2024-09-12T16:48:12.192 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T16:48:12.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T16:48:12.328 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902701 branch: wip-rgw-meta-handlers description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: null first_in_suite: false job_id: '7902701' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rgw-meta-handlers ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw d3n l1 datacache persistent path: /tmp/rgw_datacache/ rgw d3n l1 datacache size: 10737418240 rgw d3n l1 local datacache enabled: true rgw enable ops log: true rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 rgw override bucket index max shards: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 valgrind: - --tool=memcheck - --max-threads=1024 compression type: random datacache: true datacache_path: /tmp/rgw_datacache ec-data-pool: false frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 s3 tenant: RGW33333333333333333 force-branch: ceph-master storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rgw-meta-handlers sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 6279 sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b sleep_before_teardown: 0 suite: rgw suite_branch: wip-rgw-meta-handlers suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b targets: smithi067.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPIY3vW9sml6xptAv9FZNYzf42uLElOlnkcZEIhtjP+RqcLasGEGYVBcTd+0gDKF7mIP8QauJ3vFqUPLfrfzy4g= smithi118.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPrLrc+MiZoLcgItTtqSnEilxEYNgyUO+Me23djz2bV/qr/1kjm+mAjxdr/WScVk2tBbLtz6doIobFh7mRWyAtU= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-datacache.sh env: RGW_DATACACHE_PATH: /tmp/rgw_datacache - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-12_15:39:52 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T16:48:12.328 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa; will attempt to use it 2024-09-12T16:48:12.329 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa/tasks 2024-09-12T16:48:12.329 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T16:48:12.330 INFO:teuthology.task.internal:Checking packages... 2024-09-12T16:48:12.351 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bad475c18c96ec20c5778159aa33ba72b84e9c1b' 2024-09-12T16:48:12.352 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T16:48:12.352 INFO:teuthology.packaging:ref: None 2024-09-12T16:48:12.352 INFO:teuthology.packaging:tag: None 2024-09-12T16:48:12.352 INFO:teuthology.packaging:branch: wip-rgw-meta-handlers 2024-09-12T16:48:12.352 INFO:teuthology.packaging:sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T16:48:12.352 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rgw-meta-handlers 2024-09-12T16:48:12.510 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4762.gbad475c1 2024-09-12T16:48:12.511 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T16:48:12.518 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T16:48:12.518 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T16:48:12.565 INFO:teuthology.task.internal:Saving configuration 2024-09-12T16:48:12.582 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T16:48:12.590 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T16:48:12.616 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902701', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 16:42:39.282776', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPIY3vW9sml6xptAv9FZNYzf42uLElOlnkcZEIhtjP+RqcLasGEGYVBcTd+0gDKF7mIP8QauJ3vFqUPLfrfzy4g='} 2024-09-12T16:48:12.637 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902701', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 16:42:39.284838', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPrLrc+MiZoLcgItTtqSnEilxEYNgyUO+Me23djz2bV/qr/1kjm+mAjxdr/WScVk2tBbLtz6doIobFh7mRWyAtU='} 2024-09-12T16:48:12.638 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T16:48:12.644 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T16:48:12.645 INFO:teuthology.task.internal:roles: ubuntu@smithi118.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T16:48:12.645 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T16:48:12.706 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa5147b7ac0>, signals=[15]) 2024-09-12T16:48:12.706 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T16:48:12.712 INFO:teuthology.task.internal:Opening connections... 2024-09-12T16:48:12.713 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi067.front.sepia.ceph.com 2024-09-12T16:48:12.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:48:12.796 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi118.front.sepia.ceph.com 2024-09-12T16:48:12.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:48:12.872 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T16:48:12.879 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2024-09-12T16:48:12.897 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2024-09-12T16:48:12.898 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2024-09-12T16:48:12.955 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream" 2024-09-12T16:48:12.955 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="9" 2024-09-12T16:48:12.955 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos" 2024-09-12T16:48:12.955 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora" 2024-09-12T16:48:12.955 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="9" 2024-09-12T16:48:12.955 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el9" 2024-09-12T16:48:12.955 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T16:48:12.956 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2024-09-12T16:48:12.956 INFO:teuthology.orchestra.run.smithi067.stdout:LOGO="fedora-logo-icon" 2024-09-12T16:48:12.956 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T16:48:12.956 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/" 2024-09-12T16:48:12.956 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T16:48:12.956 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T16:48:12.956 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T16:48:12.957 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2024-09-12T16:48:12.977 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2024-09-12T16:48:12.995 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2024-09-12T16:48:12.995 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2024-09-12T16:48:13.053 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream" 2024-09-12T16:48:13.053 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="9" 2024-09-12T16:48:13.053 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos" 2024-09-12T16:48:13.054 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora" 2024-09-12T16:48:13.054 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="9" 2024-09-12T16:48:13.054 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el9" 2024-09-12T16:48:13.054 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T16:48:13.054 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2024-09-12T16:48:13.054 INFO:teuthology.orchestra.run.smithi118.stdout:LOGO="fedora-logo-icon" 2024-09-12T16:48:13.054 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T16:48:13.054 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/" 2024-09-12T16:48:13.054 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T16:48:13.054 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T16:48:13.054 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T16:48:13.055 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2024-09-12T16:48:13.077 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T16:48:13.087 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T16:48:13.092 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T16:48:13.093 DEBUG:teuthology.orchestra.run.smithi067:> test '!' -e /home/ubuntu/cephtest 2024-09-12T16:48:13.095 DEBUG:teuthology.orchestra.run.smithi118:> test '!' -e /home/ubuntu/cephtest 2024-09-12T16:48:13.112 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T16:48:13.118 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T16:48:13.118 DEBUG:teuthology.orchestra.run.smithi067:> test -z $(ls -A /var/lib/ceph) 2024-09-12T16:48:13.151 DEBUG:teuthology.orchestra.run.smithi118:> test -z $(ls -A /var/lib/ceph) 2024-09-12T16:48:13.171 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T16:48:13.225 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T16:48:13.242 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T16:48:13.242 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T16:48:13.242 DEBUG:teuthology.orchestra.run.smithi067:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T16:48:13.243 DEBUG:teuthology.orchestra.run.smithi118:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T16:48:13.258 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:48:13.259 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2024-09-12T16:48:13.260 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:48:13.260 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2024-09-12T16:48:13.316 INFO:teuthology.orchestra.run.smithi067.stdout:5.14.0-503.el9.x86_64 2024-09-12T16:48:13.316 INFO:teuthology.task.kernel:Running kernel on smithi067: 5.14.0-503.el9.x86_64 2024-09-12T16:48:13.316 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum install -y kernel 2024-09-12T16:48:13.317 INFO:teuthology.orchestra.run.smithi118.stdout:5.14.0-503.el9.x86_64 2024-09-12T16:48:13.317 INFO:teuthology.task.kernel:Running kernel on smithi118: 5.14.0-503.el9.x86_64 2024-09-12T16:48:13.317 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum install -y kernel 2024-09-12T16:48:15.951 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-12T16:48:18.775 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 8.2 MB 00:03 2024-09-12T16:48:21.567 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 20 MB 00:04 2024-09-12T16:48:25.985 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-12T16:48:28.377 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 19 kB 00:01 2024-09-12T16:48:29.506 INFO:teuthology.orchestra.run.smithi118.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-12T16:48:34.987 INFO:teuthology.orchestra.run.smithi118.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T16:48:36.943 INFO:teuthology.orchestra.run.smithi118.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T16:48:36.943 INFO:teuthology.orchestra.run.smithi118.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T16:48:37.042 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-12T16:48:37.053 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-12T16:48:37.053 INFO:teuthology.orchestra.run.smithi118.stdout: Package Architecture Version Repository Size 2024-09-12T16:48:37.053 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-12T16:48:37.053 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2024-09-12T16:48:37.053 INFO:teuthology.orchestra.run.smithi118.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T16:48:37.053 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2024-09-12T16:48:37.053 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T16:48:37.053 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T16:48:37.054 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T16:48:37.054 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:48:37.054 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-09-12T16:48:37.054 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-12T16:48:37.054 INFO:teuthology.orchestra.run.smithi118.stdout:Install 4 Packages 2024-09-12T16:48:37.054 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:48:37.054 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 79 M 2024-09-12T16:48:37.054 INFO:teuthology.orchestra.run.smithi118.stdout:Installed size: 126 M 2024-09-12T16:48:37.054 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-09-12T16:48:37.296 INFO:teuthology.orchestra.run.smithi118.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 205 kB/s | 23 kB 00:00 2024-09-12T16:48:37.822 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 20 MB 00:17 2024-09-12T16:48:42.414 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - CRB 9.8 MB/s | 6.5 MB 00:00 2024-09-12T16:48:43.429 INFO:teuthology.orchestra.run.smithi118.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 4.7 MB/s | 29 MB 00:06 2024-09-12T16:48:43.729 INFO:teuthology.orchestra.run.smithi118.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 2.4 MB/s | 16 MB 00:06 2024-09-12T16:48:45.083 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 19 kB 00:01 2024-09-12T16:48:45.811 INFO:teuthology.orchestra.run.smithi067.stdout:Extra Packages for Enterprise Linux 38 MB/s | 23 MB 00:00 2024-09-12T16:48:51.492 INFO:teuthology.orchestra.run.smithi067.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-12T16:48:53.557 INFO:teuthology.orchestra.run.smithi067.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T16:48:53.558 INFO:teuthology.orchestra.run.smithi067.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T16:48:53.645 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-09-12T16:48:53.651 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-09-12T16:48:53.651 INFO:teuthology.orchestra.run.smithi067.stdout: Package Architecture Version Repository Size 2024-09-12T16:48:53.651 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-09-12T16:48:53.651 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-09-12T16:48:53.651 INFO:teuthology.orchestra.run.smithi067.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T16:48:53.651 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2024-09-12T16:48:53.651 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T16:48:53.651 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T16:48:53.652 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T16:48:53.652 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:48:53.652 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-09-12T16:48:53.652 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-09-12T16:48:53.652 INFO:teuthology.orchestra.run.smithi067.stdout:Install 4 Packages 2024-09-12T16:48:53.652 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:48:53.652 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 79 M 2024-09-12T16:48:53.653 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 126 M 2024-09-12T16:48:53.653 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-09-12T16:48:53.868 INFO:teuthology.orchestra.run.smithi067.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 249 kB/s | 23 kB 00:00 2024-09-12T16:48:54.778 INFO:teuthology.orchestra.run.smithi118.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 2.0 MB/s | 35 MB 00:17 2024-09-12T16:48:54.779 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:48:54.779 INFO:teuthology.orchestra.run.smithi118.stdout:Total 4.4 MB/s | 79 MB 00:17 2024-09-12T16:48:55.463 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-09-12T16:48:56.030 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-09-12T16:48:56.030 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-09-12T16:48:56.118 INFO:teuthology.orchestra.run.smithi067.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 6.7 MB/s | 16 MB 00:02 2024-09-12T16:48:57.007 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-09-12T16:48:57.007 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-09-12T16:48:58.793 INFO:teuthology.orchestra.run.smithi067.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 5.8 MB/s | 29 MB 00:04 2024-09-12T16:48:59.102 INFO:teuthology.orchestra.run.smithi067.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 6.5 MB/s | 35 MB 00:05 2024-09-12T16:48:59.102 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:48:59.102 INFO:teuthology.orchestra.run.smithi067.stdout:Total 14 MB/s | 79 MB 00:05 2024-09-12T16:48:59.453 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-09-12T16:48:59.810 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-09-12T16:49:00.191 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-09-12T16:49:00.191 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-09-12T16:49:00.454 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T16:49:00.553 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T16:49:01.197 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-09-12T16:49:01.198 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-09-12T16:49:03.350 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T16:49:03.509 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T16:49:03.769 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-09-12T16:49:04.428 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T16:49:04.519 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T16:49:07.307 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T16:49:07.440 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T16:49:08.326 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T16:49:08.443 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:49:12.558 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T16:49:12.598 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:49:13.290 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:49:17.741 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:49:52.322 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:49:52.362 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:49:52.660 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:49:52.660 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T16:49:52.660 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T16:49:52.660 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T16:49:53.482 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:49:53.482 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:49:53.482 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2024-09-12T16:49:53.482 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T16:49:53.482 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T16:49:53.482 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T16:49:53.482 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T16:49:53.482 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:49:53.482 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-12T16:49:53.886 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T16:49:53.969 INFO:teuthology.orchestra.run.smithi118.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T16:49:53.969 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T16:49:53.969 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T16:49:53.969 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T16:49:53.969 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T16:49:53.970 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T16:49:53.970 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi118.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T16:49:53.970 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T16:49:54.027 INFO:teuthology.orchestra.run.smithi118.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T16:49:54.028 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T16:49:54.028 DEBUG:teuthology.orchestra.run.smithi118:> sudo rpm -qi grub2-tools 2024-09-12T16:49:54.067 INFO:teuthology.orchestra.run.smithi118.stdout:Name : grub2-tools 2024-09-12T16:49:54.067 INFO:teuthology.orchestra.run.smithi118.stdout:Epoch : 1 2024-09-12T16:49:54.067 INFO:teuthology.orchestra.run.smithi118.stdout:Version : 2.06 2024-09-12T16:49:54.067 INFO:teuthology.orchestra.run.smithi118.stdout:Release : 82.el9 2024-09-12T16:49:54.067 INFO:teuthology.orchestra.run.smithi118.stdout:Architecture: x86_64 2024-09-12T16:49:54.067 INFO:teuthology.orchestra.run.smithi118.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T16:49:54.067 INFO:teuthology.orchestra.run.smithi118.stdout:Group : Unspecified 2024-09-12T16:49:54.067 INFO:teuthology.orchestra.run.smithi118.stdout:Size : 8274670 2024-09-12T16:49:54.068 INFO:teuthology.orchestra.run.smithi118.stdout:License : GPLv3+ 2024-09-12T16:49:54.068 INFO:teuthology.orchestra.run.smithi118.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T16:49:54.068 INFO:teuthology.orchestra.run.smithi118.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T16:49:54.068 INFO:teuthology.orchestra.run.smithi118.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T16:49:54.068 INFO:teuthology.orchestra.run.smithi118.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T16:49:54.068 INFO:teuthology.orchestra.run.smithi118.stdout:Packager : builder@centos.org 2024-09-12T16:49:54.068 INFO:teuthology.orchestra.run.smithi118.stdout:Vendor : CentOS 2024-09-12T16:49:54.068 INFO:teuthology.orchestra.run.smithi118.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T16:49:54.068 INFO:teuthology.orchestra.run.smithi118.stdout:Summary : Support tools for GRUB. 2024-09-12T16:49:54.068 INFO:teuthology.orchestra.run.smithi118.stdout:Description : 2024-09-12T16:49:54.068 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:49:54.068 INFO:teuthology.orchestra.run.smithi118.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T16:49:54.068 INFO:teuthology.orchestra.run.smithi118.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T16:49:54.069 INFO:teuthology.orchestra.run.smithi118.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T16:49:54.069 INFO:teuthology.orchestra.run.smithi118.stdout:hardware devices. 2024-09-12T16:49:54.069 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:49:54.069 INFO:teuthology.orchestra.run.smithi118.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T16:49:54.070 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T16:49:54.070 INFO:teuthology.task.kernel:Updating grub on smithi118 to boot 5.14.0-505.el9.x86_64 2024-09-12T16:49:54.070 DEBUG:teuthology.orchestra.run.smithi118:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T16:49:54.718 INFO:teuthology.orchestra.run.smithi118.stderr:Generating grub configuration file ... 2024-09-12T16:49:55.983 INFO:teuthology.orchestra.run.smithi118.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T16:49:56.015 INFO:teuthology.orchestra.run.smithi118.stderr:done 2024-09-12T16:49:56.017 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2024-09-12T16:49:56.032 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.njVsl5o51c 2024-09-12T16:49:56.033 DEBUG:teuthology.orchestra.run.smithi118:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.njVsl5o51c 2024-09-12T16:49:56.100 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.njVsl5o51c 2024-09-12T16:49:56.245 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.njVsl5o51c is 6KB 2024-09-12T16:49:56.292 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.njVsl5o51c 2024-09-12T16:49:56.307 DEBUG:teuthology.orchestra.run.smithi118:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T16:49:56.370 INFO:teuthology.orchestra.run.smithi118.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T16:49:56.370 INFO:teuthology.orchestra.run.smithi118.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T16:49:56.370 INFO:teuthology.orchestra.run.smithi118.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T16:49:56.370 INFO:teuthology.orchestra.run.smithi118.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T16:49:56.371 DEBUG:teuthology.orchestra.run.smithi118:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T16:49:56.512 DEBUG:teuthology.orchestra.run.smithi118:> sudo shutdown -r now 2024-09-12T16:49:56.824 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:49:56.865 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:49:57.228 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:49:57.228 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T16:49:57.228 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T16:49:57.229 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T16:49:58.073 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:49:58.074 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:49:58.074 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-09-12T16:49:58.074 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T16:49:58.074 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T16:49:58.074 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T16:49:58.074 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T16:49:58.074 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:49:58.074 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-09-12T16:49:58.418 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T16:49:58.505 INFO:teuthology.orchestra.run.smithi067.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T16:49:58.505 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T16:49:58.505 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T16:49:58.505 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T16:49:58.506 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T16:49:58.506 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T16:49:58.506 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi067.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T16:49:58.506 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T16:49:58.564 INFO:teuthology.orchestra.run.smithi067.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T16:49:58.565 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T16:49:58.565 DEBUG:teuthology.orchestra.run.smithi067:> sudo rpm -qi grub2-tools 2024-09-12T16:49:58.601 INFO:teuthology.orchestra.run.smithi067.stdout:Name : grub2-tools 2024-09-12T16:49:58.601 INFO:teuthology.orchestra.run.smithi067.stdout:Epoch : 1 2024-09-12T16:49:58.601 INFO:teuthology.orchestra.run.smithi067.stdout:Version : 2.06 2024-09-12T16:49:58.602 INFO:teuthology.orchestra.run.smithi067.stdout:Release : 82.el9 2024-09-12T16:49:58.602 INFO:teuthology.orchestra.run.smithi067.stdout:Architecture: x86_64 2024-09-12T16:49:58.602 INFO:teuthology.orchestra.run.smithi067.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T16:49:58.602 INFO:teuthology.orchestra.run.smithi067.stdout:Group : Unspecified 2024-09-12T16:49:58.602 INFO:teuthology.orchestra.run.smithi067.stdout:Size : 8274670 2024-09-12T16:49:58.602 INFO:teuthology.orchestra.run.smithi067.stdout:License : GPLv3+ 2024-09-12T16:49:58.602 INFO:teuthology.orchestra.run.smithi067.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T16:49:58.602 INFO:teuthology.orchestra.run.smithi067.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T16:49:58.602 INFO:teuthology.orchestra.run.smithi067.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T16:49:58.602 INFO:teuthology.orchestra.run.smithi067.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T16:49:58.602 INFO:teuthology.orchestra.run.smithi067.stdout:Packager : builder@centos.org 2024-09-12T16:49:58.602 INFO:teuthology.orchestra.run.smithi067.stdout:Vendor : CentOS 2024-09-12T16:49:58.603 INFO:teuthology.orchestra.run.smithi067.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T16:49:58.603 INFO:teuthology.orchestra.run.smithi067.stdout:Summary : Support tools for GRUB. 2024-09-12T16:49:58.603 INFO:teuthology.orchestra.run.smithi067.stdout:Description : 2024-09-12T16:49:58.603 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:49:58.603 INFO:teuthology.orchestra.run.smithi067.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T16:49:58.603 INFO:teuthology.orchestra.run.smithi067.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T16:49:58.603 INFO:teuthology.orchestra.run.smithi067.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T16:49:58.603 INFO:teuthology.orchestra.run.smithi067.stdout:hardware devices. 2024-09-12T16:49:58.603 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:49:58.603 INFO:teuthology.orchestra.run.smithi067.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T16:49:58.605 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T16:49:58.605 INFO:teuthology.task.kernel:Updating grub on smithi067 to boot 5.14.0-505.el9.x86_64 2024-09-12T16:49:58.605 DEBUG:teuthology.orchestra.run.smithi067:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T16:49:59.208 INFO:teuthology.orchestra.run.smithi067.stderr:Generating grub configuration file ... 2024-09-12T16:50:00.516 INFO:teuthology.orchestra.run.smithi067.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T16:50:00.542 INFO:teuthology.orchestra.run.smithi067.stderr:done 2024-09-12T16:50:00.544 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2024-09-12T16:50:00.560 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.SADUe63371 2024-09-12T16:50:00.560 DEBUG:teuthology.orchestra.run.smithi067:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.SADUe63371 2024-09-12T16:50:00.638 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.SADUe63371 2024-09-12T16:50:00.834 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.SADUe63371 is 6KB 2024-09-12T16:50:00.882 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.SADUe63371 2024-09-12T16:50:00.898 DEBUG:teuthology.orchestra.run.smithi067:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T16:50:00.966 INFO:teuthology.orchestra.run.smithi067.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T16:50:00.966 INFO:teuthology.orchestra.run.smithi067.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T16:50:00.966 INFO:teuthology.orchestra.run.smithi067.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T16:50:00.967 INFO:teuthology.orchestra.run.smithi067.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T16:50:00.968 DEBUG:teuthology.orchestra.run.smithi067:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T16:50:01.107 DEBUG:teuthology.orchestra.run.smithi067:> sudo shutdown -r now 2024-09-12T16:50:26.540 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T16:50:26.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-12T16:50:26.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:50:31.113 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T16:50:31.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-12T16:50:31.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:51:01.053 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-09-12T16:51:05.661 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-09-12T16:51:10.057 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-12T16:51:10.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:51:14.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-12T16:51:14.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:51:33.053 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-09-12T16:51:45.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-12T16:51:45.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:51:45.405 DEBUG:teuthology.orchestra.run.smithi067:> true 2024-09-12T16:51:45.895 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-12T16:51:45.895 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-12T16:51:45.895 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2024-09-12T16:51:45.911 INFO:teuthology.orchestra.run.smithi067.stdout:5.14.0-505.el9.x86_64 2024-09-12T16:51:45.911 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T16:51:45.911 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T16:51:45.911 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T16:51:46.913 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T16:51:46.913 DEBUG:teuthology.orchestra.run.smithi067:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T16:51:46.998 INFO:teuthology.orchestra.run.smithi067.stdout:ttyS1 2024-09-12T16:51:47.022 DEBUG:teuthology.parallel:result is None 2024-09-12T16:52:10.060 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T16:52:22.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-12T16:52:22.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:52:22.397 DEBUG:teuthology.orchestra.run.smithi118:> true 2024-09-12T16:52:22.747 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-12T16:52:22.748 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-12T16:52:22.748 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2024-09-12T16:52:22.766 INFO:teuthology.orchestra.run.smithi118.stdout:5.14.0-505.el9.x86_64 2024-09-12T16:52:22.766 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T16:52:22.766 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T16:52:22.767 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T16:52:23.768 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T16:52:23.768 DEBUG:teuthology.orchestra.run.smithi118:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T16:52:23.846 INFO:teuthology.orchestra.run.smithi118.stdout:ttyS1 2024-09-12T16:52:23.867 DEBUG:teuthology.parallel:result is None 2024-09-12T16:52:23.867 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T16:52:23.875 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T16:52:23.875 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T16:52:23.878 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T16:52:23.897 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T16:52:23.903 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T16:52:23.910 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T16:52:23.911 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T16:52:23.939 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T16:52:23.986 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T16:52:23.993 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T16:52:23.993 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T16:52:24.007 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T16:52:24.038 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T16:52:24.043 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T16:52:24.050 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T16:52:24.054 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T16:52:24.056 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T16:52:24.063 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T16:52:24.064 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T16:52:24.095 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T16:52:24.125 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T16:52:24.133 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T16:52:24.134 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T16:52:24.165 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T16:52:24.182 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T16:52:24.267 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T16:52:24.322 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T16:52:24.405 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T16:52:24.450 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T16:52:24.450 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T16:52:24.518 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T16:52:24.563 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T16:52:24.620 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T16:52:24.706 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T16:52:24.751 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-12T16:52:24.751 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T16:52:24.821 DEBUG:teuthology.orchestra.run.smithi067:> sudo service rsyslog restart 2024-09-12T16:52:24.824 DEBUG:teuthology.orchestra.run.smithi118:> sudo service rsyslog restart 2024-09-12T16:52:24.873 INFO:teuthology.orchestra.run.smithi067.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T16:52:24.914 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T16:52:25.348 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T16:52:25.356 INFO:teuthology.task.internal:Starting timer... 2024-09-12T16:52:25.356 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T16:52:25.366 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T16:52:25.376 DEBUG:teuthology.orchestra.run.smithi067:> sudo service auditd rotate 2024-09-12T16:52:25.448 INFO:teuthology.orchestra.run.smithi067.stdout:Rotating logs: 2024-09-12T16:52:25.450 DEBUG:teuthology.orchestra.run.smithi118:> sudo service auditd rotate 2024-09-12T16:52:25.521 INFO:teuthology.orchestra.run.smithi118.stdout:Rotating logs: 2024-09-12T16:52:25.523 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T16:52:25.524 DEBUG:teuthology.orchestra.run.smithi067:> /usr/sbin/getenforce 2024-09-12T16:52:25.546 INFO:teuthology.orchestra.run.smithi067.stdout:Permissive 2024-09-12T16:52:25.546 DEBUG:teuthology.orchestra.run.smithi118:> /usr/sbin/getenforce 2024-09-12T16:52:25.567 INFO:teuthology.orchestra.run.smithi118.stdout:Permissive 2024-09-12T16:52:25.567 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi067.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi118.front.sepia.ceph.com': 'permissive'} 2024-09-12T16:52:25.567 DEBUG:teuthology.orchestra.run.smithi067:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T16:52:25.616 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:52:25.616 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T16:52:25.643 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:52:25.644 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T16:52:25.644 DEBUG:teuthology.orchestra.run.smithi067:> sudo /usr/sbin/setenforce permissive 2024-09-12T16:52:25.691 DEBUG:teuthology.orchestra.run.smithi118:> sudo /usr/sbin/setenforce permissive 2024-09-12T16:52:25.720 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T16:52:25.729 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T16:52:25.741 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T16:52:25.779 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi067.front.sepia.ceph.com,smithi118.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T16:56:16.212 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi067.front.sepia.ceph.com'), Remote(name='ubuntu@smithi118.front.sepia.ceph.com')] 2024-09-12T16:56:16.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-12T16:56:16.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:56:16.304 DEBUG:teuthology.orchestra.run.smithi067:> true 2024-09-12T16:56:16.389 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-12T16:56:16.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-12T16:56:16.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:56:16.465 DEBUG:teuthology.orchestra.run.smithi118:> true 2024-09-12T16:56:16.549 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-12T16:56:16.550 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T16:56:16.559 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T16:56:16.560 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T16:56:16.560 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T16:56:16.564 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T16:56:16.564 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T16:56:16.594 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T16:56:16.609 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T16:56:16.620 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T16:56:16.634 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T16:56:16.635 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: ntpd: command not found 2024-09-12T16:56:16.647 INFO:teuthology.orchestra.run.smithi067.stdout:506 Cannot talk to daemon 2024-09-12T16:56:16.659 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: ntpd: command not found 2024-09-12T16:56:16.662 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T16:56:16.670 INFO:teuthology.orchestra.run.smithi118.stdout:506 Cannot talk to daemon 2024-09-12T16:56:16.676 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T16:56:16.684 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T16:56:16.698 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T16:56:16.735 INFO:teuthology.orchestra.run.smithi067.stderr:bash: line 1: ntpq: command not found 2024-09-12T16:56:16.738 INFO:teuthology.orchestra.run.smithi067.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T16:56:16.738 INFO:teuthology.orchestra.run.smithi067.stdout:=============================================================================== 2024-09-12T16:56:16.738 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T16:56:16.738 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T16:56:16.738 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T16:56:16.738 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T16:56:16.752 INFO:teuthology.orchestra.run.smithi118.stderr:bash: line 1: ntpq: command not found 2024-09-12T16:56:16.755 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T16:56:16.755 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2024-09-12T16:56:16.755 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T16:56:16.755 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T16:56:16.755 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T16:56:16.755 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T16:56:16.756 INFO:teuthology.run_tasks:Running task install... 2024-09-12T16:56:16.764 DEBUG:teuthology.task.install:project ceph 2024-09-12T16:56:16.764 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}} 2024-09-12T16:56:16.764 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'} 2024-09-12T16:56:16.764 INFO:teuthology.task.install:Using flavor: default 2024-09-12T16:56:16.770 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T16:56:16.770 INFO:teuthology.task.install:extra packages: [] 2024-09-12T16:56:16.770 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'tag': None, 'wait_for_package': False} 2024-09-12T16:56:16.771 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T16:56:16.773 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'tag': None, 'wait_for_package': False} 2024-09-12T16:56:16.773 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T16:56:16.918 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/ 2024-09-12T16:56:16.918 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4762.gbad475c1 2024-09-12T16:56:16.929 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/ 2024-09-12T16:56:16.929 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4762.gbad475c1 2024-09-12T16:56:17.025 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T16:56:17.025 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-12T16:56:17.026 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T16:56:17.035 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T16:56:17.035 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T16:56:17.035 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T16:56:17.052 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-12T16:56:17.052 DEBUG:teuthology.orchestra.run.smithi118:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bad475c18c96ec20c5778159aa33ba72b84e9c1b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T16:56:17.062 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-12T16:56:17.062 DEBUG:teuthology.orchestra.run.smithi067:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bad475c18c96ec20c5778159aa33ba72b84e9c1b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T16:56:17.118 DEBUG:teuthology.orchestra.run.smithi118:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T16:56:17.129 DEBUG:teuthology.orchestra.run.smithi067:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T16:56:17.193 DEBUG:teuthology.orchestra.run.smithi118:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T16:56:17.206 DEBUG:teuthology.orchestra.run.smithi067:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T16:56:17.259 INFO:teuthology.orchestra.run.smithi118.stdout:check_obsoletes = 1 2024-09-12T16:56:17.261 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum clean all 2024-09-12T16:56:17.272 INFO:teuthology.orchestra.run.smithi067.stdout:check_obsoletes = 1 2024-09-12T16:56:17.274 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum clean all 2024-09-12T16:56:17.490 INFO:teuthology.orchestra.run.smithi118.stdout:45 files removed 2024-09-12T16:56:17.507 INFO:teuthology.orchestra.run.smithi067.stdout:45 files removed 2024-09-12T16:56:17.516 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-12T16:56:17.534 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-12T16:56:18.075 INFO:teuthology.orchestra.run.smithi118.stdout:ceph packages for x86_64 306 kB/s | 84 kB 00:00 2024-09-12T16:56:18.107 INFO:teuthology.orchestra.run.smithi067.stdout:ceph packages for x86_64 309 kB/s | 84 kB 00:00 2024-09-12T16:56:18.367 INFO:teuthology.orchestra.run.smithi118.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-12T16:56:18.399 INFO:teuthology.orchestra.run.smithi067.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-12T16:56:18.634 INFO:teuthology.orchestra.run.smithi118.stdout:ceph source packages 8.4 kB/s | 1.9 kB 00:00 2024-09-12T16:56:18.675 INFO:teuthology.orchestra.run.smithi067.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-12T16:56:20.368 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.2 MB 00:01 2024-09-12T16:56:20.527 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.2 MB 00:01 2024-09-12T16:56:23.551 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:02 2024-09-12T16:56:23.861 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - AppStream 9.1 MB/s | 20 MB 00:02 2024-09-12T16:56:28.353 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - CRB 9.8 MB/s | 6.5 MB 00:00 2024-09-12T16:56:29.879 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 19 kB 00:00 2024-09-12T16:56:30.692 INFO:teuthology.orchestra.run.smithi118.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-12T16:56:31.801 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - CRB 1.5 MB/s | 6.5 MB 00:04 2024-09-12T16:56:33.338 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 19 kB 00:00 2024-09-12T16:56:34.108 INFO:teuthology.orchestra.run.smithi067.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-12T16:56:36.097 INFO:teuthology.orchestra.run.smithi118.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-12T16:56:38.452 INFO:teuthology.orchestra.run.smithi118.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T16:56:38.453 INFO:teuthology.orchestra.run.smithi118.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T16:56:38.548 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-12T16:56:38.581 INFO:teuthology.orchestra.run.smithi118.stdout:====================================================================================================== 2024-09-12T16:56:38.582 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2024-09-12T16:56:38.582 INFO:teuthology.orchestra.run.smithi118.stdout:====================================================================================================== 2024-09-12T16:56:38.582 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2024-09-12T16:56:38.582 INFO:teuthology.orchestra.run.smithi118.stdout: ceph x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 6.6 k 2024-09-12T16:56:38.582 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T16:56:38.582 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 900 k 2024-09-12T16:56:38.582 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 145 k 2024-09-12T16:56:38.582 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 1.5 M 2024-09-12T16:56:38.582 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 154 k 2024-09-12T16:56:38.582 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 14 M 2024-09-12T16:56:38.583 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 7.4 M 2024-09-12T16:56:38.583 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 49 k 2024-09-12T16:56:38.583 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 11 M 2024-09-12T16:56:38.583 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 M 2024-09-12T16:56:38.583 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-volume noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 285 k 2024-09-12T16:56:38.583 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 783 k 2024-09-12T16:56:38.583 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 32 k 2024-09-12T16:56:38.583 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 756 k 2024-09-12T16:56:38.583 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 126 k 2024-09-12T16:56:38.583 INFO:teuthology.orchestra.run.smithi118.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-12T16:56:38.583 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T16:56:38.583 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 321 k 2024-09-12T16:56:38.584 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 305 k 2024-09-12T16:56:38.584 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 99 k 2024-09-12T16:56:38.584 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 85 k 2024-09-12T16:56:38.584 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T16:56:38.584 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 170 k 2024-09-12T16:56:38.584 INFO:teuthology.orchestra.run.smithi118.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-12T16:56:38.584 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrading: 2024-09-12T16:56:38.584 INFO:teuthology.orchestra.run.smithi118.stdout: librados2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.5 M 2024-09-12T16:56:38.584 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T16:56:38.584 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2024-09-12T16:56:38.584 INFO:teuthology.orchestra.run.smithi118.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-12T16:56:38.584 INFO:teuthology.orchestra.run.smithi118.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T16:56:38.585 INFO:teuthology.orchestra.run.smithi118.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-12T16:56:38.585 INFO:teuthology.orchestra.run.smithi118.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-12T16:56:38.585 INFO:teuthology.orchestra.run.smithi118.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-12T16:56:38.585 INFO:teuthology.orchestra.run.smithi118.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-12T16:56:38.585 INFO:teuthology.orchestra.run.smithi118.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-12T16:56:38.585 INFO:teuthology.orchestra.run.smithi118.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-12T16:56:38.585 INFO:teuthology.orchestra.run.smithi118.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-12T16:56:38.585 INFO:teuthology.orchestra.run.smithi118.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-12T16:56:38.585 INFO:teuthology.orchestra.run.smithi118.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-12T16:56:38.585 INFO:teuthology.orchestra.run.smithi118.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-12T16:56:38.585 INFO:teuthology.orchestra.run.smithi118.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-12T16:56:38.585 INFO:teuthology.orchestra.run.smithi118.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-12T16:56:38.586 INFO:teuthology.orchestra.run.smithi118.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-12T16:56:38.586 INFO:teuthology.orchestra.run.smithi118.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T16:56:38.586 INFO:teuthology.orchestra.run.smithi118.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-12T16:56:38.586 INFO:teuthology.orchestra.run.smithi118.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-12T16:56:38.586 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 22 M 2024-09-12T16:56:38.586 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 34 k 2024-09-12T16:56:38.586 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 2.4 M 2024-09-12T16:56:38.586 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 291 k 2024-09-12T16:56:38.586 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 4.8 M 2024-09-12T16:56:38.586 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 17 M 2024-09-12T16:56:38.586 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 16 k 2024-09-12T16:56:38.587 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 25 k 2024-09-12T16:56:38.587 INFO:teuthology.orchestra.run.smithi118.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-12T16:56:38.587 INFO:teuthology.orchestra.run.smithi118.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-12T16:56:38.587 INFO:teuthology.orchestra.run.smithi118.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-12T16:56:38.587 INFO:teuthology.orchestra.run.smithi118.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-12T16:56:38.587 INFO:teuthology.orchestra.run.smithi118.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-12T16:56:38.587 INFO:teuthology.orchestra.run.smithi118.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-12T16:56:38.587 INFO:teuthology.orchestra.run.smithi118.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-12T16:56:38.587 INFO:teuthology.orchestra.run.smithi118.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-12T16:56:38.587 INFO:teuthology.orchestra.run.smithi118.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-12T16:56:38.587 INFO:teuthology.orchestra.run.smithi118.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-12T16:56:38.587 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T16:56:38.587 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T16:56:38.588 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T16:56:38.588 INFO:teuthology.orchestra.run.smithi118.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T16:56:38.588 INFO:teuthology.orchestra.run.smithi118.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-12T16:56:38.588 INFO:teuthology.orchestra.run.smithi118.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-12T16:56:38.588 INFO:teuthology.orchestra.run.smithi118.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-12T16:56:38.588 INFO:teuthology.orchestra.run.smithi118.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-12T16:56:38.588 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T16:56:38.588 INFO:teuthology.orchestra.run.smithi118.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-12T16:56:38.588 INFO:teuthology.orchestra.run.smithi118.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T16:56:38.588 INFO:teuthology.orchestra.run.smithi118.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-12T16:56:38.588 INFO:teuthology.orchestra.run.smithi118.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-12T16:56:38.588 INFO:teuthology.orchestra.run.smithi118.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-12T16:56:38.589 INFO:teuthology.orchestra.run.smithi118.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-12T16:56:38.589 INFO:teuthology.orchestra.run.smithi118.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-12T16:56:38.589 INFO:teuthology.orchestra.run.smithi118.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-12T16:56:38.589 INFO:teuthology.orchestra.run.smithi118.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-12T16:56:38.589 INFO:teuthology.orchestra.run.smithi118.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-12T16:56:38.589 INFO:teuthology.orchestra.run.smithi118.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-12T16:56:38.589 INFO:teuthology.orchestra.run.smithi118.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-12T16:56:38.589 INFO:teuthology.orchestra.run.smithi118.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-12T16:56:38.589 INFO:teuthology.orchestra.run.smithi118.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-12T16:56:38.589 INFO:teuthology.orchestra.run.smithi118.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-12T16:56:38.589 INFO:teuthology.orchestra.run.smithi118.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-12T16:56:38.589 INFO:teuthology.orchestra.run.smithi118.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-12T16:56:38.590 INFO:teuthology.orchestra.run.smithi118.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-12T16:56:38.590 INFO:teuthology.orchestra.run.smithi118.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-12T16:56:38.590 INFO:teuthology.orchestra.run.smithi118.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-12T16:56:38.590 INFO:teuthology.orchestra.run.smithi118.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-12T16:56:38.590 INFO:teuthology.orchestra.run.smithi118.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-12T16:56:38.590 INFO:teuthology.orchestra.run.smithi118.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-12T16:56:38.590 INFO:teuthology.orchestra.run.smithi118.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-12T16:56:38.590 INFO:teuthology.orchestra.run.smithi118.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-12T16:56:38.590 INFO:teuthology.orchestra.run.smithi118.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-12T16:56:38.590 INFO:teuthology.orchestra.run.smithi118.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-12T16:56:38.590 INFO:teuthology.orchestra.run.smithi118.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-12T16:56:38.590 INFO:teuthology.orchestra.run.smithi118.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-12T16:56:38.591 INFO:teuthology.orchestra.run.smithi118.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-12T16:56:38.591 INFO:teuthology.orchestra.run.smithi118.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-12T16:56:38.591 INFO:teuthology.orchestra.run.smithi118.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-12T16:56:38.591 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T16:56:38.591 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T16:56:38.591 INFO:teuthology.orchestra.run.smithi118.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-12T16:56:38.591 INFO:teuthology.orchestra.run.smithi118.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-12T16:56:38.591 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T16:56:38.591 INFO:teuthology.orchestra.run.smithi118.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-12T16:56:38.591 INFO:teuthology.orchestra.run.smithi118.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-12T16:56:38.591 INFO:teuthology.orchestra.run.smithi118.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-12T16:56:38.591 INFO:teuthology.orchestra.run.smithi118.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-12T16:56:38.591 INFO:teuthology.orchestra.run.smithi118.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-12T16:56:38.592 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T16:56:38.592 INFO:teuthology.orchestra.run.smithi118.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-12T16:56:38.592 INFO:teuthology.orchestra.run.smithi118.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-12T16:56:38.592 INFO:teuthology.orchestra.run.smithi118.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-12T16:56:38.592 INFO:teuthology.orchestra.run.smithi118.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-12T16:56:38.592 INFO:teuthology.orchestra.run.smithi118.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-12T16:56:38.592 INFO:teuthology.orchestra.run.smithi118.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-12T16:56:38.592 INFO:teuthology.orchestra.run.smithi118.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-12T16:56:38.592 INFO:teuthology.orchestra.run.smithi118.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-12T16:56:38.592 INFO:teuthology.orchestra.run.smithi118.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T16:56:38.592 INFO:teuthology.orchestra.run.smithi118.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-12T16:56:38.593 INFO:teuthology.orchestra.run.smithi118.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-12T16:56:38.593 INFO:teuthology.orchestra.run.smithi118.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-12T16:56:38.593 INFO:teuthology.orchestra.run.smithi118.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T16:56:38.593 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T16:56:38.593 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T16:56:38.593 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 508 k 2024-09-12T16:56:38.593 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T16:56:38.593 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T16:56:38.593 INFO:teuthology.orchestra.run.smithi118.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-12T16:56:38.593 INFO:teuthology.orchestra.run.smithi118.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-12T16:56:38.593 INFO:teuthology.orchestra.run.smithi118.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-12T16:56:38.593 INFO:teuthology.orchestra.run.smithi118.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-12T16:56:38.593 INFO:teuthology.orchestra.run.smithi118.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-12T16:56:38.594 INFO:teuthology.orchestra.run.smithi118.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-12T16:56:38.594 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T16:56:38.594 INFO:teuthology.orchestra.run.smithi118.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-12T16:56:38.594 INFO:teuthology.orchestra.run.smithi118.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-12T16:56:38.594 INFO:teuthology.orchestra.run.smithi118.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-12T16:56:38.594 INFO:teuthology.orchestra.run.smithi118.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-12T16:56:38.594 INFO:teuthology.orchestra.run.smithi118.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-12T16:56:38.594 INFO:teuthology.orchestra.run.smithi118.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-12T16:56:38.594 INFO:teuthology.orchestra.run.smithi118.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-12T16:56:38.594 INFO:teuthology.orchestra.run.smithi118.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-12T16:56:38.594 INFO:teuthology.orchestra.run.smithi118.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-12T16:56:38.594 INFO:teuthology.orchestra.run.smithi118.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-12T16:56:38.595 INFO:teuthology.orchestra.run.smithi118.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-12T16:56:38.595 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T16:56:38.595 INFO:teuthology.orchestra.run.smithi118.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T16:56:38.595 INFO:teuthology.orchestra.run.smithi118.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T16:56:38.595 INFO:teuthology.orchestra.run.smithi118.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-12T16:56:38.595 INFO:teuthology.orchestra.run.smithi118.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T16:56:38.595 INFO:teuthology.orchestra.run.smithi118.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-12T16:56:38.595 INFO:teuthology.orchestra.run.smithi118.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-12T16:56:38.595 INFO:teuthology.orchestra.run.smithi118.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-12T16:56:38.595 INFO:teuthology.orchestra.run.smithi118.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-12T16:56:38.595 INFO:teuthology.orchestra.run.smithi118.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-12T16:56:38.595 INFO:teuthology.orchestra.run.smithi118.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-12T16:56:38.595 INFO:teuthology.orchestra.run.smithi118.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-12T16:56:38.596 INFO:teuthology.orchestra.run.smithi118.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-12T16:56:38.596 INFO:teuthology.orchestra.run.smithi118.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-12T16:56:38.596 INFO:teuthology.orchestra.run.smithi118.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-12T16:56:38.596 INFO:teuthology.orchestra.run.smithi118.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-12T16:56:38.596 INFO:teuthology.orchestra.run.smithi118.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T16:56:38.596 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T16:56:38.596 INFO:teuthology.orchestra.run.smithi118.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-12T16:56:38.596 INFO:teuthology.orchestra.run.smithi118.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-12T16:56:38.596 INFO:teuthology.orchestra.run.smithi118.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-12T16:56:38.596 INFO:teuthology.orchestra.run.smithi118.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-12T16:56:38.596 INFO:teuthology.orchestra.run.smithi118.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-12T16:56:38.596 INFO:teuthology.orchestra.run.smithi118.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-12T16:56:38.596 INFO:teuthology.orchestra.run.smithi118.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T16:56:38.597 INFO:teuthology.orchestra.run.smithi118.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-12T16:56:38.597 INFO:teuthology.orchestra.run.smithi118.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-12T16:56:38.597 INFO:teuthology.orchestra.run.smithi118.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-12T16:56:38.597 INFO:teuthology.orchestra.run.smithi118.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-12T16:56:38.597 INFO:teuthology.orchestra.run.smithi118.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-12T16:56:38.597 INFO:teuthology.orchestra.run.smithi118.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-12T16:56:38.597 INFO:teuthology.orchestra.run.smithi118.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-12T16:56:38.597 INFO:teuthology.orchestra.run.smithi118.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-12T16:56:38.597 INFO:teuthology.orchestra.run.smithi118.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-12T16:56:38.597 INFO:teuthology.orchestra.run.smithi118.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-12T16:56:38.597 INFO:teuthology.orchestra.run.smithi118.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-12T16:56:38.597 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T16:56:38.597 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T16:56:38.598 INFO:teuthology.orchestra.run.smithi118.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-12T16:56:38.598 INFO:teuthology.orchestra.run.smithi118.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-12T16:56:38.598 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T16:56:38.598 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T16:56:38.598 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T16:56:38.598 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T16:56:38.598 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 k 2024-09-12T16:56:38.598 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 143 k 2024-09-12T16:56:38.598 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T16:56:38.598 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T16:56:38.598 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T16:56:38.598 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T16:56:38.598 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T16:56:38.599 INFO:teuthology.orchestra.run.smithi118.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T16:56:38.599 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T16:56:38.599 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T16:56:38.599 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T16:56:38.599 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T16:56:38.599 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T16:56:38.599 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T16:56:38.599 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T16:56:38.599 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T16:56:38.599 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T16:56:38.599 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T16:56:38.599 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T16:56:38.599 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T16:56:38.600 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T16:56:38.600 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T16:56:38.600 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T16:56:38.600 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T16:56:38.600 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T16:56:38.600 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T16:56:38.600 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T16:56:38.600 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T16:56:38.600 INFO:teuthology.orchestra.run.smithi118.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T16:56:38.600 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T16:56:38.600 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T16:56:38.600 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T16:56:38.601 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T16:56:38.601 INFO:teuthology.orchestra.run.smithi118.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T16:56:38.601 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T16:56:38.601 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T16:56:38.601 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T16:56:38.601 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T16:56:38.601 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T16:56:38.601 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T16:56:38.601 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T16:56:38.601 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T16:56:38.601 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T16:56:38.601 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T16:56:38.601 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T16:56:38.602 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T16:56:38.602 INFO:teuthology.orchestra.run.smithi118.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T16:56:38.602 INFO:teuthology.orchestra.run.smithi118.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T16:56:38.602 INFO:teuthology.orchestra.run.smithi118.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T16:56:38.602 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T16:56:38.602 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T16:56:38.602 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T16:56:38.602 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T16:56:38.602 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T16:56:38.602 INFO:teuthology.orchestra.run.smithi118.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T16:56:38.602 INFO:teuthology.orchestra.run.smithi118.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T16:56:38.602 INFO:teuthology.orchestra.run.smithi118.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-12T16:56:38.602 INFO:teuthology.orchestra.run.smithi118.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-12T16:56:38.603 INFO:teuthology.orchestra.run.smithi118.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-12T16:56:38.603 INFO:teuthology.orchestra.run.smithi118.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T16:56:38.603 INFO:teuthology.orchestra.run.smithi118.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-12T16:56:38.603 INFO:teuthology.orchestra.run.smithi118.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T16:56:38.603 INFO:teuthology.orchestra.run.smithi118.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-12T16:56:38.603 INFO:teuthology.orchestra.run.smithi118.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-12T16:56:38.603 INFO:teuthology.orchestra.run.smithi118.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-12T16:56:38.603 INFO:teuthology.orchestra.run.smithi118.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-12T16:56:38.603 INFO:teuthology.orchestra.run.smithi118.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-12T16:56:38.603 INFO:teuthology.orchestra.run.smithi118.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-12T16:56:38.603 INFO:teuthology.orchestra.run.smithi118.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-12T16:56:38.603 INFO:teuthology.orchestra.run.smithi118.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-12T16:56:38.603 INFO:teuthology.orchestra.run.smithi118.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-12T16:56:38.604 INFO:teuthology.orchestra.run.smithi118.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-12T16:56:38.604 INFO:teuthology.orchestra.run.smithi118.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-12T16:56:38.604 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T16:56:38.604 INFO:teuthology.orchestra.run.smithi118.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-12T16:56:38.604 INFO:teuthology.orchestra.run.smithi118.stdout:Installing weak dependencies: 2024-09-12T16:56:38.604 INFO:teuthology.orchestra.run.smithi118.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-12T16:56:38.604 INFO:teuthology.orchestra.run.smithi118.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-12T16:56:38.604 INFO:teuthology.orchestra.run.smithi118.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-12T16:56:38.604 INFO:teuthology.orchestra.run.smithi118.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-12T16:56:38.604 INFO:teuthology.orchestra.run.smithi118.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-12T16:56:38.604 INFO:teuthology.orchestra.run.smithi118.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-12T16:56:38.604 INFO:teuthology.orchestra.run.smithi118.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-12T16:56:38.605 INFO:teuthology.orchestra.run.smithi118.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-12T16:56:38.605 INFO:teuthology.orchestra.run.smithi118.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-12T16:56:38.605 INFO:teuthology.orchestra.run.smithi118.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-12T16:56:38.605 INFO:teuthology.orchestra.run.smithi118.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-12T16:56:38.605 INFO:teuthology.orchestra.run.smithi118.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-12T16:56:38.605 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T16:56:38.605 INFO:teuthology.orchestra.run.smithi118.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-12T16:56:38.605 INFO:teuthology.orchestra.run.smithi118.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-12T16:56:38.605 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:56:38.605 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-09-12T16:56:38.605 INFO:teuthology.orchestra.run.smithi118.stdout:====================================================================================================== 2024-09-12T16:56:38.605 INFO:teuthology.orchestra.run.smithi118.stdout:Install 283 Packages 2024-09-12T16:56:38.605 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrade 2 Packages 2024-09-12T16:56:38.605 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:56:38.606 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 322 M 2024-09-12T16:56:38.606 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-09-12T16:56:39.149 INFO:teuthology.orchestra.run.smithi118.stdout:(1/285): ceph-19.3.0-4762.gbad475c1.el9.x86_64. 49 kB/s | 6.6 kB 00:00 2024-09-12T16:56:39.486 INFO:teuthology.orchestra.run.smithi118.stdout:(2/285): ceph-fuse-19.3.0-4762.gbad475c1.el9.x8 3.9 MB/s | 900 kB 00:00 2024-09-12T16:56:39.486 INFO:teuthology.orchestra.run.smithi118.stdout:(3/285): ceph-immutable-object-cache-19.3.0-476 2.1 MB/s | 145 kB 00:00 2024-09-12T16:56:39.541 INFO:teuthology.orchestra.run.smithi118.stdout:(4/285): ceph-base-19.3.0-4762.gbad475c1.el9.x8 10 MB/s | 5.5 MB 00:00 2024-09-12T16:56:39.666 INFO:teuthology.orchestra.run.smithi118.stdout:(5/285): ceph-mgr-19.3.0-4762.gbad475c1.el9.x86 12 MB/s | 1.5 MB 00:00 2024-09-12T16:56:39.717 INFO:teuthology.orchestra.run.smithi118.stdout:(6/285): ceph-mds-19.3.0-4762.gbad475c1.el9.x86 8.6 MB/s | 2.4 MB 00:00 2024-09-12T16:56:39.731 INFO:teuthology.orchestra.run.smithi067.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-12T16:56:39.959 INFO:teuthology.orchestra.run.smithi118.stdout:(7/285): ceph-mon-19.3.0-4762.gbad475c1.el9.x86 16 MB/s | 4.8 MB 00:00 2024-09-12T16:56:40.184 INFO:teuthology.orchestra.run.smithi118.stdout:(8/285): ceph-common-19.3.0-4762.gbad475c1.el9. 18 MB/s | 22 MB 00:01 2024-09-12T16:56:40.243 INFO:teuthology.orchestra.run.smithi118.stdout:(9/285): ceph-selinux-19.3.0-4762.gbad475c1.el9 432 kB/s | 25 kB 00:00 2024-09-12T16:56:40.627 INFO:teuthology.orchestra.run.smithi118.stdout:(10/285): ceph-radosgw-19.3.0-4762.gbad475c1.el 16 MB/s | 11 MB 00:00 2024-09-12T16:56:40.693 INFO:teuthology.orchestra.run.smithi118.stdout:(11/285): libcephfs-devel-19.3.0-4762.gbad475c1 478 kB/s | 32 kB 00:00 2024-09-12T16:56:40.785 INFO:teuthology.orchestra.run.smithi118.stdout:(12/285): libcephfs2-19.3.0-4762.gbad475c1.el9. 8.1 MB/s | 756 kB 00:00 2024-09-12T16:56:40.860 INFO:teuthology.orchestra.run.smithi118.stdout:(13/285): libcephsqlite-19.3.0-4762.gbad475c1.e 2.1 MB/s | 161 kB 00:00 2024-09-12T16:56:40.938 INFO:teuthology.orchestra.run.smithi118.stdout:(14/285): librados-devel-19.3.0-4762.gbad475c1. 1.6 MB/s | 126 kB 00:00 2024-09-12T16:56:41.019 INFO:teuthology.orchestra.run.smithi118.stdout:(15/285): libradosstriper1-19.3.0-4762.gbad475c 6.0 MB/s | 508 kB 00:00 2024-09-12T16:56:41.261 INFO:teuthology.orchestra.run.smithi118.stdout:(16/285): ceph-osd-19.3.0-4762.gbad475c1.el9.x8 11 MB/s | 17 MB 00:01 2024-09-12T16:56:41.337 INFO:teuthology.orchestra.run.smithi118.stdout:(17/285): python3-ceph-argparse-19.3.0-4762.gba 604 kB/s | 45 kB 00:00 2024-09-12T16:56:41.420 INFO:teuthology.orchestra.run.smithi118.stdout:(18/285): librgw2-19.3.0-4762.gbad475c1.el9.x86 14 MB/s | 5.5 MB 00:00 2024-09-12T16:56:41.446 INFO:teuthology.orchestra.run.smithi118.stdout:(19/285): python3-ceph-common-19.3.0-4762.gbad4 1.3 MB/s | 143 kB 00:00 2024-09-12T16:56:41.488 INFO:teuthology.orchestra.run.smithi118.stdout:(20/285): python3-cephfs-19.3.0-4762.gbad475c1. 2.4 MB/s | 161 kB 00:00 2024-09-12T16:56:41.521 INFO:teuthology.orchestra.run.smithi118.stdout:(21/285): python3-rados-19.3.0-4762.gbad475c1.e 4.2 MB/s | 321 kB 00:00 2024-09-12T16:56:41.572 INFO:teuthology.orchestra.run.smithi118.stdout:(22/285): python3-rbd-19.3.0-4762.gbad475c1.el9 3.6 MB/s | 305 kB 00:00 2024-09-12T16:56:41.597 INFO:teuthology.orchestra.run.smithi118.stdout:(23/285): python3-rgw-19.3.0-4762.gbad475c1.el9 1.3 MB/s | 99 kB 00:00 2024-09-12T16:56:41.647 INFO:teuthology.orchestra.run.smithi118.stdout:(24/285): rbd-fuse-19.3.0-4762.gbad475c1.el9.x8 1.1 MB/s | 85 kB 00:00 2024-09-12T16:56:41.756 INFO:teuthology.orchestra.run.smithi118.stdout:(25/285): rbd-nbd-19.3.0-4762.gbad475c1.el9.x86 1.5 MB/s | 170 kB 00:00 2024-09-12T16:56:41.848 INFO:teuthology.orchestra.run.smithi118.stdout:(26/285): ceph-grafana-dashboards-19.3.0-4762.g 374 kB/s | 34 kB 00:00 2024-09-12T16:56:41.948 INFO:teuthology.orchestra.run.smithi118.stdout:(27/285): ceph-mgr-cephadm-19.3.0-4762.gbad475c 1.5 MB/s | 154 kB 00:00 2024-09-12T16:56:42.016 INFO:teuthology.orchestra.run.smithi118.stdout:(28/285): rbd-mirror-19.3.0-4762.gbad475c1.el9. 7.6 MB/s | 3.2 MB 00:00 2024-09-12T16:56:42.119 INFO:teuthology.orchestra.run.smithi067.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T16:56:42.120 INFO:teuthology.orchestra.run.smithi067.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T16:56:42.218 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-09-12T16:56:42.243 INFO:teuthology.orchestra.run.smithi067.stdout:====================================================================================================== 2024-09-12T16:56:42.243 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2024-09-12T16:56:42.244 INFO:teuthology.orchestra.run.smithi067.stdout:====================================================================================================== 2024-09-12T16:56:42.244 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-09-12T16:56:42.244 INFO:teuthology.orchestra.run.smithi067.stdout: ceph x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 6.6 k 2024-09-12T16:56:42.244 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T16:56:42.244 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 900 k 2024-09-12T16:56:42.244 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 145 k 2024-09-12T16:56:42.244 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 1.5 M 2024-09-12T16:56:42.244 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 154 k 2024-09-12T16:56:42.245 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 14 M 2024-09-12T16:56:42.245 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 7.4 M 2024-09-12T16:56:42.245 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 49 k 2024-09-12T16:56:42.245 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 11 M 2024-09-12T16:56:42.245 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 M 2024-09-12T16:56:42.245 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-volume noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 285 k 2024-09-12T16:56:42.245 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 783 k 2024-09-12T16:56:42.245 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 32 k 2024-09-12T16:56:42.245 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 756 k 2024-09-12T16:56:42.245 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 126 k 2024-09-12T16:56:42.245 INFO:teuthology.orchestra.run.smithi067.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-12T16:56:42.245 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T16:56:42.245 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 321 k 2024-09-12T16:56:42.246 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 305 k 2024-09-12T16:56:42.246 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 99 k 2024-09-12T16:56:42.246 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 85 k 2024-09-12T16:56:42.246 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T16:56:42.246 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 170 k 2024-09-12T16:56:42.246 INFO:teuthology.orchestra.run.smithi067.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-12T16:56:42.246 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrading: 2024-09-12T16:56:42.246 INFO:teuthology.orchestra.run.smithi067.stdout: librados2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.5 M 2024-09-12T16:56:42.246 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T16:56:42.246 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2024-09-12T16:56:42.246 INFO:teuthology.orchestra.run.smithi067.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-12T16:56:42.246 INFO:teuthology.orchestra.run.smithi067.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T16:56:42.247 INFO:teuthology.orchestra.run.smithi067.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-12T16:56:42.247 INFO:teuthology.orchestra.run.smithi067.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-12T16:56:42.247 INFO:teuthology.orchestra.run.smithi067.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-12T16:56:42.247 INFO:teuthology.orchestra.run.smithi067.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-12T16:56:42.247 INFO:teuthology.orchestra.run.smithi067.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-12T16:56:42.247 INFO:teuthology.orchestra.run.smithi067.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-12T16:56:42.247 INFO:teuthology.orchestra.run.smithi067.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-12T16:56:42.247 INFO:teuthology.orchestra.run.smithi067.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-12T16:56:42.247 INFO:teuthology.orchestra.run.smithi067.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-12T16:56:42.247 INFO:teuthology.orchestra.run.smithi067.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-12T16:56:42.247 INFO:teuthology.orchestra.run.smithi067.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-12T16:56:42.247 INFO:teuthology.orchestra.run.smithi067.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-12T16:56:42.248 INFO:teuthology.orchestra.run.smithi067.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-12T16:56:42.248 INFO:teuthology.orchestra.run.smithi067.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T16:56:42.248 INFO:teuthology.orchestra.run.smithi067.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-12T16:56:42.248 INFO:teuthology.orchestra.run.smithi067.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-12T16:56:42.248 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 22 M 2024-09-12T16:56:42.248 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 34 k 2024-09-12T16:56:42.248 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 2.4 M 2024-09-12T16:56:42.248 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 291 k 2024-09-12T16:56:42.249 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 4.8 M 2024-09-12T16:56:42.249 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 17 M 2024-09-12T16:56:42.249 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 16 k 2024-09-12T16:56:42.249 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 25 k 2024-09-12T16:56:42.249 INFO:teuthology.orchestra.run.smithi067.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-12T16:56:42.249 INFO:teuthology.orchestra.run.smithi067.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-12T16:56:42.249 INFO:teuthology.orchestra.run.smithi067.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-12T16:56:42.249 INFO:teuthology.orchestra.run.smithi067.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-12T16:56:42.249 INFO:teuthology.orchestra.run.smithi067.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-12T16:56:42.249 INFO:teuthology.orchestra.run.smithi067.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-12T16:56:42.249 INFO:teuthology.orchestra.run.smithi067.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-12T16:56:42.249 INFO:teuthology.orchestra.run.smithi067.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-12T16:56:42.250 INFO:teuthology.orchestra.run.smithi067.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-12T16:56:42.250 INFO:teuthology.orchestra.run.smithi067.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-12T16:56:42.250 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T16:56:42.250 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T16:56:42.250 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T16:56:42.250 INFO:teuthology.orchestra.run.smithi067.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T16:56:42.250 INFO:teuthology.orchestra.run.smithi067.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-12T16:56:42.250 INFO:teuthology.orchestra.run.smithi067.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-12T16:56:42.250 INFO:teuthology.orchestra.run.smithi067.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-12T16:56:42.250 INFO:teuthology.orchestra.run.smithi067.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-12T16:56:42.250 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T16:56:42.250 INFO:teuthology.orchestra.run.smithi067.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-12T16:56:42.250 INFO:teuthology.orchestra.run.smithi067.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T16:56:42.251 INFO:teuthology.orchestra.run.smithi067.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-12T16:56:42.251 INFO:teuthology.orchestra.run.smithi067.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-12T16:56:42.251 INFO:teuthology.orchestra.run.smithi067.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-12T16:56:42.251 INFO:teuthology.orchestra.run.smithi067.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-12T16:56:42.251 INFO:teuthology.orchestra.run.smithi067.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-12T16:56:42.251 INFO:teuthology.orchestra.run.smithi067.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-12T16:56:42.251 INFO:teuthology.orchestra.run.smithi067.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-12T16:56:42.251 INFO:teuthology.orchestra.run.smithi067.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-12T16:56:42.251 INFO:teuthology.orchestra.run.smithi067.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-12T16:56:42.251 INFO:teuthology.orchestra.run.smithi067.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-12T16:56:42.252 INFO:teuthology.orchestra.run.smithi067.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-12T16:56:42.252 INFO:teuthology.orchestra.run.smithi067.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-12T16:56:42.252 INFO:teuthology.orchestra.run.smithi067.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-12T16:56:42.252 INFO:teuthology.orchestra.run.smithi067.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-12T16:56:42.252 INFO:teuthology.orchestra.run.smithi067.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-12T16:56:42.252 INFO:teuthology.orchestra.run.smithi067.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-12T16:56:42.252 INFO:teuthology.orchestra.run.smithi067.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-12T16:56:42.252 INFO:teuthology.orchestra.run.smithi067.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-12T16:56:42.252 INFO:teuthology.orchestra.run.smithi067.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-12T16:56:42.252 INFO:teuthology.orchestra.run.smithi067.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-12T16:56:42.252 INFO:teuthology.orchestra.run.smithi067.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-12T16:56:42.252 INFO:teuthology.orchestra.run.smithi067.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-12T16:56:42.253 INFO:teuthology.orchestra.run.smithi067.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-12T16:56:42.253 INFO:teuthology.orchestra.run.smithi067.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-12T16:56:42.253 INFO:teuthology.orchestra.run.smithi067.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-12T16:56:42.253 INFO:teuthology.orchestra.run.smithi067.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-12T16:56:42.253 INFO:teuthology.orchestra.run.smithi067.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-12T16:56:42.253 INFO:teuthology.orchestra.run.smithi067.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-12T16:56:42.253 INFO:teuthology.orchestra.run.smithi067.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-12T16:56:42.253 INFO:teuthology.orchestra.run.smithi067.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-12T16:56:42.253 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T16:56:42.253 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T16:56:42.253 INFO:teuthology.orchestra.run.smithi067.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-12T16:56:42.253 INFO:teuthology.orchestra.run.smithi067.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-12T16:56:42.254 INFO:teuthology.orchestra.run.smithi067.stdout: libcephsqlite x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T16:56:42.254 INFO:teuthology.orchestra.run.smithi067.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-12T16:56:42.254 INFO:teuthology.orchestra.run.smithi067.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-12T16:56:42.254 INFO:teuthology.orchestra.run.smithi067.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-12T16:56:42.254 INFO:teuthology.orchestra.run.smithi067.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-12T16:56:42.254 INFO:teuthology.orchestra.run.smithi067.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-12T16:56:42.254 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T16:56:42.254 INFO:teuthology.orchestra.run.smithi067.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-12T16:56:42.254 INFO:teuthology.orchestra.run.smithi067.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-12T16:56:42.254 INFO:teuthology.orchestra.run.smithi067.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-12T16:56:42.254 INFO:teuthology.orchestra.run.smithi067.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-12T16:56:42.254 INFO:teuthology.orchestra.run.smithi067.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-12T16:56:42.254 INFO:teuthology.orchestra.run.smithi067.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-12T16:56:42.255 INFO:teuthology.orchestra.run.smithi067.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-12T16:56:42.255 INFO:teuthology.orchestra.run.smithi067.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-12T16:56:42.255 INFO:teuthology.orchestra.run.smithi067.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T16:56:42.255 INFO:teuthology.orchestra.run.smithi067.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-12T16:56:42.255 INFO:teuthology.orchestra.run.smithi067.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-12T16:56:42.255 INFO:teuthology.orchestra.run.smithi067.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-12T16:56:42.255 INFO:teuthology.orchestra.run.smithi067.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T16:56:42.255 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T16:56:42.255 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T16:56:42.255 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 508 k 2024-09-12T16:56:42.255 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T16:56:42.255 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T16:56:42.255 INFO:teuthology.orchestra.run.smithi067.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-12T16:56:42.256 INFO:teuthology.orchestra.run.smithi067.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-12T16:56:42.256 INFO:teuthology.orchestra.run.smithi067.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-12T16:56:42.256 INFO:teuthology.orchestra.run.smithi067.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-12T16:56:42.256 INFO:teuthology.orchestra.run.smithi067.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-12T16:56:42.256 INFO:teuthology.orchestra.run.smithi067.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-12T16:56:42.256 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T16:56:42.256 INFO:teuthology.orchestra.run.smithi067.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-12T16:56:42.256 INFO:teuthology.orchestra.run.smithi067.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-12T16:56:42.256 INFO:teuthology.orchestra.run.smithi067.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-12T16:56:42.256 INFO:teuthology.orchestra.run.smithi067.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-12T16:56:42.256 INFO:teuthology.orchestra.run.smithi067.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-12T16:56:42.256 INFO:teuthology.orchestra.run.smithi067.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-12T16:56:42.256 INFO:teuthology.orchestra.run.smithi067.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-12T16:56:42.257 INFO:teuthology.orchestra.run.smithi067.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-12T16:56:42.257 INFO:teuthology.orchestra.run.smithi067.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-12T16:56:42.257 INFO:teuthology.orchestra.run.smithi067.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-12T16:56:42.257 INFO:teuthology.orchestra.run.smithi067.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-12T16:56:42.257 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T16:56:42.257 INFO:teuthology.orchestra.run.smithi067.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T16:56:42.257 INFO:teuthology.orchestra.run.smithi067.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T16:56:42.257 INFO:teuthology.orchestra.run.smithi067.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-12T16:56:42.257 INFO:teuthology.orchestra.run.smithi067.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T16:56:42.257 INFO:teuthology.orchestra.run.smithi067.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-12T16:56:42.258 INFO:teuthology.orchestra.run.smithi067.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-12T16:56:42.258 INFO:teuthology.orchestra.run.smithi067.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-12T16:56:42.258 INFO:teuthology.orchestra.run.smithi067.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-12T16:56:42.258 INFO:teuthology.orchestra.run.smithi067.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-12T16:56:42.258 INFO:teuthology.orchestra.run.smithi067.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-12T16:56:42.258 INFO:teuthology.orchestra.run.smithi067.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-12T16:56:42.258 INFO:teuthology.orchestra.run.smithi067.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-12T16:56:42.258 INFO:teuthology.orchestra.run.smithi067.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-12T16:56:42.258 INFO:teuthology.orchestra.run.smithi067.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-12T16:56:42.258 INFO:teuthology.orchestra.run.smithi067.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-12T16:56:42.258 INFO:teuthology.orchestra.run.smithi067.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T16:56:42.258 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T16:56:42.259 INFO:teuthology.orchestra.run.smithi067.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-12T16:56:42.259 INFO:teuthology.orchestra.run.smithi067.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-12T16:56:42.259 INFO:teuthology.orchestra.run.smithi067.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-12T16:56:42.259 INFO:teuthology.orchestra.run.smithi067.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-12T16:56:42.259 INFO:teuthology.orchestra.run.smithi067.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-12T16:56:42.259 INFO:teuthology.orchestra.run.smithi067.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-12T16:56:42.259 INFO:teuthology.orchestra.run.smithi067.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T16:56:42.259 INFO:teuthology.orchestra.run.smithi067.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-12T16:56:42.259 INFO:teuthology.orchestra.run.smithi067.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-12T16:56:42.259 INFO:teuthology.orchestra.run.smithi067.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-12T16:56:42.259 INFO:teuthology.orchestra.run.smithi067.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-12T16:56:42.259 INFO:teuthology.orchestra.run.smithi067.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-12T16:56:42.260 INFO:teuthology.orchestra.run.smithi067.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-12T16:56:42.260 INFO:teuthology.orchestra.run.smithi067.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-12T16:56:42.260 INFO:teuthology.orchestra.run.smithi067.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-12T16:56:42.260 INFO:teuthology.orchestra.run.smithi067.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-12T16:56:42.260 INFO:teuthology.orchestra.run.smithi067.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-12T16:56:42.260 INFO:teuthology.orchestra.run.smithi067.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-12T16:56:42.260 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T16:56:42.261 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T16:56:42.261 INFO:teuthology.orchestra.run.smithi067.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-12T16:56:42.261 INFO:teuthology.orchestra.run.smithi067.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-12T16:56:42.261 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T16:56:42.261 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T16:56:42.261 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T16:56:42.261 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T16:56:42.261 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 k 2024-09-12T16:56:42.261 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 143 k 2024-09-12T16:56:42.261 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T16:56:42.262 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T16:56:42.262 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T16:56:42.262 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T16:56:42.262 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T16:56:42.262 INFO:teuthology.orchestra.run.smithi067.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T16:56:42.262 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T16:56:42.262 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T16:56:42.262 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T16:56:42.263 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T16:56:42.263 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T16:56:42.263 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T16:56:42.263 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T16:56:42.263 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T16:56:42.263 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T16:56:42.263 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T16:56:42.263 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T16:56:42.264 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T16:56:42.264 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T16:56:42.264 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T16:56:42.264 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T16:56:42.264 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T16:56:42.264 INFO:teuthology.orchestra.run.smithi067.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T16:56:42.264 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T16:56:42.265 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T16:56:42.265 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T16:56:42.265 INFO:teuthology.orchestra.run.smithi067.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T16:56:42.265 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T16:56:42.265 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T16:56:42.265 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T16:56:42.265 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T16:56:42.265 INFO:teuthology.orchestra.run.smithi067.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T16:56:42.266 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T16:56:42.266 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T16:56:42.266 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T16:56:42.266 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T16:56:42.266 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T16:56:42.266 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T16:56:42.266 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T16:56:42.266 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T16:56:42.266 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T16:56:42.267 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T16:56:42.267 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T16:56:42.267 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T16:56:42.267 INFO:teuthology.orchestra.run.smithi067.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T16:56:42.267 INFO:teuthology.orchestra.run.smithi067.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T16:56:42.267 INFO:teuthology.orchestra.run.smithi067.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T16:56:42.267 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T16:56:42.267 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T16:56:42.268 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T16:56:42.268 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T16:56:42.268 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T16:56:42.268 INFO:teuthology.orchestra.run.smithi067.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T16:56:42.268 INFO:teuthology.orchestra.run.smithi067.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T16:56:42.268 INFO:teuthology.orchestra.run.smithi067.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-12T16:56:42.268 INFO:teuthology.orchestra.run.smithi067.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-12T16:56:42.268 INFO:teuthology.orchestra.run.smithi067.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-12T16:56:42.269 INFO:teuthology.orchestra.run.smithi067.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T16:56:42.269 INFO:teuthology.orchestra.run.smithi067.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-12T16:56:42.269 INFO:teuthology.orchestra.run.smithi067.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T16:56:42.269 INFO:teuthology.orchestra.run.smithi067.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-12T16:56:42.269 INFO:teuthology.orchestra.run.smithi067.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-12T16:56:42.269 INFO:teuthology.orchestra.run.smithi067.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-12T16:56:42.269 INFO:teuthology.orchestra.run.smithi067.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-12T16:56:42.269 INFO:teuthology.orchestra.run.smithi067.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-12T16:56:42.269 INFO:teuthology.orchestra.run.smithi067.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-12T16:56:42.270 INFO:teuthology.orchestra.run.smithi067.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-12T16:56:42.270 INFO:teuthology.orchestra.run.smithi067.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-12T16:56:42.270 INFO:teuthology.orchestra.run.smithi067.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-12T16:56:42.270 INFO:teuthology.orchestra.run.smithi067.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-12T16:56:42.270 INFO:teuthology.orchestra.run.smithi067.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-12T16:56:42.270 INFO:teuthology.orchestra.run.smithi067.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T16:56:42.270 INFO:teuthology.orchestra.run.smithi067.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-12T16:56:42.270 INFO:teuthology.orchestra.run.smithi067.stdout:Installing weak dependencies: 2024-09-12T16:56:42.271 INFO:teuthology.orchestra.run.smithi067.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-12T16:56:42.271 INFO:teuthology.orchestra.run.smithi067.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-12T16:56:42.271 INFO:teuthology.orchestra.run.smithi067.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-12T16:56:42.271 INFO:teuthology.orchestra.run.smithi067.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-12T16:56:42.271 INFO:teuthology.orchestra.run.smithi067.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-12T16:56:42.271 INFO:teuthology.orchestra.run.smithi067.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-12T16:56:42.271 INFO:teuthology.orchestra.run.smithi067.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-12T16:56:42.271 INFO:teuthology.orchestra.run.smithi067.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-12T16:56:42.271 INFO:teuthology.orchestra.run.smithi067.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-12T16:56:42.272 INFO:teuthology.orchestra.run.smithi067.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-12T16:56:42.272 INFO:teuthology.orchestra.run.smithi067.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-12T16:56:42.272 INFO:teuthology.orchestra.run.smithi067.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-12T16:56:42.272 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T16:56:42.272 INFO:teuthology.orchestra.run.smithi067.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-12T16:56:42.272 INFO:teuthology.orchestra.run.smithi067.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-12T16:56:42.273 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:56:42.273 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-09-12T16:56:42.273 INFO:teuthology.orchestra.run.smithi067.stdout:====================================================================================================== 2024-09-12T16:56:42.273 INFO:teuthology.orchestra.run.smithi067.stdout:Install 283 Packages 2024-09-12T16:56:42.273 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrade 2 Packages 2024-09-12T16:56:42.273 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:56:42.274 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 322 M 2024-09-12T16:56:42.274 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-09-12T16:56:42.841 INFO:teuthology.orchestra.run.smithi118.stdout:(29/285): ceph-mgr-diskprediction-local-19.3.0- 9.0 MB/s | 7.4 MB 00:00 2024-09-12T16:56:42.949 INFO:teuthology.orchestra.run.smithi118.stdout:(30/285): ceph-mgr-modules-core-19.3.0-4762.gba 2.6 MB/s | 291 kB 00:00 2024-09-12T16:56:42.983 INFO:teuthology.orchestra.run.smithi067.stdout:(1/285): ceph-19.3.0-4762.gbad475c1.el9.x86_64. 32 kB/s | 6.6 kB 00:00 2024-09-12T16:56:43.241 INFO:teuthology.orchestra.run.smithi067.stdout:(2/285): ceph-fuse-19.3.0-4762.gbad475c1.el9.x8 3.4 MB/s | 900 kB 00:00 2024-09-12T16:56:43.308 INFO:teuthology.orchestra.run.smithi067.stdout:(3/285): ceph-immutable-object-cache-19.3.0-476 2.1 MB/s | 145 kB 00:00 2024-09-12T16:56:43.383 INFO:teuthology.orchestra.run.smithi067.stdout:(4/285): ceph-base-19.3.0-4762.gbad475c1.el9.x8 9.1 MB/s | 5.5 MB 00:00 2024-09-12T16:56:43.416 INFO:teuthology.orchestra.run.smithi118.stdout:(31/285): ceph-test-19.3.0-4762.gbad475c1.el9.x 14 MB/s | 45 MB 00:03 2024-09-12T16:56:43.441 INFO:teuthology.orchestra.run.smithi118.stdout:(32/285): ceph-mgr-rook-19.3.0-4762.gbad475c1.e 100 kB/s | 49 kB 00:00 2024-09-12T16:56:43.525 INFO:teuthology.orchestra.run.smithi067.stdout:(5/285): ceph-mgr-19.3.0-4762.gbad475c1.el9.x86 11 MB/s | 1.5 MB 00:00 2024-09-12T16:56:43.625 INFO:teuthology.orchestra.run.smithi118.stdout:(33/285): ceph-mgr-dashboard-19.3.0-4762.gbad47 8.4 MB/s | 14 MB 00:01 2024-09-12T16:56:43.650 INFO:teuthology.orchestra.run.smithi118.stdout:(34/285): ceph-prometheus-alerts-19.3.0-4762.gb 70 kB/s | 16 kB 00:00 2024-09-12T16:56:43.675 INFO:teuthology.orchestra.run.smithi118.stdout:(35/285): ceph-volume-19.3.0-4762.gbad475c1.el9 1.2 MB/s | 285 kB 00:00 2024-09-12T16:56:43.776 INFO:teuthology.orchestra.run.smithi118.stdout:(36/285): bluez-libs-5.56-6.el9.x86_64.rpm 847 kB/s | 85 kB 00:00 2024-09-12T16:56:43.801 INFO:teuthology.orchestra.run.smithi118.stdout:(37/285): ModemManager-glib-1.20.2-1.el9.x86_64 2.2 MB/s | 335 kB 00:00 2024-09-12T16:56:43.826 INFO:teuthology.orchestra.run.smithi118.stdout:(38/285): bubblewrap-0.4.1-7.el9.x86_64.rpm 983 kB/s | 49 kB 00:00 2024-09-12T16:56:43.852 INFO:teuthology.orchestra.run.smithi118.stdout:(39/285): cups-libs-2.3.3op2-30.el9.x86_64.rpm 5.1 MB/s | 262 kB 00:00 2024-09-12T16:56:43.928 INFO:teuthology.orchestra.run.smithi067.stdout:(6/285): ceph-mon-19.3.0-4762.gbad475c1.el9.x86 13 MB/s | 4.8 MB 00:00 2024-09-12T16:56:43.928 INFO:teuthology.orchestra.run.smithi118.stdout:(40/285): fuse-2.9.9-16.el9.x86_64.rpm 1.6 MB/s | 80 kB 00:00 2024-09-12T16:56:43.928 INFO:teuthology.orchestra.run.smithi118.stdout:(41/285): libgfortran-11.5.0-2.el9.x86_64.rpm 12 MB/s | 801 kB 00:00 2024-09-12T16:56:43.944 INFO:teuthology.orchestra.run.smithi118.stdout:(42/285): libpciaccess-0.16-7.el9.x86_64.rpm 403 kB/s | 27 kB 00:00 2024-09-12T16:56:43.950 INFO:teuthology.orchestra.run.smithi067.stdout:(7/285): ceph-mds-19.3.0-4762.gbad475c1.el9.x86 3.7 MB/s | 2.4 MB 00:00 2024-09-12T16:56:43.978 INFO:teuthology.orchestra.run.smithi118.stdout:(43/285): cephadm-19.3.0-4762.gbad475c1.el9.noa 2.2 MB/s | 783 kB 00:00 2024-09-12T16:56:44.003 INFO:teuthology.orchestra.run.smithi118.stdout:(44/285): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-12T16:56:44.029 INFO:teuthology.orchestra.run.smithi118.stdout:(45/285): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.1 MB/s | 94 kB 00:00 2024-09-12T16:56:44.089 INFO:teuthology.orchestra.run.smithi118.stdout:(46/285): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-12T16:56:44.129 INFO:teuthology.orchestra.run.smithi118.stdout:(47/285): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.2 MB 00:00 2024-09-12T16:56:44.154 INFO:teuthology.orchestra.run.smithi118.stdout:(48/285): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-12T16:56:44.180 INFO:teuthology.orchestra.run.smithi118.stdout:(49/285): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-12T16:56:44.209 INFO:teuthology.orchestra.run.smithi118.stdout:(50/285): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-12T16:56:44.260 INFO:teuthology.orchestra.run.smithi118.stdout:(51/285): python3-cffi-1.14.5-5.el9.x86_64.rpm 973 kB/s | 253 kB 00:00 2024-09-12T16:56:44.523 INFO:teuthology.orchestra.run.smithi067.stdout:(8/285): ceph-common-19.3.0-4762.gbad475c1.el9. 12 MB/s | 22 MB 00:01 2024-09-12T16:56:44.559 INFO:teuthology.orchestra.run.smithi067.stdout:(9/285): ceph-selinux-19.3.0-4762.gbad475c1.el9 607 kB/s | 25 kB 00:00 2024-09-12T16:56:44.743 INFO:teuthology.orchestra.run.smithi067.stdout:(10/285): ceph-osd-19.3.0-4762.gbad475c1.el9.x8 20 MB/s | 17 MB 00:00 2024-09-12T16:56:44.793 INFO:teuthology.orchestra.run.smithi067.stdout:(11/285): libcephfs-devel-19.3.0-4762.gbad475c1 637 kB/s | 32 kB 00:00 2024-09-12T16:56:44.817 INFO:teuthology.orchestra.run.smithi118.stdout:(52/285): adwaita-cursor-theme-40.1.1-3.el9.noa 1.0 MB/s | 650 kB 00:00 2024-09-12T16:56:44.840 INFO:teuthology.orchestra.run.smithi118.stdout:(53/285): alsa-lib-1.2.12-1.el9.x86_64.rpm 872 kB/s | 523 kB 00:00 2024-09-12T16:56:44.868 INFO:teuthology.orchestra.run.smithi067.stdout:(12/285): libcephfs2-19.3.0-4762.gbad475c1.el9. 9.9 MB/s | 756 kB 00:00 2024-09-12T16:56:44.927 INFO:teuthology.orchestra.run.smithi067.stdout:(13/285): libcephsqlite-19.3.0-4762.gbad475c1.e 2.7 MB/s | 161 kB 00:00 2024-09-12T16:56:44.985 INFO:teuthology.orchestra.run.smithi067.stdout:(14/285): librados-devel-19.3.0-4762.gbad475c1. 2.1 MB/s | 126 kB 00:00 2024-09-12T16:56:45.061 INFO:teuthology.orchestra.run.smithi067.stdout:(15/285): libradosstriper1-19.3.0-4762.gbad475c 6.6 MB/s | 508 kB 00:00 2024-09-12T16:56:45.319 INFO:teuthology.orchestra.run.smithi067.stdout:(16/285): librgw2-19.3.0-4762.gbad475c1.el9.x86 21 MB/s | 5.5 MB 00:00 2024-09-12T16:56:45.445 INFO:teuthology.orchestra.run.smithi067.stdout:(17/285): ceph-radosgw-19.3.0-4762.gbad475c1.el 7.3 MB/s | 11 MB 00:01 2024-09-12T16:56:45.470 INFO:teuthology.orchestra.run.smithi067.stdout:(18/285): python3-ceph-argparse-19.3.0-4762.gba 300 kB/s | 45 kB 00:00 2024-09-12T16:56:45.495 INFO:teuthology.orchestra.run.smithi067.stdout:(19/285): python3-ceph-common-19.3.0-4762.gbad4 2.8 MB/s | 143 kB 00:00 2024-09-12T16:56:45.520 INFO:teuthology.orchestra.run.smithi067.stdout:(20/285): python3-cephfs-19.3.0-4762.gbad475c1. 3.1 MB/s | 161 kB 00:00 2024-09-12T16:56:45.551 INFO:teuthology.orchestra.run.smithi118.stdout:(54/285): apache-commons-codec-1.15-7.el9.noarc 424 kB/s | 302 kB 00:00 2024-09-12T16:56:45.554 INFO:teuthology.orchestra.run.smithi067.stdout:(21/285): python3-rados-19.3.0-4762.gbad475c1.e 5.4 MB/s | 321 kB 00:00 2024-09-12T16:56:45.579 INFO:teuthology.orchestra.run.smithi067.stdout:(22/285): python3-rbd-19.3.0-4762.gbad475c1.el9 5.1 MB/s | 305 kB 00:00 2024-09-12T16:56:45.605 INFO:teuthology.orchestra.run.smithi067.stdout:(23/285): python3-rgw-19.3.0-4762.gbad475c1.el9 1.9 MB/s | 99 kB 00:00 2024-09-12T16:56:45.634 INFO:teuthology.orchestra.run.smithi067.stdout:(24/285): rbd-fuse-19.3.0-4762.gbad475c1.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-12T16:56:45.680 INFO:teuthology.orchestra.run.smithi067.stdout:(25/285): rbd-nbd-19.3.0-4762.gbad475c1.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-12T16:56:45.730 INFO:teuthology.orchestra.run.smithi067.stdout:(26/285): ceph-grafana-dashboards-19.3.0-4762.g 685 kB/s | 34 kB 00:00 2024-09-12T16:56:45.789 INFO:teuthology.orchestra.run.smithi067.stdout:(27/285): ceph-mgr-cephadm-19.3.0-4762.gbad475c 2.6 MB/s | 154 kB 00:00 2024-09-12T16:56:45.998 INFO:teuthology.orchestra.run.smithi067.stdout:(28/285): rbd-mirror-19.3.0-4762.gbad475c1.el9. 8.1 MB/s | 3.2 MB 00:00 2024-09-12T16:56:45.998 INFO:teuthology.orchestra.run.smithi118.stdout:(55/285): adwaita-icon-theme-40.1.1-3.el9.noarc 6.6 MB/s | 12 MB 00:01 2024-09-12T16:56:46.023 INFO:teuthology.orchestra.run.smithi118.stdout:(56/285): apache-commons-cli-1.4-17.el9.noarch. 58 kB/s | 71 kB 00:01 2024-09-12T16:56:46.248 INFO:teuthology.orchestra.run.smithi118.stdout:(57/285): apache-commons-io-2.8.0-8.el9.noarch. 407 kB/s | 283 kB 00:00 2024-09-12T16:56:46.348 INFO:teuthology.orchestra.run.smithi067.stdout:(29/285): ceph-mgr-dashboard-19.3.0-4762.gbad47 25 MB/s | 14 MB 00:00 2024-09-12T16:56:46.374 INFO:teuthology.orchestra.run.smithi118.stdout:(58/285): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 248 kB/s | 87 kB 00:00 2024-09-12T16:56:46.415 INFO:teuthology.orchestra.run.smithi067.stdout:(30/285): ceph-mgr-modules-core-19.3.0-4762.gba 4.3 MB/s | 291 kB 00:00 2024-09-12T16:56:46.473 INFO:teuthology.orchestra.run.smithi067.stdout:(31/285): ceph-mgr-rook-19.3.0-4762.gbad475c1.e 848 kB/s | 49 kB 00:00 2024-09-12T16:56:46.532 INFO:teuthology.orchestra.run.smithi067.stdout:(32/285): ceph-prometheus-alerts-19.3.0-4762.gb 282 kB/s | 16 kB 00:00 2024-09-12T16:56:46.599 INFO:teuthology.orchestra.run.smithi067.stdout:(33/285): ceph-volume-19.3.0-4762.gbad475c1.el9 4.2 MB/s | 285 kB 00:00 2024-09-12T16:56:46.649 INFO:teuthology.orchestra.run.smithi118.stdout:(59/285): atinject-1.0.3-6.el9.noarch.rpm 84 kB/s | 23 kB 00:00 2024-09-12T16:56:46.675 INFO:teuthology.orchestra.run.smithi118.stdout:(60/285): apache-commons-lang3-3.12.0-6.el9.noa 827 kB/s | 559 kB 00:00 2024-09-12T16:56:46.683 INFO:teuthology.orchestra.run.smithi067.stdout:(34/285): cephadm-19.3.0-4762.gbad475c1.el9.noa 9.2 MB/s | 783 kB 00:00 2024-09-12T16:56:46.699 INFO:teuthology.orchestra.run.smithi118.stdout:(61/285): at-spi2-core-2.40.3-1.el9.x86_64.rpm 432 kB/s | 195 kB 00:00 2024-09-12T16:56:46.950 INFO:teuthology.orchestra.run.smithi118.stdout:(62/285): avahi-glib-0.8-21.el9.x86_64.rpm 54 kB/s | 15 kB 00:00 2024-09-12T16:56:47.125 INFO:teuthology.orchestra.run.smithi118.stdout:(63/285): boost-program-options-1.75.0-8.el9.x8 251 kB/s | 107 kB 00:00 2024-09-12T16:56:47.150 INFO:teuthology.orchestra.run.smithi067.stdout:(35/285): ceph-test-19.3.0-4762.gbad475c1.el9.x 18 MB/s | 45 MB 00:02 2024-09-12T16:56:47.175 INFO:teuthology.orchestra.run.smithi118.stdout:(64/285): atk-2.36.0-5.el9.x86_64.rpm 555 kB/s | 292 kB 00:00 2024-09-12T16:56:47.233 INFO:teuthology.orchestra.run.smithi067.stdout:(36/285): ceph-mgr-diskprediction-local-19.3.0- 6.0 MB/s | 7.4 MB 00:01 2024-09-12T16:56:47.309 INFO:teuthology.orchestra.run.smithi118.stdout:(65/285): cdi-api-2.0.2-6.el9.noarch.rpm 149 kB/s | 53 kB 00:00 2024-09-12T16:56:47.526 INFO:teuthology.orchestra.run.smithi118.stdout:(66/285): composefs-libs-1.0.5-1.el9.x86_64.rpm 174 kB/s | 61 kB 00:00 2024-09-12T16:56:47.568 INFO:teuthology.orchestra.run.smithi118.stdout:(67/285): copy-jdk-configs-4.0-3.el9.noarch.rpm 109 kB/s | 28 kB 00:00 2024-09-12T16:56:47.635 INFO:teuthology.orchestra.run.smithi118.stdout:(68/285): colord-libs-1.4.5-4.el9.x86_64.rpm 450 kB/s | 229 kB 00:00 2024-09-12T16:56:47.808 INFO:teuthology.orchestra.run.smithi067.stdout:(37/285): bubblewrap-0.4.1-7.el9.x86_64.rpm 86 kB/s | 49 kB 00:00 2024-09-12T16:56:47.850 INFO:teuthology.orchestra.run.smithi067.stdout:(38/285): bluez-libs-5.56-6.el9.x86_64.rpm 121 kB/s | 85 kB 00:00 2024-09-12T16:56:47.943 INFO:teuthology.orchestra.run.smithi118.stdout:(69/285): dconf-0.40.0-6.el9.x86_64.rpm 270 kB/s | 113 kB 00:00 2024-09-12T16:56:47.950 INFO:teuthology.orchestra.run.smithi067.stdout:(39/285): ModemManager-glib-1.20.2-1.el9.x86_64 264 kB/s | 335 kB 00:01 2024-09-12T16:56:48.219 INFO:teuthology.orchestra.run.smithi118.stdout:(70/285): exempi-2.6.0-0.2.20211007gite23c213.e 807 kB/s | 525 kB 00:00 2024-09-12T16:56:48.294 INFO:teuthology.orchestra.run.smithi118.stdout:(71/285): exiv2-0.27.5-2.el9.x86_64.rpm 1.5 MB/s | 980 kB 00:00 2024-09-12T16:56:48.519 INFO:teuthology.orchestra.run.smithi118.stdout:(72/285): exiv2-libs-0.27.5-2.el9.x86_64.rpm 1.3 MB/s | 781 kB 00:00 2024-09-12T16:56:48.525 INFO:teuthology.orchestra.run.smithi067.stdout:(40/285): fuse-2.9.9-16.el9.x86_64.rpm 118 kB/s | 80 kB 00:00 2024-09-12T16:56:48.736 INFO:teuthology.orchestra.run.smithi118.stdout:(73/285): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 629 kB/s | 325 kB 00:00 2024-09-12T16:56:48.795 INFO:teuthology.orchestra.run.smithi118.stdout:(74/285): flac-libs-1.3.3-12.el9.x86_64.rpm 436 kB/s | 218 kB 00:00 2024-09-12T16:56:48.843 INFO:teuthology.orchestra.run.smithi067.stdout:(41/285): cups-libs-2.3.3op2-30.el9.x86_64.rpm 254 kB/s | 262 kB 00:01 2024-09-12T16:56:48.901 INFO:teuthology.orchestra.run.smithi067.stdout:(42/285): libgfortran-11.5.0-2.el9.x86_64.rpm 843 kB/s | 801 kB 00:00 2024-09-12T16:56:48.995 INFO:teuthology.orchestra.run.smithi118.stdout:(75/285): flatpak-selinux-1.12.9-1.el9.noarch.r 83 kB/s | 22 kB 00:00 2024-09-12T16:56:49.145 INFO:teuthology.orchestra.run.smithi118.stdout:(76/285): flatpak-session-helper-1.12.9-1.el9.x 208 kB/s | 73 kB 00:00 2024-09-12T16:56:49.226 INFO:teuthology.orchestra.run.smithi067.stdout:(43/285): libpciaccess-0.16-7.el9.x86_64.rpm 38 kB/s | 27 kB 00:00 2024-09-12T16:56:49.262 INFO:teuthology.orchestra.run.smithi118.stdout:(77/285): flexiblas-3.0.4-8.el9.x86_64.rpm 122 kB/s | 33 kB 00:00 2024-09-12T16:56:49.304 INFO:teuthology.orchestra.run.smithi118.stdout:(78/285): flatpak-1.12.9-1.el9.x86_64.rpm 2.2 MB/s | 1.7 MB 00:00 2024-09-12T16:56:49.538 INFO:teuthology.orchestra.run.smithi118.stdout:(79/285): flexiblas-openblas-openmp-3.0.4-8.el9 66 kB/s | 18 kB 00:00 2024-09-12T16:56:49.651 INFO:teuthology.orchestra.run.smithi067.stdout:(44/285): libquadmath-11.5.0-2.el9.x86_64.rpm 239 kB/s | 191 kB 00:00 2024-09-12T16:56:49.685 INFO:teuthology.orchestra.run.smithi067.stdout:(45/285): lksctp-tools-1.0.19-2.el9.x86_64.rpm 120 kB/s | 94 kB 00:00 2024-09-12T16:56:49.979 INFO:teuthology.orchestra.run.smithi118.stdout:(80/285): geoclue2-2.6.0-7.el9.x86_64.rpm 282 kB/s | 124 kB 00:00 2024-09-12T16:56:50.047 INFO:teuthology.orchestra.run.smithi118.stdout:(81/285): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.3 MB/s | 3.0 MB 00:00 2024-09-12T16:56:50.252 INFO:teuthology.orchestra.run.smithi067.stdout:(46/285): python3-cffi-1.14.5-5.el9.x86_64.rpm 247 kB/s | 253 kB 00:01 2024-09-12T16:56:50.339 INFO:teuthology.orchestra.run.smithi118.stdout:(82/285): giflib-5.2.1-9.el9.x86_64.rpm 135 kB/s | 49 kB 00:00 2024-09-12T16:56:50.414 INFO:teuthology.orchestra.run.smithi118.stdout:(83/285): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 80 kB/s | 89 kB 00:01 2024-09-12T16:56:50.511 INFO:teuthology.orchestra.run.smithi067.stdout:(47/285): python3-ply-3.11-14.el9.noarch.rpm 129 kB/s | 106 kB 00:00 2024-09-12T16:56:50.639 INFO:teuthology.orchestra.run.smithi118.stdout:(84/285): google-guice-4.2.3-9.el9.noarch.rpm 799 kB/s | 473 kB 00:00 2024-09-12T16:56:50.681 INFO:teuthology.orchestra.run.smithi118.stdout:(85/285): graphene-1.10.6-2.el9.x86_64.rpm 188 kB/s | 64 kB 00:00 2024-09-12T16:56:50.706 INFO:teuthology.orchestra.run.smithi118.stdout:(86/285): gsm-1.0.19-6.el9.x86_64.rpm 116 kB/s | 34 kB 00:00 2024-09-12T16:56:51.023 INFO:teuthology.orchestra.run.smithi118.stdout:(87/285): gtk-update-icon-cache-3.24.31-5.el9.x 104 kB/s | 33 kB 00:00 2024-09-12T16:56:51.036 INFO:teuthology.orchestra.run.smithi067.stdout:(48/285): python3-pycparser-2.20-6.el9.noarch.r 172 kB/s | 135 kB 00:00 2024-09-12T16:56:51.261 INFO:teuthology.orchestra.run.smithi067.stdout:(49/285): python3-requests-2.25.1-8.el9.noarch. 168 kB/s | 125 kB 00:00 2024-09-12T16:56:51.415 INFO:teuthology.orchestra.run.smithi118.stdout:(88/285): gstreamer1-1.22.1-2.el9.x86_64.rpm 1.8 MB/s | 1.4 MB 00:00 2024-09-12T16:56:51.504 INFO:teuthology.orchestra.run.smithi067.stdout:(50/285): adwaita-cursor-theme-40.1.1-3.el9.noa 2.7 MB/s | 650 kB 00:00 2024-09-12T16:56:51.537 INFO:teuthology.orchestra.run.smithi067.stdout:(51/285): python3-cryptography-36.0.1-4.el9.x86 666 kB/s | 1.2 MB 00:01 2024-09-12T16:56:51.862 INFO:teuthology.orchestra.run.smithi067.stdout:(52/285): python3-urllib3-1.26.5-6.el9.noarch.r 260 kB/s | 215 kB 00:00 2024-09-12T16:56:51.887 INFO:teuthology.orchestra.run.smithi067.stdout:(53/285): alsa-lib-1.2.12-1.el9.x86_64.rpm 1.5 MB/s | 523 kB 00:00 2024-09-12T16:56:52.029 INFO:teuthology.orchestra.run.smithi067.stdout:(54/285): apache-commons-codec-1.15-7.el9.noarc 2.1 MB/s | 302 kB 00:00 2024-09-12T16:56:52.096 INFO:teuthology.orchestra.run.smithi067.stdout:(55/285): apache-commons-cli-1.4-17.el9.noarch. 303 kB/s | 71 kB 00:00 2024-09-12T16:56:52.182 INFO:teuthology.orchestra.run.smithi118.stdout:(89/285): guava-30.1-6.el9.noarch.rpm 3.0 MB/s | 2.3 MB 00:00 2024-09-12T16:56:52.221 INFO:teuthology.orchestra.run.smithi067.stdout:(56/285): adwaita-icon-theme-40.1.1-3.el9.noarc 17 MB/s | 12 MB 00:00 2024-09-12T16:56:52.246 INFO:teuthology.orchestra.run.smithi067.stdout:(57/285): apache-commons-io-2.8.0-8.el9.noarch. 1.3 MB/s | 283 kB 00:00 2024-09-12T16:56:52.297 INFO:teuthology.orchestra.run.smithi067.stdout:(58/285): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2024-09-12T16:56:52.341 INFO:teuthology.orchestra.run.smithi118.stdout:(90/285): gstreamer1-plugins-base-1.22.1-2.el9. 1.4 MB/s | 2.2 MB 00:01 2024-09-12T16:56:52.363 INFO:teuthology.orchestra.run.smithi067.stdout:(59/285): atinject-1.0.3-6.el9.noarch.rpm 350 kB/s | 23 kB 00:00 2024-09-12T16:56:52.389 INFO:teuthology.orchestra.run.smithi067.stdout:(60/285): at-spi2-core-2.40.3-1.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-09-12T16:56:52.423 INFO:teuthology.orchestra.run.smithi067.stdout:(61/285): atk-2.36.0-5.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-12T16:56:52.448 INFO:teuthology.orchestra.run.smithi067.stdout:(62/285): avahi-glib-0.8-21.el9.x86_64.rpm 255 kB/s | 15 kB 00:00 2024-09-12T16:56:52.481 INFO:teuthology.orchestra.run.smithi067.stdout:(63/285): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-12T16:56:52.515 INFO:teuthology.orchestra.run.smithi067.stdout:(64/285): apache-commons-lang3-3.12.0-6.el9.noa 1.3 MB/s | 559 kB 00:00 2024-09-12T16:56:52.540 INFO:teuthology.orchestra.run.smithi067.stdout:(65/285): cdi-api-2.0.2-6.el9.noarch.rpm 580 kB/s | 53 kB 00:00 2024-09-12T16:56:52.566 INFO:teuthology.orchestra.run.smithi067.stdout:(66/285): colord-libs-1.4.5-4.el9.x86_64.rpm 2.7 MB/s | 229 kB 00:00 2024-09-12T16:56:52.591 INFO:teuthology.orchestra.run.smithi067.stdout:(67/285): composefs-libs-1.0.5-1.el9.x86_64.rpm 810 kB/s | 61 kB 00:00 2024-09-12T16:56:52.616 INFO:teuthology.orchestra.run.smithi067.stdout:(68/285): copy-jdk-configs-4.0-3.el9.noarch.rpm 373 kB/s | 28 kB 00:00 2024-09-12T16:56:52.641 INFO:teuthology.orchestra.run.smithi067.stdout:(69/285): dconf-0.40.0-6.el9.x86_64.rpm 1.5 MB/s | 113 kB 00:00 2024-09-12T16:56:52.708 INFO:teuthology.orchestra.run.smithi067.stdout:(70/285): exiv2-libs-0.27.5-2.el9.x86_64.rpm 11 MB/s | 781 kB 00:00 2024-09-12T16:56:52.716 INFO:teuthology.orchestra.run.smithi118.stdout:(91/285): hicolor-icon-theme-0.17-13.el9.noarch 410 kB/s | 219 kB 00:00 2024-09-12T16:56:52.767 INFO:teuthology.orchestra.run.smithi067.stdout:(71/285): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 5.5 MB/s | 325 kB 00:00 2024-09-12T16:56:52.825 INFO:teuthology.orchestra.run.smithi067.stdout:(72/285): flac-libs-1.3.3-12.el9.x86_64.rpm 3.7 MB/s | 218 kB 00:00 2024-09-12T16:56:52.859 INFO:teuthology.orchestra.run.smithi067.stdout:(73/285): exiv2-0.27.5-2.el9.x86_64.rpm 4.0 MB/s | 980 kB 00:00 2024-09-12T16:56:52.884 INFO:teuthology.orchestra.run.smithi067.stdout:(74/285): exempi-2.6.0-0.2.20211007gite23c213.e 1.7 MB/s | 525 kB 00:00 2024-09-12T16:56:52.934 INFO:teuthology.orchestra.run.smithi067.stdout:(75/285): flatpak-selinux-1.12.9-1.el9.noarch.r 287 kB/s | 22 kB 00:00 2024-09-12T16:56:52.941 INFO:teuthology.orchestra.run.smithi118.stdout:(92/285): httpcomponents-client-4.5.13-3.el9.no 1.1 MB/s | 657 kB 00:00 2024-09-12T16:56:52.960 INFO:teuthology.orchestra.run.smithi067.stdout:(76/285): flatpak-session-helper-1.12.9-1.el9.x 972 kB/s | 73 kB 00:00 2024-09-12T16:56:53.002 INFO:teuthology.orchestra.run.smithi067.stdout:(77/285): flatpak-1.12.9-1.el9.x86_64.rpm 9.8 MB/s | 1.7 MB 00:00 2024-09-12T16:56:53.027 INFO:teuthology.orchestra.run.smithi067.stdout:(78/285): flexiblas-3.0.4-8.el9.x86_64.rpm 355 kB/s | 33 kB 00:00 2024-09-12T16:56:53.052 INFO:teuthology.orchestra.run.smithi067.stdout:(79/285): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-12T16:56:53.095 INFO:teuthology.orchestra.run.smithi067.stdout:(80/285): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.3 MB/s | 89 kB 00:00 2024-09-12T16:56:53.120 INFO:teuthology.orchestra.run.smithi067.stdout:(81/285): geoclue2-2.6.0-7.el9.x86_64.rpm 1.8 MB/s | 124 kB 00:00 2024-09-12T16:56:53.145 INFO:teuthology.orchestra.run.smithi067.stdout:(82/285): giflib-5.2.1-9.el9.x86_64.rpm 970 kB/s | 49 kB 00:00 2024-09-12T16:56:53.195 INFO:teuthology.orchestra.run.smithi067.stdout:(83/285): google-guice-4.2.3-9.el9.noarch.rpm 6.2 MB/s | 473 kB 00:00 2024-09-12T16:56:53.220 INFO:teuthology.orchestra.run.smithi067.stdout:(84/285): graphene-1.10.6-2.el9.x86_64.rpm 858 kB/s | 64 kB 00:00 2024-09-12T16:56:53.246 INFO:teuthology.orchestra.run.smithi067.stdout:(85/285): gsm-1.0.19-6.el9.x86_64.rpm 678 kB/s | 34 kB 00:00 2024-09-12T16:56:53.300 INFO:teuthology.orchestra.run.smithi118.stdout:(93/285): httpcomponents-core-4.4.13-7.el9.noar 1.1 MB/s | 632 kB 00:00 2024-09-12T16:56:53.362 INFO:teuthology.orchestra.run.smithi067.stdout:(86/285): gstreamer1-plugins-base-1.22.1-2.el9. 19 MB/s | 2.2 MB 00:00 2024-09-12T16:56:53.413 INFO:teuthology.orchestra.run.smithi067.stdout:(87/285): gtk-update-icon-cache-3.24.31-5.el9.x 661 kB/s | 33 kB 00:00 2024-09-12T16:56:53.496 INFO:teuthology.orchestra.run.smithi067.stdout:(88/285): gstreamer1-1.22.1-2.el9.x86_64.rpm 5.2 MB/s | 1.4 MB 00:00 2024-09-12T16:56:53.622 INFO:teuthology.orchestra.run.smithi067.stdout:(89/285): gtk3-3.24.31-5.el9.x86_64.rpm 23 MB/s | 4.9 MB 00:00 2024-09-12T16:56:53.650 INFO:teuthology.orchestra.run.smithi118.stdout:(94/285): jakarta-annotations-1.3.5-13.el9.noar 129 kB/s | 45 kB 00:00 2024-09-12T16:56:53.688 INFO:teuthology.orchestra.run.smithi067.stdout:(90/285): hicolor-icon-theme-0.17-13.el9.noarch 3.2 MB/s | 219 kB 00:00 2024-09-12T16:56:53.725 INFO:teuthology.orchestra.run.smithi118.stdout:(95/285): gtk3-3.24.31-5.el9.x86_64.rpm 1.8 MB/s | 4.9 MB 00:02 2024-09-12T16:56:53.755 INFO:teuthology.orchestra.run.smithi067.stdout:(91/285): httpcomponents-client-4.5.13-3.el9.no 9.7 MB/s | 657 kB 00:00 2024-09-12T16:56:53.814 INFO:teuthology.orchestra.run.smithi067.stdout:(92/285): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.5 MB/s | 3.0 MB 00:00 2024-09-12T16:56:53.848 INFO:teuthology.orchestra.run.smithi067.stdout:(93/285): httpcomponents-core-4.4.13-7.el9.noar 6.7 MB/s | 632 kB 00:00 2024-09-12T16:56:53.876 INFO:teuthology.orchestra.run.smithi118.stdout:(96/285): iso-codes-4.6.0-3.el9.noarch.rpm 3.8 MB/s | 3.5 MB 00:00 2024-09-12T16:56:53.889 INFO:teuthology.orchestra.run.smithi067.stdout:(94/285): guava-30.1-6.el9.noarch.rpm 5.9 MB/s | 2.3 MB 00:00 2024-09-12T16:56:53.915 INFO:teuthology.orchestra.run.smithi067.stdout:(95/285): jakarta-annotations-1.3.5-13.el9.noar 672 kB/s | 45 kB 00:00 2024-09-12T16:56:53.973 INFO:teuthology.orchestra.run.smithi067.stdout:(96/285): java-11-openjdk-11.0.20.1.1-2.el9.x86 6.9 MB/s | 413 kB 00:00 2024-09-12T16:56:53.999 INFO:teuthology.orchestra.run.smithi067.stdout:(97/285): jansi-2.3.3-6.el9.x86_64.rpm 1.0 MB/s | 110 kB 00:00 2024-09-12T16:56:54.068 INFO:teuthology.orchestra.run.smithi118.stdout:(97/285): jansi-2.3.3-6.el9.x86_64.rpm 263 kB/s | 110 kB 00:00 2024-09-12T16:56:54.124 INFO:teuthology.orchestra.run.smithi067.stdout:(98/285): java-11-openjdk-devel-11.0.20.1.1-2.e 22 MB/s | 3.3 MB 00:00 2024-09-12T16:56:54.182 INFO:teuthology.orchestra.run.smithi067.stdout:(99/285): javapackages-filesystem-6.0.0-4.el9.n 223 kB/s | 13 kB 00:00 2024-09-12T16:56:54.241 INFO:teuthology.orchestra.run.smithi067.stdout:(100/285): jbigkit-libs-2.1-23.el9.x86_64.rpm 908 kB/s | 53 kB 00:00 2024-09-12T16:56:54.291 INFO:teuthology.orchestra.run.smithi067.stdout:(101/285): jcl-over-slf4j-1.7.30-13.el9.noarch. 481 kB/s | 24 kB 00:00 2024-09-12T16:56:54.310 INFO:teuthology.orchestra.run.smithi118.stdout:(98/285): java-11-openjdk-11.0.20.1.1-2.el9.x86 707 kB/s | 413 kB 00:00 2024-09-12T16:56:54.391 INFO:teuthology.orchestra.run.smithi067.stdout:(102/285): iso-codes-4.6.0-3.el9.noarch.rpm 6.1 MB/s | 3.5 MB 00:00 2024-09-12T16:56:54.417 INFO:teuthology.orchestra.run.smithi067.stdout:(103/285): jsoup-1.13.1-10.el9.noarch.rpm 2.9 MB/s | 377 kB 00:00 2024-09-12T16:56:54.467 INFO:teuthology.orchestra.run.smithi067.stdout:(104/285): jsr-305-3.0.2-6.el9.noarch.rpm 472 kB/s | 35 kB 00:00 2024-09-12T16:56:54.492 INFO:teuthology.orchestra.run.smithi067.stdout:(105/285): lcms2-2.12-3.el9.x86_64.rpm 2.2 MB/s | 168 kB 00:00 2024-09-12T16:56:54.501 INFO:teuthology.orchestra.run.smithi118.stdout:(99/285): javapackages-filesystem-6.0.0-4.el9.n 68 kB/s | 13 kB 00:00 2024-09-12T16:56:54.542 INFO:teuthology.orchestra.run.smithi067.stdout:(106/285): libX11-xcb-1.7.0-9.el9.x86_64.rpm 148 kB/s | 11 kB 00:00 2024-09-12T16:56:54.568 INFO:teuthology.orchestra.run.smithi067.stdout:(107/285): libXcomposite-0.4.5-7.el9.x86_64.rpm 321 kB/s | 24 kB 00:00 2024-09-12T16:56:54.610 INFO:teuthology.orchestra.run.smithi067.stdout:(108/285): libXcursor-1.2.0-7.el9.x86_64.rpm 459 kB/s | 31 kB 00:00 2024-09-12T16:56:54.635 INFO:teuthology.orchestra.run.smithi067.stdout:(109/285): libXdamage-1.1.5-7.el9.x86_64.rpm 342 kB/s | 23 kB 00:00 2024-09-12T16:56:54.677 INFO:teuthology.orchestra.run.smithi067.stdout:(110/285): libXfixes-5.0.3-16.el9.x86_64.rpm 296 kB/s | 20 kB 00:00 2024-09-12T16:56:54.702 INFO:teuthology.orchestra.run.smithi067.stdout:(111/285): libXi-1.7.10-8.el9.x86_64.rpm 594 kB/s | 40 kB 00:00 2024-09-12T16:56:54.728 INFO:teuthology.orchestra.run.smithi067.stdout:(112/285): libXinerama-1.1.4-10.el9.x86_64.rpm 299 kB/s | 15 kB 00:00 2024-09-12T16:56:54.753 INFO:teuthology.orchestra.run.smithi067.stdout:(113/285): libXrandr-1.5.2-8.el9.x86_64.rpm 562 kB/s | 28 kB 00:00 2024-09-12T16:56:54.778 INFO:teuthology.orchestra.run.smithi067.stdout:(114/285): libXtst-1.2.3-16.el9.x86_64.rpm 426 kB/s | 21 kB 00:00 2024-09-12T16:56:54.803 INFO:teuthology.orchestra.run.smithi067.stdout:(115/285): libXv-1.0.11-16.el9.x86_64.rpm 382 kB/s | 19 kB 00:00 2024-09-12T16:56:54.820 INFO:teuthology.orchestra.run.smithi067.stdout:(116/285): libXxf86vm-1.1.4-18.el9.x86_64.rpm 448 kB/s | 19 kB 00:00 2024-09-12T16:56:54.835 INFO:teuthology.orchestra.run.smithi118.stdout:(100/285): java-11-openjdk-devel-11.0.20.1.1-2. 3.5 MB/s | 3.3 MB 00:00 2024-09-12T16:56:54.846 INFO:teuthology.orchestra.run.smithi067.stdout:(117/285): libasyncns-0.8-22.el9.x86_64.rpm 724 kB/s | 30 kB 00:00 2024-09-12T16:56:54.852 INFO:teuthology.orchestra.run.smithi118.stdout:(101/285): jbigkit-libs-2.1-23.el9.x86_64.rpm 151 kB/s | 53 kB 00:00 2024-09-12T16:56:54.887 INFO:teuthology.orchestra.run.smithi067.stdout:(118/285): libcanberra-gtk3-0.30-27.el9.x86_64. 769 kB/s | 32 kB 00:00 2024-09-12T16:56:54.904 INFO:teuthology.orchestra.run.smithi067.stdout:(119/285): libcanberra-0.30-27.el9.x86_64.rpm 1.0 MB/s | 86 kB 00:00 2024-09-12T16:56:54.947 INFO:teuthology.orchestra.run.smithi067.stdout:(120/285): libdrm-2.4.121-1.el9.x86_64.rpm 2.7 MB/s | 161 kB 00:00 2024-09-12T16:56:54.989 INFO:teuthology.orchestra.run.smithi067.stdout:(121/285): libepoxy-1.5.5-4.el9.x86_64.rpm 2.8 MB/s | 241 kB 00:00 2024-09-12T16:56:55.022 INFO:teuthology.orchestra.run.smithi067.stdout:(122/285): libexif-0.6.22-6.el9.x86_64.rpm 5.7 MB/s | 435 kB 00:00 2024-09-12T16:56:55.047 INFO:teuthology.orchestra.run.smithi067.stdout:(123/285): libfontenc-1.1.3-17.el9.x86_64.rpm 531 kB/s | 31 kB 00:00 2024-09-12T16:56:55.081 INFO:teuthology.orchestra.run.smithi067.stdout:(124/285): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2024-09-12T16:56:55.094 INFO:teuthology.orchestra.run.smithi118.stdout:(102/285): jcl-over-slf4j-1.7.30-13.el9.noarch. 93 kB/s | 24 kB 00:00 2024-09-12T16:56:55.106 INFO:teuthology.orchestra.run.smithi067.stdout:(125/285): libglvnd-1.3.4-1.el9.x86_64.rpm 2.3 MB/s | 135 kB 00:00 2024-09-12T16:56:55.131 INFO:teuthology.orchestra.run.smithi067.stdout:(126/285): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 730 kB/s | 37 kB 00:00 2024-09-12T16:56:55.165 INFO:teuthology.orchestra.run.smithi067.stdout:(127/285): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 2.4 MB/s | 142 kB 00:00 2024-09-12T16:56:55.207 INFO:teuthology.orchestra.run.smithi067.stdout:(128/285): libgsf-1.14.47-5.el9.x86_64.rpm 3.3 MB/s | 256 kB 00:00 2024-09-12T16:56:55.232 INFO:teuthology.orchestra.run.smithi067.stdout:(129/285): libgxps-0.3.2-3.el9.x86_64.rpm 1.1 MB/s | 79 kB 00:00 2024-09-12T16:56:55.258 INFO:teuthology.orchestra.run.smithi067.stdout:(130/285): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-12T16:56:55.283 INFO:teuthology.orchestra.run.smithi067.stdout:(131/285): libldac-2.0.2.3-10.el9.x86_64.rpm 824 kB/s | 41 kB 00:00 2024-09-12T16:56:55.308 INFO:teuthology.orchestra.run.smithi067.stdout:(132/285): libnotify-0.7.9-8.el9.x86_64.rpm 870 kB/s | 44 kB 00:00 2024-09-12T16:56:55.352 INFO:teuthology.orchestra.run.smithi118.stdout:(103/285): jsoup-1.13.1-10.el9.noarch.rpm 753 kB/s | 377 kB 00:00 2024-09-12T16:56:55.378 INFO:teuthology.orchestra.run.smithi118.stdout:(104/285): jsr-305-3.0.2-6.el9.noarch.rpm 125 kB/s | 35 kB 00:00 2024-09-12T16:56:55.435 INFO:teuthology.orchestra.run.smithi067.stdout:(133/285): libogg-1.3.4-6.el9.x86_64.rpm 221 kB/s | 34 kB 00:00 2024-09-12T16:56:55.469 INFO:teuthology.orchestra.run.smithi067.stdout:(134/285): libosinfo-1.10.0-1.el9.x86_64.rpm 2.0 MB/s | 319 kB 00:00 2024-09-12T16:56:55.509 INFO:teuthology.orchestra.run.smithi067.stdout:(135/285): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-12T16:56:55.551 INFO:teuthology.orchestra.run.smithi067.stdout:(136/285): librabbitmq-0.11.0-7.el9.x86_64.rpm 542 kB/s | 45 kB 00:00 2024-09-12T16:56:55.578 INFO:teuthology.orchestra.run.smithi118.stdout:(105/285): libX11-xcb-1.7.0-9.el9.x86_64.rpm 55 kB/s | 11 kB 00:00 2024-09-12T16:56:55.610 INFO:teuthology.orchestra.run.smithi067.stdout:(137/285): libsbc-1.4-9.el9.x86_64.rpm 769 kB/s | 45 kB 00:00 2024-09-12T16:56:55.635 INFO:teuthology.orchestra.run.smithi067.stdout:(138/285): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-12T16:56:55.668 INFO:teuthology.orchestra.run.smithi067.stdout:(139/285): libsndfile-1.0.31-8.el9.x86_64.rpm 3.5 MB/s | 206 kB 00:00 2024-09-12T16:56:55.693 INFO:teuthology.orchestra.run.smithi067.stdout:(140/285): libtheora-1.1.1-31.el9.x86_64.rpm 2.7 MB/s | 164 kB 00:00 2024-09-12T16:56:55.779 INFO:teuthology.orchestra.run.smithi118.stdout:(106/285): lcms2-2.12-3.el9.x86_64.rpm 394 kB/s | 168 kB 00:00 2024-09-12T16:56:55.853 INFO:teuthology.orchestra.run.smithi118.stdout:(107/285): libXcomposite-0.4.5-7.el9.x86_64.rpm 88 kB/s | 24 kB 00:00 2024-09-12T16:56:56.036 INFO:teuthology.orchestra.run.smithi067.stdout:(141/285): java-11-openjdk-headless-11.0.20.1.1 19 MB/s | 39 MB 00:02 2024-09-12T16:56:56.045 INFO:teuthology.orchestra.run.smithi118.stdout:(108/285): libXcursor-1.2.0-7.el9.x86_64.rpm 115 kB/s | 31 kB 00:00 2024-09-12T16:56:56.061 INFO:teuthology.orchestra.run.smithi067.stdout:(142/285): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 97 kB/s | 36 kB 00:00 2024-09-12T16:56:56.086 INFO:teuthology.orchestra.run.smithi067.stdout:(143/285): libtiff-4.4.0-13.el9.x86_64.rpm 474 kB/s | 198 kB 00:00 2024-09-12T16:56:56.111 INFO:teuthology.orchestra.run.smithi067.stdout:(144/285): libtracker-sparql-3.1.2-3.el9.x86_64 4.2 MB/s | 324 kB 00:00 2024-09-12T16:56:56.137 INFO:teuthology.orchestra.run.smithi067.stdout:(145/285): libvisual-0.4.0-34.el9.x86_64.rpm 1.9 MB/s | 144 kB 00:00 2024-09-12T16:56:56.138 INFO:teuthology.orchestra.run.smithi118.stdout:(109/285): libXdamage-1.1.5-7.el9.x86_64.rpm 80 kB/s | 23 kB 00:00 2024-09-12T16:56:56.162 INFO:teuthology.orchestra.run.smithi067.stdout:(146/285): libvorbis-1.3.7-5.el9.x86_64.rpm 2.5 MB/s | 193 kB 00:00 2024-09-12T16:56:56.187 INFO:teuthology.orchestra.run.smithi067.stdout:(147/285): libwayland-client-1.21.0-1.el9.x86_6 442 kB/s | 33 kB 00:00 2024-09-12T16:56:56.212 INFO:teuthology.orchestra.run.smithi067.stdout:(148/285): libwayland-cursor-1.21.0-1.el9.x86_6 257 kB/s | 19 kB 00:00 2024-09-12T16:56:56.238 INFO:teuthology.orchestra.run.smithi067.stdout:(149/285): libwayland-egl-1.21.0-1.el9.x86_64.r 170 kB/s | 13 kB 00:00 2024-09-12T16:56:56.264 INFO:teuthology.orchestra.run.smithi067.stdout:(150/285): libwayland-server-1.21.0-1.el9.x86_6 554 kB/s | 42 kB 00:00 2024-09-12T16:56:56.289 INFO:teuthology.orchestra.run.smithi067.stdout:(151/285): libwebp-1.2.0-8.el9.x86_64.rpm 3.6 MB/s | 277 kB 00:00 2024-09-12T16:56:56.305 INFO:teuthology.orchestra.run.smithi067.stdout:(152/285): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.9 MB/s | 133 kB 00:00 2024-09-12T16:56:56.330 INFO:teuthology.orchestra.run.smithi118.stdout:(110/285): libXfixes-5.0.3-16.el9.x86_64.rpm 70 kB/s | 20 kB 00:00 2024-09-12T16:56:56.330 INFO:teuthology.orchestra.run.smithi067.stdout:(153/285): libxshmfence-1.3-10.el9.x86_64.rpm 188 kB/s | 13 kB 00:00 2024-09-12T16:56:56.356 INFO:teuthology.orchestra.run.smithi067.stdout:(154/285): low-memory-monitor-2.1-4.el9.x86_64. 536 kB/s | 36 kB 00:00 2024-09-12T16:56:56.381 INFO:teuthology.orchestra.run.smithi067.stdout:(155/285): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-12T16:56:56.406 INFO:teuthology.orchestra.run.smithi067.stdout:(156/285): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-12T16:56:56.413 INFO:teuthology.orchestra.run.smithi118.stdout:(111/285): libXi-1.7.10-8.el9.x86_64.rpm 144 kB/s | 40 kB 00:00 2024-09-12T16:56:56.431 INFO:teuthology.orchestra.run.smithi067.stdout:(157/285): lua-posix-35.0-8.el9.x86_64.rpm 2.0 MB/s | 151 kB 00:00 2024-09-12T16:56:56.449 INFO:teuthology.orchestra.run.smithi067.stdout:(158/285): maven-3.6.3-15.el9.noarch.rpm 264 kB/s | 18 kB 00:00 2024-09-12T16:56:56.482 INFO:teuthology.orchestra.run.smithi067.stdout:(159/285): maven-openjdk11-3.6.3-15.el9.noarch. 180 kB/s | 9.0 kB 00:00 2024-09-12T16:56:56.515 INFO:teuthology.orchestra.run.smithi067.stdout:(160/285): maven-resolver-1.6.1-10.el9.noarch.r 7.6 MB/s | 517 kB 00:00 2024-09-12T16:56:56.549 INFO:teuthology.orchestra.run.smithi067.stdout:(161/285): maven-shared-utils-3.3.4-3.el9.noarc 2.2 MB/s | 151 kB 00:00 2024-09-12T16:56:56.574 INFO:teuthology.orchestra.run.smithi067.stdout:(162/285): maven-wagon-3.4.2-7.el9.noarch.rpm 1.9 MB/s | 112 kB 00:00 2024-09-12T16:56:56.608 INFO:teuthology.orchestra.run.smithi067.stdout:(163/285): maven-lib-3.6.3-15.el9.noarch.rpm 7.4 MB/s | 1.5 MB 00:00 2024-09-12T16:56:56.633 INFO:teuthology.orchestra.run.smithi067.stdout:(164/285): mesa-filesystem-24.1.2-3.el9.x86_64. 192 kB/s | 11 kB 00:00 2024-09-12T16:56:56.692 INFO:teuthology.orchestra.run.smithi067.stdout:(165/285): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 1.6 MB/s | 139 kB 00:00 2024-09-12T16:56:56.717 INFO:teuthology.orchestra.run.smithi067.stdout:(166/285): mesa-libGL-24.1.2-3.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2024-09-12T16:56:56.742 INFO:teuthology.orchestra.run.smithi067.stdout:(167/285): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 726 kB/s | 36 kB 00:00 2024-09-12T16:56:56.780 INFO:teuthology.orchestra.run.smithi118.stdout:(112/285): java-11-openjdk-headless-11.0.20.1.1 14 MB/s | 39 MB 00:02 2024-09-12T16:56:56.783 INFO:teuthology.orchestra.run.smithi067.stdout:(168/285): mesa-libglapi-24.1.2-3.el9.x86_64.rp 695 kB/s | 46 kB 00:00 2024-09-12T16:56:56.797 INFO:teuthology.orchestra.run.smithi118.stdout:(113/285): libXinerama-1.1.4-10.el9.x86_64.rpm 32 kB/s | 15 kB 00:00 2024-09-12T16:56:56.809 INFO:teuthology.orchestra.run.smithi067.stdout:(169/285): mkfontscale-1.2.1-3.el9.x86_64.rpm 489 kB/s | 32 kB 00:00 2024-09-12T16:56:56.917 INFO:teuthology.orchestra.run.smithi067.stdout:(170/285): mesa-dri-drivers-24.1.2-3.el9.x86_64 24 MB/s | 8.8 MB 00:00 2024-09-12T16:56:56.942 INFO:teuthology.orchestra.run.smithi067.stdout:(171/285): openblas-0.3.26-2.el9.x86_64.rpm 242 kB/s | 38 kB 00:00 2024-09-12T16:56:56.964 INFO:teuthology.orchestra.run.smithi118.stdout:(114/285): libXrandr-1.5.2-8.el9.x86_64.rpm 52 kB/s | 28 kB 00:00 2024-09-12T16:56:56.976 INFO:teuthology.orchestra.run.smithi067.stdout:(172/285): openjpeg2-2.4.0-7.el9.x86_64.rpm 2.7 MB/s | 163 kB 00:00 2024-09-12T16:56:57.001 INFO:teuthology.orchestra.run.smithi067.stdout:(173/285): opus-1.3.1-10.el9.x86_64.rpm 3.3 MB/s | 200 kB 00:00 2024-09-12T16:56:57.027 INFO:teuthology.orchestra.run.smithi067.stdout:(174/285): orc-0.4.31-8.el9.x86_64.rpm 3.6 MB/s | 183 kB 00:00 2024-09-12T16:56:57.056 INFO:teuthology.orchestra.run.smithi118.stdout:(115/285): libXtst-1.2.3-16.el9.x86_64.rpm 78 kB/s | 21 kB 00:00 2024-09-12T16:56:57.081 INFO:teuthology.orchestra.run.smithi118.stdout:(116/285): libXv-1.0.11-16.el9.x86_64.rpm 67 kB/s | 19 kB 00:00 2024-09-12T16:56:57.110 INFO:teuthology.orchestra.run.smithi067.stdout:(175/285): openblas-openmp-0.3.26-2.el9.x86_64. 16 MB/s | 4.9 MB 00:00 2024-09-12T16:56:57.136 INFO:teuthology.orchestra.run.smithi067.stdout:(176/285): osinfo-db-tools-1.10.0-1.el9.x86_64. 680 kB/s | 74 kB 00:00 2024-09-12T16:56:57.161 INFO:teuthology.orchestra.run.smithi067.stdout:(177/285): osinfo-db-20240701-2.el9.noarch.rpm 3.3 MB/s | 531 kB 00:00 2024-09-12T16:56:57.194 INFO:teuthology.orchestra.run.smithi067.stdout:(178/285): ostree-libs-2024.7-2.el9.x86_64.rpm 5.5 MB/s | 468 kB 00:00 2024-09-12T16:56:57.219 INFO:teuthology.orchestra.run.smithi067.stdout:(179/285): pipewire-1.0.1-1.el9.x86_64.rpm 1.8 MB/s | 107 kB 00:00 2024-09-12T16:56:57.245 INFO:teuthology.orchestra.run.smithi067.stdout:(180/285): p11-kit-server-0.25.3-2.el9.x86_64.r 2.2 MB/s | 246 kB 00:00 2024-09-12T16:56:57.248 INFO:teuthology.orchestra.run.smithi118.stdout:(117/285): libXxf86vm-1.1.4-18.el9.x86_64.rpm 66 kB/s | 19 kB 00:00 2024-09-12T16:56:57.270 INFO:teuthology.orchestra.run.smithi067.stdout:(181/285): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 760 kB/s | 57 kB 00:00 2024-09-12T16:56:57.295 INFO:teuthology.orchestra.run.smithi067.stdout:(182/285): pipewire-jack-audio-connection-kit-1 121 kB/s | 9.1 kB 00:00 2024-09-12T16:56:57.329 INFO:teuthology.orchestra.run.smithi067.stdout:(183/285): pipewire-jack-audio-connection-kit-l 1.6 MB/s | 135 kB 00:00 2024-09-12T16:56:57.348 INFO:teuthology.orchestra.run.smithi118.stdout:(118/285): libasyncns-0.8-22.el9.x86_64.rpm 104 kB/s | 30 kB 00:00 2024-09-12T16:56:57.354 INFO:teuthology.orchestra.run.smithi067.stdout:(184/285): pipewire-pulseaudio-1.0.1-1.el9.x86_ 3.2 MB/s | 192 kB 00:00 2024-09-12T16:56:57.380 INFO:teuthology.orchestra.run.smithi067.stdout:(185/285): plexus-cipher-1.7-27.el9.noarch.rpm 516 kB/s | 26 kB 00:00 2024-09-12T16:56:57.405 INFO:teuthology.orchestra.run.smithi067.stdout:(186/285): plexus-classworlds-2.6.0-11.el9.noar 1.2 MB/s | 60 kB 00:00 2024-09-12T16:56:57.447 INFO:teuthology.orchestra.run.smithi067.stdout:(187/285): pipewire-libs-1.0.1-1.el9.x86_64.rpm 11 MB/s | 1.9 MB 00:00 2024-09-12T16:56:57.472 INFO:teuthology.orchestra.run.smithi067.stdout:(188/285): plexus-containers-component-annotati 199 kB/s | 18 kB 00:00 2024-09-12T16:56:57.489 INFO:teuthology.orchestra.run.smithi067.stdout:(189/285): plexus-interpolation-1.26-11.el9.noa 950 kB/s | 80 kB 00:00 2024-09-12T16:56:57.514 INFO:teuthology.orchestra.run.smithi067.stdout:(190/285): plexus-sec-dispatcher-1.4-37.el9.noa 500 kB/s | 34 kB 00:00 2024-09-12T16:56:57.524 INFO:teuthology.orchestra.run.smithi118.stdout:(119/285): libcanberra-0.30-27.el9.x86_64.rpm 195 kB/s | 86 kB 00:00 2024-09-12T16:56:57.540 INFO:teuthology.orchestra.run.smithi067.stdout:(191/285): plexus-utils-3.3.0-10.el9.noarch.rpm 3.7 MB/s | 254 kB 00:00 2024-09-12T16:56:57.549 INFO:teuthology.orchestra.run.smithi118.stdout:(120/285): libcanberra-gtk3-0.30-27.el9.x86_64. 106 kB/s | 32 kB 00:00 2024-09-12T16:56:57.598 INFO:teuthology.orchestra.run.smithi067.stdout:(192/285): poppler-data-0.4.9-9.el9.noarch.rpm 22 MB/s | 1.9 MB 00:00 2024-09-12T16:56:57.623 INFO:teuthology.orchestra.run.smithi067.stdout:(193/285): poppler-glib-21.01.0-21.el9.x86_64.r 1.8 MB/s | 152 kB 00:00 2024-09-12T16:56:57.665 INFO:teuthology.orchestra.run.smithi067.stdout:(194/285): poppler-21.01.0-21.el9.x86_64.rpm 6.0 MB/s | 1.1 MB 00:00 2024-09-12T16:56:57.690 INFO:teuthology.orchestra.run.smithi067.stdout:(195/285): publicsuffix-list-20210518-3.el9.noa 1.2 MB/s | 83 kB 00:00 2024-09-12T16:56:57.725 INFO:teuthology.orchestra.run.smithi067.stdout:(196/285): protobuf-3.14.0-13.el9.x86_64.rpm 8.0 MB/s | 1.0 MB 00:00 2024-09-12T16:56:57.783 INFO:teuthology.orchestra.run.smithi067.stdout:(197/285): python3-devel-3.9.19-8.el9.x86_64.rp 4.1 MB/s | 245 kB 00:00 2024-09-12T16:56:57.808 INFO:teuthology.orchestra.run.smithi067.stdout:(198/285): pulseaudio-libs-15.0-2.el9.x86_64.rp 4.7 MB/s | 679 kB 00:00 2024-09-12T16:56:57.850 INFO:teuthology.orchestra.run.smithi067.stdout:(199/285): python3-jinja2-2.11.3-6.el9.noarch.r 3.6 MB/s | 248 kB 00:00 2024-09-12T16:56:57.858 INFO:teuthology.orchestra.run.smithi118.stdout:(121/285): libdrm-2.4.121-1.el9.x86_64.rpm 316 kB/s | 161 kB 00:00 2024-09-12T16:56:57.875 INFO:teuthology.orchestra.run.smithi067.stdout:(200/285): python3-jsonpatch-1.21-16.el9.noarch 383 kB/s | 26 kB 00:00 2024-09-12T16:56:57.892 INFO:teuthology.orchestra.run.smithi067.stdout:(201/285): python3-jsonpointer-2.0-4.el9.noarch 459 kB/s | 19 kB 00:00 2024-09-12T16:56:57.967 INFO:teuthology.orchestra.run.smithi067.stdout:(202/285): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 6.0 MB 00:00 2024-09-12T16:56:57.984 INFO:teuthology.orchestra.run.smithi067.stdout:(203/285): python3-markupsafe-1.1.1-12.el9.x86_ 378 kB/s | 35 kB 00:00 2024-09-12T16:56:58.009 INFO:teuthology.orchestra.run.smithi067.stdout:(204/285): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-12T16:56:58.025 INFO:teuthology.orchestra.run.smithi118.stdout:(122/285): libepoxy-1.5.5-4.el9.x86_64.rpm 483 kB/s | 241 kB 00:00 2024-09-12T16:56:58.043 INFO:teuthology.orchestra.run.smithi067.stdout:(205/285): python3-numpy-f2py-1.20.1-5.el9.x86_ 4.2 MB/s | 250 kB 00:00 2024-09-12T16:56:58.068 INFO:teuthology.orchestra.run.smithi067.stdout:(206/285): python3-oauthlib-3.1.1-5.el9.noarch. 3.7 MB/s | 222 kB 00:00 2024-09-12T16:56:58.102 INFO:teuthology.orchestra.run.smithi067.stdout:(207/285): python3-packaging-20.9-5.el9.noarch. 1.3 MB/s | 77 kB 00:00 2024-09-12T16:56:58.127 INFO:teuthology.orchestra.run.smithi067.stdout:(208/285): python3-prettytable-0.7.2-27.el9.noa 722 kB/s | 42 kB 00:00 2024-09-12T16:56:58.161 INFO:teuthology.orchestra.run.smithi067.stdout:(209/285): python3-protobuf-3.14.0-13.el9.noarc 4.5 MB/s | 269 kB 00:00 2024-09-12T16:56:58.186 INFO:teuthology.orchestra.run.smithi067.stdout:(210/285): python3-pyasn1-0.4.8-6.el9.noarch.rp 2.6 MB/s | 159 kB 00:00 2024-09-12T16:56:58.219 INFO:teuthology.orchestra.run.smithi067.stdout:(211/285): python3-pyasn1-modules-0.4.8-6.el9.n 4.7 MB/s | 279 kB 00:00 2024-09-12T16:56:58.225 INFO:teuthology.orchestra.run.smithi118.stdout:(123/285): libfontenc-1.1.3-17.el9.x86_64.rpm 84 kB/s | 31 kB 00:00 2024-09-12T16:56:58.245 INFO:teuthology.orchestra.run.smithi067.stdout:(212/285): python3-pytz-2021.1-5.el9.noarch.rpm 873 kB/s | 51 kB 00:00 2024-09-12T16:56:58.312 INFO:teuthology.orchestra.run.smithi067.stdout:(213/285): python3-numpy-1.20.1-5.el9.x86_64.rp 15 MB/s | 5.1 MB 00:00 2024-09-12T16:56:58.337 INFO:teuthology.orchestra.run.smithi067.stdout:(214/285): python3-requests-oauthlib-1.3.0-12.e 458 kB/s | 54 kB 00:00 2024-09-12T16:56:58.350 INFO:teuthology.orchestra.run.smithi118.stdout:(124/285): libexif-0.6.22-6.el9.x86_64.rpm 544 kB/s | 435 kB 00:00 2024-09-12T16:56:58.362 INFO:teuthology.orchestra.run.smithi067.stdout:(215/285): python3-toml-0.10.2-6.el9.noarch.rpm 828 kB/s | 42 kB 00:00 2024-09-12T16:56:58.396 INFO:teuthology.orchestra.run.smithi067.stdout:(216/285): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-12T16:56:58.421 INFO:teuthology.orchestra.run.smithi067.stdout:(217/285): qatlib-service-24.02.0-1.el9.x86_64. 614 kB/s | 36 kB 00:00 2024-09-12T16:56:58.471 INFO:teuthology.orchestra.run.smithi067.stdout:(218/285): qatzip-libs-1.2.0-1.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-09-12T16:56:58.497 INFO:teuthology.orchestra.run.smithi067.stdout:(219/285): rtkit-0.11-29.el9.x86_64.rpm 744 kB/s | 56 kB 00:00 2024-09-12T16:56:58.530 INFO:teuthology.orchestra.run.smithi067.stdout:(220/285): sisu-0.3.4-10.el9.noarch.rpm 8.5 MB/s | 510 kB 00:00 2024-09-12T16:56:58.556 INFO:teuthology.orchestra.run.smithi067.stdout:(221/285): slf4j-1.7.30-13.el9.noarch.rpm 1.2 MB/s | 69 kB 00:00 2024-09-12T16:56:58.559 INFO:teuthology.orchestra.run.smithi118.stdout:(125/285): libgexiv2-0.12.3-1.el9.x86_64.rpm 155 kB/s | 83 kB 00:00 2024-09-12T16:56:58.589 INFO:teuthology.orchestra.run.smithi067.stdout:(222/285): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-12T16:56:58.615 INFO:teuthology.orchestra.run.smithi067.stdout:(223/285): sound-theme-freedesktop-0.8-17.el9.n 6.4 MB/s | 383 kB 00:00 2024-09-12T16:56:58.617 INFO:teuthology.orchestra.run.smithi118.stdout:(126/285): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 138 kB/s | 37 kB 00:00 2024-09-12T16:56:58.649 INFO:teuthology.orchestra.run.smithi067.stdout:(224/285): totem-pl-parser-3.26.6-2.el9.x86_64. 2.5 MB/s | 152 kB 00:00 2024-09-12T16:56:58.682 INFO:teuthology.orchestra.run.smithi067.stdout:(225/285): tracker-3.1.2-3.el9.x86_64.rpm 8.1 MB/s | 555 kB 00:00 2024-09-12T16:56:58.684 INFO:teuthology.orchestra.run.smithi118.stdout:(127/285): libglvnd-1.3.4-1.el9.x86_64.rpm 295 kB/s | 135 kB 00:00 2024-09-12T16:56:58.715 INFO:teuthology.orchestra.run.smithi067.stdout:(226/285): tracker-miners-3.1.2-4.el9.x86_64.rp 14 MB/s | 944 kB 00:00 2024-09-12T16:56:58.741 INFO:teuthology.orchestra.run.smithi067.stdout:(227/285): ttmkfdir-3.0.9-65.el9.x86_64.rpm 912 kB/s | 53 kB 00:00 2024-09-12T16:56:58.791 INFO:teuthology.orchestra.run.smithi067.stdout:(228/285): tzdata-java-2024a-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-12T16:56:58.816 INFO:teuthology.orchestra.run.smithi067.stdout:(229/285): upower-0.99.11-11.el9.x86_64.rpm 2.2 MB/s | 173 kB 00:00 2024-09-12T16:56:58.858 INFO:teuthology.orchestra.run.smithi067.stdout:(230/285): webrtc-audio-processing-0.3.1-8.el9. 4.5 MB/s | 306 kB 00:00 2024-09-12T16:56:58.892 INFO:teuthology.orchestra.run.smithi067.stdout:(231/285): wireplumber-0.4.14-1.el9.x86_64.rpm 1.3 MB/s | 96 kB 00:00 2024-09-12T16:56:58.917 INFO:teuthology.orchestra.run.smithi067.stdout:(232/285): wireplumber-libs-0.4.14-1.el9.x86_64 6.0 MB/s | 358 kB 00:00 2024-09-12T16:56:58.967 INFO:teuthology.orchestra.run.smithi067.stdout:(233/285): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 565 kB/s | 42 kB 00:00 2024-09-12T16:56:59.001 INFO:teuthology.orchestra.run.smithi067.stdout:(234/285): xdg-desktop-portal-1.12.6-1.el9.x86_ 4.5 MB/s | 385 kB 00:00 2024-09-12T16:56:59.026 INFO:teuthology.orchestra.run.smithi067.stdout:(235/285): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.2 MB/s | 134 kB 00:00 2024-09-12T16:56:59.027 INFO:teuthology.orchestra.run.smithi118.stdout:(128/285): libgxps-0.3.2-3.el9.x86_64.rpm 231 kB/s | 79 kB 00:00 2024-09-12T16:56:59.052 INFO:teuthology.orchestra.run.smithi118.stdout:(129/285): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 289 kB/s | 142 kB 00:00 2024-09-12T16:56:59.076 INFO:teuthology.orchestra.run.smithi067.stdout:(236/285): xkeyboard-config-2.33-2.el9.noarch.r 11 MB/s | 859 kB 00:00 2024-09-12T16:56:59.102 INFO:teuthology.orchestra.run.smithi067.stdout:(237/285): xmlstarlet-1.6.1-20.el9.x86_64.rpm 845 kB/s | 64 kB 00:00 2024-09-12T16:56:59.152 INFO:teuthology.orchestra.run.smithi118.stdout:(130/285): libgsf-1.14.47-5.el9.x86_64.rpm 479 kB/s | 256 kB 00:00 2024-09-12T16:56:59.260 INFO:teuthology.orchestra.run.smithi067.stdout:(238/285): python3-scipy-1.6.2-8.el9.x86_64.rpm 16 MB/s | 16 MB 00:01 2024-09-12T16:56:59.285 INFO:teuthology.orchestra.run.smithi067.stdout:(239/285): lua-devel-5.4.4-4.el9.x86_64.rpm 121 kB/s | 22 kB 00:00 2024-09-12T16:56:59.319 INFO:teuthology.orchestra.run.smithi067.stdout:(240/285): xorg-x11-fonts-Type1-7.5-33.el9.noar 2.0 MB/s | 505 kB 00:00 2024-09-12T16:56:59.335 INFO:teuthology.orchestra.run.smithi118.stdout:(131/285): libldac-2.0.2.3-10.el9.x86_64.rpm 146 kB/s | 41 kB 00:00 2024-09-12T16:56:59.361 INFO:teuthology.orchestra.run.smithi118.stdout:(132/285): libiptcdata-1.0.5-10.el9.x86_64.rpm 183 kB/s | 61 kB 00:00 2024-09-12T16:56:59.361 INFO:teuthology.orchestra.run.smithi067.stdout:(241/285): protobuf-compiler-3.14.0-13.el9.x86_ 8.4 MB/s | 863 kB 00:00 2024-09-12T16:56:59.403 INFO:teuthology.orchestra.run.smithi067.stdout:(242/285): abseil-cpp-20211102.0-3.el9.x86_64.r 4.6 MB/s | 548 kB 00:00 2024-09-12T16:56:59.428 INFO:teuthology.orchestra.run.smithi067.stdout:(243/285): grpc-data-1.46.7-10.el9.noarch.rpm 300 kB/s | 19 kB 00:00 2024-09-12T16:56:59.454 INFO:teuthology.orchestra.run.smithi067.stdout:(244/285): gperftools-libs-2.9.1-3.el9.x86_64.r 2.3 MB/s | 308 kB 00:00 2024-09-12T16:56:59.479 INFO:teuthology.orchestra.run.smithi067.stdout:(245/285): libarrow-doc-9.0.0-11.el9.noarch.rpm 517 kB/s | 26 kB 00:00 2024-09-12T16:56:59.494 INFO:teuthology.orchestra.run.smithi118.stdout:(133/285): libnotify-0.7.9-8.el9.x86_64.rpm 127 kB/s | 44 kB 00:00 2024-09-12T16:56:59.504 INFO:teuthology.orchestra.run.smithi067.stdout:(246/285): liboath-2.6.7-2.el9.x86_64.rpm 968 kB/s | 49 kB 00:00 2024-09-12T16:56:59.521 INFO:teuthology.orchestra.run.smithi067.stdout:(247/285): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-12T16:56:59.555 INFO:teuthology.orchestra.run.smithi067.stdout:(248/285): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-12T16:56:59.588 INFO:teuthology.orchestra.run.smithi067.stdout:(249/285): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-12T16:56:59.595 INFO:teuthology.orchestra.run.smithi118.stdout:(134/285): libogg-1.3.4-6.el9.x86_64.rpm 130 kB/s | 34 kB 00:00 2024-09-12T16:56:59.605 INFO:teuthology.orchestra.run.smithi067.stdout:(250/285): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-12T16:56:59.622 INFO:teuthology.orchestra.run.smithi067.stdout:(251/285): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-12T16:56:59.639 INFO:teuthology.orchestra.run.smithi067.stdout:(252/285): python3-certifi-2023.05.07-4.el9.noa 862 kB/s | 14 kB 00:00 2024-09-12T16:56:59.673 INFO:teuthology.orchestra.run.smithi067.stdout:(253/285): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-09-12T16:56:59.689 INFO:teuthology.orchestra.run.smithi067.stdout:(254/285): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-12T16:56:59.723 INFO:teuthology.orchestra.run.smithi067.stdout:(255/285): python3-google-auth-2.34.0-1.el9.noa 6.5 MB/s | 220 kB 00:00 2024-09-12T16:56:59.748 INFO:teuthology.orchestra.run.smithi067.stdout:(256/285): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-09-12T16:56:59.782 INFO:teuthology.orchestra.run.smithi067.stdout:(257/285): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-12T16:56:59.807 INFO:teuthology.orchestra.run.smithi067.stdout:(258/285): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-12T16:56:59.832 INFO:teuthology.orchestra.run.smithi067.stdout:(259/285): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-09-12T16:56:59.858 INFO:teuthology.orchestra.run.smithi067.stdout:(260/285): python3-jaraco-collections-3.0.0-8.e 926 kB/s | 23 kB 00:00 2024-09-12T16:56:59.861 INFO:teuthology.orchestra.run.smithi118.stdout:(135/285): libosinfo-1.10.0-1.el9.x86_64.rpm 637 kB/s | 319 kB 00:00 2024-09-12T16:56:59.883 INFO:teuthology.orchestra.run.smithi067.stdout:(261/285): python3-jaraco-functools-3.5.0-2.el9 779 kB/s | 19 kB 00:00 2024-09-12T16:56:59.908 INFO:teuthology.orchestra.run.smithi067.stdout:(262/285): python3-jaraco-text-3.2.0-6.el9.noar 791 kB/s | 20 kB 00:00 2024-09-12T16:56:59.937 INFO:teuthology.orchestra.run.smithi118.stdout:(136/285): librabbitmq-0.11.0-7.el9.x86_64.rpm 132 kB/s | 45 kB 00:00 2024-09-12T16:56:59.962 INFO:teuthology.orchestra.run.smithi118.stdout:(137/285): libpmemobj-1.12.1-1.el9.x86_64.rpm 342 kB/s | 160 kB 00:00 2024-09-12T16:56:59.975 INFO:teuthology.orchestra.run.smithi067.stdout:(263/285): libarrow-9.0.0-11.el9.x86_64.rpm 7.7 MB/s | 4.4 MB 00:00 2024-09-12T16:57:00.001 INFO:teuthology.orchestra.run.smithi067.stdout:(264/285): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T16:57:00.026 INFO:teuthology.orchestra.run.smithi067.stdout:(265/285): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T16:57:00.051 INFO:teuthology.orchestra.run.smithi067.stdout:(266/285): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T16:57:00.101 INFO:teuthology.orchestra.run.smithi067.stdout:(267/285): python3-grpcio-1.46.7-10.el9.x86_64. 5.4 MB/s | 2.0 MB 00:00 2024-09-12T16:57:00.127 INFO:teuthology.orchestra.run.smithi067.stdout:(268/285): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-12T16:57:00.152 INFO:teuthology.orchestra.run.smithi067.stdout:(269/285): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-12T16:57:00.185 INFO:teuthology.orchestra.run.smithi067.stdout:(270/285): python3-kubernetes-26.1.0-2.el9.noar 3.7 MB/s | 1.0 MB 00:00 2024-09-12T16:57:00.211 INFO:teuthology.orchestra.run.smithi067.stdout:(271/285): python3-repoze-lru-0.7-16.el9.noarch 528 kB/s | 31 kB 00:00 2024-09-12T16:57:00.236 INFO:teuthology.orchestra.run.smithi067.stdout:(272/285): python3-pyOpenSSL-21.0.0-1.el9.noarc 826 kB/s | 90 kB 00:00 2024-09-12T16:57:00.261 INFO:teuthology.orchestra.run.smithi067.stdout:(273/285): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-12T16:57:00.279 INFO:teuthology.orchestra.run.smithi118.stdout:(138/285): libsbc-1.4-9.el9.x86_64.rpm 131 kB/s | 45 kB 00:00 2024-09-12T16:57:00.286 INFO:teuthology.orchestra.run.smithi067.stdout:(274/285): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-12T16:57:00.312 INFO:teuthology.orchestra.run.smithi067.stdout:(275/285): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-12T16:57:00.337 INFO:teuthology.orchestra.run.smithi067.stdout:(276/285): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-12T16:57:00.362 INFO:teuthology.orchestra.run.smithi067.stdout:(277/285): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-12T16:57:00.396 INFO:teuthology.orchestra.run.smithi067.stdout:(278/285): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-12T16:57:00.421 INFO:teuthology.orchestra.run.smithi067.stdout:(279/285): python3-zc-lockfile-2.0-10.el9.noarc 340 kB/s | 20 kB 00:00 2024-09-12T16:57:00.446 INFO:teuthology.orchestra.run.smithi067.stdout:(280/285): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-12T16:57:00.471 INFO:teuthology.orchestra.run.smithi118.stdout:(139/285): librdkafka-1.6.1-102.el9.x86_64.rpm 1.1 MB/s | 662 kB 00:00 2024-09-12T16:57:00.538 INFO:teuthology.orchestra.run.smithi118.stdout:(140/285): libsndfile-1.0.31-8.el9.x86_64.rpm 359 kB/s | 206 kB 00:00 2024-09-12T16:57:00.595 INFO:teuthology.orchestra.run.smithi067.stdout:(281/285): python3-werkzeug-2.0.3-3.el9.1.noarc 1.6 MB/s | 427 kB 00:00 2024-09-12T16:57:00.622 INFO:teuthology.orchestra.run.smithi067.stdout:(282/285): s3cmd-2.4.0-1.el9.noarch.rpm 1.0 MB/s | 206 kB 00:00 2024-09-12T16:57:00.672 INFO:teuthology.orchestra.run.smithi067.stdout:(283/285): thrift-0.15.0-2.el9.x86_64.rpm 7.0 MB/s | 1.6 MB 00:00 2024-09-12T16:57:00.789 INFO:teuthology.orchestra.run.smithi118.stdout:(141/285): libtheora-1.1.1-31.el9.x86_64.rpm 322 kB/s | 164 kB 00:00 2024-09-12T16:57:00.806 INFO:teuthology.orchestra.run.smithi118.stdout:(142/285): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 133 kB/s | 36 kB 00:00 2024-09-12T16:57:00.890 INFO:teuthology.orchestra.run.smithi067.stdout:(284/285): librbd1-19.3.0-4762.gbad475c1.el9.x8 12 MB/s | 3.2 MB 00:00 2024-09-12T16:57:00.956 INFO:teuthology.orchestra.run.smithi067.stdout:(285/285): librados2-19.3.0-4762.gbad475c1.el9. 9.6 MB/s | 3.5 MB 00:00 2024-09-12T16:57:01.128 INFO:teuthology.orchestra.run.smithi118.stdout:(143/285): libtiff-4.4.0-13.el9.x86_64.rpm 344 kB/s | 198 kB 00:00 2024-09-12T16:57:01.128 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:57:01.128 INFO:teuthology.orchestra.run.smithi067.stdout:Total 17 MB/s | 322 MB 00:18 2024-09-12T16:57:01.231 INFO:teuthology.orchestra.run.smithi118.stdout:(144/285): libvisual-0.4.0-34.el9.x86_64.rpm 338 kB/s | 144 kB 00:00 2024-09-12T16:57:01.373 INFO:teuthology.orchestra.run.smithi118.stdout:(145/285): libtracker-sparql-3.1.2-3.el9.x86_64 554 kB/s | 324 kB 00:00 2024-09-12T16:57:01.498 INFO:teuthology.orchestra.run.smithi118.stdout:(146/285): libwayland-client-1.21.0-1.el9.x86_6 125 kB/s | 33 kB 00:00 2024-09-12T16:57:01.540 INFO:teuthology.orchestra.run.smithi118.stdout:(147/285): libvorbis-1.3.7-5.el9.x86_64.rpm 392 kB/s | 193 kB 00:00 2024-09-12T16:57:01.640 INFO:teuthology.orchestra.run.smithi118.stdout:(148/285): libwayland-cursor-1.21.0-1.el9.x86_6 73 kB/s | 19 kB 00:00 2024-09-12T16:57:01.682 INFO:teuthology.orchestra.run.smithi118.stdout:(149/285): libwayland-egl-1.21.0-1.el9.x86_64.r 70 kB/s | 13 kB 00:00 2024-09-12T16:57:01.891 INFO:teuthology.orchestra.run.smithi118.stdout:(150/285): libwayland-server-1.21.0-1.el9.x86_6 119 kB/s | 42 kB 00:00 2024-09-12T16:57:02.091 INFO:teuthology.orchestra.run.smithi118.stdout:(151/285): libxshmfence-1.3-10.el9.x86_64.rpm 63 kB/s | 13 kB 00:00 2024-09-12T16:57:02.183 INFO:teuthology.orchestra.run.smithi118.stdout:(152/285): libxkbcommon-1.0.3-4.el9.x86_64.rpm 267 kB/s | 133 kB 00:00 2024-09-12T16:57:02.242 INFO:teuthology.orchestra.run.smithi118.stdout:(153/285): libwebp-1.2.0-8.el9.x86_64.rpm 461 kB/s | 277 kB 00:00 2024-09-12T16:57:02.400 INFO:teuthology.orchestra.run.smithi118.stdout:(154/285): low-memory-monitor-2.1-4.el9.x86_64. 116 kB/s | 36 kB 00:00 2024-09-12T16:57:02.667 INFO:teuthology.orchestra.run.smithi118.stdout:(155/285): lua-5.4.4-4.el9.x86_64.rpm 443 kB/s | 188 kB 00:00 2024-09-12T16:57:02.692 INFO:teuthology.orchestra.run.smithi118.stdout:(156/285): lttng-ust-2.12.0-6.el9.x86_64.rpm 574 kB/s | 292 kB 00:00 2024-09-12T16:57:02.909 INFO:teuthology.orchestra.run.smithi118.stdout:(157/285): lua-posix-35.0-8.el9.x86_64.rpm 297 kB/s | 151 kB 00:00 2024-09-12T16:57:03.023 INFO:teuthology.orchestra.run.smithi118.stdout:(158/285): maven-3.6.3-15.el9.noarch.rpm 66 kB/s | 18 kB 00:00 2024-09-12T16:57:03.102 INFO:teuthology.orchestra.run.smithi118.stdout:(159/285): maven-openjdk11-3.6.3-15.el9.noarch. 47 kB/s | 9.0 kB 00:00 2024-09-12T16:57:03.446 INFO:teuthology.orchestra.run.smithi118.stdout:(160/285): maven-lib-3.6.3-15.el9.noarch.rpm 2.0 MB/s | 1.5 MB 00:00 2024-09-12T16:57:03.527 INFO:teuthology.orchestra.run.smithi118.stdout:(161/285): maven-shared-utils-3.3.4-3.el9.noarc 355 kB/s | 151 kB 00:00 2024-09-12T16:57:03.552 INFO:teuthology.orchestra.run.smithi118.stdout:(162/285): maven-resolver-1.6.1-10.el9.noarch.r 837 kB/s | 517 kB 00:00 2024-09-12T16:57:03.744 INFO:teuthology.orchestra.run.smithi118.stdout:(163/285): mesa-filesystem-24.1.2-3.el9.x86_64. 59 kB/s | 11 kB 00:00 2024-09-12T16:57:03.920 INFO:teuthology.orchestra.run.smithi118.stdout:(164/285): maven-wagon-3.4.2-7.el9.noarch.rpm 236 kB/s | 112 kB 00:00 2024-09-12T16:57:04.170 INFO:teuthology.orchestra.run.smithi118.stdout:(165/285): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 326 kB/s | 139 kB 00:00 2024-09-12T16:57:04.254 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-09-12T16:57:04.421 INFO:teuthology.orchestra.run.smithi118.stdout:(166/285): mesa-libGL-24.1.2-3.el9.x86_64.rpm 341 kB/s | 171 kB 00:00 2024-09-12T16:57:04.566 INFO:teuthology.orchestra.run.smithi118.stdout:(167/285): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 132 kB/s | 36 kB 00:00 2024-09-12T16:57:04.566 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-09-12T16:57:04.566 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-09-12T16:57:04.638 INFO:teuthology.orchestra.run.smithi118.stdout:(168/285): mesa-dri-drivers-24.1.2-3.el9.x86_64 7.9 MB/s | 8.8 MB 00:01 2024-09-12T16:57:04.713 INFO:teuthology.orchestra.run.smithi118.stdout:(169/285): mkfontscale-1.2.1-3.el9.x86_64.rpm 121 kB/s | 32 kB 00:00 2024-09-12T16:57:04.763 INFO:teuthology.orchestra.run.smithi118.stdout:(170/285): mesa-libglapi-24.1.2-3.el9.x86_64.rp 134 kB/s | 46 kB 00:00 2024-09-12T16:57:04.914 INFO:teuthology.orchestra.run.smithi118.stdout:(171/285): openblas-0.3.26-2.el9.x86_64.rpm 140 kB/s | 38 kB 00:00 2024-09-12T16:57:05.197 INFO:teuthology.orchestra.run.smithi118.stdout:(172/285): openjpeg2-2.4.0-7.el9.x86_64.rpm 376 kB/s | 163 kB 00:00 2024-09-12T16:57:05.481 INFO:teuthology.orchestra.run.smithi118.stdout:(173/285): opus-1.3.1-10.el9.x86_64.rpm 352 kB/s | 200 kB 00:00 2024-09-12T16:57:05.614 INFO:teuthology.orchestra.run.smithi118.stdout:(174/285): orc-0.4.31-8.el9.x86_64.rpm 440 kB/s | 183 kB 00:00 2024-09-12T16:57:05.953 INFO:teuthology.orchestra.run.smithi118.stdout:(175/285): osinfo-db-tools-1.10.0-1.el9.x86_64. 218 kB/s | 74 kB 00:00 2024-09-12T16:57:06.078 INFO:teuthology.orchestra.run.smithi118.stdout:(176/285): osinfo-db-20240701-2.el9.noarch.rpm 889 kB/s | 531 kB 00:00 2024-09-12T16:57:06.420 INFO:teuthology.orchestra.run.smithi118.stdout:(177/285): openblas-openmp-0.3.26-2.el9.x86_64. 2.9 MB/s | 4.9 MB 00:01 2024-09-12T16:57:06.521 INFO:teuthology.orchestra.run.smithi118.stdout:(178/285): ostree-libs-2024.7-2.el9.x86_64.rpm 825 kB/s | 468 kB 00:00 2024-09-12T16:57:06.596 INFO:teuthology.orchestra.run.smithi118.stdout:(179/285): p11-kit-server-0.25.3-2.el9.x86_64.r 476 kB/s | 246 kB 00:00 2024-09-12T16:57:06.788 INFO:teuthology.orchestra.run.smithi118.stdout:(180/285): pipewire-jack-audio-connection-kit-1 48 kB/s | 9.1 kB 00:00 2024-09-12T16:57:06.854 INFO:teuthology.orchestra.run.smithi118.stdout:(181/285): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 172 kB/s | 57 kB 00:00 2024-09-12T16:57:06.880 INFO:teuthology.orchestra.run.smithi118.stdout:(182/285): pipewire-1.0.1-1.el9.x86_64.rpm 232 kB/s | 107 kB 00:00 2024-09-12T16:57:07.222 INFO:teuthology.orchestra.run.smithi118.stdout:(183/285): pipewire-jack-audio-connection-kit-l 311 kB/s | 135 kB 00:00 2024-09-12T16:57:07.380 INFO:teuthology.orchestra.run.smithi118.stdout:(184/285): pipewire-pulseaudio-1.0.1-1.el9.x86_ 383 kB/s | 192 kB 00:00 2024-09-12T16:57:07.505 INFO:teuthology.orchestra.run.smithi118.stdout:(185/285): plexus-cipher-1.7-27.el9.noarch.rpm 91 kB/s | 26 kB 00:00 2024-09-12T16:57:07.673 INFO:teuthology.orchestra.run.smithi118.stdout:(186/285): pipewire-libs-1.0.1-1.el9.x86_64.rpm 2.4 MB/s | 1.9 MB 00:00 2024-09-12T16:57:07.739 INFO:teuthology.orchestra.run.smithi118.stdout:(187/285): plexus-classworlds-2.6.0-11.el9.noar 167 kB/s | 60 kB 00:00 2024-09-12T16:57:07.771 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-09-12T16:57:07.772 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-09-12T16:57:07.781 INFO:teuthology.orchestra.run.smithi118.stdout:(188/285): plexus-containers-component-annotati 67 kB/s | 18 kB 00:00 2024-09-12T16:57:08.007 INFO:teuthology.orchestra.run.smithi118.stdout:(189/285): plexus-sec-dispatcher-1.4-37.el9.noa 126 kB/s | 34 kB 00:00 2024-09-12T16:57:08.041 INFO:teuthology.orchestra.run.smithi118.stdout:(190/285): plexus-interpolation-1.26-11.el9.noa 217 kB/s | 80 kB 00:00 2024-09-12T16:57:08.315 INFO:teuthology.orchestra.run.smithi118.stdout:(191/285): plexus-utils-3.3.0-10.el9.noarch.rpm 476 kB/s | 254 kB 00:00 2024-09-12T16:57:08.724 INFO:teuthology.orchestra.run.smithi118.stdout:(192/285): poppler-21.01.0-21.el9.x86_64.rpm 1.5 MB/s | 1.1 MB 00:00 2024-09-12T16:57:08.741 INFO:teuthology.orchestra.run.smithi118.stdout:(193/285): poppler-glib-21.01.0-21.el9.x86_64.r 358 kB/s | 152 kB 00:00 2024-09-12T16:57:08.962 INFO:teuthology.orchestra.run.smithi118.stdout:(194/285): poppler-data-0.4.9-9.el9.noarch.rpm 2.0 MB/s | 1.9 MB 00:00 2024-09-12T16:57:09.225 INFO:teuthology.orchestra.run.smithi118.stdout:(195/285): publicsuffix-list-20210518-3.el9.noa 171 kB/s | 83 kB 00:00 2024-09-12T16:57:09.500 INFO:teuthology.orchestra.run.smithi118.stdout:(196/285): protobuf-3.14.0-13.el9.x86_64.rpm 1.3 MB/s | 1.0 MB 00:00 2024-09-12T16:57:09.700 INFO:teuthology.orchestra.run.smithi118.stdout:(197/285): pulseaudio-libs-15.0-2.el9.x86_64.rp 920 kB/s | 679 kB 00:00 2024-09-12T16:57:10.009 INFO:teuthology.orchestra.run.smithi118.stdout:(198/285): python3-devel-3.9.19-8.el9.x86_64.rp 481 kB/s | 245 kB 00:00 2024-09-12T16:57:10.185 INFO:teuthology.orchestra.run.smithi118.stdout:(199/285): python3-babel-2.9.1-2.el9.noarch.rpm 6.2 MB/s | 6.0 MB 00:00 2024-09-12T16:57:10.243 INFO:teuthology.orchestra.run.smithi118.stdout:(200/285): python3-jinja2-2.11.3-6.el9.noarch.r 458 kB/s | 248 kB 00:00 2024-09-12T16:57:10.268 INFO:teuthology.orchestra.run.smithi118.stdout:(201/285): python3-jsonpatch-1.21-16.el9.noarch 99 kB/s | 26 kB 00:00 2024-09-12T16:57:10.452 INFO:teuthology.orchestra.run.smithi118.stdout:(202/285): python3-jsonpointer-2.0-4.el9.noarch 72 kB/s | 19 kB 00:00 2024-09-12T16:57:10.552 INFO:teuthology.orchestra.run.smithi118.stdout:(203/285): python3-markupsafe-1.1.1-12.el9.x86_ 122 kB/s | 35 kB 00:00 2024-09-12T16:57:10.769 INFO:teuthology.orchestra.run.smithi118.stdout:(204/285): python3-mako-1.1.4-6.el9.noarch.rpm 327 kB/s | 172 kB 00:00 2024-09-12T16:57:11.053 INFO:teuthology.orchestra.run.smithi118.stdout:(205/285): python3-numpy-f2py-1.20.1-5.el9.x86_ 501 kB/s | 250 kB 00:00 2024-09-12T16:57:11.278 INFO:teuthology.orchestra.run.smithi118.stdout:(206/285): python3-oauthlib-3.1.1-5.el9.noarch. 437 kB/s | 222 kB 00:00 2024-09-12T16:57:11.486 INFO:teuthology.orchestra.run.smithi118.stdout:(207/285): python3-packaging-20.9-5.el9.noarch. 178 kB/s | 77 kB 00:00 2024-09-12T16:57:11.628 INFO:teuthology.orchestra.run.smithi118.stdout:(208/285): python3-prettytable-0.7.2-27.el9.noa 121 kB/s | 42 kB 00:00 2024-09-12T16:57:11.995 INFO:teuthology.orchestra.run.smithi118.stdout:(209/285): python3-protobuf-3.14.0-13.el9.noarc 529 kB/s | 269 kB 00:00 2024-09-12T16:57:12.046 INFO:teuthology.orchestra.run.smithi118.stdout:(210/285): python3-pyasn1-0.4.8-6.el9.noarch.rp 380 kB/s | 159 kB 00:00 2024-09-12T16:57:12.379 INFO:teuthology.orchestra.run.smithi118.stdout:(211/285): python3-pytz-2021.1-5.el9.noarch.rpm 153 kB/s | 51 kB 00:00 2024-09-12T16:57:12.496 INFO:teuthology.orchestra.run.smithi118.stdout:(212/285): python3-pyasn1-modules-0.4.8-6.el9.n 557 kB/s | 279 kB 00:00 2024-09-12T16:57:12.730 INFO:teuthology.orchestra.run.smithi118.stdout:(213/285): python3-requests-oauthlib-1.3.0-12.e 153 kB/s | 54 kB 00:00 2024-09-12T16:57:13.005 INFO:teuthology.orchestra.run.smithi118.stdout:(214/285): python3-toml-0.10.2-6.el9.noarch.rpm 151 kB/s | 42 kB 00:00 2024-09-12T16:57:13.514 INFO:teuthology.orchestra.run.smithi118.stdout:(215/285): qatlib-24.02.0-1.el9.x86_64.rpm 434 kB/s | 221 kB 00:00 2024-09-12T16:57:13.814 INFO:teuthology.orchestra.run.smithi118.stdout:(216/285): python3-scipy-1.6.2-8.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-09-12T16:57:13.839 INFO:teuthology.orchestra.run.smithi118.stdout:(217/285): qatlib-service-24.02.0-1.el9.x86_64. 110 kB/s | 36 kB 00:00 2024-09-12T16:57:13.906 INFO:teuthology.orchestra.run.smithi118.stdout:(218/285): python3-numpy-1.20.1-5.el9.x86_64.rp 1.5 MB/s | 5.1 MB 00:03 2024-09-12T16:57:14.173 INFO:teuthology.orchestra.run.smithi118.stdout:(219/285): qatzip-libs-1.2.0-1.el9.x86_64.rpm 132 kB/s | 47 kB 00:00 2024-09-12T16:57:14.198 INFO:teuthology.orchestra.run.smithi118.stdout:(220/285): rtkit-0.11-29.el9.x86_64.rpm 156 kB/s | 56 kB 00:00 2024-09-12T16:57:14.524 INFO:teuthology.orchestra.run.smithi118.stdout:(221/285): sisu-0.3.4-10.el9.noarch.rpm 826 kB/s | 510 kB 00:00 2024-09-12T16:57:14.549 INFO:teuthology.orchestra.run.smithi118.stdout:(222/285): slf4j-1.7.30-13.el9.noarch.rpm 184 kB/s | 69 kB 00:00 2024-09-12T16:57:14.799 INFO:teuthology.orchestra.run.smithi118.stdout:(223/285): socat-1.7.4.1-6.el9.x86_64.rpm 506 kB/s | 304 kB 00:00 2024-09-12T16:57:15.058 INFO:teuthology.orchestra.run.smithi118.stdout:(224/285): totem-pl-parser-3.26.6-2.el9.x86_64. 300 kB/s | 152 kB 00:00 2024-09-12T16:57:15.141 INFO:teuthology.orchestra.run.smithi118.stdout:(225/285): sound-theme-freedesktop-0.8-17.el9.n 620 kB/s | 383 kB 00:00 2024-09-12T16:57:15.392 INFO:teuthology.orchestra.run.smithi118.stdout:(226/285): tracker-3.1.2-3.el9.x86_64.rpm 937 kB/s | 555 kB 00:00 2024-09-12T16:57:15.492 INFO:teuthology.orchestra.run.smithi118.stdout:(227/285): ttmkfdir-3.0.9-65.el9.x86_64.rpm 152 kB/s | 53 kB 00:00 2024-09-12T16:57:15.851 INFO:teuthology.orchestra.run.smithi118.stdout:(228/285): tracker-miners-3.1.2-4.el9.x86_64.rp 1.2 MB/s | 944 kB 00:00 2024-09-12T16:57:15.918 INFO:teuthology.orchestra.run.smithi118.stdout:(229/285): upower-0.99.11-11.el9.x86_64.rpm 406 kB/s | 173 kB 00:00 2024-09-12T16:57:15.951 INFO:teuthology.orchestra.run.smithi118.stdout:(230/285): tzdata-java-2024a-2.el9.noarch.rpm 411 kB/s | 230 kB 00:00 2024-09-12T16:57:16.352 INFO:teuthology.orchestra.run.smithi118.stdout:(231/285): wireplumber-0.4.14-1.el9.x86_64.rpm 223 kB/s | 96 kB 00:00 2024-09-12T16:57:16.460 INFO:teuthology.orchestra.run.smithi118.stdout:(232/285): wireplumber-libs-0.4.14-1.el9.x86_64 703 kB/s | 358 kB 00:00 2024-09-12T16:57:16.486 INFO:teuthology.orchestra.run.smithi118.stdout:(233/285): webrtc-audio-processing-0.3.1-8.el9. 482 kB/s | 306 kB 00:00 2024-09-12T16:57:16.736 INFO:teuthology.orchestra.run.smithi118.stdout:(234/285): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 110 kB/s | 42 kB 00:00 2024-09-12T16:57:16.911 INFO:teuthology.orchestra.run.smithi118.stdout:(235/285): xdg-desktop-portal-gtk-1.12.0-3.el9. 316 kB/s | 134 kB 00:00 2024-09-12T16:57:16.978 INFO:teuthology.orchestra.run.smithi118.stdout:(236/285): xdg-desktop-portal-1.12.6-1.el9.x86_ 745 kB/s | 385 kB 00:00 2024-09-12T16:57:17.262 INFO:teuthology.orchestra.run.smithi118.stdout:(237/285): xmlstarlet-1.6.1-20.el9.x86_64.rpm 182 kB/s | 64 kB 00:00 2024-09-12T16:57:17.387 INFO:teuthology.orchestra.run.smithi118.stdout:(238/285): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-09-12T16:57:17.429 INFO:teuthology.orchestra.run.smithi118.stdout:(239/285): xkeyboard-config-2.33-2.el9.noarch.r 1.2 MB/s | 859 kB 00:00 2024-09-12T16:57:17.504 INFO:teuthology.orchestra.run.smithi118.stdout:(240/285): abseil-cpp-20211102.0-3.el9.x86_64.r 7.2 MB/s | 548 kB 00:00 2024-09-12T16:57:17.538 INFO:teuthology.orchestra.run.smithi118.stdout:(241/285): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-12T16:57:17.563 INFO:teuthology.orchestra.run.smithi118.stdout:(242/285): grpc-data-1.46.7-10.el9.noarch.rpm 784 kB/s | 19 kB 00:00 2024-09-12T16:57:17.688 INFO:teuthology.orchestra.run.smithi118.stdout:(243/285): xorg-x11-fonts-Type1-7.5-33.el9.noar 711 kB/s | 505 kB 00:00 2024-09-12T16:57:17.714 INFO:teuthology.orchestra.run.smithi118.stdout:(244/285): protobuf-compiler-3.14.0-13.el9.x86_ 2.6 MB/s | 863 kB 00:00 2024-09-12T16:57:17.756 INFO:teuthology.orchestra.run.smithi118.stdout:(245/285): libarrow-doc-9.0.0-11.el9.noarch.rpm 388 kB/s | 26 kB 00:00 2024-09-12T16:57:17.781 INFO:teuthology.orchestra.run.smithi118.stdout:(246/285): liboath-2.6.7-2.el9.x86_64.rpm 822 kB/s | 49 kB 00:00 2024-09-12T16:57:17.806 INFO:teuthology.orchestra.run.smithi118.stdout:(247/285): libunwind-1.6.2-1.el9.x86_64.rpm 1.4 MB/s | 67 kB 00:00 2024-09-12T16:57:17.832 INFO:teuthology.orchestra.run.smithi118.stdout:(248/285): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-12T16:57:17.873 INFO:teuthology.orchestra.run.smithi118.stdout:(249/285): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-12T16:57:17.899 INFO:teuthology.orchestra.run.smithi118.stdout:(250/285): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T16:57:17.924 INFO:teuthology.orchestra.run.smithi118.stdout:(251/285): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T16:57:17.958 INFO:teuthology.orchestra.run.smithi118.stdout:(252/285): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.4 MB/s | 839 kB 00:00 2024-09-12T16:57:17.983 INFO:teuthology.orchestra.run.smithi118.stdout:(253/285): python3-certifi-2023.05.07-4.el9.noa 240 kB/s | 14 kB 00:00 2024-09-12T16:57:18.017 INFO:teuthology.orchestra.run.smithi118.stdout:(254/285): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-12T16:57:18.138 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-12T16:57:18.323 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-12T16:57:18.491 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-09-12T16:57:18.549 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/287 2024-09-12T16:57:18.588 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/287 2024-09-12T16:57:18.616 INFO:teuthology.orchestra.run.smithi118.stdout:(255/285): python3-cherrypy-18.6.1-2.el9.noarch 567 kB/s | 358 kB 00:00 2024-09-12T16:57:18.642 INFO:teuthology.orchestra.run.smithi118.stdout:(256/285): python3-google-auth-2.34.0-1.el9.noa 352 kB/s | 220 kB 00:00 2024-09-12T16:57:18.672 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/287 2024-09-12T16:57:18.709 INFO:teuthology.orchestra.run.smithi118.stdout:(257/285): libarrow-9.0.0-11.el9.x86_64.rpm 3.9 MB/s | 4.4 MB 00:01 2024-09-12T16:57:18.735 INFO:teuthology.orchestra.run.smithi118.stdout:(258/285): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-09-12T16:57:18.745 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/287 2024-09-12T16:57:18.760 INFO:teuthology.orchestra.run.smithi118.stdout:(259/285): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-12T16:57:18.785 INFO:teuthology.orchestra.run.smithi118.stdout:(260/285): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-12T16:57:18.805 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/287 2024-09-12T16:57:18.810 INFO:teuthology.orchestra.run.smithi118.stdout:(261/285): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-12T16:57:18.836 INFO:teuthology.orchestra.run.smithi118.stdout:(262/285): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-12T16:57:18.846 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/287 2024-09-12T16:57:18.863 INFO:teuthology.orchestra.run.smithi118.stdout:(263/285): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-12T16:57:18.871 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/287 2024-09-12T16:57:18.886 INFO:teuthology.orchestra.run.smithi118.stdout:(264/285): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T16:57:18.912 INFO:teuthology.orchestra.run.smithi118.stdout:(265/285): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T16:57:18.918 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/287 2024-09-12T16:57:18.945 INFO:teuthology.orchestra.run.smithi118.stdout:(266/285): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-12T16:57:18.979 INFO:teuthology.orchestra.run.smithi118.stdout:(267/285): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-12T16:57:19.029 INFO:teuthology.orchestra.run.smithi118.stdout:(268/285): python3-grpcio-1.46.7-10.el9.x86_64. 4.9 MB/s | 2.0 MB 00:00 2024-09-12T16:57:19.055 INFO:teuthology.orchestra.run.smithi118.stdout:(269/285): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-09-12T16:57:19.088 INFO:teuthology.orchestra.run.smithi118.stdout:(270/285): python3-kubernetes-26.1.0-2.el9.noar 4.0 MB/s | 1.0 MB 00:00 2024-09-12T16:57:19.114 INFO:teuthology.orchestra.run.smithi118.stdout:(271/285): python3-repoze-lru-0.7-16.el9.noarch 525 kB/s | 31 kB 00:00 2024-09-12T16:57:19.139 INFO:teuthology.orchestra.run.smithi118.stdout:(272/285): python3-pyOpenSSL-21.0.0-1.el9.noarc 823 kB/s | 90 kB 00:00 2024-09-12T16:57:19.164 INFO:teuthology.orchestra.run.smithi118.stdout:(273/285): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-12T16:57:19.189 INFO:teuthology.orchestra.run.smithi118.stdout:(274/285): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-12T16:57:19.215 INFO:teuthology.orchestra.run.smithi118.stdout:(275/285): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-12T16:57:19.240 INFO:teuthology.orchestra.run.smithi118.stdout:(276/285): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-12T16:57:19.265 INFO:teuthology.orchestra.run.smithi118.stdout:(277/285): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T16:57:19.274 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/287 2024-09-12T16:57:19.290 INFO:teuthology.orchestra.run.smithi118.stdout:(278/285): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-12T16:57:19.316 INFO:teuthology.orchestra.run.smithi118.stdout:(279/285): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-12T16:57:19.341 INFO:teuthology.orchestra.run.smithi118.stdout:(280/285): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T16:57:19.372 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T16:57:19.375 INFO:teuthology.orchestra.run.smithi118.stdout:(281/285): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-12T16:57:19.400 INFO:teuthology.orchestra.run.smithi118.stdout:(282/285): s3cmd-2.4.0-1.el9.noarch.rpm 2.4 MB/s | 206 kB 00:00 2024-09-12T16:57:19.451 INFO:teuthology.orchestra.run.smithi118.stdout:(283/285): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T16:57:19.508 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T16:57:19.531 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T16:57:19.616 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T16:57:19.643 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 12/287 2024-09-12T16:57:19.683 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/287 2024-09-12T16:57:19.684 INFO:teuthology.orchestra.run.smithi118.stdout:(284/285): librados2-19.3.0-4762.gbad475c1.el9. 11 MB/s | 3.5 MB 00:00 2024-09-12T16:57:19.720 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/287 2024-09-12T16:57:19.746 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/287 2024-09-12T16:57:19.771 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/287 2024-09-12T16:57:19.804 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/287 2024-09-12T16:57:19.828 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/287 2024-09-12T16:57:19.857 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/287 2024-09-12T16:57:20.069 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/287 2024-09-12T16:57:20.117 INFO:teuthology.orchestra.run.smithi118.stdout:(285/285): librbd1-19.3.0-4762.gbad475c1.el9.x8 4.5 MB/s | 3.2 MB 00:00 2024-09-12T16:57:20.125 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:57:20.125 INFO:teuthology.orchestra.run.smithi118.stdout:Total 7.8 MB/s | 322 MB 00:41 2024-09-12T16:57:20.414 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/287 2024-09-12T16:57:20.454 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/287 2024-09-12T16:57:20.482 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/287 2024-09-12T16:57:20.510 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T16:57:20.618 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T16:57:20.644 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 25/287 2024-09-12T16:57:20.708 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 25/287 2024-09-12T16:57:20.732 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/287 2024-09-12T16:57:20.754 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T16:57:20.782 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T16:57:20.941 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T16:57:20.971 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T16:57:21.090 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : re2-1:20211101-20.el9.x86_64 29/287 2024-09-12T16:57:21.121 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/287 2024-09-12T16:57:21.157 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/287 2024-09-12T16:57:21.235 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/287 2024-09-12T16:57:21.285 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/287 2024-09-12T16:57:21.324 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/287 2024-09-12T16:57:21.367 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/287 2024-09-12T16:57:21.391 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/287 2024-09-12T16:57:21.418 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 37/287 2024-09-12T16:57:21.452 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/287 2024-09-12T16:57:21.485 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/287 2024-09-12T16:57:21.513 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 40/287 2024-09-12T16:57:21.545 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/287 2024-09-12T16:57:21.570 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/287 2024-09-12T16:57:21.618 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/287 2024-09-12T16:57:21.652 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T16:57:21.858 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T16:57:21.858 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 45/287 2024-09-12T16:57:21.858 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 46/287 2024-09-12T16:57:21.859 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 47/287 2024-09-12T16:57:21.888 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 48/287 2024-09-12T16:57:21.921 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : fuse-2.9.9-16.el9.x86_64 49/287 2024-09-12T16:57:22.001 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 50/287 2024-09-12T16:57:22.038 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9. 51/287 2024-09-12T16:57:22.082 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el 52/287 2024-09-12T16:57:22.125 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_6 53/287 2024-09-12T16:57:22.205 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 54/287 2024-09-12T16:57:22.353 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 55/287 2024-09-12T16:57:22.421 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 56/287 2024-09-12T16:57:22.995 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rsa-4.9-2.el9.noarch 57/287 2024-09-12T16:57:23.093 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 58/287 2024-09-12T16:57:23.141 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 59/287 2024-09-12T16:57:23.214 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 60/287 2024-09-12T16:57:23.215 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-09-12T16:57:23.255 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 61/287 2024-09-12T16:57:23.292 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 62/287 2024-09-12T16:57:23.320 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 63/287 2024-09-12T16:57:23.395 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 64/287 2024-09-12T16:57:23.398 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-09-12T16:57:23.398 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-09-12T16:57:23.431 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : luarocks-3.9.2-5.el9.noarch 65/287 2024-09-12T16:57:23.464 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 66/287 2024-09-12T16:57:23.499 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 67/287 2024-09-12T16:57:23.529 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_6 68/287 2024-09-12T16:57:23.562 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 69/287 2024-09-12T16:57:23.594 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 70/287 2024-09-12T16:57:23.657 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/287 2024-09-12T16:57:23.712 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T16:57:23.746 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 73/287 2024-09-12T16:57:23.782 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 74/287 2024-09-12T16:57:23.880 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 75/287 2024-09-12T16:57:23.949 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/287 2024-09-12T16:57:24.024 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/287 2024-09-12T16:57:24.059 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 78/287 2024-09-12T16:57:24.095 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 79/287 2024-09-12T16:57:24.143 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/287 2024-09-12T16:57:24.188 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/287 2024-09-12T16:57:24.230 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/287 2024-09-12T16:57:24.377 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/287 2024-09-12T16:57:24.423 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/287 2024-09-12T16:57:24.464 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 85/287 2024-09-12T16:57:24.575 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/287 2024-09-12T16:57:24.607 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 87/287 2024-09-12T16:57:24.647 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/287 2024-09-12T16:57:24.687 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 89/287 2024-09-12T16:57:24.712 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 90/287 2024-09-12T16:57:24.804 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/287 2024-09-12T16:57:24.939 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/287 2024-09-12T16:57:24.989 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/287 2024-09-12T16:57:25.208 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/287 2024-09-12T16:57:25.248 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/287 2024-09-12T16:57:25.280 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/287 2024-09-12T16:57:25.310 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/287 2024-09-12T16:57:25.351 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/287 2024-09-12T16:57:25.387 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T16:57:25.401 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T16:57:25.402 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-12T16:57:25.402 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:57:25.602 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : tzdata-java-2024a-2.el9.noarch 100/287 2024-09-12T16:57:25.687 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 101/287 2024-09-12T16:57:25.737 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 102/287 2024-09-12T16:57:25.760 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T16:57:25.786 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T16:57:25.812 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 104/287 2024-09-12T16:57:26.189 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T16:57:26.217 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T16:57:26.232 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T16:57:26.233 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-12T16:57:26.233 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:57:26.274 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 106/287 2024-09-12T16:57:26.308 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 107/287 2024-09-12T16:57:26.342 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 108/287 2024-09-12T16:57:26.384 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 109/287 2024-09-12T16:57:26.418 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 110/287 2024-09-12T16:57:26.510 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 111/287 2024-09-12T16:57:26.531 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-09-12T16:57:26.531 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-09-12T16:57:26.561 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 112/287 2024-09-12T16:57:26.596 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 113/287 2024-09-12T16:57:26.707 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 114/287 2024-09-12T16:57:26.766 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/287 2024-09-12T16:57:27.571 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/287 2024-09-12T16:57:27.627 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/287 2024-09-12T16:57:27.661 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/287 2024-09-12T16:57:27.768 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/287 2024-09-12T16:57:27.818 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 120/287 2024-09-12T16:57:28.027 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/287 2024-09-12T16:57:28.066 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/287 2024-09-12T16:57:28.109 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 123/287 2024-09-12T16:57:28.676 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 124/287 2024-09-12T16:57:28.734 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : osinfo-db-20240701-2.el9.noarch 125/287 2024-09-12T16:57:28.770 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 126/287 2024-09-12T16:57:28.804 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : orc-0.4.31-8.el9.x86_64 127/287 2024-09-12T16:57:28.837 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 128/287 2024-09-12T16:57:29.027 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openblas-0.3.26-2.el9.x86_64 129/287 2024-09-12T16:57:29.050 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 130/287 2024-09-12T16:57:29.131 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 131/287 2024-09-12T16:57:29.854 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 132/287 2024-09-12T16:57:29.973 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 133/287 2024-09-12T16:57:31.350 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 134/287 2024-09-12T16:57:31.436 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 135/287 2024-09-12T16:57:31.489 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 136/287 2024-09-12T16:57:31.530 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/287 2024-09-12T16:57:31.557 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/287 2024-09-12T16:57:31.586 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T16:57:31.599 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T16:57:31.599 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-12T16:57:31.600 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:57:31.649 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/287 2024-09-12T16:57:31.682 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/287 2024-09-12T16:57:31.710 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/287 2024-09-12T16:57:32.048 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/287 2024-09-12T16:57:32.098 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 144/287 2024-09-12T16:57:32.190 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 144/287 2024-09-12T16:57:32.221 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 145/287 2024-09-12T16:57:32.254 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/287 2024-09-12T16:57:32.283 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/287 2024-09-12T16:57:32.346 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 148/287 2024-09-12T16:57:32.382 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/287 2024-09-12T16:57:32.399 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/287 2024-09-12T16:57:32.443 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/287 2024-09-12T16:57:32.471 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T16:57:32.748 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T16:57:32.790 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/287 2024-09-12T16:57:32.818 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/287 2024-09-12T16:57:32.844 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/287 2024-09-12T16:57:32.878 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/287 2024-09-12T16:57:32.903 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/287 2024-09-12T16:57:32.928 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/287 2024-09-12T16:57:32.957 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/287 2024-09-12T16:57:32.993 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/287 2024-09-12T16:57:33.034 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 161/287 2024-09-12T16:57:33.068 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 162/287 2024-09-12T16:57:33.116 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/287 2024-09-12T16:57:33.151 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : poppler-21.01.0-21.el9.x86_64 164/287 2024-09-12T16:57:33.633 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 165/287 2024-09-12T16:57:33.779 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/287 2024-09-12T16:57:33.840 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/287 2024-09-12T16:57:33.865 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 168/287 2024-09-12T16:57:33.894 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/287 2024-09-12T16:57:33.964 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/287 2024-09-12T16:57:34.017 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/287 2024-09-12T16:57:34.049 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T16:57:34.071 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T16:57:34.104 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/287 2024-09-12T16:57:34.130 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/287 2024-09-12T16:57:34.164 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 175/287 2024-09-12T16:57:34.193 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T16:57:36.476 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-12T16:57:36.629 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-12T16:57:36.786 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-09-12T16:57:36.880 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/287 2024-09-12T16:57:36.905 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/287 2024-09-12T16:57:36.981 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/287 2024-09-12T16:57:37.026 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/287 2024-09-12T16:57:37.082 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/287 2024-09-12T16:57:37.123 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/287 2024-09-12T16:57:37.149 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/287 2024-09-12T16:57:37.195 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/287 2024-09-12T16:57:37.545 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/287 2024-09-12T16:57:37.658 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T16:57:37.780 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T16:57:37.809 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T16:57:37.902 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T16:57:37.930 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 12/287 2024-09-12T16:57:37.969 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/287 2024-09-12T16:57:38.007 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/287 2024-09-12T16:57:38.032 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/287 2024-09-12T16:57:38.058 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/287 2024-09-12T16:57:38.090 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/287 2024-09-12T16:57:38.115 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/287 2024-09-12T16:57:38.143 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/287 2024-09-12T16:57:38.303 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/287 2024-09-12T16:57:38.445 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/287 2024-09-12T16:57:38.484 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/287 2024-09-12T16:57:38.528 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/287 2024-09-12T16:57:38.556 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T16:57:38.653 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T16:57:38.683 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 25/287 2024-09-12T16:57:38.746 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 25/287 2024-09-12T16:57:38.770 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/287 2024-09-12T16:57:38.793 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T16:57:38.818 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T16:57:39.045 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T16:57:39.077 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T16:57:39.200 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : re2-1:20211101-20.el9.x86_64 29/287 2024-09-12T16:57:39.232 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/287 2024-09-12T16:57:39.267 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/287 2024-09-12T16:57:39.342 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/287 2024-09-12T16:57:39.390 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/287 2024-09-12T16:57:39.430 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/287 2024-09-12T16:57:39.472 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/287 2024-09-12T16:57:39.498 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/287 2024-09-12T16:57:39.516 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 37/287 2024-09-12T16:57:39.550 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/287 2024-09-12T16:57:39.575 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/287 2024-09-12T16:57:39.604 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 40/287 2024-09-12T16:57:39.636 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/287 2024-09-12T16:57:39.661 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/287 2024-09-12T16:57:39.702 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/287 2024-09-12T16:57:39.734 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T16:57:39.805 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T16:57:39.860 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 45/287 2024-09-12T16:57:39.890 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 46/287 2024-09-12T16:57:39.934 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 47/287 2024-09-12T16:57:39.979 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 48/287 2024-09-12T16:57:40.011 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : fuse-2.9.9-16.el9.x86_64 49/287 2024-09-12T16:57:40.088 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 50/287 2024-09-12T16:57:40.121 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9. 51/287 2024-09-12T16:57:40.165 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el 52/287 2024-09-12T16:57:40.206 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_6 53/287 2024-09-12T16:57:40.283 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 54/287 2024-09-12T16:57:40.420 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 55/287 2024-09-12T16:57:40.468 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 56/287 2024-09-12T16:57:41.015 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rsa-4.9-2.el9.noarch 57/287 2024-09-12T16:57:41.098 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 58/287 2024-09-12T16:57:41.125 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 59/287 2024-09-12T16:57:41.189 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 60/287 2024-09-12T16:57:41.244 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 61/287 2024-09-12T16:57:41.281 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 62/287 2024-09-12T16:57:41.310 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 63/287 2024-09-12T16:57:41.383 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 64/287 2024-09-12T16:57:41.413 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : luarocks-3.9.2-5.el9.noarch 65/287 2024-09-12T16:57:41.446 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 66/287 2024-09-12T16:57:41.481 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 67/287 2024-09-12T16:57:41.519 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_6 68/287 2024-09-12T16:57:41.553 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 69/287 2024-09-12T16:57:41.585 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 70/287 2024-09-12T16:57:41.630 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/287 2024-09-12T16:57:41.703 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T16:57:41.738 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 73/287 2024-09-12T16:57:41.775 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 74/287 2024-09-12T16:57:41.868 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 75/287 2024-09-12T16:57:41.931 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/287 2024-09-12T16:57:42.005 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/287 2024-09-12T16:57:42.035 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 78/287 2024-09-12T16:57:42.071 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 79/287 2024-09-12T16:57:42.119 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/287 2024-09-12T16:57:42.172 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/287 2024-09-12T16:57:42.214 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/287 2024-09-12T16:57:42.353 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/287 2024-09-12T16:57:42.391 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/287 2024-09-12T16:57:42.433 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 85/287 2024-09-12T16:57:42.538 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/287 2024-09-12T16:57:42.575 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 87/287 2024-09-12T16:57:42.616 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/287 2024-09-12T16:57:42.648 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 89/287 2024-09-12T16:57:42.673 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 90/287 2024-09-12T16:57:42.747 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/287 2024-09-12T16:57:42.877 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/287 2024-09-12T16:57:42.917 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/287 2024-09-12T16:57:43.123 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/287 2024-09-12T16:57:43.160 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/287 2024-09-12T16:57:43.192 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/287 2024-09-12T16:57:43.222 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/287 2024-09-12T16:57:43.263 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/287 2024-09-12T16:57:43.301 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T16:57:43.314 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T16:57:43.314 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-12T16:57:43.314 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:57:43.513 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : tzdata-java-2024a-2.el9.noarch 100/287 2024-09-12T16:57:43.592 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 101/287 2024-09-12T16:57:43.649 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 102/287 2024-09-12T16:57:43.674 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T16:57:43.699 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T16:57:43.726 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 104/287 2024-09-12T16:57:44.166 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T16:57:44.199 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T16:57:44.213 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T16:57:44.213 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-12T16:57:44.213 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:57:44.252 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 106/287 2024-09-12T16:57:44.287 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 107/287 2024-09-12T16:57:44.321 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 108/287 2024-09-12T16:57:44.362 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 109/287 2024-09-12T16:57:44.397 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 110/287 2024-09-12T16:57:44.486 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 111/287 2024-09-12T16:57:44.536 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 112/287 2024-09-12T16:57:44.567 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 113/287 2024-09-12T16:57:44.673 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 114/287 2024-09-12T16:57:44.752 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/287 2024-09-12T16:57:45.498 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/287 2024-09-12T16:57:45.549 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/287 2024-09-12T16:57:45.584 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/287 2024-09-12T16:57:45.684 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/287 2024-09-12T16:57:45.721 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 120/287 2024-09-12T16:57:45.907 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/287 2024-09-12T16:57:45.939 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/287 2024-09-12T16:57:45.984 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 123/287 2024-09-12T16:57:46.318 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T16:57:46.386 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/287 2024-09-12T16:57:46.420 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/287 2024-09-12T16:57:46.461 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 179/287 2024-09-12T16:57:46.489 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 124/287 2024-09-12T16:57:46.494 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 180/287 2024-09-12T16:57:46.531 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/287 2024-09-12T16:57:46.548 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : osinfo-db-20240701-2.el9.noarch 125/287 2024-09-12T16:57:46.586 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 126/287 2024-09-12T16:57:46.619 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : orc-0.4.31-8.el9.x86_64 127/287 2024-09-12T16:57:46.652 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 128/287 2024-09-12T16:57:46.835 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-0.3.26-2.el9.x86_64 129/287 2024-09-12T16:57:46.866 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 130/287 2024-09-12T16:57:47.028 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 131/287 2024-09-12T16:57:47.057 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/287 2024-09-12T16:57:47.085 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 183/287 2024-09-12T16:57:47.166 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 183/287 2024-09-12T16:57:47.195 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 184/287 2024-09-12T16:57:47.713 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 132/287 2024-09-12T16:57:47.835 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 133/287 2024-09-12T16:57:49.353 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 134/287 2024-09-12T16:57:49.437 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 135/287 2024-09-12T16:57:49.487 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 136/287 2024-09-12T16:57:49.523 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/287 2024-09-12T16:57:49.550 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/287 2024-09-12T16:57:49.580 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T16:57:49.592 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T16:57:49.592 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-12T16:57:49.592 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:57:49.645 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/287 2024-09-12T16:57:49.667 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/287 2024-09-12T16:57:49.695 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/287 2024-09-12T16:57:49.798 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T16:57:49.827 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T16:57:50.015 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/287 2024-09-12T16:57:50.058 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 144/287 2024-09-12T16:57:50.132 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 144/287 2024-09-12T16:57:50.165 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 145/287 2024-09-12T16:57:50.197 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/287 2024-09-12T16:57:50.227 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/287 2024-09-12T16:57:50.289 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 148/287 2024-09-12T16:57:50.335 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/287 2024-09-12T16:57:50.361 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/287 2024-09-12T16:57:50.402 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/287 2024-09-12T16:57:50.425 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T16:57:50.427 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T16:57:50.472 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 186/287 2024-09-12T16:57:50.603 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 186/287 2024-09-12T16:57:50.603 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T16:57:50.603 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T16:57:50.603 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:57:50.631 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 187/287 2024-09-12T16:57:50.687 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T16:57:50.727 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/287 2024-09-12T16:57:50.755 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/287 2024-09-12T16:57:50.781 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/287 2024-09-12T16:57:50.806 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/287 2024-09-12T16:57:50.832 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/287 2024-09-12T16:57:50.857 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/287 2024-09-12T16:57:50.885 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/287 2024-09-12T16:57:50.921 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/287 2024-09-12T16:57:51.000 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 161/287 2024-09-12T16:57:51.031 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 162/287 2024-09-12T16:57:51.078 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/287 2024-09-12T16:57:51.105 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : poppler-21.01.0-21.el9.x86_64 164/287 2024-09-12T16:57:51.554 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 165/287 2024-09-12T16:57:51.689 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/287 2024-09-12T16:57:51.756 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/287 2024-09-12T16:57:51.781 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 168/287 2024-09-12T16:57:51.809 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/287 2024-09-12T16:57:51.882 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/287 2024-09-12T16:57:51.924 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/287 2024-09-12T16:57:51.949 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T16:57:51.969 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T16:57:51.996 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/287 2024-09-12T16:57:52.021 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/287 2024-09-12T16:57:52.065 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 175/287 2024-09-12T16:57:52.085 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T16:58:00.461 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 187/287 2024-09-12T16:58:00.462 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /sys 2024-09-12T16:58:00.462 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /proc 2024-09-12T16:58:00.462 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /mnt 2024-09-12T16:58:00.462 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /var/tmp 2024-09-12T16:58:00.462 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /home 2024-09-12T16:58:00.462 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /root 2024-09-12T16:58:00.463 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /tmp 2024-09-12T16:58:00.463 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:58:00.637 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 188/287 2024-09-12T16:58:00.654 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 188/287 2024-09-12T16:58:00.654 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:58:00.654 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T16:58:00.655 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:58:02.204 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 189/287 2024-09-12T16:58:02.234 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 189/287 2024-09-12T16:58:02.234 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:58:02.234 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T16:58:02.234 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T16:58:02.234 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T16:58:02.234 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:58:02.463 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 190/287 2024-09-12T16:58:02.489 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 190/287 2024-09-12T16:58:02.489 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:58:02.489 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T16:58:02.489 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T16:58:02.489 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T16:58:02.489 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:58:02.956 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 191/287 2024-09-12T16:58:02.981 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 191/287 2024-09-12T16:58:02.982 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:58:02.982 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T16:58:02.982 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T16:58:02.982 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T16:58:02.982 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:58:03.086 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 192/287 2024-09-12T16:58:04.384 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T16:58:04.430 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/287 2024-09-12T16:58:04.458 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/287 2024-09-12T16:58:04.499 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 179/287 2024-09-12T16:58:04.533 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 180/287 2024-09-12T16:58:04.569 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/287 2024-09-12T16:58:05.080 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/287 2024-09-12T16:58:05.116 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 183/287 2024-09-12T16:58:05.180 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 183/287 2024-09-12T16:58:05.210 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 184/287 2024-09-12T16:58:06.239 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/287 2024-09-12T16:58:06.341 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/287 2024-09-12T16:58:06.399 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/287 2024-09-12T16:58:06.464 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/287 2024-09-12T16:58:06.667 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/287 2024-09-12T16:58:06.718 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/287 2024-09-12T16:58:06.800 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/287 2024-09-12T16:58:06.898 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/287 2024-09-12T16:58:07.041 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/287 2024-09-12T16:58:07.076 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/287 2024-09-12T16:58:07.131 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/287 2024-09-12T16:58:07.561 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T16:58:07.601 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T16:58:08.048 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/287 2024-09-12T16:58:08.115 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T16:58:08.161 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T16:58:08.221 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 186/287 2024-09-12T16:58:08.323 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 186/287 2024-09-12T16:58:08.323 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T16:58:08.323 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T16:58:08.323 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:58:08.356 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 187/287 2024-09-12T16:58:08.498 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T16:58:08.547 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/287 2024-09-12T16:58:08.578 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/287 2024-09-12T16:58:08.606 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/287 2024-09-12T16:58:08.641 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/287 2024-09-12T16:58:08.678 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/287 2024-09-12T16:58:08.705 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/287 2024-09-12T16:58:08.731 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/287 2024-09-12T16:58:08.756 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/287 2024-09-12T16:58:08.781 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/287 2024-09-12T16:58:08.807 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/287 2024-09-12T16:58:08.833 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/287 2024-09-12T16:58:08.859 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/287 2024-09-12T16:58:08.898 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/287 2024-09-12T16:58:08.926 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/287 2024-09-12T16:58:08.961 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/287 2024-09-12T16:58:08.997 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/287 2024-09-12T16:58:09.027 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/287 2024-09-12T16:58:09.062 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/287 2024-09-12T16:58:09.096 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/287 2024-09-12T16:58:09.133 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/287 2024-09-12T16:58:09.172 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/287 2024-09-12T16:58:09.214 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/287 2024-09-12T16:58:09.258 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/287 2024-09-12T16:58:09.281 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : guava-30.1-6.el9.noarch 229/287 2024-09-12T16:58:09.313 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/287 2024-09-12T16:58:09.368 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/287 2024-09-12T16:58:09.398 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/287 2024-09-12T16:58:09.429 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/287 2024-09-12T16:58:09.457 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 234/287 2024-09-12T16:58:09.482 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 235/287 2024-09-12T16:58:09.658 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 236/287 2024-09-12T16:58:09.683 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 237/287 2024-09-12T16:58:09.710 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 238/287 2024-09-12T16:58:09.737 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 239/287 2024-09-12T16:58:09.769 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 240/287 2024-09-12T16:58:09.888 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 241/287 2024-09-12T16:58:09.945 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 242/287 2024-09-12T16:58:10.015 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 243/287 2024-09-12T16:58:10.048 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T16:58:10.169 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T16:58:10.211 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T16:58:10.230 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T16:58:10.257 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 246/287 2024-09-12T16:58:10.271 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 247/287 2024-09-12T16:58:10.695 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T16:58:10.725 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T16:58:10.742 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T16:58:10.742 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-12T16:58:10.742 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:58:10.987 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 249/287 2024-09-12T16:58:11.065 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 250/287 2024-09-12T16:58:11.117 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 251/287 2024-09-12T16:58:11.154 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 252/287 2024-09-12T16:58:11.179 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 253/287 2024-09-12T16:58:11.629 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T16:58:11.657 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T16:58:11.675 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T16:58:12.213 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T16:58:12.309 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T16:58:12.342 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T16:58:12.372 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T16:58:12.583 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 257/287 2024-09-12T16:58:12.642 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 258/287 2024-09-12T16:58:12.666 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T16:58:12.689 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T16:58:12.725 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T16:58:12.798 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T16:58:12.836 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T16:58:12.848 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T16:58:12.870 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T16:58:12.883 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T16:58:12.913 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/287 2024-09-12T16:58:13.335 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 264/287 2024-09-12T16:58:13.369 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 264/287 2024-09-12T16:58:13.402 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.e 265/287 2024-09-12T16:58:13.472 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1. 266/287 2024-09-12T16:58:13.509 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 267/287 2024-09-12T16:58:16.939 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 267/287 2024-09-12T16:58:16.999 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 268/287 2024-09-12T16:58:18.018 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 268/287 2024-09-12T16:58:18.049 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 269/287 2024-09-12T16:58:18.147 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 187/287 2024-09-12T16:58:18.147 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /sys 2024-09-12T16:58:18.147 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /proc 2024-09-12T16:58:18.147 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /mnt 2024-09-12T16:58:18.147 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /var/tmp 2024-09-12T16:58:18.147 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /home 2024-09-12T16:58:18.147 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /root 2024-09-12T16:58:18.147 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /tmp 2024-09-12T16:58:18.147 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:58:18.174 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 269/287 2024-09-12T16:58:18.339 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 188/287 2024-09-12T16:58:18.344 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el 270/287 2024-09-12T16:58:18.355 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 188/287 2024-09-12T16:58:18.355 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:58:18.355 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T16:58:18.356 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:58:18.368 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 271/287 2024-09-12T16:58:18.393 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 271/287 2024-09-12T16:58:18.394 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:58:18.394 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T16:58:18.394 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T16:58:18.394 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T16:58:18.394 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:58:18.444 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 272/287 2024-09-12T16:58:18.456 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 272/287 2024-09-12T16:58:18.478 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 273/287 2024-09-12T16:58:18.507 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 274/287 2024-09-12T16:58:18.557 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 275/287 2024-09-12T16:58:18.596 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T16:58:18.613 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T16:58:18.614 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-12T16:58:18.614 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:58:19.648 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 277/287 2024-09-12T16:58:19.675 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 277/287 2024-09-12T16:58:19.675 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:58:19.675 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T16:58:19.675 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T16:58:19.675 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T16:58:19.675 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:58:19.716 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4762.gbad47 278/287 2024-09-12T16:58:19.741 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4762.gbad47 278/287 2024-09-12T16:58:19.741 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:58:19.741 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T16:58:19.741 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:58:19.832 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 189/287 2024-09-12T16:58:19.859 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 189/287 2024-09-12T16:58:19.860 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:58:19.860 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T16:58:19.860 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T16:58:19.860 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T16:58:19.860 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:58:20.076 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 279/287 2024-09-12T16:58:20.091 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 190/287 2024-09-12T16:58:20.101 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 279/287 2024-09-12T16:58:20.101 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:58:20.101 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T16:58:20.101 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T16:58:20.102 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T16:58:20.102 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:58:20.116 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 190/287 2024-09-12T16:58:20.116 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:58:20.116 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T16:58:20.116 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T16:58:20.116 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T16:58:20.116 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:58:20.575 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 191/287 2024-09-12T16:58:20.599 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 191/287 2024-09-12T16:58:20.599 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:58:20.599 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T16:58:20.599 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T16:58:20.599 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T16:58:20.599 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:58:20.703 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 192/287 2024-09-12T16:58:23.559 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/287 2024-09-12T16:58:23.663 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/287 2024-09-12T16:58:23.719 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/287 2024-09-12T16:58:23.776 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/287 2024-09-12T16:58:23.962 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/287 2024-09-12T16:58:24.025 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/287 2024-09-12T16:58:24.103 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/287 2024-09-12T16:58:24.200 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/287 2024-09-12T16:58:24.348 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/287 2024-09-12T16:58:24.383 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/287 2024-09-12T16:58:24.425 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/287 2024-09-12T16:58:24.655 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 280/287 2024-09-12T16:58:24.697 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 281/287 2024-09-12T16:58:24.728 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 282/287 2024-09-12T16:58:24.836 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_ 283/287 2024-09-12T16:58:24.899 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 284/287 2024-09-12T16:58:24.927 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 285/287 2024-09-12T16:58:24.927 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T16:58:25.019 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T16:58:25.019 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T16:58:25.119 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T16:58:25.148 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 287/287 2024-09-12T16:58:25.154 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 287/287 2024-09-12T16:58:25.164 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 287/287 2024-09-12T16:58:25.175 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 287/287 2024-09-12T16:58:25.175 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T16:58:25.175 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T16:58:25.175 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:58:25.239 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T16:58:25.294 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/287 2024-09-12T16:58:25.313 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T16:58:25.358 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T16:58:25.741 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T16:58:25.772 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/287 2024-09-12T16:58:25.795 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/287 2024-09-12T16:58:25.823 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/287 2024-09-12T16:58:25.858 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/287 2024-09-12T16:58:25.895 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/287 2024-09-12T16:58:25.922 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/287 2024-09-12T16:58:25.948 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/287 2024-09-12T16:58:25.974 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/287 2024-09-12T16:58:25.998 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/287 2024-09-12T16:58:26.025 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/287 2024-09-12T16:58:26.050 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/287 2024-09-12T16:58:26.077 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/287 2024-09-12T16:58:26.109 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/287 2024-09-12T16:58:26.135 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/287 2024-09-12T16:58:26.162 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/287 2024-09-12T16:58:26.191 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/287 2024-09-12T16:58:26.222 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/287 2024-09-12T16:58:26.256 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/287 2024-09-12T16:58:26.291 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/287 2024-09-12T16:58:26.327 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/287 2024-09-12T16:58:26.366 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/287 2024-09-12T16:58:26.400 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/287 2024-09-12T16:58:26.444 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/287 2024-09-12T16:58:26.476 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : guava-30.1-6.el9.noarch 229/287 2024-09-12T16:58:26.499 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/287 2024-09-12T16:58:26.552 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/287 2024-09-12T16:58:26.585 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/287 2024-09-12T16:58:26.616 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/287 2024-09-12T16:58:26.653 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 234/287 2024-09-12T16:58:26.678 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 235/287 2024-09-12T16:58:26.846 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 236/287 2024-09-12T16:58:26.896 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 237/287 2024-09-12T16:58:26.923 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 238/287 2024-09-12T16:58:26.950 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 239/287 2024-09-12T16:58:26.982 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 240/287 2024-09-12T16:58:27.135 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 241/287 2024-09-12T16:58:27.198 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 242/287 2024-09-12T16:58:27.267 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 243/287 2024-09-12T16:58:27.321 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T16:58:27.427 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T16:58:27.468 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T16:58:27.483 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T16:58:27.513 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 246/287 2024-09-12T16:58:27.537 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 247/287 2024-09-12T16:58:27.968 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T16:58:27.999 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T16:58:28.016 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T16:58:28.016 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-12T16:58:28.016 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:58:28.259 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 249/287 2024-09-12T16:58:28.328 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 250/287 2024-09-12T16:58:28.367 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 251/287 2024-09-12T16:58:28.404 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 252/287 2024-09-12T16:58:28.437 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 253/287 2024-09-12T16:58:28.852 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T16:58:28.883 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T16:58:28.899 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T16:58:29.436 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T16:58:29.529 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T16:58:29.577 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T16:58:29.604 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T16:58:29.796 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 257/287 2024-09-12T16:58:29.859 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 258/287 2024-09-12T16:58:29.884 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T16:58:29.906 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T16:58:29.935 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T16:58:30.005 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T16:58:30.038 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T16:58:30.049 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T16:58:30.072 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T16:58:30.093 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T16:58:30.123 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/287 2024-09-12T16:58:30.519 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 264/287 2024-09-12T16:58:30.546 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 264/287 2024-09-12T16:58:30.580 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.e 265/287 2024-09-12T16:58:30.654 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1. 266/287 2024-09-12T16:58:30.679 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 267/287 2024-09-12T16:58:33.920 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 267/287 2024-09-12T16:58:33.968 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 268/287 2024-09-12T16:58:34.938 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 268/287 2024-09-12T16:58:34.985 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 269/287 2024-09-12T16:58:35.101 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T16:58:35.101 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 1/287 2024-09-12T16:58:35.101 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2/287 2024-09-12T16:58:35.101 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 3/287 2024-09-12T16:58:35.101 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 4/287 2024-09-12T16:58:35.101 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4762.gbad47 5/287 2024-09-12T16:58:35.101 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 6/287 2024-09-12T16:58:35.102 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 7/287 2024-09-12T16:58:35.102 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 8/287 2024-09-12T16:58:35.102 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 9/287 2024-09-12T16:58:35.102 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T16:58:35.102 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T16:58:35.102 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 12/287 2024-09-12T16:58:35.102 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_ 13/287 2024-09-12T16:58:35.102 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 14/287 2024-09-12T16:58:35.102 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 15/287 2024-09-12T16:58:35.102 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_6 16/287 2024-09-12T16:58:35.102 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 17/287 2024-09-12T16:58:35.102 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 18/287 2024-09-12T16:58:35.103 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el 19/287 2024-09-12T16:58:35.103 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9. 20/287 2024-09-12T16:58:35.103 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_6 21/287 2024-09-12T16:58:35.103 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 22/287 2024-09-12T16:58:35.103 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 23/287 2024-09-12T16:58:35.103 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T16:58:35.103 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 25/287 2024-09-12T16:58:35.103 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 26/287 2024-09-12T16:58:35.103 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 27/287 2024-09-12T16:58:35.103 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1. 28/287 2024-09-12T16:58:35.103 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 29/287 2024-09-12T16:58:35.103 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 30/287 2024-09-12T16:58:35.104 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 269/287 2024-09-12T16:58:35.125 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 31/287 2024-09-12T16:58:35.126 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el 32/287 2024-09-12T16:58:35.126 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 33/287 2024-09-12T16:58:35.126 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.e 34/287 2024-09-12T16:58:35.126 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 35/287 2024-09-12T16:58:35.126 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 36/287 2024-09-12T16:58:35.126 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/287 2024-09-12T16:58:35.126 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/287 2024-09-12T16:58:35.126 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/287 2024-09-12T16:58:35.126 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/287 2024-09-12T16:58:35.126 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/287 2024-09-12T16:58:35.126 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/287 2024-09-12T16:58:35.126 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/287 2024-09-12T16:58:35.126 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/287 2024-09-12T16:58:35.127 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/287 2024-09-12T16:58:35.127 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/287 2024-09-12T16:58:35.127 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/287 2024-09-12T16:58:35.127 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/287 2024-09-12T16:58:35.127 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/287 2024-09-12T16:58:35.127 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/287 2024-09-12T16:58:35.127 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/287 2024-09-12T16:58:35.127 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/287 2024-09-12T16:58:35.127 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/287 2024-09-12T16:58:35.127 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/287 2024-09-12T16:58:35.127 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/287 2024-09-12T16:58:35.127 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/287 2024-09-12T16:58:35.128 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/287 2024-09-12T16:58:35.128 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/287 2024-09-12T16:58:35.128 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/287 2024-09-12T16:58:35.128 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/287 2024-09-12T16:58:35.128 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/287 2024-09-12T16:58:35.128 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/287 2024-09-12T16:58:35.128 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/287 2024-09-12T16:58:35.128 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/287 2024-09-12T16:58:35.128 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/287 2024-09-12T16:58:35.128 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/287 2024-09-12T16:58:35.128 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/287 2024-09-12T16:58:35.128 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/287 2024-09-12T16:58:35.128 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/287 2024-09-12T16:58:35.129 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/287 2024-09-12T16:58:35.129 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/287 2024-09-12T16:58:35.129 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T16:58:35.129 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/287 2024-09-12T16:58:35.129 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/287 2024-09-12T16:58:35.129 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/287 2024-09-12T16:58:35.129 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/287 2024-09-12T16:58:35.129 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/287 2024-09-12T16:58:35.129 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/287 2024-09-12T16:58:35.129 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/287 2024-09-12T16:58:35.129 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/287 2024-09-12T16:58:35.129 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/287 2024-09-12T16:58:35.129 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/287 2024-09-12T16:58:35.129 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/287 2024-09-12T16:58:35.130 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/287 2024-09-12T16:58:35.130 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/287 2024-09-12T16:58:35.130 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/287 2024-09-12T16:58:35.130 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/287 2024-09-12T16:58:35.130 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/287 2024-09-12T16:58:35.130 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/287 2024-09-12T16:58:35.130 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/287 2024-09-12T16:58:35.130 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : guava-30.1-6.el9.noarch 91/287 2024-09-12T16:58:35.130 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/287 2024-09-12T16:58:35.130 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/287 2024-09-12T16:58:35.130 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/287 2024-09-12T16:58:35.130 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/287 2024-09-12T16:58:35.130 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/287 2024-09-12T16:58:35.131 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/287 2024-09-12T16:58:35.131 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/287 2024-09-12T16:58:35.131 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/287 2024-09-12T16:58:35.131 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/287 2024-09-12T16:58:35.131 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/287 2024-09-12T16:58:35.131 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/287 2024-09-12T16:58:35.131 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/287 2024-09-12T16:58:35.131 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/287 2024-09-12T16:58:35.131 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/287 2024-09-12T16:58:35.131 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/287 2024-09-12T16:58:35.131 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/287 2024-09-12T16:58:35.131 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/287 2024-09-12T16:58:35.131 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/287 2024-09-12T16:58:35.132 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/287 2024-09-12T16:58:35.132 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/287 2024-09-12T16:58:35.132 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/287 2024-09-12T16:58:35.132 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/287 2024-09-12T16:58:35.132 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/287 2024-09-12T16:58:35.132 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/287 2024-09-12T16:58:35.132 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/287 2024-09-12T16:58:35.132 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/287 2024-09-12T16:58:35.132 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/287 2024-09-12T16:58:35.132 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/287 2024-09-12T16:58:35.132 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/287 2024-09-12T16:58:35.132 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/287 2024-09-12T16:58:35.132 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/287 2024-09-12T16:58:35.133 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/287 2024-09-12T16:58:35.133 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/287 2024-09-12T16:58:35.133 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/287 2024-09-12T16:58:35.133 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/287 2024-09-12T16:58:35.133 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/287 2024-09-12T16:58:35.133 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/287 2024-09-12T16:58:35.133 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/287 2024-09-12T16:58:35.133 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/287 2024-09-12T16:58:35.133 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/287 2024-09-12T16:58:35.133 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/287 2024-09-12T16:58:35.133 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/287 2024-09-12T16:58:35.133 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/287 2024-09-12T16:58:35.133 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/287 2024-09-12T16:58:35.133 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/287 2024-09-12T16:58:35.134 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/287 2024-09-12T16:58:35.134 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/287 2024-09-12T16:58:35.134 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/287 2024-09-12T16:58:35.134 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/287 2024-09-12T16:58:35.134 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/287 2024-09-12T16:58:35.134 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 142/287 2024-09-12T16:58:35.134 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 143/287 2024-09-12T16:58:35.134 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/287 2024-09-12T16:58:35.134 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/287 2024-09-12T16:58:35.134 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/287 2024-09-12T16:58:35.134 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/287 2024-09-12T16:58:35.134 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/287 2024-09-12T16:58:35.134 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/287 2024-09-12T16:58:35.135 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/287 2024-09-12T16:58:35.135 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/287 2024-09-12T16:58:35.135 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/287 2024-09-12T16:58:35.135 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/287 2024-09-12T16:58:35.135 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/287 2024-09-12T16:58:35.135 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/287 2024-09-12T16:58:35.135 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/287 2024-09-12T16:58:35.135 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/287 2024-09-12T16:58:35.135 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/287 2024-09-12T16:58:35.135 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/287 2024-09-12T16:58:35.135 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/287 2024-09-12T16:58:35.135 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/287 2024-09-12T16:58:35.135 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/287 2024-09-12T16:58:35.135 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/287 2024-09-12T16:58:35.136 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 164/287 2024-09-12T16:58:35.136 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 165/287 2024-09-12T16:58:35.136 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 166/287 2024-09-12T16:58:35.136 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 167/287 2024-09-12T16:58:35.136 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 168/287 2024-09-12T16:58:35.136 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 169/287 2024-09-12T16:58:35.136 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 170/287 2024-09-12T16:58:35.136 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 171/287 2024-09-12T16:58:35.136 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 172/287 2024-09-12T16:58:35.136 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 173/287 2024-09-12T16:58:35.136 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : opus-1.3.1-10.el9.x86_64 174/287 2024-09-12T16:58:35.136 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : orc-0.4.31-8.el9.x86_64 175/287 2024-09-12T16:58:35.136 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 176/287 2024-09-12T16:58:35.137 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 177/287 2024-09-12T16:58:35.137 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 178/287 2024-09-12T16:58:35.137 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 179/287 2024-09-12T16:58:35.137 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 180/287 2024-09-12T16:58:35.137 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 181/287 2024-09-12T16:58:35.137 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 182/287 2024-09-12T16:58:35.137 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 183/287 2024-09-12T16:58:35.137 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 184/287 2024-09-12T16:58:35.137 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 185/287 2024-09-12T16:58:35.137 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 186/287 2024-09-12T16:58:35.137 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 187/287 2024-09-12T16:58:35.137 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 188/287 2024-09-12T16:58:35.137 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 189/287 2024-09-12T16:58:35.137 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 190/287 2024-09-12T16:58:35.138 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 191/287 2024-09-12T16:58:35.138 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 192/287 2024-09-12T16:58:35.138 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 193/287 2024-09-12T16:58:35.138 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 194/287 2024-09-12T16:58:35.138 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 195/287 2024-09-12T16:58:35.138 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 196/287 2024-09-12T16:58:35.138 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 197/287 2024-09-12T16:58:35.138 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 198/287 2024-09-12T16:58:35.138 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 199/287 2024-09-12T16:58:35.138 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 200/287 2024-09-12T16:58:35.138 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 201/287 2024-09-12T16:58:35.138 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 202/287 2024-09-12T16:58:35.138 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 203/287 2024-09-12T16:58:35.139 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 204/287 2024-09-12T16:58:35.139 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 205/287 2024-09-12T16:58:35.139 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 206/287 2024-09-12T16:58:35.139 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 207/287 2024-09-12T16:58:35.139 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 208/287 2024-09-12T16:58:35.139 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 209/287 2024-09-12T16:58:35.139 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 210/287 2024-09-12T16:58:35.139 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 211/287 2024-09-12T16:58:35.139 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 212/287 2024-09-12T16:58:35.139 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 213/287 2024-09-12T16:58:35.139 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 214/287 2024-09-12T16:58:35.139 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 215/287 2024-09-12T16:58:35.139 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 216/287 2024-09-12T16:58:35.140 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 217/287 2024-09-12T16:58:35.140 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 218/287 2024-09-12T16:58:35.140 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 219/287 2024-09-12T16:58:35.140 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rtkit-0.11-29.el9.x86_64 220/287 2024-09-12T16:58:35.140 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 221/287 2024-09-12T16:58:35.140 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 222/287 2024-09-12T16:58:35.140 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 223/287 2024-09-12T16:58:35.140 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 224/287 2024-09-12T16:58:35.140 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 225/287 2024-09-12T16:58:35.140 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 226/287 2024-09-12T16:58:35.140 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 227/287 2024-09-12T16:58:35.140 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 228/287 2024-09-12T16:58:35.140 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 229/287 2024-09-12T16:58:35.140 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : upower-0.99.11-11.el9.x86_64 230/287 2024-09-12T16:58:35.141 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 231/287 2024-09-12T16:58:35.141 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 232/287 2024-09-12T16:58:35.141 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 233/287 2024-09-12T16:58:35.141 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 234/287 2024-09-12T16:58:35.141 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 235/287 2024-09-12T16:58:35.141 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 236/287 2024-09-12T16:58:35.141 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 237/287 2024-09-12T16:58:35.141 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 238/287 2024-09-12T16:58:35.141 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 239/287 2024-09-12T16:58:35.141 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 240/287 2024-09-12T16:58:35.141 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 241/287 2024-09-12T16:58:35.141 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 242/287 2024-09-12T16:58:35.141 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 243/287 2024-09-12T16:58:35.142 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 244/287 2024-09-12T16:58:35.142 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 245/287 2024-09-12T16:58:35.142 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 246/287 2024-09-12T16:58:35.142 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 247/287 2024-09-12T16:58:35.142 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 248/287 2024-09-12T16:58:35.142 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 249/287 2024-09-12T16:58:35.142 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 250/287 2024-09-12T16:58:35.142 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 251/287 2024-09-12T16:58:35.142 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 252/287 2024-09-12T16:58:35.142 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 253/287 2024-09-12T16:58:35.142 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 254/287 2024-09-12T16:58:35.142 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 255/287 2024-09-12T16:58:35.142 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 256/287 2024-09-12T16:58:35.143 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 257/287 2024-09-12T16:58:35.143 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 258/287 2024-09-12T16:58:35.143 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 259/287 2024-09-12T16:58:35.143 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 260/287 2024-09-12T16:58:35.143 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 261/287 2024-09-12T16:58:35.143 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 262/287 2024-09-12T16:58:35.143 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 263/287 2024-09-12T16:58:35.143 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 264/287 2024-09-12T16:58:35.143 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 265/287 2024-09-12T16:58:35.143 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 266/287 2024-09-12T16:58:35.143 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 267/287 2024-09-12T16:58:35.143 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 268/287 2024-09-12T16:58:35.143 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 269/287 2024-09-12T16:58:35.143 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 270/287 2024-09-12T16:58:35.144 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 271/287 2024-09-12T16:58:35.144 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 272/287 2024-09-12T16:58:35.144 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 273/287 2024-09-12T16:58:35.144 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 274/287 2024-09-12T16:58:35.144 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 275/287 2024-09-12T16:58:35.144 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 276/287 2024-09-12T16:58:35.144 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 277/287 2024-09-12T16:58:35.144 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 278/287 2024-09-12T16:58:35.144 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 279/287 2024-09-12T16:58:35.144 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 280/287 2024-09-12T16:58:35.144 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : re2-1:20211101-20.el9.x86_64 281/287 2024-09-12T16:58:35.144 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 282/287 2024-09-12T16:58:35.144 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 283/287 2024-09-12T16:58:35.145 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 284/287 2024-09-12T16:58:35.145 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 285/287 2024-09-12T16:58:35.145 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 286/287 2024-09-12T16:58:35.256 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el 270/287 2024-09-12T16:58:35.321 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 271/287 2024-09-12T16:58:35.344 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 271/287 2024-09-12T16:58:35.345 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:58:35.345 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T16:58:35.345 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T16:58:35.345 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T16:58:35.345 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:58:35.396 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 272/287 2024-09-12T16:58:35.408 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 272/287 2024-09-12T16:58:35.431 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 273/287 2024-09-12T16:58:35.460 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 274/287 2024-09-12T16:58:35.509 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 275/287 2024-09-12T16:58:35.540 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T16:58:35.556 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T16:58:35.556 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-12T16:58:35.556 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:58:36.543 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 277/287 2024-09-12T16:58:36.565 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 277/287 2024-09-12T16:58:36.565 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:58:36.565 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T16:58:36.565 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T16:58:36.565 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T16:58:36.565 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:58:36.609 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4762.gbad47 278/287 2024-09-12T16:58:36.631 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4762.gbad47 278/287 2024-09-12T16:58:36.631 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:58:36.632 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T16:58:36.632 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:58:36.959 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 279/287 2024-09-12T16:58:36.982 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 279/287 2024-09-12T16:58:36.982 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T16:58:36.982 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T16:58:36.982 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T16:58:36.983 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T16:58:36.983 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:58:38.387 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T16:58:38.387 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:58:38.388 INFO:teuthology.orchestra.run.smithi067.stdout:Upgraded: 2024-09-12T16:58:38.388 INFO:teuthology.orchestra.run.smithi067.stdout: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.388 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.388 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-09-12T16:58:38.388 INFO:teuthology.orchestra.run.smithi067.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-12T16:58:38.388 INFO:teuthology.orchestra.run.smithi067.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T16:58:38.388 INFO:teuthology.orchestra.run.smithi067.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-12T16:58:38.388 INFO:teuthology.orchestra.run.smithi067.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-12T16:58:38.388 INFO:teuthology.orchestra.run.smithi067.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-12T16:58:38.388 INFO:teuthology.orchestra.run.smithi067.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-12T16:58:38.388 INFO:teuthology.orchestra.run.smithi067.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-12T16:58:38.388 INFO:teuthology.orchestra.run.smithi067.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-12T16:58:38.389 INFO:teuthology.orchestra.run.smithi067.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-12T16:58:38.389 INFO:teuthology.orchestra.run.smithi067.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-12T16:58:38.389 INFO:teuthology.orchestra.run.smithi067.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-12T16:58:38.389 INFO:teuthology.orchestra.run.smithi067.stdout: atinject-1.0.3-6.el9.noarch 2024-09-12T16:58:38.389 INFO:teuthology.orchestra.run.smithi067.stdout: atk-2.36.0-5.el9.x86_64 2024-09-12T16:58:38.389 INFO:teuthology.orchestra.run.smithi067.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-12T16:58:38.389 INFO:teuthology.orchestra.run.smithi067.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-12T16:58:38.389 INFO:teuthology.orchestra.run.smithi067.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T16:58:38.389 INFO:teuthology.orchestra.run.smithi067.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-12T16:58:38.389 INFO:teuthology.orchestra.run.smithi067.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-12T16:58:38.389 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.389 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.389 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.390 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.390 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T16:58:38.390 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.390 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.390 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.390 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T16:58:38.390 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T16:58:38.390 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T16:58:38.390 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T16:58:38.390 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T16:58:38.390 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.390 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.390 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T16:58:38.391 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.391 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.391 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.391 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T16:58:38.391 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T16:58:38.391 INFO:teuthology.orchestra.run.smithi067.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-12T16:58:38.391 INFO:teuthology.orchestra.run.smithi067.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-12T16:58:38.391 INFO:teuthology.orchestra.run.smithi067.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-12T16:58:38.391 INFO:teuthology.orchestra.run.smithi067.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-12T16:58:38.391 INFO:teuthology.orchestra.run.smithi067.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-12T16:58:38.391 INFO:teuthology.orchestra.run.smithi067.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-12T16:58:38.391 INFO:teuthology.orchestra.run.smithi067.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-12T16:58:38.391 INFO:teuthology.orchestra.run.smithi067.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-12T16:58:38.391 INFO:teuthology.orchestra.run.smithi067.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-12T16:58:38.392 INFO:teuthology.orchestra.run.smithi067.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-12T16:58:38.392 INFO:teuthology.orchestra.run.smithi067.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-12T16:58:38.392 INFO:teuthology.orchestra.run.smithi067.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-12T16:58:38.392 INFO:teuthology.orchestra.run.smithi067.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-12T16:58:38.392 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T16:58:38.392 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T16:58:38.392 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T16:58:38.392 INFO:teuthology.orchestra.run.smithi067.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T16:58:38.392 INFO:teuthology.orchestra.run.smithi067.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-12T16:58:38.392 INFO:teuthology.orchestra.run.smithi067.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-12T16:58:38.392 INFO:teuthology.orchestra.run.smithi067.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-12T16:58:38.392 INFO:teuthology.orchestra.run.smithi067.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-12T16:58:38.393 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T16:58:38.393 INFO:teuthology.orchestra.run.smithi067.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-12T16:58:38.393 INFO:teuthology.orchestra.run.smithi067.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T16:58:38.393 INFO:teuthology.orchestra.run.smithi067.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-12T16:58:38.393 INFO:teuthology.orchestra.run.smithi067.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-12T16:58:38.393 INFO:teuthology.orchestra.run.smithi067.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-12T16:58:38.393 INFO:teuthology.orchestra.run.smithi067.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-12T16:58:38.393 INFO:teuthology.orchestra.run.smithi067.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-12T16:58:38.393 INFO:teuthology.orchestra.run.smithi067.stdout: guava-30.1-6.el9.noarch 2024-09-12T16:58:38.393 INFO:teuthology.orchestra.run.smithi067.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-12T16:58:38.393 INFO:teuthology.orchestra.run.smithi067.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-12T16:58:38.393 INFO:teuthology.orchestra.run.smithi067.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-12T16:58:38.393 INFO:teuthology.orchestra.run.smithi067.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-12T16:58:38.394 INFO:teuthology.orchestra.run.smithi067.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-12T16:58:38.394 INFO:teuthology.orchestra.run.smithi067.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-12T16:58:38.394 INFO:teuthology.orchestra.run.smithi067.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T16:58:38.394 INFO:teuthology.orchestra.run.smithi067.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T16:58:38.394 INFO:teuthology.orchestra.run.smithi067.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T16:58:38.394 INFO:teuthology.orchestra.run.smithi067.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-12T16:58:38.394 INFO:teuthology.orchestra.run.smithi067.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-12T16:58:38.394 INFO:teuthology.orchestra.run.smithi067.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-12T16:58:38.394 INFO:teuthology.orchestra.run.smithi067.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-12T16:58:38.394 INFO:teuthology.orchestra.run.smithi067.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-12T16:58:38.394 INFO:teuthology.orchestra.run.smithi067.stdout: lcms2-2.12-3.el9.x86_64 2024-09-12T16:58:38.394 INFO:teuthology.orchestra.run.smithi067.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-12T16:58:38.394 INFO:teuthology.orchestra.run.smithi067.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-12T16:58:38.394 INFO:teuthology.orchestra.run.smithi067.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-12T16:58:38.395 INFO:teuthology.orchestra.run.smithi067.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-12T16:58:38.395 INFO:teuthology.orchestra.run.smithi067.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-12T16:58:38.395 INFO:teuthology.orchestra.run.smithi067.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-12T16:58:38.395 INFO:teuthology.orchestra.run.smithi067.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-12T16:58:38.395 INFO:teuthology.orchestra.run.smithi067.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-12T16:58:38.395 INFO:teuthology.orchestra.run.smithi067.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-12T16:58:38.395 INFO:teuthology.orchestra.run.smithi067.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-12T16:58:38.395 INFO:teuthology.orchestra.run.smithi067.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-12T16:58:38.395 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T16:58:38.395 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T16:58:38.395 INFO:teuthology.orchestra.run.smithi067.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-12T16:58:38.395 INFO:teuthology.orchestra.run.smithi067.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-12T16:58:38.395 INFO:teuthology.orchestra.run.smithi067.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-12T16:58:38.396 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.396 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.396 INFO:teuthology.orchestra.run.smithi067.stdout: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.396 INFO:teuthology.orchestra.run.smithi067.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-12T16:58:38.396 INFO:teuthology.orchestra.run.smithi067.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-12T16:58:38.396 INFO:teuthology.orchestra.run.smithi067.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-12T16:58:38.396 INFO:teuthology.orchestra.run.smithi067.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-12T16:58:38.396 INFO:teuthology.orchestra.run.smithi067.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-12T16:58:38.396 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T16:58:38.396 INFO:teuthology.orchestra.run.smithi067.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-12T16:58:38.396 INFO:teuthology.orchestra.run.smithi067.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-12T16:58:38.396 INFO:teuthology.orchestra.run.smithi067.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-12T16:58:38.396 INFO:teuthology.orchestra.run.smithi067.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-12T16:58:38.397 INFO:teuthology.orchestra.run.smithi067.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-12T16:58:38.397 INFO:teuthology.orchestra.run.smithi067.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-12T16:58:38.397 INFO:teuthology.orchestra.run.smithi067.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-12T16:58:38.397 INFO:teuthology.orchestra.run.smithi067.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-12T16:58:38.397 INFO:teuthology.orchestra.run.smithi067.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T16:58:38.397 INFO:teuthology.orchestra.run.smithi067.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-12T16:58:38.397 INFO:teuthology.orchestra.run.smithi067.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-12T16:58:38.397 INFO:teuthology.orchestra.run.smithi067.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-12T16:58:38.397 INFO:teuthology.orchestra.run.smithi067.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T16:58:38.397 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T16:58:38.397 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T16:58:38.397 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.397 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.398 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T16:58:38.398 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.398 INFO:teuthology.orchestra.run.smithi067.stdout: libsbc-1.4-9.el9.x86_64 2024-09-12T16:58:38.398 INFO:teuthology.orchestra.run.smithi067.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-12T16:58:38.398 INFO:teuthology.orchestra.run.smithi067.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-12T16:58:38.398 INFO:teuthology.orchestra.run.smithi067.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-12T16:58:38.398 INFO:teuthology.orchestra.run.smithi067.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-12T16:58:38.398 INFO:teuthology.orchestra.run.smithi067.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-12T16:58:38.398 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T16:58:38.398 INFO:teuthology.orchestra.run.smithi067.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-12T16:58:38.398 INFO:teuthology.orchestra.run.smithi067.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-12T16:58:38.398 INFO:teuthology.orchestra.run.smithi067.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-12T16:58:38.398 INFO:teuthology.orchestra.run.smithi067.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-12T16:58:38.399 INFO:teuthology.orchestra.run.smithi067.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-12T16:58:38.399 INFO:teuthology.orchestra.run.smithi067.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-12T16:58:38.399 INFO:teuthology.orchestra.run.smithi067.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-12T16:58:38.399 INFO:teuthology.orchestra.run.smithi067.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-12T16:58:38.399 INFO:teuthology.orchestra.run.smithi067.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-12T16:58:38.399 INFO:teuthology.orchestra.run.smithi067.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-12T16:58:38.399 INFO:teuthology.orchestra.run.smithi067.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-12T16:58:38.399 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T16:58:38.399 INFO:teuthology.orchestra.run.smithi067.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T16:58:38.399 INFO:teuthology.orchestra.run.smithi067.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T16:58:38.399 INFO:teuthology.orchestra.run.smithi067.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-12T16:58:38.399 INFO:teuthology.orchestra.run.smithi067.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T16:58:38.399 INFO:teuthology.orchestra.run.smithi067.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-12T16:58:38.399 INFO:teuthology.orchestra.run.smithi067.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-12T16:58:38.400 INFO:teuthology.orchestra.run.smithi067.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-12T16:58:38.400 INFO:teuthology.orchestra.run.smithi067.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-12T16:58:38.400 INFO:teuthology.orchestra.run.smithi067.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-12T16:58:38.400 INFO:teuthology.orchestra.run.smithi067.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-12T16:58:38.400 INFO:teuthology.orchestra.run.smithi067.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-12T16:58:38.400 INFO:teuthology.orchestra.run.smithi067.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-12T16:58:38.400 INFO:teuthology.orchestra.run.smithi067.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-12T16:58:38.400 INFO:teuthology.orchestra.run.smithi067.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-12T16:58:38.400 INFO:teuthology.orchestra.run.smithi067.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-12T16:58:38.400 INFO:teuthology.orchestra.run.smithi067.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-12T16:58:38.400 INFO:teuthology.orchestra.run.smithi067.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-12T16:58:38.400 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T16:58:38.400 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T16:58:38.401 INFO:teuthology.orchestra.run.smithi067.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-12T16:58:38.401 INFO:teuthology.orchestra.run.smithi067.stdout: opus-1.3.1-10.el9.x86_64 2024-09-12T16:58:38.401 INFO:teuthology.orchestra.run.smithi067.stdout: orc-0.4.31-8.el9.x86_64 2024-09-12T16:58:38.401 INFO:teuthology.orchestra.run.smithi067.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-12T16:58:38.401 INFO:teuthology.orchestra.run.smithi067.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-12T16:58:38.401 INFO:teuthology.orchestra.run.smithi067.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-12T16:58:38.401 INFO:teuthology.orchestra.run.smithi067.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-12T16:58:38.401 INFO:teuthology.orchestra.run.smithi067.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T16:58:38.401 INFO:teuthology.orchestra.run.smithi067.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-12T16:58:38.401 INFO:teuthology.orchestra.run.smithi067.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-12T16:58:38.401 INFO:teuthology.orchestra.run.smithi067.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-12T16:58:38.401 INFO:teuthology.orchestra.run.smithi067.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-12T16:58:38.401 INFO:teuthology.orchestra.run.smithi067.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-12T16:58:38.402 INFO:teuthology.orchestra.run.smithi067.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-12T16:58:38.402 INFO:teuthology.orchestra.run.smithi067.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-12T16:58:38.402 INFO:teuthology.orchestra.run.smithi067.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-12T16:58:38.402 INFO:teuthology.orchestra.run.smithi067.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-12T16:58:38.402 INFO:teuthology.orchestra.run.smithi067.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-12T16:58:38.402 INFO:teuthology.orchestra.run.smithi067.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-12T16:58:38.402 INFO:teuthology.orchestra.run.smithi067.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-12T16:58:38.402 INFO:teuthology.orchestra.run.smithi067.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-12T16:58:38.402 INFO:teuthology.orchestra.run.smithi067.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-12T16:58:38.402 INFO:teuthology.orchestra.run.smithi067.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-12T16:58:38.402 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T16:58:38.402 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T16:58:38.402 INFO:teuthology.orchestra.run.smithi067.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-12T16:58:38.403 INFO:teuthology.orchestra.run.smithi067.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-12T16:58:38.403 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T16:58:38.403 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T16:58:38.403 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T16:58:38.403 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T16:58:38.403 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.403 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.403 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.403 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T16:58:38.403 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T16:58:38.403 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T16:58:38.403 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T16:58:38.403 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T16:58:38.404 INFO:teuthology.orchestra.run.smithi067.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T16:58:38.404 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T16:58:38.404 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T16:58:38.404 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T16:58:38.404 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T16:58:38.404 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T16:58:38.404 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T16:58:38.404 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T16:58:38.404 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T16:58:38.404 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T16:58:38.404 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T16:58:38.404 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T16:58:38.404 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T16:58:38.405 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T16:58:38.405 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T16:58:38.405 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T16:58:38.405 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T16:58:38.405 INFO:teuthology.orchestra.run.smithi067.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T16:58:38.405 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T16:58:38.405 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T16:58:38.405 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T16:58:38.405 INFO:teuthology.orchestra.run.smithi067.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T16:58:38.405 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T16:58:38.405 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T16:58:38.405 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T16:58:38.405 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T16:58:38.406 INFO:teuthology.orchestra.run.smithi067.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T16:58:38.406 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T16:58:38.406 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T16:58:38.406 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T16:58:38.406 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T16:58:38.406 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T16:58:38.406 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.406 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.406 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T16:58:38.406 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T16:58:38.406 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T16:58:38.406 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.406 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T16:58:38.406 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T16:58:38.407 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T16:58:38.407 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T16:58:38.407 INFO:teuthology.orchestra.run.smithi067.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T16:58:38.407 INFO:teuthology.orchestra.run.smithi067.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T16:58:38.407 INFO:teuthology.orchestra.run.smithi067.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T16:58:38.407 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T16:58:38.407 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T16:58:38.407 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T16:58:38.407 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T16:58:38.407 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T16:58:38.407 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T16:58:38.407 INFO:teuthology.orchestra.run.smithi067.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T16:58:38.407 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.408 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.408 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:38.408 INFO:teuthology.orchestra.run.smithi067.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T16:58:38.408 INFO:teuthology.orchestra.run.smithi067.stdout: rtkit-0.11-29.el9.x86_64 2024-09-12T16:58:38.408 INFO:teuthology.orchestra.run.smithi067.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-12T16:58:38.408 INFO:teuthology.orchestra.run.smithi067.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-12T16:58:38.408 INFO:teuthology.orchestra.run.smithi067.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-12T16:58:38.408 INFO:teuthology.orchestra.run.smithi067.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T16:58:38.409 INFO:teuthology.orchestra.run.smithi067.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-12T16:58:38.409 INFO:teuthology.orchestra.run.smithi067.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T16:58:38.409 INFO:teuthology.orchestra.run.smithi067.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-12T16:58:38.409 INFO:teuthology.orchestra.run.smithi067.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-12T16:58:38.409 INFO:teuthology.orchestra.run.smithi067.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-12T16:58:38.409 INFO:teuthology.orchestra.run.smithi067.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-12T16:58:38.409 INFO:teuthology.orchestra.run.smithi067.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-12T16:58:38.409 INFO:teuthology.orchestra.run.smithi067.stdout: upower-0.99.11-11.el9.x86_64 2024-09-12T16:58:38.409 INFO:teuthology.orchestra.run.smithi067.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-12T16:58:38.409 INFO:teuthology.orchestra.run.smithi067.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-12T16:58:38.409 INFO:teuthology.orchestra.run.smithi067.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-12T16:58:38.409 INFO:teuthology.orchestra.run.smithi067.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-12T16:58:38.409 INFO:teuthology.orchestra.run.smithi067.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-12T16:58:38.409 INFO:teuthology.orchestra.run.smithi067.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-12T16:58:38.410 INFO:teuthology.orchestra.run.smithi067.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-12T16:58:38.410 INFO:teuthology.orchestra.run.smithi067.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T16:58:38.410 INFO:teuthology.orchestra.run.smithi067.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-12T16:58:38.410 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:58:38.410 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-09-12T16:58:38.808 DEBUG:teuthology.parallel:result is None 2024-09-12T16:58:41.280 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 280/287 2024-09-12T16:58:41.330 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 281/287 2024-09-12T16:58:41.361 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 282/287 2024-09-12T16:58:41.467 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_ 283/287 2024-09-12T16:58:41.530 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 284/287 2024-09-12T16:58:41.561 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 285/287 2024-09-12T16:58:41.561 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T16:58:41.654 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T16:58:41.654 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T16:58:41.745 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T16:58:41.772 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 287/287 2024-09-12T16:58:41.778 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 287/287 2024-09-12T16:58:41.787 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 287/287 2024-09-12T16:58:41.797 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 287/287 2024-09-12T16:58:41.797 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T16:58:41.797 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T16:58:41.797 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:58:41.855 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T16:58:41.923 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T16:58:53.917 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T16:58:53.918 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 1/287 2024-09-12T16:58:53.918 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2/287 2024-09-12T16:58:53.918 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 3/287 2024-09-12T16:58:53.918 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 4/287 2024-09-12T16:58:53.918 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4762.gbad47 5/287 2024-09-12T16:58:53.918 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 6/287 2024-09-12T16:58:53.918 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 7/287 2024-09-12T16:58:53.918 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 8/287 2024-09-12T16:58:53.918 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 9/287 2024-09-12T16:58:53.918 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T16:58:53.918 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T16:58:53.918 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 12/287 2024-09-12T16:58:53.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_ 13/287 2024-09-12T16:58:53.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 14/287 2024-09-12T16:58:53.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 15/287 2024-09-12T16:58:53.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_6 16/287 2024-09-12T16:58:53.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 17/287 2024-09-12T16:58:53.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 18/287 2024-09-12T16:58:53.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el 19/287 2024-09-12T16:58:53.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9. 20/287 2024-09-12T16:58:53.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_6 21/287 2024-09-12T16:58:53.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 22/287 2024-09-12T16:58:53.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 23/287 2024-09-12T16:58:53.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T16:58:53.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 25/287 2024-09-12T16:58:53.920 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 26/287 2024-09-12T16:58:53.920 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 27/287 2024-09-12T16:58:53.920 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1. 28/287 2024-09-12T16:58:53.942 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 29/287 2024-09-12T16:58:53.942 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 30/287 2024-09-12T16:58:53.943 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 31/287 2024-09-12T16:58:53.943 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el 32/287 2024-09-12T16:58:53.943 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 33/287 2024-09-12T16:58:53.943 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.e 34/287 2024-09-12T16:58:53.943 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 35/287 2024-09-12T16:58:53.943 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 36/287 2024-09-12T16:58:53.943 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/287 2024-09-12T16:58:53.943 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/287 2024-09-12T16:58:53.943 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/287 2024-09-12T16:58:53.943 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/287 2024-09-12T16:58:53.943 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/287 2024-09-12T16:58:53.943 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/287 2024-09-12T16:58:53.943 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/287 2024-09-12T16:58:53.944 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/287 2024-09-12T16:58:53.944 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/287 2024-09-12T16:58:53.944 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/287 2024-09-12T16:58:53.944 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/287 2024-09-12T16:58:53.944 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/287 2024-09-12T16:58:53.944 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/287 2024-09-12T16:58:53.944 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/287 2024-09-12T16:58:53.944 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/287 2024-09-12T16:58:53.944 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/287 2024-09-12T16:58:53.944 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/287 2024-09-12T16:58:53.944 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/287 2024-09-12T16:58:53.944 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/287 2024-09-12T16:58:53.945 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/287 2024-09-12T16:58:53.945 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/287 2024-09-12T16:58:53.945 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/287 2024-09-12T16:58:53.948 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/287 2024-09-12T16:58:53.948 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/287 2024-09-12T16:58:53.948 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/287 2024-09-12T16:58:53.948 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/287 2024-09-12T16:58:53.948 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/287 2024-09-12T16:58:53.948 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/287 2024-09-12T16:58:53.948 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/287 2024-09-12T16:58:53.949 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/287 2024-09-12T16:58:53.949 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/287 2024-09-12T16:58:53.949 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/287 2024-09-12T16:58:53.949 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/287 2024-09-12T16:58:53.949 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/287 2024-09-12T16:58:53.949 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/287 2024-09-12T16:58:53.949 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T16:58:53.949 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/287 2024-09-12T16:58:53.949 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/287 2024-09-12T16:58:53.949 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/287 2024-09-12T16:58:53.949 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/287 2024-09-12T16:58:53.949 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/287 2024-09-12T16:58:53.950 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/287 2024-09-12T16:58:53.950 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/287 2024-09-12T16:58:53.950 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/287 2024-09-12T16:58:53.950 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/287 2024-09-12T16:58:53.950 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/287 2024-09-12T16:58:53.950 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/287 2024-09-12T16:58:53.950 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/287 2024-09-12T16:58:53.950 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/287 2024-09-12T16:58:53.950 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/287 2024-09-12T16:58:53.950 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/287 2024-09-12T16:58:53.950 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/287 2024-09-12T16:58:53.950 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/287 2024-09-12T16:58:53.950 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/287 2024-09-12T16:58:53.950 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : guava-30.1-6.el9.noarch 91/287 2024-09-12T16:58:53.951 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/287 2024-09-12T16:58:53.951 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/287 2024-09-12T16:58:53.951 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/287 2024-09-12T16:58:53.951 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/287 2024-09-12T16:58:53.951 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/287 2024-09-12T16:58:53.951 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/287 2024-09-12T16:58:53.951 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/287 2024-09-12T16:58:53.951 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/287 2024-09-12T16:58:53.951 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/287 2024-09-12T16:58:53.951 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/287 2024-09-12T16:58:53.951 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/287 2024-09-12T16:58:53.951 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/287 2024-09-12T16:58:53.951 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/287 2024-09-12T16:58:53.951 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/287 2024-09-12T16:58:53.952 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/287 2024-09-12T16:58:53.952 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/287 2024-09-12T16:58:53.952 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/287 2024-09-12T16:58:53.952 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/287 2024-09-12T16:58:53.952 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/287 2024-09-12T16:58:53.952 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/287 2024-09-12T16:58:53.952 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/287 2024-09-12T16:58:53.952 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/287 2024-09-12T16:58:53.952 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/287 2024-09-12T16:58:53.952 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/287 2024-09-12T16:58:53.952 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/287 2024-09-12T16:58:53.952 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/287 2024-09-12T16:58:53.952 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/287 2024-09-12T16:58:53.953 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/287 2024-09-12T16:58:53.953 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/287 2024-09-12T16:58:53.953 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/287 2024-09-12T16:58:53.953 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/287 2024-09-12T16:58:53.953 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/287 2024-09-12T16:58:53.953 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/287 2024-09-12T16:58:53.953 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/287 2024-09-12T16:58:53.953 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/287 2024-09-12T16:58:53.953 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/287 2024-09-12T16:58:53.953 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/287 2024-09-12T16:58:53.953 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/287 2024-09-12T16:58:53.953 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/287 2024-09-12T16:58:53.953 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/287 2024-09-12T16:58:53.954 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/287 2024-09-12T16:58:53.954 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/287 2024-09-12T16:58:53.954 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/287 2024-09-12T16:58:53.954 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/287 2024-09-12T16:58:53.954 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/287 2024-09-12T16:58:53.954 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/287 2024-09-12T16:58:53.954 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/287 2024-09-12T16:58:53.954 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/287 2024-09-12T16:58:53.954 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/287 2024-09-12T16:58:53.954 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/287 2024-09-12T16:58:53.954 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 142/287 2024-09-12T16:58:53.954 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 143/287 2024-09-12T16:58:53.954 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/287 2024-09-12T16:58:53.955 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/287 2024-09-12T16:58:53.955 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/287 2024-09-12T16:58:53.955 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/287 2024-09-12T16:58:53.955 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/287 2024-09-12T16:58:53.955 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/287 2024-09-12T16:58:53.955 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/287 2024-09-12T16:58:53.955 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/287 2024-09-12T16:58:53.955 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/287 2024-09-12T16:58:53.955 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/287 2024-09-12T16:58:53.955 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/287 2024-09-12T16:58:53.955 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/287 2024-09-12T16:58:53.955 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/287 2024-09-12T16:58:53.956 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/287 2024-09-12T16:58:53.956 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/287 2024-09-12T16:58:53.956 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/287 2024-09-12T16:58:53.956 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/287 2024-09-12T16:58:53.956 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/287 2024-09-12T16:58:53.956 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/287 2024-09-12T16:58:53.956 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/287 2024-09-12T16:58:53.956 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 164/287 2024-09-12T16:58:53.956 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 165/287 2024-09-12T16:58:53.956 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 166/287 2024-09-12T16:58:53.956 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 167/287 2024-09-12T16:58:53.956 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 168/287 2024-09-12T16:58:53.956 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 169/287 2024-09-12T16:58:53.956 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 170/287 2024-09-12T16:58:53.957 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 171/287 2024-09-12T16:58:53.957 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 172/287 2024-09-12T16:58:53.957 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 173/287 2024-09-12T16:58:53.957 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : opus-1.3.1-10.el9.x86_64 174/287 2024-09-12T16:58:53.957 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : orc-0.4.31-8.el9.x86_64 175/287 2024-09-12T16:58:53.957 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 176/287 2024-09-12T16:58:53.957 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 177/287 2024-09-12T16:58:53.957 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 178/287 2024-09-12T16:58:53.957 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 179/287 2024-09-12T16:58:53.957 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 180/287 2024-09-12T16:58:53.957 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 181/287 2024-09-12T16:58:53.957 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 182/287 2024-09-12T16:58:53.957 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 183/287 2024-09-12T16:58:53.958 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 184/287 2024-09-12T16:58:53.958 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 185/287 2024-09-12T16:58:53.958 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 186/287 2024-09-12T16:58:53.958 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 187/287 2024-09-12T16:58:53.958 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 188/287 2024-09-12T16:58:53.958 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 189/287 2024-09-12T16:58:53.958 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 190/287 2024-09-12T16:58:53.958 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 191/287 2024-09-12T16:58:53.958 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 192/287 2024-09-12T16:58:53.958 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 193/287 2024-09-12T16:58:53.958 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 194/287 2024-09-12T16:58:53.958 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 195/287 2024-09-12T16:58:53.958 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 196/287 2024-09-12T16:58:53.958 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 197/287 2024-09-12T16:58:53.958 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 198/287 2024-09-12T16:58:53.959 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 199/287 2024-09-12T16:58:53.959 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 200/287 2024-09-12T16:58:53.959 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 201/287 2024-09-12T16:58:53.959 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 202/287 2024-09-12T16:58:53.959 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 203/287 2024-09-12T16:58:53.959 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 204/287 2024-09-12T16:58:53.959 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 205/287 2024-09-12T16:58:53.959 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 206/287 2024-09-12T16:58:53.959 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 207/287 2024-09-12T16:58:53.959 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 208/287 2024-09-12T16:58:53.959 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 209/287 2024-09-12T16:58:53.959 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 210/287 2024-09-12T16:58:53.959 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 211/287 2024-09-12T16:58:53.959 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 212/287 2024-09-12T16:58:53.960 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 213/287 2024-09-12T16:58:53.960 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 214/287 2024-09-12T16:58:53.960 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 215/287 2024-09-12T16:58:53.960 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 216/287 2024-09-12T16:58:53.960 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 217/287 2024-09-12T16:58:53.960 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 218/287 2024-09-12T16:58:53.960 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 219/287 2024-09-12T16:58:53.960 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rtkit-0.11-29.el9.x86_64 220/287 2024-09-12T16:58:53.960 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 221/287 2024-09-12T16:58:53.960 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 222/287 2024-09-12T16:58:53.960 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 223/287 2024-09-12T16:58:53.960 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 224/287 2024-09-12T16:58:53.960 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 225/287 2024-09-12T16:58:53.960 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 226/287 2024-09-12T16:58:53.961 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 227/287 2024-09-12T16:58:53.961 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 228/287 2024-09-12T16:58:53.961 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 229/287 2024-09-12T16:58:53.961 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : upower-0.99.11-11.el9.x86_64 230/287 2024-09-12T16:58:53.961 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 231/287 2024-09-12T16:58:53.961 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 232/287 2024-09-12T16:58:53.961 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 233/287 2024-09-12T16:58:53.961 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 234/287 2024-09-12T16:58:53.961 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 235/287 2024-09-12T16:58:53.961 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 236/287 2024-09-12T16:58:53.961 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 237/287 2024-09-12T16:58:53.961 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 238/287 2024-09-12T16:58:53.961 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 239/287 2024-09-12T16:58:53.962 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 240/287 2024-09-12T16:58:53.962 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 241/287 2024-09-12T16:58:53.962 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 242/287 2024-09-12T16:58:53.962 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 243/287 2024-09-12T16:58:53.962 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 244/287 2024-09-12T16:58:53.962 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 245/287 2024-09-12T16:58:53.962 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 246/287 2024-09-12T16:58:53.962 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 247/287 2024-09-12T16:58:53.962 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 248/287 2024-09-12T16:58:53.962 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 249/287 2024-09-12T16:58:53.962 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 250/287 2024-09-12T16:58:53.962 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 251/287 2024-09-12T16:58:53.962 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 252/287 2024-09-12T16:58:53.963 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 253/287 2024-09-12T16:58:53.963 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 254/287 2024-09-12T16:58:53.963 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 255/287 2024-09-12T16:58:53.963 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 256/287 2024-09-12T16:58:53.963 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 257/287 2024-09-12T16:58:53.963 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 258/287 2024-09-12T16:58:53.963 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 259/287 2024-09-12T16:58:53.963 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 260/287 2024-09-12T16:58:53.963 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 261/287 2024-09-12T16:58:53.963 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 262/287 2024-09-12T16:58:53.963 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 263/287 2024-09-12T16:58:53.963 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 264/287 2024-09-12T16:58:53.963 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 265/287 2024-09-12T16:58:53.963 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 266/287 2024-09-12T16:58:53.964 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 267/287 2024-09-12T16:58:53.964 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 268/287 2024-09-12T16:58:53.964 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 269/287 2024-09-12T16:58:53.964 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 270/287 2024-09-12T16:58:53.964 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 271/287 2024-09-12T16:58:53.964 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 272/287 2024-09-12T16:58:53.964 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 273/287 2024-09-12T16:58:53.964 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 274/287 2024-09-12T16:58:53.964 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 275/287 2024-09-12T16:58:53.964 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 276/287 2024-09-12T16:58:53.964 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 277/287 2024-09-12T16:58:53.964 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 278/287 2024-09-12T16:58:53.964 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 279/287 2024-09-12T16:58:53.965 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 280/287 2024-09-12T16:58:53.965 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : re2-1:20211101-20.el9.x86_64 281/287 2024-09-12T16:58:53.965 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 282/287 2024-09-12T16:58:53.965 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 283/287 2024-09-12T16:58:53.965 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 284/287 2024-09-12T16:58:53.965 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 285/287 2024-09-12T16:58:53.965 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 286/287 2024-09-12T16:58:57.468 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T16:58:57.468 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:58:57.468 INFO:teuthology.orchestra.run.smithi118.stdout:Upgraded: 2024-09-12T16:58:57.468 INFO:teuthology.orchestra.run.smithi118.stdout: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.468 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.469 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2024-09-12T16:58:57.469 INFO:teuthology.orchestra.run.smithi118.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-12T16:58:57.469 INFO:teuthology.orchestra.run.smithi118.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T16:58:57.469 INFO:teuthology.orchestra.run.smithi118.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-12T16:58:57.469 INFO:teuthology.orchestra.run.smithi118.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-12T16:58:57.469 INFO:teuthology.orchestra.run.smithi118.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-12T16:58:57.469 INFO:teuthology.orchestra.run.smithi118.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-12T16:58:57.469 INFO:teuthology.orchestra.run.smithi118.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-12T16:58:57.469 INFO:teuthology.orchestra.run.smithi118.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-12T16:58:57.469 INFO:teuthology.orchestra.run.smithi118.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-12T16:58:57.469 INFO:teuthology.orchestra.run.smithi118.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-12T16:58:57.469 INFO:teuthology.orchestra.run.smithi118.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-12T16:58:57.469 INFO:teuthology.orchestra.run.smithi118.stdout: atinject-1.0.3-6.el9.noarch 2024-09-12T16:58:57.470 INFO:teuthology.orchestra.run.smithi118.stdout: atk-2.36.0-5.el9.x86_64 2024-09-12T16:58:57.470 INFO:teuthology.orchestra.run.smithi118.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-12T16:58:57.470 INFO:teuthology.orchestra.run.smithi118.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-12T16:58:57.470 INFO:teuthology.orchestra.run.smithi118.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T16:58:57.470 INFO:teuthology.orchestra.run.smithi118.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-12T16:58:57.470 INFO:teuthology.orchestra.run.smithi118.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-12T16:58:57.470 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.470 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.470 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.470 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.470 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T16:58:57.470 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.470 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.471 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.471 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T16:58:57.471 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T16:58:57.471 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T16:58:57.471 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T16:58:57.471 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T16:58:57.471 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.471 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.471 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T16:58:57.471 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.471 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.471 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.471 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T16:58:57.471 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T16:58:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-12T16:58:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-12T16:58:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-12T16:58:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-12T16:58:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-12T16:58:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-12T16:58:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-12T16:58:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-12T16:58:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-12T16:58:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-12T16:58:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-12T16:58:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-12T16:58:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-12T16:58:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T16:58:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T16:58:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T16:58:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T16:58:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-12T16:58:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-12T16:58:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-12T16:58:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-12T16:58:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T16:58:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-12T16:58:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T16:58:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-12T16:58:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-12T16:58:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-12T16:58:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-12T16:58:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-12T16:58:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: guava-30.1-6.el9.noarch 2024-09-12T16:58:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-12T16:58:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-12T16:58:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-12T16:58:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-12T16:58:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-12T16:58:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-12T16:58:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T16:58:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T16:58:57.475 INFO:teuthology.orchestra.run.smithi118.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T16:58:57.475 INFO:teuthology.orchestra.run.smithi118.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-12T16:58:57.475 INFO:teuthology.orchestra.run.smithi118.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-12T16:58:57.475 INFO:teuthology.orchestra.run.smithi118.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-12T16:58:57.475 INFO:teuthology.orchestra.run.smithi118.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-12T16:58:57.475 INFO:teuthology.orchestra.run.smithi118.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-12T16:58:57.475 INFO:teuthology.orchestra.run.smithi118.stdout: lcms2-2.12-3.el9.x86_64 2024-09-12T16:58:57.475 INFO:teuthology.orchestra.run.smithi118.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-12T16:58:57.475 INFO:teuthology.orchestra.run.smithi118.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-12T16:58:57.475 INFO:teuthology.orchestra.run.smithi118.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-12T16:58:57.475 INFO:teuthology.orchestra.run.smithi118.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-12T16:58:57.475 INFO:teuthology.orchestra.run.smithi118.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-12T16:58:57.475 INFO:teuthology.orchestra.run.smithi118.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-12T16:58:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-12T16:58:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-12T16:58:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-12T16:58:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-12T16:58:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-12T16:58:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T16:58:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T16:58:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-12T16:58:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-12T16:58:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-12T16:58:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-12T16:58:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-12T16:58:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-12T16:58:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-12T16:58:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-12T16:58:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T16:58:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-12T16:58:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-12T16:58:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-12T16:58:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-12T16:58:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-12T16:58:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-12T16:58:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-12T16:58:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-12T16:58:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T16:58:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-12T16:58:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-12T16:58:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-12T16:58:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T16:58:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T16:58:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T16:58:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T16:58:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: libsbc-1.4-9.el9.x86_64 2024-09-12T16:58:57.479 INFO:teuthology.orchestra.run.smithi118.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-12T16:58:57.479 INFO:teuthology.orchestra.run.smithi118.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-12T16:58:57.479 INFO:teuthology.orchestra.run.smithi118.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-12T16:58:57.479 INFO:teuthology.orchestra.run.smithi118.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-12T16:58:57.479 INFO:teuthology.orchestra.run.smithi118.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-12T16:58:57.479 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T16:58:57.479 INFO:teuthology.orchestra.run.smithi118.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-12T16:58:57.479 INFO:teuthology.orchestra.run.smithi118.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-12T16:58:57.479 INFO:teuthology.orchestra.run.smithi118.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-12T16:58:57.479 INFO:teuthology.orchestra.run.smithi118.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-12T16:58:57.479 INFO:teuthology.orchestra.run.smithi118.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-12T16:58:57.479 INFO:teuthology.orchestra.run.smithi118.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-12T16:58:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-12T16:58:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-12T16:58:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-12T16:58:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-12T16:58:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-12T16:58:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T16:58:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T16:58:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T16:58:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-12T16:58:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T16:58:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-12T16:58:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-12T16:58:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-12T16:58:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-12T16:58:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-12T16:58:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-12T16:58:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-12T16:58:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-12T16:58:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-12T16:58:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-12T16:58:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-12T16:58:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-12T16:58:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-12T16:58:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T16:58:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T16:58:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-12T16:58:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: opus-1.3.1-10.el9.x86_64 2024-09-12T16:58:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: orc-0.4.31-8.el9.x86_64 2024-09-12T16:58:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-12T16:58:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-12T16:58:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-12T16:58:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-12T16:58:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T16:58:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-12T16:58:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-12T16:58:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-12T16:58:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-12T16:58:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-12T16:58:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-12T16:58:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-12T16:58:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-12T16:58:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-12T16:58:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-12T16:58:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-12T16:58:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-12T16:58:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-12T16:58:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-12T16:58:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-12T16:58:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T16:58:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T16:58:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-12T16:58:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-12T16:58:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T16:58:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T16:58:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T16:58:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T16:58:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T16:58:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T16:58:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T16:58:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T16:58:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T16:58:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T16:58:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T16:58:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T16:58:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T16:58:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T16:58:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T16:58:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T16:58:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T16:58:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T16:58:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T16:58:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T16:58:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T16:58:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T16:58:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T16:58:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T16:58:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T16:58:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T16:58:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T16:58:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T16:58:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T16:58:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T16:58:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T16:58:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T16:58:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T16:58:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T16:58:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T16:58:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T16:58:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T16:58:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T16:58:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T16:58:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T16:58:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T16:58:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T16:58:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T16:58:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T16:58:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T16:58:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T16:58:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T16:58:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T16:58:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T16:58:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T16:58:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T16:58:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T16:58:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T16:58:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T16:58:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T16:58:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T16:58:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T16:58:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T16:58:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T16:58:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T16:58:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: rtkit-0.11-29.el9.x86_64 2024-09-12T16:58:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-12T16:58:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-12T16:58:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-12T16:58:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T16:58:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-12T16:58:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T16:58:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-12T16:58:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-12T16:58:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-12T16:58:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-12T16:58:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-12T16:58:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: upower-0.99.11-11.el9.x86_64 2024-09-12T16:58:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-12T16:58:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-12T16:58:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-12T16:58:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-12T16:58:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-12T16:58:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-12T16:58:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-12T16:58:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T16:58:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-12T16:58:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:58:57.491 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-12T16:58:57.951 DEBUG:teuthology.parallel:result is None 2024-09-12T16:58:57.952 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T16:58:58.102 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T16:58:58.175 INFO:teuthology.orchestra.run.smithi067.stdout:19.3.0-4762.gbad475c1.el9 2024-09-12T16:58:58.176 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762.gbad475c1.el9 2024-09-12T16:58:58.176 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762.gbad475c1 is installed. 2024-09-12T16:58:58.178 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T16:58:58.323 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T16:58:58.415 INFO:teuthology.orchestra.run.smithi118.stdout:19.3.0-4762.gbad475c1.el9 2024-09-12T16:58:58.416 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762.gbad475c1.el9 2024-09-12T16:58:58.416 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762.gbad475c1 is installed. 2024-09-12T16:58:58.417 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T16:58:58.418 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T16:58:58.418 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T16:58:58.469 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-12T16:58:58.469 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T16:58:58.509 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T16:58:58.510 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T16:58:58.510 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T16:58:58.553 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T16:58:58.636 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-12T16:58:58.637 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T16:58:58.677 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T16:58:58.754 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T16:58:58.755 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T16:58:58.755 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T16:58:58.797 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T16:58:58.878 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-12T16:58:58.878 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T16:58:58.917 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T16:58:58.995 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T16:58:58.995 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T16:58:58.995 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T16:58:59.036 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T16:58:59.116 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-12T16:58:59.117 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T16:58:59.156 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T16:58:59.234 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T16:58:59.320 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T16:58:59.320 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 777 /var/log/ceph 2024-09-12T16:58:59.322 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 777 /var/log/ceph 2024-09-12T16:58:59.362 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T16:58:59.362 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T16:58:59.405 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T16:58:59.443 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T16:58:59.443 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T16:58:59.485 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T16:58:59.564 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T16:58:59.564 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T16:58:59.565 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902701', 'branch': 'wip-rgw-meta-handlers', 'description': 'rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7902701', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rgw-meta-handlers'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'datacache': True, 'datacache_path': '/tmp/rgw_datacache', 'ec-data-pool': False, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rgw-meta-handlers', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 6279, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-rgw-meta-handlers', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'targets': {'smithi067.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPIY3vW9sml6xptAv9FZNYzf42uLElOlnkcZEIhtjP+RqcLasGEGYVBcTd+0gDKF7mIP8QauJ3vFqUPLfrfzy4g=', 'smithi118.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPrLrc+MiZoLcgItTtqSnEilxEYNgyUO+Me23djz2bV/qr/1kjm+mAjxdr/WScVk2tBbLtz6doIobFh7mRWyAtU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-datacache.sh']}, 'env': {'RGW_DATACACHE_PATH': '/tmp/rgw_datacache'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-12_15:39:52', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T16:58:59.565 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T16:58:59.567 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T16:58:59.597 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T16:58:59.639 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T16:58:59.677 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T16:58:59.677 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T16:58:59.747 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T16:58:59.747 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_1 2024-09-12T16:58:59.818 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T16:58:59.818 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:58:59.818 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-12T16:58:59.818 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:58:59.818 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T16:58:59.818 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-09-12 16:58:26.371346846 +0000 2024-09-12T16:58:59.818 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-09-12 16:55:56.053846181 +0000 2024-09-12T16:58:59.818 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-09-12 16:55:56.053846181 +0000 2024-09-12T16:58:59.819 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-09-12 16:55:56.053846181 +0000 2024-09-12T16:58:59.819 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T16:58:59.897 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-12T16:58:59.897 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-12T16:58:59.897 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000206108 s, 2.5 MB/s 2024-09-12T16:58:59.899 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T16:58:59.969 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_2 2024-09-12T16:59:00.039 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T16:59:00.039 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:59:00.039 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-12T16:59:00.039 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:59:00.039 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T16:59:00.039 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-09-12 16:58:26.371346846 +0000 2024-09-12T16:59:00.039 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-09-12 16:55:56.396838547 +0000 2024-09-12T16:59:00.039 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-09-12 16:55:56.396838547 +0000 2024-09-12T16:59:00.039 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-09-12 16:55:56.396838547 +0000 2024-09-12T16:59:00.039 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T16:59:00.118 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-12T16:59:00.118 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-12T16:59:00.118 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000189922 s, 2.7 MB/s 2024-09-12T16:59:00.119 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T16:59:00.190 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_3 2024-09-12T16:59:00.261 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T16:59:00.261 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:59:00.261 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T16:59:00.261 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:59:00.261 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T16:59:00.261 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-09-12 16:58:26.372346823 +0000 2024-09-12T16:59:00.261 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-09-12 16:55:56.731831093 +0000 2024-09-12T16:59:00.262 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-09-12 16:55:56.731831093 +0000 2024-09-12T16:59:00.262 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-09-12 16:55:56.731831093 +0000 2024-09-12T16:59:00.262 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T16:59:00.339 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-12T16:59:00.339 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-12T16:59:00.339 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000173524 s, 3.0 MB/s 2024-09-12T16:59:00.340 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T16:59:00.411 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_4 2024-09-12T16:59:00.482 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T16:59:00.482 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:59:00.482 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-12T16:59:00.482 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:59:00.482 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T16:59:00.482 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-09-12 16:58:26.372346823 +0000 2024-09-12T16:59:00.482 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-09-12 16:55:57.080823327 +0000 2024-09-12T16:59:00.483 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-09-12 16:55:57.080823327 +0000 2024-09-12T16:59:00.483 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-09-12 16:55:57.080823327 +0000 2024-09-12T16:59:00.483 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T16:59:00.561 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-12T16:59:00.561 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-12T16:59:00.561 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000192255 s, 2.7 MB/s 2024-09-12T16:59:00.562 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T16:59:00.632 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T16:59:00.633 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-12T16:59:00.633 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T16:59:00.666 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T16:59:00.667 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_1 2024-09-12T16:59:00.739 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T16:59:00.739 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:59:00.739 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-12T16:59:00.739 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:59:00.739 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T16:59:00.739 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-09-12 16:58:43.043571595 +0000 2024-09-12T16:59:00.739 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-09-12 16:55:53.607609845 +0000 2024-09-12T16:59:00.740 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-09-12 16:55:53.607609845 +0000 2024-09-12T16:59:00.740 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-09-12 16:55:53.607609845 +0000 2024-09-12T16:59:00.740 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T16:59:00.819 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-09-12T16:59:00.819 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-09-12T16:59:00.819 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000110142 s, 4.6 MB/s 2024-09-12T16:59:00.820 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T16:59:00.891 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_2 2024-09-12T16:59:00.961 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T16:59:00.961 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:59:00.962 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-12T16:59:00.962 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:59:00.962 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T16:59:00.962 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-09-12 16:58:43.043571595 +0000 2024-09-12T16:59:00.962 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-09-12 16:55:53.928603100 +0000 2024-09-12T16:59:00.962 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-09-12 16:55:53.928603100 +0000 2024-09-12T16:59:00.962 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-09-12 16:55:53.928603100 +0000 2024-09-12T16:59:00.962 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T16:59:01.038 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-09-12T16:59:01.038 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-09-12T16:59:01.038 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 8.3601e-05 s, 6.1 MB/s 2024-09-12T16:59:01.039 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T16:59:01.108 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_3 2024-09-12T16:59:01.176 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T16:59:01.177 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:59:01.177 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-12T16:59:01.177 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:59:01.177 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T16:59:01.177 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-09-12 16:58:43.044571573 +0000 2024-09-12T16:59:01.177 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-09-12 16:55:54.260596124 +0000 2024-09-12T16:59:01.177 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-09-12 16:55:54.260596124 +0000 2024-09-12T16:59:01.177 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-09-12 16:55:54.260596124 +0000 2024-09-12T16:59:01.177 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T16:59:01.252 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-09-12T16:59:01.253 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-09-12T16:59:01.253 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 9.9763e-05 s, 5.1 MB/s 2024-09-12T16:59:01.254 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T16:59:01.324 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_4 2024-09-12T16:59:01.394 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T16:59:01.394 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:59:01.394 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-12T16:59:01.394 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:59:01.394 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T16:59:01.394 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-09-12 16:58:43.044571573 +0000 2024-09-12T16:59:01.394 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-09-12 16:55:54.595589085 +0000 2024-09-12T16:59:01.394 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-09-12 16:55:54.595589085 +0000 2024-09-12T16:59:01.394 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-09-12 16:55:54.595589085 +0000 2024-09-12T16:59:01.394 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T16:59:01.470 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-09-12T16:59:01.471 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-09-12T16:59:01.471 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000104133 s, 4.9 MB/s 2024-09-12T16:59:01.472 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T16:59:01.541 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T16:59:01.542 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T16:59:01.542 INFO:tasks.ceph:Generating config... 2024-09-12T16:59:01.543 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T16:59:01.543 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-12T16:59:01.543 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-12T16:59:01.543 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-12T16:59:01.543 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-12T16:59:01.543 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T16:59:01.543 INFO:tasks.ceph:[client] rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T16:59:01.543 INFO:tasks.ceph:[client] rgw d3n l1 datacache size = 10737418240 2024-09-12T16:59:01.543 INFO:tasks.ceph:[client] rgw d3n l1 local datacache enabled = True 2024-09-12T16:59:01.543 INFO:tasks.ceph:[client] rgw enable ops log = True 2024-09-12T16:59:01.543 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-12T16:59:01.544 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-12T16:59:01.544 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-12T16:59:01.544 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-12T16:59:01.544 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-12T16:59:01.544 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T16:59:01.544 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T16:59:01.544 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T16:59:01.544 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T16:59:01.544 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-09-12T16:59:01.544 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-12T16:59:01.544 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-12T16:59:01.544 INFO:tasks.ceph:[global] rgw override bucket index max shards = 1 2024-09-12T16:59:01.544 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T16:59:01.544 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T16:59:01.545 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T16:59:01.545 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T16:59:01.545 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T16:59:01.545 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-09-12T16:59:01.545 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T16:59:01.545 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T16:59:01.545 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T16:59:01.545 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T16:59:01.545 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T16:59:01.545 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T16:59:01.545 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T16:59:01.545 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T16:59:01.545 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T16:59:01.545 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T16:59:01.545 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T16:59:01.546 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T16:59:01.546 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T16:59:01.546 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T16:59:01.546 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T16:59:01.546 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-09-12T16:59:01.546 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T16:59:01.546 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T16:59:01.546 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T16:59:01.546 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T16:59:01.621 INFO:teuthology.orchestra.run.smithi067.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T16:59:01.624 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T16:59:01.686 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T16:59:01.726 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.67'), ('mon.c', '[v2:172.21.15.67:3301,v1:172.21.15.67:6790]'), ('mon.b', '172.21.15.118')] 2024-09-12T16:59:01.726 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.67,[v2:172.21.15.67:3301,v1:172.21.15.67:6790],172.21.15.118', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': True, 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T16:59:01.727 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T16:59:01.728 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T16:59:01.797 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.67 --addv c '[v2:172.21.15.67:3301,v1:172.21.15.67:6790]' --add b 172.21.15.118 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:59:01.898 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:59:01.898 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:59:01.900 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:59:01.900 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool: generated fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T16:59:01.900 INFO:teuthology.orchestra.run.smithi067.stdout:setting min_mon_release = quincy 2024-09-12T16:59:01.900 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 0 2024-09-12T16:59:01.900 INFO:teuthology.orchestra.run.smithi067.stdout:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T16:59:01.900 INFO:teuthology.orchestra.run.smithi067.stdout:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T16:59:01.901 INFO:teuthology.orchestra.run.smithi067.stdout:created 2024-09-12T16:59:01.898039+0000 2024-09-12T16:59:01.901 INFO:teuthology.orchestra.run.smithi067.stdout:min_mon_release 17 (quincy) 2024-09-12T16:59:01.901 INFO:teuthology.orchestra.run.smithi067.stdout:election_strategy: 1 2024-09-12T16:59:01.901 INFO:teuthology.orchestra.run.smithi067.stdout:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T16:59:01.901 INFO:teuthology.orchestra.run.smithi067.stdout:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T16:59:01.901 INFO:teuthology.orchestra.run.smithi067.stdout:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T16:59:01.901 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T16:59:01.902 DEBUG:teuthology.orchestra.run.smithi067:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T16:59:01.930 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f8d042e3-46c6-4732-b8bf-7d74a00649d2... 2024-09-12T16:59:01.931 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T16:59:01.973 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T16:59:02.030 INFO:teuthology.orchestra.run.smithi067.stdout:[global] 2024-09-12T16:59:02.031 INFO:teuthology.orchestra.run.smithi067.stdout: chdir = "" 2024-09-12T16:59:02.031 INFO:teuthology.orchestra.run.smithi067.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T16:59:02.031 INFO:teuthology.orchestra.run.smithi067.stdout: auth supported = cephx 2024-09-12T16:59:02.031 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.031 INFO:teuthology.orchestra.run.smithi067.stdout: filestore xattr use omap = true 2024-09-12T16:59:02.031 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.031 INFO:teuthology.orchestra.run.smithi067.stdout: mon clock drift allowed = 1.000 2024-09-12T16:59:02.031 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.031 INFO:teuthology.orchestra.run.smithi067.stdout: osd crush chooseleaf type = 0 2024-09-12T16:59:02.031 INFO:teuthology.orchestra.run.smithi067.stdout: auth debug = true 2024-09-12T16:59:02.031 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.032 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on old message = true 2024-09-12T16:59:02.032 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on bug = true 2024-09-12T16:59:02.032 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.032 INFO:teuthology.orchestra.run.smithi067.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T16:59:02.032 INFO:teuthology.orchestra.run.smithi067.stdout: mon pg warn max object skew = 0 2024-09-12T16:59:02.032 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.032 INFO:teuthology.orchestra.run.smithi067.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T16:59:02.032 INFO:teuthology.orchestra.run.smithi067.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T16:59:02.032 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.032 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default size = 2 2024-09-12T16:59:02.032 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.032 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow primary affinity = true 2024-09-12T16:59:02.032 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow pg remap = true 2024-09-12T16:59:02.033 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on legacy crush tunables = false 2024-09-12T16:59:02.033 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on crush straw calc version zero = false 2024-09-12T16:59:02.033 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on no sortbitwise = false 2024-09-12T16:59:02.033 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on osd down out interval zero = false 2024-09-12T16:59:02.033 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on too few osds = false 2024-09-12T16:59:02.033 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T16:59:02.033 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T16:59:02.033 INFO:teuthology.orchestra.run.smithi067.stdout: mon_allow_pool_size_one = true 2024-09-12T16:59:02.033 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.033 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T16:59:02.033 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.033 INFO:teuthology.orchestra.run.smithi067.stdout: osd default data pool replay window = 5 2024-09-12T16:59:02.034 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.034 INFO:teuthology.orchestra.run.smithi067.stdout: mon allow pool delete = true 2024-09-12T16:59:02.034 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.034 INFO:teuthology.orchestra.run.smithi067.stdout: mon cluster log file level = debug 2024-09-12T16:59:02.034 INFO:teuthology.orchestra.run.smithi067.stdout: debug asserts on shutdown = true 2024-09-12T16:59:02.034 INFO:teuthology.orchestra.run.smithi067.stdout: mon health detail to clog = false 2024-09-12T16:59:02.034 INFO:teuthology.orchestra.run.smithi067.stdout: mon host = "172.21.15.67,[v2:172.21.15.67:3301,v1:172.21.15.67:6790],172.21.15.118" 2024-09-12T16:59:02.034 INFO:teuthology.orchestra.run.smithi067.stdout: mon client directed command retry = 5 2024-09-12T16:59:02.034 INFO:teuthology.orchestra.run.smithi067.stdout: ms inject socket failures = 5000 2024-09-12T16:59:02.034 INFO:teuthology.orchestra.run.smithi067.stdout: osd heartbeat grace = 40 2024-09-12T16:59:02.034 INFO:teuthology.orchestra.run.smithi067.stdout: osd_max_pg_log_entries = 10 2024-09-12T16:59:02.035 INFO:teuthology.orchestra.run.smithi067.stdout: osd_min_pg_log_entries = 10 2024-09-12T16:59:02.035 INFO:teuthology.orchestra.run.smithi067.stdout: rgw override bucket index max shards = 1 2024-09-12T16:59:02.035 INFO:teuthology.orchestra.run.smithi067.stdout: fsid = f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T16:59:02.035 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.035 INFO:teuthology.orchestra.run.smithi067.stdout:[osd] 2024-09-12T16:59:02.035 INFO:teuthology.orchestra.run.smithi067.stdout: osd journal size = 100 2024-09-12T16:59:02.035 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.035 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub load threshold = 5.0 2024-09-12T16:59:02.035 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub max interval = 600 2024-09-12T16:59:02.035 INFO:teuthology.orchestra.run.smithi067.stdout: osd mclock profile = high_recovery_ops 2024-09-12T16:59:02.035 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.035 INFO:teuthology.orchestra.run.smithi067.stdout: osd recover clone overlap = true 2024-09-12T16:59:02.035 INFO:teuthology.orchestra.run.smithi067.stdout: osd recovery max chunk = 1048576 2024-09-12T16:59:02.036 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.036 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug shutdown = true 2024-09-12T16:59:02.036 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug op order = true 2024-09-12T16:59:02.036 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug verify stray on activate = true 2024-09-12T16:59:02.036 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug trim objects = true 2024-09-12T16:59:02.036 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.036 INFO:teuthology.orchestra.run.smithi067.stdout: osd open classes on start = true 2024-09-12T16:59:02.036 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug pg log writeout = true 2024-09-12T16:59:02.036 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.036 INFO:teuthology.orchestra.run.smithi067.stdout: osd deep scrub update digest min age = 30 2024-09-12T16:59:02.036 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.036 INFO:teuthology.orchestra.run.smithi067.stdout: osd map max advance = 10 2024-09-12T16:59:02.036 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.037 INFO:teuthology.orchestra.run.smithi067.stdout: journal zero on create = true 2024-09-12T16:59:02.037 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.037 INFO:teuthology.orchestra.run.smithi067.stdout: filestore ondisk finisher threads = 3 2024-09-12T16:59:02.037 INFO:teuthology.orchestra.run.smithi067.stdout: filestore apply finisher threads = 3 2024-09-12T16:59:02.037 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.037 INFO:teuthology.orchestra.run.smithi067.stdout: bdev debug aio = true 2024-09-12T16:59:02.037 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug misdirected ops = true 2024-09-12T16:59:02.037 INFO:teuthology.orchestra.run.smithi067.stdout: bdev async discard = True 2024-09-12T16:59:02.037 INFO:teuthology.orchestra.run.smithi067.stdout: bdev enable discard = True 2024-09-12T16:59:02.037 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore allocator = bitmap 2024-09-12T16:59:02.037 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore block size = 96636764160 2024-09-12T16:59:02.037 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore fsck on mount = True 2024-09-12T16:59:02.038 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluefs = 1/20 2024-09-12T16:59:02.038 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluestore = 1/20 2024-09-12T16:59:02.038 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-09-12T16:59:02.038 INFO:teuthology.orchestra.run.smithi067.stdout: debug objclass = 20 2024-09-12T16:59:02.038 INFO:teuthology.orchestra.run.smithi067.stdout: debug osd = 20 2024-09-12T16:59:02.038 INFO:teuthology.orchestra.run.smithi067.stdout: debug rocksdb = 4/10 2024-09-12T16:59:02.038 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T16:59:02.038 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd full ratio = 0.9 2024-09-12T16:59:02.038 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd nearfull ratio = 0.8 2024-09-12T16:59:02.038 INFO:teuthology.orchestra.run.smithi067.stdout: osd failsafe full ratio = 0.95 2024-09-12T16:59:02.038 INFO:teuthology.orchestra.run.smithi067.stdout: osd fast shutdown = False 2024-09-12T16:59:02.038 INFO:teuthology.orchestra.run.smithi067.stdout: osd objectstore = bluestore 2024-09-12T16:59:02.038 INFO:teuthology.orchestra.run.smithi067.stdout: osd shutdown pgref assert = True 2024-09-12T16:59:02.039 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.039 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr] 2024-09-12T16:59:02.039 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-09-12T16:59:02.039 INFO:teuthology.orchestra.run.smithi067.stdout: debug mgr = 20 2024-09-12T16:59:02.039 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2024-09-12T16:59:02.039 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2024-09-12T16:59:02.039 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2024-09-12T16:59:02.039 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2024-09-12T16:59:02.039 INFO:teuthology.orchestra.run.smithi067.stdout: mgr/telemetry/nag = false 2024-09-12T16:59:02.039 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.039 INFO:teuthology.orchestra.run.smithi067.stdout:[mon] 2024-09-12T16:59:02.039 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-09-12T16:59:02.040 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2024-09-12T16:59:02.040 INFO:teuthology.orchestra.run.smithi067.stdout: debug paxos = 20 2024-09-12T16:59:02.040 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2024-09-12T16:59:02.040 INFO:teuthology.orchestra.run.smithi067.stdout: mon data avail warn = 5 2024-09-12T16:59:02.040 INFO:teuthology.orchestra.run.smithi067.stdout: mon mgr mkfs grace = 240 2024-09-12T16:59:02.040 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2024-09-12T16:59:02.040 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd reporter subtree level = osd 2024-09-12T16:59:02.040 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd prime pg temp = true 2024-09-12T16:59:02.040 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2024-09-12T16:59:02.040 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.041 INFO:teuthology.orchestra.run.smithi067.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T16:59:02.041 INFO:teuthology.orchestra.run.smithi067.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T16:59:02.041 INFO:teuthology.orchestra.run.smithi067.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T16:59:02.041 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.041 INFO:teuthology.orchestra.run.smithi067.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T16:59:02.041 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T16:59:02.041 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T16:59:02.041 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.041 INFO:teuthology.orchestra.run.smithi067.stdout: # 1m isn't quite enough 2024-09-12T16:59:02.041 INFO:teuthology.orchestra.run.smithi067.stdout: mon_down_mkfs_grace = 2m 2024-09-12T16:59:02.041 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.041 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_filestore_osds = false 2024-09-12T16:59:02.042 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd crush smoke test = False 2024-09-12T16:59:02.042 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:02.042 INFO:teuthology.orchestra.run.smithi067.stdout:[client] 2024-09-12T16:59:02.042 INFO:teuthology.orchestra.run.smithi067.stdout: rgw cache enabled = true 2024-09-12T16:59:02.042 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable ops log = True 2024-09-12T16:59:02.042 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable usage log = true 2024-09-12T16:59:02.042 INFO:teuthology.orchestra.run.smithi067.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T16:59:02.042 INFO:teuthology.orchestra.run.smithi067.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T16:59:02.042 INFO:teuthology.orchestra.run.smithi067.stdout: debug rgw = 20 2024-09-12T16:59:02.042 INFO:teuthology.orchestra.run.smithi067.stdout: debug rgw notification = 20 2024-09-12T16:59:02.042 INFO:teuthology.orchestra.run.smithi067.stdout: rgw bucket counters cache = True 2024-09-12T16:59:02.042 INFO:teuthology.orchestra.run.smithi067.stdout: rgw crypt require ssl = False 2024-09-12T16:59:02.042 INFO:teuthology.orchestra.run.smithi067.stdout: rgw crypt s3 kms backend = testing 2024-09-12T16:59:02.042 INFO:teuthology.orchestra.run.smithi067.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T16:59:02.043 INFO:teuthology.orchestra.run.smithi067.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T16:59:02.043 INFO:teuthology.orchestra.run.smithi067.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-12T16:59:02.043 INFO:teuthology.orchestra.run.smithi067.stdout: rgw d3n l1 local datacache enabled = True 2024-09-12T16:59:02.043 INFO:teuthology.orchestra.run.smithi067.stdout: rgw reshard progress judge interval = 10 2024-09-12T16:59:02.043 INFO:teuthology.orchestra.run.smithi067.stdout: rgw s3 auth use sts = True 2024-09-12T16:59:02.043 INFO:teuthology.orchestra.run.smithi067.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T16:59:02.043 INFO:teuthology.orchestra.run.smithi067.stdout: rgw torrent flag = True 2024-09-12T16:59:02.043 INFO:teuthology.orchestra.run.smithi067.stdout: rgw user counters cache = True 2024-09-12T16:59:02.043 INFO:teuthology.orchestra.run.smithi067.stdout: setgroup = ceph 2024-09-12T16:59:02.043 INFO:teuthology.orchestra.run.smithi067.stdout: setuser = ceph 2024-09-12T16:59:02.043 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.a] 2024-09-12T16:59:02.043 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.c] 2024-09-12T16:59:02.043 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.b] 2024-09-12T16:59:02.045 INFO:teuthology.orchestra.run.smithi118.stdout:[global] 2024-09-12T16:59:02.045 INFO:teuthology.orchestra.run.smithi118.stdout: chdir = "" 2024-09-12T16:59:02.045 INFO:teuthology.orchestra.run.smithi118.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T16:59:02.045 INFO:teuthology.orchestra.run.smithi118.stdout: auth supported = cephx 2024-09-12T16:59:02.046 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.046 INFO:teuthology.orchestra.run.smithi118.stdout: filestore xattr use omap = true 2024-09-12T16:59:02.046 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.046 INFO:teuthology.orchestra.run.smithi118.stdout: mon clock drift allowed = 1.000 2024-09-12T16:59:02.046 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.046 INFO:teuthology.orchestra.run.smithi118.stdout: osd crush chooseleaf type = 0 2024-09-12T16:59:02.046 INFO:teuthology.orchestra.run.smithi118.stdout: auth debug = true 2024-09-12T16:59:02.046 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.046 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on old message = true 2024-09-12T16:59:02.046 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on bug = true 2024-09-12T16:59:02.046 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.046 INFO:teuthology.orchestra.run.smithi118.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T16:59:02.046 INFO:teuthology.orchestra.run.smithi118.stdout: mon pg warn max object skew = 0 2024-09-12T16:59:02.047 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.047 INFO:teuthology.orchestra.run.smithi118.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T16:59:02.047 INFO:teuthology.orchestra.run.smithi118.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T16:59:02.047 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.047 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default size = 2 2024-09-12T16:59:02.047 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.047 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow primary affinity = true 2024-09-12T16:59:02.047 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow pg remap = true 2024-09-12T16:59:02.047 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on legacy crush tunables = false 2024-09-12T16:59:02.047 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on crush straw calc version zero = false 2024-09-12T16:59:02.047 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on no sortbitwise = false 2024-09-12T16:59:02.047 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on osd down out interval zero = false 2024-09-12T16:59:02.047 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on too few osds = false 2024-09-12T16:59:02.047 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T16:59:02.048 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T16:59:02.048 INFO:teuthology.orchestra.run.smithi118.stdout: mon_allow_pool_size_one = true 2024-09-12T16:59:02.048 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.048 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T16:59:02.048 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.048 INFO:teuthology.orchestra.run.smithi118.stdout: osd default data pool replay window = 5 2024-09-12T16:59:02.048 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.048 INFO:teuthology.orchestra.run.smithi118.stdout: mon allow pool delete = true 2024-09-12T16:59:02.048 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.048 INFO:teuthology.orchestra.run.smithi118.stdout: mon cluster log file level = debug 2024-09-12T16:59:02.048 INFO:teuthology.orchestra.run.smithi118.stdout: debug asserts on shutdown = true 2024-09-12T16:59:02.048 INFO:teuthology.orchestra.run.smithi118.stdout: mon health detail to clog = false 2024-09-12T16:59:02.048 INFO:teuthology.orchestra.run.smithi118.stdout: mon host = "172.21.15.67,[v2:172.21.15.67:3301,v1:172.21.15.67:6790],172.21.15.118" 2024-09-12T16:59:02.049 INFO:teuthology.orchestra.run.smithi118.stdout: mon client directed command retry = 5 2024-09-12T16:59:02.049 INFO:teuthology.orchestra.run.smithi118.stdout: ms inject socket failures = 5000 2024-09-12T16:59:02.049 INFO:teuthology.orchestra.run.smithi118.stdout: osd heartbeat grace = 40 2024-09-12T16:59:02.049 INFO:teuthology.orchestra.run.smithi118.stdout: osd_max_pg_log_entries = 10 2024-09-12T16:59:02.049 INFO:teuthology.orchestra.run.smithi118.stdout: osd_min_pg_log_entries = 10 2024-09-12T16:59:02.049 INFO:teuthology.orchestra.run.smithi118.stdout: rgw override bucket index max shards = 1 2024-09-12T16:59:02.049 INFO:teuthology.orchestra.run.smithi118.stdout: fsid = f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T16:59:02.049 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.049 INFO:teuthology.orchestra.run.smithi118.stdout:[osd] 2024-09-12T16:59:02.049 INFO:teuthology.orchestra.run.smithi118.stdout: osd journal size = 100 2024-09-12T16:59:02.049 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.049 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub load threshold = 5.0 2024-09-12T16:59:02.049 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub max interval = 600 2024-09-12T16:59:02.049 INFO:teuthology.orchestra.run.smithi118.stdout: osd mclock profile = high_recovery_ops 2024-09-12T16:59:02.050 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.050 INFO:teuthology.orchestra.run.smithi118.stdout: osd recover clone overlap = true 2024-09-12T16:59:02.050 INFO:teuthology.orchestra.run.smithi118.stdout: osd recovery max chunk = 1048576 2024-09-12T16:59:02.050 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.050 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug shutdown = true 2024-09-12T16:59:02.050 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug op order = true 2024-09-12T16:59:02.050 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug verify stray on activate = true 2024-09-12T16:59:02.050 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug trim objects = true 2024-09-12T16:59:02.050 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.050 INFO:teuthology.orchestra.run.smithi118.stdout: osd open classes on start = true 2024-09-12T16:59:02.050 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug pg log writeout = true 2024-09-12T16:59:02.050 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.050 INFO:teuthology.orchestra.run.smithi118.stdout: osd deep scrub update digest min age = 30 2024-09-12T16:59:02.051 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.051 INFO:teuthology.orchestra.run.smithi118.stdout: osd map max advance = 10 2024-09-12T16:59:02.051 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.051 INFO:teuthology.orchestra.run.smithi118.stdout: journal zero on create = true 2024-09-12T16:59:02.051 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.051 INFO:teuthology.orchestra.run.smithi118.stdout: filestore ondisk finisher threads = 3 2024-09-12T16:59:02.051 INFO:teuthology.orchestra.run.smithi118.stdout: filestore apply finisher threads = 3 2024-09-12T16:59:02.051 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.051 INFO:teuthology.orchestra.run.smithi118.stdout: bdev debug aio = true 2024-09-12T16:59:02.051 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug misdirected ops = true 2024-09-12T16:59:02.051 INFO:teuthology.orchestra.run.smithi118.stdout: bdev async discard = True 2024-09-12T16:59:02.051 INFO:teuthology.orchestra.run.smithi118.stdout: bdev enable discard = True 2024-09-12T16:59:02.051 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore allocator = bitmap 2024-09-12T16:59:02.051 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore block size = 96636764160 2024-09-12T16:59:02.052 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore fsck on mount = True 2024-09-12T16:59:02.052 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluefs = 1/20 2024-09-12T16:59:02.052 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluestore = 1/20 2024-09-12T16:59:02.052 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-09-12T16:59:02.052 INFO:teuthology.orchestra.run.smithi118.stdout: debug objclass = 20 2024-09-12T16:59:02.052 INFO:teuthology.orchestra.run.smithi118.stdout: debug osd = 20 2024-09-12T16:59:02.052 INFO:teuthology.orchestra.run.smithi118.stdout: debug rocksdb = 4/10 2024-09-12T16:59:02.052 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T16:59:02.052 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd full ratio = 0.9 2024-09-12T16:59:02.052 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd nearfull ratio = 0.8 2024-09-12T16:59:02.052 INFO:teuthology.orchestra.run.smithi118.stdout: osd failsafe full ratio = 0.95 2024-09-12T16:59:02.052 INFO:teuthology.orchestra.run.smithi118.stdout: osd fast shutdown = False 2024-09-12T16:59:02.052 INFO:teuthology.orchestra.run.smithi118.stdout: osd objectstore = bluestore 2024-09-12T16:59:02.053 INFO:teuthology.orchestra.run.smithi118.stdout: osd shutdown pgref assert = True 2024-09-12T16:59:02.053 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.053 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr] 2024-09-12T16:59:02.053 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-09-12T16:59:02.053 INFO:teuthology.orchestra.run.smithi118.stdout: debug mgr = 20 2024-09-12T16:59:02.053 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2024-09-12T16:59:02.053 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2024-09-12T16:59:02.053 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2024-09-12T16:59:02.053 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2024-09-12T16:59:02.053 INFO:teuthology.orchestra.run.smithi118.stdout: mgr/telemetry/nag = false 2024-09-12T16:59:02.053 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.053 INFO:teuthology.orchestra.run.smithi118.stdout:[mon] 2024-09-12T16:59:02.053 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-09-12T16:59:02.053 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2024-09-12T16:59:02.054 INFO:teuthology.orchestra.run.smithi118.stdout: debug paxos = 20 2024-09-12T16:59:02.054 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2024-09-12T16:59:02.054 INFO:teuthology.orchestra.run.smithi118.stdout: mon data avail warn = 5 2024-09-12T16:59:02.054 INFO:teuthology.orchestra.run.smithi118.stdout: mon mgr mkfs grace = 240 2024-09-12T16:59:02.054 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2024-09-12T16:59:02.054 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd reporter subtree level = osd 2024-09-12T16:59:02.054 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd prime pg temp = true 2024-09-12T16:59:02.054 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2024-09-12T16:59:02.054 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.054 INFO:teuthology.orchestra.run.smithi118.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T16:59:02.054 INFO:teuthology.orchestra.run.smithi118.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T16:59:02.055 INFO:teuthology.orchestra.run.smithi118.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T16:59:02.055 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.055 INFO:teuthology.orchestra.run.smithi118.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T16:59:02.055 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T16:59:02.055 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T16:59:02.055 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.055 INFO:teuthology.orchestra.run.smithi118.stdout: # 1m isn't quite enough 2024-09-12T16:59:02.055 INFO:teuthology.orchestra.run.smithi118.stdout: mon_down_mkfs_grace = 2m 2024-09-12T16:59:02.055 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.055 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_filestore_osds = false 2024-09-12T16:59:02.055 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd crush smoke test = False 2024-09-12T16:59:02.055 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-12T16:59:02.056 INFO:teuthology.orchestra.run.smithi118.stdout:[client] 2024-09-12T16:59:02.056 INFO:teuthology.orchestra.run.smithi118.stdout: rgw cache enabled = true 2024-09-12T16:59:02.056 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable ops log = True 2024-09-12T16:59:02.056 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable usage log = true 2024-09-12T16:59:02.056 INFO:teuthology.orchestra.run.smithi118.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T16:59:02.056 INFO:teuthology.orchestra.run.smithi118.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T16:59:02.056 INFO:teuthology.orchestra.run.smithi118.stdout: debug rgw = 20 2024-09-12T16:59:02.056 INFO:teuthology.orchestra.run.smithi118.stdout: debug rgw notification = 20 2024-09-12T16:59:02.056 INFO:teuthology.orchestra.run.smithi118.stdout: rgw bucket counters cache = True 2024-09-12T16:59:02.057 INFO:teuthology.orchestra.run.smithi118.stdout: rgw crypt require ssl = False 2024-09-12T16:59:02.057 INFO:teuthology.orchestra.run.smithi118.stdout: rgw crypt s3 kms backend = testing 2024-09-12T16:59:02.057 INFO:teuthology.orchestra.run.smithi118.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T16:59:02.057 INFO:teuthology.orchestra.run.smithi118.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T16:59:02.057 INFO:teuthology.orchestra.run.smithi118.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-12T16:59:02.057 INFO:teuthology.orchestra.run.smithi118.stdout: rgw d3n l1 local datacache enabled = True 2024-09-12T16:59:02.057 INFO:teuthology.orchestra.run.smithi118.stdout: rgw reshard progress judge interval = 10 2024-09-12T16:59:02.057 INFO:teuthology.orchestra.run.smithi118.stdout: rgw s3 auth use sts = True 2024-09-12T16:59:02.058 INFO:teuthology.orchestra.run.smithi118.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T16:59:02.058 INFO:teuthology.orchestra.run.smithi118.stdout: rgw torrent flag = True 2024-09-12T16:59:02.058 INFO:teuthology.orchestra.run.smithi118.stdout: rgw user counters cache = True 2024-09-12T16:59:02.058 INFO:teuthology.orchestra.run.smithi118.stdout: setgroup = ceph 2024-09-12T16:59:02.058 INFO:teuthology.orchestra.run.smithi118.stdout: setuser = ceph 2024-09-12T16:59:02.058 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.a] 2024-09-12T16:59:02.058 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.c] 2024-09-12T16:59:02.058 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.b] 2024-09-12T16:59:02.059 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T16:59:02.059 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T16:59:02.129 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T16:59:02.129 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T16:59:02.130 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T16:59:02.160 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T16:59:02.160 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T16:59:02.230 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi067.front.sepia.ceph.com 2024-09-12T16:59:02.230 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T16:59:02.231 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T16:59:02.231 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T16:59:02.321 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T16:59:02.321 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:59:02.392 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi118.front.sepia.ceph.com 2024-09-12T16:59:02.393 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-12T16:59:02.393 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T16:59:02.393 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T16:59:02.442 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-12T16:59:02.443 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:59:02.527 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T16:59:02.527 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T16:59:02.527 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T16:59:02.595 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T16:59:02.598 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T16:59:02.669 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T16:59:02.672 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T16:59:02.672 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T16:59:02.672 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T16:59:02.730 INFO:teuthology.orchestra.run.smithi067.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T16:59:02.743 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T16:59:02.805 INFO:teuthology.orchestra.run.smithi118.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T16:59:02.818 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T16:59:02.818 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T16:59:02.818 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T16:59:02.858 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T16:59:02.858 INFO:tasks.ceph:role: osd.0 2024-09-12T16:59:02.858 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi067.front.sepia.ceph.com 2024-09-12T16:59:02.858 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T16:59:02.949 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T16:59:02.949 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T16:59:02.949 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T16:59:02.949 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T16:59:02.949 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T16:59:02.949 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-09-12T16:59:02.949 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T16:59:02.950 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T16:59:02.950 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T16:59:02.950 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T16:59:03.464 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-09-12T16:59:03.466 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-09-12T16:59:03.466 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T16:59:03.589 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T16:59:03.638 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T16:59:03.679 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T16:59:03.679 INFO:tasks.ceph:role: osd.1 2024-09-12T16:59:03.680 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi067.front.sepia.ceph.com 2024-09-12T16:59:03.680 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T16:59:03.768 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T16:59:03.768 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T16:59:03.768 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T16:59:03.768 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T16:59:03.768 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T16:59:03.768 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-09-12T16:59:03.768 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T16:59:03.768 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T16:59:03.769 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T16:59:03.769 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T16:59:04.234 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-09-12T16:59:04.236 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-09-12T16:59:04.236 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T16:59:04.311 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T16:59:04.357 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T16:59:04.397 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T16:59:04.397 INFO:tasks.ceph:role: osd.2 2024-09-12T16:59:04.397 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi067.front.sepia.ceph.com 2024-09-12T16:59:04.398 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T16:59:04.484 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T16:59:04.484 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T16:59:04.484 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T16:59:04.484 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T16:59:04.485 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T16:59:04.485 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-09-12T16:59:04.485 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T16:59:04.485 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T16:59:04.485 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T16:59:04.485 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T16:59:04.980 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-09-12T16:59:04.982 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-09-12T16:59:04.982 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T16:59:05.089 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T16:59:05.138 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T16:59:05.179 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T16:59:05.179 INFO:tasks.ceph:role: osd.3 2024-09-12T16:59:05.179 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi067.front.sepia.ceph.com 2024-09-12T16:59:05.179 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T16:59:05.268 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T16:59:05.268 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T16:59:05.268 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T16:59:05.268 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T16:59:05.268 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T16:59:05.269 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-09-12T16:59:05.269 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T16:59:05.269 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T16:59:05.269 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T16:59:05.269 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T16:59:05.744 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-09-12T16:59:05.746 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-09-12T16:59:05.747 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T16:59:05.841 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T16:59:05.888 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:59:05.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T16:59:05.953+0000 7fa7511c5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T16:59:05.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T16:59:05.958+0000 7fa7511c5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T16:59:05.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T16:59:05.958+0000 7fa7511c5640 -1 bdev(0x563fccd23800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T16:59:05.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T16:59:05.958+0000 7fa7511c5640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T16:59:09.376 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T16:59:09.422 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:59:09.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T16:59:09.485+0000 7f8e89e18640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T16:59:09.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T16:59:09.485+0000 7f8e89e18640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T16:59:09.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T16:59:09.485+0000 7f8e89e18640 -1 bdev(0x55ec76fcd800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T16:59:09.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T16:59:09.485+0000 7f8e89e18640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T16:59:12.408 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T16:59:12.454 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:59:12.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T16:59:12.518+0000 7f8d6e40b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T16:59:12.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T16:59:12.518+0000 7f8d6e40b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T16:59:12.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T16:59:12.518+0000 7f8d6e40b640 -1 bdev(0x55d725121800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T16:59:12.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T16:59:12.518+0000 7f8d6e40b640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T16:59:15.441 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T16:59:15.488 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:59:15.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T16:59:15.551+0000 7fd1a0a0b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T16:59:15.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T16:59:15.552+0000 7fd1a0a0b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T16:59:15.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T16:59:15.552+0000 7fd1a0a0b640 -1 bdev(0x55d313e27800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T16:59:15.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T16:59:15.552+0000 7fd1a0a0b640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T16:59:18.461 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T16:59:18.508 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T16:59:18.555 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T16:59:18.555 INFO:tasks.ceph:role: osd.4 2024-09-12T16:59:18.555 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com 2024-09-12T16:59:18.555 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T16:59:18.601 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T16:59:18.601 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T16:59:18.601 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T16:59:18.601 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T16:59:18.601 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T16:59:18.601 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-09-12T16:59:18.601 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T16:59:18.601 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T16:59:18.602 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T16:59:18.602 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T16:59:18.635 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-09-12T16:59:18.637 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-09-12T16:59:18.637 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T16:59:18.684 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T16:59:18.729 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T16:59:18.810 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T16:59:18.810 INFO:tasks.ceph:role: osd.5 2024-09-12T16:59:18.810 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com 2024-09-12T16:59:18.810 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T16:59:18.890 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T16:59:18.890 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T16:59:18.890 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T16:59:18.890 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T16:59:18.891 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T16:59:18.891 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-09-12T16:59:18.891 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T16:59:18.891 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T16:59:18.891 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T16:59:18.891 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T16:59:18.922 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-09-12T16:59:18.925 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-09-12T16:59:18.925 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T16:59:19.008 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T16:59:19.091 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T16:59:19.169 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T16:59:19.169 INFO:tasks.ceph:role: osd.6 2024-09-12T16:59:19.169 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com 2024-09-12T16:59:19.170 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T16:59:19.247 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T16:59:19.248 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T16:59:19.248 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T16:59:19.248 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T16:59:19.248 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T16:59:19.248 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-09-12T16:59:19.248 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T16:59:19.248 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T16:59:19.248 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T16:59:19.248 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T16:59:19.280 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-09-12T16:59:19.282 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-09-12T16:59:19.282 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T16:59:19.365 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T16:59:19.447 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T16:59:19.526 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T16:59:19.526 INFO:tasks.ceph:role: osd.7 2024-09-12T16:59:19.526 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com 2024-09-12T16:59:19.526 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T16:59:19.606 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T16:59:19.607 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T16:59:19.607 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T16:59:19.607 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T16:59:19.607 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T16:59:19.607 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-09-12T16:59:19.607 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T16:59:19.607 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T16:59:19.607 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T16:59:19.607 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T16:59:19.639 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-09-12T16:59:19.641 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-09-12T16:59:19.641 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T16:59:19.725 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T16:59:19.808 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:59:19.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-12T16:59:19.914+0000 7f7a98c13640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T16:59:19.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-12T16:59:19.914+0000 7f7a98c13640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T16:59:19.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-12T16:59:19.914+0000 7f7a98c13640 -1 bdev(0x564382179800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T16:59:19.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-12T16:59:19.914+0000 7f7a98c13640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T16:59:23.337 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T16:59:23.383 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:59:23.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-12T16:59:23.453+0000 7f0acdb34640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T16:59:23.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-12T16:59:23.453+0000 7f0acdb34640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T16:59:23.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-12T16:59:23.453+0000 7f0acdb34640 -1 bdev(0x55dc708ad800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T16:59:23.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-12T16:59:23.453+0000 7f0acdb34640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T16:59:26.363 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T16:59:26.408 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:59:26.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-12T16:59:26.469+0000 7ff0c6158640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T16:59:26.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-12T16:59:26.470+0000 7ff0c6158640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T16:59:26.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-12T16:59:26.470+0000 7ff0c6158640 -1 bdev(0x55a514289800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T16:59:26.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-12T16:59:26.470+0000 7ff0c6158640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T16:59:29.400 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T16:59:29.447 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:59:29.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-12T16:59:29.515+0000 7f0fcc756640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T16:59:29.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-12T16:59:29.515+0000 7f0fcc756640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T16:59:29.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-12T16:59:29.515+0000 7f0fcc756640 -1 bdev(0x564322179800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T16:59:29.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-12T16:59:29.516+0000 7f0fcc756640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T16:59:32.696 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T16:59:32.744 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T16:59:32.744 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T16:59:32.744 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T16:59:32.793 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T16:59:32.793 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T16:59:32.878 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T16:59:32.879 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T16:59:32.961 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T16:59:32.961 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T16:59:33.043 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T16:59:33.043 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T16:59:33.124 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-12T16:59:33.124 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T16:59:33.171 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-12T16:59:33.171 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T16:59:33.256 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-12T16:59:33.256 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T16:59:33.339 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-12T16:59:33.339 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T16:59:33.419 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-12T16:59:33.419 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T16:59:33.499 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T16:59:33.499 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T16:59:33.532 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-12T16:59:33.532 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T16:59:33.568 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T16:59:33.569 DEBUG:teuthology.orchestra.run.smithi067:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T16:59:33.575 DEBUG:teuthology.orchestra.run.smithi118:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T16:59:33.613 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.y] 2024-09-12T16:59:33.613 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDWHeNmBQlwIxAA7eT2WTXX8i7dja/Vyu2nbA== 2024-09-12T16:59:33.613 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.0] 2024-09-12T16:59:33.613 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDZHeNmAHDmOBAA+k16k8ovml/1+Iq2xSfLlA== 2024-09-12T16:59:33.613 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.1] 2024-09-12T16:59:33.613 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDdHeNm2j39HBAARaTiMURbl/6F7nXaqQw3Cw== 2024-09-12T16:59:33.613 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.2] 2024-09-12T16:59:33.614 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDgHeNmo2/xHhAAQ792xXTq7k0VB8Iea5BhwA== 2024-09-12T16:59:33.614 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.3] 2024-09-12T16:59:33.614 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDjHeNmXsnyIBAAYgvvAGcgiPaEd+0CxF7yLg== 2024-09-12T16:59:33.614 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.x] 2024-09-12T16:59:33.614 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDWHeNmEF3SJxAAfhXXo6ztWF+9XsiowwX0aw== 2024-09-12T16:59:33.614 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.4] 2024-09-12T16:59:33.614 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDnHeNmkomWNhAAkbg/Vg8Foka8Q3K1Xvemlg== 2024-09-12T16:59:33.614 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.5] 2024-09-12T16:59:33.614 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDrHeNmD5sNGxAAv5AThoIfke0UuSKI6BP4yQ== 2024-09-12T16:59:33.614 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.6] 2024-09-12T16:59:33.614 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDuHeNmYA8OHBAAHQYCOhPfq964hod9FSckCg== 2024-09-12T16:59:33.614 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.7] 2024-09-12T16:59:33.615 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDxHeNmxI3HHhAAgyp8JthVHZ6HDQvuNxAYGA== 2024-09-12T16:59:33.615 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2024-09-12T16:59:33.615 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDWHeNmdbd5KxAAcHoA7ehbBU98HepqTQtzYA== 2024-09-12T16:59:33.615 INFO:teuthology.orchestra.run.smithi067.stdout:[client.1] 2024-09-12T16:59:33.615 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDWHeNmRrb7LxAASVM+WhE0Ieq9YIczE/7asA== 2024-09-12T16:59:33.645 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.y] 2024-09-12T16:59:33.645 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDWHeNmBQlwIxAA7eT2WTXX8i7dja/Vyu2nbA== 2024-09-12T16:59:33.645 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.0] 2024-09-12T16:59:33.645 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDZHeNmAHDmOBAA+k16k8ovml/1+Iq2xSfLlA== 2024-09-12T16:59:33.645 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.1] 2024-09-12T16:59:33.645 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDdHeNm2j39HBAARaTiMURbl/6F7nXaqQw3Cw== 2024-09-12T16:59:33.645 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.2] 2024-09-12T16:59:33.645 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDgHeNmo2/xHhAAQ792xXTq7k0VB8Iea5BhwA== 2024-09-12T16:59:33.645 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.3] 2024-09-12T16:59:33.646 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDjHeNmXsnyIBAAYgvvAGcgiPaEd+0CxF7yLg== 2024-09-12T16:59:33.646 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.x] 2024-09-12T16:59:33.646 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDWHeNmEF3SJxAAfhXXo6ztWF+9XsiowwX0aw== 2024-09-12T16:59:33.646 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.4] 2024-09-12T16:59:33.646 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDnHeNmkomWNhAAkbg/Vg8Foka8Q3K1Xvemlg== 2024-09-12T16:59:33.646 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.5] 2024-09-12T16:59:33.646 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDrHeNmD5sNGxAAv5AThoIfke0UuSKI6BP4yQ== 2024-09-12T16:59:33.646 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.6] 2024-09-12T16:59:33.646 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDuHeNmYA8OHBAAHQYCOhPfq964hod9FSckCg== 2024-09-12T16:59:33.646 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.7] 2024-09-12T16:59:33.646 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDxHeNmxI3HHhAAgyp8JthVHZ6HDQvuNxAYGA== 2024-09-12T16:59:33.646 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2024-09-12T16:59:33.646 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDWHeNmdbd5KxAAcHoA7ehbBU98HepqTQtzYA== 2024-09-12T16:59:33.647 INFO:teuthology.orchestra.run.smithi118.stdout:[client.1] 2024-09-12T16:59:33.647 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDWHeNmRrb7LxAASVM+WhE0Ieq9YIczE/7asA== 2024-09-12T16:59:33.648 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T16:59:33.659 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T16:59:33.753 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:59:33.755 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:59:33.819 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:59:33.822 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:59:33.887 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:59:33.890 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:59:33.954 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:59:33.956 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:59:34.020 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T16:59:34.023 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T16:59:34.087 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:59:34.090 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:59:34.155 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:59:34.157 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:59:34.221 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:59:34.224 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:59:34.289 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:59:34.292 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:59:34.356 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T16:59:34.359 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T16:59:34.427 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T16:59:34.430 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T16:59:34.498 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T16:59:34.498 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T16:59:34.537 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T16:59:34.648 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T16:59:34.688 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T16:59:34.769 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T16:59:34.880 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T16:59:34.919 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T16:59:34.958 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T16:59:35.070 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T16:59:35.109 DEBUG:teuthology.orchestra.run.smithi067:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:59:35.111 DEBUG:teuthology.orchestra.run.smithi118:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:59:35.178 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T16:59:35.178 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T16:59:35.178 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T16:59:35.180 INFO:tasks.ceph.mon.a:Started 2024-09-12T16:59:35.181 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T16:59:35.181 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T16:59:35.183 INFO:tasks.ceph.mon.c:Started 2024-09-12T16:59:35.183 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T16:59:35.183 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T16:59:35.221 INFO:tasks.ceph.mon.b:Started 2024-09-12T16:59:35.221 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T16:59:35.221 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T16:59:35.221 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T16:59:35.223 INFO:tasks.ceph.mgr.y:Started 2024-09-12T16:59:35.224 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T16:59:35.224 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T16:59:35.226 INFO:tasks.ceph.mgr.x:Started 2024-09-12T16:59:35.226 DEBUG:tasks.ceph:set 0 configs 2024-09-12T16:59:35.226 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T16:59:35.226 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T16:59:40.596 INFO:teuthology.orchestra.run.smithi067.stderr:adjusted tunables profile to default 2024-09-12T16:59:40.608 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T16:59:40.608 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T16:59:40.609 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T16:59:40.609 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T16:59:40.649 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T16:59:40.649 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T16:59:40.730 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T16:59:40.730 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T16:59:40.809 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T16:59:40.809 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T16:59:40.889 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-12T16:59:40.889 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T16:59:40.928 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-12T16:59:40.928 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T16:59:41.008 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-12T16:59:41.008 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T16:59:41.087 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-12T16:59:41.087 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T16:59:41.167 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new ed210eed-1d40-4a45-9952-9a2eee0378d7 0 2024-09-12T16:59:41.399 INFO:teuthology.orchestra.run.smithi118.stdout:0 2024-09-12T16:59:41.410 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 3d34c926-d130-468a-a2bd-b91f2a9c7b68 1 2024-09-12T16:59:41.601 INFO:teuthology.orchestra.run.smithi118.stdout:1 2024-09-12T16:59:41.612 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new a15d20cc-c7ce-4a34-a951-7eb21007584b 2 2024-09-12T16:59:41.804 INFO:teuthology.orchestra.run.smithi118.stdout:2 2024-09-12T16:59:41.816 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new aa1724ee-690d-412a-9d7a-5c6a65af21ec 3 2024-09-12T16:59:42.008 INFO:teuthology.orchestra.run.smithi118.stdout:3 2024-09-12T16:59:42.019 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 26bb95af-b5c4-49f1-a45d-c1a10c8cad2b 4 2024-09-12T16:59:42.215 INFO:teuthology.orchestra.run.smithi118.stdout:4 2024-09-12T16:59:42.226 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new d2ec20b3-3ce2-499a-b900-9ca8bd5aab44 5 2024-09-12T16:59:42.420 INFO:teuthology.orchestra.run.smithi118.stdout:5 2024-09-12T16:59:42.431 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new a361798f-b5c5-4cfa-9009-10d1175d266a 6 2024-09-12T16:59:42.627 INFO:teuthology.orchestra.run.smithi118.stdout:6 2024-09-12T16:59:42.638 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new e88fb194-92ac-49d9-9fc7-f5d91416d32f 7 2024-09-12T16:59:42.834 INFO:teuthology.orchestra.run.smithi118.stdout:7 2024-09-12T16:59:42.846 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T16:59:42.846 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T16:59:42.848 INFO:tasks.ceph.osd.0:Started 2024-09-12T16:59:42.848 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T16:59:42.849 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T16:59:42.850 INFO:tasks.ceph.osd.1:Started 2024-09-12T16:59:42.851 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T16:59:42.851 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T16:59:42.853 INFO:tasks.ceph.osd.2:Started 2024-09-12T16:59:42.853 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T16:59:42.853 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T16:59:42.855 INFO:tasks.ceph.osd.3:Started 2024-09-12T16:59:42.856 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T16:59:42.856 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T16:59:42.858 INFO:tasks.ceph.osd.4:Started 2024-09-12T16:59:42.858 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T16:59:42.858 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T16:59:42.860 INFO:tasks.ceph.osd.5:Started 2024-09-12T16:59:42.860 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T16:59:42.860 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T16:59:42.863 INFO:tasks.ceph.osd.6:Started 2024-09-12T16:59:42.863 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T16:59:42.863 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T16:59:42.865 INFO:tasks.ceph.osd.7:Started 2024-09-12T16:59:42.866 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T16:59:43.107 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T16:59:43.107 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":10,"fsid":"f8d042e3-46c6-4732-b8bf-7d74a00649d2","created":"2024-09-12T16:59:40.498539+0000","modified":"2024-09-12T16:59:42.830687+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T16:59:42.830687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ed210eed-1d40-4a45-9952-9a2eee0378d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3d34c926-d130-468a-a2bd-b91f2a9c7b68","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a15d20cc-c7ce-4a34-a951-7eb21007584b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"aa1724ee-690d-412a-9d7a-5c6a65af21ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"26bb95af-b5c4-49f1-a45d-c1a10c8cad2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d2ec20b3-3ce2-499a-b900-9ca8bd5aab44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a361798f-b5c5-4cfa-9009-10d1175d266a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e88fb194-92ac-49d9-9fc7-f5d91416d32f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T16:59:43.118 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T16:59:43.118 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T16:59:43.924 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T16:59:44.105 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-09-12T16:59:44.103+0000 7f5086012640 -1 Falling back to public interface 2024-09-12T16:59:44.106 INFO:teuthology.misc.health.smithi067.stdout: 2024-09-12T16:59:44.106 INFO:teuthology.misc.health.smithi067.stdout:{"epoch":10,"fsid":"f8d042e3-46c6-4732-b8bf-7d74a00649d2","created":"2024-09-12T16:59:40.498539+0000","modified":"2024-09-12T16:59:42.830687+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T16:59:42.830687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ed210eed-1d40-4a45-9952-9a2eee0378d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3d34c926-d130-468a-a2bd-b91f2a9c7b68","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a15d20cc-c7ce-4a34-a951-7eb21007584b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"aa1724ee-690d-412a-9d7a-5c6a65af21ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"26bb95af-b5c4-49f1-a45d-c1a10c8cad2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d2ec20b3-3ce2-499a-b900-9ca8bd5aab44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a361798f-b5c5-4cfa-9009-10d1175d266a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e88fb194-92ac-49d9-9fc7-f5d91416d32f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T16:59:44.116 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T16:59:44.333 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-09-12T16:59:44.331+0000 7f1c2d264640 -1 Falling back to public interface 2024-09-12T16:59:44.338 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-09-12T16:59:44.336+0000 7fceece16640 -1 Falling back to public interface 2024-09-12T16:59:44.339 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-09-12T16:59:44.337+0000 7f9e9bc1a640 -1 Falling back to public interface 2024-09-12T16:59:44.347 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-09-12T16:59:44.346+0000 7fb29162e640 -1 Falling back to public interface 2024-09-12T16:59:44.373 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-09-12T16:59:44.372+0000 7fcb505db640 -1 Falling back to public interface 2024-09-12T16:59:44.572 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-09-12T16:59:44.570+0000 7fea19616640 -1 Falling back to public interface 2024-09-12T16:59:44.596 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-09-12T16:59:44.594+0000 7ff11f828640 -1 Falling back to public interface 2024-09-12T16:59:45.788 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-09-12T16:59:45.786+0000 7ff39d424640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T16:59:45.788 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-09-12T16:59:45.786+0000 7ff39d424640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T16:59:47.907 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-09-12T16:59:47.905+0000 7f5086012640 -1 osd.4 0 log_to_monitors true 2024-09-12T16:59:47.918 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-09-12T16:59:47.916+0000 7fb29162e640 -1 osd.3 0 log_to_monitors true 2024-09-12T16:59:48.317 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-09-12T16:59:48.316+0000 7fea19616640 -1 osd.6 0 log_to_monitors true 2024-09-12T16:59:48.406 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-09-12T16:59:48.404+0000 7f9e9bc1a640 -1 osd.0 0 log_to_monitors true 2024-09-12T16:59:48.592 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-09-12T16:59:48.590+0000 7f1c2d264640 -1 osd.5 0 log_to_monitors true 2024-09-12T16:59:48.617 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-09-12T16:59:48.616+0000 7fceece16640 -1 osd.2 0 log_to_monitors true 2024-09-12T16:59:48.661 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-09-12T16:59:48.659+0000 7fcb505db640 -1 osd.7 0 log_to_monitors true 2024-09-12T16:59:48.678 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-09-12T16:59:48.677+0000 7ff11f828640 -1 osd.1 0 log_to_monitors true 2024-09-12T16:59:50.480 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-09-12T16:59:50.479+0000 7f50821f2640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T16:59:50.490 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-09-12T16:59:50.489+0000 7f50797fd640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:59:50.509 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-09-12T16:59:50.507+0000 7fea156ba640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T16:59:50.524 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-09-12T16:59:50.523+0000 7fea0ccc5640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:59:50.922 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T16:59:51.086 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-09-12T16:59:51.084+0000 7fb28cb94640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T16:59:51.088 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-09-12T16:59:51.087+0000 7f9e975a1640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T16:59:51.102 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-09-12T16:59:51.101+0000 7fb2849b3640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:59:51.129 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-09-12T16:59:51.127+0000 7f9e8f3c0640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:59:51.310 INFO:teuthology.misc.health.smithi067.stdout: 2024-09-12T16:59:51.310 INFO:teuthology.misc.health.smithi067.stdout:{"epoch":13,"fsid":"f8d042e3-46c6-4732-b8bf-7d74a00649d2","created":"2024-09-12T16:59:40.498539+0000","modified":"2024-09-12T16:59:50.522168+0000","last_up_change":"2024-09-12T16:59:50.522168+0000","last_in_change":"2024-09-12T16:59:42.830687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ed210eed-1d40-4a45-9952-9a2eee0378d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3d34c926-d130-468a-a2bd-b91f2a9c7b68","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a15d20cc-c7ce-4a34-a951-7eb21007584b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"aa1724ee-690d-412a-9d7a-5c6a65af21ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"26bb95af-b5c4-49f1-a45d-c1a10c8cad2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2751121967},{"type":"v1","addr":"172.21.15.118:6801","nonce":2751121967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2751121967},{"type":"v1","addr":"172.21.15.118:6803","nonce":2751121967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2751121967},{"type":"v1","addr":"172.21.15.118:6807","nonce":2751121967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2751121967},{"type":"v1","addr":"172.21.15.118:6805","nonce":2751121967}]},"public_addr":"172.21.15.118:6801/2751121967","cluster_addr":"172.21.15.118:6803/2751121967","heartbeat_back_addr":"172.21.15.118:6807/2751121967","heartbeat_front_addr":"172.21.15.118:6805/2751121967","state":["exists","up"]},{"osd":5,"uuid":"d2ec20b3-3ce2-499a-b900-9ca8bd5aab44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a361798f-b5c5-4cfa-9009-10d1175d266a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e88fb194-92ac-49d9-9fc7-f5d91416d32f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T16:59:51.326 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-12T16:59:51.473 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-09-12T16:59:51.470+0000 7f1c291f8640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T16:59:51.473 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-09-12T16:59:51.471+0000 7fcb4c56f640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T16:59:51.482 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-09-12T16:59:51.481+0000 7fcb4438e640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:59:51.486 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-09-12T16:59:51.485+0000 7f1c21017640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:59:51.852 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-09-12T16:59:51.851+0000 7ff11b7bc640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T16:59:51.872 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-09-12T16:59:51.871+0000 7ff1135db640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:59:51.877 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-09-12T16:59:51.876+0000 7fcee8781640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T16:59:51.890 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-09-12T16:59:51.889+0000 7fcee05a0640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:59:58.133 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T16:59:58.453 INFO:teuthology.misc.health.smithi067.stdout: 2024-09-12T16:59:58.453 INFO:teuthology.misc.health.smithi067.stdout:{"epoch":18,"fsid":"f8d042e3-46c6-4732-b8bf-7d74a00649d2","created":"2024-09-12T16:59:40.498539+0000","modified":"2024-09-12T16:59:55.636057+0000","last_up_change":"2024-09-12T16:59:52.614375+0000","last_in_change":"2024-09-12T16:59:42.830687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T16:59:52.794947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed210eed-1d40-4a45-9952-9a2eee0378d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1841182576},{"type":"v1","addr":"172.21.15.67:6809","nonce":1841182576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1841182576},{"type":"v1","addr":"172.21.15.67:6811","nonce":1841182576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1841182576},{"type":"v1","addr":"172.21.15.67:6815","nonce":1841182576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1841182576},{"type":"v1","addr":"172.21.15.67:6813","nonce":1841182576}]},"public_addr":"172.21.15.67:6809/1841182576","cluster_addr":"172.21.15.67:6811/1841182576","heartbeat_back_addr":"172.21.15.67:6815/1841182576","heartbeat_front_addr":"172.21.15.67:6813/1841182576","state":["exists","up"]},{"osd":1,"uuid":"3d34c926-d130-468a-a2bd-b91f2a9c7b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3249659332},{"type":"v1","addr":"172.21.15.67:6825","nonce":3249659332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3249659332},{"type":"v1","addr":"172.21.15.67:6827","nonce":3249659332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3249659332},{"type":"v1","addr":"172.21.15.67:6831","nonce":3249659332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3249659332},{"type":"v1","addr":"172.21.15.67:6829","nonce":3249659332}]},"public_addr":"172.21.15.67:6825/3249659332","cluster_addr":"172.21.15.67:6827/3249659332","heartbeat_back_addr":"172.21.15.67:6831/3249659332","heartbeat_front_addr":"172.21.15.67:6829/3249659332","state":["exists","up"]},{"osd":2,"uuid":"a15d20cc-c7ce-4a34-a951-7eb21007584b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3672311065},{"type":"v1","addr":"172.21.15.67:6801","nonce":3672311065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3672311065},{"type":"v1","addr":"172.21.15.67:6803","nonce":3672311065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3672311065},{"type":"v1","addr":"172.21.15.67:6807","nonce":3672311065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3672311065},{"type":"v1","addr":"172.21.15.67:6805","nonce":3672311065}]},"public_addr":"172.21.15.67:6801/3672311065","cluster_addr":"172.21.15.67:6803/3672311065","heartbeat_back_addr":"172.21.15.67:6807/3672311065","heartbeat_front_addr":"172.21.15.67:6805/3672311065","state":["exists","up"]},{"osd":3,"uuid":"aa1724ee-690d-412a-9d7a-5c6a65af21ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":2780246260},{"type":"v1","addr":"172.21.15.67:6817","nonce":2780246260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2780246260},{"type":"v1","addr":"172.21.15.67:6819","nonce":2780246260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":2780246260},{"type":"v1","addr":"172.21.15.67:6823","nonce":2780246260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2780246260},{"type":"v1","addr":"172.21.15.67:6821","nonce":2780246260}]},"public_addr":"172.21.15.67:6817/2780246260","cluster_addr":"172.21.15.67:6819/2780246260","heartbeat_back_addr":"172.21.15.67:6823/2780246260","heartbeat_front_addr":"172.21.15.67:6821/2780246260","state":["exists","up"]},{"osd":4,"uuid":"26bb95af-b5c4-49f1-a45d-c1a10c8cad2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2751121967},{"type":"v1","addr":"172.21.15.118:6801","nonce":2751121967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2751121967},{"type":"v1","addr":"172.21.15.118:6803","nonce":2751121967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2751121967},{"type":"v1","addr":"172.21.15.118:6807","nonce":2751121967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2751121967},{"type":"v1","addr":"172.21.15.118:6805","nonce":2751121967}]},"public_addr":"172.21.15.118:6801/2751121967","cluster_addr":"172.21.15.118:6803/2751121967","heartbeat_back_addr":"172.21.15.118:6807/2751121967","heartbeat_front_addr":"172.21.15.118:6805/2751121967","state":["exists","up"]},{"osd":5,"uuid":"d2ec20b3-3ce2-499a-b900-9ca8bd5aab44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1825660705},{"type":"v1","addr":"172.21.15.118:6809","nonce":1825660705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1825660705},{"type":"v1","addr":"172.21.15.118:6811","nonce":1825660705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1825660705},{"type":"v1","addr":"172.21.15.118:6815","nonce":1825660705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1825660705},{"type":"v1","addr":"172.21.15.118:6813","nonce":1825660705}]},"public_addr":"172.21.15.118:6809/1825660705","cluster_addr":"172.21.15.118:6811/1825660705","heartbeat_back_addr":"172.21.15.118:6815/1825660705","heartbeat_front_addr":"172.21.15.118:6813/1825660705","state":["exists","up"]},{"osd":6,"uuid":"a361798f-b5c5-4cfa-9009-10d1175d266a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1070975205},{"type":"v1","addr":"172.21.15.118:6825","nonce":1070975205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1070975205},{"type":"v1","addr":"172.21.15.118:6827","nonce":1070975205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1070975205},{"type":"v1","addr":"172.21.15.118:6831","nonce":1070975205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1070975205},{"type":"v1","addr":"172.21.15.118:6829","nonce":1070975205}]},"public_addr":"172.21.15.118:6825/1070975205","cluster_addr":"172.21.15.118:6827/1070975205","heartbeat_back_addr":"172.21.15.118:6831/1070975205","heartbeat_front_addr":"172.21.15.118:6829/1070975205","state":["exists","up"]},{"osd":7,"uuid":"e88fb194-92ac-49d9-9fc7-f5d91416d32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1969396610},{"type":"v1","addr":"172.21.15.118:6817","nonce":1969396610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1969396610},{"type":"v1","addr":"172.21.15.118:6819","nonce":1969396610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1969396610},{"type":"v1","addr":"172.21.15.118:6823","nonce":1969396610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1969396610},{"type":"v1","addr":"172.21.15.118:6821","nonce":1969396610}]},"public_addr":"172.21.15.118:6817/1969396610","cluster_addr":"172.21.15.118:6819/1969396610","heartbeat_back_addr":"172.21.15.118:6823/1969396610","heartbeat_front_addr":"172.21.15.118:6821/1969396610","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:49.385155+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:49.692172+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:49.637563+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:48.916217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:48.951069+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:49.611038+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:49.273915+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:49.675897+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T16:59:58.464 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T16:59:58.464 INFO:tasks.ceph:Creating RBD pool 2024-09-12T16:59:58.465 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T16:59:59.659 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'rbd' created 2024-09-12T16:59:59.675 DEBUG:teuthology.orchestra.run.smithi067:> rbd --cluster ceph pool init rbd 2024-09-12T16:59:59.743 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:59:59.743 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:00:02.688 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T17:00:02.689 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T17:00:02.689 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T17:00:03.020 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:00:03.033 INFO:teuthology.orchestra.run.smithi067.stdout:[{"version":9,"timestamp":"2024-09-12T16:59:51.877572+0000","name":"","changes":[{"name":"osd.2/osd_mclock_max_capacity_iops_ssd","new_value":"6055.755229"}]}] 2024-09-12T17:00:03.033 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T17:00:03.033 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T17:00:03.034 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T17:00:03.034 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T17:00:03.404 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:00:03.415 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2189073638},{"type":"v1","addr":"172.21.15.118:6833","nonce":2189073638}]},"active_addr":"172.21.15.118:6833/2189073638","active_change":"2024-09-12T16:59:44.774723+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4109,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":4000510664}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":857191170}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":901872322}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":2981554376}]}]} 2024-09-12T17:00:03.420 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T17:00:03.420 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T17:00:03.420 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:00:03.738 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:00:03.738 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":22,"fsid":"f8d042e3-46c6-4732-b8bf-7d74a00649d2","created":"2024-09-12T16:59:40.498539+0000","modified":"2024-09-12T17:00:02.667730+0000","last_up_change":"2024-09-12T16:59:52.614375+0000","last_in_change":"2024-09-12T16:59:42.830687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T16:59:52.794947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T16:59:58.778829+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed210eed-1d40-4a45-9952-9a2eee0378d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1841182576},{"type":"v1","addr":"172.21.15.67:6809","nonce":1841182576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1841182576},{"type":"v1","addr":"172.21.15.67:6811","nonce":1841182576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1841182576},{"type":"v1","addr":"172.21.15.67:6815","nonce":1841182576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1841182576},{"type":"v1","addr":"172.21.15.67:6813","nonce":1841182576}]},"public_addr":"172.21.15.67:6809/1841182576","cluster_addr":"172.21.15.67:6811/1841182576","heartbeat_back_addr":"172.21.15.67:6815/1841182576","heartbeat_front_addr":"172.21.15.67:6813/1841182576","state":["exists","up"]},{"osd":1,"uuid":"3d34c926-d130-468a-a2bd-b91f2a9c7b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3249659332},{"type":"v1","addr":"172.21.15.67:6825","nonce":3249659332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3249659332},{"type":"v1","addr":"172.21.15.67:6827","nonce":3249659332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3249659332},{"type":"v1","addr":"172.21.15.67:6831","nonce":3249659332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3249659332},{"type":"v1","addr":"172.21.15.67:6829","nonce":3249659332}]},"public_addr":"172.21.15.67:6825/3249659332","cluster_addr":"172.21.15.67:6827/3249659332","heartbeat_back_addr":"172.21.15.67:6831/3249659332","heartbeat_front_addr":"172.21.15.67:6829/3249659332","state":["exists","up"]},{"osd":2,"uuid":"a15d20cc-c7ce-4a34-a951-7eb21007584b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3672311065},{"type":"v1","addr":"172.21.15.67:6801","nonce":3672311065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3672311065},{"type":"v1","addr":"172.21.15.67:6803","nonce":3672311065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3672311065},{"type":"v1","addr":"172.21.15.67:6807","nonce":3672311065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3672311065},{"type":"v1","addr":"172.21.15.67:6805","nonce":3672311065}]},"public_addr":"172.21.15.67:6801/3672311065","cluster_addr":"172.21.15.67:6803/3672311065","heartbeat_back_addr":"172.21.15.67:6807/3672311065","heartbeat_front_addr":"172.21.15.67:6805/3672311065","state":["exists","up"]},{"osd":3,"uuid":"aa1724ee-690d-412a-9d7a-5c6a65af21ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":2780246260},{"type":"v1","addr":"172.21.15.67:6817","nonce":2780246260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2780246260},{"type":"v1","addr":"172.21.15.67:6819","nonce":2780246260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":2780246260},{"type":"v1","addr":"172.21.15.67:6823","nonce":2780246260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2780246260},{"type":"v1","addr":"172.21.15.67:6821","nonce":2780246260}]},"public_addr":"172.21.15.67:6817/2780246260","cluster_addr":"172.21.15.67:6819/2780246260","heartbeat_back_addr":"172.21.15.67:6823/2780246260","heartbeat_front_addr":"172.21.15.67:6821/2780246260","state":["exists","up"]},{"osd":4,"uuid":"26bb95af-b5c4-49f1-a45d-c1a10c8cad2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2751121967},{"type":"v1","addr":"172.21.15.118:6801","nonce":2751121967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2751121967},{"type":"v1","addr":"172.21.15.118:6803","nonce":2751121967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2751121967},{"type":"v1","addr":"172.21.15.118:6807","nonce":2751121967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2751121967},{"type":"v1","addr":"172.21.15.118:6805","nonce":2751121967}]},"public_addr":"172.21.15.118:6801/2751121967","cluster_addr":"172.21.15.118:6803/2751121967","heartbeat_back_addr":"172.21.15.118:6807/2751121967","heartbeat_front_addr":"172.21.15.118:6805/2751121967","state":["exists","up"]},{"osd":5,"uuid":"d2ec20b3-3ce2-499a-b900-9ca8bd5aab44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1825660705},{"type":"v1","addr":"172.21.15.118:6809","nonce":1825660705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1825660705},{"type":"v1","addr":"172.21.15.118:6811","nonce":1825660705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1825660705},{"type":"v1","addr":"172.21.15.118:6815","nonce":1825660705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1825660705},{"type":"v1","addr":"172.21.15.118:6813","nonce":1825660705}]},"public_addr":"172.21.15.118:6809/1825660705","cluster_addr":"172.21.15.118:6811/1825660705","heartbeat_back_addr":"172.21.15.118:6815/1825660705","heartbeat_front_addr":"172.21.15.118:6813/1825660705","state":["exists","up"]},{"osd":6,"uuid":"a361798f-b5c5-4cfa-9009-10d1175d266a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1070975205},{"type":"v1","addr":"172.21.15.118:6825","nonce":1070975205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1070975205},{"type":"v1","addr":"172.21.15.118:6827","nonce":1070975205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1070975205},{"type":"v1","addr":"172.21.15.118:6831","nonce":1070975205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1070975205},{"type":"v1","addr":"172.21.15.118:6829","nonce":1070975205}]},"public_addr":"172.21.15.118:6825/1070975205","cluster_addr":"172.21.15.118:6827/1070975205","heartbeat_back_addr":"172.21.15.118:6831/1070975205","heartbeat_front_addr":"172.21.15.118:6829/1070975205","state":["exists","up"]},{"osd":7,"uuid":"e88fb194-92ac-49d9-9fc7-f5d91416d32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1969396610},{"type":"v1","addr":"172.21.15.118:6817","nonce":1969396610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1969396610},{"type":"v1","addr":"172.21.15.118:6819","nonce":1969396610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1969396610},{"type":"v1","addr":"172.21.15.118:6823","nonce":1969396610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1969396610},{"type":"v1","addr":"172.21.15.118:6821","nonce":1969396610}]},"public_addr":"172.21.15.118:6817/1969396610","cluster_addr":"172.21.15.118:6819/1969396610","heartbeat_back_addr":"172.21.15.118:6823/1969396610","heartbeat_front_addr":"172.21.15.118:6821/1969396610","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:49.385155+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:49.692172+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:49.637563+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:48.916217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:48.951069+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:49.611038+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:49.273915+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:49.675897+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:00:03.751 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T17:00:03.751 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:00:04.065 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:00:04.065 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":22,"fsid":"f8d042e3-46c6-4732-b8bf-7d74a00649d2","created":"2024-09-12T16:59:40.498539+0000","modified":"2024-09-12T17:00:02.667730+0000","last_up_change":"2024-09-12T16:59:52.614375+0000","last_in_change":"2024-09-12T16:59:42.830687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T16:59:52.794947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T16:59:58.778829+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed210eed-1d40-4a45-9952-9a2eee0378d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1841182576},{"type":"v1","addr":"172.21.15.67:6809","nonce":1841182576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1841182576},{"type":"v1","addr":"172.21.15.67:6811","nonce":1841182576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1841182576},{"type":"v1","addr":"172.21.15.67:6815","nonce":1841182576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1841182576},{"type":"v1","addr":"172.21.15.67:6813","nonce":1841182576}]},"public_addr":"172.21.15.67:6809/1841182576","cluster_addr":"172.21.15.67:6811/1841182576","heartbeat_back_addr":"172.21.15.67:6815/1841182576","heartbeat_front_addr":"172.21.15.67:6813/1841182576","state":["exists","up"]},{"osd":1,"uuid":"3d34c926-d130-468a-a2bd-b91f2a9c7b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3249659332},{"type":"v1","addr":"172.21.15.67:6825","nonce":3249659332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3249659332},{"type":"v1","addr":"172.21.15.67:6827","nonce":3249659332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3249659332},{"type":"v1","addr":"172.21.15.67:6831","nonce":3249659332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3249659332},{"type":"v1","addr":"172.21.15.67:6829","nonce":3249659332}]},"public_addr":"172.21.15.67:6825/3249659332","cluster_addr":"172.21.15.67:6827/3249659332","heartbeat_back_addr":"172.21.15.67:6831/3249659332","heartbeat_front_addr":"172.21.15.67:6829/3249659332","state":["exists","up"]},{"osd":2,"uuid":"a15d20cc-c7ce-4a34-a951-7eb21007584b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3672311065},{"type":"v1","addr":"172.21.15.67:6801","nonce":3672311065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3672311065},{"type":"v1","addr":"172.21.15.67:6803","nonce":3672311065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3672311065},{"type":"v1","addr":"172.21.15.67:6807","nonce":3672311065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3672311065},{"type":"v1","addr":"172.21.15.67:6805","nonce":3672311065}]},"public_addr":"172.21.15.67:6801/3672311065","cluster_addr":"172.21.15.67:6803/3672311065","heartbeat_back_addr":"172.21.15.67:6807/3672311065","heartbeat_front_addr":"172.21.15.67:6805/3672311065","state":["exists","up"]},{"osd":3,"uuid":"aa1724ee-690d-412a-9d7a-5c6a65af21ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":2780246260},{"type":"v1","addr":"172.21.15.67:6817","nonce":2780246260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2780246260},{"type":"v1","addr":"172.21.15.67:6819","nonce":2780246260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":2780246260},{"type":"v1","addr":"172.21.15.67:6823","nonce":2780246260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2780246260},{"type":"v1","addr":"172.21.15.67:6821","nonce":2780246260}]},"public_addr":"172.21.15.67:6817/2780246260","cluster_addr":"172.21.15.67:6819/2780246260","heartbeat_back_addr":"172.21.15.67:6823/2780246260","heartbeat_front_addr":"172.21.15.67:6821/2780246260","state":["exists","up"]},{"osd":4,"uuid":"26bb95af-b5c4-49f1-a45d-c1a10c8cad2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2751121967},{"type":"v1","addr":"172.21.15.118:6801","nonce":2751121967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2751121967},{"type":"v1","addr":"172.21.15.118:6803","nonce":2751121967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2751121967},{"type":"v1","addr":"172.21.15.118:6807","nonce":2751121967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2751121967},{"type":"v1","addr":"172.21.15.118:6805","nonce":2751121967}]},"public_addr":"172.21.15.118:6801/2751121967","cluster_addr":"172.21.15.118:6803/2751121967","heartbeat_back_addr":"172.21.15.118:6807/2751121967","heartbeat_front_addr":"172.21.15.118:6805/2751121967","state":["exists","up"]},{"osd":5,"uuid":"d2ec20b3-3ce2-499a-b900-9ca8bd5aab44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1825660705},{"type":"v1","addr":"172.21.15.118:6809","nonce":1825660705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1825660705},{"type":"v1","addr":"172.21.15.118:6811","nonce":1825660705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1825660705},{"type":"v1","addr":"172.21.15.118:6815","nonce":1825660705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1825660705},{"type":"v1","addr":"172.21.15.118:6813","nonce":1825660705}]},"public_addr":"172.21.15.118:6809/1825660705","cluster_addr":"172.21.15.118:6811/1825660705","heartbeat_back_addr":"172.21.15.118:6815/1825660705","heartbeat_front_addr":"172.21.15.118:6813/1825660705","state":["exists","up"]},{"osd":6,"uuid":"a361798f-b5c5-4cfa-9009-10d1175d266a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1070975205},{"type":"v1","addr":"172.21.15.118:6825","nonce":1070975205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1070975205},{"type":"v1","addr":"172.21.15.118:6827","nonce":1070975205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1070975205},{"type":"v1","addr":"172.21.15.118:6831","nonce":1070975205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1070975205},{"type":"v1","addr":"172.21.15.118:6829","nonce":1070975205}]},"public_addr":"172.21.15.118:6825/1070975205","cluster_addr":"172.21.15.118:6827/1070975205","heartbeat_back_addr":"172.21.15.118:6831/1070975205","heartbeat_front_addr":"172.21.15.118:6829/1070975205","state":["exists","up"]},{"osd":7,"uuid":"e88fb194-92ac-49d9-9fc7-f5d91416d32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1969396610},{"type":"v1","addr":"172.21.15.118:6817","nonce":1969396610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1969396610},{"type":"v1","addr":"172.21.15.118:6819","nonce":1969396610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1969396610},{"type":"v1","addr":"172.21.15.118:6823","nonce":1969396610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1969396610},{"type":"v1","addr":"172.21.15.118:6821","nonce":1969396610}]},"public_addr":"172.21.15.118:6817/1969396610","cluster_addr":"172.21.15.118:6819/1969396610","heartbeat_back_addr":"172.21.15.118:6823/1969396610","heartbeat_front_addr":"172.21.15.118:6821/1969396610","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:49.385155+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:49.692172+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:49.637563+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:48.916217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:48.951069+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:49.611038+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:49.273915+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:49.675897+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:00:04.079 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T17:00:04.080 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T17:00:04.080 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T17:00:04.080 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T17:00:04.081 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T17:00:04.081 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T17:00:04.082 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T17:00:04.082 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T17:00:04.344 INFO:teuthology.orchestra.run.smithi067.stdout:64424509446 2024-09-12T17:00:04.345 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:00:04.359 INFO:teuthology.orchestra.run.smithi067.stdout:60129542150 2024-09-12T17:00:04.359 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:00:04.360 INFO:teuthology.orchestra.run.smithi067.stdout:64424509447 2024-09-12T17:00:04.360 INFO:teuthology.orchestra.run.smithi067.stdout:60129542149 2024-09-12T17:00:04.361 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:00:04.361 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:00:04.362 INFO:teuthology.orchestra.run.smithi067.stdout:60129542149 2024-09-12T17:00:04.363 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T17:00:04.364 INFO:teuthology.orchestra.run.smithi067.stdout:60129542149 2024-09-12T17:00:04.364 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T17:00:04.365 INFO:teuthology.orchestra.run.smithi067.stdout:55834574852 2024-09-12T17:00:04.365 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T17:00:04.366 INFO:teuthology.orchestra.run.smithi067.stdout:60129542148 2024-09-12T17:00:04.367 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T17:00:04.956 INFO:teuthology.orchestra.run.smithi067.stdout:64424509444 2024-09-12T17:00:04.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.2 2024-09-12T17:00:05.017 INFO:teuthology.orchestra.run.smithi067.stdout:60129542148 2024-09-12T17:00:05.030 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.3 2024-09-12T17:00:05.055 INFO:teuthology.orchestra.run.smithi067.stdout:64424509445 2024-09-12T17:00:05.056 INFO:teuthology.orchestra.run.smithi067.stdout:55834574851 2024-09-12T17:00:05.059 INFO:teuthology.orchestra.run.smithi067.stdout:60129542148 2024-09-12T17:00:05.066 INFO:teuthology.orchestra.run.smithi067.stdout:60129542147 2024-09-12T17:00:05.066 INFO:teuthology.orchestra.run.smithi067.stdout:60129542149 2024-09-12T17:00:05.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.1 2024-09-12T17:00:05.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.4 2024-09-12T17:00:05.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.6 2024-09-12T17:00:05.083 INFO:teuthology.orchestra.run.smithi067.stdout:60129542148 2024-09-12T17:00:05.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.0 2024-09-12T17:00:05.086 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.7 2024-09-12T17:00:05.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.5 2024-09-12T17:00:05.976 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:00:06.032 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:00:06.074 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:00:06.075 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T17:00:06.081 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T17:00:06.084 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:00:06.087 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T17:00:06.097 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T17:00:06.520 INFO:teuthology.orchestra.run.smithi067.stdout:64424509446 2024-09-12T17:00:06.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.2 2024-09-12T17:00:06.538 DEBUG:teuthology.parallel:result is None 2024-09-12T17:00:06.637 INFO:teuthology.orchestra.run.smithi067.stdout:60129542148 2024-09-12T17:00:06.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.7 2024-09-12T17:00:06.650 DEBUG:teuthology.parallel:result is None 2024-09-12T17:00:06.651 INFO:teuthology.orchestra.run.smithi067.stdout:60129542149 2024-09-12T17:00:06.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.3 2024-09-12T17:00:06.670 DEBUG:teuthology.parallel:result is None 2024-09-12T17:00:06.690 INFO:teuthology.orchestra.run.smithi067.stdout:55834574852 2024-09-12T17:00:06.697 INFO:teuthology.orchestra.run.smithi067.stdout:64424509447 2024-09-12T17:00:06.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.4 2024-09-12T17:00:06.705 DEBUG:teuthology.parallel:result is None 2024-09-12T17:00:06.711 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.1 2024-09-12T17:00:06.711 DEBUG:teuthology.parallel:result is None 2024-09-12T17:00:06.729 INFO:teuthology.orchestra.run.smithi067.stdout:60129542149 2024-09-12T17:00:06.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2024-09-12T17:00:06.742 DEBUG:teuthology.parallel:result is None 2024-09-12T17:00:06.748 INFO:teuthology.orchestra.run.smithi067.stdout:60129542149 2024-09-12T17:00:06.756 INFO:teuthology.orchestra.run.smithi067.stdout:60129542150 2024-09-12T17:00:06.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.6 2024-09-12T17:00:06.761 DEBUG:teuthology.parallel:result is None 2024-09-12T17:00:06.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.0 2024-09-12T17:00:06.769 DEBUG:teuthology.parallel:result is None 2024-09-12T17:00:06.769 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T17:00:06.769 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:00:07.121 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:00:07.122 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-12T17:00:07.133 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-12T17:00:06.784117+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":252428,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722292,"statfs":{"total":773094113280,"available":772835627008,"internally_reserved":0,"allocated":2965504,"data_stored":1791718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.120436"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:00:02.674643+0000","last_change":"2024-09-12T17:00:02.674920+0000","last_active":"2024-09-12T17:00:02.674643+0000","last_peered":"2024-09-12T17:00:02.674643+0000","last_clean":"2024-09-12T17:00:02.674643+0000","last_became_active":"2024-09-12T17:00:00.670451+0000","last_became_peered":"2024-09-12T17:00:00.670451+0000","last_unstale":"2024-09-12T17:00:02.674643+0000","last_undegraded":"2024-09-12T17:00:02.674643+0000","last_fullsized":"2024-09-12T17:00:02.674643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:42.274336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046867000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:00:02.683419+0000","last_change":"2024-09-12T17:00:02.683419+0000","last_active":"2024-09-12T17:00:02.683419+0000","last_peered":"2024-09-12T17:00:02.683419+0000","last_clean":"2024-09-12T17:00:02.683419+0000","last_became_active":"2024-09-12T17:00:00.669898+0000","last_became_peered":"2024-09-12T17:00:00.669898+0000","last_unstale":"2024-09-12T17:00:02.683419+0000","last_undegraded":"2024-09-12T17:00:02.683419+0000","last_fullsized":"2024-09-12T17:00:02.683419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:32.053145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060387199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:00:02.996531+0000","last_change":"2024-09-12T17:00:02.996744+0000","last_active":"2024-09-12T17:00:02.996531+0000","last_peered":"2024-09-12T17:00:02.996531+0000","last_clean":"2024-09-12T17:00:02.996531+0000","last_became_active":"2024-09-12T17:00:00.670355+0000","last_became_peered":"2024-09-12T17:00:00.670355+0000","last_unstale":"2024-09-12T17:00:02.996531+0000","last_undegraded":"2024-09-12T17:00:02.996531+0000","last_fullsized":"2024-09-12T17:00:02.996531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:16.719229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042464500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:00:02.683370+0000","last_change":"2024-09-12T17:00:02.683370+0000","last_active":"2024-09-12T17:00:02.683370+0000","last_peered":"2024-09-12T17:00:02.683370+0000","last_clean":"2024-09-12T17:00:02.683370+0000","last_became_active":"2024-09-12T17:00:00.667379+0000","last_became_peered":"2024-09-12T17:00:00.667379+0000","last_unstale":"2024-09-12T17:00:02.683370+0000","last_undegraded":"2024-09-12T17:00:02.683370+0000","last_fullsized":"2024-09-12T17:00:02.683370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:23.577096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056755300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:00:02.681561+0000","last_change":"2024-09-12T17:00:02.681561+0000","last_active":"2024-09-12T17:00:02.681561+0000","last_peered":"2024-09-12T17:00:02.681561+0000","last_clean":"2024-09-12T17:00:02.681561+0000","last_became_active":"2024-09-12T17:00:00.668696+0000","last_became_peered":"2024-09-12T17:00:00.668696+0000","last_unstale":"2024-09-12T17:00:02.681561+0000","last_undegraded":"2024-09-12T17:00:02.681561+0000","last_fullsized":"2024-09-12T17:00:02.681561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:34.470591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012259720000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:00:02.677610+0000","last_change":"2024-09-12T17:00:02.677610+0000","last_active":"2024-09-12T17:00:02.677610+0000","last_peered":"2024-09-12T17:00:02.677610+0000","last_clean":"2024-09-12T17:00:02.677610+0000","last_became_active":"2024-09-12T17:00:01.173083+0000","last_became_peered":"2024-09-12T17:00:01.173083+0000","last_unstale":"2024-09-12T17:00:02.677610+0000","last_undegraded":"2024-09-12T17:00:02.677610+0000","last_fullsized":"2024-09-12T17:00:02.677610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:35.997474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056135799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:00:02.996579+0000","last_change":"2024-09-12T17:00:02.996796+0000","last_active":"2024-09-12T17:00:02.996579+0000","last_peered":"2024-09-12T17:00:02.996579+0000","last_clean":"2024-09-12T17:00:02.996579+0000","last_became_active":"2024-09-12T17:00:00.671211+0000","last_became_peered":"2024-09-12T17:00:00.671211+0000","last_unstale":"2024-09-12T17:00:02.996579+0000","last_undegraded":"2024-09-12T17:00:02.996579+0000","last_fullsized":"2024-09-12T17:00:02.996579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:37.005108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000441562,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:00:02.680655+0000","last_change":"2024-09-12T17:00:02.680922+0000","last_active":"2024-09-12T17:00:02.680655+0000","last_peered":"2024-09-12T17:00:02.680655+0000","last_clean":"2024-09-12T17:00:02.680655+0000","last_became_active":"2024-09-12T17:00:00.669728+0000","last_became_peered":"2024-09-12T17:00:00.669728+0000","last_unstale":"2024-09-12T17:00:02.680655+0000","last_undegraded":"2024-09-12T17:00:02.680655+0000","last_fullsized":"2024-09-12T17:00:02.680655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:04.614720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058116500000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:00:02.996252+0000","last_change":"2024-09-12T16:59:54.636782+0000","last_active":"2024-09-12T17:00:02.996252+0000","last_peered":"2024-09-12T17:00:02.996252+0000","last_clean":"2024-09-12T17:00:02.996252+0000","last_became_active":"2024-09-12T16:59:54.636487+0000","last_became_peered":"2024-09-12T16:59:54.636487+0000","last_unstale":"2024-09-12T17:00:02.996252+0000","last_undegraded":"2024-09-12T17:00:02.996252+0000","last_fullsized":"2024-09-12T17:00:02.996252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:53.619137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:53.619137+0000","last_clean_scrub_stamp":"2024-09-12T16:59:53.619137+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:25.991554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":76368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36148,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335692,"statfs":{"total":96636764160,"available":96599748608,"internally_reserved":0,"allocated":815104,"data_stored":666736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":221184,"data_stored":76368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35576,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336264,"statfs":{"total":96636764160,"available":96600334336,"internally_reserved":0,"allocated":225280,"data_stored":76387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":666736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35564,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":221184,"data_stored":76368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:00:07.134 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:00:07.444 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:00:07.445 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-12T17:00:07.457 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-12T17:00:06.784117+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":252428,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722292,"statfs":{"total":773094113280,"available":772835627008,"internally_reserved":0,"allocated":2965504,"data_stored":1791718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.120436"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:00:02.674643+0000","last_change":"2024-09-12T17:00:02.674920+0000","last_active":"2024-09-12T17:00:02.674643+0000","last_peered":"2024-09-12T17:00:02.674643+0000","last_clean":"2024-09-12T17:00:02.674643+0000","last_became_active":"2024-09-12T17:00:00.670451+0000","last_became_peered":"2024-09-12T17:00:00.670451+0000","last_unstale":"2024-09-12T17:00:02.674643+0000","last_undegraded":"2024-09-12T17:00:02.674643+0000","last_fullsized":"2024-09-12T17:00:02.674643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:42.274336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046867000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:00:02.683419+0000","last_change":"2024-09-12T17:00:02.683419+0000","last_active":"2024-09-12T17:00:02.683419+0000","last_peered":"2024-09-12T17:00:02.683419+0000","last_clean":"2024-09-12T17:00:02.683419+0000","last_became_active":"2024-09-12T17:00:00.669898+0000","last_became_peered":"2024-09-12T17:00:00.669898+0000","last_unstale":"2024-09-12T17:00:02.683419+0000","last_undegraded":"2024-09-12T17:00:02.683419+0000","last_fullsized":"2024-09-12T17:00:02.683419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:32.053145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060387199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:00:02.996531+0000","last_change":"2024-09-12T17:00:02.996744+0000","last_active":"2024-09-12T17:00:02.996531+0000","last_peered":"2024-09-12T17:00:02.996531+0000","last_clean":"2024-09-12T17:00:02.996531+0000","last_became_active":"2024-09-12T17:00:00.670355+0000","last_became_peered":"2024-09-12T17:00:00.670355+0000","last_unstale":"2024-09-12T17:00:02.996531+0000","last_undegraded":"2024-09-12T17:00:02.996531+0000","last_fullsized":"2024-09-12T17:00:02.996531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:16.719229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042464500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:00:02.683370+0000","last_change":"2024-09-12T17:00:02.683370+0000","last_active":"2024-09-12T17:00:02.683370+0000","last_peered":"2024-09-12T17:00:02.683370+0000","last_clean":"2024-09-12T17:00:02.683370+0000","last_became_active":"2024-09-12T17:00:00.667379+0000","last_became_peered":"2024-09-12T17:00:00.667379+0000","last_unstale":"2024-09-12T17:00:02.683370+0000","last_undegraded":"2024-09-12T17:00:02.683370+0000","last_fullsized":"2024-09-12T17:00:02.683370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:23.577096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056755300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:00:02.681561+0000","last_change":"2024-09-12T17:00:02.681561+0000","last_active":"2024-09-12T17:00:02.681561+0000","last_peered":"2024-09-12T17:00:02.681561+0000","last_clean":"2024-09-12T17:00:02.681561+0000","last_became_active":"2024-09-12T17:00:00.668696+0000","last_became_peered":"2024-09-12T17:00:00.668696+0000","last_unstale":"2024-09-12T17:00:02.681561+0000","last_undegraded":"2024-09-12T17:00:02.681561+0000","last_fullsized":"2024-09-12T17:00:02.681561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:34.470591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012259720000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:00:02.677610+0000","last_change":"2024-09-12T17:00:02.677610+0000","last_active":"2024-09-12T17:00:02.677610+0000","last_peered":"2024-09-12T17:00:02.677610+0000","last_clean":"2024-09-12T17:00:02.677610+0000","last_became_active":"2024-09-12T17:00:01.173083+0000","last_became_peered":"2024-09-12T17:00:01.173083+0000","last_unstale":"2024-09-12T17:00:02.677610+0000","last_undegraded":"2024-09-12T17:00:02.677610+0000","last_fullsized":"2024-09-12T17:00:02.677610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:35.997474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056135799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:00:02.996579+0000","last_change":"2024-09-12T17:00:02.996796+0000","last_active":"2024-09-12T17:00:02.996579+0000","last_peered":"2024-09-12T17:00:02.996579+0000","last_clean":"2024-09-12T17:00:02.996579+0000","last_became_active":"2024-09-12T17:00:00.671211+0000","last_became_peered":"2024-09-12T17:00:00.671211+0000","last_unstale":"2024-09-12T17:00:02.996579+0000","last_undegraded":"2024-09-12T17:00:02.996579+0000","last_fullsized":"2024-09-12T17:00:02.996579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:37.005108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000441562,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:00:02.680655+0000","last_change":"2024-09-12T17:00:02.680922+0000","last_active":"2024-09-12T17:00:02.680655+0000","last_peered":"2024-09-12T17:00:02.680655+0000","last_clean":"2024-09-12T17:00:02.680655+0000","last_became_active":"2024-09-12T17:00:00.669728+0000","last_became_peered":"2024-09-12T17:00:00.669728+0000","last_unstale":"2024-09-12T17:00:02.680655+0000","last_undegraded":"2024-09-12T17:00:02.680655+0000","last_fullsized":"2024-09-12T17:00:02.680655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:04.614720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058116500000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:00:02.996252+0000","last_change":"2024-09-12T16:59:54.636782+0000","last_active":"2024-09-12T17:00:02.996252+0000","last_peered":"2024-09-12T17:00:02.996252+0000","last_clean":"2024-09-12T17:00:02.996252+0000","last_became_active":"2024-09-12T16:59:54.636487+0000","last_became_peered":"2024-09-12T16:59:54.636487+0000","last_unstale":"2024-09-12T17:00:02.996252+0000","last_undegraded":"2024-09-12T17:00:02.996252+0000","last_fullsized":"2024-09-12T17:00:02.996252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:53.619137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:53.619137+0000","last_clean_scrub_stamp":"2024-09-12T16:59:53.619137+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:25.991554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":76368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36148,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335692,"statfs":{"total":96636764160,"available":96599748608,"internally_reserved":0,"allocated":815104,"data_stored":666736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":221184,"data_stored":76368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35576,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336264,"statfs":{"total":96636764160,"available":96600334336,"internally_reserved":0,"allocated":225280,"data_stored":76387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":666736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35564,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":221184,"data_stored":76368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:00:07.458 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T17:00:07.458 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T17:00:07.458 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T17:00:07.458 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T17:00:07.811 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:00:07.811 INFO:teuthology.orchestra.run.smithi067.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T17:00:07.823 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T17:00:07.823 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-12T17:00:07.835 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-09-12T17:00:07.836 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-12T17:00:07.869 DEBUG:teuthology.orchestra.run.smithi067:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-09-12T17:00:08.155 INFO:teuthology.orchestra.run.smithi067.stderr:..+...+........+....+..+......+............+..........+...+..+...+...+++++++++++++++++++++++++++++++++++++++++++++*.......+.....+....+......+..+....+.....+++++++++++++++++++++++++++++++++++++++++++++*....+.........................+..+...................+.....+.........+..........+..+....+...+.....+.......+.....+....+..+.......+..+.....................+..........+...+.....+.+.....+...+.............+.................+............+....+.....+....+...+...+...........+....+......+...+........+.......+......+..............+...+...+.+...+..+.+........+++++ 2024-09-12T17:00:08.437 INFO:teuthology.orchestra.run.smithi067.stderr:....+...+..+.+..+.........+....+......+.....+....+......+......+..+...+.............+..+.........+....+..............+......+....+...+..................+++++++++++++++++++++++++++++++++++++++++++++*.+....+..............+.......+.....+...+..........+............+.........+...+..+......+.......+...+.....+.........+...+...............+...+....+......+..+.+.........+..+...+.+.....+......+++++++++++++++++++++++++++++++++++++++++++++*...+...+......+.....+.+.........+......+.........+...........+..........+...............+.................+...............+.+.....................+..................+........+...+....+..+....+..+............................+..+...+.+...+...+...+.....+....+............+...........+.......+...+........+.+......+.....+............+...+.......+.....+..........+........+...+......+....+.....+.+........+...............+...+.......+..+.+.....+...+......+....+......+........+.....................+.........................+..............+..........+..+....+..+.......+...+..+.......+.....+.........+..........+......+...+......+......+......+.....+...+......+......+++++ 2024-09-12T17:00:08.462 INFO:teuthology.orchestra.run.smithi067.stderr:----- 2024-09-12T17:00:08.472 DEBUG:teuthology.orchestra.run.smithi067:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2024-09-12T17:00:08.514 DEBUG:teuthology.orchestra.run.smithi067:> sudo update-ca-trust 2024-09-12T17:00:09.645 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-12T17:00:09.675 DEBUG:teuthology.orchestra.run.smithi067:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi067.front.sepia.ceph.com 2024-09-12T17:00:09.780 INFO:teuthology.orchestra.run.smithi067.stderr:....+......+++++++++++++++++++++++++++++++++++++++*.+++++++++++++++++++++++++++++++++++++++*............+.+..+......+.......+.....+..........+...+.........+............+...+............+.........++++++ 2024-09-12T17:00:09.781 INFO:teuthology.orchestra.run.smithi067.stderr:.....+....+............+.........+...+..+...+...+..........+..............+...+.+...........+....+.........+......+.....+..........+......+.........+..+...+.+.....+......+....+...+...............+..+.+...+...........+....+++++++++++++++++++++++++++++++++++++++*...+.....+.+.....+...+.......+.....+....+++++++++++++++++++++++++++++++++++++++*.....+...................+..+.......+......+.....+..........+..+.........++++++ 2024-09-12T17:00:09.781 INFO:teuthology.orchestra.run.smithi067.stderr:----- 2024-09-12T17:00:09.781 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T17:00:09.781 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T17:00:09.851 DEBUG:teuthology.orchestra.run.smithi067:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T17:00:09.930 INFO:teuthology.orchestra.run.smithi067.stderr:Certificate request self-signature ok 2024-09-12T17:00:09.930 INFO:teuthology.orchestra.run.smithi067.stderr:subject=CN=smithi067.front.sepia.ceph.com 2024-09-12T17:00:09.940 DEBUG:teuthology.orchestra.run.smithi067:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T17:00:10.009 DEBUG:teuthology.orchestra.run.smithi067:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-12T17:00:10.081 INFO:teuthology.orchestra.run.smithi067.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-09-12T17:00:10.082 DEBUG:teuthology.orchestra.run.smithi067:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-12T17:00:10.152 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T17:00:10.166 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-09-12T17:00:10.166 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T17:00:10.167 INFO:tasks.rgw:Creating data pools 2024-09-12T17:00:10.167 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T17:00:10.167 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-12T17:00:11.289 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T17:00:11.314 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T17:00:12.290 INFO:teuthology.orchestra.run.smithi067.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T17:00:12.313 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T17:00:13.306 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T17:00:13.332 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T17:00:14.308 INFO:teuthology.orchestra.run.smithi067.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T17:00:14.340 DEBUG:tasks.rgw:Pools created 2024-09-12T17:00:14.340 INFO:tasks.rgw:Configuring compression type = random 2024-09-12T17:00:14.340 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:00:14.340 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:00:14.340 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:00:14.452 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:00:14.453 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:00:16.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.356+0000 7f83d3414640 0 -- 172.21.15.67:0/632995559 >> [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] conn(0x7f82a8076440 msgr2=0x7f82a8078900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:00:16.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.361+0000 7f83d6f23800 20 rados->read ofs=0 len=0 2024-09-12T17:00:16.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.362+0000 7f83d2c13640 0 -- 172.21.15.67:0/2917019047 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x562e562a5250 msgr2=0x562e562a76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:00:16.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.564+0000 7f83d6f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:16.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.564+0000 7f83d6f23800 20 realm 2024-09-12T17:00:16.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.564+0000 7f83d6f23800 20 rados->read ofs=0 len=0 2024-09-12T17:00:16.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.564+0000 7f83d6f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:16.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.564+0000 7f83d6f23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:00:16.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.564+0000 7f83d6f23800 20 rados->read ofs=0 len=0 2024-09-12T17:00:16.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.564+0000 7f83d6f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:16.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.564+0000 7f83d6f23800 20 rados->read ofs=0 len=0 2024-09-12T17:00:16.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.565+0000 7f83d6f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:16.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.565+0000 7f83d6f23800 20 rados->read ofs=0 len=0 2024-09-12T17:00:16.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.567+0000 7f83d6f23800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:00:16.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.567+0000 7f83d6f23800 20 searching for the correct realm 2024-09-12T17:00:16.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.579+0000 7f83d6f23800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:00:16.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.579+0000 7f83d6f23800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:00:16.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.579+0000 7f83d6f23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:00:16.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.579+0000 7f83d6f23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:00:16.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.579+0000 7f83d6f23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:00:16.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.579+0000 7f83d6f23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:00:16.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.579+0000 7f83d6f23800 20 rados->read ofs=0 len=0 2024-09-12T17:00:16.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.579+0000 7f83d6f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:16.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.579+0000 7f83d6f23800 20 rados->read ofs=0 len=0 2024-09-12T17:00:16.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.580+0000 7f83d6f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:16.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.580+0000 7f83d6f23800 20 rados->read ofs=0 len=0 2024-09-12T17:00:16.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.580+0000 7f83d6f23800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:00:16.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.580+0000 7f83d6f23800 20 zone default found 2024-09-12T17:00:16.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.580+0000 7f83d6f23800 4 Realm: () 2024-09-12T17:00:16.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.580+0000 7f83d6f23800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:00:16.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.580+0000 7f83d6f23800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:00:16.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.580+0000 7f83d6f23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:00:16.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.580+0000 7f83d6f23800 20 zonegroup default 2024-09-12T17:00:16.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.580+0000 7f83d6f23800 20 rados->read ofs=0 len=0 2024-09-12T17:00:16.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.580+0000 7f83d6f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:16.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:16.580+0000 7f83d6f23800 20 rados->read ofs=0 len=0 2024-09-12T17:00:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:18.327+0000 7f83d6f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:18.327+0000 7f83d6f23800 20 rados->read ofs=0 len=0 2024-09-12T17:00:18.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:18.330+0000 7f83d6f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:18.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:18.330+0000 7f83d6f23800 20 started sync module instance, tier type = 2024-09-12T17:00:18.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:18.330+0000 7f83d6f23800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:00:20.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.374+0000 7f83d6f23800 20 add_watcher() i=0 2024-09-12T17:00:20.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.374+0000 7f83d6f23800 20 add_watcher() i=1 2024-09-12T17:00:20.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.374+0000 7f83d6f23800 20 add_watcher() i=2 2024-09-12T17:00:20.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.374+0000 7f83d6f23800 20 add_watcher() i=3 2024-09-12T17:00:20.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.374+0000 7f83d6f23800 20 add_watcher() i=4 2024-09-12T17:00:20.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.374+0000 7f83d6f23800 20 add_watcher() i=5 2024-09-12T17:00:20.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.375+0000 7f83d6f23800 20 add_watcher() i=6 2024-09-12T17:00:20.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.378+0000 7f83d6f23800 20 add_watcher() i=7 2024-09-12T17:00:20.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.378+0000 7f83d6f23800 2 all 8 watchers are set, enabling cache 2024-09-12T17:00:20.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.378+0000 7f83d6f23800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-12T17:00:20.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.378+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-12T17:00:20.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.378+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.379+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-12T17:00:20.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.379+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-12T17:00:20.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.379+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.379+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-12T17:00:20.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.379+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-12T17:00:20.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.379+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.379+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-12T17:00:20.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.379+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-12T17:00:20.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.379+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.379+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-12T17:00:20.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.379+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-12T17:00:20.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.379+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.380+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-12T17:00:20.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.380+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-12T17:00:20.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.380+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.380+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-12T17:00:20.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.380+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-12T17:00:20.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.380+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.381+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-12T17:00:20.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.381+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-12T17:00:20.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.381+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.381+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-12T17:00:20.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.381+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-12T17:00:20.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.381+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.381+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-12T17:00:20.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.381+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-12T17:00:20.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.381+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.381+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-12T17:00:20.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.381+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-12T17:00:20.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.381+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.382+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-12T17:00:20.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.382+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-12T17:00:20.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.382+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.382+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-12T17:00:20.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.382+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-12T17:00:20.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.382+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.382+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-12T17:00:20.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.382+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-12T17:00:20.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.382+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.383+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-12T17:00:20.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.383+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-12T17:00:20.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.383+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.383+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-12T17:00:20.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.383+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-12T17:00:20.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.383+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.383+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-12T17:00:20.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.383+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-12T17:00:20.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.383+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.383+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-12T17:00:20.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.383+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-12T17:00:20.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.383+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.384+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-12T17:00:20.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.384+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-12T17:00:20.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.384+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.384+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-12T17:00:20.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.384+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-12T17:00:20.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.384+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.384+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-12T17:00:20.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.384+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-12T17:00:20.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.384+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.385+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-12T17:00:20.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.385+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-12T17:00:20.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.385+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.385+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-12T17:00:20.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.385+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-12T17:00:20.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.385+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.385+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-12T17:00:20.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.385+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-12T17:00:20.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.385+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.385+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-12T17:00:20.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.385+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-12T17:00:20.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.385+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.386+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-12T17:00:20.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.386+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-12T17:00:20.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.386+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.386+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-12T17:00:20.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.386+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-12T17:00:20.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.386+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.386+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-12T17:00:20.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.386+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-12T17:00:20.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.386+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.387+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-12T17:00:20.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.387+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-12T17:00:20.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.387+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.387+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-12T17:00:20.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.387+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-12T17:00:20.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.387+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.387+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-12T17:00:20.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.387+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-12T17:00:20.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.387+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.388+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-12T17:00:20.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.388+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-12T17:00:20.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.388+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.388+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-12T17:00:20.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.388+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-12T17:00:20.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.388+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.388+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-12T17:00:20.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.388+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-12T17:00:20.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.388+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.389+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-12T17:00:20.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.389+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-12T17:00:20.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.389+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.389+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-12T17:00:20.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.389+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-12T17:00:20.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.389+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.389+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-12T17:00:20.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.389+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-12T17:00:20.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.389+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.389+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-12T17:00:20.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.389+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-12T17:00:20.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.389+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.390+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-12T17:00:20.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.390+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-12T17:00:20.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.390+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.390+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-12T17:00:20.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.390+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-12T17:00:20.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.390+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.390+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-12T17:00:20.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.390+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-12T17:00:20.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.390+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.391+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-12T17:00:20.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.391+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-12T17:00:20.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.391+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.391+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-12T17:00:20.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.391+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-12T17:00:20.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.391+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.391+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-12T17:00:20.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.391+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-12T17:00:20.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.391+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.391+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-12T17:00:20.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.391+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-12T17:00:20.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.391+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.392+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-12T17:00:20.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.392+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-12T17:00:20.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.392+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.392+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-12T17:00:20.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.392+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-12T17:00:20.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.392+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.392+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-12T17:00:20.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.392+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-12T17:00:20.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.392+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.393+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-12T17:00:20.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.393+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-12T17:00:20.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.393+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.393+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-12T17:00:20.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.393+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-12T17:00:20.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.393+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.393+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-12T17:00:20.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.393+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-12T17:00:20.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.393+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.394+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-12T17:00:20.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.394+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-12T17:00:20.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.394+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.394+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-12T17:00:20.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.394+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-12T17:00:20.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.394+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.394+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-12T17:00:20.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.394+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-12T17:00:20.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.394+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.394+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-12T17:00:20.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.394+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-12T17:00:20.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.394+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.395+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-12T17:00:20.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.395+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-12T17:00:20.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.395+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.395+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-12T17:00:20.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.395+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-12T17:00:20.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.395+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.395+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-12T17:00:20.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.395+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-12T17:00:20.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.395+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.395+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-12T17:00:20.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.395+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-12T17:00:20.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.395+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.396+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-12T17:00:20.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.396+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-12T17:00:20.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.396+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.396+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-12T17:00:20.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.396+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-12T17:00:20.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.396+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.396+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-12T17:00:20.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.396+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-12T17:00:20.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.396+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.396+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-12T17:00:20.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.396+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-12T17:00:20.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.396+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.397+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-12T17:00:20.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.397+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-12T17:00:20.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.397+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.397+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-12T17:00:20.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.397+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-12T17:00:20.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.397+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.397+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-12T17:00:20.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.397+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-12T17:00:20.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.397+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.397+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-12T17:00:20.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.397+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-12T17:00:20.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.397+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.398+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-12T17:00:20.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.398+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-12T17:00:20.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.398+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.398+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-12T17:00:20.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.398+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-12T17:00:20.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.398+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.398+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-12T17:00:20.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.398+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-12T17:00:20.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.398+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.399+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-12T17:00:20.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.399+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-12T17:00:20.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.399+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.399+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-12T17:00:20.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.399+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-12T17:00:20.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.399+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.399+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-12T17:00:20.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.399+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-12T17:00:20.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.399+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.399+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-12T17:00:20.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.399+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-12T17:00:20.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.399+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.400+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-12T17:00:20.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.400+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-12T17:00:20.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.400+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.400+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-12T17:00:20.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.400+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-12T17:00:20.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.400+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.400+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-12T17:00:20.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.400+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-12T17:00:20.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.400+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.400+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-12T17:00:20.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.400+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-12T17:00:20.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.400+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.401+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-12T17:00:20.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.401+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-12T17:00:20.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.401+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.401+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-12T17:00:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.401+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-12T17:00:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.401+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.401+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-12T17:00:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.401+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-12T17:00:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.401+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.401+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-12T17:00:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.401+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-12T17:00:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.401+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.402+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-12T17:00:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.402+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-12T17:00:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.402+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.402+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-12T17:00:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.402+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-12T17:00:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.402+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.402+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-12T17:00:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.402+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-12T17:00:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.402+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.403+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-12T17:00:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.403+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-12T17:00:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.403+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.403+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-12T17:00:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.403+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-12T17:00:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.403+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.403+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-12T17:00:20.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.403+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-12T17:00:20.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.403+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.403+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-12T17:00:20.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.403+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-12T17:00:20.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.403+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.404+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-12T17:00:20.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.404+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-12T17:00:20.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.404+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.404+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-12T17:00:20.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.404+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-12T17:00:20.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.404+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.404+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-12T17:00:20.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.404+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-12T17:00:20.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.404+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.404+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-12T17:00:20.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.404+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-12T17:00:20.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.404+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.405+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-12T17:00:20.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.405+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-12T17:00:20.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.405+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.405+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-12T17:00:20.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.405+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-12T17:00:20.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.405+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.405+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-12T17:00:20.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.405+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-12T17:00:20.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.405+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.405+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-12T17:00:20.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.405+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-12T17:00:20.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.405+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.406+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-12T17:00:20.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.406+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-12T17:00:20.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.406+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.406+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-12T17:00:20.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.406+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-12T17:00:20.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.406+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.406+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-12T17:00:20.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.406+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-12T17:00:20.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.406+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.406+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-12T17:00:20.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.406+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-12T17:00:20.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.406+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.407+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-12T17:00:20.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.407+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-12T17:00:20.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.407+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.408+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-12T17:00:20.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.408+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-12T17:00:20.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.408+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.408+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-12T17:00:20.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.408+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-12T17:00:20.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.408+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.408+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-12T17:00:20.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.408+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-12T17:00:20.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.408+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.409+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-12T17:00:20.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.409+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-12T17:00:20.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.409+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.409+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-12T17:00:20.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.409+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-12T17:00:20.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.409+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.409+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-12T17:00:20.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.409+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-12T17:00:20.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.409+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.409+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-12T17:00:20.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.409+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-12T17:00:20.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.409+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.410+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-12T17:00:20.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.410+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-12T17:00:20.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.410+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.410+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-12T17:00:20.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.410+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-12T17:00:20.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.410+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.411+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-12T17:00:20.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.411+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-12T17:00:20.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.411+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.411+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-12T17:00:20.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.411+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-12T17:00:20.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.411+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.411+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-12T17:00:20.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.411+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-12T17:00:20.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.411+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.411+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-12T17:00:20.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.411+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-12T17:00:20.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.411+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.412+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-12T17:00:20.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.412+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-12T17:00:20.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.412+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.412+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-12T17:00:20.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.412+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-12T17:00:20.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.412+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.412+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-12T17:00:20.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.412+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-12T17:00:20.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.412+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.412+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-12T17:00:20.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.412+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-12T17:00:20.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.412+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.412+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-12T17:00:20.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.412+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-12T17:00:20.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.412+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.413+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-12T17:00:20.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.413+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-12T17:00:20.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.413+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.413+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-12T17:00:20.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.413+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-12T17:00:20.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.413+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.413+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-12T17:00:20.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.413+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-12T17:00:20.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.413+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.414+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-12T17:00:20.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.414+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-12T17:00:20.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.414+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.414+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-12T17:00:20.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.414+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-12T17:00:20.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.414+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.414+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-12T17:00:20.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.414+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-12T17:00:20.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.414+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.414+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-12T17:00:20.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.414+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-12T17:00:20.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.414+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.415+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-12T17:00:20.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.415+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-12T17:00:20.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.415+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.415+0000 7f83d6f23800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-12T17:00:20.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.415+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-12T17:00:20.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.416+0000 7f83d6f23800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:00:20.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.421+0000 7f82857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:20.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.421+0000 7f83d6f23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:00:20.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:20.421+0000 7f83d6f23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:00:23.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.345+0000 7f83d6f23800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-12T17:00:23.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.346+0000 7f83d6f23800 5 note: GC not initialized 2024-09-12T17:00:23.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.346+0000 7f83d6f23800 20 init_complete bucket index max shards: 1 2024-09-12T17:00:23.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.346+0000 7f83d6f23800 20 Filter name: none 2024-09-12T17:00:23.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.347+0000 7f81edffb640 20 reqs_thread_entry: start 2024-09-12T17:00:23.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.346+0000 7f81effff640 20 reqs_thread_entry: start 2024-09-12T17:00:23.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.372+0000 7f82857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:23.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.375+0000 7f83d6f23800 20 remove_watcher() i=0 2024-09-12T17:00:23.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.375+0000 7f83d6f23800 2 removed watcher, disabling cache 2024-09-12T17:00:23.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.377+0000 7f83d6f23800 20 remove_watcher() i=1 2024-09-12T17:00:23.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.378+0000 7f83d6f23800 20 remove_watcher() i=2 2024-09-12T17:00:23.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.382+0000 7f83d6f23800 20 remove_watcher() i=3 2024-09-12T17:00:23.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.384+0000 7f83d6f23800 20 remove_watcher() i=4 2024-09-12T17:00:23.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.385+0000 7f83d6f23800 20 remove_watcher() i=5 2024-09-12T17:00:23.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.388+0000 7f83d6f23800 20 remove_watcher() i=6 2024-09-12T17:00:23.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.389+0000 7f83d6f23800 20 remove_watcher() i=7 2024-09-12T17:00:23.416 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-12T17:00:23.416 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:00:23.416 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T17:00:23.416 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T17:00:23.416 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-12T17:00:23.483 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:00:23.483 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:00:23.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.509+0000 7fba9ce0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:00:23.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.509+0000 7fba9ce0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:00:23.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.513+0000 7fb90e7fc640 20 reqs_thread_entry: start 2024-09-12T17:00:23.531 INFO:teuthology.orchestra.run.smithi067.stdout:{"id":"06eb12d0-49d6-461d-9efe-05d212954deb","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T17:00:23.531 DEBUG:tasks.util.rgw: json result: {'id': '06eb12d0-49d6-461d-9efe-05d212954deb', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T17:00:23.531 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:00:23.531 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:00:23.532 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:00:23.589 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:00:23.591 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:00:23.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.622+0000 7fcc6f124800 20 rados->read ofs=0 len=0 2024-09-12T17:00:23.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.624+0000 7fcc6f124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:23.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.624+0000 7fcc6f124800 20 realm 2024-09-12T17:00:23.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.624+0000 7fcc6f124800 20 rados->read ofs=0 len=0 2024-09-12T17:00:23.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.624+0000 7fcc6f124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:23.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.624+0000 7fcc6f124800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:00:23.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.624+0000 7fcc6f124800 20 rados->read ofs=0 len=0 2024-09-12T17:00:23.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.625+0000 7fcc6f124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:23.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.625+0000 7fcc6f124800 20 rados->read ofs=0 len=0 2024-09-12T17:00:23.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.626+0000 7fcc6f124800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:23.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.626+0000 7fcc6f124800 20 rados->read ofs=0 len=0 2024-09-12T17:00:23.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.627+0000 7fcc6f124800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T17:00:23.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.627+0000 7fcc6f124800 20 searching for the correct realm 2024-09-12T17:00:23.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.630+0000 7fcc6b557640 0 -- 172.21.15.67:0/83639614 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x55b7c6eeefd0 msgr2=0x55b7c6ef1490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:23.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.633+0000 7fcc6ad56640 0 -- 172.21.15.67:0/83639614 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fcc60017040 msgr2=0x7fcc600ab0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:23.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.638+0000 7fcc6f124800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:00:23.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.638+0000 7fcc6f124800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:00:23.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.638+0000 7fcc6f124800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:00:23.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.638+0000 7fcc6f124800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:00:23.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.638+0000 7fcc6f124800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:00:23.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.638+0000 7fcc6f124800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:00:23.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.638+0000 7fcc6f124800 20 rados->read ofs=0 len=0 2024-09-12T17:00:23.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.638+0000 7fcc6f124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:23.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.638+0000 7fcc6f124800 20 rados->read ofs=0 len=0 2024-09-12T17:00:23.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.638+0000 7fcc6f124800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:23.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.638+0000 7fcc6f124800 20 rados->read ofs=0 len=0 2024-09-12T17:00:23.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.639+0000 7fcc6f124800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:00:23.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.639+0000 7fcc6f124800 20 zone default found 2024-09-12T17:00:23.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.639+0000 7fcc6f124800 4 Realm: () 2024-09-12T17:00:23.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.639+0000 7fcc6f124800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:00:23.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.639+0000 7fcc6f124800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:00:23.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.639+0000 7fcc6f124800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:00:23.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.639+0000 7fcc6f124800 20 zonegroup default 2024-09-12T17:00:23.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.639+0000 7fcc6f124800 20 rados->read ofs=0 len=0 2024-09-12T17:00:23.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.639+0000 7fcc6f124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:23.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.639+0000 7fcc6f124800 20 rados->read ofs=0 len=0 2024-09-12T17:00:23.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.639+0000 7fcc6f124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:23.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.639+0000 7fcc6f124800 20 rados->read ofs=0 len=0 2024-09-12T17:00:23.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.639+0000 7fcc6f124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:23.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.639+0000 7fcc6f124800 20 started sync module instance, tier type = 2024-09-12T17:00:23.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.639+0000 7fcc6f124800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:00:23.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.655+0000 7fcc6f124800 20 add_watcher() i=0 2024-09-12T17:00:23.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.655+0000 7fcc6f124800 20 add_watcher() i=1 2024-09-12T17:00:23.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.655+0000 7fcc6f124800 20 add_watcher() i=2 2024-09-12T17:00:23.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.655+0000 7fcc6f124800 20 add_watcher() i=3 2024-09-12T17:00:23.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.655+0000 7fcc6f124800 20 add_watcher() i=4 2024-09-12T17:00:23.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.655+0000 7fcc6f124800 20 add_watcher() i=5 2024-09-12T17:00:23.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.655+0000 7fcc6f124800 20 add_watcher() i=6 2024-09-12T17:00:23.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.656+0000 7fcc6f124800 20 add_watcher() i=7 2024-09-12T17:00:23.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.656+0000 7fcc6f124800 2 all 8 watchers are set, enabling cache 2024-09-12T17:00:23.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.658+0000 7fcb217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:23.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.658+0000 7fcc6f124800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:00:23.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.658+0000 7fcc6f124800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:00:23.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.658+0000 7fcc6f124800 5 note: GC not initialized 2024-09-12T17:00:23.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.658+0000 7fca9bfff640 20 reqs_thread_entry: start 2024-09-12T17:00:23.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.658+0000 7fcc6f124800 20 init_complete bucket index max shards: 1 2024-09-12T17:00:23.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.658+0000 7fcc6f124800 20 Filter name: none 2024-09-12T17:00:23.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.658+0000 7fca99ffb640 20 reqs_thread_entry: start 2024-09-12T17:00:23.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.667+0000 7fcb217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:23.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.670+0000 7fcc6f124800 20 remove_watcher() i=0 2024-09-12T17:00:23.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.670+0000 7fcc6f124800 2 removed watcher, disabling cache 2024-09-12T17:00:23.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.671+0000 7fcc6f124800 20 remove_watcher() i=1 2024-09-12T17:00:23.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.672+0000 7fcc6f124800 20 remove_watcher() i=2 2024-09-12T17:00:23.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.673+0000 7fcc6f124800 20 remove_watcher() i=3 2024-09-12T17:00:23.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.674+0000 7fcc6f124800 20 remove_watcher() i=4 2024-09-12T17:00:23.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.675+0000 7fcc6f124800 20 remove_watcher() i=5 2024-09-12T17:00:23.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.676+0000 7fcc6f124800 20 remove_watcher() i=6 2024-09-12T17:00:23.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.678+0000 7fcc6f124800 20 remove_watcher() i=7 2024-09-12T17:00:23.691 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-12T17:00:23.691 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:00:23.691 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T17:00:23.691 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T17:00:23.691 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-12T17:00:23.756 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:00:23.756 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:00:23.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.782+0000 7fa6d431f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:00:23.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.782+0000 7fa6d431f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:00:23.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:23.786+0000 7fa52e7fc640 20 reqs_thread_entry: start 2024-09-12T17:00:23.804 INFO:teuthology.orchestra.run.smithi067.stdout:{"id":"06eb12d0-49d6-461d-9efe-05d212954deb","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:00:23.804 DEBUG:tasks.util.rgw: json result: {'id': '06eb12d0-49d6-461d-9efe-05d212954deb', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:00:23.804 INFO:tasks.rgw:Preparing directory for rgw datacache at /tmp/rgw_datacache 2024-09-12T17:00:23.804 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p /tmp/rgw_datacache 2024-09-12T17:00:23.834 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a+rwx /tmp/rgw_datacache 2024-09-12T17:00:23.913 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:00:23.913 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:00:23.913 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:00:24.011 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:00:24.011 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:00:24.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.045+0000 7f41edb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:00:24.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.047+0000 7f41edb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:24.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.047+0000 7f41edb0c800 20 realm 2024-09-12T17:00:24.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.047+0000 7f41edb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:00:24.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.047+0000 7f41edb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:24.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.047+0000 7f41edb0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:00:24.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.047+0000 7f41edb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:00:24.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.047+0000 7f41edb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:24.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.047+0000 7f41edb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:00:24.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.048+0000 7f41edb0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:24.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.048+0000 7f41edb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:00:24.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.049+0000 7f41edb0c800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T17:00:24.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.049+0000 7f41edb0c800 20 searching for the correct realm 2024-09-12T17:00:24.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.052+0000 7f41ebdf7640 0 -- 172.21.15.67:0/3617907359 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x560f400a5fc0 msgr2=0x560f400a8450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:24.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.056+0000 7f41eb5f6640 0 -- 172.21.15.67:0/3617907359 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f41e00ac960 msgr2=0x7f41e00aa800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:24.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.060+0000 7f41edb0c800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:00:24.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.060+0000 7f41edb0c800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:00:24.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.060+0000 7f41edb0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:00:24.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.060+0000 7f41edb0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:00:24.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.060+0000 7f41edb0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:00:24.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.060+0000 7f41edb0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:00:24.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.060+0000 7f41edb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:00:24.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.060+0000 7f41edb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:24.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.060+0000 7f41edb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:00:24.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.061+0000 7f41edb0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:24.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.061+0000 7f41edb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:00:24.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.061+0000 7f41edb0c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:00:24.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.061+0000 7f41edb0c800 20 zone default found 2024-09-12T17:00:24.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.061+0000 7f41edb0c800 4 Realm: () 2024-09-12T17:00:24.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.061+0000 7f41edb0c800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:00:24.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.061+0000 7f41edb0c800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:00:24.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.061+0000 7f41edb0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:00:24.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.061+0000 7f41edb0c800 20 zonegroup default 2024-09-12T17:00:24.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.061+0000 7f41edb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:00:24.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.061+0000 7f41edb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:24.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.061+0000 7f41edb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:00:24.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.062+0000 7f41edb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:24.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.062+0000 7f41edb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:00:24.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.062+0000 7f41edb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:24.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.062+0000 7f41edb0c800 20 started sync module instance, tier type = 2024-09-12T17:00:24.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.062+0000 7f41edb0c800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:00:24.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.079+0000 7f41edb0c800 20 add_watcher() i=0 2024-09-12T17:00:24.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.079+0000 7f41edb0c800 20 add_watcher() i=1 2024-09-12T17:00:24.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.079+0000 7f41edb0c800 20 add_watcher() i=2 2024-09-12T17:00:24.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.079+0000 7f41edb0c800 20 add_watcher() i=3 2024-09-12T17:00:24.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.079+0000 7f41edb0c800 20 add_watcher() i=4 2024-09-12T17:00:24.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.079+0000 7f41edb0c800 20 add_watcher() i=5 2024-09-12T17:00:24.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.079+0000 7f41edb0c800 20 add_watcher() i=6 2024-09-12T17:00:24.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.082+0000 7f41edb0c800 20 add_watcher() i=7 2024-09-12T17:00:24.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.082+0000 7f41edb0c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:00:24.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.084+0000 7f40a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:24.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.084+0000 7f41edb0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:00:24.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.084+0000 7f41edb0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:00:24.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.084+0000 7f41edb0c800 5 note: GC not initialized 2024-09-12T17:00:24.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.084+0000 7f40a0fe1640 20 reqs_thread_entry: start 2024-09-12T17:00:24.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.084+0000 7f41edb0c800 20 init_complete bucket index max shards: 1 2024-09-12T17:00:24.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.084+0000 7f41edb0c800 20 Filter name: none 2024-09-12T17:00:24.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.084+0000 7f401a7fc640 20 reqs_thread_entry: start 2024-09-12T17:00:24.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.094+0000 7f40a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:24.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.096+0000 7f41edb0c800 20 remove_watcher() i=0 2024-09-12T17:00:24.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.096+0000 7f41edb0c800 2 removed watcher, disabling cache 2024-09-12T17:00:24.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.097+0000 7f41edb0c800 20 remove_watcher() i=1 2024-09-12T17:00:24.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.100+0000 7f41edb0c800 20 remove_watcher() i=2 2024-09-12T17:00:24.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.101+0000 7f41edb0c800 20 remove_watcher() i=3 2024-09-12T17:00:24.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.102+0000 7f41edb0c800 20 remove_watcher() i=4 2024-09-12T17:00:24.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.103+0000 7f41edb0c800 20 remove_watcher() i=5 2024-09-12T17:00:24.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.104+0000 7f41edb0c800 20 remove_watcher() i=6 2024-09-12T17:00:24.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.105+0000 7f41edb0c800 20 remove_watcher() i=7 2024-09-12T17:00:24.118 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-12T17:00:24.118 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:00:24.118 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-12T17:00:24.118 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T17:00:24.118 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T17:00:24.118 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-12T17:00:24.183 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:00:24.183 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:00:24.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.208+0000 7ff257546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:00:24.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.208+0000 7ff257546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:00:24.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.212+0000 7ff0937fe640 20 reqs_thread_entry: start 2024-09-12T17:00:24.229 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-12T17:00:24.229 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-12T17:00:24.229 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T17:00:24.229 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T17:00:24.229 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-12T17:00:24.296 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:00:24.296 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:00:24.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.321+0000 7fbb55b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:00:24.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.321+0000 7fbb55b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:00:24.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.325+0000 7fb98f7fe640 20 reqs_thread_entry: start 2024-09-12T17:00:24.342 INFO:teuthology.orchestra.run.smithi067.stdout:{"id":"06eb12d0-49d6-461d-9efe-05d212954deb","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:00:24.342 DEBUG:tasks.util.rgw: json result: {'id': '06eb12d0-49d6-461d-9efe-05d212954deb', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:00:24.343 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-12T17:00:24.343 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T17:00:24.343 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T17:00:24.343 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-12T17:00:24.407 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:00:24.407 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:00:24.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.432+0000 7f4f60c10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:00:24.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.432+0000 7f4f60c10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:00:24.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.436+0000 7f4dca7fc640 20 reqs_thread_entry: start 2024-09-12T17:00:24.453 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-12T17:00:24.454 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-12T17:00:24.454 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T17:00:24.454 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T17:00:24.454 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-12T17:00:24.520 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:00:24.521 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:00:24.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.546+0000 7f8be7926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:00:24.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.546+0000 7f8be7926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:00:24.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:00:24.549+0000 7f8a59ffb640 20 reqs_thread_entry: start 2024-09-12T17:00:24.568 INFO:teuthology.orchestra.run.smithi067.stdout:{"id":"06eb12d0-49d6-461d-9efe-05d212954deb","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:00:24.569 DEBUG:tasks.util.rgw: json result: {'id': '06eb12d0-49d6-461d-9efe-05d212954deb', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:00:24.569 INFO:tasks.rgw:Starting rgw... 2024-09-12T17:00:24.569 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-09-12T17:00:24.569 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T17:00:24.570 DEBUG:teuthology.orchestra.run.smithi067:> sudo echo -n https://smithi067.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T17:00:24.610 INFO:teuthology.orchestra.run.smithi067.stdout:https://smithi067.front.sepia.ceph.com:443 2024-09-12T17:00:24.611 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T17:00:24.691 DEBUG:teuthology.orchestra.run.smithi067:> sudo keytool -import -alias smithi067.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-09-12T17:00:24.902 INFO:teuthology.orchestra.run.smithi067.stderr:Warning: use -cacerts option to access cacerts keystore 2024-09-12T17:00:25.046 INFO:teuthology.orchestra.run.smithi067.stderr:Certificate was added to keystore 2024-09-12T17:00:25.067 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-09-12T17:00:25.068 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T17:00:25.068 DEBUG:teuthology.orchestra.run.smithi067:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T17:00:25.070 INFO:tasks.rgw.client.0:Started 2024-09-12T17:00:25.070 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi067.front.sepia.ceph.com:443/ 2024-09-12T17:00:25.070 DEBUG:teuthology.orchestra.run.smithi067:> curl https://smithi067.front.sepia.ceph.com:443/ 2024-09-12T17:00:25.108 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:00:25.108 INFO:teuthology.orchestra.run.smithi067.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:00:25.108 INFO:teuthology.orchestra.run.smithi067.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:00:25.108 INFO:teuthology.orchestra.run.smithi067.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:00:25.109 INFO:teuthology.orchestra.run.smithi067.stderr:curl: (7) Failed to connect to smithi067.front.sepia.ceph.com port 443: Connection refused 2024-09-12T17:00:26.110 DEBUG:teuthology.orchestra.run.smithi067:> curl https://smithi067.front.sepia.ceph.com:443/ 2024-09-12T17:00:26.144 INFO:teuthology.orchestra.run.smithi067.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:00:26.144 INFO:teuthology.orchestra.run.smithi067.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:00:26.145 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:00:26.145 INFO:teuthology.orchestra.run.smithi067.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:00:26.145 INFO:teuthology.orchestra.run.smithi067.stderr:curl: (7) Failed to connect to smithi067.front.sepia.ceph.com port 443: Connection refused 2024-09-12T17:00:28.146 DEBUG:teuthology.orchestra.run.smithi067:> curl https://smithi067.front.sepia.ceph.com:443/ 2024-09-12T17:00:28.181 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:00:28.182 INFO:teuthology.orchestra.run.smithi067.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:00:28.182 INFO:teuthology.orchestra.run.smithi067.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:00:28.182 INFO:teuthology.orchestra.run.smithi067.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:00:28.182 INFO:teuthology.orchestra.run.smithi067.stderr:curl: (7) Failed to connect to smithi067.front.sepia.ceph.com port 443: Connection refused 2024-09-12T17:00:32.183 DEBUG:teuthology.orchestra.run.smithi067:> curl https://smithi067.front.sepia.ceph.com:443/ 2024-09-12T17:00:32.217 INFO:teuthology.orchestra.run.smithi067.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:00:32.217 INFO:teuthology.orchestra.run.smithi067.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:00:32.219 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:00:32.220 INFO:teuthology.orchestra.run.smithi067.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:00:32.220 INFO:teuthology.orchestra.run.smithi067.stderr:curl: (7) Failed to connect to smithi067.front.sepia.ceph.com port 443: Connection refused 2024-09-12T17:00:40.221 DEBUG:teuthology.orchestra.run.smithi067:> curl https://smithi067.front.sepia.ceph.com:443/ 2024-09-12T17:00:40.256 INFO:teuthology.orchestra.run.smithi067.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:00:40.257 INFO:teuthology.orchestra.run.smithi067.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:00:40.258 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:00:40.259 INFO:teuthology.orchestra.run.smithi067.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:00:40.259 INFO:teuthology.orchestra.run.smithi067.stderr:curl: (7) Failed to connect to smithi067.front.sepia.ceph.com port 443: Connection refused 2024-09-12T17:00:49.412 INFO:tasks.rgw.client.0.smithi067.stdout:2024-09-12T17:00:49.162+0000 a1be240 -1 ssl_private_key was not found: rgw/cert//default.key 2024-09-12T17:00:56.260 DEBUG:teuthology.orchestra.run.smithi067:> curl https://smithi067.front.sepia.ceph.com:443/ 2024-09-12T17:00:56.300 INFO:teuthology.orchestra.run.smithi067.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:00:56.300 INFO:teuthology.orchestra.run.smithi067.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:00:57.331 INFO:teuthology.orchestra.run.smithi067.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 181 0 --:--:-- 0:00:01 --:--:-- 181 2024-09-12T17:00:57.333 INFO:teuthology.orchestra.run.smithi067.stdout:anonymous 2024-09-12T17:00:57.333 INFO:teuthology.run_tasks:Running task tox... 2024-09-12T17:00:57.347 INFO:tasks.tox:Deploying tox from pip... 2024-09-12T17:00:57.347 DEBUG:teuthology.orchestra.run.smithi067:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-12T17:00:59.752 DEBUG:teuthology.orchestra.run.smithi067:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-12T17:01:00.288 INFO:teuthology.orchestra.run.smithi067.stdout:Collecting tox==3.15.0 2024-09-12T17:01:00.352 INFO:teuthology.orchestra.run.smithi067.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-12T17:01:00.480 INFO:teuthology.orchestra.run.smithi067.stdout:Collecting py<2,>=1.4.17 2024-09-12T17:01:00.493 INFO:teuthology.orchestra.run.smithi067.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-12T17:01:00.768 INFO:teuthology.orchestra.run.smithi067.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-12T17:01:00.786 INFO:teuthology.orchestra.run.smithi067.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-12T17:01:00.999 INFO:teuthology.orchestra.run.smithi067.stdout:Collecting pluggy<1,>=0.12.0 2024-09-12T17:01:01.014 INFO:teuthology.orchestra.run.smithi067.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-12T17:01:01.087 INFO:teuthology.orchestra.run.smithi067.stdout:Collecting six<2,>=1.14.0 2024-09-12T17:01:01.101 INFO:teuthology.orchestra.run.smithi067.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:01:01.207 INFO:teuthology.orchestra.run.smithi067.stdout:Collecting packaging>=14 2024-09-12T17:01:01.221 INFO:teuthology.orchestra.run.smithi067.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-12T17:01:01.307 INFO:teuthology.orchestra.run.smithi067.stdout:Collecting toml>=0.9.4 2024-09-12T17:01:01.321 INFO:teuthology.orchestra.run.smithi067.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-12T17:01:01.435 INFO:teuthology.orchestra.run.smithi067.stdout:Collecting filelock<4,>=3.0.0 2024-09-12T17:01:01.448 INFO:teuthology.orchestra.run.smithi067.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-12T17:01:01.569 INFO:teuthology.orchestra.run.smithi067.stdout:Collecting distlib<1,>=0.3.7 2024-09-12T17:01:01.584 INFO:teuthology.orchestra.run.smithi067.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-12T17:01:01.710 INFO:teuthology.orchestra.run.smithi067.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-12T17:01:01.724 INFO:teuthology.orchestra.run.smithi067.stdout: Downloading platformdirs-4.3.2-py3-none-any.whl (18 kB) 2024-09-12T17:01:01.843 INFO:teuthology.orchestra.run.smithi067.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-09-12T17:01:02.744 INFO:teuthology.orchestra.run.smithi067.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-12T17:01:02.959 INFO:teuthology.orchestra.run.smithi067.stderr:WARNING: You are using pip version 21.3.1; however, version 24.2 is available. 2024-09-12T17:01:02.959 INFO:teuthology.orchestra.run.smithi067.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-09-12T17:01:03.021 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:01:03.037 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:01:03.037 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:01:03.037 DEBUG:teuthology.orchestra.run.smithi067:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:01:03.067 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:01:03.068 INFO:teuthology.orchestra.run.smithi067.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:01:03.068 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:01:03.138 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:01:03.138 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:01:03.209 INFO:tasks.workunit:timeout=3h 2024-09-12T17:01:03.209 INFO:tasks.workunit:cleanup=True 2024-09-12T17:01:03.209 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:01:03.280 INFO:tasks.workunit.client.0.smithi067.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:02:03.999 INFO:tasks.workunit.client.0.smithi067.stderr:Updating files: 92% (11705/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:02:04.321 INFO:tasks.workunit.client.0.smithi067.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:02:04.321 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:02:04.321 INFO:tasks.workunit.client.0.smithi067.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:02:04.321 INFO:tasks.workunit.client.0.smithi067.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:02:04.321 INFO:tasks.workunit.client.0.smithi067.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:02:04.321 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:02:04.321 INFO:tasks.workunit.client.0.smithi067.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:02:04.321 INFO:tasks.workunit.client.0.smithi067.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:02:04.321 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:02:04.321 INFO:tasks.workunit.client.0.smithi067.stderr: git switch -c 2024-09-12T17:02:04.322 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:02:04.322 INFO:tasks.workunit.client.0.smithi067.stderr:Or undo this operation with: 2024-09-12T17:02:04.322 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:02:04.322 INFO:tasks.workunit.client.0.smithi067.stderr: git switch - 2024-09-12T17:02:04.322 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:02:04.322 INFO:tasks.workunit.client.0.smithi067.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:02:04.322 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:02:04.322 INFO:tasks.workunit.client.0.smithi067.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:02:04.326 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:02:04.401 INFO:tasks.workunit.client.0.smithi067.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:02:04.403 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:02:04.403 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:02:05.060 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:02:05.138 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:02:05.180 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:02:05.182 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:02:05.182 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:02:05.223 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:02:05.227 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T17:02:05.227 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:02:05.297 INFO:tasks.workunit:Running workunits matching rgw/run-datacache.sh on client.0... 2024-09-12T17:02:05.299 INFO:tasks.workunit:Running workunit rgw/run-datacache.sh... 2024-09-12T17:02:05.299 DEBUG:teuthology.orchestra.run.smithi067:workunit test rgw/run-datacache.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-12T17:02:05.372 INFO:tasks.workunit.client.0.smithi067.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-12T17:02:05.372 INFO:tasks.workunit.client.0.smithi067.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:02:05.372 INFO:tasks.workunit.client.0.smithi067.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:02:07.771 INFO:tasks.workunit.client.0.smithi067.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T17:02:07.771 INFO:tasks.workunit.client.0.smithi067.stderr:++ deactivate nondestructive 2024-09-12T17:02:07.771 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T17:02:07.771 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T17:02:07.771 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:02:07.772 INFO:tasks.workunit.client.0.smithi067.stderr:++ hash -r 2024-09-12T17:02:07.772 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T17:02:07.772 INFO:tasks.workunit.client.0.smithi067.stderr:++ unset VIRTUAL_ENV 2024-09-12T17:02:07.772 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T17:02:07.772 INFO:tasks.workunit.client.0.smithi067.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:02:07.772 INFO:tasks.workunit.client.0.smithi067.stderr:++ export VIRTUAL_ENV 2024-09-12T17:02:07.772 INFO:tasks.workunit.client.0.smithi067.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:02:07.772 INFO:tasks.workunit.client.0.smithi067.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:02:07.772 INFO:tasks.workunit.client.0.smithi067.stderr:++ export PATH 2024-09-12T17:02:07.772 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T17:02:07.772 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -z '' ']' 2024-09-12T17:02:07.772 INFO:tasks.workunit.client.0.smithi067.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T17:02:07.773 INFO:tasks.workunit.client.0.smithi067.stderr:++ PS1='(rgw) ' 2024-09-12T17:02:07.773 INFO:tasks.workunit.client.0.smithi067.stderr:++ export PS1 2024-09-12T17:02:07.773 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:02:07.773 INFO:tasks.workunit.client.0.smithi067.stderr:++ hash -r 2024-09-12T17:02:07.773 INFO:tasks.workunit.client.0.smithi067.stderr:+ pip install pip --upgrade 2024-09-12T17:02:08.013 INFO:tasks.workunit.client.0.smithi067.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T17:02:08.187 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting pip 2024-09-12T17:02:08.256 INFO:tasks.workunit.client.0.smithi067.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:02:08.415 INFO:tasks.workunit.client.0.smithi067.stdout:Installing collected packages: pip 2024-09-12T17:02:08.415 INFO:tasks.workunit.client.0.smithi067.stdout: Attempting uninstall: pip 2024-09-12T17:02:08.415 INFO:tasks.workunit.client.0.smithi067.stdout: Found existing installation: pip 21.3.1 2024-09-12T17:02:08.580 INFO:tasks.workunit.client.0.smithi067.stdout: Uninstalling pip-21.3.1: 2024-09-12T17:02:08.586 INFO:tasks.workunit.client.0.smithi067.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T17:02:09.359 INFO:tasks.workunit.client.0.smithi067.stdout:Successfully installed pip-24.2 2024-09-12T17:02:09.597 INFO:tasks.workunit.client.0.smithi067.stderr:+ pip install configobj 2024-09-12T17:02:09.981 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting configobj 2024-09-12T17:02:10.023 INFO:tasks.workunit.client.0.smithi067.stdout: Downloading configobj-5.0.8-py2.py3-none-any.whl.metadata (3.4 kB) 2024-09-12T17:02:10.121 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting six (from configobj) 2024-09-12T17:02:10.135 INFO:tasks.workunit.client.0.smithi067.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:02:10.181 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading configobj-5.0.8-py2.py3-none-any.whl (36 kB) 2024-09-12T17:02:10.371 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:02:10.427 INFO:tasks.workunit.client.0.smithi067.stdout:Installing collected packages: six, configobj 2024-09-12T17:02:10.528 INFO:tasks.workunit.client.0.smithi067.stdout:Successfully installed configobj-5.0.8 six-1.16.0 2024-09-12T17:02:10.575 INFO:tasks.workunit.client.0.smithi067.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2024-09-12T17:02:10.608 INFO:tasks.workunit.client.0.smithi067.stderr:DEBUG:root:datacache dir from config is: /tmp/rgw_datacache 2024-09-12T17:02:10.608 INFO:tasks.workunit.client.0.smithi067.stderr:DEBUG:root:exec_cmd(pwd) 2024-09-12T17:02:10.610 INFO:tasks.workunit.client.0.smithi067.stderr:INFO:root:command succeeded 2024-09-12T17:02:10.610 INFO:tasks.workunit.client.0.smithi067.stderr:INFO:root:b'/home/ubuntu/cephtest/mnt.0/client.0/tmp\n' 2024-09-12T17:02:10.610 INFO:tasks.workunit.client.0.smithi067.stderr:DEBUG:root:pwd is: /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:02:10.610 INFO:tasks.workunit.client.0.smithi067.stderr:DEBUG:root:exec_cmd(sudo netstat -nltp | egrep "rados|valgr") 2024-09-12T17:02:10.662 INFO:tasks.workunit.client.0.smithi067.stderr:INFO:root:command succeeded 2024-09-12T17:02:10.662 INFO:tasks.workunit.client.0.smithi067.stderr:INFO:root:b'tcp 0 0 0.0.0.0:443 0.0.0.0:* LISTEN 45807/valgrind \ntcp6 0 0 :::443 :::* LISTEN 45807/valgrind \n' 2024-09-12T17:02:10.662 INFO:tasks.workunit.client.0.smithi067.stderr:INFO:root:radosgw port: 443 2024-09-12T17:02:10.662 INFO:tasks.workunit.client.0.smithi067.stderr:INFO:root:radosgw endpoint is: 127.0.0.1 2024-09-12T17:02:10.662 INFO:tasks.workunit.client.0.smithi067.stderr:DEBUG:root:exec_cmd(dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat bs=1M count=7) 2024-09-12T17:02:10.684 INFO:tasks.workunit.client.0.smithi067.stderr:INFO:root:command succeeded 2024-09-12T17:02:10.684 INFO:tasks.workunit.client.0.smithi067.stderr:INFO:root:b'' 2024-09-12T17:02:10.684 INFO:tasks.workunit.client.0.smithi067.stderr:DEBUG:root:exec_cmd(radosgw-admin user create --uid rgw_datacache_user --display-name DatacacheUser --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn) 2024-09-12T17:02:10.866 INFO:tasks.workunit.client.0.smithi067.stderr:INFO:root:command succeeded 2024-09-12T17:02:10.866 INFO:tasks.workunit.client.0.smithi067.stderr:INFO:root:b'{\n "user_id": "rgw_datacache_user",\n "display_name": "DatacacheUser",\n "email": "",\n "suspended": 0,\n "max_buckets": 1000,\n "subusers": [],\n "keys": [\n {\n "user": "rgw_datacache_user",\n "access_key": "NX5QOQKC6BH2IDN8HC7A",\n "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn",\n "active": true,\n "create_date": "2024-09-12T17:02:10.812285Z"\n }\n ],\n "swift_keys": [],\n "caps": [],\n "op_mask": "read, write, delete",\n "default_placement": "",\n "default_storage_class": "",\n "placement_tags": [],\n "bucket_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "user_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "temp_url_keys": [],\n "type": "rgw",\n "mfa_ids": [],\n "account_id": "",\n "path": "/",\n "create_date": "2024-09-12T17:02:10.812272Z",\n "tags": [],\n "group_ids": []\n}\n\n' 2024-09-12T17:02:10.866 INFO:tasks.workunit.client.0.smithi067.stderr:INFO:root:Creating s3cmd config... 2024-09-12T17:02:10.866 INFO:tasks.workunit.client.0.smithi067.stderr:INFO:root:proto for s3cmd config is https 2024-09-12T17:02:10.866 INFO:tasks.workunit.client.0.smithi067.stderr:INFO:root:s3cmd config written 2024-09-12T17:02:10.867 INFO:tasks.workunit.client.0.smithi067.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 mb s3://datacachebucket) 2024-09-12T17:02:11.479 INFO:tasks.workunit.client.0.smithi067.stderr:INFO:root:command succeeded 2024-09-12T17:02:11.480 INFO:tasks.workunit.client.0.smithi067.stderr:INFO:root:b"Bucket 's3://datacachebucket/' created\n" 2024-09-12T17:02:11.480 INFO:tasks.workunit.client.0.smithi067.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 put /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat s3://datacachebucket) 2024-09-12T17:02:13.927 INFO:tasks.workunit.client.0.smithi067.stderr:INFO:root:command succeeded 2024-09-12T17:02:13.927 INFO:tasks.workunit.client.0.smithi067.stderr:INFO:root:b"upload: '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat' -> 's3://datacachebucket/7M.dat' (7340032 bytes in 2.1 seconds, 3.26 MB/s) [1 of 1]\n" 2024-09-12T17:02:13.927 INFO:tasks.workunit.client.0.smithi067.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 get s3://datacachebucket/7M.dat /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat --force) 2024-09-12T17:02:15.259 INFO:tasks.workunit.client.0.smithi067.stderr:INFO:root:command succeeded 2024-09-12T17:02:15.259 INFO:tasks.workunit.client.0.smithi067.stderr:INFO:root:b"download: 's3://datacachebucket/7M.dat' -> '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat' (7340032 bytes in 1.0 seconds, 7.00 MB/s)\n" 2024-09-12T17:02:15.259 INFO:tasks.workunit.client.0.smithi067.stderr:DEBUG:root:exec_cmd(radosgw-admin object stat --bucket=datacachebucket --object=7M.dat) 2024-09-12T17:02:15.991 INFO:tasks.workunit.client.0.smithi067.stderr:INFO:root:command succeeded 2024-09-12T17:02:15.991 INFO:tasks.workunit.client.0.smithi067.stderr:INFO:root:b'{\n "name": "7M.dat",\n "size": 7368844,\n "policy": {\n "acl": {\n "acl_user_map": [\n {\n "user": "rgw_datacache_user",\n "acl": 15\n }\n ],\n "acl_group_map": [],\n "grant_map": [\n {\n "id": "rgw_datacache_user",\n "grant": {\n "type": {\n "type": 0\n },\n "id": "rgw_datacache_user",\n "name": "DatacacheUser",\n "permission": {\n "flags": 15\n }\n }\n }\n ]\n },\n "owner": {\n "id": "rgw_datacache_user",\n "display_name": "DatacacheUser"\n }\n },\n "compression": {\n "compression_type": "lz4",\n "orig_size": 7340032,\n "blocks": [\n {\n "old_ofs": 0,\n "new_ofs": 0,\n "len": 4210766\n },\n {\n "old_ofs": 4194304,\n "new_ofs": 4210766,\n "len": 3158078\n }\n ]\n },\n "etag": "386b2f1f6f057bd51be6e8f22f92761e",\n "tag": "06eb12d0-49d6-461d-9efe-05d212954deb.4538.8620519557063012822",\n "manifest": {\n "objs": [],\n "obj_size": 7368844,\n "explicit_objs": false,\n "head_size": 0,\n "max_head_size": 0,\n "prefix": ".7MbAQsQROsAhjetZSc6Y8yUw9bpXZmv_",\n "rules": [\n {\n "key": 0,\n "val": {\n "start_part_num": 0,\n "start_ofs": 0,\n "part_size": 0,\n "stripe_max_size": 4194304,\n "override_prefix": ""\n }\n }\n ],\n "tail_instance": "",\n "tail_placement": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "06eb12d0-49d6-461d-9efe-05d212954deb.4538.1",\n "bucket_id": "06eb12d0-49d6-461d-9efe-05d212954deb.4538.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "placement_rule": "default-placement"\n },\n "tier_type": "",\n "begin_iter": {\n "part_ofs": 0,\n "stripe_ofs": 0,\n "ofs": 0,\n "stripe_size": 4194304,\n "cur_part_id": 0,\n "cur_stripe": 0,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "06eb12d0-49d6-461d-9efe-05d212954deb.4538.1",\n "bucket_id": "06eb12d0-49d6-461d-9efe-05d212954deb.4538.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".7MbAQsQROsAhjetZSc6Y8yUw9bpXZmv_0",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n },\n "end_iter": {\n "part_ofs": 0,\n "stripe_ofs": 4194304,\n "ofs": 7368844,\n "stripe_size": 3174540,\n "cur_part_id": 0,\n "cur_stripe": 1,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "06eb12d0-49d6-461d-9efe-05d212954deb.4538.1",\n "bucket_id": "06eb12d0-49d6-461d-9efe-05d212954deb.4538.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".7MbAQsQROsAhjetZSc6Y8yUw9bpXZmv_1",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n }\n },\n "pg_ver": 0,\n "source_zone": 0,\n "torrent": "",\n "mtime": "2024-09-12T17:02:13.821343Z",\n "attrs": {\n "user.rgw.content_type": "application/octet-stream",\n "user.rgw.storage_class": "STANDARD",\n "user.rgw.tail_tag": "06eb12d0-49d6-461d-9efe-05d212954deb.4538.8620519557063012822",\n "user.rgw.x-amz-meta-s3cmd-attrs": "atime:1726160530/ctime:1726160530/gid:1333/gname:ubuntu/md5:386b2f1f6f057bd51be6e8f22f92761e/mode:33188/mtime:1726160530/uid:1000/uname:ubuntu"\n }\n}\n' 2024-09-12T17:02:15.991 INFO:tasks.workunit.client.0.smithi067.stderr:DEBUG:root:Cached object name is: .7MbAQsQROsAhjetZSc6Y8yUw9bpXZmv_ 2024-09-12T17:02:15.991 INFO:tasks.workunit.client.0.smithi067.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -type f | wc -l) 2024-09-12T17:02:15.997 INFO:tasks.workunit.client.0.smithi067.stderr:INFO:root:command succeeded 2024-09-12T17:02:15.997 INFO:tasks.workunit.client.0.smithi067.stderr:INFO:root:b'0\n' 2024-09-12T17:02:15.997 INFO:tasks.workunit.client.0.smithi067.stderr:DEBUG:root:Check cache dir content: 0 2024-09-12T17:02:15.997 INFO:tasks.workunit.client.0.smithi067.stderr:INFO:root:NOTICE: datacache test object not found, inspect if datacache was bypassed or disabled during this check. 2024-09-12T17:02:15.998 INFO:tasks.workunit.client.0.smithi067.stderr:INFO:root:Completed Datacache tests 2024-09-12T17:02:16.003 INFO:tasks.workunit.client.0.smithi067.stderr:+ deactivate 2024-09-12T17:02:16.003 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T17:02:16.003 INFO:tasks.workunit.client.0.smithi067.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:02:16.003 INFO:tasks.workunit.client.0.smithi067.stderr:+ export PATH 2024-09-12T17:02:16.003 INFO:tasks.workunit.client.0.smithi067.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T17:02:16.003 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n '' ']' 2024-09-12T17:02:16.003 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:02:16.003 INFO:tasks.workunit.client.0.smithi067.stderr:+ hash -r 2024-09-12T17:02:16.003 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n '' ']' 2024-09-12T17:02:16.003 INFO:tasks.workunit.client.0.smithi067.stderr:+ unset VIRTUAL_ENV 2024-09-12T17:02:16.004 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T17:02:16.004 INFO:tasks.workunit.client.0.smithi067.stderr:+ unset -f deactivate 2024-09-12T17:02:16.004 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo OK. 2024-09-12T17:02:16.004 INFO:tasks.workunit.client.0.smithi067.stdout:OK. 2024-09-12T17:02:16.005 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:02:16.005 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:02:16.087 INFO:tasks.workunit:Stopping ['rgw/run-datacache.sh'] on client.0... 2024-09-12T17:02:16.088 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:02:16.420 DEBUG:teuthology.parallel:result is None 2024-09-12T17:02:16.420 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:02:16.460 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:02:16.460 DEBUG:teuthology.orchestra.run.smithi067:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:02:16.534 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:02:16.535 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:02:16.545 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:02:16.545 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:02:16.545 DEBUG:teuthology.orchestra.run.smithi067:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:02:16.604 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:02:16.604 INFO:teuthology.orchestra.run.smithi067.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:02:16.605 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:02:16.675 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:02:16.675 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:02:16.746 INFO:tasks.workunit:timeout=3h 2024-09-12T17:02:16.746 INFO:tasks.workunit:cleanup=True 2024-09-12T17:02:16.746 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:02:16.817 INFO:tasks.workunit.client.0.smithi067.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:03:16.781 INFO:tasks.workunit.client.0.smithi067.stderr:Updating files: 93% (11814/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:03:17.648 INFO:tasks.workunit.client.0.smithi067.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:03:17.648 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:03:17.648 INFO:tasks.workunit.client.0.smithi067.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:03:17.648 INFO:tasks.workunit.client.0.smithi067.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:03:17.648 INFO:tasks.workunit.client.0.smithi067.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:03:17.648 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:03:17.648 INFO:tasks.workunit.client.0.smithi067.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:03:17.648 INFO:tasks.workunit.client.0.smithi067.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:03:17.649 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:03:17.649 INFO:tasks.workunit.client.0.smithi067.stderr: git switch -c 2024-09-12T17:03:17.649 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:03:17.649 INFO:tasks.workunit.client.0.smithi067.stderr:Or undo this operation with: 2024-09-12T17:03:17.649 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:03:17.649 INFO:tasks.workunit.client.0.smithi067.stderr: git switch - 2024-09-12T17:03:17.649 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:03:17.649 INFO:tasks.workunit.client.0.smithi067.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:03:17.649 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:03:17.649 INFO:tasks.workunit.client.0.smithi067.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:03:17.653 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:03:17.727 INFO:tasks.workunit.client.0.smithi067.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:03:17.730 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:03:17.730 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:03:17.781 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:03:17.831 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:03:17.872 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:03:17.873 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:03:17.873 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:03:17.913 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:03:17.917 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T17:03:17.917 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:03:17.992 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-12T17:03:17.993 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-12T17:03:17.994 DEBUG:teuthology.orchestra.run.smithi067:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T17:03:18.069 INFO:tasks.workunit.client.0.smithi067.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T17:03:18.070 INFO:tasks.workunit.client.0.smithi067.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:03:18.070 INFO:tasks.workunit.client.0.smithi067.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:03:20.466 INFO:tasks.workunit.client.0.smithi067.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T17:03:20.466 INFO:tasks.workunit.client.0.smithi067.stderr:++ deactivate nondestructive 2024-09-12T17:03:20.466 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T17:03:20.467 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T17:03:20.467 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:03:20.467 INFO:tasks.workunit.client.0.smithi067.stderr:++ hash -r 2024-09-12T17:03:20.467 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T17:03:20.467 INFO:tasks.workunit.client.0.smithi067.stderr:++ unset VIRTUAL_ENV 2024-09-12T17:03:20.467 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T17:03:20.467 INFO:tasks.workunit.client.0.smithi067.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:03:20.467 INFO:tasks.workunit.client.0.smithi067.stderr:++ export VIRTUAL_ENV 2024-09-12T17:03:20.467 INFO:tasks.workunit.client.0.smithi067.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:03:20.468 INFO:tasks.workunit.client.0.smithi067.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:03:20.468 INFO:tasks.workunit.client.0.smithi067.stderr:++ export PATH 2024-09-12T17:03:20.468 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T17:03:20.468 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -z '' ']' 2024-09-12T17:03:20.469 INFO:tasks.workunit.client.0.smithi067.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T17:03:20.469 INFO:tasks.workunit.client.0.smithi067.stderr:++ PS1='(rgw) ' 2024-09-12T17:03:20.469 INFO:tasks.workunit.client.0.smithi067.stderr:++ export PS1 2024-09-12T17:03:20.469 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:03:20.469 INFO:tasks.workunit.client.0.smithi067.stderr:++ hash -r 2024-09-12T17:03:20.469 INFO:tasks.workunit.client.0.smithi067.stderr:+ pip install pip --upgrade 2024-09-12T17:03:20.705 INFO:tasks.workunit.client.0.smithi067.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T17:03:20.885 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting pip 2024-09-12T17:03:20.887 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:03:20.933 INFO:tasks.workunit.client.0.smithi067.stdout:Installing collected packages: pip 2024-09-12T17:03:20.934 INFO:tasks.workunit.client.0.smithi067.stdout: Attempting uninstall: pip 2024-09-12T17:03:20.934 INFO:tasks.workunit.client.0.smithi067.stdout: Found existing installation: pip 21.3.1 2024-09-12T17:03:21.102 INFO:tasks.workunit.client.0.smithi067.stdout: Uninstalling pip-21.3.1: 2024-09-12T17:03:21.107 INFO:tasks.workunit.client.0.smithi067.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T17:03:21.893 INFO:tasks.workunit.client.0.smithi067.stdout:Successfully installed pip-24.2 2024-09-12T17:03:21.942 INFO:tasks.workunit.client.0.smithi067.stderr:+ pip install boto3 2024-09-12T17:03:22.822 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting boto3 2024-09-12T17:03:22.878 INFO:tasks.workunit.client.0.smithi067.stdout: Downloading boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:03:23.584 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:03:23.598 INFO:tasks.workunit.client.0.smithi067.stdout: Downloading botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:03:23.722 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:03:23.736 INFO:tasks.workunit.client.0.smithi067.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:03:23.836 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:03:23.850 INFO:tasks.workunit.client.0.smithi067.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:03:23.947 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:03:23.961 INFO:tasks.workunit.client.0.smithi067.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:03:24.084 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:03:24.099 INFO:tasks.workunit.client.0.smithi067.stdout: Downloading urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T17:03:24.313 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:03:24.315 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:03:24.333 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:03:24.414 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:03:24.626 INFO:tasks.workunit.client.0.smithi067.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.5/12.5 MB 61.9 MB/s eta 0:00:00 2024-09-12T17:03:24.641 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:03:24.705 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:03:24.772 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:03:24.839 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T17:03:24.894 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:03:24.973 INFO:tasks.workunit.client.0.smithi067.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:03:25.962 INFO:tasks.workunit.client.0.smithi067.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T17:03:26.079 INFO:tasks.workunit.client.0.smithi067.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-12T17:03:26.217 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-12T17:03:26.253 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:03:26.253 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:03:26.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.291+0000 7fa71e20e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:26.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.292+0000 7fa71e20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:26.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.292+0000 7fa71e20e800 20 realm 2024-09-12T17:03:26.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.292+0000 7fa71e20e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:26.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.293+0000 7fa71e20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:26.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.293+0000 7fa71e20e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:03:26.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.293+0000 7fa71e20e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:26.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.293+0000 7fa71e20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:26.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.293+0000 7fa71e20e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:26.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.294+0000 7fa71e20e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:26.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.294+0000 7fa71e20e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:26.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.295+0000 7fa71e20e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:03:26.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.295+0000 7fa71e20e800 20 searching for the correct realm 2024-09-12T17:03:26.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.298+0000 7fa719058640 0 -- 172.21.15.67:0/1704982666 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x564240ea1570 msgr2=0x564240ea3a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:26.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.301+0000 7fa719058640 0 -- 172.21.15.67:0/1704982666 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x564240ea9000 msgr2=0x564240eab3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:03:26.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.306+0000 7fa71e20e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:03:26.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.306+0000 7fa71e20e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:03:26.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.306+0000 7fa71e20e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:03:26.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.306+0000 7fa71e20e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:03:26.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.306+0000 7fa71e20e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:03:26.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.306+0000 7fa71e20e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:03:26.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.306+0000 7fa71e20e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:26.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.306+0000 7fa71e20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:26.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.306+0000 7fa71e20e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:26.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.306+0000 7fa71e20e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:26.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.306+0000 7fa71e20e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:26.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.307+0000 7fa71e20e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:03:26.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.307+0000 7fa71e20e800 20 zone default found 2024-09-12T17:03:26.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.307+0000 7fa71e20e800 4 Realm: () 2024-09-12T17:03:26.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.307+0000 7fa71e20e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:03:26.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.307+0000 7fa71e20e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:03:26.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.307+0000 7fa71e20e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:03:26.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.307+0000 7fa71e20e800 20 zonegroup default 2024-09-12T17:03:26.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.307+0000 7fa71e20e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:26.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.307+0000 7fa71e20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:26.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.307+0000 7fa71e20e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:26.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.307+0000 7fa71e20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:26.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.307+0000 7fa71e20e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:26.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.308+0000 7fa71e20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:26.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.308+0000 7fa71e20e800 20 started sync module instance, tier type = 2024-09-12T17:03:26.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.308+0000 7fa71e20e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:03:26.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.319+0000 7fa71e20e800 20 add_watcher() i=0 2024-09-12T17:03:26.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.319+0000 7fa71e20e800 20 add_watcher() i=1 2024-09-12T17:03:26.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.319+0000 7fa71e20e800 20 add_watcher() i=2 2024-09-12T17:03:26.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.319+0000 7fa71e20e800 20 add_watcher() i=3 2024-09-12T17:03:26.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.319+0000 7fa71e20e800 20 add_watcher() i=4 2024-09-12T17:03:26.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.319+0000 7fa71e20e800 20 add_watcher() i=5 2024-09-12T17:03:26.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.319+0000 7fa71e20e800 20 add_watcher() i=6 2024-09-12T17:03:26.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.320+0000 7fa71e20e800 20 add_watcher() i=7 2024-09-12T17:03:26.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.320+0000 7fa71e20e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:03:26.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.321+0000 7fa5cbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:26.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.322+0000 7fa71e20e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:03:26.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.322+0000 7fa71e20e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:03:26.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.322+0000 7fa71e20e800 5 note: GC not initialized 2024-09-12T17:03:26.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.322+0000 7fa5caffd640 20 reqs_thread_entry: start 2024-09-12T17:03:26.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.322+0000 7fa71e20e800 20 init_complete bucket index max shards: 1 2024-09-12T17:03:26.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.322+0000 7fa71e20e800 20 Filter name: none 2024-09-12T17:03:26.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.322+0000 7fa5c8ff9640 20 reqs_thread_entry: start 2024-09-12T17:03:26.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.322+0000 7fa71e20e800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-12T17:03:26.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.322+0000 7fa71e20e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:26.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.323+0000 7fa71e20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:26.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.323+0000 7fa71e20e800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-12T17:03:26.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.323+0000 7fa71e20e800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:03:26.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.323+0000 7fa71e20e800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-12T17:03:26.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.323+0000 7fa71e20e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:26.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.323+0000 7fa71e20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:26.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.323+0000 7fa71e20e800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-12T17:03:26.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.323+0000 7fa71e20e800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:03:26.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.323+0000 7fa71e20e800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T17:03:26.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.323+0000 7fa71e20e800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T17:03:26.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.325+0000 7fa71e20e800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T17:03:26.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.325+0000 7fa71e20e800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:03:26.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.325+0000 7fa71e20e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-12T17:03:26.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.325+0000 7fa5fd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757249 cookie 94842556920128 notifier 4586 bl.length()=593 2024-09-12T17:03:26.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.325+0000 7fa5fd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T17:03:26.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.325+0000 7fa5fd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:03:26.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.329+0000 7fa71e20e800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T17:03:26.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.329+0000 7fa71e20e800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:03:26.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.329+0000 7fa71e20e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-12T17:03:26.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.329+0000 7fa5fd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757248 cookie 94842556950048 notifier 4586 bl.length()=186 2024-09-12T17:03:26.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.329+0000 7fa5fd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T17:03:26.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.329+0000 7fa5fd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:03:26.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.332+0000 7fa5cbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:26.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.335+0000 7fa71e20e800 20 remove_watcher() i=0 2024-09-12T17:03:26.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.335+0000 7fa71e20e800 2 removed watcher, disabling cache 2024-09-12T17:03:26.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.336+0000 7fa71e20e800 20 remove_watcher() i=1 2024-09-12T17:03:26.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.337+0000 7fa71e20e800 20 remove_watcher() i=2 2024-09-12T17:03:26.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.338+0000 7fa71e20e800 20 remove_watcher() i=3 2024-09-12T17:03:26.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.339+0000 7fa71e20e800 20 remove_watcher() i=4 2024-09-12T17:03:26.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.340+0000 7fa71e20e800 20 remove_watcher() i=5 2024-09-12T17:03:26.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.341+0000 7fa71e20e800 20 remove_watcher() i=6 2024-09-12T17:03:26.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:26.342+0000 7fa71e20e800 20 remove_watcher() i=7 2024-09-12T17:03:26.553 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:26.554 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:26.603 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:26.603 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:26.674 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:26.675 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:26.720 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:26.720 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:26.781 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:26.781 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:26.804 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:26.804 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:26.842 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:26.842 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:26.867 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:26.867 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:26.959 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:26.959 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:27.104 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:27.104 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:27.140 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:27.140 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:27.197 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:27.197 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:27.223 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:27.223 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:27.276 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:27.277 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:27.303 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:27.303 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:27.358 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:27.358 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:27.381 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: recalculated bucket check stats are correct 2024-09-12T17:03:27.381 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:03:27.382 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T17:03:27.413 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:03:27.413 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:03:27.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.450+0000 7ffb33abb800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.452+0000 7ffb33abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:27.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.452+0000 7ffb33abb800 20 realm 2024-09-12T17:03:27.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.452+0000 7ffb33abb800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.452+0000 7ffb33abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:27.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.452+0000 7ffb33abb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:03:27.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.452+0000 7ffb33abb800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.452+0000 7ffb33abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:27.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.452+0000 7ffb33abb800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.453+0000 7ffb33abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:27.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.453+0000 7ffb33abb800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.454+0000 7ffb33abb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:03:27.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.454+0000 7ffb33abb800 20 searching for the correct realm 2024-09-12T17:03:27.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.456+0000 7ffb2bfff640 0 -- 172.21.15.67:0/1903976993 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7ffb24007390 msgr2=0x7ffb2406a450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:27.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.460+0000 7ffb315a5640 0 -- 172.21.15.67:0/1903976993 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7ffb1c03cb60 msgr2=0x7ffb1c055430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:27.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.666+0000 7ffb33abb800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:03:27.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.666+0000 7ffb33abb800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:03:27.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.666+0000 7ffb33abb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:03:27.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.666+0000 7ffb33abb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:03:27.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.666+0000 7ffb33abb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:03:27.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.666+0000 7ffb33abb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:03:27.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.666+0000 7ffb33abb800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.666+0000 7ffb33abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:27.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.666+0000 7ffb33abb800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.667+0000 7ffb33abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:27.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.667+0000 7ffb33abb800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.667+0000 7ffb33abb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:03:27.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.667+0000 7ffb33abb800 20 zone default found 2024-09-12T17:03:27.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.667+0000 7ffb33abb800 4 Realm: () 2024-09-12T17:03:27.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.667+0000 7ffb33abb800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:03:27.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.667+0000 7ffb33abb800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:03:27.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.667+0000 7ffb33abb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:03:27.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.667+0000 7ffb33abb800 20 zonegroup default 2024-09-12T17:03:27.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.667+0000 7ffb33abb800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.667+0000 7ffb33abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:27.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.667+0000 7ffb33abb800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.668+0000 7ffb33abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:27.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.668+0000 7ffb33abb800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.668+0000 7ffb33abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:27.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.668+0000 7ffb33abb800 20 started sync module instance, tier type = 2024-09-12T17:03:27.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.668+0000 7ffb33abb800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:03:27.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.681+0000 7ffb33abb800 20 add_watcher() i=0 2024-09-12T17:03:27.683 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.681+0000 7ffb33abb800 20 add_watcher() i=1 2024-09-12T17:03:27.683 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.681+0000 7ffb33abb800 20 add_watcher() i=2 2024-09-12T17:03:27.683 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.681+0000 7ffb33abb800 20 add_watcher() i=3 2024-09-12T17:03:27.683 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.681+0000 7ffb33abb800 20 add_watcher() i=4 2024-09-12T17:03:27.683 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.681+0000 7ffb33abb800 20 add_watcher() i=5 2024-09-12T17:03:27.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.683+0000 7ffb33abb800 20 add_watcher() i=6 2024-09-12T17:03:27.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.683+0000 7ffb33abb800 20 add_watcher() i=7 2024-09-12T17:03:27.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.683+0000 7ffb33abb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:03:27.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.685+0000 7ff9e7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:27.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.686+0000 7ffb33abb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:03:27.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.686+0000 7ffb33abb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:03:27.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.686+0000 7ffb33abb800 5 note: GC not initialized 2024-09-12T17:03:27.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.686+0000 7ff9e6fe5640 20 reqs_thread_entry: start 2024-09-12T17:03:27.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.686+0000 7ffb33abb800 20 init_complete bucket index max shards: 1 2024-09-12T17:03:27.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.686+0000 7ffb33abb800 20 Filter name: none 2024-09-12T17:03:27.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.686+0000 7ff9e4fe1640 20 reqs_thread_entry: start 2024-09-12T17:03:27.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.686+0000 7ffb33abb800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:03:27.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.686+0000 7ffb33abb800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.687+0000 7ffb33abb800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:03:27.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.687+0000 7ffb33abb800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:03:27.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.687+0000 7ffb33abb800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:03:27.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.687+0000 7ffb33abb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 : miss 2024-09-12T17:03:27.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.687+0000 7ffb33abb800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.687+0000 7ffb33abb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:03:27.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.687+0000 7ffb33abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 info.flags=0x17 2024-09-12T17:03:27.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.687+0000 7ffb33abb800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 to cache LRU end 2024-09-12T17:03:27.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.687+0000 7ffb33abb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:03:27.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.687+0000 7ffb33abb800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:03:27.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.688+0000 7ffb33abb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 2024-09-12T17:03:27.691 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.688+0000 7ffb33abb800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:27.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.692+0000 7ff9e7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:27.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.695+0000 7ffb33abb800 20 remove_watcher() i=0 2024-09-12T17:03:27.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.695+0000 7ffb33abb800 2 removed watcher, disabling cache 2024-09-12T17:03:27.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.696+0000 7ffb33abb800 20 remove_watcher() i=1 2024-09-12T17:03:27.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.697+0000 7ffb33abb800 20 remove_watcher() i=2 2024-09-12T17:03:27.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.698+0000 7ffb33abb800 20 remove_watcher() i=3 2024-09-12T17:03:27.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.699+0000 7ffb33abb800 20 remove_watcher() i=4 2024-09-12T17:03:27.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.700+0000 7ffb33abb800 20 remove_watcher() i=5 2024-09-12T17:03:27.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.701+0000 7ffb33abb800 20 remove_watcher() i=6 2024-09-12T17:03:27.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.702+0000 7ffb33abb800 20 remove_watcher() i=7 2024-09-12T17:03:27.716 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T17:03:27.745 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:03:27.746 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:03:27.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.783+0000 7efc58721800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.785+0000 7efc58721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:27.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.785+0000 7efc58721800 20 realm 2024-09-12T17:03:27.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.785+0000 7efc58721800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.785+0000 7efc58721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:27.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.785+0000 7efc58721800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:03:27.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.785+0000 7efc58721800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.785+0000 7efc58721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:27.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.785+0000 7efc58721800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.786+0000 7efc58721800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:27.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.786+0000 7efc58721800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.787+0000 7efc58721800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:03:27.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.787+0000 7efc58721800 20 searching for the correct realm 2024-09-12T17:03:27.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.790+0000 7efc54b57640 0 -- 172.21.15.67:0/2995036825 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x5567406378b0 msgr2=0x556740639d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:27.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.793+0000 7efc53b55640 0 -- 172.21.15.67:0/2995036825 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55674063f450 msgr2=0x556740641840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:03:27.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.797+0000 7efc58721800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:03:27.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.797+0000 7efc58721800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:03:27.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.797+0000 7efc58721800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:03:27.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.797+0000 7efc58721800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:03:27.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.797+0000 7efc58721800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:03:27.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.797+0000 7efc58721800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:03:27.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.797+0000 7efc58721800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.797+0000 7efc58721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:27.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.797+0000 7efc58721800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.798+0000 7efc58721800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:27.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.798+0000 7efc58721800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.798+0000 7efc58721800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:03:27.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.798+0000 7efc58721800 20 zone default found 2024-09-12T17:03:27.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.798+0000 7efc58721800 4 Realm: () 2024-09-12T17:03:27.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.798+0000 7efc58721800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:03:27.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.798+0000 7efc58721800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:03:27.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.798+0000 7efc58721800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:03:27.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.798+0000 7efc58721800 20 zonegroup default 2024-09-12T17:03:27.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.798+0000 7efc58721800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.798+0000 7efc58721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:27.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.798+0000 7efc58721800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.798+0000 7efc58721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:27.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.798+0000 7efc58721800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.799+0000 7efc58721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:27.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.799+0000 7efc58721800 20 started sync module instance, tier type = 2024-09-12T17:03:27.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.799+0000 7efc58721800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:03:27.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.809+0000 7efc58721800 20 add_watcher() i=0 2024-09-12T17:03:27.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.809+0000 7efc58721800 20 add_watcher() i=1 2024-09-12T17:03:27.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.809+0000 7efc58721800 20 add_watcher() i=2 2024-09-12T17:03:27.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.809+0000 7efc58721800 20 add_watcher() i=3 2024-09-12T17:03:27.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.809+0000 7efc58721800 20 add_watcher() i=4 2024-09-12T17:03:27.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.809+0000 7efc58721800 20 add_watcher() i=5 2024-09-12T17:03:27.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.809+0000 7efc58721800 20 add_watcher() i=6 2024-09-12T17:03:27.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.810+0000 7efc58721800 20 add_watcher() i=7 2024-09-12T17:03:27.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.810+0000 7efc58721800 2 all 8 watchers are set, enabling cache 2024-09-12T17:03:27.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.811+0000 7efb0afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:27.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.812+0000 7efc58721800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:03:27.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.812+0000 7efc58721800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:03:27.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.812+0000 7efc58721800 5 note: GC not initialized 2024-09-12T17:03:27.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.812+0000 7efb09fdb640 20 reqs_thread_entry: start 2024-09-12T17:03:27.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.812+0000 7efc58721800 20 init_complete bucket index max shards: 1 2024-09-12T17:03:27.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.812+0000 7efc58721800 20 Filter name: none 2024-09-12T17:03:27.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.812+0000 7efa7b7fe640 20 reqs_thread_entry: start 2024-09-12T17:03:27.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.812+0000 7efc58721800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.813+0000 7efc58721800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:03:27.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.813+0000 7efc58721800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.813+0000 7efc58721800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:03:27.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.813+0000 7efc58721800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:03:27.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.813+0000 7efc58721800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.813+0000 7efc58721800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:03:27.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.813+0000 7efc58721800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.814+0000 7efc58721800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:03:27.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.814+0000 7efc58721800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:03:27.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.815+0000 7efb0afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:27.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.817+0000 7efc58721800 20 remove_watcher() i=0 2024-09-12T17:03:27.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.817+0000 7efc58721800 2 removed watcher, disabling cache 2024-09-12T17:03:27.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.818+0000 7efc58721800 20 remove_watcher() i=1 2024-09-12T17:03:27.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.819+0000 7efc58721800 20 remove_watcher() i=2 2024-09-12T17:03:27.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.821+0000 7efc58721800 20 remove_watcher() i=3 2024-09-12T17:03:27.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.822+0000 7efc58721800 20 remove_watcher() i=4 2024-09-12T17:03:27.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.822+0000 7efc58721800 20 remove_watcher() i=5 2024-09-12T17:03:27.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.823+0000 7efc58721800 20 remove_watcher() i=6 2024-09-12T17:03:27.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.824+0000 7efc58721800 20 remove_watcher() i=7 2024-09-12T17:03:27.837 INFO:tasks.workunit.client.0.smithi067.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 99, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-12T17:03:27.837 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-12T17:03:27.837 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:03:27.838 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:03:27.872 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:03:27.873 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:03:27.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.910+0000 7f81abb39800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.912+0000 7f81abb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:27.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.912+0000 7f81abb39800 20 realm 2024-09-12T17:03:27.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.912+0000 7f81abb39800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.912+0000 7f81abb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:27.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.912+0000 7f81abb39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:03:27.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.912+0000 7f81abb39800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.912+0000 7f81abb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:27.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.912+0000 7f81abb39800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.913+0000 7f81abb39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:27.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.913+0000 7f81abb39800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.914+0000 7f81abb39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:03:27.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.914+0000 7f81abb39800 20 searching for the correct realm 2024-09-12T17:03:27.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.917+0000 7f81a7fc8640 0 -- 172.21.15.67:0/3048153599 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x561a2fce6150 msgr2=0x561a2fce8610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:27.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.920+0000 7f81a77c7640 0 -- 172.21.15.67:0/3048153599 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f819005b050 msgr2=0x7f819008fac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:03:27.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.925+0000 7f81abb39800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:03:27.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.925+0000 7f81abb39800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:03:27.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.925+0000 7f81abb39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:03:27.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.925+0000 7f81abb39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:03:27.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.925+0000 7f81abb39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:03:27.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.925+0000 7f81abb39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:03:27.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.925+0000 7f81abb39800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.925+0000 7f81abb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:27.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.925+0000 7f81abb39800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.926+0000 7f81abb39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:27.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.926+0000 7f81abb39800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.926+0000 7f81abb39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:03:27.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.926+0000 7f81abb39800 20 zone default found 2024-09-12T17:03:27.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.926+0000 7f81abb39800 4 Realm: () 2024-09-12T17:03:27.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.926+0000 7f81abb39800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:03:27.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.926+0000 7f81abb39800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:03:27.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.926+0000 7f81abb39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:03:27.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.926+0000 7f81abb39800 20 zonegroup default 2024-09-12T17:03:27.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.926+0000 7f81abb39800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.926+0000 7f81abb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:27.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.926+0000 7f81abb39800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.927+0000 7f81abb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:27.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.927+0000 7f81abb39800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.927+0000 7f81abb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:27.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.927+0000 7f81abb39800 20 started sync module instance, tier type = 2024-09-12T17:03:27.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.927+0000 7f81abb39800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:03:27.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.938+0000 7f81abb39800 20 add_watcher() i=0 2024-09-12T17:03:27.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.938+0000 7f81abb39800 20 add_watcher() i=1 2024-09-12T17:03:27.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.938+0000 7f81abb39800 20 add_watcher() i=2 2024-09-12T17:03:27.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.938+0000 7f81abb39800 20 add_watcher() i=3 2024-09-12T17:03:27.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.938+0000 7f81abb39800 20 add_watcher() i=4 2024-09-12T17:03:27.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.938+0000 7f81abb39800 20 add_watcher() i=5 2024-09-12T17:03:27.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.938+0000 7f81abb39800 20 add_watcher() i=6 2024-09-12T17:03:27.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.941+0000 7f81abb39800 20 add_watcher() i=7 2024-09-12T17:03:27.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.941+0000 7f81abb39800 2 all 8 watchers are set, enabling cache 2024-09-12T17:03:27.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.943+0000 7f805dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:27.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.943+0000 7f81abb39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:03:27.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.943+0000 7f81abb39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:03:27.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.943+0000 7f81abb39800 5 note: GC not initialized 2024-09-12T17:03:27.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.943+0000 7f805cfe1640 20 reqs_thread_entry: start 2024-09-12T17:03:27.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.943+0000 7f81abb39800 20 init_complete bucket index max shards: 1 2024-09-12T17:03:27.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.943+0000 7f81abb39800 20 Filter name: none 2024-09-12T17:03:27.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.943+0000 7f7fd67fc640 20 reqs_thread_entry: start 2024-09-12T17:03:27.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.943+0000 7f81abb39800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:03:27.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.943+0000 7f81abb39800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.944+0000 7f81abb39800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:03:27.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.944+0000 7f81abb39800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:03:27.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.944+0000 7f81abb39800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:03:27.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.944+0000 7f81abb39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 : miss 2024-09-12T17:03:27.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.944+0000 7f81abb39800 20 rados->read ofs=0 len=0 2024-09-12T17:03:27.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.944+0000 7f81abb39800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:03:27.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.944+0000 7f81abb39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 info.flags=0x17 2024-09-12T17:03:27.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.944+0000 7f81abb39800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 to cache LRU end 2024-09-12T17:03:27.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.944+0000 7f81abb39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:03:27.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.944+0000 7f81abb39800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:03:27.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.944+0000 7f81abb39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 2024-09-12T17:03:27.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.944+0000 7f81abb39800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:27.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.945+0000 7f81abb39800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:03:27.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.945+0000 7f81abb39800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:03:27.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.946+0000 7f805dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:27.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.948+0000 7f81abb39800 20 remove_watcher() i=0 2024-09-12T17:03:27.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.948+0000 7f81abb39800 2 removed watcher, disabling cache 2024-09-12T17:03:27.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.949+0000 7f81abb39800 20 remove_watcher() i=1 2024-09-12T17:03:27.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.950+0000 7f81abb39800 20 remove_watcher() i=2 2024-09-12T17:03:27.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.951+0000 7f81abb39800 20 remove_watcher() i=3 2024-09-12T17:03:27.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.953+0000 7f81abb39800 20 remove_watcher() i=4 2024-09-12T17:03:27.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.954+0000 7f81abb39800 20 remove_watcher() i=5 2024-09-12T17:03:27.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.955+0000 7f81abb39800 20 remove_watcher() i=6 2024-09-12T17:03:27.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:27.956+0000 7f81abb39800 20 remove_watcher() i=7 2024-09-12T17:03:27.970 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:03:28.383 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:03:29.801 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:29.801 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:29.904 INFO:tasks.workunit.client.0.smithi067.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:03:29.905 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:03:29.939 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:03:29.939 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:03:29.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:29.980+0000 7facc4946800 20 rados->read ofs=0 len=0 2024-09-12T17:03:29.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:29.982+0000 7facc4946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:29.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:29.982+0000 7facc4946800 20 realm 2024-09-12T17:03:29.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:29.982+0000 7facc4946800 20 rados->read ofs=0 len=0 2024-09-12T17:03:29.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:29.982+0000 7facc4946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:29.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:29.982+0000 7facc4946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:03:29.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:29.982+0000 7facc4946800 20 rados->read ofs=0 len=0 2024-09-12T17:03:29.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:29.982+0000 7facc4946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:29.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:29.982+0000 7facc4946800 20 rados->read ofs=0 len=0 2024-09-12T17:03:29.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:29.983+0000 7facc4946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:29.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:29.983+0000 7facc4946800 20 rados->read ofs=0 len=0 2024-09-12T17:03:29.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:29.984+0000 7facc4946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:03:29.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:29.984+0000 7facc4946800 20 searching for the correct realm 2024-09-12T17:03:29.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:29.986+0000 7facc2430640 0 -- 172.21.15.67:0/1851681951 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7facbc09e0b0 msgr2=0x7facbc0650e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:29.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:29.990+0000 7facc2430640 0 -- 172.21.15.67:0/1851681951 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7facb8069030 msgr2=0x7facb8070930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:30.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.197+0000 7facc4946800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:03:30.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.197+0000 7facc4946800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:03:30.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.197+0000 7facc4946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:03:30.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.197+0000 7facc4946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:03:30.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.197+0000 7facc4946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:03:30.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.197+0000 7facc4946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:03:30.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.197+0000 7facc4946800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.200 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.197+0000 7facc4946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:30.200 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.197+0000 7facc4946800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.200 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.198+0000 7facc4946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:30.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.198+0000 7facc4946800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.198+0000 7facc4946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:03:30.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.198+0000 7facc4946800 20 zone default found 2024-09-12T17:03:30.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.198+0000 7facc4946800 4 Realm: () 2024-09-12T17:03:30.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.198+0000 7facc4946800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:03:30.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.198+0000 7facc4946800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:03:30.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.198+0000 7facc4946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:03:30.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.198+0000 7facc4946800 20 zonegroup default 2024-09-12T17:03:30.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.198+0000 7facc4946800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.198+0000 7facc4946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:30.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.199+0000 7facc4946800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.199+0000 7facc4946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:30.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.199+0000 7facc4946800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.199+0000 7facc4946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:30.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.199+0000 7facc4946800 20 started sync module instance, tier type = 2024-09-12T17:03:30.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.199+0000 7facc4946800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:03:30.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.214+0000 7facc4946800 20 add_watcher() i=0 2024-09-12T17:03:30.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.214+0000 7facc4946800 20 add_watcher() i=1 2024-09-12T17:03:30.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.214+0000 7facc4946800 20 add_watcher() i=2 2024-09-12T17:03:30.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.214+0000 7facc4946800 20 add_watcher() i=3 2024-09-12T17:03:30.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.214+0000 7facc4946800 20 add_watcher() i=4 2024-09-12T17:03:30.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.214+0000 7facc4946800 20 add_watcher() i=5 2024-09-12T17:03:30.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.214+0000 7facc4946800 20 add_watcher() i=6 2024-09-12T17:03:30.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.216+0000 7facc4946800 20 add_watcher() i=7 2024-09-12T17:03:30.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.216+0000 7facc4946800 2 all 8 watchers are set, enabling cache 2024-09-12T17:03:30.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.219+0000 7fab78fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:30.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.219+0000 7facc4946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:03:30.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.219+0000 7facc4946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:03:30.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.219+0000 7facc4946800 5 note: GC not initialized 2024-09-12T17:03:30.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.219+0000 7faaf37fe640 20 reqs_thread_entry: start 2024-09-12T17:03:30.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.219+0000 7facc4946800 20 init_complete bucket index max shards: 1 2024-09-12T17:03:30.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.219+0000 7facc4946800 20 Filter name: none 2024-09-12T17:03:30.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.220+0000 7faaf17fa640 20 reqs_thread_entry: start 2024-09-12T17:03:30.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.220+0000 7facc4946800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.220+0000 7facc4946800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:03:30.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.220+0000 7facc4946800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.220+0000 7facc4946800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:03:30.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.220+0000 7facc4946800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:03:30.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.220+0000 7facc4946800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:03:30.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.220+0000 7facc4946800 20 INFO: main: starting shard=0 2024-09-12T17:03:30.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.220+0000 7facc4946800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:30.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.221+0000 7facc4946800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:03:30.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.221+0000 7facc4946800 20 INFO: main: done 2024-09-12T17:03:30.224 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.222+0000 7fab78fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:30.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.225+0000 7facc4946800 20 remove_watcher() i=0 2024-09-12T17:03:30.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.225+0000 7facc4946800 2 removed watcher, disabling cache 2024-09-12T17:03:30.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.226+0000 7facc4946800 20 remove_watcher() i=1 2024-09-12T17:03:30.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.227+0000 7facc4946800 20 remove_watcher() i=2 2024-09-12T17:03:30.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.228+0000 7facc4946800 20 remove_watcher() i=3 2024-09-12T17:03:30.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.230+0000 7facc4946800 20 remove_watcher() i=4 2024-09-12T17:03:30.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.231+0000 7facc4946800 20 remove_watcher() i=5 2024-09-12T17:03:30.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.232+0000 7facc4946800 20 remove_watcher() i=6 2024-09-12T17:03:30.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.233+0000 7facc4946800 20 remove_watcher() i=7 2024-09-12T17:03:30.249 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:30.249 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:30.274 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:30.274 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:30.299 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:30.299 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:30.386 INFO:tasks.workunit.client.0.smithi067.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:03:30.387 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:03:30.419 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:03:30.419 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:03:30.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.457+0000 7fe09f524800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.458+0000 7fe09f524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:30.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.458+0000 7fe09f524800 20 realm 2024-09-12T17:03:30.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.458+0000 7fe09f524800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.458+0000 7fe09f524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:30.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.458+0000 7fe09f524800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:03:30.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.458+0000 7fe09f524800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.459+0000 7fe09f524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:30.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.459+0000 7fe09f524800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.460+0000 7fe09f524800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:30.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.460+0000 7fe09f524800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.461+0000 7fe09f524800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:03:30.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.461+0000 7fe09f524800 20 searching for the correct realm 2024-09-12T17:03:30.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.463+0000 7fe09a955640 0 -- 172.21.15.67:0/4194774464 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55e6dec7bb50 msgr2=0x55e6dec7df40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:30.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.467+0000 7fe09b156640 0 -- 172.21.15.67:0/4194774464 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fe090027040 msgr2=0x7fe090062930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:30.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.674+0000 7fe09f524800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:03:30.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.674+0000 7fe09f524800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:03:30.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.674+0000 7fe09f524800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:03:30.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.674+0000 7fe09f524800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:03:30.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.674+0000 7fe09f524800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:03:30.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.674+0000 7fe09f524800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:03:30.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.674+0000 7fe09f524800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.674+0000 7fe09f524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:30.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.674+0000 7fe09f524800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.674+0000 7fe09f524800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:30.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.674+0000 7fe09f524800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.675+0000 7fe09f524800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:03:30.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.675+0000 7fe09f524800 20 zone default found 2024-09-12T17:03:30.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.675+0000 7fe09f524800 4 Realm: () 2024-09-12T17:03:30.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.675+0000 7fe09f524800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:03:30.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.675+0000 7fe09f524800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:03:30.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.675+0000 7fe09f524800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:03:30.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.675+0000 7fe09f524800 20 zonegroup default 2024-09-12T17:03:30.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.675+0000 7fe09f524800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.675+0000 7fe09f524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:30.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.675+0000 7fe09f524800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.675+0000 7fe09f524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:30.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.675+0000 7fe09f524800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.676+0000 7fe09f524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:30.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.676+0000 7fe09f524800 20 started sync module instance, tier type = 2024-09-12T17:03:30.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.676+0000 7fe09f524800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:03:30.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.689+0000 7fe09f524800 20 add_watcher() i=0 2024-09-12T17:03:30.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.689+0000 7fe09f524800 20 add_watcher() i=1 2024-09-12T17:03:30.691 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.689+0000 7fe09f524800 20 add_watcher() i=2 2024-09-12T17:03:30.691 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.689+0000 7fe09f524800 20 add_watcher() i=3 2024-09-12T17:03:30.691 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.689+0000 7fe09f524800 20 add_watcher() i=4 2024-09-12T17:03:30.691 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.689+0000 7fe09f524800 20 add_watcher() i=5 2024-09-12T17:03:30.691 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.689+0000 7fe09f524800 20 add_watcher() i=6 2024-09-12T17:03:30.691 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.690+0000 7fe09f524800 20 add_watcher() i=7 2024-09-12T17:03:30.691 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.690+0000 7fe09f524800 2 all 8 watchers are set, enabling cache 2024-09-12T17:03:30.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.691+0000 7fdf51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:30.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.692+0000 7fe09f524800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:03:30.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.692+0000 7fe09f524800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:03:30.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.692+0000 7fe09f524800 5 note: GC not initialized 2024-09-12T17:03:30.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.692+0000 7fdf50fe1640 20 reqs_thread_entry: start 2024-09-12T17:03:30.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.692+0000 7fe09f524800 20 init_complete bucket index max shards: 1 2024-09-12T17:03:30.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.692+0000 7fe09f524800 20 Filter name: none 2024-09-12T17:03:30.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.692+0000 7fdeca7fc640 20 reqs_thread_entry: start 2024-09-12T17:03:30.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.692+0000 7fe09f524800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.693+0000 7fe09f524800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:03:30.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.693+0000 7fe09f524800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.693+0000 7fe09f524800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:03:30.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.693+0000 7fe09f524800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:03:30.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.693+0000 7fe09f524800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:03:30.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.693+0000 7fe09f524800 20 INFO: main: starting shard=0 2024-09-12T17:03:30.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.693+0000 7fe09f524800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:30.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.694+0000 7fe09f524800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:03:30.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.694+0000 7fe09f524800 20 INFO: main: done 2024-09-12T17:03:30.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.695+0000 7fdf51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:30.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.697+0000 7fe09f524800 20 remove_watcher() i=0 2024-09-12T17:03:30.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.697+0000 7fe09f524800 2 removed watcher, disabling cache 2024-09-12T17:03:30.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.699+0000 7fe09f524800 20 remove_watcher() i=1 2024-09-12T17:03:30.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.700+0000 7fe09f524800 20 remove_watcher() i=2 2024-09-12T17:03:30.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.701+0000 7fe09f524800 20 remove_watcher() i=3 2024-09-12T17:03:30.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.702+0000 7fe09f524800 20 remove_watcher() i=4 2024-09-12T17:03:30.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.703+0000 7fe09f524800 20 remove_watcher() i=5 2024-09-12T17:03:30.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.706+0000 7fe09f524800 20 remove_watcher() i=6 2024-09-12T17:03:30.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.707+0000 7fe09f524800 20 remove_watcher() i=7 2024-09-12T17:03:30.723 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:30.723 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:30.747 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:30.748 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:30.833 INFO:tasks.workunit.client.0.smithi067.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:03:30.834 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T17:03:30.866 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:03:30.866 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:03:30.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.904+0000 7f9c8e040800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.905+0000 7f9c8e040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:30.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.905+0000 7f9c8e040800 20 realm 2024-09-12T17:03:30.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.905+0000 7f9c8e040800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.906+0000 7f9c8e040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:30.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.906+0000 7f9c8e040800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:03:30.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.906+0000 7f9c8e040800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.906+0000 7f9c8e040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:30.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.906+0000 7f9c8e040800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.907+0000 7f9c8e040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:30.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.907+0000 7f9c8e040800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.907+0000 7f9c8e040800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:03:30.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.907+0000 7f9c8e040800 20 searching for the correct realm 2024-09-12T17:03:30.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.911+0000 7f9c8c32b640 0 -- 172.21.15.67:0/2685131100 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x558a92c834b0 msgr2=0x558a92c858a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:30.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.914+0000 7f9c83329640 0 -- 172.21.15.67:0/2685131100 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x558a92c8aeb0 msgr2=0x558a92c8d2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:30.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.918+0000 7f9c8e040800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:03:30.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.918+0000 7f9c8e040800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:03:30.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.918+0000 7f9c8e040800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:03:30.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.918+0000 7f9c8e040800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:03:30.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.918+0000 7f9c8e040800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:03:30.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.918+0000 7f9c8e040800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:03:30.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.918+0000 7f9c8e040800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.918+0000 7f9c8e040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:30.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.918+0000 7f9c8e040800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.919+0000 7f9c8e040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:30.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.919+0000 7f9c8e040800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.919+0000 7f9c8e040800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:03:30.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.919+0000 7f9c8e040800 20 zone default found 2024-09-12T17:03:30.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.919+0000 7f9c8e040800 4 Realm: () 2024-09-12T17:03:30.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.919+0000 7f9c8e040800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:03:30.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.919+0000 7f9c8e040800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:03:30.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.919+0000 7f9c8e040800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:03:30.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.919+0000 7f9c8e040800 20 zonegroup default 2024-09-12T17:03:30.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.919+0000 7f9c8e040800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.919+0000 7f9c8e040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:30.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.919+0000 7f9c8e040800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.920+0000 7f9c8e040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:30.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.920+0000 7f9c8e040800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.920+0000 7f9c8e040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:30.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.920+0000 7f9c8e040800 20 started sync module instance, tier type = 2024-09-12T17:03:30.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.920+0000 7f9c8e040800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:03:30.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.935+0000 7f9c8e040800 20 add_watcher() i=0 2024-09-12T17:03:30.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.935+0000 7f9c8e040800 20 add_watcher() i=1 2024-09-12T17:03:30.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.935+0000 7f9c8e040800 20 add_watcher() i=2 2024-09-12T17:03:30.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.935+0000 7f9c8e040800 20 add_watcher() i=3 2024-09-12T17:03:30.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.935+0000 7f9c8e040800 20 add_watcher() i=4 2024-09-12T17:03:30.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.935+0000 7f9c8e040800 20 add_watcher() i=5 2024-09-12T17:03:30.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.936+0000 7f9c8e040800 20 add_watcher() i=6 2024-09-12T17:03:30.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.936+0000 7f9c8e040800 20 add_watcher() i=7 2024-09-12T17:03:30.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.936+0000 7f9c8e040800 2 all 8 watchers are set, enabling cache 2024-09-12T17:03:30.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.938+0000 7f9b41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:30.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.939+0000 7f9c8e040800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:03:30.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.939+0000 7f9c8e040800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:03:30.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.939+0000 7f9c8e040800 5 note: GC not initialized 2024-09-12T17:03:30.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.939+0000 7f9b40fe1640 20 reqs_thread_entry: start 2024-09-12T17:03:30.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.939+0000 7f9c8e040800 20 init_complete bucket index max shards: 1 2024-09-12T17:03:30.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.939+0000 7f9c8e040800 20 Filter name: none 2024-09-12T17:03:30.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.939+0000 7f9aba7fc640 20 reqs_thread_entry: start 2024-09-12T17:03:30.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.939+0000 7f9c8e040800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.939+0000 7f9c8e040800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:03:30.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.939+0000 7f9c8e040800 20 rados->read ofs=0 len=0 2024-09-12T17:03:30.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.940+0000 7f9c8e040800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:03:30.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.940+0000 7f9c8e040800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:03:30.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.940+0000 7f9c8e040800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:03:30.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.940+0000 7f9c8e040800 20 INFO: main: starting shard=0 2024-09-12T17:03:30.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.940+0000 7f9c8e040800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:30.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.940+0000 7f9c8e040800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:03:30.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.940+0000 7f9c8e040800 20 INFO: main: done 2024-09-12T17:03:30.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.941+0000 7f9b41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:30.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.943+0000 7f9c8e040800 20 remove_watcher() i=0 2024-09-12T17:03:30.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.943+0000 7f9c8e040800 2 removed watcher, disabling cache 2024-09-12T17:03:30.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.945+0000 7f9c8e040800 20 remove_watcher() i=1 2024-09-12T17:03:30.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.947+0000 7f9c8e040800 20 remove_watcher() i=2 2024-09-12T17:03:30.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.948+0000 7f9c8e040800 20 remove_watcher() i=3 2024-09-12T17:03:30.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.949+0000 7f9c8e040800 20 remove_watcher() i=4 2024-09-12T17:03:30.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.950+0000 7f9c8e040800 20 remove_watcher() i=5 2024-09-12T17:03:30.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.953+0000 7f9c8e040800 20 remove_watcher() i=6 2024-09-12T17:03:30.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:30.953+0000 7f9c8e040800 20 remove_watcher() i=7 2024-09-12T17:03:30.969 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:30.969 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:30.993 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:30.993 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:31.078 INFO:tasks.workunit.client.0.smithi067.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:03:31.079 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T17:03:31.111 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:03:31.111 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:03:31.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.149+0000 7fda0853b800 20 rados->read ofs=0 len=0 2024-09-12T17:03:31.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.150+0000 7fda0853b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:31.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.150+0000 7fda0853b800 20 realm 2024-09-12T17:03:31.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.150+0000 7fda0853b800 20 rados->read ofs=0 len=0 2024-09-12T17:03:31.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.151+0000 7fda0853b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:31.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.151+0000 7fda0853b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:03:31.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.151+0000 7fda0853b800 20 rados->read ofs=0 len=0 2024-09-12T17:03:31.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.151+0000 7fda0853b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:31.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.151+0000 7fda0853b800 20 rados->read ofs=0 len=0 2024-09-12T17:03:31.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.152+0000 7fda0853b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:31.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.152+0000 7fda0853b800 20 rados->read ofs=0 len=0 2024-09-12T17:03:31.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.152+0000 7fda03aba640 0 -- 172.21.15.67:0/543351057 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x563a0ad8bf90 msgr2=0x563a0ad8e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:31.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.355+0000 7fda0853b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:03:31.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.355+0000 7fda0853b800 20 searching for the correct realm 2024-09-12T17:03:31.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.357+0000 7fda042bb640 0 -- 172.21.15.67:0/543351057 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x563a0ab56710 msgr2=0x7fd9fc0a8080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:31.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.366+0000 7fda0853b800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:03:31.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.366+0000 7fda0853b800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:03:31.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.366+0000 7fda0853b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:03:31.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.366+0000 7fda0853b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:03:31.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.366+0000 7fda0853b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:03:31.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.366+0000 7fda0853b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:03:31.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.366+0000 7fda0853b800 20 rados->read ofs=0 len=0 2024-09-12T17:03:31.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.366+0000 7fda0853b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:31.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.366+0000 7fda0853b800 20 rados->read ofs=0 len=0 2024-09-12T17:03:31.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.366+0000 7fda0853b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:31.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.366+0000 7fda0853b800 20 rados->read ofs=0 len=0 2024-09-12T17:03:31.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.366+0000 7fda0853b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:03:31.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.366+0000 7fda0853b800 20 zone default found 2024-09-12T17:03:31.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.366+0000 7fda0853b800 4 Realm: () 2024-09-12T17:03:31.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.366+0000 7fda0853b800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:03:31.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.366+0000 7fda0853b800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:03:31.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.366+0000 7fda0853b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:03:31.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.367+0000 7fda0853b800 20 zonegroup default 2024-09-12T17:03:31.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.367+0000 7fda0853b800 20 rados->read ofs=0 len=0 2024-09-12T17:03:31.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.367+0000 7fda0853b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:31.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.367+0000 7fda0853b800 20 rados->read ofs=0 len=0 2024-09-12T17:03:31.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.367+0000 7fda0853b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:31.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.367+0000 7fda0853b800 20 rados->read ofs=0 len=0 2024-09-12T17:03:31.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.367+0000 7fda0853b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:31.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.367+0000 7fda0853b800 20 started sync module instance, tier type = 2024-09-12T17:03:31.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.367+0000 7fda0853b800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:03:31.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.385+0000 7fda0853b800 20 add_watcher() i=0 2024-09-12T17:03:31.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.385+0000 7fda0853b800 20 add_watcher() i=1 2024-09-12T17:03:31.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.385+0000 7fda0853b800 20 add_watcher() i=2 2024-09-12T17:03:31.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.385+0000 7fda0853b800 20 add_watcher() i=3 2024-09-12T17:03:31.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.385+0000 7fda0853b800 20 add_watcher() i=4 2024-09-12T17:03:31.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.385+0000 7fda0853b800 20 add_watcher() i=5 2024-09-12T17:03:31.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.386+0000 7fda0853b800 20 add_watcher() i=6 2024-09-12T17:03:31.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.389+0000 7fda0853b800 20 add_watcher() i=7 2024-09-12T17:03:31.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.389+0000 7fda0853b800 2 all 8 watchers are set, enabling cache 2024-09-12T17:03:31.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.391+0000 7fd8bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:31.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.391+0000 7fda0853b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:03:31.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.391+0000 7fda0853b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:03:31.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.392+0000 7fda0853b800 5 note: GC not initialized 2024-09-12T17:03:31.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.392+0000 7fd8b9fdb640 20 reqs_thread_entry: start 2024-09-12T17:03:31.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.392+0000 7fda0853b800 20 init_complete bucket index max shards: 1 2024-09-12T17:03:31.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.392+0000 7fda0853b800 20 Filter name: none 2024-09-12T17:03:31.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.392+0000 7fd82b7fe640 20 reqs_thread_entry: start 2024-09-12T17:03:31.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.392+0000 7fda0853b800 20 rados->read ofs=0 len=0 2024-09-12T17:03:31.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.392+0000 7fda0853b800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:03:31.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.392+0000 7fda0853b800 20 rados->read ofs=0 len=0 2024-09-12T17:03:31.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.393+0000 7fda0853b800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:03:31.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.393+0000 7fda0853b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:03:31.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.393+0000 7fda0853b800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:03:31.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.393+0000 7fda0853b800 20 INFO: main: starting shard=0 2024-09-12T17:03:31.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.393+0000 7fda0853b800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:31.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.394+0000 7fda0853b800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:03:31.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.394+0000 7fda0853b800 20 INFO: main: done 2024-09-12T17:03:31.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.394+0000 7fd8bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:31.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.397+0000 7fda0853b800 20 remove_watcher() i=0 2024-09-12T17:03:31.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.397+0000 7fda0853b800 2 removed watcher, disabling cache 2024-09-12T17:03:31.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.398+0000 7fda0853b800 20 remove_watcher() i=1 2024-09-12T17:03:31.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.404+0000 7fda0853b800 20 remove_watcher() i=2 2024-09-12T17:03:31.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.405+0000 7fda0853b800 20 remove_watcher() i=3 2024-09-12T17:03:31.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.406+0000 7fda0853b800 20 remove_watcher() i=4 2024-09-12T17:03:31.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.407+0000 7fda0853b800 20 remove_watcher() i=5 2024-09-12T17:03:31.410 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.409+0000 7fda0853b800 20 remove_watcher() i=6 2024-09-12T17:03:31.411 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:31.410+0000 7fda0853b800 20 remove_watcher() i=7 2024-09-12T17:03:31.425 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:31.426 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:31.450 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:03:31.860 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:03:32.284 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-12T17:03:32.284 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:03:32.285 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:03:32.318 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:03:32.319 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:03:32.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.358+0000 7f02e6e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:03:32.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.359+0000 7f02e6e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:32.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.359+0000 7f02e6e0f800 20 realm 2024-09-12T17:03:32.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.359+0000 7f02e6e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:03:32.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.359+0000 7f02e6e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:32.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.359+0000 7f02e6e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:03:32.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.359+0000 7f02e6e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:03:32.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.359+0000 7f02e6e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:32.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.359+0000 7f02e6e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:03:32.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.360+0000 7f02e6e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:32.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.360+0000 7f02e6e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:03:32.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.361+0000 7f02e6e0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:03:32.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.361+0000 7f02e6e0f800 20 searching for the correct realm 2024-09-12T17:03:32.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.363+0000 7f02dffff640 0 -- 172.21.15.67:0/4237756024 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f02d8045bf0 msgr2=0x7f02d80438f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:32.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.367+0000 7f02e48f9640 0 -- 172.21.15.67:0/4237756024 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f02d0017020 msgr2=0x7f02d0096aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:32.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.573+0000 7f02e6e0f800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:03:32.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.573+0000 7f02e6e0f800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:03:32.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.573+0000 7f02e6e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:03:32.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.573+0000 7f02e6e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:03:32.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.573+0000 7f02e6e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:03:32.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.573+0000 7f02e6e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:03:32.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.573+0000 7f02e6e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:03:32.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.573+0000 7f02e6e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:32.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.573+0000 7f02e6e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:03:32.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.574+0000 7f02e6e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:32.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.574+0000 7f02e6e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:03:32.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.574+0000 7f02e6e0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:03:32.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.574+0000 7f02e6e0f800 20 zone default found 2024-09-12T17:03:32.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.574+0000 7f02e6e0f800 4 Realm: () 2024-09-12T17:03:32.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.574+0000 7f02e6e0f800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:03:32.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.574+0000 7f02e6e0f800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:03:32.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.574+0000 7f02e6e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:03:32.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.574+0000 7f02e6e0f800 20 zonegroup default 2024-09-12T17:03:32.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.574+0000 7f02e6e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:03:32.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.574+0000 7f02e6e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:32.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.574+0000 7f02e6e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:03:32.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.575+0000 7f02e6e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:32.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.575+0000 7f02e6e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:03:32.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.575+0000 7f02e6e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:32.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.575+0000 7f02e6e0f800 20 started sync module instance, tier type = 2024-09-12T17:03:32.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.575+0000 7f02e6e0f800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:03:32.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.593+0000 7f02e6e0f800 20 add_watcher() i=0 2024-09-12T17:03:32.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.593+0000 7f02e6e0f800 20 add_watcher() i=1 2024-09-12T17:03:32.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.593+0000 7f02e6e0f800 20 add_watcher() i=2 2024-09-12T17:03:32.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.593+0000 7f02e6e0f800 20 add_watcher() i=3 2024-09-12T17:03:32.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.593+0000 7f02e6e0f800 20 add_watcher() i=4 2024-09-12T17:03:32.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.593+0000 7f02e6e0f800 20 add_watcher() i=5 2024-09-12T17:03:32.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.595+0000 7f02e6e0f800 20 add_watcher() i=6 2024-09-12T17:03:32.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.596+0000 7f02e6e0f800 20 add_watcher() i=7 2024-09-12T17:03:32.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.596+0000 7f02e6e0f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:03:32.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.598+0000 7f0199fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:32.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.598+0000 7f02e6e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:03:32.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.598+0000 7f02e6e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:03:32.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.598+0000 7f02e6e0f800 5 note: GC not initialized 2024-09-12T17:03:32.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.599+0000 7f0198fe1640 20 reqs_thread_entry: start 2024-09-12T17:03:32.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.599+0000 7f02e6e0f800 20 init_complete bucket index max shards: 1 2024-09-12T17:03:32.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.599+0000 7f02e6e0f800 20 Filter name: none 2024-09-12T17:03:32.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.599+0000 7f01127fc640 20 reqs_thread_entry: start 2024-09-12T17:03:32.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.599+0000 7f02e6e0f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:03:32.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.599+0000 7f02e6e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:03:32.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.599+0000 7f02e6e0f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:03:32.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.599+0000 7f02e6e0f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:03:32.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.599+0000 7f02e6e0f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:03:32.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.599+0000 7f02e6e0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 : miss 2024-09-12T17:03:32.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.599+0000 7f02e6e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:03:32.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.600+0000 7f02e6e0f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:03:32.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.600+0000 7f02e6e0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 info.flags=0x17 2024-09-12T17:03:32.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.600+0000 7f02e6e0f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 to cache LRU end 2024-09-12T17:03:32.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.600+0000 7f02e6e0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:03:32.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.600+0000 7f02e6e0f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:03:32.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.600+0000 7f02e6e0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 2024-09-12T17:03:32.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.600+0000 7f02e6e0f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:32.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.602+0000 7f02e6e0f800 1 NOTICE: finished shard 0 (4 entries found) 2024-09-12T17:03:32.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.602+0000 7f02e6e0f800 1 NOTICE: finished all shards (4 entries found) 2024-09-12T17:03:32.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.603+0000 7f0199fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:32.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.606+0000 7f02e6e0f800 20 remove_watcher() i=0 2024-09-12T17:03:32.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.606+0000 7f02e6e0f800 2 removed watcher, disabling cache 2024-09-12T17:03:32.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.607+0000 7f02e6e0f800 20 remove_watcher() i=1 2024-09-12T17:03:32.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.610+0000 7f02e6e0f800 20 remove_watcher() i=2 2024-09-12T17:03:32.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.611+0000 7f02e6e0f800 20 remove_watcher() i=3 2024-09-12T17:03:32.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.612+0000 7f02e6e0f800 20 remove_watcher() i=4 2024-09-12T17:03:32.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.613+0000 7f02e6e0f800 20 remove_watcher() i=5 2024-09-12T17:03:32.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.615+0000 7f02e6e0f800 20 remove_watcher() i=6 2024-09-12T17:03:32.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.616+0000 7f02e6e0f800 20 remove_watcher() i=7 2024-09-12T17:03:32.628 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: unlinked entries are not listable 2024-09-12T17:03:32.628 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:03:32.631 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:32.631 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:32.743 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-12T17:03:32.743 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:03:32.745 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:32.745 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:32.814 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:32.814 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:32.876 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-12T17:03:32.876 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:03:32.877 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:03:32.914 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:03:32.914 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:03:32.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.952+0000 7ff1db540800 20 rados->read ofs=0 len=0 2024-09-12T17:03:32.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.953+0000 7ff1db540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:32.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.953+0000 7ff1db540800 20 realm 2024-09-12T17:03:32.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.953+0000 7ff1db540800 20 rados->read ofs=0 len=0 2024-09-12T17:03:32.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.954+0000 7ff1db540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:32.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.954+0000 7ff1db540800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:03:32.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.954+0000 7ff1db540800 20 rados->read ofs=0 len=0 2024-09-12T17:03:32.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.954+0000 7ff1db540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:32.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.954+0000 7ff1db540800 20 rados->read ofs=0 len=0 2024-09-12T17:03:32.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.955+0000 7ff1db540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:32.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.955+0000 7ff1db540800 20 rados->read ofs=0 len=0 2024-09-12T17:03:32.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.956+0000 7ff1db540800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:03:32.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.956+0000 7ff1db540800 20 searching for the correct realm 2024-09-12T17:03:32.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.958+0000 7ff1d6abf640 0 -- 172.21.15.67:0/4206336176 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x558fcf1ba8c0 msgr2=0x558fcf1bccb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:32.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:32.962+0000 7ff1d72c0640 0 -- 172.21.15.67:0/4206336176 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7ff1c0001c20 msgr2=0x7ff1c003e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:33.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.168+0000 7ff1db540800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:03:33.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.168+0000 7ff1db540800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:03:33.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.168+0000 7ff1db540800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:03:33.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.168+0000 7ff1db540800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:03:33.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.168+0000 7ff1db540800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:03:33.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.168+0000 7ff1db540800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:03:33.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.168+0000 7ff1db540800 20 rados->read ofs=0 len=0 2024-09-12T17:03:33.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.169+0000 7ff1db540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:33.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.169+0000 7ff1db540800 20 rados->read ofs=0 len=0 2024-09-12T17:03:33.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.169+0000 7ff1db540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:33.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.169+0000 7ff1db540800 20 rados->read ofs=0 len=0 2024-09-12T17:03:33.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.169+0000 7ff1db540800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:03:33.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.169+0000 7ff1db540800 20 zone default found 2024-09-12T17:03:33.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.169+0000 7ff1db540800 4 Realm: () 2024-09-12T17:03:33.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.169+0000 7ff1db540800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:03:33.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.169+0000 7ff1db540800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:03:33.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.169+0000 7ff1db540800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:03:33.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.169+0000 7ff1db540800 20 zonegroup default 2024-09-12T17:03:33.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.169+0000 7ff1db540800 20 rados->read ofs=0 len=0 2024-09-12T17:03:33.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.170+0000 7ff1db540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:33.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.170+0000 7ff1db540800 20 rados->read ofs=0 len=0 2024-09-12T17:03:33.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.170+0000 7ff1db540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:33.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.170+0000 7ff1db540800 20 rados->read ofs=0 len=0 2024-09-12T17:03:33.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.170+0000 7ff1db540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:33.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.171+0000 7ff1db540800 20 started sync module instance, tier type = 2024-09-12T17:03:33.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.171+0000 7ff1db540800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:03:33.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.185+0000 7ff1db540800 20 add_watcher() i=0 2024-09-12T17:03:33.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.185+0000 7ff1db540800 20 add_watcher() i=1 2024-09-12T17:03:33.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.185+0000 7ff1db540800 20 add_watcher() i=2 2024-09-12T17:03:33.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.185+0000 7ff1db540800 20 add_watcher() i=3 2024-09-12T17:03:33.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.185+0000 7ff1db540800 20 add_watcher() i=4 2024-09-12T17:03:33.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.185+0000 7ff1db540800 20 add_watcher() i=5 2024-09-12T17:03:33.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.187+0000 7ff1db540800 20 add_watcher() i=6 2024-09-12T17:03:33.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.187+0000 7ff1db540800 20 add_watcher() i=7 2024-09-12T17:03:33.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.187+0000 7ff1db540800 2 all 8 watchers are set, enabling cache 2024-09-12T17:03:33.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.189+0000 7ff08e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:33.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.189+0000 7ff1db540800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:03:33.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.189+0000 7ff1db540800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:03:33.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.189+0000 7ff1db540800 5 note: GC not initialized 2024-09-12T17:03:33.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.189+0000 7ff08d7e2640 20 reqs_thread_entry: start 2024-09-12T17:03:33.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.189+0000 7ff1db540800 20 init_complete bucket index max shards: 1 2024-09-12T17:03:33.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.189+0000 7ff1db540800 20 Filter name: none 2024-09-12T17:03:33.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.190+0000 7ff0867fc640 20 reqs_thread_entry: start 2024-09-12T17:03:33.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.190+0000 7ff1db540800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:03:33.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.190+0000 7ff1db540800 20 rados->read ofs=0 len=0 2024-09-12T17:03:33.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.190+0000 7ff1db540800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:03:33.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.190+0000 7ff1db540800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:03:33.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.190+0000 7ff1db540800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:03:33.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.190+0000 7ff1db540800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 : miss 2024-09-12T17:03:33.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.190+0000 7ff1db540800 20 rados->read ofs=0 len=0 2024-09-12T17:03:33.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.190+0000 7ff1db540800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:03:33.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.190+0000 7ff1db540800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 info.flags=0x17 2024-09-12T17:03:33.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.190+0000 7ff1db540800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 to cache LRU end 2024-09-12T17:03:33.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.190+0000 7ff1db540800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:03:33.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.190+0000 7ff1db540800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:03:33.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.190+0000 7ff1db540800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 2024-09-12T17:03:33.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.191+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.192+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.192+0000 7ff1db540800 20 get_obj_state: octx=0x558fcef28190 obj=check-bucket:c state=0x558fcf1f2598 s->prefetch_data=0 2024-09-12T17:03:33.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.193+0000 7ff1db540800 20 get_obj_state: setting s->obj_tag to ki9jpd7632do8svf1la9g33dbqk4jvt7 2024-09-12T17:03:33.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.193+0000 7ff1db540800 20 get_obj_state_impl: setting s->olh_tag to 71t0q8lqi0dj86eac9ljdkk1el72oh22 2024-09-12T17:03:33.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.193+0000 7ff1db540800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=71t0q8lqi0dj86eac9ljdkk1el72oh22 2024-09-12T17:03:33.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.194+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.195+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.196+0000 7ff1db540800 20 olh_log_entry: epoch=3 op=3 key=c[Jzp0ogcrd4gmTg7N9or7eM.Jj8DpImJ] 2024-09-12T17:03:33.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.196+0000 7ff1db540800 20 get_obj_state: octx=0x558fcef28190 obj=check-bucket:_:Jzp0ogcrd4gmTg7N9or7eM.Jj8DpImJ_c state=0x558fcf22e058 s->prefetch_data=0 2024-09-12T17:03:33.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.196+0000 7ff1db540800 10 manifest: total_size = 22 2024-09-12T17:03:33.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.196+0000 7ff1db540800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.5089815058509680212 2024-09-12T17:03:33.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.196+0000 7ff1db540800 20 get_obj_state: octx=0x558fcef28190 obj=check-bucket:_:Jzp0ogcrd4gmTg7N9or7eM.Jj8DpImJ_c state=0x558fcf22e058 s->prefetch_data=0 2024-09-12T17:03:33.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.196+0000 7ff1db540800 20 prepare_atomic_modification: state is not atomic. state=0x558fcf22e058 2024-09-12T17:03:33.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.196+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.200 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.198+0000 7ff1db540800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:03:33.200 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.198+0000 7ff1db540800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:03:33.200 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.198+0000 7ff1db540800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:03:33.200 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.199+0000 7ff1db540800 5 delete_objs_inline: removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2__shadow:Jzp0ogcrd4gmTg7N9or7eM.Jj8DpImJ_.aF5MryDW_pARxKRHVMY7ycwJud5C2XP_0 2024-09-12T17:03:33.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.200+0000 7ff1db540800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:03:33.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.200+0000 7ff0ba7fc640 20 handle_completion(): completion ok for obj=c[Jzp0ogcrd4gmTg7N9or7eM.Jj8DpImJ] 2024-09-12T17:03:33.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.201+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.201+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.202+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.202+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.203+0000 7ff1db540800 20 get_obj_state: octx=0x558fcef28190 obj=check-bucket:d state=0x558fcf1f0df8 s->prefetch_data=0 2024-09-12T17:03:33.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.203+0000 7ff1db540800 20 get_obj_state: setting s->obj_tag to vbzas7k5m4q12ltnk529ig2ocil0ag6z 2024-09-12T17:03:33.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.203+0000 7ff1db540800 20 get_obj_state_impl: setting s->olh_tag to gv7ma6daae8q0gw7rjl15a7sw80frl4i 2024-09-12T17:03:33.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.203+0000 7ff1db540800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=gv7ma6daae8q0gw7rjl15a7sw80frl4i 2024-09-12T17:03:33.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.204+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.206+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.206+0000 7ff1db540800 20 olh_log_entry: epoch=3 op=3 key=d[6JPGtLRgk-AYGn0J5lK9mMHQ..8QGTe] 2024-09-12T17:03:33.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.206+0000 7ff1db540800 20 get_obj_state: octx=0x558fcef28190 obj=check-bucket:_:6JPGtLRgk-AYGn0J5lK9mMHQ..8QGTe_d state=0x558fcf22e058 s->prefetch_data=0 2024-09-12T17:03:33.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.206+0000 7ff1db540800 10 manifest: total_size = 22 2024-09-12T17:03:33.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.206+0000 7ff1db540800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.13307033401256955485 2024-09-12T17:03:33.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.206+0000 7ff1db540800 20 get_obj_state: octx=0x558fcef28190 obj=check-bucket:_:6JPGtLRgk-AYGn0J5lK9mMHQ..8QGTe_d state=0x558fcf22e058 s->prefetch_data=0 2024-09-12T17:03:33.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.206+0000 7ff1db540800 20 prepare_atomic_modification: state is not atomic. state=0x558fcf22e058 2024-09-12T17:03:33.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.206+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.209+0000 7ff1db540800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:03:33.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.209+0000 7ff1db540800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:03:33.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.209+0000 7ff1db540800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:03:33.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.209+0000 7ff1db540800 5 delete_objs_inline: removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2__shadow:6JPGtLRgk-AYGn0J5lK9mMHQ..8QGTe_.q0cclSMwXpCmY2R7G5LdKMcsHGO_6eL_0 2024-09-12T17:03:33.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.211+0000 7ff1db540800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:03:33.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.211+0000 7ff0ba7fc640 20 handle_completion(): completion ok for obj=d[6JPGtLRgk-AYGn0J5lK9mMHQ..8QGTe] 2024-09-12T17:03:33.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.212+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.212+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.214 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.213+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.213+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.213+0000 7ff1db540800 20 get_obj_state: octx=0x558fcef28190 obj=check-bucket:e state=0x558fcf1f0df8 s->prefetch_data=0 2024-09-12T17:03:33.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.214+0000 7ff1db540800 20 get_obj_state: setting s->obj_tag to dzrj37hse2man8ya2vi12ofhlfz1j93h 2024-09-12T17:03:33.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.214+0000 7ff1db540800 20 get_obj_state_impl: setting s->olh_tag to t0gpsy830qko89tjdfrbb3d3nzod25nc 2024-09-12T17:03:33.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.214+0000 7ff1db540800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=t0gpsy830qko89tjdfrbb3d3nzod25nc 2024-09-12T17:03:33.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.215+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.216+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.216+0000 7ff1db540800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T17:03:33.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.216+0000 7ff1db540800 20 olh_log_entry: epoch=2 op=3 key=e[oQ.vSZQrD6OPxOSM0KUJlDnLSbl-Q9J] 2024-09-12T17:03:33.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.216+0000 7ff1db540800 20 get_obj_state: octx=0x558fcef28190 obj=check-bucket:_:oQ.vSZQrD6OPxOSM0KUJlDnLSbl-Q9J_e state=0x558fcf1ed888 s->prefetch_data=0 2024-09-12T17:03:33.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.217+0000 7ff1db540800 10 manifest: total_size = 22 2024-09-12T17:03:33.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.217+0000 7ff1db540800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.12639100958887934990 2024-09-12T17:03:33.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.217+0000 7ff1db540800 20 get_obj_state: octx=0x558fcef28190 obj=check-bucket:_:oQ.vSZQrD6OPxOSM0KUJlDnLSbl-Q9J_e state=0x558fcf1ed888 s->prefetch_data=0 2024-09-12T17:03:33.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.217+0000 7ff1db540800 20 prepare_atomic_modification: state is not atomic. state=0x558fcf1ed888 2024-09-12T17:03:33.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.217+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.219+0000 7ff1db540800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:03:33.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.219+0000 7ff1db540800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:03:33.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.219+0000 7ff1db540800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:03:33.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.219+0000 7ff1db540800 5 delete_objs_inline: removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2__shadow:oQ.vSZQrD6OPxOSM0KUJlDnLSbl-Q9J_.fFr6ForXIYkWgHwTpAYE847XqdVcFqe_0 2024-09-12T17:03:33.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.220+0000 7ff0baffd640 20 handle_completion(): completion ok for obj=e[oQ.vSZQrD6OPxOSM0KUJlDnLSbl-Q9J] 2024-09-12T17:03:33.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.220+0000 7ff1db540800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:03:33.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.221+0000 7ff1db540800 20 get_obj_state: octx=0x558fcef28190 obj=check-bucket:e state=0x558fcf1f0df8 s->prefetch_data=0 2024-09-12T17:03:33.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.221+0000 7ff1db540800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=t0gpsy830qko89tjdfrbb3d3nzod25nc 2024-09-12T17:03:33.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.224+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.225+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.225+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.226+0000 7ff1db540800 20 get_obj_state: octx=0x558fcef28190 obj=check-bucket:f state=0x558fcf232568 s->prefetch_data=0 2024-09-12T17:03:33.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.226+0000 7ff1db540800 20 get_obj_state: setting s->obj_tag to 2ychsug9pbmi3pc0kp9mf9i4mnk98xi3 2024-09-12T17:03:33.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.226+0000 7ff1db540800 20 get_obj_state_impl: setting s->olh_tag to mlwjfytm8ocpp1e4c9fdhwm47kud90cm 2024-09-12T17:03:33.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.226+0000 7ff1db540800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mlwjfytm8ocpp1e4c9fdhwm47kud90cm 2024-09-12T17:03:33.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.227+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.229+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.229+0000 7ff1db540800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T17:03:33.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.229+0000 7ff1db540800 20 olh_log_entry: epoch=2 op=3 key=f[Q6vKP5Y9IUrqSpR8TW.L7aopSoK4Xby] 2024-09-12T17:03:33.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.229+0000 7ff1db540800 20 get_obj_state: octx=0x558fcef28190 obj=check-bucket:_:Q6vKP5Y9IUrqSpR8TW.L7aopSoK4Xby_f state=0x558fcf1f35a8 s->prefetch_data=0 2024-09-12T17:03:33.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.229+0000 7ff1db540800 10 manifest: total_size = 11 2024-09-12T17:03:33.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.229+0000 7ff1db540800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.4238299625011368877 2024-09-12T17:03:33.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.229+0000 7ff1db540800 20 get_obj_state: octx=0x558fcef28190 obj=check-bucket:_:Q6vKP5Y9IUrqSpR8TW.L7aopSoK4Xby_f state=0x558fcf1f35a8 s->prefetch_data=0 2024-09-12T17:03:33.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.229+0000 7ff1db540800 20 prepare_atomic_modification: state is not atomic. state=0x558fcf1f35a8 2024-09-12T17:03:33.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.229+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.232+0000 7ff1db540800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:03:33.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.232+0000 7ff1db540800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T17:03:33.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.232+0000 7ff1db540800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:03:33.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.232+0000 7ff1db540800 5 delete_objs_inline: removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2__shadow:Q6vKP5Y9IUrqSpR8TW.L7aopSoK4Xby_.4lFvYipgG3EIb0_E9zQELUfhVKdOiLl_0 2024-09-12T17:03:33.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.233+0000 7ff0baffd640 20 handle_completion(): completion ok for obj=f[Q6vKP5Y9IUrqSpR8TW.L7aopSoK4Xby] 2024-09-12T17:03:33.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.233+0000 7ff1db540800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:03:33.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.234+0000 7ff1db540800 20 get_obj_state: octx=0x558fcef28190 obj=check-bucket:f state=0x558fcf232568 s->prefetch_data=0 2024-09-12T17:03:33.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.234+0000 7ff1db540800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mlwjfytm8ocpp1e4c9fdhwm47kud90cm 2024-09-12T17:03:33.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.236+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.238+0000 7ff1db540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.238+0000 7ff1db540800 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-12T17:03:33.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.238+0000 7ff1db540800 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T17:03:33.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.239+0000 7ff08e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:33.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.241+0000 7ff1db540800 20 remove_watcher() i=0 2024-09-12T17:03:33.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.241+0000 7ff1db540800 2 removed watcher, disabling cache 2024-09-12T17:03:33.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.242+0000 7ff1db540800 20 remove_watcher() i=1 2024-09-12T17:03:33.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.243+0000 7ff1db540800 20 remove_watcher() i=2 2024-09-12T17:03:33.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.245+0000 7ff1db540800 20 remove_watcher() i=3 2024-09-12T17:03:33.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.246+0000 7ff1db540800 20 remove_watcher() i=4 2024-09-12T17:03:33.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.247+0000 7ff1db540800 20 remove_watcher() i=5 2024-09-12T17:03:33.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.248+0000 7ff1db540800 20 remove_watcher() i=6 2024-09-12T17:03:33.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.249+0000 7ff1db540800 20 remove_watcher() i=7 2024-09-12T17:03:33.265 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:33.265 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:33.286 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:33.286 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:33.307 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:33.307 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:33.328 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:33.328 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:33.349 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-12T17:03:33.349 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:03:33.350 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:33.350 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:33.418 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:33.418 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:33.441 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:33.441 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:33.465 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:33.466 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:33.490 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:33.490 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:33.513 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-12T17:03:33.513 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:03:33.515 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:03:33.548 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:03:33.610 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:03:33.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.586+0000 7f5a8132e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:33.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.588+0000 7f5a8132e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:33.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.588+0000 7f5a8132e800 20 realm 2024-09-12T17:03:33.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.588+0000 7f5a8132e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:33.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.588+0000 7f5a8132e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:33.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.588+0000 7f5a8132e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:03:33.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.588+0000 7f5a8132e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:33.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.588+0000 7f5a8132e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:33.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.588+0000 7f5a8132e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:33.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.589+0000 7f5a8132e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:33.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.589+0000 7f5a8132e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:33.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.590+0000 7f5a8132e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:03:33.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.590+0000 7f5a8132e800 20 searching for the correct realm 2024-09-12T17:03:33.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.592+0000 7f5a7c8dc640 0 -- 172.21.15.67:0/1381505554 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55b5ebd52560 msgr2=0x55b5ebd54950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:33.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.596+0000 7f5a7d0dd640 0 -- 172.21.15.67:0/1381505554 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f5a74072fe0 msgr2=0x7f5a74068660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:33.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.803+0000 7f5a8132e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:03:33.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.803+0000 7f5a8132e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:03:33.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.803+0000 7f5a8132e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:03:33.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.803+0000 7f5a8132e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:03:33.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.803+0000 7f5a8132e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:03:33.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.803+0000 7f5a8132e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:03:33.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.803+0000 7f5a8132e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:33.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.803+0000 7f5a8132e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:33.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.803+0000 7f5a8132e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:33.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.804+0000 7f5a8132e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:33.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.804+0000 7f5a8132e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:33.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.804+0000 7f5a8132e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:03:33.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.804+0000 7f5a8132e800 20 zone default found 2024-09-12T17:03:33.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.804+0000 7f5a8132e800 4 Realm: () 2024-09-12T17:03:33.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.804+0000 7f5a8132e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:03:33.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.804+0000 7f5a8132e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:03:33.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.804+0000 7f5a8132e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:03:33.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.804+0000 7f5a8132e800 20 zonegroup default 2024-09-12T17:03:33.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.804+0000 7f5a8132e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:33.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.805+0000 7f5a8132e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:33.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.805+0000 7f5a8132e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:33.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.805+0000 7f5a8132e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:33.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.805+0000 7f5a8132e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:33.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.805+0000 7f5a8132e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:33.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.805+0000 7f5a8132e800 20 started sync module instance, tier type = 2024-09-12T17:03:33.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.805+0000 7f5a8132e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:03:33.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.817+0000 7f5a8132e800 20 add_watcher() i=0 2024-09-12T17:03:33.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.817+0000 7f5a8132e800 20 add_watcher() i=1 2024-09-12T17:03:33.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.817+0000 7f5a8132e800 20 add_watcher() i=2 2024-09-12T17:03:33.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.817+0000 7f5a8132e800 20 add_watcher() i=3 2024-09-12T17:03:33.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.817+0000 7f5a8132e800 20 add_watcher() i=4 2024-09-12T17:03:33.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.817+0000 7f5a8132e800 20 add_watcher() i=5 2024-09-12T17:03:33.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.817+0000 7f5a8132e800 20 add_watcher() i=6 2024-09-12T17:03:33.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.818+0000 7f5a8132e800 20 add_watcher() i=7 2024-09-12T17:03:33.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.818+0000 7f5a8132e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:03:33.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.819+0000 7f59337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:33.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.820+0000 7f5a8132e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:03:33.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.820+0000 7f5a8132e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:03:33.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.820+0000 7f5a8132e800 5 note: GC not initialized 2024-09-12T17:03:33.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.820+0000 7f59327e4640 20 reqs_thread_entry: start 2024-09-12T17:03:33.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.820+0000 7f5a8132e800 20 init_complete bucket index max shards: 1 2024-09-12T17:03:33.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.820+0000 7f5a8132e800 20 Filter name: none 2024-09-12T17:03:33.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.820+0000 7f58a3fff640 20 reqs_thread_entry: start 2024-09-12T17:03:33.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.820+0000 7f5a8132e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:03:33.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.820+0000 7f5a8132e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:33.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.821+0000 7f5a8132e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:03:33.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.821+0000 7f5a8132e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:03:33.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.821+0000 7f5a8132e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:03:33.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.821+0000 7f5a8132e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 : miss 2024-09-12T17:03:33.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.821+0000 7f5a8132e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:33.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.821+0000 7f5a8132e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:03:33.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.821+0000 7f5a8132e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 info.flags=0x17 2024-09-12T17:03:33.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.821+0000 7f5a8132e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 to cache LRU end 2024-09-12T17:03:33.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.821+0000 7f5a8132e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:03:33.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.821+0000 7f5a8132e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:03:33.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.821+0000 7f5a8132e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 2024-09-12T17:03:33.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.821+0000 7f5a8132e800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:33.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.822+0000 7f5a8132e800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:03:33.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.822+0000 7f5a8132e800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:03:33.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.823+0000 7f59337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:33.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.825+0000 7f5a8132e800 20 remove_watcher() i=0 2024-09-12T17:03:33.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.825+0000 7f5a8132e800 2 removed watcher, disabling cache 2024-09-12T17:03:33.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.827+0000 7f5a8132e800 20 remove_watcher() i=1 2024-09-12T17:03:33.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.828+0000 7f5a8132e800 20 remove_watcher() i=2 2024-09-12T17:03:33.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.829+0000 7f5a8132e800 20 remove_watcher() i=3 2024-09-12T17:03:33.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.831+0000 7f5a8132e800 20 remove_watcher() i=4 2024-09-12T17:03:33.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.832+0000 7f5a8132e800 20 remove_watcher() i=5 2024-09-12T17:03:33.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.834+0000 7f5a8132e800 20 remove_watcher() i=6 2024-09-12T17:03:33.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:33.835+0000 7f5a8132e800 20 remove_watcher() i=7 2024-09-12T17:03:33.851 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:33.851 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:33.994 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:33.994 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:34.046 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:03:34.077 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:03:34.077 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:03:34.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.115+0000 7f6e44814800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.117+0000 7f6e44814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:34.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.117+0000 7f6e44814800 20 realm 2024-09-12T17:03:34.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.117+0000 7f6e44814800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.117+0000 7f6e44814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:34.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.117+0000 7f6e44814800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:03:34.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.117+0000 7f6e44814800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.117+0000 7f6e44814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:34.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.117+0000 7f6e44814800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.118+0000 7f6e44814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:34.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.118+0000 7f6e44814800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.119+0000 7f6e44814800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:03:34.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.119+0000 7f6e44814800 20 searching for the correct realm 2024-09-12T17:03:34.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.122+0000 7f6e3ffe0640 0 -- 172.21.15.67:0/448872685 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f6e38013930 msgr2=0x7f6e38030410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:34.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.125+0000 7f6e3ffe0640 0 -- 172.21.15.67:0/448872685 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f6e2808f2a0 msgr2=0x7f6e28061940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:34.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.130+0000 7f6e44814800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:03:34.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.130+0000 7f6e44814800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:03:34.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.130+0000 7f6e44814800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:03:34.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.130+0000 7f6e44814800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:03:34.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.130+0000 7f6e44814800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:03:34.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.130+0000 7f6e44814800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:03:34.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.130+0000 7f6e44814800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.130+0000 7f6e44814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:34.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.130+0000 7f6e44814800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.130+0000 7f6e44814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:34.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.130+0000 7f6e44814800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.131+0000 7f6e44814800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:03:34.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.131+0000 7f6e44814800 20 zone default found 2024-09-12T17:03:34.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.131+0000 7f6e44814800 4 Realm: () 2024-09-12T17:03:34.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.131+0000 7f6e44814800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:03:34.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.131+0000 7f6e44814800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:03:34.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.131+0000 7f6e44814800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:03:34.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.131+0000 7f6e44814800 20 zonegroup default 2024-09-12T17:03:34.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.131+0000 7f6e44814800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.131+0000 7f6e44814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:34.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.131+0000 7f6e44814800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.132+0000 7f6e44814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:34.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.132+0000 7f6e44814800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.132+0000 7f6e44814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:34.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.132+0000 7f6e44814800 20 started sync module instance, tier type = 2024-09-12T17:03:34.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.132+0000 7f6e44814800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:03:34.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.146+0000 7f6e44814800 20 add_watcher() i=0 2024-09-12T17:03:34.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.146+0000 7f6e44814800 20 add_watcher() i=1 2024-09-12T17:03:34.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.146+0000 7f6e44814800 20 add_watcher() i=2 2024-09-12T17:03:34.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.146+0000 7f6e44814800 20 add_watcher() i=3 2024-09-12T17:03:34.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.146+0000 7f6e44814800 20 add_watcher() i=4 2024-09-12T17:03:34.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.146+0000 7f6e44814800 20 add_watcher() i=5 2024-09-12T17:03:34.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.146+0000 7f6e44814800 20 add_watcher() i=6 2024-09-12T17:03:34.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.147+0000 7f6e44814800 20 add_watcher() i=7 2024-09-12T17:03:34.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.147+0000 7f6e44814800 2 all 8 watchers are set, enabling cache 2024-09-12T17:03:34.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.149+0000 7f6cf5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:34.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.149+0000 7f6e44814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:03:34.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.149+0000 7f6e44814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:03:34.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.149+0000 7f6e44814800 5 note: GC not initialized 2024-09-12T17:03:34.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.149+0000 7f6cf4fe1640 20 reqs_thread_entry: start 2024-09-12T17:03:34.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.150+0000 7f6e44814800 20 init_complete bucket index max shards: 1 2024-09-12T17:03:34.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.150+0000 7f6e44814800 20 Filter name: none 2024-09-12T17:03:34.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.150+0000 7f6c6e7fc640 20 reqs_thread_entry: start 2024-09-12T17:03:34.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.150+0000 7f6e44814800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.150+0000 7f6e44814800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:03:34.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.150+0000 7f6e44814800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.151+0000 7f6e44814800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:03:34.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.151+0000 7f6e44814800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:03:34.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.151+0000 7f6e44814800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:03:34.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.151+0000 7f6e44814800 20 INFO: main: starting shard=0 2024-09-12T17:03:34.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.151+0000 7f6e44814800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:34.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.151+0000 7f6e44814800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T17:03:34.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.151+0000 7f6e44814800 20 INFO: main: done 2024-09-12T17:03:34.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.152+0000 7f6cf5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:34.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.154+0000 7f6e44814800 20 remove_watcher() i=0 2024-09-12T17:03:34.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.154+0000 7f6e44814800 2 removed watcher, disabling cache 2024-09-12T17:03:34.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.156+0000 7f6e44814800 20 remove_watcher() i=1 2024-09-12T17:03:34.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.156+0000 7f6e44814800 20 remove_watcher() i=2 2024-09-12T17:03:34.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.157+0000 7f6e44814800 20 remove_watcher() i=3 2024-09-12T17:03:34.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.159+0000 7f6e44814800 20 remove_watcher() i=4 2024-09-12T17:03:34.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.160+0000 7f6e44814800 20 remove_watcher() i=5 2024-09-12T17:03:34.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.163+0000 7f6e44814800 20 remove_watcher() i=6 2024-09-12T17:03:34.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.164+0000 7f6e44814800 20 remove_watcher() i=7 2024-09-12T17:03:34.177 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:03:34.209 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:03:34.209 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:03:34.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.246+0000 7fc5c380e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.248+0000 7fc5c380e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:34.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.248+0000 7fc5c380e800 20 realm 2024-09-12T17:03:34.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.248+0000 7fc5c380e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.248+0000 7fc5c380e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:34.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.248+0000 7fc5c380e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:03:34.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.248+0000 7fc5c380e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.248+0000 7fc5c380e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:34.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.248+0000 7fc5c380e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.249+0000 7fc5c380e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:34.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.249+0000 7fc5c380e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.250+0000 7fc5c380e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:03:34.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.250+0000 7fc5c380e800 20 searching for the correct realm 2024-09-12T17:03:34.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.252+0000 7fc5bee59640 0 -- 172.21.15.67:0/335401966 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7fc5b8025070 msgr2=0x7fc5b8064b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:34.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.256+0000 7fc5bee59640 0 -- 172.21.15.67:0/335401966 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fc5b40b2050 msgr2=0x7fc5b40dda60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:34.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.463+0000 7fc5c380e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:03:34.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.463+0000 7fc5c380e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:03:34.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.463+0000 7fc5c380e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:03:34.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.463+0000 7fc5c380e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:03:34.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.463+0000 7fc5c380e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:03:34.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.463+0000 7fc5c380e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:03:34.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.463+0000 7fc5c380e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.463+0000 7fc5c380e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:34.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.463+0000 7fc5c380e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.463+0000 7fc5c380e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:34.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.463+0000 7fc5c380e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.464+0000 7fc5c380e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:03:34.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.464+0000 7fc5c380e800 20 zone default found 2024-09-12T17:03:34.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.464+0000 7fc5c380e800 4 Realm: () 2024-09-12T17:03:34.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.464+0000 7fc5c380e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:03:34.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.464+0000 7fc5c380e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:03:34.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.464+0000 7fc5c380e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:03:34.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.464+0000 7fc5c380e800 20 zonegroup default 2024-09-12T17:03:34.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.464+0000 7fc5c380e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.464+0000 7fc5c380e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:34.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.464+0000 7fc5c380e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.464+0000 7fc5c380e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:34.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.464+0000 7fc5c380e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.464+0000 7fc5c380e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:34.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.464+0000 7fc5c380e800 20 started sync module instance, tier type = 2024-09-12T17:03:34.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.464+0000 7fc5c380e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:03:34.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.479+0000 7fc5c380e800 20 add_watcher() i=0 2024-09-12T17:03:34.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.479+0000 7fc5c380e800 20 add_watcher() i=1 2024-09-12T17:03:34.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.479+0000 7fc5c380e800 20 add_watcher() i=2 2024-09-12T17:03:34.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.479+0000 7fc5c380e800 20 add_watcher() i=3 2024-09-12T17:03:34.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.479+0000 7fc5c380e800 20 add_watcher() i=4 2024-09-12T17:03:34.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.479+0000 7fc5c380e800 20 add_watcher() i=5 2024-09-12T17:03:34.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.480+0000 7fc5c380e800 20 add_watcher() i=6 2024-09-12T17:03:34.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.480+0000 7fc5c380e800 20 add_watcher() i=7 2024-09-12T17:03:34.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.480+0000 7fc5c380e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:03:34.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.482+0000 7fc4757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:34.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.483+0000 7fc5c380e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:03:34.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.483+0000 7fc5c380e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:03:34.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.483+0000 7fc5c380e800 5 note: GC not initialized 2024-09-12T17:03:34.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.483+0000 7fc3effff640 20 reqs_thread_entry: start 2024-09-12T17:03:34.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.483+0000 7fc5c380e800 20 init_complete bucket index max shards: 1 2024-09-12T17:03:34.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.483+0000 7fc5c380e800 20 Filter name: none 2024-09-12T17:03:34.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.483+0000 7fc3edffb640 20 reqs_thread_entry: start 2024-09-12T17:03:34.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.483+0000 7fc5c380e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.484+0000 7fc5c380e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:03:34.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.484+0000 7fc5c380e800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.484+0000 7fc5c380e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:03:34.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.484+0000 7fc5c380e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:03:34.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.484+0000 7fc5c380e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:03:34.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.484+0000 7fc5c380e800 20 INFO: main: starting shard=0 2024-09-12T17:03:34.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.484+0000 7fc5c380e800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:34.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.485+0000 7fc5c380e800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T17:03:34.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.485+0000 7fc5c380e800 20 INFO: main: done 2024-09-12T17:03:34.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.486+0000 7fc4757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:34.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.488+0000 7fc5c380e800 20 remove_watcher() i=0 2024-09-12T17:03:34.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.488+0000 7fc5c380e800 2 removed watcher, disabling cache 2024-09-12T17:03:34.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.489+0000 7fc5c380e800 20 remove_watcher() i=1 2024-09-12T17:03:34.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.490+0000 7fc5c380e800 20 remove_watcher() i=2 2024-09-12T17:03:34.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.492+0000 7fc5c380e800 20 remove_watcher() i=3 2024-09-12T17:03:34.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.493+0000 7fc5c380e800 20 remove_watcher() i=4 2024-09-12T17:03:34.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.494+0000 7fc5c380e800 20 remove_watcher() i=5 2024-09-12T17:03:34.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.497+0000 7fc5c380e800 20 remove_watcher() i=6 2024-09-12T17:03:34.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.498+0000 7fc5c380e800 20 remove_watcher() i=7 2024-09-12T17:03:34.510 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-12T17:03:34.510 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:03:34.512 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T17:03:34.543 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:03:34.543 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:03:34.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.581+0000 7f3911139800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.583+0000 7f3911139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:34.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.583+0000 7f3911139800 20 realm 2024-09-12T17:03:34.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.583+0000 7f3911139800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.583+0000 7f3911139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:34.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.583+0000 7f3911139800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:03:34.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.583+0000 7f3911139800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.583+0000 7f3911139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:34.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.583+0000 7f3911139800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.584+0000 7f3911139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:34.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.584+0000 7f3911139800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.585+0000 7f3911139800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:03:34.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.585+0000 7f3911139800 20 searching for the correct realm 2024-09-12T17:03:34.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.587+0000 7f390c5c6640 0 -- 172.21.15.67:0/3648404645 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f38fc085060 msgr2=0x7f38fc0aac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:34.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.591+0000 7f390cdc7640 0 -- 172.21.15.67:0/3648404645 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f3900017070 msgr2=0x7f3900098050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:03:34.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.798+0000 7f3911139800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:03:34.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.798+0000 7f3911139800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:03:34.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.798+0000 7f3911139800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:03:34.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.798+0000 7f3911139800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:03:34.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.798+0000 7f3911139800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:03:34.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.798+0000 7f3911139800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:03:34.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.798+0000 7f3911139800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.798+0000 7f3911139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:34.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.798+0000 7f3911139800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.798+0000 7f3911139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:34.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.798+0000 7f3911139800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.799+0000 7f3911139800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:03:34.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.799+0000 7f3911139800 20 zone default found 2024-09-12T17:03:34.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.799+0000 7f3911139800 4 Realm: () 2024-09-12T17:03:34.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.799+0000 7f3911139800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:03:34.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.799+0000 7f3911139800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:03:34.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.799+0000 7f3911139800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:03:34.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.799+0000 7f3911139800 20 zonegroup default 2024-09-12T17:03:34.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.799+0000 7f3911139800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.799+0000 7f3911139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:34.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.799+0000 7f3911139800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.799+0000 7f3911139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:34.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.799+0000 7f3911139800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.800+0000 7f3911139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:34.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.800+0000 7f3911139800 20 started sync module instance, tier type = 2024-09-12T17:03:34.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.800+0000 7f3911139800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:03:34.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.816+0000 7f3911139800 20 add_watcher() i=0 2024-09-12T17:03:34.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.816+0000 7f3911139800 20 add_watcher() i=1 2024-09-12T17:03:34.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.816+0000 7f3911139800 20 add_watcher() i=2 2024-09-12T17:03:34.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.816+0000 7f3911139800 20 add_watcher() i=3 2024-09-12T17:03:34.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.816+0000 7f3911139800 20 add_watcher() i=4 2024-09-12T17:03:34.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.816+0000 7f3911139800 20 add_watcher() i=5 2024-09-12T17:03:34.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.817+0000 7f3911139800 20 add_watcher() i=6 2024-09-12T17:03:34.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.818+0000 7f3911139800 20 add_watcher() i=7 2024-09-12T17:03:34.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.818+0000 7f3911139800 2 all 8 watchers are set, enabling cache 2024-09-12T17:03:34.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.820+0000 7f37c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:34.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.820+0000 7f3911139800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:03:34.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.820+0000 7f3911139800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:03:34.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.820+0000 7f3911139800 5 note: GC not initialized 2024-09-12T17:03:34.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.820+0000 7f37c1fe3640 20 reqs_thread_entry: start 2024-09-12T17:03:34.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.821+0000 7f3911139800 20 init_complete bucket index max shards: 1 2024-09-12T17:03:34.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.821+0000 7f3911139800 20 Filter name: none 2024-09-12T17:03:34.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.821+0000 7f37337fe640 20 reqs_thread_entry: start 2024-09-12T17:03:34.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.821+0000 7f3911139800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:03:34.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.821+0000 7f3911139800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.821+0000 7f3911139800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:03:34.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.821+0000 7f3911139800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:03:34.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.821+0000 7f3911139800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:03:34.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.821+0000 7f3911139800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 : miss 2024-09-12T17:03:34.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.821+0000 7f3911139800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.821+0000 7f3911139800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:03:34.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.821+0000 7f3911139800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 info.flags=0x17 2024-09-12T17:03:34.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.821+0000 7f3911139800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 to cache LRU end 2024-09-12T17:03:34.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.821+0000 7f3911139800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:03:34.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.821+0000 7f3911139800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:03:34.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.822+0000 7f3911139800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 2024-09-12T17:03:34.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.822+0000 7f3911139800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:34.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.822+0000 7f3911139800 1 NOTICE: finished shard 0 (2 entries found) 2024-09-12T17:03:34.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.822+0000 7f3911139800 1 NOTICE: finished all shards (2 entries found) 2024-09-12T17:03:34.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.823+0000 7f37c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:34.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.826+0000 7f3911139800 20 remove_watcher() i=0 2024-09-12T17:03:34.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.826+0000 7f3911139800 2 removed watcher, disabling cache 2024-09-12T17:03:34.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.827+0000 7f3911139800 20 remove_watcher() i=1 2024-09-12T17:03:34.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.828+0000 7f3911139800 20 remove_watcher() i=2 2024-09-12T17:03:34.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.829+0000 7f3911139800 20 remove_watcher() i=3 2024-09-12T17:03:34.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.830+0000 7f3911139800 20 remove_watcher() i=4 2024-09-12T17:03:34.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.831+0000 7f3911139800 20 remove_watcher() i=5 2024-09-12T17:03:34.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.832+0000 7f3911139800 20 remove_watcher() i=6 2024-09-12T17:03:34.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.833+0000 7f3911139800 20 remove_watcher() i=7 2024-09-12T17:03:34.845 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-12T17:03:34.845 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:03:34.847 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:03:34.880 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:03:34.880 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:03:34.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.918+0000 7f7365d35800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.920+0000 7f7365d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:34.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.920+0000 7f7365d35800 20 realm 2024-09-12T17:03:34.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.920+0000 7f7365d35800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.920+0000 7f7365d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:34.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.920+0000 7f7365d35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:03:34.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.920+0000 7f7365d35800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.921+0000 7f7365d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:34.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.921+0000 7f7365d35800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.922+0000 7f7365d35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:34.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.922+0000 7f7365d35800 20 rados->read ofs=0 len=0 2024-09-12T17:03:34.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.923+0000 7f7365d35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:03:34.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:34.923+0000 7f7365d35800 20 searching for the correct realm 2024-09-12T17:03:35.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.125+0000 7f7361ae4640 0 -- 172.21.15.67:0/31220325 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f735c027050 msgr2=0x7f735c066830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:03:35.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.332+0000 7f73612e3640 0 -- 172.21.15.67:0/31220325 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f7354074070 msgr2=0x7f7354076440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:35.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.339+0000 7f7365d35800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:03:35.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.339+0000 7f7365d35800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:03:35.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.339+0000 7f7365d35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:03:35.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.339+0000 7f7365d35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:03:35.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.339+0000 7f7365d35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:03:35.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.339+0000 7f7365d35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:03:35.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.339+0000 7f7365d35800 20 rados->read ofs=0 len=0 2024-09-12T17:03:35.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.339+0000 7f7365d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:35.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.339+0000 7f7365d35800 20 rados->read ofs=0 len=0 2024-09-12T17:03:35.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.339+0000 7f7365d35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:35.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.339+0000 7f7365d35800 20 rados->read ofs=0 len=0 2024-09-12T17:03:35.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.340+0000 7f7365d35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:03:35.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.340+0000 7f7365d35800 20 zone default found 2024-09-12T17:03:35.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.340+0000 7f7365d35800 4 Realm: () 2024-09-12T17:03:35.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.340+0000 7f7365d35800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:03:35.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.340+0000 7f7365d35800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:03:35.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.340+0000 7f7365d35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:03:35.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.340+0000 7f7365d35800 20 zonegroup default 2024-09-12T17:03:35.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.340+0000 7f7365d35800 20 rados->read ofs=0 len=0 2024-09-12T17:03:35.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.340+0000 7f7365d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:35.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.340+0000 7f7365d35800 20 rados->read ofs=0 len=0 2024-09-12T17:03:35.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.341+0000 7f7365d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:35.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.341+0000 7f7365d35800 20 rados->read ofs=0 len=0 2024-09-12T17:03:35.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.341+0000 7f7365d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:35.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.341+0000 7f7365d35800 20 started sync module instance, tier type = 2024-09-12T17:03:35.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.341+0000 7f7365d35800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:03:35.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.353+0000 7f7365d35800 20 add_watcher() i=0 2024-09-12T17:03:35.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.353+0000 7f7365d35800 20 add_watcher() i=1 2024-09-12T17:03:35.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.353+0000 7f7365d35800 20 add_watcher() i=2 2024-09-12T17:03:35.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.353+0000 7f7365d35800 20 add_watcher() i=3 2024-09-12T17:03:35.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.353+0000 7f7365d35800 20 add_watcher() i=4 2024-09-12T17:03:35.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.353+0000 7f7365d35800 20 add_watcher() i=5 2024-09-12T17:03:35.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.353+0000 7f7365d35800 20 add_watcher() i=6 2024-09-12T17:03:35.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.354+0000 7f7365d35800 20 add_watcher() i=7 2024-09-12T17:03:35.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.354+0000 7f7365d35800 2 all 8 watchers are set, enabling cache 2024-09-12T17:03:35.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.356+0000 7f72137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:35.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.356+0000 7f7365d35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:03:35.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.356+0000 7f7365d35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:03:35.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.356+0000 7f7365d35800 5 note: GC not initialized 2024-09-12T17:03:35.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.356+0000 7f72127fc640 20 reqs_thread_entry: start 2024-09-12T17:03:35.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.357+0000 7f7365d35800 20 init_complete bucket index max shards: 1 2024-09-12T17:03:35.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.357+0000 7f7365d35800 20 Filter name: none 2024-09-12T17:03:35.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.357+0000 7f7183fff640 20 reqs_thread_entry: start 2024-09-12T17:03:35.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.357+0000 7f7365d35800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:03:35.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.357+0000 7f7365d35800 20 rados->read ofs=0 len=0 2024-09-12T17:03:35.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.357+0000 7f7365d35800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:03:35.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.357+0000 7f7365d35800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:03:35.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.357+0000 7f7365d35800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:03:35.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.357+0000 7f7365d35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 : miss 2024-09-12T17:03:35.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.357+0000 7f7365d35800 20 rados->read ofs=0 len=0 2024-09-12T17:03:35.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.358+0000 7f7365d35800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:03:35.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.358+0000 7f7365d35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 info.flags=0x17 2024-09-12T17:03:35.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.358+0000 7f7365d35800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 to cache LRU end 2024-09-12T17:03:35.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.358+0000 7f7365d35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:03:35.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.358+0000 7f7365d35800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:03:35.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.358+0000 7f7365d35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 2024-09-12T17:03:35.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.358+0000 7f7365d35800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:35.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.358+0000 7f7365d35800 20 get_obj_state: octx=0x56028cf12180 obj=check-bucket:c state=0x56028d1e0748 s->prefetch_data=0 2024-09-12T17:03:35.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.359+0000 7f7365d35800 20 get_obj_state: setting s->obj_tag to ki9jpd7632do8svf1la9g33dbqk4jvt7 2024-09-12T17:03:35.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.359+0000 7f7365d35800 20 get_obj_state_impl: setting s->olh_tag to 71t0q8lqi0dj86eac9ljdkk1el72oh22 2024-09-12T17:03:35.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.359+0000 7f7365d35800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:35.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.359+0000 7f7365d35800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-12T17:03:35.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.359+0000 7f7365d35800 20 olh_log_entry: epoch=4 op=3 key=c[919qM-8zV6tbBrYervza605a8GwC4a3] 2024-09-12T17:03:35.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.359+0000 7f7365d35800 20 get_obj_state: octx=0x56028d2159b0 obj=check-bucket:_:919qM-8zV6tbBrYervza605a8GwC4a3_c state=0x56028d1dad78 s->prefetch_data=0 2024-09-12T17:03:35.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.361+0000 7f7365d35800 20 get_obj_state: octx=0x56028d2159b0 obj=check-bucket:c state=0x56028d1dad78 s->prefetch_data=0 2024-09-12T17:03:35.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.361+0000 7f7365d35800 20 get_obj_state: setting s->obj_tag to ki9jpd7632do8svf1la9g33dbqk4jvt7 2024-09-12T17:03:35.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.361+0000 7f7365d35800 20 get_obj_state_impl: setting s->olh_tag to 71t0q8lqi0dj86eac9ljdkk1el72oh22 2024-09-12T17:03:35.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.361+0000 7f7365d35800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=71t0q8lqi0dj86eac9ljdkk1el72oh22 2024-09-12T17:03:35.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.363+0000 7f7365d35800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:35.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.364+0000 7f7365d35800 20 get_obj_state: octx=0x56028cf12180 obj=check-bucket:d state=0x56028d1e0748 s->prefetch_data=0 2024-09-12T17:03:35.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.365+0000 7f7365d35800 20 get_obj_state: setting s->obj_tag to vbzas7k5m4q12ltnk529ig2ocil0ag6z 2024-09-12T17:03:35.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.365+0000 7f7365d35800 20 get_obj_state_impl: setting s->olh_tag to gv7ma6daae8q0gw7rjl15a7sw80frl4i 2024-09-12T17:03:35.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.365+0000 7f7365d35800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:35.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.365+0000 7f7365d35800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-12T17:03:35.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.365+0000 7f7365d35800 20 olh_log_entry: epoch=4 op=3 key=d[rlBrGcIQeAln2TdtS5Kd4WH4Rk7p6HX] 2024-09-12T17:03:35.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.365+0000 7f7365d35800 20 get_obj_state: octx=0x56028d2159b0 obj=check-bucket:_:rlBrGcIQeAln2TdtS5Kd4WH4Rk7p6HX_d state=0x56028d219338 s->prefetch_data=0 2024-09-12T17:03:35.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.367+0000 7f7365d35800 20 get_obj_state: octx=0x56028d2159b0 obj=check-bucket:d state=0x56028d1dd9d8 s->prefetch_data=0 2024-09-12T17:03:35.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.367+0000 7f7365d35800 20 get_obj_state: setting s->obj_tag to vbzas7k5m4q12ltnk529ig2ocil0ag6z 2024-09-12T17:03:35.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.367+0000 7f7365d35800 20 get_obj_state_impl: setting s->olh_tag to gv7ma6daae8q0gw7rjl15a7sw80frl4i 2024-09-12T17:03:35.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.367+0000 7f7365d35800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=gv7ma6daae8q0gw7rjl15a7sw80frl4i 2024-09-12T17:03:35.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.369+0000 7f7365d35800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:35.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.371+0000 7f7365d35800 1 NOTICE: finished shard 0 (2 entries removed) 2024-09-12T17:03:35.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.371+0000 7f7365d35800 1 NOTICE: finished all shards (2 entries removed) 2024-09-12T17:03:35.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.372+0000 7f72137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:35.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.374+0000 7f7365d35800 20 remove_watcher() i=0 2024-09-12T17:03:35.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.374+0000 7f7365d35800 2 removed watcher, disabling cache 2024-09-12T17:03:35.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.376+0000 7f7365d35800 20 remove_watcher() i=1 2024-09-12T17:03:35.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.377+0000 7f7365d35800 20 remove_watcher() i=2 2024-09-12T17:03:35.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.378+0000 7f7365d35800 20 remove_watcher() i=3 2024-09-12T17:03:35.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.379+0000 7f7365d35800 20 remove_watcher() i=4 2024-09-12T17:03:35.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.380+0000 7f7365d35800 20 remove_watcher() i=5 2024-09-12T17:03:35.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.381+0000 7f7365d35800 20 remove_watcher() i=6 2024-09-12T17:03:35.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.382+0000 7f7365d35800 20 remove_watcher() i=7 2024-09-12T17:03:35.401 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:03:35.429 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:03:35.429 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:03:35.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.466+0000 7efd1610c800 20 rados->read ofs=0 len=0 2024-09-12T17:03:35.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.468+0000 7efd1610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:35.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.468+0000 7efd1610c800 20 realm 2024-09-12T17:03:35.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.468+0000 7efd1610c800 20 rados->read ofs=0 len=0 2024-09-12T17:03:35.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.468+0000 7efd1610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:35.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.468+0000 7efd1610c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:03:35.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.468+0000 7efd1610c800 20 rados->read ofs=0 len=0 2024-09-12T17:03:35.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.469+0000 7efd1610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:35.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.469+0000 7efd1610c800 20 rados->read ofs=0 len=0 2024-09-12T17:03:35.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.469+0000 7efd1610c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:35.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.469+0000 7efd1610c800 20 rados->read ofs=0 len=0 2024-09-12T17:03:35.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.470+0000 7efd1610c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:03:35.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.470+0000 7efd1610c800 20 searching for the correct realm 2024-09-12T17:03:35.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.473+0000 7efd143f7640 0 -- 172.21.15.67:0/1746328709 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x5598280c0090 msgr2=0x5598280c24a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:35.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.477+0000 7efd133f5640 0 -- 172.21.15.67:0/1746328709 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x5598280c7b10 msgr2=0x5598280c9f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:35.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.481+0000 7efd1610c800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:03:35.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.481+0000 7efd1610c800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:03:35.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.481+0000 7efd1610c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:03:35.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.481+0000 7efd1610c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:03:35.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.481+0000 7efd1610c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:03:35.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.481+0000 7efd1610c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:03:35.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.481+0000 7efd1610c800 20 rados->read ofs=0 len=0 2024-09-12T17:03:35.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.481+0000 7efd1610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:35.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.481+0000 7efd1610c800 20 rados->read ofs=0 len=0 2024-09-12T17:03:35.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.481+0000 7efd1610c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:35.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.481+0000 7efd1610c800 20 rados->read ofs=0 len=0 2024-09-12T17:03:35.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.481+0000 7efd1610c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:03:35.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.481+0000 7efd1610c800 20 zone default found 2024-09-12T17:03:35.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.481+0000 7efd1610c800 4 Realm: () 2024-09-12T17:03:35.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.481+0000 7efd1610c800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:03:35.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.481+0000 7efd1610c800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:03:35.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.481+0000 7efd1610c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:03:35.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.481+0000 7efd1610c800 20 zonegroup default 2024-09-12T17:03:35.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.481+0000 7efd1610c800 20 rados->read ofs=0 len=0 2024-09-12T17:03:35.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.482+0000 7efd1610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:35.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.482+0000 7efd1610c800 20 rados->read ofs=0 len=0 2024-09-12T17:03:35.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.482+0000 7efd1610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:35.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.482+0000 7efd1610c800 20 rados->read ofs=0 len=0 2024-09-12T17:03:35.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.482+0000 7efd1610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:35.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.482+0000 7efd1610c800 20 started sync module instance, tier type = 2024-09-12T17:03:35.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.482+0000 7efd1610c800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:03:35.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.493+0000 7efd1610c800 20 add_watcher() i=0 2024-09-12T17:03:35.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.493+0000 7efd1610c800 20 add_watcher() i=1 2024-09-12T17:03:35.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.493+0000 7efd1610c800 20 add_watcher() i=2 2024-09-12T17:03:35.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.493+0000 7efd1610c800 20 add_watcher() i=3 2024-09-12T17:03:35.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.493+0000 7efd1610c800 20 add_watcher() i=4 2024-09-12T17:03:35.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.493+0000 7efd1610c800 20 add_watcher() i=5 2024-09-12T17:03:35.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.493+0000 7efd1610c800 20 add_watcher() i=6 2024-09-12T17:03:35.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.494+0000 7efd1610c800 20 add_watcher() i=7 2024-09-12T17:03:35.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.494+0000 7efd1610c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:03:35.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.495+0000 7efbc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:35.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.495+0000 7efd1610c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:03:35.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.495+0000 7efd1610c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:03:35.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.495+0000 7efd1610c800 5 note: GC not initialized 2024-09-12T17:03:35.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.496+0000 7efbc8fe1640 20 reqs_thread_entry: start 2024-09-12T17:03:35.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.496+0000 7efd1610c800 20 init_complete bucket index max shards: 1 2024-09-12T17:03:35.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.496+0000 7efd1610c800 20 Filter name: none 2024-09-12T17:03:35.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.496+0000 7efb427fc640 20 reqs_thread_entry: start 2024-09-12T17:03:35.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.496+0000 7efd1610c800 20 rados->read ofs=0 len=0 2024-09-12T17:03:35.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.496+0000 7efd1610c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:03:35.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.496+0000 7efd1610c800 20 rados->read ofs=0 len=0 2024-09-12T17:03:35.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.497+0000 7efd1610c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:03:35.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.497+0000 7efd1610c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:03:35.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.497+0000 7efd1610c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:03:35.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.497+0000 7efd1610c800 20 INFO: main: starting shard=0 2024-09-12T17:03:35.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.497+0000 7efd1610c800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:35.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.498+0000 7efd1610c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:03:35.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.498+0000 7efd1610c800 20 INFO: main: done 2024-09-12T17:03:35.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.498+0000 7efbc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:35.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.501+0000 7efd1610c800 20 remove_watcher() i=0 2024-09-12T17:03:35.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.501+0000 7efd1610c800 2 removed watcher, disabling cache 2024-09-12T17:03:35.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.502+0000 7efd1610c800 20 remove_watcher() i=1 2024-09-12T17:03:35.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.503+0000 7efd1610c800 20 remove_watcher() i=2 2024-09-12T17:03:35.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.504+0000 7efd1610c800 20 remove_watcher() i=3 2024-09-12T17:03:35.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.505+0000 7efd1610c800 20 remove_watcher() i=4 2024-09-12T17:03:35.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.506+0000 7efd1610c800 20 remove_watcher() i=5 2024-09-12T17:03:35.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.508+0000 7efd1610c800 20 remove_watcher() i=6 2024-09-12T17:03:35.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.509+0000 7efd1610c800 20 remove_watcher() i=7 2024-09-12T17:03:35.523 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:03:35.555 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:03:35.555 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:03:35.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.592+0000 7f7ec2698800 20 rados->read ofs=0 len=0 2024-09-12T17:03:35.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.593+0000 7f7ec2698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:35.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.593+0000 7f7ec2698800 20 realm 2024-09-12T17:03:35.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.593+0000 7f7ec2698800 20 rados->read ofs=0 len=0 2024-09-12T17:03:35.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.594+0000 7f7ec2698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:35.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.594+0000 7f7ec2698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:03:35.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.594+0000 7f7ec2698800 20 rados->read ofs=0 len=0 2024-09-12T17:03:35.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.594+0000 7f7ec2698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:35.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.594+0000 7f7ec2698800 20 rados->read ofs=0 len=0 2024-09-12T17:03:35.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.595+0000 7f7ec2698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:35.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.595+0000 7f7ec2698800 20 rados->read ofs=0 len=0 2024-09-12T17:03:35.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.595+0000 7f7ec2698800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:03:35.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.595+0000 7f7ec2698800 20 searching for the correct realm 2024-09-12T17:03:35.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:35.799+0000 7f7ebf981640 0 -- 172.21.15.67:0/3475674516 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f7eb006dbc0 msgr2=0x7f7eb007da40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:36.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.006+0000 7f7ec0182640 0 -- 172.21.15.67:0/3475674516 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f7eb407d570 msgr2=0x7f7eb407da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:36.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.213+0000 7f7ec2698800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:03:36.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.213+0000 7f7ec2698800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:03:36.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.213+0000 7f7ec2698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:03:36.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.213+0000 7f7ec2698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:03:36.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.213+0000 7f7ec2698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:03:36.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.213+0000 7f7ec2698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:03:36.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.213+0000 7f7ec2698800 20 rados->read ofs=0 len=0 2024-09-12T17:03:36.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.213+0000 7f7ec2698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:36.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.213+0000 7f7ec2698800 20 rados->read ofs=0 len=0 2024-09-12T17:03:36.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.214+0000 7f7ec2698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:36.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.214+0000 7f7ec2698800 20 rados->read ofs=0 len=0 2024-09-12T17:03:36.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.214+0000 7f7ec2698800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:03:36.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.214+0000 7f7ec2698800 20 zone default found 2024-09-12T17:03:36.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.214+0000 7f7ec2698800 4 Realm: () 2024-09-12T17:03:36.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.214+0000 7f7ec2698800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:03:36.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.214+0000 7f7ec2698800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:03:36.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.214+0000 7f7ec2698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:03:36.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.214+0000 7f7ec2698800 20 zonegroup default 2024-09-12T17:03:36.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.214+0000 7f7ec2698800 20 rados->read ofs=0 len=0 2024-09-12T17:03:36.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.215+0000 7f7ec2698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:36.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.215+0000 7f7ec2698800 20 rados->read ofs=0 len=0 2024-09-12T17:03:36.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.215+0000 7f7ec2698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:36.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.215+0000 7f7ec2698800 20 rados->read ofs=0 len=0 2024-09-12T17:03:36.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.216+0000 7f7ec2698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:36.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.216+0000 7f7ec2698800 20 started sync module instance, tier type = 2024-09-12T17:03:36.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.216+0000 7f7ec2698800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:03:36.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.227+0000 7f7ec2698800 20 add_watcher() i=0 2024-09-12T17:03:36.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.227+0000 7f7ec2698800 20 add_watcher() i=1 2024-09-12T17:03:36.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.227+0000 7f7ec2698800 20 add_watcher() i=2 2024-09-12T17:03:36.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.227+0000 7f7ec2698800 20 add_watcher() i=3 2024-09-12T17:03:36.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.227+0000 7f7ec2698800 20 add_watcher() i=4 2024-09-12T17:03:36.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.227+0000 7f7ec2698800 20 add_watcher() i=5 2024-09-12T17:03:36.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.227+0000 7f7ec2698800 20 add_watcher() i=6 2024-09-12T17:03:36.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.228+0000 7f7ec2698800 20 add_watcher() i=7 2024-09-12T17:03:36.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.228+0000 7f7ec2698800 2 all 8 watchers are set, enabling cache 2024-09-12T17:03:36.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.231+0000 7f7d76fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:36.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.231+0000 7f7ec2698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:03:36.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.231+0000 7f7ec2698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:03:36.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.231+0000 7f7ec2698800 5 note: GC not initialized 2024-09-12T17:03:36.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.231+0000 7f7d75fdb640 20 reqs_thread_entry: start 2024-09-12T17:03:36.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.231+0000 7f7ec2698800 20 init_complete bucket index max shards: 1 2024-09-12T17:03:36.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.231+0000 7f7ec2698800 20 Filter name: none 2024-09-12T17:03:36.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.232+0000 7f7ce77fe640 20 reqs_thread_entry: start 2024-09-12T17:03:36.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.232+0000 7f7ec2698800 20 rados->read ofs=0 len=0 2024-09-12T17:03:36.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.232+0000 7f7ec2698800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:03:36.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.232+0000 7f7ec2698800 20 rados->read ofs=0 len=0 2024-09-12T17:03:36.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.233+0000 7f7ec2698800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:03:36.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.233+0000 7f7ec2698800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:03:36.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.233+0000 7f7ec2698800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:03:36.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.233+0000 7f7ec2698800 20 INFO: main: starting shard=0 2024-09-12T17:03:36.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.233+0000 7f7ec2698800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:36.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.233+0000 7f7ec2698800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:03:36.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.233+0000 7f7ec2698800 20 INFO: main: done 2024-09-12T17:03:36.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.234+0000 7f7d76fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:36.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.237+0000 7f7ec2698800 20 remove_watcher() i=0 2024-09-12T17:03:36.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.237+0000 7f7ec2698800 2 removed watcher, disabling cache 2024-09-12T17:03:36.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.238+0000 7f7ec2698800 20 remove_watcher() i=1 2024-09-12T17:03:36.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.239+0000 7f7ec2698800 20 remove_watcher() i=2 2024-09-12T17:03:36.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.240+0000 7f7ec2698800 20 remove_watcher() i=3 2024-09-12T17:03:36.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.242+0000 7f7ec2698800 20 remove_watcher() i=4 2024-09-12T17:03:36.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.243+0000 7f7ec2698800 20 remove_watcher() i=5 2024-09-12T17:03:36.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.244+0000 7f7ec2698800 20 remove_watcher() i=6 2024-09-12T17:03:36.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.245+0000 7f7ec2698800 20 remove_watcher() i=7 2024-09-12T17:03:36.259 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-12T17:03:36.260 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:03:36.261 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T17:03:36.295 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:03:36.295 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:03:36.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.335+0000 7f2fd2946800 20 rados->read ofs=0 len=0 2024-09-12T17:03:36.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.337+0000 7f2fd2946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:36.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.337+0000 7f2fd2946800 20 realm 2024-09-12T17:03:36.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.337+0000 7f2fd2946800 20 rados->read ofs=0 len=0 2024-09-12T17:03:36.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.337+0000 7f2fd2946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:36.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.337+0000 7f2fd2946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:03:36.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.337+0000 7f2fd2946800 20 rados->read ofs=0 len=0 2024-09-12T17:03:36.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.337+0000 7f2fd2946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:36.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.337+0000 7f2fd2946800 20 rados->read ofs=0 len=0 2024-09-12T17:03:36.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.338+0000 7f2fd2946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:36.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.338+0000 7f2fd2946800 20 rados->read ofs=0 len=0 2024-09-12T17:03:36.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.339+0000 7f2fd2946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:03:36.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.339+0000 7f2fd2946800 20 searching for the correct realm 2024-09-12T17:03:36.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.342+0000 7f2fd0430640 0 -- 172.21.15.67:0/1232925585 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f2fc8028060 msgr2=0x7f2fc8062c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:36.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.345+0000 7f2fd0430640 0 -- 172.21.15.67:0/1232925585 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f2fc407a8b0 msgr2=0x7f2fc407a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:03:36.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.551+0000 7f2fd2946800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:03:36.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.551+0000 7f2fd2946800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:03:36.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.551+0000 7f2fd2946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:03:36.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.551+0000 7f2fd2946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:03:36.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.551+0000 7f2fd2946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:03:36.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.551+0000 7f2fd2946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:03:36.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.551+0000 7f2fd2946800 20 rados->read ofs=0 len=0 2024-09-12T17:03:36.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.552+0000 7f2fd2946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:36.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.552+0000 7f2fd2946800 20 rados->read ofs=0 len=0 2024-09-12T17:03:36.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.552+0000 7f2fd2946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:36.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.552+0000 7f2fd2946800 20 rados->read ofs=0 len=0 2024-09-12T17:03:36.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.552+0000 7f2fd2946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:03:36.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.552+0000 7f2fd2946800 20 zone default found 2024-09-12T17:03:36.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.552+0000 7f2fd2946800 4 Realm: () 2024-09-12T17:03:36.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.552+0000 7f2fd2946800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:03:36.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.552+0000 7f2fd2946800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:03:36.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.552+0000 7f2fd2946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:03:36.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.552+0000 7f2fd2946800 20 zonegroup default 2024-09-12T17:03:36.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.552+0000 7f2fd2946800 20 rados->read ofs=0 len=0 2024-09-12T17:03:36.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.553+0000 7f2fd2946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:36.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.553+0000 7f2fd2946800 20 rados->read ofs=0 len=0 2024-09-12T17:03:36.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.553+0000 7f2fd2946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:36.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.553+0000 7f2fd2946800 20 rados->read ofs=0 len=0 2024-09-12T17:03:36.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.553+0000 7f2fd2946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:36.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.553+0000 7f2fd2946800 20 started sync module instance, tier type = 2024-09-12T17:03:36.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.553+0000 7f2fd2946800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:03:36.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.566+0000 7f2fd2946800 20 add_watcher() i=0 2024-09-12T17:03:36.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.566+0000 7f2fd2946800 20 add_watcher() i=1 2024-09-12T17:03:36.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.566+0000 7f2fd2946800 20 add_watcher() i=2 2024-09-12T17:03:36.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.566+0000 7f2fd2946800 20 add_watcher() i=3 2024-09-12T17:03:36.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.566+0000 7f2fd2946800 20 add_watcher() i=4 2024-09-12T17:03:36.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.566+0000 7f2fd2946800 20 add_watcher() i=5 2024-09-12T17:03:36.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.571+0000 7f2fd2946800 20 add_watcher() i=6 2024-09-12T17:03:36.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.571+0000 7f2fd2946800 20 add_watcher() i=7 2024-09-12T17:03:36.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.571+0000 7f2fd2946800 2 all 8 watchers are set, enabling cache 2024-09-12T17:03:36.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.573+0000 7f2e86fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:36.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.574+0000 7f2fd2946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:03:36.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.574+0000 7f2fd2946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:03:36.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.574+0000 7f2fd2946800 5 note: GC not initialized 2024-09-12T17:03:36.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.574+0000 7f2e85fdb640 20 reqs_thread_entry: start 2024-09-12T17:03:36.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.574+0000 7f2fd2946800 20 init_complete bucket index max shards: 1 2024-09-12T17:03:36.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.574+0000 7f2fd2946800 20 Filter name: none 2024-09-12T17:03:36.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.574+0000 7f2df77fe640 20 reqs_thread_entry: start 2024-09-12T17:03:36.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.574+0000 7f2fd2946800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:03:36.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.574+0000 7f2fd2946800 20 rados->read ofs=0 len=0 2024-09-12T17:03:36.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.575+0000 7f2fd2946800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:03:36.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.575+0000 7f2fd2946800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:03:36.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.575+0000 7f2fd2946800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:03:36.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.575+0000 7f2fd2946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 : miss 2024-09-12T17:03:36.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.575+0000 7f2fd2946800 20 rados->read ofs=0 len=0 2024-09-12T17:03:36.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.575+0000 7f2fd2946800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:03:36.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.575+0000 7f2fd2946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 info.flags=0x17 2024-09-12T17:03:36.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.575+0000 7f2fd2946800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 to cache LRU end 2024-09-12T17:03:36.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.575+0000 7f2fd2946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:03:36.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.575+0000 7f2fd2946800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:03:36.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.575+0000 7f2fd2946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 2024-09-12T17:03:36.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.575+0000 7f2fd2946800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:36.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.576+0000 7f2fd2946800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:03:36.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.576+0000 7f2fd2946800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:03:36.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.577+0000 7f2e86fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:36.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.580+0000 7f2fd2946800 20 remove_watcher() i=0 2024-09-12T17:03:36.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.580+0000 7f2fd2946800 2 removed watcher, disabling cache 2024-09-12T17:03:36.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.581+0000 7f2fd2946800 20 remove_watcher() i=1 2024-09-12T17:03:36.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.583+0000 7f2fd2946800 20 remove_watcher() i=2 2024-09-12T17:03:36.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.584+0000 7f2fd2946800 20 remove_watcher() i=3 2024-09-12T17:03:36.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.585+0000 7f2fd2946800 20 remove_watcher() i=4 2024-09-12T17:03:36.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.586+0000 7f2fd2946800 20 remove_watcher() i=5 2024-09-12T17:03:36.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.587+0000 7f2fd2946800 20 remove_watcher() i=6 2024-09-12T17:03:36.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:36.588+0000 7f2fd2946800 20 remove_watcher() i=7 2024-09-12T17:03:36.600 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-12T17:03:36.600 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:03:36.602 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:36.603 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:36.627 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:36.627 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:36.651 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:36.651 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:36.720 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-12T17:03:36.720 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:03:36.721 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:36.721 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:36.787 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:36.787 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:37.009 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:37.009 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:37.069 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:37.069 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:37.094 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:37.094 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:37.147 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:37.148 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:37.173 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:37.173 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:37.229 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:37.229 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:37.254 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:37.254 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:37.340 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:37.340 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:37.365 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:37.365 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:37.418 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:37.419 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:37.445 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:37.445 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:37.499 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:37.499 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:37.523 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:03:37.941 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:03:39.361 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:39.362 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:39.451 INFO:tasks.workunit.client.0.smithi067.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:03:39.453 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:03:39.489 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:03:39.489 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:03:39.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.528+0000 7f135af2a800 20 rados->read ofs=0 len=0 2024-09-12T17:03:39.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.530+0000 7f135af2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:39.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.530+0000 7f135af2a800 20 realm 2024-09-12T17:03:39.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.530+0000 7f135af2a800 20 rados->read ofs=0 len=0 2024-09-12T17:03:39.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.530+0000 7f135af2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:39.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.530+0000 7f135af2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:03:39.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.530+0000 7f135af2a800 20 rados->read ofs=0 len=0 2024-09-12T17:03:39.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.530+0000 7f135af2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:39.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.530+0000 7f135af2a800 20 rados->read ofs=0 len=0 2024-09-12T17:03:39.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.531+0000 7f135af2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:39.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.531+0000 7f135af2a800 20 rados->read ofs=0 len=0 2024-09-12T17:03:39.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.532+0000 7f135af2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:03:39.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.532+0000 7f135af2a800 20 searching for the correct realm 2024-09-12T17:03:39.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.535+0000 7f1356c4f640 0 -- 172.21.15.67:0/4124142562 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f1350069310 msgr2=0x7f1350063c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:39.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.539+0000 7f1356c4f640 0 -- 172.21.15.67:0/4124142562 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f13400b16f0 msgr2=0x7f13400ab8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:39.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.746+0000 7f135af2a800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:03:39.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.746+0000 7f135af2a800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:03:39.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.746+0000 7f135af2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:03:39.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.746+0000 7f135af2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:03:39.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.746+0000 7f135af2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:03:39.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.746+0000 7f135af2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:03:39.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.746+0000 7f135af2a800 20 rados->read ofs=0 len=0 2024-09-12T17:03:39.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.746+0000 7f135af2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:39.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.746+0000 7f135af2a800 20 rados->read ofs=0 len=0 2024-09-12T17:03:39.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.747+0000 7f135af2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:39.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.747+0000 7f135af2a800 20 rados->read ofs=0 len=0 2024-09-12T17:03:39.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.747+0000 7f135af2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:03:39.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.747+0000 7f135af2a800 20 zone default found 2024-09-12T17:03:39.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.747+0000 7f135af2a800 4 Realm: () 2024-09-12T17:03:39.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.747+0000 7f135af2a800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:03:39.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.747+0000 7f135af2a800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:03:39.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.747+0000 7f135af2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:03:39.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.747+0000 7f135af2a800 20 zonegroup default 2024-09-12T17:03:39.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.747+0000 7f135af2a800 20 rados->read ofs=0 len=0 2024-09-12T17:03:39.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.747+0000 7f135af2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:39.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.747+0000 7f135af2a800 20 rados->read ofs=0 len=0 2024-09-12T17:03:39.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.748+0000 7f135af2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:39.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.748+0000 7f135af2a800 20 rados->read ofs=0 len=0 2024-09-12T17:03:39.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.748+0000 7f135af2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:39.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.748+0000 7f135af2a800 20 started sync module instance, tier type = 2024-09-12T17:03:39.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.748+0000 7f135af2a800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:03:39.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.762+0000 7f135af2a800 20 add_watcher() i=0 2024-09-12T17:03:39.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.762+0000 7f135af2a800 20 add_watcher() i=1 2024-09-12T17:03:39.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.762+0000 7f135af2a800 20 add_watcher() i=2 2024-09-12T17:03:39.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.762+0000 7f135af2a800 20 add_watcher() i=3 2024-09-12T17:03:39.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.762+0000 7f135af2a800 20 add_watcher() i=4 2024-09-12T17:03:39.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.762+0000 7f135af2a800 20 add_watcher() i=5 2024-09-12T17:03:39.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.762+0000 7f135af2a800 20 add_watcher() i=6 2024-09-12T17:03:39.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.764+0000 7f135af2a800 20 add_watcher() i=7 2024-09-12T17:03:39.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.764+0000 7f135af2a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:03:39.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.767+0000 7f120d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:39.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.767+0000 7f135af2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:03:39.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.767+0000 7f135af2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:03:39.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.767+0000 7f135af2a800 5 note: GC not initialized 2024-09-12T17:03:39.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.768+0000 7f1187fff640 20 reqs_thread_entry: start 2024-09-12T17:03:39.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.768+0000 7f135af2a800 20 init_complete bucket index max shards: 1 2024-09-12T17:03:39.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.768+0000 7f135af2a800 20 Filter name: none 2024-09-12T17:03:39.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.768+0000 7f1185ffb640 20 reqs_thread_entry: start 2024-09-12T17:03:39.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.768+0000 7f135af2a800 20 rados->read ofs=0 len=0 2024-09-12T17:03:39.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.768+0000 7f135af2a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:03:39.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.768+0000 7f135af2a800 20 rados->read ofs=0 len=0 2024-09-12T17:03:39.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.769+0000 7f135af2a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:03:39.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.769+0000 7f135af2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:03:39.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.769+0000 7f135af2a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:03:39.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.769+0000 7f135af2a800 20 INFO: main: starting shard=0 2024-09-12T17:03:39.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.769+0000 7f135af2a800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:39.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.770+0000 7f135af2a800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:03:39.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.770+0000 7f135af2a800 20 INFO: main: done 2024-09-12T17:03:39.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.771+0000 7f120d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:39.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.773+0000 7f135af2a800 20 remove_watcher() i=0 2024-09-12T17:03:39.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.773+0000 7f135af2a800 2 removed watcher, disabling cache 2024-09-12T17:03:39.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.775+0000 7f135af2a800 20 remove_watcher() i=1 2024-09-12T17:03:39.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.776+0000 7f135af2a800 20 remove_watcher() i=2 2024-09-12T17:03:39.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.777+0000 7f135af2a800 20 remove_watcher() i=3 2024-09-12T17:03:39.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.778+0000 7f135af2a800 20 remove_watcher() i=4 2024-09-12T17:03:39.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.779+0000 7f135af2a800 20 remove_watcher() i=5 2024-09-12T17:03:39.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.780+0000 7f135af2a800 20 remove_watcher() i=6 2024-09-12T17:03:39.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:39.782+0000 7f135af2a800 20 remove_watcher() i=7 2024-09-12T17:03:39.798 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:39.798 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:39.823 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:39.823 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:39.847 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:39.847 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:39.933 INFO:tasks.workunit.client.0.smithi067.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:03:39.934 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:03:39.966 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:03:39.966 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:03:40.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.003+0000 7f0005013800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.005+0000 7f0005013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:40.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.005+0000 7f0005013800 20 realm 2024-09-12T17:03:40.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.005+0000 7f0005013800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.005+0000 7f0005013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:40.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.005+0000 7f0005013800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:03:40.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.005+0000 7f0005013800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.005+0000 7f0005013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:40.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.005+0000 7f0005013800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.006+0000 7f0005013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:40.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.006+0000 7f0005013800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.007+0000 7f0005013800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:03:40.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.007+0000 7f0005013800 20 searching for the correct realm 2024-09-12T17:03:40.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.010+0000 7efffff21640 0 -- 172.21.15.67:0/1004319705 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x558da02cfdc0 msgr2=0x558da02d21b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:40.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.014+0000 7f0000f23640 0 -- 172.21.15.67:0/1004319705 >> [v2:172.21.15.118:6824/1070975205,v1:172.21.15.118:6825/1070975205] conn(0x7efff4018020 msgr2=0x7efff404c1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:40.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.017+0000 7f0005013800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:03:40.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.017+0000 7f0005013800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:03:40.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.017+0000 7f0005013800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:03:40.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.017+0000 7f0005013800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:03:40.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.017+0000 7f0005013800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:03:40.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.017+0000 7f0005013800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:03:40.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.017+0000 7f0005013800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.018+0000 7f0005013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:40.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.018+0000 7f0005013800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.018+0000 7f0005013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:40.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.018+0000 7f0005013800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.018+0000 7f0005013800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:03:40.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.018+0000 7f0005013800 20 zone default found 2024-09-12T17:03:40.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.018+0000 7f0005013800 4 Realm: () 2024-09-12T17:03:40.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.018+0000 7f0005013800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:03:40.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.018+0000 7f0005013800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:03:40.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.018+0000 7f0005013800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:03:40.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.018+0000 7f0005013800 20 zonegroup default 2024-09-12T17:03:40.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.018+0000 7f0005013800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.019+0000 7f0005013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:40.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.019+0000 7f0005013800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.019+0000 7f0005013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:40.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.019+0000 7f0005013800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.019+0000 7f0005013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:40.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.019+0000 7f0005013800 20 started sync module instance, tier type = 2024-09-12T17:03:40.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.019+0000 7f0005013800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:03:40.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.029+0000 7f0005013800 20 add_watcher() i=0 2024-09-12T17:03:40.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.029+0000 7f0005013800 20 add_watcher() i=1 2024-09-12T17:03:40.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.029+0000 7f0005013800 20 add_watcher() i=2 2024-09-12T17:03:40.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.029+0000 7f0005013800 20 add_watcher() i=3 2024-09-12T17:03:40.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.029+0000 7f0005013800 20 add_watcher() i=4 2024-09-12T17:03:40.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.029+0000 7f0005013800 20 add_watcher() i=5 2024-09-12T17:03:40.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.029+0000 7f0005013800 20 add_watcher() i=6 2024-09-12T17:03:40.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.030+0000 7f0005013800 20 add_watcher() i=7 2024-09-12T17:03:40.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.030+0000 7f0005013800 2 all 8 watchers are set, enabling cache 2024-09-12T17:03:40.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.032+0000 7efeb6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:40.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.032+0000 7f0005013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:03:40.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.032+0000 7f0005013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:03:40.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.032+0000 7f0005013800 5 note: GC not initialized 2024-09-12T17:03:40.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.032+0000 7efeb5fdb640 20 reqs_thread_entry: start 2024-09-12T17:03:40.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.032+0000 7f0005013800 20 init_complete bucket index max shards: 1 2024-09-12T17:03:40.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.032+0000 7f0005013800 20 Filter name: none 2024-09-12T17:03:40.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.033+0000 7efe277fe640 20 reqs_thread_entry: start 2024-09-12T17:03:40.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.033+0000 7f0005013800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.033+0000 7f0005013800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:03:40.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.033+0000 7f0005013800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.033+0000 7f0005013800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:03:40.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.033+0000 7f0005013800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:03:40.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.033+0000 7f0005013800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:03:40.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.033+0000 7f0005013800 20 INFO: main: starting shard=0 2024-09-12T17:03:40.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.033+0000 7f0005013800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:40.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.034+0000 7f0005013800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:03:40.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.034+0000 7f0005013800 20 INFO: main: done 2024-09-12T17:03:40.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.035+0000 7efeb6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:40.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.037+0000 7f0005013800 20 remove_watcher() i=0 2024-09-12T17:03:40.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.037+0000 7f0005013800 2 removed watcher, disabling cache 2024-09-12T17:03:40.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.039+0000 7f0005013800 20 remove_watcher() i=1 2024-09-12T17:03:40.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.040+0000 7f0005013800 20 remove_watcher() i=2 2024-09-12T17:03:40.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.041+0000 7f0005013800 20 remove_watcher() i=3 2024-09-12T17:03:40.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.042+0000 7f0005013800 20 remove_watcher() i=4 2024-09-12T17:03:40.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.043+0000 7f0005013800 20 remove_watcher() i=5 2024-09-12T17:03:40.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.044+0000 7f0005013800 20 remove_watcher() i=6 2024-09-12T17:03:40.046 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.045+0000 7f0005013800 20 remove_watcher() i=7 2024-09-12T17:03:40.060 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:40.060 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:40.084 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:40.084 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:40.108 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:40.108 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:40.194 INFO:tasks.workunit.client.0.smithi067.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:03:40.195 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T17:03:40.228 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:03:40.228 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:03:40.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.266+0000 7f836b2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.268+0000 7f836b2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:40.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.268+0000 7f836b2bb800 20 realm 2024-09-12T17:03:40.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.268+0000 7f836b2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.268+0000 7f836b2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:40.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.268+0000 7f836b2bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:03:40.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.268+0000 7f836b2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.268+0000 7f836b2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:40.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.268+0000 7f836b2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.269+0000 7f836b2bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:40.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.269+0000 7f836b2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.270+0000 7f836b2bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:03:40.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.270+0000 7f836b2bb800 20 searching for the correct realm 2024-09-12T17:03:40.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.273+0000 7f83685a4640 0 -- 172.21.15.67:0/3916220317 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55c45440cd50 msgr2=0x55c45440f140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:40.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.277+0000 7f8368da5640 0 -- 172.21.15.67:0/3916220317 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f835c07c410 msgr2=0x7f835c07c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:40.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.484+0000 7f836b2bb800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:03:40.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.484+0000 7f836b2bb800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:03:40.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.484+0000 7f836b2bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:03:40.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.484+0000 7f836b2bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:03:40.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.484+0000 7f836b2bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:03:40.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.484+0000 7f836b2bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:03:40.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.484+0000 7f836b2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.484+0000 7f836b2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:40.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.484+0000 7f836b2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.485+0000 7f836b2bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:40.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.485+0000 7f836b2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.485+0000 7f836b2bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:03:40.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.485+0000 7f836b2bb800 20 zone default found 2024-09-12T17:03:40.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.485+0000 7f836b2bb800 4 Realm: () 2024-09-12T17:03:40.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.485+0000 7f836b2bb800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:03:40.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.485+0000 7f836b2bb800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:03:40.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.485+0000 7f836b2bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:03:40.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.485+0000 7f836b2bb800 20 zonegroup default 2024-09-12T17:03:40.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.485+0000 7f836b2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.485+0000 7f836b2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:40.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.485+0000 7f836b2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.486+0000 7f836b2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:40.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.486+0000 7f836b2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.486+0000 7f836b2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:40.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.486+0000 7f836b2bb800 20 started sync module instance, tier type = 2024-09-12T17:03:40.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.486+0000 7f836b2bb800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:03:40.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.496+0000 7f836b2bb800 20 add_watcher() i=0 2024-09-12T17:03:40.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.496+0000 7f836b2bb800 20 add_watcher() i=1 2024-09-12T17:03:40.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.496+0000 7f836b2bb800 20 add_watcher() i=2 2024-09-12T17:03:40.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.496+0000 7f836b2bb800 20 add_watcher() i=3 2024-09-12T17:03:40.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.496+0000 7f836b2bb800 20 add_watcher() i=4 2024-09-12T17:03:40.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.496+0000 7f836b2bb800 20 add_watcher() i=5 2024-09-12T17:03:40.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.497+0000 7f836b2bb800 20 add_watcher() i=6 2024-09-12T17:03:40.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.497+0000 7f836b2bb800 20 add_watcher() i=7 2024-09-12T17:03:40.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.497+0000 7f836b2bb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:03:40.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.499+0000 7f821efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:40.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.499+0000 7f836b2bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:03:40.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.499+0000 7f836b2bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:03:40.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.500+0000 7f836b2bb800 5 note: GC not initialized 2024-09-12T17:03:40.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.500+0000 7f821dfe3640 20 reqs_thread_entry: start 2024-09-12T17:03:40.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.500+0000 7f836b2bb800 20 init_complete bucket index max shards: 1 2024-09-12T17:03:40.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.500+0000 7f836b2bb800 20 Filter name: none 2024-09-12T17:03:40.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.500+0000 7f818f7fe640 20 reqs_thread_entry: start 2024-09-12T17:03:40.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.500+0000 7f836b2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.500+0000 7f836b2bb800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:03:40.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.500+0000 7f836b2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.501+0000 7f836b2bb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:03:40.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.501+0000 7f836b2bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:03:40.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.501+0000 7f836b2bb800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:03:40.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.501+0000 7f836b2bb800 20 INFO: main: starting shard=0 2024-09-12T17:03:40.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.501+0000 7f836b2bb800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:40.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.502+0000 7f836b2bb800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:03:40.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.502+0000 7f836b2bb800 20 INFO: main: done 2024-09-12T17:03:40.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.503+0000 7f821efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:40.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.505+0000 7f836b2bb800 20 remove_watcher() i=0 2024-09-12T17:03:40.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.505+0000 7f836b2bb800 2 removed watcher, disabling cache 2024-09-12T17:03:40.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.506+0000 7f836b2bb800 20 remove_watcher() i=1 2024-09-12T17:03:40.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.508+0000 7f836b2bb800 20 remove_watcher() i=2 2024-09-12T17:03:40.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.509+0000 7f836b2bb800 20 remove_watcher() i=3 2024-09-12T17:03:40.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.510+0000 7f836b2bb800 20 remove_watcher() i=4 2024-09-12T17:03:40.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.511+0000 7f836b2bb800 20 remove_watcher() i=5 2024-09-12T17:03:40.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.512+0000 7f836b2bb800 20 remove_watcher() i=6 2024-09-12T17:03:40.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.513+0000 7f836b2bb800 20 remove_watcher() i=7 2024-09-12T17:03:40.528 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:40.528 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:40.551 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:40.552 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:40.638 INFO:tasks.workunit.client.0.smithi067.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:03:40.639 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T17:03:40.671 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:03:40.671 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:03:40.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.708+0000 7fc628728800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.710+0000 7fc628728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:40.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.710+0000 7fc628728800 20 realm 2024-09-12T17:03:40.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.710+0000 7fc628728800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.711+0000 7fc628728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:40.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.711+0000 7fc628728800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:03:40.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.711+0000 7fc628728800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.711+0000 7fc628728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:40.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.711+0000 7fc628728800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.712+0000 7fc628728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:40.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.712+0000 7fc628728800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.713+0000 7fc628728800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:03:40.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.713+0000 7fc628728800 20 searching for the correct realm 2024-09-12T17:03:40.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.716+0000 7fc62446f640 0 -- 172.21.15.67:0/715337944 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7fc61c024040 msgr2=0x7fc61c066040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:03:40.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.720+0000 7fc62446f640 0 -- 172.21.15.67:0/715337944 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fc6180a2920 msgr2=0x7fc61808f450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:40.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.927+0000 7fc628728800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:03:40.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.927+0000 7fc628728800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:03:40.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.927+0000 7fc628728800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:03:40.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.927+0000 7fc628728800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:03:40.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.927+0000 7fc628728800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:03:40.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.927+0000 7fc628728800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:03:40.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.927+0000 7fc628728800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.927+0000 7fc628728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:40.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.927+0000 7fc628728800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.927+0000 7fc628728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:40.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.927+0000 7fc628728800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.928+0000 7fc628728800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:03:40.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.928+0000 7fc628728800 20 zone default found 2024-09-12T17:03:40.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.928+0000 7fc628728800 4 Realm: () 2024-09-12T17:03:40.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.928+0000 7fc628728800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:03:40.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.928+0000 7fc628728800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:03:40.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.928+0000 7fc628728800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:03:40.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.928+0000 7fc628728800 20 zonegroup default 2024-09-12T17:03:40.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.928+0000 7fc628728800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.928+0000 7fc628728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:40.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.928+0000 7fc628728800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.928+0000 7fc628728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:40.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.928+0000 7fc628728800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.928+0000 7fc628728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:40.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.929+0000 7fc628728800 20 started sync module instance, tier type = 2024-09-12T17:03:40.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.929+0000 7fc628728800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:03:40.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.943+0000 7fc628728800 20 add_watcher() i=0 2024-09-12T17:03:40.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.943+0000 7fc628728800 20 add_watcher() i=1 2024-09-12T17:03:40.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.943+0000 7fc628728800 20 add_watcher() i=2 2024-09-12T17:03:40.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.943+0000 7fc628728800 20 add_watcher() i=3 2024-09-12T17:03:40.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.943+0000 7fc628728800 20 add_watcher() i=4 2024-09-12T17:03:40.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.943+0000 7fc628728800 20 add_watcher() i=5 2024-09-12T17:03:40.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.943+0000 7fc628728800 20 add_watcher() i=6 2024-09-12T17:03:40.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.945+0000 7fc628728800 20 add_watcher() i=7 2024-09-12T17:03:40.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.945+0000 7fc628728800 2 all 8 watchers are set, enabling cache 2024-09-12T17:03:40.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.947+0000 7fc4dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:40.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.948+0000 7fc628728800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:03:40.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.948+0000 7fc628728800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:03:40.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.948+0000 7fc628728800 5 note: GC not initialized 2024-09-12T17:03:40.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.948+0000 7fc4d9fdb640 20 reqs_thread_entry: start 2024-09-12T17:03:40.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.948+0000 7fc628728800 20 init_complete bucket index max shards: 1 2024-09-12T17:03:40.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.948+0000 7fc628728800 20 Filter name: none 2024-09-12T17:03:40.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.948+0000 7fc44b7fe640 20 reqs_thread_entry: start 2024-09-12T17:03:40.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.948+0000 7fc628728800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.949+0000 7fc628728800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:03:40.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.949+0000 7fc628728800 20 rados->read ofs=0 len=0 2024-09-12T17:03:40.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.949+0000 7fc628728800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:03:40.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.949+0000 7fc628728800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:03:40.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.949+0000 7fc628728800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:03:40.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.949+0000 7fc628728800 20 INFO: main: starting shard=0 2024-09-12T17:03:40.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.949+0000 7fc628728800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:40.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.950+0000 7fc628728800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:03:40.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.950+0000 7fc628728800 20 INFO: main: done 2024-09-12T17:03:40.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.951+0000 7fc4dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:40.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.954+0000 7fc628728800 20 remove_watcher() i=0 2024-09-12T17:03:40.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.954+0000 7fc628728800 2 removed watcher, disabling cache 2024-09-12T17:03:40.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.955+0000 7fc628728800 20 remove_watcher() i=1 2024-09-12T17:03:40.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.956+0000 7fc628728800 20 remove_watcher() i=2 2024-09-12T17:03:40.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.957+0000 7fc628728800 20 remove_watcher() i=3 2024-09-12T17:03:40.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.958+0000 7fc628728800 20 remove_watcher() i=4 2024-09-12T17:03:40.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.959+0000 7fc628728800 20 remove_watcher() i=5 2024-09-12T17:03:40.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.960+0000 7fc628728800 20 remove_watcher() i=6 2024-09-12T17:03:40.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:40.962+0000 7fc628728800 20 remove_watcher() i=7 2024-09-12T17:03:40.978 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:40.978 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:41.002 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:03:41.414 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:03:41.834 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T17:03:41.864 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:03:41.864 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:03:41.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:41.902+0000 7f0df172c800 20 rados->read ofs=0 len=0 2024-09-12T17:03:41.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:41.904+0000 7f0df172c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:41.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:41.904+0000 7f0df172c800 20 realm 2024-09-12T17:03:41.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:41.904+0000 7f0df172c800 20 rados->read ofs=0 len=0 2024-09-12T17:03:41.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:41.904+0000 7f0df172c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:41.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:41.904+0000 7f0df172c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:03:41.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:41.904+0000 7f0df172c800 20 rados->read ofs=0 len=0 2024-09-12T17:03:41.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:41.904+0000 7f0df172c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:41.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:41.904+0000 7f0df172c800 20 rados->read ofs=0 len=0 2024-09-12T17:03:41.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:41.905+0000 7f0df172c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:41.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:41.905+0000 7f0df172c800 20 rados->read ofs=0 len=0 2024-09-12T17:03:41.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:41.906+0000 7f0df172c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:03:41.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:41.906+0000 7f0df172c800 20 searching for the correct realm 2024-09-12T17:03:41.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:41.908+0000 7f0decb3d640 0 -- 172.21.15.67:0/912079026 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f0de0050040 msgr2=0x7f0de0042410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:41.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:41.912+0000 7f0ded33e640 0 -- 172.21.15.67:0/912079026 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f0de4078b60 msgr2=0x7f0de40a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:42.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.120+0000 7f0df172c800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:03:42.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.120+0000 7f0df172c800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:03:42.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.120+0000 7f0df172c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:03:42.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.120+0000 7f0df172c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:03:42.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.120+0000 7f0df172c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:03:42.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.120+0000 7f0df172c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:03:42.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.120+0000 7f0df172c800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.120+0000 7f0df172c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:42.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.120+0000 7f0df172c800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.120+0000 7f0df172c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:42.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.120+0000 7f0df172c800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.121+0000 7f0df172c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:03:42.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.121+0000 7f0df172c800 20 zone default found 2024-09-12T17:03:42.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.121+0000 7f0df172c800 4 Realm: () 2024-09-12T17:03:42.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.121+0000 7f0df172c800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:03:42.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.121+0000 7f0df172c800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:03:42.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.121+0000 7f0df172c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:03:42.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.121+0000 7f0df172c800 20 zonegroup default 2024-09-12T17:03:42.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.121+0000 7f0df172c800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.121+0000 7f0df172c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:42.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.121+0000 7f0df172c800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.122+0000 7f0df172c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:42.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.122+0000 7f0df172c800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.122+0000 7f0df172c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:42.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.122+0000 7f0df172c800 20 started sync module instance, tier type = 2024-09-12T17:03:42.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.122+0000 7f0df172c800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:03:42.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.132+0000 7f0df172c800 20 add_watcher() i=0 2024-09-12T17:03:42.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.132+0000 7f0df172c800 20 add_watcher() i=1 2024-09-12T17:03:42.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.132+0000 7f0df172c800 20 add_watcher() i=2 2024-09-12T17:03:42.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.132+0000 7f0df172c800 20 add_watcher() i=3 2024-09-12T17:03:42.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.132+0000 7f0df172c800 20 add_watcher() i=4 2024-09-12T17:03:42.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.132+0000 7f0df172c800 20 add_watcher() i=5 2024-09-12T17:03:42.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.132+0000 7f0df172c800 20 add_watcher() i=6 2024-09-12T17:03:42.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.135+0000 7f0df172c800 20 add_watcher() i=7 2024-09-12T17:03:42.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.135+0000 7f0df172c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:03:42.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.138+0000 7f0ca37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:42.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.138+0000 7f0df172c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:03:42.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.138+0000 7f0df172c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:03:42.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.138+0000 7f0df172c800 5 note: GC not initialized 2024-09-12T17:03:42.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.138+0000 7f0ca27e4640 20 reqs_thread_entry: start 2024-09-12T17:03:42.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.138+0000 7f0df172c800 20 init_complete bucket index max shards: 1 2024-09-12T17:03:42.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.139+0000 7f0df172c800 20 Filter name: none 2024-09-12T17:03:42.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.139+0000 7f0c13fff640 20 reqs_thread_entry: start 2024-09-12T17:03:42.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.139+0000 7f0df172c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:03:42.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.139+0000 7f0df172c800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.139+0000 7f0df172c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:03:42.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.139+0000 7f0df172c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:03:42.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.139+0000 7f0df172c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:03:42.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.139+0000 7f0df172c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 : miss 2024-09-12T17:03:42.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.139+0000 7f0df172c800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.139+0000 7f0df172c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:03:42.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.139+0000 7f0df172c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 info.flags=0x17 2024-09-12T17:03:42.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.139+0000 7f0df172c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 to cache LRU end 2024-09-12T17:03:42.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.139+0000 7f0df172c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:03:42.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.139+0000 7f0df172c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:03:42.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.140+0000 7f0df172c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 2024-09-12T17:03:42.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.140+0000 7f0df172c800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.145+0000 7f0ca37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:42.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.147+0000 7f0df172c800 20 remove_watcher() i=0 2024-09-12T17:03:42.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.147+0000 7f0df172c800 2 removed watcher, disabling cache 2024-09-12T17:03:42.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.148+0000 7f0df172c800 20 remove_watcher() i=1 2024-09-12T17:03:42.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.150+0000 7f0df172c800 20 remove_watcher() i=2 2024-09-12T17:03:42.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.151+0000 7f0df172c800 20 remove_watcher() i=3 2024-09-12T17:03:42.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.152+0000 7f0df172c800 20 remove_watcher() i=4 2024-09-12T17:03:42.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.153+0000 7f0df172c800 20 remove_watcher() i=5 2024-09-12T17:03:42.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.154+0000 7f0df172c800 20 remove_watcher() i=6 2024-09-12T17:03:42.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.155+0000 7f0df172c800 20 remove_watcher() i=7 2024-09-12T17:03:42.169 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:03:42.204 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:03:42.204 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:03:42.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.242+0000 7f644fa20800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.243+0000 7f644fa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:42.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.243+0000 7f644fa20800 20 realm 2024-09-12T17:03:42.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.243+0000 7f644fa20800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.244+0000 7f644fa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:42.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.244+0000 7f644fa20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:03:42.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.244+0000 7f644fa20800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.244+0000 7f644fa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:42.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.244+0000 7f644fa20800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.245+0000 7f644fa20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:42.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.245+0000 7f644fa20800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.245+0000 7f644fa20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:03:42.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.245+0000 7f644fa20800 20 searching for the correct realm 2024-09-12T17:03:42.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.249+0000 7f644dd0b640 0 -- 172.21.15.67:0/897646260 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x55ca26eca790 msgr2=0x55ca26eccb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:42.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.253+0000 7f644d50a640 0 -- 172.21.15.67:0/897646260 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f644408e030 msgr2=0x7f6444067c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:42.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.258+0000 7f644fa20800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:03:42.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.258+0000 7f644fa20800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:03:42.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.258+0000 7f644fa20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:03:42.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.258+0000 7f644fa20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:03:42.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.258+0000 7f644fa20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:03:42.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.258+0000 7f644fa20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:03:42.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.258+0000 7f644fa20800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.258+0000 7f644fa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:42.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.258+0000 7f644fa20800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.258+0000 7f644fa20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:42.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.258+0000 7f644fa20800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.258+0000 7f644fa20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:03:42.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.259+0000 7f644fa20800 20 zone default found 2024-09-12T17:03:42.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.259+0000 7f644fa20800 4 Realm: () 2024-09-12T17:03:42.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.259+0000 7f644fa20800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:03:42.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.259+0000 7f644fa20800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:03:42.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.259+0000 7f644fa20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:03:42.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.259+0000 7f644fa20800 20 zonegroup default 2024-09-12T17:03:42.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.259+0000 7f644fa20800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.259+0000 7f644fa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:42.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.259+0000 7f644fa20800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.259+0000 7f644fa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:42.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.259+0000 7f644fa20800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.259+0000 7f644fa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:42.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.259+0000 7f644fa20800 20 started sync module instance, tier type = 2024-09-12T17:03:42.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.259+0000 7f644fa20800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:03:42.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.269+0000 7f644fa20800 20 add_watcher() i=0 2024-09-12T17:03:42.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.269+0000 7f644fa20800 20 add_watcher() i=1 2024-09-12T17:03:42.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.269+0000 7f644fa20800 20 add_watcher() i=2 2024-09-12T17:03:42.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.269+0000 7f644fa20800 20 add_watcher() i=3 2024-09-12T17:03:42.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.269+0000 7f644fa20800 20 add_watcher() i=4 2024-09-12T17:03:42.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.269+0000 7f644fa20800 20 add_watcher() i=5 2024-09-12T17:03:42.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.269+0000 7f644fa20800 20 add_watcher() i=6 2024-09-12T17:03:42.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.270+0000 7f644fa20800 20 add_watcher() i=7 2024-09-12T17:03:42.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.270+0000 7f644fa20800 2 all 8 watchers are set, enabling cache 2024-09-12T17:03:42.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.272+0000 7f6303fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:42.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.273+0000 7f644fa20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:03:42.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.273+0000 7f644fa20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:03:42.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.273+0000 7f644fa20800 5 note: GC not initialized 2024-09-12T17:03:42.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.273+0000 7f6302fe5640 20 reqs_thread_entry: start 2024-09-12T17:03:42.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.273+0000 7f644fa20800 20 init_complete bucket index max shards: 1 2024-09-12T17:03:42.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.273+0000 7f644fa20800 20 Filter name: none 2024-09-12T17:03:42.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.273+0000 7f6300fe1640 20 reqs_thread_entry: start 2024-09-12T17:03:42.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.273+0000 7f644fa20800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:03:42.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.273+0000 7f644fa20800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.274+0000 7f644fa20800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:03:42.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.274+0000 7f644fa20800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:03:42.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.274+0000 7f644fa20800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:03:42.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.274+0000 7f644fa20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 : miss 2024-09-12T17:03:42.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.274+0000 7f644fa20800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.274+0000 7f644fa20800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:03:42.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.274+0000 7f644fa20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 info.flags=0x17 2024-09-12T17:03:42.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.274+0000 7f644fa20800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 to cache LRU end 2024-09-12T17:03:42.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.274+0000 7f644fa20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:03:42.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.274+0000 7f644fa20800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:03:42.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.274+0000 7f644fa20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2 2024-09-12T17:03:42.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.274+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.276+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.276+0000 7f644fa20800 20 get_obj_state: octx=0x55ca26c3f190 obj=check-bucket:c state=0x55ca26f0e198 s->prefetch_data=0 2024-09-12T17:03:42.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.276+0000 7f644fa20800 20 get_obj_state: setting s->obj_tag to uet0msgp9hppb3jiq5a85ztsthgill2k 2024-09-12T17:03:42.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.276+0000 7f644fa20800 20 get_obj_state_impl: setting s->olh_tag to sy42awlvvp79ytdbeyhclmedhyvrh7c0 2024-09-12T17:03:42.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.276+0000 7f644fa20800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=sy42awlvvp79ytdbeyhclmedhyvrh7c0 2024-09-12T17:03:42.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.278+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.279+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.279+0000 7f644fa20800 20 olh_log_entry: epoch=3 op=3 key=c[m7k.AY1egmm6zKk7lAOc7p17x0tWh6U] 2024-09-12T17:03:42.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.279+0000 7f644fa20800 20 get_obj_state: octx=0x55ca26c3f190 obj=check-bucket:_:m7k.AY1egmm6zKk7lAOc7p17x0tWh6U_c state=0x55ca26f44ad8 s->prefetch_data=0 2024-09-12T17:03:42.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.280+0000 7f644fa20800 10 manifest: total_size = 22 2024-09-12T17:03:42.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.280+0000 7f644fa20800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.269410479574234689 2024-09-12T17:03:42.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.280+0000 7f644fa20800 20 get_obj_state: octx=0x55ca26c3f190 obj=check-bucket:_:m7k.AY1egmm6zKk7lAOc7p17x0tWh6U_c state=0x55ca26f44ad8 s->prefetch_data=0 2024-09-12T17:03:42.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.280+0000 7f644fa20800 20 prepare_atomic_modification: state is not atomic. state=0x55ca26f44ad8 2024-09-12T17:03:42.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.280+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.282+0000 7f644fa20800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:03:42.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.282+0000 7f644fa20800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:03:42.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.282+0000 7f644fa20800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:03:42.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.282+0000 7f644fa20800 5 delete_objs_inline: removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2__shadow:m7k.AY1egmm6zKk7lAOc7p17x0tWh6U_.bmgdF_oo4iOGQyt3QY9lz7ndrXBtCkx_0 2024-09-12T17:03:42.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.284+0000 7f644fa20800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:03:42.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.284+0000 7f6323fff640 20 handle_completion(): completion ok for obj=c[m7k.AY1egmm6zKk7lAOc7p17x0tWh6U] 2024-09-12T17:03:42.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.285+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.285+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.287+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.287+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.287+0000 7f644fa20800 20 get_obj_state: octx=0x55ca26c3f190 obj=check-bucket:d state=0x55ca26f0e198 s->prefetch_data=0 2024-09-12T17:03:42.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.288+0000 7f644fa20800 20 get_obj_state: setting s->obj_tag to 7ij1joisqn1d1uyfv2s9fqjpugeoj2al 2024-09-12T17:03:42.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.288+0000 7f644fa20800 20 get_obj_state_impl: setting s->olh_tag to mj4mk1d8cv813tzukz0ri6p5vofdqdck 2024-09-12T17:03:42.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.288+0000 7f644fa20800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mj4mk1d8cv813tzukz0ri6p5vofdqdck 2024-09-12T17:03:42.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.289+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.291+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.291+0000 7f644fa20800 20 olh_log_entry: epoch=3 op=3 key=d[vimqpsWDCNhWig9OfchrqzDtM0A76n3] 2024-09-12T17:03:42.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.291+0000 7f644fa20800 20 get_obj_state: octx=0x55ca26c3f190 obj=check-bucket:_:vimqpsWDCNhWig9OfchrqzDtM0A76n3_d state=0x55ca26f44ad8 s->prefetch_data=0 2024-09-12T17:03:42.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.291+0000 7f644fa20800 10 manifest: total_size = 22 2024-09-12T17:03:42.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.291+0000 7f644fa20800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.14099861852177084116 2024-09-12T17:03:42.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.291+0000 7f644fa20800 20 get_obj_state: octx=0x55ca26c3f190 obj=check-bucket:_:vimqpsWDCNhWig9OfchrqzDtM0A76n3_d state=0x55ca26f44ad8 s->prefetch_data=0 2024-09-12T17:03:42.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.291+0000 7f644fa20800 20 prepare_atomic_modification: state is not atomic. state=0x55ca26f44ad8 2024-09-12T17:03:42.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.291+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.294+0000 7f644fa20800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:03:42.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.294+0000 7f644fa20800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:03:42.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.294+0000 7f644fa20800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:03:42.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.294+0000 7f644fa20800 5 delete_objs_inline: removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2__shadow:vimqpsWDCNhWig9OfchrqzDtM0A76n3_.B9HDbm9JmO6EFHBPb2IqmZAl-SFESuL_0 2024-09-12T17:03:42.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.295+0000 7f644fa20800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:03:42.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.296+0000 7f6323fff640 20 handle_completion(): completion ok for obj=d[vimqpsWDCNhWig9OfchrqzDtM0A76n3] 2024-09-12T17:03:42.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.296+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.296+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.298+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.298+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.298+0000 7f644fa20800 20 get_obj_state: octx=0x55ca26c3f190 obj=check-bucket:e state=0x55ca26f0e198 s->prefetch_data=0 2024-09-12T17:03:42.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.299+0000 7f644fa20800 20 get_obj_state: setting s->obj_tag to xz6vuy0ex5ij2u89vefbsexweyjq01o2 2024-09-12T17:03:42.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.299+0000 7f644fa20800 20 get_obj_state_impl: setting s->olh_tag to eiyu3fiwbocw294iun17cocx8jh6ld75 2024-09-12T17:03:42.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.299+0000 7f644fa20800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=eiyu3fiwbocw294iun17cocx8jh6ld75 2024-09-12T17:03:42.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.300+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.302+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.302+0000 7f644fa20800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T17:03:42.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.302+0000 7f644fa20800 20 olh_log_entry: epoch=2 op=3 key=e[b2bPXk6c7FgwmuxTA-WTsAAuU0qvB83] 2024-09-12T17:03:42.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.302+0000 7f644fa20800 20 get_obj_state: octx=0x55ca26c3f190 obj=check-bucket:_:b2bPXk6c7FgwmuxTA-WTsAAuU0qvB83_e state=0x55ca26f44ad8 s->prefetch_data=0 2024-09-12T17:03:42.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.303+0000 7f644fa20800 10 manifest: total_size = 11 2024-09-12T17:03:42.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.303+0000 7f644fa20800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.4006805877297719264 2024-09-12T17:03:42.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.303+0000 7f644fa20800 20 get_obj_state: octx=0x55ca26c3f190 obj=check-bucket:_:b2bPXk6c7FgwmuxTA-WTsAAuU0qvB83_e state=0x55ca26f44ad8 s->prefetch_data=0 2024-09-12T17:03:42.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.303+0000 7f644fa20800 20 prepare_atomic_modification: state is not atomic. state=0x55ca26f44ad8 2024-09-12T17:03:42.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.303+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.305+0000 7f644fa20800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:03:42.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.305+0000 7f644fa20800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T17:03:42.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.305+0000 7f644fa20800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:03:42.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.305+0000 7f644fa20800 5 delete_objs_inline: removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2__shadow:b2bPXk6c7FgwmuxTA-WTsAAuU0qvB83_.XXvDqgq5zplmx2PyzCUxlKQBbgbxknr_0 2024-09-12T17:03:42.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.307+0000 7f644fa20800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:03:42.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.307+0000 7f6323fff640 20 handle_completion(): completion ok for obj=e[b2bPXk6c7FgwmuxTA-WTsAAuU0qvB83] 2024-09-12T17:03:42.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.308+0000 7f644fa20800 20 get_obj_state: octx=0x55ca26c3f190 obj=check-bucket:e state=0x55ca26f0e198 s->prefetch_data=0 2024-09-12T17:03:42.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.308+0000 7f644fa20800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=eiyu3fiwbocw294iun17cocx8jh6ld75 2024-09-12T17:03:42.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.310+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.311+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.311+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.311+0000 7f644fa20800 20 get_obj_state: octx=0x55ca26c3f190 obj=check-bucket:f state=0x55ca26f0e198 s->prefetch_data=0 2024-09-12T17:03:42.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.312+0000 7f644fa20800 20 get_obj_state: setting s->obj_tag to equg3s2bj456c9bivgeo7dc3q6qc264l 2024-09-12T17:03:42.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.312+0000 7f644fa20800 20 get_obj_state_impl: setting s->olh_tag to 8co4noxauea5jgizmdsjw8jxcv3r24oj 2024-09-12T17:03:42.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.312+0000 7f644fa20800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8co4noxauea5jgizmdsjw8jxcv3r24oj 2024-09-12T17:03:42.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.313+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.314+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.315+0000 7f644fa20800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T17:03:42.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.315+0000 7f644fa20800 20 olh_log_entry: epoch=2 op=3 key=f[2VP6YfratijZIWKp8iL5rTrEkhSJtem] 2024-09-12T17:03:42.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.315+0000 7f644fa20800 20 get_obj_state: octx=0x55ca26c3f190 obj=check-bucket:_:2VP6YfratijZIWKp8iL5rTrEkhSJtem_f state=0x55ca26f44ad8 s->prefetch_data=0 2024-09-12T17:03:42.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.315+0000 7f644fa20800 10 manifest: total_size = 11 2024-09-12T17:03:42.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.315+0000 7f644fa20800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.4675863992159276424 2024-09-12T17:03:42.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.315+0000 7f644fa20800 20 get_obj_state: octx=0x55ca26c3f190 obj=check-bucket:_:2VP6YfratijZIWKp8iL5rTrEkhSJtem_f state=0x55ca26f44ad8 s->prefetch_data=0 2024-09-12T17:03:42.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.315+0000 7f644fa20800 20 prepare_atomic_modification: state is not atomic. state=0x55ca26f44ad8 2024-09-12T17:03:42.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.315+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.317+0000 7f644fa20800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:03:42.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.317+0000 7f644fa20800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T17:03:42.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.317+0000 7f644fa20800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:03:42.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.317+0000 7f644fa20800 5 delete_objs_inline: removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.2__shadow:2VP6YfratijZIWKp8iL5rTrEkhSJtem_.SI8Gp0qD8ej9smCnFL4O7rwuQnFHrLX_0 2024-09-12T17:03:42.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.318+0000 7f644fa20800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:03:42.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.318+0000 7f6323fff640 20 handle_completion(): completion ok for obj=f[2VP6YfratijZIWKp8iL5rTrEkhSJtem] 2024-09-12T17:03:42.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.319+0000 7f644fa20800 20 get_obj_state: octx=0x55ca26c3f190 obj=check-bucket:f state=0x55ca26f0e198 s->prefetch_data=0 2024-09-12T17:03:42.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.319+0000 7f644fa20800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8co4noxauea5jgizmdsjw8jxcv3r24oj 2024-09-12T17:03:42.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.321+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.322+0000 7f644fa20800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.2.0 2024-09-12T17:03:42.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.322+0000 7f644fa20800 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-12T17:03:42.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.322+0000 7f644fa20800 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T17:03:42.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.323+0000 7f6303fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:42.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.326+0000 7f644fa20800 20 remove_watcher() i=0 2024-09-12T17:03:42.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.326+0000 7f644fa20800 2 removed watcher, disabling cache 2024-09-12T17:03:42.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.327+0000 7f644fa20800 20 remove_watcher() i=1 2024-09-12T17:03:42.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.328+0000 7f644fa20800 20 remove_watcher() i=2 2024-09-12T17:03:42.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.329+0000 7f644fa20800 20 remove_watcher() i=3 2024-09-12T17:03:42.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.330+0000 7f644fa20800 20 remove_watcher() i=4 2024-09-12T17:03:42.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.331+0000 7f644fa20800 20 remove_watcher() i=5 2024-09-12T17:03:42.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.332+0000 7f644fa20800 20 remove_watcher() i=6 2024-09-12T17:03:42.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.333+0000 7f644fa20800 20 remove_watcher() i=7 2024-09-12T17:03:42.349 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:42.349 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:42.381 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:42.381 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:42.561 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T17:03:42.590 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:03:42.591 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:03:42.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.628+0000 7f14fcf37800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.629+0000 7f14fcf37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:42.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.629+0000 7f14fcf37800 20 realm 2024-09-12T17:03:42.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.629+0000 7f14fcf37800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.629+0000 7f14fcf37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:42.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.629+0000 7f14fcf37800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:03:42.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.629+0000 7f14fcf37800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.630+0000 7f14fcf37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:42.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.630+0000 7f14fcf37800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.630+0000 7f14fcf37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:42.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.630+0000 7f14fcf37800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.631+0000 7f14fcf37800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:03:42.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.631+0000 7f14fcf37800 20 searching for the correct realm 2024-09-12T17:03:42.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.635+0000 7f14f9422640 0 -- 172.21.15.67:0/4229704167 >> [v2:172.21.15.118:6824/1070975205,v1:172.21.15.118:6825/1070975205] conn(0x7f14e006e990 msgr2=0x7f14e008c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:03:42.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.840+0000 7f14f8c21640 0 -- 172.21.15.67:0/4229704167 >> [v2:172.21.15.118:6808/1825660705,v1:172.21.15.118:6809/1825660705] conn(0x56085b0d4ef0 msgr2=0x56085b0d72e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:03:42.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.842+0000 7f14fcf37800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:03:42.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.842+0000 7f14fcf37800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:03:42.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.842+0000 7f14fcf37800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:03:42.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.842+0000 7f14fcf37800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:03:42.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.842+0000 7f14fcf37800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:03:42.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.842+0000 7f14fcf37800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:03:42.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.842+0000 7f14fcf37800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.842+0000 7f14fcf37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:42.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.842+0000 7f14fcf37800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.843+0000 7f14fcf37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:03:42.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.843+0000 7f14fcf37800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.843+0000 7f14fcf37800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:03:42.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.843+0000 7f14fcf37800 20 zone default found 2024-09-12T17:03:42.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.843+0000 7f14fcf37800 4 Realm: () 2024-09-12T17:03:42.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.843+0000 7f14fcf37800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:03:42.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.843+0000 7f14fcf37800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:03:42.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.843+0000 7f14fcf37800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:03:42.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.843+0000 7f14fcf37800 20 zonegroup default 2024-09-12T17:03:42.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.843+0000 7f14fcf37800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.843+0000 7f14fcf37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:42.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.843+0000 7f14fcf37800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.844+0000 7f14fcf37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:42.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.844+0000 7f14fcf37800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.844+0000 7f14fcf37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:03:42.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.844+0000 7f14fcf37800 20 started sync module instance, tier type = 2024-09-12T17:03:42.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.844+0000 7f14fcf37800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:03:42.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.853+0000 7f14fcf37800 20 add_watcher() i=0 2024-09-12T17:03:42.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.853+0000 7f14fcf37800 20 add_watcher() i=1 2024-09-12T17:03:42.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.853+0000 7f14fcf37800 20 add_watcher() i=2 2024-09-12T17:03:42.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.853+0000 7f14fcf37800 20 add_watcher() i=3 2024-09-12T17:03:42.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.853+0000 7f14fcf37800 20 add_watcher() i=4 2024-09-12T17:03:42.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.853+0000 7f14fcf37800 20 add_watcher() i=5 2024-09-12T17:03:42.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.853+0000 7f14fcf37800 20 add_watcher() i=6 2024-09-12T17:03:42.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.854+0000 7f14fcf37800 20 add_watcher() i=7 2024-09-12T17:03:42.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.854+0000 7f14fcf37800 2 all 8 watchers are set, enabling cache 2024-09-12T17:03:42.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.856+0000 7f13aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:42.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.856+0000 7f14fcf37800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:03:42.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.856+0000 7f14fcf37800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:03:42.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.856+0000 7f14fcf37800 5 note: GC not initialized 2024-09-12T17:03:42.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.856+0000 7f13adfe3640 20 reqs_thread_entry: start 2024-09-12T17:03:42.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.856+0000 7f14fcf37800 20 init_complete bucket index max shards: 1 2024-09-12T17:03:42.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.856+0000 7f14fcf37800 20 Filter name: none 2024-09-12T17:03:42.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.856+0000 7f131f7fe640 20 reqs_thread_entry: start 2024-09-12T17:03:42.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.856+0000 7f14fcf37800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.857+0000 7f14fcf37800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:03:42.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.857+0000 7f14fcf37800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.857+0000 7f14fcf37800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:03:42.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.857+0000 7f14fcf37800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:03:42.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.857+0000 7f14fcf37800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.857+0000 7f14fcf37800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:03:42.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.857+0000 7f14fcf37800 20 rados->read ofs=0 len=0 2024-09-12T17:03:42.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.858+0000 7f14fcf37800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:03:42.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.858+0000 7f14fcf37800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:03:42.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.859+0000 7f13aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:03:42.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.861+0000 7f14fcf37800 20 remove_watcher() i=0 2024-09-12T17:03:42.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.861+0000 7f14fcf37800 2 removed watcher, disabling cache 2024-09-12T17:03:42.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.862+0000 7f14fcf37800 20 remove_watcher() i=1 2024-09-12T17:03:42.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.864+0000 7f14fcf37800 20 remove_watcher() i=2 2024-09-12T17:03:42.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.865+0000 7f14fcf37800 20 remove_watcher() i=3 2024-09-12T17:03:42.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.866+0000 7f14fcf37800 20 remove_watcher() i=4 2024-09-12T17:03:42.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.867+0000 7f14fcf37800 20 remove_watcher() i=5 2024-09-12T17:03:42.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.868+0000 7f14fcf37800 20 remove_watcher() i=6 2024-09-12T17:03:42.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:03:42.869+0000 7f14fcf37800 20 remove_watcher() i=7 2024-09-12T17:03:42.881 INFO:tasks.workunit.client.0.smithi067.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T17:03:42.882 INFO:tasks.workunit.client.0.smithi067.stderr:Deleting bucket check-bucket 2024-09-12T17:03:42.883 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:42.884 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:42.910 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:03:42.910 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:03:43.047 INFO:tasks.workunit.client.0.smithi067.stderr:Completed bucket check tests 2024-09-12T17:03:43.047 INFO:tasks.workunit.client.0.smithi067.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T17:03:43.047 INFO:tasks.workunit.client.0.smithi067.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T17:03:43.047 INFO:tasks.workunit.client.0.smithi067.stdout:connected to https://localhost:443 2024-09-12T17:03:43.110 INFO:tasks.workunit.client.0.smithi067.stderr:+ deactivate 2024-09-12T17:03:43.110 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T17:03:43.110 INFO:tasks.workunit.client.0.smithi067.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:03:43.110 INFO:tasks.workunit.client.0.smithi067.stderr:+ export PATH 2024-09-12T17:03:43.110 INFO:tasks.workunit.client.0.smithi067.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T17:03:43.110 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n '' ']' 2024-09-12T17:03:43.110 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:03:43.110 INFO:tasks.workunit.client.0.smithi067.stderr:+ hash -r 2024-09-12T17:03:43.110 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n '' ']' 2024-09-12T17:03:43.110 INFO:tasks.workunit.client.0.smithi067.stderr:+ unset VIRTUAL_ENV 2024-09-12T17:03:43.110 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T17:03:43.110 INFO:tasks.workunit.client.0.smithi067.stderr:+ unset -f deactivate 2024-09-12T17:03:43.111 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo OK. 2024-09-12T17:03:43.111 INFO:tasks.workunit.client.0.smithi067.stdout:OK. 2024-09-12T17:03:43.112 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:03:43.112 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:03:43.193 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-12T17:03:43.193 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:03:43.578 DEBUG:teuthology.parallel:result is None 2024-09-12T17:03:43.578 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:03:43.618 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:03:43.619 DEBUG:teuthology.orchestra.run.smithi067:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:03:43.689 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:03:43.689 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:03:43.705 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:03:43.705 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:03:43.705 DEBUG:teuthology.orchestra.run.smithi067:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:03:43.759 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:03:43.759 INFO:teuthology.orchestra.run.smithi067.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:03:43.760 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:03:43.829 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:03:43.830 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:03:43.900 INFO:tasks.workunit:timeout=3h 2024-09-12T17:03:43.900 INFO:tasks.workunit:cleanup=True 2024-09-12T17:03:43.901 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:03:43.970 INFO:tasks.workunit.client.0.smithi067.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:04:44.058 INFO:tasks.workunit.client.0.smithi067.stderr:Updating files: 92% (11688/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:04:44.413 INFO:tasks.workunit.client.0.smithi067.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:04:44.413 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:04:44.413 INFO:tasks.workunit.client.0.smithi067.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:04:44.413 INFO:tasks.workunit.client.0.smithi067.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:04:44.413 INFO:tasks.workunit.client.0.smithi067.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:04:44.414 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:04:44.414 INFO:tasks.workunit.client.0.smithi067.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:04:44.414 INFO:tasks.workunit.client.0.smithi067.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:04:44.414 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:04:44.414 INFO:tasks.workunit.client.0.smithi067.stderr: git switch -c 2024-09-12T17:04:44.414 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:04:44.415 INFO:tasks.workunit.client.0.smithi067.stderr:Or undo this operation with: 2024-09-12T17:04:44.415 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:04:44.415 INFO:tasks.workunit.client.0.smithi067.stderr: git switch - 2024-09-12T17:04:44.415 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:04:44.415 INFO:tasks.workunit.client.0.smithi067.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:04:44.415 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:04:44.416 INFO:tasks.workunit.client.0.smithi067.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:04:44.419 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:04:44.488 INFO:tasks.workunit.client.0.smithi067.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:04:44.490 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:04:44.490 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:04:44.542 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:04:44.592 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:04:44.632 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:04:44.634 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:04:44.634 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:04:44.673 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:04:44.677 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T17:04:44.677 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:04:44.748 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-12T17:04:44.750 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-12T17:04:44.750 DEBUG:teuthology.orchestra.run.smithi067:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-12T17:04:44.834 INFO:tasks.workunit.client.0.smithi067.stdout:Running main() from gmock_main.cc 2024-09-12T17:04:44.834 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:04:44.834 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T17:04:44.834 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 11 tests from ClsLock 2024-09-12T17:04:44.834 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-12T17:04:46.480 INFO:tasks.workunit.client.0.smithi067.stdout:lock: mylock 2024-09-12T17:04:46.480 INFO:tasks.workunit.client.0.smithi067.stdout: lock_type: exclusive 2024-09-12T17:04:46.480 INFO:tasks.workunit.client.0.smithi067.stdout: tag: 2024-09-12T17:04:46.480 INFO:tasks.workunit.client.0.smithi067.stdout: lockers: 2024-09-12T17:04:46.480 INFO:tasks.workunit.client.0.smithi067.stdout: client.5030 expiration=2024-09-12T17:06:46.475361+0000 addr=v1:172.21.15.67:0/2840910096 cookie= 2024-09-12T17:04:46.484 INFO:tasks.workunit.client.0.smithi067.stdout:lock: mylock 2024-09-12T17:04:46.484 INFO:tasks.workunit.client.0.smithi067.stdout: lock_type: shared 2024-09-12T17:04:46.484 INFO:tasks.workunit.client.0.smithi067.stdout: tag: 2024-09-12T17:04:46.485 INFO:tasks.workunit.client.0.smithi067.stdout: lockers: 2024-09-12T17:04:46.485 INFO:tasks.workunit.client.0.smithi067.stdout: client.5030 expiration=2024-09-12T17:06:46.482518+0000 addr=v1:172.21.15.67:0/2840910096 cookie= 2024-09-12T17:04:46.485 INFO:tasks.workunit.client.0.smithi067.stdout: client.5235 expiration=0.000000 addr=v1:172.21.15.67:0/1077772501 cookie= 2024-09-12T17:04:46.485 INFO:tasks.workunit.client.0.smithi067.stdout:lock: mylock 2024-09-12T17:04:46.486 INFO:tasks.workunit.client.0.smithi067.stdout: lock_type: shared 2024-09-12T17:04:46.486 INFO:tasks.workunit.client.0.smithi067.stdout: tag: 2024-09-12T17:04:46.486 INFO:tasks.workunit.client.0.smithi067.stdout: lockers: 2024-09-12T17:04:46.486 INFO:tasks.workunit.client.0.smithi067.stdout: client.5235 expiration=0.000000 addr=v1:172.21.15.67:0/1077772501 cookie= 2024-09-12T17:04:47.389 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsLock.TestMultiLocking (2554 ms) 2024-09-12T17:04:47.389 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsLock.TestMeta 2024-09-12T17:04:49.434 INFO:tasks.workunit.client.0.smithi067.stdout:lock: mylock 2024-09-12T17:04:49.434 INFO:tasks.workunit.client.0.smithi067.stdout: lock_type: shared 2024-09-12T17:04:49.434 INFO:tasks.workunit.client.0.smithi067.stdout: tag: 2024-09-12T17:04:49.435 INFO:tasks.workunit.client.0.smithi067.stdout: lockers: 2024-09-12T17:04:49.435 INFO:tasks.workunit.client.0.smithi067.stdout: client.5247 expiration=0.000000 addr=v1:172.21.15.67:0/1391005339 cookie= 2024-09-12T17:04:49.438 INFO:tasks.workunit.client.0.smithi067.stdout:lock: mylock 2024-09-12T17:04:49.438 INFO:tasks.workunit.client.0.smithi067.stdout: lock_type: exclusive 2024-09-12T17:04:49.438 INFO:tasks.workunit.client.0.smithi067.stdout: tag: new_tag 2024-09-12T17:04:49.438 INFO:tasks.workunit.client.0.smithi067.stdout: lockers: 2024-09-12T17:04:49.439 INFO:tasks.workunit.client.0.smithi067.stdout: client.5241 expiration=0.000000 addr=v1:172.21.15.67:0/981829300 cookie= 2024-09-12T17:04:50.405 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsLock.TestMeta (3017 ms) 2024-09-12T17:04:50.405 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsLock.TestCookie 2024-09-12T17:04:52.436 INFO:tasks.workunit.client.0.smithi067.stdout:lock: mylock 2024-09-12T17:04:52.436 INFO:tasks.workunit.client.0.smithi067.stdout: lock_type: exclusive 2024-09-12T17:04:52.436 INFO:tasks.workunit.client.0.smithi067.stdout: tag: 2024-09-12T17:04:52.436 INFO:tasks.workunit.client.0.smithi067.stdout: lockers: 2024-09-12T17:04:52.438 INFO:tasks.workunit.client.0.smithi067.stdout:lock: mylock 2024-09-12T17:04:52.438 INFO:tasks.workunit.client.0.smithi067.stdout: lock_type: shared 2024-09-12T17:04:52.439 INFO:tasks.workunit.client.0.smithi067.stdout: tag: 2024-09-12T17:04:52.439 INFO:tasks.workunit.client.0.smithi067.stdout: lockers: 2024-09-12T17:04:52.439 INFO:tasks.workunit.client.0.smithi067.stdout: client.5253 expiration=0.000000 addr=v1:172.21.15.67:0/1648303463 cookie= 2024-09-12T17:04:52.439 INFO:tasks.workunit.client.0.smithi067.stdout: client.5253 expiration=0.000000 addr=v1:172.21.15.67:0/1648303463 cookie=new cookie 2024-09-12T17:04:53.422 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsLock.TestCookie (3017 ms) 2024-09-12T17:04:53.422 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-12T17:04:56.444 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsLock.TestMultipleLocks (3022 ms) 2024-09-12T17:04:56.445 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-12T17:05:04.474 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsLock.TestLockDuration (8030 ms) 2024-09-12T17:05:04.475 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-12T17:05:07.507 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsLock.TestAssertLocked (3030 ms) 2024-09-12T17:05:07.507 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-12T17:05:10.514 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsLock.TestSetCookie (3010 ms) 2024-09-12T17:05:10.515 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsLock.TestRenew 2024-09-12T17:05:31.560 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsLock.TestRenew (21044 ms) 2024-09-12T17:05:31.561 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-12T17:05:38.603 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7045 ms) 2024-09-12T17:05:38.604 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-12T17:05:45.960 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7357 ms) 2024-09-12T17:05:45.961 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-12T17:05:53.999 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8039 ms) 2024-09-12T17:05:53.999 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 11 tests from ClsLock (69165 ms total) 2024-09-12T17:05:53.999 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T17:05:53.999 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T17:05:53.999 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 11 tests from 1 test suite ran. (69165 ms total) 2024-09-12T17:05:53.999 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 11 tests. 2024-09-12T17:05:54.006 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:05:54.007 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:05:54.058 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-12T17:05:54.060 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-12T17:05:54.060 DEBUG:teuthology.orchestra.run.smithi067:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-12T17:05:54.123 INFO:tasks.workunit.client.0.smithi067.stdout:Running main() from gmock_main.cc 2024-09-12T17:05:54.123 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:05:54.123 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T17:05:54.123 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 4 tests from cls_log 2024-09-12T17:05:54.123 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-12T17:05:57.024 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_log.test_log_add_same_time (2904 ms) 2024-09-12T17:05:57.024 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-12T17:06:00.045 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_log.test_log_add_different_time (3022 ms) 2024-09-12T17:06:00.045 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_log.trim_by_time 2024-09-12T17:06:03.064 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_log.trim_by_time (3019 ms) 2024-09-12T17:06:03.064 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-12T17:06:06.074 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_log.trim_by_marker (3010 ms) 2024-09-12T17:06:06.074 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 4 tests from cls_log (11955 ms total) 2024-09-12T17:06:06.074 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T17:06:06.074 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T17:06:06.075 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 4 tests from 1 test suite ran. (11955 ms total) 2024-09-12T17:06:06.075 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 4 tests. 2024-09-12T17:06:06.077 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:06:06.078 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:06:06.164 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-12T17:06:06.166 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-12T17:06:06.166 DEBUG:teuthology.orchestra.run.smithi067:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-12T17:06:06.216 INFO:tasks.workunit.client.0.smithi067.stdout:Running main() from gmock_main.cc 2024-09-12T17:06:06.216 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T17:06:06.217 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T17:06:06.217 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 10 tests from cls_refcount 2024-09-12T17:06:06.217 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-12T17:06:09.087 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_refcount.test_implicit (2871 ms) 2024-09-12T17:06:09.087 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-12T17:06:12.097 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3009 ms) 2024-09-12T17:06:12.097 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-12T17:06:21.155 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_refcount.test_put_snap (9058 ms) 2024-09-12T17:06:21.155 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-12T17:06:24.174 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_refcount.test_explicit (3020 ms) 2024-09-12T17:06:24.174 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_refcount.set 2024-09-12T17:06:27.206 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_refcount.set (3031 ms) 2024-09-12T17:06:27.206 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-12T17:06:34.237 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_refcount.test_implicit_ec (7032 ms) 2024-09-12T17:06:34.238 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-12T17:06:41.272 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7035 ms) 2024-09-12T17:06:41.272 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-12T17:06:53.413 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_refcount.test_put_snap_ec (12142 ms) 2024-09-12T17:06:53.414 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-12T17:07:00.456 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_refcount.test_explicit_ec (7041 ms) 2024-09-12T17:07:00.456 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_refcount.set_ec 2024-09-12T17:07:07.491 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_refcount.set_ec (7036 ms) 2024-09-12T17:07:07.492 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 10 tests from cls_refcount (61275 ms total) 2024-09-12T17:07:07.492 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T17:07:07.492 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T17:07:07.492 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 10 tests from 1 test suite ran. (61275 ms total) 2024-09-12T17:07:07.492 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 10 tests. 2024-09-12T17:07:07.495 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:07:07.495 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:07:07.557 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-12T17:07:07.558 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-12T17:07:07.558 DEBUG:teuthology.orchestra.run.smithi067:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-12T17:07:07.607 INFO:tasks.workunit.client.0.smithi067.stdout:Running main() from gmock_main.cc 2024-09-12T17:07:07.607 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-12T17:07:07.607 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T17:07:07.607 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 18 tests from cls_rgw 2024-09-12T17:07:09.505 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.index_basic 2024-09-12T17:07:09.558 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.index_basic (53 ms) 2024-09-12T17:07:09.558 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-12T17:07:09.591 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (33 ms) 2024-09-12T17:07:09.591 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-12T17:07:09.634 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.index_remove_object (44 ms) 2024-09-12T17:07:09.635 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-12T17:07:11.129 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.index_suggest (1494 ms) 2024-09-12T17:07:11.129 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-12T17:07:11.135 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.index_suggest_complete (6 ms) 2024-09-12T17:07:11.135 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.index_list 2024-09-12T17:07:11.154 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.index_list (20 ms) 2024-09-12T17:07:11.154 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-12T17:07:33.604 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.index_list_delimited (22448 ms) 2024-09-12T17:07:33.604 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.bi_list 2024-09-12T17:07:33.679 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.bi_list (76 ms) 2024-09-12T17:07:33.679 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.gc_set 2024-09-12T17:07:33.689 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.gc_set (10 ms) 2024-09-12T17:07:33.689 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.gc_list 2024-09-12T17:07:33.699 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.gc_list (10 ms) 2024-09-12T17:07:33.699 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-12T17:07:41.038 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.gc_defer (7338 ms) 2024-09-12T17:07:41.038 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-12T17:07:41.124 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.usage_basic (87 ms) 2024-09-12T17:07:41.124 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-12T17:07:41.125 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.usage_clear_no_obj (1 ms) 2024-09-12T17:07:41.125 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-12T17:07:41.240 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.usage_clear (115 ms) 2024-09-12T17:07:41.240 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-12T17:07:41.286 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.bi_log_trim (47 ms) 2024-09-12T17:07:41.287 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-12T17:07:41.298 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.index_racing_removes (11 ms) 2024-09-12T17:07:41.298 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-12T17:07:41.311 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.reshardlog_list (14 ms) 2024-09-12T17:07:41.312 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-12T17:07:41.321 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.reshardlog_num (9 ms) 2024-09-12T17:07:42.039 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 18 tests from cls_rgw (31816 ms total) 2024-09-12T17:07:42.039 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T17:07:42.039 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T17:07:42.039 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 18 tests from 1 test suite ran. (34432 ms total) 2024-09-12T17:07:42.040 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 18 tests. 2024-09-12T17:07:42.042 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:07:42.043 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:07:42.089 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-12T17:07:42.090 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-12T17:07:42.090 DEBUG:teuthology.orchestra.run.smithi067:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-12T17:07:42.137 INFO:tasks.workunit.client.0.smithi067.stdout:Running main() from gmock_main.cc 2024-09-12T17:07:42.137 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:07:42.138 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T17:07:42.138 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-12T17:07:42.138 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw_gc.init 2024-09-12T17:07:44.062 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw_gc.init (1926 ms) 2024-09-12T17:07:44.063 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-12T17:07:44.076 INFO:tasks.workunit.client.0.smithi067.stderr:[ ] list info tag = chain-0 2024-09-12T17:07:44.076 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (13 ms) 2024-09-12T17:07:44.076 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-12T17:07:44.086 INFO:tasks.workunit.client.0.smithi067.stderr:[ ] next_marker is: = 0/4263 2024-09-12T17:07:44.087 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (11 ms) 2024-09-12T17:07:44.087 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-12T17:07:44.097 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (11 ms) 2024-09-12T17:07:44.097 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-12T17:07:44.105 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (7 ms) 2024-09-12T17:07:44.105 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-12T17:07:44.112 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (8 ms) 2024-09-12T17:07:44.113 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-12T17:07:44.119 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (7 ms) 2024-09-12T17:07:44.119 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-12T17:07:44.126 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (6 ms) 2024-09-12T17:07:44.126 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-12T17:07:45.077 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw_gc.finalize (951 ms) 2024-09-12T17:07:45.077 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 9 tests from cls_rgw_gc (2940 ms total) 2024-09-12T17:07:45.077 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T17:07:45.077 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T17:07:45.077 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 9 tests from 1 test suite ran. (2940 ms total) 2024-09-12T17:07:45.077 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 9 tests. 2024-09-12T17:07:45.080 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:07:45.080 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:07:45.126 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-12T17:07:45.127 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-12T17:07:45.127 DEBUG:teuthology.orchestra.run.smithi067:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-12T17:07:45.183 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:07:45.184 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:07:45.184 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 1 test from 1 test suite. 2024-09-12T17:07:45.184 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T17:07:47.077 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 1 test from cls_rgw_stats 2024-09-12T17:07:47.077 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-12T17:07:47.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.095+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~8MOSF8OWTH0H.0 size=1048576 2024-09-12T17:07:47.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.096+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~8MOSF8OWTH0H.1 size=150328 2024-09-12T17:07:47.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.096+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=8MOSF8OWTH0H tag=3GQSR521SZR9 type=write size=2247480 2024-09-12T17:07:47.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.097+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=SQPIBNLD90LT type=del size=3328831 2024-09-12T17:07:47.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.099+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=SVP2KB7K6D7J type=write size=1018797 2024-09-12T17:07:47.103 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.100+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=18XC319HR65Z type=del size=1823823 2024-09-12T17:07:47.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.102+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=Q6WL6ZWULXUW type=del size=1989629 2024-09-12T17:07:47.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.104+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~769DTQYTEF14.0 size=1048576 2024-09-12T17:07:47.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.105+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~769DTQYTEF14.1 size=1048576 2024-09-12T17:07:47.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.106+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~769DTQYTEF14.2 size=536254 2024-09-12T17:07:47.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.106+0000 7f9eaebff780 1 > prepared multipart upload key=B1YC6DM9S8JJ upload=769DTQYTEF14 tag=EN3NBFZGBGUX type=write size=3681982 2024-09-12T17:07:47.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.109+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~GPAN1FFFD32U.0 size=1048576 2024-09-12T17:07:47.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.110+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~GPAN1FFFD32U.1 size=888322 2024-09-12T17:07:47.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.110+0000 7f9eaebff780 1 > prepared multipart upload key=QIMNK4DL3D0N upload=GPAN1FFFD32U tag=OYGNLNW1S1VU type=write size=2985474 2024-09-12T17:07:47.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.111+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=PSHJYUWPXVCE type=del size=3898886 2024-09-12T17:07:47.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.112+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=V2L5TH9CWC9B type=del size=656587 2024-09-12T17:07:47.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.115+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~Q87C1IN1P2DW.0 size=1048576 2024-09-12T17:07:47.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.116+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~Q87C1IN1P2DW.1 size=1048576 2024-09-12T17:07:47.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.117+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~Q87C1IN1P2DW.2 size=346238 2024-09-12T17:07:47.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.117+0000 7f9eaebff780 1 > prepared multipart upload key=9I6RGNRB6HSY upload=Q87C1IN1P2DW tag=AZ0HNAB6LMCC type=write size=3491966 2024-09-12T17:07:47.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.118+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=39376OTXS9HQ type=del size=4161148 2024-09-12T17:07:47.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.121+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~0HUO6EP6BGZ4.0 size=1048576 2024-09-12T17:07:47.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.122+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~0HUO6EP6BGZ4.1 size=1048576 2024-09-12T17:07:47.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.123+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~0HUO6EP6BGZ4.2 size=1008985 2024-09-12T17:07:47.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.123+0000 7f9eaebff780 1 > prepared multipart upload key=SO6QF2JCRX6E upload=0HUO6EP6BGZ4 tag=UN6TPAYE9KVC type=write size=4154713 2024-09-12T17:07:47.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.125+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~CX68UUKYYAIN.0 size=1048576 2024-09-12T17:07:47.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.126+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~CX68UUKYYAIN.1 size=271827 2024-09-12T17:07:47.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.126+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=CX68UUKYYAIN tag=6A9VSDO3W9HJ type=write size=2368979 2024-09-12T17:07:47.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.128+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=EJU0DONVAIGS type=del size=1096413 2024-09-12T17:07:47.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.129+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=AVHOMT2VSEFY type=del size=2868409 2024-09-12T17:07:47.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.130+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=KP3W9YQKQOL6 type=del size=85895 2024-09-12T17:07:47.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.132+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~8MOSF8OWTH0H.0 size=1048576 2024-09-12T17:07:47.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.133+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~8MOSF8OWTH0H.1 size=150328 2024-09-12T17:07:47.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.135+0000 7f9eaebff780 1 < completed multipart upload key=UYF1AN2W59VN upload=8MOSF8OWTH0H tag=3GQSR521SZR9 type=write size=2247480 2024-09-12T17:07:47.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.136+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=L00JFF0DZBR5 type=del size=3675115 2024-09-12T17:07:47.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.137+0000 7f9eaebff780 1 < completed delete operation key=0F5LXJZMBFSP tag=SQPIBNLD90LT type=del 2024-09-12T17:07:47.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.140+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~91KCJL8GBX9K.0 size=1048576 2024-09-12T17:07:47.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.141+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~91KCJL8GBX9K.1 size=1048576 2024-09-12T17:07:47.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.142+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~91KCJL8GBX9K.2 size=371153 2024-09-12T17:07:47.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.142+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=91KCJL8GBX9K tag=ZBQ9OH3OSKCC type=write size=3516881 2024-09-12T17:07:47.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.143+0000 7f9eaebff780 1 < completed write operation key=K2NHRSUDQBRW tag=SVP2KB7K6D7J type=write size=1018797 2024-09-12T17:07:47.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.145+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=Q13CBQ31G2T1 type=del size=3564041 2024-09-12T17:07:47.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.146+0000 7f9eaebff780 1 < completed delete operation key=ZYP3P4031PUZ tag=18XC319HR65Z type=del 2024-09-12T17:07:47.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.147+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=Y1FLUGA7HMGB type=del size=223432 2024-09-12T17:07:47.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.149+0000 7f9eaebff780 1 < completed delete operation key=TDZCNUZE8IOA tag=Q6WL6ZWULXUW type=del 2024-09-12T17:07:47.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.150+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=3VD6YG1DA5TL type=del size=44682 2024-09-12T17:07:47.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.151+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~769DTQYTEF14.0 size=1048576 2024-09-12T17:07:47.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.152+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~769DTQYTEF14.1 size=1048576 2024-09-12T17:07:47.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.153+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~769DTQYTEF14.2 size=536254 2024-09-12T17:07:47.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.155+0000 7f9eaebff780 1 < completed multipart upload key=B1YC6DM9S8JJ upload=769DTQYTEF14 tag=EN3NBFZGBGUX type=write size=3681982 2024-09-12T17:07:47.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.157+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~22JM66RN79BE.0 size=475731 2024-09-12T17:07:47.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.157+0000 7f9eaebff780 1 > prepared multipart upload key=9WJGBODZ60NJ upload=22JM66RN79BE tag=VX7PJU0EIELQ type=write size=1524307 2024-09-12T17:07:47.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.159+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~GPAN1FFFD32U.0 size=1048576 2024-09-12T17:07:47.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.160+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~GPAN1FFFD32U.1 size=888322 2024-09-12T17:07:47.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.161+0000 7f9eaebff780 1 < completed multipart upload key=QIMNK4DL3D0N upload=GPAN1FFFD32U tag=OYGNLNW1S1VU type=write size=2985474 2024-09-12T17:07:47.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.163+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=A5FOQZ5YVTG3 type=write size=707646 2024-09-12T17:07:47.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.164+0000 7f9eaebff780 1 < canceled operation key=A1KRCFY18QTP tag=PSHJYUWPXVCE type=del size=3898886 2024-09-12T17:07:47.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.167+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~ONLRXI92I9KJ.0 size=901636 2024-09-12T17:07:47.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.167+0000 7f9eaebff780 1 > prepared multipart upload key=8DJLYFM11DNI upload=ONLRXI92I9KJ tag=CWOXVATC9UKH type=write size=1950212 2024-09-12T17:07:47.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.168+0000 7f9eaebff780 1 < completed delete operation key=UYF1AN2W59VN tag=V2L5TH9CWC9B type=del 2024-09-12T17:07:47.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.170+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~0IVRZ92MCB5K.0 size=1048576 2024-09-12T17:07:47.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.171+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~0IVRZ92MCB5K.1 size=1048576 2024-09-12T17:07:47.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.172+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~0IVRZ92MCB5K.2 size=412290 2024-09-12T17:07:47.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.172+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=0IVRZ92MCB5K tag=GQO92U87TRCY type=write size=3558018 2024-09-12T17:07:47.176 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.174+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~Q87C1IN1P2DW.0 size=1048576 2024-09-12T17:07:47.177 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.174+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~Q87C1IN1P2DW.1 size=1048576 2024-09-12T17:07:47.178 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.175+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~Q87C1IN1P2DW.2 size=346238 2024-09-12T17:07:47.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.177+0000 7f9eaebff780 1 < completed multipart upload key=9I6RGNRB6HSY upload=Q87C1IN1P2DW tag=AZ0HNAB6LMCC type=write size=3491966 2024-09-12T17:07:47.181 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.179+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=HF1K2SQXW1DJ type=del size=913320 2024-09-12T17:07:47.182 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.180+0000 7f9eaebff780 1 < completed delete operation key=K0P9ZZ91UJJ8 tag=39376OTXS9HQ type=del 2024-09-12T17:07:47.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.181+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=VOM9773UWAL7 type=del size=115251 2024-09-12T17:07:47.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.183+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~0HUO6EP6BGZ4.0 size=1048576 2024-09-12T17:07:47.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.184+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~0HUO6EP6BGZ4.1 size=1048576 2024-09-12T17:07:47.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.185+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~0HUO6EP6BGZ4.2 size=1008985 2024-09-12T17:07:47.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.187+0000 7f9eaebff780 1 < completed multipart upload key=SO6QF2JCRX6E upload=0HUO6EP6BGZ4 tag=UN6TPAYE9KVC type=write size=4154713 2024-09-12T17:07:47.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.189+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~IF7FRRZGMC4K.0 size=1048576 2024-09-12T17:07:47.192 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.190+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~IF7FRRZGMC4K.1 size=281435 2024-09-12T17:07:47.192 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.190+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=IF7FRRZGMC4K tag=R24A1I9L7PJQ type=write size=2378587 2024-09-12T17:07:47.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.191+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~CX68UUKYYAIN.0 size=1048576 2024-09-12T17:07:47.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.191+0000 7f9eaebff780 1 < canceled part key=_multipart_M3PLQGSK34YM.2~CX68UUKYYAIN.1 size=271827 2024-09-12T17:07:47.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.193+0000 7f9eaebff780 1 < canceled multipart upload key=M3PLQGSK34YM upload=CX68UUKYYAIN tag=6A9VSDO3W9HJ type=write size=2368979 2024-09-12T17:07:47.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.194+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=P2S0QDPWP9YL type=del size=2895445 2024-09-12T17:07:47.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.195+0000 7f9eaebff780 1 < completed delete operation key=OGD6H9VSVGWF tag=EJU0DONVAIGS type=del 2024-09-12T17:07:47.200 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.197+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~G92OJ2IMVDBO.0 size=1048576 2024-09-12T17:07:47.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.198+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~G92OJ2IMVDBO.1 size=863914 2024-09-12T17:07:47.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.198+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=G92OJ2IMVDBO tag=E1C24XHHJI8E type=write size=2961066 2024-09-12T17:07:47.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.201+0000 7f9eaebff780 1 < suggested update operation key=9I6RGNRB6HSY tag=AVHOMT2VSEFY type=del size=2868409 2024-09-12T17:07:47.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.202+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=XQPPJMMZMV5J type=del size=3213754 2024-09-12T17:07:47.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.203+0000 7f9eaebff780 1 < completed delete operation key=SVWPQETL92QU tag=KP3W9YQKQOL6 type=del 2024-09-12T17:07:47.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.205+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~OORZ64WLNH1M.0 size=305637 2024-09-12T17:07:47.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.205+0000 7f9eaebff780 1 > prepared multipart upload key=OGD6H9VSVGWF upload=OORZ64WLNH1M tag=JZGZLYIDTJD0 type=write size=1354213 2024-09-12T17:07:47.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.207+0000 7f9eaebff780 1 < completed delete operation key=SHWT6AT7PN0M tag=L00JFF0DZBR5 type=del 2024-09-12T17:07:47.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.209+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~RW5SOZ5CHYWE.0 size=1048576 2024-09-12T17:07:47.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.210+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~RW5SOZ5CHYWE.1 size=78055 2024-09-12T17:07:47.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.210+0000 7f9eaebff780 1 > prepared multipart upload key=LRI5G5G8O5X4 upload=RW5SOZ5CHYWE tag=0JU9IWQ1K0H0 type=write size=2175207 2024-09-12T17:07:47.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.211+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~91KCJL8GBX9K.0 size=1048576 2024-09-12T17:07:47.214 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.212+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~91KCJL8GBX9K.1 size=1048576 2024-09-12T17:07:47.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.213+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~91KCJL8GBX9K.2 size=371153 2024-09-12T17:07:47.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.215+0000 7f9eaebff780 1 < completed multipart upload key=M3PLQGSK34YM upload=91KCJL8GBX9K tag=ZBQ9OH3OSKCC type=write size=3516881 2024-09-12T17:07:47.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.217+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~I5E5EUYZKYFY.0 size=1048576 2024-09-12T17:07:47.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.218+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~I5E5EUYZKYFY.1 size=513976 2024-09-12T17:07:47.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.218+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=I5E5EUYZKYFY tag=JVASI08DWKKZ type=write size=2611128 2024-09-12T17:07:47.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.220+0000 7f9eaebff780 1 < completed delete operation key=OGD6H9VSVGWF tag=Q13CBQ31G2T1 type=del 2024-09-12T17:07:47.224 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.222+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=3VI78QYTUF05 type=del size=1354770 2024-09-12T17:07:47.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.223+0000 7f9eaebff780 1 < canceled operation key=SO6QF2JCRX6E tag=Y1FLUGA7HMGB type=del size=223432 2024-09-12T17:07:47.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.226+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~K0NPVXD2C1LX.0 size=1048576 2024-09-12T17:07:47.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.227+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~K0NPVXD2C1LX.1 size=114276 2024-09-12T17:07:47.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.227+0000 7f9eaebff780 1 > prepared multipart upload key=0F5LXJZMBFSP upload=K0NPVXD2C1LX tag=56KEQBBIK44V type=write size=2211428 2024-09-12T17:07:47.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.229+0000 7f9eaebff780 1 < suggested update operation key=OH6GXTMPBYUY tag=3VD6YG1DA5TL type=del size=44682 2024-09-12T17:07:47.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.231+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=E609IGGLO9DM type=del size=1585569 2024-09-12T17:07:47.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.232+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~22JM66RN79BE.0 size=475731 2024-09-12T17:07:47.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.234+0000 7f9eaebff780 1 < completed multipart upload key=9WJGBODZ60NJ upload=22JM66RN79BE tag=VX7PJU0EIELQ type=write size=1524307 2024-09-12T17:07:47.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.237+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~XDIOEJUNM1WF.0 size=1048576 2024-09-12T17:07:47.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.238+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~XDIOEJUNM1WF.1 size=1048576 2024-09-12T17:07:47.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.239+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~XDIOEJUNM1WF.2 size=602557 2024-09-12T17:07:47.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.239+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=XDIOEJUNM1WF tag=P8NT5I0I6M7R type=write size=3748285 2024-09-12T17:07:47.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.241+0000 7f9eaebff780 1 < completed write operation key=B1YC6DM9S8JJ tag=A5FOQZ5YVTG3 type=write size=707646 2024-09-12T17:07:47.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.242+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=0BHN9B3NVUVZ type=del size=3121873 2024-09-12T17:07:47.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.243+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~ONLRXI92I9KJ.0 size=901636 2024-09-12T17:07:47.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.245+0000 7f9eaebff780 1 < completed multipart upload key=8DJLYFM11DNI upload=ONLRXI92I9KJ tag=CWOXVATC9UKH type=write size=1950212 2024-09-12T17:07:47.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.248+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~D0222HZCIFDR.0 size=1048576 2024-09-12T17:07:47.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.249+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~D0222HZCIFDR.1 size=370329 2024-09-12T17:07:47.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.249+0000 7f9eaebff780 1 > prepared multipart upload key=0YD5P1ACZ09Q upload=D0222HZCIFDR tag=FOKQV3F7C8NT type=write size=2467481 2024-09-12T17:07:47.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.250+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~0IVRZ92MCB5K.0 size=1048576 2024-09-12T17:07:47.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.251+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~0IVRZ92MCB5K.1 size=1048576 2024-09-12T17:07:47.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.252+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~0IVRZ92MCB5K.2 size=412290 2024-09-12T17:07:47.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.254+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=0IVRZ92MCB5K tag=GQO92U87TRCY type=write size=3558018 2024-09-12T17:07:47.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.255+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=TED8VBTQTCX4 type=write size=371544 2024-09-12T17:07:47.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.257+0000 7f9eaebff780 1 < completed delete operation key=YIEP2JYDSLW0 tag=HF1K2SQXW1DJ type=del 2024-09-12T17:07:47.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.258+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=3DQMKWAFINU0 type=del size=2928197 2024-09-12T17:07:47.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.259+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=VOM9773UWAL7 type=del 2024-09-12T17:07:47.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.260+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=N85QV00XED59 type=del size=1634628 2024-09-12T17:07:47.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.261+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~IF7FRRZGMC4K.0 size=1048576 2024-09-12T17:07:47.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.261+0000 7f9eaebff780 1 < canceled part key=_multipart_K0P9ZZ91UJJ8.2~IF7FRRZGMC4K.1 size=281435 2024-09-12T17:07:47.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.263+0000 7f9eaebff780 1 < canceled multipart upload key=K0P9ZZ91UJJ8 upload=IF7FRRZGMC4K tag=R24A1I9L7PJQ type=write size=2378587 2024-09-12T17:07:47.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.264+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=6XNOZSPQ23ZA type=del size=2978575 2024-09-12T17:07:47.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.267+0000 7f9eaebff780 1 < suggested update operation key=KF8XE48DI9KZ tag=P2S0QDPWP9YL type=del size=2895445 2024-09-12T17:07:47.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.269+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~O21AC9QCS3TD.0 size=1048576 2024-09-12T17:07:47.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.270+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~O21AC9QCS3TD.1 size=1048576 2024-09-12T17:07:47.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.271+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~O21AC9QCS3TD.2 size=422697 2024-09-12T17:07:47.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.271+0000 7f9eaebff780 1 > prepared multipart upload key=8DJLYFM11DNI upload=O21AC9QCS3TD tag=YF81CVVKTXY2 type=write size=3568425 2024-09-12T17:07:47.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.273+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~G92OJ2IMVDBO.0 size=1048576 2024-09-12T17:07:47.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.274+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~G92OJ2IMVDBO.1 size=863914 2024-09-12T17:07:47.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.276+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=G92OJ2IMVDBO tag=E1C24XHHJI8E type=write size=2961066 2024-09-12T17:07:47.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.277+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=0LQJEF5ITWSD type=del size=2651443 2024-09-12T17:07:47.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.279+0000 7f9eaebff780 1 < completed delete operation key=LJN514F16XJA tag=XQPPJMMZMV5J type=del 2024-09-12T17:07:47.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.281+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~ULA8ITO1VOB3.0 size=1048576 2024-09-12T17:07:47.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.282+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~ULA8ITO1VOB3.1 size=1048576 2024-09-12T17:07:47.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.283+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~ULA8ITO1VOB3.2 size=643309 2024-09-12T17:07:47.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.283+0000 7f9eaebff780 1 > prepared multipart upload key=TDZCNUZE8IOA upload=ULA8ITO1VOB3 tag=RN9F96IXACQT type=write size=3789037 2024-09-12T17:07:47.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.284+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~OORZ64WLNH1M.0 size=305637 2024-09-12T17:07:47.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.286+0000 7f9eaebff780 1 < completed multipart upload key=OGD6H9VSVGWF upload=OORZ64WLNH1M tag=JZGZLYIDTJD0 type=write size=1354213 2024-09-12T17:07:47.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.288+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~BXIEUD6OA1BL.0 size=1048576 2024-09-12T17:07:47.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.289+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~BXIEUD6OA1BL.1 size=1048576 2024-09-12T17:07:47.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.290+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~BXIEUD6OA1BL.2 size=588152 2024-09-12T17:07:47.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.290+0000 7f9eaebff780 1 > prepared multipart upload key=0F5LXJZMBFSP upload=BXIEUD6OA1BL tag=GO5RM1HN8PKF type=write size=3733880 2024-09-12T17:07:47.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.291+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~RW5SOZ5CHYWE.0 size=1048576 2024-09-12T17:07:47.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.292+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~RW5SOZ5CHYWE.1 size=78055 2024-09-12T17:07:47.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.294+0000 7f9eaebff780 1 < completed multipart upload key=LRI5G5G8O5X4 upload=RW5SOZ5CHYWE tag=0JU9IWQ1K0H0 type=write size=2175207 2024-09-12T17:07:47.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.296+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=153SNCYKHCTP type=del size=311344 2024-09-12T17:07:47.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.297+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~I5E5EUYZKYFY.0 size=1048576 2024-09-12T17:07:47.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.298+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~I5E5EUYZKYFY.1 size=513976 2024-09-12T17:07:47.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.300+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=I5E5EUYZKYFY tag=JVASI08DWKKZ type=write size=2611128 2024-09-12T17:07:47.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.302+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=OPUNRJWCN2Q8 type=write size=420385 2024-09-12T17:07:47.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.304+0000 7f9eaebff780 1 < suggested remove operation key=P9GMGM3WK6O7 tag=3VI78QYTUF05 type=del 2024-09-12T17:07:47.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.305+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=0477P7X7AHDB type=del size=3903627 2024-09-12T17:07:47.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.306+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~K0NPVXD2C1LX.0 size=1048576 2024-09-12T17:07:47.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.307+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~K0NPVXD2C1LX.1 size=114276 2024-09-12T17:07:47.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.309+0000 7f9eaebff780 1 < completed multipart upload key=0F5LXJZMBFSP upload=K0NPVXD2C1LX tag=56KEQBBIK44V type=write size=2211428 2024-09-12T17:07:47.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.312+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~HS8S5XP8GDJM.0 size=1048576 2024-09-12T17:07:47.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.313+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~HS8S5XP8GDJM.1 size=1048576 2024-09-12T17:07:47.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.314+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~HS8S5XP8GDJM.2 size=836654 2024-09-12T17:07:47.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.314+0000 7f9eaebff780 1 > prepared multipart upload key=ZC814TPVLJO1 upload=HS8S5XP8GDJM tag=OHNU2NLAW0EV type=write size=3982382 2024-09-12T17:07:47.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.315+0000 7f9eaebff780 1 < completed delete operation key=ZYP3P4031PUZ tag=E609IGGLO9DM type=del 2024-09-12T17:07:47.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.317+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=3T43GI8M7HN8 type=del size=3577559 2024-09-12T17:07:47.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.318+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~XDIOEJUNM1WF.0 size=1048576 2024-09-12T17:07:47.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.319+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~XDIOEJUNM1WF.1 size=1048576 2024-09-12T17:07:47.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.320+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~XDIOEJUNM1WF.2 size=602557 2024-09-12T17:07:47.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.322+0000 7f9eaebff780 1 < completed multipart upload key=SHWT6AT7PN0M upload=XDIOEJUNM1WF tag=P8NT5I0I6M7R type=write size=3748285 2024-09-12T17:07:47.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.324+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~QCPTU325KD7G.0 size=1000874 2024-09-12T17:07:47.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.324+0000 7f9eaebff780 1 > prepared multipart upload key=YIEP2JYDSLW0 upload=QCPTU325KD7G tag=IFKD5GNXYUWP type=write size=2049450 2024-09-12T17:07:47.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.325+0000 7f9eaebff780 1 < completed delete operation key=SHWT6AT7PN0M tag=0BHN9B3NVUVZ type=del 2024-09-12T17:07:47.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.326+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=IF4XIRGU6WJ4 type=del size=2370322 2024-09-12T17:07:47.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.327+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~D0222HZCIFDR.0 size=1048576 2024-09-12T17:07:47.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.328+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~D0222HZCIFDR.1 size=370329 2024-09-12T17:07:47.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.330+0000 7f9eaebff780 1 < completed multipart upload key=0YD5P1ACZ09Q upload=D0222HZCIFDR tag=FOKQV3F7C8NT type=write size=2467481 2024-09-12T17:07:47.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.331+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=64J4XJWTIQHJ type=del size=778920 2024-09-12T17:07:47.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.334+0000 7f9eaebff780 1 < suggested update operation key=SO6QF2JCRX6E tag=TED8VBTQTCX4 type=write size=371544 2024-09-12T17:07:47.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.336+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=D5DXUSDKX6XD type=del size=166244 2024-09-12T17:07:47.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.337+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=3DQMKWAFINU0 type=del 2024-09-12T17:07:47.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.340+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=4N9FSQ23CNGD type=del size=3386125 2024-09-12T17:07:47.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.341+0000 7f9eaebff780 1 < canceled operation key=QIMNK4DL3D0N tag=N85QV00XED59 type=del size=1634628 2024-09-12T17:07:47.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.342+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=8XG31WBBB1H5 type=del size=2117038 2024-09-12T17:07:47.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.345+0000 7f9eaebff780 -1 < failed to complete operation key=P9GMGM3WK6O7 tag=6XNOZSPQ23ZA type=del size=2978575: (22) Invalid argument 2024-09-12T17:07:47.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.347+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~EL4HMQ2KZ9MY.0 size=1048576 2024-09-12T17:07:47.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.348+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~EL4HMQ2KZ9MY.1 size=1048576 2024-09-12T17:07:47.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.349+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~EL4HMQ2KZ9MY.2 size=489785 2024-09-12T17:07:47.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.349+0000 7f9eaebff780 1 > prepared multipart upload key=CAIZM33SDFPM upload=EL4HMQ2KZ9MY tag=ZHO8QYP3NDAG type=write size=3635513 2024-09-12T17:07:47.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.350+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~O21AC9QCS3TD.0 size=1048576 2024-09-12T17:07:47.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.351+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~O21AC9QCS3TD.1 size=1048576 2024-09-12T17:07:47.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.352+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~O21AC9QCS3TD.2 size=422697 2024-09-12T17:07:47.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.354+0000 7f9eaebff780 1 < completed multipart upload key=8DJLYFM11DNI upload=O21AC9QCS3TD tag=YF81CVVKTXY2 type=write size=3568425 2024-09-12T17:07:47.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.355+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=11X1TD3F7HBT type=del size=1346784 2024-09-12T17:07:47.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.358+0000 7f9eaebff780 1 < suggested update operation key=SVWPQETL92QU tag=0LQJEF5ITWSD type=del size=2651443 2024-09-12T17:07:47.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.359+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=SUSDDO0KU6WE type=del size=790537 2024-09-12T17:07:47.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.360+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~ULA8ITO1VOB3.0 size=1048576 2024-09-12T17:07:47.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.361+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~ULA8ITO1VOB3.1 size=1048576 2024-09-12T17:07:47.364 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.362+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~ULA8ITO1VOB3.2 size=643309 2024-09-12T17:07:47.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.364+0000 7f9eaebff780 1 < completed multipart upload key=TDZCNUZE8IOA upload=ULA8ITO1VOB3 tag=RN9F96IXACQT type=write size=3789037 2024-09-12T17:07:47.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.366+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~1KKDKSOK062X.0 size=1048576 2024-09-12T17:07:47.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.367+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~1KKDKSOK062X.1 size=1048576 2024-09-12T17:07:47.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.368+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~1KKDKSOK062X.2 size=510475 2024-09-12T17:07:47.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.368+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=1KKDKSOK062X tag=P2WCSRY2IN1X type=write size=3656203 2024-09-12T17:07:47.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.370+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~BXIEUD6OA1BL.0 size=1048576 2024-09-12T17:07:47.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.371+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~BXIEUD6OA1BL.1 size=1048576 2024-09-12T17:07:47.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.372+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~BXIEUD6OA1BL.2 size=588152 2024-09-12T17:07:47.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.375+0000 7f9eaebff780 1 < completed multipart upload key=0F5LXJZMBFSP upload=BXIEUD6OA1BL tag=GO5RM1HN8PKF type=write size=3733880 2024-09-12T17:07:47.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.376+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=44O3UC3CZBLZ type=del size=1043878 2024-09-12T17:07:47.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.377+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=153SNCYKHCTP type=del 2024-09-12T17:07:47.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.379+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=MVZ3MT14KWEO type=del size=3284872 2024-09-12T17:07:47.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.382+0000 7f9eaebff780 1 < suggested update operation key=3LY681252WAN tag=OPUNRJWCN2Q8 type=write size=420385 2024-09-12T17:07:47.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.384+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~648GYYPOWQ4U.0 size=504585 2024-09-12T17:07:47.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.384+0000 7f9eaebff780 1 > prepared multipart upload key=B1YC6DM9S8JJ upload=648GYYPOWQ4U tag=Z65FXYRZC0B7 type=write size=1553161 2024-09-12T17:07:47.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.385+0000 7f9eaebff780 1 < completed delete operation key=K2NHRSUDQBRW tag=0477P7X7AHDB type=del 2024-09-12T17:07:47.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.388+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~WZ25A66OR7N7.0 size=777349 2024-09-12T17:07:47.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.388+0000 7f9eaebff780 1 > prepared multipart upload key=ZC814TPVLJO1 upload=WZ25A66OR7N7 tag=2HBAHJ9PJFJF type=write size=1825925 2024-09-12T17:07:47.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.389+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~HS8S5XP8GDJM.0 size=1048576 2024-09-12T17:07:47.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.390+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~HS8S5XP8GDJM.1 size=1048576 2024-09-12T17:07:47.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.391+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~HS8S5XP8GDJM.2 size=836654 2024-09-12T17:07:47.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.394+0000 7f9eaebff780 1 < completed multipart upload key=ZC814TPVLJO1 upload=HS8S5XP8GDJM tag=OHNU2NLAW0EV type=write size=3982382 2024-09-12T17:07:47.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.395+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=B9W8EO3WF2I6 type=del size=2056955 2024-09-12T17:07:47.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.396+0000 7f9eaebff780 1 < completed delete operation key=LRI5G5G8O5X4 tag=3T43GI8M7HN8 type=del 2024-09-12T17:07:47.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.398+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~4SU5F4W1ZBDQ.0 size=1048576 2024-09-12T17:07:47.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.399+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~4SU5F4W1ZBDQ.1 size=531695 2024-09-12T17:07:47.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.399+0000 7f9eaebff780 1 > prepared multipart upload key=9I6RGNRB6HSY upload=4SU5F4W1ZBDQ tag=74WZRUHQ2LUM type=write size=2628847 2024-09-12T17:07:47.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.400+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~QCPTU325KD7G.0 size=1000874 2024-09-12T17:07:47.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.402+0000 7f9eaebff780 1 < completed multipart upload key=YIEP2JYDSLW0 upload=QCPTU325KD7G tag=IFKD5GNXYUWP type=write size=2049450 2024-09-12T17:07:47.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.404+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=EFS67CH7EFMD type=del size=2190509 2024-09-12T17:07:47.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.405+0000 7f9eaebff780 1 < completed delete operation key=P9GMGM3WK6O7 tag=IF4XIRGU6WJ4 type=del 2024-09-12T17:07:47.410 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.407+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~0JPBKIJA9RDB.0 size=1048576 2024-09-12T17:07:47.411 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.408+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~0JPBKIJA9RDB.1 size=1048576 2024-09-12T17:07:47.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.409+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~0JPBKIJA9RDB.2 size=594513 2024-09-12T17:07:47.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.409+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=0JPBKIJA9RDB tag=K9357YEIT7ZM type=write size=3740241 2024-09-12T17:07:47.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.412+0000 7f9eaebff780 1 < suggested remove operation key=LRI5G5G8O5X4 tag=64J4XJWTIQHJ type=del 2024-09-12T17:07:47.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.413+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=3ZR7BU61I36D type=del size=3062490 2024-09-12T17:07:47.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.414+0000 7f9eaebff780 1 < completed delete operation key=OGD6H9VSVGWF tag=D5DXUSDKX6XD type=del 2024-09-12T17:07:47.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.416+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=NO1DCRCNWZSL type=del size=1373346 2024-09-12T17:07:47.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.417+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=4N9FSQ23CNGD type=del 2024-09-12T17:07:47.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.419+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~UVAUUINIEEE7.0 size=1048576 2024-09-12T17:07:47.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.420+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~UVAUUINIEEE7.1 size=998826 2024-09-12T17:07:47.423 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.420+0000 7f9eaebff780 1 > prepared multipart upload key=0YD5P1ACZ09Q upload=UVAUUINIEEE7 tag=MJEWLU992TA1 type=write size=3095978 2024-09-12T17:07:47.424 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.421+0000 7f9eaebff780 1 < completed delete operation key=OGD6H9VSVGWF tag=8XG31WBBB1H5 type=del 2024-09-12T17:07:47.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.424+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~G70R04CKWO0F.0 size=1048576 2024-09-12T17:07:47.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.425+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~G70R04CKWO0F.1 size=216752 2024-09-12T17:07:47.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.425+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=G70R04CKWO0F tag=TGBJ1H7O3NNH type=write size=2313904 2024-09-12T17:07:47.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.426+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~EL4HMQ2KZ9MY.0 size=1048576 2024-09-12T17:07:47.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.427+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~EL4HMQ2KZ9MY.1 size=1048576 2024-09-12T17:07:47.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.428+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~EL4HMQ2KZ9MY.2 size=489785 2024-09-12T17:07:47.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.430+0000 7f9eaebff780 1 < completed multipart upload key=CAIZM33SDFPM upload=EL4HMQ2KZ9MY tag=ZHO8QYP3NDAG type=write size=3635513 2024-09-12T17:07:47.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.431+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=NGGKC8JYG220 type=del size=3225384 2024-09-12T17:07:47.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.434+0000 7f9eaebff780 1 < suggested update operation key=UYF1AN2W59VN tag=11X1TD3F7HBT type=del size=1346784 2024-09-12T17:07:47.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.435+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=LYSQXDHTH3H5 type=del size=3296518 2024-09-12T17:07:47.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.437+0000 7f9eaebff780 1 < completed delete operation key=K2NHRSUDQBRW tag=SUSDDO0KU6WE type=del 2024-09-12T17:07:47.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.438+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=2JI9ST39F6W2 type=del size=617178 2024-09-12T17:07:47.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.439+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~1KKDKSOK062X.0 size=1048576 2024-09-12T17:07:47.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.440+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~1KKDKSOK062X.1 size=1048576 2024-09-12T17:07:47.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.440+0000 7f9eaebff780 1 < canceled part key=_multipart_P9GMGM3WK6O7.2~1KKDKSOK062X.2 size=510475 2024-09-12T17:07:47.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.442+0000 7f9eaebff780 1 < canceled multipart upload key=P9GMGM3WK6O7 upload=1KKDKSOK062X tag=P2WCSRY2IN1X type=write size=3656203 2024-09-12T17:07:47.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.443+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=TTAWWWQ2Z3RZ type=write size=824741 2024-09-12T17:07:47.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.444+0000 7f9eaebff780 1 < completed delete operation key=QIMNK4DL3D0N tag=44O3UC3CZBLZ type=del 2024-09-12T17:07:47.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.446+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=OEF363RI4QS0 type=del size=366570 2024-09-12T17:07:47.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.447+0000 7f9eaebff780 1 < canceled operation key=K2NHRSUDQBRW tag=MVZ3MT14KWEO type=del size=3284872 2024-09-12T17:07:47.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.448+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=D3F0I4LX3CFE type=del size=3140258 2024-09-12T17:07:47.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.450+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~648GYYPOWQ4U.0 size=504585 2024-09-12T17:07:47.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.452+0000 7f9eaebff780 1 < completed multipart upload key=B1YC6DM9S8JJ upload=648GYYPOWQ4U tag=Z65FXYRZC0B7 type=write size=1553161 2024-09-12T17:07:47.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.453+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=ZH3SRTP60L2V type=del size=681359 2024-09-12T17:07:47.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.454+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~WZ25A66OR7N7.0 size=777349 2024-09-12T17:07:47.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.457+0000 7f9eaebff780 1 < completed multipart upload key=ZC814TPVLJO1 upload=WZ25A66OR7N7 tag=2HBAHJ9PJFJF type=write size=1825925 2024-09-12T17:07:47.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.461+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~PNGLS3CGP0P8.0 size=1048576 2024-09-12T17:07:47.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.462+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~PNGLS3CGP0P8.1 size=1048576 2024-09-12T17:07:47.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.463+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~PNGLS3CGP0P8.2 size=213854 2024-09-12T17:07:47.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.463+0000 7f9eaebff780 1 > prepared multipart upload key=TDZCNUZE8IOA upload=PNGLS3CGP0P8 tag=R5MB76HUK6LL type=write size=3359582 2024-09-12T17:07:47.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.464+0000 7f9eaebff780 1 < completed delete operation key=B1YC6DM9S8JJ tag=B9W8EO3WF2I6 type=del 2024-09-12T17:07:47.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.465+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=Y1T5LOH11KI9 type=del size=2477822 2024-09-12T17:07:47.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.467+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~4SU5F4W1ZBDQ.0 size=1048576 2024-09-12T17:07:47.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.468+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~4SU5F4W1ZBDQ.1 size=531695 2024-09-12T17:07:47.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.470+0000 7f9eaebff780 1 < completed multipart upload key=9I6RGNRB6HSY upload=4SU5F4W1ZBDQ tag=74WZRUHQ2LUM type=write size=2628847 2024-09-12T17:07:47.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.471+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=MYQ31HEBNO8N type=del size=1216440 2024-09-12T17:07:47.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.472+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=EFS67CH7EFMD type=del 2024-09-12T17:07:47.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.474+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=6BPYQHV4ODGR type=del size=3756107 2024-09-12T17:07:47.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.475+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~0JPBKIJA9RDB.0 size=1048576 2024-09-12T17:07:47.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.476+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~0JPBKIJA9RDB.1 size=1048576 2024-09-12T17:07:47.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.477+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~0JPBKIJA9RDB.2 size=594513 2024-09-12T17:07:47.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.479+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=0JPBKIJA9RDB tag=K9357YEIT7ZM type=write size=3740241 2024-09-12T17:07:47.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.481+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~W2X2Z9BKQR05.0 size=862611 2024-09-12T17:07:47.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.481+0000 7f9eaebff780 1 > prepared multipart upload key=OGD6H9VSVGWF upload=W2X2Z9BKQR05 tag=RDQ2TVZFYEHE type=write size=1911187 2024-09-12T17:07:47.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.482+0000 7f9eaebff780 1 < completed delete operation key=YIEP2JYDSLW0 tag=3ZR7BU61I36D type=del 2024-09-12T17:07:47.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.484+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=38J2JV3HREEQ type=del size=3533164 2024-09-12T17:07:47.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.485+0000 7f9eaebff780 1 < canceled operation key=TDZCNUZE8IOA tag=NO1DCRCNWZSL type=del size=1373346 2024-09-12T17:07:47.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.486+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=ZWA7PPEZLZU9 type=del size=4169864 2024-09-12T17:07:47.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.487+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~UVAUUINIEEE7.0 size=1048576 2024-09-12T17:07:47.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.488+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~UVAUUINIEEE7.1 size=998826 2024-09-12T17:07:47.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.490+0000 7f9eaebff780 1 < completed multipart upload key=0YD5P1ACZ09Q upload=UVAUUINIEEE7 tag=MJEWLU992TA1 type=write size=3095978 2024-09-12T17:07:47.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.491+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=91XMZW82AMQJ type=del size=728107 2024-09-12T17:07:47.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.493+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~G70R04CKWO0F.0 size=1048576 2024-09-12T17:07:47.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.494+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~G70R04CKWO0F.1 size=216752 2024-09-12T17:07:47.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.496+0000 7f9eaebff780 1 < completed multipart upload key=P9GMGM3WK6O7 upload=G70R04CKWO0F tag=TGBJ1H7O3NNH type=write size=2313904 2024-09-12T17:07:47.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.498+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~4W18L82BTKIP.0 size=191752 2024-09-12T17:07:47.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.498+0000 7f9eaebff780 1 > prepared multipart upload key=3LY681252WAN upload=4W18L82BTKIP tag=DIW9QFL33FOJ type=write size=1240328 2024-09-12T17:07:47.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.499+0000 7f9eaebff780 1 < completed delete operation key=3VY271ZBO754 tag=NGGKC8JYG220 type=del 2024-09-12T17:07:47.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.501+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~F60USVSET1NV.0 size=751135 2024-09-12T17:07:47.504 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.501+0000 7f9eaebff780 1 > prepared multipart upload key=LJN514F16XJA upload=F60USVSET1NV tag=1R5DMHRRCMA7 type=write size=1799711 2024-09-12T17:07:47.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.502+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=LYSQXDHTH3H5 type=del 2024-09-12T17:07:47.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.503+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=UQF8V7V4175K type=del size=2918609 2024-09-12T17:07:47.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.505+0000 7f9eaebff780 1 < completed delete operation key=TXHXOMIB4B53 tag=2JI9ST39F6W2 type=del 2024-09-12T17:07:47.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.507+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~KKFD8TVSUXGO.0 size=1048576 2024-09-12T17:07:47.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.508+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~KKFD8TVSUXGO.1 size=52503 2024-09-12T17:07:47.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.508+0000 7f9eaebff780 1 > prepared multipart upload key=3LY681252WAN upload=KKFD8TVSUXGO tag=U0H9HBE35616 type=write size=2149655 2024-09-12T17:07:47.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.510+0000 7f9eaebff780 1 < canceled operation key=LRI5G5G8O5X4 tag=TTAWWWQ2Z3RZ type=write size=824741 2024-09-12T17:07:47.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.511+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=20L64504K2V8 type=del size=2457793 2024-09-12T17:07:47.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.513+0000 7f9eaebff780 1 < completed delete operation key=ZYP3P4031PUZ tag=OEF363RI4QS0 type=del 2024-09-12T17:07:47.518 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.515+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~PI39JK24FE7K.0 size=1048576 2024-09-12T17:07:47.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.516+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~PI39JK24FE7K.1 size=518222 2024-09-12T17:07:47.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.516+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=PI39JK24FE7K tag=LHQ5CPWH1HM7 type=write size=2615374 2024-09-12T17:07:47.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.518+0000 7f9eaebff780 1 < completed delete operation key=SVWPQETL92QU tag=D3F0I4LX3CFE type=del 2024-09-12T17:07:47.523 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.521+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~H8RVF2F4XHXE.0 size=1048576 2024-09-12T17:07:47.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.522+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~H8RVF2F4XHXE.1 size=1048576 2024-09-12T17:07:47.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.523+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~H8RVF2F4XHXE.2 size=1008024 2024-09-12T17:07:47.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.523+0000 7f9eaebff780 1 > prepared multipart upload key=EKUW5AKC428U upload=H8RVF2F4XHXE tag=9DLK2QGVVVEQ type=write size=4153752 2024-09-12T17:07:47.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.524+0000 7f9eaebff780 1 < completed delete operation key=3VY271ZBO754 tag=ZH3SRTP60L2V type=del 2024-09-12T17:07:47.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.526+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=ATJSGZ6LYEFA type=del size=608485 2024-09-12T17:07:47.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.527+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~PNGLS3CGP0P8.0 size=1048576 2024-09-12T17:07:47.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.527+0000 7f9eaebff780 1 < canceled part key=_multipart_TDZCNUZE8IOA.2~PNGLS3CGP0P8.1 size=1048576 2024-09-12T17:07:47.531 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.529+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~PNGLS3CGP0P8.2 size=213854 2024-09-12T17:07:47.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.531+0000 7f9eaebff780 1 < canceled multipart upload key=TDZCNUZE8IOA upload=PNGLS3CGP0P8 tag=R5MB76HUK6LL type=write size=3359582 2024-09-12T17:07:47.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.533+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~7E5XO1V35ANC.0 size=1048576 2024-09-12T17:07:47.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.534+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~7E5XO1V35ANC.1 size=670535 2024-09-12T17:07:47.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.534+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=7E5XO1V35ANC tag=H53EPVJ10TJY type=write size=2767687 2024-09-12T17:07:47.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.535+0000 7f9eaebff780 1 < completed delete operation key=SO6QF2JCRX6E tag=Y1T5LOH11KI9 type=del 2024-09-12T17:07:47.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.536+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=JGWDVCBHTJ2G type=del size=3546257 2024-09-12T17:07:47.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.537+0000 7f9eaebff780 1 < completed delete operation key=P9GMGM3WK6O7 tag=MYQ31HEBNO8N type=del 2024-09-12T17:07:47.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.539+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~UKBY782FM8HV.0 size=1048576 2024-09-12T17:07:47.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.540+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~UKBY782FM8HV.1 size=1048576 2024-09-12T17:07:47.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.541+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~UKBY782FM8HV.2 size=552497 2024-09-12T17:07:47.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.541+0000 7f9eaebff780 1 > prepared multipart upload key=LJN514F16XJA upload=UKBY782FM8HV tag=6H9UIWMRCK6X type=write size=3698225 2024-09-12T17:07:47.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.544+0000 7f9eaebff780 1 < suggested remove operation key=OGD6H9VSVGWF tag=6BPYQHV4ODGR type=del 2024-09-12T17:07:47.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.545+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=V31I3ZF3L632 type=del size=3367441 2024-09-12T17:07:47.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.546+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~W2X2Z9BKQR05.0 size=862611 2024-09-12T17:07:47.550 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.548+0000 7f9eaebff780 1 < completed multipart upload key=OGD6H9VSVGWF upload=W2X2Z9BKQR05 tag=RDQ2TVZFYEHE type=write size=1911187 2024-09-12T17:07:47.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.549+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=QSLF4WPZ3GZ8 type=del size=824590 2024-09-12T17:07:47.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.550+0000 7f9eaebff780 1 < completed delete operation key=3VY271ZBO754 tag=38J2JV3HREEQ type=del 2024-09-12T17:07:47.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.551+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=5PAQWU909WBV type=del size=1695656 2024-09-12T17:07:47.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.553+0000 7f9eaebff780 1 < completed delete operation key=SVWPQETL92QU tag=ZWA7PPEZLZU9 type=del 2024-09-12T17:07:47.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.554+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=XQ4Q8GNV74OE type=del size=2057702 2024-09-12T17:07:47.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.555+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=91XMZW82AMQJ type=del 2024-09-12T17:07:47.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.557+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~3XMAHVGCYW74.0 size=1048576 2024-09-12T17:07:47.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.558+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~3XMAHVGCYW74.1 size=1021569 2024-09-12T17:07:47.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.558+0000 7f9eaebff780 1 > prepared multipart upload key=LJN514F16XJA upload=3XMAHVGCYW74 tag=CPSDWMHVI3PI type=write size=3118721 2024-09-12T17:07:47.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.560+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~4W18L82BTKIP.0 size=191752 2024-09-12T17:07:47.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.564+0000 7f9eaebff780 1 < completed multipart upload key=3LY681252WAN upload=4W18L82BTKIP tag=DIW9QFL33FOJ type=write size=1240328 2024-09-12T17:07:47.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.565+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=38XBL3DGILJO type=del size=3882120 2024-09-12T17:07:47.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.567+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~F60USVSET1NV.0 size=751135 2024-09-12T17:07:47.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.568+0000 7f9eaebff780 1 < completed multipart upload key=LJN514F16XJA upload=F60USVSET1NV tag=1R5DMHRRCMA7 type=write size=1799711 2024-09-12T17:07:47.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.570+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=3UUJ3826WP2X type=del size=3479093 2024-09-12T17:07:47.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.571+0000 7f9eaebff780 1 < completed delete operation key=ZYP3P4031PUZ tag=UQF8V7V4175K type=del 2024-09-12T17:07:47.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.572+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=HSMI145QLRSE type=del size=3808070 2024-09-12T17:07:47.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.574+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~KKFD8TVSUXGO.0 size=1048576 2024-09-12T17:07:47.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.574+0000 7f9eaebff780 1 < canceled part key=_multipart_3LY681252WAN.2~KKFD8TVSUXGO.1 size=52503 2024-09-12T17:07:47.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.576+0000 7f9eaebff780 1 < canceled multipart upload key=3LY681252WAN upload=KKFD8TVSUXGO tag=U0H9HBE35616 type=write size=2149655 2024-09-12T17:07:47.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.579+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=RQFGER8QLB35 type=del size=2181993 2024-09-12T17:07:47.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.580+0000 7f9eaebff780 1 < completed delete operation key=0F5LXJZMBFSP tag=20L64504K2V8 type=del 2024-09-12T17:07:47.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.582+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=SXZ3N1QFMR5J type=write size=118554 2024-09-12T17:07:47.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.583+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~PI39JK24FE7K.0 size=1048576 2024-09-12T17:07:47.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.584+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~PI39JK24FE7K.1 size=518222 2024-09-12T17:07:47.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.586+0000 7f9eaebff780 1 < completed multipart upload key=SHWT6AT7PN0M upload=PI39JK24FE7K tag=LHQ5CPWH1HM7 type=write size=2615374 2024-09-12T17:07:47.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.588+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~NB4QLLEZ68XD.0 size=1048576 2024-09-12T17:07:47.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.589+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~NB4QLLEZ68XD.1 size=1048576 2024-09-12T17:07:47.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.590+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~NB4QLLEZ68XD.2 size=745164 2024-09-12T17:07:47.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.590+0000 7f9eaebff780 1 > prepared multipart upload key=TDZCNUZE8IOA upload=NB4QLLEZ68XD tag=2PVNIIAKXYGS type=write size=3890892 2024-09-12T17:07:47.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.592+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~H8RVF2F4XHXE.0 size=1048576 2024-09-12T17:07:47.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.593+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~H8RVF2F4XHXE.1 size=1048576 2024-09-12T17:07:47.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.593+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~H8RVF2F4XHXE.2 size=1008024 2024-09-12T17:07:47.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.595+0000 7f9eaebff780 1 < completed multipart upload key=EKUW5AKC428U upload=H8RVF2F4XHXE tag=9DLK2QGVVVEQ type=write size=4153752 2024-09-12T17:07:47.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.598+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~0RNULIWG9AT1.0 size=990660 2024-09-12T17:07:47.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.598+0000 7f9eaebff780 1 > prepared multipart upload key=CAIZM33SDFPM upload=0RNULIWG9AT1 tag=GFZL988D6XYU type=write size=2039236 2024-09-12T17:07:47.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.599+0000 7f9eaebff780 1 < completed delete operation key=EKUW5AKC428U tag=ATJSGZ6LYEFA type=del 2024-09-12T17:07:47.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.600+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=LTSIA2ECHAMR type=del size=187114 2024-09-12T17:07:47.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.602+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~7E5XO1V35ANC.0 size=1048576 2024-09-12T17:07:47.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.602+0000 7f9eaebff780 1 < canceled part key=_multipart_UYF1AN2W59VN.2~7E5XO1V35ANC.1 size=670535 2024-09-12T17:07:47.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.604+0000 7f9eaebff780 1 < canceled multipart upload key=UYF1AN2W59VN upload=7E5XO1V35ANC tag=H53EPVJ10TJY type=write size=2767687 2024-09-12T17:07:47.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.605+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=Y8EJGOZQKASD type=del size=4494 2024-09-12T17:07:47.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.606+0000 7f9eaebff780 1 < completed delete operation key=QIMNK4DL3D0N tag=JGWDVCBHTJ2G type=del 2024-09-12T17:07:47.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.608+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=VHTJNK15VQW1 type=del size=3177597 2024-09-12T17:07:47.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.608+0000 7f9eaebff780 1 < canceled part key=_multipart_LJN514F16XJA.2~UKBY782FM8HV.0 size=1048576 2024-09-12T17:07:47.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.608+0000 7f9eaebff780 1 < canceled part key=_multipart_LJN514F16XJA.2~UKBY782FM8HV.1 size=1048576 2024-09-12T17:07:47.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.609+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~UKBY782FM8HV.2 size=552497 2024-09-12T17:07:47.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.611+0000 7f9eaebff780 1 < canceled multipart upload key=LJN514F16XJA upload=UKBY782FM8HV tag=6H9UIWMRCK6X type=write size=3698225 2024-09-12T17:07:47.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.613+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=N4V8FA516BWJ type=del size=3855749 2024-09-12T17:07:47.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.615+0000 7f9eaebff780 1 < suggested update operation key=A1KRCFY18QTP tag=V31I3ZF3L632 type=del size=3367441 2024-09-12T17:07:47.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.618+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~KI8MHULO6K2X.0 size=522683 2024-09-12T17:07:47.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.618+0000 7f9eaebff780 1 > prepared multipart upload key=QIMNK4DL3D0N upload=KI8MHULO6K2X tag=HKKO3K21ZDWJ type=write size=1571259 2024-09-12T17:07:47.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.619+0000 7f9eaebff780 1 < completed delete operation key=YIEP2JYDSLW0 tag=QSLF4WPZ3GZ8 type=del 2024-09-12T17:07:47.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.620+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=Z0VZ16DPJTKF type=del size=1381938 2024-09-12T17:07:47.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.621+0000 7f9eaebff780 1 < completed delete operation key=K2NHRSUDQBRW tag=5PAQWU909WBV type=del 2024-09-12T17:07:47.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.623+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=MTKVQ0M405JB type=del size=2207981 2024-09-12T17:07:47.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.624+0000 7f9eaebff780 1 < completed delete operation key=ZYP3P4031PUZ tag=XQ4Q8GNV74OE type=del 2024-09-12T17:07:47.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.626+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~UYL19CL2JOU8.0 size=1048576 2024-09-12T17:07:47.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.627+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~UYL19CL2JOU8.1 size=1048576 2024-09-12T17:07:47.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.628+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~UYL19CL2JOU8.2 size=1045742 2024-09-12T17:07:47.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.628+0000 7f9eaebff780 1 > prepared multipart upload key=YIEP2JYDSLW0 upload=UYL19CL2JOU8 tag=XB8JI168MB3U type=write size=4191470 2024-09-12T17:07:47.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.629+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~3XMAHVGCYW74.0 size=1048576 2024-09-12T17:07:47.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.630+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~3XMAHVGCYW74.1 size=1021569 2024-09-12T17:07:47.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.632+0000 7f9eaebff780 1 < completed multipart upload key=LJN514F16XJA upload=3XMAHVGCYW74 tag=CPSDWMHVI3PI type=write size=3118721 2024-09-12T17:07:47.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.634+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~U23TXETG1UR4.0 size=1048576 2024-09-12T17:07:47.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.635+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~U23TXETG1UR4.1 size=259213 2024-09-12T17:07:47.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.635+0000 7f9eaebff780 1 > prepared multipart upload key=KF8XE48DI9KZ upload=U23TXETG1UR4 tag=YERIL6LAQQTU type=write size=2356365 2024-09-12T17:07:47.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.637+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=38XBL3DGILJO type=del 2024-09-12T17:07:47.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.639+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~0PE1PKUW55T0.0 size=1048576 2024-09-12T17:07:47.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.640+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~0PE1PKUW55T0.1 size=713340 2024-09-12T17:07:47.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.640+0000 7f9eaebff780 1 > prepared multipart upload key=3LY681252WAN upload=0PE1PKUW55T0 tag=L10S4ZERME2X type=write size=2810492 2024-09-12T17:07:47.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.641+0000 7f9eaebff780 1 < completed delete operation key=9I6RGNRB6HSY tag=3UUJ3826WP2X type=del 2024-09-12T17:07:47.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.642+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=52VASWH3CUK0 type=del size=1392994 2024-09-12T17:07:47.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.643+0000 7f9eaebff780 -1 < failed to complete operation key=A1KRCFY18QTP tag=HSMI145QLRSE type=del size=3808070: (22) Invalid argument 2024-09-12T17:07:47.647 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.644+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=27Y7VIFGM2KU type=del size=2887664 2024-09-12T17:07:47.648 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.646+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=RQFGER8QLB35 type=del 2024-09-12T17:07:47.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.647+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=S3GDV60QRVNV type=del size=1796126 2024-09-12T17:07:47.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.649+0000 7f9eaebff780 1 < suggested update operation key=SO6QF2JCRX6E tag=SXZ3N1QFMR5J type=write size=118554 2024-09-12T17:07:47.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.650+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=PHXI8M5ZLAOO type=del size=3282694 2024-09-12T17:07:47.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.652+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~NB4QLLEZ68XD.0 size=1048576 2024-09-12T17:07:47.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.652+0000 7f9eaebff780 1 < canceled part key=_multipart_TDZCNUZE8IOA.2~NB4QLLEZ68XD.1 size=1048576 2024-09-12T17:07:47.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.653+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~NB4QLLEZ68XD.2 size=745164 2024-09-12T17:07:47.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.655+0000 7f9eaebff780 1 < canceled multipart upload key=TDZCNUZE8IOA upload=NB4QLLEZ68XD tag=2PVNIIAKXYGS type=write size=3890892 2024-09-12T17:07:47.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.656+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=YNZY0ZUJ1242 type=del size=2716153 2024-09-12T17:07:47.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.658+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~0RNULIWG9AT1.0 size=990660 2024-09-12T17:07:47.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.660+0000 7f9eaebff780 1 < completed multipart upload key=CAIZM33SDFPM upload=0RNULIWG9AT1 tag=GFZL988D6XYU type=write size=2039236 2024-09-12T17:07:47.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.661+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=VVJPBYYVCR6Q type=del size=2024449 2024-09-12T17:07:47.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.662+0000 7f9eaebff780 1 < completed delete operation key=ZC814TPVLJO1 tag=LTSIA2ECHAMR type=del 2024-09-12T17:07:47.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.663+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=IULE2N5VGX6O type=write size=189399 2024-09-12T17:07:47.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.665+0000 7f9eaebff780 1 < completed delete operation key=K0P9ZZ91UJJ8 tag=Y8EJGOZQKASD type=del 2024-09-12T17:07:47.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.666+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=8OOCD4722T60 type=del size=3960035 2024-09-12T17:07:47.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.670+0000 7f9eaebff780 1 < suggested remove operation key=9I6RGNRB6HSY tag=VHTJNK15VQW1 type=del 2024-09-12T17:07:47.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.671+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=W5QX0TT7Z7OE type=del size=1526369 2024-09-12T17:07:47.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.673+0000 7f9eaebff780 1 < completed delete operation key=ZYP3P4031PUZ tag=N4V8FA516BWJ type=del 2024-09-12T17:07:47.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.674+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=VI9INKO8GNAM type=del size=246355 2024-09-12T17:07:47.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.676+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~KI8MHULO6K2X.0 size=522683 2024-09-12T17:07:47.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.678+0000 7f9eaebff780 1 < completed multipart upload key=QIMNK4DL3D0N upload=KI8MHULO6K2X tag=HKKO3K21ZDWJ type=write size=1571259 2024-09-12T17:07:47.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.680+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~7OB31BG4VXM7.0 size=1048576 2024-09-12T17:07:47.683 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.681+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~7OB31BG4VXM7.1 size=402043 2024-09-12T17:07:47.683 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.681+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=7OB31BG4VXM7 tag=4VAJBFKX9BB1 type=write size=2499195 2024-09-12T17:07:47.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.682+0000 7f9eaebff780 1 < completed delete operation key=3VY271ZBO754 tag=Z0VZ16DPJTKF type=del 2024-09-12T17:07:47.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.684+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~KHWE853CSZYK.0 size=128251 2024-09-12T17:07:47.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.684+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=KHWE853CSZYK tag=KE0ASYVS0TDO type=write size=1176827 2024-09-12T17:07:47.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.685+0000 7f9eaebff780 1 < completed delete operation key=EKUW5AKC428U tag=MTKVQ0M405JB type=del 2024-09-12T17:07:47.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.687+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=4NXS3MEI9CON type=del size=836673 2024-09-12T17:07:47.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.687+0000 7f9eaebff780 1 < canceled part key=_multipart_YIEP2JYDSLW0.2~UYL19CL2JOU8.0 size=1048576 2024-09-12T17:07:47.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.688+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~UYL19CL2JOU8.1 size=1048576 2024-09-12T17:07:47.692 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.689+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~UYL19CL2JOU8.2 size=1045742 2024-09-12T17:07:47.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.691+0000 7f9eaebff780 1 < canceled multipart upload key=YIEP2JYDSLW0 upload=UYL19CL2JOU8 tag=XB8JI168MB3U type=write size=4191470 2024-09-12T17:07:47.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.693+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=Y5SSL6KU70DH type=del size=389018 2024-09-12T17:07:47.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.694+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~U23TXETG1UR4.0 size=1048576 2024-09-12T17:07:47.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.696+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~U23TXETG1UR4.1 size=259213 2024-09-12T17:07:47.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.699+0000 7f9eaebff780 1 < completed multipart upload key=KF8XE48DI9KZ upload=U23TXETG1UR4 tag=YERIL6LAQQTU type=write size=2356365 2024-09-12T17:07:47.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.700+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=NYSQXWCZJSDW type=del size=3461427 2024-09-12T17:07:47.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.701+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~0PE1PKUW55T0.0 size=1048576 2024-09-12T17:07:47.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.702+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~0PE1PKUW55T0.1 size=713340 2024-09-12T17:07:47.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.704+0000 7f9eaebff780 1 < completed multipart upload key=3LY681252WAN upload=0PE1PKUW55T0 tag=L10S4ZERME2X type=write size=2810492 2024-09-12T17:07:47.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.706+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~4LGXDWOQMQEC.0 size=1048576 2024-09-12T17:07:47.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.707+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~4LGXDWOQMQEC.1 size=1048576 2024-09-12T17:07:47.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.708+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~4LGXDWOQMQEC.2 size=604323 2024-09-12T17:07:47.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.708+0000 7f9eaebff780 1 > prepared multipart upload key=9I6RGNRB6HSY upload=4LGXDWOQMQEC tag=KN3DG2W560GY type=write size=3750051 2024-09-12T17:07:47.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.710+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=52VASWH3CUK0 type=del 2024-09-12T17:07:47.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.711+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=GB7I1BXB72XN type=del size=2617500 2024-09-12T17:07:47.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.712+0000 7f9eaebff780 1 < canceled operation key=0YD5P1ACZ09Q tag=27Y7VIFGM2KU type=del size=2887664 2024-09-12T17:07:47.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.714+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=RY3Y6DEVU4CU type=del size=2881498 2024-09-12T17:07:47.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.715+0000 7f9eaebff780 1 < completed delete operation key=TXHXOMIB4B53 tag=S3GDV60QRVNV type=del 2024-09-12T17:07:47.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.716+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=T89WQD64DEVK type=write size=305611 2024-09-12T17:07:47.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.719+0000 7f9eaebff780 1 < suggested remove operation key=8DJLYFM11DNI tag=PHXI8M5ZLAOO type=del 2024-09-12T17:07:47.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.721+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=KYW5SRJ34LR5 type=del size=417456 2024-09-12T17:07:47.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.722+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=YNZY0ZUJ1242 type=del 2024-09-12T17:07:47.726 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.723+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=7SLO7NUGDSIU type=del size=2012624 2024-09-12T17:07:47.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.725+0000 7f9eaebff780 1 < canceled operation key=SVWPQETL92QU tag=VVJPBYYVCR6Q type=del size=2024449 2024-09-12T17:07:47.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.726+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=TGRK3L40CT10 type=del size=1669084 2024-09-12T17:07:47.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.728+0000 7f9eaebff780 1 < suggested update operation key=B1YC6DM9S8JJ tag=IULE2N5VGX6O type=write size=189399 2024-09-12T17:07:47.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.730+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~A8KVK1CQX5VJ.0 size=1048576 2024-09-12T17:07:47.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.731+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~A8KVK1CQX5VJ.1 size=227113 2024-09-12T17:07:47.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.731+0000 7f9eaebff780 1 > prepared multipart upload key=SO6QF2JCRX6E upload=A8KVK1CQX5VJ tag=JJJW0TM6MAQ1 type=write size=2324265 2024-09-12T17:07:47.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.732+0000 7f9eaebff780 1 < completed delete operation key=YIEP2JYDSLW0 tag=8OOCD4722T60 type=del 2024-09-12T17:07:47.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.734+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=RNC8V0LHUINF type=del size=1542671 2024-09-12T17:07:47.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.735+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=W5QX0TT7Z7OE type=del 2024-09-12T17:07:47.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.736+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=HPNUOG2NJ4B8 type=del size=2130180 2024-09-12T17:07:47.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.739+0000 7f9eaebff780 1 < suggested update operation key=EKUW5AKC428U tag=VI9INKO8GNAM type=del size=246355 2024-09-12T17:07:47.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.740+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=4U76OG0YZZPB type=del size=2934033 2024-09-12T17:07:47.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.740+0000 7f9eaebff780 1 < canceled part key=_multipart_SHWT6AT7PN0M.2~7OB31BG4VXM7.0 size=1048576 2024-09-12T17:07:47.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.740+0000 7f9eaebff780 1 < canceled part key=_multipart_SHWT6AT7PN0M.2~7OB31BG4VXM7.1 size=402043 2024-09-12T17:07:47.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.742+0000 7f9eaebff780 1 < canceled multipart upload key=SHWT6AT7PN0M upload=7OB31BG4VXM7 tag=4VAJBFKX9BB1 type=write size=2499195 2024-09-12T17:07:47.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.744+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=0BISRSYMZU5T type=del size=1999126 2024-09-12T17:07:47.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.744+0000 7f9eaebff780 1 < canceled part key=_multipart_K2NHRSUDQBRW.2~KHWE853CSZYK.0 size=128251 2024-09-12T17:07:47.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.746+0000 7f9eaebff780 1 < canceled multipart upload key=K2NHRSUDQBRW upload=KHWE853CSZYK tag=KE0ASYVS0TDO type=write size=1176827 2024-09-12T17:07:47.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.747+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=AGDS5WTPJUJX type=del size=373790 2024-09-12T17:07:47.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.748+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=4NXS3MEI9CON type=del 2024-09-12T17:07:47.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.750+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=27ODLJRXZSL8 type=write size=5041 2024-09-12T17:07:47.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.752+0000 7f9eaebff780 1 < suggested update operation key=7PBT9VZ07OUI tag=Y5SSL6KU70DH type=del size=389018 2024-09-12T17:07:47.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.754+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~RO93X3HDSY51.0 size=886210 2024-09-12T17:07:47.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.754+0000 7f9eaebff780 1 > prepared multipart upload key=YIEP2JYDSLW0 upload=RO93X3HDSY51 tag=T1BT8IMRW7HY type=write size=1934786 2024-09-12T17:07:47.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.756+0000 7f9eaebff780 1 < completed delete operation key=0YD5P1ACZ09Q tag=NYSQXWCZJSDW type=del 2024-09-12T17:07:47.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.758+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~X2G6VOCFEX9B.0 size=1048576 2024-09-12T17:07:47.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.759+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~X2G6VOCFEX9B.1 size=1048576 2024-09-12T17:07:47.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.760+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~X2G6VOCFEX9B.2 size=362587 2024-09-12T17:07:47.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.760+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=X2G6VOCFEX9B tag=TUYAIDHFNID3 type=write size=3508315 2024-09-12T17:07:47.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.762+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~4LGXDWOQMQEC.0 size=1048576 2024-09-12T17:07:47.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.763+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~4LGXDWOQMQEC.1 size=1048576 2024-09-12T17:07:47.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.764+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~4LGXDWOQMQEC.2 size=604323 2024-09-12T17:07:47.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.766+0000 7f9eaebff780 1 < completed multipart upload key=9I6RGNRB6HSY upload=4LGXDWOQMQEC tag=KN3DG2W560GY type=write size=3750051 2024-09-12T17:07:47.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.767+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=L8R7L6TA75JJ type=del size=1887128 2024-09-12T17:07:47.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.770+0000 7f9eaebff780 1 < suggested update operation key=LRI5G5G8O5X4 tag=GB7I1BXB72XN type=del size=2617500 2024-09-12T17:07:47.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.771+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=5YU4NFIGT9E2 type=del size=3307905 2024-09-12T17:07:47.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.773+0000 7f9eaebff780 1 < suggested remove operation key=0YD5P1ACZ09Q tag=RY3Y6DEVU4CU type=del 2024-09-12T17:07:47.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.774+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=HK43JBOCZ8DE type=write size=67052 2024-09-12T17:07:47.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.777+0000 7f9eaebff780 1 < suggested update operation key=TDZCNUZE8IOA tag=T89WQD64DEVK type=write size=305611 2024-09-12T17:07:47.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.778+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=20361KYSI7UF type=del size=3968925 2024-09-12T17:07:47.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.779+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=KYW5SRJ34LR5 type=del 2024-09-12T17:07:47.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.782+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~I2F6PNKL08F2.0 size=411536 2024-09-12T17:07:47.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.782+0000 7f9eaebff780 1 > prepared multipart upload key=ZYP3P4031PUZ upload=I2F6PNKL08F2 tag=LQL59R0ZOYNS type=write size=1460112 2024-09-12T17:07:47.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.783+0000 7f9eaebff780 1 < completed delete operation key=SO6QF2JCRX6E tag=7SLO7NUGDSIU type=del 2024-09-12T17:07:47.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.785+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~UFZNC210Y66Q.0 size=1048576 2024-09-12T17:07:47.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.786+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~UFZNC210Y66Q.1 size=802347 2024-09-12T17:07:47.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.786+0000 7f9eaebff780 1 > prepared multipart upload key=0YD5P1ACZ09Q upload=UFZNC210Y66Q tag=9DEXJIBEU5L7 type=write size=2899499 2024-09-12T17:07:47.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.787+0000 7f9eaebff780 1 < completed delete operation key=OH6GXTMPBYUY tag=TGRK3L40CT10 type=del 2024-09-12T17:07:47.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.788+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=JPCGIFZ74TE9 type=del size=544973 2024-09-12T17:07:47.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.790+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~A8KVK1CQX5VJ.0 size=1048576 2024-09-12T17:07:47.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.791+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~A8KVK1CQX5VJ.1 size=227113 2024-09-12T17:07:47.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.793+0000 7f9eaebff780 1 < completed multipart upload key=SO6QF2JCRX6E upload=A8KVK1CQX5VJ tag=JJJW0TM6MAQ1 type=write size=2324265 2024-09-12T17:07:47.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.794+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=B4ZRRVM2ZA9B type=del size=3888565 2024-09-12T17:07:47.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.795+0000 7f9eaebff780 1 < completed delete operation key=LJN514F16XJA tag=RNC8V0LHUINF type=del 2024-09-12T17:07:47.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.796+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=DCDDPWYHOPPV type=del size=722283 2024-09-12T17:07:47.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.798+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=HPNUOG2NJ4B8 type=del 2024-09-12T17:07:47.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.800+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~1L4YLG3V5VZ7.0 size=1048576 2024-09-12T17:07:47.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.801+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~1L4YLG3V5VZ7.1 size=742352 2024-09-12T17:07:47.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.801+0000 7f9eaebff780 1 > prepared multipart upload key=0YD5P1ACZ09Q upload=1L4YLG3V5VZ7 tag=HE3SGJNPFNN5 type=write size=2839504 2024-09-12T17:07:47.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.802+0000 7f9eaebff780 -1 < failed to complete operation key=TDZCNUZE8IOA tag=4U76OG0YZZPB type=del size=2934033: (22) Invalid argument 2024-09-12T17:07:47.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.804+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~73YJOIB0A2Z3.0 size=1048576 2024-09-12T17:07:47.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.805+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~73YJOIB0A2Z3.1 size=795691 2024-09-12T17:07:47.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.805+0000 7f9eaebff780 1 > prepared multipart upload key=0F5LXJZMBFSP upload=73YJOIB0A2Z3 tag=E314TZFY60YY type=write size=2892843 2024-09-12T17:07:47.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.808+0000 7f9eaebff780 1 < suggested remove operation key=QIMNK4DL3D0N tag=0BISRSYMZU5T type=del 2024-09-12T17:07:47.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.810+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~IQ9EGVCTMMCF.0 size=597760 2024-09-12T17:07:47.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.810+0000 7f9eaebff780 1 > prepared multipart upload key=SO6QF2JCRX6E upload=IQ9EGVCTMMCF tag=V9WY81EOUB4E type=write size=1646336 2024-09-12T17:07:47.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.812+0000 7f9eaebff780 1 < suggested update operation key=K2NHRSUDQBRW tag=AGDS5WTPJUJX type=del size=373790 2024-09-12T17:07:47.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.814+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~4X0IMW6R0PVD.0 size=205472 2024-09-12T17:07:47.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.814+0000 7f9eaebff780 1 > prepared multipart upload key=0F5LXJZMBFSP upload=4X0IMW6R0PVD tag=O11AT41JN2WW type=write size=1254048 2024-09-12T17:07:47.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.817+0000 7f9eaebff780 1 < suggested remove operation key=UYF1AN2W59VN tag=27ODLJRXZSL8 type=write 2024-09-12T17:07:47.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.819+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~39HP9A0VL9LQ.0 size=1048576 2024-09-12T17:07:47.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.820+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~39HP9A0VL9LQ.1 size=17391 2024-09-12T17:07:47.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.820+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=39HP9A0VL9LQ tag=X3DN4G2OCE4D type=write size=2114543 2024-09-12T17:07:47.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.821+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~RO93X3HDSY51.0 size=886210 2024-09-12T17:07:47.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.823+0000 7f9eaebff780 1 < completed multipart upload key=YIEP2JYDSLW0 upload=RO93X3HDSY51 tag=T1BT8IMRW7HY type=write size=1934786 2024-09-12T17:07:47.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.825+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=ONXGB0WJ23XH type=write size=943276 2024-09-12T17:07:47.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.826+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~X2G6VOCFEX9B.0 size=1048576 2024-09-12T17:07:47.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.826+0000 7f9eaebff780 1 < canceled part key=_multipart_K2NHRSUDQBRW.2~X2G6VOCFEX9B.1 size=1048576 2024-09-12T17:07:47.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.827+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~X2G6VOCFEX9B.2 size=362587 2024-09-12T17:07:47.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.829+0000 7f9eaebff780 1 < canceled multipart upload key=K2NHRSUDQBRW upload=X2G6VOCFEX9B tag=TUYAIDHFNID3 type=write size=3508315 2024-09-12T17:07:47.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.831+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~4L1PCUXGZEXP.0 size=515586 2024-09-12T17:07:47.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.831+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=4L1PCUXGZEXP tag=IPFXJY8KZ5YY type=write size=1564162 2024-09-12T17:07:47.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.832+0000 7f9eaebff780 1 < completed delete operation key=SHWT6AT7PN0M tag=L8R7L6TA75JJ type=del 2024-09-12T17:07:47.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.834+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=WR5UJ3LUE1TW type=del size=2784150 2024-09-12T17:07:47.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.835+0000 7f9eaebff780 1 < completed delete operation key=TXHXOMIB4B53 tag=5YU4NFIGT9E2 type=del 2024-09-12T17:07:47.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.836+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=WNHCZ2OIFAFF type=del size=2166075 2024-09-12T17:07:47.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.837+0000 7f9eaebff780 1 < completed write operation key=0YD5P1ACZ09Q tag=HK43JBOCZ8DE type=write size=67052 2024-09-12T17:07:47.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.840+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~46N18PZJDTOI.0 size=1048576 2024-09-12T17:07:47.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.841+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~46N18PZJDTOI.1 size=799546 2024-09-12T17:07:47.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.841+0000 7f9eaebff780 1 > prepared multipart upload key=QIMNK4DL3D0N upload=46N18PZJDTOI tag=C9VEHDB36PD0 type=write size=2896698 2024-09-12T17:07:47.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.842+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=20361KYSI7UF type=del 2024-09-12T17:07:47.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.843+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=Y2017FMVTTS8 type=del size=1334325 2024-09-12T17:07:47.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.844+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~I2F6PNKL08F2.0 size=411536 2024-09-12T17:07:47.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.846+0000 7f9eaebff780 1 < completed multipart upload key=ZYP3P4031PUZ upload=I2F6PNKL08F2 tag=LQL59R0ZOYNS type=write size=1460112 2024-09-12T17:07:47.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.849+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~4ACQ836VM3IQ.0 size=481909 2024-09-12T17:07:47.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.849+0000 7f9eaebff780 1 > prepared multipart upload key=CAIZM33SDFPM upload=4ACQ836VM3IQ tag=ADT2WCDYF6CC type=write size=1530485 2024-09-12T17:07:47.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.850+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~UFZNC210Y66Q.0 size=1048576 2024-09-12T17:07:47.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.851+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~UFZNC210Y66Q.1 size=802347 2024-09-12T17:07:47.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.853+0000 7f9eaebff780 1 < completed multipart upload key=0YD5P1ACZ09Q upload=UFZNC210Y66Q tag=9DEXJIBEU5L7 type=write size=2899499 2024-09-12T17:07:47.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.854+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=SJ7W4RHJOGLT type=del size=2364635 2024-09-12T17:07:47.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.855+0000 7f9eaebff780 1 < completed delete operation key=YIEP2JYDSLW0 tag=JPCGIFZ74TE9 type=del 2024-09-12T17:07:47.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.856+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=UZKT6S6OWLS6 type=del size=1191841 2024-09-12T17:07:47.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.858+0000 7f9eaebff780 1 < completed delete operation key=ZC814TPVLJO1 tag=B4ZRRVM2ZA9B type=del 2024-09-12T17:07:47.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.859+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=8MLEWA0Q44UD type=del size=1377303 2024-09-12T17:07:47.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.861+0000 7f9eaebff780 1 < suggested remove operation key=K2NHRSUDQBRW tag=DCDDPWYHOPPV type=del 2024-09-12T17:07:47.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.862+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=U426SKC5P0YK type=del size=2729327 2024-09-12T17:07:47.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.864+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~1L4YLG3V5VZ7.0 size=1048576 2024-09-12T17:07:47.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.865+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~1L4YLG3V5VZ7.1 size=742352 2024-09-12T17:07:47.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.867+0000 7f9eaebff780 1 < completed multipart upload key=0YD5P1ACZ09Q upload=1L4YLG3V5VZ7 tag=HE3SGJNPFNN5 type=write size=2839504 2024-09-12T17:07:47.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.869+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~YX4QE5OGY0YJ.0 size=800808 2024-09-12T17:07:47.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.869+0000 7f9eaebff780 1 > prepared multipart upload key=QIMNK4DL3D0N upload=YX4QE5OGY0YJ tag=FMLET12E28VA type=write size=1849384 2024-09-12T17:07:47.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.870+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~73YJOIB0A2Z3.0 size=1048576 2024-09-12T17:07:47.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.871+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~73YJOIB0A2Z3.1 size=795691 2024-09-12T17:07:47.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.873+0000 7f9eaebff780 1 < completed multipart upload key=0F5LXJZMBFSP upload=73YJOIB0A2Z3 tag=E314TZFY60YY type=write size=2892843 2024-09-12T17:07:47.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.875+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=HEL73XLZS6R4 type=del size=4025420 2024-09-12T17:07:47.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.876+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~IQ9EGVCTMMCF.0 size=597760 2024-09-12T17:07:47.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.878+0000 7f9eaebff780 1 < completed multipart upload key=SO6QF2JCRX6E upload=IQ9EGVCTMMCF tag=V9WY81EOUB4E type=write size=1646336 2024-09-12T17:07:47.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.879+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=5LLF912E1JF4 type=del size=3466495 2024-09-12T17:07:47.884 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.880+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~4X0IMW6R0PVD.0 size=205472 2024-09-12T17:07:47.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.882+0000 7f9eaebff780 1 < completed multipart upload key=0F5LXJZMBFSP upload=4X0IMW6R0PVD tag=O11AT41JN2WW type=write size=1254048 2024-09-12T17:07:47.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.884+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=37LNEPXEUJJ3 type=write size=177181 2024-09-12T17:07:47.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.885+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~39HP9A0VL9LQ.0 size=1048576 2024-09-12T17:07:47.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.886+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~39HP9A0VL9LQ.1 size=17391 2024-09-12T17:07:47.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.888+0000 7f9eaebff780 1 < completed multipart upload key=M3PLQGSK34YM upload=39HP9A0VL9LQ tag=X3DN4G2OCE4D type=write size=2114543 2024-09-12T17:07:47.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.891+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~LTU3RQ1FJ2L9.0 size=1048576 2024-09-12T17:07:47.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.892+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~LTU3RQ1FJ2L9.1 size=1048576 2024-09-12T17:07:47.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.893+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~LTU3RQ1FJ2L9.2 size=1022652 2024-09-12T17:07:47.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.893+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=LTU3RQ1FJ2L9 tag=MJ289SABP52X type=write size=4168380 2024-09-12T17:07:47.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.894+0000 7f9eaebff780 1 < completed write operation key=0F5LXJZMBFSP tag=ONXGB0WJ23XH type=write size=943276 2024-09-12T17:07:47.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.895+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=TXVATW2DFZMT type=del size=2945037 2024-09-12T17:07:47.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.896+0000 7f9eaebff780 1 < canceled part key=_multipart_UYF1AN2W59VN.2~4L1PCUXGZEXP.0 size=515586 2024-09-12T17:07:47.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.897+0000 7f9eaebff780 1 < canceled multipart upload key=UYF1AN2W59VN upload=4L1PCUXGZEXP tag=IPFXJY8KZ5YY type=write size=1564162 2024-09-12T17:07:47.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.899+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=V2BQ1Z60NFEW type=del size=3670787 2024-09-12T17:07:47.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.900+0000 7f9eaebff780 1 < completed delete operation key=3VY271ZBO754 tag=WR5UJ3LUE1TW type=del 2024-09-12T17:07:47.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.901+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=GBJA1HWH9WC7 type=del size=3640303 2024-09-12T17:07:47.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.902+0000 7f9eaebff780 1 < completed delete operation key=SVWPQETL92QU tag=WNHCZ2OIFAFF type=del 2024-09-12T17:07:47.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.904+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=ZTABS5IIZI8O type=del size=2056731 2024-09-12T17:07:47.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.905+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~46N18PZJDTOI.0 size=1048576 2024-09-12T17:07:47.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.906+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~46N18PZJDTOI.1 size=799546 2024-09-12T17:07:47.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.910+0000 7f9eaebff780 1 < completed multipart upload key=QIMNK4DL3D0N upload=46N18PZJDTOI tag=C9VEHDB36PD0 type=write size=2896698 2024-09-12T17:07:47.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.913+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~UHQETKBZ8VFH.0 size=1048576 2024-09-12T17:07:47.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.914+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~UHQETKBZ8VFH.1 size=1048576 2024-09-12T17:07:47.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.915+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~UHQETKBZ8VFH.2 size=182113 2024-09-12T17:07:47.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.915+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=UHQETKBZ8VFH tag=UWCXZZVXP4F0 type=write size=3327841 2024-09-12T17:07:47.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.916+0000 7f9eaebff780 1 < completed delete operation key=7PBT9VZ07OUI tag=Y2017FMVTTS8 type=del 2024-09-12T17:07:47.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.918+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~UEHHHBGII9CB.0 size=1048576 2024-09-12T17:07:47.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.919+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~UEHHHBGII9CB.1 size=907570 2024-09-12T17:07:47.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.919+0000 7f9eaebff780 1 > prepared multipart upload key=CAIZM33SDFPM upload=UEHHHBGII9CB tag=JV88T8DULELN type=write size=3004722 2024-09-12T17:07:47.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.920+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~4ACQ836VM3IQ.0 size=481909 2024-09-12T17:07:47.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.922+0000 7f9eaebff780 1 < completed multipart upload key=CAIZM33SDFPM upload=4ACQ836VM3IQ tag=ADT2WCDYF6CC type=write size=1530485 2024-09-12T17:07:47.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.925+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~BWK9S4WMVGEP.0 size=1048576 2024-09-12T17:07:47.928 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.926+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~BWK9S4WMVGEP.1 size=1048576 2024-09-12T17:07:47.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.927+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~BWK9S4WMVGEP.2 size=794613 2024-09-12T17:07:47.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.927+0000 7f9eaebff780 1 > prepared multipart upload key=YIEP2JYDSLW0 upload=BWK9S4WMVGEP tag=CHSNFB4MKA4T type=write size=3940341 2024-09-12T17:07:47.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.928+0000 7f9eaebff780 1 < completed delete operation key=3VY271ZBO754 tag=SJ7W4RHJOGLT type=del 2024-09-12T17:07:47.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.929+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=EVDXBSJB0MZK type=del size=1294974 2024-09-12T17:07:47.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.930+0000 7f9eaebff780 1 < completed delete operation key=SHWT6AT7PN0M tag=UZKT6S6OWLS6 type=del 2024-09-12T17:07:47.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.934+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~0MX022BXJBL0.0 size=1048576 2024-09-12T17:07:47.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.934+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~0MX022BXJBL0.1 size=959264 2024-09-12T17:07:47.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.934+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=0MX022BXJBL0 tag=N49G2OA4ZJAL type=write size=3056416 2024-09-12T17:07:47.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.936+0000 7f9eaebff780 1 < completed delete operation key=UYF1AN2W59VN tag=8MLEWA0Q44UD type=del 2024-09-12T17:07:47.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.937+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=K680IZ3YG27Q type=del size=2663674 2024-09-12T17:07:47.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.938+0000 7f9eaebff780 1 < completed delete operation key=GB8P7K59Y8VI tag=U426SKC5P0YK type=del 2024-09-12T17:07:47.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.940+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=RH3JFUTSC3WK type=del size=912484 2024-09-12T17:07:47.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.942+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~YX4QE5OGY0YJ.0 size=800808 2024-09-12T17:07:47.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.944+0000 7f9eaebff780 1 < completed multipart upload key=QIMNK4DL3D0N upload=YX4QE5OGY0YJ tag=FMLET12E28VA type=write size=1849384 2024-09-12T17:07:47.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.945+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=A5Y3RW19TVDX type=write size=878911 2024-09-12T17:07:47.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.946+0000 7f9eaebff780 1 < canceled operation key=K0P9ZZ91UJJ8 tag=HEL73XLZS6R4 type=del size=4025420 2024-09-12T17:07:47.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.948+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~E8PPS5GWORHM.0 size=931781 2024-09-12T17:07:47.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.948+0000 7f9eaebff780 1 > prepared multipart upload key=OGD6H9VSVGWF upload=E8PPS5GWORHM tag=XN32G4AAPW6V type=write size=1980357 2024-09-12T17:07:47.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.950+0000 7f9eaebff780 1 < completed delete operation key=SO6QF2JCRX6E tag=5LLF912E1JF4 type=del 2024-09-12T17:07:47.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.951+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=U0WZLGE5PTOZ type=del size=1378965 2024-09-12T17:07:47.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.953+0000 7f9eaebff780 1 < completed write operation key=0YD5P1ACZ09Q tag=37LNEPXEUJJ3 type=write size=177181 2024-09-12T17:07:47.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.954+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=8T7M0KEPQ44Z type=del size=2673361 2024-09-12T17:07:47.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.956+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~LTU3RQ1FJ2L9.0 size=1048576 2024-09-12T17:07:47.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.957+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~LTU3RQ1FJ2L9.1 size=1048576 2024-09-12T17:07:47.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.958+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~LTU3RQ1FJ2L9.2 size=1022652 2024-09-12T17:07:47.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.960+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=LTU3RQ1FJ2L9 tag=MJ289SABP52X type=write size=4168380 2024-09-12T17:07:47.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.961+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=NUSJ4LKSSRZZ type=write size=74167 2024-09-12T17:07:47.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.962+0000 7f9eaebff780 1 < completed delete operation key=UYF1AN2W59VN tag=TXVATW2DFZMT type=del 2024-09-12T17:07:47.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.965+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~0HJXPE2ZXANT.0 size=1048576 2024-09-12T17:07:47.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.966+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~0HJXPE2ZXANT.1 size=261520 2024-09-12T17:07:47.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.966+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=0HJXPE2ZXANT tag=Q6ZTTMR0EM7X type=write size=2358672 2024-09-12T17:07:47.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.967+0000 7f9eaebff780 1 < completed delete operation key=ZYP3P4031PUZ tag=V2BQ1Z60NFEW type=del 2024-09-12T17:07:47.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.968+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=FI7A0Q7HX2LD type=del size=986162 2024-09-12T17:07:47.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.969+0000 7f9eaebff780 1 < completed delete operation key=ZC814TPVLJO1 tag=GBJA1HWH9WC7 type=del 2024-09-12T17:07:47.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.970+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=Q490ISBHMRYU type=del size=3722052 2024-09-12T17:07:47.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.972+0000 7f9eaebff780 1 < completed delete operation key=ZYP3P4031PUZ tag=ZTABS5IIZI8O type=del 2024-09-12T17:07:47.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.973+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=664XSNWA0PWC type=write size=989113 2024-09-12T17:07:47.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.974+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~UHQETKBZ8VFH.0 size=1048576 2024-09-12T17:07:47.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.975+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~UHQETKBZ8VFH.1 size=1048576 2024-09-12T17:07:47.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.976+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~UHQETKBZ8VFH.2 size=182113 2024-09-12T17:07:47.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.978+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=UHQETKBZ8VFH tag=UWCXZZVXP4F0 type=write size=3327841 2024-09-12T17:07:47.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.980+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=RP79XGHEF6XD type=del size=2163037 2024-09-12T17:07:47.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.981+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~UEHHHBGII9CB.0 size=1048576 2024-09-12T17:07:47.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.982+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~UEHHHBGII9CB.1 size=907570 2024-09-12T17:07:47.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.984+0000 7f9eaebff780 1 < completed multipart upload key=CAIZM33SDFPM upload=UEHHHBGII9CB tag=JV88T8DULELN type=write size=3004722 2024-09-12T17:07:47.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.985+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=O12534CIYQFD type=del size=2106450 2024-09-12T17:07:47.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.987+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~BWK9S4WMVGEP.0 size=1048576 2024-09-12T17:07:47.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.988+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~BWK9S4WMVGEP.1 size=1048576 2024-09-12T17:07:47.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.989+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~BWK9S4WMVGEP.2 size=794613 2024-09-12T17:07:47.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.991+0000 7f9eaebff780 1 < completed multipart upload key=YIEP2JYDSLW0 upload=BWK9S4WMVGEP tag=CHSNFB4MKA4T type=write size=3940341 2024-09-12T17:07:47.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.992+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=7Q61WRKXIJ0N type=del size=2759142 2024-09-12T17:07:47.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.993+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=EVDXBSJB0MZK type=del 2024-09-12T17:07:47.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.995+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=C6XNT4OX4MA2 type=del size=3339733 2024-09-12T17:07:48.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.997+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~0MX022BXJBL0.0 size=1048576 2024-09-12T17:07:48.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:47.998+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~0MX022BXJBL0.1 size=959264 2024-09-12T17:07:48.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.000+0000 7f9eaebff780 1 < completed multipart upload key=K2NHRSUDQBRW upload=0MX022BXJBL0 tag=N49G2OA4ZJAL type=write size=3056416 2024-09-12T17:07:48.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.003+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~13SCWWUOXR59.0 size=1048576 2024-09-12T17:07:48.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.004+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~13SCWWUOXR59.1 size=144709 2024-09-12T17:07:48.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.004+0000 7f9eaebff780 1 > prepared multipart upload key=EKUW5AKC428U upload=13SCWWUOXR59 tag=6J6Y3WMA9H4H type=write size=2241861 2024-09-12T17:07:48.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.005+0000 7f9eaebff780 1 < completed delete operation key=QIMNK4DL3D0N tag=K680IZ3YG27Q type=del 2024-09-12T17:07:48.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.006+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=E8NADVR8UQ5B type=write size=508997 2024-09-12T17:07:48.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.007+0000 7f9eaebff780 1 < completed delete operation key=GB8P7K59Y8VI tag=RH3JFUTSC3WK type=del 2024-09-12T17:07:48.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.009+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=XYZO5JJPVN4Y type=write size=12963 2024-09-12T17:07:48.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.010+0000 7f9eaebff780 1 < completed write operation key=SO6QF2JCRX6E tag=A5Y3RW19TVDX type=write size=878911 2024-09-12T17:07:48.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.012+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~LJXV1T19GFWR.0 size=591354 2024-09-12T17:07:48.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.012+0000 7f9eaebff780 1 > prepared multipart upload key=SO6QF2JCRX6E upload=LJXV1T19GFWR tag=7MZY6WJUK72R type=write size=1639930 2024-09-12T17:07:48.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.013+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~E8PPS5GWORHM.0 size=931781 2024-09-12T17:07:48.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.015+0000 7f9eaebff780 1 < completed multipart upload key=OGD6H9VSVGWF upload=E8PPS5GWORHM tag=XN32G4AAPW6V type=write size=1980357 2024-09-12T17:07:48.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.017+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~G8MG7BTSHNV9.0 size=1048576 2024-09-12T17:07:48.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.018+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~G8MG7BTSHNV9.1 size=694369 2024-09-12T17:07:48.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.018+0000 7f9eaebff780 1 > prepared multipart upload key=9I6RGNRB6HSY upload=G8MG7BTSHNV9 tag=7I6I7MNVN514 type=write size=2791521 2024-09-12T17:07:48.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.020+0000 7f9eaebff780 1 < canceled operation key=OGD6H9VSVGWF tag=U0WZLGE5PTOZ type=del size=1378965 2024-09-12T17:07:48.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.021+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=PDD68GM27J6W type=del size=3877473 2024-09-12T17:07:48.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.022+0000 7f9eaebff780 1 < canceled operation key=YIEP2JYDSLW0 tag=8T7M0KEPQ44Z type=del size=2673361 2024-09-12T17:07:48.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.023+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=7X3IWA6SOAQD type=del size=1007767 2024-09-12T17:07:48.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.024+0000 7f9eaebff780 1 < completed write operation key=K0P9ZZ91UJJ8 tag=NUSJ4LKSSRZZ type=write size=74167 2024-09-12T17:07:48.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.026+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~4S43VQ6A9FID.0 size=359149 2024-09-12T17:07:48.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.026+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=4S43VQ6A9FID tag=F43365RZAY51 type=write size=1407725 2024-09-12T17:07:48.030 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.028+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~0HJXPE2ZXANT.0 size=1048576 2024-09-12T17:07:48.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.029+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~0HJXPE2ZXANT.1 size=261520 2024-09-12T17:07:48.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.031+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=0HJXPE2ZXANT tag=Q6ZTTMR0EM7X type=write size=2358672 2024-09-12T17:07:48.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.032+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=O34I8VVGH8PY type=del size=397851 2024-09-12T17:07:48.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.034+0000 7f9eaebff780 1 < suggested update operation key=7PBT9VZ07OUI tag=FI7A0Q7HX2LD type=del size=986162 2024-09-12T17:07:48.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.035+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=J9QX3STNYXVM type=del size=3849294 2024-09-12T17:07:48.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.037+0000 7f9eaebff780 1 < completed delete operation key=ZC814TPVLJO1 tag=Q490ISBHMRYU type=del 2024-09-12T17:07:48.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.038+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=MPXI42YLZS1D type=del size=1439113 2024-09-12T17:07:48.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.039+0000 7f9eaebff780 1 < completed write operation key=9I6RGNRB6HSY tag=664XSNWA0PWC type=write size=989113 2024-09-12T17:07:48.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.040+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=N2OWOK8U9KT1 type=del size=3601995 2024-09-12T17:07:48.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.041+0000 7f9eaebff780 1 < completed delete operation key=OGD6H9VSVGWF tag=RP79XGHEF6XD type=del 2024-09-12T17:07:48.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.043+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=M1FPLD32JKYU type=del size=1512700 2024-09-12T17:07:48.046 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.044+0000 7f9eaebff780 -1 < failed to complete operation key=7PBT9VZ07OUI tag=O12534CIYQFD type=del size=2106450: (22) Invalid argument 2024-09-12T17:07:48.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.045+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=ZFFJGZ85P26Y type=write size=160805 2024-09-12T17:07:48.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.047+0000 7f9eaebff780 1 < canceled operation key=SHWT6AT7PN0M tag=7Q61WRKXIJ0N type=del size=2759142 2024-09-12T17:07:48.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.049+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~VJ38AZNQWG07.0 size=1048576 2024-09-12T17:07:48.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.050+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~VJ38AZNQWG07.1 size=1048576 2024-09-12T17:07:48.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.052+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~VJ38AZNQWG07.2 size=318885 2024-09-12T17:07:48.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.052+0000 7f9eaebff780 1 > prepared multipart upload key=9WJGBODZ60NJ upload=VJ38AZNQWG07 tag=O1F3B08KK2L1 type=write size=3464613 2024-09-12T17:07:48.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.053+0000 7f9eaebff780 1 < completed delete operation key=0F5LXJZMBFSP tag=C6XNT4OX4MA2 type=del 2024-09-12T17:07:48.056 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.054+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=UL1NKTNJ8X22 type=write size=320392 2024-09-12T17:07:48.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.055+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~13SCWWUOXR59.0 size=1048576 2024-09-12T17:07:48.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.056+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~13SCWWUOXR59.1 size=144709 2024-09-12T17:07:48.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.058+0000 7f9eaebff780 1 < completed multipart upload key=EKUW5AKC428U upload=13SCWWUOXR59 tag=6J6Y3WMA9H4H type=write size=2241861 2024-09-12T17:07:48.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.059+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=TFINBXQ6DJB5 type=del size=1096308 2024-09-12T17:07:48.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.061+0000 7f9eaebff780 1 < completed write operation key=ZYP3P4031PUZ tag=E8NADVR8UQ5B type=write size=508997 2024-09-12T17:07:48.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.063+0000 7f9eaebff780 1 > prepared part key=_multipart_TXHXOMIB4B53.2~601R4N47IC51.0 size=887692 2024-09-12T17:07:48.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.063+0000 7f9eaebff780 1 > prepared multipart upload key=TXHXOMIB4B53 upload=601R4N47IC51 tag=U643REO04TXV type=write size=1936268 2024-09-12T17:07:48.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.064+0000 7f9eaebff780 -1 < failed to complete operation key=7PBT9VZ07OUI tag=XYZO5JJPVN4Y type=write size=12963: (22) Invalid argument 2024-09-12T17:07:48.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.065+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=YNABVV2E8LMI type=del size=636604 2024-09-12T17:07:48.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.066+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~LJXV1T19GFWR.0 size=591354 2024-09-12T17:07:48.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.069+0000 7f9eaebff780 1 < completed multipart upload key=SO6QF2JCRX6E upload=LJXV1T19GFWR tag=7MZY6WJUK72R type=write size=1639930 2024-09-12T17:07:48.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.075+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~YTNXVSOU88LJ.0 size=651135 2024-09-12T17:07:48.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.075+0000 7f9eaebff780 1 > prepared multipart upload key=A1KRCFY18QTP upload=YTNXVSOU88LJ tag=J2G2D6PQB028 type=write size=1699711 2024-09-12T17:07:48.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.076+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~G8MG7BTSHNV9.0 size=1048576 2024-09-12T17:07:48.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.077+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~G8MG7BTSHNV9.1 size=694369 2024-09-12T17:07:48.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.079+0000 7f9eaebff780 1 < completed multipart upload key=9I6RGNRB6HSY upload=G8MG7BTSHNV9 tag=7I6I7MNVN514 type=write size=2791521 2024-09-12T17:07:48.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.082+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~WUDEPCDKDW3U.0 size=1048576 2024-09-12T17:07:48.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.083+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~WUDEPCDKDW3U.1 size=1048576 2024-09-12T17:07:48.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.084+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~WUDEPCDKDW3U.2 size=563078 2024-09-12T17:07:48.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.084+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=WUDEPCDKDW3U tag=E1INDVGBCB0C type=write size=3708806 2024-09-12T17:07:48.087 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.085+0000 7f9eaebff780 -1 < failed to complete operation key=7PBT9VZ07OUI tag=PDD68GM27J6W type=del size=3877473: (22) Invalid argument 2024-09-12T17:07:48.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.092+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~01YUZAJ78FW9.0 size=770900 2024-09-12T17:07:48.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.092+0000 7f9eaebff780 1 > prepared multipart upload key=0YD5P1ACZ09Q upload=01YUZAJ78FW9 tag=BMQ1A20Q1QW2 type=write size=1819476 2024-09-12T17:07:48.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.093+0000 7f9eaebff780 1 < completed delete operation key=SVWPQETL92QU tag=7X3IWA6SOAQD type=del 2024-09-12T17:07:48.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.095+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~I6VJYV8SL7X0.0 size=902069 2024-09-12T17:07:48.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.095+0000 7f9eaebff780 1 > prepared multipart upload key=QIMNK4DL3D0N upload=I6VJYV8SL7X0 tag=2QWBQZ4OWFYK type=write size=1950645 2024-09-12T17:07:48.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.097+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~4S43VQ6A9FID.0 size=359149 2024-09-12T17:07:48.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.099+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=4S43VQ6A9FID tag=F43365RZAY51 type=write size=1407725 2024-09-12T17:07:48.103 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.101+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~KW27WCX200I3.0 size=1048576 2024-09-12T17:07:48.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.102+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~KW27WCX200I3.1 size=1048576 2024-09-12T17:07:48.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.103+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~KW27WCX200I3.2 size=298289 2024-09-12T17:07:48.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.103+0000 7f9eaebff780 1 > prepared multipart upload key=0YD5P1ACZ09Q upload=KW27WCX200I3 tag=GHBNVW72TNTF type=write size=3444017 2024-09-12T17:07:48.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.104+0000 7f9eaebff780 1 < completed delete operation key=0YD5P1ACZ09Q tag=O34I8VVGH8PY type=del 2024-09-12T17:07:48.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.105+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=8G13XLYYXZUO type=del size=1308223 2024-09-12T17:07:48.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.107+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=J9QX3STNYXVM type=del 2024-09-12T17:07:48.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.109+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~AIUF8X1IKD9N.0 size=282295 2024-09-12T17:07:48.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.109+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=AIUF8X1IKD9N tag=2CJ7238KSQ1W type=write size=1330871 2024-09-12T17:07:48.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.110+0000 7f9eaebff780 1 < completed delete operation key=9I6RGNRB6HSY tag=MPXI42YLZS1D type=del 2024-09-12T17:07:48.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.113+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~YKH1YKYVGAKK.0 size=1048576 2024-09-12T17:07:48.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.114+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~YKH1YKYVGAKK.1 size=52806 2024-09-12T17:07:48.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.114+0000 7f9eaebff780 1 > prepared multipart upload key=ZC814TPVLJO1 upload=YKH1YKYVGAKK tag=TAN679LMWOQU type=write size=2149958 2024-09-12T17:07:48.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.116+0000 7f9eaebff780 1 < suggested remove operation key=B1YC6DM9S8JJ tag=N2OWOK8U9KT1 type=del 2024-09-12T17:07:48.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.119+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~BNTZW3H1HHNZ.0 size=1048576 2024-09-12T17:07:48.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.120+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~BNTZW3H1HHNZ.1 size=1048576 2024-09-12T17:07:48.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.121+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~BNTZW3H1HHNZ.2 size=740385 2024-09-12T17:07:48.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.121+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=BNTZW3H1HHNZ tag=OMUUGR8NA2P0 type=write size=3886113 2024-09-12T17:07:48.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.122+0000 7f9eaebff780 1 < completed delete operation key=EKUW5AKC428U tag=M1FPLD32JKYU type=del 2024-09-12T17:07:48.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.123+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=5Z9D6TY563Q2 type=del size=2944120 2024-09-12T17:07:48.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.124+0000 7f9eaebff780 1 < completed write operation key=UYF1AN2W59VN tag=ZFFJGZ85P26Y type=write size=160805 2024-09-12T17:07:48.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.126+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=VMXT4PDZCCLJ type=del size=1927843 2024-09-12T17:07:48.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.127+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~VJ38AZNQWG07.0 size=1048576 2024-09-12T17:07:48.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.127+0000 7f9eaebff780 1 < canceled part key=_multipart_9WJGBODZ60NJ.2~VJ38AZNQWG07.1 size=1048576 2024-09-12T17:07:48.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.128+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~VJ38AZNQWG07.2 size=318885 2024-09-12T17:07:48.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.130+0000 7f9eaebff780 1 < canceled multipart upload key=9WJGBODZ60NJ upload=VJ38AZNQWG07 tag=O1F3B08KK2L1 type=write size=3464613 2024-09-12T17:07:48.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.132+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~XZK6XGI9OQPE.0 size=1048576 2024-09-12T17:07:48.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.133+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~XZK6XGI9OQPE.1 size=1048576 2024-09-12T17:07:48.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.134+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~XZK6XGI9OQPE.2 size=597668 2024-09-12T17:07:48.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.134+0000 7f9eaebff780 1 > prepared multipart upload key=A1KRCFY18QTP upload=XZK6XGI9OQPE tag=4WFQB5NB60CK type=write size=3743396 2024-09-12T17:07:48.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.135+0000 7f9eaebff780 1 < completed write operation key=P9GMGM3WK6O7 tag=UL1NKTNJ8X22 type=write size=320392 2024-09-12T17:07:48.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.136+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=51B09ULECCOR type=del size=4070338 2024-09-12T17:07:48.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.138+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=TFINBXQ6DJB5 type=del 2024-09-12T17:07:48.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.140+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~1H68E7RUPFMH.0 size=863419 2024-09-12T17:07:48.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.140+0000 7f9eaebff780 1 > prepared multipart upload key=SO6QF2JCRX6E upload=1H68E7RUPFMH tag=3ZLO45BFC1NM type=write size=1911995 2024-09-12T17:07:48.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.141+0000 7f9eaebff780 1 < completed part key=_multipart_TXHXOMIB4B53.2~601R4N47IC51.0 size=887692 2024-09-12T17:07:48.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.143+0000 7f9eaebff780 1 < completed multipart upload key=TXHXOMIB4B53 upload=601R4N47IC51 tag=U643REO04TXV type=write size=1936268 2024-09-12T17:07:48.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.144+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=VS67YJ8FBW8J type=del size=3124582 2024-09-12T17:07:48.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.145+0000 7f9eaebff780 1 < canceled operation key=7PBT9VZ07OUI tag=YNABVV2E8LMI type=del size=636604 2024-09-12T17:07:48.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.147+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=1SV6O9COEP9S type=del size=3135680 2024-09-12T17:07:48.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.148+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~YTNXVSOU88LJ.0 size=651135 2024-09-12T17:07:48.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.150+0000 7f9eaebff780 1 < completed multipart upload key=A1KRCFY18QTP upload=YTNXVSOU88LJ tag=J2G2D6PQB028 type=write size=1699711 2024-09-12T17:07:48.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.152+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~9OT0VIY9I4C1.0 size=1048576 2024-09-12T17:07:48.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.153+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~9OT0VIY9I4C1.1 size=708274 2024-09-12T17:07:48.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.153+0000 7f9eaebff780 1 > prepared multipart upload key=A1KRCFY18QTP upload=9OT0VIY9I4C1 tag=M98M7EPNTQAI type=write size=2805426 2024-09-12T17:07:48.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.154+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~WUDEPCDKDW3U.0 size=1048576 2024-09-12T17:07:48.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.155+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~WUDEPCDKDW3U.1 size=1048576 2024-09-12T17:07:48.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.156+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~WUDEPCDKDW3U.2 size=563078 2024-09-12T17:07:48.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.158+0000 7f9eaebff780 1 < completed multipart upload key=UYF1AN2W59VN upload=WUDEPCDKDW3U tag=E1INDVGBCB0C type=write size=3708806 2024-09-12T17:07:48.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.159+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=A96AC15ALGJL type=del size=838611 2024-09-12T17:07:48.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.161+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~01YUZAJ78FW9.0 size=770900 2024-09-12T17:07:48.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.163+0000 7f9eaebff780 1 < completed multipart upload key=0YD5P1ACZ09Q upload=01YUZAJ78FW9 tag=BMQ1A20Q1QW2 type=write size=1819476 2024-09-12T17:07:48.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.164+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=QUNXROHJZ0PP type=del size=3049485 2024-09-12T17:07:48.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.165+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~I6VJYV8SL7X0.0 size=902069 2024-09-12T17:07:48.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.167+0000 7f9eaebff780 1 < completed multipart upload key=QIMNK4DL3D0N upload=I6VJYV8SL7X0 tag=2QWBQZ4OWFYK type=write size=1950645 2024-09-12T17:07:48.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.169+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~VZOS9HI3V585.0 size=1048576 2024-09-12T17:07:48.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.170+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~VZOS9HI3V585.1 size=919266 2024-09-12T17:07:48.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.170+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=VZOS9HI3V585 tag=U0AS2QXIRX8I type=write size=3016418 2024-09-12T17:07:48.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.172+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~KW27WCX200I3.0 size=1048576 2024-09-12T17:07:48.177 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.174+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~KW27WCX200I3.1 size=1048576 2024-09-12T17:07:48.178 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.175+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~KW27WCX200I3.2 size=298289 2024-09-12T17:07:48.181 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.179+0000 7f9eaebff780 1 < completed multipart upload key=0YD5P1ACZ09Q upload=KW27WCX200I3 tag=GHBNVW72TNTF type=write size=3444017 2024-09-12T17:07:48.182 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.180+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=THZGB55Z2ENI type=del size=3732641 2024-09-12T17:07:48.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.181+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=8G13XLYYXZUO type=del 2024-09-12T17:07:48.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.183+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=DH6M0XCLPZ3N type=del size=1583409 2024-09-12T17:07:48.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.184+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~AIUF8X1IKD9N.0 size=282295 2024-09-12T17:07:48.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.186+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=AIUF8X1IKD9N tag=2CJ7238KSQ1W type=write size=1330871 2024-09-12T17:07:48.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.187+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=0V3PS60HJCYQ type=del size=2985596 2024-09-12T17:07:48.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.189+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~YKH1YKYVGAKK.0 size=1048576 2024-09-12T17:07:48.192 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.190+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~YKH1YKYVGAKK.1 size=52806 2024-09-12T17:07:48.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.192+0000 7f9eaebff780 1 < completed multipart upload key=ZC814TPVLJO1 upload=YKH1YKYVGAKK tag=TAN679LMWOQU type=write size=2149958 2024-09-12T17:07:48.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.193+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=KAI2IMDQZWFS type=write size=944972 2024-09-12T17:07:48.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.194+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~BNTZW3H1HHNZ.0 size=1048576 2024-09-12T17:07:48.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.195+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~BNTZW3H1HHNZ.1 size=1048576 2024-09-12T17:07:48.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.196+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~BNTZW3H1HHNZ.2 size=740385 2024-09-12T17:07:48.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.198+0000 7f9eaebff780 1 < completed multipart upload key=SHWT6AT7PN0M upload=BNTZW3H1HHNZ tag=OMUUGR8NA2P0 type=write size=3886113 2024-09-12T17:07:48.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.200+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~EC8EI8Q5S20W.0 size=117178 2024-09-12T17:07:48.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.200+0000 7f9eaebff780 1 > prepared multipart upload key=LJN514F16XJA upload=EC8EI8Q5S20W tag=AKN9PDKEKOM6 type=write size=1165754 2024-09-12T17:07:48.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.203+0000 7f9eaebff780 1 < suggested update operation key=SVWPQETL92QU tag=5Z9D6TY563Q2 type=del size=2944120 2024-09-12T17:07:48.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.204+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=B27MJNDRM66G type=del size=1045855 2024-09-12T17:07:48.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.205+0000 7f9eaebff780 1 < completed delete operation key=3VY271ZBO754 tag=VMXT4PDZCCLJ type=del 2024-09-12T17:07:48.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.207+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~71JHD4B3Y3AP.0 size=67736 2024-09-12T17:07:48.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.207+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=71JHD4B3Y3AP tag=QLQPFNX3EBII type=write size=1116312 2024-09-12T17:07:48.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.208+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~XZK6XGI9OQPE.0 size=1048576 2024-09-12T17:07:48.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.209+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~XZK6XGI9OQPE.1 size=1048576 2024-09-12T17:07:48.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.210+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~XZK6XGI9OQPE.2 size=597668 2024-09-12T17:07:48.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.212+0000 7f9eaebff780 1 < completed multipart upload key=A1KRCFY18QTP upload=XZK6XGI9OQPE tag=4WFQB5NB60CK type=write size=3743396 2024-09-12T17:07:48.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.214+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=99SYJHPTXX2J type=del size=1202531 2024-09-12T17:07:48.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.216+0000 7f9eaebff780 1 < suggested remove operation key=CAIZM33SDFPM tag=51B09ULECCOR type=del 2024-09-12T17:07:48.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.217+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=P2A37MRP4467 type=del size=1793079 2024-09-12T17:07:48.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.217+0000 7f9eaebff780 1 < canceled part key=_multipart_SO6QF2JCRX6E.2~1H68E7RUPFMH.0 size=863419 2024-09-12T17:07:48.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.219+0000 7f9eaebff780 1 < canceled multipart upload key=SO6QF2JCRX6E upload=1H68E7RUPFMH tag=3ZLO45BFC1NM type=write size=1911995 2024-09-12T17:07:48.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.220+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=1YGRD7SCZ4SJ type=del size=443596 2024-09-12T17:07:48.224 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.221+0000 7f9eaebff780 1 < canceled operation key=TXHXOMIB4B53 tag=VS67YJ8FBW8J type=del size=3124582 2024-09-12T17:07:48.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.222+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=MFOCIP8VRI0P type=del size=1927896 2024-09-12T17:07:48.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.225+0000 7f9eaebff780 1 < suggested update operation key=7PBT9VZ07OUI tag=1SV6O9COEP9S type=del size=3135680 2024-09-12T17:07:48.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.226+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=R6U0D4Y5B1IZ type=del size=630172 2024-09-12T17:07:48.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.227+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~9OT0VIY9I4C1.0 size=1048576 2024-09-12T17:07:48.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.228+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~9OT0VIY9I4C1.1 size=708274 2024-09-12T17:07:48.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.230+0000 7f9eaebff780 1 < completed multipart upload key=A1KRCFY18QTP upload=9OT0VIY9I4C1 tag=M98M7EPNTQAI type=write size=2805426 2024-09-12T17:07:48.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.233+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~9W4KC23WH896.0 size=1048576 2024-09-12T17:07:48.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.234+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~9W4KC23WH896.1 size=1048576 2024-09-12T17:07:48.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.235+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~9W4KC23WH896.2 size=86336 2024-09-12T17:07:48.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.235+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=9W4KC23WH896 tag=HB7XBOB83B1X type=write size=3232064 2024-09-12T17:07:48.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.236+0000 7f9eaebff780 1 < completed delete operation key=3VY271ZBO754 tag=A96AC15ALGJL type=del 2024-09-12T17:07:48.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.237+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=MH2YTGLLTRRD type=del size=2160116 2024-09-12T17:07:48.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.239+0000 7f9eaebff780 1 < completed delete operation key=LRI5G5G8O5X4 tag=QUNXROHJZ0PP type=del 2024-09-12T17:07:48.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.241+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~1PC38JAXINC8.0 size=183909 2024-09-12T17:07:48.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.241+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=1PC38JAXINC8 tag=7VF2OLXMKQUA type=write size=1232485 2024-09-12T17:07:48.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.241+0000 7f9eaebff780 1 < canceled part key=_multipart_OH6GXTMPBYUY.2~VZOS9HI3V585.0 size=1048576 2024-09-12T17:07:48.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.242+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~VZOS9HI3V585.1 size=919266 2024-09-12T17:07:48.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.244+0000 7f9eaebff780 1 < canceled multipart upload key=OH6GXTMPBYUY upload=VZOS9HI3V585 tag=U0AS2QXIRX8I type=write size=3016418 2024-09-12T17:07:48.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.246+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=EVBBHRXYHHMD type=write size=13030 2024-09-12T17:07:48.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.248+0000 7f9eaebff780 1 < suggested update operation key=SVWPQETL92QU tag=THZGB55Z2ENI type=del size=3732641 2024-09-12T17:07:48.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.250+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=5Z290P9GELHE type=del size=1293976 2024-09-12T17:07:48.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.251+0000 7f9eaebff780 1 < completed delete operation key=SHWT6AT7PN0M tag=DH6M0XCLPZ3N type=del 2024-09-12T17:07:48.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.253+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~LHF97TVZ1VX6.0 size=1048576 2024-09-12T17:07:48.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.254+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~LHF97TVZ1VX6.1 size=1048576 2024-09-12T17:07:48.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.255+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~LHF97TVZ1VX6.2 size=85354 2024-09-12T17:07:48.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.255+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=LHF97TVZ1VX6 tag=SBD0TUJWYRU9 type=write size=3231082 2024-09-12T17:07:48.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.257+0000 7f9eaebff780 1 < completed delete operation key=QIMNK4DL3D0N tag=0V3PS60HJCYQ type=del 2024-09-12T17:07:48.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.258+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=WD1X96O2THWN type=del size=25742 2024-09-12T17:07:48.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.259+0000 7f9eaebff780 1 < completed write operation key=M3PLQGSK34YM tag=KAI2IMDQZWFS type=write size=944972 2024-09-12T17:07:48.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.261+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~X713TRFU28IZ.0 size=536353 2024-09-12T17:07:48.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.261+0000 7f9eaebff780 1 > prepared multipart upload key=KF8XE48DI9KZ upload=X713TRFU28IZ tag=46GO63AO4IFG type=write size=1584929 2024-09-12T17:07:48.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.262+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~EC8EI8Q5S20W.0 size=117178 2024-09-12T17:07:48.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.265+0000 7f9eaebff780 1 < completed multipart upload key=LJN514F16XJA upload=EC8EI8Q5S20W tag=AKN9PDKEKOM6 type=write size=1165754 2024-09-12T17:07:48.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.266+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=TUAQYLZ3HFUU type=write size=402721 2024-09-12T17:07:48.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.267+0000 7f9eaebff780 1 < completed delete operation key=0YD5P1ACZ09Q tag=B27MJNDRM66G type=del 2024-09-12T17:07:48.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.269+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=7ORNZE17C5K8 type=del size=2190110 2024-09-12T17:07:48.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.270+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~71JHD4B3Y3AP.0 size=67736 2024-09-12T17:07:48.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.272+0000 7f9eaebff780 1 < completed multipart upload key=K2NHRSUDQBRW upload=71JHD4B3Y3AP tag=QLQPFNX3EBII type=write size=1116312 2024-09-12T17:07:48.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.274+0000 7f9eaebff780 1 > prepared part key=_multipart_TXHXOMIB4B53.2~97BG939RX5NV.0 size=59023 2024-09-12T17:07:48.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.274+0000 7f9eaebff780 1 > prepared multipart upload key=TXHXOMIB4B53 upload=97BG939RX5NV tag=9N1EQ6CX6DBF type=write size=1107599 2024-09-12T17:07:48.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.276+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=99SYJHPTXX2J type=del 2024-09-12T17:07:48.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.278+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~1MIEKBQKQIZ5.0 size=1048576 2024-09-12T17:07:48.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.279+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~1MIEKBQKQIZ5.1 size=489472 2024-09-12T17:07:48.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.279+0000 7f9eaebff780 1 > prepared multipart upload key=TDZCNUZE8IOA upload=1MIEKBQKQIZ5 tag=6FTQEX0XK0A7 type=write size=2586624 2024-09-12T17:07:48.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.280+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=P2A37MRP4467 type=del 2024-09-12T17:07:48.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.281+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=PDQQ5QGE1NDE type=del size=1972101 2024-09-12T17:07:48.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.283+0000 7f9eaebff780 1 < completed delete operation key=UYF1AN2W59VN tag=1YGRD7SCZ4SJ type=del 2024-09-12T17:07:48.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.285+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~GR6PKOTRTUMF.0 size=411302 2024-09-12T17:07:48.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.285+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=GR6PKOTRTUMF tag=IF5SMMJPGW10 type=write size=1459878 2024-09-12T17:07:48.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.286+0000 7f9eaebff780 1 < completed delete operation key=OH6GXTMPBYUY tag=MFOCIP8VRI0P type=del 2024-09-12T17:07:48.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.288+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~FI1P8S1W0BVF.0 size=1048576 2024-09-12T17:07:48.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.289+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~FI1P8S1W0BVF.1 size=525905 2024-09-12T17:07:48.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.289+0000 7f9eaebff780 1 > prepared multipart upload key=3VY271ZBO754 upload=FI1P8S1W0BVF tag=VKPZ4KJYNJ8T type=write size=2623057 2024-09-12T17:07:48.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.291+0000 7f9eaebff780 1 < completed delete operation key=LRI5G5G8O5X4 tag=R6U0D4Y5B1IZ type=del 2024-09-12T17:07:48.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.293+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~5KFVOHR1C3G7.0 size=369489 2024-09-12T17:07:48.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.293+0000 7f9eaebff780 1 > prepared multipart upload key=GB8P7K59Y8VI upload=5KFVOHR1C3G7 tag=KK49MKN1808U type=write size=1418065 2024-09-12T17:07:48.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.294+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~9W4KC23WH896.0 size=1048576 2024-09-12T17:07:48.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.295+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~9W4KC23WH896.1 size=1048576 2024-09-12T17:07:48.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.296+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~9W4KC23WH896.2 size=86336 2024-09-12T17:07:48.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.298+0000 7f9eaebff780 1 < completed multipart upload key=P9GMGM3WK6O7 upload=9W4KC23WH896 tag=HB7XBOB83B1X type=write size=3232064 2024-09-12T17:07:48.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.300+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=4GRWS6LAQ0DL type=write size=678699 2024-09-12T17:07:48.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.301+0000 7f9eaebff780 1 < completed delete operation key=K2NHRSUDQBRW tag=MH2YTGLLTRRD type=del 2024-09-12T17:07:48.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.303+0000 7f9eaebff780 1 > prepared part key=_multipart_TXHXOMIB4B53.2~C5ZXVGFGOR7N.0 size=1048576 2024-09-12T17:07:48.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.304+0000 7f9eaebff780 1 > prepared part key=_multipart_TXHXOMIB4B53.2~C5ZXVGFGOR7N.1 size=839745 2024-09-12T17:07:48.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.304+0000 7f9eaebff780 1 > prepared multipart upload key=TXHXOMIB4B53 upload=C5ZXVGFGOR7N tag=SR7MUIGGFRRT type=write size=2936897 2024-09-12T17:07:48.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.306+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~1PC38JAXINC8.0 size=183909 2024-09-12T17:07:48.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.308+0000 7f9eaebff780 1 < completed multipart upload key=P9GMGM3WK6O7 upload=1PC38JAXINC8 tag=7VF2OLXMKQUA type=write size=1232485 2024-09-12T17:07:48.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.309+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=IMD7MESYG4EE type=del size=992802 2024-09-12T17:07:48.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.310+0000 7f9eaebff780 1 < completed write operation key=7PBT9VZ07OUI tag=EVBBHRXYHHMD type=write size=13030 2024-09-12T17:07:48.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.312+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~NVHL70GPRAIF.0 size=1048576 2024-09-12T17:07:48.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.313+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~NVHL70GPRAIF.1 size=1048576 2024-09-12T17:07:48.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.314+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~NVHL70GPRAIF.2 size=489672 2024-09-12T17:07:48.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.314+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=NVHL70GPRAIF tag=YTSKSF0R38JF type=write size=3635400 2024-09-12T17:07:48.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.315+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=5Z290P9GELHE type=del 2024-09-12T17:07:48.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.316+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=G6XTVV7QJ1TA type=del size=1193313 2024-09-12T17:07:48.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.318+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~LHF97TVZ1VX6.0 size=1048576 2024-09-12T17:07:48.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.318+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~LHF97TVZ1VX6.1 size=1048576 2024-09-12T17:07:48.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.319+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~LHF97TVZ1VX6.2 size=85354 2024-09-12T17:07:48.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.322+0000 7f9eaebff780 1 < completed multipart upload key=K2NHRSUDQBRW upload=LHF97TVZ1VX6 tag=SBD0TUJWYRU9 type=write size=3231082 2024-09-12T17:07:48.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.323+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=PG03I46RWPPC type=del size=1766715 2024-09-12T17:07:48.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.324+0000 7f9eaebff780 1 < completed delete operation key=K2NHRSUDQBRW tag=WD1X96O2THWN type=del 2024-09-12T17:07:48.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.325+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=C7RQLD93R9U1 type=del size=2000375 2024-09-12T17:07:48.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.326+0000 7f9eaebff780 1 < canceled part key=_multipart_KF8XE48DI9KZ.2~X713TRFU28IZ.0 size=536353 2024-09-12T17:07:48.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.328+0000 7f9eaebff780 1 < canceled multipart upload key=KF8XE48DI9KZ upload=X713TRFU28IZ tag=46GO63AO4IFG type=write size=1584929 2024-09-12T17:07:48.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.330+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~EUZAMPAUHDJ9.0 size=1048576 2024-09-12T17:07:48.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.331+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~EUZAMPAUHDJ9.1 size=95890 2024-09-12T17:07:48.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.331+0000 7f9eaebff780 1 > prepared multipart upload key=B1YC6DM9S8JJ upload=EUZAMPAUHDJ9 tag=5HV0UEZ2I8TU type=write size=2193042 2024-09-12T17:07:48.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.332+0000 7f9eaebff780 1 < completed write operation key=P9GMGM3WK6O7 tag=TUAQYLZ3HFUU type=write size=402721 2024-09-12T17:07:48.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.334+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~JSOX6CNNQALO.0 size=1048576 2024-09-12T17:07:48.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.335+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~JSOX6CNNQALO.1 size=795253 2024-09-12T17:07:48.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.335+0000 7f9eaebff780 1 > prepared multipart upload key=QIMNK4DL3D0N upload=JSOX6CNNQALO tag=TTPH2MCMETMF type=write size=2892405 2024-09-12T17:07:48.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.336+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=7ORNZE17C5K8 type=del 2024-09-12T17:07:48.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.339+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~AHYCQ2D0G8LD.0 size=107144 2024-09-12T17:07:48.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.339+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=AHYCQ2D0G8LD tag=HVN9X0WW7UQJ type=write size=1155720 2024-09-12T17:07:48.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.339+0000 7f9eaebff780 1 < canceled part key=_multipart_TXHXOMIB4B53.2~97BG939RX5NV.0 size=59023 2024-09-12T17:07:48.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.341+0000 7f9eaebff780 1 < canceled multipart upload key=TXHXOMIB4B53 upload=97BG939RX5NV tag=9N1EQ6CX6DBF type=write size=1107599 2024-09-12T17:07:48.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.342+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=X55UO2GWGM5F type=del size=3815787 2024-09-12T17:07:48.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.343+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~1MIEKBQKQIZ5.0 size=1048576 2024-09-12T17:07:48.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.344+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~1MIEKBQKQIZ5.1 size=489472 2024-09-12T17:07:48.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.346+0000 7f9eaebff780 1 < completed multipart upload key=TDZCNUZE8IOA upload=1MIEKBQKQIZ5 tag=6FTQEX0XK0A7 type=write size=2586624 2024-09-12T17:07:48.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.349+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~VHKA1SSYM80J.0 size=1048576 2024-09-12T17:07:48.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.350+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~VHKA1SSYM80J.1 size=1048576 2024-09-12T17:07:48.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.351+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~VHKA1SSYM80J.2 size=504982 2024-09-12T17:07:48.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.351+0000 7f9eaebff780 1 > prepared multipart upload key=ZYP3P4031PUZ upload=VHKA1SSYM80J tag=HWSDVSOPLZSY type=write size=3650710 2024-09-12T17:07:48.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.353+0000 7f9eaebff780 1 < suggested update operation key=K2NHRSUDQBRW tag=PDQQ5QGE1NDE type=del size=1972101 2024-09-12T17:07:48.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.355+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=256L6II4TYXV type=del size=3810199 2024-09-12T17:07:48.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.355+0000 7f9eaebff780 1 < canceled part key=_multipart_UYF1AN2W59VN.2~GR6PKOTRTUMF.0 size=411302 2024-09-12T17:07:48.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.357+0000 7f9eaebff780 1 < canceled multipart upload key=UYF1AN2W59VN upload=GR6PKOTRTUMF tag=IF5SMMJPGW10 type=write size=1459878 2024-09-12T17:07:48.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.359+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~42F0SJ5KLU50.0 size=1048576 2024-09-12T17:07:48.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.360+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~42F0SJ5KLU50.1 size=1048576 2024-09-12T17:07:48.364 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.361+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~42F0SJ5KLU50.2 size=428428 2024-09-12T17:07:48.364 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.361+0000 7f9eaebff780 1 > prepared multipart upload key=B1YC6DM9S8JJ upload=42F0SJ5KLU50 tag=71KB2Q4HM2DY type=write size=3574156 2024-09-12T17:07:48.364 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.362+0000 7f9eaebff780 1 < canceled part key=_multipart_3VY271ZBO754.2~FI1P8S1W0BVF.0 size=1048576 2024-09-12T17:07:48.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.363+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~FI1P8S1W0BVF.1 size=525905 2024-09-12T17:07:48.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.365+0000 7f9eaebff780 1 < canceled multipart upload key=3VY271ZBO754 upload=FI1P8S1W0BVF tag=VKPZ4KJYNJ8T type=write size=2623057 2024-09-12T17:07:48.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.367+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~L0F2LX8219MX.0 size=1048576 2024-09-12T17:07:48.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.367+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~L0F2LX8219MX.1 size=1048576 2024-09-12T17:07:48.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.368+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~L0F2LX8219MX.2 size=343767 2024-09-12T17:07:48.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.368+0000 7f9eaebff780 1 > prepared multipart upload key=9WJGBODZ60NJ upload=L0F2LX8219MX tag=RREEVS65SONE type=write size=3489495 2024-09-12T17:07:48.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.370+0000 7f9eaebff780 1 < completed part key=_multipart_GB8P7K59Y8VI.2~5KFVOHR1C3G7.0 size=369489 2024-09-12T17:07:48.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.371+0000 7f9eaebff780 1 < completed multipart upload key=GB8P7K59Y8VI upload=5KFVOHR1C3G7 tag=KK49MKN1808U type=write size=1418065 2024-09-12T17:07:48.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.373+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=FD9RXP7D4UYE type=del size=3530853 2024-09-12T17:07:48.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.374+0000 7f9eaebff780 1 < completed write operation key=TXHXOMIB4B53 tag=4GRWS6LAQ0DL type=write size=678699 2024-09-12T17:07:48.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.375+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=CRD8K1DDZ3GA type=del size=1198854 2024-09-12T17:07:48.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.376+0000 7f9eaebff780 1 < completed part key=_multipart_TXHXOMIB4B53.2~C5ZXVGFGOR7N.0 size=1048576 2024-09-12T17:07:48.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.377+0000 7f9eaebff780 1 < completed part key=_multipart_TXHXOMIB4B53.2~C5ZXVGFGOR7N.1 size=839745 2024-09-12T17:07:48.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.379+0000 7f9eaebff780 1 < completed multipart upload key=TXHXOMIB4B53 upload=C5ZXVGFGOR7N tag=SR7MUIGGFRRT type=write size=2936897 2024-09-12T17:07:48.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.381+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=Z35QKESSW1XJ type=write size=245598 2024-09-12T17:07:48.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.383+0000 7f9eaebff780 1 < suggested remove operation key=LRI5G5G8O5X4 tag=IMD7MESYG4EE type=del 2024-09-12T17:07:48.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.384+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=AOGYMC26B3V2 type=del size=1079801 2024-09-12T17:07:48.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.385+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~NVHL70GPRAIF.0 size=1048576 2024-09-12T17:07:48.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.386+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~NVHL70GPRAIF.1 size=1048576 2024-09-12T17:07:48.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.388+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~NVHL70GPRAIF.2 size=489672 2024-09-12T17:07:48.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.389+0000 7f9eaebff780 1 < completed multipart upload key=UYF1AN2W59VN upload=NVHL70GPRAIF tag=YTSKSF0R38JF type=write size=3635400 2024-09-12T17:07:48.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.392+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~1H4HC71HZW0X.0 size=115291 2024-09-12T17:07:48.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.392+0000 7f9eaebff780 1 > prepared multipart upload key=CAIZM33SDFPM upload=1H4HC71HZW0X tag=45IHZ5PJJM7X type=write size=1163867 2024-09-12T17:07:48.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.393+0000 7f9eaebff780 1 < completed delete operation key=UYF1AN2W59VN tag=G6XTVV7QJ1TA type=del 2024-09-12T17:07:48.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.395+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~ISUZ7RATZHZD.0 size=1048576 2024-09-12T17:07:48.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.396+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~ISUZ7RATZHZD.1 size=688598 2024-09-12T17:07:48.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.396+0000 7f9eaebff780 1 > prepared multipart upload key=8DJLYFM11DNI upload=ISUZ7RATZHZD tag=JH3880ZFJ8M0 type=write size=2785750 2024-09-12T17:07:48.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.397+0000 7f9eaebff780 1 < completed delete operation key=OH6GXTMPBYUY tag=PG03I46RWPPC type=del 2024-09-12T17:07:48.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.398+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=IUD4G8AG8UB5 type=write size=915425 2024-09-12T17:07:48.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.399+0000 7f9eaebff780 1 < canceled operation key=YIEP2JYDSLW0 tag=C7RQLD93R9U1 type=del size=2000375 2024-09-12T17:07:48.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.402+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~U9PO13TCH0W3.0 size=1048576 2024-09-12T17:07:48.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.403+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~U9PO13TCH0W3.1 size=34135 2024-09-12T17:07:48.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.403+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=U9PO13TCH0W3 tag=W20VOORVW2NV type=write size=2131287 2024-09-12T17:07:48.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.406+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~EUZAMPAUHDJ9.0 size=1048576 2024-09-12T17:07:48.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.407+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~EUZAMPAUHDJ9.1 size=95890 2024-09-12T17:07:48.411 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.409+0000 7f9eaebff780 1 < completed multipart upload key=B1YC6DM9S8JJ upload=EUZAMPAUHDJ9 tag=5HV0UEZ2I8TU type=write size=2193042 2024-09-12T17:07:48.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.410+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=DN0MWVAM80O2 type=del size=3433803 2024-09-12T17:07:48.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.411+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~JSOX6CNNQALO.0 size=1048576 2024-09-12T17:07:48.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.412+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~JSOX6CNNQALO.1 size=795253 2024-09-12T17:07:48.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.414+0000 7f9eaebff780 1 < completed multipart upload key=QIMNK4DL3D0N upload=JSOX6CNNQALO tag=TTPH2MCMETMF type=write size=2892405 2024-09-12T17:07:48.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.416+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~2VL71XAV8OYR.0 size=1048576 2024-09-12T17:07:48.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.417+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~2VL71XAV8OYR.1 size=1048576 2024-09-12T17:07:48.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.418+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~2VL71XAV8OYR.2 size=1030733 2024-09-12T17:07:48.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.418+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=2VL71XAV8OYR tag=XL8MFVFCZM67 type=write size=4176461 2024-09-12T17:07:48.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.419+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~AHYCQ2D0G8LD.0 size=107144 2024-09-12T17:07:48.424 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.421+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=AHYCQ2D0G8LD tag=HVN9X0WW7UQJ type=write size=1155720 2024-09-12T17:07:48.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.422+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=X8H0YY4RCCIP type=del size=3471216 2024-09-12T17:07:48.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.424+0000 7f9eaebff780 1 < completed delete operation key=UYF1AN2W59VN tag=X55UO2GWGM5F type=del 2024-09-12T17:07:48.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.425+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=9ILCVTLHG0SF type=del size=1476655 2024-09-12T17:07:48.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.426+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~VHKA1SSYM80J.0 size=1048576 2024-09-12T17:07:48.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.427+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~VHKA1SSYM80J.1 size=1048576 2024-09-12T17:07:48.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.428+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~VHKA1SSYM80J.2 size=504982 2024-09-12T17:07:48.432 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.430+0000 7f9eaebff780 1 < completed multipart upload key=ZYP3P4031PUZ upload=VHKA1SSYM80J tag=HWSDVSOPLZSY type=write size=3650710 2024-09-12T17:07:48.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.431+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=628XFYWRBFMK type=write size=856612 2024-09-12T17:07:48.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.432+0000 7f9eaebff780 1 < completed delete operation key=OGD6H9VSVGWF tag=256L6II4TYXV type=del 2024-09-12T17:07:48.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.433+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=Z0Q6YPH4NJ3Q type=del size=3704229 2024-09-12T17:07:48.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.434+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~42F0SJ5KLU50.0 size=1048576 2024-09-12T17:07:48.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.435+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~42F0SJ5KLU50.1 size=1048576 2024-09-12T17:07:48.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.436+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~42F0SJ5KLU50.2 size=428428 2024-09-12T17:07:48.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.440+0000 7f9eaebff780 1 < completed multipart upload key=B1YC6DM9S8JJ upload=42F0SJ5KLU50 tag=71KB2Q4HM2DY type=write size=3574156 2024-09-12T17:07:48.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.441+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=5IJ26R2WUWLQ type=del size=1091843 2024-09-12T17:07:48.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.442+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~L0F2LX8219MX.0 size=1048576 2024-09-12T17:07:48.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.442+0000 7f9eaebff780 1 < canceled part key=_multipart_9WJGBODZ60NJ.2~L0F2LX8219MX.1 size=1048576 2024-09-12T17:07:48.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.443+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~L0F2LX8219MX.2 size=343767 2024-09-12T17:07:48.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.445+0000 7f9eaebff780 1 < canceled multipart upload key=9WJGBODZ60NJ upload=L0F2LX8219MX tag=RREEVS65SONE type=write size=3489495 2024-09-12T17:07:48.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.446+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=OIE7T4JTUPUT type=del size=4050601 2024-09-12T17:07:48.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.448+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=FD9RXP7D4UYE type=del 2024-09-12T17:07:48.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.450+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~5SK54B6UKE9R.0 size=1048576 2024-09-12T17:07:48.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.451+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~5SK54B6UKE9R.1 size=998942 2024-09-12T17:07:48.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.451+0000 7f9eaebff780 1 > prepared multipart upload key=3LY681252WAN upload=5SK54B6UKE9R tag=FDMT4WNZFYVX type=write size=3096094 2024-09-12T17:07:48.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.453+0000 7f9eaebff780 1 < suggested update operation key=ZYP3P4031PUZ tag=CRD8K1DDZ3GA type=del size=1198854 2024-09-12T17:07:48.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.454+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=YM3MWLUVA90S type=write size=951087 2024-09-12T17:07:48.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.456+0000 7f9eaebff780 1 < completed write operation key=CAIZM33SDFPM tag=Z35QKESSW1XJ type=write size=245598 2024-09-12T17:07:48.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.457+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=SDDZAPMAHDH5 type=write size=341291 2024-09-12T17:07:48.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.458+0000 7f9eaebff780 1 < completed delete operation key=B1YC6DM9S8JJ tag=AOGYMC26B3V2 type=del 2024-09-12T17:07:48.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.460+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~BZTR75DFGIVD.0 size=998212 2024-09-12T17:07:48.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.460+0000 7f9eaebff780 1 > prepared multipart upload key=8DJLYFM11DNI upload=BZTR75DFGIVD tag=9E2YZ20562TF type=write size=2046788 2024-09-12T17:07:48.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.461+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~1H4HC71HZW0X.0 size=115291 2024-09-12T17:07:48.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.463+0000 7f9eaebff780 1 < completed multipart upload key=CAIZM33SDFPM upload=1H4HC71HZW0X tag=45IHZ5PJJM7X type=write size=1163867 2024-09-12T17:07:48.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.465+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=9MD2UHF8HDZE type=write size=96363 2024-09-12T17:07:48.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.466+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~ISUZ7RATZHZD.0 size=1048576 2024-09-12T17:07:48.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.466+0000 7f9eaebff780 1 < canceled part key=_multipart_8DJLYFM11DNI.2~ISUZ7RATZHZD.1 size=688598 2024-09-12T17:07:48.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.468+0000 7f9eaebff780 1 < canceled multipart upload key=8DJLYFM11DNI upload=ISUZ7RATZHZD tag=JH3880ZFJ8M0 type=write size=2785750 2024-09-12T17:07:48.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.469+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=SLPBU5DGIZI4 type=del size=3987775 2024-09-12T17:07:48.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.472+0000 7f9eaebff780 1 < suggested remove operation key=QIMNK4DL3D0N tag=IUD4G8AG8UB5 type=write 2024-09-12T17:07:48.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.473+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=HFBF24BAFE9E type=del size=2208436 2024-09-12T17:07:48.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.474+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~U9PO13TCH0W3.0 size=1048576 2024-09-12T17:07:48.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.475+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~U9PO13TCH0W3.1 size=34135 2024-09-12T17:07:48.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.477+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=U9PO13TCH0W3 tag=W20VOORVW2NV type=write size=2131287 2024-09-12T17:07:48.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.479+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~YVPUUAU4ZEKK.0 size=1048576 2024-09-12T17:07:48.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.480+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~YVPUUAU4ZEKK.1 size=1048576 2024-09-12T17:07:48.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.481+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~YVPUUAU4ZEKK.2 size=245681 2024-09-12T17:07:48.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.481+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=YVPUUAU4ZEKK tag=NDBT1QSPK1UP type=write size=3391409 2024-09-12T17:07:48.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.484+0000 7f9eaebff780 1 < suggested update operation key=M3PLQGSK34YM tag=DN0MWVAM80O2 type=del size=3433803 2024-09-12T17:07:48.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.486+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~C5AS8F3UE6C1.0 size=1048576 2024-09-12T17:07:48.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.487+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~C5AS8F3UE6C1.1 size=1048576 2024-09-12T17:07:48.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.488+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~C5AS8F3UE6C1.2 size=849681 2024-09-12T17:07:48.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.488+0000 7f9eaebff780 1 > prepared multipart upload key=9WJGBODZ60NJ upload=C5AS8F3UE6C1 tag=P2UF41MDOX7L type=write size=3995409 2024-09-12T17:07:48.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.489+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~2VL71XAV8OYR.0 size=1048576 2024-09-12T17:07:48.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.491+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~2VL71XAV8OYR.1 size=1048576 2024-09-12T17:07:48.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.492+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~2VL71XAV8OYR.2 size=1030733 2024-09-12T17:07:48.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.494+0000 7f9eaebff780 1 < completed multipart upload key=P9GMGM3WK6O7 upload=2VL71XAV8OYR tag=XL8MFVFCZM67 type=write size=4176461 2024-09-12T17:07:48.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.497+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~6TFT3VU6WBLC.0 size=95539 2024-09-12T17:07:48.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.497+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=6TFT3VU6WBLC tag=X6LERBHXIYNR type=write size=1144115 2024-09-12T17:07:48.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.498+0000 7f9eaebff780 1 < completed delete operation key=P9GMGM3WK6O7 tag=X8H0YY4RCCIP type=del 2024-09-12T17:07:48.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.500+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=RREZB190PPS1 type=del size=1586753 2024-09-12T17:07:48.504 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.501+0000 7f9eaebff780 1 < completed delete operation key=9I6RGNRB6HSY tag=9ILCVTLHG0SF type=del 2024-09-12T17:07:48.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.506+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~HBKEDOZN5MFT.0 size=985858 2024-09-12T17:07:48.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.506+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=HBKEDOZN5MFT tag=4C22M6QB235H type=write size=2034434 2024-09-12T17:07:48.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.507+0000 7f9eaebff780 1 < suggested remove operation key=P9GMGM3WK6O7 tag=628XFYWRBFMK type=write 2024-09-12T17:07:48.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.510+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~J18G6OUMUAZ7.0 size=1048576 2024-09-12T17:07:48.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.511+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~J18G6OUMUAZ7.1 size=1048576 2024-09-12T17:07:48.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.512+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~J18G6OUMUAZ7.2 size=346003 2024-09-12T17:07:48.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.512+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=J18G6OUMUAZ7 tag=5OPTASHA2S9G type=write size=3491731 2024-09-12T17:07:48.516 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.513+0000 7f9eaebff780 1 < completed delete operation key=7PBT9VZ07OUI tag=Z0Q6YPH4NJ3Q type=del 2024-09-12T17:07:48.517 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.514+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=280Y6K3CRW94 type=del size=600867 2024-09-12T17:07:48.518 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.516+0000 7f9eaebff780 1 < canceled operation key=3LY681252WAN tag=5IJ26R2WUWLQ type=del size=1091843 2024-09-12T17:07:48.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.518+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~OUS8I3EG7IVC.0 size=1048576 2024-09-12T17:07:48.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.520+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~OUS8I3EG7IVC.1 size=163532 2024-09-12T17:07:48.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.520+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=OUS8I3EG7IVC tag=ERY4SJN9S1BT type=write size=2260684 2024-09-12T17:07:48.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.521+0000 7f9eaebff780 1 < canceled operation key=YIEP2JYDSLW0 tag=OIE7T4JTUPUT type=del size=4050601 2024-09-12T17:07:48.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.524+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~Q6M3JA8GNM0F.0 size=319994 2024-09-12T17:07:48.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.524+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=Q6M3JA8GNM0F tag=ZCNDJWU3KEH6 type=write size=1368570 2024-09-12T17:07:48.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.526+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~5SK54B6UKE9R.0 size=1048576 2024-09-12T17:07:48.531 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.528+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~5SK54B6UKE9R.1 size=998942 2024-09-12T17:07:48.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.530+0000 7f9eaebff780 1 < completed multipart upload key=3LY681252WAN upload=5SK54B6UKE9R tag=FDMT4WNZFYVX type=write size=3096094 2024-09-12T17:07:48.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.532+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=ZOG7OT8U9457 type=del size=284369 2024-09-12T17:07:48.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.534+0000 7f9eaebff780 1 < suggested remove operation key=8DJLYFM11DNI tag=YM3MWLUVA90S type=write 2024-09-12T17:07:48.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.535+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=RY05N4VW632E type=del size=1963388 2024-09-12T17:07:48.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.538+0000 7f9eaebff780 1 < suggested update operation key=UYF1AN2W59VN tag=SDDZAPMAHDH5 type=write size=341291 2024-09-12T17:07:48.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.539+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=VOCG7N4YFULD type=write size=711096 2024-09-12T17:07:48.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.540+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~BZTR75DFGIVD.0 size=998212 2024-09-12T17:07:48.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.542+0000 7f9eaebff780 1 < completed multipart upload key=8DJLYFM11DNI upload=BZTR75DFGIVD tag=9E2YZ20562TF type=write size=2046788 2024-09-12T17:07:48.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.544+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~IYOWFL2M8O2Z.0 size=1048576 2024-09-12T17:07:48.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.546+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~IYOWFL2M8O2Z.1 size=1048576 2024-09-12T17:07:48.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.547+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~IYOWFL2M8O2Z.2 size=172984 2024-09-12T17:07:48.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.547+0000 7f9eaebff780 1 > prepared multipart upload key=YIEP2JYDSLW0 upload=IYOWFL2M8O2Z tag=EDXM8N8E6YUY type=write size=3318712 2024-09-12T17:07:48.550 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.548+0000 7f9eaebff780 1 < completed write operation key=SO6QF2JCRX6E tag=9MD2UHF8HDZE type=write size=96363 2024-09-12T17:07:48.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.549+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=FS2LU9D63DHO type=del size=158722 2024-09-12T17:07:48.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.551+0000 7f9eaebff780 1 < completed delete operation key=0F5LXJZMBFSP tag=SLPBU5DGIZI4 type=del 2024-09-12T17:07:48.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.552+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=8Q70STN2SK6X type=write size=824640 2024-09-12T17:07:48.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.553+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=HFBF24BAFE9E type=del 2024-09-12T17:07:48.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.554+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=CVWTS94SG7TM type=del size=1062223 2024-09-12T17:07:48.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.556+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~YVPUUAU4ZEKK.0 size=1048576 2024-09-12T17:07:48.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.557+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~YVPUUAU4ZEKK.1 size=1048576 2024-09-12T17:07:48.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.558+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~YVPUUAU4ZEKK.2 size=245681 2024-09-12T17:07:48.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.560+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=YVPUUAU4ZEKK tag=NDBT1QSPK1UP type=write size=3391409 2024-09-12T17:07:48.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.562+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~83LLVC1SLBP5.0 size=1048576 2024-09-12T17:07:48.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.563+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~83LLVC1SLBP5.1 size=1048576 2024-09-12T17:07:48.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.564+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~83LLVC1SLBP5.2 size=58039 2024-09-12T17:07:48.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.564+0000 7f9eaebff780 1 > prepared multipart upload key=LRI5G5G8O5X4 upload=83LLVC1SLBP5 tag=7F8DPI11YX09 type=write size=3203767 2024-09-12T17:07:48.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.565+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~C5AS8F3UE6C1.0 size=1048576 2024-09-12T17:07:48.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.566+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~C5AS8F3UE6C1.1 size=1048576 2024-09-12T17:07:48.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.566+0000 7f9eaebff780 1 < canceled part key=_multipart_9WJGBODZ60NJ.2~C5AS8F3UE6C1.2 size=849681 2024-09-12T17:07:48.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.568+0000 7f9eaebff780 1 < canceled multipart upload key=9WJGBODZ60NJ upload=C5AS8F3UE6C1 tag=P2UF41MDOX7L type=write size=3995409 2024-09-12T17:07:48.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.569+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=B31WPBVUUZWM type=del size=1003999 2024-09-12T17:07:48.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.571+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~6TFT3VU6WBLC.0 size=95539 2024-09-12T17:07:48.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.572+0000 7f9eaebff780 1 < completed multipart upload key=M3PLQGSK34YM upload=6TFT3VU6WBLC tag=X6LERBHXIYNR type=write size=1144115 2024-09-12T17:07:48.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.574+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~XF38YD23V4GJ.0 size=1048576 2024-09-12T17:07:48.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.575+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~XF38YD23V4GJ.1 size=913968 2024-09-12T17:07:48.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.575+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=XF38YD23V4GJ tag=NXEZ09YK8BPS type=write size=3011120 2024-09-12T17:07:48.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.578+0000 7f9eaebff780 1 < suggested remove operation key=LJN514F16XJA tag=RREZB190PPS1 type=del 2024-09-12T17:07:48.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.579+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=ZHSENEAPMQXL type=del size=1872495 2024-09-12T17:07:48.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.580+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~HBKEDOZN5MFT.0 size=985858 2024-09-12T17:07:48.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.582+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=HBKEDOZN5MFT tag=4C22M6QB235H type=write size=2034434 2024-09-12T17:07:48.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.583+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=VA16PKB3B8G3 type=del size=4131739 2024-09-12T17:07:48.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.584+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~J18G6OUMUAZ7.0 size=1048576 2024-09-12T17:07:48.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.584+0000 7f9eaebff780 1 < canceled part key=_multipart_K2NHRSUDQBRW.2~J18G6OUMUAZ7.1 size=1048576 2024-09-12T17:07:48.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.585+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~J18G6OUMUAZ7.2 size=346003 2024-09-12T17:07:48.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.587+0000 7f9eaebff780 1 < canceled multipart upload key=K2NHRSUDQBRW upload=J18G6OUMUAZ7 tag=5OPTASHA2S9G type=write size=3491731 2024-09-12T17:07:48.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.588+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=T93I95AO3YD9 type=del size=2540443 2024-09-12T17:07:48.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.590+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=280Y6K3CRW94 type=del 2024-09-12T17:07:48.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.591+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=U7EG7V3D40L6 type=del size=1329393 2024-09-12T17:07:48.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.593+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~OUS8I3EG7IVC.0 size=1048576 2024-09-12T17:07:48.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.594+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~OUS8I3EG7IVC.1 size=163532 2024-09-12T17:07:48.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.596+0000 7f9eaebff780 1 < completed multipart upload key=M3PLQGSK34YM upload=OUS8I3EG7IVC tag=ERY4SJN9S1BT type=write size=2260684 2024-09-12T17:07:48.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.598+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~84YV7YDF0884.0 size=1048576 2024-09-12T17:07:48.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.599+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~84YV7YDF0884.1 size=1048576 2024-09-12T17:07:48.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.600+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~84YV7YDF0884.2 size=884448 2024-09-12T17:07:48.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.600+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=84YV7YDF0884 tag=ZEE8CW9PHT3F type=write size=4030176 2024-09-12T17:07:48.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.601+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~Q6M3JA8GNM0F.0 size=319994 2024-09-12T17:07:48.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.603+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=Q6M3JA8GNM0F tag=ZCNDJWU3KEH6 type=write size=1368570 2024-09-12T17:07:48.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.605+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=OZP25F3WN9DT type=del size=984546 2024-09-12T17:07:48.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.606+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=ZOG7OT8U9457 type=del 2024-09-12T17:07:48.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.608+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~NVACBKOKA3Y5.0 size=1048576 2024-09-12T17:07:48.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.609+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~NVACBKOKA3Y5.1 size=163105 2024-09-12T17:07:48.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.609+0000 7f9eaebff780 1 > prepared multipart upload key=KF8XE48DI9KZ upload=NVACBKOKA3Y5 tag=20N4TD6443YR type=write size=2260257 2024-09-12T17:07:48.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.610+0000 7f9eaebff780 1 < completed delete operation key=GB8P7K59Y8VI tag=RY05N4VW632E type=del 2024-09-12T17:07:48.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.612+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~53HJ2DSTJD20.0 size=1048576 2024-09-12T17:07:48.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.613+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~53HJ2DSTJD20.1 size=1048576 2024-09-12T17:07:48.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.614+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~53HJ2DSTJD20.2 size=335575 2024-09-12T17:07:48.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.614+0000 7f9eaebff780 1 > prepared multipart upload key=TDZCNUZE8IOA upload=53HJ2DSTJD20 tag=GCBFSHI1NI6O type=write size=3481303 2024-09-12T17:07:48.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.616+0000 7f9eaebff780 1 < completed write operation key=8DJLYFM11DNI tag=VOCG7N4YFULD type=write size=711096 2024-09-12T17:07:48.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.617+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=DOOPPPQQ6RPO type=del size=3745612 2024-09-12T17:07:48.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.618+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~IYOWFL2M8O2Z.0 size=1048576 2024-09-12T17:07:48.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.620+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~IYOWFL2M8O2Z.1 size=1048576 2024-09-12T17:07:48.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.621+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~IYOWFL2M8O2Z.2 size=172984 2024-09-12T17:07:48.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.623+0000 7f9eaebff780 1 < completed multipart upload key=YIEP2JYDSLW0 upload=IYOWFL2M8O2Z tag=EDXM8N8E6YUY type=write size=3318712 2024-09-12T17:07:48.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.624+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=FWJ1NC8HEZQS type=del size=3128579 2024-09-12T17:07:48.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.626+0000 7f9eaebff780 1 < canceled operation key=0F5LXJZMBFSP tag=FS2LU9D63DHO type=del size=158722 2024-09-12T17:07:48.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.627+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=YEIPPBSSPR08 type=del size=732685 2024-09-12T17:07:48.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.629+0000 7f9eaebff780 1 < suggested remove operation key=0YD5P1ACZ09Q tag=8Q70STN2SK6X type=write 2024-09-12T17:07:48.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.630+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=JO3LYGT4Y1K6 type=del size=3698819 2024-09-12T17:07:48.634 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.632+0000 7f9eaebff780 1 < completed delete operation key=M3PLQGSK34YM tag=CVWTS94SG7TM type=del 2024-09-12T17:07:48.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.634+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~ZB4C2AJ4L5V3.0 size=1048576 2024-09-12T17:07:48.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.635+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~ZB4C2AJ4L5V3.1 size=419001 2024-09-12T17:07:48.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.635+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=ZB4C2AJ4L5V3 tag=DSN788KNGAIG type=write size=2516153 2024-09-12T17:07:48.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.637+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~83LLVC1SLBP5.0 size=1048576 2024-09-12T17:07:48.640 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.638+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~83LLVC1SLBP5.1 size=1048576 2024-09-12T17:07:48.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.639+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~83LLVC1SLBP5.2 size=58039 2024-09-12T17:07:48.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.641+0000 7f9eaebff780 1 < completed multipart upload key=LRI5G5G8O5X4 upload=83LLVC1SLBP5 tag=7F8DPI11YX09 type=write size=3203767 2024-09-12T17:07:48.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.642+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=X4OMB9L1WA5N type=del size=329963 2024-09-12T17:07:48.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.643+0000 7f9eaebff780 1 < completed delete operation key=GB8P7K59Y8VI tag=B31WPBVUUZWM type=del 2024-09-12T17:07:48.648 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.646+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~82Z3C30W7I6C.0 size=1048576 2024-09-12T17:07:48.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.647+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~82Z3C30W7I6C.1 size=1048576 2024-09-12T17:07:48.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.648+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~82Z3C30W7I6C.2 size=272780 2024-09-12T17:07:48.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.648+0000 7f9eaebff780 1 > prepared multipart upload key=LRI5G5G8O5X4 upload=82Z3C30W7I6C tag=W98NMAQXQUVH type=write size=3418508 2024-09-12T17:07:48.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.649+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~XF38YD23V4GJ.0 size=1048576 2024-09-12T17:07:48.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.649+0000 7f9eaebff780 1 < canceled part key=_multipart_SHWT6AT7PN0M.2~XF38YD23V4GJ.1 size=913968 2024-09-12T17:07:48.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.651+0000 7f9eaebff780 1 < canceled multipart upload key=SHWT6AT7PN0M upload=XF38YD23V4GJ tag=NXEZ09YK8BPS type=write size=3011120 2024-09-12T17:07:48.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.654+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~YCP2QBYGASR8.0 size=1048576 2024-09-12T17:07:48.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.655+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~YCP2QBYGASR8.1 size=1048576 2024-09-12T17:07:48.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.656+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~YCP2QBYGASR8.2 size=28853 2024-09-12T17:07:48.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.656+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=YCP2QBYGASR8 tag=KMZER74AEZB8 type=write size=3174581 2024-09-12T17:07:48.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.657+0000 7f9eaebff780 1 < canceled operation key=OH6GXTMPBYUY tag=ZHSENEAPMQXL type=del size=1872495 2024-09-12T17:07:48.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.658+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=FYMIVVERH37A type=del size=217244 2024-09-12T17:07:48.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.660+0000 7f9eaebff780 1 < completed delete operation key=GB8P7K59Y8VI tag=VA16PKB3B8G3 type=del 2024-09-12T17:07:48.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.662+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~1UBSWCI88OMX.0 size=658212 2024-09-12T17:07:48.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.662+0000 7f9eaebff780 1 > prepared multipart upload key=3LY681252WAN upload=1UBSWCI88OMX tag=39LRFM0S8Y3B type=write size=1706788 2024-09-12T17:07:48.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.663+0000 7f9eaebff780 1 < completed delete operation key=SO6QF2JCRX6E tag=T93I95AO3YD9 type=del 2024-09-12T17:07:48.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.664+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=NROLBHEU4P2Q type=del size=3812541 2024-09-12T17:07:48.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.666+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=U7EG7V3D40L6 type=del 2024-09-12T17:07:48.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.667+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=YC3SDAOI2GKR type=del size=3367424 2024-09-12T17:07:48.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.668+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~84YV7YDF0884.0 size=1048576 2024-09-12T17:07:48.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.669+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~84YV7YDF0884.1 size=1048576 2024-09-12T17:07:48.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.670+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~84YV7YDF0884.2 size=884448 2024-09-12T17:07:48.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.672+0000 7f9eaebff780 1 < completed multipart upload key=K2NHRSUDQBRW upload=84YV7YDF0884 tag=ZEE8CW9PHT3F type=write size=4030176 2024-09-12T17:07:48.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.673+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=00DWJDV00628 type=write size=320114 2024-09-12T17:07:48.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.676+0000 7f9eaebff780 1 < suggested remove operation key=OGD6H9VSVGWF tag=OZP25F3WN9DT type=del 2024-09-12T17:07:48.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.677+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=QLUVBBVAQRV8 type=del size=1051874 2024-09-12T17:07:48.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.678+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~NVACBKOKA3Y5.0 size=1048576 2024-09-12T17:07:48.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.678+0000 7f9eaebff780 1 < canceled part key=_multipart_KF8XE48DI9KZ.2~NVACBKOKA3Y5.1 size=163105 2024-09-12T17:07:48.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.680+0000 7f9eaebff780 1 < canceled multipart upload key=KF8XE48DI9KZ upload=NVACBKOKA3Y5 tag=20N4TD6443YR type=write size=2260257 2024-09-12T17:07:48.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.682+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~GGE0F3E2Q2FX.0 size=1048576 2024-09-12T17:07:48.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.683+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~GGE0F3E2Q2FX.1 size=1048576 2024-09-12T17:07:48.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.684+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~GGE0F3E2Q2FX.2 size=864857 2024-09-12T17:07:48.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.684+0000 7f9eaebff780 1 > prepared multipart upload key=ZC814TPVLJO1 upload=GGE0F3E2Q2FX tag=ZN12S1VSKEQL type=write size=4010585 2024-09-12T17:07:48.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.685+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~53HJ2DSTJD20.0 size=1048576 2024-09-12T17:07:48.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.685+0000 7f9eaebff780 1 < canceled part key=_multipart_TDZCNUZE8IOA.2~53HJ2DSTJD20.1 size=1048576 2024-09-12T17:07:48.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.686+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~53HJ2DSTJD20.2 size=335575 2024-09-12T17:07:48.691 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.688+0000 7f9eaebff780 1 < canceled multipart upload key=TDZCNUZE8IOA upload=53HJ2DSTJD20 tag=GCBFSHI1NI6O type=write size=3481303 2024-09-12T17:07:48.692 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.690+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=UK3SQXKT8VD5 type=del size=1789394 2024-09-12T17:07:48.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.692+0000 7f9eaebff780 1 < suggested remove operation key=P9GMGM3WK6O7 tag=DOOPPPQQ6RPO type=del 2024-09-12T17:07:48.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.695+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~X7J03XABELJB.0 size=1048576 2024-09-12T17:07:48.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.696+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~X7J03XABELJB.1 size=3452 2024-09-12T17:07:48.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.696+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=X7J03XABELJB tag=J2EACB1L1RJF type=write size=2100604 2024-09-12T17:07:48.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.697+0000 7f9eaebff780 1 < completed delete operation key=ZYP3P4031PUZ tag=FWJ1NC8HEZQS type=del 2024-09-12T17:07:48.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.699+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~ONL99GA6BTQK.0 size=679765 2024-09-12T17:07:48.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.699+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=ONL99GA6BTQK tag=TZQM32T0ZTLD type=write size=1728341 2024-09-12T17:07:48.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.701+0000 7f9eaebff780 1 < suggested update operation key=9WJGBODZ60NJ tag=YEIPPBSSPR08 type=del size=732685 2024-09-12T17:07:48.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.703+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~0WK4M8IZF4GU.0 size=1048576 2024-09-12T17:07:48.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.704+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~0WK4M8IZF4GU.1 size=148551 2024-09-12T17:07:48.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.704+0000 7f9eaebff780 1 > prepared multipart upload key=ZYP3P4031PUZ upload=0WK4M8IZF4GU tag=P8N5648WOD6L type=write size=2245703 2024-09-12T17:07:48.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.707+0000 7f9eaebff780 1 < suggested update operation key=KF8XE48DI9KZ tag=JO3LYGT4Y1K6 type=del size=3698819 2024-09-12T17:07:48.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.709+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~VOM20KQXH2DJ.0 size=1048576 2024-09-12T17:07:48.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.710+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~VOM20KQXH2DJ.1 size=274656 2024-09-12T17:07:48.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.710+0000 7f9eaebff780 1 > prepared multipart upload key=YIEP2JYDSLW0 upload=VOM20KQXH2DJ tag=SAWSMRYY2IBA type=write size=2371808 2024-09-12T17:07:48.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.711+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~ZB4C2AJ4L5V3.0 size=1048576 2024-09-12T17:07:48.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.712+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~ZB4C2AJ4L5V3.1 size=419001 2024-09-12T17:07:48.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.714+0000 7f9eaebff780 1 < completed multipart upload key=P9GMGM3WK6O7 upload=ZB4C2AJ4L5V3 tag=DSN788KNGAIG type=write size=2516153 2024-09-12T17:07:48.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.715+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=5C830DIA0NGM type=del size=175334 2024-09-12T17:07:48.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.718+0000 7f9eaebff780 1 < suggested remove operation key=OH6GXTMPBYUY tag=X4OMB9L1WA5N type=del 2024-09-12T17:07:48.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.719+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=QIL98Z3X7KI1 type=del size=788100 2024-09-12T17:07:48.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.720+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~82Z3C30W7I6C.0 size=1048576 2024-09-12T17:07:48.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.722+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~82Z3C30W7I6C.1 size=1048576 2024-09-12T17:07:48.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.723+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~82Z3C30W7I6C.2 size=272780 2024-09-12T17:07:48.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.725+0000 7f9eaebff780 1 < completed multipart upload key=LRI5G5G8O5X4 upload=82Z3C30W7I6C tag=W98NMAQXQUVH type=write size=3418508 2024-09-12T17:07:48.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.727+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~2ST39H0NTJO3.0 size=1048576 2024-09-12T17:07:48.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.728+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~2ST39H0NTJO3.1 size=918469 2024-09-12T17:07:48.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.728+0000 7f9eaebff780 1 > prepared multipart upload key=9I6RGNRB6HSY upload=2ST39H0NTJO3 tag=47B94OSW25JT type=write size=3015621 2024-09-12T17:07:48.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.729+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~YCP2QBYGASR8.0 size=1048576 2024-09-12T17:07:48.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.729+0000 7f9eaebff780 1 < canceled part key=_multipart_SHWT6AT7PN0M.2~YCP2QBYGASR8.1 size=1048576 2024-09-12T17:07:48.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.730+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~YCP2QBYGASR8.2 size=28853 2024-09-12T17:07:48.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.732+0000 7f9eaebff780 1 < canceled multipart upload key=SHWT6AT7PN0M upload=YCP2QBYGASR8 tag=KMZER74AEZB8 type=write size=3174581 2024-09-12T17:07:48.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.735+0000 7f9eaebff780 1 > prepared part key=_multipart_TXHXOMIB4B53.2~88DI0I50YEDP.0 size=1048576 2024-09-12T17:07:48.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.736+0000 7f9eaebff780 1 > prepared part key=_multipart_TXHXOMIB4B53.2~88DI0I50YEDP.1 size=1048576 2024-09-12T17:07:48.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.737+0000 7f9eaebff780 1 > prepared part key=_multipart_TXHXOMIB4B53.2~88DI0I50YEDP.2 size=511869 2024-09-12T17:07:48.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.737+0000 7f9eaebff780 1 > prepared multipart upload key=TXHXOMIB4B53 upload=88DI0I50YEDP tag=OOWOHG8I0EZE type=write size=3657597 2024-09-12T17:07:48.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.738+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=FYMIVVERH37A type=del 2024-09-12T17:07:48.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.739+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=HZ4R2M6F5YVP type=del size=570651 2024-09-12T17:07:48.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.741+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~1UBSWCI88OMX.0 size=658212 2024-09-12T17:07:48.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.743+0000 7f9eaebff780 1 < completed multipart upload key=3LY681252WAN upload=1UBSWCI88OMX tag=39LRFM0S8Y3B type=write size=1706788 2024-09-12T17:07:48.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.745+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~BDMCOEYHEC9R.0 size=1048576 2024-09-12T17:07:48.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.746+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~BDMCOEYHEC9R.1 size=1048576 2024-09-12T17:07:48.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.747+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~BDMCOEYHEC9R.2 size=500016 2024-09-12T17:07:48.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.747+0000 7f9eaebff780 1 > prepared multipart upload key=3VY271ZBO754 upload=BDMCOEYHEC9R tag=0WXXLRP34B8T type=write size=3645744 2024-09-12T17:07:48.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.748+0000 7f9eaebff780 1 < completed delete operation key=SHWT6AT7PN0M tag=NROLBHEU4P2Q type=del 2024-09-12T17:07:48.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.750+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=QTC932I0BNGG type=del size=2878805 2024-09-12T17:07:48.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.753+0000 7f9eaebff780 1 < suggested update operation key=7PBT9VZ07OUI tag=YC3SDAOI2GKR type=del size=3367424 2024-09-12T17:07:48.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.755+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~JA3MREBAJC3W.0 size=1048576 2024-09-12T17:07:48.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.756+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~JA3MREBAJC3W.1 size=1048576 2024-09-12T17:07:48.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.757+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~JA3MREBAJC3W.2 size=650361 2024-09-12T17:07:48.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.757+0000 7f9eaebff780 1 > prepared multipart upload key=CAIZM33SDFPM upload=JA3MREBAJC3W tag=800J0B1TFY1V type=write size=3796089 2024-09-12T17:07:48.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.759+0000 7f9eaebff780 1 < completed write operation key=LJN514F16XJA tag=00DWJDV00628 type=write size=320114 2024-09-12T17:07:48.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.761+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~CW5QBQYAC72O.0 size=1048576 2024-09-12T17:07:48.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.762+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~CW5QBQYAC72O.1 size=396008 2024-09-12T17:07:48.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.762+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=CW5QBQYAC72O tag=QDIGBQHU4673 type=write size=2493160 2024-09-12T17:07:48.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.763+0000 7f9eaebff780 1 < completed delete operation key=SHWT6AT7PN0M tag=QLUVBBVAQRV8 type=del 2024-09-12T17:07:48.767 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.764+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=D55TANT8JFQ3 type=write size=460798 2024-09-12T17:07:48.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.766+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~GGE0F3E2Q2FX.0 size=1048576 2024-09-12T17:07:48.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.767+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~GGE0F3E2Q2FX.1 size=1048576 2024-09-12T17:07:48.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.770+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~GGE0F3E2Q2FX.2 size=864857 2024-09-12T17:07:48.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.772+0000 7f9eaebff780 1 < completed multipart upload key=ZC814TPVLJO1 upload=GGE0F3E2Q2FX tag=ZN12S1VSKEQL type=write size=4010585 2024-09-12T17:07:48.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.775+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~9UODCF1HERT1.0 size=1048576 2024-09-12T17:07:48.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.775+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~9UODCF1HERT1.1 size=936783 2024-09-12T17:07:48.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.775+0000 7f9eaebff780 1 > prepared multipart upload key=0F5LXJZMBFSP upload=9UODCF1HERT1 tag=Y2PO2O2YIYTA type=write size=3033935 2024-09-12T17:07:48.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.777+0000 7f9eaebff780 1 < completed delete operation key=3VY271ZBO754 tag=UK3SQXKT8VD5 type=del 2024-09-12T17:07:48.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.778+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=BJ29Y0ILXGL1 type=del size=984869 2024-09-12T17:07:48.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.779+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~X7J03XABELJB.0 size=1048576 2024-09-12T17:07:48.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.780+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~X7J03XABELJB.1 size=3452 2024-09-12T17:07:48.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.782+0000 7f9eaebff780 1 < completed multipart upload key=P9GMGM3WK6O7 upload=X7J03XABELJB tag=J2EACB1L1RJF type=write size=2100604 2024-09-12T17:07:48.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.783+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=XHNM1PSLW8VH type=del size=1964747 2024-09-12T17:07:48.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.784+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~ONL99GA6BTQK.0 size=679765 2024-09-12T17:07:48.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.786+0000 7f9eaebff780 1 < completed multipart upload key=UYF1AN2W59VN upload=ONL99GA6BTQK tag=TZQM32T0ZTLD type=write size=1728341 2024-09-12T17:07:48.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.787+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=WCBHOWO28FXD type=del size=387435 2024-09-12T17:07:48.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.788+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~0WK4M8IZF4GU.0 size=1048576 2024-09-12T17:07:48.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.789+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~0WK4M8IZF4GU.1 size=148551 2024-09-12T17:07:48.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.791+0000 7f9eaebff780 1 < completed multipart upload key=ZYP3P4031PUZ upload=0WK4M8IZF4GU tag=P8N5648WOD6L type=write size=2245703 2024-09-12T17:07:48.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.792+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=6NZFG3TD2G5I type=del size=183548 2024-09-12T17:07:48.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.793+0000 7f9eaebff780 1 < canceled part key=_multipart_YIEP2JYDSLW0.2~VOM20KQXH2DJ.0 size=1048576 2024-09-12T17:07:48.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.794+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~VOM20KQXH2DJ.1 size=274656 2024-09-12T17:07:48.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.796+0000 7f9eaebff780 1 < canceled multipart upload key=YIEP2JYDSLW0 upload=VOM20KQXH2DJ tag=SAWSMRYY2IBA type=write size=2371808 2024-09-12T17:07:48.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.798+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~2KUEWJDAJ6HH.0 size=1048576 2024-09-12T17:07:48.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.798+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~2KUEWJDAJ6HH.1 size=186720 2024-09-12T17:07:48.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.798+0000 7f9eaebff780 1 > prepared multipart upload key=CAIZM33SDFPM upload=2KUEWJDAJ6HH tag=62X6KBBCKLIO type=write size=2283872 2024-09-12T17:07:48.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.800+0000 7f9eaebff780 1 < completed delete operation key=0F5LXJZMBFSP tag=5C830DIA0NGM type=del 2024-09-12T17:07:48.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.801+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=R6PMTJ7TZ3OL type=del size=4081654 2024-09-12T17:07:48.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.802+0000 7f9eaebff780 1 < completed delete operation key=P9GMGM3WK6O7 tag=QIL98Z3X7KI1 type=del 2024-09-12T17:07:48.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.803+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=KX70NU9V2WOM type=write size=32544 2024-09-12T17:07:48.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.804+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~2ST39H0NTJO3.0 size=1048576 2024-09-12T17:07:48.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.805+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~2ST39H0NTJO3.1 size=918469 2024-09-12T17:07:48.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.807+0000 7f9eaebff780 1 < completed multipart upload key=9I6RGNRB6HSY upload=2ST39H0NTJO3 tag=47B94OSW25JT type=write size=3015621 2024-09-12T17:07:48.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.808+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=09JUI13X3BDT type=del size=1944753 2024-09-12T17:07:48.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.810+0000 7f9eaebff780 1 < completed part key=_multipart_TXHXOMIB4B53.2~88DI0I50YEDP.0 size=1048576 2024-09-12T17:07:48.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.811+0000 7f9eaebff780 1 < completed part key=_multipart_TXHXOMIB4B53.2~88DI0I50YEDP.1 size=1048576 2024-09-12T17:07:48.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.812+0000 7f9eaebff780 1 < completed part key=_multipart_TXHXOMIB4B53.2~88DI0I50YEDP.2 size=511869 2024-09-12T17:07:48.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.814+0000 7f9eaebff780 1 < completed multipart upload key=TXHXOMIB4B53 upload=88DI0I50YEDP tag=OOWOHG8I0EZE type=write size=3657597 2024-09-12T17:07:48.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.816+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~MXU7XT2IHXAK.0 size=1048576 2024-09-12T17:07:48.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.817+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~MXU7XT2IHXAK.1 size=1048576 2024-09-12T17:07:48.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.817+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~MXU7XT2IHXAK.2 size=443290 2024-09-12T17:07:48.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.817+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=MXU7XT2IHXAK tag=WZZJST4G1GKW type=write size=3589018 2024-09-12T17:07:48.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.819+0000 7f9eaebff780 1 < completed delete operation key=9I6RGNRB6HSY tag=HZ4R2M6F5YVP type=del 2024-09-12T17:07:48.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.820+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=YWOOPGE0YGVA type=del size=1718243 2024-09-12T17:07:48.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.821+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~BDMCOEYHEC9R.0 size=1048576 2024-09-12T17:07:48.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.822+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~BDMCOEYHEC9R.1 size=1048576 2024-09-12T17:07:48.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.823+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~BDMCOEYHEC9R.2 size=500016 2024-09-12T17:07:48.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.826+0000 7f9eaebff780 1 < completed multipart upload key=3VY271ZBO754 upload=BDMCOEYHEC9R tag=0WXXLRP34B8T type=write size=3645744 2024-09-12T17:07:48.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.827+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=W642L96E5LCA type=del size=3293396 2024-09-12T17:07:48.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.829+0000 7f9eaebff780 1 < suggested update operation key=9I6RGNRB6HSY tag=QTC932I0BNGG type=del size=2878805 2024-09-12T17:07:48.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.831+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=FAD723JS21UI type=del size=2924848 2024-09-12T17:07:48.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.832+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~JA3MREBAJC3W.0 size=1048576 2024-09-12T17:07:48.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.833+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~JA3MREBAJC3W.1 size=1048576 2024-09-12T17:07:48.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.835+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~JA3MREBAJC3W.2 size=650361 2024-09-12T17:07:48.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.837+0000 7f9eaebff780 1 < completed multipart upload key=CAIZM33SDFPM upload=JA3MREBAJC3W tag=800J0B1TFY1V type=write size=3796089 2024-09-12T17:07:48.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.838+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=YPE8JVTD873K type=del size=1763153 2024-09-12T17:07:48.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.839+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~CW5QBQYAC72O.0 size=1048576 2024-09-12T17:07:48.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.840+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~CW5QBQYAC72O.1 size=396008 2024-09-12T17:07:48.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.843+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=CW5QBQYAC72O tag=QDIGBQHU4673 type=write size=2493160 2024-09-12T17:07:48.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.844+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=N9FGQ2PXLH51 type=write size=793644 2024-09-12T17:07:48.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.845+0000 7f9eaebff780 -1 < failed to complete operation key=9I6RGNRB6HSY tag=D55TANT8JFQ3 type=write size=460798: (22) Invalid argument 2024-09-12T17:07:48.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.847+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~397HZK04NYSM.0 size=1048576 2024-09-12T17:07:48.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.848+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~397HZK04NYSM.1 size=493597 2024-09-12T17:07:48.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.848+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=397HZK04NYSM tag=182KCMWNM7NX type=write size=2590749 2024-09-12T17:07:48.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.850+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~9UODCF1HERT1.0 size=1048576 2024-09-12T17:07:48.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.851+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~9UODCF1HERT1.1 size=936783 2024-09-12T17:07:48.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.853+0000 7f9eaebff780 1 < completed multipart upload key=0F5LXJZMBFSP upload=9UODCF1HERT1 tag=Y2PO2O2YIYTA type=write size=3033935 2024-09-12T17:07:48.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.854+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=GMOKCT0Z0RCV type=write size=1035529 2024-09-12T17:07:48.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.856+0000 7f9eaebff780 1 < completed delete operation key=0F5LXJZMBFSP tag=BJ29Y0ILXGL1 type=del 2024-09-12T17:07:48.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.858+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~T8GV8JDEIK3A.0 size=950646 2024-09-12T17:07:48.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.858+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=T8GV8JDEIK3A tag=ML7KHPNTVOZ5 type=write size=1999222 2024-09-12T17:07:48.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.859+0000 7f9eaebff780 1 < completed delete operation key=M3PLQGSK34YM tag=XHNM1PSLW8VH type=del 2024-09-12T17:07:48.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.861+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~A6VX2SDAL5L8.0 size=1048576 2024-09-12T17:07:48.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.862+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~A6VX2SDAL5L8.1 size=1048576 2024-09-12T17:07:48.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.863+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~A6VX2SDAL5L8.2 size=641543 2024-09-12T17:07:48.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.863+0000 7f9eaebff780 1 > prepared multipart upload key=0YD5P1ACZ09Q upload=A6VX2SDAL5L8 tag=ANQKEJWEDNM8 type=write size=3787271 2024-09-12T17:07:48.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.865+0000 7f9eaebff780 1 < completed delete operation key=K2NHRSUDQBRW tag=WCBHOWO28FXD type=del 2024-09-12T17:07:48.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.866+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=L37NMTZ1NBQ6 type=del size=2029094 2024-09-12T17:07:48.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.869+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=6NZFG3TD2G5I type=del 2024-09-12T17:07:48.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.870+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=D0CFN00POE3F type=del size=1318724 2024-09-12T17:07:48.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.872+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~2KUEWJDAJ6HH.0 size=1048576 2024-09-12T17:07:48.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.873+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~2KUEWJDAJ6HH.1 size=186720 2024-09-12T17:07:48.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.875+0000 7f9eaebff780 1 < completed multipart upload key=CAIZM33SDFPM upload=2KUEWJDAJ6HH tag=62X6KBBCKLIO type=write size=2283872 2024-09-12T17:07:48.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.876+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=1MP1ZH3VK28U type=write size=734715 2024-09-12T17:07:48.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.877+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=R6PMTJ7TZ3OL type=del 2024-09-12T17:07:48.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.878+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=3Y6MFMGBXNUG type=del size=754747 2024-09-12T17:07:48.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.879+0000 7f9eaebff780 1 < completed write operation key=0YD5P1ACZ09Q tag=KX70NU9V2WOM type=write size=32544 2024-09-12T17:07:48.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.881+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=LVZXY9YPVUO9 type=del size=3506552 2024-09-12T17:07:48.884 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.882+0000 7f9eaebff780 1 < completed delete operation key=8DJLYFM11DNI tag=09JUI13X3BDT type=del 2024-09-12T17:07:48.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.883+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=1EQCOBSA4POM type=del size=1233514 2024-09-12T17:07:48.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.884+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~MXU7XT2IHXAK.0 size=1048576 2024-09-12T17:07:48.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.884+0000 7f9eaebff780 1 < canceled part key=_multipart_UYF1AN2W59VN.2~MXU7XT2IHXAK.1 size=1048576 2024-09-12T17:07:48.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.885+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~MXU7XT2IHXAK.2 size=443290 2024-09-12T17:07:48.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.887+0000 7f9eaebff780 1 < canceled multipart upload key=UYF1AN2W59VN upload=MXU7XT2IHXAK tag=WZZJST4G1GKW type=write size=3589018 2024-09-12T17:07:48.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.888+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=1T5A5YCW249Q type=del size=2237063 2024-09-12T17:07:48.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.889+0000 7f9eaebff780 1 < completed delete operation key=EKUW5AKC428U tag=YWOOPGE0YGVA type=del 2024-09-12T17:07:48.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.892+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~39MLF7OY2PMU.0 size=1048576 2024-09-12T17:07:48.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.892+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~39MLF7OY2PMU.1 size=1048576 2024-09-12T17:07:48.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.894+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~39MLF7OY2PMU.2 size=769123 2024-09-12T17:07:48.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.894+0000 7f9eaebff780 1 > prepared multipart upload key=9I6RGNRB6HSY upload=39MLF7OY2PMU tag=52FXHX3YWTCM type=write size=3914851 2024-09-12T17:07:48.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.895+0000 7f9eaebff780 1 < completed delete operation key=SO6QF2JCRX6E tag=W642L96E5LCA type=del 2024-09-12T17:07:48.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.897+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~T9WHJ5J9IYPW.0 size=1048576 2024-09-12T17:07:48.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.898+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~T9WHJ5J9IYPW.1 size=120015 2024-09-12T17:07:48.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.898+0000 7f9eaebff780 1 > prepared multipart upload key=LJN514F16XJA upload=T9WHJ5J9IYPW tag=32R8EBNRL4MR type=write size=2217167 2024-09-12T17:07:48.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.899+0000 7f9eaebff780 1 < canceled operation key=TXHXOMIB4B53 tag=FAD723JS21UI type=del size=2924848 2024-09-12T17:07:48.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.901+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~YW5JRVAA1JRW.0 size=1048576 2024-09-12T17:07:48.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.902+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~YW5JRVAA1JRW.1 size=692756 2024-09-12T17:07:48.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.902+0000 7f9eaebff780 1 > prepared multipart upload key=QIMNK4DL3D0N upload=YW5JRVAA1JRW tag=WAWDVQEO3ML7 type=write size=2789908 2024-09-12T17:07:48.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.904+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=YPE8JVTD873K type=del 2024-09-12T17:07:48.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.906+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~VVOWTWT1QLDE.0 size=1048576 2024-09-12T17:07:48.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.907+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~VVOWTWT1QLDE.1 size=531854 2024-09-12T17:07:48.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.907+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=VVOWTWT1QLDE tag=9GWAA98C2OFM type=write size=2629006 2024-09-12T17:07:48.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.910+0000 7f9eaebff780 1 < suggested update operation key=SHWT6AT7PN0M tag=N9FGQ2PXLH51 type=write size=793644 2024-09-12T17:07:48.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.912+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~PL7J4JWA55H3.0 size=1048576 2024-09-12T17:07:48.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.913+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~PL7J4JWA55H3.1 size=1048576 2024-09-12T17:07:48.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.914+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~PL7J4JWA55H3.2 size=83588 2024-09-12T17:07:48.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.914+0000 7f9eaebff780 1 > prepared multipart upload key=GB8P7K59Y8VI upload=PL7J4JWA55H3 tag=A41D9YJ7VK5Z type=write size=3229316 2024-09-12T17:07:48.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.915+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~397HZK04NYSM.0 size=1048576 2024-09-12T17:07:48.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.916+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~397HZK04NYSM.1 size=493597 2024-09-12T17:07:48.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.918+0000 7f9eaebff780 1 < completed multipart upload key=UYF1AN2W59VN upload=397HZK04NYSM tag=182KCMWNM7NX type=write size=2590749 2024-09-12T17:07:48.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.919+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=QXC3YD1W15XR type=del size=210534 2024-09-12T17:07:48.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.920+0000 7f9eaebff780 1 < completed write operation key=P9GMGM3WK6O7 tag=GMOKCT0Z0RCV type=write size=1035529 2024-09-12T17:07:48.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.921+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=P5VZWHAV5QIZ type=del size=1005342 2024-09-12T17:07:48.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.922+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~T8GV8JDEIK3A.0 size=950646 2024-09-12T17:07:48.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.924+0000 7f9eaebff780 1 < completed multipart upload key=P9GMGM3WK6O7 upload=T8GV8JDEIK3A tag=ML7KHPNTVOZ5 type=write size=1999222 2024-09-12T17:07:48.928 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.925+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=YJVL0GRUTFEL type=write size=822009 2024-09-12T17:07:48.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.926+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~A6VX2SDAL5L8.0 size=1048576 2024-09-12T17:07:48.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.927+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~A6VX2SDAL5L8.1 size=1048576 2024-09-12T17:07:48.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.928+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~A6VX2SDAL5L8.2 size=641543 2024-09-12T17:07:48.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.930+0000 7f9eaebff780 1 < completed multipart upload key=0YD5P1ACZ09Q upload=A6VX2SDAL5L8 tag=ANQKEJWEDNM8 type=write size=3787271 2024-09-12T17:07:48.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.932+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=4PANVG1O7OY2 type=del size=684677 2024-09-12T17:07:48.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.934+0000 7f9eaebff780 1 < suggested remove operation key=SVWPQETL92QU tag=L37NMTZ1NBQ6 type=del 2024-09-12T17:07:48.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.936+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~S3WJURFOGQOE.0 size=767 2024-09-12T17:07:48.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.936+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=S3WJURFOGQOE tag=P07R8I4VXF0F type=write size=1049343 2024-09-12T17:07:48.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.937+0000 7f9eaebff780 1 < completed delete operation key=M3PLQGSK34YM tag=D0CFN00POE3F type=del 2024-09-12T17:07:48.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.940+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~3SP60FRXX6ZS.0 size=141205 2024-09-12T17:07:48.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.940+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=3SP60FRXX6ZS tag=HABOT5SGVG59 type=write size=1189781 2024-09-12T17:07:48.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.942+0000 7f9eaebff780 1 < suggested remove operation key=KF8XE48DI9KZ tag=1MP1ZH3VK28U type=write 2024-09-12T17:07:48.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.943+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=R9KRTY5E0CK0 type=del size=2829108 2024-09-12T17:07:48.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.944+0000 7f9eaebff780 1 < completed delete operation key=TDZCNUZE8IOA tag=3Y6MFMGBXNUG type=del 2024-09-12T17:07:48.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.946+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=U8TTJRF3IZ8O type=del size=848295 2024-09-12T17:07:48.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.947+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=LVZXY9YPVUO9 type=del 2024-09-12T17:07:48.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.948+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=HQ98RVT03T1Z type=del size=97656 2024-09-12T17:07:48.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.949+0000 7f9eaebff780 1 < completed delete operation key=TDZCNUZE8IOA tag=1EQCOBSA4POM type=del 2024-09-12T17:07:48.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.950+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=O7I5I6KB2EAF type=del size=1249030 2024-09-12T17:07:48.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.953+0000 7f9eaebff780 1 < suggested remove operation key=0YD5P1ACZ09Q tag=1T5A5YCW249Q type=del 2024-09-12T17:07:48.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.955+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~2Y0Q8QYSIX6V.0 size=1048576 2024-09-12T17:07:48.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.956+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~2Y0Q8QYSIX6V.1 size=430756 2024-09-12T17:07:48.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.956+0000 7f9eaebff780 1 > prepared multipart upload key=ZC814TPVLJO1 upload=2Y0Q8QYSIX6V tag=MR5D8N9ZATCM type=write size=2527908 2024-09-12T17:07:48.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.957+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~39MLF7OY2PMU.0 size=1048576 2024-09-12T17:07:48.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.958+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~39MLF7OY2PMU.1 size=1048576 2024-09-12T17:07:48.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.959+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~39MLF7OY2PMU.2 size=769123 2024-09-12T17:07:48.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.961+0000 7f9eaebff780 1 < completed multipart upload key=9I6RGNRB6HSY upload=39MLF7OY2PMU tag=52FXHX3YWTCM type=write size=3914851 2024-09-12T17:07:48.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.962+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=06C7C2BQ9AWL type=del size=2991815 2024-09-12T17:07:48.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.962+0000 7f9eaebff780 1 < canceled part key=_multipart_LJN514F16XJA.2~T9WHJ5J9IYPW.0 size=1048576 2024-09-12T17:07:48.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.963+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~T9WHJ5J9IYPW.1 size=120015 2024-09-12T17:07:48.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.965+0000 7f9eaebff780 1 < canceled multipart upload key=LJN514F16XJA upload=T9WHJ5J9IYPW tag=32R8EBNRL4MR type=write size=2217167 2024-09-12T17:07:48.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.967+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=5KM1MCWY1FA5 type=del size=4051625 2024-09-12T17:07:48.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.968+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~YW5JRVAA1JRW.0 size=1048576 2024-09-12T17:07:48.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.969+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~YW5JRVAA1JRW.1 size=692756 2024-09-12T17:07:48.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.971+0000 7f9eaebff780 1 < completed multipart upload key=QIMNK4DL3D0N upload=YW5JRVAA1JRW tag=WAWDVQEO3ML7 type=write size=2789908 2024-09-12T17:07:48.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.972+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=B56MXA3NNYZ2 type=del size=1696120 2024-09-12T17:07:48.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.973+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~VVOWTWT1QLDE.0 size=1048576 2024-09-12T17:07:48.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.974+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~VVOWTWT1QLDE.1 size=531854 2024-09-12T17:07:48.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.976+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=VVOWTWT1QLDE tag=9GWAA98C2OFM type=write size=2629006 2024-09-12T17:07:48.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.979+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=GD40GI5OUVSF type=write size=308879 2024-09-12T17:07:48.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.980+0000 7f9eaebff780 1 < completed part key=_multipart_GB8P7K59Y8VI.2~PL7J4JWA55H3.0 size=1048576 2024-09-12T17:07:48.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.980+0000 7f9eaebff780 1 < canceled part key=_multipart_GB8P7K59Y8VI.2~PL7J4JWA55H3.1 size=1048576 2024-09-12T17:07:48.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.983+0000 7f9eaebff780 1 < completed part key=_multipart_GB8P7K59Y8VI.2~PL7J4JWA55H3.2 size=83588 2024-09-12T17:07:48.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.985+0000 7f9eaebff780 1 < canceled multipart upload key=GB8P7K59Y8VI upload=PL7J4JWA55H3 tag=A41D9YJ7VK5Z type=write size=3229316 2024-09-12T17:07:48.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.987+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~YO2FUN15BGWI.0 size=1048576 2024-09-12T17:07:48.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.988+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~YO2FUN15BGWI.1 size=1023846 2024-09-12T17:07:48.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.988+0000 7f9eaebff780 1 > prepared multipart upload key=SO6QF2JCRX6E upload=YO2FUN15BGWI tag=DN5RPHLRIZGV type=write size=3120998 2024-09-12T17:07:48.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.989+0000 7f9eaebff780 1 < completed delete operation key=GB8P7K59Y8VI tag=QXC3YD1W15XR type=del 2024-09-12T17:07:48.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.991+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~OXJ77KR6M9M4.0 size=1048576 2024-09-12T17:07:48.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.992+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~OXJ77KR6M9M4.1 size=48308 2024-09-12T17:07:48.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.992+0000 7f9eaebff780 1 > prepared multipart upload key=3VY271ZBO754 upload=OXJ77KR6M9M4 tag=VWFPMD5DZV88 type=write size=2145460 2024-09-12T17:07:48.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.993+0000 7f9eaebff780 -1 < no bi entry to suggest for operation key=KF8XE48DI9KZ tag=P5VZWHAV5QIZ type=del size=1005342: (2) No such file or directory 2024-09-12T17:07:48.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.994+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=KNV84AIJZPBS type=write size=868793 2024-09-12T17:07:48.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.995+0000 7f9eaebff780 1 < completed write operation key=9I6RGNRB6HSY tag=YJVL0GRUTFEL type=write size=822009 2024-09-12T17:07:48.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.996+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=NBFAGVKXSW07 type=del size=1654788 2024-09-12T17:07:49.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.998+0000 7f9eaebff780 1 < completed delete operation key=OGD6H9VSVGWF tag=4PANVG1O7OY2 type=del 2024-09-12T17:07:49.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:48.999+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=WZVRLM1CLEY4 type=del size=2876347 2024-09-12T17:07:49.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.000+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~S3WJURFOGQOE.0 size=767 2024-09-12T17:07:49.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.002+0000 7f9eaebff780 1 < completed multipart upload key=K2NHRSUDQBRW upload=S3WJURFOGQOE tag=P07R8I4VXF0F type=write size=1049343 2024-09-12T17:07:49.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.003+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=OPBLFWLGJGQM type=del size=785592 2024-09-12T17:07:49.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.005+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~3SP60FRXX6ZS.0 size=141205 2024-09-12T17:07:49.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.007+0000 7f9eaebff780 1 < completed multipart upload key=M3PLQGSK34YM upload=3SP60FRXX6ZS tag=HABOT5SGVG59 type=write size=1189781 2024-09-12T17:07:49.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.009+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~LH4HLMADHX9T.0 size=1048576 2024-09-12T17:07:49.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.010+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~LH4HLMADHX9T.1 size=91626 2024-09-12T17:07:49.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.010+0000 7f9eaebff780 1 > prepared multipart upload key=0F5LXJZMBFSP upload=LH4HLMADHX9T tag=MKG2P31GTA0S type=write size=2188778 2024-09-12T17:07:49.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.011+0000 7f9eaebff780 1 < completed delete operation key=TDZCNUZE8IOA tag=R9KRTY5E0CK0 type=del 2024-09-12T17:07:49.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.012+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=2BO7Y17Q9SFN type=del size=309324 2024-09-12T17:07:49.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.013+0000 7f9eaebff780 1 < canceled operation key=8DJLYFM11DNI tag=U8TTJRF3IZ8O type=del size=848295 2024-09-12T17:07:49.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.016+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~0E49R55BWOKO.0 size=1048576 2024-09-12T17:07:49.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.017+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~0E49R55BWOKO.1 size=1048576 2024-09-12T17:07:49.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.018+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~0E49R55BWOKO.2 size=784505 2024-09-12T17:07:49.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.018+0000 7f9eaebff780 1 > prepared multipart upload key=EKUW5AKC428U upload=0E49R55BWOKO tag=5JG9RO2XOO8U type=write size=3930233 2024-09-12T17:07:49.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.019+0000 7f9eaebff780 1 < canceled operation key=3VY271ZBO754 tag=HQ98RVT03T1Z type=del size=97656 2024-09-12T17:07:49.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.020+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=5UECADLK44KW type=write size=131204 2024-09-12T17:07:49.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.021+0000 7f9eaebff780 1 < completed delete operation key=8DJLYFM11DNI tag=O7I5I6KB2EAF type=del 2024-09-12T17:07:49.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.023+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~XUBHU8BGDNGJ.0 size=1048576 2024-09-12T17:07:49.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.025+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~XUBHU8BGDNGJ.1 size=420476 2024-09-12T17:07:49.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.025+0000 7f9eaebff780 1 > prepared multipart upload key=B1YC6DM9S8JJ upload=XUBHU8BGDNGJ tag=XNC3WFECL00F type=write size=2517628 2024-09-12T17:07:49.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.026+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~2Y0Q8QYSIX6V.0 size=1048576 2024-09-12T17:07:49.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.027+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~2Y0Q8QYSIX6V.1 size=430756 2024-09-12T17:07:49.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.029+0000 7f9eaebff780 1 < completed multipart upload key=ZC814TPVLJO1 upload=2Y0Q8QYSIX6V tag=MR5D8N9ZATCM type=write size=2527908 2024-09-12T17:07:49.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.030+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=7PCGJV4BE4D7 type=write size=114706 2024-09-12T17:07:49.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.031+0000 7f9eaebff780 1 < completed delete operation key=SHWT6AT7PN0M tag=06C7C2BQ9AWL type=del 2024-09-12T17:07:49.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.032+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=IIHJO0R3XGE8 type=del size=504633 2024-09-12T17:07:49.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.035+0000 7f9eaebff780 1 < suggested update operation key=TXHXOMIB4B53 tag=5KM1MCWY1FA5 type=del size=4051625 2024-09-12T17:07:49.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.037+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~OMFFWH2J4E4F.0 size=1048576 2024-09-12T17:07:49.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.038+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~OMFFWH2J4E4F.1 size=1048576 2024-09-12T17:07:49.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.039+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~OMFFWH2J4E4F.2 size=99114 2024-09-12T17:07:49.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.039+0000 7f9eaebff780 1 > prepared multipart upload key=B1YC6DM9S8JJ upload=OMFFWH2J4E4F tag=BIBYV21DEA71 type=write size=3244842 2024-09-12T17:07:49.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.041+0000 7f9eaebff780 1 < canceled operation key=LRI5G5G8O5X4 tag=B56MXA3NNYZ2 type=del size=1696120 2024-09-12T17:07:49.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.042+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=UAQ5URQ66NOA type=del size=2912299 2024-09-12T17:07:49.046 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.044+0000 7f9eaebff780 1 < canceled operation key=0F5LXJZMBFSP tag=GD40GI5OUVSF type=write size=308879 2024-09-12T17:07:49.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.045+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=INRNMRFG5216 type=del size=3649237 2024-09-12T17:07:49.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.046+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~YO2FUN15BGWI.0 size=1048576 2024-09-12T17:07:49.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.047+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~YO2FUN15BGWI.1 size=1023846 2024-09-12T17:07:49.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.050+0000 7f9eaebff780 1 < completed multipart upload key=SO6QF2JCRX6E upload=YO2FUN15BGWI tag=DN5RPHLRIZGV type=write size=3120998 2024-09-12T17:07:49.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.051+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=719C8XU04LLU type=write size=324328 2024-09-12T17:07:49.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.051+0000 7f9eaebff780 1 < canceled part key=_multipart_3VY271ZBO754.2~OXJ77KR6M9M4.0 size=1048576 2024-09-12T17:07:49.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.051+0000 7f9eaebff780 1 < canceled part key=_multipart_3VY271ZBO754.2~OXJ77KR6M9M4.1 size=48308 2024-09-12T17:07:49.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.053+0000 7f9eaebff780 1 < canceled multipart upload key=3VY271ZBO754 upload=OXJ77KR6M9M4 tag=VWFPMD5DZV88 type=write size=2145460 2024-09-12T17:07:49.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.055+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~H8SN2SL6N252.0 size=1048576 2024-09-12T17:07:49.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.056+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~H8SN2SL6N252.1 size=776941 2024-09-12T17:07:49.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.056+0000 7f9eaebff780 1 > prepared multipart upload key=EKUW5AKC428U upload=H8SN2SL6N252 tag=207FHHD85BH7 type=write size=2874093 2024-09-12T17:07:49.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.059+0000 7f9eaebff780 1 < suggested remove operation key=9I6RGNRB6HSY tag=KNV84AIJZPBS type=write 2024-09-12T17:07:49.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.060+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=29CFGNQA4S2C type=del size=897451 2024-09-12T17:07:49.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.063+0000 7f9eaebff780 1 < suggested update operation key=P9GMGM3WK6O7 tag=NBFAGVKXSW07 type=del size=1654788 2024-09-12T17:07:49.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.065+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~DSRCWMJ778Q6.0 size=446494 2024-09-12T17:07:49.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.065+0000 7f9eaebff780 1 > prepared multipart upload key=8DJLYFM11DNI upload=DSRCWMJ778Q6 tag=DCETFWTBEAT4 type=write size=1495070 2024-09-12T17:07:49.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.068+0000 7f9eaebff780 1 < suggested update operation key=0F5LXJZMBFSP tag=WZVRLM1CLEY4 type=del size=2876347 2024-09-12T17:07:49.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.069+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=DCQJBXRVNY3R type=del size=1101630 2024-09-12T17:07:49.073 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.071+0000 7f9eaebff780 -1 < failed to complete operation key=P9GMGM3WK6O7 tag=OPBLFWLGJGQM type=del size=785592: (22) Invalid argument 2024-09-12T17:07:49.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.072+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=RBOVHZH9QHQD type=del size=2204014 2024-09-12T17:07:49.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.074+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~LH4HLMADHX9T.0 size=1048576 2024-09-12T17:07:49.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.075+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~LH4HLMADHX9T.1 size=91626 2024-09-12T17:07:49.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.077+0000 7f9eaebff780 1 < completed multipart upload key=0F5LXJZMBFSP upload=LH4HLMADHX9T tag=MKG2P31GTA0S type=write size=2188778 2024-09-12T17:07:49.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.078+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=IZ196HTWNJ8L type=del size=1661674 2024-09-12T17:07:49.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.079+0000 7f9eaebff780 1 < completed delete operation key=8DJLYFM11DNI tag=2BO7Y17Q9SFN type=del 2024-09-12T17:07:49.083 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.081+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=0UEJA8FXWZRQ type=write size=513781 2024-09-12T17:07:49.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.082+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~0E49R55BWOKO.0 size=1048576 2024-09-12T17:07:49.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.083+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~0E49R55BWOKO.1 size=1048576 2024-09-12T17:07:49.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.084+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~0E49R55BWOKO.2 size=784505 2024-09-12T17:07:49.088 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.086+0000 7f9eaebff780 1 < completed multipart upload key=EKUW5AKC428U upload=0E49R55BWOKO tag=5JG9RO2XOO8U type=write size=3930233 2024-09-12T17:07:49.091 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.089+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~7HCRTOQ09OXX.0 size=932053 2024-09-12T17:07:49.091 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.089+0000 7f9eaebff780 1 > prepared multipart upload key=0YD5P1ACZ09Q upload=7HCRTOQ09OXX tag=P1L0CB014DTO type=write size=1980629 2024-09-12T17:07:49.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.090+0000 7f9eaebff780 1 < canceled operation key=3LY681252WAN tag=5UECADLK44KW type=write size=131204 2024-09-12T17:07:49.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.092+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=GS8VIE2DQB4U type=del size=1854280 2024-09-12T17:07:49.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.093+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~XUBHU8BGDNGJ.0 size=1048576 2024-09-12T17:07:49.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.093+0000 7f9eaebff780 1 < canceled part key=_multipart_B1YC6DM9S8JJ.2~XUBHU8BGDNGJ.1 size=420476 2024-09-12T17:07:49.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.096+0000 7f9eaebff780 1 < canceled multipart upload key=B1YC6DM9S8JJ upload=XUBHU8BGDNGJ tag=XNC3WFECL00F type=write size=2517628 2024-09-12T17:07:49.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.097+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=P5PPYWMSH71S type=del size=3461298 2024-09-12T17:07:49.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.099+0000 7f9eaebff780 -1 < failed to complete operation key=TXHXOMIB4B53 tag=7PCGJV4BE4D7 type=write size=114706: (22) Invalid argument 2024-09-12T17:07:49.103 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.101+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=QY710BGD6R1T type=del size=536977 2024-09-12T17:07:49.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.102+0000 7f9eaebff780 1 < completed delete operation key=LJN514F16XJA tag=IIHJO0R3XGE8 type=del 2024-09-12T17:07:49.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.103+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=WW1KAJK1OQFW type=del size=1398128 2024-09-12T17:07:49.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.104+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~OMFFWH2J4E4F.0 size=1048576 2024-09-12T17:07:49.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.106+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~OMFFWH2J4E4F.1 size=1048576 2024-09-12T17:07:49.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.107+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~OMFFWH2J4E4F.2 size=99114 2024-09-12T17:07:49.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.109+0000 7f9eaebff780 1 < completed multipart upload key=B1YC6DM9S8JJ upload=OMFFWH2J4E4F tag=BIBYV21DEA71 type=write size=3244842 2024-09-12T17:07:49.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.110+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=CY7JKL5EZLSI type=del size=1758296 2024-09-12T17:07:49.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.111+0000 7f9eaebff780 1 < completed delete operation key=8DJLYFM11DNI tag=UAQ5URQ66NOA type=del 2024-09-12T17:07:49.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.112+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=HTAN7OZ0WDKR type=del size=847352 2024-09-12T17:07:49.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.113+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=INRNMRFG5216 type=del 2024-09-12T17:07:49.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.115+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=4UFCEQFX3FIS type=write size=55721 2024-09-12T17:07:49.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.116+0000 7f9eaebff780 1 < completed write operation key=3VY271ZBO754 tag=719C8XU04LLU type=write size=324328 2024-09-12T17:07:49.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.118+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~ZC7UE8USETLY.0 size=1048576 2024-09-12T17:07:49.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.119+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~ZC7UE8USETLY.1 size=1048576 2024-09-12T17:07:49.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.120+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~ZC7UE8USETLY.2 size=850952 2024-09-12T17:07:49.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.120+0000 7f9eaebff780 1 > prepared multipart upload key=SO6QF2JCRX6E upload=ZC7UE8USETLY tag=K2TBTXY96E92 type=write size=3996680 2024-09-12T17:07:49.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.121+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~H8SN2SL6N252.0 size=1048576 2024-09-12T17:07:49.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.121+0000 7f9eaebff780 1 < canceled part key=_multipart_EKUW5AKC428U.2~H8SN2SL6N252.1 size=776941 2024-09-12T17:07:49.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.124+0000 7f9eaebff780 1 < canceled multipart upload key=EKUW5AKC428U upload=H8SN2SL6N252 tag=207FHHD85BH7 type=write size=2874093 2024-09-12T17:07:49.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.126+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~YDKDSKHH85QA.0 size=1048576 2024-09-12T17:07:49.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.126+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~YDKDSKHH85QA.1 size=770948 2024-09-12T17:07:49.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.126+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=YDKDSKHH85QA tag=XXZ8C3FSY59Q type=write size=2868100 2024-09-12T17:07:49.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.128+0000 7f9eaebff780 1 < completed delete operation key=YIEP2JYDSLW0 tag=29CFGNQA4S2C type=del 2024-09-12T17:07:49.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.130+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~CXJ60A6RGTUJ.0 size=1048576 2024-09-12T17:07:49.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.131+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~CXJ60A6RGTUJ.1 size=1048576 2024-09-12T17:07:49.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.132+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~CXJ60A6RGTUJ.2 size=472098 2024-09-12T17:07:49.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.132+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=CXJ60A6RGTUJ tag=OX4W25SUOUZ7 type=write size=3617826 2024-09-12T17:07:49.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.133+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~DSRCWMJ778Q6.0 size=446494 2024-09-12T17:07:49.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.135+0000 7f9eaebff780 1 < completed multipart upload key=8DJLYFM11DNI upload=DSRCWMJ778Q6 tag=DCETFWTBEAT4 type=write size=1495070 2024-09-12T17:07:49.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.136+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=T4JNOQROQYVJ type=del size=2500539 2024-09-12T17:07:49.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.137+0000 7f9eaebff780 1 < completed delete operation key=K0P9ZZ91UJJ8 tag=DCQJBXRVNY3R type=del 2024-09-12T17:07:49.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.140+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=Z409AP09PQHT type=del size=679228 2024-09-12T17:07:49.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.142+0000 7f9eaebff780 1 < completed delete operation key=QIMNK4DL3D0N tag=RBOVHZH9QHQD type=del 2024-09-12T17:07:49.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.143+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=41UR0N8FP50W type=write size=767560 2024-09-12T17:07:49.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.144+0000 7f9eaebff780 1 < completed delete operation key=7PBT9VZ07OUI tag=IZ196HTWNJ8L type=del 2024-09-12T17:07:49.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.146+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=3S1YHT1BYNI3 type=del size=2217011 2024-09-12T17:07:49.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.147+0000 7f9eaebff780 1 < completed write operation key=8DJLYFM11DNI tag=0UEJA8FXWZRQ type=write size=513781 2024-09-12T17:07:49.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.149+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~I517J1FI6G3N.0 size=89020 2024-09-12T17:07:49.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.149+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=I517J1FI6G3N tag=YVQDCPV6FQ03 type=write size=1137596 2024-09-12T17:07:49.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.151+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~7HCRTOQ09OXX.0 size=932053 2024-09-12T17:07:49.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.153+0000 7f9eaebff780 1 < completed multipart upload key=0YD5P1ACZ09Q upload=7HCRTOQ09OXX tag=P1L0CB014DTO type=write size=1980629 2024-09-12T17:07:49.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.154+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=VLGNGWA57TA1 type=del size=2928720 2024-09-12T17:07:49.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.155+0000 7f9eaebff780 1 < completed delete operation key=B1YC6DM9S8JJ tag=GS8VIE2DQB4U type=del 2024-09-12T17:07:49.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.156+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=ND224D7L6SGS type=del size=2518030 2024-09-12T17:07:49.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.159+0000 7f9eaebff780 1 < suggested remove operation key=GB8P7K59Y8VI tag=P5PPYWMSH71S type=del 2024-09-12T17:07:49.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.161+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~ZEHF70G9P2V3.0 size=227282 2024-09-12T17:07:49.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.161+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=ZEHF70G9P2V3 tag=HLVSYX1N1SF8 type=write size=1275858 2024-09-12T17:07:49.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.162+0000 7f9eaebff780 1 < completed delete operation key=ZYP3P4031PUZ tag=QY710BGD6R1T type=del 2024-09-12T17:07:49.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.164+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=YO1T9TF91ECZ type=del size=1030973 2024-09-12T17:07:49.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.166+0000 7f9eaebff780 1 < suggested update operation key=K2NHRSUDQBRW tag=WW1KAJK1OQFW type=del size=1398128 2024-09-12T17:07:49.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.168+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~0AH9506GC5S0.0 size=1048576 2024-09-12T17:07:49.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.169+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~0AH9506GC5S0.1 size=1048576 2024-09-12T17:07:49.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.170+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~0AH9506GC5S0.2 size=191897 2024-09-12T17:07:49.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.170+0000 7f9eaebff780 1 > prepared multipart upload key=TDZCNUZE8IOA upload=0AH9506GC5S0 tag=59W8FNACYFAG type=write size=3337625 2024-09-12T17:07:49.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.172+0000 7f9eaebff780 1 < canceled operation key=K0P9ZZ91UJJ8 tag=CY7JKL5EZLSI type=del size=1758296 2024-09-12T17:07:49.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.173+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=24K4AFJ7A2G3 type=del size=1664222 2024-09-12T17:07:49.176 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.174+0000 7f9eaebff780 1 < completed delete operation key=ZYP3P4031PUZ tag=HTAN7OZ0WDKR type=del 2024-09-12T17:07:49.178 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.176+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~988N4WUJFCAC.0 size=1048576 2024-09-12T17:07:49.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.177+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~988N4WUJFCAC.1 size=143605 2024-09-12T17:07:49.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.177+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=988N4WUJFCAC tag=P2S15AQTJSMZ type=write size=2240757 2024-09-12T17:07:49.181 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.178+0000 7f9eaebff780 1 < completed write operation key=9I6RGNRB6HSY tag=4UFCEQFX3FIS type=write size=55721 2024-09-12T17:07:49.182 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.179+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=SK5XD8L5U4SE type=del size=1341984 2024-09-12T17:07:49.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.181+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~ZC7UE8USETLY.0 size=1048576 2024-09-12T17:07:49.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.182+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~ZC7UE8USETLY.1 size=1048576 2024-09-12T17:07:49.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.183+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~ZC7UE8USETLY.2 size=850952 2024-09-12T17:07:49.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.184+0000 7f9eaebff780 1 < completed multipart upload key=SO6QF2JCRX6E upload=ZC7UE8USETLY tag=K2TBTXY96E92 type=write size=3996680 2024-09-12T17:07:49.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.186+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=85RCBYJUPGXV type=del size=2905167 2024-09-12T17:07:49.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.187+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~YDKDSKHH85QA.0 size=1048576 2024-09-12T17:07:49.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.188+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~YDKDSKHH85QA.1 size=770948 2024-09-12T17:07:49.192 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.190+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=YDKDSKHH85QA tag=XXZ8C3FSY59Q type=write size=2868100 2024-09-12T17:07:49.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.192+0000 7f9eaebff780 1 > prepared part key=_multipart_TXHXOMIB4B53.2~T17A7765LQH9.0 size=569827 2024-09-12T17:07:49.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.192+0000 7f9eaebff780 1 > prepared multipart upload key=TXHXOMIB4B53 upload=T17A7765LQH9 tag=LH85U5Q4YE47 type=write size=1618403 2024-09-12T17:07:49.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.193+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~CXJ60A6RGTUJ.0 size=1048576 2024-09-12T17:07:49.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.193+0000 7f9eaebff780 1 < canceled part key=_multipart_OH6GXTMPBYUY.2~CXJ60A6RGTUJ.1 size=1048576 2024-09-12T17:07:49.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.194+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~CXJ60A6RGTUJ.2 size=472098 2024-09-12T17:07:49.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.196+0000 7f9eaebff780 1 < canceled multipart upload key=OH6GXTMPBYUY upload=CXJ60A6RGTUJ tag=OX4W25SUOUZ7 type=write size=3617826 2024-09-12T17:07:49.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.198+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~HYKU0HAFO40B.0 size=1048576 2024-09-12T17:07:49.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.199+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~HYKU0HAFO40B.1 size=1048576 2024-09-12T17:07:49.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.200+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~HYKU0HAFO40B.2 size=33320 2024-09-12T17:07:49.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.200+0000 7f9eaebff780 1 > prepared multipart upload key=3VY271ZBO754 upload=HYKU0HAFO40B tag=SIGRIIK8N0QG type=write size=3179048 2024-09-12T17:07:49.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.201+0000 7f9eaebff780 1 < completed delete operation key=0F5LXJZMBFSP tag=T4JNOQROQYVJ type=del 2024-09-12T17:07:49.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.202+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=2OATS3LDYL4J type=write size=567919 2024-09-12T17:07:49.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.205+0000 7f9eaebff780 1 < suggested remove operation key=K2NHRSUDQBRW tag=Z409AP09PQHT type=del 2024-09-12T17:07:49.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.207+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~2HCUI5SS6J7H.0 size=1048576 2024-09-12T17:07:49.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.208+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~2HCUI5SS6J7H.1 size=1048576 2024-09-12T17:07:49.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.209+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~2HCUI5SS6J7H.2 size=322049 2024-09-12T17:07:49.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.209+0000 7f9eaebff780 1 > prepared multipart upload key=QIMNK4DL3D0N upload=2HCUI5SS6J7H tag=E6JZRSL9ENBK type=write size=3467777 2024-09-12T17:07:49.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.210+0000 7f9eaebff780 1 < completed write operation key=SHWT6AT7PN0M tag=41UR0N8FP50W type=write size=767560 2024-09-12T17:07:49.214 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.211+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=X1BZ6TS9MTZF type=del size=632118 2024-09-12T17:07:49.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.213+0000 7f9eaebff780 -1 < failed to complete operation key=K2NHRSUDQBRW tag=3S1YHT1BYNI3 type=del size=2217011: (22) Invalid argument 2024-09-12T17:07:49.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.214+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=VZ17K435WQA9 type=write size=886077 2024-09-12T17:07:49.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.216+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~I517J1FI6G3N.0 size=89020 2024-09-12T17:07:49.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.219+0000 7f9eaebff780 1 < completed multipart upload key=UYF1AN2W59VN upload=I517J1FI6G3N tag=YVQDCPV6FQ03 type=write size=1137596 2024-09-12T17:07:49.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.220+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=PYPJEP6GXA70 type=del size=184005 2024-09-12T17:07:49.224 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.221+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=VLGNGWA57TA1 type=del 2024-09-12T17:07:49.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.222+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=NNMPHMF7YQ2R type=del size=711265 2024-09-12T17:07:49.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.224+0000 7f9eaebff780 1 < completed delete operation key=ZYP3P4031PUZ tag=ND224D7L6SGS type=del 2024-09-12T17:07:49.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.225+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=MJV3WTUH2JU1 type=del size=3171772 2024-09-12T17:07:49.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.226+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~ZEHF70G9P2V3.0 size=227282 2024-09-12T17:07:49.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.228+0000 7f9eaebff780 1 < completed multipart upload key=UYF1AN2W59VN upload=ZEHF70G9P2V3 tag=HLVSYX1N1SF8 type=write size=1275858 2024-09-12T17:07:49.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.230+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=EDHGZ8FZL0C9 type=del size=3116998 2024-09-12T17:07:49.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.231+0000 7f9eaebff780 1 < completed delete operation key=TDZCNUZE8IOA tag=YO1T9TF91ECZ type=del 2024-09-12T17:07:49.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.233+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~A7X18SCPY8RE.0 size=416216 2024-09-12T17:07:49.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.233+0000 7f9eaebff780 1 > prepared multipart upload key=A1KRCFY18QTP upload=A7X18SCPY8RE tag=2TW0U29HWPKV type=write size=1464792 2024-09-12T17:07:49.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.234+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~0AH9506GC5S0.0 size=1048576 2024-09-12T17:07:49.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.235+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~0AH9506GC5S0.1 size=1048576 2024-09-12T17:07:49.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.236+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~0AH9506GC5S0.2 size=191897 2024-09-12T17:07:49.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.238+0000 7f9eaebff780 1 < completed multipart upload key=TDZCNUZE8IOA upload=0AH9506GC5S0 tag=59W8FNACYFAG type=write size=3337625 2024-09-12T17:07:49.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.240+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=KU7SDHWU0D22 type=del size=3066486 2024-09-12T17:07:49.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.241+0000 7f9eaebff780 1 < completed delete operation key=B1YC6DM9S8JJ tag=24K4AFJ7A2G3 type=del 2024-09-12T17:07:49.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.242+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=5RB9V8BKB2VE type=del size=3925966 2024-09-12T17:07:49.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.242+0000 7f9eaebff780 1 < canceled part key=_multipart_M3PLQGSK34YM.2~988N4WUJFCAC.0 size=1048576 2024-09-12T17:07:49.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.243+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~988N4WUJFCAC.1 size=143605 2024-09-12T17:07:49.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.245+0000 7f9eaebff780 1 < canceled multipart upload key=M3PLQGSK34YM upload=988N4WUJFCAC tag=P2S15AQTJSMZ type=write size=2240757 2024-09-12T17:07:49.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.246+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=QP6Z04J906NX type=del size=1847860 2024-09-12T17:07:49.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.247+0000 7f9eaebff780 1 < canceled operation key=ZYP3P4031PUZ tag=SK5XD8L5U4SE type=del size=1341984 2024-09-12T17:07:49.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.250+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~UY667HOER79G.0 size=1048576 2024-09-12T17:07:49.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.251+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~UY667HOER79G.1 size=1048576 2024-09-12T17:07:49.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.252+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~UY667HOER79G.2 size=586992 2024-09-12T17:07:49.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.252+0000 7f9eaebff780 1 > prepared multipart upload key=KF8XE48DI9KZ upload=UY667HOER79G tag=5YLG4Y0I96MZ type=write size=3732720 2024-09-12T17:07:49.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.254+0000 7f9eaebff780 1 < suggested update operation key=GB8P7K59Y8VI tag=85RCBYJUPGXV type=del size=2905167 2024-09-12T17:07:49.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.255+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=ONJT82QVR4W1 type=del size=1327838 2024-09-12T17:07:49.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.256+0000 7f9eaebff780 1 < completed part key=_multipart_TXHXOMIB4B53.2~T17A7765LQH9.0 size=569827 2024-09-12T17:07:49.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.259+0000 7f9eaebff780 1 < completed multipart upload key=TXHXOMIB4B53 upload=T17A7765LQH9 tag=LH85U5Q4YE47 type=write size=1618403 2024-09-12T17:07:49.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.260+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=1W3HDW8SNM7H type=write size=459603 2024-09-12T17:07:49.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.260+0000 7f9eaebff780 1 < canceled part key=_multipart_3VY271ZBO754.2~HYKU0HAFO40B.0 size=1048576 2024-09-12T17:07:49.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.261+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~HYKU0HAFO40B.1 size=1048576 2024-09-12T17:07:49.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.261+0000 7f9eaebff780 1 < canceled part key=_multipart_3VY271ZBO754.2~HYKU0HAFO40B.2 size=33320 2024-09-12T17:07:49.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.263+0000 7f9eaebff780 1 < canceled multipart upload key=3VY271ZBO754 upload=HYKU0HAFO40B tag=SIGRIIK8N0QG type=write size=3179048 2024-09-12T17:07:49.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.264+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=YSQBL5CBKSXM type=del size=2546579 2024-09-12T17:07:49.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.265+0000 7f9eaebff780 1 < completed write operation key=TDZCNUZE8IOA tag=2OATS3LDYL4J type=write size=567919 2024-09-12T17:07:49.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.267+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=CWG9C6JA7B6M type=del size=2851532 2024-09-12T17:07:49.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.267+0000 7f9eaebff780 1 < canceled part key=_multipart_QIMNK4DL3D0N.2~2HCUI5SS6J7H.0 size=1048576 2024-09-12T17:07:49.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.268+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~2HCUI5SS6J7H.1 size=1048576 2024-09-12T17:07:49.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.269+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~2HCUI5SS6J7H.2 size=322049 2024-09-12T17:07:49.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.271+0000 7f9eaebff780 1 < canceled multipart upload key=QIMNK4DL3D0N upload=2HCUI5SS6J7H tag=E6JZRSL9ENBK type=write size=3467777 2024-09-12T17:07:49.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.272+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=AET2OK494CH7 type=del size=3723305 2024-09-12T17:07:49.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.273+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=X1BZ6TS9MTZF type=del 2024-09-12T17:07:49.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.275+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~Q77ZP0X3J970.0 size=1048576 2024-09-12T17:07:49.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.276+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~Q77ZP0X3J970.1 size=1048576 2024-09-12T17:07:49.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.277+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~Q77ZP0X3J970.2 size=227441 2024-09-12T17:07:49.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.277+0000 7f9eaebff780 1 > prepared multipart upload key=CAIZM33SDFPM upload=Q77ZP0X3J970 tag=XDLU2TBALVYU type=write size=3373169 2024-09-12T17:07:49.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.279+0000 7f9eaebff780 1 < suggested remove operation key=ZC814TPVLJO1 tag=VZ17K435WQA9 type=write 2024-09-12T17:07:49.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.280+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=NQ6BYPND3P0E type=write size=212601 2024-09-12T17:07:49.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.282+0000 7f9eaebff780 1 < suggested remove operation key=SHWT6AT7PN0M tag=PYPJEP6GXA70 type=del 2024-09-12T17:07:49.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.283+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=SRN9MV1U0XSS type=del size=1536035 2024-09-12T17:07:49.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.285+0000 7f9eaebff780 -1 < failed to complete operation key=ZC814TPVLJO1 tag=NNMPHMF7YQ2R type=del size=711265: (22) Invalid argument 2024-09-12T17:07:49.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.287+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~Z17Q0R1HOPLA.0 size=692386 2024-09-12T17:07:49.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.287+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=Z17Q0R1HOPLA tag=7B9FMX1L12WE type=write size=1740962 2024-09-12T17:07:49.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.288+0000 7f9eaebff780 1 < completed delete operation key=LRI5G5G8O5X4 tag=MJV3WTUH2JU1 type=del 2024-09-12T17:07:49.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.289+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=UQKJXXJOGOAZ type=del size=704562 2024-09-12T17:07:49.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.291+0000 7f9eaebff780 1 < completed delete operation key=UYF1AN2W59VN tag=EDHGZ8FZL0C9 type=del 2024-09-12T17:07:49.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.292+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=7OP5BBP05G68 type=write size=280300 2024-09-12T17:07:49.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.293+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~A7X18SCPY8RE.0 size=416216 2024-09-12T17:07:49.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.295+0000 7f9eaebff780 1 < completed multipart upload key=A1KRCFY18QTP upload=A7X18SCPY8RE tag=2TW0U29HWPKV type=write size=1464792 2024-09-12T17:07:49.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.297+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~ODK7YZ53QPUA.0 size=1048576 2024-09-12T17:07:49.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.298+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~ODK7YZ53QPUA.1 size=1048576 2024-09-12T17:07:49.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.299+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~ODK7YZ53QPUA.2 size=236913 2024-09-12T17:07:49.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.299+0000 7f9eaebff780 1 > prepared multipart upload key=3VY271ZBO754 upload=ODK7YZ53QPUA tag=JIDB1HB89GJ6 type=write size=3382641 2024-09-12T17:07:49.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.302+0000 7f9eaebff780 1 < suggested update operation key=K2NHRSUDQBRW tag=KU7SDHWU0D22 type=del size=3066486 2024-09-12T17:07:49.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.303+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=ARHJJ90AFUQ6 type=del size=4030512 2024-09-12T17:07:49.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.306+0000 7f9eaebff780 1 < suggested update operation key=8DJLYFM11DNI tag=5RB9V8BKB2VE type=del size=3925966 2024-09-12T17:07:49.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.308+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~9VOIX4B3SM1P.0 size=1048576 2024-09-12T17:07:49.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.309+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~9VOIX4B3SM1P.1 size=1048576 2024-09-12T17:07:49.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.310+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~9VOIX4B3SM1P.2 size=309591 2024-09-12T17:07:49.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.310+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=9VOIX4B3SM1P tag=IXDEW7IHZBL9 type=write size=3455319 2024-09-12T17:07:49.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.311+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=QP6Z04J906NX type=del 2024-09-12T17:07:49.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.313+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=3WBUTKS02AI8 type=del size=3243505 2024-09-12T17:07:49.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.314+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~UY667HOER79G.0 size=1048576 2024-09-12T17:07:49.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.315+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~UY667HOER79G.1 size=1048576 2024-09-12T17:07:49.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.316+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~UY667HOER79G.2 size=586992 2024-09-12T17:07:49.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.318+0000 7f9eaebff780 1 < completed multipart upload key=KF8XE48DI9KZ upload=UY667HOER79G tag=5YLG4Y0I96MZ type=write size=3732720 2024-09-12T17:07:49.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.319+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=Y7T59LXZN5B6 type=del size=3938067 2024-09-12T17:07:49.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.320+0000 7f9eaebff780 -1 < failed to complete operation key=ZC814TPVLJO1 tag=ONJT82QVR4W1 type=del size=1327838: (22) Invalid argument 2024-09-12T17:07:49.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.321+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=EP0S74QBJ7I2 type=del size=876040 2024-09-12T17:07:49.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.323+0000 7f9eaebff780 1 < completed write operation key=TDZCNUZE8IOA tag=1W3HDW8SNM7H type=write size=459603 2024-09-12T17:07:49.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.324+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=QLNBC0VLUXKR type=del size=1570159 2024-09-12T17:07:49.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.325+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=YSQBL5CBKSXM type=del 2024-09-12T17:07:49.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.326+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=2IY7Y7CAK2UY type=del size=219093 2024-09-12T17:07:49.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.328+0000 7f9eaebff780 1 < suggested remove operation key=3VY271ZBO754 tag=CWG9C6JA7B6M type=del 2024-09-12T17:07:49.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.330+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=DEAZ846RX7FN type=del size=2073037 2024-09-12T17:07:49.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.332+0000 7f9eaebff780 1 < completed delete operation key=TXHXOMIB4B53 tag=AET2OK494CH7 type=del 2024-09-12T17:07:49.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.334+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=YGBQC1XSCZU3 type=del size=3391621 2024-09-12T17:07:49.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.334+0000 7f9eaebff780 1 < canceled part key=_multipart_CAIZM33SDFPM.2~Q77ZP0X3J970.0 size=1048576 2024-09-12T17:07:49.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.335+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~Q77ZP0X3J970.1 size=1048576 2024-09-12T17:07:49.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.336+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~Q77ZP0X3J970.2 size=227441 2024-09-12T17:07:49.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.338+0000 7f9eaebff780 1 < canceled multipart upload key=CAIZM33SDFPM upload=Q77ZP0X3J970 tag=XDLU2TBALVYU type=write size=3373169 2024-09-12T17:07:49.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.340+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~RYHDYH4EWNF1.0 size=1048576 2024-09-12T17:07:49.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.341+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~RYHDYH4EWNF1.1 size=836184 2024-09-12T17:07:49.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.341+0000 7f9eaebff780 1 > prepared multipart upload key=0YD5P1ACZ09Q upload=RYHDYH4EWNF1 tag=HHT24Z6SCK8N type=write size=2933336 2024-09-12T17:07:49.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.344+0000 7f9eaebff780 1 < suggested remove operation key=8DJLYFM11DNI tag=NQ6BYPND3P0E type=write 2024-09-12T17:07:49.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.346+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~TRVANOGI7TBK.0 size=1048576 2024-09-12T17:07:49.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.347+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~TRVANOGI7TBK.1 size=1048576 2024-09-12T17:07:49.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.348+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~TRVANOGI7TBK.2 size=691048 2024-09-12T17:07:49.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.348+0000 7f9eaebff780 1 > prepared multipart upload key=LRI5G5G8O5X4 upload=TRVANOGI7TBK tag=PIALXAB335LO type=write size=3836776 2024-09-12T17:07:49.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.349+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=SRN9MV1U0XSS type=del 2024-09-12T17:07:49.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.350+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=8REOHZG603Z9 type=del size=626493 2024-09-12T17:07:49.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.352+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~Z17Q0R1HOPLA.0 size=692386 2024-09-12T17:07:49.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.354+0000 7f9eaebff780 1 < completed multipart upload key=P9GMGM3WK6O7 upload=Z17Q0R1HOPLA tag=7B9FMX1L12WE type=write size=1740962 2024-09-12T17:07:49.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.355+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=07CWBYA1VIPC type=del size=1862738 2024-09-12T17:07:49.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.357+0000 7f9eaebff780 1 < completed delete operation key=ZC814TPVLJO1 tag=UQKJXXJOGOAZ type=del 2024-09-12T17:07:49.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.358+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=NFHMHRPVQ1FX type=write size=49970 2024-09-12T17:07:49.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.359+0000 7f9eaebff780 1 < completed write operation key=QIMNK4DL3D0N tag=7OP5BBP05G68 type=write size=280300 2024-09-12T17:07:49.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.360+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=32MCO3WX5HYS type=del size=3742633 2024-09-12T17:07:49.364 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.362+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~ODK7YZ53QPUA.0 size=1048576 2024-09-12T17:07:49.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.362+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~ODK7YZ53QPUA.1 size=1048576 2024-09-12T17:07:49.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.363+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~ODK7YZ53QPUA.2 size=236913 2024-09-12T17:07:49.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.365+0000 7f9eaebff780 1 < completed multipart upload key=3VY271ZBO754 upload=ODK7YZ53QPUA tag=JIDB1HB89GJ6 type=write size=3382641 2024-09-12T17:07:49.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.367+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=FEOB8YZGTP74 type=del size=499948 2024-09-12T17:07:49.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.368+0000 7f9eaebff780 1 < completed delete operation key=GB8P7K59Y8VI tag=ARHJJ90AFUQ6 type=del 2024-09-12T17:07:49.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.369+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=C1L1Q2P3ZNUR type=del size=3994064 2024-09-12T17:07:49.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.370+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~9VOIX4B3SM1P.0 size=1048576 2024-09-12T17:07:49.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.370+0000 7f9eaebff780 1 < canceled part key=_multipart_M3PLQGSK34YM.2~9VOIX4B3SM1P.1 size=1048576 2024-09-12T17:07:49.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.371+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~9VOIX4B3SM1P.2 size=309591 2024-09-12T17:07:49.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.373+0000 7f9eaebff780 1 < canceled multipart upload key=M3PLQGSK34YM upload=9VOIX4B3SM1P tag=IXDEW7IHZBL9 type=write size=3455319 2024-09-12T17:07:49.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.374+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=CEB1RVKCWH1L type=del size=1717254 2024-09-12T17:07:49.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.376+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=3WBUTKS02AI8 type=del 2024-09-12T17:07:49.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.377+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=QJNZ2YPLF8HL type=del size=4112573 2024-09-12T17:07:49.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.378+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=Y7T59LXZN5B6 type=del 2024-09-12T17:07:49.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.380+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~19CNXY9E0QX3.0 size=1048576 2024-09-12T17:07:49.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.381+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~19CNXY9E0QX3.1 size=1048576 2024-09-12T17:07:49.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.382+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~19CNXY9E0QX3.2 size=555208 2024-09-12T17:07:49.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.382+0000 7f9eaebff780 1 > prepared multipart upload key=TDZCNUZE8IOA upload=19CNXY9E0QX3 tag=5O5729479SJ4 type=write size=3700936 2024-09-12T17:07:49.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.383+0000 7f9eaebff780 1 < canceled operation key=CAIZM33SDFPM tag=EP0S74QBJ7I2 type=del size=876040 2024-09-12T17:07:49.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.385+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=OBIQJZ5SVSU6 type=del size=675680 2024-09-12T17:07:49.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.387+0000 7f9eaebff780 1 < suggested remove operation key=LRI5G5G8O5X4 tag=QLNBC0VLUXKR type=del 2024-09-12T17:07:49.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.388+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=WB14NZKP3MM8 type=del size=2671068 2024-09-12T17:07:49.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.389+0000 7f9eaebff780 1 < completed delete operation key=TDZCNUZE8IOA tag=2IY7Y7CAK2UY type=del 2024-09-12T17:07:49.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.391+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~XG25XR9597CU.0 size=1048576 2024-09-12T17:07:49.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.392+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~XG25XR9597CU.1 size=1048576 2024-09-12T17:07:49.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.393+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~XG25XR9597CU.2 size=691737 2024-09-12T17:07:49.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.393+0000 7f9eaebff780 1 > prepared multipart upload key=CAIZM33SDFPM upload=XG25XR9597CU tag=R7QPSONM0AUD type=write size=3837465 2024-09-12T17:07:49.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.394+0000 7f9eaebff780 -1 < failed to complete operation key=8DJLYFM11DNI tag=DEAZ846RX7FN type=del size=2073037: (22) Invalid argument 2024-09-12T17:07:49.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.397+0000 7f9eaebff780 1 > prepared part key=_multipart_TXHXOMIB4B53.2~9Q9VB27EEHAA.0 size=1048576 2024-09-12T17:07:49.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.398+0000 7f9eaebff780 1 > prepared part key=_multipart_TXHXOMIB4B53.2~9Q9VB27EEHAA.1 size=1048576 2024-09-12T17:07:49.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.398+0000 7f9eaebff780 1 > prepared part key=_multipart_TXHXOMIB4B53.2~9Q9VB27EEHAA.2 size=342833 2024-09-12T17:07:49.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.398+0000 7f9eaebff780 1 > prepared multipart upload key=TXHXOMIB4B53 upload=9Q9VB27EEHAA tag=OVW3A3AE5XUX type=write size=3488561 2024-09-12T17:07:49.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.400+0000 7f9eaebff780 1 < completed delete operation key=OH6GXTMPBYUY tag=YGBQC1XSCZU3 type=del 2024-09-12T17:07:49.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.401+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=VXR0R68D89DY type=del size=2265324 2024-09-12T17:07:49.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.402+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~RYHDYH4EWNF1.0 size=1048576 2024-09-12T17:07:49.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.402+0000 7f9eaebff780 1 < canceled part key=_multipart_0YD5P1ACZ09Q.2~RYHDYH4EWNF1.1 size=836184 2024-09-12T17:07:49.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.404+0000 7f9eaebff780 1 < canceled multipart upload key=0YD5P1ACZ09Q upload=RYHDYH4EWNF1 tag=HHT24Z6SCK8N type=write size=2933336 2024-09-12T17:07:49.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.406+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=LIMUIQ6T5JB7 type=del size=4061295 2024-09-12T17:07:49.410 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.407+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~TRVANOGI7TBK.0 size=1048576 2024-09-12T17:07:49.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.408+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~TRVANOGI7TBK.1 size=1048576 2024-09-12T17:07:49.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.410+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~TRVANOGI7TBK.2 size=691048 2024-09-12T17:07:49.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.412+0000 7f9eaebff780 1 < completed multipart upload key=LRI5G5G8O5X4 upload=TRVANOGI7TBK tag=PIALXAB335LO type=write size=3836776 2024-09-12T17:07:49.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.413+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=OUT5N9PQARHT type=del size=1032312 2024-09-12T17:07:49.416 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.414+0000 7f9eaebff780 1 < completed delete operation key=0F5LXJZMBFSP tag=8REOHZG603Z9 type=del 2024-09-12T17:07:49.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.415+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=M03ZZ3RVSKXH type=del size=2359291 2024-09-12T17:07:49.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.417+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=07CWBYA1VIPC type=del 2024-09-12T17:07:49.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.418+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=H0ZYHB1LW2ZZ type=del size=1546067 2024-09-12T17:07:49.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.420+0000 7f9eaebff780 1 < suggested update operation key=LJN514F16XJA tag=NFHMHRPVQ1FX type=write size=49970 2024-09-12T17:07:49.424 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.421+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=WF8VFM95NJFS type=del size=657162 2024-09-12T17:07:49.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.424+0000 7f9eaebff780 1 < suggested update operation key=UYF1AN2W59VN tag=32MCO3WX5HYS type=del size=3742633 2024-09-12T17:07:49.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.426+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~JE1N0QDVJZIG.0 size=127573 2024-09-12T17:07:49.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.426+0000 7f9eaebff780 1 > prepared multipart upload key=QIMNK4DL3D0N upload=JE1N0QDVJZIG tag=XG7T7UL07JDY type=write size=1176149 2024-09-12T17:07:49.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.427+0000 7f9eaebff780 1 < completed delete operation key=OH6GXTMPBYUY tag=FEOB8YZGTP74 type=del 2024-09-12T17:07:49.432 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.429+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~TDNZZFKVX6BO.0 size=609864 2024-09-12T17:07:49.432 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.429+0000 7f9eaebff780 1 > prepared multipart upload key=9WJGBODZ60NJ upload=TDNZZFKVX6BO tag=8G69Q65I0RE9 type=write size=1658440 2024-09-12T17:07:49.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.430+0000 7f9eaebff780 1 < completed delete operation key=B1YC6DM9S8JJ tag=C1L1Q2P3ZNUR type=del 2024-09-12T17:07:49.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.432+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=9IKBWD7A4VZI type=del size=1375357 2024-09-12T17:07:49.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.434+0000 7f9eaebff780 1 < completed delete operation key=3VY271ZBO754 tag=CEB1RVKCWH1L type=del 2024-09-12T17:07:49.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.435+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=Q7TEEO1WS25Q type=del size=3745451 2024-09-12T17:07:49.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.436+0000 7f9eaebff780 1 < canceled operation key=A1KRCFY18QTP tag=QJNZ2YPLF8HL type=del size=4112573 2024-09-12T17:07:49.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.437+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=MUKX7KZPTSPO type=del size=1346846 2024-09-12T17:07:49.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.438+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~19CNXY9E0QX3.0 size=1048576 2024-09-12T17:07:49.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.439+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~19CNXY9E0QX3.1 size=1048576 2024-09-12T17:07:49.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.440+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~19CNXY9E0QX3.2 size=555208 2024-09-12T17:07:49.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.442+0000 7f9eaebff780 1 < completed multipart upload key=TDZCNUZE8IOA upload=19CNXY9E0QX3 tag=5O5729479SJ4 type=write size=3700936 2024-09-12T17:07:49.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.444+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~RBONDA8NGW3B.0 size=1048576 2024-09-12T17:07:49.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.446+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~RBONDA8NGW3B.1 size=1048576 2024-09-12T17:07:49.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.447+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~RBONDA8NGW3B.2 size=123188 2024-09-12T17:07:49.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.447+0000 7f9eaebff780 1 > prepared multipart upload key=A1KRCFY18QTP upload=RBONDA8NGW3B tag=SHN2OWEKGA25 type=write size=3268916 2024-09-12T17:07:49.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.450+0000 7f9eaebff780 1 < suggested remove operation key=7PBT9VZ07OUI tag=OBIQJZ5SVSU6 type=del 2024-09-12T17:07:49.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.452+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=SITJ8K36F4CI type=write size=660896 2024-09-12T17:07:49.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.454+0000 7f9eaebff780 1 < suggested update operation key=3LY681252WAN tag=WB14NZKP3MM8 type=del size=2671068 2024-09-12T17:07:49.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.455+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=JE6HZTDGGXN4 type=del size=3935215 2024-09-12T17:07:49.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.456+0000 7f9eaebff780 1 < canceled part key=_multipart_CAIZM33SDFPM.2~XG25XR9597CU.0 size=1048576 2024-09-12T17:07:49.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.457+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~XG25XR9597CU.1 size=1048576 2024-09-12T17:07:49.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.458+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~XG25XR9597CU.2 size=691737 2024-09-12T17:07:49.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.460+0000 7f9eaebff780 1 < canceled multipart upload key=CAIZM33SDFPM upload=XG25XR9597CU tag=R7QPSONM0AUD type=write size=3837465 2024-09-12T17:07:49.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.461+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=NA6K2QMCP54P type=del size=612879 2024-09-12T17:07:49.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.462+0000 7f9eaebff780 1 < canceled part key=_multipart_TXHXOMIB4B53.2~9Q9VB27EEHAA.0 size=1048576 2024-09-12T17:07:49.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.463+0000 7f9eaebff780 1 < completed part key=_multipart_TXHXOMIB4B53.2~9Q9VB27EEHAA.1 size=1048576 2024-09-12T17:07:49.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.464+0000 7f9eaebff780 1 < completed part key=_multipart_TXHXOMIB4B53.2~9Q9VB27EEHAA.2 size=342833 2024-09-12T17:07:49.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.466+0000 7f9eaebff780 1 < canceled multipart upload key=TXHXOMIB4B53 upload=9Q9VB27EEHAA tag=OVW3A3AE5XUX type=write size=3488561 2024-09-12T17:07:49.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.468+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~WCDOXZM6QSMM.0 size=1048576 2024-09-12T17:07:49.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.469+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~WCDOXZM6QSMM.1 size=658536 2024-09-12T17:07:49.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.469+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=WCDOXZM6QSMM tag=61YR1BPITMZH type=write size=2755688 2024-09-12T17:07:49.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.470+0000 7f9eaebff780 1 < completed delete operation key=SHWT6AT7PN0M tag=VXR0R68D89DY type=del 2024-09-12T17:07:49.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.472+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~UJ3ZPGG3A5QJ.0 size=1048576 2024-09-12T17:07:49.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.473+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~UJ3ZPGG3A5QJ.1 size=985070 2024-09-12T17:07:49.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.473+0000 7f9eaebff780 1 > prepared multipart upload key=KF8XE48DI9KZ upload=UJ3ZPGG3A5QJ tag=DSR3UCTN7C3D type=write size=3082222 2024-09-12T17:07:49.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.475+0000 7f9eaebff780 1 < completed delete operation key=QIMNK4DL3D0N tag=LIMUIQ6T5JB7 type=del 2024-09-12T17:07:49.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.477+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~KHLG4GPCVB2S.0 size=1048576 2024-09-12T17:07:49.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.478+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~KHLG4GPCVB2S.1 size=990967 2024-09-12T17:07:49.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.478+0000 7f9eaebff780 1 > prepared multipart upload key=3VY271ZBO754 upload=KHLG4GPCVB2S tag=1O47II3532HP type=write size=3088119 2024-09-12T17:07:49.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.480+0000 7f9eaebff780 1 < suggested remove operation key=B1YC6DM9S8JJ tag=OUT5N9PQARHT type=del 2024-09-12T17:07:49.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.481+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=FA52QSDWWU49 type=del size=3305959 2024-09-12T17:07:49.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.482+0000 7f9eaebff780 1 < completed delete operation key=LRI5G5G8O5X4 tag=M03ZZ3RVSKXH type=del 2024-09-12T17:07:49.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.485+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~HU66MQ44K4TL.0 size=1048576 2024-09-12T17:07:49.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.485+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~HU66MQ44K4TL.1 size=24733 2024-09-12T17:07:49.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.485+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=HU66MQ44K4TL tag=NBJOL3EWYW2E type=write size=2121885 2024-09-12T17:07:49.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.487+0000 7f9eaebff780 1 < completed delete operation key=TDZCNUZE8IOA tag=H0ZYHB1LW2ZZ type=del 2024-09-12T17:07:49.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.489+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~GQFNWD1JXQZA.0 size=846772 2024-09-12T17:07:49.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.489+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=GQFNWD1JXQZA tag=AHCHZ9YYTQ1P type=write size=1895348 2024-09-12T17:07:49.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.490+0000 7f9eaebff780 1 < canceled operation key=A1KRCFY18QTP tag=WF8VFM95NJFS type=del size=657162 2024-09-12T17:07:49.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.494+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=9ZZSP39SKWQE type=del size=2012988 2024-09-12T17:07:49.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.494+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~JE1N0QDVJZIG.0 size=127573 2024-09-12T17:07:49.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.496+0000 7f9eaebff780 1 < completed multipart upload key=QIMNK4DL3D0N upload=JE1N0QDVJZIG tag=XG7T7UL07JDY type=write size=1176149 2024-09-12T17:07:49.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.498+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~JVIS9Z3T0OVR.0 size=1048576 2024-09-12T17:07:49.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.499+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~JVIS9Z3T0OVR.1 size=736915 2024-09-12T17:07:49.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.499+0000 7f9eaebff780 1 > prepared multipart upload key=ZC814TPVLJO1 upload=JVIS9Z3T0OVR tag=HF2P4XSJ0IP8 type=write size=2834067 2024-09-12T17:07:49.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.500+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~TDNZZFKVX6BO.0 size=609864 2024-09-12T17:07:49.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.502+0000 7f9eaebff780 1 < completed multipart upload key=9WJGBODZ60NJ upload=TDNZZFKVX6BO tag=8G69Q65I0RE9 type=write size=1658440 2024-09-12T17:07:49.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.505+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~OA12PPX9P466.0 size=42944 2024-09-12T17:07:49.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.505+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=OA12PPX9P466 tag=4DKRPJ9MM18E type=write size=1091520 2024-09-12T17:07:49.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.508+0000 7f9eaebff780 1 < suggested remove operation key=A1KRCFY18QTP tag=9IKBWD7A4VZI type=del 2024-09-12T17:07:49.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.509+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~2I8AZ7GTQO7U.0 size=1048576 2024-09-12T17:07:49.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.510+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~2I8AZ7GTQO7U.1 size=1048576 2024-09-12T17:07:49.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.511+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~2I8AZ7GTQO7U.2 size=595266 2024-09-12T17:07:49.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.511+0000 7f9eaebff780 1 > prepared multipart upload key=ZYP3P4031PUZ upload=2I8AZ7GTQO7U tag=GI9DOFYEMWDG type=write size=3740994 2024-09-12T17:07:49.516 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.514+0000 7f9eaebff780 1 < suggested remove operation key=LRI5G5G8O5X4 tag=Q7TEEO1WS25Q type=del 2024-09-12T17:07:49.517 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.516+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=QTDQAQDCR3PU type=del size=3124164 2024-09-12T17:07:49.518 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.516+0000 7f9eaebff780 1 < completed delete operation key=K0P9ZZ91UJJ8 tag=MUKX7KZPTSPO type=del 2024-09-12T17:07:49.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.517+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=LKVIJME1K5I7 type=del size=3581415 2024-09-12T17:07:49.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.517+0000 7f9eaebff780 1 < canceled part key=_multipart_A1KRCFY18QTP.2~RBONDA8NGW3B.0 size=1048576 2024-09-12T17:07:49.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.517+0000 7f9eaebff780 1 < canceled part key=_multipart_A1KRCFY18QTP.2~RBONDA8NGW3B.1 size=1048576 2024-09-12T17:07:49.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.518+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~RBONDA8NGW3B.2 size=123188 2024-09-12T17:07:49.523 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.520+0000 7f9eaebff780 1 < canceled multipart upload key=A1KRCFY18QTP upload=RBONDA8NGW3B tag=SHN2OWEKGA25 type=write size=3268916 2024-09-12T17:07:49.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.522+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=DG0B3HY6KM9C type=del size=1529478 2024-09-12T17:07:49.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.524+0000 7f9eaebff780 1 < completed write operation key=3VY271ZBO754 tag=SITJ8K36F4CI type=write size=660896 2024-09-12T17:07:49.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.524+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=JT86FSI24JA9 type=del size=2921903 2024-09-12T17:07:49.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.525+0000 7f9eaebff780 1 < completed delete operation key=TXHXOMIB4B53 tag=JE6HZTDGGXN4 type=del 2024-09-12T17:07:49.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.529+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~7FTOQVSP8HQX.0 size=1048576 2024-09-12T17:07:49.531 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.529+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~7FTOQVSP8HQX.1 size=1048576 2024-09-12T17:07:49.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.530+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~7FTOQVSP8HQX.2 size=929276 2024-09-12T17:07:49.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.530+0000 7f9eaebff780 1 > prepared multipart upload key=QIMNK4DL3D0N upload=7FTOQVSP8HQX tag=PHY7VK9LHP86 type=write size=4075004 2024-09-12T17:07:49.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.532+0000 7f9eaebff780 1 < canceled operation key=8DJLYFM11DNI tag=NA6K2QMCP54P type=del size=612879 2024-09-12T17:07:49.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.534+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~GN1M7Y6VX5P6.0 size=186568 2024-09-12T17:07:49.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.534+0000 7f9eaebff780 1 > prepared multipart upload key=SO6QF2JCRX6E upload=GN1M7Y6VX5P6 tag=CJHEQWHHO8DI type=write size=1235144 2024-09-12T17:07:49.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.535+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~WCDOXZM6QSMM.0 size=1048576 2024-09-12T17:07:49.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.536+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~WCDOXZM6QSMM.1 size=658536 2024-09-12T17:07:49.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.538+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=WCDOXZM6QSMM tag=61YR1BPITMZH type=write size=2755688 2024-09-12T17:07:49.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.539+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=4PH0UJVU99RB type=del size=26963 2024-09-12T17:07:49.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.541+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~UJ3ZPGG3A5QJ.0 size=1048576 2024-09-12T17:07:49.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.541+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~UJ3ZPGG3A5QJ.1 size=985070 2024-09-12T17:07:49.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.544+0000 7f9eaebff780 1 < completed multipart upload key=KF8XE48DI9KZ upload=UJ3ZPGG3A5QJ tag=DSR3UCTN7C3D type=write size=3082222 2024-09-12T17:07:49.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.545+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=LXGEU2MXKBSP type=del size=4011751 2024-09-12T17:07:49.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.545+0000 7f9eaebff780 1 < canceled part key=_multipart_3VY271ZBO754.2~KHLG4GPCVB2S.0 size=1048576 2024-09-12T17:07:49.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.546+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~KHLG4GPCVB2S.1 size=990967 2024-09-12T17:07:49.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.548+0000 7f9eaebff780 1 < canceled multipart upload key=3VY271ZBO754 upload=KHLG4GPCVB2S tag=1O47II3532HP type=write size=3088119 2024-09-12T17:07:49.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.549+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=LU9MLLI5JXLH type=del size=3455474 2024-09-12T17:07:49.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.551+0000 7f9eaebff780 1 < completed delete operation key=QIMNK4DL3D0N tag=FA52QSDWWU49 type=del 2024-09-12T17:07:49.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.552+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=FP7AAHY8SE5L type=del size=553705 2024-09-12T17:07:49.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.553+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~HU66MQ44K4TL.0 size=1048576 2024-09-12T17:07:49.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.554+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~HU66MQ44K4TL.1 size=24733 2024-09-12T17:07:49.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.556+0000 7f9eaebff780 1 < completed multipart upload key=K2NHRSUDQBRW upload=HU66MQ44K4TL tag=NBJOL3EWYW2E type=write size=2121885 2024-09-12T17:07:49.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.559+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~QA9KAF04PALC.0 size=1048576 2024-09-12T17:07:49.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.560+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~QA9KAF04PALC.1 size=391890 2024-09-12T17:07:49.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.560+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=QA9KAF04PALC tag=JIA15SYN9X8K type=write size=2489042 2024-09-12T17:07:49.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.561+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~GQFNWD1JXQZA.0 size=846772 2024-09-12T17:07:49.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.564+0000 7f9eaebff780 1 < completed multipart upload key=SHWT6AT7PN0M upload=GQFNWD1JXQZA tag=AHCHZ9YYTQ1P type=write size=1895348 2024-09-12T17:07:49.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.565+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=OV5ZFDJWGZB4 type=del size=1506725 2024-09-12T17:07:49.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.566+0000 7f9eaebff780 1 < completed delete operation key=3VY271ZBO754 tag=9ZZSP39SKWQE type=del 2024-09-12T17:07:49.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.567+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=281N9HGAVC18 type=write size=681751 2024-09-12T17:07:49.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.569+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~JVIS9Z3T0OVR.0 size=1048576 2024-09-12T17:07:49.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.570+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~JVIS9Z3T0OVR.1 size=736915 2024-09-12T17:07:49.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.572+0000 7f9eaebff780 1 < completed multipart upload key=ZC814TPVLJO1 upload=JVIS9Z3T0OVR tag=HF2P4XSJ0IP8 type=write size=2834067 2024-09-12T17:07:49.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.573+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=BPPZW235T0P2 type=del size=3175584 2024-09-12T17:07:49.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.574+0000 7f9eaebff780 1 < canceled part key=_multipart_OH6GXTMPBYUY.2~OA12PPX9P466.0 size=42944 2024-09-12T17:07:49.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.576+0000 7f9eaebff780 1 < canceled multipart upload key=OH6GXTMPBYUY upload=OA12PPX9P466 tag=4DKRPJ9MM18E type=write size=1091520 2024-09-12T17:07:49.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.578+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~UMUNJDFQGH4Q.0 size=1048576 2024-09-12T17:07:49.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.579+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~UMUNJDFQGH4Q.1 size=1048576 2024-09-12T17:07:49.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.580+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~UMUNJDFQGH4Q.2 size=154030 2024-09-12T17:07:49.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.580+0000 7f9eaebff780 1 > prepared multipart upload key=3VY271ZBO754 upload=UMUNJDFQGH4Q tag=8OHWFSL4VXXB type=write size=3299758 2024-09-12T17:07:49.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.581+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~2I8AZ7GTQO7U.0 size=1048576 2024-09-12T17:07:49.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.582+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~2I8AZ7GTQO7U.1 size=1048576 2024-09-12T17:07:49.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.583+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~2I8AZ7GTQO7U.2 size=595266 2024-09-12T17:07:49.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.585+0000 7f9eaebff780 1 < completed multipart upload key=ZYP3P4031PUZ upload=2I8AZ7GTQO7U tag=GI9DOFYEMWDG type=write size=3740994 2024-09-12T17:07:49.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.588+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~9135HY5R6MMZ.0 size=1048576 2024-09-12T17:07:49.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.589+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~9135HY5R6MMZ.1 size=150056 2024-09-12T17:07:49.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.589+0000 7f9eaebff780 1 > prepared multipart upload key=9WJGBODZ60NJ upload=9135HY5R6MMZ tag=2L38Q0EIMOEE type=write size=2247208 2024-09-12T17:07:49.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.591+0000 7f9eaebff780 1 < suggested remove operation key=SO6QF2JCRX6E tag=QTDQAQDCR3PU type=del 2024-09-12T17:07:49.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.592+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=J3EFH1YTLWOJ type=del size=2297547 2024-09-12T17:07:49.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.594+0000 7f9eaebff780 1 < completed delete operation key=QIMNK4DL3D0N tag=LKVIJME1K5I7 type=del 2024-09-12T17:07:49.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.595+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=XWESHMPXQOP7 type=write size=327444 2024-09-12T17:07:49.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.596+0000 7f9eaebff780 1 < completed delete operation key=M3PLQGSK34YM tag=DG0B3HY6KM9C type=del 2024-09-12T17:07:49.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.597+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=JXEDZSTCJ18U type=del size=267756 2024-09-12T17:07:49.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.598+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=JT86FSI24JA9 type=del 2024-09-12T17:07:49.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.600+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=FAK330OUAGDD type=del size=2691092 2024-09-12T17:07:49.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.601+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~7FTOQVSP8HQX.0 size=1048576 2024-09-12T17:07:49.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.602+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~7FTOQVSP8HQX.1 size=1048576 2024-09-12T17:07:49.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.603+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~7FTOQVSP8HQX.2 size=929276 2024-09-12T17:07:49.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.605+0000 7f9eaebff780 1 < completed multipart upload key=QIMNK4DL3D0N upload=7FTOQVSP8HQX tag=PHY7VK9LHP86 type=write size=4075004 2024-09-12T17:07:49.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.607+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~DN7V8N0UZP1Z.0 size=1048576 2024-09-12T17:07:49.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.608+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~DN7V8N0UZP1Z.1 size=1048576 2024-09-12T17:07:49.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.609+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~DN7V8N0UZP1Z.2 size=177629 2024-09-12T17:07:49.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.609+0000 7f9eaebff780 1 > prepared multipart upload key=0F5LXJZMBFSP upload=DN7V8N0UZP1Z tag=11MATQNANXS1 type=write size=3323357 2024-09-12T17:07:49.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.609+0000 7f9eaebff780 1 < canceled part key=_multipart_SO6QF2JCRX6E.2~GN1M7Y6VX5P6.0 size=186568 2024-09-12T17:07:49.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.611+0000 7f9eaebff780 1 < canceled multipart upload key=SO6QF2JCRX6E upload=GN1M7Y6VX5P6 tag=CJHEQWHHO8DI type=write size=1235144 2024-09-12T17:07:49.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.613+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=6O5XHF2SFW7T type=del size=2650211 2024-09-12T17:07:49.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.614+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=4PH0UJVU99RB type=del 2024-09-12T17:07:49.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.615+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=R8ZY1TF89BAO type=del size=1370455 2024-09-12T17:07:49.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.616+0000 7f9eaebff780 1 < completed delete operation key=0YD5P1ACZ09Q tag=LXGEU2MXKBSP type=del 2024-09-12T17:07:49.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.618+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~CTD6Z9LO3E1K.0 size=672831 2024-09-12T17:07:49.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.618+0000 7f9eaebff780 1 > prepared multipart upload key=QIMNK4DL3D0N upload=CTD6Z9LO3E1K tag=VB0SYD8Q4W8V type=write size=1721407 2024-09-12T17:07:49.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.620+0000 7f9eaebff780 1 < completed delete operation key=7PBT9VZ07OUI tag=LU9MLLI5JXLH type=del 2024-09-12T17:07:49.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.621+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=OS4DORXVYDSO type=del size=44221 2024-09-12T17:07:49.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.622+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=FP7AAHY8SE5L type=del 2024-09-12T17:07:49.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.624+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~RC3L0BPXZ16G.0 size=1048576 2024-09-12T17:07:49.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.626+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~RC3L0BPXZ16G.1 size=1048576 2024-09-12T17:07:49.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.627+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~RC3L0BPXZ16G.2 size=106887 2024-09-12T17:07:49.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.627+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=RC3L0BPXZ16G tag=VZTCYYR79PJM type=write size=3252615 2024-09-12T17:07:49.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.627+0000 7f9eaebff780 1 < canceled part key=_multipart_SVWPQETL92QU.2~QA9KAF04PALC.0 size=1048576 2024-09-12T17:07:49.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.628+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~QA9KAF04PALC.1 size=391890 2024-09-12T17:07:49.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.630+0000 7f9eaebff780 1 < canceled multipart upload key=SVWPQETL92QU upload=QA9KAF04PALC tag=JIA15SYN9X8K type=write size=2489042 2024-09-12T17:07:49.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.631+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=R7I49LFM5C2N type=del size=2589121 2024-09-12T17:07:49.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.632+0000 7f9eaebff780 1 < completed delete operation key=B1YC6DM9S8JJ tag=OV5ZFDJWGZB4 type=del 2024-09-12T17:07:49.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.634+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~RIVRMYS0OZL1.0 size=689381 2024-09-12T17:07:49.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.634+0000 7f9eaebff780 1 > prepared multipart upload key=YIEP2JYDSLW0 upload=RIVRMYS0OZL1 tag=WTSHJBXSNBP2 type=write size=1737957 2024-09-12T17:07:49.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.635+0000 7f9eaebff780 1 < completed write operation key=8DJLYFM11DNI tag=281N9HGAVC18 type=write size=681751 2024-09-12T17:07:49.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.638+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~Q46ON7S0H8I1.0 size=1048576 2024-09-12T17:07:49.640 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.639+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~Q46ON7S0H8I1.1 size=1048576 2024-09-12T17:07:49.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.640+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~Q46ON7S0H8I1.2 size=59530 2024-09-12T17:07:49.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.640+0000 7f9eaebff780 1 > prepared multipart upload key=QIMNK4DL3D0N upload=Q46ON7S0H8I1 tag=0X7P1QE8MURQ type=write size=3205258 2024-09-12T17:07:49.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.641+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=BPPZW235T0P2 type=del 2024-09-12T17:07:49.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.643+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~KL9K5UGT3QJ3.0 size=939934 2024-09-12T17:07:49.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.643+0000 7f9eaebff780 1 > prepared multipart upload key=SO6QF2JCRX6E upload=KL9K5UGT3QJ3 tag=VXZUKJT19ACB type=write size=1988510 2024-09-12T17:07:49.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.645+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~UMUNJDFQGH4Q.0 size=1048576 2024-09-12T17:07:49.647 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.646+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~UMUNJDFQGH4Q.1 size=1048576 2024-09-12T17:07:49.648 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.647+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~UMUNJDFQGH4Q.2 size=154030 2024-09-12T17:07:49.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.649+0000 7f9eaebff780 1 < completed multipart upload key=3VY271ZBO754 upload=UMUNJDFQGH4Q tag=8OHWFSL4VXXB type=write size=3299758 2024-09-12T17:07:49.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.650+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=1BRIDXCWB1IN type=del size=1206496 2024-09-12T17:07:49.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.652+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~9135HY5R6MMZ.0 size=1048576 2024-09-12T17:07:49.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.653+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~9135HY5R6MMZ.1 size=150056 2024-09-12T17:07:49.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.655+0000 7f9eaebff780 1 < completed multipart upload key=9WJGBODZ60NJ upload=9135HY5R6MMZ tag=2L38Q0EIMOEE type=write size=2247208 2024-09-12T17:07:49.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.657+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~5B966VFE1DQK.0 size=70091 2024-09-12T17:07:49.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.657+0000 7f9eaebff780 1 > prepared multipart upload key=ZYP3P4031PUZ upload=5B966VFE1DQK tag=3Y5W3P6EIWND type=write size=1118667 2024-09-12T17:07:49.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.658+0000 7f9eaebff780 1 < completed delete operation key=OGD6H9VSVGWF tag=J3EFH1YTLWOJ type=del 2024-09-12T17:07:49.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.660+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~7IZ6F2VZ4UQE.0 size=1048576 2024-09-12T17:07:49.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.661+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~7IZ6F2VZ4UQE.1 size=1048576 2024-09-12T17:07:49.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.662+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~7IZ6F2VZ4UQE.2 size=780211 2024-09-12T17:07:49.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.662+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=7IZ6F2VZ4UQE tag=TVW1OW1Y9RVK type=write size=3925939 2024-09-12T17:07:49.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.664+0000 7f9eaebff780 1 < completed write operation key=3LY681252WAN tag=XWESHMPXQOP7 type=write size=327444 2024-09-12T17:07:49.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.666+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=X608DJI8E9HH type=del size=2505375 2024-09-12T17:07:49.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.667+0000 7f9eaebff780 1 < completed delete operation key=B1YC6DM9S8JJ tag=JXEDZSTCJ18U type=del 2024-09-12T17:07:49.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.669+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=3G4ZY7AFA88X type=del size=2747386 2024-09-12T17:07:49.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.670+0000 7f9eaebff780 1 < completed delete operation key=UYF1AN2W59VN tag=FAK330OUAGDD type=del 2024-09-12T17:07:49.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.671+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=BKLKCJ9OMUAF type=write size=258647 2024-09-12T17:07:49.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.673+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~DN7V8N0UZP1Z.0 size=1048576 2024-09-12T17:07:49.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.674+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~DN7V8N0UZP1Z.1 size=1048576 2024-09-12T17:07:49.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.675+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~DN7V8N0UZP1Z.2 size=177629 2024-09-12T17:07:49.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.677+0000 7f9eaebff780 1 < completed multipart upload key=0F5LXJZMBFSP upload=DN7V8N0UZP1Z tag=11MATQNANXS1 type=write size=3323357 2024-09-12T17:07:49.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.679+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=LAZDTKM65OS8 type=del size=984160 2024-09-12T17:07:49.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.680+0000 7f9eaebff780 1 < completed delete operation key=M3PLQGSK34YM tag=6O5XHF2SFW7T type=del 2024-09-12T17:07:49.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.684+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~KLIQVSCQ7B0T.0 size=1048576 2024-09-12T17:07:49.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.685+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~KLIQVSCQ7B0T.1 size=1048576 2024-09-12T17:07:49.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.685+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~KLIQVSCQ7B0T.2 size=151454 2024-09-12T17:07:49.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.685+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=KLIQVSCQ7B0T tag=AQC5FTNE8RDR type=write size=3297182 2024-09-12T17:07:49.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.687+0000 7f9eaebff780 1 < completed delete operation key=0F5LXJZMBFSP tag=R8ZY1TF89BAO type=del 2024-09-12T17:07:49.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.688+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=UYMZ4SYAW6K9 type=del size=1960408 2024-09-12T17:07:49.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.689+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~CTD6Z9LO3E1K.0 size=672831 2024-09-12T17:07:49.692 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.691+0000 7f9eaebff780 1 < completed multipart upload key=QIMNK4DL3D0N upload=CTD6Z9LO3E1K tag=VB0SYD8Q4W8V type=write size=1721407 2024-09-12T17:07:49.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.692+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=4230Q4O9W7SR type=write size=681986 2024-09-12T17:07:49.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.693+0000 7f9eaebff780 1 < completed delete operation key=8DJLYFM11DNI tag=OS4DORXVYDSO type=del 2024-09-12T17:07:49.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.694+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=8UGRYS8N8YYF type=del size=416933 2024-09-12T17:07:49.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.696+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~RC3L0BPXZ16G.0 size=1048576 2024-09-12T17:07:49.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.697+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~RC3L0BPXZ16G.1 size=1048576 2024-09-12T17:07:49.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.698+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~RC3L0BPXZ16G.2 size=106887 2024-09-12T17:07:49.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.700+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=RC3L0BPXZ16G tag=VZTCYYR79PJM type=write size=3252615 2024-09-12T17:07:49.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.701+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=WBUMIHMG622L type=del size=2658139 2024-09-12T17:07:49.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.702+0000 7f9eaebff780 1 < completed delete operation key=SO6QF2JCRX6E tag=R7I49LFM5C2N type=del 2024-09-12T17:07:49.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.705+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~XJZI71OCEQM8.0 size=1048576 2024-09-12T17:07:49.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.706+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~XJZI71OCEQM8.1 size=1048576 2024-09-12T17:07:49.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.707+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~XJZI71OCEQM8.2 size=921093 2024-09-12T17:07:49.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.707+0000 7f9eaebff780 1 > prepared multipart upload key=8DJLYFM11DNI upload=XJZI71OCEQM8 tag=U32YBA8TH03L type=write size=4066821 2024-09-12T17:07:49.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.708+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~RIVRMYS0OZL1.0 size=689381 2024-09-12T17:07:49.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.710+0000 7f9eaebff780 1 < completed multipart upload key=YIEP2JYDSLW0 upload=RIVRMYS0OZL1 tag=WTSHJBXSNBP2 type=write size=1737957 2024-09-12T17:07:49.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.711+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=VZT7YC1P0NH2 type=del size=1492615 2024-09-12T17:07:49.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.712+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~Q46ON7S0H8I1.0 size=1048576 2024-09-12T17:07:49.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.712+0000 7f9eaebff780 1 < canceled part key=_multipart_QIMNK4DL3D0N.2~Q46ON7S0H8I1.1 size=1048576 2024-09-12T17:07:49.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.713+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~Q46ON7S0H8I1.2 size=59530 2024-09-12T17:07:49.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.716+0000 7f9eaebff780 1 < canceled multipart upload key=QIMNK4DL3D0N upload=Q46ON7S0H8I1 tag=0X7P1QE8MURQ type=write size=3205258 2024-09-12T17:07:49.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.717+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=JENRHAIXCZDK type=del size=3266699 2024-09-12T17:07:49.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.718+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~KL9K5UGT3QJ3.0 size=939934 2024-09-12T17:07:49.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.720+0000 7f9eaebff780 1 < completed multipart upload key=SO6QF2JCRX6E upload=KL9K5UGT3QJ3 tag=VXZUKJT19ACB type=write size=1988510 2024-09-12T17:07:49.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.722+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~15YLPWIS5PHZ.0 size=1048576 2024-09-12T17:07:49.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.723+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~15YLPWIS5PHZ.1 size=1048576 2024-09-12T17:07:49.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.724+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~15YLPWIS5PHZ.2 size=276926 2024-09-12T17:07:49.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.724+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=15YLPWIS5PHZ tag=4I6AXM0J0W3F type=write size=3422654 2024-09-12T17:07:49.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.726+0000 7f9eaebff780 1 < suggested update operation key=LRI5G5G8O5X4 tag=1BRIDXCWB1IN type=del size=1206496 2024-09-12T17:07:49.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.727+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=WZB231ICPS2W type=write size=41032 2024-09-12T17:07:49.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.728+0000 7f9eaebff780 1 < canceled part key=_multipart_ZYP3P4031PUZ.2~5B966VFE1DQK.0 size=70091 2024-09-12T17:07:49.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.730+0000 7f9eaebff780 1 < canceled multipart upload key=ZYP3P4031PUZ upload=5B966VFE1DQK tag=3Y5W3P6EIWND type=write size=1118667 2024-09-12T17:07:49.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.731+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=3ZRXVIUB80SV type=del size=2750297 2024-09-12T17:07:49.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.732+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~7IZ6F2VZ4UQE.0 size=1048576 2024-09-12T17:07:49.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.733+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~7IZ6F2VZ4UQE.1 size=1048576 2024-09-12T17:07:49.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.734+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~7IZ6F2VZ4UQE.2 size=780211 2024-09-12T17:07:49.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.736+0000 7f9eaebff780 1 < completed multipart upload key=M3PLQGSK34YM upload=7IZ6F2VZ4UQE tag=TVW1OW1Y9RVK type=write size=3925939 2024-09-12T17:07:49.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.737+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=WHO370YKGUJA type=del size=3800238 2024-09-12T17:07:49.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.740+0000 7f9eaebff780 1 < suggested update operation key=K0P9ZZ91UJJ8 tag=X608DJI8E9HH type=del size=2505375 2024-09-12T17:07:49.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.741+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=532UPWJEF1YF type=del size=4179748 2024-09-12T17:07:49.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.742+0000 7f9eaebff780 1 < completed delete operation key=TXHXOMIB4B53 tag=3G4ZY7AFA88X type=del 2024-09-12T17:07:49.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.743+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=GF0T1RRMOZEL type=del size=4175029 2024-09-12T17:07:49.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.745+0000 7f9eaebff780 1 < canceled operation key=SO6QF2JCRX6E tag=BKLKCJ9OMUAF type=write size=258647 2024-09-12T17:07:49.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.747+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~K9PVUWDT1ZLW.0 size=835940 2024-09-12T17:07:49.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.747+0000 7f9eaebff780 1 > prepared multipart upload key=QIMNK4DL3D0N upload=K9PVUWDT1ZLW tag=9DYN9X2K19YW type=write size=1884516 2024-09-12T17:07:49.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.748+0000 7f9eaebff780 1 < completed delete operation key=GB8P7K59Y8VI tag=LAZDTKM65OS8 type=del 2024-09-12T17:07:49.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.749+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=IQ377BRZ4JCV type=del size=464419 2024-09-12T17:07:49.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.751+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~KLIQVSCQ7B0T.0 size=1048576 2024-09-12T17:07:49.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.751+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~KLIQVSCQ7B0T.1 size=1048576 2024-09-12T17:07:49.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.752+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~KLIQVSCQ7B0T.2 size=151454 2024-09-12T17:07:49.756 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.754+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=KLIQVSCQ7B0T tag=AQC5FTNE8RDR type=write size=3297182 2024-09-12T17:07:49.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.757+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~QAGPFEE76I09.0 size=1024330 2024-09-12T17:07:49.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.757+0000 7f9eaebff780 1 > prepared multipart upload key=KF8XE48DI9KZ upload=QAGPFEE76I09 tag=0ORR5SKHBI7Y type=write size=2072906 2024-09-12T17:07:49.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.760+0000 7f9eaebff780 1 < suggested update operation key=9I6RGNRB6HSY tag=UYMZ4SYAW6K9 type=del size=1960408 2024-09-12T17:07:49.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.761+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=75KFRK6L58QH type=del size=1138951 2024-09-12T17:07:49.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.762+0000 7f9eaebff780 -1 < failed to complete operation key=K0P9ZZ91UJJ8 tag=4230Q4O9W7SR type=write size=681986: (22) Invalid argument 2024-09-12T17:07:49.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.763+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=EFUC0G4ZZ3MG type=del size=3170892 2024-09-12T17:07:49.767 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.766+0000 7f9eaebff780 1 < suggested remove operation key=LJN514F16XJA tag=8UGRYS8N8YYF type=del 2024-09-12T17:07:49.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.768+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~XCVIT315XKNJ.0 size=1048576 2024-09-12T17:07:49.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.769+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~XCVIT315XKNJ.1 size=1048576 2024-09-12T17:07:49.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.770+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~XCVIT315XKNJ.2 size=408762 2024-09-12T17:07:49.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.770+0000 7f9eaebff780 1 > prepared multipart upload key=SO6QF2JCRX6E upload=XCVIT315XKNJ tag=AJBBJCHHE4R4 type=write size=3554490 2024-09-12T17:07:49.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.771+0000 7f9eaebff780 1 < completed delete operation key=SHWT6AT7PN0M tag=WBUMIHMG622L type=del 2024-09-12T17:07:49.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.773+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~NR5AUDRFB0S6.0 size=1048576 2024-09-12T17:07:49.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.774+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~NR5AUDRFB0S6.1 size=88804 2024-09-12T17:07:49.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.774+0000 7f9eaebff780 1 > prepared multipart upload key=B1YC6DM9S8JJ upload=NR5AUDRFB0S6 tag=ULACUP7F7WZX type=write size=2185956 2024-09-12T17:07:49.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.776+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~XJZI71OCEQM8.0 size=1048576 2024-09-12T17:07:49.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.777+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~XJZI71OCEQM8.1 size=1048576 2024-09-12T17:07:49.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.778+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~XJZI71OCEQM8.2 size=921093 2024-09-12T17:07:49.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.780+0000 7f9eaebff780 1 < completed multipart upload key=8DJLYFM11DNI upload=XJZI71OCEQM8 tag=U32YBA8TH03L type=write size=4066821 2024-09-12T17:07:49.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.781+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=Q8DWLCBBNDOG type=write size=500734 2024-09-12T17:07:49.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.782+0000 7f9eaebff780 1 < completed delete operation key=TXHXOMIB4B53 tag=VZT7YC1P0NH2 type=del 2024-09-12T17:07:49.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.783+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=VE50DUVJCBTC type=del size=3037005 2024-09-12T17:07:49.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.785+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=JENRHAIXCZDK type=del 2024-09-12T17:07:49.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.786+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=DB4PNHE4K29V type=del size=2548678 2024-09-12T17:07:49.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.787+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~15YLPWIS5PHZ.0 size=1048576 2024-09-12T17:07:49.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.788+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~15YLPWIS5PHZ.1 size=1048576 2024-09-12T17:07:49.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.789+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~15YLPWIS5PHZ.2 size=276926 2024-09-12T17:07:49.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.791+0000 7f9eaebff780 1 < completed multipart upload key=SHWT6AT7PN0M upload=15YLPWIS5PHZ tag=4I6AXM0J0W3F type=write size=3422654 2024-09-12T17:07:49.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.793+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=ROXAYAIL8WIA type=write size=246593 2024-09-12T17:07:49.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.796+0000 7f9eaebff780 1 < suggested update operation key=SVWPQETL92QU tag=WZB231ICPS2W type=write size=41032 2024-09-12T17:07:49.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.797+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=2H3GO6ENJR9G type=del size=2369565 2024-09-12T17:07:49.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.798+0000 7f9eaebff780 1 < completed delete operation key=K2NHRSUDQBRW tag=3ZRXVIUB80SV type=del 2024-09-12T17:07:49.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.800+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=GVVZUH71QG9O type=write size=180220 2024-09-12T17:07:49.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.801+0000 7f9eaebff780 -1 < failed to complete operation key=LJN514F16XJA tag=WHO370YKGUJA type=del size=3800238: (22) Invalid argument 2024-09-12T17:07:49.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.802+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=2BXDGZGQGLQ7 type=del size=231437 2024-09-12T17:07:49.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.803+0000 7f9eaebff780 -1 < failed to complete operation key=LJN514F16XJA tag=532UPWJEF1YF type=del size=4179748: (22) Invalid argument 2024-09-12T17:07:49.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.806+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~CU0EAFA5S6PO.0 size=276791 2024-09-12T17:07:49.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.806+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=CU0EAFA5S6PO tag=NSCJ8U8TO8NG type=write size=1325367 2024-09-12T17:07:49.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.807+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=GF0T1RRMOZEL type=del 2024-09-12T17:07:49.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.809+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~MXRTALIJYL6H.0 size=1048576 2024-09-12T17:07:49.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.810+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~MXRTALIJYL6H.1 size=1048576 2024-09-12T17:07:49.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.811+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~MXRTALIJYL6H.2 size=964353 2024-09-12T17:07:49.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.811+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=MXRTALIJYL6H tag=T6MDY1R7LN39 type=write size=4110081 2024-09-12T17:07:49.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.812+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~K9PVUWDT1ZLW.0 size=835940 2024-09-12T17:07:49.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.815+0000 7f9eaebff780 1 < completed multipart upload key=QIMNK4DL3D0N upload=K9PVUWDT1ZLW tag=9DYN9X2K19YW type=write size=1884516 2024-09-12T17:07:49.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.816+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=P5FLMDZ52Q1V type=del size=3083640 2024-09-12T17:07:49.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.817+0000 7f9eaebff780 -1 < failed to complete operation key=9I6RGNRB6HSY tag=IQ377BRZ4JCV type=del size=464419: (22) Invalid argument 2024-09-12T17:07:49.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.818+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=0J5S963DXL3G type=del size=3809719 2024-09-12T17:07:49.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.819+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~QAGPFEE76I09.0 size=1024330 2024-09-12T17:07:49.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.821+0000 7f9eaebff780 1 < completed multipart upload key=KF8XE48DI9KZ upload=QAGPFEE76I09 tag=0ORR5SKHBI7Y type=write size=2072906 2024-09-12T17:07:49.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.823+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=9DHF2ZP7IKHN type=del size=2315934 2024-09-12T17:07:49.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.824+0000 7f9eaebff780 1 < canceled operation key=OGD6H9VSVGWF tag=75KFRK6L58QH type=del size=1138951 2024-09-12T17:07:49.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.826+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~OMUZ6J8MRRSG.0 size=1048576 2024-09-12T17:07:49.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.827+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~OMUZ6J8MRRSG.1 size=1048576 2024-09-12T17:07:49.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.828+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~OMUZ6J8MRRSG.2 size=306953 2024-09-12T17:07:49.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.828+0000 7f9eaebff780 1 > prepared multipart upload key=TDZCNUZE8IOA upload=OMUZ6J8MRRSG tag=6G3AD7K2MI0O type=write size=3452681 2024-09-12T17:07:49.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.830+0000 7f9eaebff780 1 < suggested remove operation key=OH6GXTMPBYUY tag=EFUC0G4ZZ3MG type=del 2024-09-12T17:07:49.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.831+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=H3KN8C9L4M58 type=del size=2508548 2024-09-12T17:07:49.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.832+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~XCVIT315XKNJ.0 size=1048576 2024-09-12T17:07:49.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.833+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~XCVIT315XKNJ.1 size=1048576 2024-09-12T17:07:49.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.834+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~XCVIT315XKNJ.2 size=408762 2024-09-12T17:07:49.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.836+0000 7f9eaebff780 1 < completed multipart upload key=SO6QF2JCRX6E upload=XCVIT315XKNJ tag=AJBBJCHHE4R4 type=write size=3554490 2024-09-12T17:07:49.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.838+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=95AA9Y7GXDL4 type=write size=99041 2024-09-12T17:07:49.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.838+0000 7f9eaebff780 1 < canceled part key=_multipart_B1YC6DM9S8JJ.2~NR5AUDRFB0S6.0 size=1048576 2024-09-12T17:07:49.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.838+0000 7f9eaebff780 1 < canceled part key=_multipart_B1YC6DM9S8JJ.2~NR5AUDRFB0S6.1 size=88804 2024-09-12T17:07:49.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.840+0000 7f9eaebff780 1 < canceled multipart upload key=B1YC6DM9S8JJ upload=NR5AUDRFB0S6 tag=ULACUP7F7WZX type=write size=2185956 2024-09-12T17:07:49.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.842+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~H86S29LJ2D73.0 size=331046 2024-09-12T17:07:49.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.842+0000 7f9eaebff780 1 > prepared multipart upload key=OGD6H9VSVGWF upload=H86S29LJ2D73 tag=533L1JO1A6J7 type=write size=1379622 2024-09-12T17:07:49.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.843+0000 7f9eaebff780 -1 < failed to complete operation key=SVWPQETL92QU tag=Q8DWLCBBNDOG type=write size=500734: (22) Invalid argument 2024-09-12T17:07:49.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.846+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~BGKCM0G6XS5A.0 size=1048576 2024-09-12T17:07:49.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.847+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~BGKCM0G6XS5A.1 size=765738 2024-09-12T17:07:49.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.847+0000 7f9eaebff780 1 > prepared multipart upload key=9I6RGNRB6HSY upload=BGKCM0G6XS5A tag=L8WJ0Y0HLSJQ type=write size=2862890 2024-09-12T17:07:49.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.848+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=VE50DUVJCBTC type=del 2024-09-12T17:07:49.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.849+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=16KOTRDJ671H type=del size=2868691 2024-09-12T17:07:49.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.850+0000 7f9eaebff780 1 < completed delete operation key=ZC814TPVLJO1 tag=DB4PNHE4K29V type=del 2024-09-12T17:07:49.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.852+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=OQ238TDZ2I5W type=del size=1702285 2024-09-12T17:07:49.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.853+0000 7f9eaebff780 1 < completed write operation key=P9GMGM3WK6O7 tag=ROXAYAIL8WIA type=write size=246593 2024-09-12T17:07:49.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.854+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=X87FH6JCDYCB type=del size=276637 2024-09-12T17:07:49.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.855+0000 7f9eaebff780 1 < completed delete operation key=P9GMGM3WK6O7 tag=2H3GO6ENJR9G type=del 2024-09-12T17:07:49.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.856+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=YS4AK1HUMSOZ type=del size=1357592 2024-09-12T17:07:49.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.858+0000 7f9eaebff780 1 < completed write operation key=K2NHRSUDQBRW tag=GVVZUH71QG9O type=write size=180220 2024-09-12T17:07:49.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.860+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~7SEGL8EZD4C2.0 size=1048576 2024-09-12T17:07:49.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.861+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~7SEGL8EZD4C2.1 size=1048576 2024-09-12T17:07:49.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.862+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~7SEGL8EZD4C2.2 size=1000068 2024-09-12T17:07:49.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.862+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=7SEGL8EZD4C2 tag=0G53FJASL1RS type=write size=4145796 2024-09-12T17:07:49.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.864+0000 7f9eaebff780 1 < suggested update operation key=UYF1AN2W59VN tag=2BXDGZGQGLQ7 type=del size=231437 2024-09-12T17:07:49.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.865+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=M839Z4N99BTX type=del size=1752487 2024-09-12T17:07:49.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.867+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~CU0EAFA5S6PO.0 size=276791 2024-09-12T17:07:49.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.869+0000 7f9eaebff780 1 < completed multipart upload key=M3PLQGSK34YM upload=CU0EAFA5S6PO tag=NSCJ8U8TO8NG type=write size=1325367 2024-09-12T17:07:49.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.871+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~APJJWGRJVADB.0 size=1048576 2024-09-12T17:07:49.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.872+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~APJJWGRJVADB.1 size=83292 2024-09-12T17:07:49.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.872+0000 7f9eaebff780 1 > prepared multipart upload key=LJN514F16XJA upload=APJJWGRJVADB tag=C4MFHPZGSOGD type=write size=2180444 2024-09-12T17:07:49.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.873+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~MXRTALIJYL6H.0 size=1048576 2024-09-12T17:07:49.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.874+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~MXRTALIJYL6H.1 size=1048576 2024-09-12T17:07:49.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.875+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~MXRTALIJYL6H.2 size=964353 2024-09-12T17:07:49.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.877+0000 7f9eaebff780 1 < completed multipart upload key=K2NHRSUDQBRW upload=MXRTALIJYL6H tag=T6MDY1R7LN39 type=write size=4110081 2024-09-12T17:07:49.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.879+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~SHIX9ID97XG4.0 size=1048576 2024-09-12T17:07:49.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.880+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~SHIX9ID97XG4.1 size=1048576 2024-09-12T17:07:49.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.881+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~SHIX9ID97XG4.2 size=476584 2024-09-12T17:07:49.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.881+0000 7f9eaebff780 1 > prepared multipart upload key=EKUW5AKC428U upload=SHIX9ID97XG4 tag=7X3QQV2QUED9 type=write size=3622312 2024-09-12T17:07:49.884 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.882+0000 7f9eaebff780 1 < completed delete operation key=M3PLQGSK34YM tag=P5FLMDZ52Q1V type=del 2024-09-12T17:07:49.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.884+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=TBL19F8B4HCF type=write size=469895 2024-09-12T17:07:49.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.886+0000 7f9eaebff780 1 < suggested remove operation key=K2NHRSUDQBRW tag=0J5S963DXL3G type=del 2024-09-12T17:07:49.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.888+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~2EJQPK52J2L4.0 size=1048576 2024-09-12T17:07:49.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.889+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~2EJQPK52J2L4.1 size=1048576 2024-09-12T17:07:49.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.890+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~2EJQPK52J2L4.2 size=561115 2024-09-12T17:07:49.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.890+0000 7f9eaebff780 1 > prepared multipart upload key=KF8XE48DI9KZ upload=2EJQPK52J2L4 tag=VGN1M8XGD9JY type=write size=3706843 2024-09-12T17:07:49.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.891+0000 7f9eaebff780 1 < completed delete operation key=P9GMGM3WK6O7 tag=9DHF2ZP7IKHN type=del 2024-09-12T17:07:49.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.893+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~SW193VSSEA7O.0 size=960284 2024-09-12T17:07:49.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.893+0000 7f9eaebff780 1 > prepared multipart upload key=B1YC6DM9S8JJ upload=SW193VSSEA7O tag=TFYIP684ZOKY type=write size=2008860 2024-09-12T17:07:49.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.894+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~OMUZ6J8MRRSG.0 size=1048576 2024-09-12T17:07:49.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.894+0000 7f9eaebff780 1 < canceled part key=_multipart_TDZCNUZE8IOA.2~OMUZ6J8MRRSG.1 size=1048576 2024-09-12T17:07:49.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.895+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~OMUZ6J8MRRSG.2 size=306953 2024-09-12T17:07:49.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.897+0000 7f9eaebff780 1 < canceled multipart upload key=TDZCNUZE8IOA upload=OMUZ6J8MRRSG tag=6G3AD7K2MI0O type=write size=3452681 2024-09-12T17:07:49.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.899+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=PDNQQLSOZ5GO type=del size=3811507 2024-09-12T17:07:49.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.901+0000 7f9eaebff780 1 < suggested remove operation key=SO6QF2JCRX6E tag=H3KN8C9L4M58 type=del 2024-09-12T17:07:49.903 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.902+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=RNLDXIVJ9ETF type=write size=83043 2024-09-12T17:07:49.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.904+0000 7f9eaebff780 1 < suggested update operation key=7PBT9VZ07OUI tag=95AA9Y7GXDL4 type=write size=99041 2024-09-12T17:07:49.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.906+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=9D36KX8JB5HS type=del size=418591 2024-09-12T17:07:49.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.907+0000 7f9eaebff780 1 < canceled part key=_multipart_OGD6H9VSVGWF.2~H86S29LJ2D73.0 size=331046 2024-09-12T17:07:49.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.909+0000 7f9eaebff780 1 < canceled multipart upload key=OGD6H9VSVGWF upload=H86S29LJ2D73 tag=533L1JO1A6J7 type=write size=1379622 2024-09-12T17:07:49.911 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.910+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=V9I7M392VLPN type=write size=186962 2024-09-12T17:07:49.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.911+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~BGKCM0G6XS5A.0 size=1048576 2024-09-12T17:07:49.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.912+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~BGKCM0G6XS5A.1 size=765738 2024-09-12T17:07:49.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.914+0000 7f9eaebff780 1 < completed multipart upload key=9I6RGNRB6HSY upload=BGKCM0G6XS5A tag=L8WJ0Y0HLSJQ type=write size=2862890 2024-09-12T17:07:49.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.915+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=VCGBRY6I5NHI type=del size=3906989 2024-09-12T17:07:49.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.918+0000 7f9eaebff780 1 < suggested update operation key=9WJGBODZ60NJ tag=16KOTRDJ671H type=del size=2868691 2024-09-12T17:07:49.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.920+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~TWDRED5NYC5R.0 size=1048576 2024-09-12T17:07:49.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.921+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~TWDRED5NYC5R.1 size=1048576 2024-09-12T17:07:49.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.922+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~TWDRED5NYC5R.2 size=541330 2024-09-12T17:07:49.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.922+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=TWDRED5NYC5R tag=KTPLRGH5IYO7 type=write size=3687058 2024-09-12T17:07:49.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.923+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=OQ238TDZ2I5W type=del 2024-09-12T17:07:49.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.924+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=NE9HY1MU7CRT type=del size=1283440 2024-09-12T17:07:49.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.925+0000 7f9eaebff780 -1 < failed to complete operation key=9WJGBODZ60NJ tag=X87FH6JCDYCB type=del size=276637: (22) Invalid argument 2024-09-12T17:07:49.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.927+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~AKFUKGXFRWH2.0 size=1048576 2024-09-12T17:07:49.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.928+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~AKFUKGXFRWH2.1 size=153446 2024-09-12T17:07:49.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.928+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=AKFUKGXFRWH2 tag=MQJS2VXNZYLS type=write size=2250598 2024-09-12T17:07:49.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.929+0000 7f9eaebff780 1 < completed delete operation key=ZC814TPVLJO1 tag=YS4AK1HUMSOZ type=del 2024-09-12T17:07:49.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.932+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~HLDBCVQGCABQ.0 size=1048576 2024-09-12T17:07:49.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.933+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~HLDBCVQGCABQ.1 size=1048576 2024-09-12T17:07:49.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.934+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~HLDBCVQGCABQ.2 size=535896 2024-09-12T17:07:49.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.934+0000 7f9eaebff780 1 > prepared multipart upload key=ZYP3P4031PUZ upload=HLDBCVQGCABQ tag=9PRL0PNSWSHI type=write size=3681624 2024-09-12T17:07:49.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.935+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~7SEGL8EZD4C2.0 size=1048576 2024-09-12T17:07:49.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.936+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~7SEGL8EZD4C2.1 size=1048576 2024-09-12T17:07:49.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.936+0000 7f9eaebff780 1 < canceled part key=_multipart_SHWT6AT7PN0M.2~7SEGL8EZD4C2.2 size=1000068 2024-09-12T17:07:49.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.938+0000 7f9eaebff780 1 < canceled multipart upload key=SHWT6AT7PN0M upload=7SEGL8EZD4C2 tag=0G53FJASL1RS type=write size=4145796 2024-09-12T17:07:49.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.939+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=A7VYXIX00J9M type=del size=1218646 2024-09-12T17:07:49.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.941+0000 7f9eaebff780 1 < completed delete operation key=UYF1AN2W59VN tag=M839Z4N99BTX type=del 2024-09-12T17:07:49.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.942+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=V3PZ2ZIXYI3C type=del size=2493726 2024-09-12T17:07:49.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.942+0000 7f9eaebff780 1 < canceled part key=_multipart_LJN514F16XJA.2~APJJWGRJVADB.0 size=1048576 2024-09-12T17:07:49.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.943+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~APJJWGRJVADB.1 size=83292 2024-09-12T17:07:49.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.946+0000 7f9eaebff780 1 < canceled multipart upload key=LJN514F16XJA upload=APJJWGRJVADB tag=C4MFHPZGSOGD type=write size=2180444 2024-09-12T17:07:49.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.947+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=2AMEF6A6985S type=write size=762133 2024-09-12T17:07:49.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.948+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~SHIX9ID97XG4.0 size=1048576 2024-09-12T17:07:49.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.949+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~SHIX9ID97XG4.1 size=1048576 2024-09-12T17:07:49.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.949+0000 7f9eaebff780 1 < canceled part key=_multipart_EKUW5AKC428U.2~SHIX9ID97XG4.2 size=476584 2024-09-12T17:07:49.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.952+0000 7f9eaebff780 1 < canceled multipart upload key=EKUW5AKC428U upload=SHIX9ID97XG4 tag=7X3QQV2QUED9 type=write size=3622312 2024-09-12T17:07:49.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.953+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=8C2D08JK7A35 type=del size=2414577 2024-09-12T17:07:49.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.954+0000 7f9eaebff780 -1 < failed to complete operation key=SO6QF2JCRX6E tag=TBL19F8B4HCF type=write size=469895: (22) Invalid argument 2024-09-12T17:07:49.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.956+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=X1P8LC552ZYO type=del size=3593595 2024-09-12T17:07:49.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.957+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~2EJQPK52J2L4.0 size=1048576 2024-09-12T17:07:49.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.958+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~2EJQPK52J2L4.1 size=1048576 2024-09-12T17:07:49.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.959+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~2EJQPK52J2L4.2 size=561115 2024-09-12T17:07:49.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.961+0000 7f9eaebff780 1 < completed multipart upload key=KF8XE48DI9KZ upload=2EJQPK52J2L4 tag=VGN1M8XGD9JY type=write size=3706843 2024-09-12T17:07:49.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.964+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~EKBBSG0RWQA3.0 size=1048576 2024-09-12T17:07:49.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.965+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~EKBBSG0RWQA3.1 size=205037 2024-09-12T17:07:49.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.965+0000 7f9eaebff780 1 > prepared multipart upload key=YIEP2JYDSLW0 upload=EKBBSG0RWQA3 tag=X0Y9T8O30X81 type=write size=2302189 2024-09-12T17:07:49.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.965+0000 7f9eaebff780 1 < canceled part key=_multipart_B1YC6DM9S8JJ.2~SW193VSSEA7O.0 size=960284 2024-09-12T17:07:49.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.967+0000 7f9eaebff780 1 < canceled multipart upload key=B1YC6DM9S8JJ upload=SW193VSSEA7O tag=TFYIP684ZOKY type=write size=2008860 2024-09-12T17:07:49.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.968+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=F4AQ0G9XVH43 type=del size=1433190 2024-09-12T17:07:49.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.969+0000 7f9eaebff780 -1 < failed to complete operation key=7PBT9VZ07OUI tag=PDNQQLSOZ5GO type=del size=3811507: (22) Invalid argument 2024-09-12T17:07:49.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.971+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~OWT7TU705UJV.0 size=1048576 2024-09-12T17:07:49.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.972+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~OWT7TU705UJV.1 size=1048576 2024-09-12T17:07:49.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.973+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~OWT7TU705UJV.2 size=515332 2024-09-12T17:07:49.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.973+0000 7f9eaebff780 1 > prepared multipart upload key=8DJLYFM11DNI upload=OWT7TU705UJV tag=RI6T7C8CAOWU type=write size=3661060 2024-09-12T17:07:49.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.974+0000 7f9eaebff780 1 < completed write operation key=0YD5P1ACZ09Q tag=RNLDXIVJ9ETF type=write size=83043 2024-09-12T17:07:49.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.976+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=2P4AO4FO1BAW type=del size=1114704 2024-09-12T17:07:49.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.977+0000 7f9eaebff780 1 < canceled operation key=K0P9ZZ91UJJ8 tag=9D36KX8JB5HS type=del size=418591 2024-09-12T17:07:49.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.979+0000 7f9eaebff780 1 > prepared part key=_multipart_TXHXOMIB4B53.2~516W68OF5DAW.0 size=1048576 2024-09-12T17:07:49.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.980+0000 7f9eaebff780 1 > prepared part key=_multipart_TXHXOMIB4B53.2~516W68OF5DAW.1 size=412513 2024-09-12T17:07:49.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.980+0000 7f9eaebff780 1 > prepared multipart upload key=TXHXOMIB4B53 upload=516W68OF5DAW tag=480RTHJZJ0QV type=write size=2509665 2024-09-12T17:07:49.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.981+0000 7f9eaebff780 1 < completed write operation key=QIMNK4DL3D0N tag=V9I7M392VLPN type=write size=186962 2024-09-12T17:07:49.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.982+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=3GK5RGYWT0R1 type=write size=527597 2024-09-12T17:07:49.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.983+0000 7f9eaebff780 1 < canceled operation key=TDZCNUZE8IOA tag=VCGBRY6I5NHI type=del size=3906989 2024-09-12T17:07:49.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.985+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=5HBC2NL0QF7G type=del size=1144150 2024-09-12T17:07:49.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.986+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~TWDRED5NYC5R.0 size=1048576 2024-09-12T17:07:49.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.987+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~TWDRED5NYC5R.1 size=1048576 2024-09-12T17:07:49.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.988+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~TWDRED5NYC5R.2 size=541330 2024-09-12T17:07:49.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.990+0000 7f9eaebff780 1 < completed multipart upload key=UYF1AN2W59VN upload=TWDRED5NYC5R tag=KTPLRGH5IYO7 type=write size=3687058 2024-09-12T17:07:49.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.991+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=3Z895S8XOPH9 type=write size=158542 2024-09-12T17:07:49.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.992+0000 7f9eaebff780 1 < canceled operation key=ZYP3P4031PUZ tag=NE9HY1MU7CRT type=del size=1283440 2024-09-12T17:07:49.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.994+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~HUXB6RO4NGX1.0 size=501656 2024-09-12T17:07:49.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.994+0000 7f9eaebff780 1 > prepared multipart upload key=7PBT9VZ07OUI upload=HUXB6RO4NGX1 tag=ZFGD1JIVLD5U type=write size=1550232 2024-09-12T17:07:49.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.996+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~AKFUKGXFRWH2.0 size=1048576 2024-09-12T17:07:49.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.996+0000 7f9eaebff780 1 < canceled part key=_multipart_P9GMGM3WK6O7.2~AKFUKGXFRWH2.1 size=153446 2024-09-12T17:07:49.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.997+0000 7f9eaebff780 1 < canceled multipart upload key=P9GMGM3WK6O7 upload=AKFUKGXFRWH2 tag=MQJS2VXNZYLS type=write size=2250598 2024-09-12T17:07:50.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:49.999+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=V5LS831J6PHU type=write size=1027126 2024-09-12T17:07:50.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.000+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~HLDBCVQGCABQ.0 size=1048576 2024-09-12T17:07:50.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.001+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~HLDBCVQGCABQ.1 size=1048576 2024-09-12T17:07:50.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.002+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~HLDBCVQGCABQ.2 size=535896 2024-09-12T17:07:50.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.004+0000 7f9eaebff780 1 < completed multipart upload key=ZYP3P4031PUZ upload=HLDBCVQGCABQ tag=9PRL0PNSWSHI type=write size=3681624 2024-09-12T17:07:50.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.006+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~OCJ9S7PLLZ7Z.0 size=1048576 2024-09-12T17:07:50.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.007+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~OCJ9S7PLLZ7Z.1 size=865710 2024-09-12T17:07:50.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.007+0000 7f9eaebff780 1 > prepared multipart upload key=YIEP2JYDSLW0 upload=OCJ9S7PLLZ7Z tag=NKYAHVCYGA86 type=write size=2962862 2024-09-12T17:07:50.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.009+0000 7f9eaebff780 1 < suggested remove operation key=ZYP3P4031PUZ tag=A7VYXIX00J9M type=del 2024-09-12T17:07:50.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.010+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=7KI2KVIU1LHB type=del size=562489 2024-09-12T17:07:50.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.011+0000 7f9eaebff780 1 < completed delete operation key=0F5LXJZMBFSP tag=V3PZ2ZIXYI3C type=del 2024-09-12T17:07:50.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.013+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=GZFWX8IOPCV2 type=del size=706853 2024-09-12T17:07:50.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.014+0000 7f9eaebff780 1 < completed write operation key=9WJGBODZ60NJ tag=2AMEF6A6985S type=write size=762133 2024-09-12T17:07:50.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.016+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~742HL3TC9VSC.0 size=1048576 2024-09-12T17:07:50.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.017+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~742HL3TC9VSC.1 size=125880 2024-09-12T17:07:50.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.017+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=742HL3TC9VSC tag=8BBV1S9TRT5S type=write size=2223032 2024-09-12T17:07:50.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.020+0000 7f9eaebff780 1 < completed delete operation key=3VY271ZBO754 tag=8C2D08JK7A35 type=del 2024-09-12T17:07:50.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.022+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~VM4BED6P7PET.0 size=549009 2024-09-12T17:07:50.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.022+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=VM4BED6P7PET tag=2VJ70Z4SRGXJ type=write size=1597585 2024-09-12T17:07:50.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.024+0000 7f9eaebff780 1 < suggested update operation key=OH6GXTMPBYUY tag=X1P8LC552ZYO type=del size=3593595 2024-09-12T17:07:50.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.026+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~E335O59JRWQC.0 size=1048576 2024-09-12T17:07:50.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.027+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~E335O59JRWQC.1 size=1048576 2024-09-12T17:07:50.030 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.028+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~E335O59JRWQC.2 size=1002594 2024-09-12T17:07:50.030 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.028+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=E335O59JRWQC tag=EFIFV50YSX5O type=write size=4148322 2024-09-12T17:07:50.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.029+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~EKBBSG0RWQA3.0 size=1048576 2024-09-12T17:07:50.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.031+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~EKBBSG0RWQA3.1 size=205037 2024-09-12T17:07:50.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.032+0000 7f9eaebff780 1 < completed multipart upload key=YIEP2JYDSLW0 upload=EKBBSG0RWQA3 tag=X0Y9T8O30X81 type=write size=2302189 2024-09-12T17:07:50.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.034+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=T4LT9S98RDOP type=del size=3805966 2024-09-12T17:07:50.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.036+0000 7f9eaebff780 1 < suggested update operation key=TDZCNUZE8IOA tag=F4AQ0G9XVH43 type=del size=1433190 2024-09-12T17:07:50.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.037+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=MJVWQXK1UW3S type=write size=210277 2024-09-12T17:07:50.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.039+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~OWT7TU705UJV.0 size=1048576 2024-09-12T17:07:50.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.040+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~OWT7TU705UJV.1 size=1048576 2024-09-12T17:07:50.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.041+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~OWT7TU705UJV.2 size=515332 2024-09-12T17:07:50.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.043+0000 7f9eaebff780 1 < completed multipart upload key=8DJLYFM11DNI upload=OWT7TU705UJV tag=RI6T7C8CAOWU type=write size=3661060 2024-09-12T17:07:50.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.044+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=MRVF4PQRWB9S type=del size=3031031 2024-09-12T17:07:50.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.045+0000 7f9eaebff780 1 < completed delete operation key=3VY271ZBO754 tag=2P4AO4FO1BAW type=del 2024-09-12T17:07:50.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.047+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=VYZID91B362J type=del size=3045531 2024-09-12T17:07:50.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.048+0000 7f9eaebff780 1 < completed part key=_multipart_TXHXOMIB4B53.2~516W68OF5DAW.0 size=1048576 2024-09-12T17:07:50.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.049+0000 7f9eaebff780 1 < completed part key=_multipart_TXHXOMIB4B53.2~516W68OF5DAW.1 size=412513 2024-09-12T17:07:50.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.051+0000 7f9eaebff780 1 < completed multipart upload key=TXHXOMIB4B53 upload=516W68OF5DAW tag=480RTHJZJ0QV type=write size=2509665 2024-09-12T17:07:50.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.052+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=2SNTIOUEB3BQ type=del size=172497 2024-09-12T17:07:50.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.053+0000 7f9eaebff780 1 < completed write operation key=GB8P7K59Y8VI tag=3GK5RGYWT0R1 type=write size=527597 2024-09-12T17:07:50.056 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.054+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=34N4PZ7Z1Q1C type=write size=1044786 2024-09-12T17:07:50.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.056+0000 7f9eaebff780 1 < completed delete operation key=0YD5P1ACZ09Q tag=5HBC2NL0QF7G type=del 2024-09-12T17:07:50.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.057+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=VKZSZK1NOFUC type=del size=1547484 2024-09-12T17:07:50.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.058+0000 7f9eaebff780 1 < completed write operation key=EKUW5AKC428U tag=3Z895S8XOPH9 type=write size=158542 2024-09-12T17:07:50.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.061+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=7X6F15LSGXE6 type=del size=2259674 2024-09-12T17:07:50.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.061+0000 7f9eaebff780 1 < canceled part key=_multipart_7PBT9VZ07OUI.2~HUXB6RO4NGX1.0 size=501656 2024-09-12T17:07:50.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.063+0000 7f9eaebff780 1 < canceled multipart upload key=7PBT9VZ07OUI upload=HUXB6RO4NGX1 tag=ZFGD1JIVLD5U type=write size=1550232 2024-09-12T17:07:50.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.064+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=X27311SEG72L type=write size=917521 2024-09-12T17:07:50.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.066+0000 7f9eaebff780 1 < completed write operation key=3LY681252WAN tag=V5LS831J6PHU type=write size=1027126 2024-09-12T17:07:50.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.067+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=KU9319H3PJ96 type=write size=766778 2024-09-12T17:07:50.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.068+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~OCJ9S7PLLZ7Z.0 size=1048576 2024-09-12T17:07:50.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.069+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~OCJ9S7PLLZ7Z.1 size=865710 2024-09-12T17:07:50.073 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.071+0000 7f9eaebff780 1 < completed multipart upload key=YIEP2JYDSLW0 upload=OCJ9S7PLLZ7Z tag=NKYAHVCYGA86 type=write size=2962862 2024-09-12T17:07:50.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.074+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~6GIF23ID4VY5.0 size=1048576 2024-09-12T17:07:50.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.074+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~6GIF23ID4VY5.1 size=1048576 2024-09-12T17:07:50.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.076+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~6GIF23ID4VY5.2 size=868341 2024-09-12T17:07:50.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.076+0000 7f9eaebff780 1 > prepared multipart upload key=CAIZM33SDFPM upload=6GIF23ID4VY5 tag=R6G5O514O6QA type=write size=4014069 2024-09-12T17:07:50.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.077+0000 7f9eaebff780 1 < completed delete operation key=TXHXOMIB4B53 tag=7KI2KVIU1LHB type=del 2024-09-12T17:07:50.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.080+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~IP0MI54JKQGJ.0 size=1048576 2024-09-12T17:07:50.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.081+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~IP0MI54JKQGJ.1 size=1048576 2024-09-12T17:07:50.083 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.082+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~IP0MI54JKQGJ.2 size=574761 2024-09-12T17:07:50.083 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.082+0000 7f9eaebff780 1 > prepared multipart upload key=0F5LXJZMBFSP upload=IP0MI54JKQGJ tag=R8XWJ256C7EI type=write size=3720489 2024-09-12T17:07:50.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.084+0000 7f9eaebff780 1 < suggested remove operation key=YIEP2JYDSLW0 tag=GZFWX8IOPCV2 type=del 2024-09-12T17:07:50.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.085+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=6UJUUXWXH50D type=del size=1008637 2024-09-12T17:07:50.088 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.086+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~742HL3TC9VSC.0 size=1048576 2024-09-12T17:07:50.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.087+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~742HL3TC9VSC.1 size=125880 2024-09-12T17:07:50.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.089+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=742HL3TC9VSC tag=8BBV1S9TRT5S type=write size=2223032 2024-09-12T17:07:50.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.090+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=CV2SXQT4EHEZ type=del size=3403810 2024-09-12T17:07:50.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.092+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~VM4BED6P7PET.0 size=549009 2024-09-12T17:07:50.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.093+0000 7f9eaebff780 1 < completed multipart upload key=UYF1AN2W59VN upload=VM4BED6P7PET tag=2VJ70Z4SRGXJ type=write size=1597585 2024-09-12T17:07:50.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.095+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=M0F8BNKFDQN2 type=del size=258624 2024-09-12T17:07:50.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.096+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~E335O59JRWQC.0 size=1048576 2024-09-12T17:07:50.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.096+0000 7f9eaebff780 1 < canceled part key=_multipart_SHWT6AT7PN0M.2~E335O59JRWQC.1 size=1048576 2024-09-12T17:07:50.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.097+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~E335O59JRWQC.2 size=1002594 2024-09-12T17:07:50.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.099+0000 7f9eaebff780 1 < canceled multipart upload key=SHWT6AT7PN0M upload=E335O59JRWQC tag=EFIFV50YSX5O type=write size=4148322 2024-09-12T17:07:50.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.100+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=EMM0GZR7V175 type=del size=3923556 2024-09-12T17:07:50.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.101+0000 7f9eaebff780 1 < completed delete operation key=SVWPQETL92QU tag=T4LT9S98RDOP type=del 2024-09-12T17:07:50.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.102+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=K06LV9DG04DK type=del size=2299907 2024-09-12T17:07:50.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.103+0000 7f9eaebff780 -1 < failed to complete operation key=YIEP2JYDSLW0 tag=MJVWQXK1UW3S type=write size=210277: (22) Invalid argument 2024-09-12T17:07:50.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.106+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~YL77OHHINB2X.0 size=68461 2024-09-12T17:07:50.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.106+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=YL77OHHINB2X tag=WYECTS4EE9TU type=write size=1117037 2024-09-12T17:07:50.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.107+0000 7f9eaebff780 1 < completed delete operation key=QIMNK4DL3D0N tag=MRVF4PQRWB9S type=del 2024-09-12T17:07:50.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.108+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=OHR6O38T6YL8 type=del size=2521733 2024-09-12T17:07:50.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.110+0000 7f9eaebff780 1 < suggested update operation key=OGD6H9VSVGWF tag=VYZID91B362J type=del size=3045531 2024-09-12T17:07:50.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.112+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=AAINHJ2NDE7V type=del size=2624761 2024-09-12T17:07:50.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.114+0000 7f9eaebff780 1 < suggested update operation key=7PBT9VZ07OUI tag=2SNTIOUEB3BQ type=del size=172497 2024-09-12T17:07:50.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.115+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=NCHKL451N59N type=del size=1612573 2024-09-12T17:07:50.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.118+0000 7f9eaebff780 1 < suggested update operation key=SVWPQETL92QU tag=34N4PZ7Z1Q1C type=write size=1044786 2024-09-12T17:07:50.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.119+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=HVJ9X3CW9AKS type=del size=3925181 2024-09-12T17:07:50.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.120+0000 7f9eaebff780 1 < completed delete operation key=LRI5G5G8O5X4 tag=VKZSZK1NOFUC type=del 2024-09-12T17:07:50.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.121+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=13W9LDX2HMBI type=del size=2404404 2024-09-12T17:07:50.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.123+0000 7f9eaebff780 1 < completed delete operation key=TDZCNUZE8IOA tag=7X6F15LSGXE6 type=del 2024-09-12T17:07:50.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.124+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=6TFR7FZE8CLW type=del size=1463252 2024-09-12T17:07:50.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.125+0000 7f9eaebff780 1 < completed write operation key=LRI5G5G8O5X4 tag=X27311SEG72L type=write size=917521 2024-09-12T17:07:50.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.126+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=QC11PB5BQMAO type=del size=1362523 2024-09-12T17:07:50.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.128+0000 7f9eaebff780 1 < suggested update operation key=SVWPQETL92QU tag=KU9319H3PJ96 type=write size=766778 2024-09-12T17:07:50.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.131+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~2VSCGQ8J7PWQ.0 size=164011 2024-09-12T17:07:50.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.131+0000 7f9eaebff780 1 > prepared multipart upload key=QIMNK4DL3D0N upload=2VSCGQ8J7PWQ tag=P2FVW39P4RMP type=write size=1212587 2024-09-12T17:07:50.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.132+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~6GIF23ID4VY5.0 size=1048576 2024-09-12T17:07:50.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.133+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~6GIF23ID4VY5.1 size=1048576 2024-09-12T17:07:50.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.134+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~6GIF23ID4VY5.2 size=868341 2024-09-12T17:07:50.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.137+0000 7f9eaebff780 1 < completed multipart upload key=CAIZM33SDFPM upload=6GIF23ID4VY5 tag=R6G5O514O6QA type=write size=4014069 2024-09-12T17:07:50.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.140+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~YQXL3I5JMJEJ.0 size=1048576 2024-09-12T17:07:50.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.141+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~YQXL3I5JMJEJ.1 size=1048576 2024-09-12T17:07:50.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.142+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~YQXL3I5JMJEJ.2 size=77555 2024-09-12T17:07:50.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.142+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=YQXL3I5JMJEJ tag=8KLUWAS7V09Q type=write size=3223283 2024-09-12T17:07:50.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.145+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~IP0MI54JKQGJ.0 size=1048576 2024-09-12T17:07:50.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.146+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~IP0MI54JKQGJ.1 size=1048576 2024-09-12T17:07:50.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.146+0000 7f9eaebff780 1 < canceled part key=_multipart_0F5LXJZMBFSP.2~IP0MI54JKQGJ.2 size=574761 2024-09-12T17:07:50.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.148+0000 7f9eaebff780 1 < canceled multipart upload key=0F5LXJZMBFSP upload=IP0MI54JKQGJ tag=R8XWJ256C7EI type=write size=3720489 2024-09-12T17:07:50.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.149+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=7ND9EPYDRP82 type=del size=2759123 2024-09-12T17:07:50.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.151+0000 7f9eaebff780 1 < completed delete operation key=OH6GXTMPBYUY tag=6UJUUXWXH50D type=del 2024-09-12T17:07:50.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.153+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~690K7S796DG1.0 size=1048576 2024-09-12T17:07:50.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.154+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~690K7S796DG1.1 size=376030 2024-09-12T17:07:50.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.154+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=690K7S796DG1 tag=LRHTSY954EOJ type=write size=2473182 2024-09-12T17:07:50.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.155+0000 7f9eaebff780 1 < completed delete operation key=SO6QF2JCRX6E tag=CV2SXQT4EHEZ type=del 2024-09-12T17:07:50.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.156+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=W8Z7O7O7WOUX type=del size=294892 2024-09-12T17:07:50.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.157+0000 7f9eaebff780 1 < completed delete operation key=M3PLQGSK34YM tag=M0F8BNKFDQN2 type=del 2024-09-12T17:07:50.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.158+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=J83AE4H7WVXA type=write size=386745 2024-09-12T17:07:50.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.160+0000 7f9eaebff780 1 < completed delete operation key=0F5LXJZMBFSP tag=EMM0GZR7V175 type=del 2024-09-12T17:07:50.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.162+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~PN8Z1APHCF5W.0 size=1048576 2024-09-12T17:07:50.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.162+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~PN8Z1APHCF5W.1 size=1048576 2024-09-12T17:07:50.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.163+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~PN8Z1APHCF5W.2 size=751208 2024-09-12T17:07:50.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.163+0000 7f9eaebff780 1 > prepared multipart upload key=ZYP3P4031PUZ upload=PN8Z1APHCF5W tag=PLQIF62VI7D1 type=write size=3896936 2024-09-12T17:07:50.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.164+0000 7f9eaebff780 1 < completed delete operation key=LRI5G5G8O5X4 tag=K06LV9DG04DK type=del 2024-09-12T17:07:50.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.167+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~DD7OX3LIZS88.0 size=1048576 2024-09-12T17:07:50.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.167+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~DD7OX3LIZS88.1 size=619021 2024-09-12T17:07:50.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.167+0000 7f9eaebff780 1 > prepared multipart upload key=7PBT9VZ07OUI upload=DD7OX3LIZS88 tag=TEFFBKYZL5G0 type=write size=2716173 2024-09-12T17:07:50.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.169+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~YL77OHHINB2X.0 size=68461 2024-09-12T17:07:50.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.171+0000 7f9eaebff780 1 < completed multipart upload key=K2NHRSUDQBRW upload=YL77OHHINB2X tag=WYECTS4EE9TU type=write size=1117037 2024-09-12T17:07:50.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.173+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~PXVRRHF3N03T.0 size=621824 2024-09-12T17:07:50.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.173+0000 7f9eaebff780 1 > prepared multipart upload key=9WJGBODZ60NJ upload=PXVRRHF3N03T tag=A4NSIMYGHUXR type=write size=1670400 2024-09-12T17:07:50.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.174+0000 7f9eaebff780 1 < completed delete operation key=B1YC6DM9S8JJ tag=OHR6O38T6YL8 type=del 2024-09-12T17:07:50.176 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.175+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=ZB9UCXO0AY54 type=del size=2023948 2024-09-12T17:07:50.177 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.176+0000 7f9eaebff780 1 < completed delete operation key=LRI5G5G8O5X4 tag=AAINHJ2NDE7V type=del 2024-09-12T17:07:50.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.177+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=GHPTPPWR8033 type=write size=321971 2024-09-12T17:07:50.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.178+0000 7f9eaebff780 1 < completed delete operation key=K0P9ZZ91UJJ8 tag=NCHKL451N59N type=del 2024-09-12T17:07:50.182 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.180+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~I1QMT1GXW9OR.0 size=1048576 2024-09-12T17:07:50.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.181+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~I1QMT1GXW9OR.1 size=1048576 2024-09-12T17:07:50.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.182+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~I1QMT1GXW9OR.2 size=923929 2024-09-12T17:07:50.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.182+0000 7f9eaebff780 1 > prepared multipart upload key=3LY681252WAN upload=I1QMT1GXW9OR tag=92YRP4MJBAM4 type=write size=4069657 2024-09-12T17:07:50.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.184+0000 7f9eaebff780 1 < completed delete operation key=K2NHRSUDQBRW tag=HVJ9X3CW9AKS type=del 2024-09-12T17:07:50.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.185+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=H373LPP5GV2S type=del size=2490446 2024-09-12T17:07:50.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.186+0000 7f9eaebff780 1 < completed delete operation key=LJN514F16XJA tag=13W9LDX2HMBI type=del 2024-09-12T17:07:50.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.187+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=LI7GBZXU19JH type=del size=636179 2024-09-12T17:07:50.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.190+0000 7f9eaebff780 1 < suggested remove operation key=K0P9ZZ91UJJ8 tag=6TFR7FZE8CLW type=del 2024-09-12T17:07:50.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.192+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~T5FQ1HELDKGZ.0 size=1048576 2024-09-12T17:07:50.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.193+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~T5FQ1HELDKGZ.1 size=1048576 2024-09-12T17:07:50.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.194+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~T5FQ1HELDKGZ.2 size=522673 2024-09-12T17:07:50.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.194+0000 7f9eaebff780 1 > prepared multipart upload key=B1YC6DM9S8JJ upload=T5FQ1HELDKGZ tag=SQZW5LZ776ME type=write size=3668401 2024-09-12T17:07:50.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.195+0000 7f9eaebff780 1 < completed delete operation key=TXHXOMIB4B53 tag=QC11PB5BQMAO type=del 2024-09-12T17:07:50.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.197+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~7DZHN7E4V1QP.0 size=221355 2024-09-12T17:07:50.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.197+0000 7f9eaebff780 1 > prepared multipart upload key=SO6QF2JCRX6E upload=7DZHN7E4V1QP tag=ST0GBICB0DAV type=write size=1269931 2024-09-12T17:07:50.200 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.199+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~2VSCGQ8J7PWQ.0 size=164011 2024-09-12T17:07:50.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.201+0000 7f9eaebff780 1 < completed multipart upload key=QIMNK4DL3D0N upload=2VSCGQ8J7PWQ tag=P2FVW39P4RMP type=write size=1212587 2024-09-12T17:07:50.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.202+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=Z6KMLUI7QQTI type=del size=1472015 2024-09-12T17:07:50.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.204+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~YQXL3I5JMJEJ.0 size=1048576 2024-09-12T17:07:50.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.205+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~YQXL3I5JMJEJ.1 size=1048576 2024-09-12T17:07:50.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.206+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~YQXL3I5JMJEJ.2 size=77555 2024-09-12T17:07:50.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.208+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=YQXL3I5JMJEJ tag=8KLUWAS7V09Q type=write size=3223283 2024-09-12T17:07:50.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.211+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~AZ3Q3A8NZ1IP.0 size=1048576 2024-09-12T17:07:50.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.211+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~AZ3Q3A8NZ1IP.1 size=1004768 2024-09-12T17:07:50.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.211+0000 7f9eaebff780 1 > prepared multipart upload key=SO6QF2JCRX6E upload=AZ3Q3A8NZ1IP tag=MOZ5C7O2XPK1 type=write size=3101920 2024-09-12T17:07:50.214 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.213+0000 7f9eaebff780 -1 < failed to complete operation key=K0P9ZZ91UJJ8 tag=7ND9EPYDRP82 type=del size=2759123: (22) Invalid argument 2024-09-12T17:07:50.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.214+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=MD155AH2RE9P type=del size=1357600 2024-09-12T17:07:50.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.216+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~690K7S796DG1.0 size=1048576 2024-09-12T17:07:50.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.217+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~690K7S796DG1.1 size=376030 2024-09-12T17:07:50.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.219+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=690K7S796DG1 tag=LRHTSY954EOJ type=write size=2473182 2024-09-12T17:07:50.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.220+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=JL3TT33SQUY0 type=write size=603170 2024-09-12T17:07:50.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.223+0000 7f9eaebff780 1 < suggested remove operation key=KF8XE48DI9KZ tag=W8Z7O7O7WOUX type=del 2024-09-12T17:07:50.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.226+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~P7V8STZLELQR.0 size=49469 2024-09-12T17:07:50.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.226+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=P7V8STZLELQR tag=FESHJLSH5T6U type=write size=1098045 2024-09-12T17:07:50.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.227+0000 7f9eaebff780 1 < completed write operation key=M3PLQGSK34YM tag=J83AE4H7WVXA type=write size=386745 2024-09-12T17:07:50.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.229+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~9I7MPE3Z5M0K.0 size=7421 2024-09-12T17:07:50.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.229+0000 7f9eaebff780 1 > prepared multipart upload key=9WJGBODZ60NJ upload=9I7MPE3Z5M0K tag=VZFDYFO6VHVE type=write size=1055997 2024-09-12T17:07:50.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.230+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~PN8Z1APHCF5W.0 size=1048576 2024-09-12T17:07:50.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.231+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~PN8Z1APHCF5W.1 size=1048576 2024-09-12T17:07:50.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.232+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~PN8Z1APHCF5W.2 size=751208 2024-09-12T17:07:50.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.234+0000 7f9eaebff780 1 < completed multipart upload key=ZYP3P4031PUZ upload=PN8Z1APHCF5W tag=PLQIF62VI7D1 type=write size=3896936 2024-09-12T17:07:50.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.236+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~T2ZZ34WKFQT1.0 size=1048576 2024-09-12T17:07:50.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.237+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~T2ZZ34WKFQT1.1 size=86448 2024-09-12T17:07:50.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.237+0000 7f9eaebff780 1 > prepared multipart upload key=7PBT9VZ07OUI upload=T2ZZ34WKFQT1 tag=MD3J4124V8SN type=write size=2183600 2024-09-12T17:07:50.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.238+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~DD7OX3LIZS88.0 size=1048576 2024-09-12T17:07:50.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.239+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~DD7OX3LIZS88.1 size=619021 2024-09-12T17:07:50.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.242+0000 7f9eaebff780 1 < completed multipart upload key=7PBT9VZ07OUI upload=DD7OX3LIZS88 tag=TEFFBKYZL5G0 type=write size=2716173 2024-09-12T17:07:50.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.243+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=FCVAQWG57TJ0 type=write size=574296 2024-09-12T17:07:50.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.244+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~PXVRRHF3N03T.0 size=621824 2024-09-12T17:07:50.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.246+0000 7f9eaebff780 1 < completed multipart upload key=9WJGBODZ60NJ upload=PXVRRHF3N03T tag=A4NSIMYGHUXR type=write size=1670400 2024-09-12T17:07:50.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.247+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=XF1I5JJSGI62 type=del size=2884618 2024-09-12T17:07:50.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.249+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=ZB9UCXO0AY54 type=del 2024-09-12T17:07:50.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.250+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=GVX2NB8RRWRB type=write size=159430 2024-09-12T17:07:50.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.252+0000 7f9eaebff780 1 < completed write operation key=UYF1AN2W59VN tag=GHPTPPWR8033 type=write size=321971 2024-09-12T17:07:50.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.253+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=S2JZA7LI92FV type=del size=3704300 2024-09-12T17:07:50.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.254+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~I1QMT1GXW9OR.0 size=1048576 2024-09-12T17:07:50.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.255+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~I1QMT1GXW9OR.1 size=1048576 2024-09-12T17:07:50.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.256+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~I1QMT1GXW9OR.2 size=923929 2024-09-12T17:07:50.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.258+0000 7f9eaebff780 1 < completed multipart upload key=3LY681252WAN upload=I1QMT1GXW9OR tag=92YRP4MJBAM4 type=write size=4069657 2024-09-12T17:07:50.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.259+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=68CKDZS7S1GN type=del size=2200510 2024-09-12T17:07:50.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.260+0000 7f9eaebff780 1 < completed delete operation key=TDZCNUZE8IOA tag=H373LPP5GV2S type=del 2024-09-12T17:07:50.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.262+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=J400XXD918I3 type=del size=938543 2024-09-12T17:07:50.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.263+0000 7f9eaebff780 1 < completed delete operation key=ZC814TPVLJO1 tag=LI7GBZXU19JH type=del 2024-09-12T17:07:50.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.265+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~31IQRWW5Y6T9.0 size=173243 2024-09-12T17:07:50.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.265+0000 7f9eaebff780 1 > prepared multipart upload key=3LY681252WAN upload=31IQRWW5Y6T9 tag=ZXSZU6AGDTEE type=write size=1221819 2024-09-12T17:07:50.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.266+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~T5FQ1HELDKGZ.0 size=1048576 2024-09-12T17:07:50.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.267+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~T5FQ1HELDKGZ.1 size=1048576 2024-09-12T17:07:50.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.268+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~T5FQ1HELDKGZ.2 size=522673 2024-09-12T17:07:50.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.270+0000 7f9eaebff780 1 < completed multipart upload key=B1YC6DM9S8JJ upload=T5FQ1HELDKGZ tag=SQZW5LZ776ME type=write size=3668401 2024-09-12T17:07:50.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.271+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=OEGN82B7UWGG type=del size=497882 2024-09-12T17:07:50.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.273+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~7DZHN7E4V1QP.0 size=221355 2024-09-12T17:07:50.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.275+0000 7f9eaebff780 1 < completed multipart upload key=SO6QF2JCRX6E upload=7DZHN7E4V1QP tag=ST0GBICB0DAV type=write size=1269931 2024-09-12T17:07:50.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.277+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~VO44W026BSCO.0 size=1048576 2024-09-12T17:07:50.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.278+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~VO44W026BSCO.1 size=551176 2024-09-12T17:07:50.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.278+0000 7f9eaebff780 1 > prepared multipart upload key=ZC814TPVLJO1 upload=VO44W026BSCO tag=IAPFK0DKS7OG type=write size=2648328 2024-09-12T17:07:50.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.279+0000 7f9eaebff780 -1 < failed to complete operation key=KF8XE48DI9KZ tag=Z6KMLUI7QQTI type=del size=1472015: (22) Invalid argument 2024-09-12T17:07:50.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.281+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=XT74LEJR6B0S type=write size=521177 2024-09-12T17:07:50.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.282+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~AZ3Q3A8NZ1IP.0 size=1048576 2024-09-12T17:07:50.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.283+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~AZ3Q3A8NZ1IP.1 size=1004768 2024-09-12T17:07:50.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.285+0000 7f9eaebff780 1 < completed multipart upload key=SO6QF2JCRX6E upload=AZ3Q3A8NZ1IP tag=MOZ5C7O2XPK1 type=write size=3101920 2024-09-12T17:07:50.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.287+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~9US9UE7W16KU.0 size=1048576 2024-09-12T17:07:50.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.288+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~9US9UE7W16KU.1 size=1048576 2024-09-12T17:07:50.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.289+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~9US9UE7W16KU.2 size=650735 2024-09-12T17:07:50.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.289+0000 7f9eaebff780 1 > prepared multipart upload key=GB8P7K59Y8VI upload=9US9UE7W16KU tag=A4K1E8Q1WOS3 type=write size=3796463 2024-09-12T17:07:50.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.291+0000 7f9eaebff780 1 < canceled operation key=9WJGBODZ60NJ tag=MD155AH2RE9P type=del size=1357600 2024-09-12T17:07:50.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.292+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=I2KQAN8Q834S type=del size=3582871 2024-09-12T17:07:50.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.293+0000 7f9eaebff780 1 < completed write operation key=LJN514F16XJA tag=JL3TT33SQUY0 type=write size=603170 2024-09-12T17:07:50.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.295+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~3NSO1SKTPWT6.0 size=1048576 2024-09-12T17:07:50.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.296+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~3NSO1SKTPWT6.1 size=1048576 2024-09-12T17:07:50.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.297+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~3NSO1SKTPWT6.2 size=131654 2024-09-12T17:07:50.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.297+0000 7f9eaebff780 1 > prepared multipart upload key=EKUW5AKC428U upload=3NSO1SKTPWT6 tag=CQR70DA9XU4A type=write size=3277382 2024-09-12T17:07:50.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.298+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~P7V8STZLELQR.0 size=49469 2024-09-12T17:07:50.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.300+0000 7f9eaebff780 1 < completed multipart upload key=UYF1AN2W59VN upload=P7V8STZLELQR tag=FESHJLSH5T6U type=write size=1098045 2024-09-12T17:07:50.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.302+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=GI06RFOSEOL8 type=del size=80351 2024-09-12T17:07:50.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.303+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~9I7MPE3Z5M0K.0 size=7421 2024-09-12T17:07:50.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.305+0000 7f9eaebff780 1 < completed multipart upload key=9WJGBODZ60NJ upload=9I7MPE3Z5M0K tag=VZFDYFO6VHVE type=write size=1055997 2024-09-12T17:07:50.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.306+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=UE7VVFUM2AI8 type=del size=1360222 2024-09-12T17:07:50.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.307+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~T2ZZ34WKFQT1.0 size=1048576 2024-09-12T17:07:50.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.309+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~T2ZZ34WKFQT1.1 size=86448 2024-09-12T17:07:50.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.310+0000 7f9eaebff780 1 < completed multipart upload key=7PBT9VZ07OUI upload=T2ZZ34WKFQT1 tag=MD3J4124V8SN type=write size=2183600 2024-09-12T17:07:50.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.312+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=Z8TH3XWSGKZC type=del size=1683521 2024-09-12T17:07:50.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.313+0000 7f9eaebff780 1 < completed write operation key=P9GMGM3WK6O7 tag=FCVAQWG57TJ0 type=write size=574296 2024-09-12T17:07:50.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.315+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~A7E0RQS7DWAW.0 size=1048576 2024-09-12T17:07:50.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.316+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~A7E0RQS7DWAW.1 size=927774 2024-09-12T17:07:50.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.316+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=A7E0RQS7DWAW tag=0F0U7A26DULW type=write size=3024926 2024-09-12T17:07:50.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.318+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=XF1I5JJSGI62 type=del 2024-09-12T17:07:50.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.319+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=RB7XV2LUMUNO type=del size=1545334 2024-09-12T17:07:50.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.321+0000 7f9eaebff780 1 < suggested remove operation key=K2NHRSUDQBRW tag=GVX2NB8RRWRB type=write 2024-09-12T17:07:50.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.323+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~TMZ7MC5YD2KA.0 size=1048576 2024-09-12T17:07:50.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.324+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~TMZ7MC5YD2KA.1 size=1048576 2024-09-12T17:07:50.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.325+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~TMZ7MC5YD2KA.2 size=101715 2024-09-12T17:07:50.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.325+0000 7f9eaebff780 1 > prepared multipart upload key=ZC814TPVLJO1 upload=TMZ7MC5YD2KA tag=DK1RHWM13QP7 type=write size=3247443 2024-09-12T17:07:50.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.326+0000 7f9eaebff780 1 < completed delete operation key=SO6QF2JCRX6E tag=S2JZA7LI92FV type=del 2024-09-12T17:07:50.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.327+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=RE45GR15J7AS type=del size=2804891 2024-09-12T17:07:50.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.329+0000 7f9eaebff780 1 < completed delete operation key=SO6QF2JCRX6E tag=68CKDZS7S1GN type=del 2024-09-12T17:07:50.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.331+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~V906F1U9V0KI.0 size=938493 2024-09-12T17:07:50.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.331+0000 7f9eaebff780 1 > prepared multipart upload key=EKUW5AKC428U upload=V906F1U9V0KI tag=8YA9LG6C6CZD type=write size=1987069 2024-09-12T17:07:50.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.332+0000 7f9eaebff780 1 < completed delete operation key=OGD6H9VSVGWF tag=J400XXD918I3 type=del 2024-09-12T17:07:50.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.333+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=DJPS7S63AV28 type=del size=2977043 2024-09-12T17:07:50.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.334+0000 7f9eaebff780 1 < canceled part key=_multipart_3LY681252WAN.2~31IQRWW5Y6T9.0 size=173243 2024-09-12T17:07:50.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.336+0000 7f9eaebff780 1 < canceled multipart upload key=3LY681252WAN upload=31IQRWW5Y6T9 tag=ZXSZU6AGDTEE type=write size=1221819 2024-09-12T17:07:50.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.338+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~BTA4UMLXXRGF.0 size=1048576 2024-09-12T17:07:50.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.339+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~BTA4UMLXXRGF.1 size=1048576 2024-09-12T17:07:50.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.340+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~BTA4UMLXXRGF.2 size=358482 2024-09-12T17:07:50.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.340+0000 7f9eaebff780 1 > prepared multipart upload key=9WJGBODZ60NJ upload=BTA4UMLXXRGF tag=Z2MPCDH8B3L4 type=write size=3504210 2024-09-12T17:07:50.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.343+0000 7f9eaebff780 1 < suggested remove operation key=UYF1AN2W59VN tag=OEGN82B7UWGG type=del 2024-09-12T17:07:50.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.344+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=X7DFU9EWV5UB type=write size=297820 2024-09-12T17:07:50.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.345+0000 7f9eaebff780 1 < canceled part key=_multipart_ZC814TPVLJO1.2~VO44W026BSCO.0 size=1048576 2024-09-12T17:07:50.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.346+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~VO44W026BSCO.1 size=551176 2024-09-12T17:07:50.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.348+0000 7f9eaebff780 1 < canceled multipart upload key=ZC814TPVLJO1 upload=VO44W026BSCO tag=IAPFK0DKS7OG type=write size=2648328 2024-09-12T17:07:50.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.350+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~GQ7EGDZ0MRXF.0 size=1048576 2024-09-12T17:07:50.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.351+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~GQ7EGDZ0MRXF.1 size=1048576 2024-09-12T17:07:50.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.352+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~GQ7EGDZ0MRXF.2 size=12241 2024-09-12T17:07:50.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.352+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=GQ7EGDZ0MRXF tag=EU1U59U5UNX5 type=write size=3157969 2024-09-12T17:07:50.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.353+0000 7f9eaebff780 1 < completed write operation key=3LY681252WAN tag=XT74LEJR6B0S type=write size=521177 2024-09-12T17:07:50.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.354+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=7HSAGDN6F2A6 type=del size=1927613 2024-09-12T17:07:50.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.355+0000 7f9eaebff780 1 < canceled part key=_multipart_GB8P7K59Y8VI.2~9US9UE7W16KU.0 size=1048576 2024-09-12T17:07:50.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.356+0000 7f9eaebff780 1 < completed part key=_multipart_GB8P7K59Y8VI.2~9US9UE7W16KU.1 size=1048576 2024-09-12T17:07:50.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.357+0000 7f9eaebff780 1 < completed part key=_multipart_GB8P7K59Y8VI.2~9US9UE7W16KU.2 size=650735 2024-09-12T17:07:50.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.359+0000 7f9eaebff780 1 < canceled multipart upload key=GB8P7K59Y8VI upload=9US9UE7W16KU tag=A4K1E8Q1WOS3 type=write size=3796463 2024-09-12T17:07:50.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.360+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=ZNQI16ELP45M type=write size=475537 2024-09-12T17:07:50.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.362+0000 7f9eaebff780 -1 < failed to complete operation key=UYF1AN2W59VN tag=I2KQAN8Q834S type=del size=3582871: (22) Invalid argument 2024-09-12T17:07:50.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.364+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~OFD9P17O6CN1.0 size=1048576 2024-09-12T17:07:50.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.365+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~OFD9P17O6CN1.1 size=535115 2024-09-12T17:07:50.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.365+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=OFD9P17O6CN1 tag=A3WLSIFCX0WW type=write size=2632267 2024-09-12T17:07:50.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.367+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~3NSO1SKTPWT6.0 size=1048576 2024-09-12T17:07:50.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.367+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~3NSO1SKTPWT6.1 size=1048576 2024-09-12T17:07:50.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.368+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~3NSO1SKTPWT6.2 size=131654 2024-09-12T17:07:50.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.370+0000 7f9eaebff780 1 < completed multipart upload key=EKUW5AKC428U upload=3NSO1SKTPWT6 tag=CQR70DA9XU4A type=write size=3277382 2024-09-12T17:07:50.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.372+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~Q9M6F2PRLYF4.0 size=1048576 2024-09-12T17:07:50.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.373+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~Q9M6F2PRLYF4.1 size=527381 2024-09-12T17:07:50.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.373+0000 7f9eaebff780 1 > prepared multipart upload key=TDZCNUZE8IOA upload=Q9M6F2PRLYF4 tag=FO6LEDUK22F2 type=write size=2624533 2024-09-12T17:07:50.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.376+0000 7f9eaebff780 1 < suggested remove operation key=M3PLQGSK34YM tag=GI06RFOSEOL8 type=del 2024-09-12T17:07:50.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.377+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=DVDMC0SRJ0NF type=del size=2328106 2024-09-12T17:07:50.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.378+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=UE7VVFUM2AI8 type=del 2024-09-12T17:07:50.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.379+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=ECY3H12B69W7 type=del size=3519537 2024-09-12T17:07:50.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.380+0000 7f9eaebff780 1 < completed delete operation key=LRI5G5G8O5X4 tag=Z8TH3XWSGKZC type=del 2024-09-12T17:07:50.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.382+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~M8BJZTPYI8KA.0 size=222196 2024-09-12T17:07:50.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.382+0000 7f9eaebff780 1 > prepared multipart upload key=A1KRCFY18QTP upload=M8BJZTPYI8KA tag=HX26X0K0FAGP type=write size=1270772 2024-09-12T17:07:50.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.384+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~A7E0RQS7DWAW.0 size=1048576 2024-09-12T17:07:50.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.385+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~A7E0RQS7DWAW.1 size=927774 2024-09-12T17:07:50.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.387+0000 7f9eaebff780 1 < completed multipart upload key=M3PLQGSK34YM upload=A7E0RQS7DWAW tag=0F0U7A26DULW type=write size=3024926 2024-09-12T17:07:50.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.388+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=9WT4BBL6ZGHB type=del size=3373646 2024-09-12T17:07:50.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.390+0000 7f9eaebff780 1 < suggested update operation key=8DJLYFM11DNI tag=RB7XV2LUMUNO type=del size=1545334 2024-09-12T17:07:50.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.391+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=RJT6YM5R0TKV type=del size=3586605 2024-09-12T17:07:50.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.392+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~TMZ7MC5YD2KA.0 size=1048576 2024-09-12T17:07:50.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.393+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~TMZ7MC5YD2KA.1 size=1048576 2024-09-12T17:07:50.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.394+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~TMZ7MC5YD2KA.2 size=101715 2024-09-12T17:07:50.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.396+0000 7f9eaebff780 1 < completed multipart upload key=ZC814TPVLJO1 upload=TMZ7MC5YD2KA tag=DK1RHWM13QP7 type=write size=3247443 2024-09-12T17:07:50.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.399+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~6OD40WIZQQSC.0 size=9449 2024-09-12T17:07:50.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.399+0000 7f9eaebff780 1 > prepared multipart upload key=GB8P7K59Y8VI upload=6OD40WIZQQSC tag=NY4TZVYM1EG0 type=write size=1058025 2024-09-12T17:07:50.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.400+0000 7f9eaebff780 1 < completed delete operation key=7PBT9VZ07OUI tag=RE45GR15J7AS type=del 2024-09-12T17:07:50.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.402+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~19SOXUL1IWUO.0 size=1048576 2024-09-12T17:07:50.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.403+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~19SOXUL1IWUO.1 size=140959 2024-09-12T17:07:50.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.403+0000 7f9eaebff780 1 > prepared multipart upload key=7PBT9VZ07OUI upload=19SOXUL1IWUO tag=IUYSV01OKLWN type=write size=2238111 2024-09-12T17:07:50.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.404+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~V906F1U9V0KI.0 size=938493 2024-09-12T17:07:50.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.406+0000 7f9eaebff780 1 < completed multipart upload key=EKUW5AKC428U upload=V906F1U9V0KI tag=8YA9LG6C6CZD type=write size=1987069 2024-09-12T17:07:50.410 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.408+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~OTS0BQKXAVYG.0 size=1048576 2024-09-12T17:07:50.411 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.409+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~OTS0BQKXAVYG.1 size=624207 2024-09-12T17:07:50.411 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.409+0000 7f9eaebff780 1 > prepared multipart upload key=LRI5G5G8O5X4 upload=OTS0BQKXAVYG tag=6JB88S232FDJ type=write size=2721359 2024-09-12T17:07:50.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.411+0000 7f9eaebff780 -1 < failed to complete operation key=M3PLQGSK34YM tag=DJPS7S63AV28 type=del size=2977043: (22) Invalid argument 2024-09-12T17:07:50.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.412+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=HIS10J9MR9PC type=write size=876603 2024-09-12T17:07:50.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.413+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~BTA4UMLXXRGF.0 size=1048576 2024-09-12T17:07:50.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.414+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~BTA4UMLXXRGF.1 size=1048576 2024-09-12T17:07:50.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.414+0000 7f9eaebff780 1 < canceled part key=_multipart_9WJGBODZ60NJ.2~BTA4UMLXXRGF.2 size=358482 2024-09-12T17:07:50.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.416+0000 7f9eaebff780 1 < canceled multipart upload key=9WJGBODZ60NJ upload=BTA4UMLXXRGF tag=Z2MPCDH8B3L4 type=write size=3504210 2024-09-12T17:07:50.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.417+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=E8E9NCRJTNTV type=del size=1715223 2024-09-12T17:07:50.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.418+0000 7f9eaebff780 1 < completed write operation key=LJN514F16XJA tag=X7DFU9EWV5UB type=write size=297820 2024-09-12T17:07:50.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.420+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=DM8B31AKOF2A type=del size=2211156 2024-09-12T17:07:50.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.420+0000 7f9eaebff780 1 < canceled part key=_multipart_M3PLQGSK34YM.2~GQ7EGDZ0MRXF.0 size=1048576 2024-09-12T17:07:50.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.421+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~GQ7EGDZ0MRXF.1 size=1048576 2024-09-12T17:07:50.423 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.422+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~GQ7EGDZ0MRXF.2 size=12241 2024-09-12T17:07:50.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.424+0000 7f9eaebff780 1 < canceled multipart upload key=M3PLQGSK34YM upload=GQ7EGDZ0MRXF tag=EU1U59U5UNX5 type=write size=3157969 2024-09-12T17:07:50.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.426+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~A27ER36OP0WY.0 size=1048576 2024-09-12T17:07:50.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.427+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~A27ER36OP0WY.1 size=470360 2024-09-12T17:07:50.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.427+0000 7f9eaebff780 1 > prepared multipart upload key=OGD6H9VSVGWF upload=A27ER36OP0WY tag=22NZLUMQ6GPX type=write size=2567512 2024-09-12T17:07:50.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.429+0000 7f9eaebff780 1 < suggested update operation key=ZC814TPVLJO1 tag=7HSAGDN6F2A6 type=del size=1927613 2024-09-12T17:07:50.432 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.431+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=JDL2I42DJ3CR type=del size=1941460 2024-09-12T17:07:50.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.432+0000 7f9eaebff780 1 < completed write operation key=ZYP3P4031PUZ tag=ZNQI16ELP45M type=write size=475537 2024-09-12T17:07:50.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.433+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=B53KCOCCLNO0 type=del size=2864017 2024-09-12T17:07:50.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.434+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~OFD9P17O6CN1.0 size=1048576 2024-09-12T17:07:50.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.435+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~OFD9P17O6CN1.1 size=535115 2024-09-12T17:07:50.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.437+0000 7f9eaebff780 1 < completed multipart upload key=P9GMGM3WK6O7 upload=OFD9P17O6CN1 tag=A3WLSIFCX0WW type=write size=2632267 2024-09-12T17:07:50.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.439+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~9DI2SJHY62JT.0 size=1048576 2024-09-12T17:07:50.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.441+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~9DI2SJHY62JT.1 size=1048576 2024-09-12T17:07:50.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.442+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~9DI2SJHY62JT.2 size=355749 2024-09-12T17:07:50.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.442+0000 7f9eaebff780 1 > prepared multipart upload key=TDZCNUZE8IOA upload=9DI2SJHY62JT tag=407FL67UPE1H type=write size=3501477 2024-09-12T17:07:50.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.443+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~Q9M6F2PRLYF4.0 size=1048576 2024-09-12T17:07:50.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.444+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~Q9M6F2PRLYF4.1 size=527381 2024-09-12T17:07:50.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.446+0000 7f9eaebff780 1 < completed multipart upload key=TDZCNUZE8IOA upload=Q9M6F2PRLYF4 tag=FO6LEDUK22F2 type=write size=2624533 2024-09-12T17:07:50.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.448+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~B232663NYMH3.0 size=20670 2024-09-12T17:07:50.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.448+0000 7f9eaebff780 1 > prepared multipart upload key=EKUW5AKC428U upload=B232663NYMH3 tag=U60OAW8MPI0M type=write size=1069246 2024-09-12T17:07:50.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.451+0000 7f9eaebff780 1 < suggested remove operation key=QIMNK4DL3D0N tag=DVDMC0SRJ0NF type=del 2024-09-12T17:07:50.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.452+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=LSZH1895M4AE type=del size=1728728 2024-09-12T17:07:50.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.453+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=ECY3H12B69W7 type=del 2024-09-12T17:07:50.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.455+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~1NI14V56Z5KU.0 size=1048576 2024-09-12T17:07:50.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.456+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~1NI14V56Z5KU.1 size=102150 2024-09-12T17:07:50.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.456+0000 7f9eaebff780 1 > prepared multipart upload key=7PBT9VZ07OUI upload=1NI14V56Z5KU tag=NTYIA6L0U8WD type=write size=2199302 2024-09-12T17:07:50.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.458+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~M8BJZTPYI8KA.0 size=222196 2024-09-12T17:07:50.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.460+0000 7f9eaebff780 1 < completed multipart upload key=A1KRCFY18QTP upload=M8BJZTPYI8KA tag=HX26X0K0FAGP type=write size=1270772 2024-09-12T17:07:50.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.461+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=VB1IGS55CPO8 type=del size=6847 2024-09-12T17:07:50.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.463+0000 7f9eaebff780 1 < completed delete operation key=SVWPQETL92QU tag=9WT4BBL6ZGHB type=del 2024-09-12T17:07:50.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.464+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=3ORBWQOW8H2T type=del size=3468770 2024-09-12T17:07:50.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.465+0000 7f9eaebff780 -1 < failed to complete operation key=QIMNK4DL3D0N tag=RJT6YM5R0TKV type=del size=3586605: (22) Invalid argument 2024-09-12T17:07:50.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.467+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=UFB5FZO0OKCA type=del size=1524700 2024-09-12T17:07:50.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.468+0000 7f9eaebff780 1 < completed part key=_multipart_GB8P7K59Y8VI.2~6OD40WIZQQSC.0 size=9449 2024-09-12T17:07:50.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.471+0000 7f9eaebff780 1 < completed multipart upload key=GB8P7K59Y8VI upload=6OD40WIZQQSC tag=NY4TZVYM1EG0 type=write size=1058025 2024-09-12T17:07:50.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.473+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~KPB27OA4TEV0.0 size=1048576 2024-09-12T17:07:50.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.474+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~KPB27OA4TEV0.1 size=301303 2024-09-12T17:07:50.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.474+0000 7f9eaebff780 1 > prepared multipart upload key=LRI5G5G8O5X4 upload=KPB27OA4TEV0 tag=XGK79XVORZ9A type=write size=2398455 2024-09-12T17:07:50.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.475+0000 7f9eaebff780 1 < canceled part key=_multipart_7PBT9VZ07OUI.2~19SOXUL1IWUO.0 size=1048576 2024-09-12T17:07:50.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.476+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~19SOXUL1IWUO.1 size=140959 2024-09-12T17:07:50.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.479+0000 7f9eaebff780 1 < canceled multipart upload key=7PBT9VZ07OUI upload=19SOXUL1IWUO tag=IUYSV01OKLWN type=write size=2238111 2024-09-12T17:07:50.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.481+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=XWQCRKRYJOYD type=write size=510406 2024-09-12T17:07:50.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.484+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~OTS0BQKXAVYG.0 size=1048576 2024-09-12T17:07:50.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.485+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~OTS0BQKXAVYG.1 size=624207 2024-09-12T17:07:50.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.487+0000 7f9eaebff780 1 < completed multipart upload key=LRI5G5G8O5X4 upload=OTS0BQKXAVYG tag=6JB88S232FDJ type=write size=2721359 2024-09-12T17:07:50.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.489+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=3CFUGBSC0A2K type=del size=2787642 2024-09-12T17:07:50.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.490+0000 7f9eaebff780 1 < completed write operation key=ZYP3P4031PUZ tag=HIS10J9MR9PC type=write size=876603 2024-09-12T17:07:50.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.491+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=9UAAXFO0RF8F type=del size=3533359 2024-09-12T17:07:50.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.493+0000 7f9eaebff780 -1 < failed to complete operation key=ZC814TPVLJO1 tag=E8E9NCRJTNTV type=del size=1715223: (22) Invalid argument 2024-09-12T17:07:50.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.494+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=3XK4XZ2HSWVJ type=del size=3244605 2024-09-12T17:07:50.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.495+0000 7f9eaebff780 1 < canceled operation key=P9GMGM3WK6O7 tag=DM8B31AKOF2A type=del size=2211156 2024-09-12T17:07:50.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.497+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=RJTQ5SYO1P4Y type=del size=2830051 2024-09-12T17:07:50.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.498+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~A27ER36OP0WY.0 size=1048576 2024-09-12T17:07:50.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.499+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~A27ER36OP0WY.1 size=470360 2024-09-12T17:07:50.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.501+0000 7f9eaebff780 1 < completed multipart upload key=OGD6H9VSVGWF upload=A27ER36OP0WY tag=22NZLUMQ6GPX type=write size=2567512 2024-09-12T17:07:50.504 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.502+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=11GQ70A0MX78 type=del size=4025424 2024-09-12T17:07:50.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.503+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=JDL2I42DJ3CR type=del 2024-09-12T17:07:50.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.505+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=E317PCJ5RXS1 type=del size=371978 2024-09-12T17:07:50.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.506+0000 7f9eaebff780 1 < completed delete operation key=P9GMGM3WK6O7 tag=B53KCOCCLNO0 type=del 2024-09-12T17:07:50.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.507+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=564TJTJCIN6C type=write size=734811 2024-09-12T17:07:50.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.508+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~9DI2SJHY62JT.0 size=1048576 2024-09-12T17:07:50.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.509+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~9DI2SJHY62JT.1 size=1048576 2024-09-12T17:07:50.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.510+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~9DI2SJHY62JT.2 size=355749 2024-09-12T17:07:50.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.513+0000 7f9eaebff780 1 < completed multipart upload key=TDZCNUZE8IOA upload=9DI2SJHY62JT tag=407FL67UPE1H type=write size=3501477 2024-09-12T17:07:50.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.514+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=UAL6RZ3KM90Y type=del size=1196103 2024-09-12T17:07:50.517 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.515+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~B232663NYMH3.0 size=20670 2024-09-12T17:07:50.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.517+0000 7f9eaebff780 1 < completed multipart upload key=EKUW5AKC428U upload=B232663NYMH3 tag=U60OAW8MPI0M type=write size=1069246 2024-09-12T17:07:50.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.520+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~ZK3B5C25ZRY8.0 size=1048576 2024-09-12T17:07:50.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.521+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~ZK3B5C25ZRY8.1 size=237589 2024-09-12T17:07:50.523 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.521+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=ZK3B5C25ZRY8 tag=I7MCZWK4XJUP type=write size=2334741 2024-09-12T17:07:50.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.524+0000 7f9eaebff780 1 < suggested remove operation key=3VY271ZBO754 tag=LSZH1895M4AE type=del 2024-09-12T17:07:50.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.526+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~Q7PVPI59AM9A.0 size=1048576 2024-09-12T17:07:50.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.527+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~Q7PVPI59AM9A.1 size=579214 2024-09-12T17:07:50.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.527+0000 7f9eaebff780 1 > prepared multipart upload key=EKUW5AKC428U upload=Q7PVPI59AM9A tag=UXST1VM4ORRT type=write size=2676366 2024-09-12T17:07:50.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.528+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~1NI14V56Z5KU.0 size=1048576 2024-09-12T17:07:50.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.529+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~1NI14V56Z5KU.1 size=102150 2024-09-12T17:07:50.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.531+0000 7f9eaebff780 1 < completed multipart upload key=7PBT9VZ07OUI upload=1NI14V56Z5KU tag=NTYIA6L0U8WD type=write size=2199302 2024-09-12T17:07:50.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.532+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=INT9367D0BMA type=write size=146831 2024-09-12T17:07:50.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.535+0000 7f9eaebff780 1 < suggested remove operation key=YIEP2JYDSLW0 tag=VB1IGS55CPO8 type=del 2024-09-12T17:07:50.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.536+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=6DTCXEVNXB8B type=write size=538942 2024-09-12T17:07:50.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.537+0000 7f9eaebff780 1 < completed delete operation key=SVWPQETL92QU tag=3ORBWQOW8H2T type=del 2024-09-12T17:07:50.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.538+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=2ER44HP7SSG0 type=del size=2015413 2024-09-12T17:07:50.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.540+0000 7f9eaebff780 1 < suggested update operation key=K0P9ZZ91UJJ8 tag=UFB5FZO0OKCA type=del size=1524700 2024-09-12T17:07:50.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.541+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=X2O92YSOP84L type=del size=1174741 2024-09-12T17:07:50.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.543+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~KPB27OA4TEV0.0 size=1048576 2024-09-12T17:07:50.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.544+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~KPB27OA4TEV0.1 size=301303 2024-09-12T17:07:50.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.546+0000 7f9eaebff780 1 < completed multipart upload key=LRI5G5G8O5X4 upload=KPB27OA4TEV0 tag=XGK79XVORZ9A type=write size=2398455 2024-09-12T17:07:50.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.548+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~SDS5BRIETEX2.0 size=1048576 2024-09-12T17:07:50.550 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.549+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~SDS5BRIETEX2.1 size=76355 2024-09-12T17:07:50.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.549+0000 7f9eaebff780 1 > prepared multipart upload key=3LY681252WAN upload=SDS5BRIETEX2 tag=92TYH0ZDCSSV type=write size=2173507 2024-09-12T17:07:50.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.550+0000 7f9eaebff780 1 < completed write operation key=GB8P7K59Y8VI tag=XWQCRKRYJOYD type=write size=510406 2024-09-12T17:07:50.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.551+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=2V9MTZIKA731 type=write size=675614 2024-09-12T17:07:50.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.552+0000 7f9eaebff780 -1 < failed to complete operation key=YIEP2JYDSLW0 tag=3CFUGBSC0A2K type=del size=2787642: (22) Invalid argument 2024-09-12T17:07:50.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.554+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=UQ0UJWAGMUZ9 type=write size=118664 2024-09-12T17:07:50.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.555+0000 7f9eaebff780 1 < completed delete operation key=UYF1AN2W59VN tag=9UAAXFO0RF8F type=del 2024-09-12T17:07:50.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.556+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=T5G2TNQ2TCLN type=del size=3968855 2024-09-12T17:07:50.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.557+0000 7f9eaebff780 1 < completed delete operation key=K2NHRSUDQBRW tag=3XK4XZ2HSWVJ type=del 2024-09-12T17:07:50.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.559+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~0ASPD8RL09UT.0 size=1048576 2024-09-12T17:07:50.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.560+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~0ASPD8RL09UT.1 size=446299 2024-09-12T17:07:50.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.560+0000 7f9eaebff780 1 > prepared multipart upload key=7PBT9VZ07OUI upload=0ASPD8RL09UT tag=L9556VL1FZ9M type=write size=2543451 2024-09-12T17:07:50.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.562+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=RJTQ5SYO1P4Y type=del 2024-09-12T17:07:50.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.563+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=TXNCOWEAGS9O type=del size=1161222 2024-09-12T17:07:50.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.564+0000 7f9eaebff780 1 < canceled operation key=0F5LXJZMBFSP tag=11GQ70A0MX78 type=del size=4025424 2024-09-12T17:07:50.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.565+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=KIGAHB6QWZY2 type=del size=4178879 2024-09-12T17:07:50.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.567+0000 7f9eaebff780 1 < completed delete operation key=LRI5G5G8O5X4 tag=E317PCJ5RXS1 type=del 2024-09-12T17:07:50.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.568+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=JUP602MMEGAU type=del size=4065821 2024-09-12T17:07:50.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.569+0000 7f9eaebff780 1 < completed write operation key=0YD5P1ACZ09Q tag=564TJTJCIN6C type=write size=734811 2024-09-12T17:07:50.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.570+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=EQZDPTMFVE45 type=del size=1463778 2024-09-12T17:07:50.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.572+0000 7f9eaebff780 1 < canceled operation key=OGD6H9VSVGWF tag=UAL6RZ3KM90Y type=del size=1196103 2024-09-12T17:07:50.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.573+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=ZMSWYTOP42GC type=del size=1318792 2024-09-12T17:07:50.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.574+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~ZK3B5C25ZRY8.0 size=1048576 2024-09-12T17:07:50.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.575+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~ZK3B5C25ZRY8.1 size=237589 2024-09-12T17:07:50.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.577+0000 7f9eaebff780 1 < completed multipart upload key=P9GMGM3WK6O7 upload=ZK3B5C25ZRY8 tag=I7MCZWK4XJUP type=write size=2334741 2024-09-12T17:07:50.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.578+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=7OPM3XCF1FJW type=del size=2989470 2024-09-12T17:07:50.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.579+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~Q7PVPI59AM9A.0 size=1048576 2024-09-12T17:07:50.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.580+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~Q7PVPI59AM9A.1 size=579214 2024-09-12T17:07:50.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.582+0000 7f9eaebff780 1 < completed multipart upload key=EKUW5AKC428U upload=Q7PVPI59AM9A tag=UXST1VM4ORRT type=write size=2676366 2024-09-12T17:07:50.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.583+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=55Q7922XOSYW type=del size=1220817 2024-09-12T17:07:50.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.585+0000 7f9eaebff780 1 < completed write operation key=QIMNK4DL3D0N tag=INT9367D0BMA type=write size=146831 2024-09-12T17:07:50.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.587+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~YGX9P9B1FAYJ.0 size=1048576 2024-09-12T17:07:50.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.588+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~YGX9P9B1FAYJ.1 size=448873 2024-09-12T17:07:50.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.588+0000 7f9eaebff780 1 > prepared multipart upload key=7PBT9VZ07OUI upload=YGX9P9B1FAYJ tag=AISIP6E0SPN8 type=write size=2546025 2024-09-12T17:07:50.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.590+0000 7f9eaebff780 1 < suggested remove operation key=SVWPQETL92QU tag=6DTCXEVNXB8B type=write 2024-09-12T17:07:50.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.591+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=0MIY4KHT0J6H type=del size=1948152 2024-09-12T17:07:50.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.592+0000 7f9eaebff780 -1 < no bi entry to suggest for operation key=SVWPQETL92QU tag=2ER44HP7SSG0 type=del size=2015413: (2) No such file or directory 2024-09-12T17:07:50.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.594+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~8UU4L98BFGCY.0 size=1048576 2024-09-12T17:07:50.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.595+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~8UU4L98BFGCY.1 size=1048576 2024-09-12T17:07:50.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.596+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~8UU4L98BFGCY.2 size=629741 2024-09-12T17:07:50.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.596+0000 7f9eaebff780 1 > prepared multipart upload key=8DJLYFM11DNI upload=8UU4L98BFGCY tag=IU03VF0JN4KM type=write size=3775469 2024-09-12T17:07:50.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.599+0000 7f9eaebff780 1 < suggested update operation key=K2NHRSUDQBRW tag=X2O92YSOP84L type=del size=1174741 2024-09-12T17:07:50.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.602+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~VNQ0EEDVDU4J.0 size=609771 2024-09-12T17:07:50.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.602+0000 7f9eaebff780 1 > prepared multipart upload key=CAIZM33SDFPM upload=VNQ0EEDVDU4J tag=98BVW2WZS8KL type=write size=1658347 2024-09-12T17:07:50.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.603+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~SDS5BRIETEX2.0 size=1048576 2024-09-12T17:07:50.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.604+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~SDS5BRIETEX2.1 size=76355 2024-09-12T17:07:50.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.606+0000 7f9eaebff780 1 < completed multipart upload key=3LY681252WAN upload=SDS5BRIETEX2 tag=92TYH0ZDCSSV type=write size=2173507 2024-09-12T17:07:50.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.607+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=EJR9FN7U7D44 type=del size=3948203 2024-09-12T17:07:50.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.609+0000 7f9eaebff780 1 < completed write operation key=TDZCNUZE8IOA tag=2V9MTZIKA731 type=write size=675614 2024-09-12T17:07:50.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.610+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=9ZT2RQWXSNFF type=del size=1369137 2024-09-12T17:07:50.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.611+0000 7f9eaebff780 1 < completed write operation key=0F5LXJZMBFSP tag=UQ0UJWAGMUZ9 type=write size=118664 2024-09-12T17:07:50.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.613+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~L16AY97EHR9R.0 size=8682 2024-09-12T17:07:50.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.613+0000 7f9eaebff780 1 > prepared multipart upload key=8DJLYFM11DNI upload=L16AY97EHR9R tag=2K97OUWPGANK type=write size=1057258 2024-09-12T17:07:50.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.616+0000 7f9eaebff780 1 < suggested remove operation key=CAIZM33SDFPM tag=T5G2TNQ2TCLN type=del 2024-09-12T17:07:50.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.618+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~PTCLC4ZHDJQU.0 size=1048576 2024-09-12T17:07:50.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.619+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~PTCLC4ZHDJQU.1 size=640253 2024-09-12T17:07:50.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.619+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=PTCLC4ZHDJQU tag=UMHUS7UH16W9 type=write size=2737405 2024-09-12T17:07:50.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.620+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~0ASPD8RL09UT.0 size=1048576 2024-09-12T17:07:50.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.621+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~0ASPD8RL09UT.1 size=446299 2024-09-12T17:07:50.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.623+0000 7f9eaebff780 1 < completed multipart upload key=7PBT9VZ07OUI upload=0ASPD8RL09UT tag=L9556VL1FZ9M type=write size=2543451 2024-09-12T17:07:50.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.625+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~M2793Z6PLJJ4.0 size=1048576 2024-09-12T17:07:50.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.626+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~M2793Z6PLJJ4.1 size=1044854 2024-09-12T17:07:50.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.626+0000 7f9eaebff780 1 > prepared multipart upload key=0YD5P1ACZ09Q upload=M2793Z6PLJJ4 tag=OBJRPMZNV8HY type=write size=3142006 2024-09-12T17:07:50.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.627+0000 7f9eaebff780 1 < completed delete operation key=EKUW5AKC428U tag=TXNCOWEAGS9O type=del 2024-09-12T17:07:50.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.629+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~LYH6EN3M6MIC.0 size=1048576 2024-09-12T17:07:50.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.630+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~LYH6EN3M6MIC.1 size=527021 2024-09-12T17:07:50.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.630+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=LYH6EN3M6MIC tag=MQDJFEUWAVG2 type=write size=2624173 2024-09-12T17:07:50.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.631+0000 7f9eaebff780 1 < completed delete operation key=ZC814TPVLJO1 tag=KIGAHB6QWZY2 type=del 2024-09-12T17:07:50.634 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.633+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=BIPTNVO2A5B7 type=del size=1979616 2024-09-12T17:07:50.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.634+0000 7f9eaebff780 1 < canceled operation key=LJN514F16XJA tag=JUP602MMEGAU type=del size=4065821 2024-09-12T17:07:50.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.635+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=2A6XIKADFPB1 type=write size=213133 2024-09-12T17:07:50.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.636+0000 7f9eaebff780 1 < completed delete operation key=ZC814TPVLJO1 tag=EQZDPTMFVE45 type=del 2024-09-12T17:07:50.640 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.637+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=H9EMNV8PHTTN type=del size=716558 2024-09-12T17:07:50.640 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.638+0000 7f9eaebff780 1 < completed delete operation key=GB8P7K59Y8VI tag=ZMSWYTOP42GC type=del 2024-09-12T17:07:50.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.640+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=RZZ4NK0NGGLP type=del size=660782 2024-09-12T17:07:50.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.641+0000 7f9eaebff780 -1 < failed to complete operation key=SVWPQETL92QU tag=7OPM3XCF1FJW type=del size=2989470: (22) Invalid argument 2024-09-12T17:07:50.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.643+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~952REVCXZX09.0 size=945540 2024-09-12T17:07:50.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.643+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=952REVCXZX09 tag=AGHFEM5OV1XT type=write size=1994116 2024-09-12T17:07:50.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.644+0000 7f9eaebff780 1 < canceled operation key=ZYP3P4031PUZ tag=55Q7922XOSYW type=del size=1220817 2024-09-12T17:07:50.647 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.646+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=IDHI9RRV6AWC type=del size=915900 2024-09-12T17:07:50.648 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.647+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~YGX9P9B1FAYJ.0 size=1048576 2024-09-12T17:07:50.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.648+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~YGX9P9B1FAYJ.1 size=448873 2024-09-12T17:07:50.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.650+0000 7f9eaebff780 1 < completed multipart upload key=7PBT9VZ07OUI upload=YGX9P9B1FAYJ tag=AISIP6E0SPN8 type=write size=2546025 2024-09-12T17:07:50.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.651+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=EI9MGM78ICAA type=del size=2890620 2024-09-12T17:07:50.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.652+0000 7f9eaebff780 1 < completed delete operation key=ZC814TPVLJO1 tag=0MIY4KHT0J6H type=del 2024-09-12T17:07:50.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.654+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=NNJLCBSQKXQY type=del size=3130512 2024-09-12T17:07:50.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.655+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~8UU4L98BFGCY.0 size=1048576 2024-09-12T17:07:50.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.656+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~8UU4L98BFGCY.1 size=1048576 2024-09-12T17:07:50.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.656+0000 7f9eaebff780 1 < canceled part key=_multipart_8DJLYFM11DNI.2~8UU4L98BFGCY.2 size=629741 2024-09-12T17:07:50.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.658+0000 7f9eaebff780 1 < canceled multipart upload key=8DJLYFM11DNI upload=8UU4L98BFGCY tag=IU03VF0JN4KM type=write size=3775469 2024-09-12T17:07:50.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.660+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~OZ87BQPLYTO9.0 size=374456 2024-09-12T17:07:50.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.660+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=OZ87BQPLYTO9 tag=S7BKZ9JR234X type=write size=1423032 2024-09-12T17:07:50.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.660+0000 7f9eaebff780 1 < canceled part key=_multipart_CAIZM33SDFPM.2~VNQ0EEDVDU4J.0 size=609771 2024-09-12T17:07:50.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.662+0000 7f9eaebff780 1 < canceled multipart upload key=CAIZM33SDFPM upload=VNQ0EEDVDU4J tag=98BVW2WZS8KL type=write size=1658347 2024-09-12T17:07:50.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.663+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=7QTPKPKX68VU type=del size=4169433 2024-09-12T17:07:50.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.665+0000 7f9eaebff780 1 < completed delete operation key=OGD6H9VSVGWF tag=EJR9FN7U7D44 type=del 2024-09-12T17:07:50.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.667+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~MUXMMCUJYV93.0 size=1048576 2024-09-12T17:07:50.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.668+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~MUXMMCUJYV93.1 size=552475 2024-09-12T17:07:50.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.668+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=MUXMMCUJYV93 tag=4CFTOMV4N6U0 type=write size=2649627 2024-09-12T17:07:50.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.669+0000 7f9eaebff780 1 < completed delete operation key=SVWPQETL92QU tag=9ZT2RQWXSNFF type=del 2024-09-12T17:07:50.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.670+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=NL56X1FQTCTA type=del size=2777659 2024-09-12T17:07:50.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.671+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~L16AY97EHR9R.0 size=8682 2024-09-12T17:07:50.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.673+0000 7f9eaebff780 1 < completed multipart upload key=8DJLYFM11DNI upload=L16AY97EHR9R tag=2K97OUWPGANK type=write size=1057258 2024-09-12T17:07:50.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.675+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~8HTQ1QBQZWKU.0 size=1033726 2024-09-12T17:07:50.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.675+0000 7f9eaebff780 1 > prepared multipart upload key=GB8P7K59Y8VI upload=8HTQ1QBQZWKU tag=5H8SA1J21MAQ type=write size=2082302 2024-09-12T17:07:50.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.677+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~PTCLC4ZHDJQU.0 size=1048576 2024-09-12T17:07:50.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.678+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~PTCLC4ZHDJQU.1 size=640253 2024-09-12T17:07:50.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.680+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=PTCLC4ZHDJQU tag=UMHUS7UH16W9 type=write size=2737405 2024-09-12T17:07:50.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.682+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~W0YJ3TWBX2MB.0 size=1048576 2024-09-12T17:07:50.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.683+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~W0YJ3TWBX2MB.1 size=147746 2024-09-12T17:07:50.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.683+0000 7f9eaebff780 1 > prepared multipart upload key=EKUW5AKC428U upload=W0YJ3TWBX2MB tag=GCG2PWBTIBBI type=write size=2244898 2024-09-12T17:07:50.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.684+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~M2793Z6PLJJ4.0 size=1048576 2024-09-12T17:07:50.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.685+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~M2793Z6PLJJ4.1 size=1044854 2024-09-12T17:07:50.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.687+0000 7f9eaebff780 1 < completed multipart upload key=0YD5P1ACZ09Q upload=M2793Z6PLJJ4 tag=OBJRPMZNV8HY type=write size=3142006 2024-09-12T17:07:50.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.689+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=O56C9U3NJLYC type=del size=504780 2024-09-12T17:07:50.691 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.690+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~LYH6EN3M6MIC.0 size=1048576 2024-09-12T17:07:50.692 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.691+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~LYH6EN3M6MIC.1 size=527021 2024-09-12T17:07:50.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.693+0000 7f9eaebff780 1 < completed multipart upload key=SHWT6AT7PN0M upload=LYH6EN3M6MIC tag=MQDJFEUWAVG2 type=write size=2624173 2024-09-12T17:07:50.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.694+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=5FLIVLT0B9EH type=del size=2117735 2024-09-12T17:07:50.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.695+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=BIPTNVO2A5B7 type=del 2024-09-12T17:07:50.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.696+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=LFG5P5OYDV3N type=del size=3708320 2024-09-12T17:07:50.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.697+0000 7f9eaebff780 1 < completed write operation key=8DJLYFM11DNI tag=2A6XIKADFPB1 type=write size=213133 2024-09-12T17:07:50.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.699+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=K7N424SEILSL type=write size=649766 2024-09-12T17:07:50.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.700+0000 7f9eaebff780 1 < completed delete operation key=0F5LXJZMBFSP tag=H9EMNV8PHTTN type=del 2024-09-12T17:07:50.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.702+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~T7YOWWMQ9PID.0 size=35080 2024-09-12T17:07:50.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.702+0000 7f9eaebff780 1 > prepared multipart upload key=9I6RGNRB6HSY upload=T7YOWWMQ9PID tag=54HO0IW4VYDO type=write size=1083656 2024-09-12T17:07:50.705 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.703+0000 7f9eaebff780 1 < completed delete operation key=M3PLQGSK34YM tag=RZZ4NK0NGGLP type=del 2024-09-12T17:07:50.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.705+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=63A8CG66WD7H type=del size=3207708 2024-09-12T17:07:50.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.706+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~952REVCXZX09.0 size=945540 2024-09-12T17:07:50.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.708+0000 7f9eaebff780 1 < completed multipart upload key=SHWT6AT7PN0M upload=952REVCXZX09 tag=AGHFEM5OV1XT type=write size=1994116 2024-09-12T17:07:50.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.709+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=ILGKS1Q8TMFC type=del size=1624357 2024-09-12T17:07:50.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.713+0000 7f9eaebff780 1 < suggested remove operation key=TDZCNUZE8IOA tag=IDHI9RRV6AWC type=del 2024-09-12T17:07:50.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.715+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~BQVAR7R4H2JC.0 size=1048576 2024-09-12T17:07:50.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.716+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~BQVAR7R4H2JC.1 size=1048576 2024-09-12T17:07:50.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.717+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~BQVAR7R4H2JC.2 size=285614 2024-09-12T17:07:50.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.717+0000 7f9eaebff780 1 > prepared multipart upload key=B1YC6DM9S8JJ upload=BQVAR7R4H2JC tag=A6QQ1F1RT7E8 type=write size=3431342 2024-09-12T17:07:50.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.719+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=EI9MGM78ICAA type=del 2024-09-12T17:07:50.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.721+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~QHXL1P08Y7ET.0 size=119895 2024-09-12T17:07:50.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.721+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=QHXL1P08Y7ET tag=X93JFQ6MM125 type=write size=1168471 2024-09-12T17:07:50.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.722+0000 7f9eaebff780 1 < canceled operation key=SO6QF2JCRX6E tag=NNJLCBSQKXQY type=del size=3130512 2024-09-12T17:07:50.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.723+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=IPE48ZVNKXRM type=del size=3604626 2024-09-12T17:07:50.726 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.725+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~OZ87BQPLYTO9.0 size=374456 2024-09-12T17:07:50.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.727+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=OZ87BQPLYTO9 tag=S7BKZ9JR234X type=write size=1423032 2024-09-12T17:07:50.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.729+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=LV52W5QU58IV type=del size=3488935 2024-09-12T17:07:50.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.731+0000 7f9eaebff780 1 < suggested remove operation key=OH6GXTMPBYUY tag=7QTPKPKX68VU type=del 2024-09-12T17:07:50.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.733+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=GOXUPLUNU1P6 type=write size=440957 2024-09-12T17:07:50.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.734+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~MUXMMCUJYV93.0 size=1048576 2024-09-12T17:07:50.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.735+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~MUXMMCUJYV93.1 size=552475 2024-09-12T17:07:50.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.738+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=MUXMMCUJYV93 tag=4CFTOMV4N6U0 type=write size=2649627 2024-09-12T17:07:50.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.740+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~WDDVVGKRO2WN.0 size=1048576 2024-09-12T17:07:50.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.741+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~WDDVVGKRO2WN.1 size=1048576 2024-09-12T17:07:50.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.742+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~WDDVVGKRO2WN.2 size=542424 2024-09-12T17:07:50.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.742+0000 7f9eaebff780 1 > prepared multipart upload key=TDZCNUZE8IOA upload=WDDVVGKRO2WN tag=1WDK2JZPOM68 type=write size=3688152 2024-09-12T17:07:50.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.743+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=NL56X1FQTCTA type=del 2024-09-12T17:07:50.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.745+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~37WU9XXJ4HHY.0 size=315773 2024-09-12T17:07:50.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.745+0000 7f9eaebff780 1 > prepared multipart upload key=EKUW5AKC428U upload=37WU9XXJ4HHY tag=TLXZX882JGAR type=write size=1364349 2024-09-12T17:07:50.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.747+0000 7f9eaebff780 1 < completed part key=_multipart_GB8P7K59Y8VI.2~8HTQ1QBQZWKU.0 size=1033726 2024-09-12T17:07:50.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.749+0000 7f9eaebff780 1 < completed multipart upload key=GB8P7K59Y8VI upload=8HTQ1QBQZWKU tag=5H8SA1J21MAQ type=write size=2082302 2024-09-12T17:07:50.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.750+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=1CQMU6IGOVRX type=del size=3617052 2024-09-12T17:07:50.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.751+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~W0YJ3TWBX2MB.0 size=1048576 2024-09-12T17:07:50.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.752+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~W0YJ3TWBX2MB.1 size=147746 2024-09-12T17:07:50.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.754+0000 7f9eaebff780 1 < completed multipart upload key=EKUW5AKC428U upload=W0YJ3TWBX2MB tag=GCG2PWBTIBBI type=write size=2244898 2024-09-12T17:07:50.756 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.755+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=XZBLX8XK2BD8 type=del size=1094852 2024-09-12T17:07:50.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.756+0000 7f9eaebff780 1 < completed delete operation key=ZYP3P4031PUZ tag=O56C9U3NJLYC type=del 2024-09-12T17:07:50.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.759+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~KDFMBUEK8BJK.0 size=1048576 2024-09-12T17:07:50.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.760+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~KDFMBUEK8BJK.1 size=947878 2024-09-12T17:07:50.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.760+0000 7f9eaebff780 1 > prepared multipart upload key=OGD6H9VSVGWF upload=KDFMBUEK8BJK tag=IOFL05BBGU4I type=write size=3045030 2024-09-12T17:07:50.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.761+0000 7f9eaebff780 1 < completed delete operation key=8DJLYFM11DNI tag=5FLIVLT0B9EH type=del 2024-09-12T17:07:50.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.763+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~IFUDD0MAJ640.0 size=373410 2024-09-12T17:07:50.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.763+0000 7f9eaebff780 1 > prepared multipart upload key=B1YC6DM9S8JJ upload=IFUDD0MAJ640 tag=0ORP0CCHBAAJ type=write size=1421986 2024-09-12T17:07:50.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.764+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=LFG5P5OYDV3N type=del 2024-09-12T17:07:50.767 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.765+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=R4X6B9VQ49K9 type=del size=1234143 2024-09-12T17:07:50.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.767+0000 7f9eaebff780 1 < completed write operation key=GB8P7K59Y8VI tag=K7N424SEILSL type=write size=649766 2024-09-12T17:07:50.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.768+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=FADZRO83HA79 type=del size=4118548 2024-09-12T17:07:50.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.769+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~T7YOWWMQ9PID.0 size=35080 2024-09-12T17:07:50.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.771+0000 7f9eaebff780 1 < completed multipart upload key=9I6RGNRB6HSY upload=T7YOWWMQ9PID tag=54HO0IW4VYDO type=write size=1083656 2024-09-12T17:07:50.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.772+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=C0SGNDVO9U00 type=del size=1849778 2024-09-12T17:07:50.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.774+0000 7f9eaebff780 1 < completed delete operation key=LRI5G5G8O5X4 tag=63A8CG66WD7H type=del 2024-09-12T17:07:50.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.775+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=FX3UZ084J78J type=del size=3139509 2024-09-12T17:07:50.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.776+0000 7f9eaebff780 1 < completed delete operation key=QIMNK4DL3D0N tag=ILGKS1Q8TMFC type=del 2024-09-12T17:07:50.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.777+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=93G8WGUZX83S type=del size=934765 2024-09-12T17:07:50.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.778+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~BQVAR7R4H2JC.0 size=1048576 2024-09-12T17:07:50.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.779+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~BQVAR7R4H2JC.1 size=1048576 2024-09-12T17:07:50.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.780+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~BQVAR7R4H2JC.2 size=285614 2024-09-12T17:07:50.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.782+0000 7f9eaebff780 1 < completed multipart upload key=B1YC6DM9S8JJ upload=BQVAR7R4H2JC tag=A6QQ1F1RT7E8 type=write size=3431342 2024-09-12T17:07:50.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.784+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=JF4LG2WIYOJN type=del size=2716014 2024-09-12T17:07:50.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.784+0000 7f9eaebff780 1 < canceled part key=_multipart_UYF1AN2W59VN.2~QHXL1P08Y7ET.0 size=119895 2024-09-12T17:07:50.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.786+0000 7f9eaebff780 1 < canceled multipart upload key=UYF1AN2W59VN upload=QHXL1P08Y7ET tag=X93JFQ6MM125 type=write size=1168471 2024-09-12T17:07:50.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.788+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~12YHPFMVA3DK.0 size=398061 2024-09-12T17:07:50.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.788+0000 7f9eaebff780 1 > prepared multipart upload key=9I6RGNRB6HSY upload=12YHPFMVA3DK tag=NLMBIPN4A16J type=write size=1446637 2024-09-12T17:07:50.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.789+0000 7f9eaebff780 1 < completed delete operation key=GB8P7K59Y8VI tag=IPE48ZVNKXRM type=del 2024-09-12T17:07:50.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.790+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=1FDP6SLW1PF3 type=del size=3994132 2024-09-12T17:07:50.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.792+0000 7f9eaebff780 1 < completed delete operation key=0F5LXJZMBFSP tag=LV52W5QU58IV type=del 2024-09-12T17:07:50.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.793+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=QDTYN1GRG375 type=del size=2576598 2024-09-12T17:07:50.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.794+0000 7f9eaebff780 1 < completed write operation key=9WJGBODZ60NJ tag=GOXUPLUNU1P6 type=write size=440957 2024-09-12T17:07:50.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.795+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=AHFEY2UZUEV9 type=del size=3730317 2024-09-12T17:07:50.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.796+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~WDDVVGKRO2WN.0 size=1048576 2024-09-12T17:07:50.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.797+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~WDDVVGKRO2WN.1 size=1048576 2024-09-12T17:07:50.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.798+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~WDDVVGKRO2WN.2 size=542424 2024-09-12T17:07:50.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.801+0000 7f9eaebff780 1 < completed multipart upload key=TDZCNUZE8IOA upload=WDDVVGKRO2WN tag=1WDK2JZPOM68 type=write size=3688152 2024-09-12T17:07:50.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.802+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=Q20WHQ1EYY29 type=del size=2453803 2024-09-12T17:07:50.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.803+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~37WU9XXJ4HHY.0 size=315773 2024-09-12T17:07:50.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.806+0000 7f9eaebff780 1 < completed multipart upload key=EKUW5AKC428U upload=37WU9XXJ4HHY tag=TLXZX882JGAR type=write size=1364349 2024-09-12T17:07:50.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.807+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=F0XIHZGZTTVT type=del size=3111986 2024-09-12T17:07:50.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.808+0000 7f9eaebff780 1 < completed delete operation key=P9GMGM3WK6O7 tag=1CQMU6IGOVRX type=del 2024-09-12T17:07:50.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.810+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=GUZQAFBBGFCP type=del size=2552572 2024-09-12T17:07:50.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.811+0000 7f9eaebff780 1 < completed delete operation key=M3PLQGSK34YM tag=XZBLX8XK2BD8 type=del 2024-09-12T17:07:50.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.813+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~19ZP391H3LQ6.0 size=754445 2024-09-12T17:07:50.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.813+0000 7f9eaebff780 1 > prepared multipart upload key=QIMNK4DL3D0N upload=19ZP391H3LQ6 tag=0TYROGD46WK0 type=write size=1803021 2024-09-12T17:07:50.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.815+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~KDFMBUEK8BJK.0 size=1048576 2024-09-12T17:07:50.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.816+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~KDFMBUEK8BJK.1 size=947878 2024-09-12T17:07:50.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.818+0000 7f9eaebff780 1 < completed multipart upload key=OGD6H9VSVGWF upload=KDFMBUEK8BJK tag=IOFL05BBGU4I type=write size=3045030 2024-09-12T17:07:50.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.820+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~6CS4BY2RZ2D4.0 size=1048576 2024-09-12T17:07:50.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.821+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~6CS4BY2RZ2D4.1 size=1048576 2024-09-12T17:07:50.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.822+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~6CS4BY2RZ2D4.2 size=515876 2024-09-12T17:07:50.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.822+0000 7f9eaebff780 1 > prepared multipart upload key=SO6QF2JCRX6E upload=6CS4BY2RZ2D4 tag=5QDQBBA7KX6K type=write size=3661604 2024-09-12T17:07:50.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.823+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~IFUDD0MAJ640.0 size=373410 2024-09-12T17:07:50.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.826+0000 7f9eaebff780 1 < completed multipart upload key=B1YC6DM9S8JJ upload=IFUDD0MAJ640 tag=0ORP0CCHBAAJ type=write size=1421986 2024-09-12T17:07:50.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.830+0000 7f9eaebff780 1 > prepared part key=_multipart_TXHXOMIB4B53.2~FJ0HFBGQ6PFX.0 size=1048576 2024-09-12T17:07:50.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.831+0000 7f9eaebff780 1 > prepared part key=_multipart_TXHXOMIB4B53.2~FJ0HFBGQ6PFX.1 size=1008857 2024-09-12T17:07:50.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.831+0000 7f9eaebff780 1 > prepared multipart upload key=TXHXOMIB4B53 upload=FJ0HFBGQ6PFX tag=SQZE6N5ZMTWD type=write size=3106009 2024-09-12T17:07:50.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.832+0000 7f9eaebff780 1 < completed delete operation key=B1YC6DM9S8JJ tag=R4X6B9VQ49K9 type=del 2024-09-12T17:07:50.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.834+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~361I0G9IVGQ0.0 size=1048576 2024-09-12T17:07:50.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.836+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~361I0G9IVGQ0.1 size=1048576 2024-09-12T17:07:50.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.837+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~361I0G9IVGQ0.2 size=69869 2024-09-12T17:07:50.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.837+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=361I0G9IVGQ0 tag=VNITYZP2FERG type=write size=3215597 2024-09-12T17:07:50.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.838+0000 7f9eaebff780 1 < canceled operation key=LJN514F16XJA tag=FADZRO83HA79 type=del size=4118548 2024-09-12T17:07:50.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.840+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=UO40O8Y5PNEW type=write size=604607 2024-09-12T17:07:50.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.841+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=C0SGNDVO9U00 type=del 2024-09-12T17:07:50.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.842+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=LUS6J9BVVSDI type=write size=540942 2024-09-12T17:07:50.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.843+0000 7f9eaebff780 1 < completed delete operation key=QIMNK4DL3D0N tag=FX3UZ084J78J type=del 2024-09-12T17:07:50.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.845+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~0W3DY5Q3E1US.0 size=7930 2024-09-12T17:07:50.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.845+0000 7f9eaebff780 1 > prepared multipart upload key=0YD5P1ACZ09Q upload=0W3DY5Q3E1US tag=DHHJLSY8A3QI type=write size=1056506 2024-09-12T17:07:50.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.848+0000 7f9eaebff780 1 < suggested remove operation key=K2NHRSUDQBRW tag=93G8WGUZX83S type=del 2024-09-12T17:07:50.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.849+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=WCVL75BVA9R3 type=write size=62979 2024-09-12T17:07:50.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.851+0000 7f9eaebff780 1 < completed delete operation key=TDZCNUZE8IOA tag=JF4LG2WIYOJN type=del 2024-09-12T17:07:50.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.852+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=WYGDU73VVYUL type=write size=175493 2024-09-12T17:07:50.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.853+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~12YHPFMVA3DK.0 size=398061 2024-09-12T17:07:50.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.855+0000 7f9eaebff780 1 < completed multipart upload key=9I6RGNRB6HSY upload=12YHPFMVA3DK tag=NLMBIPN4A16J type=write size=1446637 2024-09-12T17:07:50.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.856+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=5WB1QC25UBUK type=write size=722327 2024-09-12T17:07:50.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.858+0000 7f9eaebff780 1 < completed delete operation key=YIEP2JYDSLW0 tag=1FDP6SLW1PF3 type=del 2024-09-12T17:07:50.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.860+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~TR76WPJW2FZZ.0 size=854719 2024-09-12T17:07:50.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.860+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=TR76WPJW2FZZ tag=PVVRHC139XQW type=write size=1903295 2024-09-12T17:07:50.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.861+0000 7f9eaebff780 1 < completed delete operation key=7PBT9VZ07OUI tag=QDTYN1GRG375 type=del 2024-09-12T17:07:50.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.862+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=U8UDJGX601SQ type=del size=1115809 2024-09-12T17:07:50.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.864+0000 7f9eaebff780 1 < completed delete operation key=0F5LXJZMBFSP tag=AHFEY2UZUEV9 type=del 2024-09-12T17:07:50.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.865+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=7A3IHMJIRUJ0 type=del size=360221 2024-09-12T17:07:50.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.867+0000 7f9eaebff780 1 < completed delete operation key=0F5LXJZMBFSP tag=Q20WHQ1EYY29 type=del 2024-09-12T17:07:50.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.868+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=FXBDBCQFAAH1 type=write size=454262 2024-09-12T17:07:50.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.869+0000 7f9eaebff780 1 < completed delete operation key=TXHXOMIB4B53 tag=F0XIHZGZTTVT type=del 2024-09-12T17:07:50.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.870+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=SGWA3WBMJXFY type=write size=830729 2024-09-12T17:07:50.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.872+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=GUZQAFBBGFCP type=del 2024-09-12T17:07:50.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.873+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=5EIYS1AU9TA2 type=write size=700901 2024-09-12T17:07:50.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.873+0000 7f9eaebff780 1 < canceled part key=_multipart_QIMNK4DL3D0N.2~19ZP391H3LQ6.0 size=754445 2024-09-12T17:07:50.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.875+0000 7f9eaebff780 1 < canceled multipart upload key=QIMNK4DL3D0N upload=19ZP391H3LQ6 tag=0TYROGD46WK0 type=write size=1803021 2024-09-12T17:07:50.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.879+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~T5HAQVD0CUI6.0 size=1048576 2024-09-12T17:07:50.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.880+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~T5HAQVD0CUI6.1 size=1048576 2024-09-12T17:07:50.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.881+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~T5HAQVD0CUI6.2 size=747929 2024-09-12T17:07:50.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.881+0000 7f9eaebff780 1 > prepared multipart upload key=KF8XE48DI9KZ upload=T5HAQVD0CUI6 tag=LOJ7O4LZBJY7 type=write size=3893657 2024-09-12T17:07:50.884 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.883+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~6CS4BY2RZ2D4.0 size=1048576 2024-09-12T17:07:50.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.884+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~6CS4BY2RZ2D4.1 size=1048576 2024-09-12T17:07:50.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.885+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~6CS4BY2RZ2D4.2 size=515876 2024-09-12T17:07:50.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.887+0000 7f9eaebff780 1 < completed multipart upload key=SO6QF2JCRX6E upload=6CS4BY2RZ2D4 tag=5QDQBBA7KX6K type=write size=3661604 2024-09-12T17:07:50.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.889+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~TESJG692460W.0 size=1048576 2024-09-12T17:07:50.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.891+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~TESJG692460W.1 size=89581 2024-09-12T17:07:50.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.891+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=TESJG692460W tag=L3FESGNLNTX8 type=write size=2186733 2024-09-12T17:07:50.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.892+0000 7f9eaebff780 1 < completed part key=_multipart_TXHXOMIB4B53.2~FJ0HFBGQ6PFX.0 size=1048576 2024-09-12T17:07:50.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.893+0000 7f9eaebff780 1 < completed part key=_multipart_TXHXOMIB4B53.2~FJ0HFBGQ6PFX.1 size=1008857 2024-09-12T17:07:50.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.895+0000 7f9eaebff780 1 < completed multipart upload key=TXHXOMIB4B53 upload=FJ0HFBGQ6PFX tag=SQZE6N5ZMTWD type=write size=3106009 2024-09-12T17:07:50.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.898+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~1W983PWBD1X4.0 size=1048576 2024-09-12T17:07:50.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.899+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~1W983PWBD1X4.1 size=1048576 2024-09-12T17:07:50.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.900+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~1W983PWBD1X4.2 size=713521 2024-09-12T17:07:50.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.900+0000 7f9eaebff780 1 > prepared multipart upload key=TDZCNUZE8IOA upload=1W983PWBD1X4 tag=FJG07RE88BW9 type=write size=3859249 2024-09-12T17:07:50.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.901+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~361I0G9IVGQ0.0 size=1048576 2024-09-12T17:07:50.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.902+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~361I0G9IVGQ0.1 size=1048576 2024-09-12T17:07:50.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.903+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~361I0G9IVGQ0.2 size=69869 2024-09-12T17:07:50.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.905+0000 7f9eaebff780 1 < completed multipart upload key=SHWT6AT7PN0M upload=361I0G9IVGQ0 tag=VNITYZP2FERG type=write size=3215597 2024-09-12T17:07:50.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.907+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=9DWX7KWC8PDN type=del size=4082150 2024-09-12T17:07:50.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.908+0000 7f9eaebff780 1 < completed write operation key=3LY681252WAN tag=UO40O8Y5PNEW type=write size=604607 2024-09-12T17:07:50.911 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.909+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=HQABBMC0K965 type=del size=2445404 2024-09-12T17:07:50.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.910+0000 7f9eaebff780 1 < completed write operation key=7PBT9VZ07OUI tag=LUS6J9BVVSDI type=write size=540942 2024-09-12T17:07:50.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.913+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~GOLD9SINTXS7.0 size=1048576 2024-09-12T17:07:50.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.914+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~GOLD9SINTXS7.1 size=1048576 2024-09-12T17:07:50.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.915+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~GOLD9SINTXS7.2 size=895941 2024-09-12T17:07:50.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.915+0000 7f9eaebff780 1 > prepared multipart upload key=OGD6H9VSVGWF upload=GOLD9SINTXS7 tag=RZ6NMJXC3QHL type=write size=4041669 2024-09-12T17:07:50.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.916+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~0W3DY5Q3E1US.0 size=7930 2024-09-12T17:07:50.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.918+0000 7f9eaebff780 1 < completed multipart upload key=0YD5P1ACZ09Q upload=0W3DY5Q3E1US tag=DHHJLSY8A3QI type=write size=1056506 2024-09-12T17:07:50.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.920+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~3JE1VRG7994Z.0 size=1048576 2024-09-12T17:07:50.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.921+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~3JE1VRG7994Z.1 size=463250 2024-09-12T17:07:50.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.921+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=3JE1VRG7994Z tag=X7GDAZKT8VEW type=write size=2560402 2024-09-12T17:07:50.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.922+0000 7f9eaebff780 1 < completed write operation key=LRI5G5G8O5X4 tag=WCVL75BVA9R3 type=write size=62979 2024-09-12T17:07:50.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.923+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=3AIT0YXEQYLP type=del size=3021762 2024-09-12T17:07:50.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.925+0000 7f9eaebff780 1 < completed write operation key=YIEP2JYDSLW0 tag=WYGDU73VVYUL type=write size=175493 2024-09-12T17:07:50.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.926+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=93PMVNQSAEWX type=del size=722369 2024-09-12T17:07:50.928 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.927+0000 7f9eaebff780 1 < completed write operation key=K2NHRSUDQBRW tag=5WB1QC25UBUK type=write size=722327 2024-09-12T17:07:50.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.928+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=N6R7UG1VHUXU type=del size=2447235 2024-09-12T17:07:50.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.930+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~TR76WPJW2FZZ.0 size=854719 2024-09-12T17:07:50.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.932+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=TR76WPJW2FZZ tag=PVVRHC139XQW type=write size=1903295 2024-09-12T17:07:50.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.934+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~TKTF1PVGUGNP.0 size=729000 2024-09-12T17:07:50.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.934+0000 7f9eaebff780 1 > prepared multipart upload key=9I6RGNRB6HSY upload=TKTF1PVGUGNP tag=WLV6S0GB2DAX type=write size=1777576 2024-09-12T17:07:50.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.935+0000 7f9eaebff780 1 < canceled operation key=ZC814TPVLJO1 tag=U8UDJGX601SQ type=del size=1115809 2024-09-12T17:07:50.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.937+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~FAYJXZ4OLA52.0 size=1048576 2024-09-12T17:07:50.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.938+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~FAYJXZ4OLA52.1 size=1048576 2024-09-12T17:07:50.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.939+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~FAYJXZ4OLA52.2 size=112043 2024-09-12T17:07:50.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.939+0000 7f9eaebff780 1 > prepared multipart upload key=3LY681252WAN upload=FAYJXZ4OLA52 tag=VZ35FHL1S627 type=write size=3257771 2024-09-12T17:07:50.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.941+0000 7f9eaebff780 1 < completed delete operation key=K2NHRSUDQBRW tag=7A3IHMJIRUJ0 type=del 2024-09-12T17:07:50.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.943+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~EHIV9S89TPRD.0 size=919111 2024-09-12T17:07:50.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.943+0000 7f9eaebff780 1 > prepared multipart upload key=GB8P7K59Y8VI upload=EHIV9S89TPRD tag=934FX4YXACUQ type=write size=1967687 2024-09-12T17:07:50.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.944+0000 7f9eaebff780 1 < completed write operation key=OGD6H9VSVGWF tag=FXBDBCQFAAH1 type=write size=454262 2024-09-12T17:07:50.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.946+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~5T1608TV0RYD.0 size=1048576 2024-09-12T17:07:50.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.947+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~5T1608TV0RYD.1 size=4261 2024-09-12T17:07:50.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.947+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=5T1608TV0RYD tag=6WUTKLVQ86QL type=write size=2101413 2024-09-12T17:07:50.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.951+0000 7f9eaebff780 1 < suggested update operation key=9WJGBODZ60NJ tag=SGWA3WBMJXFY type=write size=830729 2024-09-12T17:07:50.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.953+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~SQR8EC49BOXC.0 size=686564 2024-09-12T17:07:50.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.953+0000 7f9eaebff780 1 > prepared multipart upload key=ZC814TPVLJO1 upload=SQR8EC49BOXC tag=DPEYL13XBG7Z type=write size=1735140 2024-09-12T17:07:50.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.955+0000 7f9eaebff780 1 < completed write operation key=0F5LXJZMBFSP tag=5EIYS1AU9TA2 type=write size=700901 2024-09-12T17:07:50.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.956+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=SEZWQRT62NAS type=del size=395357 2024-09-12T17:07:50.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.957+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~T5HAQVD0CUI6.0 size=1048576 2024-09-12T17:07:50.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.957+0000 7f9eaebff780 1 < canceled part key=_multipart_KF8XE48DI9KZ.2~T5HAQVD0CUI6.1 size=1048576 2024-09-12T17:07:50.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.957+0000 7f9eaebff780 1 < canceled part key=_multipart_KF8XE48DI9KZ.2~T5HAQVD0CUI6.2 size=747929 2024-09-12T17:07:50.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.959+0000 7f9eaebff780 1 < canceled multipart upload key=KF8XE48DI9KZ upload=T5HAQVD0CUI6 tag=LOJ7O4LZBJY7 type=write size=3893657 2024-09-12T17:07:50.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.962+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~LCNDBWYKLY30.0 size=958420 2024-09-12T17:07:50.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.962+0000 7f9eaebff780 1 > prepared multipart upload key=ZYP3P4031PUZ upload=LCNDBWYKLY30 tag=HLK52VN7DTX5 type=write size=2006996 2024-09-12T17:07:50.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.963+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~TESJG692460W.0 size=1048576 2024-09-12T17:07:50.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.964+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~TESJG692460W.1 size=89581 2024-09-12T17:07:50.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.965+0000 7f9eaebff780 1 < completed multipart upload key=UYF1AN2W59VN upload=TESJG692460W tag=L3FESGNLNTX8 type=write size=2186733 2024-09-12T17:07:50.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.967+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=TO0XEJCJ3HCK type=del size=471023 2024-09-12T17:07:50.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.968+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~1W983PWBD1X4.0 size=1048576 2024-09-12T17:07:50.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.969+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~1W983PWBD1X4.1 size=1048576 2024-09-12T17:07:50.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.970+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~1W983PWBD1X4.2 size=713521 2024-09-12T17:07:50.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.972+0000 7f9eaebff780 1 < completed multipart upload key=TDZCNUZE8IOA upload=1W983PWBD1X4 tag=FJG07RE88BW9 type=write size=3859249 2024-09-12T17:07:50.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.974+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~QYL4Z4ZXVN7C.0 size=1048576 2024-09-12T17:07:50.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.975+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~QYL4Z4ZXVN7C.1 size=834781 2024-09-12T17:07:50.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.975+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=QYL4Z4ZXVN7C tag=X83KKCFU72N6 type=write size=2931933 2024-09-12T17:07:50.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.976+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=9DWX7KWC8PDN type=del 2024-09-12T17:07:50.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.977+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=LZGFTJCU0QEH type=del size=2002644 2024-09-12T17:07:50.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.980+0000 7f9eaebff780 1 < suggested update operation key=QIMNK4DL3D0N tag=HQABBMC0K965 type=del size=2445404 2024-09-12T17:07:50.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.982+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~0NIDI1KSMH73.0 size=1048576 2024-09-12T17:07:50.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.983+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~0NIDI1KSMH73.1 size=507479 2024-09-12T17:07:50.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.983+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=0NIDI1KSMH73 tag=BCNWOGRC4GQO type=write size=2604631 2024-09-12T17:07:50.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.984+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~GOLD9SINTXS7.0 size=1048576 2024-09-12T17:07:50.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.985+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~GOLD9SINTXS7.1 size=1048576 2024-09-12T17:07:50.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.986+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~GOLD9SINTXS7.2 size=895941 2024-09-12T17:07:50.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.988+0000 7f9eaebff780 1 < completed multipart upload key=OGD6H9VSVGWF upload=GOLD9SINTXS7 tag=RZ6NMJXC3QHL type=write size=4041669 2024-09-12T17:07:50.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.990+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=XVFU4PK3RGDD type=del size=3391886 2024-09-12T17:07:50.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.990+0000 7f9eaebff780 1 < canceled part key=_multipart_OH6GXTMPBYUY.2~3JE1VRG7994Z.0 size=1048576 2024-09-12T17:07:50.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.991+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~3JE1VRG7994Z.1 size=463250 2024-09-12T17:07:50.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.993+0000 7f9eaebff780 1 < canceled multipart upload key=OH6GXTMPBYUY upload=3JE1VRG7994Z tag=X7GDAZKT8VEW type=write size=2560402 2024-09-12T17:07:50.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.996+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~RSPKWJM25NU7.0 size=1048576 2024-09-12T17:07:50.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.997+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~RSPKWJM25NU7.1 size=1048576 2024-09-12T17:07:50.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.998+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~RSPKWJM25NU7.2 size=681052 2024-09-12T17:07:50.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.998+0000 7f9eaebff780 1 > prepared multipart upload key=3LY681252WAN upload=RSPKWJM25NU7 tag=MDTKMX3ZDKNO type=write size=3826780 2024-09-12T17:07:51.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:50.999+0000 7f9eaebff780 1 < completed delete operation key=K0P9ZZ91UJJ8 tag=3AIT0YXEQYLP type=del 2024-09-12T17:07:51.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.000+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=GYZI5DRPJPRG type=del size=869005 2024-09-12T17:07:51.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.002+0000 7f9eaebff780 1 < completed delete operation key=UYF1AN2W59VN tag=93PMVNQSAEWX type=del 2024-09-12T17:07:51.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.003+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=TSVQWSNMBAOD type=del size=3507844 2024-09-12T17:07:51.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.004+0000 7f9eaebff780 -1 < failed to complete operation key=QIMNK4DL3D0N tag=N6R7UG1VHUXU type=del size=2447235: (22) Invalid argument 2024-09-12T17:07:51.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.005+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=U256Y0ROACZV type=del size=4158096 2024-09-12T17:07:51.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.006+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~TKTF1PVGUGNP.0 size=729000 2024-09-12T17:07:51.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.009+0000 7f9eaebff780 1 < completed multipart upload key=9I6RGNRB6HSY upload=TKTF1PVGUGNP tag=WLV6S0GB2DAX type=write size=1777576 2024-09-12T17:07:51.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.011+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~24JD7EERMW81.0 size=1048576 2024-09-12T17:07:51.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.012+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~24JD7EERMW81.1 size=1048576 2024-09-12T17:07:51.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.013+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~24JD7EERMW81.2 size=585147 2024-09-12T17:07:51.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.013+0000 7f9eaebff780 1 > prepared multipart upload key=8DJLYFM11DNI upload=24JD7EERMW81 tag=VSHMW92SKXHU type=write size=3730875 2024-09-12T17:07:51.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.015+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~FAYJXZ4OLA52.0 size=1048576 2024-09-12T17:07:51.017 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.016+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~FAYJXZ4OLA52.1 size=1048576 2024-09-12T17:07:51.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.017+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~FAYJXZ4OLA52.2 size=112043 2024-09-12T17:07:51.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.019+0000 7f9eaebff780 1 < completed multipart upload key=3LY681252WAN upload=FAYJXZ4OLA52 tag=VZ35FHL1S627 type=write size=3257771 2024-09-12T17:07:51.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.021+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~KXE7GPX44RTR.0 size=1048576 2024-09-12T17:07:51.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.022+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~KXE7GPX44RTR.1 size=1048576 2024-09-12T17:07:51.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.023+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~KXE7GPX44RTR.2 size=53732 2024-09-12T17:07:51.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.023+0000 7f9eaebff780 1 > prepared multipart upload key=3LY681252WAN upload=KXE7GPX44RTR tag=XL78RHST9VOH type=write size=3199460 2024-09-12T17:07:51.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.024+0000 7f9eaebff780 1 < completed part key=_multipart_GB8P7K59Y8VI.2~EHIV9S89TPRD.0 size=919111 2024-09-12T17:07:51.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.026+0000 7f9eaebff780 1 < completed multipart upload key=GB8P7K59Y8VI upload=EHIV9S89TPRD tag=934FX4YXACUQ type=write size=1967687 2024-09-12T17:07:51.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.027+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=JQ1LG6TK360J type=del size=3941423 2024-09-12T17:07:51.030 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.029+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~5T1608TV0RYD.0 size=1048576 2024-09-12T17:07:51.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.030+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~5T1608TV0RYD.1 size=4261 2024-09-12T17:07:51.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.032+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=5T1608TV0RYD tag=6WUTKLVQ86QL type=write size=2101413 2024-09-12T17:07:51.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.033+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=9L8EXEEP7RND type=del size=635913 2024-09-12T17:07:51.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.034+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~SQR8EC49BOXC.0 size=686564 2024-09-12T17:07:51.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.036+0000 7f9eaebff780 1 < completed multipart upload key=ZC814TPVLJO1 upload=SQR8EC49BOXC tag=DPEYL13XBG7Z type=write size=1735140 2024-09-12T17:07:51.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.038+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=QFA7TN555TZ3 type=del size=1059106 2024-09-12T17:07:51.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.039+0000 7f9eaebff780 1 < completed delete operation key=ZC814TPVLJO1 tag=SEZWQRT62NAS type=del 2024-09-12T17:07:51.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.040+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=UAHVF7T7CLQT type=del size=1014444 2024-09-12T17:07:51.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.041+0000 7f9eaebff780 1 < canceled part key=_multipart_ZYP3P4031PUZ.2~LCNDBWYKLY30.0 size=958420 2024-09-12T17:07:51.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.043+0000 7f9eaebff780 1 < canceled multipart upload key=ZYP3P4031PUZ upload=LCNDBWYKLY30 tag=HLK52VN7DTX5 type=write size=2006996 2024-09-12T17:07:51.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.044+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=XUHII8R9ZUX2 type=del size=2327130 2024-09-12T17:07:51.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.045+0000 7f9eaebff780 1 < completed delete operation key=OGD6H9VSVGWF tag=TO0XEJCJ3HCK type=del 2024-09-12T17:07:51.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.047+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=R1XOCV0GIVGV type=del size=1558165 2024-09-12T17:07:51.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.048+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~QYL4Z4ZXVN7C.0 size=1048576 2024-09-12T17:07:51.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.049+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~QYL4Z4ZXVN7C.1 size=834781 2024-09-12T17:07:51.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.051+0000 7f9eaebff780 1 < completed multipart upload key=UYF1AN2W59VN upload=QYL4Z4ZXVN7C tag=X83KKCFU72N6 type=write size=2931933 2024-09-12T17:07:51.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.053+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~Q7L8TPS26GKK.0 size=1048576 2024-09-12T17:07:51.056 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.054+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~Q7L8TPS26GKK.1 size=1048576 2024-09-12T17:07:51.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.055+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~Q7L8TPS26GKK.2 size=499661 2024-09-12T17:07:51.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.055+0000 7f9eaebff780 1 > prepared multipart upload key=KF8XE48DI9KZ upload=Q7L8TPS26GKK tag=0MEAZMFAOQ6R type=write size=3645389 2024-09-12T17:07:51.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.057+0000 7f9eaebff780 1 < completed delete operation key=SO6QF2JCRX6E tag=LZGFTJCU0QEH type=del 2024-09-12T17:07:51.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.058+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=EWI2KNX95IYX type=del size=356523 2024-09-12T17:07:51.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.059+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~0NIDI1KSMH73.0 size=1048576 2024-09-12T17:07:51.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.060+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~0NIDI1KSMH73.1 size=507479 2024-09-12T17:07:51.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.062+0000 7f9eaebff780 1 < completed multipart upload key=M3PLQGSK34YM upload=0NIDI1KSMH73 tag=BCNWOGRC4GQO type=write size=2604631 2024-09-12T17:07:51.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.064+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=RAV7C8PD7H2Y type=del size=1048217 2024-09-12T17:07:51.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.067+0000 7f9eaebff780 1 < suggested update operation key=SVWPQETL92QU tag=XVFU4PK3RGDD type=del size=3391886 2024-09-12T17:07:51.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.070+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~DCCB5JLQ3M4J.0 size=1048576 2024-09-12T17:07:51.073 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.071+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~DCCB5JLQ3M4J.1 size=1048576 2024-09-12T17:07:51.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.072+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~DCCB5JLQ3M4J.2 size=819399 2024-09-12T17:07:51.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.072+0000 7f9eaebff780 1 > prepared multipart upload key=KF8XE48DI9KZ upload=DCCB5JLQ3M4J tag=8AW8K4V5JLH3 type=write size=3965127 2024-09-12T17:07:51.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.073+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~RSPKWJM25NU7.0 size=1048576 2024-09-12T17:07:51.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.074+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~RSPKWJM25NU7.1 size=1048576 2024-09-12T17:07:51.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.075+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~RSPKWJM25NU7.2 size=681052 2024-09-12T17:07:51.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.077+0000 7f9eaebff780 1 < completed multipart upload key=3LY681252WAN upload=RSPKWJM25NU7 tag=MDTKMX3ZDKNO type=write size=3826780 2024-09-12T17:07:51.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.078+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=D7EOEKIOD9B4 type=del size=1062051 2024-09-12T17:07:51.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.080+0000 7f9eaebff780 1 < completed delete operation key=9I6RGNRB6HSY tag=GYZI5DRPJPRG type=del 2024-09-12T17:07:51.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.081+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=W6ZM5BIAPQQN type=del size=1886806 2024-09-12T17:07:51.083 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.082+0000 7f9eaebff780 1 < completed delete operation key=LRI5G5G8O5X4 tag=TSVQWSNMBAOD type=del 2024-09-12T17:07:51.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.083+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=3F1IITBF42QU type=write size=124262 2024-09-12T17:07:51.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.085+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=U256Y0ROACZV type=del 2024-09-12T17:07:51.088 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.087+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~B94JFOU509AT.0 size=1048576 2024-09-12T17:07:51.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.088+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~B94JFOU509AT.1 size=49683 2024-09-12T17:07:51.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.088+0000 7f9eaebff780 1 > prepared multipart upload key=CAIZM33SDFPM upload=B94JFOU509AT tag=TKBM00WBQH93 type=write size=2146835 2024-09-12T17:07:51.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.089+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~24JD7EERMW81.0 size=1048576 2024-09-12T17:07:51.091 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.090+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~24JD7EERMW81.1 size=1048576 2024-09-12T17:07:51.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.091+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~24JD7EERMW81.2 size=585147 2024-09-12T17:07:51.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.093+0000 7f9eaebff780 1 < completed multipart upload key=8DJLYFM11DNI upload=24JD7EERMW81 tag=VSHMW92SKXHU type=write size=3730875 2024-09-12T17:07:51.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.094+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=Q8KPDIJ8XKWI type=del size=3726092 2024-09-12T17:07:51.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.096+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~KXE7GPX44RTR.0 size=1048576 2024-09-12T17:07:51.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.096+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~KXE7GPX44RTR.1 size=1048576 2024-09-12T17:07:51.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.098+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~KXE7GPX44RTR.2 size=53732 2024-09-12T17:07:51.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.100+0000 7f9eaebff780 1 < completed multipart upload key=3LY681252WAN upload=KXE7GPX44RTR tag=XL78RHST9VOH type=write size=3199460 2024-09-12T17:07:51.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.101+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=H903YN02XYQ1 type=del size=1963328 2024-09-12T17:07:51.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.102+0000 7f9eaebff780 1 < completed delete operation key=GB8P7K59Y8VI tag=JQ1LG6TK360J type=del 2024-09-12T17:07:51.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.103+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=HZRCOAB4NEYX type=del size=386986 2024-09-12T17:07:51.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.105+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=9L8EXEEP7RND type=del 2024-09-12T17:07:51.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.106+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=COS0SNO8BAIJ type=del size=2055117 2024-09-12T17:07:51.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.107+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=QFA7TN555TZ3 type=del 2024-09-12T17:07:51.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.109+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~D5ZO9U1INWZM.0 size=1048576 2024-09-12T17:07:51.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.110+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~D5ZO9U1INWZM.1 size=1048576 2024-09-12T17:07:51.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.112+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~D5ZO9U1INWZM.2 size=867329 2024-09-12T17:07:51.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.112+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=D5ZO9U1INWZM tag=3MLCIMU7DZZW type=write size=4013057 2024-09-12T17:07:51.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.113+0000 7f9eaebff780 1 < completed delete operation key=9I6RGNRB6HSY tag=UAHVF7T7CLQT type=del 2024-09-12T17:07:51.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.116+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~UIQY1L7Q94VQ.0 size=1048576 2024-09-12T17:07:51.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.117+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~UIQY1L7Q94VQ.1 size=81977 2024-09-12T17:07:51.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.117+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=UIQY1L7Q94VQ tag=ZFG9JCN7VWZB type=write size=2179129 2024-09-12T17:07:51.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.118+0000 7f9eaebff780 1 < completed delete operation key=B1YC6DM9S8JJ tag=XUHII8R9ZUX2 type=del 2024-09-12T17:07:51.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.120+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=7YCDJWGTNJX2 type=del size=4057812 2024-09-12T17:07:51.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.121+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=R1XOCV0GIVGV type=del 2024-09-12T17:07:51.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.123+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~20GLKFQY7MTL.0 size=1048576 2024-09-12T17:07:51.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.124+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~20GLKFQY7MTL.1 size=485365 2024-09-12T17:07:51.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.124+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=20GLKFQY7MTL tag=OG1SENCIV163 type=write size=2582517 2024-09-12T17:07:51.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.126+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~Q7L8TPS26GKK.0 size=1048576 2024-09-12T17:07:51.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.127+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~Q7L8TPS26GKK.1 size=1048576 2024-09-12T17:07:51.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.128+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~Q7L8TPS26GKK.2 size=499661 2024-09-12T17:07:51.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.130+0000 7f9eaebff780 1 < completed multipart upload key=KF8XE48DI9KZ upload=Q7L8TPS26GKK tag=0MEAZMFAOQ6R type=write size=3645389 2024-09-12T17:07:51.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.132+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=ES3YFIU8U6Q3 type=del size=1537643 2024-09-12T17:07:51.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.133+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=EWI2KNX95IYX type=del 2024-09-12T17:07:51.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.136+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~GS9Q7WNXLFDJ.0 size=127940 2024-09-12T17:07:51.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.136+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=GS9Q7WNXLFDJ tag=ZPOHFBOJMBCJ type=write size=1176516 2024-09-12T17:07:51.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.139+0000 7f9eaebff780 1 < suggested remove operation key=LJN514F16XJA tag=RAV7C8PD7H2Y type=del 2024-09-12T17:07:51.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.140+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=2J4FPT5QMZFO type=del size=3264347 2024-09-12T17:07:51.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.141+0000 7f9eaebff780 1 < canceled part key=_multipart_KF8XE48DI9KZ.2~DCCB5JLQ3M4J.0 size=1048576 2024-09-12T17:07:51.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.142+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~DCCB5JLQ3M4J.1 size=1048576 2024-09-12T17:07:51.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.145+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~DCCB5JLQ3M4J.2 size=819399 2024-09-12T17:07:51.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.149+0000 7f9eaebff780 1 < canceled multipart upload key=KF8XE48DI9KZ upload=DCCB5JLQ3M4J tag=8AW8K4V5JLH3 type=write size=3965127 2024-09-12T17:07:51.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.150+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=3OHG1DS9LSIP type=del size=631753 2024-09-12T17:07:51.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.151+0000 7f9eaebff780 1 < completed delete operation key=SO6QF2JCRX6E tag=D7EOEKIOD9B4 type=del 2024-09-12T17:07:51.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.152+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=YC090VFRL3AJ type=del size=1349216 2024-09-12T17:07:51.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.154+0000 7f9eaebff780 1 < completed delete operation key=SHWT6AT7PN0M tag=W6ZM5BIAPQQN type=del 2024-09-12T17:07:51.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.156+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~LCZIJARI0RFQ.0 size=1048576 2024-09-12T17:07:51.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.157+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~LCZIJARI0RFQ.1 size=622552 2024-09-12T17:07:51.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.157+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=LCZIJARI0RFQ tag=8I5PMD8JLANB type=write size=2719704 2024-09-12T17:07:51.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.158+0000 7f9eaebff780 1 < completed write operation key=B1YC6DM9S8JJ tag=3F1IITBF42QU type=write size=124262 2024-09-12T17:07:51.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.160+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~HWESGLOZENY5.0 size=957557 2024-09-12T17:07:51.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.160+0000 7f9eaebff780 1 > prepared multipart upload key=0F5LXJZMBFSP upload=HWESGLOZENY5 tag=4NSKUM5G9U2H type=write size=2006133 2024-09-12T17:07:51.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.160+0000 7f9eaebff780 1 < canceled part key=_multipart_CAIZM33SDFPM.2~B94JFOU509AT.0 size=1048576 2024-09-12T17:07:51.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.162+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~B94JFOU509AT.1 size=49683 2024-09-12T17:07:51.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.164+0000 7f9eaebff780 1 < canceled multipart upload key=CAIZM33SDFPM upload=B94JFOU509AT tag=TKBM00WBQH93 type=write size=2146835 2024-09-12T17:07:51.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.165+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=56N54QMX08XY type=del size=2930181 2024-09-12T17:07:51.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.166+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=Q8KPDIJ8XKWI type=del 2024-09-12T17:07:51.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.167+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=1M4CJPKA3E0E type=del size=3184334 2024-09-12T17:07:51.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.168+0000 7f9eaebff780 1 < canceled operation key=EKUW5AKC428U tag=H903YN02XYQ1 type=del size=1963328 2024-09-12T17:07:51.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.170+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=AZ1F8SXJGXVX type=del size=3442708 2024-09-12T17:07:51.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.171+0000 7f9eaebff780 1 < completed delete operation key=0YD5P1ACZ09Q tag=HZRCOAB4NEYX type=del 2024-09-12T17:07:51.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.172+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=JA71W6IRRVQO type=del size=3055708 2024-09-12T17:07:51.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.173+0000 7f9eaebff780 1 < completed delete operation key=SO6QF2JCRX6E tag=COS0SNO8BAIJ type=del 2024-09-12T17:07:51.176 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.175+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=HOAO1JSG232M type=del size=2342686 2024-09-12T17:07:51.176 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.175+0000 7f9eaebff780 1 < canceled part key=_multipart_OH6GXTMPBYUY.2~D5ZO9U1INWZM.0 size=1048576 2024-09-12T17:07:51.177 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.176+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~D5ZO9U1INWZM.1 size=1048576 2024-09-12T17:07:51.178 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.177+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~D5ZO9U1INWZM.2 size=867329 2024-09-12T17:07:51.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.179+0000 7f9eaebff780 1 < canceled multipart upload key=OH6GXTMPBYUY upload=D5ZO9U1INWZM tag=3MLCIMU7DZZW type=write size=4013057 2024-09-12T17:07:51.182 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.181+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~8T8AOKLK0PRK.0 size=1048576 2024-09-12T17:07:51.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.182+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~8T8AOKLK0PRK.1 size=1048576 2024-09-12T17:07:51.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.183+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~8T8AOKLK0PRK.2 size=25802 2024-09-12T17:07:51.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.183+0000 7f9eaebff780 1 > prepared multipart upload key=0F5LXJZMBFSP upload=8T8AOKLK0PRK tag=KXN2DT3IK2HD type=write size=3171530 2024-09-12T17:07:51.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.184+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~UIQY1L7Q94VQ.0 size=1048576 2024-09-12T17:07:51.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.186+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~UIQY1L7Q94VQ.1 size=81977 2024-09-12T17:07:51.192 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.191+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=UIQY1L7Q94VQ tag=ZFG9JCN7VWZB type=write size=2179129 2024-09-12T17:07:51.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.192+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=ZELO8P3M5K4T type=del size=53113 2024-09-12T17:07:51.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.193+0000 7f9eaebff780 1 < completed delete operation key=B1YC6DM9S8JJ tag=7YCDJWGTNJX2 type=del 2024-09-12T17:07:51.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.195+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~B7RJJBWL6YPO.0 size=481637 2024-09-12T17:07:51.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.195+0000 7f9eaebff780 1 > prepared multipart upload key=GB8P7K59Y8VI upload=B7RJJBWL6YPO tag=EMDCSZE3KV0I type=write size=1530213 2024-09-12T17:07:51.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.196+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~20GLKFQY7MTL.0 size=1048576 2024-09-12T17:07:51.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.196+0000 7f9eaebff780 1 < canceled part key=_multipart_K2NHRSUDQBRW.2~20GLKFQY7MTL.1 size=485365 2024-09-12T17:07:51.200 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.199+0000 7f9eaebff780 1 < canceled multipart upload key=K2NHRSUDQBRW upload=20GLKFQY7MTL tag=OG1SENCIV163 type=write size=2582517 2024-09-12T17:07:51.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.200+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=QQGBN9Z895VS type=del size=3285966 2024-09-12T17:07:51.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.201+0000 7f9eaebff780 1 < completed delete operation key=SVWPQETL92QU tag=ES3YFIU8U6Q3 type=del 2024-09-12T17:07:51.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.202+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=VKLRCOG3YF1J type=del size=3391966 2024-09-12T17:07:51.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.203+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~GS9Q7WNXLFDJ.0 size=127940 2024-09-12T17:07:51.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.205+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=GS9Q7WNXLFDJ tag=ZPOHFBOJMBCJ type=write size=1176516 2024-09-12T17:07:51.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.207+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=F0K5BO42XEN7 type=del size=2226062 2024-09-12T17:07:51.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.208+0000 7f9eaebff780 1 < completed delete operation key=SVWPQETL92QU tag=2J4FPT5QMZFO type=del 2024-09-12T17:07:51.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.209+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=TZ61028RLPBA type=del size=2131759 2024-09-12T17:07:51.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.210+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=3OHG1DS9LSIP type=del 2024-09-12T17:07:51.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.211+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=THWK1NJX7UG3 type=del size=1420512 2024-09-12T17:07:51.214 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.213+0000 7f9eaebff780 1 < canceled operation key=SVWPQETL92QU tag=YC090VFRL3AJ type=del size=1349216 2024-09-12T17:07:51.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.215+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~QVTQNO5BMUQY.0 size=1048576 2024-09-12T17:07:51.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.215+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~QVTQNO5BMUQY.1 size=1048576 2024-09-12T17:07:51.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.216+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~QVTQNO5BMUQY.2 size=891262 2024-09-12T17:07:51.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.216+0000 7f9eaebff780 1 > prepared multipart upload key=OGD6H9VSVGWF upload=QVTQNO5BMUQY tag=WTQXJMTBEOSS type=write size=4036990 2024-09-12T17:07:51.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.217+0000 7f9eaebff780 1 < canceled part key=_multipart_SHWT6AT7PN0M.2~LCZIJARI0RFQ.0 size=1048576 2024-09-12T17:07:51.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.218+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~LCZIJARI0RFQ.1 size=622552 2024-09-12T17:07:51.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.220+0000 7f9eaebff780 1 < canceled multipart upload key=SHWT6AT7PN0M upload=LCZIJARI0RFQ tag=8I5PMD8JLANB type=write size=2719704 2024-09-12T17:07:51.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.221+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=AJGXKN3C9CI7 type=del size=2865051 2024-09-12T17:07:51.224 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.222+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~HWESGLOZENY5.0 size=957557 2024-09-12T17:07:51.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.224+0000 7f9eaebff780 1 < completed multipart upload key=0F5LXJZMBFSP upload=HWESGLOZENY5 tag=4NSKUM5G9U2H type=write size=2006133 2024-09-12T17:07:51.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.226+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=1VJY7VO0RXYJ type=del size=2312958 2024-09-12T17:07:51.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.228+0000 7f9eaebff780 1 < suggested update operation key=SO6QF2JCRX6E tag=56N54QMX08XY type=del size=2930181 2024-09-12T17:07:51.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.229+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=B1S8JHUFCSMJ type=write size=107352 2024-09-12T17:07:51.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.231+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=1M4CJPKA3E0E type=del 2024-09-12T17:07:51.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.232+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=HMZ4BLZT2PKY type=del size=1171888 2024-09-12T17:07:51.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.233+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=AZ1F8SXJGXVX type=del 2024-09-12T17:07:51.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.234+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=5AQKNNKV9L7J type=write size=804718 2024-09-12T17:07:51.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.237+0000 7f9eaebff780 1 < suggested remove operation key=QIMNK4DL3D0N tag=JA71W6IRRVQO type=del 2024-09-12T17:07:51.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.239+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~F3GLI663YGJU.0 size=523842 2024-09-12T17:07:51.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.239+0000 7f9eaebff780 1 > prepared multipart upload key=ZYP3P4031PUZ upload=F3GLI663YGJU tag=VSL8A3LQ93XY type=write size=1572418 2024-09-12T17:07:51.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.240+0000 7f9eaebff780 1 < completed delete operation key=OH6GXTMPBYUY tag=HOAO1JSG232M type=del 2024-09-12T17:07:51.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.241+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=WP8YWIK0ST1P type=del size=1440860 2024-09-12T17:07:51.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.242+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~8T8AOKLK0PRK.0 size=1048576 2024-09-12T17:07:51.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.243+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~8T8AOKLK0PRK.1 size=1048576 2024-09-12T17:07:51.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.244+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~8T8AOKLK0PRK.2 size=25802 2024-09-12T17:07:51.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.246+0000 7f9eaebff780 1 < completed multipart upload key=0F5LXJZMBFSP upload=8T8AOKLK0PRK tag=KXN2DT3IK2HD type=write size=3171530 2024-09-12T17:07:51.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.247+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=CLGJWTIQSZX4 type=del size=3608462 2024-09-12T17:07:51.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.249+0000 7f9eaebff780 1 < suggested remove operation key=K2NHRSUDQBRW tag=ZELO8P3M5K4T type=del 2024-09-12T17:07:51.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.251+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=4GEK8QQ2I4ZV type=write size=942315 2024-09-12T17:07:51.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.252+0000 7f9eaebff780 1 < completed part key=_multipart_GB8P7K59Y8VI.2~B7RJJBWL6YPO.0 size=481637 2024-09-12T17:07:51.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.254+0000 7f9eaebff780 1 < completed multipart upload key=GB8P7K59Y8VI upload=B7RJJBWL6YPO tag=EMDCSZE3KV0I type=write size=1530213 2024-09-12T17:07:51.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.257+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~2GEZ3FL6MQIK.0 size=432913 2024-09-12T17:07:51.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.257+0000 7f9eaebff780 1 > prepared multipart upload key=9I6RGNRB6HSY upload=2GEZ3FL6MQIK tag=E3SKZ5268L0Q type=write size=1481489 2024-09-12T17:07:51.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.258+0000 7f9eaebff780 1 < completed delete operation key=ZYP3P4031PUZ tag=QQGBN9Z895VS type=del 2024-09-12T17:07:51.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.259+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=19PRF65VNUFJ type=del size=1582382 2024-09-12T17:07:51.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.260+0000 7f9eaebff780 1 < completed delete operation key=YIEP2JYDSLW0 tag=VKLRCOG3YF1J type=del 2024-09-12T17:07:51.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.261+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=TJH2HRR2QYUM type=del size=1140524 2024-09-12T17:07:51.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.263+0000 7f9eaebff780 1 < suggested remove operation key=SVWPQETL92QU tag=F0K5BO42XEN7 type=del 2024-09-12T17:07:51.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.266+0000 7f9eaebff780 1 > prepared part key=_multipart_TXHXOMIB4B53.2~QIHJHIT49CXQ.0 size=1048576 2024-09-12T17:07:51.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.267+0000 7f9eaebff780 1 > prepared part key=_multipart_TXHXOMIB4B53.2~QIHJHIT49CXQ.1 size=1048576 2024-09-12T17:07:51.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.268+0000 7f9eaebff780 1 > prepared part key=_multipart_TXHXOMIB4B53.2~QIHJHIT49CXQ.2 size=176162 2024-09-12T17:07:51.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.268+0000 7f9eaebff780 1 > prepared multipart upload key=TXHXOMIB4B53 upload=QIHJHIT49CXQ tag=URXX6PE4RNZO type=write size=3321890 2024-09-12T17:07:51.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.270+0000 7f9eaebff780 1 < suggested update operation key=9I6RGNRB6HSY tag=TZ61028RLPBA type=del size=2131759 2024-09-12T17:07:51.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.271+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=V9PBRALTC9V2 type=write size=290944 2024-09-12T17:07:51.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.272+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=THWK1NJX7UG3 type=del 2024-09-12T17:07:51.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.273+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=P4Z69WLK3KME type=del size=4047907 2024-09-12T17:07:51.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.274+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~QVTQNO5BMUQY.0 size=1048576 2024-09-12T17:07:51.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.275+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~QVTQNO5BMUQY.1 size=1048576 2024-09-12T17:07:51.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.276+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~QVTQNO5BMUQY.2 size=891262 2024-09-12T17:07:51.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.278+0000 7f9eaebff780 1 < completed multipart upload key=OGD6H9VSVGWF upload=QVTQNO5BMUQY tag=WTQXJMTBEOSS type=write size=4036990 2024-09-12T17:07:51.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.280+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=W81FRM9TD427 type=del size=1477443 2024-09-12T17:07:51.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.281+0000 7f9eaebff780 1 < completed delete operation key=SHWT6AT7PN0M tag=AJGXKN3C9CI7 type=del 2024-09-12T17:07:51.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.283+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~HFRCYSLJRMYE.0 size=1048576 2024-09-12T17:07:51.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.284+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~HFRCYSLJRMYE.1 size=1048576 2024-09-12T17:07:51.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.285+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~HFRCYSLJRMYE.2 size=248552 2024-09-12T17:07:51.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.285+0000 7f9eaebff780 1 > prepared multipart upload key=7PBT9VZ07OUI upload=HFRCYSLJRMYE tag=4R6NTO8FGIX2 type=write size=3394280 2024-09-12T17:07:51.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.286+0000 7f9eaebff780 1 < completed delete operation key=K0P9ZZ91UJJ8 tag=1VJY7VO0RXYJ type=del 2024-09-12T17:07:51.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.288+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~S2888GSFPEPN.0 size=1048576 2024-09-12T17:07:51.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.289+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~S2888GSFPEPN.1 size=1048576 2024-09-12T17:07:51.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.290+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~S2888GSFPEPN.2 size=910367 2024-09-12T17:07:51.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.290+0000 7f9eaebff780 1 > prepared multipart upload key=ZC814TPVLJO1 upload=S2888GSFPEPN tag=UA0V20QMC0VB type=write size=4056095 2024-09-12T17:07:51.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.292+0000 7f9eaebff780 -1 < failed to complete operation key=SVWPQETL92QU tag=B1S8JHUFCSMJ type=write size=107352: (22) Invalid argument 2024-09-12T17:07:51.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.293+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=0HIVN9BFICJO type=write size=711795 2024-09-12T17:07:51.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.294+0000 7f9eaebff780 1 < completed delete operation key=0YD5P1ACZ09Q tag=HMZ4BLZT2PKY type=del 2024-09-12T17:07:51.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.297+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~522KKZ7DY24B.0 size=1048576 2024-09-12T17:07:51.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.298+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~522KKZ7DY24B.1 size=19686 2024-09-12T17:07:51.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.298+0000 7f9eaebff780 1 > prepared multipart upload key=ZYP3P4031PUZ upload=522KKZ7DY24B tag=7LERV9TZ8V38 type=write size=2116838 2024-09-12T17:07:51.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.299+0000 7f9eaebff780 1 < completed write operation key=UYF1AN2W59VN tag=5AQKNNKV9L7J type=write size=804718 2024-09-12T17:07:51.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.301+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=L0XCG4EH0AU1 type=del size=2947433 2024-09-12T17:07:51.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.302+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~F3GLI663YGJU.0 size=523842 2024-09-12T17:07:51.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.305+0000 7f9eaebff780 1 < completed multipart upload key=ZYP3P4031PUZ upload=F3GLI663YGJU tag=VSL8A3LQ93XY type=write size=1572418 2024-09-12T17:07:51.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.308+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~BZN2MYD5F48B.0 size=1048576 2024-09-12T17:07:51.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.309+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~BZN2MYD5F48B.1 size=1048576 2024-09-12T17:07:51.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.310+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~BZN2MYD5F48B.2 size=633126 2024-09-12T17:07:51.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.310+0000 7f9eaebff780 1 > prepared multipart upload key=ZC814TPVLJO1 upload=BZN2MYD5F48B tag=IJVOYLOCW0YG type=write size=3778854 2024-09-12T17:07:51.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.311+0000 7f9eaebff780 1 < completed delete operation key=M3PLQGSK34YM tag=WP8YWIK0ST1P type=del 2024-09-12T17:07:51.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.313+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=COC15B3FCSWR type=del size=1554930 2024-09-12T17:07:51.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.314+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=CLGJWTIQSZX4 type=del 2024-09-12T17:07:51.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.315+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=2ZRD67H8BDO3 type=del size=458322 2024-09-12T17:07:51.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.316+0000 7f9eaebff780 1 < completed write operation key=UYF1AN2W59VN tag=4GEK8QQ2I4ZV type=write size=942315 2024-09-12T17:07:51.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.318+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=CIQTPKJ80R2X type=del size=2504543 2024-09-12T17:07:51.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.319+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~2GEZ3FL6MQIK.0 size=432913 2024-09-12T17:07:51.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.321+0000 7f9eaebff780 1 < completed multipart upload key=9I6RGNRB6HSY upload=2GEZ3FL6MQIK tag=E3SKZ5268L0Q type=write size=1481489 2024-09-12T17:07:51.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.322+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=JN2GVQRNVOHS type=del size=2621759 2024-09-12T17:07:51.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.325+0000 7f9eaebff780 1 < suggested update operation key=OGD6H9VSVGWF tag=19PRF65VNUFJ type=del size=1582382 2024-09-12T17:07:51.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.326+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=WPCZDLR4KRPZ type=write size=881118 2024-09-12T17:07:51.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.327+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=TJH2HRR2QYUM type=del 2024-09-12T17:07:51.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.329+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=O5S9M8AZUGUH type=del size=3602066 2024-09-12T17:07:51.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.330+0000 7f9eaebff780 1 < completed part key=_multipart_TXHXOMIB4B53.2~QIHJHIT49CXQ.0 size=1048576 2024-09-12T17:07:51.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.331+0000 7f9eaebff780 1 < completed part key=_multipart_TXHXOMIB4B53.2~QIHJHIT49CXQ.1 size=1048576 2024-09-12T17:07:51.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.332+0000 7f9eaebff780 1 < completed part key=_multipart_TXHXOMIB4B53.2~QIHJHIT49CXQ.2 size=176162 2024-09-12T17:07:51.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.334+0000 7f9eaebff780 1 < completed multipart upload key=TXHXOMIB4B53 upload=QIHJHIT49CXQ tag=URXX6PE4RNZO type=write size=3321890 2024-09-12T17:07:51.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.336+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~RAR0MPLHA7WA.0 size=1048576 2024-09-12T17:07:51.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.337+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~RAR0MPLHA7WA.1 size=546132 2024-09-12T17:07:51.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.337+0000 7f9eaebff780 1 > prepared multipart upload key=9WJGBODZ60NJ upload=RAR0MPLHA7WA tag=Z8EPJAMEEZ1S type=write size=2643284 2024-09-12T17:07:51.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.339+0000 7f9eaebff780 1 < suggested remove operation key=OH6GXTMPBYUY tag=V9PBRALTC9V2 type=write 2024-09-12T17:07:51.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.341+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=886E6G2VWS8T type=write size=711998 2024-09-12T17:07:51.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.342+0000 7f9eaebff780 1 < completed delete operation key=P9GMGM3WK6O7 tag=P4Z69WLK3KME type=del 2024-09-12T17:07:51.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.344+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=NTFQGNTQEG5O type=del size=1881714 2024-09-12T17:07:51.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.345+0000 7f9eaebff780 1 < completed delete operation key=LJN514F16XJA tag=W81FRM9TD427 type=del 2024-09-12T17:07:51.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.346+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=NFC9LMAFULBR type=del size=3832605 2024-09-12T17:07:51.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.348+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~HFRCYSLJRMYE.0 size=1048576 2024-09-12T17:07:51.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.349+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~HFRCYSLJRMYE.1 size=1048576 2024-09-12T17:07:51.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.350+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~HFRCYSLJRMYE.2 size=248552 2024-09-12T17:07:51.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.353+0000 7f9eaebff780 1 < completed multipart upload key=7PBT9VZ07OUI upload=HFRCYSLJRMYE tag=4R6NTO8FGIX2 type=write size=3394280 2024-09-12T17:07:51.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.354+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=OI6G593NEZR7 type=del size=1478136 2024-09-12T17:07:51.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.356+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~S2888GSFPEPN.0 size=1048576 2024-09-12T17:07:51.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.357+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~S2888GSFPEPN.1 size=1048576 2024-09-12T17:07:51.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.358+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~S2888GSFPEPN.2 size=910367 2024-09-12T17:07:51.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.360+0000 7f9eaebff780 1 < completed multipart upload key=ZC814TPVLJO1 upload=S2888GSFPEPN tag=UA0V20QMC0VB type=write size=4056095 2024-09-12T17:07:51.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.362+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=XR58WK70WS8S type=del size=1164119 2024-09-12T17:07:51.364 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.363+0000 7f9eaebff780 1 < completed write operation key=ZYP3P4031PUZ tag=0HIVN9BFICJO type=write size=711795 2024-09-12T17:07:51.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.365+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~SMQI3ZFMJUHF.0 size=1048576 2024-09-12T17:07:51.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.366+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~SMQI3ZFMJUHF.1 size=1048576 2024-09-12T17:07:51.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.367+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~SMQI3ZFMJUHF.2 size=215732 2024-09-12T17:07:51.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.367+0000 7f9eaebff780 1 > prepared multipart upload key=TDZCNUZE8IOA upload=SMQI3ZFMJUHF tag=KJ58SRG5575I type=write size=3361460 2024-09-12T17:07:51.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.368+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~522KKZ7DY24B.0 size=1048576 2024-09-12T17:07:51.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.369+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~522KKZ7DY24B.1 size=19686 2024-09-12T17:07:51.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.371+0000 7f9eaebff780 1 < completed multipart upload key=ZYP3P4031PUZ upload=522KKZ7DY24B tag=7LERV9TZ8V38 type=write size=2116838 2024-09-12T17:07:51.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.373+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=YSDZ9RKNQJVW type=del size=1725560 2024-09-12T17:07:51.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.374+0000 7f9eaebff780 1 < completed delete operation key=TDZCNUZE8IOA tag=L0XCG4EH0AU1 type=del 2024-09-12T17:07:51.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.376+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~Y08WHIXOGBOQ.0 size=1048576 2024-09-12T17:07:51.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.377+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~Y08WHIXOGBOQ.1 size=1048576 2024-09-12T17:07:51.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.378+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~Y08WHIXOGBOQ.2 size=789796 2024-09-12T17:07:51.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.378+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=Y08WHIXOGBOQ tag=RV9XBX9U4SW7 type=write size=3935524 2024-09-12T17:07:51.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.379+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~BZN2MYD5F48B.0 size=1048576 2024-09-12T17:07:51.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.380+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~BZN2MYD5F48B.1 size=1048576 2024-09-12T17:07:51.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.381+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~BZN2MYD5F48B.2 size=633126 2024-09-12T17:07:51.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.383+0000 7f9eaebff780 1 < completed multipart upload key=ZC814TPVLJO1 upload=BZN2MYD5F48B tag=IJVOYLOCW0YG type=write size=3778854 2024-09-12T17:07:51.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.384+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=8F8WK5X7D4Q7 type=write size=589938 2024-09-12T17:07:51.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.386+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=COC15B3FCSWR type=del 2024-09-12T17:07:51.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.387+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=N6E0LEPELNM0 type=write size=17067 2024-09-12T17:07:51.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.389+0000 7f9eaebff780 1 < suggested remove operation key=KF8XE48DI9KZ tag=2ZRD67H8BDO3 type=del 2024-09-12T17:07:51.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.392+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~NUR3NPQ500DP.0 size=733653 2024-09-12T17:07:51.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.392+0000 7f9eaebff780 1 > prepared multipart upload key=3LY681252WAN upload=NUR3NPQ500DP tag=692EXO693F8J type=write size=1782229 2024-09-12T17:07:51.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.393+0000 7f9eaebff780 -1 < failed to complete operation key=KF8XE48DI9KZ tag=CIQTPKJ80R2X type=del size=2504543: (22) Invalid argument 2024-09-12T17:07:51.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.394+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=1V6E3RPMIQN0 type=del size=3657056 2024-09-12T17:07:51.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.395+0000 7f9eaebff780 1 < completed delete operation key=8DJLYFM11DNI tag=JN2GVQRNVOHS type=del 2024-09-12T17:07:51.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.397+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~NFPHRQLP1CF2.0 size=1048576 2024-09-12T17:07:51.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.399+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~NFPHRQLP1CF2.1 size=172953 2024-09-12T17:07:51.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.399+0000 7f9eaebff780 1 > prepared multipart upload key=3VY271ZBO754 upload=NFPHRQLP1CF2 tag=GU8YMNOLLY3X type=write size=2270105 2024-09-12T17:07:51.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.400+0000 7f9eaebff780 1 < completed write operation key=P9GMGM3WK6O7 tag=WPCZDLR4KRPZ type=write size=881118 2024-09-12T17:07:51.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.401+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=B8VS16S7HRVD type=del size=1457640 2024-09-12T17:07:51.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.402+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=O5S9M8AZUGUH type=del 2024-09-12T17:07:51.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.403+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=GPZ1I6Q80XX4 type=del size=264150 2024-09-12T17:07:51.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.405+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~RAR0MPLHA7WA.0 size=1048576 2024-09-12T17:07:51.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.406+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~RAR0MPLHA7WA.1 size=546132 2024-09-12T17:07:51.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.408+0000 7f9eaebff780 1 < completed multipart upload key=9WJGBODZ60NJ upload=RAR0MPLHA7WA tag=Z8EPJAMEEZ1S type=write size=2643284 2024-09-12T17:07:51.411 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.410+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~TT4U5QPYQSPC.0 size=520761 2024-09-12T17:07:51.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.410+0000 7f9eaebff780 1 > prepared multipart upload key=OGD6H9VSVGWF upload=TT4U5QPYQSPC tag=PC4GAT6HUT8C type=write size=1569337 2024-09-12T17:07:51.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.413+0000 7f9eaebff780 1 < suggested remove operation key=GB8P7K59Y8VI tag=886E6G2VWS8T type=write 2024-09-12T17:07:51.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.415+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~66P5KXW97HR0.0 size=1048576 2024-09-12T17:07:51.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.416+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~66P5KXW97HR0.1 size=1048576 2024-09-12T17:07:51.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.417+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~66P5KXW97HR0.2 size=280097 2024-09-12T17:07:51.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.417+0000 7f9eaebff780 1 > prepared multipart upload key=0F5LXJZMBFSP upload=66P5KXW97HR0 tag=NMATEK0M3U8X type=write size=3425825 2024-09-12T17:07:51.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.419+0000 7f9eaebff780 1 < completed delete operation key=M3PLQGSK34YM tag=NTFQGNTQEG5O type=del 2024-09-12T17:07:51.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.421+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~ARQ5PYQW8C5Z.0 size=1048576 2024-09-12T17:07:51.424 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.423+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~ARQ5PYQW8C5Z.1 size=1048576 2024-09-12T17:07:51.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.424+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~ARQ5PYQW8C5Z.2 size=485823 2024-09-12T17:07:51.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.424+0000 7f9eaebff780 1 > prepared multipart upload key=3LY681252WAN upload=ARQ5PYQW8C5Z tag=O23RYG9SUV20 type=write size=3631551 2024-09-12T17:07:51.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.425+0000 7f9eaebff780 1 < completed delete operation key=M3PLQGSK34YM tag=NFC9LMAFULBR type=del 2024-09-12T17:07:51.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.427+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~XXPGY5EWD37I.0 size=1048576 2024-09-12T17:07:51.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.428+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~XXPGY5EWD37I.1 size=1048576 2024-09-12T17:07:51.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.429+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~XXPGY5EWD37I.2 size=685711 2024-09-12T17:07:51.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.429+0000 7f9eaebff780 1 > prepared multipart upload key=EKUW5AKC428U upload=XXPGY5EWD37I tag=QQI4FHE1OLNB type=write size=3831439 2024-09-12T17:07:51.432 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.430+0000 7f9eaebff780 1 < completed delete operation key=TDZCNUZE8IOA tag=OI6G593NEZR7 type=del 2024-09-12T17:07:51.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.432+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=CD7KEW48TVMR type=del size=2202255 2024-09-12T17:07:51.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.433+0000 7f9eaebff780 1 < completed delete operation key=TDZCNUZE8IOA tag=XR58WK70WS8S type=del 2024-09-12T17:07:51.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.434+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=T981WM69HYGY type=del size=3714599 2024-09-12T17:07:51.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.435+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~SMQI3ZFMJUHF.0 size=1048576 2024-09-12T17:07:51.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.436+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~SMQI3ZFMJUHF.1 size=1048576 2024-09-12T17:07:51.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.437+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~SMQI3ZFMJUHF.2 size=215732 2024-09-12T17:07:51.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.439+0000 7f9eaebff780 1 < completed multipart upload key=TDZCNUZE8IOA upload=SMQI3ZFMJUHF tag=KJ58SRG5575I type=write size=3361460 2024-09-12T17:07:51.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.440+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=3MYJMZPP575C type=del size=3002983 2024-09-12T17:07:51.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.442+0000 7f9eaebff780 1 < completed delete operation key=LRI5G5G8O5X4 tag=YSDZ9RKNQJVW type=del 2024-09-12T17:07:51.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.443+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=OM3NE4XS6JAU type=write size=102932 2024-09-12T17:07:51.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.445+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~Y08WHIXOGBOQ.0 size=1048576 2024-09-12T17:07:51.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.446+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~Y08WHIXOGBOQ.1 size=1048576 2024-09-12T17:07:51.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.447+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~Y08WHIXOGBOQ.2 size=789796 2024-09-12T17:07:51.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.449+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=Y08WHIXOGBOQ tag=RV9XBX9U4SW7 type=write size=3935524 2024-09-12T17:07:51.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.452+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~ZIS85T261Q6Z.0 size=1048576 2024-09-12T17:07:51.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.453+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~ZIS85T261Q6Z.1 size=363182 2024-09-12T17:07:51.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.453+0000 7f9eaebff780 1 > prepared multipart upload key=OGD6H9VSVGWF upload=ZIS85T261Q6Z tag=PHWB3LOFE9V9 type=write size=2460334 2024-09-12T17:07:51.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.454+0000 7f9eaebff780 1 < completed write operation key=9I6RGNRB6HSY tag=8F8WK5X7D4Q7 type=write size=589938 2024-09-12T17:07:51.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.455+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=CXNUAACUOV3L type=del size=2839138 2024-09-12T17:07:51.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.457+0000 7f9eaebff780 1 < completed write operation key=ZC814TPVLJO1 tag=N6E0LEPELNM0 type=write size=17067 2024-09-12T17:07:51.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.458+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=7KEUPBZI1D08 type=write size=537762 2024-09-12T17:07:51.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.459+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~NUR3NPQ500DP.0 size=733653 2024-09-12T17:07:51.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.461+0000 7f9eaebff780 1 < completed multipart upload key=3LY681252WAN upload=NUR3NPQ500DP tag=692EXO693F8J type=write size=1782229 2024-09-12T17:07:51.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.463+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~LCZTPIQHUDHW.0 size=1048576 2024-09-12T17:07:51.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.464+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~LCZTPIQHUDHW.1 size=832788 2024-09-12T17:07:51.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.464+0000 7f9eaebff780 1 > prepared multipart upload key=GB8P7K59Y8VI upload=LCZTPIQHUDHW tag=84LNV5N85K59 type=write size=2929940 2024-09-12T17:07:51.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.465+0000 7f9eaebff780 1 < completed delete operation key=0F5LXJZMBFSP tag=1V6E3RPMIQN0 type=del 2024-09-12T17:07:51.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.467+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=OMBS5OQLCSTX type=del size=857559 2024-09-12T17:07:51.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.468+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~NFPHRQLP1CF2.0 size=1048576 2024-09-12T17:07:51.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.469+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~NFPHRQLP1CF2.1 size=172953 2024-09-12T17:07:51.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.470+0000 7f9eaebff780 1 < completed multipart upload key=3VY271ZBO754 upload=NFPHRQLP1CF2 tag=GU8YMNOLLY3X type=write size=2270105 2024-09-12T17:07:51.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.473+0000 7f9eaebff780 1 > prepared part key=_multipart_TXHXOMIB4B53.2~WAKBDRDUW5D8.0 size=594239 2024-09-12T17:07:51.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.473+0000 7f9eaebff780 1 > prepared multipart upload key=TXHXOMIB4B53 upload=WAKBDRDUW5D8 tag=8YS2VXSXAM74 type=write size=1642815 2024-09-12T17:07:51.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.474+0000 7f9eaebff780 1 < canceled operation key=SHWT6AT7PN0M tag=B8VS16S7HRVD type=del size=1457640 2024-09-12T17:07:51.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.476+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~T9F5LWJZI9WM.0 size=1048576 2024-09-12T17:07:51.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.477+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~T9F5LWJZI9WM.1 size=128218 2024-09-12T17:07:51.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.477+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=T9F5LWJZI9WM tag=H1R11KP2OV59 type=write size=2225370 2024-09-12T17:07:51.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.478+0000 7f9eaebff780 1 < completed delete operation key=M3PLQGSK34YM tag=GPZ1I6Q80XX4 type=del 2024-09-12T17:07:51.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.480+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~ZO5FA5REWC17.0 size=756207 2024-09-12T17:07:51.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.480+0000 7f9eaebff780 1 > prepared multipart upload key=LJN514F16XJA upload=ZO5FA5REWC17 tag=YN9QSYA8OF0B type=write size=1804783 2024-09-12T17:07:51.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.482+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~TT4U5QPYQSPC.0 size=520761 2024-09-12T17:07:51.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.483+0000 7f9eaebff780 1 < completed multipart upload key=OGD6H9VSVGWF upload=TT4U5QPYQSPC tag=PC4GAT6HUT8C type=write size=1569337 2024-09-12T17:07:51.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.484+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=20M7PTO3UAZ1 type=write size=638907 2024-09-12T17:07:51.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.486+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~66P5KXW97HR0.0 size=1048576 2024-09-12T17:07:51.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.487+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~66P5KXW97HR0.1 size=1048576 2024-09-12T17:07:51.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.488+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~66P5KXW97HR0.2 size=280097 2024-09-12T17:07:51.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.490+0000 7f9eaebff780 1 < completed multipart upload key=0F5LXJZMBFSP upload=66P5KXW97HR0 tag=NMATEK0M3U8X type=write size=3425825 2024-09-12T17:07:51.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.492+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~HSU1AHDNKINW.0 size=1048576 2024-09-12T17:07:51.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.493+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~HSU1AHDNKINW.1 size=1048576 2024-09-12T17:07:51.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.494+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~HSU1AHDNKINW.2 size=841470 2024-09-12T17:07:51.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.494+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=HSU1AHDNKINW tag=VPEPF9K6BSLV type=write size=3987198 2024-09-12T17:07:51.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.495+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~ARQ5PYQW8C5Z.0 size=1048576 2024-09-12T17:07:51.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.496+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~ARQ5PYQW8C5Z.1 size=1048576 2024-09-12T17:07:51.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.496+0000 7f9eaebff780 1 < canceled part key=_multipart_3LY681252WAN.2~ARQ5PYQW8C5Z.2 size=485823 2024-09-12T17:07:51.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.498+0000 7f9eaebff780 1 < canceled multipart upload key=3LY681252WAN upload=ARQ5PYQW8C5Z tag=O23RYG9SUV20 type=write size=3631551 2024-09-12T17:07:51.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.500+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~5GKMC8LDUG26.0 size=1048576 2024-09-12T17:07:51.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.501+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~5GKMC8LDUG26.1 size=1048576 2024-09-12T17:07:51.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.502+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~5GKMC8LDUG26.2 size=469483 2024-09-12T17:07:51.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.502+0000 7f9eaebff780 1 > prepared multipart upload key=3VY271ZBO754 upload=5GKMC8LDUG26 tag=1XATTXA1LBSW type=write size=3615211 2024-09-12T17:07:51.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.503+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~XXPGY5EWD37I.0 size=1048576 2024-09-12T17:07:51.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.504+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~XXPGY5EWD37I.1 size=1048576 2024-09-12T17:07:51.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.505+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~XXPGY5EWD37I.2 size=685711 2024-09-12T17:07:51.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.507+0000 7f9eaebff780 1 < completed multipart upload key=EKUW5AKC428U upload=XXPGY5EWD37I tag=QQI4FHE1OLNB type=write size=3831439 2024-09-12T17:07:51.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.510+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~HZJT4T34HPB9.0 size=803840 2024-09-12T17:07:51.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.510+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=HZJT4T34HPB9 tag=GLQ7ICIXXWXN type=write size=1852416 2024-09-12T17:07:51.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.511+0000 7f9eaebff780 1 < completed delete operation key=QIMNK4DL3D0N tag=CD7KEW48TVMR type=del 2024-09-12T17:07:51.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.512+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=BQRMN5H0SEM6 type=del size=3964428 2024-09-12T17:07:51.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.513+0000 7f9eaebff780 1 < completed delete operation key=B1YC6DM9S8JJ tag=T981WM69HYGY type=del 2024-09-12T17:07:51.517 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.516+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~E5VJRJO7KC6N.0 size=685827 2024-09-12T17:07:51.517 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.516+0000 7f9eaebff780 1 > prepared multipart upload key=EKUW5AKC428U upload=E5VJRJO7KC6N tag=FG8Y1J4EUB73 type=write size=1734403 2024-09-12T17:07:51.518 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.517+0000 7f9eaebff780 1 < completed delete operation key=SVWPQETL92QU tag=3MYJMZPP575C type=del 2024-09-12T17:07:51.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.518+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=YYAGHGRSWIG4 type=write size=863026 2024-09-12T17:07:51.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.519+0000 7f9eaebff780 1 < completed write operation key=GB8P7K59Y8VI tag=OM3NE4XS6JAU type=write size=102932 2024-09-12T17:07:51.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.521+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=U92DVNIPLU7A type=del size=2103787 2024-09-12T17:07:51.523 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.522+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~ZIS85T261Q6Z.0 size=1048576 2024-09-12T17:07:51.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.523+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~ZIS85T261Q6Z.1 size=363182 2024-09-12T17:07:51.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.525+0000 7f9eaebff780 1 < completed multipart upload key=OGD6H9VSVGWF upload=ZIS85T261Q6Z tag=PHWB3LOFE9V9 type=write size=2460334 2024-09-12T17:07:51.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.527+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~CANKE8SXCS29.0 size=1048576 2024-09-12T17:07:51.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.528+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~CANKE8SXCS29.1 size=461979 2024-09-12T17:07:51.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.528+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=CANKE8SXCS29 tag=U08UAFE5PNJC type=write size=2559131 2024-09-12T17:07:51.531 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.529+0000 7f9eaebff780 1 < completed delete operation key=7PBT9VZ07OUI tag=CXNUAACUOV3L type=del 2024-09-12T17:07:51.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.531+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=N4KPLXJPIYP5 type=del size=2435506 2024-09-12T17:07:51.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.533+0000 7f9eaebff780 1 < suggested remove operation key=P9GMGM3WK6O7 tag=7KEUPBZI1D08 type=write 2024-09-12T17:07:51.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.536+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~VYMNBI80C7ZF.0 size=1048576 2024-09-12T17:07:51.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.537+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~VYMNBI80C7ZF.1 size=1048576 2024-09-12T17:07:51.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.538+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~VYMNBI80C7ZF.2 size=776594 2024-09-12T17:07:51.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.538+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=VYMNBI80C7ZF tag=Z6EU7UTHASV8 type=write size=3922322 2024-09-12T17:07:51.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.540+0000 7f9eaebff780 1 < completed part key=_multipart_GB8P7K59Y8VI.2~LCZTPIQHUDHW.0 size=1048576 2024-09-12T17:07:51.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.540+0000 7f9eaebff780 1 < completed part key=_multipart_GB8P7K59Y8VI.2~LCZTPIQHUDHW.1 size=832788 2024-09-12T17:07:51.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.542+0000 7f9eaebff780 1 < completed multipart upload key=GB8P7K59Y8VI upload=LCZTPIQHUDHW tag=84LNV5N85K59 type=write size=2929940 2024-09-12T17:07:51.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.544+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~GR105564R59U.0 size=1048576 2024-09-12T17:07:51.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.545+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~GR105564R59U.1 size=1024649 2024-09-12T17:07:51.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.545+0000 7f9eaebff780 1 > prepared multipart upload key=9WJGBODZ60NJ upload=GR105564R59U tag=LRJCPQ7I656I type=write size=3121801 2024-09-12T17:07:51.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.547+0000 7f9eaebff780 1 < completed delete operation key=7PBT9VZ07OUI tag=OMBS5OQLCSTX type=del 2024-09-12T17:07:51.550 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.549+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~2U7IVTGPK4MT.0 size=1048576 2024-09-12T17:07:51.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.549+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~2U7IVTGPK4MT.1 size=1048576 2024-09-12T17:07:51.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.550+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~2U7IVTGPK4MT.2 size=832777 2024-09-12T17:07:51.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.550+0000 7f9eaebff780 1 > prepared multipart upload key=SO6QF2JCRX6E upload=2U7IVTGPK4MT tag=87ZURHJDP4I3 type=write size=3978505 2024-09-12T17:07:51.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.551+0000 7f9eaebff780 1 < completed part key=_multipart_TXHXOMIB4B53.2~WAKBDRDUW5D8.0 size=594239 2024-09-12T17:07:51.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.553+0000 7f9eaebff780 1 < completed multipart upload key=TXHXOMIB4B53 upload=WAKBDRDUW5D8 tag=8YS2VXSXAM74 type=write size=1642815 2024-09-12T17:07:51.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.554+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=PGDQ1IWNMOB4 type=del size=1549278 2024-09-12T17:07:51.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.556+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~T9F5LWJZI9WM.0 size=1048576 2024-09-12T17:07:51.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.557+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~T9F5LWJZI9WM.1 size=128218 2024-09-12T17:07:51.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.559+0000 7f9eaebff780 1 < completed multipart upload key=P9GMGM3WK6O7 upload=T9F5LWJZI9WM tag=H1R11KP2OV59 type=write size=2225370 2024-09-12T17:07:51.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.562+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~B6A5CQMFZQ6W.0 size=1048576 2024-09-12T17:07:51.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.563+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~B6A5CQMFZQ6W.1 size=1048576 2024-09-12T17:07:51.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.564+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~B6A5CQMFZQ6W.2 size=205725 2024-09-12T17:07:51.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.564+0000 7f9eaebff780 1 > prepared multipart upload key=YIEP2JYDSLW0 upload=B6A5CQMFZQ6W tag=KS8C4NG295PZ type=write size=3351453 2024-09-12T17:07:51.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.565+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~ZO5FA5REWC17.0 size=756207 2024-09-12T17:07:51.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.567+0000 7f9eaebff780 1 < completed multipart upload key=LJN514F16XJA upload=ZO5FA5REWC17 tag=YN9QSYA8OF0B type=write size=1804783 2024-09-12T17:07:51.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.568+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=1LVV3XRBDMTD type=del size=3897089 2024-09-12T17:07:51.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.569+0000 7f9eaebff780 1 < completed write operation key=EKUW5AKC428U tag=20M7PTO3UAZ1 type=write size=638907 2024-09-12T17:07:51.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.570+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=BUHMRVDTU75Y type=del size=3931490 2024-09-12T17:07:51.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.571+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~HSU1AHDNKINW.0 size=1048576 2024-09-12T17:07:51.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.572+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~HSU1AHDNKINW.1 size=1048576 2024-09-12T17:07:51.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.573+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~HSU1AHDNKINW.2 size=841470 2024-09-12T17:07:51.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.575+0000 7f9eaebff780 1 < completed multipart upload key=M3PLQGSK34YM upload=HSU1AHDNKINW tag=VPEPF9K6BSLV type=write size=3987198 2024-09-12T17:07:51.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.577+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=HDVLHSJYO8SY type=del size=2904655 2024-09-12T17:07:51.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.578+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~5GKMC8LDUG26.0 size=1048576 2024-09-12T17:07:51.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.579+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~5GKMC8LDUG26.1 size=1048576 2024-09-12T17:07:51.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.580+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~5GKMC8LDUG26.2 size=469483 2024-09-12T17:07:51.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.582+0000 7f9eaebff780 1 < completed multipart upload key=3VY271ZBO754 upload=5GKMC8LDUG26 tag=1XATTXA1LBSW type=write size=3615211 2024-09-12T17:07:51.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.584+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~7CXVPKCVB3NY.0 size=110860 2024-09-12T17:07:51.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.584+0000 7f9eaebff780 1 > prepared multipart upload key=9I6RGNRB6HSY upload=7CXVPKCVB3NY tag=SFW8CQIA4A1U type=write size=1159436 2024-09-12T17:07:51.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.585+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~HZJT4T34HPB9.0 size=803840 2024-09-12T17:07:51.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.587+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=HZJT4T34HPB9 tag=GLQ7ICIXXWXN type=write size=1852416 2024-09-12T17:07:51.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.589+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~RIJPQKCO9OX1.0 size=1048576 2024-09-12T17:07:51.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.590+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~RIJPQKCO9OX1.1 size=958587 2024-09-12T17:07:51.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.590+0000 7f9eaebff780 1 > prepared multipart upload key=YIEP2JYDSLW0 upload=RIJPQKCO9OX1 tag=2D9PAAB0G4LE type=write size=3055739 2024-09-12T17:07:51.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.592+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=BQRMN5H0SEM6 type=del 2024-09-12T17:07:51.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.593+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=YNXQV1K8Z42B type=del size=2576505 2024-09-12T17:07:51.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.594+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~E5VJRJO7KC6N.0 size=685827 2024-09-12T17:07:51.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.596+0000 7f9eaebff780 1 < completed multipart upload key=EKUW5AKC428U upload=E5VJRJO7KC6N tag=FG8Y1J4EUB73 type=write size=1734403 2024-09-12T17:07:51.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.597+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=YIL99ZC9G5NE type=del size=2839110 2024-09-12T17:07:51.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.598+0000 7f9eaebff780 1 < completed write operation key=8DJLYFM11DNI tag=YYAGHGRSWIG4 type=write size=863026 2024-09-12T17:07:51.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.599+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=P6E2G79ZVNCX type=del size=2728395 2024-09-12T17:07:51.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.600+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=U92DVNIPLU7A type=del 2024-09-12T17:07:51.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.602+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~FUPUMOYX8ECY.0 size=1048576 2024-09-12T17:07:51.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.603+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~FUPUMOYX8ECY.1 size=1048576 2024-09-12T17:07:51.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.604+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~FUPUMOYX8ECY.2 size=958205 2024-09-12T17:07:51.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.604+0000 7f9eaebff780 1 > prepared multipart upload key=CAIZM33SDFPM upload=FUPUMOYX8ECY tag=NGGEKACT7R87 type=write size=4103933 2024-09-12T17:07:51.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.605+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~CANKE8SXCS29.0 size=1048576 2024-09-12T17:07:51.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.607+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~CANKE8SXCS29.1 size=461979 2024-09-12T17:07:51.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.609+0000 7f9eaebff780 1 < completed multipart upload key=K2NHRSUDQBRW upload=CANKE8SXCS29 tag=U08UAFE5PNJC type=write size=2559131 2024-09-12T17:07:51.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.610+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=03FVAPZ0UMIS type=del size=2378683 2024-09-12T17:07:51.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.611+0000 7f9eaebff780 1 < canceled operation key=SVWPQETL92QU tag=N4KPLXJPIYP5 type=del size=2435506 2024-09-12T17:07:51.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.612+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=ST4DO4H44A5P type=del size=3195385 2024-09-12T17:07:51.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.613+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~VYMNBI80C7ZF.0 size=1048576 2024-09-12T17:07:51.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.613+0000 7f9eaebff780 1 < canceled part key=_multipart_SHWT6AT7PN0M.2~VYMNBI80C7ZF.1 size=1048576 2024-09-12T17:07:51.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.615+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~VYMNBI80C7ZF.2 size=776594 2024-09-12T17:07:51.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.617+0000 7f9eaebff780 1 < canceled multipart upload key=SHWT6AT7PN0M upload=VYMNBI80C7ZF tag=Z6EU7UTHASV8 type=write size=3922322 2024-09-12T17:07:51.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.619+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~EVU7B4V1113K.0 size=105843 2024-09-12T17:07:51.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.619+0000 7f9eaebff780 1 > prepared multipart upload key=KF8XE48DI9KZ upload=EVU7B4V1113K tag=1OOB3SYBSVDQ type=write size=1154419 2024-09-12T17:07:51.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.620+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~GR105564R59U.0 size=1048576 2024-09-12T17:07:51.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.621+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~GR105564R59U.1 size=1024649 2024-09-12T17:07:51.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.623+0000 7f9eaebff780 1 < completed multipart upload key=9WJGBODZ60NJ upload=GR105564R59U tag=LRJCPQ7I656I type=write size=3121801 2024-09-12T17:07:51.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.624+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=APA6O54VS736 type=del size=1976673 2024-09-12T17:07:51.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.625+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~2U7IVTGPK4MT.0 size=1048576 2024-09-12T17:07:51.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.626+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~2U7IVTGPK4MT.1 size=1048576 2024-09-12T17:07:51.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.627+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~2U7IVTGPK4MT.2 size=832777 2024-09-12T17:07:51.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.629+0000 7f9eaebff780 1 < completed multipart upload key=SO6QF2JCRX6E upload=2U7IVTGPK4MT tag=87ZURHJDP4I3 type=write size=3978505 2024-09-12T17:07:51.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.630+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=F7VQ0NSUXLMF type=del size=138475 2024-09-12T17:07:51.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.631+0000 7f9eaebff780 1 < completed delete operation key=EKUW5AKC428U tag=PGDQ1IWNMOB4 type=del 2024-09-12T17:07:51.634 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.633+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=ID10A2L1CDOO type=del size=3402753 2024-09-12T17:07:51.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.634+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~B6A5CQMFZQ6W.0 size=1048576 2024-09-12T17:07:51.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.635+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~B6A5CQMFZQ6W.1 size=1048576 2024-09-12T17:07:51.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.636+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~B6A5CQMFZQ6W.2 size=205725 2024-09-12T17:07:51.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.640+0000 7f9eaebff780 1 < completed multipart upload key=YIEP2JYDSLW0 upload=B6A5CQMFZQ6W tag=KS8C4NG295PZ type=write size=3351453 2024-09-12T17:07:51.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.641+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=LJTVCXN2DNRL type=del size=3131020 2024-09-12T17:07:51.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.642+0000 7f9eaebff780 1 < completed delete operation key=QIMNK4DL3D0N tag=1LVV3XRBDMTD type=del 2024-09-12T17:07:51.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.644+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=H823H09PAT8K type=del size=1811863 2024-09-12T17:07:51.648 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.647+0000 7f9eaebff780 1 < suggested update operation key=TXHXOMIB4B53 tag=BUHMRVDTU75Y type=del size=3931490 2024-09-12T17:07:51.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.650+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=UU62DAUM1Z8M type=del size=341368 2024-09-12T17:07:51.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.652+0000 7f9eaebff780 1 < suggested remove operation key=K0P9ZZ91UJJ8 tag=HDVLHSJYO8SY type=del 2024-09-12T17:07:51.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.654+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~YXZESXIS5X7B.0 size=884719 2024-09-12T17:07:51.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.654+0000 7f9eaebff780 1 > prepared multipart upload key=0YD5P1ACZ09Q upload=YXZESXIS5X7B tag=DU7PP49QYC98 type=write size=1933295 2024-09-12T17:07:51.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.656+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~7CXVPKCVB3NY.0 size=110860 2024-09-12T17:07:51.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.658+0000 7f9eaebff780 1 < completed multipart upload key=9I6RGNRB6HSY upload=7CXVPKCVB3NY tag=SFW8CQIA4A1U type=write size=1159436 2024-09-12T17:07:51.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.659+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=8SIAD5P7JHIW type=del size=1195877 2024-09-12T17:07:51.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.660+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~RIJPQKCO9OX1.0 size=1048576 2024-09-12T17:07:51.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.661+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~RIJPQKCO9OX1.1 size=958587 2024-09-12T17:07:51.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.663+0000 7f9eaebff780 1 < completed multipart upload key=YIEP2JYDSLW0 upload=RIJPQKCO9OX1 tag=2D9PAAB0G4LE type=write size=3055739 2024-09-12T17:07:51.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.665+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~WOMR1QN5HDJ8.0 size=1048576 2024-09-12T17:07:51.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.666+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~WOMR1QN5HDJ8.1 size=913990 2024-09-12T17:07:51.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.666+0000 7f9eaebff780 1 > prepared multipart upload key=YIEP2JYDSLW0 upload=WOMR1QN5HDJ8 tag=H1O6953O12UJ type=write size=3011142 2024-09-12T17:07:51.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.668+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=YNXQV1K8Z42B type=del 2024-09-12T17:07:51.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.669+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=TGQ1Z8OJVO29 type=del size=80074 2024-09-12T17:07:51.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.671+0000 7f9eaebff780 1 < suggested remove operation key=0F5LXJZMBFSP tag=YIL99ZC9G5NE type=del 2024-09-12T17:07:51.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.674+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~QTQM4347P1YX.0 size=1048576 2024-09-12T17:07:51.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.675+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~QTQM4347P1YX.1 size=328394 2024-09-12T17:07:51.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.675+0000 7f9eaebff780 1 > prepared multipart upload key=LRI5G5G8O5X4 upload=QTQM4347P1YX tag=L00Q93P11C7D type=write size=2425546 2024-09-12T17:07:51.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.676+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=P6E2G79ZVNCX type=del 2024-09-12T17:07:51.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.677+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=WWB2MOKVM1F3 type=del size=2508503 2024-09-12T17:07:51.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.678+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~FUPUMOYX8ECY.0 size=1048576 2024-09-12T17:07:51.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.679+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~FUPUMOYX8ECY.1 size=1048576 2024-09-12T17:07:51.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.680+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~FUPUMOYX8ECY.2 size=958205 2024-09-12T17:07:51.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.682+0000 7f9eaebff780 1 < completed multipart upload key=CAIZM33SDFPM upload=FUPUMOYX8ECY tag=NGGEKACT7R87 type=write size=4103933 2024-09-12T17:07:51.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.684+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=4NGCAC7FB5CC type=write size=638250 2024-09-12T17:07:51.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.685+0000 7f9eaebff780 1 < completed delete operation key=SHWT6AT7PN0M tag=03FVAPZ0UMIS type=del 2024-09-12T17:07:51.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.687+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~Q7VSQB30AJGI.0 size=1048576 2024-09-12T17:07:51.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.688+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~Q7VSQB30AJGI.1 size=1048576 2024-09-12T17:07:51.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.689+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~Q7VSQB30AJGI.2 size=325806 2024-09-12T17:07:51.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.689+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=Q7VSQB30AJGI tag=XPDLYE3MLNH0 type=write size=3471534 2024-09-12T17:07:51.691 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.690+0000 7f9eaebff780 1 < completed delete operation key=QIMNK4DL3D0N tag=ST4DO4H44A5P type=del 2024-09-12T17:07:51.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.691+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=FZEDKP8JG2VT type=del size=1155360 2024-09-12T17:07:51.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.692+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~EVU7B4V1113K.0 size=105843 2024-09-12T17:07:51.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.694+0000 7f9eaebff780 1 < completed multipart upload key=KF8XE48DI9KZ upload=EVU7B4V1113K tag=1OOB3SYBSVDQ type=write size=1154419 2024-09-12T17:07:51.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.696+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=T2Y7UR7V44TT type=del size=3275584 2024-09-12T17:07:51.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.697+0000 7f9eaebff780 1 < completed delete operation key=B1YC6DM9S8JJ tag=APA6O54VS736 type=del 2024-09-12T17:07:51.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.700+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~TMFNOG7W5OZ8.0 size=1048576 2024-09-12T17:07:51.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.701+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~TMFNOG7W5OZ8.1 size=586793 2024-09-12T17:07:51.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.701+0000 7f9eaebff780 1 > prepared multipart upload key=7PBT9VZ07OUI upload=TMFNOG7W5OZ8 tag=4WHWD8L57COM type=write size=2683945 2024-09-12T17:07:51.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.702+0000 7f9eaebff780 1 < completed delete operation key=SVWPQETL92QU tag=F7VQ0NSUXLMF type=del 2024-09-12T17:07:51.705 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.704+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~QYSYG0CE04TE.0 size=1048576 2024-09-12T17:07:51.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.705+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~QYSYG0CE04TE.1 size=1048576 2024-09-12T17:07:51.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.706+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~QYSYG0CE04TE.2 size=522636 2024-09-12T17:07:51.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.706+0000 7f9eaebff780 1 > prepared multipart upload key=3LY681252WAN upload=QYSYG0CE04TE tag=WWWL5EGKPJCP type=write size=3668364 2024-09-12T17:07:51.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.707+0000 7f9eaebff780 -1 < failed to complete operation key=K0P9ZZ91UJJ8 tag=ID10A2L1CDOO type=del size=3402753: (22) Invalid argument 2024-09-12T17:07:51.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.710+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~W7POGQ7UHTA8.0 size=923044 2024-09-12T17:07:51.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.710+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=W7POGQ7UHTA8 tag=VE452GX1733I type=write size=1971620 2024-09-12T17:07:51.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.711+0000 7f9eaebff780 1 < canceled operation key=OGD6H9VSVGWF tag=LJTVCXN2DNRL type=del size=3131020 2024-09-12T17:07:51.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.712+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=O95B0C35WM7J type=del size=3956834 2024-09-12T17:07:51.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.713+0000 7f9eaebff780 -1 < failed to complete operation key=TXHXOMIB4B53 tag=H823H09PAT8K type=del size=1811863: (22) Invalid argument 2024-09-12T17:07:51.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.716+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~YP3KU241A07Q.0 size=1048576 2024-09-12T17:07:51.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.717+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~YP3KU241A07Q.1 size=1048576 2024-09-12T17:07:51.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.718+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~YP3KU241A07Q.2 size=756097 2024-09-12T17:07:51.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.718+0000 7f9eaebff780 1 > prepared multipart upload key=B1YC6DM9S8JJ upload=YP3KU241A07Q tag=3BOT8CRAQLHN type=write size=3901825 2024-09-12T17:07:51.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.719+0000 7f9eaebff780 1 < completed delete operation key=SVWPQETL92QU tag=UU62DAUM1Z8M type=del 2024-09-12T17:07:51.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.720+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=NSUFGG1NDJ5W type=del size=2273052 2024-09-12T17:07:51.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.721+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~YXZESXIS5X7B.0 size=884719 2024-09-12T17:07:51.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.723+0000 7f9eaebff780 1 < completed multipart upload key=0YD5P1ACZ09Q upload=YXZESXIS5X7B tag=DU7PP49QYC98 type=write size=1933295 2024-09-12T17:07:51.726 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.725+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=7HYL4AX57WZM type=del size=1456949 2024-09-12T17:07:51.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.726+0000 7f9eaebff780 1 < completed delete operation key=ZYP3P4031PUZ tag=8SIAD5P7JHIW type=del 2024-09-12T17:07:51.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.728+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~2J9MM1LTDKEX.0 size=1048576 2024-09-12T17:07:51.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.729+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~2J9MM1LTDKEX.1 size=90958 2024-09-12T17:07:51.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.729+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=2J9MM1LTDKEX tag=AUWVLK5U3XZY type=write size=2188110 2024-09-12T17:07:51.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.731+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~WOMR1QN5HDJ8.0 size=1048576 2024-09-12T17:07:51.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.732+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~WOMR1QN5HDJ8.1 size=913990 2024-09-12T17:07:51.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.734+0000 7f9eaebff780 1 < completed multipart upload key=YIEP2JYDSLW0 upload=WOMR1QN5HDJ8 tag=H1O6953O12UJ type=write size=3011142 2024-09-12T17:07:51.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.736+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~T5HMIKR747JJ.0 size=1048576 2024-09-12T17:07:51.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.737+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~T5HMIKR747JJ.1 size=1048576 2024-09-12T17:07:51.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.738+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~T5HMIKR747JJ.2 size=735231 2024-09-12T17:07:51.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.738+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=T5HMIKR747JJ tag=JJVIQBCP2RVX type=write size=3880959 2024-09-12T17:07:51.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.739+0000 7f9eaebff780 1 < canceled operation key=YIEP2JYDSLW0 tag=TGQ1Z8OJVO29 type=del size=80074 2024-09-12T17:07:51.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.741+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=XWJ30CFNNLH3 type=del size=1634767 2024-09-12T17:07:51.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.742+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~QTQM4347P1YX.0 size=1048576 2024-09-12T17:07:51.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.743+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~QTQM4347P1YX.1 size=328394 2024-09-12T17:07:51.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.745+0000 7f9eaebff780 1 < completed multipart upload key=LRI5G5G8O5X4 upload=QTQM4347P1YX tag=L00Q93P11C7D type=write size=2425546 2024-09-12T17:07:51.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.746+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=Z1CCC4BXJ9NE type=write size=2519 2024-09-12T17:07:51.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.748+0000 7f9eaebff780 1 < canceled operation key=LRI5G5G8O5X4 tag=WWB2MOKVM1F3 type=del size=2508503 2024-09-12T17:07:51.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.750+0000 7f9eaebff780 1 > prepared part key=_multipart_TXHXOMIB4B53.2~LQFW5OHHLGRF.0 size=268586 2024-09-12T17:07:51.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.750+0000 7f9eaebff780 1 > prepared multipart upload key=TXHXOMIB4B53 upload=LQFW5OHHLGRF tag=AQZ249T43AKF type=write size=1317162 2024-09-12T17:07:51.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.751+0000 7f9eaebff780 1 < completed write operation key=9WJGBODZ60NJ tag=4NGCAC7FB5CC type=write size=638250 2024-09-12T17:07:51.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.752+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=Z8U1RRQ09A6I type=del size=2870327 2024-09-12T17:07:51.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.753+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~Q7VSQB30AJGI.0 size=1048576 2024-09-12T17:07:51.756 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.754+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~Q7VSQB30AJGI.1 size=1048576 2024-09-12T17:07:51.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.755+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~Q7VSQB30AJGI.2 size=325806 2024-09-12T17:07:51.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.758+0000 7f9eaebff780 1 < completed multipart upload key=K2NHRSUDQBRW upload=Q7VSQB30AJGI tag=XPDLYE3MLNH0 type=write size=3471534 2024-09-12T17:07:51.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.760+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~5IXMWME87W9E.0 size=1048576 2024-09-12T17:07:51.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.762+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~5IXMWME87W9E.1 size=1048576 2024-09-12T17:07:51.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.763+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~5IXMWME87W9E.2 size=567654 2024-09-12T17:07:51.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.763+0000 7f9eaebff780 1 > prepared multipart upload key=ZYP3P4031PUZ upload=5IXMWME87W9E tag=2BC5NQGSWOM4 type=write size=3713382 2024-09-12T17:07:51.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.764+0000 7f9eaebff780 1 < completed delete operation key=TXHXOMIB4B53 tag=FZEDKP8JG2VT type=del 2024-09-12T17:07:51.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.765+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=LQP4GGR7V5M2 type=del size=3376859 2024-09-12T17:07:51.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.766+0000 7f9eaebff780 1 < completed delete operation key=SHWT6AT7PN0M tag=T2Y7UR7V44TT type=del 2024-09-12T17:07:51.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.769+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~QGMIR5ODSFDM.0 size=1011956 2024-09-12T17:07:51.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.769+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=QGMIR5ODSFDM tag=M70VWZ400PW1 type=write size=2060532 2024-09-12T17:07:51.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.770+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~TMFNOG7W5OZ8.0 size=1048576 2024-09-12T17:07:51.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.771+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~TMFNOG7W5OZ8.1 size=586793 2024-09-12T17:07:51.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.773+0000 7f9eaebff780 1 < completed multipart upload key=7PBT9VZ07OUI upload=TMFNOG7W5OZ8 tag=4WHWD8L57COM type=write size=2683945 2024-09-12T17:07:51.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.775+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~OK8MMP0LEA3C.0 size=1048576 2024-09-12T17:07:51.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.776+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~OK8MMP0LEA3C.1 size=886131 2024-09-12T17:07:51.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.776+0000 7f9eaebff780 1 > prepared multipart upload key=EKUW5AKC428U upload=OK8MMP0LEA3C tag=79TB50FQ64HR type=write size=2983283 2024-09-12T17:07:51.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.777+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~QYSYG0CE04TE.0 size=1048576 2024-09-12T17:07:51.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.778+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~QYSYG0CE04TE.1 size=1048576 2024-09-12T17:07:51.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.779+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~QYSYG0CE04TE.2 size=522636 2024-09-12T17:07:51.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.782+0000 7f9eaebff780 1 < completed multipart upload key=3LY681252WAN upload=QYSYG0CE04TE tag=WWWL5EGKPJCP type=write size=3668364 2024-09-12T17:07:51.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.783+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=Y1CMFRDPAKTO type=write size=84048 2024-09-12T17:07:51.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.784+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~W7POGQ7UHTA8.0 size=923044 2024-09-12T17:07:51.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.786+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=W7POGQ7UHTA8 tag=VE452GX1733I type=write size=1971620 2024-09-12T17:07:51.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.787+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=Y1JRR4KXC6KR type=del size=864260 2024-09-12T17:07:51.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.789+0000 7f9eaebff780 1 < completed delete operation key=ZYP3P4031PUZ tag=O95B0C35WM7J type=del 2024-09-12T17:07:51.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.790+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=65LWXMGPS5U9 type=del size=2474936 2024-09-12T17:07:51.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.791+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~YP3KU241A07Q.0 size=1048576 2024-09-12T17:07:51.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.792+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~YP3KU241A07Q.1 size=1048576 2024-09-12T17:07:51.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.793+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~YP3KU241A07Q.2 size=756097 2024-09-12T17:07:51.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.795+0000 7f9eaebff780 1 < completed multipart upload key=B1YC6DM9S8JJ upload=YP3KU241A07Q tag=3BOT8CRAQLHN type=write size=3901825 2024-09-12T17:07:51.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.796+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=U2LRU5S51M3T type=del size=1472390 2024-09-12T17:07:51.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.797+0000 7f9eaebff780 1 < completed delete operation key=SVWPQETL92QU tag=NSUFGG1NDJ5W type=del 2024-09-12T17:07:51.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.799+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~PPHMVGAAPT4E.0 size=1048576 2024-09-12T17:07:51.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.800+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~PPHMVGAAPT4E.1 size=1048576 2024-09-12T17:07:51.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.801+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~PPHMVGAAPT4E.2 size=620327 2024-09-12T17:07:51.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.801+0000 7f9eaebff780 1 > prepared multipart upload key=A1KRCFY18QTP upload=PPHMVGAAPT4E tag=UH3EKW2Y2N26 type=write size=3766055 2024-09-12T17:07:51.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.802+0000 7f9eaebff780 1 < completed delete operation key=SVWPQETL92QU tag=7HYL4AX57WZM type=del 2024-09-12T17:07:51.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.804+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=33I9R5T5ZN07 type=del size=1937923 2024-09-12T17:07:51.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.805+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~2J9MM1LTDKEX.0 size=1048576 2024-09-12T17:07:51.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.806+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~2J9MM1LTDKEX.1 size=90958 2024-09-12T17:07:51.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.808+0000 7f9eaebff780 1 < completed multipart upload key=P9GMGM3WK6O7 upload=2J9MM1LTDKEX tag=AUWVLK5U3XZY type=write size=2188110 2024-09-12T17:07:51.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.809+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=Q2J0HGYAH3RO type=del size=1234217 2024-09-12T17:07:51.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.810+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~T5HMIKR747JJ.0 size=1048576 2024-09-12T17:07:51.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.810+0000 7f9eaebff780 1 < canceled part key=_multipart_SHWT6AT7PN0M.2~T5HMIKR747JJ.1 size=1048576 2024-09-12T17:07:51.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.811+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~T5HMIKR747JJ.2 size=735231 2024-09-12T17:07:51.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.814+0000 7f9eaebff780 1 < canceled multipart upload key=SHWT6AT7PN0M upload=T5HMIKR747JJ tag=JJVIQBCP2RVX type=write size=3880959 2024-09-12T17:07:51.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.816+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=D4X8XIKL7I22 type=del size=377727 2024-09-12T17:07:51.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.817+0000 7f9eaebff780 1 < completed delete operation key=9I6RGNRB6HSY tag=XWJ30CFNNLH3 type=del 2024-09-12T17:07:51.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.818+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=S4OV4HVVJA54 type=del size=3188194 2024-09-12T17:07:51.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.819+0000 7f9eaebff780 1 < completed write operation key=EKUW5AKC428U tag=Z1CCC4BXJ9NE type=write size=2519 2024-09-12T17:07:51.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.820+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=Z1Y973GT5J17 type=del size=2437055 2024-09-12T17:07:51.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.822+0000 7f9eaebff780 1 < completed part key=_multipart_TXHXOMIB4B53.2~LQFW5OHHLGRF.0 size=268586 2024-09-12T17:07:51.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.823+0000 7f9eaebff780 1 < completed multipart upload key=TXHXOMIB4B53 upload=LQFW5OHHLGRF tag=AQZ249T43AKF type=write size=1317162 2024-09-12T17:07:51.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.825+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=5KNM0KUGTPWU type=write size=540965 2024-09-12T17:07:51.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.826+0000 7f9eaebff780 1 < completed delete operation key=0YD5P1ACZ09Q tag=Z8U1RRQ09A6I type=del 2024-09-12T17:07:51.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.827+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=BQVS5OI8JAG5 type=del size=3476421 2024-09-12T17:07:51.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.828+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~5IXMWME87W9E.0 size=1048576 2024-09-12T17:07:51.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.829+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~5IXMWME87W9E.1 size=1048576 2024-09-12T17:07:51.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.830+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~5IXMWME87W9E.2 size=567654 2024-09-12T17:07:51.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.832+0000 7f9eaebff780 1 < completed multipart upload key=ZYP3P4031PUZ upload=5IXMWME87W9E tag=2BC5NQGSWOM4 type=write size=3713382 2024-09-12T17:07:51.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.834+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~Z4N5WVLAEPW5.0 size=742585 2024-09-12T17:07:51.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.834+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=Z4N5WVLAEPW5 tag=WXQOPIZ96W0Z type=write size=1791161 2024-09-12T17:07:51.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.836+0000 7f9eaebff780 1 < completed delete operation key=UYF1AN2W59VN tag=LQP4GGR7V5M2 type=del 2024-09-12T17:07:51.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.837+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=50WSHEPTL52A type=del size=3659382 2024-09-12T17:07:51.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.838+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~QGMIR5ODSFDM.0 size=1011956 2024-09-12T17:07:51.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.840+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=QGMIR5ODSFDM tag=M70VWZ400PW1 type=write size=2060532 2024-09-12T17:07:51.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.842+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=X2GFDEH4DCJ6 type=del size=2167182 2024-09-12T17:07:51.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.843+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~OK8MMP0LEA3C.0 size=1048576 2024-09-12T17:07:51.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.844+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~OK8MMP0LEA3C.1 size=886131 2024-09-12T17:07:51.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.846+0000 7f9eaebff780 1 < completed multipart upload key=EKUW5AKC428U upload=OK8MMP0LEA3C tag=79TB50FQ64HR type=write size=2983283 2024-09-12T17:07:51.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.847+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=FP4RX8VCY3VZ type=del size=98601 2024-09-12T17:07:51.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.849+0000 7f9eaebff780 1 < completed write operation key=0YD5P1ACZ09Q tag=Y1CMFRDPAKTO type=write size=84048 2024-09-12T17:07:51.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.851+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~W1CRDU7729OS.0 size=599760 2024-09-12T17:07:51.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.851+0000 7f9eaebff780 1 > prepared multipart upload key=8DJLYFM11DNI upload=W1CRDU7729OS tag=T4S12HXHYLH1 type=write size=1648336 2024-09-12T17:07:51.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.854+0000 7f9eaebff780 1 < suggested update operation key=YIEP2JYDSLW0 tag=Y1JRR4KXC6KR type=del size=864260 2024-09-12T17:07:51.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.855+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=OV2BVHHN2PXA type=del size=147168 2024-09-12T17:07:51.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.856+0000 7f9eaebff780 1 < completed delete operation key=EKUW5AKC428U tag=65LWXMGPS5U9 type=del 2024-09-12T17:07:51.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.857+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=R04LLPK73ZGV type=del size=2138627 2024-09-12T17:07:51.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.859+0000 7f9eaebff780 1 < completed delete operation key=8DJLYFM11DNI tag=U2LRU5S51M3T type=del 2024-09-12T17:07:51.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.860+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=7GJ9NZA90IGS type=del size=4137535 2024-09-12T17:07:51.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.861+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~PPHMVGAAPT4E.0 size=1048576 2024-09-12T17:07:51.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.862+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~PPHMVGAAPT4E.1 size=1048576 2024-09-12T17:07:51.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.863+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~PPHMVGAAPT4E.2 size=620327 2024-09-12T17:07:51.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.865+0000 7f9eaebff780 1 < completed multipart upload key=A1KRCFY18QTP upload=PPHMVGAAPT4E tag=UH3EKW2Y2N26 type=write size=3766055 2024-09-12T17:07:51.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.866+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=VMLWT5KC0YUX type=del size=796249 2024-09-12T17:07:51.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.867+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=33I9R5T5ZN07 type=del 2024-09-12T17:07:51.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.868+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=DP6SV3GZ33XE type=del size=4086855 2024-09-12T17:07:51.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.869+0000 7f9eaebff780 1 < completed delete operation key=OH6GXTMPBYUY tag=Q2J0HGYAH3RO type=del 2024-09-12T17:07:51.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.871+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=2LFMV2MY5A9Q type=del size=714874 2024-09-12T17:07:51.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.872+0000 7f9eaebff780 1 < completed delete operation key=0YD5P1ACZ09Q tag=D4X8XIKL7I22 type=del 2024-09-12T17:07:51.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.874+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~JF19ZWGQS90A.0 size=329955 2024-09-12T17:07:51.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.874+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=JF19ZWGQS90A tag=8MSBBL8B6NS0 type=write size=1378531 2024-09-12T17:07:51.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.878+0000 7f9eaebff780 1 < suggested update operation key=QIMNK4DL3D0N tag=S4OV4HVVJA54 type=del size=3188194 2024-09-12T17:07:51.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.879+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=ADX0CPRR6MHX type=write size=220831 2024-09-12T17:07:51.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.881+0000 7f9eaebff780 1 < suggested update operation key=K2NHRSUDQBRW tag=Z1Y973GT5J17 type=del size=2437055 2024-09-12T17:07:51.884 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.883+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=6XEUBWR2BBRU type=del size=92116 2024-09-12T17:07:51.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.884+0000 7f9eaebff780 1 < completed write operation key=0YD5P1ACZ09Q tag=5KNM0KUGTPWU type=write size=540965 2024-09-12T17:07:51.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.885+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=VH11RLQM1KS8 type=write size=23924 2024-09-12T17:07:51.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.886+0000 7f9eaebff780 1 < completed delete operation key=EKUW5AKC428U tag=BQVS5OI8JAG5 type=del 2024-09-12T17:07:51.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.888+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=ZQ62XVNEL7UE type=del size=1476593 2024-09-12T17:07:51.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.889+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~Z4N5WVLAEPW5.0 size=742585 2024-09-12T17:07:51.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.891+0000 7f9eaebff780 1 < completed multipart upload key=P9GMGM3WK6O7 upload=Z4N5WVLAEPW5 tag=WXQOPIZ96W0Z type=write size=1791161 2024-09-12T17:07:51.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.892+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=3S6M2W4B8PVI type=del size=3045079 2024-09-12T17:07:51.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.894+0000 7f9eaebff780 1 < suggested update operation key=GB8P7K59Y8VI tag=50WSHEPTL52A type=del size=3659382 2024-09-12T17:07:51.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.896+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~GS69TBQM6FY3.0 size=840627 2024-09-12T17:07:51.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.896+0000 7f9eaebff780 1 > prepared multipart upload key=EKUW5AKC428U upload=GS69TBQM6FY3 tag=G1230EZYS7MT type=write size=1889203 2024-09-12T17:07:51.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.898+0000 7f9eaebff780 1 < completed delete operation key=ZYP3P4031PUZ tag=X2GFDEH4DCJ6 type=del 2024-09-12T17:07:51.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.899+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=N5NJL3X8LNN2 type=del size=3338121 2024-09-12T17:07:51.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.900+0000 7f9eaebff780 1 < canceled operation key=SHWT6AT7PN0M tag=FP4RX8VCY3VZ type=del size=98601 2024-09-12T17:07:51.903 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.901+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=ZRSNH86001IT type=del size=3981224 2024-09-12T17:07:51.903 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.901+0000 7f9eaebff780 1 < canceled part key=_multipart_8DJLYFM11DNI.2~W1CRDU7729OS.0 size=599760 2024-09-12T17:07:51.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.903+0000 7f9eaebff780 1 < canceled multipart upload key=8DJLYFM11DNI upload=W1CRDU7729OS tag=T4S12HXHYLH1 type=write size=1648336 2024-09-12T17:07:51.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.906+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~I9T23WCUXFZS.0 size=1048576 2024-09-12T17:07:51.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.907+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~I9T23WCUXFZS.1 size=644289 2024-09-12T17:07:51.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.907+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=I9T23WCUXFZS tag=TEMY9SPE375W type=write size=2741441 2024-09-12T17:07:51.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.908+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=OV2BVHHN2PXA type=del 2024-09-12T17:07:51.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.910+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~5SUJE3QIVWHE.0 size=1048576 2024-09-12T17:07:51.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.911+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~5SUJE3QIVWHE.1 size=1048576 2024-09-12T17:07:51.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.912+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~5SUJE3QIVWHE.2 size=102902 2024-09-12T17:07:51.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.912+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=5SUJE3QIVWHE tag=WEGASTTLQS4C type=write size=3248630 2024-09-12T17:07:51.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.914+0000 7f9eaebff780 1 < suggested update operation key=UYF1AN2W59VN tag=R04LLPK73ZGV type=del size=2138627 2024-09-12T17:07:51.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.916+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~BRJ63405VZYA.0 size=1048576 2024-09-12T17:07:51.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.917+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~BRJ63405VZYA.1 size=407652 2024-09-12T17:07:51.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.917+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=BRJ63405VZYA tag=8FTDVG82H4Y1 type=write size=2504804 2024-09-12T17:07:51.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.919+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=7GJ9NZA90IGS type=del 2024-09-12T17:07:51.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.920+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=UJBK1SX8LGJ1 type=del size=2513136 2024-09-12T17:07:51.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.921+0000 7f9eaebff780 1 < completed delete operation key=SVWPQETL92QU tag=VMLWT5KC0YUX type=del 2024-09-12T17:07:51.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.923+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=EFNBW9IVMO4W type=write size=409446 2024-09-12T17:07:51.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.924+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=DP6SV3GZ33XE type=del 2024-09-12T17:07:51.928 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.926+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~WMTF1G5KV2HO.0 size=1048576 2024-09-12T17:07:51.928 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.927+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~WMTF1G5KV2HO.1 size=1048576 2024-09-12T17:07:51.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.928+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~WMTF1G5KV2HO.2 size=896536 2024-09-12T17:07:51.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.928+0000 7f9eaebff780 1 > prepared multipart upload key=8DJLYFM11DNI upload=WMTF1G5KV2HO tag=TGAD6LMMDOOM type=write size=4042264 2024-09-12T17:07:51.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.931+0000 7f9eaebff780 1 < suggested update operation key=CAIZM33SDFPM tag=2LFMV2MY5A9Q type=del size=714874 2024-09-12T17:07:51.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.932+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=CO9WO445OQHG type=del size=3350990 2024-09-12T17:07:51.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.933+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~JF19ZWGQS90A.0 size=329955 2024-09-12T17:07:51.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.935+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=JF19ZWGQS90A tag=8MSBBL8B6NS0 type=write size=1378531 2024-09-12T17:07:51.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.938+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~X26FVUIKJG25.0 size=1048576 2024-09-12T17:07:51.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.939+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~X26FVUIKJG25.1 size=545551 2024-09-12T17:07:51.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.939+0000 7f9eaebff780 1 > prepared multipart upload key=A1KRCFY18QTP upload=X26FVUIKJG25 tag=058Q9G3F2O05 type=write size=2642703 2024-09-12T17:07:51.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.940+0000 7f9eaebff780 1 < completed write operation key=ZC814TPVLJO1 tag=ADX0CPRR6MHX type=write size=220831 2024-09-12T17:07:51.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.942+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~6HGAD7BNISCZ.0 size=1048576 2024-09-12T17:07:51.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.944+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~6HGAD7BNISCZ.1 size=133626 2024-09-12T17:07:51.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.944+0000 7f9eaebff780 1 > prepared multipart upload key=ZC814TPVLJO1 upload=6HGAD7BNISCZ tag=AJN1AT9TOK1X type=write size=2230778 2024-09-12T17:07:51.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.945+0000 7f9eaebff780 1 < completed delete operation key=LRI5G5G8O5X4 tag=6XEUBWR2BBRU type=del 2024-09-12T17:07:51.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.947+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~3KGJ756UOEDI.0 size=1048576 2024-09-12T17:07:51.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.948+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~3KGJ756UOEDI.1 size=945272 2024-09-12T17:07:51.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.948+0000 7f9eaebff780 1 > prepared multipart upload key=0YD5P1ACZ09Q upload=3KGJ756UOEDI tag=0YS0RHBFIF0R type=write size=3042424 2024-09-12T17:07:51.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.949+0000 7f9eaebff780 1 < completed write operation key=K0P9ZZ91UJJ8 tag=VH11RLQM1KS8 type=write size=23924 2024-09-12T17:07:51.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.951+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=5846FIC4IUHL type=del size=926744 2024-09-12T17:07:51.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.952+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=ZQ62XVNEL7UE type=del 2024-09-12T17:07:51.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.954+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~HE6FMG1I8Y94.0 size=521168 2024-09-12T17:07:51.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.954+0000 7f9eaebff780 1 > prepared multipart upload key=OGD6H9VSVGWF upload=HE6FMG1I8Y94 tag=IU1T0QTXPS7W type=write size=1569744 2024-09-12T17:07:51.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.955+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=3S6M2W4B8PVI type=del 2024-09-12T17:07:51.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.957+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~9KJHI9JA4CV2.0 size=1048576 2024-09-12T17:07:51.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.958+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~9KJHI9JA4CV2.1 size=1048576 2024-09-12T17:07:51.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.959+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~9KJHI9JA4CV2.2 size=764490 2024-09-12T17:07:51.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.959+0000 7f9eaebff780 1 > prepared multipart upload key=0YD5P1ACZ09Q upload=9KJHI9JA4CV2 tag=VD08AQ9CXTEN type=write size=3910218 2024-09-12T17:07:51.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.959+0000 7f9eaebff780 1 < canceled part key=_multipart_EKUW5AKC428U.2~GS69TBQM6FY3.0 size=840627 2024-09-12T17:07:51.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.961+0000 7f9eaebff780 1 < canceled multipart upload key=EKUW5AKC428U upload=GS69TBQM6FY3 tag=G1230EZYS7MT type=write size=1889203 2024-09-12T17:07:51.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.962+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=FVG2XTEDQ1NI type=del size=2059139 2024-09-12T17:07:51.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.963+0000 7f9eaebff780 1 < canceled operation key=0YD5P1ACZ09Q tag=N5NJL3X8LNN2 type=del size=3338121 2024-09-12T17:07:51.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.965+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~UKE25QMD6LV6.0 size=1048576 2024-09-12T17:07:51.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.966+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~UKE25QMD6LV6.1 size=1048576 2024-09-12T17:07:51.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.967+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~UKE25QMD6LV6.2 size=454599 2024-09-12T17:07:51.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.967+0000 7f9eaebff780 1 > prepared multipart upload key=8DJLYFM11DNI upload=UKE25QMD6LV6 tag=RA5F4GYG3CP1 type=write size=3600327 2024-09-12T17:07:51.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.968+0000 7f9eaebff780 1 < completed delete operation key=P9GMGM3WK6O7 tag=ZRSNH86001IT type=del 2024-09-12T17:07:51.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.971+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~5ZL99C8TYW3J.0 size=97364 2024-09-12T17:07:51.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.971+0000 7f9eaebff780 1 > prepared multipart upload key=OGD6H9VSVGWF upload=5ZL99C8TYW3J tag=3GNKV8CP5FXV type=write size=1145940 2024-09-12T17:07:51.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.972+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~I9T23WCUXFZS.0 size=1048576 2024-09-12T17:07:51.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.973+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~I9T23WCUXFZS.1 size=644289 2024-09-12T17:07:51.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.975+0000 7f9eaebff780 1 < completed multipart upload key=SHWT6AT7PN0M upload=I9T23WCUXFZS tag=TEMY9SPE375W type=write size=2741441 2024-09-12T17:07:51.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.976+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=KA4X3Q10A3BS type=del size=2480281 2024-09-12T17:07:51.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.977+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~5SUJE3QIVWHE.0 size=1048576 2024-09-12T17:07:51.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.978+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~5SUJE3QIVWHE.1 size=1048576 2024-09-12T17:07:51.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.979+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~5SUJE3QIVWHE.2 size=102902 2024-09-12T17:07:51.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.981+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=5SUJE3QIVWHE tag=WEGASTTLQS4C type=write size=3248630 2024-09-12T17:07:51.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.982+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=MOHGUPVE8PS1 type=del size=1119233 2024-09-12T17:07:51.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.984+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~BRJ63405VZYA.0 size=1048576 2024-09-12T17:07:51.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.985+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~BRJ63405VZYA.1 size=407652 2024-09-12T17:07:51.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.987+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=BRJ63405VZYA tag=8FTDVG82H4Y1 type=write size=2504804 2024-09-12T17:07:51.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.988+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=ZUXKO3DKHM5S type=del size=929609 2024-09-12T17:07:51.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.990+0000 7f9eaebff780 1 < completed delete operation key=7PBT9VZ07OUI tag=UJBK1SX8LGJ1 type=del 2024-09-12T17:07:51.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.992+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=RS2LB9J6G59N type=del size=3197127 2024-09-12T17:07:51.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.995+0000 7f9eaebff780 1 < suggested update operation key=TDZCNUZE8IOA tag=EFNBW9IVMO4W type=write size=409446 2024-09-12T17:07:51.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.997+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~IDGT1WIXGUMH.0 size=1048576 2024-09-12T17:07:52.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.998+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~IDGT1WIXGUMH.1 size=1048576 2024-09-12T17:07:52.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.999+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~IDGT1WIXGUMH.2 size=877519 2024-09-12T17:07:52.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:51.999+0000 7f9eaebff780 1 > prepared multipart upload key=GB8P7K59Y8VI upload=IDGT1WIXGUMH tag=4P7WJRAK95S9 type=write size=4023247 2024-09-12T17:07:52.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.000+0000 7f9eaebff780 1 < canceled part key=_multipart_8DJLYFM11DNI.2~WMTF1G5KV2HO.0 size=1048576 2024-09-12T17:07:52.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.001+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~WMTF1G5KV2HO.1 size=1048576 2024-09-12T17:07:52.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.002+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~WMTF1G5KV2HO.2 size=896536 2024-09-12T17:07:52.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.004+0000 7f9eaebff780 1 < canceled multipart upload key=8DJLYFM11DNI upload=WMTF1G5KV2HO tag=TGAD6LMMDOOM type=write size=4042264 2024-09-12T17:07:52.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.005+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=7BEL517W3WSC type=del size=2702764 2024-09-12T17:07:52.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.006+0000 7f9eaebff780 1 < canceled operation key=0F5LXJZMBFSP tag=CO9WO445OQHG type=del size=3350990 2024-09-12T17:07:52.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.009+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~Y3JGSB3N8FDT.0 size=1048576 2024-09-12T17:07:52.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.010+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~Y3JGSB3N8FDT.1 size=465970 2024-09-12T17:07:52.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.010+0000 7f9eaebff780 1 > prepared multipart upload key=TDZCNUZE8IOA upload=Y3JGSB3N8FDT tag=XI5C8IN243JC type=write size=2563122 2024-09-12T17:07:52.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.011+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~X26FVUIKJG25.0 size=1048576 2024-09-12T17:07:52.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.012+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~X26FVUIKJG25.1 size=545551 2024-09-12T17:07:52.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.014+0000 7f9eaebff780 1 < completed multipart upload key=A1KRCFY18QTP upload=X26FVUIKJG25 tag=058Q9G3F2O05 type=write size=2642703 2024-09-12T17:07:52.017 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.015+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=Q6ERNM8RU11C type=write size=57568 2024-09-12T17:07:52.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.016+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~6HGAD7BNISCZ.0 size=1048576 2024-09-12T17:07:52.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.017+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~6HGAD7BNISCZ.1 size=133626 2024-09-12T17:07:52.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.020+0000 7f9eaebff780 1 < completed multipart upload key=ZC814TPVLJO1 upload=6HGAD7BNISCZ tag=AJN1AT9TOK1X type=write size=2230778 2024-09-12T17:07:52.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.021+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=311EFN41KSXA type=del size=3999219 2024-09-12T17:07:52.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.022+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~3KGJ756UOEDI.0 size=1048576 2024-09-12T17:07:52.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.023+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~3KGJ756UOEDI.1 size=945272 2024-09-12T17:07:52.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.025+0000 7f9eaebff780 1 < completed multipart upload key=0YD5P1ACZ09Q upload=3KGJ756UOEDI tag=0YS0RHBFIF0R type=write size=3042424 2024-09-12T17:07:52.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.026+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=1SHJHU2KXOIM type=del size=2904761 2024-09-12T17:07:52.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.027+0000 7f9eaebff780 1 < completed delete operation key=ZC814TPVLJO1 tag=5846FIC4IUHL type=del 2024-09-12T17:07:52.030 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.028+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=U8N71XSIWWH2 type=write size=552514 2024-09-12T17:07:52.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.030+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~HE6FMG1I8Y94.0 size=521168 2024-09-12T17:07:52.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.032+0000 7f9eaebff780 1 < completed multipart upload key=OGD6H9VSVGWF upload=HE6FMG1I8Y94 tag=IU1T0QTXPS7W type=write size=1569744 2024-09-12T17:07:52.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.033+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=TWH1BL3B3QFN type=del size=2159019 2024-09-12T17:07:52.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.034+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~9KJHI9JA4CV2.0 size=1048576 2024-09-12T17:07:52.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.035+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~9KJHI9JA4CV2.1 size=1048576 2024-09-12T17:07:52.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.036+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~9KJHI9JA4CV2.2 size=764490 2024-09-12T17:07:52.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.038+0000 7f9eaebff780 1 < completed multipart upload key=0YD5P1ACZ09Q upload=9KJHI9JA4CV2 tag=VD08AQ9CXTEN type=write size=3910218 2024-09-12T17:07:52.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.040+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~EWKM6T1A0H44.0 size=1048576 2024-09-12T17:07:52.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.041+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~EWKM6T1A0H44.1 size=426065 2024-09-12T17:07:52.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.041+0000 7f9eaebff780 1 > prepared multipart upload key=KF8XE48DI9KZ upload=EWKM6T1A0H44 tag=LIEBU9ENO47I type=write size=2523217 2024-09-12T17:07:52.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.043+0000 7f9eaebff780 1 < canceled operation key=K0P9ZZ91UJJ8 tag=FVG2XTEDQ1NI type=del size=2059139 2024-09-12T17:07:52.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.044+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=Q0E2FMQOZW59 type=del size=2133762 2024-09-12T17:07:52.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.045+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~UKE25QMD6LV6.0 size=1048576 2024-09-12T17:07:52.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.045+0000 7f9eaebff780 1 < canceled part key=_multipart_8DJLYFM11DNI.2~UKE25QMD6LV6.1 size=1048576 2024-09-12T17:07:52.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.046+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~UKE25QMD6LV6.2 size=454599 2024-09-12T17:07:52.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.048+0000 7f9eaebff780 1 < canceled multipart upload key=8DJLYFM11DNI upload=UKE25QMD6LV6 tag=RA5F4GYG3CP1 type=write size=3600327 2024-09-12T17:07:52.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.050+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=LHR4JPG7ARR0 type=del size=2438579 2024-09-12T17:07:52.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.051+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~5ZL99C8TYW3J.0 size=97364 2024-09-12T17:07:52.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.053+0000 7f9eaebff780 1 < completed multipart upload key=OGD6H9VSVGWF upload=5ZL99C8TYW3J tag=3GNKV8CP5FXV type=write size=1145940 2024-09-12T17:07:52.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.055+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~B26DXWLKF8RQ.0 size=1048576 2024-09-12T17:07:52.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.056+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~B26DXWLKF8RQ.1 size=310695 2024-09-12T17:07:52.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.056+0000 7f9eaebff780 1 > prepared multipart upload key=SO6QF2JCRX6E upload=B26DXWLKF8RQ tag=K1RAA8AJRF40 type=write size=2407847 2024-09-12T17:07:52.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.058+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=KA4X3Q10A3BS type=del 2024-09-12T17:07:52.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.060+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~LPOOYC37TK20.0 size=1048576 2024-09-12T17:07:52.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.061+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~LPOOYC37TK20.1 size=302050 2024-09-12T17:07:52.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.061+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=LPOOYC37TK20 tag=9HJZ743UAMOF type=write size=2399202 2024-09-12T17:07:52.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.062+0000 7f9eaebff780 1 < canceled operation key=OH6GXTMPBYUY tag=MOHGUPVE8PS1 type=del size=1119233 2024-09-12T17:07:52.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.064+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~DHWG7M6PJ3S6.0 size=1048576 2024-09-12T17:07:52.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.065+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~DHWG7M6PJ3S6.1 size=1048576 2024-09-12T17:07:52.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.067+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~DHWG7M6PJ3S6.2 size=120137 2024-09-12T17:07:52.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.067+0000 7f9eaebff780 1 > prepared multipart upload key=YIEP2JYDSLW0 upload=DHWG7M6PJ3S6 tag=6AUBBFJA06PM type=write size=3265865 2024-09-12T17:07:52.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.068+0000 7f9eaebff780 1 < canceled operation key=QIMNK4DL3D0N tag=ZUXKO3DKHM5S type=del size=929609 2024-09-12T17:07:52.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.071+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~4WRCN235I148.0 size=245274 2024-09-12T17:07:52.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.071+0000 7f9eaebff780 1 > prepared multipart upload key=B1YC6DM9S8JJ upload=4WRCN235I148 tag=FOKX7GTU729E type=write size=1293850 2024-09-12T17:07:52.073 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.072+0000 7f9eaebff780 1 < completed delete operation key=7PBT9VZ07OUI tag=RS2LB9J6G59N type=del 2024-09-12T17:07:52.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.073+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=UUCFSCD5BZR0 type=write size=670163 2024-09-12T17:07:52.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.075+0000 7f9eaebff780 1 < completed part key=_multipart_GB8P7K59Y8VI.2~IDGT1WIXGUMH.0 size=1048576 2024-09-12T17:07:52.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.076+0000 7f9eaebff780 1 < completed part key=_multipart_GB8P7K59Y8VI.2~IDGT1WIXGUMH.1 size=1048576 2024-09-12T17:07:52.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.077+0000 7f9eaebff780 1 < completed part key=_multipart_GB8P7K59Y8VI.2~IDGT1WIXGUMH.2 size=877519 2024-09-12T17:07:52.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.079+0000 7f9eaebff780 1 < completed multipart upload key=GB8P7K59Y8VI upload=IDGT1WIXGUMH tag=4P7WJRAK95S9 type=write size=4023247 2024-09-12T17:07:52.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.081+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~B9J40952FZ9O.0 size=861772 2024-09-12T17:07:52.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.081+0000 7f9eaebff780 1 > prepared multipart upload key=B1YC6DM9S8JJ upload=B9J40952FZ9O tag=QQ7OGBQ86IS3 type=write size=1910348 2024-09-12T17:07:52.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.082+0000 7f9eaebff780 1 < canceled operation key=A1KRCFY18QTP tag=7BEL517W3WSC type=del size=2702764 2024-09-12T17:07:52.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.083+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=DCPH6V4DHMDU type=del size=959506 2024-09-12T17:07:52.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.085+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~Y3JGSB3N8FDT.0 size=1048576 2024-09-12T17:07:52.087 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.086+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~Y3JGSB3N8FDT.1 size=465970 2024-09-12T17:07:52.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.089+0000 7f9eaebff780 1 < completed multipart upload key=TDZCNUZE8IOA upload=Y3JGSB3N8FDT tag=XI5C8IN243JC type=write size=2563122 2024-09-12T17:07:52.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.091+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~86Z6JBA10U55.0 size=461658 2024-09-12T17:07:52.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.091+0000 7f9eaebff780 1 > prepared multipart upload key=YIEP2JYDSLW0 upload=86Z6JBA10U55 tag=NLL8SOOFG060 type=write size=1510234 2024-09-12T17:07:52.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.092+0000 7f9eaebff780 1 < completed write operation key=SO6QF2JCRX6E tag=Q6ERNM8RU11C type=write size=57568 2024-09-12T17:07:52.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.094+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=EG01DWX3LKPT type=del size=972385 2024-09-12T17:07:52.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.095+0000 7f9eaebff780 1 < completed delete operation key=7PBT9VZ07OUI tag=311EFN41KSXA type=del 2024-09-12T17:07:52.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.098+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~MJ9SF6XA9W3Y.0 size=1048576 2024-09-12T17:07:52.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.099+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~MJ9SF6XA9W3Y.1 size=1048576 2024-09-12T17:07:52.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.100+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~MJ9SF6XA9W3Y.2 size=490397 2024-09-12T17:07:52.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.100+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=MJ9SF6XA9W3Y tag=M6GB2HVFAPHR type=write size=3636125 2024-09-12T17:07:52.103 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.101+0000 7f9eaebff780 1 < completed delete operation key=K2NHRSUDQBRW tag=1SHJHU2KXOIM type=del 2024-09-12T17:07:52.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.104+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~XJ9JEK8M65BH.0 size=1048576 2024-09-12T17:07:52.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.105+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~XJ9JEK8M65BH.1 size=1048576 2024-09-12T17:07:52.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.106+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~XJ9JEK8M65BH.2 size=327915 2024-09-12T17:07:52.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.106+0000 7f9eaebff780 1 > prepared multipart upload key=EKUW5AKC428U upload=XJ9JEK8M65BH tag=GJ6HA71PWHPM type=write size=3473643 2024-09-12T17:07:52.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.108+0000 7f9eaebff780 1 < canceled operation key=9I6RGNRB6HSY tag=U8N71XSIWWH2 type=write size=552514 2024-09-12T17:07:52.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.111+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~WODJHUOJ3RA0.0 size=102895 2024-09-12T17:07:52.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.111+0000 7f9eaebff780 1 > prepared multipart upload key=3LY681252WAN upload=WODJHUOJ3RA0 tag=GE1Q3RDGPF7B type=write size=1151471 2024-09-12T17:07:52.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.112+0000 7f9eaebff780 1 < canceled operation key=K0P9ZZ91UJJ8 tag=TWH1BL3B3QFN type=del size=2159019 2024-09-12T17:07:52.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.115+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~NI2S1SMPHUG4.0 size=455890 2024-09-12T17:07:52.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.115+0000 7f9eaebff780 1 > prepared multipart upload key=0F5LXJZMBFSP upload=NI2S1SMPHUG4 tag=07SHJ20MZ0G6 type=write size=1504466 2024-09-12T17:07:52.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.116+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~EWKM6T1A0H44.0 size=1048576 2024-09-12T17:07:52.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.117+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~EWKM6T1A0H44.1 size=426065 2024-09-12T17:07:52.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.119+0000 7f9eaebff780 1 < completed multipart upload key=KF8XE48DI9KZ upload=EWKM6T1A0H44 tag=LIEBU9ENO47I type=write size=2523217 2024-09-12T17:07:52.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.121+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=24XH7337EYEM type=del size=720065 2024-09-12T17:07:52.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.122+0000 7f9eaebff780 1 < completed delete operation key=ZC814TPVLJO1 tag=Q0E2FMQOZW59 type=del 2024-09-12T17:07:52.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.123+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=Q1J27SLPWTDU type=del size=2147923 2024-09-12T17:07:52.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.126+0000 7f9eaebff780 1 < suggested update operation key=OH6GXTMPBYUY tag=LHR4JPG7ARR0 type=del size=2438579 2024-09-12T17:07:52.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.127+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=0U3627A10GHM type=del size=784773 2024-09-12T17:07:52.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.128+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~B26DXWLKF8RQ.0 size=1048576 2024-09-12T17:07:52.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.129+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~B26DXWLKF8RQ.1 size=310695 2024-09-12T17:07:52.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.131+0000 7f9eaebff780 1 < completed multipart upload key=SO6QF2JCRX6E upload=B26DXWLKF8RQ tag=K1RAA8AJRF40 type=write size=2407847 2024-09-12T17:07:52.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.132+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=ZJPQ0XASXKFO type=del size=1573400 2024-09-12T17:07:52.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.133+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~LPOOYC37TK20.0 size=1048576 2024-09-12T17:07:52.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.134+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~LPOOYC37TK20.1 size=302050 2024-09-12T17:07:52.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.136+0000 7f9eaebff780 1 < completed multipart upload key=UYF1AN2W59VN upload=LPOOYC37TK20 tag=9HJZ743UAMOF type=write size=2399202 2024-09-12T17:07:52.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.137+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=1TT5W89HV1D5 type=del size=826636 2024-09-12T17:07:52.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.139+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~DHWG7M6PJ3S6.0 size=1048576 2024-09-12T17:07:52.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.140+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~DHWG7M6PJ3S6.1 size=1048576 2024-09-12T17:07:52.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.141+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~DHWG7M6PJ3S6.2 size=120137 2024-09-12T17:07:52.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.143+0000 7f9eaebff780 1 < completed multipart upload key=YIEP2JYDSLW0 upload=DHWG7M6PJ3S6 tag=6AUBBFJA06PM type=write size=3265865 2024-09-12T17:07:52.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.145+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=WEJT2SYSS5OT type=write size=499384 2024-09-12T17:07:52.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.146+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~4WRCN235I148.0 size=245274 2024-09-12T17:07:52.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.149+0000 7f9eaebff780 1 < completed multipart upload key=B1YC6DM9S8JJ upload=4WRCN235I148 tag=FOKX7GTU729E type=write size=1293850 2024-09-12T17:07:52.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.150+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=V5MWRKID3S8Z type=write size=593018 2024-09-12T17:07:52.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.151+0000 7f9eaebff780 1 < completed write operation key=YIEP2JYDSLW0 tag=UUCFSCD5BZR0 type=write size=670163 2024-09-12T17:07:52.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.154+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~6PA9DDP7FQTC.0 size=634988 2024-09-12T17:07:52.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.154+0000 7f9eaebff780 1 > prepared multipart upload key=CAIZM33SDFPM upload=6PA9DDP7FQTC tag=RYXGL4PTJOD2 type=write size=1683564 2024-09-12T17:07:52.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.154+0000 7f9eaebff780 1 < canceled part key=_multipart_B1YC6DM9S8JJ.2~B9J40952FZ9O.0 size=861772 2024-09-12T17:07:52.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.156+0000 7f9eaebff780 1 < canceled multipart upload key=B1YC6DM9S8JJ upload=B9J40952FZ9O tag=QQ7OGBQ86IS3 type=write size=1910348 2024-09-12T17:07:52.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.157+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=8IJUXLXIQUZX type=del size=2338442 2024-09-12T17:07:52.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.158+0000 7f9eaebff780 1 < canceled operation key=SO6QF2JCRX6E tag=DCPH6V4DHMDU type=del size=959506 2024-09-12T17:07:52.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.161+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~86HNF1V7GATW.0 size=715932 2024-09-12T17:07:52.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.161+0000 7f9eaebff780 1 > prepared multipart upload key=YIEP2JYDSLW0 upload=86HNF1V7GATW tag=4QF0I8F6FK5Z type=write size=1764508 2024-09-12T17:07:52.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.162+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~86Z6JBA10U55.0 size=461658 2024-09-12T17:07:52.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.164+0000 7f9eaebff780 1 < completed multipart upload key=YIEP2JYDSLW0 upload=86Z6JBA10U55 tag=NLL8SOOFG060 type=write size=1510234 2024-09-12T17:07:52.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.165+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=2TAP7I7M1AZP type=del size=3981942 2024-09-12T17:07:52.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.166+0000 7f9eaebff780 1 < completed delete operation key=UYF1AN2W59VN tag=EG01DWX3LKPT type=del 2024-09-12T17:07:52.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.169+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~B8ZWRD13KWN0.0 size=1048576 2024-09-12T17:07:52.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.170+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~B8ZWRD13KWN0.1 size=1048576 2024-09-12T17:07:52.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.171+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~B8ZWRD13KWN0.2 size=338913 2024-09-12T17:07:52.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.171+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=B8ZWRD13KWN0 tag=25R69CG512L4 type=write size=3484641 2024-09-12T17:07:52.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.171+0000 7f9eaebff780 1 < canceled part key=_multipart_M3PLQGSK34YM.2~MJ9SF6XA9W3Y.0 size=1048576 2024-09-12T17:07:52.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.172+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~MJ9SF6XA9W3Y.1 size=1048576 2024-09-12T17:07:52.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.173+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~MJ9SF6XA9W3Y.2 size=490397 2024-09-12T17:07:52.177 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.175+0000 7f9eaebff780 1 < canceled multipart upload key=M3PLQGSK34YM upload=MJ9SF6XA9W3Y tag=M6GB2HVFAPHR type=write size=3636125 2024-09-12T17:07:52.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.177+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~7K5D35KTSCW6.0 size=1048576 2024-09-12T17:07:52.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.178+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~7K5D35KTSCW6.1 size=706674 2024-09-12T17:07:52.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.178+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=7K5D35KTSCW6 tag=TE8ITR2OFQVF type=write size=2803826 2024-09-12T17:07:52.181 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.180+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~XJ9JEK8M65BH.0 size=1048576 2024-09-12T17:07:52.181 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.180+0000 7f9eaebff780 1 < canceled part key=_multipart_EKUW5AKC428U.2~XJ9JEK8M65BH.1 size=1048576 2024-09-12T17:07:52.182 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.181+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~XJ9JEK8M65BH.2 size=327915 2024-09-12T17:07:52.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.182+0000 7f9eaebff780 1 < canceled multipart upload key=EKUW5AKC428U upload=XJ9JEK8M65BH tag=GJ6HA71PWHPM type=write size=3473643 2024-09-12T17:07:52.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.185+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~X1H3ERUMO9LS.0 size=1048576 2024-09-12T17:07:52.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.186+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~X1H3ERUMO9LS.1 size=857355 2024-09-12T17:07:52.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.186+0000 7f9eaebff780 1 > prepared multipart upload key=9I6RGNRB6HSY upload=X1H3ERUMO9LS tag=YJ43K1LHS9Y3 type=write size=2954507 2024-09-12T17:07:52.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.187+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~WODJHUOJ3RA0.0 size=102895 2024-09-12T17:07:52.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.189+0000 7f9eaebff780 1 < completed multipart upload key=3LY681252WAN upload=WODJHUOJ3RA0 tag=GE1Q3RDGPF7B type=write size=1151471 2024-09-12T17:07:52.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.190+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=IKBZQ0EV0D2B type=del size=1566651 2024-09-12T17:07:52.192 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.191+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~NI2S1SMPHUG4.0 size=455890 2024-09-12T17:07:52.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.193+0000 7f9eaebff780 1 < completed multipart upload key=0F5LXJZMBFSP upload=NI2S1SMPHUG4 tag=07SHJ20MZ0G6 type=write size=1504466 2024-09-12T17:07:52.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.195+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~5EIB0K5L14MB.0 size=553711 2024-09-12T17:07:52.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.195+0000 7f9eaebff780 1 > prepared multipart upload key=YIEP2JYDSLW0 upload=5EIB0K5L14MB tag=KSVRW1WI9RQ9 type=write size=1602287 2024-09-12T17:07:52.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.197+0000 7f9eaebff780 1 < completed delete operation key=8DJLYFM11DNI tag=24XH7337EYEM type=del 2024-09-12T17:07:52.200 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.199+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~31YJ3DEK90Y7.0 size=1048576 2024-09-12T17:07:52.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.200+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~31YJ3DEK90Y7.1 size=1048576 2024-09-12T17:07:52.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.201+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~31YJ3DEK90Y7.2 size=764516 2024-09-12T17:07:52.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.201+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=31YJ3DEK90Y7 tag=2MNM62Y661X5 type=write size=3910244 2024-09-12T17:07:52.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.203+0000 7f9eaebff780 1 < suggested update operation key=CAIZM33SDFPM tag=Q1J27SLPWTDU type=del size=2147923 2024-09-12T17:07:52.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.204+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=0Q9CMBLGTWTV type=del size=1119093 2024-09-12T17:07:52.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.205+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=0U3627A10GHM type=del 2024-09-12T17:07:52.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.206+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=SBH6Y49TSI0I type=write size=1014397 2024-09-12T17:07:52.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.207+0000 7f9eaebff780 1 < completed delete operation key=K2NHRSUDQBRW tag=ZJPQ0XASXKFO type=del 2024-09-12T17:07:52.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.210+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~0ITNDLEXP404.0 size=259772 2024-09-12T17:07:52.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.210+0000 7f9eaebff780 1 > prepared multipart upload key=ZC814TPVLJO1 upload=0ITNDLEXP404 tag=UVX0QRUXW70H type=write size=1308348 2024-09-12T17:07:52.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.211+0000 7f9eaebff780 1 < completed delete operation key=GB8P7K59Y8VI tag=1TT5W89HV1D5 type=del 2024-09-12T17:07:52.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.212+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=X0Y3MSC2HMRV type=del size=288514 2024-09-12T17:07:52.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.213+0000 7f9eaebff780 1 < completed write operation key=LJN514F16XJA tag=WEJT2SYSS5OT type=write size=499384 2024-09-12T17:07:52.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.215+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~RXZPTR4ED6RY.0 size=1048576 2024-09-12T17:07:52.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.216+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~RXZPTR4ED6RY.1 size=1048576 2024-09-12T17:07:52.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.217+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~RXZPTR4ED6RY.2 size=374987 2024-09-12T17:07:52.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.217+0000 7f9eaebff780 1 > prepared multipart upload key=ZC814TPVLJO1 upload=RXZPTR4ED6RY tag=X0UP3SC34O85 type=write size=3520715 2024-09-12T17:07:52.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.218+0000 7f9eaebff780 1 < completed write operation key=OGD6H9VSVGWF tag=V5MWRKID3S8Z type=write size=593018 2024-09-12T17:07:52.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.220+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~WKVVVYHDWSDW.0 size=50948 2024-09-12T17:07:52.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.220+0000 7f9eaebff780 1 > prepared multipart upload key=9WJGBODZ60NJ upload=WKVVVYHDWSDW tag=Y59FAMQNSH0I type=write size=1099524 2024-09-12T17:07:52.224 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.223+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~6PA9DDP7FQTC.0 size=634988 2024-09-12T17:07:52.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.224+0000 7f9eaebff780 1 < completed multipart upload key=CAIZM33SDFPM upload=6PA9DDP7FQTC tag=RYXGL4PTJOD2 type=write size=1683564 2024-09-12T17:07:52.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.226+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=PYAW53Z9AX1I type=write size=655475 2024-09-12T17:07:52.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.227+0000 7f9eaebff780 1 < completed delete operation key=LRI5G5G8O5X4 tag=8IJUXLXIQUZX type=del 2024-09-12T17:07:52.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.228+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=V780Q48YCG5C type=write size=260396 2024-09-12T17:07:52.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.229+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~86HNF1V7GATW.0 size=715932 2024-09-12T17:07:52.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.231+0000 7f9eaebff780 1 < completed multipart upload key=YIEP2JYDSLW0 upload=86HNF1V7GATW tag=4QF0I8F6FK5Z type=write size=1764508 2024-09-12T17:07:52.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.233+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~PYL9PIR5L2VW.0 size=902415 2024-09-12T17:07:52.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.233+0000 7f9eaebff780 1 > prepared multipart upload key=TDZCNUZE8IOA upload=PYL9PIR5L2VW tag=416WPR7VNC0H type=write size=1950991 2024-09-12T17:07:52.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.234+0000 7f9eaebff780 1 < completed delete operation key=TXHXOMIB4B53 tag=2TAP7I7M1AZP type=del 2024-09-12T17:07:52.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.235+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=YJIU1FJ8PFOR type=write size=844091 2024-09-12T17:07:52.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.236+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~B8ZWRD13KWN0.0 size=1048576 2024-09-12T17:07:52.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.237+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~B8ZWRD13KWN0.1 size=1048576 2024-09-12T17:07:52.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.238+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~B8ZWRD13KWN0.2 size=338913 2024-09-12T17:07:52.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.240+0000 7f9eaebff780 1 < completed multipart upload key=UYF1AN2W59VN upload=B8ZWRD13KWN0 tag=25R69CG512L4 type=write size=3484641 2024-09-12T17:07:52.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.241+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=FOL29H0P7ZB7 type=write size=849326 2024-09-12T17:07:52.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.242+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~7K5D35KTSCW6.0 size=1048576 2024-09-12T17:07:52.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.243+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~7K5D35KTSCW6.1 size=706674 2024-09-12T17:07:52.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.245+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=7K5D35KTSCW6 tag=TE8ITR2OFQVF type=write size=2803826 2024-09-12T17:07:52.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.246+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=6NJU6KZX4WTR type=del size=3149339 2024-09-12T17:07:52.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.247+0000 7f9eaebff780 1 < canceled part key=_multipart_9I6RGNRB6HSY.2~X1H3ERUMO9LS.0 size=1048576 2024-09-12T17:07:52.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.247+0000 7f9eaebff780 1 < canceled part key=_multipart_9I6RGNRB6HSY.2~X1H3ERUMO9LS.1 size=857355 2024-09-12T17:07:52.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.249+0000 7f9eaebff780 1 < canceled multipart upload key=9I6RGNRB6HSY upload=X1H3ERUMO9LS tag=YJ43K1LHS9Y3 type=write size=2954507 2024-09-12T17:07:52.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.252+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~USWKY5QCYLUN.0 size=1048576 2024-09-12T17:07:52.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.253+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~USWKY5QCYLUN.1 size=648659 2024-09-12T17:07:52.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.253+0000 7f9eaebff780 1 > prepared multipart upload key=3VY271ZBO754 upload=USWKY5QCYLUN tag=WKCELJK2O3MU type=write size=2745811 2024-09-12T17:07:52.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.255+0000 7f9eaebff780 1 < suggested remove operation key=B1YC6DM9S8JJ tag=IKBZQ0EV0D2B type=del 2024-09-12T17:07:52.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.258+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~ZSKKA3DYOOAR.0 size=1048576 2024-09-12T17:07:52.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.259+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~ZSKKA3DYOOAR.1 size=110046 2024-09-12T17:07:52.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.259+0000 7f9eaebff780 1 > prepared multipart upload key=LRI5G5G8O5X4 upload=ZSKKA3DYOOAR tag=MTJTLO8SCG7G type=write size=2207198 2024-09-12T17:07:52.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.261+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~5EIB0K5L14MB.0 size=553711 2024-09-12T17:07:52.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.263+0000 7f9eaebff780 1 < completed multipart upload key=YIEP2JYDSLW0 upload=5EIB0K5L14MB tag=KSVRW1WI9RQ9 type=write size=1602287 2024-09-12T17:07:52.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.266+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~WK5HNB7N77LQ.0 size=1048576 2024-09-12T17:07:52.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.267+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~WK5HNB7N77LQ.1 size=1048576 2024-09-12T17:07:52.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.268+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~WK5HNB7N77LQ.2 size=222777 2024-09-12T17:07:52.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.268+0000 7f9eaebff780 1 > prepared multipart upload key=8DJLYFM11DNI upload=WK5HNB7N77LQ tag=VSGQQ5JUNALE type=write size=3368505 2024-09-12T17:07:52.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.270+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~31YJ3DEK90Y7.0 size=1048576 2024-09-12T17:07:52.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.270+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~31YJ3DEK90Y7.1 size=1048576 2024-09-12T17:07:52.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.272+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~31YJ3DEK90Y7.2 size=764516 2024-09-12T17:07:52.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.273+0000 7f9eaebff780 1 < completed multipart upload key=UYF1AN2W59VN upload=31YJ3DEK90Y7 tag=2MNM62Y661X5 type=write size=3910244 2024-09-12T17:07:52.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.276+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~HOSCGSO2AUK1.0 size=264781 2024-09-12T17:07:52.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.276+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=HOSCGSO2AUK1 tag=5PPJEEHMT40L type=write size=1313357 2024-09-12T17:07:52.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.277+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=0Q9CMBLGTWTV type=del 2024-09-12T17:07:52.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.279+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=2NJW17F8BUVF type=write size=469519 2024-09-12T17:07:52.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.280+0000 7f9eaebff780 1 < completed write operation key=A1KRCFY18QTP tag=SBH6Y49TSI0I type=write size=1014397 2024-09-12T17:07:52.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.282+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~3DJ83MYCCM01.0 size=8783 2024-09-12T17:07:52.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.282+0000 7f9eaebff780 1 > prepared multipart upload key=0F5LXJZMBFSP upload=3DJ83MYCCM01 tag=Y4GLEKMNQWF0 type=write size=1057359 2024-09-12T17:07:52.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.284+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~0ITNDLEXP404.0 size=259772 2024-09-12T17:07:52.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.286+0000 7f9eaebff780 1 < completed multipart upload key=ZC814TPVLJO1 upload=0ITNDLEXP404 tag=UVX0QRUXW70H type=write size=1308348 2024-09-12T17:07:52.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.287+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=D7OFENUDAEWI type=del size=1386470 2024-09-12T17:07:52.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.289+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=X0Y3MSC2HMRV type=del 2024-09-12T17:07:52.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.291+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~OO9HIK5AY4FM.0 size=1048576 2024-09-12T17:07:52.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.292+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~OO9HIK5AY4FM.1 size=643021 2024-09-12T17:07:52.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.292+0000 7f9eaebff780 1 > prepared multipart upload key=LRI5G5G8O5X4 upload=OO9HIK5AY4FM tag=LXD0B69V8U21 type=write size=2740173 2024-09-12T17:07:52.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.293+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~RXZPTR4ED6RY.0 size=1048576 2024-09-12T17:07:52.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.293+0000 7f9eaebff780 1 < canceled part key=_multipart_ZC814TPVLJO1.2~RXZPTR4ED6RY.1 size=1048576 2024-09-12T17:07:52.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.294+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~RXZPTR4ED6RY.2 size=374987 2024-09-12T17:07:52.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.297+0000 7f9eaebff780 1 < canceled multipart upload key=ZC814TPVLJO1 upload=RXZPTR4ED6RY tag=X0UP3SC34O85 type=write size=3520715 2024-09-12T17:07:52.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.298+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=2KXB1YHHP9K2 type=del size=2641377 2024-09-12T17:07:52.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.299+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~WKVVVYHDWSDW.0 size=50948 2024-09-12T17:07:52.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.301+0000 7f9eaebff780 1 < completed multipart upload key=9WJGBODZ60NJ upload=WKVVVYHDWSDW tag=Y59FAMQNSH0I type=write size=1099524 2024-09-12T17:07:52.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.302+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=LFV42DPRLZ30 type=del size=1010199 2024-09-12T17:07:52.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.303+0000 7f9eaebff780 1 < canceled operation key=A1KRCFY18QTP tag=PYAW53Z9AX1I type=write size=655475 2024-09-12T17:07:52.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.305+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=XNG21BI1O66F type=write size=141139 2024-09-12T17:07:52.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.306+0000 7f9eaebff780 1 < completed write operation key=0YD5P1ACZ09Q tag=V780Q48YCG5C type=write size=260396 2024-09-12T17:07:52.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.307+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=0KA81FWBK7O0 type=del size=762872 2024-09-12T17:07:52.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.308+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~PYL9PIR5L2VW.0 size=902415 2024-09-12T17:07:52.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.310+0000 7f9eaebff780 1 < completed multipart upload key=TDZCNUZE8IOA upload=PYL9PIR5L2VW tag=416WPR7VNC0H type=write size=1950991 2024-09-12T17:07:52.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.312+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~D2GONYBWK9LT.0 size=1048576 2024-09-12T17:07:52.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.313+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~D2GONYBWK9LT.1 size=1048576 2024-09-12T17:07:52.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.314+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~D2GONYBWK9LT.2 size=1001294 2024-09-12T17:07:52.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.314+0000 7f9eaebff780 1 > prepared multipart upload key=GB8P7K59Y8VI upload=D2GONYBWK9LT tag=GA9LE3MG324Z type=write size=4147022 2024-09-12T17:07:52.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.315+0000 7f9eaebff780 1 < canceled operation key=ZYP3P4031PUZ tag=YJIU1FJ8PFOR type=write size=844091 2024-09-12T17:07:52.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.317+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=GCYQWQPC6B16 type=del size=1813001 2024-09-12T17:07:52.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.318+0000 7f9eaebff780 1 < completed write operation key=P9GMGM3WK6O7 tag=FOL29H0P7ZB7 type=write size=849326 2024-09-12T17:07:52.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.319+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=OC4SB5DAVPT6 type=del size=3654662 2024-09-12T17:07:52.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.320+0000 7f9eaebff780 1 < completed delete operation key=8DJLYFM11DNI tag=6NJU6KZX4WTR type=del 2024-09-12T17:07:52.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.321+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=FQFDJJXE6IAD type=del size=3280372 2024-09-12T17:07:52.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.323+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~USWKY5QCYLUN.0 size=1048576 2024-09-12T17:07:52.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.324+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~USWKY5QCYLUN.1 size=648659 2024-09-12T17:07:52.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.326+0000 7f9eaebff780 1 < completed multipart upload key=3VY271ZBO754 upload=USWKY5QCYLUN tag=WKCELJK2O3MU type=write size=2745811 2024-09-12T17:07:52.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.327+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=IW8TQJD6TIXW type=write size=366314 2024-09-12T17:07:52.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.329+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~ZSKKA3DYOOAR.0 size=1048576 2024-09-12T17:07:52.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.329+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~ZSKKA3DYOOAR.1 size=110046 2024-09-12T17:07:52.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.331+0000 7f9eaebff780 1 < completed multipart upload key=LRI5G5G8O5X4 upload=ZSKKA3DYOOAR tag=MTJTLO8SCG7G type=write size=2207198 2024-09-12T17:07:52.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.333+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=LPLM2MBQ3FDD type=del size=2321822 2024-09-12T17:07:52.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.334+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~WK5HNB7N77LQ.0 size=1048576 2024-09-12T17:07:52.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.335+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~WK5HNB7N77LQ.1 size=1048576 2024-09-12T17:07:52.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.336+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~WK5HNB7N77LQ.2 size=222777 2024-09-12T17:07:52.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.339+0000 7f9eaebff780 1 < completed multipart upload key=8DJLYFM11DNI upload=WK5HNB7N77LQ tag=VSGQQ5JUNALE type=write size=3368505 2024-09-12T17:07:52.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.340+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=JUVGTF0OQYWX type=del size=357159 2024-09-12T17:07:52.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.341+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~HOSCGSO2AUK1.0 size=264781 2024-09-12T17:07:52.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.343+0000 7f9eaebff780 1 < completed multipart upload key=M3PLQGSK34YM upload=HOSCGSO2AUK1 tag=5PPJEEHMT40L type=write size=1313357 2024-09-12T17:07:52.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.345+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~2M2E5KFZ4M0O.0 size=1048576 2024-09-12T17:07:52.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.346+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~2M2E5KFZ4M0O.1 size=1048576 2024-09-12T17:07:52.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.347+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~2M2E5KFZ4M0O.2 size=10113 2024-09-12T17:07:52.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.347+0000 7f9eaebff780 1 > prepared multipart upload key=B1YC6DM9S8JJ upload=2M2E5KFZ4M0O tag=ALHHZBWUSRNB type=write size=3155841 2024-09-12T17:07:52.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.348+0000 7f9eaebff780 1 < canceled operation key=K0P9ZZ91UJJ8 tag=2NJW17F8BUVF type=write size=469519 2024-09-12T17:07:52.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.349+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=BTI1AONJ5PMH type=write size=44439 2024-09-12T17:07:52.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.351+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~3DJ83MYCCM01.0 size=8783 2024-09-12T17:07:52.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.353+0000 7f9eaebff780 1 < completed multipart upload key=0F5LXJZMBFSP upload=3DJ83MYCCM01 tag=Y4GLEKMNQWF0 type=write size=1057359 2024-09-12T17:07:52.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.354+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=3CSUH0TTPATR type=del size=2877799 2024-09-12T17:07:52.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.356+0000 7f9eaebff780 1 < suggested update operation key=M3PLQGSK34YM tag=D7OFENUDAEWI type=del size=1386470 2024-09-12T17:07:52.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.357+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=MY0FUYHM40VX type=del size=3532310 2024-09-12T17:07:52.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.359+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~OO9HIK5AY4FM.0 size=1048576 2024-09-12T17:07:52.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.360+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~OO9HIK5AY4FM.1 size=643021 2024-09-12T17:07:52.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.362+0000 7f9eaebff780 1 < completed multipart upload key=LRI5G5G8O5X4 upload=OO9HIK5AY4FM tag=LXD0B69V8U21 type=write size=2740173 2024-09-12T17:07:52.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.364+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~8N3WO7S7JZMR.0 size=1048576 2024-09-12T17:07:52.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.365+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~8N3WO7S7JZMR.1 size=773829 2024-09-12T17:07:52.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.365+0000 7f9eaebff780 1 > prepared multipart upload key=LJN514F16XJA upload=8N3WO7S7JZMR tag=YYJJRMF6PKXF type=write size=2870981 2024-09-12T17:07:52.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.366+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=2KXB1YHHP9K2 type=del 2024-09-12T17:07:52.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.368+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~31IFG3W048KL.0 size=275704 2024-09-12T17:07:52.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.368+0000 7f9eaebff780 1 > prepared multipart upload key=7PBT9VZ07OUI upload=31IFG3W048KL tag=EGJAPH72N571 type=write size=1324280 2024-09-12T17:07:52.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.371+0000 7f9eaebff780 1 < suggested update operation key=7PBT9VZ07OUI tag=LFV42DPRLZ30 type=del size=1010199 2024-09-12T17:07:52.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.372+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=IU5KJMZN6ZF5 type=write size=17346 2024-09-12T17:07:52.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.373+0000 7f9eaebff780 1 < completed write operation key=SVWPQETL92QU tag=XNG21BI1O66F type=write size=141139 2024-09-12T17:07:52.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.376+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~KH64MFTYYI7U.0 size=1048576 2024-09-12T17:07:52.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.377+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~KH64MFTYYI7U.1 size=1048576 2024-09-12T17:07:52.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.378+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~KH64MFTYYI7U.2 size=333352 2024-09-12T17:07:52.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.378+0000 7f9eaebff780 1 > prepared multipart upload key=A1KRCFY18QTP upload=KH64MFTYYI7U tag=TMG9DN50GSRA type=write size=3479080 2024-09-12T17:07:52.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.379+0000 7f9eaebff780 1 < completed delete operation key=TXHXOMIB4B53 tag=0KA81FWBK7O0 type=del 2024-09-12T17:07:52.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.381+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~TMNAHTRG45GD.0 size=1048576 2024-09-12T17:07:52.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.382+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~TMNAHTRG45GD.1 size=1043427 2024-09-12T17:07:52.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.382+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=TMNAHTRG45GD tag=KI79ISFQYYCV type=write size=3140579 2024-09-12T17:07:52.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.382+0000 7f9eaebff780 1 < canceled part key=_multipart_GB8P7K59Y8VI.2~D2GONYBWK9LT.0 size=1048576 2024-09-12T17:07:52.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.383+0000 7f9eaebff780 1 < completed part key=_multipart_GB8P7K59Y8VI.2~D2GONYBWK9LT.1 size=1048576 2024-09-12T17:07:52.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.383+0000 7f9eaebff780 1 < canceled part key=_multipart_GB8P7K59Y8VI.2~D2GONYBWK9LT.2 size=1001294 2024-09-12T17:07:52.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.386+0000 7f9eaebff780 1 < canceled multipart upload key=GB8P7K59Y8VI upload=D2GONYBWK9LT tag=GA9LE3MG324Z type=write size=4147022 2024-09-12T17:07:52.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.387+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=3QU1NPWQT69W type=del size=3509548 2024-09-12T17:07:52.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.388+0000 7f9eaebff780 1 < completed delete operation key=GB8P7K59Y8VI tag=GCYQWQPC6B16 type=del 2024-09-12T17:07:52.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.389+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=AOITDD9EKNJC type=del size=341806 2024-09-12T17:07:52.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.391+0000 7f9eaebff780 1 < completed delete operation key=ZC814TPVLJO1 tag=OC4SB5DAVPT6 type=del 2024-09-12T17:07:52.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.393+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~FWJ531AH1XM7.0 size=963883 2024-09-12T17:07:52.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.393+0000 7f9eaebff780 1 > prepared multipart upload key=7PBT9VZ07OUI upload=FWJ531AH1XM7 tag=SVCLQ3YNJAA4 type=write size=2012459 2024-09-12T17:07:52.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.394+0000 7f9eaebff780 1 < completed delete operation key=LRI5G5G8O5X4 tag=FQFDJJXE6IAD type=del 2024-09-12T17:07:52.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.397+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~QQBO1X4A37GM.0 size=830838 2024-09-12T17:07:52.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.397+0000 7f9eaebff780 1 > prepared multipart upload key=7PBT9VZ07OUI upload=QQBO1X4A37GM tag=QIEP3W35AS6G type=write size=1879414 2024-09-12T17:07:52.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.399+0000 7f9eaebff780 1 < suggested remove operation key=B1YC6DM9S8JJ tag=IW8TQJD6TIXW type=write 2024-09-12T17:07:52.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.400+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=4K2I4GA6F11J type=del size=3219149 2024-09-12T17:07:52.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.403+0000 7f9eaebff780 1 < suggested remove operation key=OH6GXTMPBYUY tag=LPLM2MBQ3FDD type=del 2024-09-12T17:07:52.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.405+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~7HKL23V9S3P9.0 size=1048576 2024-09-12T17:07:52.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.406+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~7HKL23V9S3P9.1 size=669081 2024-09-12T17:07:52.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.406+0000 7f9eaebff780 1 > prepared multipart upload key=8DJLYFM11DNI upload=7HKL23V9S3P9 tag=HHAFUXGHS627 type=write size=2766233 2024-09-12T17:07:52.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.407+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=JUVGTF0OQYWX type=del 2024-09-12T17:07:52.410 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.409+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=YDPB1V241MKS type=del size=2625270 2024-09-12T17:07:52.411 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.410+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~2M2E5KFZ4M0O.0 size=1048576 2024-09-12T17:07:52.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.411+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~2M2E5KFZ4M0O.1 size=1048576 2024-09-12T17:07:52.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.412+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~2M2E5KFZ4M0O.2 size=10113 2024-09-12T17:07:52.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.414+0000 7f9eaebff780 1 < completed multipart upload key=B1YC6DM9S8JJ upload=2M2E5KFZ4M0O tag=ALHHZBWUSRNB type=write size=3155841 2024-09-12T17:07:52.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.415+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=ZUAG7V8NURLP type=del size=2010187 2024-09-12T17:07:52.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.418+0000 7f9eaebff780 1 < suggested remove operation key=K2NHRSUDQBRW tag=BTI1AONJ5PMH type=write 2024-09-12T17:07:52.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.419+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=2AUQI61BU3BX type=del size=645437 2024-09-12T17:07:52.423 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.421+0000 7f9eaebff780 1 < suggested remove operation key=9I6RGNRB6HSY tag=3CSUH0TTPATR type=del 2024-09-12T17:07:52.424 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.422+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=842AG6KHGJD4 type=write size=474137 2024-09-12T17:07:52.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.425+0000 7f9eaebff780 1 < suggested remove operation key=ZYP3P4031PUZ tag=MY0FUYHM40VX type=del 2024-09-12T17:07:52.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.427+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~85NZK3RILH07.0 size=1048576 2024-09-12T17:07:52.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.428+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~85NZK3RILH07.1 size=1048576 2024-09-12T17:07:52.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.430+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~85NZK3RILH07.2 size=889937 2024-09-12T17:07:52.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.430+0000 7f9eaebff780 1 > prepared multipart upload key=9I6RGNRB6HSY upload=85NZK3RILH07 tag=5QIZ00REGIH1 type=write size=4035665 2024-09-12T17:07:52.432 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.431+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~8N3WO7S7JZMR.0 size=1048576 2024-09-12T17:07:52.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.432+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~8N3WO7S7JZMR.1 size=773829 2024-09-12T17:07:52.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.434+0000 7f9eaebff780 1 < completed multipart upload key=LJN514F16XJA upload=8N3WO7S7JZMR tag=YYJJRMF6PKXF type=write size=2870981 2024-09-12T17:07:52.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.437+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~GPKO0XJSQHS5.0 size=210843 2024-09-12T17:07:52.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.437+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=GPKO0XJSQHS5 tag=SS9PXIPIHVAB type=write size=1259419 2024-09-12T17:07:52.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.438+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~31IFG3W048KL.0 size=275704 2024-09-12T17:07:52.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.441+0000 7f9eaebff780 1 < completed multipart upload key=7PBT9VZ07OUI upload=31IFG3W048KL tag=EGJAPH72N571 type=write size=1324280 2024-09-12T17:07:52.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.442+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=GRBVKS0X0CLE type=del size=2877529 2024-09-12T17:07:52.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.444+0000 7f9eaebff780 1 < canceled operation key=0YD5P1ACZ09Q tag=IU5KJMZN6ZF5 type=write size=17346 2024-09-12T17:07:52.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.446+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~8AWESIX9AD6I.0 size=1048576 2024-09-12T17:07:52.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.448+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~8AWESIX9AD6I.1 size=1048576 2024-09-12T17:07:52.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.449+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~8AWESIX9AD6I.2 size=717937 2024-09-12T17:07:52.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.449+0000 7f9eaebff780 1 > prepared multipart upload key=ZYP3P4031PUZ upload=8AWESIX9AD6I tag=CN88CUKU5S1U type=write size=3863665 2024-09-12T17:07:52.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.450+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~KH64MFTYYI7U.0 size=1048576 2024-09-12T17:07:52.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.451+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~KH64MFTYYI7U.1 size=1048576 2024-09-12T17:07:52.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.451+0000 7f9eaebff780 1 < canceled part key=_multipart_A1KRCFY18QTP.2~KH64MFTYYI7U.2 size=333352 2024-09-12T17:07:52.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.453+0000 7f9eaebff780 1 < canceled multipart upload key=A1KRCFY18QTP upload=KH64MFTYYI7U tag=TMG9DN50GSRA type=write size=3479080 2024-09-12T17:07:52.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.456+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=25ETJYPMUKP9 type=write size=460141 2024-09-12T17:07:52.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.457+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~TMNAHTRG45GD.0 size=1048576 2024-09-12T17:07:52.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.458+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~TMNAHTRG45GD.1 size=1043427 2024-09-12T17:07:52.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.460+0000 7f9eaebff780 1 < completed multipart upload key=SHWT6AT7PN0M upload=TMNAHTRG45GD tag=KI79ISFQYYCV type=write size=3140579 2024-09-12T17:07:52.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.461+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=P399VFL4OOAX type=del size=4168354 2024-09-12T17:07:52.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.463+0000 7f9eaebff780 1 < completed delete operation key=P9GMGM3WK6O7 tag=3QU1NPWQT69W type=del 2024-09-12T17:07:52.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.465+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~NFQ620QR7S3E.0 size=1048576 2024-09-12T17:07:52.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.466+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~NFQ620QR7S3E.1 size=1048576 2024-09-12T17:07:52.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.467+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~NFQ620QR7S3E.2 size=615475 2024-09-12T17:07:52.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.467+0000 7f9eaebff780 1 > prepared multipart upload key=0YD5P1ACZ09Q upload=NFQ620QR7S3E tag=7CEY3F754DD8 type=write size=3761203 2024-09-12T17:07:52.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.468+0000 7f9eaebff780 1 < canceled operation key=TDZCNUZE8IOA tag=AOITDD9EKNJC type=del size=341806 2024-09-12T17:07:52.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.470+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=DMWA2XMSRU8G type=del size=3764635 2024-09-12T17:07:52.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.471+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~FWJ531AH1XM7.0 size=963883 2024-09-12T17:07:52.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.473+0000 7f9eaebff780 1 < completed multipart upload key=7PBT9VZ07OUI upload=FWJ531AH1XM7 tag=SVCLQ3YNJAA4 type=write size=2012459 2024-09-12T17:07:52.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.474+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=X4KG00ZRM1PA type=del size=539428 2024-09-12T17:07:52.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.476+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~QQBO1X4A37GM.0 size=830838 2024-09-12T17:07:52.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.478+0000 7f9eaebff780 1 < completed multipart upload key=7PBT9VZ07OUI upload=QQBO1X4A37GM tag=QIEP3W35AS6G type=write size=1879414 2024-09-12T17:07:52.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.479+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=2ZG8KPO1ZPH5 type=write size=151096 2024-09-12T17:07:52.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.481+0000 7f9eaebff780 1 < suggested remove operation key=LJN514F16XJA tag=4K2I4GA6F11J type=del 2024-09-12T17:07:52.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.484+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~XUI6U2RLR4FM.0 size=189706 2024-09-12T17:07:52.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.484+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=XUI6U2RLR4FM tag=M59H523B9CET type=write size=1238282 2024-09-12T17:07:52.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.485+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~7HKL23V9S3P9.0 size=1048576 2024-09-12T17:07:52.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.486+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~7HKL23V9S3P9.1 size=669081 2024-09-12T17:07:52.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.489+0000 7f9eaebff780 1 < completed multipart upload key=8DJLYFM11DNI upload=7HKL23V9S3P9 tag=HHAFUXGHS627 type=write size=2766233 2024-09-12T17:07:52.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.491+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~SE4PQNMMEMYB.0 size=1048576 2024-09-12T17:07:52.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.492+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~SE4PQNMMEMYB.1 size=1048576 2024-09-12T17:07:52.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.493+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~SE4PQNMMEMYB.2 size=428627 2024-09-12T17:07:52.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.493+0000 7f9eaebff780 1 > prepared multipart upload key=KF8XE48DI9KZ upload=SE4PQNMMEMYB tag=U482AC2299J8 type=write size=3574355 2024-09-12T17:07:52.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.494+0000 7f9eaebff780 1 < completed delete operation key=EKUW5AKC428U tag=YDPB1V241MKS type=del 2024-09-12T17:07:52.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.496+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=2NWQLDPA5Q6J type=del size=4177731 2024-09-12T17:07:52.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.497+0000 7f9eaebff780 1 < completed delete operation key=7PBT9VZ07OUI tag=ZUAG7V8NURLP type=del 2024-09-12T17:07:52.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.498+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=OZ8HIM2HYNQ5 type=del size=3008937 2024-09-12T17:07:52.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.499+0000 7f9eaebff780 -1 < failed to complete operation key=LJN514F16XJA tag=2AUQI61BU3BX type=del size=645437: (22) Invalid argument 2024-09-12T17:07:52.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.501+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=ZS3UVJOXT6K4 type=del size=3345631 2024-09-12T17:07:52.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.502+0000 7f9eaebff780 1 < canceled operation key=3LY681252WAN tag=842AG6KHGJD4 type=write size=474137 2024-09-12T17:07:52.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.504+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~A6V8H2K53Z71.0 size=891537 2024-09-12T17:07:52.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.504+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=A6V8H2K53Z71 tag=AYDCQCU6XVG2 type=write size=1940113 2024-09-12T17:07:52.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.504+0000 7f9eaebff780 1 < canceled part key=_multipart_9I6RGNRB6HSY.2~85NZK3RILH07.0 size=1048576 2024-09-12T17:07:52.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.505+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~85NZK3RILH07.1 size=1048576 2024-09-12T17:07:52.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.506+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~85NZK3RILH07.2 size=889937 2024-09-12T17:07:52.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.508+0000 7f9eaebff780 1 < canceled multipart upload key=9I6RGNRB6HSY upload=85NZK3RILH07 tag=5QIZ00REGIH1 type=write size=4035665 2024-09-12T17:07:52.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.510+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~SB8C6SAISF1Q.0 size=1048576 2024-09-12T17:07:52.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.511+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~SB8C6SAISF1Q.1 size=1048576 2024-09-12T17:07:52.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.512+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~SB8C6SAISF1Q.2 size=618648 2024-09-12T17:07:52.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.512+0000 7f9eaebff780 1 > prepared multipart upload key=CAIZM33SDFPM upload=SB8C6SAISF1Q tag=AQF24JYXQZBM type=write size=3764376 2024-09-12T17:07:52.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.513+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~GPKO0XJSQHS5.0 size=210843 2024-09-12T17:07:52.517 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.515+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=GPKO0XJSQHS5 tag=SS9PXIPIHVAB type=write size=1259419 2024-09-12T17:07:52.518 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.517+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=CN7YOFEHN0FD type=del size=3230301 2024-09-12T17:07:52.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.518+0000 7f9eaebff780 1 < completed delete operation key=B1YC6DM9S8JJ tag=GRBVKS0X0CLE type=del 2024-09-12T17:07:52.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.520+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~H7PRQO2TVWBB.0 size=1048576 2024-09-12T17:07:52.523 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.521+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~H7PRQO2TVWBB.1 size=1048576 2024-09-12T17:07:52.523 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.522+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~H7PRQO2TVWBB.2 size=1032314 2024-09-12T17:07:52.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.522+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=H7PRQO2TVWBB tag=DT37WI5ZKYIP type=write size=4178042 2024-09-12T17:07:52.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.523+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~8AWESIX9AD6I.0 size=1048576 2024-09-12T17:07:52.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.524+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~8AWESIX9AD6I.1 size=1048576 2024-09-12T17:07:52.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.525+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~8AWESIX9AD6I.2 size=717937 2024-09-12T17:07:52.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.527+0000 7f9eaebff780 1 < completed multipart upload key=ZYP3P4031PUZ upload=8AWESIX9AD6I tag=CN88CUKU5S1U type=write size=3863665 2024-09-12T17:07:52.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.529+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=X8T9R4WZFAR8 type=del size=3905288 2024-09-12T17:07:52.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.530+0000 7f9eaebff780 1 < completed write operation key=SO6QF2JCRX6E tag=25ETJYPMUKP9 type=write size=460141 2024-09-12T17:07:52.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.532+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~0JRSG4GISFRW.0 size=1048576 2024-09-12T17:07:52.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.533+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~0JRSG4GISFRW.1 size=532169 2024-09-12T17:07:52.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.533+0000 7f9eaebff780 1 > prepared multipart upload key=LRI5G5G8O5X4 upload=0JRSG4GISFRW tag=WR26R36VJ4GR type=write size=2629321 2024-09-12T17:07:52.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.534+0000 7f9eaebff780 1 < completed delete operation key=ZC814TPVLJO1 tag=P399VFL4OOAX type=del 2024-09-12T17:07:52.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.537+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~NUKLDLBXP0E5.0 size=1048576 2024-09-12T17:07:52.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.538+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~NUKLDLBXP0E5.1 size=1048576 2024-09-12T17:07:52.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.539+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~NUKLDLBXP0E5.2 size=627487 2024-09-12T17:07:52.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.539+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=NUKLDLBXP0E5 tag=N7FW18XEJC6R type=write size=3773215 2024-09-12T17:07:52.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.540+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~NFQ620QR7S3E.0 size=1048576 2024-09-12T17:07:52.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.541+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~NFQ620QR7S3E.1 size=1048576 2024-09-12T17:07:52.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.542+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~NFQ620QR7S3E.2 size=615475 2024-09-12T17:07:52.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.544+0000 7f9eaebff780 1 < completed multipart upload key=0YD5P1ACZ09Q upload=NFQ620QR7S3E tag=7CEY3F754DD8 type=write size=3761203 2024-09-12T17:07:52.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.545+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=I8KJY6632RCB type=write size=665281 2024-09-12T17:07:52.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.547+0000 7f9eaebff780 1 < completed delete operation key=9I6RGNRB6HSY tag=DMWA2XMSRU8G type=del 2024-09-12T17:07:52.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.548+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=9F643LJ5IPH4 type=del size=764668 2024-09-12T17:07:52.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.550+0000 7f9eaebff780 1 < suggested update operation key=TXHXOMIB4B53 tag=X4KG00ZRM1PA type=del size=539428 2024-09-12T17:07:52.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.552+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=C8X7Y2D1V9GE type=del size=3485179 2024-09-12T17:07:52.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.554+0000 7f9eaebff780 1 < suggested update operation key=OGD6H9VSVGWF tag=2ZG8KPO1ZPH5 type=write size=151096 2024-09-12T17:07:52.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.556+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~S62B0WA6WGN4.0 size=13531 2024-09-12T17:07:52.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.556+0000 7f9eaebff780 1 > prepared multipart upload key=LJN514F16XJA upload=S62B0WA6WGN4 tag=NE76JKZBTE2I type=write size=1062107 2024-09-12T17:07:52.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.558+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~XUI6U2RLR4FM.0 size=189706 2024-09-12T17:07:52.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.560+0000 7f9eaebff780 1 < completed multipart upload key=K2NHRSUDQBRW upload=XUI6U2RLR4FM tag=M59H523B9CET type=write size=1238282 2024-09-12T17:07:52.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.562+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~398DMLA35T1L.0 size=2229 2024-09-12T17:07:52.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.562+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=398DMLA35T1L tag=HP2HNZY2E5XR type=write size=1050805 2024-09-12T17:07:52.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.563+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~SE4PQNMMEMYB.0 size=1048576 2024-09-12T17:07:52.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.564+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~SE4PQNMMEMYB.1 size=1048576 2024-09-12T17:07:52.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.565+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~SE4PQNMMEMYB.2 size=428627 2024-09-12T17:07:52.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.567+0000 7f9eaebff780 1 < completed multipart upload key=KF8XE48DI9KZ upload=SE4PQNMMEMYB tag=U482AC2299J8 type=write size=3574355 2024-09-12T17:07:52.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.569+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=0Y1D76BFC7O1 type=del size=2243971 2024-09-12T17:07:52.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.574+0000 7f9eaebff780 1 < suggested remove operation key=9I6RGNRB6HSY tag=2NWQLDPA5Q6J type=del 2024-09-12T17:07:52.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.576+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=4WO33389WSM0 type=del size=3203379 2024-09-12T17:07:52.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.578+0000 7f9eaebff780 1 < suggested update operation key=TXHXOMIB4B53 tag=OZ8HIM2HYNQ5 type=del size=3008937 2024-09-12T17:07:52.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.580+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~D826UYJ0L5QM.0 size=1048576 2024-09-12T17:07:52.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.582+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~D826UYJ0L5QM.1 size=1048576 2024-09-12T17:07:52.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.583+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~D826UYJ0L5QM.2 size=487756 2024-09-12T17:07:52.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.583+0000 7f9eaebff780 1 > prepared multipart upload key=OGD6H9VSVGWF upload=D826UYJ0L5QM tag=B89S209EK1PV type=write size=3633484 2024-09-12T17:07:52.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.585+0000 7f9eaebff780 1 < suggested remove operation key=M3PLQGSK34YM tag=ZS3UVJOXT6K4 type=del 2024-09-12T17:07:52.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.586+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=LRGP6VPHY4NF type=del size=1676398 2024-09-12T17:07:52.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.587+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~A6V8H2K53Z71.0 size=891537 2024-09-12T17:07:52.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.589+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=A6V8H2K53Z71 tag=AYDCQCU6XVG2 type=write size=1940113 2024-09-12T17:07:52.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.591+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~SN3C6MDN7B6T.0 size=120025 2024-09-12T17:07:52.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.591+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=SN3C6MDN7B6T tag=V9M8TNETVU7N type=write size=1168601 2024-09-12T17:07:52.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.593+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~SB8C6SAISF1Q.0 size=1048576 2024-09-12T17:07:52.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.594+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~SB8C6SAISF1Q.1 size=1048576 2024-09-12T17:07:52.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.594+0000 7f9eaebff780 1 < canceled part key=_multipart_CAIZM33SDFPM.2~SB8C6SAISF1Q.2 size=618648 2024-09-12T17:07:52.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.595+0000 7f9eaebff780 1 < canceled multipart upload key=CAIZM33SDFPM upload=SB8C6SAISF1Q tag=AQF24JYXQZBM type=write size=3764376 2024-09-12T17:07:52.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.597+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~RNKITGH8OYXD.0 size=1048576 2024-09-12T17:07:52.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.598+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~RNKITGH8OYXD.1 size=236253 2024-09-12T17:07:52.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.598+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=RNKITGH8OYXD tag=220C9KNZCZNP type=write size=2333405 2024-09-12T17:07:52.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.600+0000 7f9eaebff780 1 < completed delete operation key=QIMNK4DL3D0N tag=CN7YOFEHN0FD type=del 2024-09-12T17:07:52.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.601+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=222061J02TEA type=del size=1089621 2024-09-12T17:07:52.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.602+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~H7PRQO2TVWBB.0 size=1048576 2024-09-12T17:07:52.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.603+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~H7PRQO2TVWBB.1 size=1048576 2024-09-12T17:07:52.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.604+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~H7PRQO2TVWBB.2 size=1032314 2024-09-12T17:07:52.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.606+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=H7PRQO2TVWBB tag=DT37WI5ZKYIP type=write size=4178042 2024-09-12T17:07:52.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.608+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~DFO5AIN7W5OW.0 size=1048576 2024-09-12T17:07:52.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.609+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~DFO5AIN7W5OW.1 size=589713 2024-09-12T17:07:52.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.609+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=DFO5AIN7W5OW tag=7JYKZWC48O30 type=write size=2686865 2024-09-12T17:07:52.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.610+0000 7f9eaebff780 1 < completed delete operation key=UYF1AN2W59VN tag=X8T9R4WZFAR8 type=del 2024-09-12T17:07:52.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.611+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=CVEFGHMLH9QH type=del size=1126357 2024-09-12T17:07:52.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.612+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~0JRSG4GISFRW.0 size=1048576 2024-09-12T17:07:52.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.613+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~0JRSG4GISFRW.1 size=532169 2024-09-12T17:07:52.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.615+0000 7f9eaebff780 1 < completed multipart upload key=LRI5G5G8O5X4 upload=0JRSG4GISFRW tag=WR26R36VJ4GR type=write size=2629321 2024-09-12T17:07:52.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.618+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~01ZBR36ULGOS.0 size=1048576 2024-09-12T17:07:52.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.619+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~01ZBR36ULGOS.1 size=1048576 2024-09-12T17:07:52.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.620+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~01ZBR36ULGOS.2 size=575456 2024-09-12T17:07:52.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.620+0000 7f9eaebff780 1 > prepared multipart upload key=ZC814TPVLJO1 upload=01ZBR36ULGOS tag=AKFQBOUZKJ7P type=write size=3721184 2024-09-12T17:07:52.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.620+0000 7f9eaebff780 1 < canceled part key=_multipart_UYF1AN2W59VN.2~NUKLDLBXP0E5.0 size=1048576 2024-09-12T17:07:52.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.621+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~NUKLDLBXP0E5.1 size=1048576 2024-09-12T17:07:52.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.621+0000 7f9eaebff780 1 < canceled part key=_multipart_UYF1AN2W59VN.2~NUKLDLBXP0E5.2 size=627487 2024-09-12T17:07:52.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.623+0000 7f9eaebff780 1 < canceled multipart upload key=UYF1AN2W59VN upload=NUKLDLBXP0E5 tag=N7FW18XEJC6R type=write size=3773215 2024-09-12T17:07:52.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.624+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=QX1DA5S0Y0EV type=del size=6225 2024-09-12T17:07:52.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.626+0000 7f9eaebff780 1 < completed write operation key=K0P9ZZ91UJJ8 tag=I8KJY6632RCB type=write size=665281 2024-09-12T17:07:52.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.627+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=YOT7HP4NFQQ7 type=del size=3734248 2024-09-12T17:07:52.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.629+0000 7f9eaebff780 1 < suggested remove operation key=TXHXOMIB4B53 tag=9F643LJ5IPH4 type=del 2024-09-12T17:07:52.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.630+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=W3Q0SKIVR2K7 type=del size=2123543 2024-09-12T17:07:52.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.632+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=C8X7Y2D1V9GE type=del 2024-09-12T17:07:52.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.634+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~X2CS6S0N9TI0.0 size=1048576 2024-09-12T17:07:52.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.635+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~X2CS6S0N9TI0.1 size=184183 2024-09-12T17:07:52.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.635+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=X2CS6S0N9TI0 tag=80RK6I9X3QUQ type=write size=2281335 2024-09-12T17:07:52.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.636+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~S62B0WA6WGN4.0 size=13531 2024-09-12T17:07:52.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.638+0000 7f9eaebff780 1 < completed multipart upload key=LJN514F16XJA upload=S62B0WA6WGN4 tag=NE76JKZBTE2I type=write size=1062107 2024-09-12T17:07:52.640 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.639+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=NIBEJRK9R2VT type=del size=2345275 2024-09-12T17:07:52.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.640+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~398DMLA35T1L.0 size=2229 2024-09-12T17:07:52.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.642+0000 7f9eaebff780 1 < completed multipart upload key=SHWT6AT7PN0M upload=398DMLA35T1L tag=HP2HNZY2E5XR type=write size=1050805 2024-09-12T17:07:52.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.644+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~9W7MYGV20TZF.0 size=323421 2024-09-12T17:07:52.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.644+0000 7f9eaebff780 1 > prepared multipart upload key=SO6QF2JCRX6E upload=9W7MYGV20TZF tag=JTG4BFQHGQPA type=write size=1371997 2024-09-12T17:07:52.647 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.646+0000 7f9eaebff780 1 < completed delete operation key=LRI5G5G8O5X4 tag=0Y1D76BFC7O1 type=del 2024-09-12T17:07:52.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.648+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~LFRWRXUMBE7E.0 size=1048576 2024-09-12T17:07:52.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.649+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~LFRWRXUMBE7E.1 size=1048576 2024-09-12T17:07:52.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.649+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~LFRWRXUMBE7E.2 size=226661 2024-09-12T17:07:52.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.649+0000 7f9eaebff780 1 > prepared multipart upload key=ZYP3P4031PUZ upload=LFRWRXUMBE7E tag=MJ7FDHRMMUFG type=write size=3372389 2024-09-12T17:07:52.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.652+0000 7f9eaebff780 1 < suggested update operation key=LJN514F16XJA tag=4WO33389WSM0 type=del size=3203379 2024-09-12T17:07:52.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.654+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~ARAI76MM2EJB.0 size=949367 2024-09-12T17:07:52.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.654+0000 7f9eaebff780 1 > prepared multipart upload key=3LY681252WAN upload=ARAI76MM2EJB tag=T7KGZJ30YBJT type=write size=1997943 2024-09-12T17:07:52.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.655+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~D826UYJ0L5QM.0 size=1048576 2024-09-12T17:07:52.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.656+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~D826UYJ0L5QM.1 size=1048576 2024-09-12T17:07:52.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.657+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~D826UYJ0L5QM.2 size=487756 2024-09-12T17:07:52.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.659+0000 7f9eaebff780 1 < completed multipart upload key=OGD6H9VSVGWF upload=D826UYJ0L5QM tag=B89S209EK1PV type=write size=3633484 2024-09-12T17:07:52.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.660+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=TOO73SAI41RY type=del size=911463 2024-09-12T17:07:52.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.662+0000 7f9eaebff780 1 < suggested update operation key=SHWT6AT7PN0M tag=LRGP6VPHY4NF type=del size=1676398 2024-09-12T17:07:52.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.664+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~L77HSQ1820XC.0 size=1048576 2024-09-12T17:07:52.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.665+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~L77HSQ1820XC.1 size=1048576 2024-09-12T17:07:52.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.666+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~L77HSQ1820XC.2 size=515314 2024-09-12T17:07:52.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.666+0000 7f9eaebff780 1 > prepared multipart upload key=7PBT9VZ07OUI upload=L77HSQ1820XC tag=5YAGX97P64GD type=write size=3661042 2024-09-12T17:07:52.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.667+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~SN3C6MDN7B6T.0 size=120025 2024-09-12T17:07:52.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.669+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=SN3C6MDN7B6T tag=V9M8TNETVU7N type=write size=1168601 2024-09-12T17:07:52.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.670+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=BEDA10QK8CQL type=del size=2307375 2024-09-12T17:07:52.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.672+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~RNKITGH8OYXD.0 size=1048576 2024-09-12T17:07:52.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.673+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~RNKITGH8OYXD.1 size=236253 2024-09-12T17:07:52.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.674+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=RNKITGH8OYXD tag=220C9KNZCZNP type=write size=2333405 2024-09-12T17:07:52.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.676+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=OXDR8A4FJFFP type=del size=1004128 2024-09-12T17:07:52.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.677+0000 7f9eaebff780 1 < completed delete operation key=SO6QF2JCRX6E tag=222061J02TEA type=del 2024-09-12T17:07:52.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.678+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=56AUSEVSOF9G type=write size=919714 2024-09-12T17:07:52.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.679+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~DFO5AIN7W5OW.0 size=1048576 2024-09-12T17:07:52.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.680+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~DFO5AIN7W5OW.1 size=589713 2024-09-12T17:07:52.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.683+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=DFO5AIN7W5OW tag=7JYKZWC48O30 type=write size=2686865 2024-09-12T17:07:52.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.685+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~4N2QLL7J4ZZJ.0 size=1048576 2024-09-12T17:07:52.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.686+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~4N2QLL7J4ZZJ.1 size=1048576 2024-09-12T17:07:52.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.687+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~4N2QLL7J4ZZJ.2 size=774154 2024-09-12T17:07:52.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.687+0000 7f9eaebff780 1 > prepared multipart upload key=EKUW5AKC428U upload=4N2QLL7J4ZZJ tag=44560N8ZW41W type=write size=3919882 2024-09-12T17:07:52.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.688+0000 7f9eaebff780 1 < completed delete operation key=K2NHRSUDQBRW tag=CVEFGHMLH9QH type=del 2024-09-12T17:07:52.692 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.690+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~2W5CW5IBE64A.0 size=657825 2024-09-12T17:07:52.692 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.690+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=2W5CW5IBE64A tag=2AAOK2RY8K33 type=write size=1706401 2024-09-12T17:07:52.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.692+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~01ZBR36ULGOS.0 size=1048576 2024-09-12T17:07:52.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.692+0000 7f9eaebff780 1 < canceled part key=_multipart_ZC814TPVLJO1.2~01ZBR36ULGOS.1 size=1048576 2024-09-12T17:07:52.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.693+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~01ZBR36ULGOS.2 size=575456 2024-09-12T17:07:52.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.695+0000 7f9eaebff780 1 < canceled multipart upload key=ZC814TPVLJO1 upload=01ZBR36ULGOS tag=AKFQBOUZKJ7P type=write size=3721184 2024-09-12T17:07:52.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.696+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=IHQEUO3MANYJ type=del size=1685449 2024-09-12T17:07:52.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.697+0000 7f9eaebff780 1 < completed delete operation key=SO6QF2JCRX6E tag=QX1DA5S0Y0EV type=del 2024-09-12T17:07:52.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.699+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~SZUN07Z9KFWP.0 size=1048576 2024-09-12T17:07:52.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.700+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~SZUN07Z9KFWP.1 size=1048576 2024-09-12T17:07:52.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.701+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~SZUN07Z9KFWP.2 size=25758 2024-09-12T17:07:52.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.701+0000 7f9eaebff780 1 > prepared multipart upload key=QIMNK4DL3D0N upload=SZUN07Z9KFWP tag=J4MSXPL6WBBB type=write size=3171486 2024-09-12T17:07:52.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.702+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=YOT7HP4NFQQ7 type=del 2024-09-12T17:07:52.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.704+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~ATBSLNC60WMC.0 size=1048576 2024-09-12T17:07:52.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.705+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~ATBSLNC60WMC.1 size=160681 2024-09-12T17:07:52.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.705+0000 7f9eaebff780 1 > prepared multipart upload key=3LY681252WAN upload=ATBSLNC60WMC tag=GVZTE9JRFFSO type=write size=2257833 2024-09-12T17:07:52.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.707+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=W3Q0SKIVR2K7 type=del 2024-09-12T17:07:52.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.708+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=3CDMV3TZGG3N type=del size=1207489 2024-09-12T17:07:52.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.708+0000 7f9eaebff780 1 < canceled part key=_multipart_SHWT6AT7PN0M.2~X2CS6S0N9TI0.0 size=1048576 2024-09-12T17:07:52.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.709+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~X2CS6S0N9TI0.1 size=184183 2024-09-12T17:07:52.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.712+0000 7f9eaebff780 1 < canceled multipart upload key=SHWT6AT7PN0M upload=X2CS6S0N9TI0 tag=80RK6I9X3QUQ type=write size=2281335 2024-09-12T17:07:52.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.714+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~EF0OER6ONIPO.0 size=418805 2024-09-12T17:07:52.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.714+0000 7f9eaebff780 1 > prepared multipart upload key=0F5LXJZMBFSP upload=EF0OER6ONIPO tag=U1FDNXOU2VDM type=write size=1467381 2024-09-12T17:07:52.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.715+0000 7f9eaebff780 1 < completed delete operation key=OH6GXTMPBYUY tag=NIBEJRK9R2VT type=del 2024-09-12T17:07:52.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.717+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~QY4N3QLD5AUS.0 size=1048576 2024-09-12T17:07:52.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.718+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~QY4N3QLD5AUS.1 size=1048576 2024-09-12T17:07:52.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.720+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~QY4N3QLD5AUS.2 size=503226 2024-09-12T17:07:52.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.720+0000 7f9eaebff780 1 > prepared multipart upload key=ZYP3P4031PUZ upload=QY4N3QLD5AUS tag=ZNV0Z3M0DLL1 type=write size=3648954 2024-09-12T17:07:52.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.721+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~9W7MYGV20TZF.0 size=323421 2024-09-12T17:07:52.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.723+0000 7f9eaebff780 1 < completed multipart upload key=SO6QF2JCRX6E upload=9W7MYGV20TZF tag=JTG4BFQHGQPA type=write size=1371997 2024-09-12T17:07:52.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.724+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=91P46FFKO260 type=del size=2659364 2024-09-12T17:07:52.726 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.725+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~LFRWRXUMBE7E.0 size=1048576 2024-09-12T17:07:52.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.726+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~LFRWRXUMBE7E.1 size=1048576 2024-09-12T17:07:52.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.727+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~LFRWRXUMBE7E.2 size=226661 2024-09-12T17:07:52.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.729+0000 7f9eaebff780 1 < completed multipart upload key=ZYP3P4031PUZ upload=LFRWRXUMBE7E tag=MJ7FDHRMMUFG type=write size=3372389 2024-09-12T17:07:52.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.730+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=6LCJ42WJHJ21 type=del size=4172356 2024-09-12T17:07:52.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.731+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~ARAI76MM2EJB.0 size=949367 2024-09-12T17:07:52.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.733+0000 7f9eaebff780 1 < completed multipart upload key=3LY681252WAN upload=ARAI76MM2EJB tag=T7KGZJ30YBJT type=write size=1997943 2024-09-12T17:07:52.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.734+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=TWGMAWV0AIKC type=del size=3544725 2024-09-12T17:07:52.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.735+0000 7f9eaebff780 1 < completed delete operation key=P9GMGM3WK6O7 tag=TOO73SAI41RY type=del 2024-09-12T17:07:52.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.737+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=TUY8ED1UTY02 type=del size=162473 2024-09-12T17:07:52.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.738+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~L77HSQ1820XC.0 size=1048576 2024-09-12T17:07:52.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.739+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~L77HSQ1820XC.1 size=1048576 2024-09-12T17:07:52.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.740+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~L77HSQ1820XC.2 size=515314 2024-09-12T17:07:52.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.742+0000 7f9eaebff780 1 < completed multipart upload key=7PBT9VZ07OUI upload=L77HSQ1820XC tag=5YAGX97P64GD type=write size=3661042 2024-09-12T17:07:52.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.745+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~Z2D6RGCBL4OD.0 size=962658 2024-09-12T17:07:52.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.745+0000 7f9eaebff780 1 > prepared multipart upload key=LRI5G5G8O5X4 upload=Z2D6RGCBL4OD tag=4SN1K8ZUB66Y type=write size=2011234 2024-09-12T17:07:52.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.746+0000 7f9eaebff780 1 < completed delete operation key=3VY271ZBO754 tag=BEDA10QK8CQL type=del 2024-09-12T17:07:52.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.748+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~2ZUO156ZK2C2.0 size=1048576 2024-09-12T17:07:52.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.749+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~2ZUO156ZK2C2.1 size=1048576 2024-09-12T17:07:52.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.750+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~2ZUO156ZK2C2.2 size=1046024 2024-09-12T17:07:52.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.750+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=2ZUO156ZK2C2 tag=N1RPW2NOBF5S type=write size=4191752 2024-09-12T17:07:52.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.751+0000 7f9eaebff780 1 < completed delete operation key=QIMNK4DL3D0N tag=OXDR8A4FJFFP type=del 2024-09-12T17:07:52.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.752+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=73403IXP129V type=del size=3797448 2024-09-12T17:07:52.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.753+0000 7f9eaebff780 1 < canceled operation key=CAIZM33SDFPM tag=56AUSEVSOF9G type=write size=919714 2024-09-12T17:07:52.756 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.755+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=SR6H54FBURYH type=write size=839288 2024-09-12T17:07:52.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.756+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~4N2QLL7J4ZZJ.0 size=1048576 2024-09-12T17:07:52.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.757+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~4N2QLL7J4ZZJ.1 size=1048576 2024-09-12T17:07:52.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.758+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~4N2QLL7J4ZZJ.2 size=774154 2024-09-12T17:07:52.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.760+0000 7f9eaebff780 1 < completed multipart upload key=EKUW5AKC428U upload=4N2QLL7J4ZZJ tag=44560N8ZW41W type=write size=3919882 2024-09-12T17:07:52.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.761+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=KGQJ29BEJGKH type=del size=3645177 2024-09-12T17:07:52.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.761+0000 7f9eaebff780 1 < canceled part key=_multipart_OH6GXTMPBYUY.2~2W5CW5IBE64A.0 size=657825 2024-09-12T17:07:52.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.763+0000 7f9eaebff780 1 < canceled multipart upload key=OH6GXTMPBYUY upload=2W5CW5IBE64A tag=2AAOK2RY8K33 type=write size=1706401 2024-09-12T17:07:52.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.764+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=S7IVMBWIQ69L type=write size=904341 2024-09-12T17:07:52.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.765+0000 7f9eaebff780 1 < completed delete operation key=K0P9ZZ91UJJ8 tag=IHQEUO3MANYJ type=del 2024-09-12T17:07:52.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.766+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=FNJT84XWKHSC type=del size=3236680 2024-09-12T17:07:52.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.768+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~SZUN07Z9KFWP.0 size=1048576 2024-09-12T17:07:52.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.769+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~SZUN07Z9KFWP.1 size=1048576 2024-09-12T17:07:52.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.770+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~SZUN07Z9KFWP.2 size=25758 2024-09-12T17:07:52.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.772+0000 7f9eaebff780 1 < completed multipart upload key=QIMNK4DL3D0N upload=SZUN07Z9KFWP tag=J4MSXPL6WBBB type=write size=3171486 2024-09-12T17:07:52.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.774+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~FADHQ8ZE4X64.0 size=754476 2024-09-12T17:07:52.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.774+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=FADHQ8ZE4X64 tag=KLLKWK45QUFM type=write size=1803052 2024-09-12T17:07:52.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.775+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~ATBSLNC60WMC.0 size=1048576 2024-09-12T17:07:52.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.776+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~ATBSLNC60WMC.1 size=160681 2024-09-12T17:07:52.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.778+0000 7f9eaebff780 1 < completed multipart upload key=3LY681252WAN upload=ATBSLNC60WMC tag=GVZTE9JRFFSO type=write size=2257833 2024-09-12T17:07:52.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.779+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=A3AYP2Z4ZRK4 type=del size=3009914 2024-09-12T17:07:52.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.780+0000 7f9eaebff780 1 < completed delete operation key=TDZCNUZE8IOA tag=3CDMV3TZGG3N type=del 2024-09-12T17:07:52.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.781+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=P3VFUHOKKSC7 type=del size=2222825 2024-09-12T17:07:52.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.783+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~EF0OER6ONIPO.0 size=418805 2024-09-12T17:07:52.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.785+0000 7f9eaebff780 1 < completed multipart upload key=0F5LXJZMBFSP upload=EF0OER6ONIPO tag=U1FDNXOU2VDM type=write size=1467381 2024-09-12T17:07:52.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.786+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=0SIVM02DS89G type=del size=3387102 2024-09-12T17:07:52.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.787+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~QY4N3QLD5AUS.0 size=1048576 2024-09-12T17:07:52.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.788+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~QY4N3QLD5AUS.1 size=1048576 2024-09-12T17:07:52.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.789+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~QY4N3QLD5AUS.2 size=503226 2024-09-12T17:07:52.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.792+0000 7f9eaebff780 1 < completed multipart upload key=ZYP3P4031PUZ upload=QY4N3QLD5AUS tag=ZNV0Z3M0DLL1 type=write size=3648954 2024-09-12T17:07:52.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.795+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=Z4BLKGRFHW3A type=del size=996548 2024-09-12T17:07:52.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.798+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=91P46FFKO260 type=del 2024-09-12T17:07:52.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.800+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~W90WUMCTBFUU.0 size=1048576 2024-09-12T17:07:52.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.801+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~W90WUMCTBFUU.1 size=1048576 2024-09-12T17:07:52.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.802+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~W90WUMCTBFUU.2 size=233330 2024-09-12T17:07:52.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.802+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=W90WUMCTBFUU tag=5K3Q3WYQJJKC type=write size=3379058 2024-09-12T17:07:52.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.803+0000 7f9eaebff780 1 < completed delete operation key=SHWT6AT7PN0M tag=6LCJ42WJHJ21 type=del 2024-09-12T17:07:52.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.804+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=J36W7SDCQW20 type=del size=591232 2024-09-12T17:07:52.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.805+0000 7f9eaebff780 1 < completed delete operation key=SO6QF2JCRX6E tag=TWGMAWV0AIKC type=del 2024-09-12T17:07:52.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.807+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~OPWVO5V14HZG.0 size=1048576 2024-09-12T17:07:52.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.808+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~OPWVO5V14HZG.1 size=1048576 2024-09-12T17:07:52.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.809+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~OPWVO5V14HZG.2 size=572602 2024-09-12T17:07:52.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.809+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=OPWVO5V14HZG tag=G3EQ01PWI50U type=write size=3718330 2024-09-12T17:07:52.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.810+0000 7f9eaebff780 1 < completed delete operation key=UYF1AN2W59VN tag=TUY8ED1UTY02 type=del 2024-09-12T17:07:52.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.811+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=OITMP0J9VLM7 type=del size=4144655 2024-09-12T17:07:52.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.812+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~Z2D6RGCBL4OD.0 size=962658 2024-09-12T17:07:52.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.815+0000 7f9eaebff780 1 < completed multipart upload key=LRI5G5G8O5X4 upload=Z2D6RGCBL4OD tag=4SN1K8ZUB66Y type=write size=2011234 2024-09-12T17:07:52.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.817+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~OJBM1D6X3HZ9.0 size=1048576 2024-09-12T17:07:52.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.818+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~OJBM1D6X3HZ9.1 size=1048576 2024-09-12T17:07:52.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.819+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~OJBM1D6X3HZ9.2 size=137505 2024-09-12T17:07:52.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.819+0000 7f9eaebff780 1 > prepared multipart upload key=8DJLYFM11DNI upload=OJBM1D6X3HZ9 tag=2D308Q4RKBZR type=write size=3283233 2024-09-12T17:07:52.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.820+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~2ZUO156ZK2C2.0 size=1048576 2024-09-12T17:07:52.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.821+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~2ZUO156ZK2C2.1 size=1048576 2024-09-12T17:07:52.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.822+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~2ZUO156ZK2C2.2 size=1046024 2024-09-12T17:07:52.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.824+0000 7f9eaebff780 1 < completed multipart upload key=P9GMGM3WK6O7 upload=2ZUO156ZK2C2 tag=N1RPW2NOBF5S type=write size=4191752 2024-09-12T17:07:52.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.826+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~GHZ6C9LPOITZ.0 size=1048576 2024-09-12T17:07:52.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.827+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~GHZ6C9LPOITZ.1 size=583395 2024-09-12T17:07:52.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.827+0000 7f9eaebff780 1 > prepared multipart upload key=EKUW5AKC428U upload=GHZ6C9LPOITZ tag=M7BW3OLE16RO type=write size=2680547 2024-09-12T17:07:52.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.829+0000 7f9eaebff780 1 < suggested remove operation key=OGD6H9VSVGWF tag=73403IXP129V type=del 2024-09-12T17:07:52.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.830+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=YZ1ZF32LM8JR type=write size=355868 2024-09-12T17:07:52.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.832+0000 7f9eaebff780 1 < suggested remove operation key=CAIZM33SDFPM tag=SR6H54FBURYH type=write 2024-09-12T17:07:52.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.835+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~R4DGVZ2TRUUF.0 size=892393 2024-09-12T17:07:52.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.835+0000 7f9eaebff780 1 > prepared multipart upload key=LRI5G5G8O5X4 upload=R4DGVZ2TRUUF tag=BXUBYYEB2TT4 type=write size=1940969 2024-09-12T17:07:52.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.836+0000 7f9eaebff780 1 < completed delete operation key=0F5LXJZMBFSP tag=KGQJ29BEJGKH type=del 2024-09-12T17:07:52.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.837+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=ZZ2K6ZEBG3FL type=del size=1748901 2024-09-12T17:07:52.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.838+0000 7f9eaebff780 1 < completed write operation key=0F5LXJZMBFSP tag=S7IVMBWIQ69L type=write size=904341 2024-09-12T17:07:52.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.840+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~1FNGFX4U2SXA.0 size=1048576 2024-09-12T17:07:52.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.841+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~1FNGFX4U2SXA.1 size=1048576 2024-09-12T17:07:52.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.842+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~1FNGFX4U2SXA.2 size=527474 2024-09-12T17:07:52.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.842+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=1FNGFX4U2SXA tag=04T7NGGSD43U type=write size=3673202 2024-09-12T17:07:52.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.845+0000 7f9eaebff780 1 < suggested update operation key=0F5LXJZMBFSP tag=FNJT84XWKHSC type=del size=3236680 2024-09-12T17:07:52.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.847+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~ZTJQJDONNL5O.0 size=1048576 2024-09-12T17:07:52.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.848+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~ZTJQJDONNL5O.1 size=500324 2024-09-12T17:07:52.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.848+0000 7f9eaebff780 1 > prepared multipart upload key=3VY271ZBO754 upload=ZTJQJDONNL5O tag=I3WQPKG1Z53O type=write size=2597476 2024-09-12T17:07:52.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.848+0000 7f9eaebff780 1 < canceled part key=_multipart_P9GMGM3WK6O7.2~FADHQ8ZE4X64.0 size=754476 2024-09-12T17:07:52.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.850+0000 7f9eaebff780 1 < canceled multipart upload key=P9GMGM3WK6O7 upload=FADHQ8ZE4X64 tag=KLLKWK45QUFM type=write size=1803052 2024-09-12T17:07:52.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.851+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=8N318WH461LV type=del size=1680577 2024-09-12T17:07:52.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.852+0000 7f9eaebff780 1 < canceled operation key=YIEP2JYDSLW0 tag=A3AYP2Z4ZRK4 type=del size=3009914 2024-09-12T17:07:52.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.854+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~62SOJRCBMYB5.0 size=1048576 2024-09-12T17:07:52.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.855+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~62SOJRCBMYB5.1 size=416712 2024-09-12T17:07:52.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.855+0000 7f9eaebff780 1 > prepared multipart upload key=OGD6H9VSVGWF upload=62SOJRCBMYB5 tag=OSDXSQW9BC24 type=write size=2513864 2024-09-12T17:07:52.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.857+0000 7f9eaebff780 1 < completed delete operation key=K0P9ZZ91UJJ8 tag=P3VFUHOKKSC7 type=del 2024-09-12T17:07:52.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.858+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=C7BKS2MMYVUU type=del size=2341714 2024-09-12T17:07:52.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.861+0000 7f9eaebff780 1 < suggested update operation key=0F5LXJZMBFSP tag=0SIVM02DS89G type=del size=3387102 2024-09-12T17:07:52.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.862+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=LYOWA3XR9XKG type=del size=716412 2024-09-12T17:07:52.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.865+0000 7f9eaebff780 1 < suggested update operation key=P9GMGM3WK6O7 tag=Z4BLKGRFHW3A type=del size=996548 2024-09-12T17:07:52.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.866+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=4IZOOA32BT0D type=del size=2214984 2024-09-12T17:07:52.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.867+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~W90WUMCTBFUU.0 size=1048576 2024-09-12T17:07:52.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.868+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~W90WUMCTBFUU.1 size=1048576 2024-09-12T17:07:52.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.870+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~W90WUMCTBFUU.2 size=233330 2024-09-12T17:07:52.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.872+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=W90WUMCTBFUU tag=5K3Q3WYQJJKC type=write size=3379058 2024-09-12T17:07:52.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.874+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~X4V07KVJQ3GE.0 size=1048576 2024-09-12T17:07:52.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.875+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~X4V07KVJQ3GE.1 size=651968 2024-09-12T17:07:52.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.875+0000 7f9eaebff780 1 > prepared multipart upload key=8DJLYFM11DNI upload=X4V07KVJQ3GE tag=ZNEGF7I8N7I4 type=write size=2749120 2024-09-12T17:07:52.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.876+0000 7f9eaebff780 1 < completed delete operation key=OH6GXTMPBYUY tag=J36W7SDCQW20 type=del 2024-09-12T17:07:52.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.878+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~BIAFXHMV9LWR.0 size=1048576 2024-09-12T17:07:52.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.879+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~BIAFXHMV9LWR.1 size=315766 2024-09-12T17:07:52.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.879+0000 7f9eaebff780 1 > prepared multipart upload key=7PBT9VZ07OUI upload=BIAFXHMV9LWR tag=3M3SVLVOD7IS type=write size=2412918 2024-09-12T17:07:52.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.880+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~OPWVO5V14HZG.0 size=1048576 2024-09-12T17:07:52.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.881+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~OPWVO5V14HZG.1 size=1048576 2024-09-12T17:07:52.884 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.882+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~OPWVO5V14HZG.2 size=572602 2024-09-12T17:07:52.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.884+0000 7f9eaebff780 1 < completed multipart upload key=UYF1AN2W59VN upload=OPWVO5V14HZG tag=G3EQ01PWI50U type=write size=3718330 2024-09-12T17:07:52.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.885+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=R1T70ZH6RKEK type=del size=2561504 2024-09-12T17:07:52.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.888+0000 7f9eaebff780 1 < suggested update operation key=0YD5P1ACZ09Q tag=OITMP0J9VLM7 type=del size=4144655 2024-09-12T17:07:52.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.890+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~IOIZXDDSQW57.0 size=1048576 2024-09-12T17:07:52.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.890+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~IOIZXDDSQW57.1 size=683000 2024-09-12T17:07:52.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.890+0000 7f9eaebff780 1 > prepared multipart upload key=LRI5G5G8O5X4 upload=IOIZXDDSQW57 tag=B8YFDQB07XW4 type=write size=2780152 2024-09-12T17:07:52.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.892+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~OJBM1D6X3HZ9.0 size=1048576 2024-09-12T17:07:52.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.892+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~OJBM1D6X3HZ9.1 size=1048576 2024-09-12T17:07:52.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.893+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~OJBM1D6X3HZ9.2 size=137505 2024-09-12T17:07:52.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.896+0000 7f9eaebff780 1 < completed multipart upload key=8DJLYFM11DNI upload=OJBM1D6X3HZ9 tag=2D308Q4RKBZR type=write size=3283233 2024-09-12T17:07:52.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.897+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=U4MQW7CN8SNP type=del size=3635263 2024-09-12T17:07:52.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.898+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~GHZ6C9LPOITZ.0 size=1048576 2024-09-12T17:07:52.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.899+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~GHZ6C9LPOITZ.1 size=583395 2024-09-12T17:07:52.903 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.901+0000 7f9eaebff780 1 < completed multipart upload key=EKUW5AKC428U upload=GHZ6C9LPOITZ tag=M7BW3OLE16RO type=write size=2680547 2024-09-12T17:07:52.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.903+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~PJORXGSGTS24.0 size=1048576 2024-09-12T17:07:52.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.905+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~PJORXGSGTS24.1 size=884287 2024-09-12T17:07:52.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.905+0000 7f9eaebff780 1 > prepared multipart upload key=LRI5G5G8O5X4 upload=PJORXGSGTS24 tag=H3SGU57RPAJ2 type=write size=2981439 2024-09-12T17:07:52.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.907+0000 7f9eaebff780 1 < completed write operation key=OH6GXTMPBYUY tag=YZ1ZF32LM8JR type=write size=355868 2024-09-12T17:07:52.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.908+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=ENY73SH9I0CF type=write size=34724 2024-09-12T17:07:52.911 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.909+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~R4DGVZ2TRUUF.0 size=892393 2024-09-12T17:07:52.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.911+0000 7f9eaebff780 1 < completed multipart upload key=LRI5G5G8O5X4 upload=R4DGVZ2TRUUF tag=BXUBYYEB2TT4 type=write size=1940969 2024-09-12T17:07:52.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.913+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=TLDA0C97PMDQ type=del size=3886098 2024-09-12T17:07:52.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.914+0000 7f9eaebff780 -1 < failed to complete operation key=0YD5P1ACZ09Q tag=ZZ2K6ZEBG3FL type=del size=1748901: (22) Invalid argument 2024-09-12T17:07:52.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.915+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=753OAR46CUSR type=del size=1565816 2024-09-12T17:07:52.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.916+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~1FNGFX4U2SXA.0 size=1048576 2024-09-12T17:07:52.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.917+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~1FNGFX4U2SXA.1 size=1048576 2024-09-12T17:07:52.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.918+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~1FNGFX4U2SXA.2 size=527474 2024-09-12T17:07:52.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.920+0000 7f9eaebff780 1 < completed multipart upload key=P9GMGM3WK6O7 upload=1FNGFX4U2SXA tag=04T7NGGSD43U type=write size=3673202 2024-09-12T17:07:52.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.923+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~CF1A2O903RW0.0 size=1048576 2024-09-12T17:07:52.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.924+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~CF1A2O903RW0.1 size=733478 2024-09-12T17:07:52.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.924+0000 7f9eaebff780 1 > prepared multipart upload key=EKUW5AKC428U upload=CF1A2O903RW0 tag=UBC0DHHZI9HK type=write size=2830630 2024-09-12T17:07:52.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.925+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~ZTJQJDONNL5O.0 size=1048576 2024-09-12T17:07:52.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.926+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~ZTJQJDONNL5O.1 size=500324 2024-09-12T17:07:52.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.928+0000 7f9eaebff780 1 < completed multipart upload key=3VY271ZBO754 upload=ZTJQJDONNL5O tag=I3WQPKG1Z53O type=write size=2597476 2024-09-12T17:07:52.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.930+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~WMS250AW44YO.0 size=1048576 2024-09-12T17:07:52.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.931+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~WMS250AW44YO.1 size=1048576 2024-09-12T17:07:52.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.932+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~WMS250AW44YO.2 size=697388 2024-09-12T17:07:52.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.932+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=WMS250AW44YO tag=0LY5D1YMEXMP type=write size=3843116 2024-09-12T17:07:52.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.933+0000 7f9eaebff780 1 < completed delete operation key=K0P9ZZ91UJJ8 tag=8N318WH461LV type=del 2024-09-12T17:07:52.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.935+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~Z637FW6BLF7C.0 size=1048576 2024-09-12T17:07:52.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.936+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~Z637FW6BLF7C.1 size=475566 2024-09-12T17:07:52.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.936+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=Z637FW6BLF7C tag=APM3FREMA5XE type=write size=2572718 2024-09-12T17:07:52.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.937+0000 7f9eaebff780 1 < canceled part key=_multipart_OGD6H9VSVGWF.2~62SOJRCBMYB5.0 size=1048576 2024-09-12T17:07:52.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.938+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~62SOJRCBMYB5.1 size=416712 2024-09-12T17:07:52.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.940+0000 7f9eaebff780 1 < canceled multipart upload key=OGD6H9VSVGWF upload=62SOJRCBMYB5 tag=OSDXSQW9BC24 type=write size=2513864 2024-09-12T17:07:52.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.942+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~9JO3Z92XSVZ0.0 size=1048576 2024-09-12T17:07:52.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.943+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~9JO3Z92XSVZ0.1 size=997901 2024-09-12T17:07:52.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.943+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=9JO3Z92XSVZ0 tag=7YCRVK0QQF47 type=write size=3095053 2024-09-12T17:07:52.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.944+0000 7f9eaebff780 -1 < failed to complete operation key=0F5LXJZMBFSP tag=C7BKS2MMYVUU type=del size=2341714: (22) Invalid argument 2024-09-12T17:07:52.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.945+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=7C9UP0FSEYMT type=del size=2882901 2024-09-12T17:07:52.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.946+0000 7f9eaebff780 1 < completed delete operation key=EKUW5AKC428U tag=LYOWA3XR9XKG type=del 2024-09-12T17:07:52.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.947+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=4F3SV841JTOU type=del size=180308 2024-09-12T17:07:52.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.950+0000 7f9eaebff780 1 < suggested update operation key=3VY271ZBO754 tag=4IZOOA32BT0D type=del size=2214984 2024-09-12T17:07:52.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.952+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~DW4JYZLFJIIM.0 size=1048576 2024-09-12T17:07:52.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.953+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~DW4JYZLFJIIM.1 size=663953 2024-09-12T17:07:52.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.953+0000 7f9eaebff780 1 > prepared multipart upload key=CAIZM33SDFPM upload=DW4JYZLFJIIM tag=ITW87A65P9YN type=write size=2761105 2024-09-12T17:07:52.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.954+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~X4V07KVJQ3GE.0 size=1048576 2024-09-12T17:07:52.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.955+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~X4V07KVJQ3GE.1 size=651968 2024-09-12T17:07:52.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.957+0000 7f9eaebff780 1 < completed multipart upload key=8DJLYFM11DNI upload=X4V07KVJQ3GE tag=ZNEGF7I8N7I4 type=write size=2749120 2024-09-12T17:07:52.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.958+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=J8IQKA2JJJ2T type=write size=57132 2024-09-12T17:07:52.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.959+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~BIAFXHMV9LWR.0 size=1048576 2024-09-12T17:07:52.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.960+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~BIAFXHMV9LWR.1 size=315766 2024-09-12T17:07:52.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.962+0000 7f9eaebff780 1 < completed multipart upload key=7PBT9VZ07OUI upload=BIAFXHMV9LWR tag=3M3SVLVOD7IS type=write size=2412918 2024-09-12T17:07:52.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.964+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~ECP44F8F3S3E.0 size=1048576 2024-09-12T17:07:52.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.965+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~ECP44F8F3S3E.1 size=1048576 2024-09-12T17:07:52.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.966+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~ECP44F8F3S3E.2 size=841160 2024-09-12T17:07:52.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.966+0000 7f9eaebff780 1 > prepared multipart upload key=GB8P7K59Y8VI upload=ECP44F8F3S3E tag=136E7BSJ0KKV type=write size=3986888 2024-09-12T17:07:52.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.967+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=R1T70ZH6RKEK type=del 2024-09-12T17:07:52.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.968+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=ABLJJ8M9K2ZH type=del size=2746744 2024-09-12T17:07:52.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.969+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~IOIZXDDSQW57.0 size=1048576 2024-09-12T17:07:52.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.970+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~IOIZXDDSQW57.1 size=683000 2024-09-12T17:07:52.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.972+0000 7f9eaebff780 1 < completed multipart upload key=LRI5G5G8O5X4 upload=IOIZXDDSQW57 tag=B8YFDQB07XW4 type=write size=2780152 2024-09-12T17:07:52.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.974+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=P9FQB7HFKXXU type=write size=269902 2024-09-12T17:07:52.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.975+0000 7f9eaebff780 1 < completed delete operation key=TDZCNUZE8IOA tag=U4MQW7CN8SNP type=del 2024-09-12T17:07:52.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.976+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=L3HXGG2I0ICR type=del size=2047455 2024-09-12T17:07:52.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.977+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~PJORXGSGTS24.0 size=1048576 2024-09-12T17:07:52.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.979+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~PJORXGSGTS24.1 size=884287 2024-09-12T17:07:52.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.980+0000 7f9eaebff780 1 < completed multipart upload key=LRI5G5G8O5X4 upload=PJORXGSGTS24 tag=H3SGU57RPAJ2 type=write size=2981439 2024-09-12T17:07:52.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.982+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=AN535DAG6IBG type=del size=4188323 2024-09-12T17:07:52.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.984+0000 7f9eaebff780 1 < suggested remove operation key=7PBT9VZ07OUI tag=ENY73SH9I0CF type=write 2024-09-12T17:07:52.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.987+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~CWW20FR44XW9.0 size=1048576 2024-09-12T17:07:52.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.988+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~CWW20FR44XW9.1 size=650712 2024-09-12T17:07:52.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.988+0000 7f9eaebff780 1 > prepared multipart upload key=KF8XE48DI9KZ upload=CWW20FR44XW9 tag=U308IY255YKF type=write size=2747864 2024-09-12T17:07:52.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.989+0000 7f9eaebff780 1 < completed delete operation key=OGD6H9VSVGWF tag=TLDA0C97PMDQ type=del 2024-09-12T17:07:52.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.991+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~PFXNNKIPT7J0.0 size=1048576 2024-09-12T17:07:52.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.992+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~PFXNNKIPT7J0.1 size=1048576 2024-09-12T17:07:52.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.993+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~PFXNNKIPT7J0.2 size=560653 2024-09-12T17:07:52.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.993+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=PFXNNKIPT7J0 tag=K3G8778O6TA5 type=write size=3706381 2024-09-12T17:07:52.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.994+0000 7f9eaebff780 1 < completed delete operation key=P9GMGM3WK6O7 tag=753OAR46CUSR type=del 2024-09-12T17:07:52.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.996+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=02SLUSB0FTKL type=del size=2661793 2024-09-12T17:07:52.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.997+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~CF1A2O903RW0.0 size=1048576 2024-09-12T17:07:53.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:52.998+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~CF1A2O903RW0.1 size=733478 2024-09-12T17:07:53.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.000+0000 7f9eaebff780 1 < completed multipart upload key=EKUW5AKC428U upload=CF1A2O903RW0 tag=UBC0DHHZI9HK type=write size=2830630 2024-09-12T17:07:53.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.002+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=BT916OMNII81 type=del size=2001546 2024-09-12T17:07:53.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.003+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~WMS250AW44YO.0 size=1048576 2024-09-12T17:07:53.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.004+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~WMS250AW44YO.1 size=1048576 2024-09-12T17:07:53.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.005+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~WMS250AW44YO.2 size=697388 2024-09-12T17:07:53.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.007+0000 7f9eaebff780 1 < completed multipart upload key=K2NHRSUDQBRW upload=WMS250AW44YO tag=0LY5D1YMEXMP type=write size=3843116 2024-09-12T17:07:53.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.009+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~YEYHU2ADPZJT.0 size=1048576 2024-09-12T17:07:53.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.010+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~YEYHU2ADPZJT.1 size=843478 2024-09-12T17:07:53.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.010+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=YEYHU2ADPZJT tag=OOSZF13OGXJI type=write size=2940630 2024-09-12T17:07:53.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.011+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~Z637FW6BLF7C.0 size=1048576 2024-09-12T17:07:53.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.012+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~Z637FW6BLF7C.1 size=475566 2024-09-12T17:07:53.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.014+0000 7f9eaebff780 1 < completed multipart upload key=P9GMGM3WK6O7 upload=Z637FW6BLF7C tag=APM3FREMA5XE type=write size=2572718 2024-09-12T17:07:53.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.017+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=32MM1W1HI7FM type=del size=690826 2024-09-12T17:07:53.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.018+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~9JO3Z92XSVZ0.0 size=1048576 2024-09-12T17:07:53.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.019+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~9JO3Z92XSVZ0.1 size=997901 2024-09-12T17:07:53.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.021+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=9JO3Z92XSVZ0 tag=7YCRVK0QQF47 type=write size=3095053 2024-09-12T17:07:53.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.022+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=OT5KL4CRC2G6 type=del size=121988 2024-09-12T17:07:53.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.023+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=7C9UP0FSEYMT type=del 2024-09-12T17:07:53.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.024+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=9DR4MSDMKZHD type=del size=22120 2024-09-12T17:07:53.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.026+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=4F3SV841JTOU type=del 2024-09-12T17:07:53.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.027+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=TXH9SN21GJCC type=write size=689303 2024-09-12T17:07:53.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.028+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~DW4JYZLFJIIM.0 size=1048576 2024-09-12T17:07:53.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.029+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~DW4JYZLFJIIM.1 size=663953 2024-09-12T17:07:53.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.031+0000 7f9eaebff780 1 < completed multipart upload key=CAIZM33SDFPM upload=DW4JYZLFJIIM tag=ITW87A65P9YN type=write size=2761105 2024-09-12T17:07:53.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.032+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=F5O6NTSAKJJV type=del size=747042 2024-09-12T17:07:53.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.034+0000 7f9eaebff780 1 < completed write operation key=ZC814TPVLJO1 tag=J8IQKA2JJJ2T type=write size=57132 2024-09-12T17:07:53.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.035+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=0UY3ZR41NZ6F type=del size=316870 2024-09-12T17:07:53.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.036+0000 7f9eaebff780 1 < completed part key=_multipart_GB8P7K59Y8VI.2~ECP44F8F3S3E.0 size=1048576 2024-09-12T17:07:53.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.037+0000 7f9eaebff780 1 < completed part key=_multipart_GB8P7K59Y8VI.2~ECP44F8F3S3E.1 size=1048576 2024-09-12T17:07:53.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.038+0000 7f9eaebff780 1 < completed part key=_multipart_GB8P7K59Y8VI.2~ECP44F8F3S3E.2 size=841160 2024-09-12T17:07:53.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.040+0000 7f9eaebff780 1 < completed multipart upload key=GB8P7K59Y8VI upload=ECP44F8F3S3E tag=136E7BSJ0KKV type=write size=3986888 2024-09-12T17:07:53.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.041+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=JJ07OQSW52H7 type=del size=2420306 2024-09-12T17:07:53.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.042+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=ABLJJ8M9K2ZH type=del 2024-09-12T17:07:53.046 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.044+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~ZT2F9IIJ1U63.0 size=1048576 2024-09-12T17:07:53.046 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.045+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~ZT2F9IIJ1U63.1 size=1048576 2024-09-12T17:07:53.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.046+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~ZT2F9IIJ1U63.2 size=1006327 2024-09-12T17:07:53.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.046+0000 7f9eaebff780 1 > prepared multipart upload key=7PBT9VZ07OUI upload=ZT2F9IIJ1U63 tag=3YFBQG41E8NW type=write size=4152055 2024-09-12T17:07:53.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.048+0000 7f9eaebff780 1 < suggested remove operation key=SHWT6AT7PN0M tag=P9FQB7HFKXXU type=write 2024-09-12T17:07:53.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.050+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=FSF2KQ05KDMS type=del size=2426463 2024-09-12T17:07:53.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.051+0000 7f9eaebff780 1 < canceled operation key=KF8XE48DI9KZ tag=L3HXGG2I0ICR type=del size=2047455 2024-09-12T17:07:53.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.052+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=HU5HWVF1OZH4 type=del size=2673476 2024-09-12T17:07:53.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.053+0000 7f9eaebff780 1 < completed delete operation key=OGD6H9VSVGWF tag=AN535DAG6IBG type=del 2024-09-12T17:07:53.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.056+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~N29812R4PAEU.0 size=1048576 2024-09-12T17:07:53.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.057+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~N29812R4PAEU.1 size=1048576 2024-09-12T17:07:53.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.058+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~N29812R4PAEU.2 size=1017998 2024-09-12T17:07:53.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.058+0000 7f9eaebff780 1 > prepared multipart upload key=0F5LXJZMBFSP upload=N29812R4PAEU tag=MR560FSNT7VU type=write size=4163726 2024-09-12T17:07:53.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.059+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~CWW20FR44XW9.0 size=1048576 2024-09-12T17:07:53.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.060+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~CWW20FR44XW9.1 size=650712 2024-09-12T17:07:53.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.062+0000 7f9eaebff780 1 < completed multipart upload key=KF8XE48DI9KZ upload=CWW20FR44XW9 tag=U308IY255YKF type=write size=2747864 2024-09-12T17:07:53.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.063+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=H41XSKO2HOL6 type=del size=3718640 2024-09-12T17:07:53.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.065+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~PFXNNKIPT7J0.0 size=1048576 2024-09-12T17:07:53.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.066+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~PFXNNKIPT7J0.1 size=1048576 2024-09-12T17:07:53.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.067+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~PFXNNKIPT7J0.2 size=560653 2024-09-12T17:07:53.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.069+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=PFXNNKIPT7J0 tag=K3G8778O6TA5 type=write size=3706381 2024-09-12T17:07:53.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.070+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=P9QBJBQXIDW7 type=del size=4181107 2024-09-12T17:07:53.073 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.071+0000 7f9eaebff780 1 < completed delete operation key=GB8P7K59Y8VI tag=02SLUSB0FTKL type=del 2024-09-12T17:07:53.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.073+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~C2INART9FK3L.0 size=1048576 2024-09-12T17:07:53.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.074+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~C2INART9FK3L.1 size=1048576 2024-09-12T17:07:53.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.075+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~C2INART9FK3L.2 size=927341 2024-09-12T17:07:53.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.075+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=C2INART9FK3L tag=Z6V1G93MUNPN type=write size=4073069 2024-09-12T17:07:53.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.076+0000 7f9eaebff780 1 < completed delete operation key=YIEP2JYDSLW0 tag=BT916OMNII81 type=del 2024-09-12T17:07:53.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.078+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=T15RLBW03GAU type=del size=4043502 2024-09-12T17:07:53.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.078+0000 7f9eaebff780 1 < canceled part key=_multipart_OH6GXTMPBYUY.2~YEYHU2ADPZJT.0 size=1048576 2024-09-12T17:07:53.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.079+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~YEYHU2ADPZJT.1 size=843478 2024-09-12T17:07:53.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.081+0000 7f9eaebff780 1 < canceled multipart upload key=OH6GXTMPBYUY upload=YEYHU2ADPZJT tag=OOSZF13OGXJI type=write size=2940630 2024-09-12T17:07:53.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.082+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=HZWVEJZXZ036 type=write size=496668 2024-09-12T17:07:53.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.084+0000 7f9eaebff780 1 < completed delete operation key=LJN514F16XJA tag=32MM1W1HI7FM type=del 2024-09-12T17:07:53.087 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.086+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~16XE1G2HVZI5.0 size=1048576 2024-09-12T17:07:53.088 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.087+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~16XE1G2HVZI5.1 size=421284 2024-09-12T17:07:53.088 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.087+0000 7f9eaebff780 1 > prepared multipart upload key=ZYP3P4031PUZ upload=16XE1G2HVZI5 tag=5GMS8S453QLT type=write size=2518436 2024-09-12T17:07:53.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.088+0000 7f9eaebff780 1 < completed delete operation key=TXHXOMIB4B53 tag=OT5KL4CRC2G6 type=del 2024-09-12T17:07:53.091 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.090+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~6FW6XR0N4EK7.0 size=1048576 2024-09-12T17:07:53.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.091+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~6FW6XR0N4EK7.1 size=440295 2024-09-12T17:07:53.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.091+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=6FW6XR0N4EK7 tag=ALQX3IC4J3U4 type=write size=2537447 2024-09-12T17:07:53.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.092+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=9DR4MSDMKZHD type=del 2024-09-12T17:07:53.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.094+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=17E4TFQEVIXI type=del size=45859 2024-09-12T17:07:53.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.095+0000 7f9eaebff780 1 < completed write operation key=QIMNK4DL3D0N tag=TXH9SN21GJCC type=write size=689303 2024-09-12T17:07:53.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.096+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=36N8N3EM4X7T type=del size=2029287 2024-09-12T17:07:53.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.098+0000 7f9eaebff780 1 < completed delete operation key=M3PLQGSK34YM tag=F5O6NTSAKJJV type=del 2024-09-12T17:07:53.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.099+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=TECPP6632B98 type=del size=56257 2024-09-12T17:07:53.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.100+0000 7f9eaebff780 1 < completed delete operation key=GB8P7K59Y8VI tag=0UY3ZR41NZ6F type=del 2024-09-12T17:07:53.103 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.102+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=TEKW0Y1248ML type=del size=2229905 2024-09-12T17:07:53.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.103+0000 7f9eaebff780 1 < canceled operation key=9I6RGNRB6HSY tag=JJ07OQSW52H7 type=del size=2420306 2024-09-12T17:07:53.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.104+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=QHI8QN30LLAP type=del size=750629 2024-09-12T17:07:53.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.105+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~ZT2F9IIJ1U63.0 size=1048576 2024-09-12T17:07:53.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.106+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~ZT2F9IIJ1U63.1 size=1048576 2024-09-12T17:07:53.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.108+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~ZT2F9IIJ1U63.2 size=1006327 2024-09-12T17:07:53.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.110+0000 7f9eaebff780 1 < completed multipart upload key=7PBT9VZ07OUI upload=ZT2F9IIJ1U63 tag=3YFBQG41E8NW type=write size=4152055 2024-09-12T17:07:53.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.112+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~03KFOMC1WB9V.0 size=1048576 2024-09-12T17:07:53.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.113+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~03KFOMC1WB9V.1 size=1048576 2024-09-12T17:07:53.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.114+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~03KFOMC1WB9V.2 size=267706 2024-09-12T17:07:53.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.114+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=03KFOMC1WB9V tag=7R3TI1QRX46X type=write size=3413434 2024-09-12T17:07:53.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.116+0000 7f9eaebff780 1 < suggested remove operation key=M3PLQGSK34YM tag=FSF2KQ05KDMS type=del 2024-09-12T17:07:53.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.118+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=N5N3L9J0R88N type=del size=1187162 2024-09-12T17:07:53.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.119+0000 7f9eaebff780 1 < completed delete operation key=QIMNK4DL3D0N tag=HU5HWVF1OZH4 type=del 2024-09-12T17:07:53.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.120+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=R33FEO2CY2M3 type=del size=3625809 2024-09-12T17:07:53.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.121+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~N29812R4PAEU.0 size=1048576 2024-09-12T17:07:53.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.122+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~N29812R4PAEU.1 size=1048576 2024-09-12T17:07:53.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.124+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~N29812R4PAEU.2 size=1017998 2024-09-12T17:07:53.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.126+0000 7f9eaebff780 1 < completed multipart upload key=0F5LXJZMBFSP upload=N29812R4PAEU tag=MR560FSNT7VU type=write size=4163726 2024-09-12T17:07:53.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.127+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=EWRIDL2B88OQ type=del size=3680118 2024-09-12T17:07:53.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.128+0000 7f9eaebff780 1 < completed delete operation key=ZYP3P4031PUZ tag=H41XSKO2HOL6 type=del 2024-09-12T17:07:53.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.129+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=HAJSRHFMDHRV type=del size=3682682 2024-09-12T17:07:53.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.132+0000 7f9eaebff780 1 < canceled operation key=0YD5P1ACZ09Q tag=P9QBJBQXIDW7 type=del size=4181107 2024-09-12T17:07:53.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.133+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=M0F2K72ZIVCL type=del size=2599204 2024-09-12T17:07:53.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.135+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~C2INART9FK3L.0 size=1048576 2024-09-12T17:07:53.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.136+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~C2INART9FK3L.1 size=1048576 2024-09-12T17:07:53.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.137+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~C2INART9FK3L.2 size=927341 2024-09-12T17:07:53.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.141+0000 7f9eaebff780 1 < completed multipart upload key=P9GMGM3WK6O7 upload=C2INART9FK3L tag=Z6V1G93MUNPN type=write size=4073069 2024-09-12T17:07:53.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.142+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=3V0CMJQWV6V6 type=del size=3745350 2024-09-12T17:07:53.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.143+0000 7f9eaebff780 1 < completed delete operation key=OH6GXTMPBYUY tag=T15RLBW03GAU type=del 2024-09-12T17:07:53.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.144+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=JBRJJ3EUG58Y type=del size=83064 2024-09-12T17:07:53.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.147+0000 7f9eaebff780 1 < suggested update operation key=K0P9ZZ91UJJ8 tag=HZWVEJZXZ036 type=write size=496668 2024-09-12T17:07:53.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.148+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=8PKJXMGV9HZZ type=del size=1488646 2024-09-12T17:07:53.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.149+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~16XE1G2HVZI5.0 size=1048576 2024-09-12T17:07:53.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.150+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~16XE1G2HVZI5.1 size=421284 2024-09-12T17:07:53.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.152+0000 7f9eaebff780 1 < completed multipart upload key=ZYP3P4031PUZ upload=16XE1G2HVZI5 tag=5GMS8S453QLT type=write size=2518436 2024-09-12T17:07:53.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.154+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=MAZDCWQ5HG9B type=del size=3320556 2024-09-12T17:07:53.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.155+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~6FW6XR0N4EK7.0 size=1048576 2024-09-12T17:07:53.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.156+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~6FW6XR0N4EK7.1 size=440295 2024-09-12T17:07:53.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.158+0000 7f9eaebff780 1 < completed multipart upload key=SHWT6AT7PN0M upload=6FW6XR0N4EK7 tag=ALQX3IC4J3U4 type=write size=2537447 2024-09-12T17:07:53.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.160+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~TBGEV487NI1U.0 size=1048576 2024-09-12T17:07:53.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.161+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~TBGEV487NI1U.1 size=1048576 2024-09-12T17:07:53.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.162+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~TBGEV487NI1U.2 size=394405 2024-09-12T17:07:53.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.162+0000 7f9eaebff780 1 > prepared multipart upload key=0F5LXJZMBFSP upload=TBGEV487NI1U tag=8C18GVQ7DH42 type=write size=3540133 2024-09-12T17:07:53.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.163+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=17E4TFQEVIXI type=del 2024-09-12T17:07:53.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.165+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~ZA2WYPJVFSLU.0 size=1048576 2024-09-12T17:07:53.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.166+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~ZA2WYPJVFSLU.1 size=650568 2024-09-12T17:07:53.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.166+0000 7f9eaebff780 1 > prepared multipart upload key=TDZCNUZE8IOA upload=ZA2WYPJVFSLU tag=TZ18I35O5M1D type=write size=2747720 2024-09-12T17:07:53.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.167+0000 7f9eaebff780 1 < completed delete operation key=OGD6H9VSVGWF tag=36N8N3EM4X7T type=del 2024-09-12T17:07:53.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.169+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~LC2IEY85ZFVM.0 size=1048576 2024-09-12T17:07:53.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.170+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~LC2IEY85ZFVM.1 size=840217 2024-09-12T17:07:53.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.170+0000 7f9eaebff780 1 > prepared multipart upload key=LRI5G5G8O5X4 upload=LC2IEY85ZFVM tag=DD31TLGYKRHB type=write size=2937369 2024-09-12T17:07:53.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.171+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=TECPP6632B98 type=del 2024-09-12T17:07:53.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.173+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=J5R5ADD55BD0 type=del size=1894683 2024-09-12T17:07:53.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.174+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=TEKW0Y1248ML type=del 2024-09-12T17:07:53.178 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.176+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~ZJW49F2HAHS3.0 size=1048576 2024-09-12T17:07:53.178 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.177+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~ZJW49F2HAHS3.1 size=895821 2024-09-12T17:07:53.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.177+0000 7f9eaebff780 1 > prepared multipart upload key=CAIZM33SDFPM upload=ZJW49F2HAHS3 tag=UM2I1TX5VI6B type=write size=2992973 2024-09-12T17:07:53.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.178+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=QHI8QN30LLAP type=del 2024-09-12T17:07:53.182 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.180+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~6NZVJL2DA1ZY.0 size=966345 2024-09-12T17:07:53.182 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.180+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=6NZVJL2DA1ZY tag=U9VNYGZ6YJTO type=write size=2014921 2024-09-12T17:07:53.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.181+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~03KFOMC1WB9V.0 size=1048576 2024-09-12T17:07:53.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.182+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~03KFOMC1WB9V.1 size=1048576 2024-09-12T17:07:53.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.183+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~03KFOMC1WB9V.2 size=267706 2024-09-12T17:07:53.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.185+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=03KFOMC1WB9V tag=7R3TI1QRX46X type=write size=3413434 2024-09-12T17:07:53.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.187+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~DY20JAYG318U.0 size=813556 2024-09-12T17:07:53.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.187+0000 7f9eaebff780 1 > prepared multipart upload key=LRI5G5G8O5X4 upload=DY20JAYG318U tag=BGF0KOABB1N9 type=write size=1862132 2024-09-12T17:07:53.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.190+0000 7f9eaebff780 1 < suggested update operation key=GB8P7K59Y8VI tag=N5N3L9J0R88N type=del size=1187162 2024-09-12T17:07:53.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.191+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=SAT9VYXVHKNJ type=del size=3567154 2024-09-12T17:07:53.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.192+0000 7f9eaebff780 1 < canceled operation key=LRI5G5G8O5X4 tag=R33FEO2CY2M3 type=del size=3625809 2024-09-12T17:07:53.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.194+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=QZSEP8Q5YF7I type=write size=88105 2024-09-12T17:07:53.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.195+0000 7f9eaebff780 1 < completed delete operation key=LJN514F16XJA tag=EWRIDL2B88OQ type=del 2024-09-12T17:07:53.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.196+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=CPEUBPP9K2Z8 type=del size=2416673 2024-09-12T17:07:53.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.197+0000 7f9eaebff780 1 < completed delete operation key=UYF1AN2W59VN tag=HAJSRHFMDHRV type=del 2024-09-12T17:07:53.200 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.198+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=2FGJUKBYLA0F type=del size=1725707 2024-09-12T17:07:53.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.200+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=M0F2K72ZIVCL type=del 2024-09-12T17:07:53.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.201+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=JPSF1KR0XE92 type=del size=3024298 2024-09-12T17:07:53.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.202+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=3V0CMJQWV6V6 type=del 2024-09-12T17:07:53.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.203+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=9TAHZJLLCTBU type=del size=3693103 2024-09-12T17:07:53.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.204+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=JBRJJ3EUG58Y type=del 2024-09-12T17:07:53.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.205+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=ME5M19II51EF type=del size=3979489 2024-09-12T17:07:53.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.206+0000 7f9eaebff780 1 < canceled operation key=7PBT9VZ07OUI tag=8PKJXMGV9HZZ type=del size=1488646 2024-09-12T17:07:53.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.208+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=V8D1NBLGOQJF type=del size=1110712 2024-09-12T17:07:53.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.209+0000 7f9eaebff780 1 < canceled operation key=M3PLQGSK34YM tag=MAZDCWQ5HG9B type=del size=3320556 2024-09-12T17:07:53.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.210+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=VV0NLA0HKYG3 type=write size=655553 2024-09-12T17:07:53.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.211+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~TBGEV487NI1U.0 size=1048576 2024-09-12T17:07:53.214 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.212+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~TBGEV487NI1U.1 size=1048576 2024-09-12T17:07:53.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.213+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~TBGEV487NI1U.2 size=394405 2024-09-12T17:07:53.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.215+0000 7f9eaebff780 1 < completed multipart upload key=0F5LXJZMBFSP upload=TBGEV487NI1U tag=8C18GVQ7DH42 type=write size=3540133 2024-09-12T17:07:53.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.216+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=25PZC11G620A type=write size=919915 2024-09-12T17:07:53.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.218+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~ZA2WYPJVFSLU.0 size=1048576 2024-09-12T17:07:53.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.219+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~ZA2WYPJVFSLU.1 size=650568 2024-09-12T17:07:53.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.220+0000 7f9eaebff780 1 < completed multipart upload key=TDZCNUZE8IOA upload=ZA2WYPJVFSLU tag=TZ18I35O5M1D type=write size=2747720 2024-09-12T17:07:53.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.222+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=VWI0YV1RV3T4 type=write size=757623 2024-09-12T17:07:53.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.223+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~LC2IEY85ZFVM.0 size=1048576 2024-09-12T17:07:53.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.224+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~LC2IEY85ZFVM.1 size=840217 2024-09-12T17:07:53.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.226+0000 7f9eaebff780 1 < completed multipart upload key=LRI5G5G8O5X4 upload=LC2IEY85ZFVM tag=DD31TLGYKRHB type=write size=2937369 2024-09-12T17:07:53.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.228+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~BOG253G1Z3VP.0 size=121333 2024-09-12T17:07:53.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.228+0000 7f9eaebff780 1 > prepared multipart upload key=3VY271ZBO754 upload=BOG253G1Z3VP tag=PLZQG9FECB60 type=write size=1169909 2024-09-12T17:07:53.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.230+0000 7f9eaebff780 1 < completed delete operation key=SHWT6AT7PN0M tag=J5R5ADD55BD0 type=del 2024-09-12T17:07:53.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.232+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~BMH8QH2IXIIW.0 size=1048576 2024-09-12T17:07:53.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.233+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~BMH8QH2IXIIW.1 size=11447 2024-09-12T17:07:53.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.233+0000 7f9eaebff780 1 > prepared multipart upload key=7PBT9VZ07OUI upload=BMH8QH2IXIIW tag=E0ZNX9NF8EPU type=write size=2108599 2024-09-12T17:07:53.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.234+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~ZJW49F2HAHS3.0 size=1048576 2024-09-12T17:07:53.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.234+0000 7f9eaebff780 1 < canceled part key=_multipart_CAIZM33SDFPM.2~ZJW49F2HAHS3.1 size=895821 2024-09-12T17:07:53.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.236+0000 7f9eaebff780 1 < canceled multipart upload key=CAIZM33SDFPM upload=ZJW49F2HAHS3 tag=UM2I1TX5VI6B type=write size=2992973 2024-09-12T17:07:53.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.237+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=K3OAR5Z8J6HX type=del size=2578165 2024-09-12T17:07:53.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.238+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~6NZVJL2DA1ZY.0 size=966345 2024-09-12T17:07:53.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.240+0000 7f9eaebff780 1 < completed multipart upload key=SHWT6AT7PN0M upload=6NZVJL2DA1ZY tag=U9VNYGZ6YJTO type=write size=2014921 2024-09-12T17:07:53.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.242+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=7SZ63Z7SX3IZ type=del size=678215 2024-09-12T17:07:53.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.243+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~DY20JAYG318U.0 size=813556 2024-09-12T17:07:53.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.246+0000 7f9eaebff780 1 < completed multipart upload key=LRI5G5G8O5X4 upload=DY20JAYG318U tag=BGF0KOABB1N9 type=write size=1862132 2024-09-12T17:07:53.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.247+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=WYL9UIKRRAYD type=del size=354872 2024-09-12T17:07:53.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.250+0000 7f9eaebff780 1 < suggested remove operation key=P9GMGM3WK6O7 tag=SAT9VYXVHKNJ type=del 2024-09-12T17:07:53.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.251+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=F6BV4PQ4BX67 type=del size=2576723 2024-09-12T17:07:53.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.252+0000 7f9eaebff780 1 < canceled operation key=YIEP2JYDSLW0 tag=QZSEP8Q5YF7I type=write size=88105 2024-09-12T17:07:53.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.254+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~VWNOTC7AQ12R.0 size=1048576 2024-09-12T17:07:53.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.255+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~VWNOTC7AQ12R.1 size=1048576 2024-09-12T17:07:53.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.256+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~VWNOTC7AQ12R.2 size=678764 2024-09-12T17:07:53.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.256+0000 7f9eaebff780 1 > prepared multipart upload key=8DJLYFM11DNI upload=VWNOTC7AQ12R tag=LS1ANOHCZ5F5 type=write size=3824492 2024-09-12T17:07:53.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.258+0000 7f9eaebff780 1 < suggested update operation key=KF8XE48DI9KZ tag=CPEUBPP9K2Z8 type=del size=2416673 2024-09-12T17:07:53.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.260+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=M2CDYHROJH5B type=write size=565670 2024-09-12T17:07:53.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.262+0000 7f9eaebff780 1 < suggested remove operation key=QIMNK4DL3D0N tag=2FGJUKBYLA0F type=del 2024-09-12T17:07:53.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.263+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=4WCGULAMT4MN type=del size=2668222 2024-09-12T17:07:53.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.264+0000 7f9eaebff780 1 < completed delete operation key=3VY271ZBO754 tag=JPSF1KR0XE92 type=del 2024-09-12T17:07:53.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.265+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=ALQ5BZA32UV1 type=del size=583832 2024-09-12T17:07:53.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.267+0000 7f9eaebff780 1 < completed delete operation key=YIEP2JYDSLW0 tag=9TAHZJLLCTBU type=del 2024-09-12T17:07:53.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.269+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~UAAEO61TLN9Z.0 size=618341 2024-09-12T17:07:53.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.269+0000 7f9eaebff780 1 > prepared multipart upload key=ZC814TPVLJO1 upload=UAAEO61TLN9Z tag=U54EZ0CI5CK4 type=write size=1666917 2024-09-12T17:07:53.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.270+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=ME5M19II51EF type=del 2024-09-12T17:07:53.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.271+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=J18Z5J8LLBTS type=del size=218125 2024-09-12T17:07:53.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.272+0000 7f9eaebff780 1 < completed delete operation key=7PBT9VZ07OUI tag=V8D1NBLGOQJF type=del 2024-09-12T17:07:53.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.274+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=8L348JLHBBAR type=del size=12813 2024-09-12T17:07:53.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.276+0000 7f9eaebff780 1 < suggested remove operation key=LRI5G5G8O5X4 tag=VV0NLA0HKYG3 type=write 2024-09-12T17:07:53.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.278+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=OP6LPHHD7JOZ type=write size=859643 2024-09-12T17:07:53.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.279+0000 7f9eaebff780 1 < completed write operation key=TXHXOMIB4B53 tag=25PZC11G620A type=write size=919915 2024-09-12T17:07:53.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.281+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=RF9592WSF3JX type=del size=1749531 2024-09-12T17:07:53.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.282+0000 7f9eaebff780 1 < completed write operation key=8DJLYFM11DNI tag=VWI0YV1RV3T4 type=write size=757623 2024-09-12T17:07:53.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.284+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~3PUUS6N0VY4K.0 size=1048576 2024-09-12T17:07:53.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.286+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~3PUUS6N0VY4K.1 size=420770 2024-09-12T17:07:53.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.286+0000 7f9eaebff780 1 > prepared multipart upload key=0YD5P1ACZ09Q upload=3PUUS6N0VY4K tag=7JJMJBUMY3EI type=write size=2517922 2024-09-12T17:07:53.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.287+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~BOG253G1Z3VP.0 size=121333 2024-09-12T17:07:53.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.289+0000 7f9eaebff780 1 < completed multipart upload key=3VY271ZBO754 upload=BOG253G1Z3VP tag=PLZQG9FECB60 type=write size=1169909 2024-09-12T17:07:53.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.291+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~YCE3AOC12ORG.0 size=1048576 2024-09-12T17:07:53.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.292+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~YCE3AOC12ORG.1 size=1048576 2024-09-12T17:07:53.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.293+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~YCE3AOC12ORG.2 size=250915 2024-09-12T17:07:53.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.293+0000 7f9eaebff780 1 > prepared multipart upload key=3LY681252WAN upload=YCE3AOC12ORG tag=OXRP6PD3VI2M type=write size=3396643 2024-09-12T17:07:53.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.294+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~BMH8QH2IXIIW.0 size=1048576 2024-09-12T17:07:53.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.294+0000 7f9eaebff780 1 < canceled part key=_multipart_7PBT9VZ07OUI.2~BMH8QH2IXIIW.1 size=11447 2024-09-12T17:07:53.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.296+0000 7f9eaebff780 1 < canceled multipart upload key=7PBT9VZ07OUI upload=BMH8QH2IXIIW tag=E0ZNX9NF8EPU type=write size=2108599 2024-09-12T17:07:53.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.298+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~DJ0I8L8QXMQL.0 size=335216 2024-09-12T17:07:53.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.298+0000 7f9eaebff780 1 > prepared multipart upload key=SO6QF2JCRX6E upload=DJ0I8L8QXMQL tag=3OU4LW8T1T6W type=write size=1383792 2024-09-12T17:07:53.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.300+0000 7f9eaebff780 1 < suggested update operation key=GB8P7K59Y8VI tag=K3OAR5Z8J6HX type=del size=2578165 2024-09-12T17:07:53.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.303+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~7KX4N7RLUO3M.0 size=336491 2024-09-12T17:07:53.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.303+0000 7f9eaebff780 1 > prepared multipart upload key=TDZCNUZE8IOA upload=7KX4N7RLUO3M tag=ZZJOP4N37BR8 type=write size=1385067 2024-09-12T17:07:53.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.305+0000 7f9eaebff780 1 < suggested remove operation key=TDZCNUZE8IOA tag=7SZ63Z7SX3IZ type=del 2024-09-12T17:07:53.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.306+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=OLM1R42KZB35 type=del size=3618579 2024-09-12T17:07:53.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.307+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=WYL9UIKRRAYD type=del 2024-09-12T17:07:53.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.309+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~0O0Z68N5I0EB.0 size=1048576 2024-09-12T17:07:53.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.310+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~0O0Z68N5I0EB.1 size=555024 2024-09-12T17:07:53.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.310+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=0O0Z68N5I0EB tag=ZMR8QLN1TJV0 type=write size=2652176 2024-09-12T17:07:53.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.311+0000 7f9eaebff780 1 < completed delete operation key=P9GMGM3WK6O7 tag=F6BV4PQ4BX67 type=del 2024-09-12T17:07:53.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.313+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~1XHD6MEKTY8X.0 size=1048576 2024-09-12T17:07:53.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.314+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~1XHD6MEKTY8X.1 size=837372 2024-09-12T17:07:53.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.314+0000 7f9eaebff780 1 > prepared multipart upload key=3VY271ZBO754 upload=1XHD6MEKTY8X tag=KDA0EBQKDXQ1 type=write size=2934524 2024-09-12T17:07:53.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.316+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~VWNOTC7AQ12R.0 size=1048576 2024-09-12T17:07:53.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.317+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~VWNOTC7AQ12R.1 size=1048576 2024-09-12T17:07:53.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.318+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~VWNOTC7AQ12R.2 size=678764 2024-09-12T17:07:53.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.320+0000 7f9eaebff780 1 < completed multipart upload key=8DJLYFM11DNI upload=VWNOTC7AQ12R tag=LS1ANOHCZ5F5 type=write size=3824492 2024-09-12T17:07:53.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.321+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=8KCAYYUAGDHN type=del size=3894698 2024-09-12T17:07:53.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.322+0000 7f9eaebff780 -1 < failed to complete operation key=QIMNK4DL3D0N tag=M2CDYHROJH5B type=write size=565670: (22) Invalid argument 2024-09-12T17:07:53.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.323+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=8BWLXI4E6IQ9 type=del size=421171 2024-09-12T17:07:53.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.325+0000 7f9eaebff780 1 < completed delete operation key=8DJLYFM11DNI tag=4WCGULAMT4MN type=del 2024-09-12T17:07:53.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.326+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=HM880ESEZLLT type=del size=3264126 2024-09-12T17:07:53.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.328+0000 7f9eaebff780 1 < suggested update operation key=9WJGBODZ60NJ tag=ALQ5BZA32UV1 type=del size=583832 2024-09-12T17:07:53.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.329+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=5IPQDTFDGA1E type=del size=2737475 2024-09-12T17:07:53.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.330+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~UAAEO61TLN9Z.0 size=618341 2024-09-12T17:07:53.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.332+0000 7f9eaebff780 1 < completed multipart upload key=ZC814TPVLJO1 upload=UAAEO61TLN9Z tag=U54EZ0CI5CK4 type=write size=1666917 2024-09-12T17:07:53.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.333+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=QAKBJ3R4TV3T type=del size=3576497 2024-09-12T17:07:53.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.335+0000 7f9eaebff780 -1 < failed to complete operation key=LRI5G5G8O5X4 tag=J18Z5J8LLBTS type=del size=218125: (22) Invalid argument 2024-09-12T17:07:53.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.337+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~PPZTYV1S100Q.0 size=1048576 2024-09-12T17:07:53.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.338+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~PPZTYV1S100Q.1 size=1048576 2024-09-12T17:07:53.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.339+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~PPZTYV1S100Q.2 size=520619 2024-09-12T17:07:53.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.339+0000 7f9eaebff780 1 > prepared multipart upload key=KF8XE48DI9KZ upload=PPZTYV1S100Q tag=BRUW5SCGHGY3 type=write size=3666347 2024-09-12T17:07:53.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.340+0000 7f9eaebff780 1 < completed delete operation key=ZYP3P4031PUZ tag=8L348JLHBBAR type=del 2024-09-12T17:07:53.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.342+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=N95HRGLAZPD8 type=del size=1754276 2024-09-12T17:07:53.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.343+0000 7f9eaebff780 1 < completed write operation key=ZYP3P4031PUZ tag=OP6LPHHD7JOZ type=write size=859643 2024-09-12T17:07:53.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.345+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~EM4U1O1R1CV1.0 size=1048576 2024-09-12T17:07:53.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.346+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~EM4U1O1R1CV1.1 size=536883 2024-09-12T17:07:53.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.346+0000 7f9eaebff780 1 > prepared multipart upload key=B1YC6DM9S8JJ upload=EM4U1O1R1CV1 tag=OL8BUELEMQ3K type=write size=2634035 2024-09-12T17:07:53.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.348+0000 7f9eaebff780 1 < suggested remove operation key=9WJGBODZ60NJ tag=RF9592WSF3JX type=del 2024-09-12T17:07:53.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.350+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~UTWFUFOZTRGH.0 size=1048576 2024-09-12T17:07:53.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.351+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~UTWFUFOZTRGH.1 size=1048576 2024-09-12T17:07:53.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.352+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~UTWFUFOZTRGH.2 size=415888 2024-09-12T17:07:53.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.352+0000 7f9eaebff780 1 > prepared multipart upload key=3LY681252WAN upload=UTWFUFOZTRGH tag=202YY2A8SUHW type=write size=3561616 2024-09-12T17:07:53.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.353+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~3PUUS6N0VY4K.0 size=1048576 2024-09-12T17:07:53.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.354+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~3PUUS6N0VY4K.1 size=420770 2024-09-12T17:07:53.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.356+0000 7f9eaebff780 1 < completed multipart upload key=0YD5P1ACZ09Q upload=3PUUS6N0VY4K tag=7JJMJBUMY3EI type=write size=2517922 2024-09-12T17:07:53.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.358+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=28KBQ26JXOLR type=write size=368910 2024-09-12T17:07:53.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.360+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~YCE3AOC12ORG.0 size=1048576 2024-09-12T17:07:53.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.361+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~YCE3AOC12ORG.1 size=1048576 2024-09-12T17:07:53.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.361+0000 7f9eaebff780 1 < canceled part key=_multipart_3LY681252WAN.2~YCE3AOC12ORG.2 size=250915 2024-09-12T17:07:53.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.363+0000 7f9eaebff780 1 < canceled multipart upload key=3LY681252WAN upload=YCE3AOC12ORG tag=OXRP6PD3VI2M type=write size=3396643 2024-09-12T17:07:53.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.365+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~41E7WCW8M06H.0 size=1048576 2024-09-12T17:07:53.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.366+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~41E7WCW8M06H.1 size=163632 2024-09-12T17:07:53.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.366+0000 7f9eaebff780 1 > prepared multipart upload key=A1KRCFY18QTP upload=41E7WCW8M06H tag=AJUW30TYRPSQ type=write size=2260784 2024-09-12T17:07:53.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.367+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~DJ0I8L8QXMQL.0 size=335216 2024-09-12T17:07:53.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.369+0000 7f9eaebff780 1 < completed multipart upload key=SO6QF2JCRX6E upload=DJ0I8L8QXMQL tag=3OU4LW8T1T6W type=write size=1383792 2024-09-12T17:07:53.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.371+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=BAPOO3G4WXMD type=del size=2534530 2024-09-12T17:07:53.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.372+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~7KX4N7RLUO3M.0 size=336491 2024-09-12T17:07:53.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.374+0000 7f9eaebff780 1 < completed multipart upload key=TDZCNUZE8IOA upload=7KX4N7RLUO3M tag=ZZJOP4N37BR8 type=write size=1385067 2024-09-12T17:07:53.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.375+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=DYOLE4ULFTSB type=write size=554186 2024-09-12T17:07:53.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.376+0000 7f9eaebff780 1 < completed delete operation key=OGD6H9VSVGWF tag=OLM1R42KZB35 type=del 2024-09-12T17:07:53.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.377+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=JPR225AN16CM type=write size=120461 2024-09-12T17:07:53.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.378+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~0O0Z68N5I0EB.0 size=1048576 2024-09-12T17:07:53.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.379+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~0O0Z68N5I0EB.1 size=555024 2024-09-12T17:07:53.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.381+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=0O0Z68N5I0EB tag=ZMR8QLN1TJV0 type=write size=2652176 2024-09-12T17:07:53.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.383+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~IRFGFM6I2NG5.0 size=1048576 2024-09-12T17:07:53.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.384+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~IRFGFM6I2NG5.1 size=1048576 2024-09-12T17:07:53.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.385+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~IRFGFM6I2NG5.2 size=987117 2024-09-12T17:07:53.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.385+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=IRFGFM6I2NG5 tag=GUSJLCTW5530 type=write size=4132845 2024-09-12T17:07:53.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.386+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~1XHD6MEKTY8X.0 size=1048576 2024-09-12T17:07:53.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.387+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~1XHD6MEKTY8X.1 size=837372 2024-09-12T17:07:53.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.389+0000 7f9eaebff780 1 < completed multipart upload key=3VY271ZBO754 upload=1XHD6MEKTY8X tag=KDA0EBQKDXQ1 type=write size=2934524 2024-09-12T17:07:53.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.391+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=OIIOB8M3OEAK type=del size=3727580 2024-09-12T17:07:53.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.392+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=8KCAYYUAGDHN type=del 2024-09-12T17:07:53.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.394+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~KSU1LU8VXBXJ.0 size=280378 2024-09-12T17:07:53.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.394+0000 7f9eaebff780 1 > prepared multipart upload key=A1KRCFY18QTP upload=KSU1LU8VXBXJ tag=I94NRW09QG7Q type=write size=1328954 2024-09-12T17:07:53.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.395+0000 7f9eaebff780 1 < completed delete operation key=YIEP2JYDSLW0 tag=8BWLXI4E6IQ9 type=del 2024-09-12T17:07:53.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.397+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~0IKLU5R1Z8K8.0 size=727646 2024-09-12T17:07:53.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.397+0000 7f9eaebff780 1 > prepared multipart upload key=ZYP3P4031PUZ upload=0IKLU5R1Z8K8 tag=0LOVOF7KBN5T type=write size=1776222 2024-09-12T17:07:53.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.398+0000 7f9eaebff780 1 < completed delete operation key=P9GMGM3WK6O7 tag=HM880ESEZLLT type=del 2024-09-12T17:07:53.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.401+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~WYOWA1EE4O2D.0 size=678588 2024-09-12T17:07:53.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.401+0000 7f9eaebff780 1 > prepared multipart upload key=SO6QF2JCRX6E upload=WYOWA1EE4O2D tag=O6VV5DX8U1A9 type=write size=1727164 2024-09-12T17:07:53.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.402+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=5IPQDTFDGA1E type=del 2024-09-12T17:07:53.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.403+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=749TFEKTYLDR type=del size=1671706 2024-09-12T17:07:53.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.404+0000 7f9eaebff780 1 < completed delete operation key=EKUW5AKC428U tag=QAKBJ3R4TV3T type=del 2024-09-12T17:07:53.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.405+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=VGBO4DE6ZNST type=write size=352671 2024-09-12T17:07:53.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.407+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~PPZTYV1S100Q.0 size=1048576 2024-09-12T17:07:53.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.408+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~PPZTYV1S100Q.1 size=1048576 2024-09-12T17:07:53.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.409+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~PPZTYV1S100Q.2 size=520619 2024-09-12T17:07:53.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.411+0000 7f9eaebff780 1 < completed multipart upload key=KF8XE48DI9KZ upload=PPZTYV1S100Q tag=BRUW5SCGHGY3 type=write size=3666347 2024-09-12T17:07:53.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.412+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=9NR7NLIXZNVZ type=del size=3148598 2024-09-12T17:07:53.416 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.414+0000 7f9eaebff780 1 < suggested update operation key=SHWT6AT7PN0M tag=N95HRGLAZPD8 type=del size=1754276 2024-09-12T17:07:53.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.416+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~BYD6CKEXAH21.0 size=655983 2024-09-12T17:07:53.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.416+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=BYD6CKEXAH21 tag=5V0IBTTI32M0 type=write size=1704559 2024-09-12T17:07:53.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.418+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~EM4U1O1R1CV1.0 size=1048576 2024-09-12T17:07:53.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.419+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~EM4U1O1R1CV1.1 size=536883 2024-09-12T17:07:53.423 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.421+0000 7f9eaebff780 1 < completed multipart upload key=B1YC6DM9S8JJ upload=EM4U1O1R1CV1 tag=OL8BUELEMQ3K type=write size=2634035 2024-09-12T17:07:53.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.424+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~C2HAK1BZNRNN.0 size=1048576 2024-09-12T17:07:53.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.425+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~C2HAK1BZNRNN.1 size=1048576 2024-09-12T17:07:53.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.426+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~C2HAK1BZNRNN.2 size=126954 2024-09-12T17:07:53.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.426+0000 7f9eaebff780 1 > prepared multipart upload key=LJN514F16XJA upload=C2HAK1BZNRNN tag=PI2VJ3KEFK0A type=write size=3272682 2024-09-12T17:07:53.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.428+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~UTWFUFOZTRGH.0 size=1048576 2024-09-12T17:07:53.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.429+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~UTWFUFOZTRGH.1 size=1048576 2024-09-12T17:07:53.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.430+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~UTWFUFOZTRGH.2 size=415888 2024-09-12T17:07:53.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.432+0000 7f9eaebff780 1 < completed multipart upload key=3LY681252WAN upload=UTWFUFOZTRGH tag=202YY2A8SUHW type=write size=3561616 2024-09-12T17:07:53.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.435+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~TQAPMQR2W2J8.0 size=704305 2024-09-12T17:07:53.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.435+0000 7f9eaebff780 1 > prepared multipart upload key=3VY271ZBO754 upload=TQAPMQR2W2J8 tag=HXKCGWLTE63U type=write size=1752881 2024-09-12T17:07:53.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.438+0000 7f9eaebff780 1 < suggested remove operation key=GB8P7K59Y8VI tag=28KBQ26JXOLR type=write 2024-09-12T17:07:53.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.439+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=H15SS8C2FK80 type=del size=383492 2024-09-12T17:07:53.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.441+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~41E7WCW8M06H.0 size=1048576 2024-09-12T17:07:53.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.442+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~41E7WCW8M06H.1 size=163632 2024-09-12T17:07:53.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.444+0000 7f9eaebff780 1 < completed multipart upload key=A1KRCFY18QTP upload=41E7WCW8M06H tag=AJUW30TYRPSQ type=write size=2260784 2024-09-12T17:07:53.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.446+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~LPM4STC7IJNR.0 size=1048576 2024-09-12T17:07:53.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.447+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~LPM4STC7IJNR.1 size=160920 2024-09-12T17:07:53.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.447+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=LPM4STC7IJNR tag=ESKCJS1S26PG type=write size=2258072 2024-09-12T17:07:53.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.449+0000 7f9eaebff780 1 < completed delete operation key=UYF1AN2W59VN tag=BAPOO3G4WXMD type=del 2024-09-12T17:07:53.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.451+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~Q64AN14ZHIMZ.0 size=1048576 2024-09-12T17:07:53.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.452+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~Q64AN14ZHIMZ.1 size=1048576 2024-09-12T17:07:53.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.453+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~Q64AN14ZHIMZ.2 size=115234 2024-09-12T17:07:53.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.453+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=Q64AN14ZHIMZ tag=A4TADWPIJLS2 type=write size=3260962 2024-09-12T17:07:53.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.454+0000 7f9eaebff780 1 < completed write operation key=TXHXOMIB4B53 tag=DYOLE4ULFTSB type=write size=554186 2024-09-12T17:07:53.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.457+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~6Y2VUPZ49ESI.0 size=1048576 2024-09-12T17:07:53.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.458+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~6Y2VUPZ49ESI.1 size=1048576 2024-09-12T17:07:53.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.459+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~6Y2VUPZ49ESI.2 size=442611 2024-09-12T17:07:53.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.459+0000 7f9eaebff780 1 > prepared multipart upload key=9WJGBODZ60NJ upload=6Y2VUPZ49ESI tag=7PVDKX87BD5B type=write size=3588339 2024-09-12T17:07:53.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.460+0000 7f9eaebff780 1 < completed write operation key=8DJLYFM11DNI tag=JPR225AN16CM type=write size=120461 2024-09-12T17:07:53.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.462+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~VWN9ACMUHG39.0 size=155328 2024-09-12T17:07:53.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.462+0000 7f9eaebff780 1 > prepared multipart upload key=LRI5G5G8O5X4 upload=VWN9ACMUHG39 tag=A5MAY6NPYGB5 type=write size=1203904 2024-09-12T17:07:53.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.463+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~IRFGFM6I2NG5.0 size=1048576 2024-09-12T17:07:53.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.463+0000 7f9eaebff780 1 < canceled part key=_multipart_OH6GXTMPBYUY.2~IRFGFM6I2NG5.1 size=1048576 2024-09-12T17:07:53.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.464+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~IRFGFM6I2NG5.2 size=987117 2024-09-12T17:07:53.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.467+0000 7f9eaebff780 1 < canceled multipart upload key=OH6GXTMPBYUY upload=IRFGFM6I2NG5 tag=GUSJLCTW5530 type=write size=4132845 2024-09-12T17:07:53.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.469+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~K0VZB02HEQ5V.0 size=1048576 2024-09-12T17:07:53.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.470+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~K0VZB02HEQ5V.1 size=1048576 2024-09-12T17:07:53.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.471+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~K0VZB02HEQ5V.2 size=361598 2024-09-12T17:07:53.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.471+0000 7f9eaebff780 1 > prepared multipart upload key=YIEP2JYDSLW0 upload=K0VZB02HEQ5V tag=H5A7BY6NZQZ0 type=write size=3507326 2024-09-12T17:07:53.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.472+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=OIIOB8M3OEAK type=del 2024-09-12T17:07:53.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.474+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=8MEBBAL39Y2B type=del size=1132853 2024-09-12T17:07:53.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.477+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~KSU1LU8VXBXJ.0 size=280378 2024-09-12T17:07:53.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.481+0000 7f9eaebff780 1 < completed multipart upload key=A1KRCFY18QTP upload=KSU1LU8VXBXJ tag=I94NRW09QG7Q type=write size=1328954 2024-09-12T17:07:53.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.483+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~YZPAELWOUDGR.0 size=1048576 2024-09-12T17:07:53.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.484+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~YZPAELWOUDGR.1 size=68033 2024-09-12T17:07:53.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.484+0000 7f9eaebff780 1 > prepared multipart upload key=YIEP2JYDSLW0 upload=YZPAELWOUDGR tag=PHB063S1GJNB type=write size=2165185 2024-09-12T17:07:53.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.485+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~0IKLU5R1Z8K8.0 size=727646 2024-09-12T17:07:53.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.487+0000 7f9eaebff780 1 < completed multipart upload key=ZYP3P4031PUZ upload=0IKLU5R1Z8K8 tag=0LOVOF7KBN5T type=write size=1776222 2024-09-12T17:07:53.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.489+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=G4XNC8FYRSRD type=del size=3699000 2024-09-12T17:07:53.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.490+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~WYOWA1EE4O2D.0 size=678588 2024-09-12T17:07:53.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.492+0000 7f9eaebff780 1 < completed multipart upload key=SO6QF2JCRX6E upload=WYOWA1EE4O2D tag=O6VV5DX8U1A9 type=write size=1727164 2024-09-12T17:07:53.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.494+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~WO6QB0ILEXYO.0 size=839807 2024-09-12T17:07:53.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.494+0000 7f9eaebff780 1 > prepared multipart upload key=0YD5P1ACZ09Q upload=WO6QB0ILEXYO tag=U9K32QDWQF23 type=write size=1888383 2024-09-12T17:07:53.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.496+0000 7f9eaebff780 1 < suggested update operation key=ZC814TPVLJO1 tag=749TFEKTYLDR type=del size=1671706 2024-09-12T17:07:53.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.497+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=9HMHCL0S47OX type=del size=334720 2024-09-12T17:07:53.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.498+0000 7f9eaebff780 1 < completed write operation key=TXHXOMIB4B53 tag=VGBO4DE6ZNST type=write size=352671 2024-09-12T17:07:53.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.500+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=IMQG9MIB995N type=del size=307336 2024-09-12T17:07:53.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.502+0000 7f9eaebff780 1 < suggested update operation key=M3PLQGSK34YM tag=9NR7NLIXZNVZ type=del size=3148598 2024-09-12T17:07:53.504 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.503+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=CC9N1TUAC4C0 type=del size=2095435 2024-09-12T17:07:53.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.504+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~BYD6CKEXAH21.0 size=655983 2024-09-12T17:07:53.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.506+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=BYD6CKEXAH21 tag=5V0IBTTI32M0 type=write size=1704559 2024-09-12T17:07:53.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.507+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=UOZE6PYY3YJB type=del size=1755187 2024-09-12T17:07:53.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.508+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~C2HAK1BZNRNN.0 size=1048576 2024-09-12T17:07:53.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.509+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~C2HAK1BZNRNN.1 size=1048576 2024-09-12T17:07:53.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.510+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~C2HAK1BZNRNN.2 size=126954 2024-09-12T17:07:53.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.512+0000 7f9eaebff780 1 < completed multipart upload key=LJN514F16XJA upload=C2HAK1BZNRNN tag=PI2VJ3KEFK0A type=write size=3272682 2024-09-12T17:07:53.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.513+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=ZQ55OUBZO3Q2 type=del size=522706 2024-09-12T17:07:53.516 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.514+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~TQAPMQR2W2J8.0 size=704305 2024-09-12T17:07:53.518 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.516+0000 7f9eaebff780 1 < completed multipart upload key=3VY271ZBO754 upload=TQAPMQR2W2J8 tag=HXKCGWLTE63U type=write size=1752881 2024-09-12T17:07:53.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.517+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=QSEQQUKKOYZI type=del size=2991727 2024-09-12T17:07:53.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.519+0000 7f9eaebff780 1 < completed delete operation key=OH6GXTMPBYUY tag=H15SS8C2FK80 type=del 2024-09-12T17:07:53.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.521+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~UYPKMWBU0BBN.0 size=373073 2024-09-12T17:07:53.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.521+0000 7f9eaebff780 1 > prepared multipart upload key=ZYP3P4031PUZ upload=UYPKMWBU0BBN tag=XKVJW5F0HZ9A type=write size=1421649 2024-09-12T17:07:53.523 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.522+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~LPM4STC7IJNR.0 size=1048576 2024-09-12T17:07:53.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.523+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~LPM4STC7IJNR.1 size=160920 2024-09-12T17:07:53.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.525+0000 7f9eaebff780 1 < completed multipart upload key=M3PLQGSK34YM upload=LPM4STC7IJNR tag=ESKCJS1S26PG type=write size=2258072 2024-09-12T17:07:53.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.526+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=F6SDAXSNQ420 type=del size=2396172 2024-09-12T17:07:53.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.527+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~Q64AN14ZHIMZ.0 size=1048576 2024-09-12T17:07:53.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.528+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~Q64AN14ZHIMZ.1 size=1048576 2024-09-12T17:07:53.531 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.529+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~Q64AN14ZHIMZ.2 size=115234 2024-09-12T17:07:53.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.531+0000 7f9eaebff780 1 < completed multipart upload key=UYF1AN2W59VN upload=Q64AN14ZHIMZ tag=A4TADWPIJLS2 type=write size=3260962 2024-09-12T17:07:53.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.534+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~FHPPMX1W2JUT.0 size=1048576 2024-09-12T17:07:53.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.535+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~FHPPMX1W2JUT.1 size=1048576 2024-09-12T17:07:53.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.536+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~FHPPMX1W2JUT.2 size=188433 2024-09-12T17:07:53.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.536+0000 7f9eaebff780 1 > prepared multipart upload key=QIMNK4DL3D0N upload=FHPPMX1W2JUT tag=NE0P70Z7SLS8 type=write size=3334161 2024-09-12T17:07:53.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.537+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~6Y2VUPZ49ESI.0 size=1048576 2024-09-12T17:07:53.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.538+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~6Y2VUPZ49ESI.1 size=1048576 2024-09-12T17:07:53.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.539+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~6Y2VUPZ49ESI.2 size=442611 2024-09-12T17:07:53.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.541+0000 7f9eaebff780 1 < completed multipart upload key=9WJGBODZ60NJ upload=6Y2VUPZ49ESI tag=7PVDKX87BD5B type=write size=3588339 2024-09-12T17:07:53.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.543+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~HYVQ5LAX8U7E.0 size=1048576 2024-09-12T17:07:53.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.544+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~HYVQ5LAX8U7E.1 size=1048576 2024-09-12T17:07:53.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.545+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~HYVQ5LAX8U7E.2 size=521991 2024-09-12T17:07:53.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.545+0000 7f9eaebff780 1 > prepared multipart upload key=LJN514F16XJA upload=HYVQ5LAX8U7E tag=FUVXNVJTWHT7 type=write size=3667719 2024-09-12T17:07:53.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.546+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~VWN9ACMUHG39.0 size=155328 2024-09-12T17:07:53.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.548+0000 7f9eaebff780 1 < completed multipart upload key=LRI5G5G8O5X4 upload=VWN9ACMUHG39 tag=A5MAY6NPYGB5 type=write size=1203904 2024-09-12T17:07:53.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.549+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=WCARP2U91WJB type=del size=3552198 2024-09-12T17:07:53.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.551+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~K0VZB02HEQ5V.0 size=1048576 2024-09-12T17:07:53.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.552+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~K0VZB02HEQ5V.1 size=1048576 2024-09-12T17:07:53.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.553+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~K0VZB02HEQ5V.2 size=361598 2024-09-12T17:07:53.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.555+0000 7f9eaebff780 1 < completed multipart upload key=YIEP2JYDSLW0 upload=K0VZB02HEQ5V tag=H5A7BY6NZQZ0 type=write size=3507326 2024-09-12T17:07:53.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.556+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=AOZYRW1OV3DC type=del size=3587764 2024-09-12T17:07:53.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.557+0000 7f9eaebff780 1 < completed delete operation key=7PBT9VZ07OUI tag=8MEBBAL39Y2B type=del 2024-09-12T17:07:53.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.559+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~T21FJY75J1P1.0 size=1048576 2024-09-12T17:07:53.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.561+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~T21FJY75J1P1.1 size=1048576 2024-09-12T17:07:53.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.561+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~T21FJY75J1P1.2 size=231209 2024-09-12T17:07:53.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.561+0000 7f9eaebff780 1 > prepared multipart upload key=7PBT9VZ07OUI upload=T21FJY75J1P1 tag=Y97HQ3DFTVO2 type=write size=3376937 2024-09-12T17:07:53.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.563+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~YZPAELWOUDGR.0 size=1048576 2024-09-12T17:07:53.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.563+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~YZPAELWOUDGR.1 size=68033 2024-09-12T17:07:53.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.565+0000 7f9eaebff780 1 < completed multipart upload key=YIEP2JYDSLW0 upload=YZPAELWOUDGR tag=PHB063S1GJNB type=write size=2165185 2024-09-12T17:07:53.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.567+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=3S2PE9CC635X type=write size=371066 2024-09-12T17:07:53.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.568+0000 7f9eaebff780 1 < completed delete operation key=SVWPQETL92QU tag=G4XNC8FYRSRD type=del 2024-09-12T17:07:53.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.570+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~GDMRSSV5BRBQ.0 size=1048576 2024-09-12T17:07:53.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.571+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~GDMRSSV5BRBQ.1 size=1048576 2024-09-12T17:07:53.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.572+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~GDMRSSV5BRBQ.2 size=279663 2024-09-12T17:07:53.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.572+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=GDMRSSV5BRBQ tag=KGDNC0SN0KKV type=write size=3425391 2024-09-12T17:07:53.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.572+0000 7f9eaebff780 1 < canceled part key=_multipart_0YD5P1ACZ09Q.2~WO6QB0ILEXYO.0 size=839807 2024-09-12T17:07:53.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.574+0000 7f9eaebff780 1 < canceled multipart upload key=0YD5P1ACZ09Q upload=WO6QB0ILEXYO tag=U9K32QDWQF23 type=write size=1888383 2024-09-12T17:07:53.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.576+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~OML44J2NEEBO.0 size=1048576 2024-09-12T17:07:53.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.577+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~OML44J2NEEBO.1 size=442068 2024-09-12T17:07:53.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.577+0000 7f9eaebff780 1 > prepared multipart upload key=3LY681252WAN upload=OML44J2NEEBO tag=DFMBTKLD0WKF type=write size=2539220 2024-09-12T17:07:53.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.579+0000 7f9eaebff780 1 < canceled operation key=YIEP2JYDSLW0 tag=9HMHCL0S47OX type=del size=334720 2024-09-12T17:07:53.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.580+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=3O0INRZV6GD7 type=del size=661269 2024-09-12T17:07:53.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.581+0000 7f9eaebff780 1 < completed delete operation key=0F5LXJZMBFSP tag=IMQG9MIB995N type=del 2024-09-12T17:07:53.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.583+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~QTAOX73HZ348.0 size=834675 2024-09-12T17:07:53.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.583+0000 7f9eaebff780 1 > prepared multipart upload key=TDZCNUZE8IOA upload=QTAOX73HZ348 tag=UA511Z2QEXHU type=write size=1883251 2024-09-12T17:07:53.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.584+0000 7f9eaebff780 1 < completed delete operation key=OGD6H9VSVGWF tag=CC9N1TUAC4C0 type=del 2024-09-12T17:07:53.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.587+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~GE6VQCFW20VB.0 size=1048576 2024-09-12T17:07:53.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.588+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~GE6VQCFW20VB.1 size=1048576 2024-09-12T17:07:53.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.589+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~GE6VQCFW20VB.2 size=33357 2024-09-12T17:07:53.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.589+0000 7f9eaebff780 1 > prepared multipart upload key=A1KRCFY18QTP upload=GE6VQCFW20VB tag=M2SY53P30VF9 type=write size=3179085 2024-09-12T17:07:53.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.590+0000 7f9eaebff780 1 < canceled operation key=SO6QF2JCRX6E tag=UOZE6PYY3YJB type=del size=1755187 2024-09-12T17:07:53.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.593+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~I8R1XUXU11OK.0 size=1048576 2024-09-12T17:07:53.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.594+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~I8R1XUXU11OK.1 size=1048576 2024-09-12T17:07:53.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.595+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~I8R1XUXU11OK.2 size=102076 2024-09-12T17:07:53.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.595+0000 7f9eaebff780 1 > prepared multipart upload key=3LY681252WAN upload=I8R1XUXU11OK tag=9H1NJHW4OQN2 type=write size=3247804 2024-09-12T17:07:53.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.596+0000 7f9eaebff780 1 < completed delete operation key=LJN514F16XJA tag=ZQ55OUBZO3Q2 type=del 2024-09-12T17:07:53.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.597+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=YCMFHXB7PWXJ type=del size=283044 2024-09-12T17:07:53.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.598+0000 7f9eaebff780 1 < completed delete operation key=8DJLYFM11DNI tag=QSEQQUKKOYZI type=del 2024-09-12T17:07:53.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.599+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=7M09R5H5Q1MP type=del size=463097 2024-09-12T17:07:53.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.600+0000 7f9eaebff780 1 < canceled part key=_multipart_ZYP3P4031PUZ.2~UYPKMWBU0BBN.0 size=373073 2024-09-12T17:07:53.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.602+0000 7f9eaebff780 1 < canceled multipart upload key=ZYP3P4031PUZ upload=UYPKMWBU0BBN tag=XKVJW5F0HZ9A type=write size=1421649 2024-09-12T17:07:53.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.603+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=F9Y8AHV0GKG5 type=del size=372 2024-09-12T17:07:53.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.604+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=F6SDAXSNQ420 type=del 2024-09-12T17:07:53.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.605+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=G40U40TR0F23 type=del size=3724591 2024-09-12T17:07:53.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.606+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~FHPPMX1W2JUT.0 size=1048576 2024-09-12T17:07:53.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.608+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~FHPPMX1W2JUT.1 size=1048576 2024-09-12T17:07:53.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.608+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~FHPPMX1W2JUT.2 size=188433 2024-09-12T17:07:53.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.611+0000 7f9eaebff780 1 < completed multipart upload key=QIMNK4DL3D0N upload=FHPPMX1W2JUT tag=NE0P70Z7SLS8 type=write size=3334161 2024-09-12T17:07:53.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.613+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~P4RAZUZM2V0A.0 size=1048576 2024-09-12T17:07:53.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.614+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~P4RAZUZM2V0A.1 size=1048576 2024-09-12T17:07:53.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.615+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~P4RAZUZM2V0A.2 size=649996 2024-09-12T17:07:53.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.615+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=P4RAZUZM2V0A tag=XG23PNNX92HW type=write size=3795724 2024-09-12T17:07:53.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.616+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~HYVQ5LAX8U7E.0 size=1048576 2024-09-12T17:07:53.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.617+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~HYVQ5LAX8U7E.1 size=1048576 2024-09-12T17:07:53.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.618+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~HYVQ5LAX8U7E.2 size=521991 2024-09-12T17:07:53.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.620+0000 7f9eaebff780 1 < completed multipart upload key=LJN514F16XJA upload=HYVQ5LAX8U7E tag=FUVXNVJTWHT7 type=write size=3667719 2024-09-12T17:07:53.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.622+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~JQUZJ37HSKDB.0 size=1048576 2024-09-12T17:07:53.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.623+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~JQUZJ37HSKDB.1 size=635955 2024-09-12T17:07:53.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.623+0000 7f9eaebff780 1 > prepared multipart upload key=A1KRCFY18QTP upload=JQUZJ37HSKDB tag=U3RI28EDSQXN type=write size=2733107 2024-09-12T17:07:53.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.625+0000 7f9eaebff780 1 < completed delete operation key=EKUW5AKC428U tag=WCARP2U91WJB type=del 2024-09-12T17:07:53.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.626+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=BGBVQSSIYL7U type=del size=3812710 2024-09-12T17:07:53.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.627+0000 7f9eaebff780 1 < canceled operation key=LJN514F16XJA tag=AOZYRW1OV3DC type=del size=3587764 2024-09-12T17:07:53.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.629+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~AVBTH6I0YXGZ.0 size=1048576 2024-09-12T17:07:53.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.630+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~AVBTH6I0YXGZ.1 size=1048576 2024-09-12T17:07:53.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.631+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~AVBTH6I0YXGZ.2 size=268435 2024-09-12T17:07:53.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.631+0000 7f9eaebff780 1 > prepared multipart upload key=QIMNK4DL3D0N upload=AVBTH6I0YXGZ tag=GYVUCVYKORGX type=write size=3414163 2024-09-12T17:07:53.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.634+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~T21FJY75J1P1.0 size=1048576 2024-09-12T17:07:53.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.635+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~T21FJY75J1P1.1 size=1048576 2024-09-12T17:07:53.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.636+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~T21FJY75J1P1.2 size=231209 2024-09-12T17:07:53.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.638+0000 7f9eaebff780 1 < completed multipart upload key=7PBT9VZ07OUI upload=T21FJY75J1P1 tag=Y97HQ3DFTVO2 type=write size=3376937 2024-09-12T17:07:53.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.640+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~8SEMPSO88FNI.0 size=1048576 2024-09-12T17:07:53.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.641+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~8SEMPSO88FNI.1 size=1048576 2024-09-12T17:07:53.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.642+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~8SEMPSO88FNI.2 size=710988 2024-09-12T17:07:53.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.642+0000 7f9eaebff780 1 > prepared multipart upload key=CAIZM33SDFPM upload=8SEMPSO88FNI tag=VRZ1NKDR83JE type=write size=3856716 2024-09-12T17:07:53.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.643+0000 7f9eaebff780 1 < canceled operation key=K2NHRSUDQBRW tag=3S2PE9CC635X type=write size=371066 2024-09-12T17:07:53.647 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.646+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~EFH81PW8HSQ0.0 size=777339 2024-09-12T17:07:53.647 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.646+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=EFH81PW8HSQ0 tag=X3OTG5H1TKNK type=write size=1825915 2024-09-12T17:07:53.648 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.647+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~GDMRSSV5BRBQ.0 size=1048576 2024-09-12T17:07:53.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.648+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~GDMRSSV5BRBQ.1 size=1048576 2024-09-12T17:07:53.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.648+0000 7f9eaebff780 1 < canceled part key=_multipart_M3PLQGSK34YM.2~GDMRSSV5BRBQ.2 size=279663 2024-09-12T17:07:53.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.650+0000 7f9eaebff780 1 < canceled multipart upload key=M3PLQGSK34YM upload=GDMRSSV5BRBQ tag=KGDNC0SN0KKV type=write size=3425391 2024-09-12T17:07:53.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.652+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~61B9R58X89WT.0 size=1041085 2024-09-12T17:07:53.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.652+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=61B9R58X89WT tag=FGC1TS64OVIH type=write size=2089661 2024-09-12T17:07:53.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.653+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~OML44J2NEEBO.0 size=1048576 2024-09-12T17:07:53.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.653+0000 7f9eaebff780 1 < canceled part key=_multipart_3LY681252WAN.2~OML44J2NEEBO.1 size=442068 2024-09-12T17:07:53.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.655+0000 7f9eaebff780 1 < canceled multipart upload key=3LY681252WAN upload=OML44J2NEEBO tag=DFMBTKLD0WKF type=write size=2539220 2024-09-12T17:07:53.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.656+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=A0KV04KIQMDR type=del size=3626087 2024-09-12T17:07:53.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.658+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=3O0INRZV6GD7 type=del 2024-09-12T17:07:53.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.660+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~8HQ808BZUED1.0 size=1048576 2024-09-12T17:07:53.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.661+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~8HQ808BZUED1.1 size=1048576 2024-09-12T17:07:53.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.662+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~8HQ808BZUED1.2 size=603595 2024-09-12T17:07:53.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.662+0000 7f9eaebff780 1 > prepared multipart upload key=3LY681252WAN upload=8HQ808BZUED1 tag=IVUD1UURXIUB type=write size=3749323 2024-09-12T17:07:53.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.663+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~QTAOX73HZ348.0 size=834675 2024-09-12T17:07:53.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.665+0000 7f9eaebff780 1 < completed multipart upload key=TDZCNUZE8IOA upload=QTAOX73HZ348 tag=UA511Z2QEXHU type=write size=1883251 2024-09-12T17:07:53.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.666+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=77TWN8V1CE17 type=write size=279674 2024-09-12T17:07:53.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.667+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~GE6VQCFW20VB.0 size=1048576 2024-09-12T17:07:53.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.668+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~GE6VQCFW20VB.1 size=1048576 2024-09-12T17:07:53.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.668+0000 7f9eaebff780 1 < canceled part key=_multipart_A1KRCFY18QTP.2~GE6VQCFW20VB.2 size=33357 2024-09-12T17:07:53.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.670+0000 7f9eaebff780 1 < canceled multipart upload key=A1KRCFY18QTP upload=GE6VQCFW20VB tag=M2SY53P30VF9 type=write size=3179085 2024-09-12T17:07:53.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.671+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=LL3GJBHVOL0A type=del size=2309807 2024-09-12T17:07:53.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.672+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~I8R1XUXU11OK.0 size=1048576 2024-09-12T17:07:53.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.673+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~I8R1XUXU11OK.1 size=1048576 2024-09-12T17:07:53.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.674+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~I8R1XUXU11OK.2 size=102076 2024-09-12T17:07:53.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.676+0000 7f9eaebff780 1 < completed multipart upload key=3LY681252WAN upload=I8R1XUXU11OK tag=9H1NJHW4OQN2 type=write size=3247804 2024-09-12T17:07:53.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.679+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~JEKKEQ947C4M.0 size=1048576 2024-09-12T17:07:53.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.680+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~JEKKEQ947C4M.1 size=1048576 2024-09-12T17:07:53.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.681+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~JEKKEQ947C4M.2 size=324662 2024-09-12T17:07:53.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.681+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=JEKKEQ947C4M tag=M6SKVLYXN0JH type=write size=3470390 2024-09-12T17:07:53.683 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.682+0000 7f9eaebff780 1 < canceled operation key=OGD6H9VSVGWF tag=YCMFHXB7PWXJ type=del size=283044 2024-09-12T17:07:53.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.684+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~FCT8WPPHS5IS.0 size=1048576 2024-09-12T17:07:53.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.685+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~FCT8WPPHS5IS.1 size=469517 2024-09-12T17:07:53.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.685+0000 7f9eaebff780 1 > prepared multipart upload key=8DJLYFM11DNI upload=FCT8WPPHS5IS tag=VG8PS8XT09HG type=write size=2566669 2024-09-12T17:07:53.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.686+0000 7f9eaebff780 1 < completed delete operation key=M3PLQGSK34YM tag=7M09R5H5Q1MP type=del 2024-09-12T17:07:53.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.687+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=LCL0SIX9MO00 type=del size=3888388 2024-09-12T17:07:53.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.689+0000 7f9eaebff780 1 < completed delete operation key=9I6RGNRB6HSY tag=F9Y8AHV0GKG5 type=del 2024-09-12T17:07:53.691 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.690+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=AAKPMRYPWHBT type=del size=4191852 2024-09-12T17:07:53.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.691+0000 7f9eaebff780 1 < completed delete operation key=OH6GXTMPBYUY tag=G40U40TR0F23 type=del 2024-09-12T17:07:53.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.692+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=9S61CDPXQQ1W type=del size=567217 2024-09-12T17:07:53.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.694+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~P4RAZUZM2V0A.0 size=1048576 2024-09-12T17:07:53.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.695+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~P4RAZUZM2V0A.1 size=1048576 2024-09-12T17:07:53.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.695+0000 7f9eaebff780 1 < canceled part key=_multipart_P9GMGM3WK6O7.2~P4RAZUZM2V0A.2 size=649996 2024-09-12T17:07:53.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.698+0000 7f9eaebff780 1 < canceled multipart upload key=P9GMGM3WK6O7 upload=P4RAZUZM2V0A tag=XG23PNNX92HW type=write size=3795724 2024-09-12T17:07:53.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.699+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=CHKHFAU9ZOTT type=del size=1872119 2024-09-12T17:07:53.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.701+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~JQUZJ37HSKDB.0 size=1048576 2024-09-12T17:07:53.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.702+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~JQUZJ37HSKDB.1 size=635955 2024-09-12T17:07:53.705 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.703+0000 7f9eaebff780 1 < completed multipart upload key=A1KRCFY18QTP upload=JQUZJ37HSKDB tag=U3RI28EDSQXN type=write size=2733107 2024-09-12T17:07:53.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.705+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=Z81MVU0JGQM7 type=del size=438027 2024-09-12T17:07:53.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.706+0000 7f9eaebff780 1 < completed delete operation key=K0P9ZZ91UJJ8 tag=BGBVQSSIYL7U type=del 2024-09-12T17:07:53.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.707+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=XYO1RW2E4P6L type=del size=3962121 2024-09-12T17:07:53.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.708+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~AVBTH6I0YXGZ.0 size=1048576 2024-09-12T17:07:53.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.708+0000 7f9eaebff780 1 < canceled part key=_multipart_QIMNK4DL3D0N.2~AVBTH6I0YXGZ.1 size=1048576 2024-09-12T17:07:53.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.709+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~AVBTH6I0YXGZ.2 size=268435 2024-09-12T17:07:53.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.711+0000 7f9eaebff780 1 < canceled multipart upload key=QIMNK4DL3D0N upload=AVBTH6I0YXGZ tag=GYVUCVYKORGX type=write size=3414163 2024-09-12T17:07:53.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.713+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~GR1029RTBDJE.0 size=954944 2024-09-12T17:07:53.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.713+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=GR1029RTBDJE tag=D3EJTXDFLB55 type=write size=2003520 2024-09-12T17:07:53.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.715+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~8SEMPSO88FNI.0 size=1048576 2024-09-12T17:07:53.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.716+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~8SEMPSO88FNI.1 size=1048576 2024-09-12T17:07:53.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.717+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~8SEMPSO88FNI.2 size=710988 2024-09-12T17:07:53.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.719+0000 7f9eaebff780 1 < completed multipart upload key=CAIZM33SDFPM upload=8SEMPSO88FNI tag=VRZ1NKDR83JE type=write size=3856716 2024-09-12T17:07:53.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.720+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=ZFLZT55Z5WRC type=del size=512969 2024-09-12T17:07:53.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.722+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~EFH81PW8HSQ0.0 size=777339 2024-09-12T17:07:53.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.723+0000 7f9eaebff780 1 < completed multipart upload key=UYF1AN2W59VN upload=EFH81PW8HSQ0 tag=X3OTG5H1TKNK type=write size=1825915 2024-09-12T17:07:53.726 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.725+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=LJS5QRGLNZVS type=del size=1905530 2024-09-12T17:07:53.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.726+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~61B9R58X89WT.0 size=1041085 2024-09-12T17:07:53.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.728+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=61B9R58X89WT tag=FGC1TS64OVIH type=write size=2089661 2024-09-12T17:07:53.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.730+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~D0TAK9UXN4QI.0 size=1048576 2024-09-12T17:07:53.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.731+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~D0TAK9UXN4QI.1 size=533048 2024-09-12T17:07:53.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.731+0000 7f9eaebff780 1 > prepared multipart upload key=YIEP2JYDSLW0 upload=D0TAK9UXN4QI tag=AODA29F330SN type=write size=2630200 2024-09-12T17:07:53.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.732+0000 7f9eaebff780 1 < completed delete operation key=B1YC6DM9S8JJ tag=A0KV04KIQMDR type=del 2024-09-12T17:07:53.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.734+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=DU7YEE3QWADI type=del size=2762544 2024-09-12T17:07:53.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.735+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~8HQ808BZUED1.0 size=1048576 2024-09-12T17:07:53.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.736+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~8HQ808BZUED1.1 size=1048576 2024-09-12T17:07:53.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.737+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~8HQ808BZUED1.2 size=603595 2024-09-12T17:07:53.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.739+0000 7f9eaebff780 1 < completed multipart upload key=3LY681252WAN upload=8HQ808BZUED1 tag=IVUD1UURXIUB type=write size=3749323 2024-09-12T17:07:53.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.741+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=9G31TNBOEDB8 type=del size=784898 2024-09-12T17:07:53.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.742+0000 7f9eaebff780 1 < canceled operation key=ZYP3P4031PUZ tag=77TWN8V1CE17 type=write size=279674 2024-09-12T17:07:53.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.744+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~F4QO35653R2W.0 size=865342 2024-09-12T17:07:53.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.744+0000 7f9eaebff780 1 > prepared multipart upload key=3LY681252WAN upload=F4QO35653R2W tag=FZ4A2IIWU5ZK type=write size=1913918 2024-09-12T17:07:53.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.746+0000 7f9eaebff780 1 < suggested remove operation key=TXHXOMIB4B53 tag=LL3GJBHVOL0A type=del 2024-09-12T17:07:53.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.747+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=NB38JE33ZMKG type=del size=3106000 2024-09-12T17:07:53.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.749+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~JEKKEQ947C4M.0 size=1048576 2024-09-12T17:07:53.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.750+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~JEKKEQ947C4M.1 size=1048576 2024-09-12T17:07:53.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.751+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~JEKKEQ947C4M.2 size=324662 2024-09-12T17:07:53.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.753+0000 7f9eaebff780 1 < completed multipart upload key=K2NHRSUDQBRW upload=JEKKEQ947C4M tag=M6SKVLYXN0JH type=write size=3470390 2024-09-12T17:07:53.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.756+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~BNIR43O089IU.0 size=1048576 2024-09-12T17:07:53.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.757+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~BNIR43O089IU.1 size=1048576 2024-09-12T17:07:53.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.758+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~BNIR43O089IU.2 size=157263 2024-09-12T17:07:53.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.758+0000 7f9eaebff780 1 > prepared multipart upload key=QIMNK4DL3D0N upload=BNIR43O089IU tag=T175NEE1T4QQ type=write size=3302991 2024-09-12T17:07:53.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.759+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~FCT8WPPHS5IS.0 size=1048576 2024-09-12T17:07:53.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.760+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~FCT8WPPHS5IS.1 size=469517 2024-09-12T17:07:53.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.762+0000 7f9eaebff780 1 < completed multipart upload key=8DJLYFM11DNI upload=FCT8WPPHS5IS tag=VG8PS8XT09HG type=write size=2566669 2024-09-12T17:07:53.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.763+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=TNY51Z5DK94A type=del size=2098292 2024-09-12T17:07:53.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.764+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=LCL0SIX9MO00 type=del 2024-09-12T17:07:53.767 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.766+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=KHSHJCD5SECI type=write size=858845 2024-09-12T17:07:53.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.767+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=AAKPMRYPWHBT type=del 2024-09-12T17:07:53.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.768+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=X7T1LTVQAJU9 type=del size=3966581 2024-09-12T17:07:53.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.769+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=9S61CDPXQQ1W type=del 2024-09-12T17:07:53.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.770+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=CCS5EXJ0ZLQW type=del size=1936732 2024-09-12T17:07:53.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.772+0000 7f9eaebff780 1 < completed delete operation key=LRI5G5G8O5X4 tag=CHKHFAU9ZOTT type=del 2024-09-12T17:07:53.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.773+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=0M3F2BA3HFIW type=del size=3127310 2024-09-12T17:07:53.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.774+0000 7f9eaebff780 1 < completed delete operation key=K2NHRSUDQBRW tag=Z81MVU0JGQM7 type=del 2024-09-12T17:07:53.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.776+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~4B79IKJ19B7J.0 size=1048576 2024-09-12T17:07:53.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.777+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~4B79IKJ19B7J.1 size=1048576 2024-09-12T17:07:53.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.778+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~4B79IKJ19B7J.2 size=138446 2024-09-12T17:07:53.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.778+0000 7f9eaebff780 1 > prepared multipart upload key=TDZCNUZE8IOA upload=4B79IKJ19B7J tag=K9Y5VIDIXE37 type=write size=3284174 2024-09-12T17:07:53.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.779+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=XYO1RW2E4P6L type=del 2024-09-12T17:07:53.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.781+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~44W24G6ZD141.0 size=1048576 2024-09-12T17:07:53.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.782+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~44W24G6ZD141.1 size=1048576 2024-09-12T17:07:53.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.783+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~44W24G6ZD141.2 size=498079 2024-09-12T17:07:53.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.783+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=44W24G6ZD141 tag=1P7EK2OTV527 type=write size=3643807 2024-09-12T17:07:53.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.784+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~GR1029RTBDJE.0 size=954944 2024-09-12T17:07:53.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.786+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=GR1029RTBDJE tag=D3EJTXDFLB55 type=write size=2003520 2024-09-12T17:07:53.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.788+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=4OZFBIBR37DG type=write size=424327 2024-09-12T17:07:53.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.789+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=ZFLZT55Z5WRC type=del 2024-09-12T17:07:53.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.790+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=DYXIF0749QP8 type=del size=706546 2024-09-12T17:07:53.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.791+0000 7f9eaebff780 1 < completed delete operation key=B1YC6DM9S8JJ tag=LJS5QRGLNZVS type=del 2024-09-12T17:07:53.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.793+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~VXB8JCOGONWV.0 size=403897 2024-09-12T17:07:53.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.793+0000 7f9eaebff780 1 > prepared multipart upload key=EKUW5AKC428U upload=VXB8JCOGONWV tag=N2MNL3PDVAYV type=write size=1452473 2024-09-12T17:07:53.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.795+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~D0TAK9UXN4QI.0 size=1048576 2024-09-12T17:07:53.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.795+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~D0TAK9UXN4QI.1 size=533048 2024-09-12T17:07:53.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.797+0000 7f9eaebff780 1 < completed multipart upload key=YIEP2JYDSLW0 upload=D0TAK9UXN4QI tag=AODA29F330SN type=write size=2630200 2024-09-12T17:07:53.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.798+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=XTR9NGA8ZBBL type=write size=566692 2024-09-12T17:07:53.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.800+0000 7f9eaebff780 1 < completed delete operation key=YIEP2JYDSLW0 tag=DU7YEE3QWADI type=del 2024-09-12T17:07:53.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.801+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=J1UXZPZDZDXW type=del size=523174 2024-09-12T17:07:53.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.802+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=9G31TNBOEDB8 type=del 2024-09-12T17:07:53.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.803+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=ECM672BEQWMP type=del size=2635675 2024-09-12T17:07:53.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.805+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~F4QO35653R2W.0 size=865342 2024-09-12T17:07:53.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.806+0000 7f9eaebff780 1 < completed multipart upload key=3LY681252WAN upload=F4QO35653R2W tag=FZ4A2IIWU5ZK type=write size=1913918 2024-09-12T17:07:53.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.808+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=8SS30QGT72YX type=del size=142882 2024-09-12T17:07:53.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.809+0000 7f9eaebff780 1 < completed delete operation key=SVWPQETL92QU tag=NB38JE33ZMKG type=del 2024-09-12T17:07:53.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.812+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=0VPMH6WTRLBN type=write size=241423 2024-09-12T17:07:53.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.813+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~BNIR43O089IU.0 size=1048576 2024-09-12T17:07:53.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.814+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~BNIR43O089IU.1 size=1048576 2024-09-12T17:07:53.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.815+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~BNIR43O089IU.2 size=157263 2024-09-12T17:07:53.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.817+0000 7f9eaebff780 1 < completed multipart upload key=QIMNK4DL3D0N upload=BNIR43O089IU tag=T175NEE1T4QQ type=write size=3302991 2024-09-12T17:07:53.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.819+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~85UA573XEUBT.0 size=1048576 2024-09-12T17:07:53.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.820+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~85UA573XEUBT.1 size=1048576 2024-09-12T17:07:53.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.821+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~85UA573XEUBT.2 size=455063 2024-09-12T17:07:53.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.821+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=85UA573XEUBT tag=KJOB6444XKP2 type=write size=3600791 2024-09-12T17:07:53.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.822+0000 7f9eaebff780 1 < completed delete operation key=UYF1AN2W59VN tag=TNY51Z5DK94A type=del 2024-09-12T17:07:53.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.823+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=RMYVYMU9TL66 type=del size=2623993 2024-09-12T17:07:53.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.824+0000 7f9eaebff780 1 < canceled operation key=ZC814TPVLJO1 tag=KHSHJCD5SECI type=write size=858845 2024-09-12T17:07:53.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.826+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=L3N6M8D9V864 type=del size=84597 2024-09-12T17:07:53.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.827+0000 7f9eaebff780 1 < completed delete operation key=3VY271ZBO754 tag=X7T1LTVQAJU9 type=del 2024-09-12T17:07:53.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.828+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=MYZ53V6WB145 type=write size=995402 2024-09-12T17:07:53.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.829+0000 7f9eaebff780 1 < completed delete operation key=SVWPQETL92QU tag=CCS5EXJ0ZLQW type=del 2024-09-12T17:07:53.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.831+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~2U5II66XIXHH.0 size=1048576 2024-09-12T17:07:53.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.832+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~2U5II66XIXHH.1 size=310541 2024-09-12T17:07:53.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.832+0000 7f9eaebff780 1 > prepared multipart upload key=0YD5P1ACZ09Q upload=2U5II66XIXHH tag=0OO50U1DBR6W type=write size=2407693 2024-09-12T17:07:53.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.833+0000 7f9eaebff780 1 < canceled operation key=3LY681252WAN tag=0M3F2BA3HFIW type=del size=3127310 2024-09-12T17:07:53.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.834+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=U6EDH01QLXHI type=del size=1483760 2024-09-12T17:07:53.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.836+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~4B79IKJ19B7J.0 size=1048576 2024-09-12T17:07:53.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.837+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~4B79IKJ19B7J.1 size=1048576 2024-09-12T17:07:53.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.838+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~4B79IKJ19B7J.2 size=138446 2024-09-12T17:07:53.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.840+0000 7f9eaebff780 1 < completed multipart upload key=TDZCNUZE8IOA upload=4B79IKJ19B7J tag=K9Y5VIDIXE37 type=write size=3284174 2024-09-12T17:07:53.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.842+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~I30A9ORLKED3.0 size=207813 2024-09-12T17:07:53.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.842+0000 7f9eaebff780 1 > prepared multipart upload key=9I6RGNRB6HSY upload=I30A9ORLKED3 tag=OM03KXH3UNJC type=write size=1256389 2024-09-12T17:07:53.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.843+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~44W24G6ZD141.0 size=1048576 2024-09-12T17:07:53.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.844+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~44W24G6ZD141.1 size=1048576 2024-09-12T17:07:53.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.844+0000 7f9eaebff780 1 < canceled part key=_multipart_P9GMGM3WK6O7.2~44W24G6ZD141.2 size=498079 2024-09-12T17:07:53.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.846+0000 7f9eaebff780 1 < canceled multipart upload key=P9GMGM3WK6O7 upload=44W24G6ZD141 tag=1P7EK2OTV527 type=write size=3643807 2024-09-12T17:07:53.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.847+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=OITUAI9010JH type=del size=2466787 2024-09-12T17:07:53.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.849+0000 7f9eaebff780 1 < completed write operation key=LRI5G5G8O5X4 tag=4OZFBIBR37DG type=write size=424327 2024-09-12T17:07:53.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.851+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~TN1872JP3ZFY.0 size=924324 2024-09-12T17:07:53.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.851+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=TN1872JP3ZFY tag=TAV81HY2RU4F type=write size=1972900 2024-09-12T17:07:53.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.853+0000 7f9eaebff780 1 < suggested update operation key=K0P9ZZ91UJJ8 tag=DYXIF0749QP8 type=del size=706546 2024-09-12T17:07:53.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.855+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~6AE6AAAMSKXV.0 size=499269 2024-09-12T17:07:53.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.855+0000 7f9eaebff780 1 > prepared multipart upload key=OGD6H9VSVGWF upload=6AE6AAAMSKXV tag=53OC1JP3V7C8 type=write size=1547845 2024-09-12T17:07:53.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.856+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~VXB8JCOGONWV.0 size=403897 2024-09-12T17:07:53.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.858+0000 7f9eaebff780 1 < completed multipart upload key=EKUW5AKC428U upload=VXB8JCOGONWV tag=N2MNL3PDVAYV type=write size=1452473 2024-09-12T17:07:53.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.859+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=4A0OE5N1BEJI type=write size=367052 2024-09-12T17:07:53.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.861+0000 7f9eaebff780 1 < completed write operation key=TXHXOMIB4B53 tag=XTR9NGA8ZBBL type=write size=566692 2024-09-12T17:07:53.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.862+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=L021R7GJPU21 type=del size=1116694 2024-09-12T17:07:53.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.863+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=J1UXZPZDZDXW type=del 2024-09-12T17:07:53.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.865+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=J93JON218IUS type=del size=1605867 2024-09-12T17:07:53.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.866+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=ECM672BEQWMP type=del 2024-09-12T17:07:53.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.867+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=8J16DE35Z3TO type=del size=1423547 2024-09-12T17:07:53.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.870+0000 7f9eaebff780 1 < suggested update operation key=ZC814TPVLJO1 tag=8SS30QGT72YX type=del size=142882 2024-09-12T17:07:53.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.871+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=AWP4DUHIJRZW type=del size=2874693 2024-09-12T17:07:53.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.872+0000 7f9eaebff780 1 < completed write operation key=B1YC6DM9S8JJ tag=0VPMH6WTRLBN type=write size=241423 2024-09-12T17:07:53.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.874+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~PCPPTUIXE4K5.0 size=1048576 2024-09-12T17:07:53.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.875+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~PCPPTUIXE4K5.1 size=1048576 2024-09-12T17:07:53.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.876+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~PCPPTUIXE4K5.2 size=828615 2024-09-12T17:07:53.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.876+0000 7f9eaebff780 1 > prepared multipart upload key=3VY271ZBO754 upload=PCPPTUIXE4K5 tag=08ABGLSLIHWB type=write size=3974343 2024-09-12T17:07:53.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.877+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~85UA573XEUBT.0 size=1048576 2024-09-12T17:07:53.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.878+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~85UA573XEUBT.1 size=1048576 2024-09-12T17:07:53.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.878+0000 7f9eaebff780 1 < canceled part key=_multipart_SVWPQETL92QU.2~85UA573XEUBT.2 size=455063 2024-09-12T17:07:53.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.880+0000 7f9eaebff780 1 < canceled multipart upload key=SVWPQETL92QU upload=85UA573XEUBT tag=KJOB6444XKP2 type=write size=3600791 2024-09-12T17:07:53.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.881+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=2ABBR5W8BZ1R type=del size=1549167 2024-09-12T17:07:53.884 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.883+0000 7f9eaebff780 1 < completed delete operation key=9I6RGNRB6HSY tag=RMYVYMU9TL66 type=del 2024-09-12T17:07:53.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.884+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=RR269DDEUBHT type=del size=331663 2024-09-12T17:07:53.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.885+0000 7f9eaebff780 1 < completed delete operation key=QIMNK4DL3D0N tag=L3N6M8D9V864 type=del 2024-09-12T17:07:53.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.886+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=8Q3RD97ZLJ5R type=del size=393683 2024-09-12T17:07:53.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.888+0000 7f9eaebff780 1 < completed write operation key=K2NHRSUDQBRW tag=MYZ53V6WB145 type=write size=995402 2024-09-12T17:07:53.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.889+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=S3I853R220JC type=del size=3511210 2024-09-12T17:07:53.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.890+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~2U5II66XIXHH.0 size=1048576 2024-09-12T17:07:53.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.891+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~2U5II66XIXHH.1 size=310541 2024-09-12T17:07:53.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.893+0000 7f9eaebff780 1 < completed multipart upload key=0YD5P1ACZ09Q upload=2U5II66XIXHH tag=0OO50U1DBR6W type=write size=2407693 2024-09-12T17:07:53.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.894+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=FL3GTEQLDITK type=del size=1695319 2024-09-12T17:07:53.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.895+0000 7f9eaebff780 -1 < failed to complete operation key=ZC814TPVLJO1 tag=U6EDH01QLXHI type=del size=1483760: (22) Invalid argument 2024-09-12T17:07:53.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.897+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~6M2SOUPHJYGO.0 size=1048576 2024-09-12T17:07:53.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.898+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~6M2SOUPHJYGO.1 size=577885 2024-09-12T17:07:53.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.898+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=6M2SOUPHJYGO tag=O5WDYBSOA820 type=write size=2675037 2024-09-12T17:07:53.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.900+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~I30A9ORLKED3.0 size=207813 2024-09-12T17:07:53.903 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.901+0000 7f9eaebff780 1 < completed multipart upload key=9I6RGNRB6HSY upload=I30A9ORLKED3 tag=OM03KXH3UNJC type=write size=1256389 2024-09-12T17:07:53.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.903+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=ONOWRE6ZD4EA type=del size=3529246 2024-09-12T17:07:53.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.904+0000 7f9eaebff780 1 < completed delete operation key=UYF1AN2W59VN tag=OITUAI9010JH type=del 2024-09-12T17:07:53.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.905+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=TGW4NDDC10FU type=del size=1865051 2024-09-12T17:07:53.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.906+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~TN1872JP3ZFY.0 size=924324 2024-09-12T17:07:53.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.908+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=TN1872JP3ZFY tag=TAV81HY2RU4F type=write size=1972900 2024-09-12T17:07:53.911 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.910+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~BVKJZDCA31G4.0 size=1048576 2024-09-12T17:07:53.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.911+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~BVKJZDCA31G4.1 size=186443 2024-09-12T17:07:53.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.911+0000 7f9eaebff780 1 > prepared multipart upload key=CAIZM33SDFPM upload=BVKJZDCA31G4 tag=9M13WPTI18RZ type=write size=2283595 2024-09-12T17:07:53.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.912+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~6AE6AAAMSKXV.0 size=499269 2024-09-12T17:07:53.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.914+0000 7f9eaebff780 1 < completed multipart upload key=OGD6H9VSVGWF upload=6AE6AAAMSKXV tag=53OC1JP3V7C8 type=write size=1547845 2024-09-12T17:07:53.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.915+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=Y38TNVK2Y506 type=del size=2624189 2024-09-12T17:07:53.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.917+0000 7f9eaebff780 1 < completed write operation key=0YD5P1ACZ09Q tag=4A0OE5N1BEJI type=write size=367052 2024-09-12T17:07:53.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.918+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=349JL9X2SN0M type=del size=2067521 2024-09-12T17:07:53.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.919+0000 7f9eaebff780 1 < completed delete operation key=3VY271ZBO754 tag=L021R7GJPU21 type=del 2024-09-12T17:07:53.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.920+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=OPNGE98WDPNA type=del size=1628096 2024-09-12T17:07:53.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.924+0000 7f9eaebff780 1 < suggested remove operation key=SHWT6AT7PN0M tag=J93JON218IUS type=del 2024-09-12T17:07:53.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.925+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=F0IAVJF7F7RT type=del size=3065903 2024-09-12T17:07:53.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.926+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=8J16DE35Z3TO type=del 2024-09-12T17:07:53.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.927+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=HZPNEC4LC48E type=del size=3791081 2024-09-12T17:07:53.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.928+0000 7f9eaebff780 1 < completed delete operation key=P9GMGM3WK6O7 tag=AWP4DUHIJRZW type=del 2024-09-12T17:07:53.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.930+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=B0YRI08M16RR type=del size=678139 2024-09-12T17:07:53.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.930+0000 7f9eaebff780 1 < canceled part key=_multipart_3VY271ZBO754.2~PCPPTUIXE4K5.0 size=1048576 2024-09-12T17:07:53.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.931+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~PCPPTUIXE4K5.1 size=1048576 2024-09-12T17:07:53.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.932+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~PCPPTUIXE4K5.2 size=828615 2024-09-12T17:07:53.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.934+0000 7f9eaebff780 1 < canceled multipart upload key=3VY271ZBO754 upload=PCPPTUIXE4K5 tag=08ABGLSLIHWB type=write size=3974343 2024-09-12T17:07:53.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.935+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=N1U9BLBTMUDD type=del size=444712 2024-09-12T17:07:53.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.937+0000 7f9eaebff780 1 < completed delete operation key=3VY271ZBO754 tag=2ABBR5W8BZ1R type=del 2024-09-12T17:07:53.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.938+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=D9GOLLYT4D3J type=del size=1317033 2024-09-12T17:07:53.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.940+0000 7f9eaebff780 1 < suggested update operation key=ZYP3P4031PUZ tag=RR269DDEUBHT type=del size=331663 2024-09-12T17:07:53.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.941+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=E0RO4LX2WURO type=del size=3002298 2024-09-12T17:07:53.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.942+0000 7f9eaebff780 1 < canceled operation key=K0P9ZZ91UJJ8 tag=8Q3RD97ZLJ5R type=del size=393683 2024-09-12T17:07:53.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.944+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=KGB7ZIA8FSIG type=del size=2577428 2024-09-12T17:07:53.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.945+0000 7f9eaebff780 1 < completed delete operation key=K0P9ZZ91UJJ8 tag=S3I853R220JC type=del 2024-09-12T17:07:53.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.947+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~COEWBGD9W1FY.0 size=1048576 2024-09-12T17:07:53.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.948+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~COEWBGD9W1FY.1 size=696503 2024-09-12T17:07:53.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.948+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=COEWBGD9W1FY tag=G5VS1P876OIO type=write size=2793655 2024-09-12T17:07:53.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.949+0000 7f9eaebff780 1 < completed delete operation key=TDZCNUZE8IOA tag=FL3GTEQLDITK type=del 2024-09-12T17:07:53.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.951+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~4A7V9YZRYBII.0 size=327155 2024-09-12T17:07:53.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.951+0000 7f9eaebff780 1 > prepared multipart upload key=9WJGBODZ60NJ upload=4A7V9YZRYBII tag=1G4T73RQ7HZ0 type=write size=1375731 2024-09-12T17:07:53.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.953+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~6M2SOUPHJYGO.0 size=1048576 2024-09-12T17:07:53.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.954+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~6M2SOUPHJYGO.1 size=577885 2024-09-12T17:07:53.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.956+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=6M2SOUPHJYGO tag=O5WDYBSOA820 type=write size=2675037 2024-09-12T17:07:53.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.958+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~G74SXNGVE84H.0 size=1048576 2024-09-12T17:07:53.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.959+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~G74SXNGVE84H.1 size=1048576 2024-09-12T17:07:53.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.960+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~G74SXNGVE84H.2 size=372659 2024-09-12T17:07:53.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.960+0000 7f9eaebff780 1 > prepared multipart upload key=SO6QF2JCRX6E upload=G74SXNGVE84H tag=XLFYRBAWE3R1 type=write size=3518387 2024-09-12T17:07:53.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.961+0000 7f9eaebff780 1 < completed delete operation key=LJN514F16XJA tag=ONOWRE6ZD4EA type=del 2024-09-12T17:07:53.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.963+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~4OGKUA40MOWI.0 size=1048576 2024-09-12T17:07:53.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.964+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~4OGKUA40MOWI.1 size=381941 2024-09-12T17:07:53.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.964+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=4OGKUA40MOWI tag=L2ESMBL4KD0V type=write size=2479093 2024-09-12T17:07:53.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.965+0000 7f9eaebff780 1 < completed delete operation key=UYF1AN2W59VN tag=TGW4NDDC10FU type=del 2024-09-12T17:07:53.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.968+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~2I3FQF8GQOV2.0 size=1048576 2024-09-12T17:07:53.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.969+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~2I3FQF8GQOV2.1 size=1048576 2024-09-12T17:07:53.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.969+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~2I3FQF8GQOV2.2 size=411277 2024-09-12T17:07:53.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.969+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=2I3FQF8GQOV2 tag=WKPUHGM0Q69R type=write size=3557005 2024-09-12T17:07:53.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.971+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~BVKJZDCA31G4.0 size=1048576 2024-09-12T17:07:53.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.972+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~BVKJZDCA31G4.1 size=186443 2024-09-12T17:07:53.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.973+0000 7f9eaebff780 1 < completed multipart upload key=CAIZM33SDFPM upload=BVKJZDCA31G4 tag=9M13WPTI18RZ type=write size=2283595 2024-09-12T17:07:53.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.975+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=EXKO5Y1VQFOG type=del size=1114720 2024-09-12T17:07:53.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.976+0000 7f9eaebff780 1 < canceled operation key=8DJLYFM11DNI tag=Y38TNVK2Y506 type=del size=2624189 2024-09-12T17:07:53.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.978+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~NL65ZU5FGX1I.0 size=1048576 2024-09-12T17:07:53.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.979+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~NL65ZU5FGX1I.1 size=1048576 2024-09-12T17:07:53.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.980+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~NL65ZU5FGX1I.2 size=334719 2024-09-12T17:07:53.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.980+0000 7f9eaebff780 1 > prepared multipart upload key=YIEP2JYDSLW0 upload=NL65ZU5FGX1I tag=1HWO1PPARAQ1 type=write size=3480447 2024-09-12T17:07:53.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.982+0000 7f9eaebff780 1 < suggested remove operation key=3LY681252WAN tag=349JL9X2SN0M type=del 2024-09-12T17:07:53.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.983+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=1PM3R18PY430 type=del size=3888516 2024-09-12T17:07:53.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.986+0000 7f9eaebff780 1 < suggested remove operation key=P9GMGM3WK6O7 tag=OPNGE98WDPNA type=del 2024-09-12T17:07:53.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.987+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=YUUE0TTVTEUR type=del size=1617230 2024-09-12T17:07:53.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.988+0000 7f9eaebff780 1 < completed delete operation key=EKUW5AKC428U tag=F0IAVJF7F7RT type=del 2024-09-12T17:07:53.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.989+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=50Z1DPT9LMOE type=write size=123404 2024-09-12T17:07:53.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.990+0000 7f9eaebff780 1 < completed delete operation key=GB8P7K59Y8VI tag=HZPNEC4LC48E type=del 2024-09-12T17:07:53.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.993+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~YTS19F6RIRJZ.0 size=62854 2024-09-12T17:07:53.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.993+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=YTS19F6RIRJZ tag=X32R5G29KG4W type=write size=1111430 2024-09-12T17:07:53.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.994+0000 7f9eaebff780 1 < completed delete operation key=K2NHRSUDQBRW tag=B0YRI08M16RR type=del 2024-09-12T17:07:53.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.995+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=ZIWM3UV3V724 type=del size=543897 2024-09-12T17:07:53.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.997+0000 7f9eaebff780 1 < suggested update operation key=YIEP2JYDSLW0 tag=N1U9BLBTMUDD type=del size=444712 2024-09-12T17:07:54.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:53.999+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=6P8F478LSSUB type=del size=3839089 2024-09-12T17:07:54.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.000+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=D9GOLLYT4D3J type=del 2024-09-12T17:07:54.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.002+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~QH9J1GMRVE3K.0 size=1048576 2024-09-12T17:07:54.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.003+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~QH9J1GMRVE3K.1 size=1048576 2024-09-12T17:07:54.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.004+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~QH9J1GMRVE3K.2 size=433576 2024-09-12T17:07:54.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.004+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=QH9J1GMRVE3K tag=STW92RK2KIP1 type=write size=3579304 2024-09-12T17:07:54.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.005+0000 7f9eaebff780 -1 < failed to complete operation key=P9GMGM3WK6O7 tag=E0RO4LX2WURO type=del size=3002298: (22) Invalid argument 2024-09-12T17:07:54.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.006+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=R9GW1NL76TTE type=del size=2514665 2024-09-12T17:07:54.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.007+0000 7f9eaebff780 1 < completed delete operation key=TXHXOMIB4B53 tag=KGB7ZIA8FSIG type=del 2024-09-12T17:07:54.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.010+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~B1UGI3HD09T6.0 size=1048576 2024-09-12T17:07:54.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.011+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~B1UGI3HD09T6.1 size=1048576 2024-09-12T17:07:54.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.012+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~B1UGI3HD09T6.2 size=216467 2024-09-12T17:07:54.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.012+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=B1UGI3HD09T6 tag=I3TX423RLM7Y type=write size=3362195 2024-09-12T17:07:54.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.013+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~COEWBGD9W1FY.0 size=1048576 2024-09-12T17:07:54.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.014+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~COEWBGD9W1FY.1 size=696503 2024-09-12T17:07:54.017 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.016+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=COEWBGD9W1FY tag=G5VS1P876OIO type=write size=2793655 2024-09-12T17:07:54.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.018+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=JI3SGMJQDNMV type=del size=2401264 2024-09-12T17:07:54.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.019+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~4A7V9YZRYBII.0 size=327155 2024-09-12T17:07:54.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.021+0000 7f9eaebff780 1 < completed multipart upload key=9WJGBODZ60NJ upload=4A7V9YZRYBII tag=1G4T73RQ7HZ0 type=write size=1375731 2024-09-12T17:07:54.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.023+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~022JE8S00GDC.0 size=1048576 2024-09-12T17:07:54.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.024+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~022JE8S00GDC.1 size=1048576 2024-09-12T17:07:54.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.025+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~022JE8S00GDC.2 size=929092 2024-09-12T17:07:54.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.025+0000 7f9eaebff780 1 > prepared multipart upload key=KF8XE48DI9KZ upload=022JE8S00GDC tag=5LWQB7BPKE4Y type=write size=4074820 2024-09-12T17:07:54.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.027+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~G74SXNGVE84H.0 size=1048576 2024-09-12T17:07:54.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.028+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~G74SXNGVE84H.1 size=1048576 2024-09-12T17:07:54.030 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.029+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~G74SXNGVE84H.2 size=372659 2024-09-12T17:07:54.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.031+0000 7f9eaebff780 1 < completed multipart upload key=SO6QF2JCRX6E upload=G74SXNGVE84H tag=XLFYRBAWE3R1 type=write size=3518387 2024-09-12T17:07:54.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.033+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~HX5OPRA1H6V7.0 size=1048576 2024-09-12T17:07:54.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.034+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~HX5OPRA1H6V7.1 size=481423 2024-09-12T17:07:54.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.034+0000 7f9eaebff780 1 > prepared multipart upload key=LJN514F16XJA upload=HX5OPRA1H6V7 tag=C5QAUW8KMNGS type=write size=2578575 2024-09-12T17:07:54.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.037+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~4OGKUA40MOWI.0 size=1048576 2024-09-12T17:07:54.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.037+0000 7f9eaebff780 1 < canceled part key=_multipart_M3PLQGSK34YM.2~4OGKUA40MOWI.1 size=381941 2024-09-12T17:07:54.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.040+0000 7f9eaebff780 1 < canceled multipart upload key=M3PLQGSK34YM upload=4OGKUA40MOWI tag=L2ESMBL4KD0V type=write size=2479093 2024-09-12T17:07:54.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.043+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~DLCIG6DBK5U5.0 size=1048576 2024-09-12T17:07:54.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.043+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~DLCIG6DBK5U5.1 size=1048576 2024-09-12T17:07:54.046 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.044+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~DLCIG6DBK5U5.2 size=221861 2024-09-12T17:07:54.046 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.044+0000 7f9eaebff780 1 > prepared multipart upload key=TDZCNUZE8IOA upload=DLCIG6DBK5U5 tag=9V0HXUY4CUNU type=write size=3367589 2024-09-12T17:07:54.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.046+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~2I3FQF8GQOV2.0 size=1048576 2024-09-12T17:07:54.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.047+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~2I3FQF8GQOV2.1 size=1048576 2024-09-12T17:07:54.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.048+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~2I3FQF8GQOV2.2 size=411277 2024-09-12T17:07:54.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.050+0000 7f9eaebff780 1 < completed multipart upload key=K2NHRSUDQBRW upload=2I3FQF8GQOV2 tag=WKPUHGM0Q69R type=write size=3557005 2024-09-12T17:07:54.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.051+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=LVJZA2LYVWQI type=del size=3341379 2024-09-12T17:07:54.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.052+0000 7f9eaebff780 1 < canceled operation key=0F5LXJZMBFSP tag=EXKO5Y1VQFOG type=del size=1114720 2024-09-12T17:07:54.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.053+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=QXAOWVKR6WZP type=del size=2006087 2024-09-12T17:07:54.056 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.054+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~NL65ZU5FGX1I.0 size=1048576 2024-09-12T17:07:54.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.055+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~NL65ZU5FGX1I.1 size=1048576 2024-09-12T17:07:54.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.056+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~NL65ZU5FGX1I.2 size=334719 2024-09-12T17:07:54.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.058+0000 7f9eaebff780 1 < completed multipart upload key=YIEP2JYDSLW0 upload=NL65ZU5FGX1I tag=1HWO1PPARAQ1 type=write size=3480447 2024-09-12T17:07:54.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.059+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=67E7JBUT1WNZ type=write size=652135 2024-09-12T17:07:54.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.061+0000 7f9eaebff780 -1 < failed to complete operation key=P9GMGM3WK6O7 tag=1PM3R18PY430 type=del size=3888516: (22) Invalid argument 2024-09-12T17:07:54.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.063+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~91V4FJIJK1XT.0 size=540002 2024-09-12T17:07:54.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.063+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=91V4FJIJK1XT tag=0ZY5S3SEQ0Q7 type=write size=1588578 2024-09-12T17:07:54.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.065+0000 7f9eaebff780 1 < suggested update operation key=OH6GXTMPBYUY tag=YUUE0TTVTEUR type=del size=1617230 2024-09-12T17:07:54.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.066+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=LFO5RU9OX48I type=del size=3805746 2024-09-12T17:07:54.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.068+0000 7f9eaebff780 1 < suggested remove operation key=0F5LXJZMBFSP tag=50Z1DPT9LMOE type=write 2024-09-12T17:07:54.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.070+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=U82OV4W0C96X type=write size=191840 2024-09-12T17:07:54.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.071+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~YTS19F6RIRJZ.0 size=62854 2024-09-12T17:07:54.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.073+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=YTS19F6RIRJZ tag=X32R5G29KG4W type=write size=1111430 2024-09-12T17:07:54.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.075+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~DU6RJJTZUIHK.0 size=551053 2024-09-12T17:07:54.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.075+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=DU6RJJTZUIHK tag=G53BEC3YPXDF type=write size=1599629 2024-09-12T17:07:54.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.076+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=ZIWM3UV3V724 type=del 2024-09-12T17:07:54.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.077+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=SIHKJMMLLE13 type=del size=51905 2024-09-12T17:07:54.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.078+0000 7f9eaebff780 1 < completed delete operation key=P9GMGM3WK6O7 tag=6P8F478LSSUB type=del 2024-09-12T17:07:54.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.080+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~G9HD2SSMJVZB.0 size=1048576 2024-09-12T17:07:54.083 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.081+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~G9HD2SSMJVZB.1 size=1048576 2024-09-12T17:07:54.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.082+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~G9HD2SSMJVZB.2 size=800446 2024-09-12T17:07:54.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.082+0000 7f9eaebff780 1 > prepared multipart upload key=YIEP2JYDSLW0 upload=G9HD2SSMJVZB tag=TDOUT5X9O99N type=write size=3946174 2024-09-12T17:07:54.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.083+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~QH9J1GMRVE3K.0 size=1048576 2024-09-12T17:07:54.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.084+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~QH9J1GMRVE3K.1 size=1048576 2024-09-12T17:07:54.087 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.085+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~QH9J1GMRVE3K.2 size=433576 2024-09-12T17:07:54.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.087+0000 7f9eaebff780 1 < completed multipart upload key=SHWT6AT7PN0M upload=QH9J1GMRVE3K tag=STW92RK2KIP1 type=write size=3579304 2024-09-12T17:07:54.091 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.089+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~RYI6GL81HRYR.0 size=1048576 2024-09-12T17:07:54.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.090+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~RYI6GL81HRYR.1 size=1048576 2024-09-12T17:07:54.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.091+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~RYI6GL81HRYR.2 size=941467 2024-09-12T17:07:54.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.091+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=RYI6GL81HRYR tag=5WSSW7G5ROKP type=write size=4087195 2024-09-12T17:07:54.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.092+0000 7f9eaebff780 1 < completed delete operation key=QIMNK4DL3D0N tag=R9GW1NL76TTE type=del 2024-09-12T17:07:54.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.093+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=TIM04IEB16X0 type=del size=2677824 2024-09-12T17:07:54.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.095+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~B1UGI3HD09T6.0 size=1048576 2024-09-12T17:07:54.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.095+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~B1UGI3HD09T6.1 size=1048576 2024-09-12T17:07:54.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.096+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~B1UGI3HD09T6.2 size=216467 2024-09-12T17:07:54.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.098+0000 7f9eaebff780 1 < completed multipart upload key=M3PLQGSK34YM upload=B1UGI3HD09T6 tag=I3TX423RLM7Y type=write size=3362195 2024-09-12T17:07:54.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.101+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~AL7J1Z4RW7FF.0 size=1048576 2024-09-12T17:07:54.103 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.101+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~AL7J1Z4RW7FF.1 size=1048576 2024-09-12T17:07:54.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.102+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~AL7J1Z4RW7FF.2 size=760243 2024-09-12T17:07:54.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.102+0000 7f9eaebff780 1 > prepared multipart upload key=0YD5P1ACZ09Q upload=AL7J1Z4RW7FF tag=NSTQABQAGKAP type=write size=3905971 2024-09-12T17:07:54.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.104+0000 7f9eaebff780 1 < canceled operation key=9I6RGNRB6HSY tag=JI3SGMJQDNMV type=del size=2401264 2024-09-12T17:07:54.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.106+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~L6L0A4NGPP5T.0 size=1048576 2024-09-12T17:07:54.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.107+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~L6L0A4NGPP5T.1 size=1048576 2024-09-12T17:07:54.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.108+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~L6L0A4NGPP5T.2 size=628606 2024-09-12T17:07:54.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.108+0000 7f9eaebff780 1 > prepared multipart upload key=TDZCNUZE8IOA upload=L6L0A4NGPP5T tag=E7KFOA1U3GM3 type=write size=3774334 2024-09-12T17:07:54.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.109+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~022JE8S00GDC.0 size=1048576 2024-09-12T17:07:54.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.110+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~022JE8S00GDC.1 size=1048576 2024-09-12T17:07:54.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.111+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~022JE8S00GDC.2 size=929092 2024-09-12T17:07:54.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.113+0000 7f9eaebff780 1 < completed multipart upload key=KF8XE48DI9KZ upload=022JE8S00GDC tag=5LWQB7BPKE4Y type=write size=4074820 2024-09-12T17:07:54.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.114+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=PAXJZJAFI1J6 type=del size=2809968 2024-09-12T17:07:54.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.115+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~HX5OPRA1H6V7.0 size=1048576 2024-09-12T17:07:54.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.116+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~HX5OPRA1H6V7.1 size=481423 2024-09-12T17:07:54.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.118+0000 7f9eaebff780 1 < completed multipart upload key=LJN514F16XJA upload=HX5OPRA1H6V7 tag=C5QAUW8KMNGS type=write size=2578575 2024-09-12T17:07:54.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.119+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=IU14AB8JBAHI type=del size=94900 2024-09-12T17:07:54.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.121+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~DLCIG6DBK5U5.0 size=1048576 2024-09-12T17:07:54.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.122+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~DLCIG6DBK5U5.1 size=1048576 2024-09-12T17:07:54.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.123+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~DLCIG6DBK5U5.2 size=221861 2024-09-12T17:07:54.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.125+0000 7f9eaebff780 1 < completed multipart upload key=TDZCNUZE8IOA upload=DLCIG6DBK5U5 tag=9V0HXUY4CUNU type=write size=3367589 2024-09-12T17:07:54.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.126+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=MRAQ4C3BBS9F type=write size=159256 2024-09-12T17:07:54.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.127+0000 7f9eaebff780 1 < completed delete operation key=8DJLYFM11DNI tag=LVJZA2LYVWQI type=del 2024-09-12T17:07:54.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.129+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~4T289J1X1AU9.0 size=1048576 2024-09-12T17:07:54.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.130+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~4T289J1X1AU9.1 size=674116 2024-09-12T17:07:54.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.130+0000 7f9eaebff780 1 > prepared multipart upload key=CAIZM33SDFPM upload=4T289J1X1AU9 tag=VDFNFLU32WNW type=write size=2771268 2024-09-12T17:07:54.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.131+0000 7f9eaebff780 1 < canceled operation key=ZC814TPVLJO1 tag=QXAOWVKR6WZP type=del size=2006087 2024-09-12T17:07:54.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.134+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~C6URCG9KGTRC.0 size=809794 2024-09-12T17:07:54.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.134+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=C6URCG9KGTRC tag=05GI8KK8465X type=write size=1858370 2024-09-12T17:07:54.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.136+0000 7f9eaebff780 1 < suggested update operation key=ZYP3P4031PUZ tag=67E7JBUT1WNZ type=write size=652135 2024-09-12T17:07:54.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.138+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~RP2E0GBGSZPX.0 size=1048576 2024-09-12T17:07:54.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.139+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~RP2E0GBGSZPX.1 size=494047 2024-09-12T17:07:54.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.139+0000 7f9eaebff780 1 > prepared multipart upload key=ZC814TPVLJO1 upload=RP2E0GBGSZPX tag=2SVJRZOK62D8 type=write size=2591199 2024-09-12T17:07:54.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.141+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~91V4FJIJK1XT.0 size=540002 2024-09-12T17:07:54.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.143+0000 7f9eaebff780 1 < completed multipart upload key=SHWT6AT7PN0M upload=91V4FJIJK1XT tag=0ZY5S3SEQ0Q7 type=write size=1588578 2024-09-12T17:07:54.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.144+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=VC5COX8YS0HM type=del size=653253 2024-09-12T17:07:54.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.146+0000 7f9eaebff780 1 < completed delete operation key=SHWT6AT7PN0M tag=LFO5RU9OX48I type=del 2024-09-12T17:07:54.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.147+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=EKJE6RQ0KV7E type=del size=1500742 2024-09-12T17:07:54.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.149+0000 7f9eaebff780 1 < completed write operation key=9I6RGNRB6HSY tag=U82OV4W0C96X type=write size=191840 2024-09-12T17:07:54.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.150+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=ZGOJVDO7KOD4 type=del size=3732410 2024-09-12T17:07:54.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.152+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~DU6RJJTZUIHK.0 size=551053 2024-09-12T17:07:54.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.154+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=DU6RJJTZUIHK tag=G53BEC3YPXDF type=write size=1599629 2024-09-12T17:07:54.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.155+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=EDFAXG7FFP49 type=del size=1009057 2024-09-12T17:07:54.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.156+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=SIHKJMMLLE13 type=del 2024-09-12T17:07:54.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.157+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=RSOSU78YPUMF type=del size=713312 2024-09-12T17:07:54.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.159+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~G9HD2SSMJVZB.0 size=1048576 2024-09-12T17:07:54.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.160+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~G9HD2SSMJVZB.1 size=1048576 2024-09-12T17:07:54.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.161+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~G9HD2SSMJVZB.2 size=800446 2024-09-12T17:07:54.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.163+0000 7f9eaebff780 1 < completed multipart upload key=YIEP2JYDSLW0 upload=G9HD2SSMJVZB tag=TDOUT5X9O99N type=write size=3946174 2024-09-12T17:07:54.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.164+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=TKYEMBLC6OO0 type=del size=864102 2024-09-12T17:07:54.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.165+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~RYI6GL81HRYR.0 size=1048576 2024-09-12T17:07:54.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.166+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~RYI6GL81HRYR.1 size=1048576 2024-09-12T17:07:54.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.167+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~RYI6GL81HRYR.2 size=941467 2024-09-12T17:07:54.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.168+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=RYI6GL81HRYR tag=5WSSW7G5ROKP type=write size=4087195 2024-09-12T17:07:54.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.170+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=J1XJLRHBJF2C type=del size=3569047 2024-09-12T17:07:54.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.171+0000 7f9eaebff780 1 < completed delete operation key=7PBT9VZ07OUI tag=TIM04IEB16X0 type=del 2024-09-12T17:07:54.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.172+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=J5YOYGLVPHNY type=del size=536691 2024-09-12T17:07:54.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.173+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~AL7J1Z4RW7FF.0 size=1048576 2024-09-12T17:07:54.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.174+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~AL7J1Z4RW7FF.1 size=1048576 2024-09-12T17:07:54.176 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.175+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~AL7J1Z4RW7FF.2 size=760243 2024-09-12T17:07:54.178 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.177+0000 7f9eaebff780 1 < completed multipart upload key=0YD5P1ACZ09Q upload=AL7J1Z4RW7FF tag=NSTQABQAGKAP type=write size=3905971 2024-09-12T17:07:54.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.178+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=NFLU1KKGRNVD type=del size=519597 2024-09-12T17:07:54.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.179+0000 7f9eaebff780 1 < canceled part key=_multipart_TDZCNUZE8IOA.2~L6L0A4NGPP5T.0 size=1048576 2024-09-12T17:07:54.181 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.180+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~L6L0A4NGPP5T.1 size=1048576 2024-09-12T17:07:54.182 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.181+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~L6L0A4NGPP5T.2 size=628606 2024-09-12T17:07:54.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.183+0000 7f9eaebff780 1 < canceled multipart upload key=TDZCNUZE8IOA upload=L6L0A4NGPP5T tag=E7KFOA1U3GM3 type=write size=3774334 2024-09-12T17:07:54.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.185+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~VNLOV377C3LC.0 size=570773 2024-09-12T17:07:54.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.185+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=VNLOV377C3LC tag=4PRNRQCBHZA2 type=write size=1619349 2024-09-12T17:07:54.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.188+0000 7f9eaebff780 1 < suggested remove operation key=EKUW5AKC428U tag=PAXJZJAFI1J6 type=del 2024-09-12T17:07:54.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.190+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~0CRRMRJW4U0I.0 size=1048576 2024-09-12T17:07:54.192 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.191+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~0CRRMRJW4U0I.1 size=1048576 2024-09-12T17:07:54.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.192+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~0CRRMRJW4U0I.2 size=16611 2024-09-12T17:07:54.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.192+0000 7f9eaebff780 1 > prepared multipart upload key=7PBT9VZ07OUI upload=0CRRMRJW4U0I tag=RK4P36AYEBLL type=write size=3162339 2024-09-12T17:07:54.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.193+0000 7f9eaebff780 -1 < failed to complete operation key=EKUW5AKC428U tag=IU14AB8JBAHI type=del size=94900: (22) Invalid argument 2024-09-12T17:07:54.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.194+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=42FYKD5739DF type=del size=596645 2024-09-12T17:07:54.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.197+0000 7f9eaebff780 1 < suggested update operation key=K0P9ZZ91UJJ8 tag=MRAQ4C3BBS9F type=write size=159256 2024-09-12T17:07:54.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.198+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=7XF1ZIW48GFJ type=del size=3029939 2024-09-12T17:07:54.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.199+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~4T289J1X1AU9.0 size=1048576 2024-09-12T17:07:54.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.200+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~4T289J1X1AU9.1 size=674116 2024-09-12T17:07:54.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.202+0000 7f9eaebff780 1 < completed multipart upload key=CAIZM33SDFPM upload=4T289J1X1AU9 tag=VDFNFLU32WNW type=write size=2771268 2024-09-12T17:07:54.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.203+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=GYZ79AC5WIN6 type=del size=2760979 2024-09-12T17:07:54.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.204+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~C6URCG9KGTRC.0 size=809794 2024-09-12T17:07:54.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.206+0000 7f9eaebff780 1 < completed multipart upload key=K2NHRSUDQBRW upload=C6URCG9KGTRC tag=05GI8KK8465X type=write size=1858370 2024-09-12T17:07:54.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.207+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=1J4JPZPCKKSB type=del size=499467 2024-09-12T17:07:54.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.209+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~RP2E0GBGSZPX.0 size=1048576 2024-09-12T17:07:54.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.210+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~RP2E0GBGSZPX.1 size=494047 2024-09-12T17:07:54.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.212+0000 7f9eaebff780 1 < completed multipart upload key=ZC814TPVLJO1 upload=RP2E0GBGSZPX tag=2SVJRZOK62D8 type=write size=2591199 2024-09-12T17:07:54.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.213+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=PSEKLUMTHPKF type=del size=2220494 2024-09-12T17:07:54.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.214+0000 7f9eaebff780 1 < completed delete operation key=ZYP3P4031PUZ tag=VC5COX8YS0HM type=del 2024-09-12T17:07:54.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.217+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~MX6U6WWZ514P.0 size=252967 2024-09-12T17:07:54.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.217+0000 7f9eaebff780 1 > prepared multipart upload key=9I6RGNRB6HSY upload=MX6U6WWZ514P tag=L3LWDR0LYV10 type=write size=1301543 2024-09-12T17:07:54.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.219+0000 7f9eaebff780 1 < suggested remove operation key=YIEP2JYDSLW0 tag=EKJE6RQ0KV7E type=del 2024-09-12T17:07:54.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.220+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=SYSYVZBS82U0 type=del size=1838049 2024-09-12T17:07:54.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.221+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=ZGOJVDO7KOD4 type=del 2024-09-12T17:07:54.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.223+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~ONANRI20ECOY.0 size=1048576 2024-09-12T17:07:54.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.224+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~ONANRI20ECOY.1 size=1048576 2024-09-12T17:07:54.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.225+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~ONANRI20ECOY.2 size=868290 2024-09-12T17:07:54.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.225+0000 7f9eaebff780 1 > prepared multipart upload key=0YD5P1ACZ09Q upload=ONANRI20ECOY tag=3N7GB0QPYWNE type=write size=4014018 2024-09-12T17:07:54.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.227+0000 7f9eaebff780 1 < suggested update operation key=LJN514F16XJA tag=EDFAXG7FFP49 type=del size=1009057 2024-09-12T17:07:54.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.229+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~P01DRC3PHFUY.0 size=1048576 2024-09-12T17:07:54.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.230+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~P01DRC3PHFUY.1 size=1048576 2024-09-12T17:07:54.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.231+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~P01DRC3PHFUY.2 size=700885 2024-09-12T17:07:54.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.231+0000 7f9eaebff780 1 > prepared multipart upload key=9I6RGNRB6HSY upload=P01DRC3PHFUY tag=ARZIA2Q4BCFX type=write size=3846613 2024-09-12T17:07:54.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.232+0000 7f9eaebff780 1 < completed delete operation key=P9GMGM3WK6O7 tag=RSOSU78YPUMF type=del 2024-09-12T17:07:54.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.234+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~WKKNBXQTU6OO.0 size=122328 2024-09-12T17:07:54.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.234+0000 7f9eaebff780 1 > prepared multipart upload key=EKUW5AKC428U upload=WKKNBXQTU6OO tag=NR4G6VRWWLII type=write size=1170904 2024-09-12T17:07:54.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.236+0000 7f9eaebff780 1 < completed delete operation key=8DJLYFM11DNI tag=TKYEMBLC6OO0 type=del 2024-09-12T17:07:54.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.237+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=038L4AEGQK0D type=del size=649942 2024-09-12T17:07:54.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.239+0000 7f9eaebff780 1 < suggested remove operation key=0YD5P1ACZ09Q tag=J1XJLRHBJF2C type=del 2024-09-12T17:07:54.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.241+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=3PCO9YGF7O9T type=del size=4153569 2024-09-12T17:07:54.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.243+0000 7f9eaebff780 1 < suggested remove operation key=P9GMGM3WK6O7 tag=J5YOYGLVPHNY type=del 2024-09-12T17:07:54.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.246+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~TAG9WQK1AM8S.0 size=1048576 2024-09-12T17:07:54.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.246+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~TAG9WQK1AM8S.1 size=1048576 2024-09-12T17:07:54.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.247+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~TAG9WQK1AM8S.2 size=727371 2024-09-12T17:07:54.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.247+0000 7f9eaebff780 1 > prepared multipart upload key=SO6QF2JCRX6E upload=TAG9WQK1AM8S tag=KTNIQDQ3KAKC type=write size=3873099 2024-09-12T17:07:54.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.249+0000 7f9eaebff780 1 < completed delete operation key=M3PLQGSK34YM tag=NFLU1KKGRNVD type=del 2024-09-12T17:07:54.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.250+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=A2Y3SO9JCDV6 type=del size=186136 2024-09-12T17:07:54.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.251+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~VNLOV377C3LC.0 size=570773 2024-09-12T17:07:54.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.253+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=VNLOV377C3LC tag=4PRNRQCBHZA2 type=write size=1619349 2024-09-12T17:07:54.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.254+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=XYXMGBFOQ5Z1 type=del size=2961635 2024-09-12T17:07:54.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.255+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~0CRRMRJW4U0I.0 size=1048576 2024-09-12T17:07:54.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.256+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~0CRRMRJW4U0I.1 size=1048576 2024-09-12T17:07:54.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.258+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~0CRRMRJW4U0I.2 size=16611 2024-09-12T17:07:54.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.260+0000 7f9eaebff780 1 < completed multipart upload key=7PBT9VZ07OUI upload=0CRRMRJW4U0I tag=RK4P36AYEBLL type=write size=3162339 2024-09-12T17:07:54.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.262+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~73HKJOI97T8K.0 size=1048576 2024-09-12T17:07:54.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.263+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~73HKJOI97T8K.1 size=618359 2024-09-12T17:07:54.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.263+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=73HKJOI97T8K tag=49QENMDN8627 type=write size=2715511 2024-09-12T17:07:54.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.264+0000 7f9eaebff780 1 < canceled operation key=LRI5G5G8O5X4 tag=42FYKD5739DF type=del size=596645 2024-09-12T17:07:54.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.265+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=M27V5ROAOU8T type=del size=1317695 2024-09-12T17:07:54.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.266+0000 7f9eaebff780 1 < completed delete operation key=ZC814TPVLJO1 tag=7XF1ZIW48GFJ type=del 2024-09-12T17:07:54.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.268+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~X10P70ABPGIN.0 size=1048576 2024-09-12T17:07:54.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.269+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~X10P70ABPGIN.1 size=1048576 2024-09-12T17:07:54.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.270+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~X10P70ABPGIN.2 size=79501 2024-09-12T17:07:54.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.270+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=X10P70ABPGIN tag=XDOWO4CLOIYA type=write size=3225229 2024-09-12T17:07:54.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.271+0000 7f9eaebff780 1 < completed delete operation key=0F5LXJZMBFSP tag=GYZ79AC5WIN6 type=del 2024-09-12T17:07:54.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.273+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~M02DQANMIK8R.0 size=1048576 2024-09-12T17:07:54.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.274+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~M02DQANMIK8R.1 size=1048576 2024-09-12T17:07:54.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.275+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~M02DQANMIK8R.2 size=499690 2024-09-12T17:07:54.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.275+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=M02DQANMIK8R tag=SH9RF1W07KS5 type=write size=3645418 2024-09-12T17:07:54.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.276+0000 7f9eaebff780 1 < canceled operation key=9WJGBODZ60NJ tag=1J4JPZPCKKSB type=del size=499467 2024-09-12T17:07:54.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.278+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~PGR9QVBY2X1H.0 size=1048576 2024-09-12T17:07:54.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.279+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~PGR9QVBY2X1H.1 size=1048576 2024-09-12T17:07:54.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.280+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~PGR9QVBY2X1H.2 size=752459 2024-09-12T17:07:54.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.280+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=PGR9QVBY2X1H tag=8ACGV58U58ZV type=write size=3898187 2024-09-12T17:07:54.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.281+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=PSEKLUMTHPKF type=del 2024-09-12T17:07:54.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.283+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=GYSQXQ9FHUCX type=write size=280798 2024-09-12T17:07:54.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.284+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~MX6U6WWZ514P.0 size=252967 2024-09-12T17:07:54.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.286+0000 7f9eaebff780 1 < completed multipart upload key=9I6RGNRB6HSY upload=MX6U6WWZ514P tag=L3LWDR0LYV10 type=write size=1301543 2024-09-12T17:07:54.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.287+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=Y8FJ9SD7OYUU type=write size=979484 2024-09-12T17:07:54.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.289+0000 7f9eaebff780 1 < suggested remove operation key=LRI5G5G8O5X4 tag=SYSYVZBS82U0 type=del 2024-09-12T17:07:54.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.291+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~I7F2CVCU6R3E.0 size=1048576 2024-09-12T17:07:54.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.292+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~I7F2CVCU6R3E.1 size=1048576 2024-09-12T17:07:54.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.293+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~I7F2CVCU6R3E.2 size=462138 2024-09-12T17:07:54.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.293+0000 7f9eaebff780 1 > prepared multipart upload key=SO6QF2JCRX6E upload=I7F2CVCU6R3E tag=ZMBI4DAMDMQ2 type=write size=3607866 2024-09-12T17:07:54.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.294+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~ONANRI20ECOY.0 size=1048576 2024-09-12T17:07:54.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.295+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~ONANRI20ECOY.1 size=1048576 2024-09-12T17:07:54.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.296+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~ONANRI20ECOY.2 size=868290 2024-09-12T17:07:54.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.298+0000 7f9eaebff780 1 < completed multipart upload key=0YD5P1ACZ09Q upload=ONANRI20ECOY tag=3N7GB0QPYWNE type=write size=4014018 2024-09-12T17:07:54.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.299+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=XVWT7BLH6P2V type=del size=96866 2024-09-12T17:07:54.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.300+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~P01DRC3PHFUY.0 size=1048576 2024-09-12T17:07:54.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.301+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~P01DRC3PHFUY.1 size=1048576 2024-09-12T17:07:54.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.302+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~P01DRC3PHFUY.2 size=700885 2024-09-12T17:07:54.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.304+0000 7f9eaebff780 1 < completed multipart upload key=9I6RGNRB6HSY upload=P01DRC3PHFUY tag=ARZIA2Q4BCFX type=write size=3846613 2024-09-12T17:07:54.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.305+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=MV7MBTOAAJ5Q type=del size=403230 2024-09-12T17:07:54.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.307+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~WKKNBXQTU6OO.0 size=122328 2024-09-12T17:07:54.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.309+0000 7f9eaebff780 1 < completed multipart upload key=EKUW5AKC428U upload=WKKNBXQTU6OO tag=NR4G6VRWWLII type=write size=1170904 2024-09-12T17:07:54.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.311+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~PH4940WFCBSI.0 size=1048576 2024-09-12T17:07:54.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.312+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~PH4940WFCBSI.1 size=1048576 2024-09-12T17:07:54.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.313+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~PH4940WFCBSI.2 size=610668 2024-09-12T17:07:54.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.313+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=PH4940WFCBSI tag=GYLSBXHZHHRA type=write size=3756396 2024-09-12T17:07:54.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.314+0000 7f9eaebff780 1 < completed delete operation key=OGD6H9VSVGWF tag=038L4AEGQK0D type=del 2024-09-12T17:07:54.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.315+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=76MH2XV8HNZE type=del size=3999857 2024-09-12T17:07:54.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.317+0000 7f9eaebff780 1 < completed delete operation key=M3PLQGSK34YM tag=3PCO9YGF7O9T type=del 2024-09-12T17:07:54.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.318+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=4WCF7ZSLC65V type=del size=768615 2024-09-12T17:07:54.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.319+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~TAG9WQK1AM8S.0 size=1048576 2024-09-12T17:07:54.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.320+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~TAG9WQK1AM8S.1 size=1048576 2024-09-12T17:07:54.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.321+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~TAG9WQK1AM8S.2 size=727371 2024-09-12T17:07:54.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.323+0000 7f9eaebff780 1 < completed multipart upload key=SO6QF2JCRX6E upload=TAG9WQK1AM8S tag=KTNIQDQ3KAKC type=write size=3873099 2024-09-12T17:07:54.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.325+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=R122IXBWLAC5 type=del size=1456394 2024-09-12T17:07:54.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.326+0000 7f9eaebff780 1 < completed delete operation key=K2NHRSUDQBRW tag=A2Y3SO9JCDV6 type=del 2024-09-12T17:07:54.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.328+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~LR3XPS2SC2D9.0 size=1048576 2024-09-12T17:07:54.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.329+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~LR3XPS2SC2D9.1 size=130432 2024-09-12T17:07:54.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.329+0000 7f9eaebff780 1 > prepared multipart upload key=LJN514F16XJA upload=LR3XPS2SC2D9 tag=TVC5MSQ12ZD7 type=write size=2227584 2024-09-12T17:07:54.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.330+0000 7f9eaebff780 1 < completed delete operation key=ZC814TPVLJO1 tag=XYXMGBFOQ5Z1 type=del 2024-09-12T17:07:54.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.332+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~35R1HS4B02JY.0 size=597377 2024-09-12T17:07:54.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.332+0000 7f9eaebff780 1 > prepared multipart upload key=7PBT9VZ07OUI upload=35R1HS4B02JY tag=OY3WYI5N63CG type=write size=1645953 2024-09-12T17:07:54.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.333+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~73HKJOI97T8K.0 size=1048576 2024-09-12T17:07:54.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.334+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~73HKJOI97T8K.1 size=618359 2024-09-12T17:07:54.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.337+0000 7f9eaebff780 1 < completed multipart upload key=P9GMGM3WK6O7 upload=73HKJOI97T8K tag=49QENMDN8627 type=write size=2715511 2024-09-12T17:07:54.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.339+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~DYP1YQERJVNO.0 size=1048576 2024-09-12T17:07:54.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.340+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~DYP1YQERJVNO.1 size=286977 2024-09-12T17:07:54.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.340+0000 7f9eaebff780 1 > prepared multipart upload key=A1KRCFY18QTP upload=DYP1YQERJVNO tag=NMUHBCGU7CJ4 type=write size=2384129 2024-09-12T17:07:54.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.342+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=M27V5ROAOU8T type=del 2024-09-12T17:07:54.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.343+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=6TVZS4AT68B0 type=del size=1556094 2024-09-12T17:07:54.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.344+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~X10P70ABPGIN.0 size=1048576 2024-09-12T17:07:54.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.345+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~X10P70ABPGIN.1 size=1048576 2024-09-12T17:07:54.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.346+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~X10P70ABPGIN.2 size=79501 2024-09-12T17:07:54.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.350+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=X10P70ABPGIN tag=XDOWO4CLOIYA type=write size=3225229 2024-09-12T17:07:54.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.352+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~A50BBIO98F5Y.0 size=1048576 2024-09-12T17:07:54.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.353+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~A50BBIO98F5Y.1 size=1048576 2024-09-12T17:07:54.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.354+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~A50BBIO98F5Y.2 size=903015 2024-09-12T17:07:54.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.354+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=A50BBIO98F5Y tag=ZY4U7W870ZCM type=write size=4048743 2024-09-12T17:07:54.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.354+0000 7f9eaebff780 1 < canceled part key=_multipart_K2NHRSUDQBRW.2~M02DQANMIK8R.0 size=1048576 2024-09-12T17:07:54.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.355+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~M02DQANMIK8R.1 size=1048576 2024-09-12T17:07:54.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.356+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~M02DQANMIK8R.2 size=499690 2024-09-12T17:07:54.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.358+0000 7f9eaebff780 1 < canceled multipart upload key=K2NHRSUDQBRW upload=M02DQANMIK8R tag=SH9RF1W07KS5 type=write size=3645418 2024-09-12T17:07:54.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.359+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=5DLDI2GYBXY4 type=write size=393497 2024-09-12T17:07:54.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.360+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~PGR9QVBY2X1H.0 size=1048576 2024-09-12T17:07:54.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.361+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~PGR9QVBY2X1H.1 size=1048576 2024-09-12T17:07:54.364 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.362+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~PGR9QVBY2X1H.2 size=752459 2024-09-12T17:07:54.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.364+0000 7f9eaebff780 1 < completed multipart upload key=P9GMGM3WK6O7 upload=PGR9QVBY2X1H tag=8ACGV58U58ZV type=write size=3898187 2024-09-12T17:07:54.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.368+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~R3O5200RLC05.0 size=413673 2024-09-12T17:07:54.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.368+0000 7f9eaebff780 1 > prepared multipart upload key=0F5LXJZMBFSP upload=R3O5200RLC05 tag=R1U8OW4K1DIO type=write size=1462249 2024-09-12T17:07:54.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.369+0000 7f9eaebff780 1 < completed write operation key=0YD5P1ACZ09Q tag=GYSQXQ9FHUCX type=write size=280798 2024-09-12T17:07:54.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.370+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=WFCX54D0WHZJ type=del size=3707052 2024-09-12T17:07:54.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.371+0000 7f9eaebff780 -1 < failed to complete operation key=LRI5G5G8O5X4 tag=Y8FJ9SD7OYUU type=write size=979484: (22) Invalid argument 2024-09-12T17:07:54.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.373+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~CEPQQUH1K5EK.0 size=326948 2024-09-12T17:07:54.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.373+0000 7f9eaebff780 1 > prepared multipart upload key=3VY271ZBO754 upload=CEPQQUH1K5EK tag=KR8UGFKQ9YKI type=write size=1375524 2024-09-12T17:07:54.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.374+0000 7f9eaebff780 1 < canceled part key=_multipart_SO6QF2JCRX6E.2~I7F2CVCU6R3E.0 size=1048576 2024-09-12T17:07:54.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.375+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~I7F2CVCU6R3E.1 size=1048576 2024-09-12T17:07:54.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.376+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~I7F2CVCU6R3E.2 size=462138 2024-09-12T17:07:54.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.377+0000 7f9eaebff780 1 < canceled multipart upload key=SO6QF2JCRX6E upload=I7F2CVCU6R3E tag=ZMBI4DAMDMQ2 type=write size=3607866 2024-09-12T17:07:54.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.379+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~IMKE3PT9Q4AM.0 size=1048576 2024-09-12T17:07:54.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.380+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~IMKE3PT9Q4AM.1 size=1048576 2024-09-12T17:07:54.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.381+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~IMKE3PT9Q4AM.2 size=945438 2024-09-12T17:07:54.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.381+0000 7f9eaebff780 1 > prepared multipart upload key=0F5LXJZMBFSP upload=IMKE3PT9Q4AM tag=S5L942B2WNXI type=write size=4091166 2024-09-12T17:07:54.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.382+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=XVWT7BLH6P2V type=del 2024-09-12T17:07:54.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.385+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~PYPZ6KTTUF0Y.0 size=1048576 2024-09-12T17:07:54.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.385+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~PYPZ6KTTUF0Y.1 size=1048576 2024-09-12T17:07:54.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.386+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~PYPZ6KTTUF0Y.2 size=975365 2024-09-12T17:07:54.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.386+0000 7f9eaebff780 1 > prepared multipart upload key=LJN514F16XJA upload=PYPZ6KTTUF0Y tag=OQK34MJE52FD type=write size=4121093 2024-09-12T17:07:54.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.387+0000 7f9eaebff780 1 < completed delete operation key=0YD5P1ACZ09Q tag=MV7MBTOAAJ5Q type=del 2024-09-12T17:07:54.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.389+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=UT9ERGJXX5B2 type=del size=2670298 2024-09-12T17:07:54.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.390+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~PH4940WFCBSI.0 size=1048576 2024-09-12T17:07:54.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.391+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~PH4940WFCBSI.1 size=1048576 2024-09-12T17:07:54.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.392+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~PH4940WFCBSI.2 size=610668 2024-09-12T17:07:54.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.394+0000 7f9eaebff780 1 < completed multipart upload key=SHWT6AT7PN0M upload=PH4940WFCBSI tag=GYLSBXHZHHRA type=write size=3756396 2024-09-12T17:07:54.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.395+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=AXL3ETXCJACG type=del size=2571265 2024-09-12T17:07:54.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.398+0000 7f9eaebff780 1 < suggested update operation key=7PBT9VZ07OUI tag=76MH2XV8HNZE type=del size=3999857 2024-09-12T17:07:54.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.399+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=0NF9WALUNWSN type=write size=222139 2024-09-12T17:07:54.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.400+0000 7f9eaebff780 1 < completed delete operation key=B1YC6DM9S8JJ tag=4WCF7ZSLC65V type=del 2024-09-12T17:07:54.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.402+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=C8NZNSBN1IFH type=del size=3741685 2024-09-12T17:07:54.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.403+0000 7f9eaebff780 -1 < failed to complete operation key=7PBT9VZ07OUI tag=R122IXBWLAC5 type=del size=1456394: (22) Invalid argument 2024-09-12T17:07:54.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.404+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=BH644LCVJHP9 type=write size=862766 2024-09-12T17:07:54.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.405+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~LR3XPS2SC2D9.0 size=1048576 2024-09-12T17:07:54.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.406+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~LR3XPS2SC2D9.1 size=130432 2024-09-12T17:07:54.410 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.408+0000 7f9eaebff780 1 < completed multipart upload key=LJN514F16XJA upload=LR3XPS2SC2D9 tag=TVC5MSQ12ZD7 type=write size=2227584 2024-09-12T17:07:54.411 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.410+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~OU1C1VZ7CGA5.0 size=1048576 2024-09-12T17:07:54.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.411+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~OU1C1VZ7CGA5.1 size=636268 2024-09-12T17:07:54.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.411+0000 7f9eaebff780 1 > prepared multipart upload key=ZYP3P4031PUZ upload=OU1C1VZ7CGA5 tag=1UKFB41AOI16 type=write size=2733420 2024-09-12T17:07:54.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.412+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~35R1HS4B02JY.0 size=597377 2024-09-12T17:07:54.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.414+0000 7f9eaebff780 1 < completed multipart upload key=7PBT9VZ07OUI upload=35R1HS4B02JY tag=OY3WYI5N63CG type=write size=1645953 2024-09-12T17:07:54.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.416+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~SP3D4T3HJW7I.0 size=448036 2024-09-12T17:07:54.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.416+0000 7f9eaebff780 1 > prepared multipart upload key=LJN514F16XJA upload=SP3D4T3HJW7I tag=ZJY92GOV4CJY type=write size=1496612 2024-09-12T17:07:54.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.417+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~DYP1YQERJVNO.0 size=1048576 2024-09-12T17:07:54.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.418+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~DYP1YQERJVNO.1 size=286977 2024-09-12T17:07:54.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.420+0000 7f9eaebff780 1 < completed multipart upload key=A1KRCFY18QTP upload=DYP1YQERJVNO tag=NMUHBCGU7CJ4 type=write size=2384129 2024-09-12T17:07:54.423 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.422+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~1GS2O0GMSJU4.0 size=1048576 2024-09-12T17:07:54.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.423+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~1GS2O0GMSJU4.1 size=917043 2024-09-12T17:07:54.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.423+0000 7f9eaebff780 1 > prepared multipart upload key=0YD5P1ACZ09Q upload=1GS2O0GMSJU4 tag=7VTI4RC2VO2Q type=write size=3014195 2024-09-12T17:07:54.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.424+0000 7f9eaebff780 1 < completed delete operation key=B1YC6DM9S8JJ tag=6TVZS4AT68B0 type=del 2024-09-12T17:07:54.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.426+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~VFM5RSPJ2X4V.0 size=972934 2024-09-12T17:07:54.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.426+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=VFM5RSPJ2X4V tag=X9U8ECWFEJL3 type=write size=2021510 2024-09-12T17:07:54.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.428+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~A50BBIO98F5Y.0 size=1048576 2024-09-12T17:07:54.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.428+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~A50BBIO98F5Y.1 size=1048576 2024-09-12T17:07:54.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.429+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~A50BBIO98F5Y.2 size=903015 2024-09-12T17:07:54.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.431+0000 7f9eaebff780 1 < completed multipart upload key=P9GMGM3WK6O7 upload=A50BBIO98F5Y tag=ZY4U7W870ZCM type=write size=4048743 2024-09-12T17:07:54.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.433+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~LKTFOJ19SDX9.0 size=710720 2024-09-12T17:07:54.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.433+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=LKTFOJ19SDX9 tag=KO4VQA8QAUAS type=write size=1759296 2024-09-12T17:07:54.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.434+0000 7f9eaebff780 1 < completed write operation key=SVWPQETL92QU tag=5DLDI2GYBXY4 type=write size=393497 2024-09-12T17:07:54.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.435+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=56F4LKHTXN2K type=del size=1221771 2024-09-12T17:07:54.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.436+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~R3O5200RLC05.0 size=413673 2024-09-12T17:07:54.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.438+0000 7f9eaebff780 1 < completed multipart upload key=0F5LXJZMBFSP upload=R3O5200RLC05 tag=R1U8OW4K1DIO type=write size=1462249 2024-09-12T17:07:54.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.440+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~SNF4L358KJCW.0 size=988755 2024-09-12T17:07:54.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.440+0000 7f9eaebff780 1 > prepared multipart upload key=8DJLYFM11DNI upload=SNF4L358KJCW tag=MNXDPJK3JPW8 type=write size=2037331 2024-09-12T17:07:54.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.441+0000 7f9eaebff780 1 < completed delete operation key=0F5LXJZMBFSP tag=WFCX54D0WHZJ type=del 2024-09-12T17:07:54.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.443+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~AE3FBCDJSXO4.0 size=1048576 2024-09-12T17:07:54.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.444+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~AE3FBCDJSXO4.1 size=1048576 2024-09-12T17:07:54.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.445+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~AE3FBCDJSXO4.2 size=888783 2024-09-12T17:07:54.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.445+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=AE3FBCDJSXO4 tag=KASHPCUUVHQX type=write size=4034511 2024-09-12T17:07:54.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.446+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~CEPQQUH1K5EK.0 size=326948 2024-09-12T17:07:54.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.448+0000 7f9eaebff780 1 < completed multipart upload key=3VY271ZBO754 upload=CEPQQUH1K5EK tag=KR8UGFKQ9YKI type=write size=1375524 2024-09-12T17:07:54.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.450+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~LEC010B3E2XJ.0 size=1048576 2024-09-12T17:07:54.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.451+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~LEC010B3E2XJ.1 size=988337 2024-09-12T17:07:54.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.451+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=LEC010B3E2XJ tag=G8YT4UOTYYT2 type=write size=3085489 2024-09-12T17:07:54.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.452+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~IMKE3PT9Q4AM.0 size=1048576 2024-09-12T17:07:54.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.453+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~IMKE3PT9Q4AM.1 size=1048576 2024-09-12T17:07:54.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.454+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~IMKE3PT9Q4AM.2 size=945438 2024-09-12T17:07:54.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.456+0000 7f9eaebff780 1 < completed multipart upload key=0F5LXJZMBFSP upload=IMKE3PT9Q4AM tag=S5L942B2WNXI type=write size=4091166 2024-09-12T17:07:54.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.457+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=XQ968FFVXJ21 type=del size=55189 2024-09-12T17:07:54.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.458+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~PYPZ6KTTUF0Y.0 size=1048576 2024-09-12T17:07:54.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.459+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~PYPZ6KTTUF0Y.1 size=1048576 2024-09-12T17:07:54.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.460+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~PYPZ6KTTUF0Y.2 size=975365 2024-09-12T17:07:54.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.462+0000 7f9eaebff780 1 < completed multipart upload key=LJN514F16XJA upload=PYPZ6KTTUF0Y tag=OQK34MJE52FD type=write size=4121093 2024-09-12T17:07:54.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.463+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=P25R20P4XQHW type=del size=1886783 2024-09-12T17:07:54.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.464+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=UT9ERGJXX5B2 type=del 2024-09-12T17:07:54.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.467+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~KSFYB07M7DCW.0 size=131237 2024-09-12T17:07:54.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.467+0000 7f9eaebff780 1 > prepared multipart upload key=ZC814TPVLJO1 upload=KSFYB07M7DCW tag=CZSPAGPU85BO type=write size=1179813 2024-09-12T17:07:54.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.468+0000 7f9eaebff780 1 < completed delete operation key=K0P9ZZ91UJJ8 tag=AXL3ETXCJACG type=del 2024-09-12T17:07:54.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.471+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~LT9YZG6JYA10.0 size=1048576 2024-09-12T17:07:54.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.472+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~LT9YZG6JYA10.1 size=1048576 2024-09-12T17:07:54.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.474+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~LT9YZG6JYA10.2 size=613454 2024-09-12T17:07:54.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.474+0000 7f9eaebff780 1 > prepared multipart upload key=0F5LXJZMBFSP upload=LT9YZG6JYA10 tag=ESNU2O1866Q6 type=write size=3759182 2024-09-12T17:07:54.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.475+0000 7f9eaebff780 1 < canceled operation key=B1YC6DM9S8JJ tag=0NF9WALUNWSN type=write size=222139 2024-09-12T17:07:54.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.477+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~QC3DFFEHXXJS.0 size=1048576 2024-09-12T17:07:54.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.478+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~QC3DFFEHXXJS.1 size=505836 2024-09-12T17:07:54.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.478+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=QC3DFFEHXXJS tag=YJ7QPWXMPPDK type=write size=2602988 2024-09-12T17:07:54.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.479+0000 7f9eaebff780 1 < canceled operation key=ZC814TPVLJO1 tag=C8NZNSBN1IFH type=del size=3741685 2024-09-12T17:07:54.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.481+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=3HNTF7DF2UNW type=del size=3037094 2024-09-12T17:07:54.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.483+0000 7f9eaebff780 1 < suggested update operation key=LRI5G5G8O5X4 tag=BH644LCVJHP9 type=write size=862766 2024-09-12T17:07:54.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.485+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~D0S0W2UE1P7G.0 size=1048576 2024-09-12T17:07:54.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.486+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~D0S0W2UE1P7G.1 size=843799 2024-09-12T17:07:54.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.486+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=D0S0W2UE1P7G tag=X8KZMKI1HPLL type=write size=2940951 2024-09-12T17:07:54.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.487+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~OU1C1VZ7CGA5.0 size=1048576 2024-09-12T17:07:54.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.488+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~OU1C1VZ7CGA5.1 size=636268 2024-09-12T17:07:54.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.490+0000 7f9eaebff780 1 < completed multipart upload key=ZYP3P4031PUZ upload=OU1C1VZ7CGA5 tag=1UKFB41AOI16 type=write size=2733420 2024-09-12T17:07:54.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.493+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~EE7KQ1J0QVOV.0 size=108100 2024-09-12T17:07:54.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.493+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=EE7KQ1J0QVOV tag=S456HJ0WP427 type=write size=1156676 2024-09-12T17:07:54.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.494+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~SP3D4T3HJW7I.0 size=448036 2024-09-12T17:07:54.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.496+0000 7f9eaebff780 1 < completed multipart upload key=LJN514F16XJA upload=SP3D4T3HJW7I tag=ZJY92GOV4CJY type=write size=1496612 2024-09-12T17:07:54.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.498+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~ELVTC1LPWTSO.0 size=1048576 2024-09-12T17:07:54.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.499+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~ELVTC1LPWTSO.1 size=183021 2024-09-12T17:07:54.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.499+0000 7f9eaebff780 1 > prepared multipart upload key=LRI5G5G8O5X4 upload=ELVTC1LPWTSO tag=OHYFI5WMFTWT type=write size=2280173 2024-09-12T17:07:54.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.499+0000 7f9eaebff780 1 < canceled part key=_multipart_0YD5P1ACZ09Q.2~1GS2O0GMSJU4.0 size=1048576 2024-09-12T17:07:54.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.500+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~1GS2O0GMSJU4.1 size=917043 2024-09-12T17:07:54.504 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.503+0000 7f9eaebff780 1 < canceled multipart upload key=0YD5P1ACZ09Q upload=1GS2O0GMSJU4 tag=7VTI4RC2VO2Q type=write size=3014195 2024-09-12T17:07:54.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.505+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~6AEUBOI78XH4.0 size=1048576 2024-09-12T17:07:54.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.506+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~6AEUBOI78XH4.1 size=572320 2024-09-12T17:07:54.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.506+0000 7f9eaebff780 1 > prepared multipart upload key=QIMNK4DL3D0N upload=6AEUBOI78XH4 tag=GX9PKUGQVN7P type=write size=2669472 2024-09-12T17:07:54.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.507+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~VFM5RSPJ2X4V.0 size=972934 2024-09-12T17:07:54.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.509+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=VFM5RSPJ2X4V tag=X9U8ECWFEJL3 type=write size=2021510 2024-09-12T17:07:54.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.511+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~LQ308KY3Y7DP.0 size=1048576 2024-09-12T17:07:54.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.512+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~LQ308KY3Y7DP.1 size=503542 2024-09-12T17:07:54.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.512+0000 7f9eaebff780 1 > prepared multipart upload key=OGD6H9VSVGWF upload=LQ308KY3Y7DP tag=PM05PG3NPCKI type=write size=2600694 2024-09-12T17:07:54.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.513+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~LKTFOJ19SDX9.0 size=710720 2024-09-12T17:07:54.517 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.515+0000 7f9eaebff780 1 < completed multipart upload key=P9GMGM3WK6O7 upload=LKTFOJ19SDX9 tag=KO4VQA8QAUAS type=write size=1759296 2024-09-12T17:07:54.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.518+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~B0F2K0GIBVXN.0 size=1048576 2024-09-12T17:07:54.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.519+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~B0F2K0GIBVXN.1 size=875057 2024-09-12T17:07:54.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.519+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=B0F2K0GIBVXN tag=SPJLEWOU6XQ1 type=write size=2972209 2024-09-12T17:07:54.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.520+0000 7f9eaebff780 1 < completed delete operation key=SO6QF2JCRX6E tag=56F4LKHTXN2K type=del 2024-09-12T17:07:54.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.521+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=QZ5E0LDL9E23 type=del size=3822657 2024-09-12T17:07:54.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.522+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~SNF4L358KJCW.0 size=988755 2024-09-12T17:07:54.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.524+0000 7f9eaebff780 1 < completed multipart upload key=8DJLYFM11DNI upload=SNF4L358KJCW tag=MNXDPJK3JPW8 type=write size=2037331 2024-09-12T17:07:54.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.525+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=ZTU01QHZQ3SE type=del size=2956123 2024-09-12T17:07:54.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.527+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~AE3FBCDJSXO4.0 size=1048576 2024-09-12T17:07:54.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.528+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~AE3FBCDJSXO4.1 size=1048576 2024-09-12T17:07:54.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.528+0000 7f9eaebff780 1 < canceled part key=_multipart_K2NHRSUDQBRW.2~AE3FBCDJSXO4.2 size=888783 2024-09-12T17:07:54.531 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.529+0000 7f9eaebff780 1 < canceled multipart upload key=K2NHRSUDQBRW upload=AE3FBCDJSXO4 tag=KASHPCUUVHQX type=write size=4034511 2024-09-12T17:07:54.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.531+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=R0ZTJTBS6AFP type=del size=1190824 2024-09-12T17:07:54.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.532+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~LEC010B3E2XJ.0 size=1048576 2024-09-12T17:07:54.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.533+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~LEC010B3E2XJ.1 size=988337 2024-09-12T17:07:54.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.534+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=LEC010B3E2XJ tag=G8YT4UOTYYT2 type=write size=3085489 2024-09-12T17:07:54.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.536+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=YDDTAWFRJY1Z type=write size=1018180 2024-09-12T17:07:54.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.537+0000 7f9eaebff780 1 < completed delete operation key=7PBT9VZ07OUI tag=XQ968FFVXJ21 type=del 2024-09-12T17:07:54.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.538+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=M6JSS0OX0P5T type=del size=1590567 2024-09-12T17:07:54.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.540+0000 7f9eaebff780 1 < suggested update operation key=TXHXOMIB4B53 tag=P25R20P4XQHW type=del size=1886783 2024-09-12T17:07:54.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.542+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=CN9KRBP32JTU type=del size=3716991 2024-09-12T17:07:54.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.543+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~KSFYB07M7DCW.0 size=131237 2024-09-12T17:07:54.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.545+0000 7f9eaebff780 1 < completed multipart upload key=ZC814TPVLJO1 upload=KSFYB07M7DCW tag=CZSPAGPU85BO type=write size=1179813 2024-09-12T17:07:54.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.547+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~L8N7TGB0AW9U.0 size=1048576 2024-09-12T17:07:54.550 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.548+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~L8N7TGB0AW9U.1 size=249394 2024-09-12T17:07:54.550 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.548+0000 7f9eaebff780 1 > prepared multipart upload key=GB8P7K59Y8VI upload=L8N7TGB0AW9U tag=1IJTH4GSKJTW type=write size=2346546 2024-09-12T17:07:54.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.550+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~LT9YZG6JYA10.0 size=1048576 2024-09-12T17:07:54.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.551+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~LT9YZG6JYA10.1 size=1048576 2024-09-12T17:07:54.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.552+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~LT9YZG6JYA10.2 size=613454 2024-09-12T17:07:54.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.554+0000 7f9eaebff780 1 < completed multipart upload key=0F5LXJZMBFSP upload=LT9YZG6JYA10 tag=ESNU2O1866Q6 type=write size=3759182 2024-09-12T17:07:54.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.556+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=S404M7RW70S3 type=del size=205896 2024-09-12T17:07:54.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.557+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~QC3DFFEHXXJS.0 size=1048576 2024-09-12T17:07:54.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.558+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~QC3DFFEHXXJS.1 size=505836 2024-09-12T17:07:54.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.560+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=QC3DFFEHXXJS tag=YJ7QPWXMPPDK type=write size=2602988 2024-09-12T17:07:54.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.561+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=6QRZEGV4OJ9K type=del size=2138183 2024-09-12T17:07:54.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.563+0000 7f9eaebff780 1 < suggested update operation key=ZC814TPVLJO1 tag=3HNTF7DF2UNW type=del size=3037094 2024-09-12T17:07:54.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.564+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=2D6BVXC9BRU3 type=del size=92344 2024-09-12T17:07:54.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.566+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~D0S0W2UE1P7G.0 size=1048576 2024-09-12T17:07:54.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.566+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~D0S0W2UE1P7G.1 size=843799 2024-09-12T17:07:54.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.569+0000 7f9eaebff780 1 < completed multipart upload key=K2NHRSUDQBRW upload=D0S0W2UE1P7G tag=X8KZMKI1HPLL type=write size=2940951 2024-09-12T17:07:54.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.570+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=I04SLBQEB327 type=del size=3486706 2024-09-12T17:07:54.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.571+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~EE7KQ1J0QVOV.0 size=108100 2024-09-12T17:07:54.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.573+0000 7f9eaebff780 1 < completed multipart upload key=SHWT6AT7PN0M upload=EE7KQ1J0QVOV tag=S456HJ0WP427 type=write size=1156676 2024-09-12T17:07:54.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.575+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=199J602UOHG4 type=del size=46350 2024-09-12T17:07:54.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.576+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~ELVTC1LPWTSO.0 size=1048576 2024-09-12T17:07:54.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.577+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~ELVTC1LPWTSO.1 size=183021 2024-09-12T17:07:54.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.579+0000 7f9eaebff780 1 < completed multipart upload key=LRI5G5G8O5X4 upload=ELVTC1LPWTSO tag=OHYFI5WMFTWT type=write size=2280173 2024-09-12T17:07:54.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.581+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~98HC6M622BGC.0 size=1048576 2024-09-12T17:07:54.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.582+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~98HC6M622BGC.1 size=95311 2024-09-12T17:07:54.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.582+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=98HC6M622BGC tag=TQ1ODP6PSSWH type=write size=2192463 2024-09-12T17:07:54.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.584+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~6AEUBOI78XH4.0 size=1048576 2024-09-12T17:07:54.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.586+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~6AEUBOI78XH4.1 size=572320 2024-09-12T17:07:54.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.588+0000 7f9eaebff780 1 < completed multipart upload key=QIMNK4DL3D0N upload=6AEUBOI78XH4 tag=GX9PKUGQVN7P type=write size=2669472 2024-09-12T17:07:54.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.590+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=PM9F4V4M4HYK type=write size=805028 2024-09-12T17:07:54.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.591+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~LQ308KY3Y7DP.0 size=1048576 2024-09-12T17:07:54.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.592+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~LQ308KY3Y7DP.1 size=503542 2024-09-12T17:07:54.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.594+0000 7f9eaebff780 1 < completed multipart upload key=OGD6H9VSVGWF upload=LQ308KY3Y7DP tag=PM05PG3NPCKI type=write size=2600694 2024-09-12T17:07:54.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.595+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=W1LW8ILYLON5 type=write size=178819 2024-09-12T17:07:54.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.596+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~B0F2K0GIBVXN.0 size=1048576 2024-09-12T17:07:54.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.597+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~B0F2K0GIBVXN.1 size=875057 2024-09-12T17:07:54.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.599+0000 7f9eaebff780 1 < completed multipart upload key=UYF1AN2W59VN upload=B0F2K0GIBVXN tag=SPJLEWOU6XQ1 type=write size=2972209 2024-09-12T17:07:54.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.600+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=EFHWNTABH2O1 type=del size=687101 2024-09-12T17:07:54.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.602+0000 7f9eaebff780 1 < completed delete operation key=UYF1AN2W59VN tag=QZ5E0LDL9E23 type=del 2024-09-12T17:07:54.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.603+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=QRTBQUSK3UZ4 type=write size=452821 2024-09-12T17:07:54.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.604+0000 7f9eaebff780 1 < completed delete operation key=EKUW5AKC428U tag=ZTU01QHZQ3SE type=del 2024-09-12T17:07:54.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.605+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=54XCRX9MZ96L type=del size=4012888 2024-09-12T17:07:54.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.606+0000 7f9eaebff780 1 < completed delete operation key=EKUW5AKC428U tag=R0ZTJTBS6AFP type=del 2024-09-12T17:07:54.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.608+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=I2TB3IZU5DBG type=write size=368599 2024-09-12T17:07:54.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.610+0000 7f9eaebff780 1 < suggested update operation key=LRI5G5G8O5X4 tag=YDDTAWFRJY1Z type=write size=1018180 2024-09-12T17:07:54.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.611+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=H4DTLIRQID3W type=del size=2433369 2024-09-12T17:07:54.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.612+0000 7f9eaebff780 -1 < failed to complete operation key=LRI5G5G8O5X4 tag=M6JSS0OX0P5T type=del size=1590567: (22) Invalid argument 2024-09-12T17:07:54.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.614+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~4F7AB7JC1DB7.0 size=1048576 2024-09-12T17:07:54.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.615+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~4F7AB7JC1DB7.1 size=252724 2024-09-12T17:07:54.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.615+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=4F7AB7JC1DB7 tag=LI0X60IZ0WO1 type=write size=2349876 2024-09-12T17:07:54.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.616+0000 7f9eaebff780 -1 < failed to complete operation key=LRI5G5G8O5X4 tag=CN9KRBP32JTU type=del size=3716991: (22) Invalid argument 2024-09-12T17:07:54.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.618+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=YE2AXSM0GFXV type=write size=367621 2024-09-12T17:07:54.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.619+0000 7f9eaebff780 1 < completed part key=_multipart_GB8P7K59Y8VI.2~L8N7TGB0AW9U.0 size=1048576 2024-09-12T17:07:54.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.620+0000 7f9eaebff780 1 < completed part key=_multipart_GB8P7K59Y8VI.2~L8N7TGB0AW9U.1 size=249394 2024-09-12T17:07:54.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.622+0000 7f9eaebff780 1 < completed multipart upload key=GB8P7K59Y8VI upload=L8N7TGB0AW9U tag=1IJTH4GSKJTW type=write size=2346546 2024-09-12T17:07:54.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.624+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~5B9EJE19TNZW.0 size=1048576 2024-09-12T17:07:54.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.625+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~5B9EJE19TNZW.1 size=663419 2024-09-12T17:07:54.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.625+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=5B9EJE19TNZW tag=XVTPSJCU983N type=write size=2760571 2024-09-12T17:07:54.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.627+0000 7f9eaebff780 1 < suggested remove operation key=ZC814TPVLJO1 tag=S404M7RW70S3 type=del 2024-09-12T17:07:54.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.629+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~WC623XHDM7SD.0 size=1048576 2024-09-12T17:07:54.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.630+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~WC623XHDM7SD.1 size=1048576 2024-09-12T17:07:54.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.631+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~WC623XHDM7SD.2 size=842297 2024-09-12T17:07:54.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.631+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=WC623XHDM7SD tag=IKS6HB86BAGA type=write size=3988025 2024-09-12T17:07:54.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.633+0000 7f9eaebff780 1 < suggested remove operation key=9WJGBODZ60NJ tag=6QRZEGV4OJ9K type=del 2024-09-12T17:07:54.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.634+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=82DS7S5OW602 type=del size=773110 2024-09-12T17:07:54.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.636+0000 7f9eaebff780 1 < completed delete operation key=SVWPQETL92QU tag=2D6BVXC9BRU3 type=del 2024-09-12T17:07:54.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.638+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~BBC2LMHC9GFC.0 size=1048576 2024-09-12T17:07:54.640 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.639+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~BBC2LMHC9GFC.1 size=1048576 2024-09-12T17:07:54.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.640+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~BBC2LMHC9GFC.2 size=806598 2024-09-12T17:07:54.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.640+0000 7f9eaebff780 1 > prepared multipart upload key=YIEP2JYDSLW0 upload=BBC2LMHC9GFC tag=CD21J1I6FK5P type=write size=3952326 2024-09-12T17:07:54.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.641+0000 7f9eaebff780 1 < completed delete operation key=B1YC6DM9S8JJ tag=I04SLBQEB327 type=del 2024-09-12T17:07:54.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.643+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=CPG5VDGP4CPX type=del size=3646258 2024-09-12T17:07:54.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.645+0000 7f9eaebff780 1 < completed delete operation key=TXHXOMIB4B53 tag=199J602UOHG4 type=del 2024-09-12T17:07:54.648 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.647+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~PKEBMMT2QW3X.0 size=1048576 2024-09-12T17:07:54.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.648+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~PKEBMMT2QW3X.1 size=1048576 2024-09-12T17:07:54.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.649+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~PKEBMMT2QW3X.2 size=297985 2024-09-12T17:07:54.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.649+0000 7f9eaebff780 1 > prepared multipart upload key=TDZCNUZE8IOA upload=PKEBMMT2QW3X tag=9VT005O4A2XY type=write size=3443713 2024-09-12T17:07:54.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.650+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~98HC6M622BGC.0 size=1048576 2024-09-12T17:07:54.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.651+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~98HC6M622BGC.1 size=95311 2024-09-12T17:07:54.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.653+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=98HC6M622BGC tag=TQ1ODP6PSSWH type=write size=2192463 2024-09-12T17:07:54.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.654+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=U1C164WDL1CB type=del size=3718194 2024-09-12T17:07:54.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.655+0000 7f9eaebff780 1 < canceled operation key=SO6QF2JCRX6E tag=PM9F4V4M4HYK type=write size=805028 2024-09-12T17:07:54.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.657+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~CPTP6RSOYF72.0 size=1048576 2024-09-12T17:07:54.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.658+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~CPTP6RSOYF72.1 size=1048576 2024-09-12T17:07:54.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.659+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~CPTP6RSOYF72.2 size=1010012 2024-09-12T17:07:54.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.659+0000 7f9eaebff780 1 > prepared multipart upload key=LRI5G5G8O5X4 upload=CPTP6RSOYF72 tag=GPV6T8JYTXVG type=write size=4155740 2024-09-12T17:07:54.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.661+0000 7f9eaebff780 1 < completed write operation key=CAIZM33SDFPM tag=W1LW8ILYLON5 type=write size=178819 2024-09-12T17:07:54.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.663+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~IWQSE5MVKTLG.0 size=1048576 2024-09-12T17:07:54.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.664+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~IWQSE5MVKTLG.1 size=1048576 2024-09-12T17:07:54.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.665+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~IWQSE5MVKTLG.2 size=969419 2024-09-12T17:07:54.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.665+0000 7f9eaebff780 1 > prepared multipart upload key=A1KRCFY18QTP upload=IWQSE5MVKTLG tag=FBX4FVOWCL6V type=write size=4115147 2024-09-12T17:07:54.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.666+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=EFHWNTABH2O1 type=del 2024-09-12T17:07:54.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.668+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~TBDH8067BQZX.0 size=1048576 2024-09-12T17:07:54.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.669+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~TBDH8067BQZX.1 size=619064 2024-09-12T17:07:54.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.669+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=TBDH8067BQZX tag=BKMKFXSSWIY6 type=write size=2716216 2024-09-12T17:07:54.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.670+0000 7f9eaebff780 1 < completed write operation key=EKUW5AKC428U tag=QRTBQUSK3UZ4 type=write size=452821 2024-09-12T17:07:54.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.672+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=KP0QAD19P0C0 type=del size=1141713 2024-09-12T17:07:54.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.673+0000 7f9eaebff780 1 < canceled operation key=SHWT6AT7PN0M tag=54XCRX9MZ96L type=del size=4012888 2024-09-12T17:07:54.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.674+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=3Z5VQZKDDVL5 type=del size=2977548 2024-09-12T17:07:54.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.675+0000 7f9eaebff780 1 < canceled operation key=K2NHRSUDQBRW tag=I2TB3IZU5DBG type=write size=368599 2024-09-12T17:07:54.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.677+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=D4AI3Z7YAJRI type=del size=2096958 2024-09-12T17:07:54.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.678+0000 7f9eaebff780 1 < completed delete operation key=K0P9ZZ91UJJ8 tag=H4DTLIRQID3W type=del 2024-09-12T17:07:54.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.679+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=V3V02UG1QSVC type=write size=1025551 2024-09-12T17:07:54.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.680+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~4F7AB7JC1DB7.0 size=1048576 2024-09-12T17:07:54.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.680+0000 7f9eaebff780 1 < canceled part key=_multipart_K2NHRSUDQBRW.2~4F7AB7JC1DB7.1 size=252724 2024-09-12T17:07:54.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.683+0000 7f9eaebff780 1 < canceled multipart upload key=K2NHRSUDQBRW upload=4F7AB7JC1DB7 tag=LI0X60IZ0WO1 type=write size=2349876 2024-09-12T17:07:54.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.684+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=MAM0IVL6YMIE type=del size=3378144 2024-09-12T17:07:54.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.686+0000 7f9eaebff780 1 < suggested update operation key=A1KRCFY18QTP tag=YE2AXSM0GFXV type=write size=367621 2024-09-12T17:07:54.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.688+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~S1PBAF4E3HGZ.0 size=1048576 2024-09-12T17:07:54.691 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.689+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~S1PBAF4E3HGZ.1 size=1048576 2024-09-12T17:07:54.692 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.690+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~S1PBAF4E3HGZ.2 size=84483 2024-09-12T17:07:54.692 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.690+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=S1PBAF4E3HGZ tag=BPV0WKGPICG4 type=write size=3230211 2024-09-12T17:07:54.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.691+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~5B9EJE19TNZW.0 size=1048576 2024-09-12T17:07:54.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.692+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~5B9EJE19TNZW.1 size=663419 2024-09-12T17:07:54.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.694+0000 7f9eaebff780 1 < completed multipart upload key=UYF1AN2W59VN upload=5B9EJE19TNZW tag=XVTPSJCU983N type=write size=2760571 2024-09-12T17:07:54.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.695+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=FIU4KMG6SSL8 type=write size=542732 2024-09-12T17:07:54.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.697+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~WC623XHDM7SD.0 size=1048576 2024-09-12T17:07:54.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.699+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~WC623XHDM7SD.1 size=1048576 2024-09-12T17:07:54.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.700+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~WC623XHDM7SD.2 size=842297 2024-09-12T17:07:54.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.702+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=WC623XHDM7SD tag=IKS6HB86BAGA type=write size=3988025 2024-09-12T17:07:54.705 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.703+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=3H6Y9CURYMX5 type=write size=127524 2024-09-12T17:07:54.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.704+0000 7f9eaebff780 1 < completed delete operation key=0F5LXJZMBFSP tag=82DS7S5OW602 type=del 2024-09-12T17:07:54.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.705+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=SZS73B94YMEZ type=write size=672598 2024-09-12T17:07:54.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.707+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~BBC2LMHC9GFC.0 size=1048576 2024-09-12T17:07:54.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.708+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~BBC2LMHC9GFC.1 size=1048576 2024-09-12T17:07:54.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.709+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~BBC2LMHC9GFC.2 size=806598 2024-09-12T17:07:54.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.711+0000 7f9eaebff780 1 < completed multipart upload key=YIEP2JYDSLW0 upload=BBC2LMHC9GFC tag=CD21J1I6FK5P type=write size=3952326 2024-09-12T17:07:54.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.712+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=N3WA9IQLMO8T type=del size=2733340 2024-09-12T17:07:54.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.713+0000 7f9eaebff780 1 < completed delete operation key=SHWT6AT7PN0M tag=CPG5VDGP4CPX type=del 2024-09-12T17:07:54.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.714+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=OTAQ7UL9RVLL type=del size=2756976 2024-09-12T17:07:54.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.715+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~PKEBMMT2QW3X.0 size=1048576 2024-09-12T17:07:54.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.716+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~PKEBMMT2QW3X.1 size=1048576 2024-09-12T17:07:54.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.717+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~PKEBMMT2QW3X.2 size=297985 2024-09-12T17:07:54.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.719+0000 7f9eaebff780 1 < completed multipart upload key=TDZCNUZE8IOA upload=PKEBMMT2QW3X tag=9VT005O4A2XY type=write size=3443713 2024-09-12T17:07:54.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.720+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=FPLW2VKG4WI4 type=write size=902044 2024-09-12T17:07:54.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.721+0000 7f9eaebff780 1 < completed delete operation key=GB8P7K59Y8VI tag=U1C164WDL1CB type=del 2024-09-12T17:07:54.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.724+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~WCGPENWIAHBZ.0 size=356013 2024-09-12T17:07:54.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.724+0000 7f9eaebff780 1 > prepared multipart upload key=3VY271ZBO754 upload=WCGPENWIAHBZ tag=TC19QX7V46G2 type=write size=1404589 2024-09-12T17:07:54.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.725+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~CPTP6RSOYF72.0 size=1048576 2024-09-12T17:07:54.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.726+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~CPTP6RSOYF72.1 size=1048576 2024-09-12T17:07:54.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.727+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~CPTP6RSOYF72.2 size=1010012 2024-09-12T17:07:54.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.729+0000 7f9eaebff780 1 < completed multipart upload key=LRI5G5G8O5X4 upload=CPTP6RSOYF72 tag=GPV6T8JYTXVG type=write size=4155740 2024-09-12T17:07:54.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.731+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~EY0F3PCMIT9A.0 size=1048576 2024-09-12T17:07:54.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.732+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~EY0F3PCMIT9A.1 size=124146 2024-09-12T17:07:54.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.732+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=EY0F3PCMIT9A tag=TWEYPYUAV2ZS type=write size=2221298 2024-09-12T17:07:54.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.733+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~IWQSE5MVKTLG.0 size=1048576 2024-09-12T17:07:54.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.734+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~IWQSE5MVKTLG.1 size=1048576 2024-09-12T17:07:54.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.735+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~IWQSE5MVKTLG.2 size=969419 2024-09-12T17:07:54.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.737+0000 7f9eaebff780 1 < completed multipart upload key=A1KRCFY18QTP upload=IWQSE5MVKTLG tag=FBX4FVOWCL6V type=write size=4115147 2024-09-12T17:07:54.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.739+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~XG099JX81G5F.0 size=1048576 2024-09-12T17:07:54.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.740+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~XG099JX81G5F.1 size=797909 2024-09-12T17:07:54.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.740+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=XG099JX81G5F tag=O8J3VKWJFXVM type=write size=2895061 2024-09-12T17:07:54.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.742+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~TBDH8067BQZX.0 size=1048576 2024-09-12T17:07:54.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.742+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~TBDH8067BQZX.1 size=619064 2024-09-12T17:07:54.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.744+0000 7f9eaebff780 1 < completed multipart upload key=M3PLQGSK34YM upload=TBDH8067BQZX tag=BKMKFXSSWIY6 type=write size=2716216 2024-09-12T17:07:54.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.747+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~V138I9IQ2UML.0 size=1048576 2024-09-12T17:07:54.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.747+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~V138I9IQ2UML.1 size=1048576 2024-09-12T17:07:54.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.748+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~V138I9IQ2UML.2 size=489927 2024-09-12T17:07:54.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.748+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=V138I9IQ2UML tag=L3849Y22GXMG type=write size=3635655 2024-09-12T17:07:54.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.750+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=KP0QAD19P0C0 type=del 2024-09-12T17:07:54.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.751+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=B9FOJDFUV66E type=del size=751926 2024-09-12T17:07:54.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.753+0000 7f9eaebff780 1 < suggested update operation key=YIEP2JYDSLW0 tag=3Z5VQZKDDVL5 type=del size=2977548 2024-09-12T17:07:54.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.755+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~424GY3URJY8W.0 size=465598 2024-09-12T17:07:54.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.755+0000 7f9eaebff780 1 > prepared multipart upload key=7PBT9VZ07OUI upload=424GY3URJY8W tag=7U14FN74IMII type=write size=1514174 2024-09-12T17:07:54.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.756+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=D4AI3Z7YAJRI type=del 2024-09-12T17:07:54.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.759+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~VN2E1HAI0OAD.0 size=1048576 2024-09-12T17:07:54.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.760+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~VN2E1HAI0OAD.1 size=152517 2024-09-12T17:07:54.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.760+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=VN2E1HAI0OAD tag=XQQ85L1HL5GY type=write size=2249669 2024-09-12T17:07:54.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.761+0000 7f9eaebff780 1 < canceled operation key=ZYP3P4031PUZ tag=V3V02UG1QSVC type=write size=1025551 2024-09-12T17:07:54.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.762+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=P3DBXY57ZJPD type=del size=2038046 2024-09-12T17:07:54.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.763+0000 7f9eaebff780 -1 < failed to complete operation key=YIEP2JYDSLW0 tag=MAM0IVL6YMIE type=del size=3378144: (22) Invalid argument 2024-09-12T17:07:54.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.765+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=MW70DZ3DG41Q type=del size=2131556 2024-09-12T17:07:54.767 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.766+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~S1PBAF4E3HGZ.0 size=1048576 2024-09-12T17:07:54.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.767+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~S1PBAF4E3HGZ.1 size=1048576 2024-09-12T17:07:54.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.768+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~S1PBAF4E3HGZ.2 size=84483 2024-09-12T17:07:54.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.770+0000 7f9eaebff780 1 < completed multipart upload key=SHWT6AT7PN0M upload=S1PBAF4E3HGZ tag=BPV0WKGPICG4 type=write size=3230211 2024-09-12T17:07:54.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.771+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=TGFDTJHVZ7BG type=del size=3878873 2024-09-12T17:07:54.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.772+0000 7f9eaebff780 1 < completed write operation key=ZC814TPVLJO1 tag=FIU4KMG6SSL8 type=write size=542732 2024-09-12T17:07:54.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.775+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~V09EJYNKCML3.0 size=1048576 2024-09-12T17:07:54.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.775+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~V09EJYNKCML3.1 size=1048576 2024-09-12T17:07:54.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.776+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~V09EJYNKCML3.2 size=309676 2024-09-12T17:07:54.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.776+0000 7f9eaebff780 1 > prepared multipart upload key=EKUW5AKC428U upload=V09EJYNKCML3 tag=F5P99CIHEPLX type=write size=3455404 2024-09-12T17:07:54.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.779+0000 7f9eaebff780 1 < suggested update operation key=M3PLQGSK34YM tag=3H6Y9CURYMX5 type=write size=127524 2024-09-12T17:07:54.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.780+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=XDJLPBJE0T2Y type=del size=4043813 2024-09-12T17:07:54.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.781+0000 7f9eaebff780 1 < completed write operation key=CAIZM33SDFPM tag=SZS73B94YMEZ type=write size=672598 2024-09-12T17:07:54.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.782+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=RQSRCOONCNTP type=del size=3544886 2024-09-12T17:07:54.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.784+0000 7f9eaebff780 -1 < failed to complete operation key=M3PLQGSK34YM tag=N3WA9IQLMO8T type=del size=2733340: (22) Invalid argument 2024-09-12T17:07:54.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.786+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~VI9SQE3ZQQK4.0 size=266244 2024-09-12T17:07:54.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.786+0000 7f9eaebff780 1 > prepared multipart upload key=YIEP2JYDSLW0 upload=VI9SQE3ZQQK4 tag=V2AOD3USJ3PI type=write size=1314820 2024-09-12T17:07:54.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.787+0000 7f9eaebff780 1 < completed delete operation key=LJN514F16XJA tag=OTAQ7UL9RVLL type=del 2024-09-12T17:07:54.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.788+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=LMRS8X6QZ2WQ type=del size=2761465 2024-09-12T17:07:54.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.790+0000 7f9eaebff780 1 < completed write operation key=OH6GXTMPBYUY tag=FPLW2VKG4WI4 type=write size=902044 2024-09-12T17:07:54.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.791+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=6XJH65F4B9BN type=del size=502658 2024-09-12T17:07:54.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.792+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~WCGPENWIAHBZ.0 size=356013 2024-09-12T17:07:54.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.794+0000 7f9eaebff780 1 < completed multipart upload key=3VY271ZBO754 upload=WCGPENWIAHBZ tag=TC19QX7V46G2 type=write size=1404589 2024-09-12T17:07:54.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.795+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=9BJJJQW5CCR3 type=del size=1733918 2024-09-12T17:07:54.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.796+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~EY0F3PCMIT9A.0 size=1048576 2024-09-12T17:07:54.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.797+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~EY0F3PCMIT9A.1 size=124146 2024-09-12T17:07:54.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.799+0000 7f9eaebff780 1 < completed multipart upload key=UYF1AN2W59VN upload=EY0F3PCMIT9A tag=TWEYPYUAV2ZS type=write size=2221298 2024-09-12T17:07:54.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.801+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=V92XRBAH35W6 type=del size=2624269 2024-09-12T17:07:54.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.802+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~XG099JX81G5F.0 size=1048576 2024-09-12T17:07:54.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.803+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~XG099JX81G5F.1 size=797909 2024-09-12T17:07:54.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.805+0000 7f9eaebff780 1 < completed multipart upload key=M3PLQGSK34YM upload=XG099JX81G5F tag=O8J3VKWJFXVM type=write size=2895061 2024-09-12T17:07:54.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.807+0000 7f9eaebff780 1 > prepared part key=_multipart_TXHXOMIB4B53.2~81H8494UM75Y.0 size=945182 2024-09-12T17:07:54.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.807+0000 7f9eaebff780 1 > prepared multipart upload key=TXHXOMIB4B53 upload=81H8494UM75Y tag=2AHUDAOZIPVW type=write size=1993758 2024-09-12T17:07:54.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.809+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~V138I9IQ2UML.0 size=1048576 2024-09-12T17:07:54.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.810+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~V138I9IQ2UML.1 size=1048576 2024-09-12T17:07:54.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.810+0000 7f9eaebff780 1 < canceled part key=_multipart_UYF1AN2W59VN.2~V138I9IQ2UML.2 size=489927 2024-09-12T17:07:54.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.812+0000 7f9eaebff780 1 < canceled multipart upload key=UYF1AN2W59VN upload=V138I9IQ2UML tag=L3849Y22GXMG type=write size=3635655 2024-09-12T17:07:54.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.813+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=E7L9FSKV5NRB type=del size=452602 2024-09-12T17:07:54.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.814+0000 7f9eaebff780 1 < canceled operation key=7PBT9VZ07OUI tag=B9FOJDFUV66E type=del size=751926 2024-09-12T17:07:54.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.815+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=ECR51YOBB0Y4 type=del size=2328482 2024-09-12T17:07:54.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.817+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~424GY3URJY8W.0 size=465598 2024-09-12T17:07:54.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.818+0000 7f9eaebff780 1 < completed multipart upload key=7PBT9VZ07OUI upload=424GY3URJY8W tag=7U14FN74IMII type=write size=1514174 2024-09-12T17:07:54.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.821+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~WY8GHE8T0X4W.0 size=1048576 2024-09-12T17:07:54.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.822+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~WY8GHE8T0X4W.1 size=1011783 2024-09-12T17:07:54.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.822+0000 7f9eaebff780 1 > prepared multipart upload key=KF8XE48DI9KZ upload=WY8GHE8T0X4W tag=SURK814D30JL type=write size=3108935 2024-09-12T17:07:54.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.823+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~VN2E1HAI0OAD.0 size=1048576 2024-09-12T17:07:54.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.824+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~VN2E1HAI0OAD.1 size=152517 2024-09-12T17:07:54.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.826+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=VN2E1HAI0OAD tag=XQQ85L1HL5GY type=write size=2249669 2024-09-12T17:07:54.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.827+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=2TD9UZA82KOE type=del size=3351636 2024-09-12T17:07:54.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.830+0000 7f9eaebff780 1 < suggested update operation key=LRI5G5G8O5X4 tag=P3DBXY57ZJPD type=del size=2038046 2024-09-12T17:07:54.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.832+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~5CKR7TRGBAP7.0 size=1048576 2024-09-12T17:07:54.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.832+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~5CKR7TRGBAP7.1 size=498687 2024-09-12T17:07:54.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.832+0000 7f9eaebff780 1 > prepared multipart upload key=7PBT9VZ07OUI upload=5CKR7TRGBAP7 tag=FDVIB4TOO52G type=write size=2595839 2024-09-12T17:07:54.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.834+0000 7f9eaebff780 1 < completed delete operation key=LJN514F16XJA tag=MW70DZ3DG41Q type=del 2024-09-12T17:07:54.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.835+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=MZ353L1F6WG5 type=del size=574796 2024-09-12T17:07:54.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.836+0000 7f9eaebff780 1 < completed delete operation key=9I6RGNRB6HSY tag=TGFDTJHVZ7BG type=del 2024-09-12T17:07:54.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.837+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=CZVSKOT1S777 type=del size=183551 2024-09-12T17:07:54.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.837+0000 7f9eaebff780 1 < canceled part key=_multipart_EKUW5AKC428U.2~V09EJYNKCML3.0 size=1048576 2024-09-12T17:07:54.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.838+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~V09EJYNKCML3.1 size=1048576 2024-09-12T17:07:54.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.839+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~V09EJYNKCML3.2 size=309676 2024-09-12T17:07:54.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.841+0000 7f9eaebff780 1 < canceled multipart upload key=EKUW5AKC428U upload=V09EJYNKCML3 tag=F5P99CIHEPLX type=write size=3455404 2024-09-12T17:07:54.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.843+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~LXFPXZSJQM11.0 size=320708 2024-09-12T17:07:54.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.843+0000 7f9eaebff780 1 > prepared multipart upload key=OGD6H9VSVGWF upload=LXFPXZSJQM11 tag=4ISUYTGJS2JD type=write size=1369284 2024-09-12T17:07:54.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.845+0000 7f9eaebff780 1 < suggested update operation key=A1KRCFY18QTP tag=XDJLPBJE0T2Y type=del size=4043813 2024-09-12T17:07:54.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.847+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=SRZRQNDY6MV7 type=del size=3653452 2024-09-12T17:07:54.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.849+0000 7f9eaebff780 1 < suggested update operation key=ZC814TPVLJO1 tag=RQSRCOONCNTP type=del size=3544886 2024-09-12T17:07:54.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.851+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~68FXWWCWWT0Z.0 size=581429 2024-09-12T17:07:54.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.851+0000 7f9eaebff780 1 > prepared multipart upload key=ZC814TPVLJO1 upload=68FXWWCWWT0Z tag=2CVYKJJUC8WI type=write size=1630005 2024-09-12T17:07:54.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.852+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~VI9SQE3ZQQK4.0 size=266244 2024-09-12T17:07:54.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.854+0000 7f9eaebff780 1 < completed multipart upload key=YIEP2JYDSLW0 upload=VI9SQE3ZQQK4 tag=V2AOD3USJ3PI type=write size=1314820 2024-09-12T17:07:54.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.855+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=IIQY8O2S9848 type=del size=3662370 2024-09-12T17:07:54.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.856+0000 7f9eaebff780 1 < completed delete operation key=K0P9ZZ91UJJ8 tag=LMRS8X6QZ2WQ type=del 2024-09-12T17:07:54.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.858+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~WLTBG0L7SN64.0 size=1048576 2024-09-12T17:07:54.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.859+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~WLTBG0L7SN64.1 size=60264 2024-09-12T17:07:54.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.859+0000 7f9eaebff780 1 > prepared multipart upload key=8DJLYFM11DNI upload=WLTBG0L7SN64 tag=4MNYJ7OCQCIN type=write size=2157416 2024-09-12T17:07:54.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.861+0000 7f9eaebff780 1 < canceled operation key=B1YC6DM9S8JJ tag=6XJH65F4B9BN type=del size=502658 2024-09-12T17:07:54.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.863+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~D1TYLGRAO9O1.0 size=1048576 2024-09-12T17:07:54.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.864+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~D1TYLGRAO9O1.1 size=1048576 2024-09-12T17:07:54.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.865+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~D1TYLGRAO9O1.2 size=803032 2024-09-12T17:07:54.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.865+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=D1TYLGRAO9O1 tag=0AL233BT7334 type=write size=3948760 2024-09-12T17:07:54.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.867+0000 7f9eaebff780 1 < suggested update operation key=SVWPQETL92QU tag=9BJJJQW5CCR3 type=del size=1733918 2024-09-12T17:07:54.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.870+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~0RVZNFR7S0H5.0 size=862125 2024-09-12T17:07:54.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.870+0000 7f9eaebff780 1 > prepared multipart upload key=YIEP2JYDSLW0 upload=0RVZNFR7S0H5 tag=1NNDNW1QCD2G type=write size=1910701 2024-09-12T17:07:54.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.871+0000 7f9eaebff780 1 < completed delete operation key=B1YC6DM9S8JJ tag=V92XRBAH35W6 type=del 2024-09-12T17:07:54.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.872+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=6KZ1COHMTV4R type=del size=529863 2024-09-12T17:07:54.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.872+0000 7f9eaebff780 1 < canceled part key=_multipart_TXHXOMIB4B53.2~81H8494UM75Y.0 size=945182 2024-09-12T17:07:54.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.874+0000 7f9eaebff780 1 < canceled multipart upload key=TXHXOMIB4B53 upload=81H8494UM75Y tag=2AHUDAOZIPVW type=write size=1993758 2024-09-12T17:07:54.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.876+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~CZ5684U3S3SQ.0 size=1048576 2024-09-12T17:07:54.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.877+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~CZ5684U3S3SQ.1 size=829125 2024-09-12T17:07:54.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.877+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=CZ5684U3S3SQ tag=Q2H23WZLX5M4 type=write size=2926277 2024-09-12T17:07:54.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.879+0000 7f9eaebff780 -1 < failed to complete operation key=SVWPQETL92QU tag=E7L9FSKV5NRB type=del size=452602: (22) Invalid argument 2024-09-12T17:07:54.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.880+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=Z80MZTIT4YMU type=del size=2403834 2024-09-12T17:07:54.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.881+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=ECR51YOBB0Y4 type=del 2024-09-12T17:07:54.884 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.882+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=4I8TYHSJGTTH type=del size=1768263 2024-09-12T17:07:54.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.883+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~WY8GHE8T0X4W.0 size=1048576 2024-09-12T17:07:54.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.884+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~WY8GHE8T0X4W.1 size=1011783 2024-09-12T17:07:54.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.886+0000 7f9eaebff780 1 < completed multipart upload key=KF8XE48DI9KZ upload=WY8GHE8T0X4W tag=SURK814D30JL type=write size=3108935 2024-09-12T17:07:54.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.887+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=1HEUXB3BQ4EQ type=del size=2719574 2024-09-12T17:07:54.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.889+0000 7f9eaebff780 1 < completed delete operation key=SHWT6AT7PN0M tag=2TD9UZA82KOE type=del 2024-09-12T17:07:54.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.890+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=UDNG3O898CF3 type=del size=3612358 2024-09-12T17:07:54.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.891+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~5CKR7TRGBAP7.0 size=1048576 2024-09-12T17:07:54.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.891+0000 7f9eaebff780 1 < canceled part key=_multipart_7PBT9VZ07OUI.2~5CKR7TRGBAP7.1 size=498687 2024-09-12T17:07:54.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.893+0000 7f9eaebff780 1 < canceled multipart upload key=7PBT9VZ07OUI upload=5CKR7TRGBAP7 tag=FDVIB4TOO52G type=write size=2595839 2024-09-12T17:07:54.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.895+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=C2LF4ZCO9Z1Q type=del size=3357101 2024-09-12T17:07:54.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.896+0000 7f9eaebff780 1 < completed delete operation key=TDZCNUZE8IOA tag=MZ353L1F6WG5 type=del 2024-09-12T17:07:54.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.897+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=XZQRXACF7R20 type=del size=2554076 2024-09-12T17:07:54.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.899+0000 7f9eaebff780 1 < completed delete operation key=OH6GXTMPBYUY tag=CZVSKOT1S777 type=del 2024-09-12T17:07:54.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.900+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=487UDW8H1VPL type=del size=5295 2024-09-12T17:07:54.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.901+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~LXFPXZSJQM11.0 size=320708 2024-09-12T17:07:54.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.903+0000 7f9eaebff780 1 < completed multipart upload key=OGD6H9VSVGWF upload=LXFPXZSJQM11 tag=4ISUYTGJS2JD type=write size=1369284 2024-09-12T17:07:54.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.904+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=1JCA8TJX2MKD type=del size=470922 2024-09-12T17:07:54.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.906+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=SRZRQNDY6MV7 type=del 2024-09-12T17:07:54.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.907+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=YN7ZAU2SK7IH type=write size=304798 2024-09-12T17:07:54.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.908+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~68FXWWCWWT0Z.0 size=581429 2024-09-12T17:07:54.911 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.910+0000 7f9eaebff780 1 < completed multipart upload key=ZC814TPVLJO1 upload=68FXWWCWWT0Z tag=2CVYKJJUC8WI type=write size=1630005 2024-09-12T17:07:54.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.911+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=6R8PUD17B3EV type=del size=3221532 2024-09-12T17:07:54.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.913+0000 7f9eaebff780 1 < completed delete operation key=8DJLYFM11DNI tag=IIQY8O2S9848 type=del 2024-09-12T17:07:54.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.914+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=K02DYF7XKSIL type=del size=3066788 2024-09-12T17:07:54.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.915+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~WLTBG0L7SN64.0 size=1048576 2024-09-12T17:07:54.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.916+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~WLTBG0L7SN64.1 size=60264 2024-09-12T17:07:54.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.918+0000 7f9eaebff780 1 < completed multipart upload key=8DJLYFM11DNI upload=WLTBG0L7SN64 tag=4MNYJ7OCQCIN type=write size=2157416 2024-09-12T17:07:54.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.919+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=XNOZ7NTLW3TS type=del size=620476 2024-09-12T17:07:54.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.922+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~D1TYLGRAO9O1.0 size=1048576 2024-09-12T17:07:54.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.925+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~D1TYLGRAO9O1.1 size=1048576 2024-09-12T17:07:54.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.927+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~D1TYLGRAO9O1.2 size=803032 2024-09-12T17:07:54.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.930+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=D1TYLGRAO9O1 tag=0AL233BT7334 type=write size=3948760 2024-09-12T17:07:54.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.931+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=P1MWYCMYT5HQ type=del size=3475769 2024-09-12T17:07:54.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.932+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~0RVZNFR7S0H5.0 size=862125 2024-09-12T17:07:54.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.934+0000 7f9eaebff780 1 < completed multipart upload key=YIEP2JYDSLW0 upload=0RVZNFR7S0H5 tag=1NNDNW1QCD2G type=write size=1910701 2024-09-12T17:07:54.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.936+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=LS1ZVLTSVISO type=del size=4153494 2024-09-12T17:07:54.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.937+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=6KZ1COHMTV4R type=del 2024-09-12T17:07:54.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.938+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=BWGI2L2SLLV9 type=write size=115393 2024-09-12T17:07:54.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.939+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~CZ5684U3S3SQ.0 size=1048576 2024-09-12T17:07:54.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.940+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~CZ5684U3S3SQ.1 size=829125 2024-09-12T17:07:54.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.942+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=CZ5684U3S3SQ tag=Q2H23WZLX5M4 type=write size=2926277 2024-09-12T17:07:54.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.945+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~80E6C2X2ZC7N.0 size=37801 2024-09-12T17:07:54.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.945+0000 7f9eaebff780 1 > prepared multipart upload key=ZC814TPVLJO1 upload=80E6C2X2ZC7N tag=L16FYQ8PEVFG type=write size=1086377 2024-09-12T17:07:54.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.946+0000 7f9eaebff780 1 < completed delete operation key=LJN514F16XJA tag=Z80MZTIT4YMU type=del 2024-09-12T17:07:54.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.947+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=56EHYVOTCQP9 type=write size=684504 2024-09-12T17:07:54.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.948+0000 7f9eaebff780 1 < completed delete operation key=8DJLYFM11DNI tag=4I8TYHSJGTTH type=del 2024-09-12T17:07:54.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.949+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=GJTIY3OMGOX6 type=del size=1670189 2024-09-12T17:07:54.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.951+0000 7f9eaebff780 1 < completed delete operation key=LRI5G5G8O5X4 tag=1HEUXB3BQ4EQ type=del 2024-09-12T17:07:54.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.953+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~Y20EM7UG8Q63.0 size=1048576 2024-09-12T17:07:54.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.954+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~Y20EM7UG8Q63.1 size=1048576 2024-09-12T17:07:54.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.954+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~Y20EM7UG8Q63.2 size=99003 2024-09-12T17:07:54.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.954+0000 7f9eaebff780 1 > prepared multipart upload key=OGD6H9VSVGWF upload=Y20EM7UG8Q63 tag=Y96H8700P1DD type=write size=3244731 2024-09-12T17:07:54.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.956+0000 7f9eaebff780 1 < completed delete operation key=7PBT9VZ07OUI tag=UDNG3O898CF3 type=del 2024-09-12T17:07:54.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.958+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~FF8MIC6GNQ1S.0 size=681108 2024-09-12T17:07:54.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.958+0000 7f9eaebff780 1 > prepared multipart upload key=7PBT9VZ07OUI upload=FF8MIC6GNQ1S tag=G1OWNZ3D9CXZ type=write size=1729684 2024-09-12T17:07:54.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.959+0000 7f9eaebff780 1 < completed delete operation key=SO6QF2JCRX6E tag=C2LF4ZCO9Z1Q type=del 2024-09-12T17:07:54.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.960+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=ZILXKIVKJ5DC type=del size=1672411 2024-09-12T17:07:54.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.961+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=XZQRXACF7R20 type=del 2024-09-12T17:07:54.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.962+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=Z7XSEAUGDP7W type=del size=959780 2024-09-12T17:07:54.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.964+0000 7f9eaebff780 1 < completed delete operation key=7PBT9VZ07OUI tag=487UDW8H1VPL type=del 2024-09-12T17:07:54.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.966+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~ULMGVB20U1GZ.0 size=1048576 2024-09-12T17:07:54.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.967+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~ULMGVB20U1GZ.1 size=1048576 2024-09-12T17:07:54.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.967+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~ULMGVB20U1GZ.2 size=98067 2024-09-12T17:07:54.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.967+0000 7f9eaebff780 1 > prepared multipart upload key=TDZCNUZE8IOA upload=ULMGVB20U1GZ tag=FQQIE2UYE6DP type=write size=3243795 2024-09-12T17:07:54.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.969+0000 7f9eaebff780 1 < completed delete operation key=OH6GXTMPBYUY tag=1JCA8TJX2MKD type=del 2024-09-12T17:07:54.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.971+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~X4S4NRU9F5OC.0 size=602261 2024-09-12T17:07:54.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.971+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=X4S4NRU9F5OC tag=1KSIJC82GP9K type=write size=1650837 2024-09-12T17:07:54.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.973+0000 7f9eaebff780 1 < suggested update operation key=SO6QF2JCRX6E tag=YN7ZAU2SK7IH type=write size=304798 2024-09-12T17:07:54.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.975+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~PBOIG2RTTCWD.0 size=1048576 2024-09-12T17:07:54.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.976+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~PBOIG2RTTCWD.1 size=1048576 2024-09-12T17:07:54.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.977+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~PBOIG2RTTCWD.2 size=400045 2024-09-12T17:07:54.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.977+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=PBOIG2RTTCWD tag=VEQURN8COAPL type=write size=3545773 2024-09-12T17:07:54.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.978+0000 7f9eaebff780 1 < completed delete operation key=ZYP3P4031PUZ tag=6R8PUD17B3EV type=del 2024-09-12T17:07:54.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.980+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~E65WD11LMOXV.0 size=1048576 2024-09-12T17:07:54.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.981+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~E65WD11LMOXV.1 size=1048576 2024-09-12T17:07:54.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.982+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~E65WD11LMOXV.2 size=439180 2024-09-12T17:07:54.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.982+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=E65WD11LMOXV tag=SEOZQ3BPGQOF type=write size=3584908 2024-09-12T17:07:54.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.983+0000 7f9eaebff780 1 < canceled operation key=OH6GXTMPBYUY tag=K02DYF7XKSIL type=del size=3066788 2024-09-12T17:07:54.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.984+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=07EAQW9D4Y5X type=del size=2289751 2024-09-12T17:07:54.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.985+0000 7f9eaebff780 1 < completed delete operation key=K2NHRSUDQBRW tag=XNOZ7NTLW3TS type=del 2024-09-12T17:07:54.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.986+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=VBM6QH3F5FWW type=del size=2522043 2024-09-12T17:07:54.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.988+0000 7f9eaebff780 1 < completed delete operation key=OGD6H9VSVGWF tag=P1MWYCMYT5HQ type=del 2024-09-12T17:07:54.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.989+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=EH6Q9NOLSEGG type=del size=1896973 2024-09-12T17:07:54.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.990+0000 7f9eaebff780 1 < completed delete operation key=ZC814TPVLJO1 tag=LS1ZVLTSVISO type=del 2024-09-12T17:07:54.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.992+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~5H5GQN3H5W4T.0 size=1048576 2024-09-12T17:07:54.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.993+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~5H5GQN3H5W4T.1 size=1048576 2024-09-12T17:07:54.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.994+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~5H5GQN3H5W4T.2 size=294109 2024-09-12T17:07:54.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.994+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=5H5GQN3H5W4T tag=4VPXBPS9V2CM type=write size=3439837 2024-09-12T17:07:54.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.995+0000 7f9eaebff780 1 < completed write operation key=OGD6H9VSVGWF tag=BWGI2L2SLLV9 type=write size=115393 2024-09-12T17:07:54.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.996+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=AM9VR0OBDT87 type=del size=682146 2024-09-12T17:07:54.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.997+0000 7f9eaebff780 1 < canceled part key=_multipart_ZC814TPVLJO1.2~80E6C2X2ZC7N.0 size=37801 2024-09-12T17:07:55.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:54.998+0000 7f9eaebff780 1 < canceled multipart upload key=ZC814TPVLJO1 upload=80E6C2X2ZC7N tag=L16FYQ8PEVFG type=write size=1086377 2024-09-12T17:07:55.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.000+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=5U0IGG160T9C type=del size=3075487 2024-09-12T17:07:55.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.001+0000 7f9eaebff780 1 < completed write operation key=LRI5G5G8O5X4 tag=56EHYVOTCQP9 type=write size=684504 2024-09-12T17:07:55.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.003+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~5V9I8S14DQL2.0 size=1048576 2024-09-12T17:07:55.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.004+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~5V9I8S14DQL2.1 size=1048576 2024-09-12T17:07:55.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.005+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~5V9I8S14DQL2.2 size=1017647 2024-09-12T17:07:55.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.005+0000 7f9eaebff780 1 > prepared multipart upload key=OGD6H9VSVGWF upload=5V9I8S14DQL2 tag=R6WHM6RPY4Y1 type=write size=4163375 2024-09-12T17:07:55.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.006+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=GJTIY3OMGOX6 type=del 2024-09-12T17:07:55.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.007+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=SKHYWRM225OL type=del size=710190 2024-09-12T17:07:55.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.009+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~Y20EM7UG8Q63.0 size=1048576 2024-09-12T17:07:55.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.010+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~Y20EM7UG8Q63.1 size=1048576 2024-09-12T17:07:55.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.011+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~Y20EM7UG8Q63.2 size=99003 2024-09-12T17:07:55.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.013+0000 7f9eaebff780 1 < completed multipart upload key=OGD6H9VSVGWF upload=Y20EM7UG8Q63 tag=Y96H8700P1DD type=write size=3244731 2024-09-12T17:07:55.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.014+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=PF2FVI4ODC01 type=del size=1212522 2024-09-12T17:07:55.017 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.015+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~FF8MIC6GNQ1S.0 size=681108 2024-09-12T17:07:55.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.017+0000 7f9eaebff780 1 < completed multipart upload key=7PBT9VZ07OUI upload=FF8MIC6GNQ1S tag=G1OWNZ3D9CXZ type=write size=1729684 2024-09-12T17:07:55.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.019+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~J2XC43H6CFP7.0 size=1048576 2024-09-12T17:07:55.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.020+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~J2XC43H6CFP7.1 size=1048576 2024-09-12T17:07:55.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.021+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~J2XC43H6CFP7.2 size=197167 2024-09-12T17:07:55.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.021+0000 7f9eaebff780 1 > prepared multipart upload key=LRI5G5G8O5X4 upload=J2XC43H6CFP7 tag=UEOHMY0WJATZ type=write size=3342895 2024-09-12T17:07:55.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.024+0000 7f9eaebff780 1 < suggested update operation key=OGD6H9VSVGWF tag=ZILXKIVKJ5DC type=del size=1672411 2024-09-12T17:07:55.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.026+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~JOFNR6I212LK.0 size=1048576 2024-09-12T17:07:55.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.027+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~JOFNR6I212LK.1 size=989826 2024-09-12T17:07:55.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.027+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=JOFNR6I212LK tag=W3RWG0PM9F54 type=write size=3086978 2024-09-12T17:07:55.030 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.028+0000 7f9eaebff780 1 < completed delete operation key=0YD5P1ACZ09Q tag=Z7XSEAUGDP7W type=del 2024-09-12T17:07:55.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.029+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=7KCRUGIJE04S type=del size=4013802 2024-09-12T17:07:55.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.030+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~ULMGVB20U1GZ.0 size=1048576 2024-09-12T17:07:55.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.031+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~ULMGVB20U1GZ.1 size=1048576 2024-09-12T17:07:55.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.032+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~ULMGVB20U1GZ.2 size=98067 2024-09-12T17:07:55.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.036+0000 7f9eaebff780 1 < completed multipart upload key=TDZCNUZE8IOA upload=ULMGVB20U1GZ tag=FQQIE2UYE6DP type=write size=3243795 2024-09-12T17:07:55.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.041+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~8QMSJJQKFTG1.0 size=598945 2024-09-12T17:07:55.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.041+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=8QMSJJQKFTG1 tag=HBCEKGFVDOAF type=write size=1647521 2024-09-12T17:07:55.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.042+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~X4S4NRU9F5OC.0 size=602261 2024-09-12T17:07:55.046 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.044+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=X4S4NRU9F5OC tag=1KSIJC82GP9K type=write size=1650837 2024-09-12T17:07:55.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.046+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~NGC7VJA2I9IK.0 size=1048576 2024-09-12T17:07:55.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.047+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~NGC7VJA2I9IK.1 size=804456 2024-09-12T17:07:55.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.047+0000 7f9eaebff780 1 > prepared multipart upload key=KF8XE48DI9KZ upload=NGC7VJA2I9IK tag=4ADLBARPD49X type=write size=2901608 2024-09-12T17:07:55.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.050+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~PBOIG2RTTCWD.0 size=1048576 2024-09-12T17:07:55.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.051+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~PBOIG2RTTCWD.1 size=1048576 2024-09-12T17:07:55.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.052+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~PBOIG2RTTCWD.2 size=400045 2024-09-12T17:07:55.056 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.054+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=PBOIG2RTTCWD tag=VEQURN8COAPL type=write size=3545773 2024-09-12T17:07:55.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.056+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~A4546QJAPQ0O.0 size=1048576 2024-09-12T17:07:55.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.057+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~A4546QJAPQ0O.1 size=1048576 2024-09-12T17:07:55.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.058+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~A4546QJAPQ0O.2 size=675908 2024-09-12T17:07:55.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.058+0000 7f9eaebff780 1 > prepared multipart upload key=9I6RGNRB6HSY upload=A4546QJAPQ0O tag=SY0MEKZXOBE9 type=write size=3821636 2024-09-12T17:07:55.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.059+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~E65WD11LMOXV.0 size=1048576 2024-09-12T17:07:55.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.060+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~E65WD11LMOXV.1 size=1048576 2024-09-12T17:07:55.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.061+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~E65WD11LMOXV.2 size=439180 2024-09-12T17:07:55.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.063+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=E65WD11LMOXV tag=SEOZQ3BPGQOF type=write size=3584908 2024-09-12T17:07:55.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.065+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~99MG3VB3ABGW.0 size=488986 2024-09-12T17:07:55.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.065+0000 7f9eaebff780 1 > prepared multipart upload key=3VY271ZBO754 upload=99MG3VB3ABGW tag=MJGETZKK898P type=write size=1537562 2024-09-12T17:07:55.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.068+0000 7f9eaebff780 1 < suggested update operation key=9I6RGNRB6HSY tag=07EAQW9D4Y5X type=del size=2289751 2024-09-12T17:07:55.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.069+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=6I0AO4BCMMR1 type=del size=2932399 2024-09-12T17:07:55.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.070+0000 7f9eaebff780 1 < completed delete operation key=UYF1AN2W59VN tag=VBM6QH3F5FWW type=del 2024-09-12T17:07:55.073 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.071+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=LFSAV1G8UYY2 type=del size=2172099 2024-09-12T17:07:55.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.072+0000 7f9eaebff780 1 < completed delete operation key=P9GMGM3WK6O7 tag=EH6Q9NOLSEGG type=del 2024-09-12T17:07:55.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.074+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=DOHSPA3TQ97Q type=del size=2904909 2024-09-12T17:07:55.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.075+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~5H5GQN3H5W4T.0 size=1048576 2024-09-12T17:07:55.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.076+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~5H5GQN3H5W4T.1 size=1048576 2024-09-12T17:07:55.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.077+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~5H5GQN3H5W4T.2 size=294109 2024-09-12T17:07:55.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.079+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=5H5GQN3H5W4T tag=4VPXBPS9V2CM type=write size=3439837 2024-09-12T17:07:55.083 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.081+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~5LL38CKT5CKN.0 size=631703 2024-09-12T17:07:55.083 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.081+0000 7f9eaebff780 1 > prepared multipart upload key=QIMNK4DL3D0N upload=5LL38CKT5CKN tag=8LUQHS8R16UT type=write size=1680279 2024-09-12T17:07:55.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.083+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=AM9VR0OBDT87 type=del 2024-09-12T17:07:55.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.084+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=F7I5ES4BU8F8 type=del size=3138357 2024-09-12T17:07:55.088 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.086+0000 7f9eaebff780 1 < suggested update operation key=0YD5P1ACZ09Q tag=5U0IGG160T9C type=del size=3075487 2024-09-12T17:07:55.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.088+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~4MEJ2O5JX6XU.0 size=511507 2024-09-12T17:07:55.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.088+0000 7f9eaebff780 1 > prepared multipart upload key=ZC814TPVLJO1 upload=4MEJ2O5JX6XU tag=AJU4L0T45Y95 type=write size=1560083 2024-09-12T17:07:55.091 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.089+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~5V9I8S14DQL2.0 size=1048576 2024-09-12T17:07:55.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.090+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~5V9I8S14DQL2.1 size=1048576 2024-09-12T17:07:55.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.091+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~5V9I8S14DQL2.2 size=1017647 2024-09-12T17:07:55.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.093+0000 7f9eaebff780 1 < completed multipart upload key=OGD6H9VSVGWF upload=5V9I8S14DQL2 tag=R6WHM6RPY4Y1 type=write size=4163375 2024-09-12T17:07:55.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.094+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=XFJUJWDZM97Y type=del size=718732 2024-09-12T17:07:55.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.096+0000 7f9eaebff780 1 < completed delete operation key=9WJGBODZ60NJ tag=SKHYWRM225OL type=del 2024-09-12T17:07:55.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.097+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=7L0N0TZ3H8RZ type=del size=1120087 2024-09-12T17:07:55.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.098+0000 7f9eaebff780 1 < completed delete operation key=ZC814TPVLJO1 tag=PF2FVI4ODC01 type=del 2024-09-12T17:07:55.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.100+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~A06NJ99P1X4S.0 size=1048576 2024-09-12T17:07:55.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.101+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~A06NJ99P1X4S.1 size=383004 2024-09-12T17:07:55.103 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.101+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=A06NJ99P1X4S tag=TQPE4GFU82CB type=write size=2480156 2024-09-12T17:07:55.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.102+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~J2XC43H6CFP7.0 size=1048576 2024-09-12T17:07:55.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.103+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~J2XC43H6CFP7.1 size=1048576 2024-09-12T17:07:55.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.104+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~J2XC43H6CFP7.2 size=197167 2024-09-12T17:07:55.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.106+0000 7f9eaebff780 1 < completed multipart upload key=LRI5G5G8O5X4 upload=J2XC43H6CFP7 tag=UEOHMY0WJATZ type=write size=3342895 2024-09-12T17:07:55.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.108+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=EEFC94TCZ2SH type=del size=1004453 2024-09-12T17:07:55.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.108+0000 7f9eaebff780 1 < canceled part key=_multipart_SVWPQETL92QU.2~JOFNR6I212LK.0 size=1048576 2024-09-12T17:07:55.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.109+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~JOFNR6I212LK.1 size=989826 2024-09-12T17:07:55.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.111+0000 7f9eaebff780 1 < canceled multipart upload key=SVWPQETL92QU upload=JOFNR6I212LK tag=W3RWG0PM9F54 type=write size=3086978 2024-09-12T17:07:55.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.112+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=1P0YBY92FKIE type=del size=1234368 2024-09-12T17:07:55.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.114+0000 7f9eaebff780 1 < completed delete operation key=K0P9ZZ91UJJ8 tag=7KCRUGIJE04S type=del 2024-09-12T17:07:55.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.116+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~3P676UDD56PU.0 size=1048576 2024-09-12T17:07:55.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.117+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~3P676UDD56PU.1 size=55790 2024-09-12T17:07:55.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.117+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=3P676UDD56PU tag=OQN5Q16RUOO0 type=write size=2152942 2024-09-12T17:07:55.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.118+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~8QMSJJQKFTG1.0 size=598945 2024-09-12T17:07:55.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.120+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=8QMSJJQKFTG1 tag=HBCEKGFVDOAF type=write size=1647521 2024-09-12T17:07:55.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.122+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~RWPU3J8W1IQI.0 size=1048576 2024-09-12T17:07:55.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.123+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~RWPU3J8W1IQI.1 size=177646 2024-09-12T17:07:55.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.123+0000 7f9eaebff780 1 > prepared multipart upload key=0F5LXJZMBFSP upload=RWPU3J8W1IQI tag=Z43BSH2370JZ type=write size=2274798 2024-09-12T17:07:55.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.125+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~NGC7VJA2I9IK.0 size=1048576 2024-09-12T17:07:55.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.126+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~NGC7VJA2I9IK.1 size=804456 2024-09-12T17:07:55.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.128+0000 7f9eaebff780 1 < completed multipart upload key=KF8XE48DI9KZ upload=NGC7VJA2I9IK tag=4ADLBARPD49X type=write size=2901608 2024-09-12T17:07:55.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.129+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=A0JL3XEELRMN type=del size=2708637 2024-09-12T17:07:55.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.130+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~A4546QJAPQ0O.0 size=1048576 2024-09-12T17:07:55.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.131+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~A4546QJAPQ0O.1 size=1048576 2024-09-12T17:07:55.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.132+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~A4546QJAPQ0O.2 size=675908 2024-09-12T17:07:55.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.134+0000 7f9eaebff780 1 < completed multipart upload key=9I6RGNRB6HSY upload=A4546QJAPQ0O tag=SY0MEKZXOBE9 type=write size=3821636 2024-09-12T17:07:55.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.136+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~IUXKVAS3P7YY.0 size=1048576 2024-09-12T17:07:55.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.137+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~IUXKVAS3P7YY.1 size=850738 2024-09-12T17:07:55.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.137+0000 7f9eaebff780 1 > prepared multipart upload key=0YD5P1ACZ09Q upload=IUXKVAS3P7YY tag=16SEG3A54NWT type=write size=2947890 2024-09-12T17:07:55.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.138+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~99MG3VB3ABGW.0 size=488986 2024-09-12T17:07:55.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.140+0000 7f9eaebff780 1 < completed multipart upload key=3VY271ZBO754 upload=99MG3VB3ABGW tag=MJGETZKK898P type=write size=1537562 2024-09-12T17:07:55.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.141+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=PI14RLSQTA1R type=del size=847476 2024-09-12T17:07:55.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.143+0000 7f9eaebff780 1 < suggested remove operation key=K0P9ZZ91UJJ8 tag=6I0AO4BCMMR1 type=del 2024-09-12T17:07:55.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.145+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=QBEEMUJ9AVS6 type=del size=1781948 2024-09-12T17:07:55.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.146+0000 7f9eaebff780 1 < completed delete operation key=P9GMGM3WK6O7 tag=LFSAV1G8UYY2 type=del 2024-09-12T17:07:55.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.147+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=Q4JX3HR94IFQ type=del size=2863247 2024-09-12T17:07:55.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.148+0000 7f9eaebff780 1 < completed delete operation key=M3PLQGSK34YM tag=DOHSPA3TQ97Q type=del 2024-09-12T17:07:55.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.152+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=ORJIMB10NCWF type=del size=2878008 2024-09-12T17:07:55.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.153+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~5LL38CKT5CKN.0 size=631703 2024-09-12T17:07:55.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.155+0000 7f9eaebff780 1 < completed multipart upload key=QIMNK4DL3D0N upload=5LL38CKT5CKN tag=8LUQHS8R16UT type=write size=1680279 2024-09-12T17:07:55.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.156+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=VMWO38BXXJ5W type=del size=1572692 2024-09-12T17:07:55.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.157+0000 7f9eaebff780 1 < completed delete operation key=9I6RGNRB6HSY tag=F7I5ES4BU8F8 type=del 2024-09-12T17:07:55.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.158+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=29OVSYUL9CT5 type=del size=3000591 2024-09-12T17:07:55.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.159+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~4MEJ2O5JX6XU.0 size=511507 2024-09-12T17:07:55.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.161+0000 7f9eaebff780 1 < completed multipart upload key=ZC814TPVLJO1 upload=4MEJ2O5JX6XU tag=AJU4L0T45Y95 type=write size=1560083 2024-09-12T17:07:55.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.163+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=8AYL8AJ3NL00 type=del size=248004 2024-09-12T17:07:55.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.164+0000 7f9eaebff780 1 < completed delete operation key=9I6RGNRB6HSY tag=XFJUJWDZM97Y type=del 2024-09-12T17:07:55.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.165+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=WLDX4HY1GE7X type=write size=347703 2024-09-12T17:07:55.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.166+0000 7f9eaebff780 1 < completed delete operation key=LRI5G5G8O5X4 tag=7L0N0TZ3H8RZ type=del 2024-09-12T17:07:55.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.168+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~KH7ZK3IZW2XP.0 size=1048576 2024-09-12T17:07:55.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.169+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~KH7ZK3IZW2XP.1 size=1048576 2024-09-12T17:07:55.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.170+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~KH7ZK3IZW2XP.2 size=540628 2024-09-12T17:07:55.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.170+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=KH7ZK3IZW2XP tag=95EE1F7GNUXB type=write size=3686356 2024-09-12T17:07:55.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.171+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~A06NJ99P1X4S.0 size=1048576 2024-09-12T17:07:55.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.172+0000 7f9eaebff780 1 < completed part key=_multipart_SHWT6AT7PN0M.2~A06NJ99P1X4S.1 size=383004 2024-09-12T17:07:55.176 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.174+0000 7f9eaebff780 1 < completed multipart upload key=SHWT6AT7PN0M upload=A06NJ99P1X4S tag=TQPE4GFU82CB type=write size=2480156 2024-09-12T17:07:55.177 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.175+0000 7f9eaebff780 1 > prepared operation key=9WJGBODZ60NJ tag=ABE4SPHZVFYG type=del size=1565741 2024-09-12T17:07:55.178 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.177+0000 7f9eaebff780 1 < completed delete operation key=3VY271ZBO754 tag=EEFC94TCZ2SH type=del 2024-09-12T17:07:55.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.178+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=35BAYO9YY1IB type=del size=139991 2024-09-12T17:07:55.181 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.179+0000 7f9eaebff780 1 < completed delete operation key=SVWPQETL92QU tag=1P0YBY92FKIE type=del 2024-09-12T17:07:55.182 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.180+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=6P2U6V1TW6BE type=del size=1010142 2024-09-12T17:07:55.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.181+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~3P676UDD56PU.0 size=1048576 2024-09-12T17:07:55.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.182+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~3P676UDD56PU.1 size=55790 2024-09-12T17:07:55.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.185+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=3P676UDD56PU tag=OQN5Q16RUOO0 type=write size=2152942 2024-09-12T17:07:55.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.186+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=QNEVJJTSDQI1 type=del size=2157227 2024-09-12T17:07:55.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.187+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~RWPU3J8W1IQI.0 size=1048576 2024-09-12T17:07:55.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.188+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~RWPU3J8W1IQI.1 size=177646 2024-09-12T17:07:55.192 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.190+0000 7f9eaebff780 1 < completed multipart upload key=0F5LXJZMBFSP upload=RWPU3J8W1IQI tag=Z43BSH2370JZ type=write size=2274798 2024-09-12T17:07:55.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.192+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=72F3ZCT71D3N type=del size=3087571 2024-09-12T17:07:55.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.193+0000 7f9eaebff780 1 < canceled operation key=LJN514F16XJA tag=A0JL3XEELRMN type=del size=2708637 2024-09-12T17:07:55.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.194+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=ET5R32N4WBRZ type=del size=184532 2024-09-12T17:07:55.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.195+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~IUXKVAS3P7YY.0 size=1048576 2024-09-12T17:07:55.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.196+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~IUXKVAS3P7YY.1 size=850738 2024-09-12T17:07:55.200 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.199+0000 7f9eaebff780 1 < completed multipart upload key=0YD5P1ACZ09Q upload=IUXKVAS3P7YY tag=16SEG3A54NWT type=write size=2947890 2024-09-12T17:07:55.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.200+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=RY4OM0RI11EZ type=write size=398564 2024-09-12T17:07:55.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.201+0000 7f9eaebff780 1 < completed delete operation key=ZC814TPVLJO1 tag=PI14RLSQTA1R type=del 2024-09-12T17:07:55.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.203+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=I5FT3CGA9YU1 type=del size=3826151 2024-09-12T17:07:55.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.204+0000 7f9eaebff780 1 < completed delete operation key=OGD6H9VSVGWF tag=QBEEMUJ9AVS6 type=del 2024-09-12T17:07:55.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.205+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=A84G0RSGBSVF type=del size=2281869 2024-09-12T17:07:55.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.206+0000 7f9eaebff780 1 < completed delete operation key=K0P9ZZ91UJJ8 tag=Q4JX3HR94IFQ type=del 2024-09-12T17:07:55.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.208+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=1KYYT3LXRDX4 type=del size=1158088 2024-09-12T17:07:55.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.209+0000 7f9eaebff780 1 < completed delete operation key=OGD6H9VSVGWF tag=ORJIMB10NCWF type=del 2024-09-12T17:07:55.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.211+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~BPO8IP3A5FO3.0 size=1048576 2024-09-12T17:07:55.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.212+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~BPO8IP3A5FO3.1 size=1048576 2024-09-12T17:07:55.214 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.213+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~BPO8IP3A5FO3.2 size=503981 2024-09-12T17:07:55.214 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.213+0000 7f9eaebff780 1 > prepared multipart upload key=ZC814TPVLJO1 upload=BPO8IP3A5FO3 tag=X70Q7KTPKVRH type=write size=3649709 2024-09-12T17:07:55.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.215+0000 7f9eaebff780 1 < suggested update operation key=LRI5G5G8O5X4 tag=VMWO38BXXJ5W type=del size=1572692 2024-09-12T17:07:55.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.216+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=XC46RFVYO0GY type=del size=741440 2024-09-12T17:07:55.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.218+0000 7f9eaebff780 1 < suggested remove operation key=SVWPQETL92QU tag=29OVSYUL9CT5 type=del 2024-09-12T17:07:55.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.220+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=WZKKFZEZE0LQ type=del size=2832532 2024-09-12T17:07:55.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.221+0000 7f9eaebff780 1 < canceled operation key=ZC814TPVLJO1 tag=8AYL8AJ3NL00 type=del size=248004 2024-09-12T17:07:55.224 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.223+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~ZQEBXLYIL4B6.0 size=1048576 2024-09-12T17:07:55.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.224+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~ZQEBXLYIL4B6.1 size=871904 2024-09-12T17:07:55.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.224+0000 7f9eaebff780 1 > prepared multipart upload key=0F5LXJZMBFSP upload=ZQEBXLYIL4B6 tag=981F4XW1UQFO type=write size=2969056 2024-09-12T17:07:55.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.225+0000 7f9eaebff780 1 < canceled operation key=P9GMGM3WK6O7 tag=WLDX4HY1GE7X type=write size=347703 2024-09-12T17:07:55.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.227+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~BBXE3FHZJ9HA.0 size=1048576 2024-09-12T17:07:55.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.228+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~BBXE3FHZJ9HA.1 size=639483 2024-09-12T17:07:55.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.228+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=BBXE3FHZJ9HA tag=XWNQ3T278B1O type=write size=2736635 2024-09-12T17:07:55.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.230+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~KH7ZK3IZW2XP.0 size=1048576 2024-09-12T17:07:55.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.231+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~KH7ZK3IZW2XP.1 size=1048576 2024-09-12T17:07:55.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.232+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~KH7ZK3IZW2XP.2 size=540628 2024-09-12T17:07:55.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.234+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=KH7ZK3IZW2XP tag=95EE1F7GNUXB type=write size=3686356 2024-09-12T17:07:55.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.236+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~64TETKQZLGU4.0 size=1048576 2024-09-12T17:07:55.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.237+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~64TETKQZLGU4.1 size=1048576 2024-09-12T17:07:55.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.238+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~64TETKQZLGU4.2 size=812999 2024-09-12T17:07:55.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.238+0000 7f9eaebff780 1 > prepared multipart upload key=0F5LXJZMBFSP upload=64TETKQZLGU4 tag=DNC3NC619BN5 type=write size=3958727 2024-09-12T17:07:55.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.239+0000 7f9eaebff780 1 < canceled operation key=9WJGBODZ60NJ tag=ABE4SPHZVFYG type=del size=1565741 2024-09-12T17:07:55.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.240+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=LH0I470MMFBU type=write size=1004720 2024-09-12T17:07:55.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.243+0000 7f9eaebff780 1 < suggested update operation key=CAIZM33SDFPM tag=35BAYO9YY1IB type=del size=139991 2024-09-12T17:07:55.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.244+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=A1I8FRMMSJK8 type=del size=3552266 2024-09-12T17:07:55.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.245+0000 7f9eaebff780 1 < completed delete operation key=OH6GXTMPBYUY tag=6P2U6V1TW6BE type=del 2024-09-12T17:07:55.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.247+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=PJK3YPCFKHHG type=write size=560410 2024-09-12T17:07:55.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.249+0000 7f9eaebff780 1 < suggested remove operation key=YIEP2JYDSLW0 tag=QNEVJJTSDQI1 type=del 2024-09-12T17:07:55.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.250+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=XZNX77NQT2OK type=write size=343360 2024-09-12T17:07:55.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.253+0000 7f9eaebff780 1 < suggested update operation key=ZYP3P4031PUZ tag=72F3ZCT71D3N type=del size=3087571 2024-09-12T17:07:55.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.254+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=P0J8S3OUHTMW type=del size=2719045 2024-09-12T17:07:55.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.256+0000 7f9eaebff780 1 < suggested remove operation key=K0P9ZZ91UJJ8 tag=ET5R32N4WBRZ type=del 2024-09-12T17:07:55.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.258+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=T5DND4GB64WO type=del size=1830873 2024-09-12T17:07:55.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.258+0000 7f9eaebff780 -1 < no bi entry to suggest for operation key=K0P9ZZ91UJJ8 tag=RY4OM0RI11EZ type=write size=398564: (2) No such file or directory 2024-09-12T17:07:55.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.260+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~HPN7B5N9PL4L.0 size=139036 2024-09-12T17:07:55.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.260+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=HPN7B5N9PL4L tag=NAGIQ93WVJH1 type=write size=1187612 2024-09-12T17:07:55.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.262+0000 7f9eaebff780 1 < completed delete operation key=SHWT6AT7PN0M tag=I5FT3CGA9YU1 type=del 2024-09-12T17:07:55.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.263+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=ZNPR0G0JV8Y5 type=del size=3104193 2024-09-12T17:07:55.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.264+0000 7f9eaebff780 1 < completed delete operation key=8DJLYFM11DNI tag=A84G0RSGBSVF type=del 2024-09-12T17:07:55.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.265+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=TZX5MXQJF1QW type=write size=634107 2024-09-12T17:07:55.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.267+0000 7f9eaebff780 1 < completed delete operation key=7PBT9VZ07OUI tag=1KYYT3LXRDX4 type=del 2024-09-12T17:07:55.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.269+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=UQ3XMVNS1DTH type=del size=669513 2024-09-12T17:07:55.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.270+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~BPO8IP3A5FO3.0 size=1048576 2024-09-12T17:07:55.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.271+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~BPO8IP3A5FO3.1 size=1048576 2024-09-12T17:07:55.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.272+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~BPO8IP3A5FO3.2 size=503981 2024-09-12T17:07:55.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.274+0000 7f9eaebff780 1 < completed multipart upload key=ZC814TPVLJO1 upload=BPO8IP3A5FO3 tag=X70Q7KTPKVRH type=write size=3649709 2024-09-12T17:07:55.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.275+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=ZCPPGFL9AU7Z type=del size=2039839 2024-09-12T17:07:55.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.276+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=XC46RFVYO0GY type=del 2024-09-12T17:07:55.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.278+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~CWX3FCG3ZP9Z.0 size=902902 2024-09-12T17:07:55.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.278+0000 7f9eaebff780 1 > prepared multipart upload key=3LY681252WAN upload=CWX3FCG3ZP9Z tag=TMY26X29ABA6 type=write size=1951478 2024-09-12T17:07:55.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.280+0000 7f9eaebff780 1 < completed delete operation key=UYF1AN2W59VN tag=WZKKFZEZE0LQ type=del 2024-09-12T17:07:55.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.281+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=HIPODFRA8XBZ type=write size=130060 2024-09-12T17:07:55.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.282+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~ZQEBXLYIL4B6.0 size=1048576 2024-09-12T17:07:55.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.283+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~ZQEBXLYIL4B6.1 size=871904 2024-09-12T17:07:55.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.285+0000 7f9eaebff780 1 < completed multipart upload key=0F5LXJZMBFSP upload=ZQEBXLYIL4B6 tag=981F4XW1UQFO type=write size=2969056 2024-09-12T17:07:55.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.286+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=CURTAEKQR7RW type=del size=378324 2024-09-12T17:07:55.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.287+0000 7f9eaebff780 1 < canceled part key=_multipart_P9GMGM3WK6O7.2~BBXE3FHZJ9HA.0 size=1048576 2024-09-12T17:07:55.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.288+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~BBXE3FHZJ9HA.1 size=639483 2024-09-12T17:07:55.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.289+0000 7f9eaebff780 1 < canceled multipart upload key=P9GMGM3WK6O7 upload=BBXE3FHZJ9HA tag=XWNQ3T278B1O type=write size=2736635 2024-09-12T17:07:55.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.292+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~F5F0PY8C4QQ7.0 size=1048576 2024-09-12T17:07:55.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.293+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~F5F0PY8C4QQ7.1 size=1048576 2024-09-12T17:07:55.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.294+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~F5F0PY8C4QQ7.2 size=964724 2024-09-12T17:07:55.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.294+0000 7f9eaebff780 1 > prepared multipart upload key=TDZCNUZE8IOA upload=F5F0PY8C4QQ7 tag=CEDH24598JUC type=write size=4110452 2024-09-12T17:07:55.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.295+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~64TETKQZLGU4.0 size=1048576 2024-09-12T17:07:55.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.296+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~64TETKQZLGU4.1 size=1048576 2024-09-12T17:07:55.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.297+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~64TETKQZLGU4.2 size=812999 2024-09-12T17:07:55.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.299+0000 7f9eaebff780 1 < completed multipart upload key=0F5LXJZMBFSP upload=64TETKQZLGU4 tag=DNC3NC619BN5 type=write size=3958727 2024-09-12T17:07:55.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.300+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=40CSO35J5ZK7 type=write size=130436 2024-09-12T17:07:55.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.301+0000 7f9eaebff780 1 < completed write operation key=LRI5G5G8O5X4 tag=LH0I470MMFBU type=write size=1004720 2024-09-12T17:07:55.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.303+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=9QZWM1HCEY2J type=del size=2719526 2024-09-12T17:07:55.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.305+0000 7f9eaebff780 1 < suggested update operation key=P9GMGM3WK6O7 tag=A1I8FRMMSJK8 type=del size=3552266 2024-09-12T17:07:55.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.307+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~PS1AB9PL47GV.0 size=1048576 2024-09-12T17:07:55.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.308+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~PS1AB9PL47GV.1 size=995873 2024-09-12T17:07:55.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.308+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=PS1AB9PL47GV tag=J1LCMQZ8YHMR type=write size=3093025 2024-09-12T17:07:55.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.310+0000 7f9eaebff780 1 < completed write operation key=CAIZM33SDFPM tag=PJK3YPCFKHHG type=write size=560410 2024-09-12T17:07:55.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.311+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=9MH6YMV2SHJ9 type=del size=1923821 2024-09-12T17:07:55.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.312+0000 7f9eaebff780 1 < completed write operation key=0YD5P1ACZ09Q tag=XZNX77NQT2OK type=write size=343360 2024-09-12T17:07:55.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.313+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=XF1667FVZME7 type=write size=739891 2024-09-12T17:07:55.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.315+0000 7f9eaebff780 1 < canceled operation key=SHWT6AT7PN0M tag=P0J8S3OUHTMW type=del size=2719045 2024-09-12T17:07:55.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.317+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~BK2L86C7QYAA.0 size=1048576 2024-09-12T17:07:55.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.318+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~BK2L86C7QYAA.1 size=1048576 2024-09-12T17:07:55.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.319+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~BK2L86C7QYAA.2 size=319741 2024-09-12T17:07:55.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.319+0000 7f9eaebff780 1 > prepared multipart upload key=9I6RGNRB6HSY upload=BK2L86C7QYAA tag=FIDNEU64AABX type=write size=3465469 2024-09-12T17:07:55.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.320+0000 7f9eaebff780 1 < completed delete operation key=SHWT6AT7PN0M tag=T5DND4GB64WO type=del 2024-09-12T17:07:55.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.322+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=8J8OB7YFFO11 type=del size=235499 2024-09-12T17:07:55.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.323+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~HPN7B5N9PL4L.0 size=139036 2024-09-12T17:07:55.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.325+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=HPN7B5N9PL4L tag=NAGIQ93WVJH1 type=write size=1187612 2024-09-12T17:07:55.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.326+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=EOCE0XBIPKW5 type=del size=2000282 2024-09-12T17:07:55.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.328+0000 7f9eaebff780 1 < completed delete operation key=0YD5P1ACZ09Q tag=ZNPR0G0JV8Y5 type=del 2024-09-12T17:07:55.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.330+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~AEABG9VHXT65.0 size=1048576 2024-09-12T17:07:55.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.331+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~AEABG9VHXT65.1 size=151466 2024-09-12T17:07:55.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.331+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=AEABG9VHXT65 tag=BQS1ED6ORINW type=write size=2248618 2024-09-12T17:07:55.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.333+0000 7f9eaebff780 1 < completed write operation key=KF8XE48DI9KZ tag=TZX5MXQJF1QW type=write size=634107 2024-09-12T17:07:55.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.334+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=X2HX23YOWAV5 type=write size=393670 2024-09-12T17:07:55.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.335+0000 7f9eaebff780 1 < completed delete operation key=K0P9ZZ91UJJ8 tag=UQ3XMVNS1DTH type=del 2024-09-12T17:07:55.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.336+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=ON8C1A6JW7TQ type=del size=2681991 2024-09-12T17:07:55.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.338+0000 7f9eaebff780 1 < canceled operation key=LJN514F16XJA tag=ZCPPGFL9AU7Z type=del size=2039839 2024-09-12T17:07:55.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.339+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=X2B2H8YVXIOO type=del size=293255 2024-09-12T17:07:55.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.340+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~CWX3FCG3ZP9Z.0 size=902902 2024-09-12T17:07:55.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.342+0000 7f9eaebff780 1 < completed multipart upload key=3LY681252WAN upload=CWX3FCG3ZP9Z tag=TMY26X29ABA6 type=write size=1951478 2024-09-12T17:07:55.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.344+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~DD6EZMFUFXSE.0 size=1038818 2024-09-12T17:07:55.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.344+0000 7f9eaebff780 1 > prepared multipart upload key=EKUW5AKC428U upload=DD6EZMFUFXSE tag=U6VBP5OB1H7Y type=write size=2087394 2024-09-12T17:07:55.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.345+0000 7f9eaebff780 1 < canceled operation key=OH6GXTMPBYUY tag=HIPODFRA8XBZ type=write size=130060 2024-09-12T17:07:55.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.347+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=P5WRUNZ0IL5L type=del size=3936401 2024-09-12T17:07:55.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.348+0000 7f9eaebff780 1 < completed delete operation key=LRI5G5G8O5X4 tag=CURTAEKQR7RW type=del 2024-09-12T17:07:55.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.349+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=DT58U47L7U9Y type=write size=782583 2024-09-12T17:07:55.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.350+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~F5F0PY8C4QQ7.0 size=1048576 2024-09-12T17:07:55.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.351+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~F5F0PY8C4QQ7.1 size=1048576 2024-09-12T17:07:55.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.352+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~F5F0PY8C4QQ7.2 size=964724 2024-09-12T17:07:55.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.354+0000 7f9eaebff780 1 < completed multipart upload key=TDZCNUZE8IOA upload=F5F0PY8C4QQ7 tag=CEDH24598JUC type=write size=4110452 2024-09-12T17:07:55.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.356+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=C26ZUQRIC9IS type=del size=3964727 2024-09-12T17:07:55.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.357+0000 7f9eaebff780 1 < canceled operation key=ZC814TPVLJO1 tag=40CSO35J5ZK7 type=write size=130436 2024-09-12T17:07:55.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.359+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~PVN8PQHQ8O32.0 size=604525 2024-09-12T17:07:55.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.359+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=PVN8PQHQ8O32 tag=06DP8GXBSLGB type=write size=1653101 2024-09-12T17:07:55.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.362+0000 7f9eaebff780 1 < suggested remove operation key=A1KRCFY18QTP tag=9QZWM1HCEY2J type=del 2024-09-12T17:07:55.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.364+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~ANG5HYA51RUD.0 size=498602 2024-09-12T17:07:55.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.364+0000 7f9eaebff780 1 > prepared multipart upload key=0F5LXJZMBFSP upload=ANG5HYA51RUD tag=ZCTYK14IQ76B type=write size=1547178 2024-09-12T17:07:55.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.365+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~PS1AB9PL47GV.0 size=1048576 2024-09-12T17:07:55.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.366+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~PS1AB9PL47GV.1 size=995873 2024-09-12T17:07:55.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.368+0000 7f9eaebff780 1 < completed multipart upload key=UYF1AN2W59VN upload=PS1AB9PL47GV tag=J1LCMQZ8YHMR type=write size=3093025 2024-09-12T17:07:55.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.369+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=ER7S2VZP5HVX type=del size=819073 2024-09-12T17:07:55.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.370+0000 7f9eaebff780 1 < completed delete operation key=SVWPQETL92QU tag=9MH6YMV2SHJ9 type=del 2024-09-12T17:07:55.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.372+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=9BRFZ2BJLXFI type=write size=421757 2024-09-12T17:07:55.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.373+0000 7f9eaebff780 1 < completed write operation key=K0P9ZZ91UJJ8 tag=XF1667FVZME7 type=write size=739891 2024-09-12T17:07:55.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.375+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~B5ZU8UKGQC4Y.0 size=1048576 2024-09-12T17:07:55.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.376+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~B5ZU8UKGQC4Y.1 size=1048576 2024-09-12T17:07:55.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.377+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~B5ZU8UKGQC4Y.2 size=686349 2024-09-12T17:07:55.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.377+0000 7f9eaebff780 1 > prepared multipart upload key=7PBT9VZ07OUI upload=B5ZU8UKGQC4Y tag=EP2ULOAOZCA7 type=write size=3832077 2024-09-12T17:07:55.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.378+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~BK2L86C7QYAA.0 size=1048576 2024-09-12T17:07:55.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.379+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~BK2L86C7QYAA.1 size=1048576 2024-09-12T17:07:55.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.380+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~BK2L86C7QYAA.2 size=319741 2024-09-12T17:07:55.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.383+0000 7f9eaebff780 1 < completed multipart upload key=9I6RGNRB6HSY upload=BK2L86C7QYAA tag=FIDNEU64AABX type=write size=3465469 2024-09-12T17:07:55.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.386+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~EHEEP9DDYHG3.0 size=276371 2024-09-12T17:07:55.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.386+0000 7f9eaebff780 1 > prepared multipart upload key=9I6RGNRB6HSY upload=EHEEP9DDYHG3 tag=YCR8ONJC0U96 type=write size=1324947 2024-09-12T17:07:55.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.387+0000 7f9eaebff780 1 < completed delete operation key=8DJLYFM11DNI tag=8J8OB7YFFO11 type=del 2024-09-12T17:07:55.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.388+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=W693K9BWPWJL type=del size=2742388 2024-09-12T17:07:55.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.389+0000 7f9eaebff780 1 < completed delete operation key=SO6QF2JCRX6E tag=EOCE0XBIPKW5 type=del 2024-09-12T17:07:55.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.391+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~76ZVSX3K2U04.0 size=471789 2024-09-12T17:07:55.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.391+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=76ZVSX3K2U04 tag=43PQ6VY8ES58 type=write size=1520365 2024-09-12T17:07:55.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.392+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~AEABG9VHXT65.0 size=1048576 2024-09-12T17:07:55.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.393+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~AEABG9VHXT65.1 size=151466 2024-09-12T17:07:55.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.395+0000 7f9eaebff780 1 < completed multipart upload key=M3PLQGSK34YM upload=AEABG9VHXT65 tag=BQS1ED6ORINW type=write size=2248618 2024-09-12T17:07:55.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.396+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=R75TU1ALRYPM type=del size=2191057 2024-09-12T17:07:55.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.398+0000 7f9eaebff780 1 < completed write operation key=LRI5G5G8O5X4 tag=X2HX23YOWAV5 type=write size=393670 2024-09-12T17:07:55.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.399+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=EFZNBPWSHDWH type=del size=2311610 2024-09-12T17:07:55.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.400+0000 7f9eaebff780 1 < completed delete operation key=7PBT9VZ07OUI tag=ON8C1A6JW7TQ type=del 2024-09-12T17:07:55.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.401+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=HVI33EZ3NHSJ type=del size=986929 2024-09-12T17:07:55.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.402+0000 7f9eaebff780 1 < completed delete operation key=TXHXOMIB4B53 tag=X2B2H8YVXIOO type=del 2024-09-12T17:07:55.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.404+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=Z0NZ8NFWOD17 type=write size=789932 2024-09-12T17:07:55.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.405+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~DD6EZMFUFXSE.0 size=1038818 2024-09-12T17:07:55.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.407+0000 7f9eaebff780 1 < completed multipart upload key=EKUW5AKC428U upload=DD6EZMFUFXSE tag=U6VBP5OB1H7Y type=write size=2087394 2024-09-12T17:07:55.411 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.409+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~QSJ0WHIJFGA8.0 size=218392 2024-09-12T17:07:55.411 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.409+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=QSJ0WHIJFGA8 tag=YZKKLKVEEWD1 type=write size=1266968 2024-09-12T17:07:55.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.410+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=P5WRUNZ0IL5L type=del 2024-09-12T17:07:55.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.413+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~6CO5SFS91VY1.0 size=617903 2024-09-12T17:07:55.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.413+0000 7f9eaebff780 1 > prepared multipart upload key=ZYP3P4031PUZ upload=6CO5SFS91VY1 tag=4ZDLF67BCA25 type=write size=1666479 2024-09-12T17:07:55.416 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.414+0000 7f9eaebff780 1 < completed write operation key=EKUW5AKC428U tag=DT58U47L7U9Y type=write size=782583 2024-09-12T17:07:55.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.416+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~FXMKFCSW39WE.0 size=1048576 2024-09-12T17:07:55.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.417+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~FXMKFCSW39WE.1 size=278991 2024-09-12T17:07:55.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.417+0000 7f9eaebff780 1 > prepared multipart upload key=LJN514F16XJA upload=FXMKFCSW39WE tag=WWIH58SLJ96H type=write size=2376143 2024-09-12T17:07:55.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.419+0000 7f9eaebff780 1 < completed delete operation key=9I6RGNRB6HSY tag=C26ZUQRIC9IS type=del 2024-09-12T17:07:55.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.420+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=13FUPYWI9OQS type=del size=7394 2024-09-12T17:07:55.423 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.421+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~PVN8PQHQ8O32.0 size=604525 2024-09-12T17:07:55.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.424+0000 7f9eaebff780 1 < completed multipart upload key=P9GMGM3WK6O7 upload=PVN8PQHQ8O32 tag=06DP8GXBSLGB type=write size=1653101 2024-09-12T17:07:55.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.425+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=C87H7DG6UJSB type=del size=2285934 2024-09-12T17:07:55.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.425+0000 7f9eaebff780 1 < canceled part key=_multipart_0F5LXJZMBFSP.2~ANG5HYA51RUD.0 size=498602 2024-09-12T17:07:55.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.428+0000 7f9eaebff780 1 < canceled multipart upload key=0F5LXJZMBFSP upload=ANG5HYA51RUD tag=ZCTYK14IQ76B type=write size=1547178 2024-09-12T17:07:55.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.430+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~CU6P7ZWGVW2N.0 size=1048576 2024-09-12T17:07:55.432 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.431+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~CU6P7ZWGVW2N.1 size=1048576 2024-09-12T17:07:55.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.432+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~CU6P7ZWGVW2N.2 size=73018 2024-09-12T17:07:55.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.432+0000 7f9eaebff780 1 > prepared multipart upload key=ZYP3P4031PUZ upload=CU6P7ZWGVW2N tag=WRHLIS9Y4AUY type=write size=3218746 2024-09-12T17:07:55.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.433+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=ER7S2VZP5HVX type=del 2024-09-12T17:07:55.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.435+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~20V92JWCT7GL.0 size=1048576 2024-09-12T17:07:55.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.436+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~20V92JWCT7GL.1 size=1046118 2024-09-12T17:07:55.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.436+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=20V92JWCT7GL tag=7CO1VAB4TD6R type=write size=3143270 2024-09-12T17:07:55.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.437+0000 7f9eaebff780 1 < completed write operation key=QIMNK4DL3D0N tag=9BRFZ2BJLXFI type=write size=421757 2024-09-12T17:07:55.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.438+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=XN4PLGY17MWU type=write size=287042 2024-09-12T17:07:55.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.439+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~B5ZU8UKGQC4Y.0 size=1048576 2024-09-12T17:07:55.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.439+0000 7f9eaebff780 1 < canceled part key=_multipart_7PBT9VZ07OUI.2~B5ZU8UKGQC4Y.1 size=1048576 2024-09-12T17:07:55.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.440+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~B5ZU8UKGQC4Y.2 size=686349 2024-09-12T17:07:55.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.442+0000 7f9eaebff780 1 < canceled multipart upload key=7PBT9VZ07OUI upload=B5ZU8UKGQC4Y tag=EP2ULOAOZCA7 type=write size=3832077 2024-09-12T17:07:55.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.445+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~MDVHA4FG4IK5.0 size=789753 2024-09-12T17:07:55.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.445+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=MDVHA4FG4IK5 tag=I8JXGWXX139X type=write size=1838329 2024-09-12T17:07:55.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.446+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~EHEEP9DDYHG3.0 size=276371 2024-09-12T17:07:55.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.448+0000 7f9eaebff780 1 < completed multipart upload key=9I6RGNRB6HSY upload=EHEEP9DDYHG3 tag=YCR8ONJC0U96 type=write size=1324947 2024-09-12T17:07:55.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.449+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=H14FA4CITTQH type=del size=3855151 2024-09-12T17:07:55.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.450+0000 7f9eaebff780 1 < completed delete operation key=ZC814TPVLJO1 tag=W693K9BWPWJL type=del 2024-09-12T17:07:55.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.451+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=3UNAQLEH09ZO type=del size=3593512 2024-09-12T17:07:55.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.453+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~76ZVSX3K2U04.0 size=471789 2024-09-12T17:07:55.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.455+0000 7f9eaebff780 1 < completed multipart upload key=P9GMGM3WK6O7 upload=76ZVSX3K2U04 tag=43PQ6VY8ES58 type=write size=1520365 2024-09-12T17:07:55.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.457+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~JA3BHURDFW92.0 size=1048576 2024-09-12T17:07:55.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.458+0000 7f9eaebff780 1 > prepared part key=_multipart_0F5LXJZMBFSP.2~JA3BHURDFW92.1 size=82220 2024-09-12T17:07:55.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.458+0000 7f9eaebff780 1 > prepared multipart upload key=0F5LXJZMBFSP upload=JA3BHURDFW92 tag=OVFJOEXEYB9K type=write size=2179372 2024-09-12T17:07:55.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.459+0000 7f9eaebff780 1 < completed delete operation key=OGD6H9VSVGWF tag=R75TU1ALRYPM type=del 2024-09-12T17:07:55.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.460+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=TYI573Q5JXMW type=del size=1974127 2024-09-12T17:07:55.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.461+0000 7f9eaebff780 1 < canceled operation key=YIEP2JYDSLW0 tag=EFZNBPWSHDWH type=del size=2311610 2024-09-12T17:07:55.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.462+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=WIITPCRK1M1Z type=del size=2538908 2024-09-12T17:07:55.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.464+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=HVI33EZ3NHSJ type=del 2024-09-12T17:07:55.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.465+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=0HY2M03WMRUU type=del size=2126442 2024-09-12T17:07:55.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.467+0000 7f9eaebff780 1 < suggested remove operation key=YIEP2JYDSLW0 tag=Z0NZ8NFWOD17 type=write 2024-09-12T17:07:55.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.468+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=9V2GIEL7GP3Y type=del size=2959784 2024-09-12T17:07:55.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.470+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~QSJ0WHIJFGA8.0 size=218392 2024-09-12T17:07:55.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.472+0000 7f9eaebff780 1 < completed multipart upload key=UYF1AN2W59VN upload=QSJ0WHIJFGA8 tag=YZKKLKVEEWD1 type=write size=1266968 2024-09-12T17:07:55.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.473+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=KP5QCMLCSWXJ type=del size=2001784 2024-09-12T17:07:55.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.474+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~6CO5SFS91VY1.0 size=617903 2024-09-12T17:07:55.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.476+0000 7f9eaebff780 1 < completed multipart upload key=ZYP3P4031PUZ upload=6CO5SFS91VY1 tag=4ZDLF67BCA25 type=write size=1666479 2024-09-12T17:07:55.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.478+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~7VZD20IBS5L2.0 size=1048576 2024-09-12T17:07:55.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.479+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~7VZD20IBS5L2.1 size=1048576 2024-09-12T17:07:55.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.480+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~7VZD20IBS5L2.2 size=924673 2024-09-12T17:07:55.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.480+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=7VZD20IBS5L2 tag=69OVVMPGXVWT type=write size=4070401 2024-09-12T17:07:55.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.481+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~FXMKFCSW39WE.0 size=1048576 2024-09-12T17:07:55.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.482+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~FXMKFCSW39WE.1 size=278991 2024-09-12T17:07:55.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.485+0000 7f9eaebff780 1 < completed multipart upload key=LJN514F16XJA upload=FXMKFCSW39WE tag=WWIH58SLJ96H type=write size=2376143 2024-09-12T17:07:55.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.486+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=W7BH6OPMOKP2 type=del size=98714 2024-09-12T17:07:55.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.487+0000 7f9eaebff780 1 < completed delete operation key=B1YC6DM9S8JJ tag=13FUPYWI9OQS type=del 2024-09-12T17:07:55.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.488+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=PA8DZDDGPOHY type=del size=827260 2024-09-12T17:07:55.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.490+0000 7f9eaebff780 -1 < failed to complete operation key=YIEP2JYDSLW0 tag=C87H7DG6UJSB type=del size=2285934: (22) Invalid argument 2024-09-12T17:07:55.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.492+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~GOZMZHE6GVL3.0 size=1048576 2024-09-12T17:07:55.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.493+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~GOZMZHE6GVL3.1 size=1048576 2024-09-12T17:07:55.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.494+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~GOZMZHE6GVL3.2 size=377489 2024-09-12T17:07:55.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.494+0000 7f9eaebff780 1 > prepared multipart upload key=OGD6H9VSVGWF upload=GOZMZHE6GVL3 tag=MHM4FUILANGH type=write size=3523217 2024-09-12T17:07:55.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.497+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~CU6P7ZWGVW2N.0 size=1048576 2024-09-12T17:07:55.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.498+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~CU6P7ZWGVW2N.1 size=1048576 2024-09-12T17:07:55.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.500+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~CU6P7ZWGVW2N.2 size=73018 2024-09-12T17:07:55.504 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.502+0000 7f9eaebff780 1 < completed multipart upload key=ZYP3P4031PUZ upload=CU6P7ZWGVW2N tag=WRHLIS9Y4AUY type=write size=3218746 2024-09-12T17:07:55.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.504+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~QOJ83N2UCKVE.0 size=1048576 2024-09-12T17:07:55.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.505+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~QOJ83N2UCKVE.1 size=1048576 2024-09-12T17:07:55.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.506+0000 7f9eaebff780 1 > prepared part key=_multipart_LJN514F16XJA.2~QOJ83N2UCKVE.2 size=24756 2024-09-12T17:07:55.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.506+0000 7f9eaebff780 1 > prepared multipart upload key=LJN514F16XJA upload=QOJ83N2UCKVE tag=7CXZ7M07D8Q7 type=write size=3170484 2024-09-12T17:07:55.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.508+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~20V92JWCT7GL.0 size=1048576 2024-09-12T17:07:55.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.508+0000 7f9eaebff780 1 < canceled part key=_multipart_M3PLQGSK34YM.2~20V92JWCT7GL.1 size=1046118 2024-09-12T17:07:55.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.510+0000 7f9eaebff780 1 < canceled multipart upload key=M3PLQGSK34YM upload=20V92JWCT7GL tag=7CO1VAB4TD6R type=write size=3143270 2024-09-12T17:07:55.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.511+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=YA0M4L71YS29 type=del size=3067982 2024-09-12T17:07:55.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.512+0000 7f9eaebff780 1 < completed write operation key=OGD6H9VSVGWF tag=XN4PLGY17MWU type=write size=287042 2024-09-12T17:07:55.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.513+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=ZU20AQANIBZA type=del size=2039307 2024-09-12T17:07:55.516 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.514+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~MDVHA4FG4IK5.0 size=789753 2024-09-12T17:07:55.517 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.516+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=MDVHA4FG4IK5 tag=I8JXGWXX139X type=write size=1838329 2024-09-12T17:07:55.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.517+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=6ZVOSCPTUM91 type=del size=781533 2024-09-12T17:07:55.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.519+0000 7f9eaebff780 1 < completed delete operation key=SVWPQETL92QU tag=H14FA4CITTQH type=del 2024-09-12T17:07:55.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.520+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=5C2BI9112LD7 type=del size=1313774 2024-09-12T17:07:55.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.522+0000 7f9eaebff780 1 < suggested update operation key=EKUW5AKC428U tag=3UNAQLEH09ZO type=del size=3593512 2024-09-12T17:07:55.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.524+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=W671AHD6HN20 type=del size=3930865 2024-09-12T17:07:55.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.525+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~JA3BHURDFW92.0 size=1048576 2024-09-12T17:07:55.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.526+0000 7f9eaebff780 1 < completed part key=_multipart_0F5LXJZMBFSP.2~JA3BHURDFW92.1 size=82220 2024-09-12T17:07:55.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.528+0000 7f9eaebff780 1 < completed multipart upload key=0F5LXJZMBFSP upload=JA3BHURDFW92 tag=OVFJOEXEYB9K type=write size=2179372 2024-09-12T17:07:55.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.530+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~HL21329TJGUE.0 size=1048576 2024-09-12T17:07:55.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.531+0000 7f9eaebff780 1 > prepared part key=_multipart_ZYP3P4031PUZ.2~HL21329TJGUE.1 size=545198 2024-09-12T17:07:55.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.531+0000 7f9eaebff780 1 > prepared multipart upload key=ZYP3P4031PUZ upload=HL21329TJGUE tag=ITPG6EIPJS88 type=write size=2642350 2024-09-12T17:07:55.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.533+0000 7f9eaebff780 1 < completed delete operation key=LJN514F16XJA tag=TYI573Q5JXMW type=del 2024-09-12T17:07:55.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.534+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=A05F0710RO0A type=del size=894665 2024-09-12T17:07:55.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.535+0000 7f9eaebff780 -1 < failed to complete operation key=YIEP2JYDSLW0 tag=WIITPCRK1M1Z type=del size=2538908: (22) Invalid argument 2024-09-12T17:07:55.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.536+0000 7f9eaebff780 1 > prepared operation key=0YD5P1ACZ09Q tag=8W91NNNN8ZU2 type=del size=431090 2024-09-12T17:07:55.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.538+0000 7f9eaebff780 1 < canceled operation key=0F5LXJZMBFSP tag=0HY2M03WMRUU type=del size=2126442 2024-09-12T17:07:55.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.540+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~951S76I0Q1K7.0 size=1048576 2024-09-12T17:07:55.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.541+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~951S76I0Q1K7.1 size=53325 2024-09-12T17:07:55.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.541+0000 7f9eaebff780 1 > prepared multipart upload key=OGD6H9VSVGWF upload=951S76I0Q1K7 tag=M16S4SVZPD2O type=write size=2150477 2024-09-12T17:07:55.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.542+0000 7f9eaebff780 1 < completed delete operation key=QIMNK4DL3D0N tag=9V2GIEL7GP3Y type=del 2024-09-12T17:07:55.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.544+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~5NVRJAHJBZX6.0 size=1048576 2024-09-12T17:07:55.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.545+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~5NVRJAHJBZX6.1 size=1048576 2024-09-12T17:07:55.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.546+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~5NVRJAHJBZX6.2 size=174141 2024-09-12T17:07:55.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.546+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=5NVRJAHJBZX6 tag=HEOWYI3DHMTD type=write size=3319869 2024-09-12T17:07:55.550 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.548+0000 7f9eaebff780 1 < canceled operation key=3LY681252WAN tag=KP5QCMLCSWXJ type=del size=2001784 2024-09-12T17:07:55.550 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.549+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=04QSI84SU4B5 type=write size=897018 2024-09-12T17:07:55.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.550+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~7VZD20IBS5L2.0 size=1048576 2024-09-12T17:07:55.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.551+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~7VZD20IBS5L2.1 size=1048576 2024-09-12T17:07:55.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.552+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~7VZD20IBS5L2.2 size=924673 2024-09-12T17:07:55.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.554+0000 7f9eaebff780 1 < completed multipart upload key=UYF1AN2W59VN upload=7VZD20IBS5L2 tag=69OVVMPGXVWT type=write size=4070401 2024-09-12T17:07:55.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.555+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=X897FLXV7383 type=del size=3867161 2024-09-12T17:07:55.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.556+0000 7f9eaebff780 1 < completed delete operation key=QIMNK4DL3D0N tag=W7BH6OPMOKP2 type=del 2024-09-12T17:07:55.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.558+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~ZLCR515WRIY0.0 size=1048576 2024-09-12T17:07:55.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.559+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~ZLCR515WRIY0.1 size=1048576 2024-09-12T17:07:55.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.560+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~ZLCR515WRIY0.2 size=526846 2024-09-12T17:07:55.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.560+0000 7f9eaebff780 1 > prepared multipart upload key=ZC814TPVLJO1 upload=ZLCR515WRIY0 tag=W0Y5BTWT0U15 type=write size=3672574 2024-09-12T17:07:55.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.561+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=PA8DZDDGPOHY type=del 2024-09-12T17:07:55.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.563+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=EYTSADA89DRI type=write size=608602 2024-09-12T17:07:55.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.564+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~GOZMZHE6GVL3.0 size=1048576 2024-09-12T17:07:55.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.565+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~GOZMZHE6GVL3.1 size=1048576 2024-09-12T17:07:55.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.566+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~GOZMZHE6GVL3.2 size=377489 2024-09-12T17:07:55.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.568+0000 7f9eaebff780 1 < completed multipart upload key=OGD6H9VSVGWF upload=GOZMZHE6GVL3 tag=MHM4FUILANGH type=write size=3523217 2024-09-12T17:07:55.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.569+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=V52V506S1KPB type=del size=1639254 2024-09-12T17:07:55.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.570+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~QOJ83N2UCKVE.0 size=1048576 2024-09-12T17:07:55.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.571+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~QOJ83N2UCKVE.1 size=1048576 2024-09-12T17:07:55.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.572+0000 7f9eaebff780 1 < completed part key=_multipart_LJN514F16XJA.2~QOJ83N2UCKVE.2 size=24756 2024-09-12T17:07:55.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.574+0000 7f9eaebff780 1 < completed multipart upload key=LJN514F16XJA upload=QOJ83N2UCKVE tag=7CXZ7M07D8Q7 type=write size=3170484 2024-09-12T17:07:55.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.575+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=ZPRSUBY0WQRT type=del size=487973 2024-09-12T17:07:55.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.576+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=YA0M4L71YS29 type=del 2024-09-12T17:07:55.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.578+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~NNJUBKNHVCMU.0 size=1048576 2024-09-12T17:07:55.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.579+0000 7f9eaebff780 1 > prepared part key=_multipart_3LY681252WAN.2~NNJUBKNHVCMU.1 size=694885 2024-09-12T17:07:55.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.579+0000 7f9eaebff780 1 > prepared multipart upload key=3LY681252WAN upload=NNJUBKNHVCMU tag=XW2GE0JFKBHL type=write size=2792037 2024-09-12T17:07:55.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.582+0000 7f9eaebff780 1 < suggested update operation key=TXHXOMIB4B53 tag=ZU20AQANIBZA type=del size=2039307 2024-09-12T17:07:55.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.584+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~ELZS3TNG4BVQ.0 size=1048576 2024-09-12T17:07:55.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.585+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~ELZS3TNG4BVQ.1 size=1048576 2024-09-12T17:07:55.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.586+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~ELZS3TNG4BVQ.2 size=14113 2024-09-12T17:07:55.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.586+0000 7f9eaebff780 1 > prepared multipart upload key=SO6QF2JCRX6E upload=ELZS3TNG4BVQ tag=QX4MRUVARP6F type=write size=3159841 2024-09-12T17:07:55.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.587+0000 7f9eaebff780 1 < canceled operation key=B1YC6DM9S8JJ tag=6ZVOSCPTUM91 type=del size=781533 2024-09-12T17:07:55.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.588+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=LS7V1S8LIOY8 type=write size=477348 2024-09-12T17:07:55.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.589+0000 7f9eaebff780 1 < canceled operation key=LJN514F16XJA tag=5C2BI9112LD7 type=del size=1313774 2024-09-12T17:07:55.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.591+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=F9EPYQNO4QY6 type=del size=3346763 2024-09-12T17:07:55.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.592+0000 7f9eaebff780 1 < completed delete operation key=SHWT6AT7PN0M tag=W671AHD6HN20 type=del 2024-09-12T17:07:55.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.594+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~E81BTUXYUZC9.0 size=1048576 2024-09-12T17:07:55.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.595+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~E81BTUXYUZC9.1 size=1048576 2024-09-12T17:07:55.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.596+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~E81BTUXYUZC9.2 size=800110 2024-09-12T17:07:55.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.596+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=E81BTUXYUZC9 tag=HZXH36WYJRU3 type=write size=3945838 2024-09-12T17:07:55.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.597+0000 7f9eaebff780 1 < completed part key=_multipart_ZYP3P4031PUZ.2~HL21329TJGUE.0 size=1048576 2024-09-12T17:07:55.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.597+0000 7f9eaebff780 1 < canceled part key=_multipart_ZYP3P4031PUZ.2~HL21329TJGUE.1 size=545198 2024-09-12T17:07:55.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.599+0000 7f9eaebff780 1 < canceled multipart upload key=ZYP3P4031PUZ upload=HL21329TJGUE tag=ITPG6EIPJS88 type=write size=2642350 2024-09-12T17:07:55.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.601+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=4L003UNOMH1W type=write size=189170 2024-09-12T17:07:55.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.602+0000 7f9eaebff780 1 < completed delete operation key=OH6GXTMPBYUY tag=A05F0710RO0A type=del 2024-09-12T17:07:55.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.604+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~1R6DWFFCN3XV.0 size=1048576 2024-09-12T17:07:55.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.605+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~1R6DWFFCN3XV.1 size=543287 2024-09-12T17:07:55.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.605+0000 7f9eaebff780 1 > prepared multipart upload key=9I6RGNRB6HSY upload=1R6DWFFCN3XV tag=E4FYU5JTVJ5M type=write size=2640439 2024-09-12T17:07:55.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.606+0000 7f9eaebff780 1 < completed delete operation key=0YD5P1ACZ09Q tag=8W91NNNN8ZU2 type=del 2024-09-12T17:07:55.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.608+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=IHK1M7OKB4X2 type=del size=4099598 2024-09-12T17:07:55.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.610+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~951S76I0Q1K7.0 size=1048576 2024-09-12T17:07:55.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.611+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~951S76I0Q1K7.1 size=53325 2024-09-12T17:07:55.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.613+0000 7f9eaebff780 1 < completed multipart upload key=OGD6H9VSVGWF upload=951S76I0Q1K7 tag=M16S4SVZPD2O type=write size=2150477 2024-09-12T17:07:55.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.615+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~D1XS8GKG84O6.0 size=1048576 2024-09-12T17:07:55.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.615+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~D1XS8GKG84O6.1 size=1048576 2024-09-12T17:07:55.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.616+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~D1XS8GKG84O6.2 size=59192 2024-09-12T17:07:55.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.616+0000 7f9eaebff780 1 > prepared multipart upload key=OGD6H9VSVGWF upload=D1XS8GKG84O6 tag=FOYHRO75PT24 type=write size=3204920 2024-09-12T17:07:55.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.617+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~5NVRJAHJBZX6.0 size=1048576 2024-09-12T17:07:55.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.618+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~5NVRJAHJBZX6.1 size=1048576 2024-09-12T17:07:55.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.620+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~5NVRJAHJBZX6.2 size=174141 2024-09-12T17:07:55.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.622+0000 7f9eaebff780 1 < completed multipart upload key=M3PLQGSK34YM upload=5NVRJAHJBZX6 tag=HEOWYI3DHMTD type=write size=3319869 2024-09-12T17:07:55.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.624+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~5CQ5J5O4ZUFG.0 size=1048576 2024-09-12T17:07:55.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.625+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~5CQ5J5O4ZUFG.1 size=874450 2024-09-12T17:07:55.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.625+0000 7f9eaebff780 1 > prepared multipart upload key=ZC814TPVLJO1 upload=5CQ5J5O4ZUFG tag=292UZQU5LS1B type=write size=2971602 2024-09-12T17:07:55.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.627+0000 7f9eaebff780 1 < suggested remove operation key=EKUW5AKC428U tag=04QSI84SU4B5 type=write 2024-09-12T17:07:55.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.628+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=ZNFS2BVHZIIG type=del size=3153563 2024-09-12T17:07:55.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.630+0000 7f9eaebff780 1 < completed delete operation key=OH6GXTMPBYUY tag=X897FLXV7383 type=del 2024-09-12T17:07:55.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.632+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~07F26PO3PH2J.0 size=1048576 2024-09-12T17:07:55.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.633+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~07F26PO3PH2J.1 size=1048576 2024-09-12T17:07:55.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.634+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~07F26PO3PH2J.2 size=277247 2024-09-12T17:07:55.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.634+0000 7f9eaebff780 1 > prepared multipart upload key=B1YC6DM9S8JJ upload=07F26PO3PH2J tag=PGIQ6B4NLBZZ type=write size=3422975 2024-09-12T17:07:55.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.635+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~ZLCR515WRIY0.0 size=1048576 2024-09-12T17:07:55.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.636+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~ZLCR515WRIY0.1 size=1048576 2024-09-12T17:07:55.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.637+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~ZLCR515WRIY0.2 size=526846 2024-09-12T17:07:55.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.639+0000 7f9eaebff780 1 < completed multipart upload key=ZC814TPVLJO1 upload=ZLCR515WRIY0 tag=W0Y5BTWT0U15 type=write size=3672574 2024-09-12T17:07:55.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.641+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=5OGWBPJHSL8D type=del size=1975940 2024-09-12T17:07:55.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.642+0000 7f9eaebff780 1 < completed write operation key=B1YC6DM9S8JJ tag=EYTSADA89DRI type=write size=608602 2024-09-12T17:07:55.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.644+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~J712XE50OYML.0 size=1048576 2024-09-12T17:07:55.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.645+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~J712XE50OYML.1 size=1048576 2024-09-12T17:07:55.647 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.646+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~J712XE50OYML.2 size=345097 2024-09-12T17:07:55.647 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.646+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=J712XE50OYML tag=5ZTXJ98GT658 type=write size=3490825 2024-09-12T17:07:55.648 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.647+0000 7f9eaebff780 1 < completed delete operation key=ZYP3P4031PUZ tag=V52V506S1KPB type=del 2024-09-12T17:07:55.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.648+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=KC3X7UZ383Z2 type=del size=2353974 2024-09-12T17:07:55.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.651+0000 7f9eaebff780 1 < suggested update operation key=K2NHRSUDQBRW tag=ZPRSUBY0WQRT type=del size=487973 2024-09-12T17:07:55.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.653+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~8541HLRHQTZG.0 size=1048576 2024-09-12T17:07:55.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.654+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~8541HLRHQTZG.1 size=768450 2024-09-12T17:07:55.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.654+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=8541HLRHQTZG tag=H8NHHQR6QO4Q type=write size=2865602 2024-09-12T17:07:55.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.655+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~NNJUBKNHVCMU.0 size=1048576 2024-09-12T17:07:55.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.656+0000 7f9eaebff780 1 < completed part key=_multipart_3LY681252WAN.2~NNJUBKNHVCMU.1 size=694885 2024-09-12T17:07:55.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.658+0000 7f9eaebff780 1 < completed multipart upload key=3LY681252WAN upload=NNJUBKNHVCMU tag=XW2GE0JFKBHL type=write size=2792037 2024-09-12T17:07:55.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.660+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~D4VHJMFOL4U4.0 size=585766 2024-09-12T17:07:55.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.660+0000 7f9eaebff780 1 > prepared multipart upload key=9WJGBODZ60NJ upload=D4VHJMFOL4U4 tag=V0VBHXHYY4VD type=write size=1634342 2024-09-12T17:07:55.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.661+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~ELZS3TNG4BVQ.0 size=1048576 2024-09-12T17:07:55.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.662+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~ELZS3TNG4BVQ.1 size=1048576 2024-09-12T17:07:55.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.663+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~ELZS3TNG4BVQ.2 size=14113 2024-09-12T17:07:55.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.665+0000 7f9eaebff780 1 < completed multipart upload key=SO6QF2JCRX6E upload=ELZS3TNG4BVQ tag=QX4MRUVARP6F type=write size=3159841 2024-09-12T17:07:55.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.667+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~4MI65TRND0VZ.0 size=1048576 2024-09-12T17:07:55.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.668+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~4MI65TRND0VZ.1 size=468363 2024-09-12T17:07:55.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.668+0000 7f9eaebff780 1 > prepared multipart upload key=CAIZM33SDFPM upload=4MI65TRND0VZ tag=6WGJR6FUF19U type=write size=2565515 2024-09-12T17:07:55.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.670+0000 7f9eaebff780 1 < suggested update operation key=SVWPQETL92QU tag=LS7V1S8LIOY8 type=write size=477348 2024-09-12T17:07:55.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.673+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~7RWAB5D8NU10.0 size=1048576 2024-09-12T17:07:55.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.674+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~7RWAB5D8NU10.1 size=1048576 2024-09-12T17:07:55.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.675+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~7RWAB5D8NU10.2 size=52035 2024-09-12T17:07:55.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.675+0000 7f9eaebff780 1 > prepared multipart upload key=0YD5P1ACZ09Q upload=7RWAB5D8NU10 tag=KCBSFOACGRKC type=write size=3197763 2024-09-12T17:07:55.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.676+0000 7f9eaebff780 1 < completed delete operation key=A1KRCFY18QTP tag=F9EPYQNO4QY6 type=del 2024-09-12T17:07:55.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.677+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=L1YTH8MPU23W type=del size=108693 2024-09-12T17:07:55.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.678+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~E81BTUXYUZC9.0 size=1048576 2024-09-12T17:07:55.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.679+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~E81BTUXYUZC9.1 size=1048576 2024-09-12T17:07:55.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.680+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~E81BTUXYUZC9.2 size=800110 2024-09-12T17:07:55.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.682+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=E81BTUXYUZC9 tag=HZXH36WYJRU3 type=write size=3945838 2024-09-12T17:07:55.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.684+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=OVA2AOZBNOSK type=del size=1549329 2024-09-12T17:07:55.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.686+0000 7f9eaebff780 1 < suggested update operation key=3LY681252WAN tag=4L003UNOMH1W type=write size=189170 2024-09-12T17:07:55.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.687+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=9CRKW447SEUZ type=del size=1843347 2024-09-12T17:07:55.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.687+0000 7f9eaebff780 1 < canceled part key=_multipart_9I6RGNRB6HSY.2~1R6DWFFCN3XV.0 size=1048576 2024-09-12T17:07:55.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.688+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~1R6DWFFCN3XV.1 size=543287 2024-09-12T17:07:55.692 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.690+0000 7f9eaebff780 1 < canceled multipart upload key=9I6RGNRB6HSY upload=1R6DWFFCN3XV tag=E4FYU5JTVJ5M type=write size=2640439 2024-09-12T17:07:55.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.692+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=23ZBJ5S7DMKG type=del size=4182246 2024-09-12T17:07:55.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.693+0000 7f9eaebff780 1 < completed delete operation key=SO6QF2JCRX6E tag=IHK1M7OKB4X2 type=del 2024-09-12T17:07:55.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.695+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~HQAYQAEA13JO.0 size=1048576 2024-09-12T17:07:55.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.696+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~HQAYQAEA13JO.1 size=1002631 2024-09-12T17:07:55.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.696+0000 7f9eaebff780 1 > prepared multipart upload key=ZC814TPVLJO1 upload=HQAYQAEA13JO tag=R6FFOVY1WU6D type=write size=3099783 2024-09-12T17:07:55.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.697+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~D1XS8GKG84O6.0 size=1048576 2024-09-12T17:07:55.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.698+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~D1XS8GKG84O6.1 size=1048576 2024-09-12T17:07:55.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.699+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~D1XS8GKG84O6.2 size=59192 2024-09-12T17:07:55.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.701+0000 7f9eaebff780 1 < completed multipart upload key=OGD6H9VSVGWF upload=D1XS8GKG84O6 tag=FOYHRO75PT24 type=write size=3204920 2024-09-12T17:07:55.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.702+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=NFO5UHCTVC6P type=del size=2462469 2024-09-12T17:07:55.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.703+0000 7f9eaebff780 1 < canceled part key=_multipart_ZC814TPVLJO1.2~5CQ5J5O4ZUFG.0 size=1048576 2024-09-12T17:07:55.705 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.704+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~5CQ5J5O4ZUFG.1 size=874450 2024-09-12T17:07:55.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.706+0000 7f9eaebff780 1 < canceled multipart upload key=ZC814TPVLJO1 upload=5CQ5J5O4ZUFG tag=292UZQU5LS1B type=write size=2971602 2024-09-12T17:07:55.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.707+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=Q2RK5ZSX5JFF type=del size=3988262 2024-09-12T17:07:55.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.709+0000 7f9eaebff780 1 < suggested update operation key=SO6QF2JCRX6E tag=ZNFS2BVHZIIG type=del size=3153563 2024-09-12T17:07:55.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.711+0000 7f9eaebff780 1 > prepared operation key=P9GMGM3WK6O7 tag=WDAL6Q3GAA28 type=del size=511741 2024-09-12T17:07:55.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.712+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~07F26PO3PH2J.0 size=1048576 2024-09-12T17:07:55.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.713+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~07F26PO3PH2J.1 size=1048576 2024-09-12T17:07:55.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.713+0000 7f9eaebff780 1 < canceled part key=_multipart_B1YC6DM9S8JJ.2~07F26PO3PH2J.2 size=277247 2024-09-12T17:07:55.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.715+0000 7f9eaebff780 1 < canceled multipart upload key=B1YC6DM9S8JJ upload=07F26PO3PH2J tag=PGIQ6B4NLBZZ type=write size=3422975 2024-09-12T17:07:55.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.716+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=YD81HK18BDQX type=del size=3512863 2024-09-12T17:07:55.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.717+0000 7f9eaebff780 1 < completed delete operation key=3VY271ZBO754 tag=5OGWBPJHSL8D type=del 2024-09-12T17:07:55.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.720+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~739AZDWTNXYG.0 size=1048576 2024-09-12T17:07:55.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.721+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~739AZDWTNXYG.1 size=644750 2024-09-12T17:07:55.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.721+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=739AZDWTNXYG tag=0DSE2S1JT667 type=write size=2741902 2024-09-12T17:07:55.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.722+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~J712XE50OYML.0 size=1048576 2024-09-12T17:07:55.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.723+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~J712XE50OYML.1 size=1048576 2024-09-12T17:07:55.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.724+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~J712XE50OYML.2 size=345097 2024-09-12T17:07:55.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.726+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=J712XE50OYML tag=5ZTXJ98GT658 type=write size=3490825 2024-09-12T17:07:55.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.728+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~IN1NDXUO8D0Y.0 size=1048576 2024-09-12T17:07:55.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.729+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~IN1NDXUO8D0Y.1 size=1048576 2024-09-12T17:07:55.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.730+0000 7f9eaebff780 1 > prepared part key=_multipart_TDZCNUZE8IOA.2~IN1NDXUO8D0Y.2 size=368483 2024-09-12T17:07:55.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.730+0000 7f9eaebff780 1 > prepared multipart upload key=TDZCNUZE8IOA upload=IN1NDXUO8D0Y tag=GLHDNN2P2RJC type=write size=3514211 2024-09-12T17:07:55.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.733+0000 7f9eaebff780 1 < suggested remove operation key=CAIZM33SDFPM tag=KC3X7UZ383Z2 type=del 2024-09-12T17:07:55.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.735+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~0AY2FGYLS216.0 size=1048576 2024-09-12T17:07:55.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.736+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~0AY2FGYLS216.1 size=961681 2024-09-12T17:07:55.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.736+0000 7f9eaebff780 1 > prepared multipart upload key=SO6QF2JCRX6E upload=0AY2FGYLS216 tag=E16OM2U1AJ1D type=write size=3058833 2024-09-12T17:07:55.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.737+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~8541HLRHQTZG.0 size=1048576 2024-09-12T17:07:55.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.738+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~8541HLRHQTZG.1 size=768450 2024-09-12T17:07:55.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.740+0000 7f9eaebff780 1 < completed multipart upload key=K2NHRSUDQBRW upload=8541HLRHQTZG tag=H8NHHQR6QO4Q type=write size=2865602 2024-09-12T17:07:55.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.741+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=I84QUUEP6VML type=del size=55375 2024-09-12T17:07:55.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.743+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~D4VHJMFOL4U4.0 size=585766 2024-09-12T17:07:55.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.745+0000 7f9eaebff780 1 < completed multipart upload key=9WJGBODZ60NJ upload=D4VHJMFOL4U4 tag=V0VBHXHYY4VD type=write size=1634342 2024-09-12T17:07:55.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.747+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~ZGIOFLRWNOGZ.0 size=1048576 2024-09-12T17:07:55.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.748+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~ZGIOFLRWNOGZ.1 size=394765 2024-09-12T17:07:55.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.748+0000 7f9eaebff780 1 > prepared multipart upload key=9I6RGNRB6HSY upload=ZGIOFLRWNOGZ tag=ULD6CHCA6Q60 type=write size=2491917 2024-09-12T17:07:55.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.749+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~4MI65TRND0VZ.0 size=1048576 2024-09-12T17:07:55.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.750+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~4MI65TRND0VZ.1 size=468363 2024-09-12T17:07:55.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.752+0000 7f9eaebff780 1 < completed multipart upload key=CAIZM33SDFPM upload=4MI65TRND0VZ tag=6WGJR6FUF19U type=write size=2565515 2024-09-12T17:07:55.756 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.753+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=3XMA2ZPWRF52 type=del size=3438139 2024-09-12T17:07:55.756 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.754+0000 7f9eaebff780 1 < canceled part key=_multipart_0YD5P1ACZ09Q.2~7RWAB5D8NU10.0 size=1048576 2024-09-12T17:07:55.756 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.755+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~7RWAB5D8NU10.1 size=1048576 2024-09-12T17:07:55.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.756+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~7RWAB5D8NU10.2 size=52035 2024-09-12T17:07:55.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.758+0000 7f9eaebff780 1 < canceled multipart upload key=0YD5P1ACZ09Q upload=7RWAB5D8NU10 tag=KCBSFOACGRKC type=write size=3197763 2024-09-12T17:07:55.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.760+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~AIRWF9NFS8KW.0 size=1048576 2024-09-12T17:07:55.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.761+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~AIRWF9NFS8KW.1 size=1048576 2024-09-12T17:07:55.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.762+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~AIRWF9NFS8KW.2 size=257777 2024-09-12T17:07:55.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.762+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=AIRWF9NFS8KW tag=TA9ME4V8J21T type=write size=3403505 2024-09-12T17:07:55.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.763+0000 7f9eaebff780 1 < completed delete operation key=YIEP2JYDSLW0 tag=L1YTH8MPU23W type=del 2024-09-12T17:07:55.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.764+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=PM0VH20HR38R type=del size=2605645 2024-09-12T17:07:55.767 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.765+0000 7f9eaebff780 1 < completed delete operation key=0F5LXJZMBFSP tag=OVA2AOZBNOSK type=del 2024-09-12T17:07:55.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.768+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~HWX6XA1V0SX9.0 size=1048576 2024-09-12T17:07:55.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.769+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~HWX6XA1V0SX9.1 size=747672 2024-09-12T17:07:55.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.769+0000 7f9eaebff780 1 > prepared multipart upload key=CAIZM33SDFPM upload=HWX6XA1V0SX9 tag=5TXWCE3WONNU type=write size=2844824 2024-09-12T17:07:55.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.771+0000 7f9eaebff780 1 < suggested remove operation key=TDZCNUZE8IOA tag=9CRKW447SEUZ type=del 2024-09-12T17:07:55.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.773+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~2KD4FCONXQ5H.0 size=358561 2024-09-12T17:07:55.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.773+0000 7f9eaebff780 1 > prepared multipart upload key=0YD5P1ACZ09Q upload=2KD4FCONXQ5H tag=WIF5FPCMEAYE type=write size=1407137 2024-09-12T17:07:55.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.774+0000 7f9eaebff780 1 < completed delete operation key=EKUW5AKC428U tag=23ZBJ5S7DMKG type=del 2024-09-12T17:07:55.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.776+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=9KQU06KYF1TD type=del size=1461918 2024-09-12T17:07:55.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.777+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~HQAYQAEA13JO.0 size=1048576 2024-09-12T17:07:55.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.778+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~HQAYQAEA13JO.1 size=1002631 2024-09-12T17:07:55.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.780+0000 7f9eaebff780 1 < completed multipart upload key=ZC814TPVLJO1 upload=HQAYQAEA13JO tag=R6FFOVY1WU6D type=write size=3099783 2024-09-12T17:07:55.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.782+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~O1YBUY8M9CEB.0 size=1048576 2024-09-12T17:07:55.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.783+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~O1YBUY8M9CEB.1 size=1048576 2024-09-12T17:07:55.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.784+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~O1YBUY8M9CEB.2 size=872994 2024-09-12T17:07:55.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.784+0000 7f9eaebff780 1 > prepared multipart upload key=9I6RGNRB6HSY upload=O1YBUY8M9CEB tag=9WGEL36OQ5RI type=write size=4018722 2024-09-12T17:07:55.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.785+0000 7f9eaebff780 -1 < failed to complete operation key=CAIZM33SDFPM tag=NFO5UHCTVC6P type=del size=2462469: (22) Invalid argument 2024-09-12T17:07:55.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.787+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=HZ3RHVOXJR0J type=write size=682155 2024-09-12T17:07:55.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.789+0000 7f9eaebff780 1 < suggested update operation key=9I6RGNRB6HSY tag=Q2RK5ZSX5JFF type=del size=3988262 2024-09-12T17:07:55.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.790+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=3IJ1IFOR7GCY type=del size=206088 2024-09-12T17:07:55.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.793+0000 7f9eaebff780 1 < suggested update operation key=P9GMGM3WK6O7 tag=WDAL6Q3GAA28 type=del size=511741 2024-09-12T17:07:55.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.794+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=G0MU0GPGAGU2 type=del size=3332681 2024-09-12T17:07:55.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.796+0000 7f9eaebff780 -1 < failed to complete operation key=TDZCNUZE8IOA tag=YD81HK18BDQX type=del size=3512863: (22) Invalid argument 2024-09-12T17:07:55.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.797+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=4B4DWA1045HA type=del size=484460 2024-09-12T17:07:55.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.798+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~739AZDWTNXYG.0 size=1048576 2024-09-12T17:07:55.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.799+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~739AZDWTNXYG.1 size=644750 2024-09-12T17:07:55.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.801+0000 7f9eaebff780 1 < completed multipart upload key=UYF1AN2W59VN upload=739AZDWTNXYG tag=0DSE2S1JT667 type=write size=2741902 2024-09-12T17:07:55.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.804+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~T8RQ5RA3NKEV.0 size=954624 2024-09-12T17:07:55.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.804+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=T8RQ5RA3NKEV tag=3J7VR11AK08B type=write size=2003200 2024-09-12T17:07:55.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.805+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~IN1NDXUO8D0Y.0 size=1048576 2024-09-12T17:07:55.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.806+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~IN1NDXUO8D0Y.1 size=1048576 2024-09-12T17:07:55.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.807+0000 7f9eaebff780 1 < completed part key=_multipart_TDZCNUZE8IOA.2~IN1NDXUO8D0Y.2 size=368483 2024-09-12T17:07:55.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.809+0000 7f9eaebff780 1 < completed multipart upload key=TDZCNUZE8IOA upload=IN1NDXUO8D0Y tag=GLHDNN2P2RJC type=write size=3514211 2024-09-12T17:07:55.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.810+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=8Z42LC1OXRKR type=del size=3866381 2024-09-12T17:07:55.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.811+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~0AY2FGYLS216.0 size=1048576 2024-09-12T17:07:55.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.812+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~0AY2FGYLS216.1 size=961681 2024-09-12T17:07:55.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.814+0000 7f9eaebff780 1 < completed multipart upload key=SO6QF2JCRX6E upload=0AY2FGYLS216 tag=E16OM2U1AJ1D type=write size=3058833 2024-09-12T17:07:55.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.816+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~QRVCV83D9ZSU.0 size=156224 2024-09-12T17:07:55.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.816+0000 7f9eaebff780 1 > prepared multipart upload key=9I6RGNRB6HSY upload=QRVCV83D9ZSU tag=M0GOJM6UAMLT type=write size=1204800 2024-09-12T17:07:55.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.818+0000 7f9eaebff780 1 < completed delete operation key=EKUW5AKC428U tag=I84QUUEP6VML type=del 2024-09-12T17:07:55.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.820+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~NH5HSXFN2933.0 size=1048576 2024-09-12T17:07:55.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.821+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~NH5HSXFN2933.1 size=1048576 2024-09-12T17:07:55.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.822+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~NH5HSXFN2933.2 size=541054 2024-09-12T17:07:55.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.822+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=NH5HSXFN2933 tag=7HZTBFPT0ALO type=write size=3686782 2024-09-12T17:07:55.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.823+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~ZGIOFLRWNOGZ.0 size=1048576 2024-09-12T17:07:55.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.825+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~ZGIOFLRWNOGZ.1 size=394765 2024-09-12T17:07:55.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.827+0000 7f9eaebff780 1 < completed multipart upload key=9I6RGNRB6HSY upload=ZGIOFLRWNOGZ tag=ULD6CHCA6Q60 type=write size=2491917 2024-09-12T17:07:55.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.828+0000 7f9eaebff780 1 > prepared operation key=CAIZM33SDFPM tag=RIXHKB4FINZI type=del size=695486 2024-09-12T17:07:55.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.829+0000 7f9eaebff780 1 < completed delete operation key=QIMNK4DL3D0N tag=3XMA2ZPWRF52 type=del 2024-09-12T17:07:55.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.832+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=PV75AABUOKNH type=del size=1911801 2024-09-12T17:07:55.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.833+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~AIRWF9NFS8KW.0 size=1048576 2024-09-12T17:07:55.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.834+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~AIRWF9NFS8KW.1 size=1048576 2024-09-12T17:07:55.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.835+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~AIRWF9NFS8KW.2 size=257777 2024-09-12T17:07:55.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.837+0000 7f9eaebff780 1 < completed multipart upload key=M3PLQGSK34YM upload=AIRWF9NFS8KW tag=TA9ME4V8J21T type=write size=3403505 2024-09-12T17:07:55.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.839+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~2N25YE79PIWZ.0 size=408457 2024-09-12T17:07:55.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.839+0000 7f9eaebff780 1 > prepared multipart upload key=CAIZM33SDFPM upload=2N25YE79PIWZ tag=RUPMXS77KAP0 type=write size=1457033 2024-09-12T17:07:55.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.840+0000 7f9eaebff780 1 < canceled operation key=KF8XE48DI9KZ tag=PM0VH20HR38R type=del size=2605645 2024-09-12T17:07:55.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.842+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=54KSCQ5MXMAN type=del size=2345441 2024-09-12T17:07:55.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.842+0000 7f9eaebff780 1 < canceled part key=_multipart_CAIZM33SDFPM.2~HWX6XA1V0SX9.0 size=1048576 2024-09-12T17:07:55.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.843+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~HWX6XA1V0SX9.1 size=747672 2024-09-12T17:07:55.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.845+0000 7f9eaebff780 1 < canceled multipart upload key=CAIZM33SDFPM upload=HWX6XA1V0SX9 tag=5TXWCE3WONNU type=write size=2844824 2024-09-12T17:07:55.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.847+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~WDAIY4XY6RS3.0 size=1048576 2024-09-12T17:07:55.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.848+0000 7f9eaebff780 1 > prepared part key=_multipart_7PBT9VZ07OUI.2~WDAIY4XY6RS3.1 size=497898 2024-09-12T17:07:55.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.848+0000 7f9eaebff780 1 > prepared multipart upload key=7PBT9VZ07OUI upload=WDAIY4XY6RS3 tag=UH43EOE2GAF1 type=write size=2595050 2024-09-12T17:07:55.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.849+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~2KD4FCONXQ5H.0 size=358561 2024-09-12T17:07:55.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.851+0000 7f9eaebff780 1 < completed multipart upload key=0YD5P1ACZ09Q upload=2KD4FCONXQ5H tag=WIF5FPCMEAYE type=write size=1407137 2024-09-12T17:07:55.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.852+0000 7f9eaebff780 1 > prepared operation key=SHWT6AT7PN0M tag=EL2FUQ56AVHD type=write size=841207 2024-09-12T17:07:55.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.855+0000 7f9eaebff780 1 < suggested remove operation key=OGD6H9VSVGWF tag=9KQU06KYF1TD type=del 2024-09-12T17:07:55.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.856+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=OFG798QHT3UU type=write size=174522 2024-09-12T17:07:55.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.857+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~O1YBUY8M9CEB.0 size=1048576 2024-09-12T17:07:55.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.858+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~O1YBUY8M9CEB.1 size=1048576 2024-09-12T17:07:55.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.859+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~O1YBUY8M9CEB.2 size=872994 2024-09-12T17:07:55.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.861+0000 7f9eaebff780 1 < completed multipart upload key=9I6RGNRB6HSY upload=O1YBUY8M9CEB tag=9WGEL36OQ5RI type=write size=4018722 2024-09-12T17:07:55.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.863+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~QLS64WW7S0OP.0 size=1048576 2024-09-12T17:07:55.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.864+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~QLS64WW7S0OP.1 size=1048576 2024-09-12T17:07:55.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.865+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~QLS64WW7S0OP.2 size=386465 2024-09-12T17:07:55.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.865+0000 7f9eaebff780 1 > prepared multipart upload key=QIMNK4DL3D0N upload=QLS64WW7S0OP tag=HXEDS0VMZGXC type=write size=3532193 2024-09-12T17:07:55.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.867+0000 7f9eaebff780 1 < suggested remove operation key=SHWT6AT7PN0M tag=HZ3RHVOXJR0J type=write 2024-09-12T17:07:55.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.868+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=X37GSKPLIZKD type=write size=284424 2024-09-12T17:07:55.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.870+0000 7f9eaebff780 1 < completed delete operation key=K2NHRSUDQBRW tag=3IJ1IFOR7GCY type=del 2024-09-12T17:07:55.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.871+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=CJD15O9ZZMJP type=del size=4053768 2024-09-12T17:07:55.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.873+0000 7f9eaebff780 1 < suggested update operation key=M3PLQGSK34YM tag=G0MU0GPGAGU2 type=del size=3332681 2024-09-12T17:07:55.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.874+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=EHEJL98IW50Z type=del size=271527 2024-09-12T17:07:55.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.875+0000 7f9eaebff780 1 < completed delete operation key=UYF1AN2W59VN tag=4B4DWA1045HA type=del 2024-09-12T17:07:55.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.876+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=JXCX1Y46FM4T type=write size=536133 2024-09-12T17:07:55.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.877+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~T8RQ5RA3NKEV.0 size=954624 2024-09-12T17:07:55.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.879+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=T8RQ5RA3NKEV tag=3J7VR11AK08B type=write size=2003200 2024-09-12T17:07:55.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.880+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=9Q2GKMKQDAAD type=del size=3117459 2024-09-12T17:07:55.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.881+0000 7f9eaebff780 1 < completed delete operation key=OH6GXTMPBYUY tag=8Z42LC1OXRKR type=del 2024-09-12T17:07:55.884 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.882+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=K0WCVNKPLKUO type=del size=13048 2024-09-12T17:07:55.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.884+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~QRVCV83D9ZSU.0 size=156224 2024-09-12T17:07:55.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.885+0000 7f9eaebff780 1 < completed multipart upload key=9I6RGNRB6HSY upload=QRVCV83D9ZSU tag=M0GOJM6UAMLT type=write size=1204800 2024-09-12T17:07:55.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.887+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~77H4KFZVVQ2Q.0 size=1048576 2024-09-12T17:07:55.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.888+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~77H4KFZVVQ2Q.1 size=1048576 2024-09-12T17:07:55.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.889+0000 7f9eaebff780 1 > prepared part key=_multipart_ZC814TPVLJO1.2~77H4KFZVVQ2Q.2 size=530830 2024-09-12T17:07:55.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.889+0000 7f9eaebff780 1 > prepared multipart upload key=ZC814TPVLJO1 upload=77H4KFZVVQ2Q tag=LJF3DO48PTJ7 type=write size=3676558 2024-09-12T17:07:55.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.890+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~NH5HSXFN2933.0 size=1048576 2024-09-12T17:07:55.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.890+0000 7f9eaebff780 1 < canceled part key=_multipart_K0P9ZZ91UJJ8.2~NH5HSXFN2933.1 size=1048576 2024-09-12T17:07:55.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.891+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~NH5HSXFN2933.2 size=541054 2024-09-12T17:07:55.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.893+0000 7f9eaebff780 1 < canceled multipart upload key=K0P9ZZ91UJJ8 upload=NH5HSXFN2933 tag=7HZTBFPT0ALO type=write size=3686782 2024-09-12T17:07:55.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.894+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=F0FMHEF3FTVA type=del size=3627996 2024-09-12T17:07:55.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.895+0000 7f9eaebff780 1 < completed delete operation key=CAIZM33SDFPM tag=RIXHKB4FINZI type=del 2024-09-12T17:07:55.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.897+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=VTUG1OWICNSK type=del size=119185 2024-09-12T17:07:55.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.898+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=PV75AABUOKNH type=del 2024-09-12T17:07:55.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.900+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~DENUEQO9NZ23.0 size=1048576 2024-09-12T17:07:55.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.901+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~DENUEQO9NZ23.1 size=176786 2024-09-12T17:07:55.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.901+0000 7f9eaebff780 1 > prepared multipart upload key=B1YC6DM9S8JJ upload=DENUEQO9NZ23 tag=LLE1LZOBIGXE type=write size=2273938 2024-09-12T17:07:55.903 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.902+0000 7f9eaebff780 1 < completed part key=_multipart_CAIZM33SDFPM.2~2N25YE79PIWZ.0 size=408457 2024-09-12T17:07:55.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.904+0000 7f9eaebff780 1 < completed multipart upload key=CAIZM33SDFPM upload=2N25YE79PIWZ tag=RUPMXS77KAP0 type=write size=1457033 2024-09-12T17:07:55.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.906+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~DE3IT1J1ZEM1.0 size=1048576 2024-09-12T17:07:55.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.907+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~DE3IT1J1ZEM1.1 size=1048576 2024-09-12T17:07:55.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.908+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~DE3IT1J1ZEM1.2 size=40083 2024-09-12T17:07:55.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.908+0000 7f9eaebff780 1 > prepared multipart upload key=9WJGBODZ60NJ upload=DE3IT1J1ZEM1 tag=UNUTLEAWZ20B type=write size=3185811 2024-09-12T17:07:55.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.909+0000 7f9eaebff780 1 < completed delete operation key=K2NHRSUDQBRW tag=54KSCQ5MXMAN type=del 2024-09-12T17:07:55.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.911+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~O5KOB2KQFY2O.0 size=1048576 2024-09-12T17:07:55.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.912+0000 7f9eaebff780 1 > prepared part key=_multipart_LRI5G5G8O5X4.2~O5KOB2KQFY2O.1 size=931280 2024-09-12T17:07:55.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.912+0000 7f9eaebff780 1 > prepared multipart upload key=LRI5G5G8O5X4 upload=O5KOB2KQFY2O tag=RA67SWR8LFX2 type=write size=3028432 2024-09-12T17:07:55.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.913+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~WDAIY4XY6RS3.0 size=1048576 2024-09-12T17:07:55.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.914+0000 7f9eaebff780 1 < completed part key=_multipart_7PBT9VZ07OUI.2~WDAIY4XY6RS3.1 size=497898 2024-09-12T17:07:55.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.916+0000 7f9eaebff780 1 < completed multipart upload key=7PBT9VZ07OUI upload=WDAIY4XY6RS3 tag=UH43EOE2GAF1 type=write size=2595050 2024-09-12T17:07:55.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.917+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=2BHHLZRORK27 type=del size=2027617 2024-09-12T17:07:55.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.918+0000 7f9eaebff780 -1 < failed to complete operation key=SHWT6AT7PN0M tag=EL2FUQ56AVHD type=write size=841207: (22) Invalid argument 2024-09-12T17:07:55.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.919+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=6AHGFIP96F3U type=del size=3884150 2024-09-12T17:07:55.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.921+0000 7f9eaebff780 1 < completed write operation key=EKUW5AKC428U tag=OFG798QHT3UU type=write size=174522 2024-09-12T17:07:55.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.922+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=H5W11YB6PMDO type=del size=3792715 2024-09-12T17:07:55.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.923+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~QLS64WW7S0OP.0 size=1048576 2024-09-12T17:07:55.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.923+0000 7f9eaebff780 1 < canceled part key=_multipart_QIMNK4DL3D0N.2~QLS64WW7S0OP.1 size=1048576 2024-09-12T17:07:55.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.924+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~QLS64WW7S0OP.2 size=386465 2024-09-12T17:07:55.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.926+0000 7f9eaebff780 1 < canceled multipart upload key=QIMNK4DL3D0N upload=QLS64WW7S0OP tag=HXEDS0VMZGXC type=write size=3532193 2024-09-12T17:07:55.928 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.927+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=2UACQKEBTIC0 type=del size=1363256 2024-09-12T17:07:55.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.928+0000 7f9eaebff780 1 < canceled operation key=3LY681252WAN tag=X37GSKPLIZKD type=write size=284424 2024-09-12T17:07:55.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.929+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=JLPXY0N39URX type=del size=2575093 2024-09-12T17:07:55.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.930+0000 7f9eaebff780 1 < completed delete operation key=UYF1AN2W59VN tag=CJD15O9ZZMJP type=del 2024-09-12T17:07:55.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.933+0000 7f9eaebff780 1 > prepared part key=_multipart_KF8XE48DI9KZ.2~IJ6ZTF92XZ80.0 size=926341 2024-09-12T17:07:55.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.933+0000 7f9eaebff780 1 > prepared multipart upload key=KF8XE48DI9KZ upload=IJ6ZTF92XZ80 tag=SJAVESYEKDVO type=write size=1974917 2024-09-12T17:07:55.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.935+0000 7f9eaebff780 1 < suggested remove operation key=7PBT9VZ07OUI tag=EHEJL98IW50Z type=del 2024-09-12T17:07:55.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.937+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~YTKO66YLEFH1.0 size=436900 2024-09-12T17:07:55.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.937+0000 7f9eaebff780 1 > prepared multipart upload key=9I6RGNRB6HSY upload=YTKO66YLEFH1 tag=N3PW0YRBIYH0 type=write size=1485476 2024-09-12T17:07:55.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.939+0000 7f9eaebff780 1 < completed write operation key=8DJLYFM11DNI tag=JXCX1Y46FM4T type=write size=536133 2024-09-12T17:07:55.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.940+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=T7EXE93N3HD5 type=del size=3880412 2024-09-12T17:07:55.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.941+0000 7f9eaebff780 1 < completed delete operation key=TXHXOMIB4B53 tag=9Q2GKMKQDAAD type=del 2024-09-12T17:07:55.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.944+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~JIIKD56FNSPO.0 size=978076 2024-09-12T17:07:55.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.944+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=JIIKD56FNSPO tag=62LR5MTYVH9M type=write size=2026652 2024-09-12T17:07:55.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.946+0000 7f9eaebff780 1 < suggested update operation key=LJN514F16XJA tag=K0WCVNKPLKUO type=del size=13048 2024-09-12T17:07:55.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.948+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~OV8CPRWJZD46.0 size=1048576 2024-09-12T17:07:55.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.949+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~OV8CPRWJZD46.1 size=1048576 2024-09-12T17:07:55.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.950+0000 7f9eaebff780 1 > prepared part key=_multipart_YIEP2JYDSLW0.2~OV8CPRWJZD46.2 size=721187 2024-09-12T17:07:55.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.950+0000 7f9eaebff780 1 > prepared multipart upload key=YIEP2JYDSLW0 upload=OV8CPRWJZD46 tag=5A9E9RKSHXD8 type=write size=3866915 2024-09-12T17:07:55.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.951+0000 7f9eaebff780 1 < completed part key=_multipart_ZC814TPVLJO1.2~77H4KFZVVQ2Q.0 size=1048576 2024-09-12T17:07:55.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.951+0000 7f9eaebff780 1 < canceled part key=_multipart_ZC814TPVLJO1.2~77H4KFZVVQ2Q.1 size=1048576 2024-09-12T17:07:55.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.951+0000 7f9eaebff780 1 < canceled part key=_multipart_ZC814TPVLJO1.2~77H4KFZVVQ2Q.2 size=530830 2024-09-12T17:07:55.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.953+0000 7f9eaebff780 1 < canceled multipart upload key=ZC814TPVLJO1 upload=77H4KFZVVQ2Q tag=LJF3DO48PTJ7 type=write size=3676558 2024-09-12T17:07:55.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.956+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~1N49QT1E0QQ4.0 size=1048576 2024-09-12T17:07:55.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.957+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~1N49QT1E0QQ4.1 size=1048576 2024-09-12T17:07:55.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.958+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~1N49QT1E0QQ4.2 size=221526 2024-09-12T17:07:55.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.958+0000 7f9eaebff780 1 > prepared multipart upload key=A1KRCFY18QTP upload=1N49QT1E0QQ4 tag=JDDD01Z9GNZ8 type=write size=3367254 2024-09-12T17:07:55.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.959+0000 7f9eaebff780 1 < completed delete operation key=K0P9ZZ91UJJ8 tag=F0FMHEF3FTVA type=del 2024-09-12T17:07:55.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.961+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~OCDC51CQ1HBA.0 size=1048576 2024-09-12T17:07:55.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.962+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~OCDC51CQ1HBA.1 size=1048576 2024-09-12T17:07:55.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.963+0000 7f9eaebff780 1 > prepared part key=_multipart_A1KRCFY18QTP.2~OCDC51CQ1HBA.2 size=722289 2024-09-12T17:07:55.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.963+0000 7f9eaebff780 1 > prepared multipart upload key=A1KRCFY18QTP upload=OCDC51CQ1HBA tag=6GXYZ214HYNZ type=write size=3868017 2024-09-12T17:07:55.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.965+0000 7f9eaebff780 1 < suggested remove operation key=9I6RGNRB6HSY tag=VTUG1OWICNSK type=del 2024-09-12T17:07:55.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.967+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=BCSUJU0NS0LO type=del size=2774602 2024-09-12T17:07:55.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.968+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~DENUEQO9NZ23.0 size=1048576 2024-09-12T17:07:55.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.969+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~DENUEQO9NZ23.1 size=176786 2024-09-12T17:07:55.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.971+0000 7f9eaebff780 1 < completed multipart upload key=B1YC6DM9S8JJ upload=DENUEQO9NZ23 tag=LLE1LZOBIGXE type=write size=2273938 2024-09-12T17:07:55.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.972+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=VICRSVBMH20V type=del size=2599076 2024-09-12T17:07:55.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.974+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~DE3IT1J1ZEM1.0 size=1048576 2024-09-12T17:07:55.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.975+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~DE3IT1J1ZEM1.1 size=1048576 2024-09-12T17:07:55.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.976+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~DE3IT1J1ZEM1.2 size=40083 2024-09-12T17:07:55.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.978+0000 7f9eaebff780 1 < completed multipart upload key=9WJGBODZ60NJ upload=DE3IT1J1ZEM1 tag=UNUTLEAWZ20B type=write size=3185811 2024-09-12T17:07:55.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.979+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=CFW4SD7Z2ZHL type=del size=2986278 2024-09-12T17:07:55.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.980+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~O5KOB2KQFY2O.0 size=1048576 2024-09-12T17:07:55.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.981+0000 7f9eaebff780 1 < completed part key=_multipart_LRI5G5G8O5X4.2~O5KOB2KQFY2O.1 size=931280 2024-09-12T17:07:55.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.983+0000 7f9eaebff780 1 < completed multipart upload key=LRI5G5G8O5X4 upload=O5KOB2KQFY2O tag=RA67SWR8LFX2 type=write size=3028432 2024-09-12T17:07:55.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.984+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=7HT6EGCVBF3F type=del size=3668508 2024-09-12T17:07:55.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.985+0000 7f9eaebff780 1 < completed delete operation key=GB8P7K59Y8VI tag=2BHHLZRORK27 type=del 2024-09-12T17:07:55.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.987+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=5PPW8SS6N7DH type=write size=751209 2024-09-12T17:07:55.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.989+0000 7f9eaebff780 1 < suggested remove operation key=LJN514F16XJA tag=6AHGFIP96F3U type=del 2024-09-12T17:07:55.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.990+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=9AM41KC6IKC3 type=del size=624967 2024-09-12T17:07:55.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.991+0000 7f9eaebff780 1 < completed delete operation key=3LY681252WAN tag=H5W11YB6PMDO type=del 2024-09-12T17:07:55.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.992+0000 7f9eaebff780 1 > prepared operation key=0F5LXJZMBFSP tag=DNYUFAW5FISU type=del size=2255166 2024-09-12T17:07:55.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.993+0000 7f9eaebff780 -1 < failed to complete operation key=LJN514F16XJA tag=2UACQKEBTIC0 type=del size=1363256: (22) Invalid argument 2024-09-12T17:07:55.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.995+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=XZZWA5VBWD0V type=del size=1165333 2024-09-12T17:07:55.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.996+0000 7f9eaebff780 1 < completed delete operation key=EKUW5AKC428U tag=JLPXY0N39URX type=del 2024-09-12T17:07:55.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.997+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=9KH27BH0KMXT type=del size=4156457 2024-09-12T17:07:56.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:55.998+0000 7f9eaebff780 1 < completed part key=_multipart_KF8XE48DI9KZ.2~IJ6ZTF92XZ80.0 size=926341 2024-09-12T17:07:56.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.000+0000 7f9eaebff780 1 < completed multipart upload key=KF8XE48DI9KZ upload=IJ6ZTF92XZ80 tag=SJAVESYEKDVO type=write size=1974917 2024-09-12T17:07:56.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.002+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~M9N74JX9OJAM.0 size=1048576 2024-09-12T17:07:56.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.003+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~M9N74JX9OJAM.1 size=1048576 2024-09-12T17:07:56.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.004+0000 7f9eaebff780 1 > prepared part key=_multipart_UYF1AN2W59VN.2~M9N74JX9OJAM.2 size=192658 2024-09-12T17:07:56.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.004+0000 7f9eaebff780 1 > prepared multipart upload key=UYF1AN2W59VN upload=M9N74JX9OJAM tag=27ZUF30JPNI3 type=write size=3338386 2024-09-12T17:07:56.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.005+0000 7f9eaebff780 1 < completed part key=_multipart_9I6RGNRB6HSY.2~YTKO66YLEFH1.0 size=436900 2024-09-12T17:07:56.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.007+0000 7f9eaebff780 1 < completed multipart upload key=9I6RGNRB6HSY upload=YTKO66YLEFH1 tag=N3PW0YRBIYH0 type=write size=1485476 2024-09-12T17:07:56.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.009+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=NT7UTI95ATGL type=write size=736307 2024-09-12T17:07:56.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.010+0000 7f9eaebff780 -1 < failed to complete operation key=LJN514F16XJA tag=T7EXE93N3HD5 type=del size=3880412: (22) Invalid argument 2024-09-12T17:07:56.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.012+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~HC0P53M6QKRX.0 size=1048576 2024-09-12T17:07:56.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.013+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~HC0P53M6QKRX.1 size=1048576 2024-09-12T17:07:56.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.014+0000 7f9eaebff780 1 > prepared part key=_multipart_OH6GXTMPBYUY.2~HC0P53M6QKRX.2 size=783612 2024-09-12T17:07:56.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.014+0000 7f9eaebff780 1 > prepared multipart upload key=OH6GXTMPBYUY upload=HC0P53M6QKRX tag=06LT2OHOOJKT type=write size=3929340 2024-09-12T17:07:56.017 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.015+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~JIIKD56FNSPO.0 size=978076 2024-09-12T17:07:56.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.017+0000 7f9eaebff780 1 < completed multipart upload key=K2NHRSUDQBRW upload=JIIKD56FNSPO tag=62LR5MTYVH9M type=write size=2026652 2024-09-12T17:07:56.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.018+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=WUW4VS4DGNB3 type=del size=3151039 2024-09-12T17:07:56.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.019+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~OV8CPRWJZD46.0 size=1048576 2024-09-12T17:07:56.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.020+0000 7f9eaebff780 1 < completed part key=_multipart_YIEP2JYDSLW0.2~OV8CPRWJZD46.1 size=1048576 2024-09-12T17:07:56.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.020+0000 7f9eaebff780 1 < canceled part key=_multipart_YIEP2JYDSLW0.2~OV8CPRWJZD46.2 size=721187 2024-09-12T17:07:56.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.022+0000 7f9eaebff780 1 < canceled multipart upload key=YIEP2JYDSLW0 upload=OV8CPRWJZD46 tag=5A9E9RKSHXD8 type=write size=3866915 2024-09-12T17:07:56.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.025+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~IYIEADH1M25R.0 size=236412 2024-09-12T17:07:56.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.025+0000 7f9eaebff780 1 > prepared multipart upload key=EKUW5AKC428U upload=IYIEADH1M25R tag=83ME9SL8MHC1 type=write size=1284988 2024-09-12T17:07:56.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.025+0000 7f9eaebff780 1 < canceled part key=_multipart_A1KRCFY18QTP.2~1N49QT1E0QQ4.0 size=1048576 2024-09-12T17:07:56.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.025+0000 7f9eaebff780 1 < canceled part key=_multipart_A1KRCFY18QTP.2~1N49QT1E0QQ4.1 size=1048576 2024-09-12T17:07:56.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.026+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~1N49QT1E0QQ4.2 size=221526 2024-09-12T17:07:56.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.028+0000 7f9eaebff780 1 < canceled multipart upload key=A1KRCFY18QTP upload=1N49QT1E0QQ4 tag=JDDD01Z9GNZ8 type=write size=3367254 2024-09-12T17:07:56.030 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.029+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=OB4NRS0DPCY7 type=del size=835522 2024-09-12T17:07:56.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.030+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~OCDC51CQ1HBA.0 size=1048576 2024-09-12T17:07:56.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.030+0000 7f9eaebff780 1 < canceled part key=_multipart_A1KRCFY18QTP.2~OCDC51CQ1HBA.1 size=1048576 2024-09-12T17:07:56.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.031+0000 7f9eaebff780 1 < completed part key=_multipart_A1KRCFY18QTP.2~OCDC51CQ1HBA.2 size=722289 2024-09-12T17:07:56.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.033+0000 7f9eaebff780 1 < canceled multipart upload key=A1KRCFY18QTP upload=OCDC51CQ1HBA tag=6GXYZ214HYNZ type=write size=3868017 2024-09-12T17:07:56.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.036+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~HWWY9KV2Q0EH.0 size=1048576 2024-09-12T17:07:56.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.036+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~HWWY9KV2Q0EH.1 size=41269 2024-09-12T17:07:56.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.036+0000 7f9eaebff780 1 > prepared multipart upload key=SO6QF2JCRX6E upload=HWWY9KV2Q0EH tag=DEES4PG5BT3M type=write size=2138421 2024-09-12T17:07:56.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.039+0000 7f9eaebff780 1 < suggested update operation key=KF8XE48DI9KZ tag=BCSUJU0NS0LO type=del size=2774602 2024-09-12T17:07:56.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.040+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=68YPSXPVBZOF type=del size=1758458 2024-09-12T17:07:56.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.041+0000 7f9eaebff780 1 < completed delete operation key=0F5LXJZMBFSP tag=VICRSVBMH20V type=del 2024-09-12T17:07:56.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.042+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=MHAB4NS5VY6A type=write size=865132 2024-09-12T17:07:56.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.044+0000 7f9eaebff780 1 < completed delete operation key=OGD6H9VSVGWF tag=CFW4SD7Z2ZHL type=del 2024-09-12T17:07:56.046 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.045+0000 7f9eaebff780 1 > prepared operation key=LJN514F16XJA tag=CE6P1HC9C7NY type=del size=404456 2024-09-12T17:07:56.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.046+0000 7f9eaebff780 1 < completed delete operation key=LRI5G5G8O5X4 tag=7HT6EGCVBF3F type=del 2024-09-12T17:07:56.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.048+0000 7f9eaebff780 1 > prepared part key=_multipart_TXHXOMIB4B53.2~TJAG5DF6NRVE.0 size=1048576 2024-09-12T17:07:56.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.050+0000 7f9eaebff780 1 > prepared part key=_multipart_TXHXOMIB4B53.2~TJAG5DF6NRVE.1 size=1048576 2024-09-12T17:07:56.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.051+0000 7f9eaebff780 1 > prepared part key=_multipart_TXHXOMIB4B53.2~TJAG5DF6NRVE.2 size=611206 2024-09-12T17:07:56.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.051+0000 7f9eaebff780 1 > prepared multipart upload key=TXHXOMIB4B53 upload=TJAG5DF6NRVE tag=F51FAAS1SM30 type=write size=3756934 2024-09-12T17:07:56.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.052+0000 7f9eaebff780 1 < canceled operation key=OGD6H9VSVGWF tag=5PPW8SS6N7DH type=write size=751209 2024-09-12T17:07:56.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.054+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~U7AG3KYMPST8.0 size=191502 2024-09-12T17:07:56.056 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.054+0000 7f9eaebff780 1 > prepared multipart upload key=SO6QF2JCRX6E upload=U7AG3KYMPST8 tag=K3BEA0K7I3PU type=write size=1240078 2024-09-12T17:07:56.056 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.055+0000 7f9eaebff780 1 < completed delete operation key=3VY271ZBO754 tag=9AM41KC6IKC3 type=del 2024-09-12T17:07:56.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.056+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=8QM8TKOTO58X type=write size=738306 2024-09-12T17:07:56.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.057+0000 7f9eaebff780 1 < completed delete operation key=0F5LXJZMBFSP tag=DNYUFAW5FISU type=del 2024-09-12T17:07:56.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.059+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~TYV4WHOVQD3C.0 size=1048576 2024-09-12T17:07:56.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.060+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~TYV4WHOVQD3C.1 size=1048576 2024-09-12T17:07:56.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.061+0000 7f9eaebff780 1 > prepared part key=_multipart_EKUW5AKC428U.2~TYV4WHOVQD3C.2 size=1023177 2024-09-12T17:07:56.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.061+0000 7f9eaebff780 1 > prepared multipart upload key=EKUW5AKC428U upload=TYV4WHOVQD3C tag=LF547G81Y25Z type=write size=4168905 2024-09-12T17:07:56.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.062+0000 7f9eaebff780 1 < completed delete operation key=GB8P7K59Y8VI tag=XZZWA5VBWD0V type=del 2024-09-12T17:07:56.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.066+0000 7f9eaebff780 1 > prepared part key=_multipart_8DJLYFM11DNI.2~CW8T7EHM3HOZ.0 size=202995 2024-09-12T17:07:56.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.066+0000 7f9eaebff780 1 > prepared multipart upload key=8DJLYFM11DNI upload=CW8T7EHM3HOZ tag=A7DQO9EK2H37 type=write size=1251571 2024-09-12T17:07:56.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.067+0000 7f9eaebff780 1 < completed delete operation key=SVWPQETL92QU tag=9KH27BH0KMXT type=del 2024-09-12T17:07:56.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.069+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~2Z2IEILQWDM4.0 size=1048576 2024-09-12T17:07:56.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.070+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~2Z2IEILQWDM4.1 size=620602 2024-09-12T17:07:56.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.070+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=2Z2IEILQWDM4 tag=08KA17MYKNZK type=write size=2717754 2024-09-12T17:07:56.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.071+0000 7f9eaebff780 1 < canceled part key=_multipart_UYF1AN2W59VN.2~M9N74JX9OJAM.0 size=1048576 2024-09-12T17:07:56.073 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.072+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~M9N74JX9OJAM.1 size=1048576 2024-09-12T17:07:56.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.073+0000 7f9eaebff780 1 < completed part key=_multipart_UYF1AN2W59VN.2~M9N74JX9OJAM.2 size=192658 2024-09-12T17:07:56.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.075+0000 7f9eaebff780 1 < canceled multipart upload key=UYF1AN2W59VN upload=M9N74JX9OJAM tag=27ZUF30JPNI3 type=write size=3338386 2024-09-12T17:07:56.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.076+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=F4GVJTUTL65D type=del size=1735682 2024-09-12T17:07:56.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.077+0000 7f9eaebff780 1 < completed write operation key=QIMNK4DL3D0N tag=NT7UTI95ATGL type=write size=736307 2024-09-12T17:07:56.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.078+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=KDPO9YN4Z64I type=del size=1354360 2024-09-12T17:07:56.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.079+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~HC0P53M6QKRX.0 size=1048576 2024-09-12T17:07:56.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.080+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~HC0P53M6QKRX.1 size=1048576 2024-09-12T17:07:56.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.081+0000 7f9eaebff780 1 < completed part key=_multipart_OH6GXTMPBYUY.2~HC0P53M6QKRX.2 size=783612 2024-09-12T17:07:56.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.083+0000 7f9eaebff780 1 < completed multipart upload key=OH6GXTMPBYUY upload=HC0P53M6QKRX tag=06LT2OHOOJKT type=write size=3929340 2024-09-12T17:07:56.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.085+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~HILL5H2U50PK.0 size=1048576 2024-09-12T17:07:56.087 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.086+0000 7f9eaebff780 1 > prepared part key=_multipart_M3PLQGSK34YM.2~HILL5H2U50PK.1 size=1032777 2024-09-12T17:07:56.087 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.086+0000 7f9eaebff780 1 > prepared multipart upload key=M3PLQGSK34YM upload=HILL5H2U50PK tag=V1W6DIJ2GPHG type=write size=3129929 2024-09-12T17:07:56.088 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.087+0000 7f9eaebff780 1 < completed delete operation key=OH6GXTMPBYUY tag=WUW4VS4DGNB3 type=del 2024-09-12T17:07:56.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.088+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=J94K2QCHNZYH type=write size=687800 2024-09-12T17:07:56.091 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.090+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~IYIEADH1M25R.0 size=236412 2024-09-12T17:07:56.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.091+0000 7f9eaebff780 1 < completed multipart upload key=EKUW5AKC428U upload=IYIEADH1M25R tag=83ME9SL8MHC1 type=write size=1284988 2024-09-12T17:07:56.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.093+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=DRB0MJ9FGQL1 type=del size=675051 2024-09-12T17:07:56.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.094+0000 7f9eaebff780 1 < completed delete operation key=7PBT9VZ07OUI tag=OB4NRS0DPCY7 type=del 2024-09-12T17:07:56.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.095+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=YAQ854UJBN6G type=del size=3233006 2024-09-12T17:07:56.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.097+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~HWWY9KV2Q0EH.0 size=1048576 2024-09-12T17:07:56.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.098+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~HWWY9KV2Q0EH.1 size=41269 2024-09-12T17:07:56.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.100+0000 7f9eaebff780 1 < completed multipart upload key=SO6QF2JCRX6E upload=HWWY9KV2Q0EH tag=DEES4PG5BT3M type=write size=2138421 2024-09-12T17:07:56.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.102+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~EL2GM1CU9DUB.0 size=1048576 2024-09-12T17:07:56.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.103+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~EL2GM1CU9DUB.1 size=637690 2024-09-12T17:07:56.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.103+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=EL2GM1CU9DUB tag=LK3RQD4WI1U3 type=write size=2734842 2024-09-12T17:07:56.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.104+0000 7f9eaebff780 1 < completed delete operation key=KF8XE48DI9KZ tag=68YPSXPVBZOF type=del 2024-09-12T17:07:56.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.105+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=KB1VGWP841E4 type=del size=759676 2024-09-12T17:07:56.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.108+0000 7f9eaebff780 1 < suggested update operation key=SVWPQETL92QU tag=MHAB4NS5VY6A type=write size=865132 2024-09-12T17:07:56.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.110+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~E1A473OCTNHW.0 size=1048576 2024-09-12T17:07:56.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.111+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~E1A473OCTNHW.1 size=1048576 2024-09-12T17:07:56.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.112+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~E1A473OCTNHW.2 size=2520 2024-09-12T17:07:56.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.112+0000 7f9eaebff780 1 > prepared multipart upload key=QIMNK4DL3D0N upload=E1A473OCTNHW tag=15KFRQT3JFX4 type=write size=3148248 2024-09-12T17:07:56.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.113+0000 7f9eaebff780 1 < completed delete operation key=LJN514F16XJA tag=CE6P1HC9C7NY type=del 2024-09-12T17:07:56.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.115+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~612YV6ELO21B.0 size=1048576 2024-09-12T17:07:56.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.116+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~612YV6ELO21B.1 size=288225 2024-09-12T17:07:56.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.116+0000 7f9eaebff780 1 > prepared multipart upload key=OGD6H9VSVGWF upload=612YV6ELO21B tag=HLFW7W81H547 type=write size=2385377 2024-09-12T17:07:56.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.117+0000 7f9eaebff780 1 < completed part key=_multipart_TXHXOMIB4B53.2~TJAG5DF6NRVE.0 size=1048576 2024-09-12T17:07:56.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.118+0000 7f9eaebff780 1 < completed part key=_multipart_TXHXOMIB4B53.2~TJAG5DF6NRVE.1 size=1048576 2024-09-12T17:07:56.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.119+0000 7f9eaebff780 1 < completed part key=_multipart_TXHXOMIB4B53.2~TJAG5DF6NRVE.2 size=611206 2024-09-12T17:07:56.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.121+0000 7f9eaebff780 1 < completed multipart upload key=TXHXOMIB4B53 upload=TJAG5DF6NRVE tag=F51FAAS1SM30 type=write size=3756934 2024-09-12T17:07:56.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.122+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=93VYKIK0G8YE type=write size=898286 2024-09-12T17:07:56.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.124+0000 7f9eaebff780 1 < completed part key=_multipart_SO6QF2JCRX6E.2~U7AG3KYMPST8.0 size=191502 2024-09-12T17:07:56.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.125+0000 7f9eaebff780 1 < completed multipart upload key=SO6QF2JCRX6E upload=U7AG3KYMPST8 tag=K3BEA0K7I3PU type=write size=1240078 2024-09-12T17:07:56.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.127+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=ANGP41M09P3V type=write size=937393 2024-09-12T17:07:56.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.128+0000 7f9eaebff780 1 < completed write operation key=QIMNK4DL3D0N tag=8QM8TKOTO58X type=write size=738306 2024-09-12T17:07:56.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.130+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~FW5IFZA0WOEK.0 size=1048576 2024-09-12T17:07:56.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.131+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~FW5IFZA0WOEK.1 size=271048 2024-09-12T17:07:56.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.131+0000 7f9eaebff780 1 > prepared multipart upload key=GB8P7K59Y8VI upload=FW5IFZA0WOEK tag=YJLZY0L1BW3H type=write size=2368200 2024-09-12T17:07:56.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.131+0000 7f9eaebff780 1 < canceled part key=_multipart_EKUW5AKC428U.2~TYV4WHOVQD3C.0 size=1048576 2024-09-12T17:07:56.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.132+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~TYV4WHOVQD3C.1 size=1048576 2024-09-12T17:07:56.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.133+0000 7f9eaebff780 1 < completed part key=_multipart_EKUW5AKC428U.2~TYV4WHOVQD3C.2 size=1023177 2024-09-12T17:07:56.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.135+0000 7f9eaebff780 1 < canceled multipart upload key=EKUW5AKC428U upload=TYV4WHOVQD3C tag=LF547G81Y25Z type=write size=4168905 2024-09-12T17:07:56.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.136+0000 7f9eaebff780 1 > prepared operation key=A1KRCFY18QTP tag=JTKMJREA4XJY type=del size=571799 2024-09-12T17:07:56.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.137+0000 7f9eaebff780 1 < completed part key=_multipart_8DJLYFM11DNI.2~CW8T7EHM3HOZ.0 size=202995 2024-09-12T17:07:56.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.139+0000 7f9eaebff780 1 < completed multipart upload key=8DJLYFM11DNI upload=CW8T7EHM3HOZ tag=A7DQO9EK2H37 type=write size=1251571 2024-09-12T17:07:56.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.141+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~VG2NN4N9SBSW.0 size=1048576 2024-09-12T17:07:56.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.142+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~VG2NN4N9SBSW.1 size=1048576 2024-09-12T17:07:56.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.143+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~VG2NN4N9SBSW.2 size=294523 2024-09-12T17:07:56.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.143+0000 7f9eaebff780 1 > prepared multipart upload key=9WJGBODZ60NJ upload=VG2NN4N9SBSW tag=2L141QYZ2XR6 type=write size=3440251 2024-09-12T17:07:56.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.144+0000 7f9eaebff780 1 < completed part key=_multipart_K2NHRSUDQBRW.2~2Z2IEILQWDM4.0 size=1048576 2024-09-12T17:07:56.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.144+0000 7f9eaebff780 1 < canceled part key=_multipart_K2NHRSUDQBRW.2~2Z2IEILQWDM4.1 size=620602 2024-09-12T17:07:56.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.146+0000 7f9eaebff780 1 < canceled multipart upload key=K2NHRSUDQBRW upload=2Z2IEILQWDM4 tag=08KA17MYKNZK type=write size=2717754 2024-09-12T17:07:56.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.147+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=I3KEQAVB8W50 type=del size=3059377 2024-09-12T17:07:56.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.150+0000 7f9eaebff780 1 < suggested remove operation key=ZC814TPVLJO1 tag=F4GVJTUTL65D type=del 2024-09-12T17:07:56.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.152+0000 7f9eaebff780 1 > prepared operation key=8DJLYFM11DNI tag=9NMPIEPKMGGY type=del size=779663 2024-09-12T17:07:56.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.153+0000 7f9eaebff780 1 < canceled operation key=OGD6H9VSVGWF tag=KDPO9YN4Z64I type=del size=1354360 2024-09-12T17:07:56.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.155+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~5IYGY74WUDLR.0 size=237279 2024-09-12T17:07:56.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.155+0000 7f9eaebff780 1 > prepared multipart upload key=3VY271ZBO754 upload=5IYGY74WUDLR tag=2F4BDVPYVQDM type=write size=1285855 2024-09-12T17:07:56.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.156+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~HILL5H2U50PK.0 size=1048576 2024-09-12T17:07:56.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.157+0000 7f9eaebff780 1 < completed part key=_multipart_M3PLQGSK34YM.2~HILL5H2U50PK.1 size=1032777 2024-09-12T17:07:56.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.161+0000 7f9eaebff780 1 < completed multipart upload key=M3PLQGSK34YM upload=HILL5H2U50PK tag=V1W6DIJ2GPHG type=write size=3129929 2024-09-12T17:07:56.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.163+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~KJXVTDBG2R68.0 size=414993 2024-09-12T17:07:56.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.163+0000 7f9eaebff780 1 > prepared multipart upload key=QIMNK4DL3D0N upload=KJXVTDBG2R68 tag=0Z8FR2A1W3NS type=write size=1463569 2024-09-12T17:07:56.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.166+0000 7f9eaebff780 1 < suggested remove operation key=B1YC6DM9S8JJ tag=J94K2QCHNZYH type=write 2024-09-12T17:07:56.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.167+0000 7f9eaebff780 1 > prepared operation key=GB8P7K59Y8VI tag=6PI1NEJH134U type=write size=563907 2024-09-12T17:07:56.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.169+0000 7f9eaebff780 1 < suggested remove operation key=SVWPQETL92QU tag=DRB0MJ9FGQL1 type=del 2024-09-12T17:07:56.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.170+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=QPSARXB5X733 type=del size=3923219 2024-09-12T17:07:56.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.171+0000 7f9eaebff780 1 < canceled operation key=K2NHRSUDQBRW tag=YAQ854UJBN6G type=del size=3233006 2024-09-12T17:07:56.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.173+0000 7f9eaebff780 1 > prepared operation key=KF8XE48DI9KZ tag=89793JAX4NNN type=write size=360535 2024-09-12T17:07:56.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.174+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~EL2GM1CU9DUB.0 size=1048576 2024-09-12T17:07:56.177 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.175+0000 7f9eaebff780 1 < completed part key=_multipart_K0P9ZZ91UJJ8.2~EL2GM1CU9DUB.1 size=637690 2024-09-12T17:07:56.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.179+0000 7f9eaebff780 1 < completed multipart upload key=K0P9ZZ91UJJ8 upload=EL2GM1CU9DUB tag=LK3RQD4WI1U3 type=write size=2734842 2024-09-12T17:07:56.181 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.180+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=5HSLNY642B7V type=write size=555890 2024-09-12T17:07:56.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.182+0000 7f9eaebff780 1 < suggested update operation key=3LY681252WAN tag=KB1VGWP841E4 type=del size=759676 2024-09-12T17:07:56.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.183+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=ZF7M2XMM2MDP type=del size=786395 2024-09-12T17:07:56.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.184+0000 7f9eaebff780 1 < canceled part key=_multipart_QIMNK4DL3D0N.2~E1A473OCTNHW.0 size=1048576 2024-09-12T17:07:56.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.185+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~E1A473OCTNHW.1 size=1048576 2024-09-12T17:07:56.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.186+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~E1A473OCTNHW.2 size=2520 2024-09-12T17:07:56.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.187+0000 7f9eaebff780 1 < canceled multipart upload key=QIMNK4DL3D0N upload=E1A473OCTNHW tag=15KFRQT3JFX4 type=write size=3148248 2024-09-12T17:07:56.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.189+0000 7f9eaebff780 1 > prepared operation key=YIEP2JYDSLW0 tag=0J8360OAI8Y3 type=del size=3520239 2024-09-12T17:07:56.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.190+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~612YV6ELO21B.0 size=1048576 2024-09-12T17:07:56.192 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.191+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~612YV6ELO21B.1 size=288225 2024-09-12T17:07:56.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.193+0000 7f9eaebff780 1 < completed multipart upload key=OGD6H9VSVGWF upload=612YV6ELO21B tag=HLFW7W81H547 type=write size=2385377 2024-09-12T17:07:56.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.194+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=83MP8ORJS9W0 type=del size=3090219 2024-09-12T17:07:56.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.196+0000 7f9eaebff780 1 < completed write operation key=YIEP2JYDSLW0 tag=93VYKIK0G8YE type=write size=898286 2024-09-12T17:07:56.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.197+0000 7f9eaebff780 1 > prepared operation key=EKUW5AKC428U tag=NJL16YAFZ1ZG type=del size=233190 2024-09-12T17:07:56.200 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.199+0000 7f9eaebff780 1 < completed write operation key=SO6QF2JCRX6E tag=ANGP41M09P3V type=write size=937393 2024-09-12T17:07:56.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.200+0000 7f9eaebff780 1 > prepared operation key=QIMNK4DL3D0N tag=FECQKJ839S9N type=del size=1507806 2024-09-12T17:07:56.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.201+0000 7f9eaebff780 1 < completed part key=_multipart_GB8P7K59Y8VI.2~FW5IFZA0WOEK.0 size=1048576 2024-09-12T17:07:56.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.202+0000 7f9eaebff780 1 < completed part key=_multipart_GB8P7K59Y8VI.2~FW5IFZA0WOEK.1 size=271048 2024-09-12T17:07:56.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.204+0000 7f9eaebff780 1 < completed multipart upload key=GB8P7K59Y8VI upload=FW5IFZA0WOEK tag=YJLZY0L1BW3H type=write size=2368200 2024-09-12T17:07:56.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.205+0000 7f9eaebff780 1 > prepared operation key=K0P9ZZ91UJJ8 tag=FZKXEY56P2G7 type=del size=3956275 2024-09-12T17:07:56.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.208+0000 7f9eaebff780 1 < suggested remove operation key=A1KRCFY18QTP tag=JTKMJREA4XJY type=del 2024-09-12T17:07:56.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.210+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~F1BZSG16S4DJ.0 size=1048576 2024-09-12T17:07:56.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.211+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~F1BZSG16S4DJ.1 size=78905 2024-09-12T17:07:56.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.211+0000 7f9eaebff780 1 > prepared multipart upload key=0YD5P1ACZ09Q upload=F1BZSG16S4DJ tag=G3CR42H43L2Z type=write size=2176057 2024-09-12T17:07:56.214 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.212+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~VG2NN4N9SBSW.0 size=1048576 2024-09-12T17:07:56.214 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.213+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~VG2NN4N9SBSW.1 size=1048576 2024-09-12T17:07:56.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.214+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~VG2NN4N9SBSW.2 size=294523 2024-09-12T17:07:56.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.216+0000 7f9eaebff780 1 < completed multipart upload key=9WJGBODZ60NJ upload=VG2NN4N9SBSW tag=2L141QYZ2XR6 type=write size=3440251 2024-09-12T17:07:56.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.217+0000 7f9eaebff780 1 > prepared operation key=SVWPQETL92QU tag=9AZTI0NE28UC type=write size=854691 2024-09-12T17:07:56.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.219+0000 7f9eaebff780 1 < suggested update operation key=SVWPQETL92QU tag=I3KEQAVB8W50 type=del size=3059377 2024-09-12T17:07:56.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.220+0000 7f9eaebff780 1 > prepared operation key=7PBT9VZ07OUI tag=E9QGIWOHT7BG type=del size=3920420 2024-09-12T17:07:56.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.222+0000 7f9eaebff780 1 < completed delete operation key=8DJLYFM11DNI tag=9NMPIEPKMGGY type=del 2024-09-12T17:07:56.224 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.223+0000 7f9eaebff780 1 > prepared operation key=OGD6H9VSVGWF tag=QUPX48C0RG2B type=del size=1217722 2024-09-12T17:07:56.224 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.223+0000 7f9eaebff780 1 < canceled part key=_multipart_3VY271ZBO754.2~5IYGY74WUDLR.0 size=237279 2024-09-12T17:07:56.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.225+0000 7f9eaebff780 1 < canceled multipart upload key=3VY271ZBO754 upload=5IYGY74WUDLR tag=2F4BDVPYVQDM type=write size=1285855 2024-09-12T17:07:56.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.226+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=I17UULLT0ZI2 type=del size=222375 2024-09-12T17:07:56.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.228+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~KJXVTDBG2R68.0 size=414993 2024-09-12T17:07:56.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.230+0000 7f9eaebff780 1 < completed multipart upload key=QIMNK4DL3D0N upload=KJXVTDBG2R68 tag=0Z8FR2A1W3NS type=write size=1463569 2024-09-12T17:07:56.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.232+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~HWYWWGKO7AEN.0 size=1048576 2024-09-12T17:07:56.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.233+0000 7f9eaebff780 1 > prepared part key=_multipart_3VY271ZBO754.2~HWYWWGKO7AEN.1 size=390675 2024-09-12T17:07:56.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.233+0000 7f9eaebff780 1 > prepared multipart upload key=3VY271ZBO754 upload=HWYWWGKO7AEN tag=HLZ38JCHNTFV type=write size=2487827 2024-09-12T17:07:56.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.234+0000 7f9eaebff780 1 < completed write operation key=GB8P7K59Y8VI tag=6PI1NEJH134U type=write size=563907 2024-09-12T17:07:56.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.235+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=FVH3RJS2BKG2 type=del size=2727208 2024-09-12T17:07:56.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.236+0000 7f9eaebff780 1 < completed delete operation key=OH6GXTMPBYUY tag=QPSARXB5X733 type=del 2024-09-12T17:07:56.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.237+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=5NHMHZ4Z8P4E type=del size=3203582 2024-09-12T17:07:56.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.239+0000 7f9eaebff780 1 < canceled operation key=KF8XE48DI9KZ tag=89793JAX4NNN type=write size=360535 2024-09-12T17:07:56.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.241+0000 7f9eaebff780 1 > prepared part key=_multipart_P9GMGM3WK6O7.2~U5YSKXLAI2SO.0 size=737895 2024-09-12T17:07:56.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.241+0000 7f9eaebff780 1 > prepared multipart upload key=P9GMGM3WK6O7 upload=U5YSKXLAI2SO tag=S82FOSCQCO8I type=write size=1786471 2024-09-12T17:07:56.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.242+0000 7f9eaebff780 1 < completed write operation key=3VY271ZBO754 tag=5HSLNY642B7V type=write size=555890 2024-09-12T17:07:56.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.243+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=FEZNVYMH0LEF type=del size=1177483 2024-09-12T17:07:56.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.244+0000 7f9eaebff780 1 < canceled operation key=TXHXOMIB4B53 tag=ZF7M2XMM2MDP type=del size=786395 2024-09-12T17:07:56.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.246+0000 7f9eaebff780 1 > prepared operation key=SO6QF2JCRX6E tag=BQNFQFB830FV type=del size=1339831 2024-09-12T17:07:56.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.247+0000 7f9eaebff780 1 < completed delete operation key=YIEP2JYDSLW0 tag=0J8360OAI8Y3 type=del 2024-09-12T17:07:56.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.249+0000 7f9eaebff780 1 > prepared part key=_multipart_SVWPQETL92QU.2~6GP9Y9GFTAG1.0 size=554950 2024-09-12T17:07:56.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.249+0000 7f9eaebff780 1 > prepared multipart upload key=SVWPQETL92QU upload=6GP9Y9GFTAG1 tag=7I034JTNN04Z type=write size=1603526 2024-09-12T17:07:56.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.250+0000 7f9eaebff780 1 < completed delete operation key=ZYP3P4031PUZ tag=83MP8ORJS9W0 type=del 2024-09-12T17:07:56.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.251+0000 7f9eaebff780 1 > prepared operation key=9I6RGNRB6HSY tag=IO1LETHUMDXC type=del size=4009026 2024-09-12T17:07:56.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.254+0000 7f9eaebff780 1 < suggested update operation key=EKUW5AKC428U tag=NJL16YAFZ1ZG type=del size=233190 2024-09-12T17:07:56.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.255+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=Q4PLHIHG60GR type=write size=251989 2024-09-12T17:07:56.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.257+0000 7f9eaebff780 1 < completed delete operation key=QIMNK4DL3D0N tag=FECQKJ839S9N type=del 2024-09-12T17:07:56.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.259+0000 7f9eaebff780 1 > prepared part key=_multipart_9WJGBODZ60NJ.2~8RKESU9HN230.0 size=435082 2024-09-12T17:07:56.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.259+0000 7f9eaebff780 1 > prepared multipart upload key=9WJGBODZ60NJ upload=8RKESU9HN230 tag=C4CWY5ERV8GM type=write size=1483658 2024-09-12T17:07:56.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.260+0000 7f9eaebff780 1 < completed delete operation key=K0P9ZZ91UJJ8 tag=FZKXEY56P2G7 type=del 2024-09-12T17:07:56.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.261+0000 7f9eaebff780 1 > prepared operation key=TDZCNUZE8IOA tag=08BJB1G8GU0Z type=del size=3424529 2024-09-12T17:07:56.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.262+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~F1BZSG16S4DJ.0 size=1048576 2024-09-12T17:07:56.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.263+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~F1BZSG16S4DJ.1 size=78905 2024-09-12T17:07:56.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.265+0000 7f9eaebff780 1 < completed multipart upload key=0YD5P1ACZ09Q upload=F1BZSG16S4DJ tag=G3CR42H43L2Z type=write size=2176057 2024-09-12T17:07:56.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.267+0000 7f9eaebff780 1 > prepared operation key=B1YC6DM9S8JJ tag=07TJ6WN3V2MR type=write size=55673 2024-09-12T17:07:56.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.268+0000 7f9eaebff780 -1 < failed to complete operation key=SVWPQETL92QU tag=9AZTI0NE28UC type=write size=854691: (22) Invalid argument 2024-09-12T17:07:56.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.270+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=BY2SVPZKBOEF type=del size=445285 2024-09-12T17:07:56.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.271+0000 7f9eaebff780 1 < completed delete operation key=7PBT9VZ07OUI tag=E9QGIWOHT7BG type=del 2024-09-12T17:07:56.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.273+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~L58P12DYVNX4.0 size=1048576 2024-09-12T17:07:56.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.274+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~L58P12DYVNX4.1 size=1048576 2024-09-12T17:07:56.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.275+0000 7f9eaebff780 1 > prepared part key=_multipart_QIMNK4DL3D0N.2~L58P12DYVNX4.2 size=630434 2024-09-12T17:07:56.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.275+0000 7f9eaebff780 1 > prepared multipart upload key=QIMNK4DL3D0N upload=L58P12DYVNX4 tag=IL8QSJQJC3GY type=write size=3776162 2024-09-12T17:07:56.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.276+0000 7f9eaebff780 1 < completed delete operation key=OGD6H9VSVGWF tag=QUPX48C0RG2B type=del 2024-09-12T17:07:56.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.279+0000 7f9eaebff780 1 > prepared part key=_multipart_0YD5P1ACZ09Q.2~HIF1BQCQ5PKH.0 size=788774 2024-09-12T17:07:56.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.279+0000 7f9eaebff780 1 > prepared multipart upload key=0YD5P1ACZ09Q upload=HIF1BQCQ5PKH tag=11LCAUPT911J type=write size=1837350 2024-09-12T17:07:56.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.281+0000 7f9eaebff780 1 < canceled operation key=OH6GXTMPBYUY tag=I17UULLT0ZI2 type=del size=222375 2024-09-12T17:07:56.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.283+0000 7f9eaebff780 1 > prepared part key=_multipart_OGD6H9VSVGWF.2~4BXG9BDG8UZX.0 size=28709 2024-09-12T17:07:56.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.283+0000 7f9eaebff780 1 > prepared multipart upload key=OGD6H9VSVGWF upload=4BXG9BDG8UZX tag=UWOQE62UDRS6 type=write size=1077285 2024-09-12T17:07:56.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.284+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~HWYWWGKO7AEN.0 size=1048576 2024-09-12T17:07:56.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.285+0000 7f9eaebff780 1 < completed part key=_multipart_3VY271ZBO754.2~HWYWWGKO7AEN.1 size=390675 2024-09-12T17:07:56.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.287+0000 7f9eaebff780 1 < completed multipart upload key=3VY271ZBO754 upload=HWYWWGKO7AEN tag=HLZ38JCHNTFV type=write size=2487827 2024-09-12T17:07:56.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.288+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=ER8S6R9G4Z3Z type=del size=1873954 2024-09-12T17:07:56.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.289+0000 7f9eaebff780 1 < completed delete operation key=B1YC6DM9S8JJ tag=FVH3RJS2BKG2 type=del 2024-09-12T17:07:56.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.290+0000 7f9eaebff780 1 > prepared operation key=K2NHRSUDQBRW tag=IILU3TKQ21BL type=del size=3957457 2024-09-12T17:07:56.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.292+0000 7f9eaebff780 1 < completed delete operation key=9I6RGNRB6HSY tag=5NHMHZ4Z8P4E type=del 2024-09-12T17:07:56.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.293+0000 7f9eaebff780 1 > prepared operation key=M3PLQGSK34YM tag=9Y32RQ01TBVK type=write size=164810 2024-09-12T17:07:56.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.294+0000 7f9eaebff780 1 < completed part key=_multipart_P9GMGM3WK6O7.2~U5YSKXLAI2SO.0 size=737895 2024-09-12T17:07:56.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.296+0000 7f9eaebff780 1 < completed multipart upload key=P9GMGM3WK6O7 upload=U5YSKXLAI2SO tag=S82FOSCQCO8I type=write size=1786471 2024-09-12T17:07:56.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.298+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~4R18HF2SJ4HC.0 size=1048576 2024-09-12T17:07:56.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.299+0000 7f9eaebff780 1 > prepared part key=_multipart_B1YC6DM9S8JJ.2~4R18HF2SJ4HC.1 size=229744 2024-09-12T17:07:56.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.299+0000 7f9eaebff780 1 > prepared multipart upload key=B1YC6DM9S8JJ upload=4R18HF2SJ4HC tag=9AIMZ3DPJ2R4 type=write size=2326896 2024-09-12T17:07:56.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.300+0000 7f9eaebff780 1 < completed delete operation key=3VY271ZBO754 tag=FEZNVYMH0LEF type=del 2024-09-12T17:07:56.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.302+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~5IIJ9NBX8H3C.0 size=1048576 2024-09-12T17:07:56.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.303+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~5IIJ9NBX8H3C.1 size=1048576 2024-09-12T17:07:56.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.304+0000 7f9eaebff780 1 > prepared part key=_multipart_SO6QF2JCRX6E.2~5IIJ9NBX8H3C.2 size=752676 2024-09-12T17:07:56.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.304+0000 7f9eaebff780 1 > prepared multipart upload key=SO6QF2JCRX6E upload=5IIJ9NBX8H3C tag=D2RZIPVF8O63 type=write size=3898404 2024-09-12T17:07:56.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.305+0000 7f9eaebff780 1 < completed delete operation key=SO6QF2JCRX6E tag=BQNFQFB830FV type=del 2024-09-12T17:07:56.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.307+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~OGHJEBBN890Y.0 size=1048576 2024-09-12T17:07:56.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.308+0000 7f9eaebff780 1 > prepared part key=_multipart_9I6RGNRB6HSY.2~OGHJEBBN890Y.1 size=40117 2024-09-12T17:07:56.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.308+0000 7f9eaebff780 1 > prepared multipart upload key=9I6RGNRB6HSY upload=OGHJEBBN890Y tag=EZ7VGHU4KCL1 type=write size=2137269 2024-09-12T17:07:56.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.310+0000 7f9eaebff780 1 < completed part key=_multipart_SVWPQETL92QU.2~6GP9Y9GFTAG1.0 size=554950 2024-09-12T17:07:56.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.312+0000 7f9eaebff780 1 < completed multipart upload key=SVWPQETL92QU upload=6GP9Y9GFTAG1 tag=7I034JTNN04Z type=write size=1603526 2024-09-12T17:07:56.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.313+0000 7f9eaebff780 1 > prepared operation key=3LY681252WAN tag=SRW1YMT5C64Q type=del size=1880397 2024-09-12T17:07:56.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.315+0000 7f9eaebff780 1 < suggested remove operation key=9I6RGNRB6HSY tag=IO1LETHUMDXC type=del 2024-09-12T17:07:56.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.318+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~CBLWFORQRGNE.0 size=1048576 2024-09-12T17:07:56.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.319+0000 7f9eaebff780 1 > prepared part key=_multipart_SHWT6AT7PN0M.2~CBLWFORQRGNE.1 size=324095 2024-09-12T17:07:56.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.319+0000 7f9eaebff780 1 > prepared multipart upload key=SHWT6AT7PN0M upload=CBLWFORQRGNE tag=QPMUL33712RH type=write size=2421247 2024-09-12T17:07:56.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.321+0000 7f9eaebff780 1 < suggested remove operation key=ZC814TPVLJO1 tag=Q4PLHIHG60GR type=write 2024-09-12T17:07:56.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.323+0000 7f9eaebff780 1 > prepared operation key=ZC814TPVLJO1 tag=81ZU4GAMXLXV type=del size=1971076 2024-09-12T17:07:56.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.324+0000 7f9eaebff780 1 < completed part key=_multipart_9WJGBODZ60NJ.2~8RKESU9HN230.0 size=435082 2024-09-12T17:07:56.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.326+0000 7f9eaebff780 1 < completed multipart upload key=9WJGBODZ60NJ upload=8RKESU9HN230 tag=C4CWY5ERV8GM type=write size=1483658 2024-09-12T17:07:56.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.329+0000 7f9eaebff780 1 > prepared part key=_multipart_CAIZM33SDFPM.2~GVN4HH3IOPV4.0 size=858943 2024-09-12T17:07:56.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.329+0000 7f9eaebff780 1 > prepared multipart upload key=CAIZM33SDFPM upload=GVN4HH3IOPV4 tag=O1RKC35B8F81 type=write size=1907519 2024-09-12T17:07:56.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.330+0000 7f9eaebff780 1 < completed delete operation key=TDZCNUZE8IOA tag=08BJB1G8GU0Z type=del 2024-09-12T17:07:56.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.331+0000 7f9eaebff780 1 > prepared operation key=LRI5G5G8O5X4 tag=8LEKUYL0T1EM type=write size=176453 2024-09-12T17:07:56.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.333+0000 7f9eaebff780 1 < completed write operation key=B1YC6DM9S8JJ tag=07TJ6WN3V2MR type=write size=55673 2024-09-12T17:07:56.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.335+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~DXG91EFX28WH.0 size=1048576 2024-09-12T17:07:56.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.336+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~DXG91EFX28WH.1 size=1048576 2024-09-12T17:07:56.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.337+0000 7f9eaebff780 1 > prepared part key=_multipart_K2NHRSUDQBRW.2~DXG91EFX28WH.2 size=374721 2024-09-12T17:07:56.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.337+0000 7f9eaebff780 1 > prepared multipart upload key=K2NHRSUDQBRW upload=DXG91EFX28WH tag=7HO3NRGB2QXV type=write size=3520449 2024-09-12T17:07:56.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.339+0000 7f9eaebff780 1 < suggested remove operation key=TXHXOMIB4B53 tag=BY2SVPZKBOEF type=del 2024-09-12T17:07:56.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.341+0000 7f9eaebff780 1 > prepared part key=_multipart_GB8P7K59Y8VI.2~X7IXV7V96KX8.0 size=695418 2024-09-12T17:07:56.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.341+0000 7f9eaebff780 1 > prepared multipart upload key=GB8P7K59Y8VI upload=X7IXV7V96KX8 tag=XFTDPJFBQG6T type=write size=1743994 2024-09-12T17:07:56.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.343+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~L58P12DYVNX4.0 size=1048576 2024-09-12T17:07:56.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.344+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~L58P12DYVNX4.1 size=1048576 2024-09-12T17:07:56.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.345+0000 7f9eaebff780 1 < completed part key=_multipart_QIMNK4DL3D0N.2~L58P12DYVNX4.2 size=630434 2024-09-12T17:07:56.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.347+0000 7f9eaebff780 1 < completed multipart upload key=QIMNK4DL3D0N upload=L58P12DYVNX4 tag=IL8QSJQJC3GY type=write size=3776162 2024-09-12T17:07:56.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.348+0000 7f9eaebff780 1 > prepared operation key=OH6GXTMPBYUY tag=171OEGXLVGFT type=write size=199113 2024-09-12T17:07:56.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.349+0000 7f9eaebff780 1 < completed part key=_multipart_0YD5P1ACZ09Q.2~HIF1BQCQ5PKH.0 size=788774 2024-09-12T17:07:56.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.351+0000 7f9eaebff780 1 < completed multipart upload key=0YD5P1ACZ09Q upload=HIF1BQCQ5PKH tag=11LCAUPT911J type=write size=1837350 2024-09-12T17:07:56.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.352+0000 7f9eaebff780 1 > prepared operation key=UYF1AN2W59VN tag=VCL5J1MN4SM8 type=del size=3447255 2024-09-12T17:07:56.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.354+0000 7f9eaebff780 1 < completed part key=_multipart_OGD6H9VSVGWF.2~4BXG9BDG8UZX.0 size=28709 2024-09-12T17:07:56.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.356+0000 7f9eaebff780 1 < completed multipart upload key=OGD6H9VSVGWF upload=4BXG9BDG8UZX tag=UWOQE62UDRS6 type=write size=1077285 2024-09-12T17:07:56.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.357+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=4VS3NFJLBEYU type=del size=853654 2024-09-12T17:07:56.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.358+0000 7f9eaebff780 1 < completed delete operation key=ZYP3P4031PUZ tag=ER8S6R9G4Z3Z type=del 2024-09-12T17:07:56.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.360+0000 7f9eaebff780 1 > prepared operation key=TXHXOMIB4B53 tag=P693A1YX8E60 type=del size=868080 2024-09-12T17:07:56.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.361+0000 7f9eaebff780 1 < completed delete operation key=K2NHRSUDQBRW tag=IILU3TKQ21BL type=del 2024-09-12T17:07:56.364 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.363+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~0O1QHRVYE4XK.0 size=1048576 2024-09-12T17:07:56.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.364+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~0O1QHRVYE4XK.1 size=1048576 2024-09-12T17:07:56.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.365+0000 7f9eaebff780 1 > prepared part key=_multipart_K0P9ZZ91UJJ8.2~0O1QHRVYE4XK.2 size=489673 2024-09-12T17:07:56.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.365+0000 7f9eaebff780 1 > prepared multipart upload key=K0P9ZZ91UJJ8 upload=0O1QHRVYE4XK tag=WJ1CAT537X5X type=write size=3635401 2024-09-12T17:07:56.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.366+0000 7f9eaebff780 1 < completed write operation key=M3PLQGSK34YM tag=9Y32RQ01TBVK type=write size=164810 2024-09-12T17:07:56.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.367+0000 7f9eaebff780 1 > prepared operation key=3VY271ZBO754 tag=HMG5PABQJFU4 type=write size=699758 2024-09-12T17:07:56.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.369+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~4R18HF2SJ4HC.0 size=1048576 2024-09-12T17:07:56.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.370+0000 7f9eaebff780 1 < completed part key=_multipart_B1YC6DM9S8JJ.2~4R18HF2SJ4HC.1 size=229744 2024-09-12T17:07:56.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.371+0000 7f9eaebff780 1 < completed multipart upload key=B1YC6DM9S8JJ upload=4R18HF2SJ4HC tag=9AIMZ3DPJ2R4 type=write size=2326896 2024-09-12T17:07:56.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:07:56.373+0000 7f9eaebff780 1 > prepared operation key=ZYP3P4031PUZ tag=7LCSF51Z0H9Z type=del size=3817024 2024-09-12T17:07:56.375 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw_stats.simulate (9298 ms) 2024-09-12T17:07:56.375 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 1 test from cls_rgw_stats (9298 ms total) 2024-09-12T17:07:56.375 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T17:07:56.375 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T17:07:57.161 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 1 test from 1 test suite ran. (11977 ms total) 2024-09-12T17:07:57.161 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 1 test. 2024-09-12T17:07:57.165 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:07:57.165 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:07:57.250 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-12T17:07:57.251 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-12T17:07:57.252 DEBUG:teuthology.orchestra.run.smithi067:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-12T17:07:57.338 INFO:tasks.workunit.client.0.smithi067.stdout:Running main() from gmock_main.cc 2024-09-12T17:07:57.339 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-12T17:07:57.339 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T17:07:59.186 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 31 tests from CmpOmap 2024-09-12T17:07:59.187 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-12T17:07:59.194 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (8 ms) 2024-09-12T17:07:59.194 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-12T17:07:59.198 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (4 ms) 2024-09-12T17:07:59.198 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-12T17:07:59.200 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-09-12T17:07:59.201 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-12T17:07:59.204 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (3 ms) 2024-09-12T17:07:59.204 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-12T17:07:59.213 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_vals_str (9 ms) 2024-09-12T17:07:59.213 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-12T17:07:59.219 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_vals_u64 (7 ms) 2024-09-12T17:07:59.219 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-12T17:07:59.223 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (3 ms) 2024-09-12T17:07:59.223 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-12T17:07:59.226 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (4 ms) 2024-09-12T17:07:59.226 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-12T17:07:59.231 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (4 ms) 2024-09-12T17:07:59.231 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-12T17:07:59.235 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (4 ms) 2024-09-12T17:07:59.235 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-12T17:07:59.236 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-12T17:07:59.236 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-12T17:07:59.236 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-09-12T17:07:59.237 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-12T17:07:59.244 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (7 ms) 2024-09-12T17:07:59.244 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-12T17:07:59.250 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (7 ms) 2024-09-12T17:07:59.250 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-12T17:07:59.257 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (6 ms) 2024-09-12T17:07:59.257 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-12T17:07:59.263 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (6 ms) 2024-09-12T17:07:59.263 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-12T17:07:59.271 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_set_vals_str (8 ms) 2024-09-12T17:07:59.271 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-12T17:07:59.279 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (8 ms) 2024-09-12T17:07:59.279 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-12T17:07:59.282 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (3 ms) 2024-09-12T17:07:59.282 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-12T17:07:59.284 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (3 ms) 2024-09-12T17:07:59.284 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-12T17:07:59.285 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-09-12T17:07:59.285 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-12T17:07:59.286 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (0 ms) 2024-09-12T17:07:59.286 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-12T17:07:59.293 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (7 ms) 2024-09-12T17:07:59.293 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-12T17:07:59.299 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (6 ms) 2024-09-12T17:07:59.299 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-12T17:07:59.307 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (7 ms) 2024-09-12T17:07:59.307 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-12T17:07:59.316 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (9 ms) 2024-09-12T17:07:59.316 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-12T17:07:59.318 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-09-12T17:07:59.318 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-12T17:07:59.320 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2024-09-12T17:07:59.321 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-12T17:07:59.321 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-12T17:07:59.322 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-12T17:07:59.322 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (0 ms) 2024-09-12T17:07:59.322 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-12T17:07:59.330 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (8 ms) 2024-09-12T17:07:59.330 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 31 tests from CmpOmap (144 ms total) 2024-09-12T17:07:59.330 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T17:07:59.330 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T17:08:00.182 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 31 tests from 1 test suite ran. (2843 ms total) 2024-09-12T17:08:00.182 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 31 tests. 2024-09-12T17:08:00.185 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:08:00.185 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:08:00.229 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-12T17:08:00.230 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-12T17:08:00.230 DEBUG:teuthology.orchestra.run.smithi067:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-12T17:08:00.317 INFO:tasks.workunit.client.0.smithi067.stdout:Running main() from gmock_main.cc 2024-09-12T17:08:00.318 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:08:00.318 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T17:08:00.318 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-12T17:08:00.318 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-12T17:08:03.206 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2888 ms) 2024-09-12T17:08:03.206 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-12T17:08:06.212 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3006 ms) 2024-09-12T17:08:06.212 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-12T17:08:09.245 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.Reserve (3033 ms) 2024-09-12T17:08:09.245 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-12T17:08:13.274 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (4029 ms) 2024-09-12T17:08:13.274 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-12T17:08:16.288 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.Commit (3013 ms) 2024-09-12T17:08:16.288 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-12T17:08:19.305 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.Stats (3018 ms) 2024-09-12T17:08:19.305 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-12T17:08:23.336 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4031 ms) 2024-09-12T17:08:23.336 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-12T17:08:26.348 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.Abort (3009 ms) 2024-09-12T17:08:26.349 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-12T17:08:29.363 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.ReserveError (3017 ms) 2024-09-12T17:08:29.363 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-12T17:08:32.376 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.CommitError (3013 ms) 2024-09-12T17:08:32.377 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-12T17:08:35.396 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.AbortError (3016 ms) 2024-09-12T17:08:35.397 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-12T17:08:38.399 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3007 ms) 2024-09-12T17:08:38.399 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-12T17:08:41.434 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3035 ms) 2024-09-12T17:08:41.434 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-12T17:08:44.437 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3004 ms) 2024-09-12T17:08:44.438 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-12T17:08:47.470 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3032 ms) 2024-09-12T17:08:47.470 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-12T17:08:50.490 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3020 ms) 2024-09-12T17:08:50.490 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-12T17:08:53.508 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3018 ms) 2024-09-12T17:08:53.508 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-12T17:08:56.515 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.Cleanup (3006 ms) 2024-09-12T17:08:56.515 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-12T17:09:07.562 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.MultiProducer (11048 ms) 2024-09-12T17:09:07.562 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-12T17:09:11.595 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (4034 ms) 2024-09-12T17:09:11.596 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-12T17:09:25.044 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13447 ms) 2024-09-12T17:09:25.045 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-12T17:09:29.076 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4034 ms) 2024-09-12T17:09:29.076 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-12T17:09:35.107 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (6030 ms) 2024-09-12T17:09:35.107 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-12T17:09:40.187 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5081 ms) 2024-09-12T17:09:40.188 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 24 tests from TestCls2PCQueue (99870 ms total) 2024-09-12T17:09:40.188 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T17:09:40.188 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T17:09:40.188 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 24 tests from 1 test suite ran. (99870 ms total) 2024-09-12T17:09:40.188 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 24 tests. 2024-09-12T17:09:40.190 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:09:40.191 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:09:40.237 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-12T17:09:40.238 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-12T17:09:40.239 DEBUG:teuthology.orchestra.run.smithi067:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-12T17:09:40.299 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:09:40.300 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:09:40.300 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:09:40.300 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T17:09:42.193 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 4 tests from ClsAccount 2024-09-12T17:09:42.194 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsAccount.add 2024-09-12T17:09:42.217 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsAccount.add (23 ms) 2024-09-12T17:09:42.217 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsAccount.get 2024-09-12T17:09:42.222 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsAccount.get (5 ms) 2024-09-12T17:09:42.222 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsAccount.rm 2024-09-12T17:09:42.229 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsAccount.rm (8 ms) 2024-09-12T17:09:42.229 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsAccount.list 2024-09-12T17:09:42.245 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsAccount.list (16 ms) 2024-09-12T17:09:42.246 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 4 tests from ClsAccount (52 ms total) 2024-09-12T17:09:42.246 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T17:09:42.246 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T17:09:43.213 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 4 tests from 1 test suite ran. (2913 ms total) 2024-09-12T17:09:43.213 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 4 tests. 2024-09-12T17:09:43.217 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:09:43.217 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:09:43.263 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-12T17:09:43.264 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-12T17:09:43.264 DEBUG:teuthology.orchestra.run.smithi067:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-12T17:09:43.321 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:09:43.321 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:09:43.321 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-12T17:09:43.321 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T17:09:45.213 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 6 tests from rgw_gc_log 2024-09-12T17:09:45.213 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-12T17:09:45.231 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] rgw_gc_log.init_existing_queue (18 ms) 2024-09-12T17:09:45.231 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-12T17:09:45.234 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] rgw_gc_log.init_existing_omap (4 ms) 2024-09-12T17:09:45.234 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-12T17:09:45.238 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (3 ms) 2024-09-12T17:09:45.238 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-12T17:09:45.240 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2024-09-12T17:09:45.240 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-12T17:09:45.242 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2024-09-12T17:09:45.242 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-12T17:09:45.244 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2024-09-12T17:09:45.244 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 6 tests from rgw_gc_log (32 ms total) 2024-09-12T17:09:45.244 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T17:09:45.245 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T17:09:46.213 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 6 tests from 1 test suite ran. (2893 ms total) 2024-09-12T17:09:46.213 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 6 tests. 2024-09-12T17:09:46.218 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:09:46.218 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:09:46.264 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-12T17:09:46.266 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-12T17:09:46.266 DEBUG:teuthology.orchestra.run.smithi067:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-12T17:09:46.327 INFO:tasks.workunit.client.0.smithi067.stdout:Running main() from gmock_main.cc 2024-09-12T17:09:46.327 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:09:46.327 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T17:09:46.327 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 4 tests from TestRGWObj 2024-09-12T17:09:46.327 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestRGWObj.underscore 2024-09-12T17:09:46.327 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj 2024-09-12T17:09:46.327 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj 2024-09-12T17:09:46.328 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: _obj ns= i= 2024-09-12T17:09:46.328 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj 2024-09-12T17:09:46.328 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj 2024-09-12T17:09:46.328 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: _obj ns= i= 2024-09-12T17:09:46.328 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj 2024-09-12T17:09:46.328 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj 2024-09-12T17:09:46.328 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: _obj ns= i= 2024-09-12T17:09:46.328 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.328 INFO:tasks.workunit.client.0.smithi067.stdout: "obj1": { 2024-09-12T17:09:46.328 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.328 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.328 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.328 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.328 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.329 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.329 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.329 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.329 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.333 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.333 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.333 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.333 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T17:09:46.333 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.333 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.333 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.333 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.333 INFO:tasks.workunit.client.0.smithi067.stdout: "obj2": { 2024-09-12T17:09:46.333 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.333 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.334 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.334 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.334 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.334 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.334 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.334 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.334 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.334 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.334 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.334 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.334 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T17:09:46.335 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.335 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.335 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.335 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.335 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3": { 2024-09-12T17:09:46.335 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.335 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.335 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.335 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.335 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.335 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.335 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.336 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.336 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.336 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.336 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.336 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.336 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T17:09:46.336 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.336 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.336 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.336 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.336 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3-2": { 2024-09-12T17:09:46.336 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.336 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.337 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.337 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.337 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.337 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.337 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.337 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.337 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.337 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.337 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.337 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.337 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T17:09:46.337 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.337 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.338 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.338 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.338 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.338 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj 2024-09-12T17:09:46.338 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj 2024-09-12T17:09:46.338 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: _obj ns=ns i= 2024-09-12T17:09:46.338 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj 2024-09-12T17:09:46.338 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj 2024-09-12T17:09:46.338 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: _obj ns=ns i= 2024-09-12T17:09:46.338 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj 2024-09-12T17:09:46.338 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj 2024-09-12T17:09:46.338 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: _obj ns=ns i= 2024-09-12T17:09:46.338 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.338 INFO:tasks.workunit.client.0.smithi067.stdout: "obj1": { 2024-09-12T17:09:46.339 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.339 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.339 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.339 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.339 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.339 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.339 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.339 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.339 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.339 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.339 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.339 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.339 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T17:09:46.340 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.340 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.340 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.340 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.340 INFO:tasks.workunit.client.0.smithi067.stdout: "obj2": { 2024-09-12T17:09:46.340 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.340 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.340 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.340 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.340 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.340 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.340 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.340 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.341 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.341 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.341 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.341 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.341 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T17:09:46.341 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.341 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.341 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.341 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.341 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3": { 2024-09-12T17:09:46.342 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.342 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.342 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.342 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.342 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.342 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.342 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.342 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.342 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.342 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.342 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.342 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.342 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T17:09:46.342 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.343 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.343 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.343 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.343 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3-2": { 2024-09-12T17:09:46.343 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.343 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.343 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.343 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.343 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.343 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.343 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.343 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.343 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.344 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.344 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.344 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.344 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T17:09:46.344 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.344 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.344 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.344 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.344 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.344 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj[v1] 2024-09-12T17:09:46.344 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj[v1] 2024-09-12T17:09:46.344 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: _obj ns= i=v1 2024-09-12T17:09:46.344 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj[v1] 2024-09-12T17:09:46.345 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj[v1] 2024-09-12T17:09:46.345 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: _obj ns= i=v1 2024-09-12T17:09:46.345 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj[v1] 2024-09-12T17:09:46.345 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj[v1] 2024-09-12T17:09:46.345 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: _obj ns= i=v1 2024-09-12T17:09:46.345 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.345 INFO:tasks.workunit.client.0.smithi067.stdout: "obj1": { 2024-09-12T17:09:46.345 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.345 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.345 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.345 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.345 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.345 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.346 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.346 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.346 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.346 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.346 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.346 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.346 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T17:09:46.346 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "v1", 2024-09-12T17:09:46.346 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.346 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.346 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.346 INFO:tasks.workunit.client.0.smithi067.stdout: "obj2": { 2024-09-12T17:09:46.346 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.346 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.347 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.347 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.347 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.347 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.347 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.347 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.347 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.350 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.351 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.351 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.351 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T17:09:46.351 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "v1", 2024-09-12T17:09:46.351 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.351 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.351 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.351 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3": { 2024-09-12T17:09:46.351 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.351 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.351 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.351 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.351 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.352 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.352 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.352 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.352 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.352 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.352 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.352 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.352 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T17:09:46.352 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.352 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.352 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.352 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.352 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3-2": { 2024-09-12T17:09:46.352 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.353 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.353 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.353 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.353 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.353 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.353 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.353 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.353 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.353 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.354 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.354 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.354 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T17:09:46.354 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "v1", 2024-09-12T17:09:46.354 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.354 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.354 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.354 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.354 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj[v1] 2024-09-12T17:09:46.354 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj[v1] 2024-09-12T17:09:46.354 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:09:46.354 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj[v1] 2024-09-12T17:09:46.354 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj[v1] 2024-09-12T17:09:46.354 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:09:46.355 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj[v1] 2024-09-12T17:09:46.355 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj[v1] 2024-09-12T17:09:46.355 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:09:46.355 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.355 INFO:tasks.workunit.client.0.smithi067.stdout: "obj1": { 2024-09-12T17:09:46.356 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.356 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.356 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.356 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.356 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.356 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.356 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.356 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.356 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.356 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.356 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.356 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.356 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T17:09:46.356 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "v1", 2024-09-12T17:09:46.357 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.357 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.357 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.357 INFO:tasks.workunit.client.0.smithi067.stdout: "obj2": { 2024-09-12T17:09:46.357 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.357 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.357 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.357 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.357 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.357 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.357 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.357 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.358 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.358 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.358 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.358 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.358 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T17:09:46.358 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "v1", 2024-09-12T17:09:46.358 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.358 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.358 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.359 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3": { 2024-09-12T17:09:46.359 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.359 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.359 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.359 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.359 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.359 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.359 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.359 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.359 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.359 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.359 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.359 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.359 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T17:09:46.360 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.360 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.360 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.360 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.360 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3-2": { 2024-09-12T17:09:46.360 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.360 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.360 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.360 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.360 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.360 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.360 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.360 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.361 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.361 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.361 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.361 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.361 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T17:09:46.361 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "v1", 2024-09-12T17:09:46.361 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.361 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.361 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.361 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.361 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-12T17:09:46.361 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-12T17:09:46.361 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj 2024-09-12T17:09:46.362 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj 2024-09-12T17:09:46.362 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: obj ns= i= 2024-09-12T17:09:46.362 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj 2024-09-12T17:09:46.362 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj 2024-09-12T17:09:46.362 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: obj ns= i= 2024-09-12T17:09:46.362 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj 2024-09-12T17:09:46.362 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj 2024-09-12T17:09:46.362 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: obj ns= i= 2024-09-12T17:09:46.362 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.362 INFO:tasks.workunit.client.0.smithi067.stdout: "obj1": { 2024-09-12T17:09:46.362 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.362 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.362 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.362 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.363 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.363 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.363 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.363 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.363 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.363 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.363 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.364 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.364 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T17:09:46.364 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.364 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.364 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.364 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.364 INFO:tasks.workunit.client.0.smithi067.stdout: "obj2": { 2024-09-12T17:09:46.365 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.365 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.365 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.365 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.365 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.365 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.365 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.365 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.365 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.365 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.365 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.365 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.366 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T17:09:46.366 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.366 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.366 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.366 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.366 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3": { 2024-09-12T17:09:46.366 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.366 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.366 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.366 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.367 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.367 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.367 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.367 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.367 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.367 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.367 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.367 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.367 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T17:09:46.367 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.368 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.368 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.368 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.368 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3-2": { 2024-09-12T17:09:46.368 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.368 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.368 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.368 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.368 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.368 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.368 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.368 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.369 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.369 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.369 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.369 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.369 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T17:09:46.369 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.369 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.369 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.369 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.369 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.369 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj 2024-09-12T17:09:46.369 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj 2024-09-12T17:09:46.369 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: obj ns=ns i= 2024-09-12T17:09:46.370 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj 2024-09-12T17:09:46.370 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj 2024-09-12T17:09:46.370 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: obj ns=ns i= 2024-09-12T17:09:46.370 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj 2024-09-12T17:09:46.370 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj 2024-09-12T17:09:46.370 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: obj ns=ns i= 2024-09-12T17:09:46.370 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.370 INFO:tasks.workunit.client.0.smithi067.stdout: "obj1": { 2024-09-12T17:09:46.370 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.370 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.370 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.370 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.370 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.370 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.370 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.371 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.371 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.371 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.371 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.371 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.371 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T17:09:46.371 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.371 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.371 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.371 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.371 INFO:tasks.workunit.client.0.smithi067.stdout: "obj2": { 2024-09-12T17:09:46.371 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.371 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.372 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.372 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.372 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.372 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.372 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.372 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.372 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.372 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.372 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.372 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.372 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T17:09:46.372 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.372 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.373 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.373 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.373 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3": { 2024-09-12T17:09:46.373 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.373 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.373 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.373 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.373 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.373 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.373 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.373 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.373 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.373 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.374 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.374 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.374 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T17:09:46.374 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.374 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.374 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.374 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.374 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3-2": { 2024-09-12T17:09:46.374 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.374 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.374 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.374 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.374 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.374 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.375 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.375 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.375 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.375 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.375 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.375 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.375 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T17:09:46.375 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.375 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.375 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.375 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.375 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.375 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj[v1] 2024-09-12T17:09:46.375 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj[v1] 2024-09-12T17:09:46.376 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: obj ns= i=v1 2024-09-12T17:09:46.376 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj[v1] 2024-09-12T17:09:46.376 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj[v1] 2024-09-12T17:09:46.376 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: obj ns= i=v1 2024-09-12T17:09:46.376 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj[v1] 2024-09-12T17:09:46.376 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj[v1] 2024-09-12T17:09:46.376 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: obj ns= i=v1 2024-09-12T17:09:46.376 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.376 INFO:tasks.workunit.client.0.smithi067.stdout: "obj1": { 2024-09-12T17:09:46.376 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.377 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.377 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.377 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.377 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.377 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.377 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.377 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.377 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.377 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.377 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.377 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.377 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T17:09:46.377 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "v1", 2024-09-12T17:09:46.377 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.378 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.378 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.378 INFO:tasks.workunit.client.0.smithi067.stdout: "obj2": { 2024-09-12T17:09:46.378 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.378 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.378 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.378 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.378 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.378 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.378 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.378 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.378 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.378 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.379 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.379 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.379 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T17:09:46.379 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "v1", 2024-09-12T17:09:46.379 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.379 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.379 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.379 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3": { 2024-09-12T17:09:46.379 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.379 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.379 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.379 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.379 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.379 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.380 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.380 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.380 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.380 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.380 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.380 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.380 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T17:09:46.380 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.380 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.380 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.380 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.380 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3-2": { 2024-09-12T17:09:46.380 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.381 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.381 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.381 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.381 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.381 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.381 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.381 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.381 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.381 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.381 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.381 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.381 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T17:09:46.381 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "v1", 2024-09-12T17:09:46.381 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.382 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.382 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.382 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.382 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj[v1] 2024-09-12T17:09:46.382 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj[v1] 2024-09-12T17:09:46.382 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:09:46.382 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj[v1] 2024-09-12T17:09:46.382 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj[v1] 2024-09-12T17:09:46.382 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:09:46.382 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj[v1] 2024-09-12T17:09:46.382 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj[v1] 2024-09-12T17:09:46.382 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:09:46.382 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.382 INFO:tasks.workunit.client.0.smithi067.stdout: "obj1": { 2024-09-12T17:09:46.383 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.383 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.383 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.383 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.383 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.383 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.383 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.383 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.383 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.383 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.383 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.383 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.383 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T17:09:46.383 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "v1", 2024-09-12T17:09:46.384 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.384 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.384 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.384 INFO:tasks.workunit.client.0.smithi067.stdout: "obj2": { 2024-09-12T17:09:46.384 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.384 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.384 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.384 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.384 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.384 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.384 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.384 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.384 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.385 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.385 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.385 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.385 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T17:09:46.385 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "v1", 2024-09-12T17:09:46.385 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.385 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.385 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.385 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3": { 2024-09-12T17:09:46.385 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.385 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.385 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.385 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.385 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.386 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.386 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.386 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.386 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.386 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.386 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.386 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.386 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T17:09:46.386 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.386 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.386 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.386 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.386 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3-2": { 2024-09-12T17:09:46.386 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.387 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.387 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.387 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.387 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.387 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.387 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.387 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.387 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.387 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.387 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.387 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.387 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T17:09:46.387 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "v1", 2024-09-12T17:09:46.387 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.388 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.388 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.388 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.388 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-12T17:09:46.388 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-12T17:09:46.388 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.388 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.388 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.388 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.388 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.388 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.388 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.388 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.389 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.389 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.389 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.389 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.389 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.389 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.389 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T17:09:46.389 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.389 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.389 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.389 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.389 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.389 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.389 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.389 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.390 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.390 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.390 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.390 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.390 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T17:09:46.390 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.390 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.390 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.390 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.390 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.390 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.390 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.390 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": "default-placement.data", 2024-09-12T17:09:46.390 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker_myobj", 2024-09-12T17:09:46.391 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.391 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.391 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.391 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.391 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.391 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.391 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.391 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.391 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.391 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.391 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.391 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.391 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.391 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.392 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.392 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.392 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.392 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T17:09:46.392 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.392 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.392 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.392 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.392 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.392 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.392 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.392 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.392 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.393 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.393 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.393 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.393 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.393 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.393 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.393 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.393 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.393 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.393 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.393 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T17:09:46.393 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.393 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.393 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.394 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.394 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.394 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.394 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.394 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.394 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.394 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.394 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.394 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.394 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T17:09:46.394 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.394 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.394 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.394 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.395 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.395 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.395 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.395 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.395 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker_myobj", 2024-09-12T17:09:46.395 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.395 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.395 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.395 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.395 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.395 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.396 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.396 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.396 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.396 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.396 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.396 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.396 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.396 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.397 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.397 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.397 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.397 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T17:09:46.397 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.397 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.397 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.397 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.397 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.397 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.397 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.397 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.398 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.398 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.398 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.398 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.398 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.398 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.399 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.399 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.399 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.399 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.399 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.399 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T17:09:46.399 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.399 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.399 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.399 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.399 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.399 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.399 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.399 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.399 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.399 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.400 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.400 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.400 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T17:09:46.400 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.400 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.400 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.400 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.400 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.400 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.400 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.400 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": "default-placement.data", 2024-09-12T17:09:46.400 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:09:46.400 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.401 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.401 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.401 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.401 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.401 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.401 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.401 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.401 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.401 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.401 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.401 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.401 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.401 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.402 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.402 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.402 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.402 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T17:09:46.402 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.402 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.402 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.402 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.402 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.402 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.402 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.402 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.402 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.403 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.403 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.403 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.403 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.403 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.403 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.403 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.403 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.403 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.403 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.403 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T17:09:46.403 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.403 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.404 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.404 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.404 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.404 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.404 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.404 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.404 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.404 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.404 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.404 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.404 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T17:09:46.404 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.404 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.405 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.405 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.405 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.405 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.405 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.405 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.405 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:09:46.405 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.405 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.405 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.405 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.405 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.405 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.405 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.406 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.406 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.406 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.406 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.406 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.406 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.406 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.406 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.406 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.406 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.406 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T17:09:46.406 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.406 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.406 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.407 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.407 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.407 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.407 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.407 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.407 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.407 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.407 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.407 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.407 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.407 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.407 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.407 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.408 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.408 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.408 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.408 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T17:09:46.408 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.408 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.408 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.408 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.408 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.408 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.408 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.408 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.408 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.408 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.409 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.409 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.409 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T17:09:46.409 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.409 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.409 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.409 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.409 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.409 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.409 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.409 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": "default-placement.data", 2024-09-12T17:09:46.409 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:09:46.409 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.410 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.410 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.410 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.410 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.410 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.410 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.410 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.410 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.410 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.410 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.410 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.410 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.410 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.410 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.410 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.411 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.411 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T17:09:46.411 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.411 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.411 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.411 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.411 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.411 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.411 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.411 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.411 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.411 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.411 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.411 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.411 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.412 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.412 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.412 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.412 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.412 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.412 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.412 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T17:09:46.412 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.412 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.412 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.412 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.412 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.412 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.412 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.412 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.413 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.413 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.413 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.413 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.413 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T17:09:46.413 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.413 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.413 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.413 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.413 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.413 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.413 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.413 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.414 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:09:46.414 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.414 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.414 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.414 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.414 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.414 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.414 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.414 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.414 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.414 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.414 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.414 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.414 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.414 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.415 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.415 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.415 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.415 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T17:09:46.415 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.415 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.415 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.415 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.415 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.415 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.415 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.415 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.415 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.416 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.416 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.416 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.416 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.416 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.416 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.416 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.416 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.416 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.416 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.416 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T17:09:46.416 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.416 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.416 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.417 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.417 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.417 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.417 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.417 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.417 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.417 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.417 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.417 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.417 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T17:09:46.417 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.417 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.417 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.418 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.418 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.418 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.418 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.418 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": "default-placement.data", 2024-09-12T17:09:46.418 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:09:46.418 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.418 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.418 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.418 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.418 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.418 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.418 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.418 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.419 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.419 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.419 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.419 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.419 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.419 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.419 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.419 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.419 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.419 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T17:09:46.419 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.419 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.419 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.419 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.420 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.420 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.420 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.420 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.420 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.420 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.420 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.420 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.420 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.420 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.420 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.420 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.420 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.420 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.421 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.421 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T17:09:46.421 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.421 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.421 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.421 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.421 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.421 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.421 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.421 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.421 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.421 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.421 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.421 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.422 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T17:09:46.422 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.422 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.422 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.422 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.422 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.422 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.422 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.422 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.422 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:09:46.422 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.422 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.423 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.423 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.423 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.423 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.423 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.423 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.423 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.423 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.423 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.423 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.423 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.423 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.423 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.424 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.424 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.424 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T17:09:46.424 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.424 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.424 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.424 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.424 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.424 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.424 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.424 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.424 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.424 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.424 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.425 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.425 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.425 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.425 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.425 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.425 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.425 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.425 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.425 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T17:09:46.425 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.425 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.425 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.425 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.425 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.426 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.426 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.426 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.426 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.426 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.426 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.426 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.426 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T17:09:46.426 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.426 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.426 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.426 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.426 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.426 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.426 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.427 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": "default-placement.data", 2024-09-12T17:09:46.427 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker___myobj", 2024-09-12T17:09:46.427 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj" 2024-09-12T17:09:46.427 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.427 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.427 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.427 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.427 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.427 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.428 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.428 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.428 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.428 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.428 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.428 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.428 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.428 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.428 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.428 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.428 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T17:09:46.428 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.428 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.428 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.429 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.429 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.429 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.429 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.429 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.429 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.429 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.429 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.429 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.429 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.429 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.429 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.429 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.429 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.430 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.430 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.430 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T17:09:46.430 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.430 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.430 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.430 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.430 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.430 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.430 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.430 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.430 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.430 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.431 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.431 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.431 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T17:09:46.431 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.431 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.431 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.431 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.431 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.431 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.431 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.431 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.431 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker___myobj", 2024-09-12T17:09:46.431 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj" 2024-09-12T17:09:46.431 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.431 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.432 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.432 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.432 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.432 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.432 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.432 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.432 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.432 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.432 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.432 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.432 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.432 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.432 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.432 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.433 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T17:09:46.433 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.433 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.433 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.433 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.433 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.433 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.433 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.433 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.433 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.433 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.433 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.433 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.434 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.434 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.434 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.434 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.434 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.434 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.434 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.434 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T17:09:46.434 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.434 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.434 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.434 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.434 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.434 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.435 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.435 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.435 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.435 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.435 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.435 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.435 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T17:09:46.435 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.435 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.435 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.435 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.435 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.435 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.435 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.436 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": "default-placement.data", 2024-09-12T17:09:46.436 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:09:46.436 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.436 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.436 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.436 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.436 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.436 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.436 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.436 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.436 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.436 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.436 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.436 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.437 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.437 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.437 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.437 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.437 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.437 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T17:09:46.437 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.437 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.437 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.437 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.437 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.437 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.437 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.437 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.438 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.438 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.438 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.438 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.438 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.438 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.438 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.438 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.438 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.438 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.438 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.438 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T17:09:46.438 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.438 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.439 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.439 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.439 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.439 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.439 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.439 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.439 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.439 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.439 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.439 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.439 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T17:09:46.439 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.439 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.439 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.439 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.440 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.440 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.440 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.440 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.440 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:09:46.440 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.440 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.440 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.440 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.440 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.440 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.440 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.440 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.440 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.441 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.441 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.441 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.441 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.442 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.442 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.442 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.442 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.442 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T17:09:46.442 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.442 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.442 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.442 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.442 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.442 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.442 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.442 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.443 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.443 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.443 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.443 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.443 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.443 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.443 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.443 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.443 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.443 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.443 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.443 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T17:09:46.443 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.444 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.444 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.444 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.444 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.444 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.444 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.444 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.444 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.444 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.444 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.444 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.444 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T17:09:46.444 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.445 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.445 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.445 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.445 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.445 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.445 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.445 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": "default-placement.data", 2024-09-12T17:09:46.445 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:09:46.445 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj" 2024-09-12T17:09:46.445 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.445 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.445 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.445 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.445 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.445 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.446 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.446 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.446 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.446 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.446 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.446 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.446 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.446 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.446 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.446 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.446 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T17:09:46.446 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.446 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.446 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.447 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.447 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.447 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.447 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.447 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.447 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.447 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.447 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.447 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.447 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.447 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.447 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.447 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.447 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.448 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.448 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.448 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T17:09:46.448 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.448 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.448 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.448 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.448 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.448 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.448 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.448 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.448 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.448 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.449 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.449 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.449 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T17:09:46.449 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.449 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.449 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.449 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.449 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.449 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.449 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.449 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.449 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:09:46.449 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj" 2024-09-12T17:09:46.449 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.450 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.450 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.450 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.450 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.450 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.450 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.450 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.450 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.450 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.450 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.450 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.450 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.450 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.450 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.451 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.451 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T17:09:46.451 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.451 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.451 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.451 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.451 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.451 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.451 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.451 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.451 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.451 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.451 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.452 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.452 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.452 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.452 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.452 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.452 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.452 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.452 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.452 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T17:09:46.452 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.452 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.452 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.452 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.453 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.453 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.453 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.453 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.453 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.453 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.453 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.453 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.453 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T17:09:46.453 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.453 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.453 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.453 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.454 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.454 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.454 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.454 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": "default-placement.data", 2024-09-12T17:09:46.454 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:09:46.454 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.454 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.454 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.454 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.454 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.454 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.454 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.454 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.454 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.455 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.455 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.455 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.455 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.455 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.455 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.455 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.455 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.455 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T17:09:46.455 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.455 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.455 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.455 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.455 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.456 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.456 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.456 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.456 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.456 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.456 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.456 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.456 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.456 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.456 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.456 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.456 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.456 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.456 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.457 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T17:09:46.457 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.457 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.457 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.457 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.457 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.457 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.457 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.457 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.457 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.457 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.457 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.457 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.458 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T17:09:46.458 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.458 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.458 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.458 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.458 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.458 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.458 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.458 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.458 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:09:46.458 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.458 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.458 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.458 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.459 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.459 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.459 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.459 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.459 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.459 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.459 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.459 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.459 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.459 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.459 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.459 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.459 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.460 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T17:09:46.460 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.460 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.460 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.460 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.460 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.460 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.460 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.460 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.460 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.460 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.460 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.460 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.460 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.461 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.461 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.461 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.461 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.461 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.461 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.461 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T17:09:46.461 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.461 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.461 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.461 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.461 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.461 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.461 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.462 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.462 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.462 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.462 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.462 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.462 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T17:09:46.462 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.462 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.462 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.462 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.462 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.462 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.462 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.462 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": "default-placement.data", 2024-09-12T17:09:46.463 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker___myobj_", 2024-09-12T17:09:46.463 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj_" 2024-09-12T17:09:46.463 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.463 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.463 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.463 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.463 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.463 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.463 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.463 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.463 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.463 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.463 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.464 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.464 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.464 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.464 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.464 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.464 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T17:09:46.464 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.464 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.464 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.464 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.464 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.464 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.464 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.464 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.465 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.465 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.465 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.465 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.465 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.465 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.465 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.465 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.465 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.465 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.465 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.465 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T17:09:46.465 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.465 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.466 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.466 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.466 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.466 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.466 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.466 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.466 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.466 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.466 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.466 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.466 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T17:09:46.466 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.466 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.466 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.467 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.467 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.467 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.467 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.467 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.467 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker___myobj_", 2024-09-12T17:09:46.467 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj_" 2024-09-12T17:09:46.467 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.467 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.467 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.467 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.467 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.467 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.467 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.468 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.468 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.468 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.468 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.468 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.468 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.468 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.468 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.468 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.468 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T17:09:46.468 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.468 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.468 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.469 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.469 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.469 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.469 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.469 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.469 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.469 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.469 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.469 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.469 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.469 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.469 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.469 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.469 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.470 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.470 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.470 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T17:09:46.470 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.470 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.470 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.470 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.470 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.470 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.470 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.470 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.470 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.470 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.470 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.471 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.471 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T17:09:46.471 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.471 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.471 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.471 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.471 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.471 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.471 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.471 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": "default-placement.data", 2024-09-12T17:09:46.471 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:09:46.471 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.471 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.471 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.472 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.472 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.472 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.472 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.472 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.472 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.472 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.472 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.472 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.472 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.472 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.472 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.472 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.472 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.473 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T17:09:46.473 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.473 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.473 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.473 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.473 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.473 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.473 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.473 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.473 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.473 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.474 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.474 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.474 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.474 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.474 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.474 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.474 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.474 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.474 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.474 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T17:09:46.474 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.475 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.475 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.475 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.475 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.475 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.475 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.475 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.475 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.475 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.475 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.475 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.475 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T17:09:46.475 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.476 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.476 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.476 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.476 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.476 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.476 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.476 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.476 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:09:46.476 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.476 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.476 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.476 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.476 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.476 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.477 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.477 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.477 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.477 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.477 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.477 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.477 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.477 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.477 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.477 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.477 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.477 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T17:09:46.477 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.478 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.478 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.478 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.478 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.478 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.478 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.478 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.478 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.478 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.478 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.478 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.478 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.478 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.478 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.479 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.479 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.479 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.479 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.479 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T17:09:46.479 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.479 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.479 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.479 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.479 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.479 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.479 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.479 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.479 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.480 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.480 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.480 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.480 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T17:09:46.480 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.480 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.480 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.480 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.480 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.480 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.480 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.480 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": "default-placement.data", 2024-09-12T17:09:46.480 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:09:46.480 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj_" 2024-09-12T17:09:46.481 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.481 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.481 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.481 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.481 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.481 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.481 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.481 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.481 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.481 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.481 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.481 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.481 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.481 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.482 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.482 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.482 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T17:09:46.482 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.482 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.482 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.482 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.482 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.482 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.482 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.482 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.482 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.482 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.482 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.483 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.483 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.483 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.483 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.483 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.483 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.483 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.483 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.483 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T17:09:46.483 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.483 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.483 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.483 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.483 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.484 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.484 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.484 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.484 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.484 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.484 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.484 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.484 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T17:09:46.484 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.484 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.484 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.484 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.484 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.484 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.485 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.485 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.485 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:09:46.485 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj_" 2024-09-12T17:09:46.485 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.485 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.485 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.485 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.485 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.485 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.485 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.485 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.485 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.485 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.486 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.486 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.486 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.486 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.486 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.486 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.486 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T17:09:46.486 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.486 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.486 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.486 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.486 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.486 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.487 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.487 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.487 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.487 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.487 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.487 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.487 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.487 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.487 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.487 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.487 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.487 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.487 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.487 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T17:09:46.488 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.488 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.488 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.488 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.488 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.488 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.488 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.488 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.488 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.488 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.488 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.488 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.488 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T17:09:46.488 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.489 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.489 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.489 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.489 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.489 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.489 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.489 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": "default-placement.data", 2024-09-12T17:09:46.489 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:09:46.489 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.491 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.491 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.491 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.491 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.491 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.491 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T17:09:46.491 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.491 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.491 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.491 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.491 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T17:09:46.491 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.491 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T17:09:46.492 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.492 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.492 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.492 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T17:09:46.492 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.492 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.492 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.492 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.492 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.492 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.492 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.492 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.493 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.493 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.494 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.494 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.494 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.494 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.494 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.494 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.494 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.494 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.494 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.494 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T17:09:46.494 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.494 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.494 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.494 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.495 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.495 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.495 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.495 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.495 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.495 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.495 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.495 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.495 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T17:09:46.495 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.495 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.495 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.495 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.496 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.496 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.496 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.496 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.496 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:09:46.496 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.496 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.496 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.496 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.496 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.497 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.497 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.497 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.497 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.497 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.497 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.497 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.497 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.497 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.497 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.497 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.497 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.497 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T17:09:46.497 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.498 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.498 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.498 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.498 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.498 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-12T17:09:46.498 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-12T17:09:46.498 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.498 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.498 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.498 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker_myobj", 2024-09-12T17:09:46.498 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.498 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.498 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.498 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.499 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.499 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.499 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.499 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.499 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.499 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.499 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.499 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.499 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.499 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.499 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.499 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.499 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.500 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T17:09:46.500 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.500 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.500 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.500 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.500 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.500 INFO:tasks.workunit.client.0.smithi067.stdout:raw=.data-pool:marker_myobj 2024-09-12T17:09:46.500 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.500 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj2": { 2024-09-12T17:09:46.500 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.500 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker_myobj", 2024-09-12T17:09:46.500 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.501 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.501 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.501 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.501 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj2": { 2024-09-12T17:09:46.501 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.501 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.501 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.501 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.501 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.502 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.502 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.502 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.502 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.502 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.502 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.502 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.502 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T17:09:46.502 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.502 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.502 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.502 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.502 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.503 INFO:tasks.workunit.client.0.smithi067.stdout:raw2=.data-pool:marker_myobj 2024-09-12T17:09:46.503 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.503 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.503 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.503 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:09:46.503 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.503 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.503 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.503 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.503 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.503 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.503 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.503 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.503 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.504 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.504 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.504 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.504 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.504 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.504 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.504 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.504 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.504 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T17:09:46.504 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.504 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.504 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.504 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.504 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.505 INFO:tasks.workunit.client.0.smithi067.stdout:raw=.data-pool:marker__ns_myobj 2024-09-12T17:09:46.505 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.505 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj2": { 2024-09-12T17:09:46.505 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.505 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:09:46.505 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.505 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.505 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.505 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.505 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj2": { 2024-09-12T17:09:46.505 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.505 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.505 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.506 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.506 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.506 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.506 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.506 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.506 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.506 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.506 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.506 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.506 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T17:09:46.506 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.506 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.506 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.506 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.507 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.507 INFO:tasks.workunit.client.0.smithi067.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-12T17:09:46.507 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.507 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.507 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.507 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:09:46.507 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.507 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.507 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.507 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.507 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.507 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.507 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.507 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.508 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.508 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.508 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.508 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.508 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.508 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.508 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.508 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.508 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.508 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T17:09:46.508 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.508 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.508 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.509 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.509 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.509 INFO:tasks.workunit.client.0.smithi067.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-12T17:09:46.509 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.509 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj2": { 2024-09-12T17:09:46.509 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.509 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:09:46.509 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.509 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.509 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.509 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.509 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj2": { 2024-09-12T17:09:46.510 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.510 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.510 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.510 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.510 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.510 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.510 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.510 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.510 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.510 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.510 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.511 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.511 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T17:09:46.511 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.511 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.511 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.511 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.511 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.511 INFO:tasks.workunit.client.0.smithi067.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-12T17:09:46.511 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.511 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.511 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.511 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:09:46.511 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.511 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.512 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.512 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.512 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.512 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.512 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.512 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.512 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.512 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.512 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.512 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.512 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.513 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.513 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.513 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.513 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.513 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T17:09:46.513 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.513 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.513 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.513 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.513 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.513 INFO:tasks.workunit.client.0.smithi067.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-12T17:09:46.513 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.513 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj2": { 2024-09-12T17:09:46.514 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.514 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:09:46.514 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.514 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.514 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.514 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.514 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj2": { 2024-09-12T17:09:46.514 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.514 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.514 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.514 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.514 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.514 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.514 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.515 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.515 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.515 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.515 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.515 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.515 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T17:09:46.515 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.515 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.515 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.515 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.515 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.515 INFO:tasks.workunit.client.0.smithi067.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-12T17:09:46.515 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.515 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.516 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.516 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker___myobj", 2024-09-12T17:09:46.516 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj" 2024-09-12T17:09:46.516 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.516 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.516 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.516 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.516 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.516 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.516 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.516 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.516 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.516 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.517 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.517 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.517 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.517 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.517 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.517 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.517 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T17:09:46.517 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.517 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.517 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.517 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.517 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.517 INFO:tasks.workunit.client.0.smithi067.stdout:raw=.data-pool:marker___myobj 2024-09-12T17:09:46.518 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.518 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj2": { 2024-09-12T17:09:46.518 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.518 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker___myobj", 2024-09-12T17:09:46.518 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj" 2024-09-12T17:09:46.518 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.518 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.518 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.518 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj2": { 2024-09-12T17:09:46.518 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.518 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.518 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.518 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.518 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.519 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.519 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.519 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.519 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.519 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.519 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.519 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.519 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T17:09:46.519 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.519 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.519 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.519 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.519 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.520 INFO:tasks.workunit.client.0.smithi067.stdout:raw2=.data-pool:marker___myobj 2024-09-12T17:09:46.520 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.520 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.520 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.520 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:09:46.520 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.520 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.520 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.520 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.520 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.520 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.520 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.520 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.521 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.521 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.521 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.521 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.521 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.521 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.521 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.521 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.521 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.521 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T17:09:46.521 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.521 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.521 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.521 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.522 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.522 INFO:tasks.workunit.client.0.smithi067.stdout:raw=.data-pool:marker__ns__myobj 2024-09-12T17:09:46.522 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.522 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj2": { 2024-09-12T17:09:46.522 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.522 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:09:46.522 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.522 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.522 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.522 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.522 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj2": { 2024-09-12T17:09:46.522 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.522 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.522 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.523 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.523 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.523 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.523 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.523 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.523 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.523 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.523 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.523 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.523 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T17:09:46.523 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.523 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.523 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.523 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.524 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.524 INFO:tasks.workunit.client.0.smithi067.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-12T17:09:46.524 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.524 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.524 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.524 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:09:46.524 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj" 2024-09-12T17:09:46.524 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.524 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.524 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.524 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.524 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.524 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.525 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.525 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.525 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.525 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.525 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.525 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.525 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.525 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.525 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.525 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.525 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T17:09:46.525 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.525 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.525 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.526 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.526 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.526 INFO:tasks.workunit.client.0.smithi067.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-12T17:09:46.526 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.526 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj2": { 2024-09-12T17:09:46.526 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.526 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:09:46.526 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj" 2024-09-12T17:09:46.526 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.526 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.526 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.526 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj2": { 2024-09-12T17:09:46.527 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.527 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.527 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.527 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.527 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.527 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.527 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.527 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.527 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.527 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.527 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.527 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.527 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T17:09:46.527 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.528 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.528 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.528 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.528 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.528 INFO:tasks.workunit.client.0.smithi067.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-12T17:09:46.528 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.528 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.528 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.528 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:09:46.528 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.528 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.528 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.528 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.528 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.529 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.529 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.529 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.529 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.529 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.529 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.529 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.529 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.529 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.529 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.529 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.529 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.529 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T17:09:46.529 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.530 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.530 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.530 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.530 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.530 INFO:tasks.workunit.client.0.smithi067.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-12T17:09:46.530 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.530 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj2": { 2024-09-12T17:09:46.530 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.530 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:09:46.530 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.530 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.530 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.530 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.530 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj2": { 2024-09-12T17:09:46.531 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.531 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.531 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.531 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.531 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.531 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.531 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.531 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.531 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.531 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.531 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.531 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.531 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T17:09:46.531 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.532 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.532 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.532 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.532 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.532 INFO:tasks.workunit.client.0.smithi067.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-12T17:09:46.532 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.532 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.532 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.532 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker___myobj_", 2024-09-12T17:09:46.532 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj_" 2024-09-12T17:09:46.532 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.532 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.532 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.532 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.533 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.533 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.533 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.533 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.533 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.533 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.533 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.533 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.533 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.533 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.533 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.533 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.533 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T17:09:46.534 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.534 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.534 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.534 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.534 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.534 INFO:tasks.workunit.client.0.smithi067.stdout:raw=.data-pool:marker___myobj_ 2024-09-12T17:09:46.534 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.534 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj2": { 2024-09-12T17:09:46.534 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.534 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker___myobj_", 2024-09-12T17:09:46.534 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj_" 2024-09-12T17:09:46.534 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.534 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.534 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.535 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj2": { 2024-09-12T17:09:46.535 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.535 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.535 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.535 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.536 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.536 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.536 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.537 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.537 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.537 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.537 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.537 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.537 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T17:09:46.537 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.537 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.537 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.537 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.537 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.537 INFO:tasks.workunit.client.0.smithi067.stdout:raw2=.data-pool:marker___myobj_ 2024-09-12T17:09:46.538 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.538 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.538 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.538 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:09:46.538 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.538 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.538 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.538 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.538 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.538 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.538 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.538 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.538 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.538 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.539 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.539 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.539 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.539 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.539 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.539 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.539 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.539 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T17:09:46.539 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.539 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.539 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.539 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.540 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.540 INFO:tasks.workunit.client.0.smithi067.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-12T17:09:46.540 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.540 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj2": { 2024-09-12T17:09:46.540 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.540 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:09:46.540 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.540 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.540 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.540 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.540 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj2": { 2024-09-12T17:09:46.540 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.540 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.541 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.541 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.541 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.541 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.541 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.541 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.541 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.541 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.541 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.541 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.541 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T17:09:46.541 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T17:09:46.541 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.541 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.542 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.542 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.542 INFO:tasks.workunit.client.0.smithi067.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-12T17:09:46.542 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.542 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.542 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.542 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:09:46.542 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj_" 2024-09-12T17:09:46.542 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.542 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.542 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.542 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.542 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.543 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.543 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.543 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.543 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.544 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.544 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.544 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.544 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.544 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.544 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.544 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.544 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T17:09:46.544 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.545 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.545 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.545 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.545 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.545 INFO:tasks.workunit.client.0.smithi067.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-12T17:09:46.545 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.545 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj2": { 2024-09-12T17:09:46.545 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.545 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:09:46.545 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj_" 2024-09-12T17:09:46.545 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.545 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.545 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.545 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj2": { 2024-09-12T17:09:46.546 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.546 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.546 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.546 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.546 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.546 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.546 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.546 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.546 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.546 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.546 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.546 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.546 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T17:09:46.547 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.547 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T17:09:46.547 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.547 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.547 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.547 INFO:tasks.workunit.client.0.smithi067.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-12T17:09:46.547 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.547 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T17:09:46.547 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.547 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:09:46.547 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.547 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.547 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.547 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.548 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T17:09:46.548 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.548 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.548 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.548 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.548 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.548 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.548 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.548 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.548 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.548 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.548 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.549 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.549 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T17:09:46.549 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.549 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.549 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.549 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.549 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.549 INFO:tasks.workunit.client.0.smithi067.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-12T17:09:46.549 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.549 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj2": { 2024-09-12T17:09:46.549 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T17:09:46.549 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:09:46.550 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T17:09:46.550 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.550 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.550 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:46.550 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj2": { 2024-09-12T17:09:46.550 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T17:09:46.550 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T17:09:46.550 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T17:09:46.550 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T17:09:46.550 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T17:09:46.550 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T17:09:46.550 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T17:09:46.550 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T17:09:46.550 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T17:09:46.551 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.551 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:46.551 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T17:09:46.551 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T17:09:46.551 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T17:09:46.551 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T17:09:46.551 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.551 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:46.551 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:46.551 INFO:tasks.workunit.client.0.smithi067.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-12T17:09:46.551 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-12T17:09:46.551 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 4 tests from TestRGWObj (0 ms total) 2024-09-12T17:09:46.552 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T17:09:46.552 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T17:09:46.552 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-12T17:09:46.552 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 4 tests. 2024-09-12T17:09:46.552 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:09:46.552 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:09:46.597 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-12T17:09:46.598 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-12T17:09:46.599 DEBUG:teuthology.orchestra.run.smithi067:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-12T17:09:46.719 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:09:46.720 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:09:46.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.767+0000 7fe891b40800 20 rados->read ofs=0 len=0 2024-09-12T17:09:46.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.768+0000 7fe891b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:09:46.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.768+0000 7fe891b40800 20 realm 2024-09-12T17:09:46.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.768+0000 7fe891b40800 20 rados->read ofs=0 len=0 2024-09-12T17:09:46.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.768+0000 7fe891b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:09:46.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.768+0000 7fe891b40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:09:46.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.768+0000 7fe891b40800 20 rados->read ofs=0 len=0 2024-09-12T17:09:46.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.768+0000 7fe891b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:09:46.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.768+0000 7fe891b40800 20 rados->read ofs=0 len=0 2024-09-12T17:09:46.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.769+0000 7fe891b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:09:46.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.769+0000 7fe891b40800 20 rados->read ofs=0 len=0 2024-09-12T17:09:46.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.770+0000 7fe891b40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:09:46.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.770+0000 7fe891b40800 20 searching for the correct realm 2024-09-12T17:09:46.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.776+0000 7fe887fff640 0 -- 172.21.15.67:0/1365280826 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x5569dc03e4a0 msgr2=0x5569dc0408b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:09:46.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.784+0000 7fe88d8c0640 0 -- 172.21.15.67:0/1365280826 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fe878019740 msgr2=0x7fe878063730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:09:46.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.992+0000 7fe891b40800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:09:46.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.992+0000 7fe891b40800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:09:46.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.992+0000 7fe891b40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:09:46.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.992+0000 7fe891b40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:09:46.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.992+0000 7fe891b40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:09:46.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.992+0000 7fe891b40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:09:46.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.992+0000 7fe891b40800 20 rados->read ofs=0 len=0 2024-09-12T17:09:46.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.992+0000 7fe891b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:09:46.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.992+0000 7fe891b40800 20 rados->read ofs=0 len=0 2024-09-12T17:09:46.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.992+0000 7fe891b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:09:46.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.992+0000 7fe891b40800 20 rados->read ofs=0 len=0 2024-09-12T17:09:46.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.993+0000 7fe891b40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:09:46.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.993+0000 7fe891b40800 20 zone default found 2024-09-12T17:09:46.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.993+0000 7fe891b40800 4 Realm: () 2024-09-12T17:09:46.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.993+0000 7fe891b40800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:09:46.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.993+0000 7fe891b40800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:09:46.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.993+0000 7fe891b40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:09:46.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.993+0000 7fe891b40800 20 zonegroup default 2024-09-12T17:09:46.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.993+0000 7fe891b40800 20 rados->read ofs=0 len=0 2024-09-12T17:09:46.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.993+0000 7fe891b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:09:46.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.993+0000 7fe891b40800 20 rados->read ofs=0 len=0 2024-09-12T17:09:46.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.994+0000 7fe891b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:09:46.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.994+0000 7fe891b40800 20 rados->read ofs=0 len=0 2024-09-12T17:09:46.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.994+0000 7fe891b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:09:46.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.994+0000 7fe891b40800 20 started sync module instance, tier type = 2024-09-12T17:09:46.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:46.994+0000 7fe891b40800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:09:47.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.004+0000 7fe891b40800 20 add_watcher() i=0 2024-09-12T17:09:47.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.004+0000 7fe891b40800 20 add_watcher() i=1 2024-09-12T17:09:47.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.004+0000 7fe891b40800 20 add_watcher() i=2 2024-09-12T17:09:47.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.004+0000 7fe891b40800 20 add_watcher() i=3 2024-09-12T17:09:47.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.004+0000 7fe891b40800 20 add_watcher() i=4 2024-09-12T17:09:47.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.004+0000 7fe891b40800 20 add_watcher() i=5 2024-09-12T17:09:47.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.004+0000 7fe891b40800 20 add_watcher() i=6 2024-09-12T17:09:47.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.005+0000 7fe891b40800 20 add_watcher() i=7 2024-09-12T17:09:47.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.005+0000 7fe891b40800 2 all 8 watchers are set, enabling cache 2024-09-12T17:09:47.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.007+0000 7fe7377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:09:47.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.007+0000 7fe891b40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:09:47.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.007+0000 7fe891b40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:09:47.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.007+0000 7fe891b40800 5 note: GC not initialized 2024-09-12T17:09:47.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.007+0000 7fe7367fc640 20 reqs_thread_entry: start 2024-09-12T17:09:47.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.007+0000 7fe891b40800 20 init_complete bucket index max shards: 1 2024-09-12T17:09:47.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.007+0000 7fe891b40800 20 Filter name: none 2024-09-12T17:09:47.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.008+0000 7fe6affff640 20 reqs_thread_entry: start 2024-09-12T17:09:47.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.008+0000 7fe891b40800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-12T17:09:47.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.008+0000 7fe891b40800 20 rados->read ofs=0 len=0 2024-09-12T17:09:47.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.008+0000 7fe891b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:09:47.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.008+0000 7fe891b40800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-12T17:09:47.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.008+0000 7fe891b40800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:09:47.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.008+0000 7fe891b40800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-12T17:09:47.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.008+0000 7fe891b40800 20 rados->read ofs=0 len=0 2024-09-12T17:09:47.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.008+0000 7fe891b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:09:47.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.008+0000 7fe891b40800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-12T17:09:47.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.008+0000 7fe891b40800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:09:47.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.008+0000 7fe891b40800 10 cache get: name=default.rgw.meta+users.keys+PHbRe0fcPLp6/QR6ujmv3i49iJY= : miss 2024-09-12T17:09:47.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.008+0000 7fe891b40800 20 rados->read ofs=0 len=0 2024-09-12T17:09:47.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.009+0000 7fe891b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:09:47.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.009+0000 7fe891b40800 10 cache put: name=default.rgw.meta+users.keys+PHbRe0fcPLp6/QR6ujmv3i49iJY= info.flags=0x0 2024-09-12T17:09:47.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.009+0000 7fe891b40800 10 adding default.rgw.meta+users.keys+PHbRe0fcPLp6/QR6ujmv3i49iJY= to cache LRU end 2024-09-12T17:09:47.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.009+0000 7fe891b40800 10 cache get: name=default.rgw.meta+users.keys+PHbRe0fcPLp6/QR6ujmv3i49iJY= : hit (negative entry) 2024-09-12T17:09:47.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.009+0000 7fe891b40800 10 cache get: name=default.rgw.meta+users.keys+PHbRe0fcPLp6/QR6ujmv3i49iJY= : hit (negative entry) 2024-09-12T17:09:47.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.010+0000 7fe891b40800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T17:09:47.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.010+0000 7fe891b40800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:09:47.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.010+0000 7fe891b40800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-12T17:09:47.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.011+0000 7fe7717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824002 cookie 93913151201760 notifier 5321 bl.length()=697 2024-09-12T17:09:47.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.011+0000 7fe7717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T17:09:47.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.011+0000 7fe7717fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:09:47.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.016+0000 7fe891b40800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T17:09:47.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.016+0000 7fe891b40800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:09:47.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.016+0000 7fe891b40800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-12T17:09:47.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.017+0000 7fe7717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824000 cookie 93913151203328 notifier 5321 bl.length()=194 2024-09-12T17:09:47.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.017+0000 7fe7717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T17:09:47.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.017+0000 7fe7717fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:09:47.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.019+0000 7fe891b40800 10 cache put: name=default.rgw.meta+users.keys+PHbRe0fcPLp6/QR6ujmv3i49iJY= info.flags=0x7 2024-09-12T17:09:47.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.020+0000 7fe891b40800 10 moving default.rgw.meta+users.keys+PHbRe0fcPLp6/QR6ujmv3i49iJY= to cache LRU end 2024-09-12T17:09:47.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.020+0000 7fe891b40800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:PHbRe0fcPLp6/QR6ujmv3i49iJY=, ofs0, ns] 2024-09-12T17:09:47.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.020+0000 7fe7717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824000 cookie 93913151220720 notifier 5321 bl.length()=203 2024-09-12T17:09:47.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.020+0000 7fe7717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PHbRe0fcPLp6/QR6ujmv3i49iJY= info.flags=0x7 2024-09-12T17:09:47.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.020+0000 7fe7717fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PHbRe0fcPLp6/QR6ujmv3i49iJY= to cache LRU end 2024-09-12T17:09:47.022 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:09:47.022 INFO:tasks.workunit.client.0.smithi067.stdout: "user_id": "ceph-test-librgw-file", 2024-09-12T17:09:47.023 INFO:tasks.workunit.client.0.smithi067.stdout: "display_name": "librgw test user", 2024-09-12T17:09:47.023 INFO:tasks.workunit.client.0.smithi067.stdout: "email": "librgw@example.com", 2024-09-12T17:09:47.023 INFO:tasks.workunit.client.0.smithi067.stdout: "suspended": 0, 2024-09-12T17:09:47.023 INFO:tasks.workunit.client.0.smithi067.stdout: "max_buckets": 1000, 2024-09-12T17:09:47.023 INFO:tasks.workunit.client.0.smithi067.stdout: "subusers": [], 2024-09-12T17:09:47.023 INFO:tasks.workunit.client.0.smithi067.stdout: "keys": [ 2024-09-12T17:09:47.023 INFO:tasks.workunit.client.0.smithi067.stdout: { 2024-09-12T17:09:47.023 INFO:tasks.workunit.client.0.smithi067.stdout: "user": "ceph-test-librgw-file", 2024-09-12T17:09:47.023 INFO:tasks.workunit.client.0.smithi067.stdout: "access_key": "PHbRe0fcPLp6/QR6ujmv3i49iJY=", 2024-09-12T17:09:47.023 INFO:tasks.workunit.client.0.smithi067.stdout: "secret_key": "ywANHmAdo8NWoRxAu24Hww4RsmB4RCBQTtSfnjiEHcGBfJd5kSAn3w==", 2024-09-12T17:09:47.023 INFO:tasks.workunit.client.0.smithi067.stdout: "active": true, 2024-09-12T17:09:47.023 INFO:tasks.workunit.client.0.smithi067.stdout: "create_date": "2024-09-12T17:09:47.009988Z" 2024-09-12T17:09:47.023 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:09:47.023 INFO:tasks.workunit.client.0.smithi067.stdout: ], 2024-09-12T17:09:47.024 INFO:tasks.workunit.client.0.smithi067.stdout: "swift_keys": [], 2024-09-12T17:09:47.024 INFO:tasks.workunit.client.0.smithi067.stdout: "caps": [], 2024-09-12T17:09:47.024 INFO:tasks.workunit.client.0.smithi067.stdout: "op_mask": "read, write, delete", 2024-09-12T17:09:47.024 INFO:tasks.workunit.client.0.smithi067.stdout: "default_placement": "", 2024-09-12T17:09:47.024 INFO:tasks.workunit.client.0.smithi067.stdout: "default_storage_class": "", 2024-09-12T17:09:47.024 INFO:tasks.workunit.client.0.smithi067.stdout: "placement_tags": [], 2024-09-12T17:09:47.024 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_quota": { 2024-09-12T17:09:47.024 INFO:tasks.workunit.client.0.smithi067.stdout: "enabled": false, 2024-09-12T17:09:47.024 INFO:tasks.workunit.client.0.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:09:47.024 INFO:tasks.workunit.client.0.smithi067.stdout: "max_size": -1, 2024-09-12T17:09:47.024 INFO:tasks.workunit.client.0.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:09:47.024 INFO:tasks.workunit.client.0.smithi067.stdout: "max_objects": -1 2024-09-12T17:09:47.024 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:47.024 INFO:tasks.workunit.client.0.smithi067.stdout: "user_quota": { 2024-09-12T17:09:47.024 INFO:tasks.workunit.client.0.smithi067.stdout: "enabled": false, 2024-09-12T17:09:47.025 INFO:tasks.workunit.client.0.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:09:47.025 INFO:tasks.workunit.client.0.smithi067.stdout: "max_size": -1, 2024-09-12T17:09:47.025 INFO:tasks.workunit.client.0.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:09:47.025 INFO:tasks.workunit.client.0.smithi067.stdout: "max_objects": -1 2024-09-12T17:09:47.025 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:09:47.025 INFO:tasks.workunit.client.0.smithi067.stdout: "temp_url_keys": [], 2024-09-12T17:09:47.025 INFO:tasks.workunit.client.0.smithi067.stdout: "type": "rgw", 2024-09-12T17:09:47.025 INFO:tasks.workunit.client.0.smithi067.stdout: "mfa_ids": [], 2024-09-12T17:09:47.025 INFO:tasks.workunit.client.0.smithi067.stdout: "account_id": "", 2024-09-12T17:09:47.025 INFO:tasks.workunit.client.0.smithi067.stdout: "path": "/", 2024-09-12T17:09:47.025 INFO:tasks.workunit.client.0.smithi067.stdout: "create_date": "2024-09-12T17:09:47.009976Z", 2024-09-12T17:09:47.025 INFO:tasks.workunit.client.0.smithi067.stdout: "tags": [], 2024-09-12T17:09:47.025 INFO:tasks.workunit.client.0.smithi067.stdout: "group_ids": [] 2024-09-12T17:09:47.025 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:09:47.026 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T17:09:47.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.022+0000 7fe7377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:09:47.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.024+0000 7fe891b40800 20 remove_watcher() i=0 2024-09-12T17:09:47.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.025+0000 7fe891b40800 2 removed watcher, disabling cache 2024-09-12T17:09:47.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.026+0000 7fe891b40800 20 remove_watcher() i=1 2024-09-12T17:09:47.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.027+0000 7fe891b40800 20 remove_watcher() i=2 2024-09-12T17:09:47.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.028+0000 7fe891b40800 20 remove_watcher() i=3 2024-09-12T17:09:47.030 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.029+0000 7fe891b40800 20 remove_watcher() i=4 2024-09-12T17:09:47.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.030+0000 7fe891b40800 20 remove_watcher() i=5 2024-09-12T17:09:47.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.031+0000 7fe891b40800 20 remove_watcher() i=6 2024-09-12T17:09:47.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.032+0000 7fe891b40800 20 remove_watcher() i=7 2024-09-12T17:09:47.044 INFO:tasks.workunit.client.0.smithi067.stdout:phase 1.1 2024-09-12T17:09:47.066 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:09:47.066 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T17:09:47.066 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:09:47.066 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:09:47.077 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:09:47.077 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:09:47.256 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.INIT (190 ms) 2024-09-12T17:09:47.256 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:09:47.257 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T17:09:47.257 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:09:47.257 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:09:47.257 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:09:47.267 INFO:tasks.workunit.client.0.smithi067.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-12T17:09:47.272 INFO:tasks.workunit.client.0.smithi067.stdout:creating: nfsroot:foo/f1 2024-09-12T17:09:47.275 INFO:tasks.workunit.client.0.smithi067.stdout:creating: nfsroot:foo/f2 2024-09-12T17:09:47.278 INFO:tasks.workunit.client.0.smithi067.stdout:creating: nfsroot:foo/bar/f1 2024-09-12T17:09:47.282 INFO:tasks.workunit.client.0.smithi067.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-12T17:09:47.285 INFO:tasks.workunit.client.0.smithi067.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-12T17:09:47.287 INFO:tasks.workunit.client.0.smithi067.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-12T17:09:47.290 INFO:tasks.workunit.client.0.smithi067.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-12T17:09:47.292 INFO:tasks.workunit.client.0.smithi067.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-12T17:09:47.295 INFO:tasks.workunit.client.0.smithi067.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-12T17:09:47.297 INFO:tasks.workunit.client.0.smithi067.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-12T17:09:47.300 INFO:tasks.workunit.client.0.smithi067.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-12T17:09:47.303 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SETUP_HIER1 (46 ms) 2024-09-12T17:09:47.303 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:09:47.396 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SETUP_DIRS1 (93 ms) 2024-09-12T17:09:47.397 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:09:47.397 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:09:47.397 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:09:47.411 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (16 ms) 2024-09-12T17:09:47.412 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:09:47.451 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (40 ms) 2024-09-12T17:09:47.452 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:09:47.452 INFO:tasks.workunit.client.0.smithi067.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-12T17:09:47.457 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (5 ms) 2024-09-12T17:09:47.457 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:09:47.457 INFO:tasks.workunit.client.0.smithi067.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-12T17:09:47.463 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (6 ms) 2024-09-12T17:09:47.463 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:09:47.463 INFO:tasks.workunit.client.0.smithi067.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T17:09:47.463 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:09:47.463 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:09:47.463 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:09:47.463 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:09:47.463 INFO:tasks.workunit.client.0.smithi067.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T17:09:47.463 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:09:47.463 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:09:47.464 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:09:47.464 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:09:47.464 INFO:tasks.workunit.client.0.smithi067.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T17:09:47.464 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:09:47.464 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:09:47.464 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:09:47.464 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:09:47.464 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:09:47.464 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:09:47.464 INFO:tasks.workunit.client.0.smithi067.stdout:read back objects in /bdirs1/dir_0 2024-09-12T17:09:47.464 INFO:tasks.workunit.client.0.smithi067.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T17:09:47.465 INFO:tasks.workunit.client.0.smithi067.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:09:47.465 INFO:tasks.workunit.client.0.smithi067.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T17:09:47.465 INFO:tasks.workunit.client.0.smithi067.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:09:47.465 INFO:tasks.workunit.client.0.smithi067.stdout:read back objects in /bdirs1/dir_1 2024-09-12T17:09:47.465 INFO:tasks.workunit.client.0.smithi067.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T17:09:47.466 INFO:tasks.workunit.client.0.smithi067.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:09:47.466 INFO:tasks.workunit.client.0.smithi067.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T17:09:47.466 INFO:tasks.workunit.client.0.smithi067.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:09:47.466 INFO:tasks.workunit.client.0.smithi067.stdout:read back objects in /bdirs1/dir_2 2024-09-12T17:09:47.466 INFO:tasks.workunit.client.0.smithi067.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T17:09:47.467 INFO:tasks.workunit.client.0.smithi067.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:09:47.467 INFO:tasks.workunit.client.0.smithi067.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T17:09:47.468 INFO:tasks.workunit.client.0.smithi067.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:09:47.468 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.READ_DIRS1 (6 ms) 2024-09-12T17:09:47.468 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:09:47.649 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.READF_SETUP1 (180 ms) 2024-09-12T17:09:47.649 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:09:47.649 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:09:47.649 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:09:47.649 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:09:47.650 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:09:47.650 INFO:tasks.workunit.client.0.smithi067.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:09:47.650 INFO:tasks.workunit.client.0.smithi067.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:09:47.650 INFO:tasks.workunit.client.0.smithi067.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:09:47.650 INFO:tasks.workunit.client.0.smithi067.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:09:47.650 INFO:tasks.workunit.client.0.smithi067.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:09:47.650 INFO:tasks.workunit.client.0.smithi067.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:09:47.650 INFO:tasks.workunit.client.0.smithi067.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:09:47.650 INFO:tasks.workunit.client.0.smithi067.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:09:47.650 INFO:tasks.workunit.client.0.smithi067.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:09:47.650 INFO:tasks.workunit.client.0.smithi067.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:09:47.650 INFO:tasks.workunit.client.0.smithi067.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:09:47.650 INFO:tasks.workunit.client.0.smithi067.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:09:47.651 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:09:47.651 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:09:47.656 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T17:09:47.657 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T17:09:47.659 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T17:09:47.661 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T17:09:47.663 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:09:47.663 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:09:47.664 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T17:09:47.664 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T17:09:47.665 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:09:47.665 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:09:47.666 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T17:09:47.668 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T17:09:47.668 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T17:09:47.668 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T17:09:47.668 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo (foo): DIR 2024-09-12T17:09:47.668 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot (nfsroot): DIR 2024-09-12T17:09:47.668 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.HIER1 (19 ms) 2024-09-12T17:09:47.668 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:09:47.668 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:09:47.668 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:09:47.668 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:09:47.669 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:09:47.669 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:09:47.669 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:09:47.669 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:09:47.669 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:09:47.669 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:09:47.669 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:09:47.669 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:09:47.669 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:09:47.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.666+0000 7f8f005208c0 -1 shutting down 2024-09-12T17:09:47.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:09:47.667+0000 7f8dd84f5640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65725, si_uid : 1000, si_addr0x3e8000100bd, si_status0 2024-09-12T17:10:17.482 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SHUTDOWN (29813 ms) 2024-09-12T17:10:17.482 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 24 tests from LibRGW (30415 ms total) 2024-09-12T17:10:17.482 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T17:10:17.482 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T17:10:17.482 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 24 tests from 1 test suite ran. (30415 ms total) 2024-09-12T17:10:17.482 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 24 tests. 2024-09-12T17:10:17.488 INFO:tasks.workunit.client.0.smithi067.stdout:phase 1.2 2024-09-12T17:10:17.513 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:10:17.514 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T17:10:17.514 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:10:17.514 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:10:17.522 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:10:17.522 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:10:17.710 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.INIT (196 ms) 2024-09-12T17:10:17.710 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:10:17.711 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T17:10:17.711 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:10:17.712 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:10:17.712 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:10:17.712 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-12T17:10:17.712 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:10:17.712 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-12T17:10:17.712 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:10:17.712 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:10:17.712 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:10:17.712 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T17:10:17.712 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:10:17.712 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T17:10:17.712 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:10:17.712 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T17:10:17.713 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:10:17.713 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T17:10:17.713 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:10:17.713 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:10:17.713 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:10:17.713 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-12T17:10:17.713 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:10:17.713 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T17:10:17.713 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:10:17.713 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:10:17.713 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:10:17.713 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:10:17.713 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:10:17.714 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:10:17.714 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:10:17.714 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-12T17:10:17.714 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:10:17.714 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:10:17.714 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:10:17.714 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:10:17.714 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:10:17.714 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:10:17.714 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:10:17.714 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:10:17.714 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:10:17.714 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:10:17.715 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:10:17.715 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:10:17.715 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:10:17.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:10:17.709+0000 7fee2b11f8c0 -1 shutting down 2024-09-12T17:10:17.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:10:17.711+0000 7fed02fcf640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66347, si_uid : 1000, si_addr0x3e80001032b, si_status0 2024-09-12T17:10:47.770 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SHUTDOWN (30059 ms) 2024-09-12T17:10:47.770 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 24 tests from LibRGW (30256 ms total) 2024-09-12T17:10:47.770 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T17:10:47.771 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T17:10:47.771 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 24 tests from 1 test suite ran. (30256 ms total) 2024-09-12T17:10:47.771 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 24 tests. 2024-09-12T17:10:47.776 INFO:tasks.workunit.client.0.smithi067.stdout:phase 1.3 2024-09-12T17:10:47.801 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:10:47.801 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T17:10:47.801 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:10:47.802 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:10:47.812 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:10:47.812 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:10:48.629 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.INIT (827 ms) 2024-09-12T17:10:48.629 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:10:48.630 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T17:10:48.630 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:10:48.630 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:10:48.630 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:10:48.635 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SETUP_HIER1 (6 ms) 2024-09-12T17:10:48.635 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:10:48.697 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SETUP_DIRS1 (62 ms) 2024-09-12T17:10:48.698 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:10:48.698 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:10:48.698 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:10:48.698 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T17:10:48.698 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:10:48.698 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T17:10:48.698 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:10:48.698 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T17:10:48.698 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:10:48.698 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T17:10:48.698 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:10:48.699 INFO:tasks.workunit.client.0.smithi067.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T17:10:48.699 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:10:48.699 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:10:48.699 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:10:48.699 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:10:48.699 INFO:tasks.workunit.client.0.smithi067.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T17:10:48.699 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:10:48.699 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:10:48.699 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:10:48.699 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:10:48.699 INFO:tasks.workunit.client.0.smithi067.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T17:10:48.699 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:10:48.699 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:10:48.699 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:10:48.700 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:10:48.700 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:10:48.700 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:10:48.700 INFO:tasks.workunit.client.0.smithi067.stdout:read back objects in /bdirs1/dir_0 2024-09-12T17:10:48.700 INFO:tasks.workunit.client.0.smithi067.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T17:10:48.700 INFO:tasks.workunit.client.0.smithi067.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:10:48.700 INFO:tasks.workunit.client.0.smithi067.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T17:10:48.701 INFO:tasks.workunit.client.0.smithi067.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:10:48.701 INFO:tasks.workunit.client.0.smithi067.stdout:read back objects in /bdirs1/dir_1 2024-09-12T17:10:48.701 INFO:tasks.workunit.client.0.smithi067.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T17:10:48.701 INFO:tasks.workunit.client.0.smithi067.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:10:48.701 INFO:tasks.workunit.client.0.smithi067.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T17:10:48.701 INFO:tasks.workunit.client.0.smithi067.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:10:48.702 INFO:tasks.workunit.client.0.smithi067.stdout:read back objects in /bdirs1/dir_2 2024-09-12T17:10:48.702 INFO:tasks.workunit.client.0.smithi067.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T17:10:48.702 INFO:tasks.workunit.client.0.smithi067.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:10:48.702 INFO:tasks.workunit.client.0.smithi067.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T17:10:48.704 INFO:tasks.workunit.client.0.smithi067.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:10:48.704 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.READ_DIRS1 (6 ms) 2024-09-12T17:10:48.704 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:10:48.704 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T17:10:48.704 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:10:48.705 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:10:48.705 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:10:48.705 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:10:48.705 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:10:48.705 INFO:tasks.workunit.client.0.smithi067.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:10:48.705 INFO:tasks.workunit.client.0.smithi067.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:10:48.705 INFO:tasks.workunit.client.0.smithi067.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:10:48.705 INFO:tasks.workunit.client.0.smithi067.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:10:48.705 INFO:tasks.workunit.client.0.smithi067.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:10:48.705 INFO:tasks.workunit.client.0.smithi067.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:10:48.705 INFO:tasks.workunit.client.0.smithi067.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:10:48.705 INFO:tasks.workunit.client.0.smithi067.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:10:48.705 INFO:tasks.workunit.client.0.smithi067.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:10:48.706 INFO:tasks.workunit.client.0.smithi067.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:10:48.706 INFO:tasks.workunit.client.0.smithi067.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:10:48.706 INFO:tasks.workunit.client.0.smithi067.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:10:48.706 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:10:48.706 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:10:48.712 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T17:10:48.713 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T17:10:48.716 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T17:10:48.717 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T17:10:48.719 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:10:48.720 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:10:48.720 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T17:10:48.721 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T17:10:48.722 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:10:48.722 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:10:48.723 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T17:10:48.725 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T17:10:48.725 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T17:10:48.725 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T17:10:48.725 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo (foo): DIR 2024-09-12T17:10:48.725 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot (nfsroot): DIR 2024-09-12T17:10:48.725 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.HIER1 (21 ms) 2024-09-12T17:10:48.725 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:10:48.725 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:10:48.726 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:10:48.726 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:10:48.726 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:10:48.726 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:10:48.726 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:10:48.726 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:10:48.726 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:10:48.726 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:10:48.726 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:10:48.726 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:10:48.726 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:10:48.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:10:48.722+0000 7fd56bf268c0 -1 shutting down 2024-09-12T17:10:48.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:10:48.723+0000 7fd4433cf640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66967, si_uid : 1000, si_addr0x3e800010597, si_status0 2024-09-12T17:11:18.774 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SHUTDOWN (30049 ms) 2024-09-12T17:11:18.775 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 24 tests from LibRGW (30972 ms total) 2024-09-12T17:11:18.775 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T17:11:18.775 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T17:11:18.775 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 24 tests from 1 test suite ran. (30972 ms total) 2024-09-12T17:11:18.775 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 24 tests. 2024-09-12T17:11:18.780 INFO:tasks.workunit.client.0.smithi067.stdout:phase 2.1 2024-09-12T17:11:18.807 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:11:18.807 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T17:11:18.807 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 9 tests from LibRGW 2024-09-12T17:11:18.807 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:11:18.816 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:18.816 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:19.209 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.INIT (403 ms) 2024-09-12T17:11:19.209 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:11:19.210 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:11:19.210 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:11:19.220 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CREATE_BUCKET (10 ms) 2024-09-12T17:11:19.220 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:11:19.220 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:11:19.221 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T17:11:19.229 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave0 2024-09-12T17:11:19.238 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave1 2024-09-12T17:11:19.247 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave2 2024-09-12T17:11:19.256 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave3 2024-09-12T17:11:19.265 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave4 2024-09-12T17:11:19.275 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave5 2024-09-12T17:11:19.284 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave6 2024-09-12T17:11:19.293 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave7 2024-09-12T17:11:19.303 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave8 2024-09-12T17:11:19.312 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave9 2024-09-12T17:11:19.312 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (92 ms) 2024-09-12T17:11:19.312 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T17:11:19.484 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (172 ms) 2024-09-12T17:11:19.485 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:11:19.485 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:11:19.485 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:11:19.485 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:11:19.485 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:11:19.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:11:19.483+0000 7fe72b91f8c0 -1 shutting down 2024-09-12T17:11:19.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:11:19.484+0000 7fe603898640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67588, si_uid : 1000, si_addr0x3e800010804, si_status0 2024-09-12T17:11:49.280 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SHUTDOWN (29795 ms) 2024-09-12T17:11:49.281 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 9 tests from LibRGW (30473 ms total) 2024-09-12T17:11:49.281 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T17:11:49.281 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T17:11:49.281 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 9 tests from 1 test suite ran. (30473 ms total) 2024-09-12T17:11:49.281 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 9 tests. 2024-09-12T17:11:49.286 INFO:tasks.workunit.client.0.smithi067.stdout:phase 2.2 2024-09-12T17:11:49.311 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:11:49.311 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T17:11:49.312 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 9 tests from LibRGW 2024-09-12T17:11:49.312 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:11:49.321 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:49.321 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:49.711 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.INIT (400 ms) 2024-09-12T17:11:49.712 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:11:49.712 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:11:49.713 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:11:49.713 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:11:49.713 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:11:49.735 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.DELETE_BUCKET (22 ms) 2024-09-12T17:11:49.735 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T17:11:49.744 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave0 2024-09-12T17:11:49.753 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave1 2024-09-12T17:11:49.763 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave2 2024-09-12T17:11:49.772 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave3 2024-09-12T17:11:49.782 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave4 2024-09-12T17:11:49.791 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave5 2024-09-12T17:11:49.800 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave6 2024-09-12T17:11:49.809 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave7 2024-09-12T17:11:49.822 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave8 2024-09-12T17:11:49.831 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave9 2024-09-12T17:11:49.831 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (97 ms) 2024-09-12T17:11:49.831 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T17:11:50.001 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (169 ms) 2024-09-12T17:11:50.001 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:11:50.001 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:11:50.001 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:11:50.001 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:11:50.001 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:11:50.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:11:49.999+0000 7f98bb4c58c0 -1 shutting down 2024-09-12T17:11:50.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:11:50.001+0000 7f979241c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68207, si_uid : 1000, si_addr0x3e800010a6f, si_status0 2024-09-12T17:12:19.903 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SHUTDOWN (29902 ms) 2024-09-12T17:12:19.904 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 9 tests from LibRGW (30592 ms total) 2024-09-12T17:12:19.904 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T17:12:19.904 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T17:12:19.904 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 9 tests from 1 test suite ran. (30592 ms total) 2024-09-12T17:12:19.904 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 9 tests. 2024-09-12T17:12:19.910 INFO:tasks.workunit.client.0.smithi067.stdout:phase 3.1 2024-09-12T17:12:20.241 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T17:12:20.241 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T17:12:20.241 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 13 tests from LibRGW 2024-09-12T17:12:20.241 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:12:20.250 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:12:20.251 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:12:20.836 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.INIT (595 ms) 2024-09-12T17:12:20.836 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:12:20.836 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:12:20.837 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:12:20.846 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CREATE_BUCKET (10 ms) 2024-09-12T17:12:20.846 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:12:20.850 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-12T17:12:20.850 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:12:20.852 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (1 ms) 2024-09-12T17:12:20.852 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T17:12:21.291 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LARGE1 (440 ms) 2024-09-12T17:12:21.292 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T17:12:21.333 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LARGE2 (42 ms) 2024-09-12T17:12:21.334 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:12:21.334 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:12:21.334 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:12:21.334 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T17:12:21.334 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:12:21.334 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:12:21.334 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:12:21.334 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:12:21.334 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:12:21.334 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:12:21.334 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:12:21.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:12:21.332+0000 7fe4c49258c0 -1 shutting down 2024-09-12T17:12:21.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:12:21.333+0000 7fe39c7ac640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68826, si_uid : 1000, si_addr0x3e800010cda, si_status0 2024-09-12T17:12:51.242 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SHUTDOWN (29908 ms) 2024-09-12T17:12:51.243 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 13 tests from LibRGW (31001 ms total) 2024-09-12T17:12:51.243 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T17:12:51.243 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T17:12:51.243 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 13 tests from 1 test suite ran. (31001 ms total) 2024-09-12T17:12:51.243 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 13 tests. 2024-09-12T17:12:51.249 INFO:tasks.workunit.client.0.smithi067.stdout:phase 3.2 2024-09-12T17:12:51.580 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T17:12:51.581 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T17:12:51.581 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 13 tests from LibRGW 2024-09-12T17:12:51.581 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:12:51.589 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:12:51.589 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:12:51.972 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.INIT (391 ms) 2024-09-12T17:12:51.972 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:12:51.973 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:12:51.973 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:12:51.973 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:12:51.973 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:12:51.979 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-12T17:12:51.979 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:12:51.982 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-12T17:12:51.982 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T17:12:52.425 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LARGE1 (442 ms) 2024-09-12T17:12:52.425 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T17:12:52.425 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-12T17:12:52.425 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:12:52.425 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:12:52.425 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:12:52.429 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.DELETE_OBJECT (4 ms) 2024-09-12T17:12:52.429 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:12:52.447 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.DELETE_BUCKET (19 ms) 2024-09-12T17:12:52.448 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:12:52.448 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:12:52.448 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:12:52.448 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:12:52.448 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:12:52.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:12:52.446+0000 7f9fb59448c0 -1 shutting down 2024-09-12T17:12:52.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:12:52.447+0000 7f9e8d947640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69445, si_uid : 1000, si_addr0x3e800010f45, si_status0 2024-09-12T17:13:22.119 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SHUTDOWN (29671 ms) 2024-09-12T17:13:22.119 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 13 tests from LibRGW (30538 ms total) 2024-09-12T17:13:22.119 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T17:13:22.119 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T17:13:22.119 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 13 tests from 1 test suite ran. (30538 ms total) 2024-09-12T17:13:22.119 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 13 tests. 2024-09-12T17:13:22.126 INFO:tasks.workunit.client.0.smithi067.stdout:phase 4.1 2024-09-12T17:13:22.156 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:13:22.156 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T17:13:22.156 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 11 tests from LibRGW 2024-09-12T17:13:22.156 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T17:13:22.156 INFO:tasks.workunit.client.0.smithi067.stdout:read i1: 64001 2024-09-12T17:13:22.156 INFO:tasks.workunit.client.0.smithi067.stdout:read s1: blunderbuss 2024-09-12T17:13:22.156 INFO:tasks.workunit.client.0.smithi067.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T17:13:22.156 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:13:22.167 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:22.167 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:22.553 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.INIT (398 ms) 2024-09-12T17:13:22.553 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:13:22.554 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:13:22.554 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:13:22.572 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (18 ms) 2024-09-12T17:13:22.572 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:13:23.080 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_0 2024-09-12T17:13:23.080 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_1 2024-09-12T17:13:23.081 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_2 2024-09-12T17:13:23.081 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_3 2024-09-12T17:13:23.081 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_4 2024-09-12T17:13:23.081 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_5 2024-09-12T17:13:23.081 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_6 2024-09-12T17:13:23.081 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_7 2024-09-12T17:13:23.081 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_8 2024-09-12T17:13:23.081 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_9 2024-09-12T17:13:23.081 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_10 2024-09-12T17:13:23.081 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_11 2024-09-12T17:13:23.082 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_12 2024-09-12T17:13:23.082 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_13 2024-09-12T17:13:23.082 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_14 2024-09-12T17:13:23.082 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_15 2024-09-12T17:13:23.082 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_16 2024-09-12T17:13:23.082 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_17 2024-09-12T17:13:23.082 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_18 2024-09-12T17:13:23.082 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_19 2024-09-12T17:13:23.082 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_20 2024-09-12T17:13:23.082 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_21 2024-09-12T17:13:23.083 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_22 2024-09-12T17:13:23.083 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_23 2024-09-12T17:13:23.083 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_24 2024-09-12T17:13:23.083 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_25 2024-09-12T17:13:23.083 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_26 2024-09-12T17:13:23.083 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_27 2024-09-12T17:13:23.083 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_28 2024-09-12T17:13:23.083 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_29 2024-09-12T17:13:23.083 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_30 2024-09-12T17:13:23.084 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_31 2024-09-12T17:13:23.084 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_32 2024-09-12T17:13:23.084 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_33 2024-09-12T17:13:23.084 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_34 2024-09-12T17:13:23.084 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_35 2024-09-12T17:13:23.084 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_36 2024-09-12T17:13:23.084 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_37 2024-09-12T17:13:23.084 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_38 2024-09-12T17:13:23.084 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_39 2024-09-12T17:13:23.084 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_40 2024-09-12T17:13:23.085 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_41 2024-09-12T17:13:23.085 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_42 2024-09-12T17:13:23.085 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_43 2024-09-12T17:13:23.085 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_44 2024-09-12T17:13:23.085 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_45 2024-09-12T17:13:23.085 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_46 2024-09-12T17:13:23.085 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_47 2024-09-12T17:13:23.085 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_48 2024-09-12T17:13:23.085 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_49 2024-09-12T17:13:23.085 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_50 2024-09-12T17:13:23.086 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_51 2024-09-12T17:13:23.086 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_52 2024-09-12T17:13:23.086 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_53 2024-09-12T17:13:23.086 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_54 2024-09-12T17:13:23.086 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_55 2024-09-12T17:13:23.086 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_56 2024-09-12T17:13:23.086 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_57 2024-09-12T17:13:23.086 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_58 2024-09-12T17:13:23.086 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_59 2024-09-12T17:13:23.087 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_60 2024-09-12T17:13:23.087 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_61 2024-09-12T17:13:23.087 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_62 2024-09-12T17:13:23.087 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_63 2024-09-12T17:13:23.087 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_64 2024-09-12T17:13:23.087 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_65 2024-09-12T17:13:23.087 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_66 2024-09-12T17:13:23.087 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_67 2024-09-12T17:13:23.087 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_68 2024-09-12T17:13:23.087 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_69 2024-09-12T17:13:23.087 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_70 2024-09-12T17:13:23.087 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_71 2024-09-12T17:13:23.087 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_72 2024-09-12T17:13:23.087 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_73 2024-09-12T17:13:23.088 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_74 2024-09-12T17:13:23.088 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_75 2024-09-12T17:13:23.088 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_76 2024-09-12T17:13:23.088 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_77 2024-09-12T17:13:23.088 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_78 2024-09-12T17:13:23.088 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_79 2024-09-12T17:13:23.088 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_80 2024-09-12T17:13:23.088 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_81 2024-09-12T17:13:23.088 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_82 2024-09-12T17:13:23.088 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_83 2024-09-12T17:13:23.088 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_84 2024-09-12T17:13:23.088 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_85 2024-09-12T17:13:23.089 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_86 2024-09-12T17:13:23.089 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_87 2024-09-12T17:13:23.089 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_88 2024-09-12T17:13:23.089 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_89 2024-09-12T17:13:23.089 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_90 2024-09-12T17:13:23.089 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_91 2024-09-12T17:13:23.089 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_92 2024-09-12T17:13:23.089 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_93 2024-09-12T17:13:23.089 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_94 2024-09-12T17:13:23.089 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_95 2024-09-12T17:13:23.089 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_96 2024-09-12T17:13:23.089 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_97 2024-09-12T17:13:23.089 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_98 2024-09-12T17:13:23.090 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_99 2024-09-12T17:13:23.090 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (507 ms) 2024-09-12T17:13:23.090 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:13:23.091 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-12T17:13:23.091 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-12T17:13:23.091 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:13:23.092 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:13:23.092 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:13:23.092 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:13:23.092 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:13:23.092 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:13:23.092 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:13:23.092 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:13:23.092 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:13:23.092 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:13:23.092 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:13:23.092 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:13:23.092 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:13:23.093 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:13:23.093 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:13:23.093 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:13:23.093 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:13:23.093 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:13:23.093 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:13:23.093 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:13:23.093 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:13:23.093 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:13:23.093 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:13:23.093 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:13:23.093 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:13:23.094 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:13:23.094 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:13:23.094 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:13:23.094 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:13:23.094 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:13:23.094 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:13:23.094 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:13:23.094 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:13:23.094 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:13:23.095 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:13:23.095 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:13:23.095 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:13:23.095 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:13:23.095 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:13:23.095 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:13:23.096 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:13:23.096 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:13:23.096 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:13:23.096 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:13:23.096 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:13:23.097 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:13:23.097 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:13:23.097 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:13:23.097 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:13:23.097 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:13:23.097 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:13:23.097 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:13:23.097 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:13:23.097 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:13:23.097 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:13:23.097 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:13:23.097 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:13:23.098 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:13:23.098 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:13:23.098 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:13:23.098 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:13:23.098 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:13:23.098 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:13:23.098 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:13:23.098 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:13:23.098 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:13:23.098 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:13:23.098 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:13:23.098 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:13:23.098 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:13:23.099 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:13:23.099 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:13:23.099 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:13:23.099 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:13:23.099 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:13:23.099 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:13:23.099 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:13:23.099 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:13:23.099 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:13:23.099 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:13:23.099 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:13:23.099 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:13:23.099 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:13:23.099 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:13:23.100 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:13:23.100 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:13:23.100 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:13:23.100 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:13:23.100 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:13:23.100 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:13:23.100 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:13:23.100 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:13:23.100 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:13:23.100 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:13:23.100 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:13:23.100 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:13:23.100 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:13:23.101 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:13:23.101 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:13:23.101 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:13:23.101 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_READDIR (5 ms) 2024-09-12T17:13:23.101 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T17:13:23.101 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:13:23.101 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:13:23.101 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:13:23.101 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:13:23.101 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:13:23.101 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:13:23.101 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:13:23.101 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:13:23.102 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:13:23.102 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:13:23.102 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:13:23.102 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:13:23.102 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:13:23.102 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:13:23.102 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:13:23.102 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:13:23.102 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:13:23.102 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:13:23.102 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:13:23.102 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:13:23.102 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:13:23.102 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:13:23.103 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:13:23.103 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:13:23.103 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:13:23.103 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:13:23.103 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:13:23.103 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:13:23.103 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:13:23.103 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:13:23.103 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:13:23.103 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:13:23.103 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:13:23.103 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:13:23.103 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:13:23.103 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:13:23.104 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:13:23.104 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:13:23.104 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:13:23.104 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:13:23.104 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:13:23.104 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:13:23.104 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:13:23.104 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:13:23.104 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:13:23.104 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:13:23.104 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:13:23.105 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:13:23.105 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:13:23.105 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:13:23.105 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:13:23.105 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:13:23.105 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:13:23.105 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:13:23.105 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:13:23.105 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:13:23.105 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:13:23.105 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:13:23.105 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:13:23.105 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:13:23.106 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:13:23.106 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:13:23.106 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:13:23.106 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:13:23.106 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:13:23.106 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:13:23.106 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:13:23.106 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:13:23.106 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:13:23.106 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:13:23.106 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:13:23.106 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:13:23.106 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:13:23.106 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:13:23.107 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:13:23.107 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:13:23.107 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:13:23.107 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:13:23.107 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:13:23.107 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:13:23.107 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:13:23.107 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:13:23.107 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:13:23.107 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:13:23.107 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:13:23.107 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:13:23.107 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:13:23.107 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:13:23.108 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:13:23.108 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:13:23.108 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:13:23.108 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:13:23.108 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:13:23.108 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:13:23.108 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:13:23.108 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:13:23.108 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:13:23.108 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:13:23.108 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:13:23.108 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:13:23.108 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER2_READDIR (3 ms) 2024-09-12T17:13:23.108 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:13:23.109 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:13:23.109 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:13:23.109 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:13:23.109 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:13:23.109 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:13:23.109 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:13:23.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:13:23.086+0000 7f43f44878c0 -1 shutting down 2024-09-12T17:13:23.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:13:23.087+0000 7f42ce1c6640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70064, si_uid : 1000, si_addr0x3e8000111b0, si_status0 2024-09-12T17:13:52.733 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SHUTDOWN (29645 ms) 2024-09-12T17:13:52.733 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 11 tests from LibRGW (30577 ms total) 2024-09-12T17:13:52.734 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T17:13:52.734 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T17:13:52.734 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 11 tests from 1 test suite ran. (30577 ms total) 2024-09-12T17:13:52.734 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 11 tests. 2024-09-12T17:13:52.739 INFO:tasks.workunit.client.0.smithi067.stdout:phase 4.2 2024-09-12T17:13:52.766 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:13:52.766 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T17:13:52.767 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 11 tests from LibRGW 2024-09-12T17:13:52.767 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T17:13:52.767 INFO:tasks.workunit.client.0.smithi067.stdout:read i1: 64001 2024-09-12T17:13:52.767 INFO:tasks.workunit.client.0.smithi067.stdout:read s1: blunderbuss 2024-09-12T17:13:52.767 INFO:tasks.workunit.client.0.smithi067.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T17:13:52.767 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:13:52.775 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:52.775 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:53.374 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.INIT (607 ms) 2024-09-12T17:13:53.374 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:13:53.375 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:13:53.375 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:13:53.384 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (10 ms) 2024-09-12T17:13:53.384 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:13:53.385 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:13:53.385 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:13:53.385 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:13:53.385 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T17:13:53.388 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:13:53.389 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:13:53.389 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:13:53.389 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:13:53.389 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:13:53.389 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:13:53.389 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:13:53.389 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:13:53.389 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:13:53.389 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:13:53.389 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:13:53.389 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:13:53.389 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:13:53.390 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:13:53.390 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:13:53.390 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:13:53.390 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:13:53.390 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:13:53.390 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:13:53.390 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:13:53.390 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:13:53.390 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:13:53.390 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:13:53.390 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:13:53.390 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:13:53.390 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:13:53.391 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:13:53.391 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:13:53.391 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:13:53.391 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:13:53.391 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:13:53.391 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:13:53.391 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:13:53.391 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:13:53.391 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:13:53.391 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:13:53.391 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:13:53.391 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:13:53.391 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:13:53.391 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:13:53.392 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:13:53.392 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:13:53.392 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:13:53.392 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:13:53.392 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:13:53.392 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:13:53.392 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:13:53.392 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:13:53.392 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:13:53.392 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:13:53.392 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:13:53.392 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:13:53.392 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:13:53.393 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:13:53.393 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:13:53.393 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:13:53.393 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:13:53.393 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:13:53.393 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:13:53.393 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:13:53.393 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:13:53.393 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:13:53.393 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:13:53.393 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:13:53.393 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:13:53.393 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:13:53.393 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:13:53.394 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:13:53.394 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:13:53.394 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:13:53.394 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:13:53.394 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:13:53.394 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:13:53.394 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:13:53.394 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:13:53.394 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:13:53.394 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:13:53.394 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:13:53.394 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:13:53.394 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:13:53.394 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:13:53.395 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:13:53.395 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:13:53.395 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:13:53.395 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:13:53.395 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:13:53.395 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:13:53.395 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:13:53.395 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:13:53.395 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:13:53.395 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:13:53.395 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:13:53.395 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:13:53.395 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:13:53.395 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:13:53.396 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:13:53.396 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:13:53.396 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:13:53.396 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:13:53.396 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:13:53.396 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER2_READDIR (4 ms) 2024-09-12T17:13:53.396 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:13:53.396 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:13:53.396 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:13:53.396 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:13:53.397 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:13:53.397 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:13:53.397 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:13:53.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:13:53.387+0000 7f2340b1f8c0 -1 shutting down 2024-09-12T17:13:53.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:13:53.389+0000 7f22189cf640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70683, si_uid : 1000, si_addr0x3e80001141b, si_status0 2024-09-12T17:14:23.729 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SHUTDOWN (30340 ms) 2024-09-12T17:14:23.729 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 11 tests from LibRGW (30962 ms total) 2024-09-12T17:14:23.729 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T17:14:23.729 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T17:14:23.730 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 11 tests from 1 test suite ran. (30962 ms total) 2024-09-12T17:14:23.730 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 11 tests. 2024-09-12T17:14:23.735 INFO:tasks.workunit.client.0.smithi067.stdout:phase 5.1 2024-09-12T17:14:23.770 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T17:14:23.770 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T17:14:23.770 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 19 tests from LibRGW 2024-09-12T17:14:23.770 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:14:23.781 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:23.781 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:24.167 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.INIT (398 ms) 2024-09-12T17:14:24.167 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:14:24.168 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:14:24.168 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:14:24.178 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CREATE_BUCKET (9 ms) 2024-09-12T17:14:24.178 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:14:24.181 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-12T17:14:24.181 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T17:14:24.181 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T17:14:24.182 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:14:24.183 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (1 ms) 2024-09-12T17:14:24.183 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T17:14:24.183 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T17:14:24.183 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T17:14:24.187 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.PUT_OBJECT (5 ms) 2024-09-12T17:14:24.187 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T17:14:24.189 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.GET_OBJECT (1 ms) 2024-09-12T17:14:24.189 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:14:24.189 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:14:24.189 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T17:14:24.190 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T17:14:24.190 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T17:14:24.190 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T17:14:24.190 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.READV 2024-09-12T17:14:24.190 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T17:14:24.190 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T17:14:24.190 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T17:14:24.190 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:14:24.190 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T17:14:24.190 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:14:24.190 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:14:24.191 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:14:24.191 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:14:24.191 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:14:24.191 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:14:24.191 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:14:24.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:14:24.188+0000 7ff8fb2b58c0 -1 shutting down 2024-09-12T17:14:24.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:14:24.189+0000 7ff7d4ff2640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 71302, si_uid : 1000, si_addr0x3e800011686, si_status0 2024-09-12T17:14:54.209 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SHUTDOWN (30020 ms) 2024-09-12T17:14:54.209 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 19 tests from LibRGW (30439 ms total) 2024-09-12T17:14:54.209 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T17:14:54.209 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T17:14:54.209 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 19 tests from 1 test suite ran. (30439 ms total) 2024-09-12T17:14:54.210 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 19 tests. 2024-09-12T17:14:54.215 INFO:tasks.workunit.client.0.smithi067.stdout:phase 5.2 2024-09-12T17:14:54.249 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T17:14:54.249 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T17:14:54.249 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 19 tests from LibRGW 2024-09-12T17:14:54.250 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:14:54.257 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:54.257 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:54.645 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.INIT (396 ms) 2024-09-12T17:14:54.645 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:14:54.646 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:14:54.646 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:14:54.646 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:14:54.646 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:14:54.652 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-12T17:14:54.652 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T17:14:54.652 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T17:14:54.652 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:14:54.652 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-12T17:14:54.652 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T17:14:54.652 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T17:14:54.653 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T17:14:54.653 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-12T17:14:54.653 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T17:14:54.653 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-12T17:14:54.653 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:14:54.653 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:14:54.653 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T17:14:54.653 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T17:14:54.653 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T17:14:54.653 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T17:14:54.653 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.READV 2024-09-12T17:14:54.653 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T17:14:54.653 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T17:14:54.654 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T17:14:54.654 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:14:54.656 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-09-12T17:14:54.656 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:14:54.674 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.DELETE_BUCKET (18 ms) 2024-09-12T17:14:54.674 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:14:54.674 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:14:54.675 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:14:54.675 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:14:54.675 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:14:54.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:14:54.673+0000 7fed201248c0 -1 shutting down 2024-09-12T17:14:54.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:14:54.674+0000 7febf809a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 71921, si_uid : 1000, si_addr0x3e8000118f1, si_status0 2024-09-12T17:15:24.814 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SHUTDOWN (30139 ms) 2024-09-12T17:15:24.814 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 19 tests from LibRGW (30564 ms total) 2024-09-12T17:15:24.814 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T17:15:24.814 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T17:15:24.814 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 19 tests from 1 test suite ran. (30564 ms total) 2024-09-12T17:15:24.815 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 19 tests. 2024-09-12T17:15:24.820 INFO:tasks.workunit.client.0.smithi067.stdout:phase 6.1 2024-09-12T17:15:24.847 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T17:15:24.847 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T17:15:24.847 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 10 tests from LibRGW 2024-09-12T17:15:24.847 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:15:24.854 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:15:24.854 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:15:25.448 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.INIT (602 ms) 2024-09-12T17:15:25.448 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:15:25.449 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:15:25.449 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-12T17:15:25.468 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CREATE_BUCKETS (19 ms) 2024-09-12T17:15:25.468 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-12T17:15:25.476 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (8 ms) 2024-09-12T17:15:25.476 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-12T17:15:25.494 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.TOPDIR_RENAME (18 ms) 2024-09-12T17:15:25.494 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-12T17:15:25.516 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SUBDIR_RENAME (21 ms) 2024-09-12T17:15:25.516 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-12T17:15:25.537 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (22 ms) 2024-09-12T17:15:25.538 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:15:25.538 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:15:25.538 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:15:25.538 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:15:25.538 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:15:25.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:25.536+0000 7f4086f2e8c0 -1 shutting down 2024-09-12T17:15:25.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:25.537+0000 7f3f60c6d640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 72540, si_uid : 1000, si_addr0x3e800011b5c, si_status0 2024-09-12T17:15:55.859 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SHUTDOWN (30321 ms) 2024-09-12T17:15:55.859 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 10 tests from LibRGW (31012 ms total) 2024-09-12T17:15:55.859 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T17:15:55.859 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T17:15:55.859 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 10 tests from 1 test suite ran. (31012 ms total) 2024-09-12T17:15:55.859 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 10 tests. 2024-09-12T17:15:55.866 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:15:55.866 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:15:55.913 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-12T17:15:55.914 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-12T17:15:55.915 DEBUG:teuthology.orchestra.run.smithi067:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-12T17:15:55.951 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -z ']' 2024-09-12T17:15:55.951 INFO:tasks.workunit.client.0.smithi067.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:15:55.951 INFO:tasks.workunit.client.0.smithi067.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:15:55.951 INFO:tasks.workunit.client.0.smithi067.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:15:55.952 INFO:tasks.workunit.client.0.smithi067.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:15:55.952 INFO:tasks.workunit.client.0.smithi067.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-09-12T17:15:55.989 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:15:55.989 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:15:56.030 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.029+0000 7f1b5d020800 20 rados->read ofs=0 len=0 2024-09-12T17:15:56.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.030+0000 7f1b5d020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:56.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.030+0000 7f1b5d020800 20 realm 2024-09-12T17:15:56.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.030+0000 7f1b5d020800 20 rados->read ofs=0 len=0 2024-09-12T17:15:56.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.030+0000 7f1b5d020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:56.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.030+0000 7f1b5d020800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:15:56.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.030+0000 7f1b5d020800 20 rados->read ofs=0 len=0 2024-09-12T17:15:56.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.031+0000 7f1b5d020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:56.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.031+0000 7f1b5d020800 20 rados->read ofs=0 len=0 2024-09-12T17:15:56.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.031+0000 7f1b5d020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:15:56.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.031+0000 7f1b5d020800 20 rados->read ofs=0 len=0 2024-09-12T17:15:56.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.032+0000 7f1b5d020800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:15:56.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.032+0000 7f1b5d020800 20 searching for the correct realm 2024-09-12T17:15:56.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.035+0000 7f1b5ab0a640 0 -- 172.21.15.67:0/2490249293 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f1b540a00b0 msgr2=0x7f1b54096a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:15:56.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.039+0000 7f1b5ab0a640 0 -- 172.21.15.67:0/2490249293 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f1b50043460 msgr2=0x7f1b500438e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:15:56.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.246+0000 7f1b5d020800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:15:56.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.246+0000 7f1b5d020800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:15:56.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.246+0000 7f1b5d020800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:15:56.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.246+0000 7f1b5d020800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:15:56.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.246+0000 7f1b5d020800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:15:56.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.246+0000 7f1b5d020800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:15:56.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.246+0000 7f1b5d020800 20 rados->read ofs=0 len=0 2024-09-12T17:15:56.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.247+0000 7f1b5d020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:56.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.247+0000 7f1b5d020800 20 rados->read ofs=0 len=0 2024-09-12T17:15:56.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.247+0000 7f1b5d020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:15:56.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.247+0000 7f1b5d020800 20 rados->read ofs=0 len=0 2024-09-12T17:15:56.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.247+0000 7f1b5d020800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:15:56.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.247+0000 7f1b5d020800 20 zone default found 2024-09-12T17:15:56.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.247+0000 7f1b5d020800 4 Realm: () 2024-09-12T17:15:56.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.247+0000 7f1b5d020800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:15:56.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.247+0000 7f1b5d020800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:15:56.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.247+0000 7f1b5d020800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:15:56.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.247+0000 7f1b5d020800 20 zonegroup default 2024-09-12T17:15:56.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.247+0000 7f1b5d020800 20 rados->read ofs=0 len=0 2024-09-12T17:15:56.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.248+0000 7f1b5d020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:56.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.248+0000 7f1b5d020800 20 rados->read ofs=0 len=0 2024-09-12T17:15:56.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.248+0000 7f1b5d020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:56.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.248+0000 7f1b5d020800 20 rados->read ofs=0 len=0 2024-09-12T17:15:56.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.248+0000 7f1b5d020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:56.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.248+0000 7f1b5d020800 20 started sync module instance, tier type = 2024-09-12T17:15:56.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.248+0000 7f1b5d020800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:15:56.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.258+0000 7f1b5d020800 20 add_watcher() i=0 2024-09-12T17:15:56.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.258+0000 7f1b5d020800 20 add_watcher() i=1 2024-09-12T17:15:56.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.258+0000 7f1b5d020800 20 add_watcher() i=2 2024-09-12T17:15:56.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.258+0000 7f1b5d020800 20 add_watcher() i=3 2024-09-12T17:15:56.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.258+0000 7f1b5d020800 20 add_watcher() i=4 2024-09-12T17:15:56.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.258+0000 7f1b5d020800 20 add_watcher() i=5 2024-09-12T17:15:56.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.258+0000 7f1b5d020800 20 add_watcher() i=6 2024-09-12T17:15:56.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.259+0000 7f1b5d020800 20 add_watcher() i=7 2024-09-12T17:15:56.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.259+0000 7f1b5d020800 2 all 8 watchers are set, enabling cache 2024-09-12T17:15:56.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.261+0000 7f1a11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:15:56.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.262+0000 7f1b5d020800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:15:56.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.262+0000 7f1b5d020800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:15:56.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.262+0000 7f1b5d020800 5 note: GC not initialized 2024-09-12T17:15:56.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.262+0000 7f1a10fe1640 20 reqs_thread_entry: start 2024-09-12T17:15:56.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.262+0000 7f1b5d020800 20 init_complete bucket index max shards: 1 2024-09-12T17:15:56.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.262+0000 7f1b5d020800 20 Filter name: none 2024-09-12T17:15:56.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.262+0000 7f1a09ffb640 20 reqs_thread_entry: start 2024-09-12T17:15:56.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.262+0000 7f1b5d020800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-12T17:15:56.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.262+0000 7f1b5d020800 20 rados->read ofs=0 len=0 2024-09-12T17:15:56.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.263+0000 7f1b5d020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:56.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.263+0000 7f1b5d020800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-12T17:15:56.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.263+0000 7f1b5d020800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:15:56.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.263+0000 7f1b5d020800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-12T17:15:56.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.263+0000 7f1b5d020800 20 rados->read ofs=0 len=0 2024-09-12T17:15:56.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.263+0000 7f1b5d020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:56.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.263+0000 7f1b5d020800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-12T17:15:56.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.263+0000 7f1b5d020800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:15:56.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.263+0000 7f1b5d020800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-12T17:15:56.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.263+0000 7f1b5d020800 20 rados->read ofs=0 len=0 2024-09-12T17:15:56.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.263+0000 7f1b5d020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:56.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.263+0000 7f1b5d020800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-12T17:15:56.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.263+0000 7f1b5d020800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:15:56.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.263+0000 7f1b5d020800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T17:15:56.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.263+0000 7f1b5d020800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T17:15:56.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.264+0000 7f1b5d020800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T17:15:56.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.264+0000 7f1b5d020800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:15:56.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.264+0000 7f1b5d020800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-12T17:15:56.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.265+0000 7f1a3e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824009 cookie 94544669779088 notifier 5853 bl.length()=677 2024-09-12T17:15:56.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.265+0000 7f1a3e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T17:15:56.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.265+0000 7f1a3e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:15:56.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.268+0000 7f1b5d020800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T17:15:56.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.268+0000 7f1b5d020800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:15:56.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.268+0000 7f1b5d020800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-12T17:15:56.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.268+0000 7f1a3e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824009 cookie 94544669765888 notifier 5853 bl.length()=187 2024-09-12T17:15:56.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.268+0000 7f1a3e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T17:15:56.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.268+0000 7f1a3e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:15:56.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.271+0000 7f1b5d020800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T17:15:56.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.271+0000 7f1b5d020800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:15:56.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.271+0000 7f1b5d020800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-12T17:15:56.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.271+0000 7f1a3e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824010 cookie 94544669765888 notifier 5853 bl.length()=197 2024-09-12T17:15:56.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.271+0000 7f1a3e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T17:15:56.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.271+0000 7f1a3e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:15:56.273 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:15:56.273 INFO:tasks.workunit.client.0.smithi067.stdout: "user_id": "ceph-test-maven", 2024-09-12T17:15:56.273 INFO:tasks.workunit.client.0.smithi067.stdout: "display_name": "maven test user", 2024-09-12T17:15:56.273 INFO:tasks.workunit.client.0.smithi067.stdout: "email": "sigv4@example.com", 2024-09-12T17:15:56.274 INFO:tasks.workunit.client.0.smithi067.stdout: "suspended": 0, 2024-09-12T17:15:56.274 INFO:tasks.workunit.client.0.smithi067.stdout: "max_buckets": 1000, 2024-09-12T17:15:56.274 INFO:tasks.workunit.client.0.smithi067.stdout: "subusers": [], 2024-09-12T17:15:56.274 INFO:tasks.workunit.client.0.smithi067.stdout: "keys": [ 2024-09-12T17:15:56.274 INFO:tasks.workunit.client.0.smithi067.stdout: { 2024-09-12T17:15:56.274 INFO:tasks.workunit.client.0.smithi067.stdout: "user": "ceph-test-maven", 2024-09-12T17:15:56.274 INFO:tasks.workunit.client.0.smithi067.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-12T17:15:56.274 INFO:tasks.workunit.client.0.smithi067.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-12T17:15:56.274 INFO:tasks.workunit.client.0.smithi067.stdout: "active": true, 2024-09-12T17:15:56.274 INFO:tasks.workunit.client.0.smithi067.stdout: "create_date": "2024-09-12T17:15:56.264490Z" 2024-09-12T17:15:56.274 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:15:56.274 INFO:tasks.workunit.client.0.smithi067.stdout: ], 2024-09-12T17:15:56.275 INFO:tasks.workunit.client.0.smithi067.stdout: "swift_keys": [], 2024-09-12T17:15:56.275 INFO:tasks.workunit.client.0.smithi067.stdout: "caps": [], 2024-09-12T17:15:56.275 INFO:tasks.workunit.client.0.smithi067.stdout: "op_mask": "read, write, delete", 2024-09-12T17:15:56.275 INFO:tasks.workunit.client.0.smithi067.stdout: "default_placement": "", 2024-09-12T17:15:56.275 INFO:tasks.workunit.client.0.smithi067.stdout: "default_storage_class": "", 2024-09-12T17:15:56.275 INFO:tasks.workunit.client.0.smithi067.stdout: "placement_tags": [], 2024-09-12T17:15:56.275 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_quota": { 2024-09-12T17:15:56.275 INFO:tasks.workunit.client.0.smithi067.stdout: "enabled": false, 2024-09-12T17:15:56.275 INFO:tasks.workunit.client.0.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:15:56.275 INFO:tasks.workunit.client.0.smithi067.stdout: "max_size": -1, 2024-09-12T17:15:56.275 INFO:tasks.workunit.client.0.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:15:56.275 INFO:tasks.workunit.client.0.smithi067.stdout: "max_objects": -1 2024-09-12T17:15:56.275 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:15:56.275 INFO:tasks.workunit.client.0.smithi067.stdout: "user_quota": { 2024-09-12T17:15:56.276 INFO:tasks.workunit.client.0.smithi067.stdout: "enabled": false, 2024-09-12T17:15:56.276 INFO:tasks.workunit.client.0.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:15:56.276 INFO:tasks.workunit.client.0.smithi067.stdout: "max_size": -1, 2024-09-12T17:15:56.276 INFO:tasks.workunit.client.0.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:15:56.276 INFO:tasks.workunit.client.0.smithi067.stdout: "max_objects": -1 2024-09-12T17:15:56.276 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:15:56.276 INFO:tasks.workunit.client.0.smithi067.stdout: "temp_url_keys": [], 2024-09-12T17:15:56.276 INFO:tasks.workunit.client.0.smithi067.stdout: "type": "rgw", 2024-09-12T17:15:56.276 INFO:tasks.workunit.client.0.smithi067.stdout: "mfa_ids": [], 2024-09-12T17:15:56.276 INFO:tasks.workunit.client.0.smithi067.stdout: "account_id": "", 2024-09-12T17:15:56.276 INFO:tasks.workunit.client.0.smithi067.stdout: "path": "/", 2024-09-12T17:15:56.276 INFO:tasks.workunit.client.0.smithi067.stdout: "create_date": "2024-09-12T17:15:56.264473Z", 2024-09-12T17:15:56.276 INFO:tasks.workunit.client.0.smithi067.stdout: "tags": [], 2024-09-12T17:15:56.277 INFO:tasks.workunit.client.0.smithi067.stdout: "group_ids": [] 2024-09-12T17:15:56.277 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:15:56.277 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T17:15:56.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.273+0000 7f1a11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:15:56.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.276+0000 7f1b5d020800 20 remove_watcher() i=0 2024-09-12T17:15:56.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.276+0000 7f1b5d020800 2 removed watcher, disabling cache 2024-09-12T17:15:56.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.277+0000 7f1b5d020800 20 remove_watcher() i=1 2024-09-12T17:15:56.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.278+0000 7f1b5d020800 20 remove_watcher() i=2 2024-09-12T17:15:56.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.279+0000 7f1b5d020800 20 remove_watcher() i=3 2024-09-12T17:15:56.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.280+0000 7f1b5d020800 20 remove_watcher() i=4 2024-09-12T17:15:56.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.281+0000 7f1b5d020800 20 remove_watcher() i=5 2024-09-12T17:15:56.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.282+0000 7f1b5d020800 20 remove_watcher() i=6 2024-09-12T17:15:56.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:15:56.283+0000 7f1b5d020800 20 remove_watcher() i=7 2024-09-12T17:15:56.295 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -z ']' 2024-09-12T17:15:56.295 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-09-12T17:15:56.295 INFO:tasks.workunit.client.0.smithi067.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-09-12T17:15:56.296 INFO:tasks.workunit.client.0.smithi067.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi067.front.sepia.ceph.com:443 2024-09-12T17:15:56.297 INFO:tasks.workunit.client.0.smithi067.stderr:+ RGW_HTTP_ENDPOINT_URL=https://smithi067.front.sepia.ceph.com:443 2024-09-12T17:15:56.297 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-09-12T17:15:56.297 INFO:tasks.workunit.client.0.smithi067.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-12T17:15:56.297 INFO:tasks.workunit.client.0.smithi067.stderr:+ ./mvnw clean package 2024-09-12T17:15:56.306 INFO:tasks.workunit.client.0.smithi067.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T17:15:57.785 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Scanning for projects... 2024-09-12T17:15:57.915 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-12T17:15:58.000 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 64 kB/s) 2024-09-12T17:15:58.014 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-12T17:15:58.055 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.0 MB/s) 2024-09-12T17:15:58.066 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-12T17:15:58.088 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.7 MB/s) 2024-09-12T17:15:58.120 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T17:15:58.120 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T17:15:58.121 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Building jcksum 1.0 2024-09-12T17:15:58.121 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] from pom.xml 2024-09-12T17:15:58.121 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T17:15:58.124 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-12T17:15:58.139 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 332 kB/s) 2024-09-12T17:15:58.146 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-12T17:15:58.161 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 660 kB/s) 2024-09-12T17:15:58.166 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-12T17:15:58.182 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.8 MB/s) 2024-09-12T17:15:58.189 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-12T17:15:58.206 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.3 MB/s) 2024-09-12T17:15:58.221 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-12T17:15:58.237 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.1 MB/s) 2024-09-12T17:15:58.244 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-12T17:15:58.260 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 510 kB/s) 2024-09-12T17:15:58.262 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-12T17:15:58.277 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 539 kB/s) 2024-09-12T17:15:58.279 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-12T17:15:58.296 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.2 MB/s) 2024-09-12T17:15:58.298 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-12T17:15:58.313 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.4 MB/s) 2024-09-12T17:15:58.318 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-12T17:15:58.334 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 2.1 MB/s) 2024-09-12T17:15:58.341 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-12T17:15:58.357 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 613 kB/s) 2024-09-12T17:15:58.365 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-12T17:15:58.382 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/66 kB Progress (1): 32/66 kB Progress (1): 49/66 kB Progress (1): 65/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.6 MB/s) 2024-09-12T17:15:58.391 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-12T17:15:58.408 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 332 kB/s) 2024-09-12T17:15:58.411 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-12T17:15:58.427 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.4 MB/s) 2024-09-12T17:15:58.432 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-12T17:15:58.448 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 3.1 MB/s) 2024-09-12T17:15:58.454 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-12T17:15:58.469 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.6 MB/s) 2024-09-12T17:15:58.477 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-12T17:15:58.492 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 375 kB/s) 2024-09-12T17:15:58.500 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-12T17:15:58.514 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.6 MB/s) 2024-09-12T17:15:58.521 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-12T17:15:58.537 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 423 kB/s) 2024-09-12T17:15:58.540 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-12T17:15:58.554 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 707 kB/s) 2024-09-12T17:15:58.557 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-12T17:15:58.572 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/46 kB Progress (1): 31/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.9 MB/s) 2024-09-12T17:15:58.575 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-12T17:15:58.590 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.4 MB/s) 2024-09-12T17:15:58.596 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-12T17:15:58.611 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.8 MB/s) 2024-09-12T17:15:58.624 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-12T17:15:58.640 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 406 kB/s) 2024-09-12T17:15:58.642 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-12T17:15:58.657 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.3 MB/s) 2024-09-12T17:15:58.661 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-12T17:15:58.677 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.3 MB/s) 2024-09-12T17:15:58.684 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-12T17:15:58.699 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 267 kB/s) 2024-09-12T17:15:58.701 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-12T17:15:58.716 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 104 kB/s) 2024-09-12T17:15:58.718 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-12T17:15:58.733 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 149 kB/s) 2024-09-12T17:15:58.737 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-12T17:15:58.752 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 243 kB/s) 2024-09-12T17:15:58.756 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-12T17:15:58.772 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 201 kB/s) 2024-09-12T17:15:58.777 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-12T17:15:58.792 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 731 kB/s) 2024-09-12T17:15:58.796 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-12T17:15:58.810 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 112 kB/s) 2024-09-12T17:15:58.814 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-12T17:15:58.829 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 273 kB/s) 2024-09-12T17:15:58.832 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-12T17:15:58.847 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 327 kB/s) 2024-09-12T17:15:58.851 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-12T17:15:58.865 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 77 kB/s) 2024-09-12T17:15:58.867 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-12T17:15:58.882 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 274 kB/s) 2024-09-12T17:15:58.883 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-12T17:15:58.898 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 920 kB/s) 2024-09-12T17:15:58.901 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-12T17:15:58.915 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 245 kB/s) 2024-09-12T17:15:58.918 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-12T17:15:58.933 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 163 kB/s) 2024-09-12T17:15:58.937 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-12T17:15:58.951 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 194 kB/s) 2024-09-12T17:15:58.955 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-12T17:15:58.970 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 494 kB/s) 2024-09-12T17:15:58.973 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-12T17:15:58.989 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 341 kB/s) 2024-09-12T17:15:58.993 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-12T17:15:59.006 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 249 kB/s) 2024-09-12T17:15:59.010 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-12T17:15:59.025 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 293 kB/s) 2024-09-12T17:15:59.027 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-12T17:15:59.042 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 161 kB/s) 2024-09-12T17:15:59.045 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-12T17:15:59.061 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 402 kB/s) 2024-09-12T17:15:59.065 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-12T17:15:59.081 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 379 kB/s) 2024-09-12T17:15:59.085 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-12T17:15:59.099 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 212 kB/s) 2024-09-12T17:15:59.103 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-12T17:15:59.120 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 204 kB/s) 2024-09-12T17:15:59.124 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-12T17:15:59.139 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 272 kB/s) 2024-09-12T17:15:59.141 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-12T17:15:59.155 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 118 kB/s) 2024-09-12T17:15:59.159 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-12T17:15:59.172 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 472 kB/s) 2024-09-12T17:15:59.174 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-12T17:15:59.189 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 1.2 MB/s) 2024-09-12T17:15:59.191 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-12T17:15:59.205 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.5 MB/s) 2024-09-12T17:15:59.208 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-12T17:15:59.222 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.2 MB/s) 2024-09-12T17:15:59.226 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-12T17:15:59.240 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 355 kB/s) 2024-09-12T17:15:59.242 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-12T17:15:59.257 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 940 kB/s) 2024-09-12T17:15:59.260 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-12T17:15:59.275 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 998 kB/s) 2024-09-12T17:15:59.277 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-12T17:15:59.293 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/68 kB Progress (1): 32/68 kB Progress (1): 49/68 kB Progress (1): 65/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 4.0 MB/s) 2024-09-12T17:15:59.298 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-12T17:15:59.313 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 1.1 MB/s) 2024-09-12T17:15:59.316 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-12T17:15:59.331 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 1.1 MB/s) 2024-09-12T17:15:59.332 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-12T17:15:59.352 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 4.0 MB/s) 2024-09-12T17:15:59.356 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-12T17:15:59.370 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.2 MB/s) 2024-09-12T17:15:59.374 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-12T17:15:59.392 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.1 MB/s) 2024-09-12T17:15:59.394 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-12T17:15:59.410 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 4.9 MB/s) 2024-09-12T17:15:59.416 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-12T17:15:59.430 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 274 kB/s) 2024-09-12T17:15:59.432 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-12T17:15:59.447 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 920 kB/s) 2024-09-12T17:15:59.450 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-12T17:15:59.464 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 229 kB/s) 2024-09-12T17:15:59.466 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-12T17:15:59.480 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 227 kB/s) 2024-09-12T17:15:59.482 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-12T17:15:59.496 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 145 kB/s) 2024-09-12T17:15:59.498 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-12T17:15:59.513 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 189 kB/s) 2024-09-12T17:15:59.515 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-12T17:15:59.530 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 109 kB/s) 2024-09-12T17:15:59.532 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-12T17:15:59.546 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 215 kB/s) 2024-09-12T17:15:59.548 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-12T17:15:59.563 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 214 kB/s) 2024-09-12T17:15:59.565 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-12T17:15:59.579 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 229 kB/s) 2024-09-12T17:15:59.582 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-12T17:15:59.596 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 73 kB/s) 2024-09-12T17:15:59.600 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-12T17:15:59.614 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 69 kB/s) 2024-09-12T17:15:59.617 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-12T17:15:59.631 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 218 kB/s) 2024-09-12T17:15:59.633 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-12T17:15:59.647 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 217 kB/s) 2024-09-12T17:15:59.650 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-12T17:15:59.665 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 229 kB/s) 2024-09-12T17:15:59.666 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-12T17:15:59.680 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 245 kB/s) 2024-09-12T17:15:59.682 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-12T17:15:59.697 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 202 kB/s) 2024-09-12T17:15:59.714 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-12T17:15:59.797 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 39 MB/s) 2024-09-12T17:15:59.799 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-12T17:15:59.799 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-12T17:15:59.799 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-12T17:15:59.799 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-12T17:15:59.800 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-12T17:15:59.822 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/71 kB Progress (1): 33/71 kB Progress (1): 49/71 kB Progress (1): 66/71 kB Progress (1): 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 2.9 MB/s) 2024-09-12T17:15:59.823 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-12T17:15:59.837 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 422 kB/s) 2024-09-12T17:15:59.837 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-12T17:15:59.848 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.4/35 kB Progress (2): 1.4/35 kB | 1.4/49 kB Progress (2): 2.8/35 kB | 1.4/49 kB Progress (2): 2.8/35 kB | 2.8/49 kB Progress (3): 2.8/35 kB | 2.8/49 kB | 1.4/16 kB Progress (3): 2.8/35 kB | 4.1/49 kB | 1.4/16 kB Progress (3): 4.1/35 kB | 4.1/49 kB | 1.4/16 kB Progress (3): 4.1/35 kB | 5.5/49 kB | 1.4/16 kB Progress (3): 5.5/35 kB | 5.5/49 kB | 1.4/16 kB Progress (3): 5.5/35 kB | 6.9/49 kB | 1.4/16 kB Progress (3): 5.5/35 kB | 6.9/49 kB | 2.8/16 kB Progress (3): 5.5/35 kB | 8.3/49 kB | 2.8/16 kB Progress (3): 6.9/35 kB | 8.3/49 kB | 2.8/16 kB Progress (3): 6.9/35 kB | 9.7/49 kB | 2.8/16 kB Progress (3): 6.9/35 kB | 9.7/49 kB | 4.1/16 kB Progress (3): 6.9/35 kB | 11/49 kB | 4.1/16 kB Progress (3): 8.3/35 kB | 11/49 kB | 4.1/16 kB Progress (3): 8.3/35 kB | 12/49 kB | 4.1/16 kB Progress (3): 9.7/35 kB | 12/49 kB | 4.1/16 kB Progress (3): 9.7/35 kB | 12/49 kB | 5.5/16 kB Progress (3): 11/35 kB | 12/49 kB | 5.5/16 kB Progress (3): 11/35 kB | 12/49 kB | 6.9/16 kB Progress (3): 12/35 kB | 12/49 kB | 6.9/16 kB Progress (3): 12/35 kB | 14/49 kB | 6.9/16 kB Progress (3): 14/35 kB | 14/49 kB | 6.9/16 kB Progress (3): 14/35 kB | 15/49 kB | 6.9/16 kB Progress (3): 14/35 kB | 15/49 kB | 8.3/16 kB Progress (3): 15/35 kB | 15/49 kB | 8.3/16 kB Progress (3): 15/35 kB | 15/49 kB | 9.7/16 kB Progress (3): 15/35 kB | 15/49 kB | 11/16 kB Progress (3): 17/35 kB | 15/49 kB | 11/16 kB Progress (3): 17/35 kB | 15/49 kB | 12/16 kB Progress (3): 17/35 kB | 17/49 kB | 12/16 kB Progress (3): 17/35 kB | 17/49 kB | 14/16 kB Progress (3): 17/35 kB | 18/49 kB | 14/16 kB Progress (3): 17/35 kB | 18/49 kB | 15/16 kB Progress (3): 18/35 kB | 18/49 kB | 15/16 kB Progress (4): 18/35 kB | 18/49 kB | 15/16 kB | 16/98 kB Progress (4): 19/35 kB | 18/49 kB | 15/16 kB | 16/98 kB Progress (4): 19/35 kB | 18/49 kB | 16 kB | 16/98 kB Progress (4): 19/35 kB | 19/49 kB | 16 kB | 16/98 kB Progress (4): 21/35 kB | 19/49 kB | 16 kB | 16/98 kB Progress (4): 21/35 kB | 21/49 kB | 16 kB | 16/98 kB Progress (4): 22/35 kB | 21/49 kB | 16 kB | 16/98 kB Progress (4): 22/35 kB | 22/49 kB | 16 kB | 16/98 kB Progress (4): 23/35 kB | 22/49 kB | 16 kB | 16/98 kB Progress (4): 23/35 kB | 23/49 kB | 16 kB | 16/98 kB Progress (4): 25/35 kB | 23/49 kB | 16 kB | 16/98 kB Progress (4): 25/35 kB | 25/49 kB | 16 kB | 16/98 kB Progress (4): 26/35 kB | 25/49 kB | 16 kB | 16/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 336 kB/s) 2024-09-12T17:15:59.848 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (3): 26/35 kB | 26/49 kB | 16/98 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-12T17:15:59.856 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (3): 28/35 kB | 26/49 kB | 16/98 kB Progress (3): 28/35 kB | 28/49 kB | 16/98 kB Progress (3): 29/35 kB | 28/49 kB | 16/98 kB Progress (3): 29/35 kB | 29/49 kB | 16/98 kB Progress (3): 30/35 kB | 29/49 kB | 16/98 kB Progress (3): 30/35 kB | 30/49 kB | 16/98 kB Progress (4): 30/35 kB | 30/49 kB | 16/98 kB | 16/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/98 kB | 33/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/98 kB | 49/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/98 kB | 66/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/98 kB | 82/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/98 kB | 98/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/98 kB | 115/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/98 kB | 131/782 kB Progress (4): 30/35 kB | 32/49 kB | 16/98 kB | 131/782 kB Progress (4): 32/35 kB | 32/49 kB | 16/98 kB | 131/782 kB Progress (4): 32/35 kB | 33/49 kB | 16/98 kB | 131/782 kB Progress (4): 33/35 kB | 33/49 kB | 16/98 kB | 131/782 kB Progress (4): 33/35 kB | 33/49 kB | 16/98 kB | 147/782 kB Progress (4): 34/35 kB | 33/49 kB | 16/98 kB | 147/782 kB Progress (4): 34/35 kB | 34/49 kB | 16/98 kB | 147/782 kB Progress (4): 35 kB | 34/49 kB | 16/98 kB | 147/782 kB Progress (4): 35 kB | 36/49 kB | 16/98 kB | 147/782 kB Progress (4): 35 kB | 36/49 kB | 16/98 kB | 164/782 kB Progress (4): 35 kB | 37/49 kB | 16/98 kB | 164/782 kB Progress (4): 35 kB | 39/49 kB | 16/98 kB | 164/782 kB Progress (4): 35 kB | 39/49 kB | 16/98 kB | 180/782 kB Progress (4): 35 kB | 40/49 kB | 16/98 kB | 180/782 kB Progress (4): 35 kB | 41/49 kB | 16/98 kB | 180/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 628 kB/s) 2024-09-12T17:15:59.856 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (3): 43/49 kB | 16/98 kB | 180/782 kB Progress (3): 43/49 kB | 33/98 kB | 180/782 kB Progress (3): 43/49 kB | 33/98 kB | 197/782 kB Progress (3): 44/49 kB | 33/98 kB | 197/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-12T17:15:59.858 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (3): 44/49 kB | 33/98 kB | 213/782 kB Progress (3): 44/49 kB | 33/98 kB | 229/782 kB Progress (3): 44/49 kB | 33/98 kB | 246/782 kB Progress (3): 46/49 kB | 33/98 kB | 246/782 kB Progress (3): 47/49 kB | 33/98 kB | 246/782 kB Progress (3): 47/49 kB | 33/98 kB | 256/782 kB Progress (3): 48/49 kB | 33/98 kB | 256/782 kB Progress (3): 49 kB | 33/98 kB | 256/782 kB Progress (3): 49 kB | 33/98 kB | 272/782 kB Progress (3): 49 kB | 33/98 kB | 289/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 834 kB/s) 2024-09-12T17:15:59.858 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 49/98 kB | 289/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-12T17:15:59.862 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 49/98 kB | 305/782 kB Progress (2): 49/98 kB | 321/782 kB Progress (2): 49/98 kB | 338/782 kB Progress (2): 49/98 kB | 354/782 kB Progress (3): 49/98 kB | 354/782 kB | 1.4/11 kB Progress (3): 49/98 kB | 370/782 kB | 1.4/11 kB Progress (3): 49/98 kB | 370/782 kB | 2.8/11 kB Progress (3): 49/98 kB | 370/782 kB | 4.1/11 kB Progress (3): 49/98 kB | 387/782 kB | 4.1/11 kB Progress (3): 49/98 kB | 403/782 kB | 4.1/11 kB Progress (3): 49/98 kB | 403/782 kB | 5.5/11 kB Progress (3): 49/98 kB | 403/782 kB | 6.9/11 kB Progress (3): 49/98 kB | 420/782 kB | 6.9/11 kB Progress (3): 49/98 kB | 420/782 kB | 8.3/11 kB Progress (3): 49/98 kB | 420/782 kB | 9.7/11 kB Progress (3): 49/98 kB | 436/782 kB | 9.7/11 kB Progress (3): 49/98 kB | 452/782 kB | 9.7/11 kB Progress (3): 49/98 kB | 469/782 kB | 9.7/11 kB Progress (3): 49/98 kB | 469/782 kB | 11/11 kB Progress (3): 49/98 kB | 469/782 kB | 11 kB Progress (3): 49/98 kB | 485/782 kB | 11 kB Progress (3): 49/98 kB | 502/782 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 186 kB/s) 2024-09-12T17:15:59.862 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 49/98 kB | 518/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-12T17:15:59.867 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 49/98 kB | 534/782 kB Progress (2): 49/98 kB | 551/782 kB Progress (2): 49/98 kB | 567/782 kB Progress (2): 49/98 kB | 583/782 kB Progress (2): 49/98 kB | 600/782 kB Progress (2): 49/98 kB | 616/782 kB Progress (2): 49/98 kB | 633/782 kB Progress (2): 49/98 kB | 649/782 kB Progress (2): 49/98 kB | 665/782 kB Progress (2): 49/98 kB | 682/782 kB Progress (2): 49/98 kB | 698/782 kB Progress (2): 49/98 kB | 715/782 kB Progress (2): 49/98 kB | 731/782 kB Progress (2): 49/98 kB | 747/782 kB Progress (2): 49/98 kB | 764/782 kB Progress (2): 49/98 kB | 780/782 kB Progress (2): 49/98 kB | 782 kB Progress (2): 66/98 kB | 782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 12 MB/s) 2024-09-12T17:15:59.867 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-12T17:15:59.870 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 82/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.3 MB/s) 2024-09-12T17:15:59.870 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-12T17:15:59.873 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/205 kB Progress (2): 16/205 kB | 16/30 kB Progress (2): 33/205 kB | 16/30 kB Progress (2): 33/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 414 kB/s) 2024-09-12T17:15:59.873 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-12T17:15:59.897 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 33/205 kB | 16/81 kB Progress (2): 49/205 kB | 16/81 kB Progress (3): 49/205 kB | 16/81 kB | 16/798 kB Progress (3): 49/205 kB | 16/81 kB | 33/798 kB Progress (3): 66/205 kB | 16/81 kB | 33/798 kB Progress (3): 66/205 kB | 16/81 kB | 49/798 kB Progress (3): 66/205 kB | 16/81 kB | 66/798 kB Progress (3): 66/205 kB | 16/81 kB | 82/798 kB Progress (3): 66/205 kB | 16/81 kB | 98/798 kB Progress (3): 66/205 kB | 16/81 kB | 115/798 kB Progress (3): 66/205 kB | 16/81 kB | 131/798 kB Progress (4): 66/205 kB | 16/81 kB | 131/798 kB | 13 kB Progress (4): 66/205 kB | 16/81 kB | 147/798 kB | 13 kB Progress (4): 82/205 kB | 16/81 kB | 147/798 kB | 13 kB Progress (4): 82/205 kB | 16/81 kB | 164/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 158 kB/s) 2024-09-12T17:15:59.898 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-12T17:15:59.898 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (3): 82/205 kB | 16/81 kB | 180/798 kB Progress (3): 98/205 kB | 16/81 kB | 180/798 kB Progress (3): 98/205 kB | 16/81 kB | 197/798 kB Progress (3): 98/205 kB | 16/81 kB | 213/798 kB Progress (3): 98/205 kB | 16/81 kB | 229/798 kB Progress (3): 115/205 kB | 16/81 kB | 229/798 kB Progress (3): 115/205 kB | 16/81 kB | 246/798 kB Progress (3): 115/205 kB | 16/81 kB | 262/798 kB Progress (3): 115/205 kB | 16/81 kB | 279/798 kB Progress (3): 131/205 kB | 16/81 kB | 279/798 kB Progress (3): 131/205 kB | 16/81 kB | 295/798 kB Progress (3): 131/205 kB | 16/81 kB | 311/798 kB Progress (3): 131/205 kB | 16/81 kB | 328/798 kB Progress (3): 131/205 kB | 16/81 kB | 344/798 kB Progress (4): 131/205 kB | 16/81 kB | 344/798 kB | 16/182 kB Progress (4): 131/205 kB | 16/81 kB | 360/798 kB | 16/182 kB Progress (4): 147/205 kB | 16/81 kB | 360/798 kB | 16/182 kB Progress (4): 147/205 kB | 33/81 kB | 360/798 kB | 16/182 kB Progress (4): 147/205 kB | 33/81 kB | 377/798 kB | 16/182 kB Progress (4): 147/205 kB | 33/81 kB | 393/798 kB | 16/182 kB Progress (4): 147/205 kB | 33/81 kB | 410/798 kB | 16/182 kB Progress (4): 147/205 kB | 33/81 kB | 410/798 kB | 33/182 kB Progress (4): 147/205 kB | 33/81 kB | 426/798 kB | 33/182 kB Progress (4): 147/205 kB | 33/81 kB | 442/798 kB | 33/182 kB Progress (4): 147/205 kB | 49/81 kB | 442/798 kB | 33/182 kB Progress (4): 147/205 kB | 49/81 kB | 459/798 kB | 33/182 kB Progress (4): 147/205 kB | 49/81 kB | 475/798 kB | 33/182 kB Progress (4): 147/205 kB | 49/81 kB | 492/798 kB | 33/182 kB Progress (4): 147/205 kB | 49/81 kB | 492/798 kB | 49/182 kB Progress (4): 147/205 kB | 49/81 kB | 508/798 kB | 49/182 kB Progress (4): 147/205 kB | 49/81 kB | 524/798 kB | 49/182 kB Progress (4): 147/205 kB | 66/81 kB | 524/798 kB | 49/182 kB Progress (4): 147/205 kB | 66/81 kB | 541/798 kB | 49/182 kB Progress (4): 147/205 kB | 66/81 kB | 557/798 kB | 49/182 kB Progress (4): 147/205 kB | 66/81 kB | 557/798 kB | 66/182 kB Progress (4): 147/205 kB | 66/81 kB | 573/798 kB | 66/182 kB Progress (4): 147/205 kB | 66/81 kB | 585/798 kB | 66/182 kB Progress (4): 147/205 kB | 66/81 kB | 601/798 kB | 66/182 kB Progress (4): 147/205 kB | 66/81 kB | 617/798 kB | 66/182 kB Progress (4): 164/205 kB | 66/81 kB | 617/798 kB | 66/182 kB Progress (4): 164/205 kB | 81 kB | 617/798 kB | 66/182 kB Progress (4): 164/205 kB | 81 kB | 634/798 kB | 66/182 kB Progress (4): 180/205 kB | 81 kB | 634/798 kB | 66/182 kB Progress (4): 180/205 kB | 81 kB | 650/798 kB | 66/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 874 kB/s) 2024-09-12T17:15:59.898 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-12T17:15:59.898 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (3): 180/205 kB | 667/798 kB | 66/182 kB Progress (3): 180/205 kB | 683/798 kB | 66/182 kB Progress (3): 180/205 kB | 699/798 kB | 66/182 kB Progress (3): 197/205 kB | 699/798 kB | 66/182 kB Progress (3): 197/205 kB | 716/798 kB | 66/182 kB Progress (3): 197/205 kB | 732/798 kB | 66/182 kB Progress (3): 205 kB | 732/798 kB | 66/182 kB Progress (3): 205 kB | 749/798 kB | 66/182 kB Progress (3): 205 kB | 765/798 kB | 66/182 kB Progress (3): 205 kB | 781/798 kB | 66/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.2 MB/s) 2024-09-12T17:15:59.898 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-12T17:15:59.899 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 798/798 kB | 66/182 kB Progress (2): 798 kB | 66/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 8.3 MB/s) 2024-09-12T17:15:59.899 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-12T17:15:59.905 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 66/182 kB | 16/151 kB Progress (2): 82/182 kB | 16/151 kB Progress (2): 82/182 kB | 33/151 kB Progress (2): 98/182 kB | 33/151 kB Progress (2): 98/182 kB | 49/151 kB Progress (2): 115/182 kB | 49/151 kB Progress (2): 115/182 kB | 66/151 kB Progress (2): 131/182 kB | 66/151 kB Progress (2): 131/182 kB | 82/151 kB Progress (2): 147/182 kB | 82/151 kB Progress (2): 147/182 kB | 98/151 kB Progress (2): 164/182 kB | 98/151 kB Progress (2): 180/182 kB | 98/151 kB Progress (2): 182 kB | 98/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.8 MB/s) 2024-09-12T17:15:59.906 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-12T17:15:59.909 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 98/151 kB | 16/27 kB Progress (2): 98/151 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 253 kB/s) 2024-09-12T17:15:59.909 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-12T17:15:59.915 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 98/151 kB | 16/30 kB Progress (2): 98/151 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 273 kB/s) 2024-09-12T17:15:59.916 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-12T17:15:59.916 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 115/151 kB Progress (2): 115/151 kB | 16/385 kB Progress (2): 115/151 kB | 33/385 kB Progress (2): 131/151 kB | 33/385 kB Progress (2): 131/151 kB | 49/385 kB Progress (2): 147/151 kB | 49/385 kB Progress (2): 151 kB | 49/385 kB Progress (2): 151 kB | 66/385 kB Progress (2): 151 kB | 82/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.3 MB/s) 2024-09-12T17:15:59.916 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-12T17:15:59.920 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 98/385 kB Progress (1): 115/385 kB Progress (1): 131/385 kB Progress (1): 147/385 kB Progress (1): 164/385 kB Progress (1): 180/385 kB Progress (1): 197/385 kB Progress (1): 213/385 kB Progress (1): 229/385 kB Progress (1): 246/385 kB Progress (1): 256/385 kB Progress (1): 272/385 kB Progress (2): 272/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 110 kB/s) 2024-09-12T17:15:59.921 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-12T17:15:59.931 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 272/385 kB | 16/75 kB Progress (2): 289/385 kB | 16/75 kB Progress (2): 305/385 kB | 16/75 kB Progress (2): 321/385 kB | 16/75 kB Progress (2): 321/385 kB | 33/75 kB Progress (2): 338/385 kB | 33/75 kB Progress (2): 354/385 kB | 33/75 kB Progress (2): 370/385 kB | 33/75 kB Progress (2): 370/385 kB | 49/75 kB Progress (2): 385 kB | 49/75 kB Progress (3): 385 kB | 49/75 kB | 16/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 3.1 MB/s) 2024-09-12T17:15:59.931 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-12T17:15:59.931 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 66/75 kB | 16/780 kB Progress (2): 66/75 kB | 33/780 kB Progress (2): 66/75 kB | 49/780 kB Progress (2): 66/75 kB | 62/780 kB Progress (2): 75 kB | 62/780 kB Progress (3): 75 kB | 62/780 kB | 16/329 kB Progress (3): 75 kB | 78/780 kB | 16/329 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 596 kB/s) 2024-09-12T17:15:59.932 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-12T17:15:59.954 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 78/780 kB | 33/329 kB Progress (2): 94/780 kB | 33/329 kB Progress (2): 94/780 kB | 49/329 kB Progress (2): 111/780 kB | 49/329 kB Progress (2): 111/780 kB | 64/329 kB Progress (2): 111/780 kB | 81/329 kB Progress (2): 127/780 kB | 81/329 kB Progress (2): 127/780 kB | 97/329 kB Progress (2): 144/780 kB | 97/329 kB Progress (2): 144/780 kB | 113/329 kB Progress (2): 160/780 kB | 113/329 kB Progress (2): 160/780 kB | 130/329 kB Progress (2): 160/780 kB | 146/329 kB Progress (2): 176/780 kB | 146/329 kB Progress (2): 193/780 kB | 146/329 kB Progress (2): 193/780 kB | 162/329 kB Progress (2): 193/780 kB | 179/329 kB Progress (2): 209/780 kB | 179/329 kB Progress (2): 225/780 kB | 179/329 kB Progress (2): 225/780 kB | 195/329 kB Progress (2): 225/780 kB | 212/329 kB Progress (2): 242/780 kB | 212/329 kB Progress (2): 242/780 kB | 228/329 kB Progress (2): 258/780 kB | 228/329 kB Progress (2): 258/780 kB | 244/329 kB Progress (2): 275/780 kB | 244/329 kB Progress (2): 291/780 kB | 244/329 kB Progress (2): 307/780 kB | 244/329 kB Progress (2): 324/780 kB | 244/329 kB Progress (2): 340/780 kB | 244/329 kB Progress (2): 356/780 kB | 244/329 kB Progress (2): 373/780 kB | 244/329 kB Progress (2): 389/780 kB | 244/329 kB Progress (2): 406/780 kB | 244/329 kB Progress (2): 422/780 kB | 244/329 kB Progress (2): 438/780 kB | 244/329 kB Progress (2): 455/780 kB | 244/329 kB Progress (2): 471/780 kB | 244/329 kB Progress (2): 488/780 kB | 244/329 kB Progress (2): 504/780 kB | 244/329 kB Progress (2): 520/780 kB | 244/329 kB Progress (2): 537/780 kB | 244/329 kB Progress (2): 553/780 kB | 244/329 kB Progress (2): 553/780 kB | 261/329 kB Progress (2): 569/780 kB | 261/329 kB Progress (2): 569/780 kB | 277/329 kB Progress (2): 586/780 kB | 277/329 kB Progress (2): 586/780 kB | 294/329 kB Progress (2): 602/780 kB | 294/329 kB Progress (2): 602/780 kB | 310/329 kB Progress (3): 602/780 kB | 310/329 kB | 16/354 kB Progress (4): 602/780 kB | 310/329 kB | 16/354 kB | 16/501 kB Progress (4): 619/780 kB | 310/329 kB | 16/354 kB | 16/501 kB Progress (4): 619/780 kB | 326/329 kB | 16/354 kB | 16/501 kB Progress (4): 619/780 kB | 326/329 kB | 33/354 kB | 16/501 kB Progress (4): 619/780 kB | 329 kB | 33/354 kB | 16/501 kB Progress (5): 619/780 kB | 329 kB | 33/354 kB | 16/501 kB | 16/41 kB Progress (5): 635/780 kB | 329 kB | 33/354 kB | 16/501 kB | 16/41 kB Progress (5): 635/780 kB | 329 kB | 33/354 kB | 32/501 kB | 16/41 kB Progress (5): 635/780 kB | 329 kB | 49/354 kB | 32/501 kB | 16/41 kB Progress (5): 635/780 kB | 329 kB | 49/354 kB | 32/501 kB | 33/41 kB Progress (5): 635/780 kB | 329 kB | 49/354 kB | 49/501 kB | 33/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.2 MB/s) 2024-09-12T17:15:59.954 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (4): 635/780 kB | 66/354 kB | 49/501 kB | 33/41 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-12T17:15:59.955 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (4): 635/780 kB | 66/354 kB | 49/501 kB | 41 kB Progress (4): 635/780 kB | 66/354 kB | 65/501 kB | 41 kB Progress (4): 635/780 kB | 82/354 kB | 65/501 kB | 41 kB Progress (4): 635/780 kB | 82/354 kB | 81/501 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 269 kB/s) 2024-09-12T17:15:59.955 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (3): 635/780 kB | 98/354 kB | 81/501 kB Progress (3): 651/780 kB | 98/354 kB | 81/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-12T17:15:59.963 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (3): 651/780 kB | 98/354 kB | 98/501 kB Progress (3): 651/780 kB | 115/354 kB | 98/501 kB Progress (3): 668/780 kB | 115/354 kB | 98/501 kB Progress (3): 668/780 kB | 115/354 kB | 114/501 kB Progress (3): 668/780 kB | 131/354 kB | 114/501 kB Progress (3): 684/780 kB | 131/354 kB | 114/501 kB Progress (3): 684/780 kB | 131/354 kB | 130/501 kB Progress (3): 684/780 kB | 147/354 kB | 130/501 kB Progress (3): 701/780 kB | 147/354 kB | 130/501 kB Progress (3): 701/780 kB | 147/354 kB | 147/501 kB Progress (3): 717/780 kB | 147/354 kB | 147/501 kB Progress (3): 717/780 kB | 164/354 kB | 147/501 kB Progress (3): 717/780 kB | 164/354 kB | 163/501 kB Progress (3): 733/780 kB | 164/354 kB | 163/501 kB Progress (3): 733/780 kB | 164/354 kB | 180/501 kB Progress (3): 733/780 kB | 180/354 kB | 180/501 kB Progress (3): 750/780 kB | 180/354 kB | 180/501 kB Progress (3): 750/780 kB | 180/354 kB | 196/501 kB Progress (3): 750/780 kB | 197/354 kB | 196/501 kB Progress (3): 766/780 kB | 197/354 kB | 196/501 kB Progress (3): 766/780 kB | 197/354 kB | 212/501 kB Progress (3): 766/780 kB | 213/354 kB | 212/501 kB Progress (3): 780 kB | 213/354 kB | 212/501 kB Progress (3): 780 kB | 213/354 kB | 229/501 kB Progress (3): 780 kB | 229/354 kB | 229/501 kB Progress (3): 780 kB | 229/354 kB | 245/501 kB Progress (3): 780 kB | 246/354 kB | 245/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.9 MB/s) 2024-09-12T17:15:59.963 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 262/354 kB | 245/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-12T17:15:59.963 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 262/354 kB | 262/501 kB Progress (2): 279/354 kB | 262/501 kB Progress (2): 279/354 kB | 278/501 kB Progress (2): 295/354 kB | 278/501 kB Progress (2): 295/354 kB | 294/501 kB Progress (2): 311/354 kB | 294/501 kB Progress (2): 311/354 kB | 311/501 kB Progress (2): 328/354 kB | 311/501 kB Progress (2): 328/354 kB | 327/501 kB Progress (2): 344/354 kB | 327/501 kB Progress (2): 344/354 kB | 343/501 kB Progress (2): 354 kB | 343/501 kB Progress (2): 354 kB | 360/501 kB Progress (2): 354 kB | 376/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.2 MB/s) 2024-09-12T17:15:59.963 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-12T17:15:59.965 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 393/501 kB Progress (1): 402/501 kB Progress (1): 418/501 kB Progress (1): 435/501 kB Progress (1): 451/501 kB Progress (1): 468/501 kB Progress (1): 484/501 kB Progress (1): 500/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 3.1 MB/s) 2024-09-12T17:15:59.965 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-12T17:15:59.968 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 38 kB/s) 2024-09-12T17:15:59.969 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-12T17:15:59.979 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/586 kB Progress (1): 33/586 kB Progress (1): 49/586 kB Progress (1): 66/586 kB Progress (1): 82/586 kB Progress (1): 98/586 kB Progress (1): 115/586 kB Progress (1): 131/586 kB Progress (1): 147/586 kB Progress (1): 164/586 kB Progress (1): 180/586 kB Progress (1): 197/586 kB Progress (1): 213/586 kB Progress (1): 229/586 kB Progress (1): 246/586 kB Progress (1): 262/586 kB Progress (2): 262/586 kB | 16/211 kB Progress (2): 279/586 kB | 16/211 kB Progress (2): 279/586 kB | 32/211 kB Progress (2): 295/586 kB | 32/211 kB Progress (2): 295/586 kB | 49/211 kB Progress (2): 311/586 kB | 49/211 kB Progress (2): 311/586 kB | 65/211 kB Progress (2): 328/586 kB | 65/211 kB Progress (2): 328/586 kB | 81/211 kB Progress (2): 344/586 kB | 81/211 kB Progress (2): 344/586 kB | 98/211 kB Progress (2): 360/586 kB | 98/211 kB Progress (2): 360/586 kB | 114/211 kB Progress (2): 377/586 kB | 114/211 kB Progress (2): 377/586 kB | 130/211 kB Progress (2): 393/586 kB | 130/211 kB Progress (2): 393/586 kB | 147/211 kB Progress (2): 410/586 kB | 147/211 kB Progress (2): 410/586 kB | 163/211 kB Progress (2): 426/586 kB | 163/211 kB Progress (2): 426/586 kB | 180/211 kB Progress (2): 442/586 kB | 180/211 kB Progress (2): 442/586 kB | 196/211 kB Progress (3): 442/586 kB | 196/211 kB | 14 kB Progress (3): 442/586 kB | 211 kB | 14 kB Progress (3): 459/586 kB | 211 kB | 14 kB Progress (3): 475/586 kB | 211 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 81 kB/s) 2024-09-12T17:15:59.980 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-12T17:15:59.980 INFO:tasks.workunit.client.0.smithi067.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.2 MB/s) 2024-09-12T17:15:59.980 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-12T17:15:59.983 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 492/586 kB Progress (1): 508/586 kB Progress (1): 524/586 kB Progress (1): 541/586 kB Progress (1): 557/586 kB Progress (1): 573/586 kB Progress (2): 573/586 kB | 15/106 kB Progress (2): 573/586 kB | 31/106 kB Progress (2): 573/586 kB | 48/106 kB Progress (2): 573/586 kB | 64/106 kB Progress (2): 573/586 kB | 81/106 kB Progress (2): 573/586 kB | 97/106 kB Progress (2): 573/586 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 590 kB/s) 2024-09-12T17:15:59.983 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-12T17:15:59.983 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 573/586 kB | 6.8 kB Progress (2): 585/586 kB | 6.8 kB Progress (2): 586 kB | 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 38 kB/s) 2024-09-12T17:15:59.983 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-12T17:15:59.983 INFO:tasks.workunit.client.0.smithi067.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.2 MB/s) 2024-09-12T17:15:59.983 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-12T17:15:59.997 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/205 kB Progress (2): 16/205 kB | 16/245 kB Progress (2): 32/205 kB | 16/245 kB Progress (2): 32/205 kB | 33/245 kB Progress (2): 32/205 kB | 49/245 kB Progress (2): 49/205 kB | 49/245 kB Progress (2): 49/205 kB | 66/245 kB Progress (2): 65/205 kB | 66/245 kB Progress (2): 65/205 kB | 82/245 kB Progress (2): 81/205 kB | 82/245 kB Progress (2): 81/205 kB | 98/245 kB Progress (2): 98/205 kB | 98/245 kB Progress (2): 98/205 kB | 115/245 kB Progress (2): 114/205 kB | 115/245 kB Progress (2): 114/205 kB | 131/245 kB Progress (2): 130/205 kB | 131/245 kB Progress (2): 130/205 kB | 147/245 kB Progress (2): 147/205 kB | 147/245 kB Progress (3): 147/205 kB | 147/245 kB | 15 kB Progress (3): 147/205 kB | 164/245 kB | 15 kB Progress (3): 163/205 kB | 164/245 kB | 15 kB Progress (3): 163/205 kB | 180/245 kB | 15 kB Progress (3): 180/205 kB | 180/245 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 78 kB/s) 2024-09-12T17:15:59.997 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 180/205 kB | 197/245 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-12T17:15:59.997 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 196/205 kB | 197/245 kB Progress (3): 196/205 kB | 197/245 kB | 6.4 kB Progress (3): 196/205 kB | 213/245 kB | 6.4 kB Progress (3): 196/205 kB | 229/245 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 33 kB/s) 2024-09-12T17:15:59.997 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-12T17:15:59.998 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 196/205 kB | 245 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.2 MB/s) 2024-09-12T17:15:59.998 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 196/205 kB | 16/16 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-12T17:15:59.998 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 205 kB | 16/16 kB Progress (2): 205 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 1.0 MB/s) 2024-09-12T17:15:59.998 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-12T17:15:59.999 INFO:tasks.workunit.client.0.smithi067.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 84 kB/s) 2024-09-12T17:16:00.010 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 108 kB/s) 2024-09-12T17:16:00.011 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Progress (2): 17 kB | 16/24 kB Progress (2): 17 kB | 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 83 kB/s) 2024-09-12T17:16:00.012 INFO:tasks.workunit.client.0.smithi067.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 114 kB/s) 2024-09-12T17:16:00.016 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 66/184 kB Progress (1): 82/184 kB Progress (1): 98/184 kB Progress (1): 115/184 kB Progress (1): 131/184 kB Progress (1): 147/184 kB Progress (1): 164/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 855 kB/s) 2024-09-12T17:16:00.036 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T17:16:00.036 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-12T17:16:00.041 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-12T17:16:00.056 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 389 kB/s) 2024-09-12T17:16:00.058 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-12T17:16:00.072 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 364 kB/s) 2024-09-12T17:16:00.074 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-12T17:16:00.088 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.9 MB/s) 2024-09-12T17:16:00.092 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-12T17:16:00.106 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 950 kB/s) 2024-09-12T17:16:00.111 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-12T17:16:00.128 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 66/153 kB Progress (1): 82/153 kB Progress (1): 98/153 kB Progress (1): 115/153 kB Progress (1): 131/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 8.5 MB/s) 2024-09-12T17:16:00.128 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-12T17:16:00.146 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 15/215 kB Progress (1): 31/215 kB Progress (1): 48/215 kB Progress (1): 64/215 kB Progress (1): 81/215 kB Progress (1): 97/215 kB Progress (1): 113/215 kB Progress (1): 130/215 kB Progress (1): 146/215 kB Progress (1): 163/215 kB Progress (1): 179/215 kB Progress (1): 194/215 kB Progress (1): 211/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 12 MB/s) 2024-09-12T17:16:00.194 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T17:16:00.194 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T17:16:00.198 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-12T17:16:00.215 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 156 kB/s) 2024-09-12T17:16:00.217 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-12T17:16:00.232 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.5 MB/s) 2024-09-12T17:16:00.235 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-12T17:16:00.250 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 626 kB/s) 2024-09-12T17:16:00.252 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-12T17:16:00.267 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.7 MB/s) 2024-09-12T17:16:00.270 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-12T17:16:00.286 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 377 kB/s) 2024-09-12T17:16:00.288 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-12T17:16:00.301 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 248 kB/s) 2024-09-12T17:16:00.305 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-12T17:16:00.319 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 47 kB/s) 2024-09-12T17:16:00.321 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-12T17:16:00.335 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 183 kB/s) 2024-09-12T17:16:00.339 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-12T17:16:00.351 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.0 MB/s) 2024-09-12T17:16:00.353 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-12T17:16:00.367 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 229 kB/s) 2024-09-12T17:16:00.369 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-12T17:16:00.383 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 597 kB/s) 2024-09-12T17:16:00.385 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-12T17:16:00.399 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 597 kB/s) 2024-09-12T17:16:00.401 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-12T17:16:00.415 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 572 kB/s) 2024-09-12T17:16:00.417 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-12T17:16:00.431 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.4 MB/s) 2024-09-12T17:16:00.437 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-12T17:16:00.451 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 364 kB/s) 2024-09-12T17:16:00.453 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-12T17:16:00.467 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.2 MB/s) 2024-09-12T17:16:00.471 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-12T17:16:00.485 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 364 kB/s) 2024-09-12T17:16:00.489 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-12T17:16:00.505 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/85 kB Progress (1): 32/85 kB Progress (1): 49/85 kB Progress (1): 65/85 kB Progress (1): 81/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.7 MB/s) 2024-09-12T17:16:00.505 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-12T17:16:00.505 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-12T17:16:00.505 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-12T17:16:00.506 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-12T17:16:00.506 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-12T17:16:00.520 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 16/41 kB Progress (3): 2.5 kB | 16/41 kB | 8.5 kB Progress (3): 2.5 kB | 33/41 kB | 8.5 kB Progress (4): 2.5 kB | 33/41 kB | 8.5 kB | 16/55 kB Progress (4): 2.5 kB | 41 kB | 8.5 kB | 16/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 178 kB/s) 2024-09-12T17:16:00.520 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-12T17:16:00.520 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (3): 41 kB | 8.5 kB | 33/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 565 kB/s) 2024-09-12T17:16:00.520 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-12T17:16:00.520 INFO:tasks.workunit.client.0.smithi067.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.7 MB/s) 2024-09-12T17:16:00.522 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 49/55 kB Progress (1): 55 kB Progress (2): 55 kB | 16/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.7 MB/s) 2024-09-12T17:16:00.524 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 33/269 kB Progress (1): 49/269 kB Progress (1): 66/269 kB Progress (1): 82/269 kB Progress (1): 98/269 kB Progress (1): 115/269 kB Progress (1): 131/269 kB Progress (1): 147/269 kB Progress (1): 164/269 kB Progress (1): 180/269 kB Progress (1): 197/269 kB Progress (1): 213/269 kB Progress (1): 229/269 kB Progress (1): 246/269 kB Progress (1): 256/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 14 MB/s) 2024-09-12T17:16:00.548 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/327 kB Progress (1): 33/327 kB Progress (1): 49/327 kB Progress (1): 65/327 kB Progress (1): 82/327 kB Progress (2): 82/327 kB | 16/587 kB Progress (2): 82/327 kB | 33/587 kB Progress (2): 98/327 kB | 33/587 kB Progress (2): 98/327 kB | 49/587 kB Progress (2): 98/327 kB | 66/587 kB Progress (2): 114/327 kB | 66/587 kB Progress (2): 114/327 kB | 82/587 kB Progress (2): 114/327 kB | 98/587 kB Progress (2): 114/327 kB | 115/587 kB Progress (2): 131/327 kB | 115/587 kB Progress (2): 131/327 kB | 131/587 kB Progress (2): 131/327 kB | 147/587 kB Progress (2): 131/327 kB | 164/587 kB Progress (2): 131/327 kB | 180/587 kB Progress (2): 147/327 kB | 180/587 kB Progress (2): 147/327 kB | 197/587 kB Progress (2): 147/327 kB | 213/587 kB Progress (2): 147/327 kB | 229/587 kB Progress (2): 147/327 kB | 246/587 kB Progress (2): 147/327 kB | 262/587 kB Progress (2): 147/327 kB | 279/587 kB Progress (2): 147/327 kB | 295/587 kB Progress (2): 147/327 kB | 311/587 kB Progress (2): 147/327 kB | 328/587 kB Progress (2): 147/327 kB | 344/587 kB Progress (2): 147/327 kB | 360/587 kB Progress (2): 147/327 kB | 377/587 kB Progress (2): 147/327 kB | 393/587 kB Progress (2): 147/327 kB | 410/587 kB Progress (2): 147/327 kB | 426/587 kB Progress (2): 147/327 kB | 442/587 kB Progress (2): 147/327 kB | 459/587 kB Progress (2): 147/327 kB | 475/587 kB Progress (2): 147/327 kB | 492/587 kB Progress (2): 147/327 kB | 508/587 kB Progress (2): 147/327 kB | 524/587 kB Progress (2): 147/327 kB | 541/587 kB Progress (2): 147/327 kB | 557/587 kB Progress (2): 147/327 kB | 573/587 kB Progress (2): 147/327 kB | 585/587 kB Progress (2): 147/327 kB | 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 15 MB/s) 2024-09-12T17:16:00.550 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 163/327 kB Progress (1): 180/327 kB Progress (1): 196/327 kB Progress (1): 213/327 kB Progress (1): 229/327 kB Progress (1): 245/327 kB Progress (1): 262/327 kB Progress (1): 278/327 kB Progress (1): 295/327 kB Progress (1): 311/327 kB Progress (1): 327 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 7.4 MB/s) 2024-09-12T17:16:00.582 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T17:16:00.583 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T17:16:00.583 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T17:16:00.587 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-12T17:16:00.601 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 339 kB/s) 2024-09-12T17:16:00.603 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-12T17:16:00.617 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 424 kB/s) 2024-09-12T17:16:00.620 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-12T17:16:00.635 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/33 kB Progress (1): 32/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-09-12T17:16:00.638 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-12T17:16:00.652 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 932 kB/s) 2024-09-12T17:16:00.656 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-12T17:16:00.670 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 58 kB/s) 2024-09-12T17:16:00.673 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-12T17:16:00.687 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 303 kB/s) 2024-09-12T17:16:00.689 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-12T17:16:00.704 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-12T17:16:00.708 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-12T17:16:00.723 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 311 kB/s) 2024-09-12T17:16:00.726 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-12T17:16:00.741 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 276 kB/s) 2024-09-12T17:16:00.744 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-12T17:16:00.760 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 158 kB/s) 2024-09-12T17:16:00.762 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-12T17:16:00.777 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 753 kB/s) 2024-09-12T17:16:00.780 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-12T17:16:00.795 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-12T17:16:00.799 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-12T17:16:00.813 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 438 kB/s) 2024-09-12T17:16:00.816 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-12T17:16:00.831 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 76 kB/s) 2024-09-12T17:16:00.832 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-12T17:16:00.846 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 599 kB/s) 2024-09-12T17:16:00.848 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-12T17:16:00.862 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 179 kB/s) 2024-09-12T17:16:00.865 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-12T17:16:00.880 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 375 kB/s) 2024-09-12T17:16:00.884 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-12T17:16:00.898 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 81 kB/s) 2024-09-12T17:16:00.901 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-12T17:16:00.914 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 55 kB/s) 2024-09-12T17:16:00.915 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-12T17:16:00.929 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 431 kB/s) 2024-09-12T17:16:00.930 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-12T17:16:00.943 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 2.0 MB/s) 2024-09-12T17:16:00.948 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-12T17:16:00.961 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 86 kB/s) 2024-09-12T17:16:00.963 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-12T17:16:00.976 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 102 kB/s) 2024-09-12T17:16:00.982 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-12T17:16:00.997 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 967 kB/s) 2024-09-12T17:16:00.997 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-12T17:16:00.997 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-12T17:16:00.997 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-12T17:16:00.997 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-12T17:16:00.997 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-12T17:16:01.011 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/27 kB Progress (2): 4.2 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 301 kB/s) 2024-09-12T17:16:01.011 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 27 kB | 16/122 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-12T17:16:01.011 INFO:tasks.workunit.client.0.smithi067.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.9 MB/s) 2024-09-12T17:16:01.011 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 33/122 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-12T17:16:01.018 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 49/122 kB Progress (2): 49/122 kB | 16/334 kB Progress (2): 66/122 kB | 16/334 kB Progress (3): 66/122 kB | 16/334 kB | 16/55 kB Progress (3): 66/122 kB | 33/334 kB | 16/55 kB Progress (3): 82/122 kB | 33/334 kB | 16/55 kB Progress (3): 82/122 kB | 33/334 kB | 33/55 kB Progress (3): 82/122 kB | 49/334 kB | 33/55 kB Progress (3): 98/122 kB | 49/334 kB | 33/55 kB Progress (3): 98/122 kB | 49/334 kB | 49/55 kB Progress (3): 98/122 kB | 66/334 kB | 49/55 kB Progress (3): 98/122 kB | 66/334 kB | 55 kB Progress (3): 115/122 kB | 66/334 kB | 55 kB Progress (3): 115/122 kB | 82/334 kB | 55 kB Progress (3): 122 kB | 82/334 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.4 MB/s) 2024-09-12T17:16:01.020 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 122 kB | 98/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-12T17:16:01.020 INFO:tasks.workunit.client.0.smithi067.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 8.2 MB/s) 2024-09-12T17:16:01.020 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 115/334 kB Progress (1): 131/334 kB Progress (1): 147/334 kB Progress (1): 164/334 kB Progress (1): 180/334 kB Progress (1): 197/334 kB Progress (1): 213/334 kB Progress (1): 229/334 kB Progress (1): 246/334 kB Progress (1): 256/334 kB Progress (1): 272/334 kB Progress (1): 289/334 kB Progress (1): 305/334 kB Progress (1): 321/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 18 MB/s) 2024-09-12T17:16:01.025 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 172 kB/s) 2024-09-12T17:16:01.027 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/267 kB Progress (2): 16/267 kB | 16/23 kB Progress (2): 33/267 kB | 16/23 kB Progress (2): 33/267 kB | 23 kB Progress (2): 49/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 786 kB/s) 2024-09-12T17:16:01.030 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 66/267 kB Progress (1): 82/267 kB Progress (1): 98/267 kB Progress (1): 115/267 kB Progress (1): 131/267 kB Progress (1): 147/267 kB Progress (1): 164/267 kB Progress (1): 180/267 kB Progress (1): 197/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 246/267 kB Progress (1): 262/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.1 MB/s) 2024-09-12T17:16:01.090 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-12T17:16:01.091 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-12T17:16:01.733 INFO:tasks.workunit.client.0.smithi067.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T17:16:01.733 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T17:16:01.733 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T17:16:01.737 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T17:16:01.737 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T17:16:01.737 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T17:16:01.744 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-12T17:16:01.744 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-12T17:16:01.936 INFO:tasks.workunit.client.0.smithi067.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T17:16:01.936 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T17:16:01.936 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T17:16:01.940 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-12T17:16:01.960 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 312 kB/s) 2024-09-12T17:16:01.964 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-12T17:16:01.978 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 235 kB/s) 2024-09-12T17:16:01.982 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-12T17:16:01.997 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 217 kB/s) 2024-09-12T17:16:02.000 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-12T17:16:02.015 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 271 kB/s) 2024-09-12T17:16:02.018 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-12T17:16:02.032 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 236 kB/s) 2024-09-12T17:16:02.036 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-12T17:16:02.052 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 278 kB/s) 2024-09-12T17:16:02.056 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-12T17:16:02.070 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 117 kB/s) 2024-09-12T17:16:02.073 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-12T17:16:02.087 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 169 kB/s) 2024-09-12T17:16:02.088 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-12T17:16:02.103 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.0 MB/s) 2024-09-12T17:16:02.106 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-12T17:16:02.120 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 126 kB/s) 2024-09-12T17:16:02.122 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-12T17:16:02.136 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 414 kB/s) 2024-09-12T17:16:02.139 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-12T17:16:02.154 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 168 kB/s) 2024-09-12T17:16:02.155 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-12T17:16:02.170 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.5 MB/s) 2024-09-12T17:16:02.171 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-12T17:16:02.185 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.5 MB/s) 2024-09-12T17:16:02.188 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-12T17:16:02.201 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.2 MB/s) 2024-09-12T17:16:02.204 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-12T17:16:02.219 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 618 kB/s) 2024-09-12T17:16:02.220 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-12T17:16:02.233 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 2.1 MB/s) 2024-09-12T17:16:02.236 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-12T17:16:02.250 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 576 kB/s) 2024-09-12T17:16:02.253 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-12T17:16:02.267 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 155 kB/s) 2024-09-12T17:16:02.270 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-12T17:16:02.284 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 185 kB/s) 2024-09-12T17:16:02.286 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-12T17:16:02.300 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 110 kB/s) 2024-09-12T17:16:02.301 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-12T17:16:02.315 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-09-12T17:16:02.316 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-12T17:16:02.330 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.5 MB/s) 2024-09-12T17:16:02.332 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-12T17:16:02.345 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 520 kB/s) 2024-09-12T17:16:02.347 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-12T17:16:02.363 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 848 kB/s) 2024-09-12T17:16:02.366 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-12T17:16:02.379 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 228 kB/s) 2024-09-12T17:16:02.381 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-12T17:16:02.397 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 523 kB/s) 2024-09-12T17:16:02.397 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-12T17:16:02.409 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 646 kB/s) 2024-09-12T17:16:02.411 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-12T17:16:02.424 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 148 kB/s) 2024-09-12T17:16:02.426 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-12T17:16:02.439 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 171 kB/s) 2024-09-12T17:16:02.442 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-12T17:16:02.457 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 216 kB/s) 2024-09-12T17:16:02.459 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-12T17:16:02.473 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-12T17:16:02.475 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-12T17:16:02.490 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 967 kB/s) 2024-09-12T17:16:02.493 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-12T17:16:02.506 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 959 kB/s) 2024-09-12T17:16:02.508 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-12T17:16:02.521 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 368 kB/s) 2024-09-12T17:16:02.523 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-12T17:16:02.536 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 483 kB/s) 2024-09-12T17:16:02.538 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-12T17:16:02.552 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.3 MB/s) 2024-09-12T17:16:02.555 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-12T17:16:02.569 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.3 MB/s) 2024-09-12T17:16:02.570 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-12T17:16:02.584 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-12T17:16:02.587 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-12T17:16:02.600 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 58 kB/s) 2024-09-12T17:16:02.604 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-12T17:16:02.615 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 370 kB/s) 2024-09-12T17:16:02.617 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-12T17:16:02.630 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 609 kB/s) 2024-09-12T17:16:02.632 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-12T17:16:02.647 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 200 kB/s) 2024-09-12T17:16:02.649 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-12T17:16:02.663 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 304 kB/s) 2024-09-12T17:16:02.665 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-12T17:16:02.680 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 137 kB/s) 2024-09-12T17:16:02.682 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-12T17:16:02.696 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 248 kB/s) 2024-09-12T17:16:02.698 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-12T17:16:02.712 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 781 kB/s) 2024-09-12T17:16:02.713 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-12T17:16:02.729 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 898 kB/s) 2024-09-12T17:16:02.730 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-12T17:16:02.744 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.3 MB/s) 2024-09-12T17:16:02.746 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-12T17:16:02.760 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 26 kB/s) 2024-09-12T17:16:02.761 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-12T17:16:02.775 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 469 kB/s) 2024-09-12T17:16:02.776 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-12T17:16:02.790 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 524 kB/s) 2024-09-12T17:16:02.791 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-12T17:16:02.805 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 345 kB/s) 2024-09-12T17:16:02.807 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-12T17:16:02.820 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 562 kB/s) 2024-09-12T17:16:02.823 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-12T17:16:02.837 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.5 MB/s) 2024-09-12T17:16:02.838 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-12T17:16:02.853 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 37/78 kB Progress (1): 53/78 kB Progress (1): 69/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 5.2 MB/s) 2024-09-12T17:16:02.856 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-12T17:16:02.870 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.7 MB/s) 2024-09-12T17:16:02.873 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-12T17:16:02.887 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 435 kB/s) 2024-09-12T17:16:02.888 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-12T17:16:02.902 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 305 kB/s) 2024-09-12T17:16:02.904 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-12T17:16:02.919 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 228 kB/s) 2024-09-12T17:16:02.920 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-12T17:16:02.935 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.9 MB/s) 2024-09-12T17:16:02.938 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-12T17:16:02.951 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 182 kB/s) 2024-09-12T17:16:02.956 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-12T17:16:02.975 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 65/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 17 MB/s) 2024-09-12T17:16:02.975 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-12T17:16:02.975 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-12T17:16:02.975 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-12T17:16:02.975 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-12T17:16:02.975 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-12T17:16:02.989 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 14 kB Progress (2): 14 kB | 16/171 kB Progress (3): 14 kB | 16/171 kB | 16/26 kB Progress (4): 14 kB | 16/171 kB | 16/26 kB | 8.2 kB Progress (4): 14 kB | 16/171 kB | 26 kB | 8.2 kB Progress (4): 14 kB | 33/171 kB | 26 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 584 kB/s) 2024-09-12T17:16:02.991 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (3): 14 kB | 49/171 kB | 26 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-12T17:16:02.991 INFO:tasks.workunit.client.0.smithi067.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 906 kB/s) 2024-09-12T17:16:02.991 INFO:tasks.workunit.client.0.smithi067.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.7 MB/s) 2024-09-12T17:16:02.992 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-12T17:16:02.992 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 49/171 kB | 16/118 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-12T17:16:02.993 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 66/171 kB | 16/118 kB Progress (2): 66/171 kB | 33/118 kB Progress (2): 82/171 kB | 33/118 kB Progress (2): 82/171 kB | 49/118 kB Progress (2): 98/171 kB | 49/118 kB Progress (2): 98/171 kB | 66/118 kB Progress (2): 113/171 kB | 66/118 kB Progress (2): 113/171 kB | 80/118 kB Progress (2): 130/171 kB | 80/118 kB Progress (2): 130/171 kB | 97/118 kB Progress (2): 146/171 kB | 97/118 kB Progress (2): 146/171 kB | 113/118 kB Progress (2): 146/171 kB | 118 kB Progress (2): 163/171 kB | 118 kB Progress (2): 171 kB | 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.5 MB/s) 2024-09-12T17:16:02.993 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-12T17:16:02.993 INFO:tasks.workunit.client.0.smithi067.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 9.0 MB/s) 2024-09-12T17:16:02.993 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-12T17:16:03.005 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/61 kB Progress (2): 16/61 kB | 16/136 kB Progress (2): 33/61 kB | 16/136 kB Progress (3): 33/61 kB | 16/136 kB | 16/146 kB Progress (3): 33/61 kB | 33/136 kB | 16/146 kB Progress (3): 49/61 kB | 33/136 kB | 16/146 kB Progress (3): 49/61 kB | 33/136 kB | 33/146 kB Progress (3): 61 kB | 33/136 kB | 33/146 kB Progress (3): 61 kB | 49/136 kB | 33/146 kB Progress (3): 61 kB | 49/136 kB | 49/146 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 2.0 MB/s) 2024-09-12T17:16:03.006 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 66/136 kB | 49/146 kB Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-12T17:16:03.007 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 66/136 kB | 66/146 kB Progress (2): 82/136 kB | 66/146 kB Progress (2): 82/136 kB | 82/146 kB Progress (2): 98/136 kB | 82/146 kB Progress (2): 98/136 kB | 98/146 kB Progress (2): 114/136 kB | 98/146 kB Progress (2): 114/136 kB | 112/146 kB Progress (2): 114/136 kB | 128/146 kB Progress (2): 130/136 kB | 128/146 kB Progress (3): 130/136 kB | 128/146 kB | 16/58 kB Progress (4): 130/136 kB | 128/146 kB | 16/58 kB | 16/501 kB Progress (4): 136 kB | 128/146 kB | 16/58 kB | 16/501 kB Progress (4): 136 kB | 144/146 kB | 16/58 kB | 16/501 kB Progress (4): 136 kB | 146 kB | 16/58 kB | 16/501 kB Progress (4): 136 kB | 146 kB | 33/58 kB | 16/501 kB Progress (4): 136 kB | 146 kB | 33/58 kB | 31/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.3 MB/s) 2024-09-12T17:16:03.008 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-12T17:16:03.008 INFO:tasks.workunit.client.0.smithi067.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.6 MB/s) 2024-09-12T17:16:03.009 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 49/58 kB | 31/501 kB Progress (2): 49/58 kB | 48/501 kB Progress (2): 58 kB | 48/501 kB Progress (2): 58 kB | 64/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.7 MB/s) 2024-09-12T17:16:03.014 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 77/501 kB Progress (1): 93/501 kB Progress (1): 110/501 kB Progress (1): 126/501 kB Progress (1): 143/501 kB Progress (1): 159/501 kB Progress (1): 175/501 kB Progress (1): 192/501 kB Progress (1): 208/501 kB Progress (1): 224/501 kB Progress (1): 241/501 kB Progress (1): 257/501 kB Progress (1): 274/501 kB Progress (1): 290/501 kB Progress (1): 306/501 kB Progress (1): 323/501 kB Progress (1): 339/501 kB Progress (1): 356/501 kB Progress (1): 372/501 kB Progress (1): 388/501 kB Progress (1): 405/501 kB Progress (1): 421/501 kB Progress (1): 437/501 kB Progress (1): 454/501 kB Progress (1): 470/501 kB Progress (1): 487/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 13 MB/s) 2024-09-12T17:16:03.020 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 66/124 kB Progress (1): 82/124 kB Progress (1): 98/124 kB Progress (1): 115/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.7 MB/s) 2024-09-12T17:16:03.054 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 31 MB/s) 2024-09-12T17:16:03.137 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T17:16:03.137 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-12T17:16:03.140 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-12T17:16:03.154 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 320 kB/s) 2024-09-12T17:16:03.156 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-12T17:16:03.169 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 350 kB/s) 2024-09-12T17:16:03.171 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-12T17:16:03.185 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.2 MB/s) 2024-09-12T17:16:03.187 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-12T17:16:03.201 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.4 MB/s) 2024-09-12T17:16:03.203 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-12T17:16:03.217 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 370 kB/s) 2024-09-12T17:16:03.219 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-12T17:16:03.232 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 302 kB/s) 2024-09-12T17:16:03.234 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-12T17:16:03.248 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 430 kB/s) 2024-09-12T17:16:03.250 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-12T17:16:03.264 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 447 kB/s) 2024-09-12T17:16:03.266 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-12T17:16:03.280 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.4 MB/s) 2024-09-12T17:16:03.283 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-12T17:16:03.297 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 1.0 MB/s) 2024-09-12T17:16:03.299 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-12T17:16:03.313 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 146 kB/s) 2024-09-12T17:16:03.315 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-12T17:16:03.329 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 587 kB/s) 2024-09-12T17:16:03.331 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-12T17:16:03.345 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 2.0 MB/s) 2024-09-12T17:16:03.349 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-12T17:16:03.364 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/36 kB Progress (1): 32/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.6 MB/s) 2024-09-12T17:16:03.364 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-12T17:16:03.364 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-12T17:16:03.364 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-12T17:16:03.364 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-12T17:16:03.365 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-12T17:16:03.379 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/58 kB Progress (2): 16/58 kB | 16/26 kB Progress (3): 16/58 kB | 16/26 kB | 16/79 kB Progress (4): 16/58 kB | 16/26 kB | 16/79 kB | 15/211 kB Progress (4): 16/58 kB | 26 kB | 16/79 kB | 15/211 kB Progress (4): 33/58 kB | 26 kB | 16/79 kB | 15/211 kB Progress (4): 33/58 kB | 26 kB | 33/79 kB | 15/211 kB Progress (4): 33/58 kB | 26 kB | 33/79 kB | 31/211 kB Progress (4): 49/58 kB | 26 kB | 33/79 kB | 31/211 kB Progress (4): 49/58 kB | 26 kB | 49/79 kB | 31/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.7 MB/s) 2024-09-12T17:16:03.379 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (3): 49/58 kB | 49/79 kB | 48/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-12T17:16:03.380 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (3): 58 kB | 49/79 kB | 48/211 kB Progress (3): 58 kB | 66/79 kB | 48/211 kB Progress (3): 58 kB | 66/79 kB | 64/211 kB Progress (3): 58 kB | 79 kB | 64/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.9 MB/s) 2024-09-12T17:16:03.380 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-12T17:16:03.380 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 79 kB | 81/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 5.0 MB/s) 2024-09-12T17:16:03.383 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 95/211 kB Progress (1): 112/211 kB Progress (1): 128/211 kB Progress (1): 145/211 kB Progress (1): 161/211 kB Progress (1): 177/211 kB Progress (1): 194/211 kB Progress (2): 194/211 kB | 0/1.0 MB Progress (2): 210/211 kB | 0/1.0 MB Progress (2): 211 kB | 0/1.0 MB Progress (2): 211 kB | 0/1.0 MB Progress (2): 211 kB | 0/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 11 MB/s) 2024-09-12T17:16:03.397 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (2): 0.7/1.0 MB | 16/116 kB Progress (2): 0.7/1.0 MB | 16/116 kB Progress (2): 0.7/1.0 MB | 33/116 kB Progress (2): 0.7/1.0 MB | 33/116 kB Progress (3): 0.7/1.0 MB | 33/116 kB | 16/267 kB Progress (3): 0.7/1.0 MB | 49/116 kB | 16/267 kB Progress (3): 0.8/1.0 MB | 49/116 kB | 16/267 kB Progress (3): 0.8/1.0 MB | 49/116 kB | 32/267 kB Progress (3): 0.8/1.0 MB | 66/116 kB | 32/267 kB Progress (3): 0.8/1.0 MB | 66/116 kB | 32/267 kB Progress (3): 0.8/1.0 MB | 66/116 kB | 49/267 kB Progress (3): 0.8/1.0 MB | 82/116 kB | 49/267 kB Progress (3): 0.8/1.0 MB | 82/116 kB | 49/267 kB Progress (3): 0.8/1.0 MB | 82/116 kB | 49/267 kB Progress (3): 0.8/1.0 MB | 98/116 kB | 49/267 kB Progress (3): 0.8/1.0 MB | 98/116 kB | 66/267 kB Progress (3): 0.8/1.0 MB | 98/116 kB | 66/267 kB Progress (3): 0.8/1.0 MB | 115/116 kB | 66/267 kB Progress (3): 0.8/1.0 MB | 115/116 kB | 79/267 kB Progress (3): 0.8/1.0 MB | 116 kB | 79/267 kB Progress (3): 0.8/1.0 MB | 116 kB | 79/267 kB Progress (3): 0.8/1.0 MB | 116 kB | 96/267 kB Progress (3): 0.8/1.0 MB | 116 kB | 96/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.6 MB/s) 2024-09-12T17:16:03.399 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 0.9/1.0 MB | 96/267 kB Progress (2): 0.9/1.0 MB | 112/267 kB Progress (2): 0.9/1.0 MB | 112/267 kB Progress (2): 0.9/1.0 MB | 128/267 kB Progress (2): 0.9/1.0 MB | 128/267 kB Progress (2): 0.9/1.0 MB | 128/267 kB Progress (2): 0.9/1.0 MB | 145/267 kB Progress (2): 0.9/1.0 MB | 145/267 kB Progress (2): 0.9/1.0 MB | 161/267 kB Progress (2): 0.9/1.0 MB | 161/267 kB Progress (2): 1.0/1.0 MB | 161/267 kB Progress (2): 1.0/1.0 MB | 178/267 kB Progress (2): 1.0/1.0 MB | 178/267 kB Progress (2): 1.0/1.0 MB | 194/267 kB Progress (2): 1.0/1.0 MB | 194/267 kB Progress (2): 1.0/1.0 MB | 194/267 kB Progress (2): 1.0/1.0 MB | 210/267 kB Progress (2): 1.0 MB | 210/267 kB Progress (2): 1.0 MB | 227/267 kB Progress (2): 1.0 MB | 243/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 29 MB/s) 2024-09-12T17:16:03.400 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 260/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.4 MB/s) 2024-09-12T17:16:03.596 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-12T17:16:03.630 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:16:03.630 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] BUILD SUCCESS 2024-09-12T17:16:03.630 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:16:03.631 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Total time: 5.878 s 2024-09-12T17:16:03.631 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Finished at: 2024-09-12T17:16:03Z 2024-09-12T17:16:03.631 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:16:03.654 INFO:tasks.workunit.client.0.smithi067.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-12T17:16:03.663 INFO:tasks.workunit.client.0.smithi067.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T17:16:04.694 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Scanning for projects... 2024-09-12T17:16:04.792 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T17:16:04.792 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T17:16:04.792 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Building jcksum 1.0 2024-09-12T17:16:04.792 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] from pom.xml 2024-09-12T17:16:04.792 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T17:16:05.049 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T17:16:05.049 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T17:16:05.136 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T17:16:05.137 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T17:16:05.137 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T17:16:05.226 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T17:16:05.226 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T17:16:05.227 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T17:16:05.228 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T17:16:05.229 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T17:16:05.229 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T17:16:05.233 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T17:16:05.233 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T17:16:05.233 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T17:16:05.417 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-12T17:16:05.619 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-12T17:16:05.821 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 23 kB/s) 2024-09-12T17:16:05.830 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-12T17:16:05.861 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 87 kB/s) 2024-09-12T17:16:05.866 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-12T17:16:05.882 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 166 kB/s) 2024-09-12T17:16:05.887 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-12T17:16:05.903 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 189 kB/s) 2024-09-12T17:16:05.905 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-12T17:16:05.922 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 200 kB/s) 2024-09-12T17:16:05.924 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-12T17:16:05.940 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 105 kB/s) 2024-09-12T17:16:05.942 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-12T17:16:05.959 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 167 kB/s) 2024-09-12T17:16:05.964 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-12T17:16:05.985 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.6/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.3 MB/s) 2024-09-12T17:16:05.987 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-12T17:16:05.987 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-12T17:16:05.988 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-12T17:16:05.988 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-12T17:16:05.988 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-12T17:16:06.026 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 15/169 kB Progress (1): 31/169 kB Progress (1): 48/169 kB Progress (1): 64/169 kB Progress (1): 81/169 kB Progress (1): 97/169 kB Progress (1): 111/169 kB Progress (1): 127/169 kB Progress (1): 143/169 kB Progress (1): 160/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 4.2 MB/s) 2024-09-12T17:16:06.043 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.4/7.7 kB Progress (2): 1.4/7.7 kB | 1.4/189 kB Progress (2): 2.8/7.7 kB | 1.4/189 kB Progress (2): 2.8/7.7 kB | 2.8/189 kB Progress (3): 2.8/7.7 kB | 2.8/189 kB | 1.4/18 kB Progress (3): 2.8/7.7 kB | 4.1/189 kB | 1.4/18 kB Progress (4): 2.8/7.7 kB | 4.1/189 kB | 1.4/18 kB | 1.4/103 kB Progress (4): 4.1/7.7 kB | 4.1/189 kB | 1.4/18 kB | 1.4/103 kB Progress (4): 4.1/7.7 kB | 4.1/189 kB | 1.4/18 kB | 2.8/103 kB Progress (4): 4.1/7.7 kB | 5.5/189 kB | 1.4/18 kB | 2.8/103 kB Progress (4): 4.1/7.7 kB | 5.5/189 kB | 2.8/18 kB | 2.8/103 kB Progress (4): 4.1/7.7 kB | 6.9/189 kB | 2.8/18 kB | 2.8/103 kB Progress (4): 4.1/7.7 kB | 6.9/189 kB | 2.8/18 kB | 4.1/103 kB Progress (4): 5.5/7.7 kB | 6.9/189 kB | 2.8/18 kB | 4.1/103 kB Progress (4): 5.5/7.7 kB | 6.9/189 kB | 2.8/18 kB | 5.5/103 kB Progress (4): 5.5/7.7 kB | 8.3/189 kB | 2.8/18 kB | 5.5/103 kB Progress (4): 5.5/7.7 kB | 8.3/189 kB | 4.1/18 kB | 5.5/103 kB Progress (4): 5.5/7.7 kB | 9.7/189 kB | 4.1/18 kB | 5.5/103 kB Progress (4): 5.5/7.7 kB | 9.7/189 kB | 4.1/18 kB | 6.9/103 kB Progress (4): 6.9/7.7 kB | 9.7/189 kB | 4.1/18 kB | 6.9/103 kB Progress (4): 6.9/7.7 kB | 9.7/189 kB | 4.1/18 kB | 8.3/103 kB Progress (4): 6.9/7.7 kB | 11/189 kB | 4.1/18 kB | 8.3/103 kB Progress (4): 6.9/7.7 kB | 11/189 kB | 5.5/18 kB | 8.3/103 kB Progress (4): 6.9/7.7 kB | 12/189 kB | 5.5/18 kB | 8.3/103 kB Progress (4): 6.9/7.7 kB | 12/189 kB | 5.5/18 kB | 9.7/103 kB Progress (4): 7.7 kB | 12/189 kB | 5.5/18 kB | 9.7/103 kB Progress (4): 7.7 kB | 12/189 kB | 5.5/18 kB | 11/103 kB Progress (4): 7.7 kB | 14/189 kB | 5.5/18 kB | 11/103 kB Progress (4): 7.7 kB | 14/189 kB | 6.9/18 kB | 11/103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 137 kB/s) 2024-09-12T17:16:06.051 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (3): 15/189 kB | 6.9/18 kB | 11/103 kB Progress (3): 15/189 kB | 6.9/18 kB | 12/103 kB Progress (3): 16/189 kB | 6.9/18 kB | 12/103 kB Progress (3): 16/189 kB | 8.3/18 kB | 12/103 kB Progress (3): 18/189 kB | 8.3/18 kB | 12/103 kB Progress (3): 18/189 kB | 8.3/18 kB | 14/103 kB Progress (3): 19/189 kB | 8.3/18 kB | 14/103 kB Progress (3): 19/189 kB | 9.7/18 kB | 14/103 kB Progress (3): 21/189 kB | 9.7/18 kB | 14/103 kB Progress (3): 21/189 kB | 9.7/18 kB | 15/103 kB Progress (3): 22/189 kB | 9.7/18 kB | 15/103 kB Progress (3): 22/189 kB | 11/18 kB | 15/103 kB Progress (3): 23/189 kB | 11/18 kB | 15/103 kB Progress (3): 23/189 kB | 11/18 kB | 16/103 kB Progress (3): 25/189 kB | 11/18 kB | 16/103 kB Progress (3): 25/189 kB | 12/18 kB | 16/103 kB Progress (3): 26/189 kB | 12/18 kB | 16/103 kB Progress (3): 26/189 kB | 14/18 kB | 16/103 kB Progress (3): 26/189 kB | 14/18 kB | 32/103 kB Progress (3): 26/189 kB | 15/18 kB | 32/103 kB Progress (3): 27/189 kB | 15/18 kB | 32/103 kB Progress (3): 27/189 kB | 17/18 kB | 32/103 kB Progress (3): 29/189 kB | 17/18 kB | 32/103 kB Progress (3): 29/189 kB | 18 kB | 32/103 kB Progress (3): 30/189 kB | 18 kB | 32/103 kB Progress (3): 30/189 kB | 18 kB | 49/103 kB Progress (3): 31/189 kB | 18 kB | 49/103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 270 kB/s) 2024-09-12T17:16:06.073 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 48/189 kB | 49/103 kB Progress (2): 64/189 kB | 49/103 kB Progress (2): 64/189 kB | 65/103 kB Progress (2): 81/189 kB | 65/103 kB Progress (2): 96/189 kB | 65/103 kB Progress (2): 96/189 kB | 81/103 kB Progress (2): 112/189 kB | 81/103 kB Progress (2): 128/189 kB | 81/103 kB Progress (2): 145/189 kB | 81/103 kB Progress (2): 145/189 kB | 98/103 kB Progress (2): 161/189 kB | 98/103 kB Progress (2): 178/189 kB | 98/103 kB Progress (2): 189 kB | 98/103 kB Progress (2): 189 kB | 103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.2 MB/s) 2024-09-12T17:16:06.074 INFO:tasks.workunit.client.0.smithi067.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.2 MB/s) 2024-09-12T17:16:06.087 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T17:16:06.087 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] ------------------------------------------------------- 2024-09-12T17:16:06.087 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] T E S T S 2024-09-12T17:16:06.088 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] ------------------------------------------------------- 2024-09-12T17:16:06.549 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-12T17:16:06.665 INFO:tasks.workunit.client.0.smithi067.stdout:PutObjects.java: starting test run: 2024-09-12T17:16:06.666 INFO:tasks.workunit.client.0.smithi067.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:16:06.666 INFO:tasks.workunit.client.0.smithi067.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:16:06.666 INFO:tasks.workunit.client.0.smithi067.stdout: EndpointUrl=https://smithi067.front.sepia.ceph.com:443 2024-09-12T17:16:06.666 INFO:tasks.workunit.client.0.smithi067.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-12T17:16:06.763 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: Environment Variables Read 2024-09-12T17:16:07.165 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: S3 Client Initialized 2024-09-12T17:16:07.165 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: Generating File 2024-09-12T17:16:07.165 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: File Generated 2024-09-12T17:16:07.165 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: Generating File 2024-09-12T17:16:07.166 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: File Generated 2024-09-12T17:16:07.166 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: Generating File 2024-09-12T17:16:07.166 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: File Generated 2024-09-12T17:16:07.166 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: Generating File 2024-09-12T17:16:07.166 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: File Generated 2024-09-12T17:16:07.166 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: Generating File 2024-09-12T17:16:07.166 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: File Generated 2024-09-12T17:16:07.166 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: Generating File 2024-09-12T17:16:07.166 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: File Generated 2024-09-12T17:16:07.166 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: Generated Big Files 2024-09-12T17:16:07.565 INFO:tasks.workunit.client.0.smithi067.stdout:HeadBucketResponse() 2024-09-12T17:16:07.565 INFO:tasks.workunit.client.0.smithi067.stdout:sheik is ready 2024-09-12T17:16:07.565 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: Test Bucket Created 2024-09-12T17:16:07.665 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-12T17:16:07.765 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-12T17:16:07.865 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-12T17:16:08.065 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-12T17:16:08.166 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-12T17:16:08.266 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-12T17:16:08.667 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-12T17:16:08.867 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-12T17:16:09.568 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-12T17:16:10.168 INFO:tasks.workunit.client.0.smithi067.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-12T17:16:14.075 INFO:tasks.workunit.client.0.smithi067.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-12T17:16:18.481 INFO:tasks.workunit.client.0.smithi067.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-12T17:17:13.858 INFO:tasks.workunit.client.0.smithi067.stdout:arg: file-0b 2024-09-12T17:17:13.858 INFO:tasks.workunit.client.0.smithi067.stdout:arg: file-8b 2024-09-12T17:17:13.859 INFO:tasks.workunit.client.0.smithi067.stdout:arg: file-200b 2024-09-12T17:17:13.859 INFO:tasks.workunit.client.0.smithi067.stdout:arg: file-21983b 2024-09-12T17:17:13.860 INFO:tasks.workunit.client.0.smithi067.stdout:arg: file-5519b 2024-09-12T17:17:13.861 INFO:tasks.workunit.client.0.smithi067.stdout:arg: file-204329b 2024-09-12T17:17:13.862 INFO:tasks.workunit.client.0.smithi067.stdout:arg: file-256k 2024-09-12T17:17:13.863 INFO:tasks.workunit.client.0.smithi067.stdout:arg: file-1m 2024-09-12T17:17:13.864 INFO:tasks.workunit.client.0.smithi067.stdout:arg: file-1038757b 2024-09-12T17:17:13.943 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileCksum called with file-0b 2024-09-12T17:17:14.014 INFO:tasks.workunit.client.0.smithi067.stdout:PutObjectResponse 2024-09-12T17:17:14.043 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileCksum called with file-8b 2024-09-12T17:17:14.143 INFO:tasks.workunit.client.0.smithi067.stdout:PutObjectResponse 2024-09-12T17:17:14.243 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileCksum called with file-200b 2024-09-12T17:17:14.243 INFO:tasks.workunit.client.0.smithi067.stdout:PutObjectResponse 2024-09-12T17:17:14.343 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileCksum called with file-21983b 2024-09-12T17:17:14.422 INFO:tasks.workunit.client.0.smithi067.stdout:PutObjectResponse 2024-09-12T17:17:14.443 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileCksum called with file-5519b 2024-09-12T17:17:14.543 INFO:tasks.workunit.client.0.smithi067.stdout:PutObjectResponse 2024-09-12T17:17:14.644 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileCksum called with file-204329b 2024-09-12T17:17:14.744 INFO:tasks.workunit.client.0.smithi067.stdout:PutObjectResponse 2024-09-12T17:17:14.844 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileCksum called with file-256k 2024-09-12T17:17:15.026 INFO:tasks.workunit.client.0.smithi067.stdout:PutObjectResponse 2024-09-12T17:17:15.044 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileCksum called with file-1m 2024-09-12T17:17:15.444 INFO:tasks.workunit.client.0.smithi067.stdout:PutObjectResponse 2024-09-12T17:17:15.645 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-12T17:17:16.245 INFO:tasks.workunit.client.0.smithi067.stdout:PutObjectResponse 2024-09-12T17:17:16.445 INFO:tasks.workunit.client.0.smithi067.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-12T17:17:19.248 INFO:tasks.workunit.client.0.smithi067.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-12T17:17:24.553 INFO:tasks.workunit.client.0.smithi067.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-12T17:18:13.887 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 127.3 s -- in io.ceph.jcksum.PutObjects 2024-09-12T17:18:13.907 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T17:18:13.907 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Results: 2024-09-12T17:18:13.907 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T17:18:13.907 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-12T17:18:13.907 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T17:18:13.909 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:18:13.909 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] BUILD SUCCESS 2024-09-12T17:18:13.909 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:18:13.910 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Total time: 02:09 min 2024-09-12T17:18:13.910 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Finished at: 2024-09-12T17:18:13Z 2024-09-12T17:18:13.910 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:18:13.923 INFO:tasks.workunit.client.0.smithi067.stderr:+ exit 2024-09-12T17:18:13.923 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:18:13.924 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:18:14.004 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-12T17:18:14.005 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:18:14.386 DEBUG:teuthology.parallel:result is None 2024-09-12T17:18:14.387 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:18:14.426 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:18:14.426 DEBUG:teuthology.orchestra.run.smithi067:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:18:14.496 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:18:14.496 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:18:14.512 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:18:14.512 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:18:14.513 DEBUG:teuthology.orchestra.run.smithi067:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:18:14.565 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:18:14.566 INFO:teuthology.orchestra.run.smithi067.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:18:14.566 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:18:14.637 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:18:14.637 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:18:14.714 INFO:tasks.workunit:timeout=3h 2024-09-12T17:18:14.715 INFO:tasks.workunit:cleanup=True 2024-09-12T17:18:14.715 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:18:14.793 INFO:tasks.workunit.client.0.smithi067.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:19:14.820 INFO:tasks.workunit.client.0.smithi067.stderr:Updating files: 91% (11668/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:19:15.691 INFO:tasks.workunit.client.0.smithi067.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:19:15.692 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:19:15.692 INFO:tasks.workunit.client.0.smithi067.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:19:15.692 INFO:tasks.workunit.client.0.smithi067.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:19:15.692 INFO:tasks.workunit.client.0.smithi067.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:19:15.692 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:19:15.692 INFO:tasks.workunit.client.0.smithi067.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:19:15.692 INFO:tasks.workunit.client.0.smithi067.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:19:15.692 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:19:15.692 INFO:tasks.workunit.client.0.smithi067.stderr: git switch -c 2024-09-12T17:19:15.692 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:19:15.692 INFO:tasks.workunit.client.0.smithi067.stderr:Or undo this operation with: 2024-09-12T17:19:15.692 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:19:15.693 INFO:tasks.workunit.client.0.smithi067.stderr: git switch - 2024-09-12T17:19:15.693 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:19:15.693 INFO:tasks.workunit.client.0.smithi067.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:19:15.693 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:19:15.693 INFO:tasks.workunit.client.0.smithi067.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:19:15.698 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:19:15.768 INFO:tasks.workunit.client.0.smithi067.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:19:15.770 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:19:15.770 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:19:15.820 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:19:15.869 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:19:15.909 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:19:15.911 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:19:15.911 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:19:15.951 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:19:15.955 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T17:19:15.955 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:19:16.025 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-12T17:19:16.026 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-12T17:19:16.026 DEBUG:teuthology.orchestra.run.smithi067:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-12T17:19:16.102 INFO:tasks.workunit.client.0.smithi067.stdout:INFO: fully qualified domain name: smithi067.front.sepia.ceph.com 2024-09-12T17:19:16.102 INFO:tasks.workunit.client.0.smithi067.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-12T17:19:16.102 INFO:tasks.workunit.client.0.smithi067.stdout:== TESTING VERSIONED BUCKET == 2024-09-12T17:19:18.705 INFO:tasks.workunit.client.0.smithi067.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T17:19:18.890 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting pip 2024-09-12T17:19:18.896 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:19:18.942 INFO:tasks.workunit.client.0.smithi067.stdout:Installing collected packages: pip 2024-09-12T17:19:18.943 INFO:tasks.workunit.client.0.smithi067.stdout: Attempting uninstall: pip 2024-09-12T17:19:18.943 INFO:tasks.workunit.client.0.smithi067.stdout: Found existing installation: pip 21.3.1 2024-09-12T17:19:19.109 INFO:tasks.workunit.client.0.smithi067.stdout: Uninstalling pip-21.3.1: 2024-09-12T17:19:19.114 INFO:tasks.workunit.client.0.smithi067.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T17:19:19.886 INFO:tasks.workunit.client.0.smithi067.stdout:Successfully installed pip-24.2 2024-09-12T17:19:20.732 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting boto3 2024-09-12T17:19:20.733 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:19:21.334 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:19:21.335 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:19:21.387 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:19:21.388 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:19:21.443 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:19:21.444 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:19:21.493 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:19:21.495 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:19:21.571 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:19:21.573 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T17:19:21.832 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:19:21.834 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:19:21.838 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:19:21.840 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:19:21.849 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:19:21.850 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:19:21.852 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:19:21.853 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T17:19:21.855 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:19:21.930 INFO:tasks.workunit.client.0.smithi067.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:19:22.986 INFO:tasks.workunit.client.0.smithi067.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T17:19:23.224 INFO:tasks.workunit.client.0.smithi067.stdout:INFO: creating user 2024-09-12T17:19:23.339 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T17:19:23.340 INFO:tasks.workunit.client.0.smithi067.stdout: "user_id": "testid", 2024-09-12T17:19:23.340 INFO:tasks.workunit.client.0.smithi067.stdout: "display_name": "M. Tester", 2024-09-12T17:19:23.340 INFO:tasks.workunit.client.0.smithi067.stdout: "email": "tester@ceph.com", 2024-09-12T17:19:23.340 INFO:tasks.workunit.client.0.smithi067.stdout: "suspended": 0, 2024-09-12T17:19:23.340 INFO:tasks.workunit.client.0.smithi067.stdout: "max_buckets": 1000, 2024-09-12T17:19:23.340 INFO:tasks.workunit.client.0.smithi067.stdout: "subusers": [], 2024-09-12T17:19:23.340 INFO:tasks.workunit.client.0.smithi067.stdout: "keys": [ 2024-09-12T17:19:23.340 INFO:tasks.workunit.client.0.smithi067.stdout: { 2024-09-12T17:19:23.340 INFO:tasks.workunit.client.0.smithi067.stdout: "user": "testid", 2024-09-12T17:19:23.340 INFO:tasks.workunit.client.0.smithi067.stdout: "access_key": "0555b35654ad1656d804", 2024-09-12T17:19:23.340 INFO:tasks.workunit.client.0.smithi067.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-12T17:19:23.340 INFO:tasks.workunit.client.0.smithi067.stdout: "active": true, 2024-09-12T17:19:23.340 INFO:tasks.workunit.client.0.smithi067.stdout: "create_date": "2024-09-12T17:19:23.331151Z" 2024-09-12T17:19:23.341 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T17:19:23.341 INFO:tasks.workunit.client.0.smithi067.stdout: ], 2024-09-12T17:19:23.341 INFO:tasks.workunit.client.0.smithi067.stdout: "swift_keys": [], 2024-09-12T17:19:23.341 INFO:tasks.workunit.client.0.smithi067.stdout: "caps": [], 2024-09-12T17:19:23.341 INFO:tasks.workunit.client.0.smithi067.stdout: "op_mask": "read, write, delete", 2024-09-12T17:19:23.341 INFO:tasks.workunit.client.0.smithi067.stdout: "default_placement": "", 2024-09-12T17:19:23.341 INFO:tasks.workunit.client.0.smithi067.stdout: "default_storage_class": "", 2024-09-12T17:19:23.341 INFO:tasks.workunit.client.0.smithi067.stdout: "placement_tags": [], 2024-09-12T17:19:23.341 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_quota": { 2024-09-12T17:19:23.341 INFO:tasks.workunit.client.0.smithi067.stdout: "enabled": false, 2024-09-12T17:19:23.341 INFO:tasks.workunit.client.0.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:19:23.341 INFO:tasks.workunit.client.0.smithi067.stdout: "max_size": -1, 2024-09-12T17:19:23.342 INFO:tasks.workunit.client.0.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:19:23.342 INFO:tasks.workunit.client.0.smithi067.stdout: "max_objects": -1 2024-09-12T17:19:23.342 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:19:23.342 INFO:tasks.workunit.client.0.smithi067.stdout: "user_quota": { 2024-09-12T17:19:23.342 INFO:tasks.workunit.client.0.smithi067.stdout: "enabled": false, 2024-09-12T17:19:23.342 INFO:tasks.workunit.client.0.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:19:23.342 INFO:tasks.workunit.client.0.smithi067.stdout: "max_size": -1, 2024-09-12T17:19:23.342 INFO:tasks.workunit.client.0.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:19:23.342 INFO:tasks.workunit.client.0.smithi067.stdout: "max_objects": -1 2024-09-12T17:19:23.342 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T17:19:23.342 INFO:tasks.workunit.client.0.smithi067.stdout: "temp_url_keys": [], 2024-09-12T17:19:23.342 INFO:tasks.workunit.client.0.smithi067.stdout: "type": "rgw", 2024-09-12T17:19:23.342 INFO:tasks.workunit.client.0.smithi067.stdout: "mfa_ids": [], 2024-09-12T17:19:23.342 INFO:tasks.workunit.client.0.smithi067.stdout: "account_id": "", 2024-09-12T17:19:23.343 INFO:tasks.workunit.client.0.smithi067.stdout: "path": "/", 2024-09-12T17:19:23.343 INFO:tasks.workunit.client.0.smithi067.stdout: "create_date": "2024-09-12T17:19:23.331140Z", 2024-09-12T17:19:23.343 INFO:tasks.workunit.client.0.smithi067.stdout: "tags": [], 2024-09-12T17:19:23.343 INFO:tasks.workunit.client.0.smithi067.stdout: "group_ids": [] 2024-09-12T17:19:23.343 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T17:19:23.343 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T17:19:29.270 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi067.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:19:29.270 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:19:29.321 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi067.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:19:29.322 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:19:29.367 INFO:tasks.workunit.client.0.smithi067.stderr:5+0 records in 2024-09-12T17:19:29.367 INFO:tasks.workunit.client.0.smithi067.stderr:5+0 records out 2024-09-12T17:19:29.368 INFO:tasks.workunit.client.0.smithi067.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0143926 s, 364 MB/s 2024-09-12T17:19:29.370 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi067.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:19:29.371 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:19:29.450 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi067.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:19:29.450 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:19:30.505 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi067.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:19:30.505 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:19:31.561 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi067.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:19:31.561 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:19:32.617 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi067.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:19:32.617 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:19:33.669 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi067.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:19:33.670 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:19:34.725 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi067.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:19:34.725 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:19:35.774 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi067.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:19:35.774 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:19:36.825 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi067.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:19:36.825 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:19:37.870 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi067.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:19:37.870 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:19:38.921 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi067.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:19:38.922 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:19:39.981 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi067.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:19:39.981 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:19:41.030 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi067.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:19:41.030 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:19:42.082 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi067.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:19:42.082 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:19:43.126 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi067.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:19:43.126 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:19:43.210 INFO:tasks.workunit.client.0.smithi067.stdout:bucket nams is reupload-bkt-124459 2024-09-12T17:19:43.210 INFO:tasks.workunit.client.0.smithi067.stdout:endpoint is https://smithi067.front.sepia.ceph.com:443 2024-09-12T17:19:43.210 INFO:tasks.workunit.client.0.smithi067.stdout:start UploadId=2~2_XVAYHXDkhnHO5NgxHyk7IWIqmrDPQ 2024-09-12T17:19:43.211 INFO:tasks.workunit.client.0.smithi067.stdout:phase 1 uploaded part {'ETag': '"ba8f6b9f06fde323cbefb419ba11bd70"', 'PartNumber': 1} 2024-09-12T17:19:43.211 INFO:tasks.workunit.client.0.smithi067.stdout:phase 1 uploaded part {'ETag': '"ba8f6b9f06fde323cbefb419ba11bd70"', 'PartNumber': 2} 2024-09-12T17:19:43.211 INFO:tasks.workunit.client.0.smithi067.stdout:phase 2 uploaded part {'ETag': '"ba8f6b9f06fde323cbefb419ba11bd70"', 'PartNumber': 1} 2024-09-12T17:19:43.211 INFO:tasks.workunit.client.0.smithi067.stdout:phase 2 uploaded part {'ETag': '"ba8f6b9f06fde323cbefb419ba11bd70"', 'PartNumber': 1} 2024-09-12T17:19:43.211 INFO:tasks.workunit.client.0.smithi067.stdout:phase 2 uploaded part {'ETag': '"ba8f6b9f06fde323cbefb419ba11bd70"', 'PartNumber': 1} 2024-09-12T17:19:43.211 INFO:tasks.workunit.client.0.smithi067.stdout:phase 2 uploaded part {'ETag': '"ba8f6b9f06fde323cbefb419ba11bd70"', 'PartNumber': 1} 2024-09-12T17:19:43.211 INFO:tasks.workunit.client.0.smithi067.stdout:phase 2 uploaded part {'ETag': '"ba8f6b9f06fde323cbefb419ba11bd70"', 'PartNumber': 1} 2024-09-12T17:19:43.211 INFO:tasks.workunit.client.0.smithi067.stdout:phase 2 uploaded part {'ETag': '"ba8f6b9f06fde323cbefb419ba11bd70"', 'PartNumber': 1} 2024-09-12T17:19:43.211 INFO:tasks.workunit.client.0.smithi067.stdout:phase 2 uploaded part {'ETag': '"ba8f6b9f06fde323cbefb419ba11bd70"', 'PartNumber': 1} 2024-09-12T17:19:43.211 INFO:tasks.workunit.client.0.smithi067.stdout:phase 2 uploaded part {'ETag': '"ba8f6b9f06fde323cbefb419ba11bd70"', 'PartNumber': 1} 2024-09-12T17:19:43.211 INFO:tasks.workunit.client.0.smithi067.stdout:phase 2 uploaded part {'ETag': '"ba8f6b9f06fde323cbefb419ba11bd70"', 'PartNumber': 1} 2024-09-12T17:19:43.211 INFO:tasks.workunit.client.0.smithi067.stdout:phase 2 uploaded part {'ETag': '"ba8f6b9f06fde323cbefb419ba11bd70"', 'PartNumber': 1} 2024-09-12T17:19:43.211 INFO:tasks.workunit.client.0.smithi067.stdout:phase 2 uploaded part {'ETag': '"ba8f6b9f06fde323cbefb419ba11bd70"', 'PartNumber': 1} 2024-09-12T17:19:43.212 INFO:tasks.workunit.client.0.smithi067.stdout:aborting multipart upload, parts=[{'ETag': '"ba8f6b9f06fde323cbefb419ba11bd70"', 'PartNumber': 1}, {'ETag': '"ba8f6b9f06fde323cbefb419ba11bd70"', 'PartNumber': 2}] 2024-09-12T17:19:44.024 INFO:tasks.workunit.client.0.smithi067.stdout:radosgw-admin bucket radoslist: 2024-09-12T17:19:44.085 INFO:tasks.workunit.client.0.smithi067.stdout:rados ls: 2024-09-12T17:19:44.090 INFO:tasks.workunit.client.0.smithi067.stdout:== PASSED == 2024-09-12T17:19:44.090 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:19:44.090 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:19:44.169 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-12T17:19:44.170 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:19:44.553 DEBUG:teuthology.parallel:result is None 2024-09-12T17:19:44.553 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:19:44.594 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:19:44.594 DEBUG:teuthology.orchestra.run.smithi067:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:19:44.664 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:19:44.664 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-12T17:19:44.684 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-12T17:19:44.685 INFO:tasks.ragweed:Downloading ragweed... 2024-09-12T17:19:44.685 INFO:tasks.ragweed:Using branch 'wip-rgw-meta-handlers' for ragweed 2024-09-12T17:19:44.685 DEBUG:teuthology.orchestra.run.smithi067:> git clone -b wip-rgw-meta-handlers https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:19:44.734 INFO:teuthology.orchestra.run.smithi067.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T17:19:44.764 INFO:teuthology.orchestra.run.smithi067.stderr:fatal: Remote branch wip-rgw-meta-handlers not found in upstream origin 2024-09-12T17:19:44.764 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-12T17:19:44.765 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-12T17:19:44.766 DEBUG:teuthology.orchestra.run.smithi067:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:19:44.836 INFO:teuthology.orchestra.run.smithi067.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T17:19:45.035 INFO:tasks.ragweed:Creating rgw users... 2024-09-12T17:19:45.036 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-12T17:19:45.036 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key URVGDGXDAUHEWWNGIFEL --secret 0Lx4yiK/WhseECNJFhgkLrYRPgFQ08VJ+E4muwvQuh4McNMiKyn94g== --email ragweed.client.0+test@test.test --system false 2024-09-12T17:19:45.144 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:19:45.144 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:19:45.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.179+0000 7f2265120800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.181+0000 7f2265120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.181+0000 7f2265120800 20 realm 2024-09-12T17:19:45.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.181+0000 7f2265120800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.181+0000 7f2265120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.181+0000 7f2265120800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:45.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.181+0000 7f2265120800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.181+0000 7f2265120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.181+0000 7f2265120800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.182+0000 7f2265120800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:45.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.182+0000 7f2265120800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.183+0000 7f2265120800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:45.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.183+0000 7f2265120800 20 searching for the correct realm 2024-09-12T17:19:45.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.186+0000 7f225bfff640 0 -- 172.21.15.67:0/1105315756 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x564738a507c0 msgr2=0x564738a52bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:45.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.189+0000 7f2260e68640 0 -- 172.21.15.67:0/1105315756 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f224c06aa00 msgr2=0x7f224c06ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:45.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.396+0000 7f2265120800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:19:45.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.396+0000 7f2265120800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:19:45.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.396+0000 7f2265120800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:45.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.396+0000 7f2265120800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:45.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.396+0000 7f2265120800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:45.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.396+0000 7f2265120800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:45.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.396+0000 7f2265120800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.397+0000 7f2265120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.397+0000 7f2265120800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.397+0000 7f2265120800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:45.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.397+0000 7f2265120800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.398+0000 7f2265120800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:45.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.398+0000 7f2265120800 20 zone default found 2024-09-12T17:19:45.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.398+0000 7f2265120800 4 Realm: () 2024-09-12T17:19:45.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.398+0000 7f2265120800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:19:45.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.398+0000 7f2265120800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:19:45.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.398+0000 7f2265120800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:45.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.398+0000 7f2265120800 20 zonegroup default 2024-09-12T17:19:45.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.398+0000 7f2265120800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.398+0000 7f2265120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.398+0000 7f2265120800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.398+0000 7f2265120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.398+0000 7f2265120800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.399+0000 7f2265120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.399+0000 7f2265120800 20 started sync module instance, tier type = 2024-09-12T17:19:45.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.399+0000 7f2265120800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:19:45.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.409+0000 7f2265120800 20 add_watcher() i=0 2024-09-12T17:19:45.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.409+0000 7f2265120800 20 add_watcher() i=1 2024-09-12T17:19:45.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.409+0000 7f2265120800 20 add_watcher() i=2 2024-09-12T17:19:45.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.409+0000 7f2265120800 20 add_watcher() i=3 2024-09-12T17:19:45.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.409+0000 7f2265120800 20 add_watcher() i=4 2024-09-12T17:19:45.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.409+0000 7f2265120800 20 add_watcher() i=5 2024-09-12T17:19:45.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.409+0000 7f2265120800 20 add_watcher() i=6 2024-09-12T17:19:45.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.410+0000 7f2265120800 20 add_watcher() i=7 2024-09-12T17:19:45.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.410+0000 7f2265120800 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:45.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.412+0000 7f2116fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:45.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.412+0000 7f2265120800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:45.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.412+0000 7f2265120800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:45.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.412+0000 7f2265120800 5 note: GC not initialized 2024-09-12T17:19:45.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.412+0000 7f2115fe3640 20 reqs_thread_entry: start 2024-09-12T17:19:45.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.412+0000 7f2265120800 20 init_complete bucket index max shards: 1 2024-09-12T17:19:45.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.412+0000 7f2265120800 20 Filter name: none 2024-09-12T17:19:45.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.413+0000 7f20877fe640 20 reqs_thread_entry: start 2024-09-12T17:19:45.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.413+0000 7f2265120800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T17:19:45.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.413+0000 7f2265120800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.413+0000 7f2265120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.413+0000 7f2265120800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-12T17:19:45.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.413+0000 7f2265120800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:19:45.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.413+0000 7f2265120800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-12T17:19:45.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.413+0000 7f2265120800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.414+0000 7f2265120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.414+0000 7f2265120800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-12T17:19:45.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.414+0000 7f2265120800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:19:45.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.414+0000 7f2265120800 10 cache get: name=default.rgw.meta+users.keys+URVGDGXDAUHEWWNGIFEL : miss 2024-09-12T17:19:45.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.414+0000 7f2265120800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.414+0000 7f2265120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.414+0000 7f2265120800 10 cache put: name=default.rgw.meta+users.keys+URVGDGXDAUHEWWNGIFEL info.flags=0x0 2024-09-12T17:19:45.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.414+0000 7f2265120800 10 adding default.rgw.meta+users.keys+URVGDGXDAUHEWWNGIFEL to cache LRU end 2024-09-12T17:19:45.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.414+0000 7f2265120800 10 cache get: name=default.rgw.meta+users.keys+URVGDGXDAUHEWWNGIFEL : hit (negative entry) 2024-09-12T17:19:45.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.414+0000 7f2265120800 10 cache get: name=default.rgw.meta+users.keys+URVGDGXDAUHEWWNGIFEL : hit (negative entry) 2024-09-12T17:19:45.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.415+0000 7f2265120800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T17:19:45.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.415+0000 7f2265120800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:19:45.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.415+0000 7f2265120800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T17:19:45.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.416+0000 7f2137fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725908 cookie 94863893051376 notifier 5973 bl.length()=675 2024-09-12T17:19:45.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.416+0000 7f2137fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T17:19:45.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.416+0000 7f2137fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:19:45.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.419+0000 7f2265120800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T17:19:45.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.419+0000 7f2265120800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:19:45.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.419+0000 7f2265120800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T17:19:45.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.420+0000 7f2137fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725899 cookie 94863893044240 notifier 5973 bl.length()=202 2024-09-12T17:19:45.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.420+0000 7f2137fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T17:19:45.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.420+0000 7f2137fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:19:45.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.423+0000 7f2265120800 10 cache put: name=default.rgw.meta+users.keys+URVGDGXDAUHEWWNGIFEL info.flags=0x7 2024-09-12T17:19:45.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.423+0000 7f2265120800 10 moving default.rgw.meta+users.keys+URVGDGXDAUHEWWNGIFEL to cache LRU end 2024-09-12T17:19:45.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.423+0000 7f2265120800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:URVGDGXDAUHEWWNGIFEL, ofs0, ns] 2024-09-12T17:19:45.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.423+0000 7f2137fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725900 cookie 94863893044240 notifier 5973 bl.length()=190 2024-09-12T17:19:45.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.423+0000 7f2137fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+URVGDGXDAUHEWWNGIFEL info.flags=0x7 2024-09-12T17:19:45.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.423+0000 7f2137fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+URVGDGXDAUHEWWNGIFEL to cache LRU end 2024-09-12T17:19:45.425 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T17:19:45.425 INFO:teuthology.orchestra.run.smithi067.stdout: "user_id": "ragweed.client.0", 2024-09-12T17:19:45.426 INFO:teuthology.orchestra.run.smithi067.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-12T17:19:45.426 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-12T17:19:45.426 INFO:teuthology.orchestra.run.smithi067.stdout: "suspended": 0, 2024-09-12T17:19:45.426 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T17:19:45.426 INFO:teuthology.orchestra.run.smithi067.stdout: "subusers": [], 2024-09-12T17:19:45.426 INFO:teuthology.orchestra.run.smithi067.stdout: "keys": [ 2024-09-12T17:19:45.426 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-12T17:19:45.426 INFO:teuthology.orchestra.run.smithi067.stdout: "user": "ragweed.client.0", 2024-09-12T17:19:45.426 INFO:teuthology.orchestra.run.smithi067.stdout: "access_key": "URVGDGXDAUHEWWNGIFEL", 2024-09-12T17:19:45.426 INFO:teuthology.orchestra.run.smithi067.stdout: "secret_key": "0Lx4yiK/WhseECNJFhgkLrYRPgFQ08VJ+E4muwvQuh4McNMiKyn94g==", 2024-09-12T17:19:45.426 INFO:teuthology.orchestra.run.smithi067.stdout: "active": true, 2024-09-12T17:19:45.426 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T17:19:45.415192Z" 2024-09-12T17:19:45.426 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-12T17:19:45.427 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-12T17:19:45.427 INFO:teuthology.orchestra.run.smithi067.stdout: "swift_keys": [], 2024-09-12T17:19:45.427 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": [], 2024-09-12T17:19:45.427 INFO:teuthology.orchestra.run.smithi067.stdout: "op_mask": "read, write, delete", 2024-09-12T17:19:45.427 INFO:teuthology.orchestra.run.smithi067.stdout: "default_placement": "", 2024-09-12T17:19:45.427 INFO:teuthology.orchestra.run.smithi067.stdout: "default_storage_class": "", 2024-09-12T17:19:45.427 INFO:teuthology.orchestra.run.smithi067.stdout: "placement_tags": [], 2024-09-12T17:19:45.427 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T17:19:45.427 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:19:45.427 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:19:45.427 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:19:45.427 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:19:45.427 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:19:45.427 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:19:45.428 INFO:teuthology.orchestra.run.smithi067.stdout: "user_quota": { 2024-09-12T17:19:45.428 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:19:45.428 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:19:45.428 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:19:45.428 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:19:45.428 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:19:45.428 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:19:45.428 INFO:teuthology.orchestra.run.smithi067.stdout: "temp_url_keys": [], 2024-09-12T17:19:45.428 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "rgw", 2024-09-12T17:19:45.428 INFO:teuthology.orchestra.run.smithi067.stdout: "mfa_ids": [], 2024-09-12T17:19:45.428 INFO:teuthology.orchestra.run.smithi067.stdout: "account_id": "", 2024-09-12T17:19:45.428 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-12T17:19:45.428 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T17:19:45.415174Z", 2024-09-12T17:19:45.429 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-12T17:19:45.429 INFO:teuthology.orchestra.run.smithi067.stdout: "group_ids": [] 2024-09-12T17:19:45.429 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T17:19:45.429 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:19:45.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.425+0000 7f2116fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:45.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.428+0000 7f2265120800 20 remove_watcher() i=0 2024-09-12T17:19:45.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.428+0000 7f2265120800 2 removed watcher, disabling cache 2024-09-12T17:19:45.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.429+0000 7f2265120800 20 remove_watcher() i=1 2024-09-12T17:19:45.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.430+0000 7f2265120800 20 remove_watcher() i=2 2024-09-12T17:19:45.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.432+0000 7f2265120800 20 remove_watcher() i=3 2024-09-12T17:19:45.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.433+0000 7f2265120800 20 remove_watcher() i=4 2024-09-12T17:19:45.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.434+0000 7f2265120800 20 remove_watcher() i=5 2024-09-12T17:19:45.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.435+0000 7f2265120800 20 remove_watcher() i=6 2024-09-12T17:19:45.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.436+0000 7f2265120800 20 remove_watcher() i=7 2024-09-12T17:19:45.448 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-12T17:19:45.449 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key BIMIRUXGBRMSACGOZPNI --secret ex3GCPt8HN6TV33w1uV1+BylXoDvHSu4uEnMQ13+38OUVmXGnXHvBQ== --email sysuser.client.0+test@test.test --system true 2024-09-12T17:19:45.517 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:19:45.517 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:19:45.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.552+0000 7f9bc9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.553+0000 7f9bc9b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.553+0000 7f9bc9b25800 20 realm 2024-09-12T17:19:45.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.553+0000 7f9bc9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.554+0000 7f9bc9b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.554+0000 7f9bc9b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:45.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.554+0000 7f9bc9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.554+0000 7f9bc9b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.554+0000 7f9bc9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.555+0000 7f9bc9b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:45.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.555+0000 7f9bc9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.555+0000 7f9bc9b25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:45.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.556+0000 7f9bc9b25800 20 searching for the correct realm 2024-09-12T17:19:45.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.558+0000 7f9bc5fb6640 0 -- 172.21.15.67:0/2671773534 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x56211731e5d0 msgr2=0x562117320a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:19:45.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.764+0000 7f9bc4fb4640 0 -- 172.21.15.67:0/2671773534 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x562117319710 msgr2=0x56211731bb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:45.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.769+0000 7f9bc9b25800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:19:45.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.769+0000 7f9bc9b25800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:19:45.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.769+0000 7f9bc9b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:45.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.769+0000 7f9bc9b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:45.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.769+0000 7f9bc9b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:45.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.769+0000 7f9bc9b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:45.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.769+0000 7f9bc9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.770+0000 7f9bc9b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.770+0000 7f9bc9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.770+0000 7f9bc9b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:45.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.770+0000 7f9bc9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.770+0000 7f9bc9b25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:45.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.771+0000 7f9bc9b25800 20 zone default found 2024-09-12T17:19:45.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.771+0000 7f9bc9b25800 4 Realm: () 2024-09-12T17:19:45.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.771+0000 7f9bc9b25800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:19:45.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.771+0000 7f9bc9b25800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:19:45.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.771+0000 7f9bc9b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:45.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.771+0000 7f9bc9b25800 20 zonegroup default 2024-09-12T17:19:45.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.771+0000 7f9bc9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.771+0000 7f9bc9b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.771+0000 7f9bc9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.771+0000 7f9bc9b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.771+0000 7f9bc9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.771+0000 7f9bc9b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.771+0000 7f9bc9b25800 20 started sync module instance, tier type = 2024-09-12T17:19:45.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.771+0000 7f9bc9b25800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:19:45.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.781+0000 7f9bc9b25800 20 add_watcher() i=0 2024-09-12T17:19:45.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.781+0000 7f9bc9b25800 20 add_watcher() i=1 2024-09-12T17:19:45.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.781+0000 7f9bc9b25800 20 add_watcher() i=2 2024-09-12T17:19:45.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.781+0000 7f9bc9b25800 20 add_watcher() i=3 2024-09-12T17:19:45.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.781+0000 7f9bc9b25800 20 add_watcher() i=4 2024-09-12T17:19:45.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.781+0000 7f9bc9b25800 20 add_watcher() i=5 2024-09-12T17:19:45.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.781+0000 7f9bc9b25800 20 add_watcher() i=6 2024-09-12T17:19:45.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.782+0000 7f9bc9b25800 20 add_watcher() i=7 2024-09-12T17:19:45.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.782+0000 7f9bc9b25800 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:45.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.784+0000 7f9a7bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:45.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.784+0000 7f9bc9b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:45.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.784+0000 7f9bc9b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:45.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.784+0000 7f9bc9b25800 5 note: GC not initialized 2024-09-12T17:19:45.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.784+0000 7f9a7afe5640 20 reqs_thread_entry: start 2024-09-12T17:19:45.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.784+0000 7f9bc9b25800 20 init_complete bucket index max shards: 1 2024-09-12T17:19:45.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.784+0000 7f9bc9b25800 20 Filter name: none 2024-09-12T17:19:45.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.785+0000 7f9a78fe1640 20 reqs_thread_entry: start 2024-09-12T17:19:45.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.785+0000 7f9bc9b25800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T17:19:45.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.785+0000 7f9bc9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.785+0000 7f9bc9b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.785+0000 7f9bc9b25800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-12T17:19:45.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.785+0000 7f9bc9b25800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:19:45.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.785+0000 7f9bc9b25800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-12T17:19:45.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.785+0000 7f9bc9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.785+0000 7f9bc9b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.785+0000 7f9bc9b25800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-12T17:19:45.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.785+0000 7f9bc9b25800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:19:45.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.785+0000 7f9bc9b25800 10 cache get: name=default.rgw.meta+users.keys+BIMIRUXGBRMSACGOZPNI : miss 2024-09-12T17:19:45.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.785+0000 7f9bc9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.786+0000 7f9bc9b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.786+0000 7f9bc9b25800 10 cache put: name=default.rgw.meta+users.keys+BIMIRUXGBRMSACGOZPNI info.flags=0x0 2024-09-12T17:19:45.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.786+0000 7f9bc9b25800 10 adding default.rgw.meta+users.keys+BIMIRUXGBRMSACGOZPNI to cache LRU end 2024-09-12T17:19:45.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.786+0000 7f9bc9b25800 10 cache get: name=default.rgw.meta+users.keys+BIMIRUXGBRMSACGOZPNI : hit (negative entry) 2024-09-12T17:19:45.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.786+0000 7f9bc9b25800 10 cache get: name=default.rgw.meta+users.keys+BIMIRUXGBRMSACGOZPNI : hit (negative entry) 2024-09-12T17:19:45.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.787+0000 7f9bc9b25800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T17:19:45.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.787+0000 7f9bc9b25800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:19:45.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.787+0000 7f9bc9b25800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T17:19:45.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.787+0000 7f9aa8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725901 cookie 94700123062944 notifier 5994 bl.length()=675 2024-09-12T17:19:45.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.787+0000 7f9aa8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T17:19:45.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.787+0000 7f9aa8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:19:45.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.790+0000 7f9bc9b25800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T17:19:45.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.790+0000 7f9bc9b25800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:19:45.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.790+0000 7f9bc9b25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T17:19:45.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.791+0000 7f9a97fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725909 cookie 94700123068784 notifier 5994 bl.length()=202 2024-09-12T17:19:45.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.791+0000 7f9a97fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T17:19:45.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.791+0000 7f9a97fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:19:45.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.793+0000 7f9bc9b25800 10 cache put: name=default.rgw.meta+users.keys+BIMIRUXGBRMSACGOZPNI info.flags=0x7 2024-09-12T17:19:45.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.793+0000 7f9bc9b25800 10 moving default.rgw.meta+users.keys+BIMIRUXGBRMSACGOZPNI to cache LRU end 2024-09-12T17:19:45.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.793+0000 7f9bc9b25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:BIMIRUXGBRMSACGOZPNI, ofs0, ns] 2024-09-12T17:19:45.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.793+0000 7f9a97fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725910 cookie 94700123068784 notifier 5994 bl.length()=190 2024-09-12T17:19:45.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.793+0000 7f9a97fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+BIMIRUXGBRMSACGOZPNI info.flags=0x7 2024-09-12T17:19:45.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.793+0000 7f9a97fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+BIMIRUXGBRMSACGOZPNI to cache LRU end 2024-09-12T17:19:45.796 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T17:19:45.796 INFO:teuthology.orchestra.run.smithi067.stdout: "user_id": "sysuser.client.0", 2024-09-12T17:19:45.796 INFO:teuthology.orchestra.run.smithi067.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-12T17:19:45.796 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-12T17:19:45.796 INFO:teuthology.orchestra.run.smithi067.stdout: "suspended": 0, 2024-09-12T17:19:45.796 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T17:19:45.796 INFO:teuthology.orchestra.run.smithi067.stdout: "subusers": [], 2024-09-12T17:19:45.796 INFO:teuthology.orchestra.run.smithi067.stdout: "keys": [ 2024-09-12T17:19:45.796 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-12T17:19:45.796 INFO:teuthology.orchestra.run.smithi067.stdout: "user": "sysuser.client.0", 2024-09-12T17:19:45.796 INFO:teuthology.orchestra.run.smithi067.stdout: "access_key": "BIMIRUXGBRMSACGOZPNI", 2024-09-12T17:19:45.796 INFO:teuthology.orchestra.run.smithi067.stdout: "secret_key": "ex3GCPt8HN6TV33w1uV1+BylXoDvHSu4uEnMQ13+38OUVmXGnXHvBQ==", 2024-09-12T17:19:45.797 INFO:teuthology.orchestra.run.smithi067.stdout: "active": true, 2024-09-12T17:19:45.797 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T17:19:45.786900Z" 2024-09-12T17:19:45.797 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-12T17:19:45.797 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-12T17:19:45.797 INFO:teuthology.orchestra.run.smithi067.stdout: "swift_keys": [], 2024-09-12T17:19:45.797 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": [], 2024-09-12T17:19:45.797 INFO:teuthology.orchestra.run.smithi067.stdout: "op_mask": "read, write, delete", 2024-09-12T17:19:45.797 INFO:teuthology.orchestra.run.smithi067.stdout: "system": true, 2024-09-12T17:19:45.797 INFO:teuthology.orchestra.run.smithi067.stdout: "default_placement": "", 2024-09-12T17:19:45.797 INFO:teuthology.orchestra.run.smithi067.stdout: "default_storage_class": "", 2024-09-12T17:19:45.797 INFO:teuthology.orchestra.run.smithi067.stdout: "placement_tags": [], 2024-09-12T17:19:45.797 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T17:19:45.797 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:19:45.798 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:19:45.798 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:19:45.798 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:19:45.798 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:19:45.798 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:19:45.798 INFO:teuthology.orchestra.run.smithi067.stdout: "user_quota": { 2024-09-12T17:19:45.798 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:19:45.798 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:19:45.798 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:19:45.798 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:19:45.798 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:19:45.798 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:19:45.798 INFO:teuthology.orchestra.run.smithi067.stdout: "temp_url_keys": [], 2024-09-12T17:19:45.798 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "rgw", 2024-09-12T17:19:45.798 INFO:teuthology.orchestra.run.smithi067.stdout: "mfa_ids": [], 2024-09-12T17:19:45.799 INFO:teuthology.orchestra.run.smithi067.stdout: "account_id": "", 2024-09-12T17:19:45.799 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-12T17:19:45.799 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T17:19:45.786886Z", 2024-09-12T17:19:45.799 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-12T17:19:45.799 INFO:teuthology.orchestra.run.smithi067.stdout: "group_ids": [] 2024-09-12T17:19:45.799 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T17:19:45.799 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:19:45.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.796+0000 7f9a7bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:45.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.798+0000 7f9bc9b25800 20 remove_watcher() i=0 2024-09-12T17:19:45.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.798+0000 7f9bc9b25800 2 removed watcher, disabling cache 2024-09-12T17:19:45.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.799+0000 7f9bc9b25800 20 remove_watcher() i=1 2024-09-12T17:19:45.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.800+0000 7f9bc9b25800 20 remove_watcher() i=2 2024-09-12T17:19:45.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.801+0000 7f9bc9b25800 20 remove_watcher() i=3 2024-09-12T17:19:45.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.802+0000 7f9bc9b25800 20 remove_watcher() i=4 2024-09-12T17:19:45.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.803+0000 7f9bc9b25800 20 remove_watcher() i=5 2024-09-12T17:19:45.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.804+0000 7f9bc9b25800 20 remove_watcher() i=6 2024-09-12T17:19:45.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:19:45.805+0000 7f9bc9b25800 20 remove_watcher() i=7 2024-09-12T17:19:45.818 INFO:tasks.ragweed:Configuring ragweed... 2024-09-12T17:19:45.819 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T17:19:45.819 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-12T17:19:45.848 INFO:tasks.ragweed:Configuring boto... 2024-09-12T17:19:45.849 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T17:19:45.849 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-12T17:19:45.919 DEBUG:teuthology.orchestra.run.smithi067:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-12T17:19:46.116 INFO:teuthology.orchestra.run.smithi067.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-12T17:19:46.284 INFO:teuthology.orchestra.run.smithi067.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-12T17:19:46.909 INFO:teuthology.orchestra.run.smithi067.stdout:py installdeps: -rrequirements.txt 2024-09-12T17:19:53.318 INFO:teuthology.orchestra.run.smithi067.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-12T17:19:56.896 INFO:teuthology.orchestra.run.smithi067.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2023.5.7,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-323/tmp/wheel/cockpit-323-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.2,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.34.0,gpg==1.15.1,greenlet==3.1.0,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.3.3,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=d738299a3067dbdb0dac32ffe3ed372e8dea124652381f1266a5ca1317aa3be0,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.12.2,urllib3==1.26.5,WebOb==1.8.8,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==7.0.3 2024-09-12T17:19:56.896 INFO:teuthology.orchestra.run.smithi067.stdout:py run-test-pre: PYTHONHASHSEED='3506194932' 2024-09-12T17:19:56.897 INFO:teuthology.orchestra.run.smithi067.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-12T17:19:57.105 INFO:teuthology.orchestra.run.smithi067.stdout:============================= test session starts ============================== 2024-09-12T17:19:57.105 INFO:teuthology.orchestra.run.smithi067.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-12T17:19:57.105 INFO:teuthology.orchestra.run.smithi067.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T17:19:57.105 INFO:teuthology.orchestra.run.smithi067.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:19:57.105 INFO:teuthology.orchestra.run.smithi067.stdout:configfile: pytest.ini 2024-09-12T17:19:57.206 INFO:teuthology.orchestra.run.smithi067.stdout:collecting ... collected 9 items 2024-09-12T17:19:57.206 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:20:02.973 INFO:teuthology.orchestra.run.smithi067.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-12T17:20:09.486 INFO:teuthology.orchestra.run.smithi067.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-12T17:20:15.322 INFO:teuthology.orchestra.run.smithi067.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-12T17:20:21.841 INFO:teuthology.orchestra.run.smithi067.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-12T17:20:28.249 INFO:teuthology.orchestra.run.smithi067.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-12T17:20:44.661 INFO:teuthology.orchestra.run.smithi067.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-12T17:20:57.538 INFO:teuthology.orchestra.run.smithi067.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-12T17:21:11.425 INFO:teuthology.orchestra.run.smithi067.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-12T17:21:38.594 INFO:teuthology.orchestra.run.smithi067.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-12T17:21:38.595 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:21:38.595 INFO:teuthology.orchestra.run.smithi067.stdout:=============================== warnings summary =============================== 2024-09-12T17:21:38.595 INFO:teuthology.orchestra.run.smithi067.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-12T17:21:38.596 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-12T17:21:38.596 INFO:teuthology.orchestra.run.smithi067.stdout: import imp 2024-09-12T17:21:38.596 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:21:38.596 INFO:teuthology.orchestra.run.smithi067.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T17:21:38.596 INFO:teuthology.orchestra.run.smithi067.stdout:=================== 9 passed, 1 warning in 101.49s (0:01:41) =================== 2024-09-12T17:21:38.626 INFO:teuthology.orchestra.run.smithi067.stdout:___________________________________ summary ____________________________________ 2024-09-12T17:21:38.627 INFO:teuthology.orchestra.run.smithi067.stdout: py: commands succeeded 2024-09-12T17:21:38.627 INFO:teuthology.orchestra.run.smithi067.stdout: congratulations :) 2024-09-12T17:21:38.645 INFO:tasks.ragweed:Cleaning up boto... 2024-09-12T17:21:38.646 DEBUG:teuthology.orchestra.run.smithi067:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-12T17:21:38.676 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-12T17:21:38.774 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:38.774 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:38.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.809+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.811+0000 7f5ebeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:38.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.811+0000 7f5ebeb26800 20 realm 2024-09-12T17:21:38.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.811+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.811+0000 7f5ebeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:38.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.811+0000 7f5ebeb26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:38.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.811+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.811+0000 7f5ebeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:38.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.811+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.812+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:38.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.812+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.813+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:38.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.813+0000 7f5ebeb26800 20 searching for the correct realm 2024-09-12T17:21:38.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.816+0000 7f5eb9f08640 0 -- 172.21.15.67:0/1576355898 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x563def5d1710 msgr2=0x563def5d3b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:21:38.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.820+0000 7f5eb9f08640 0 -- 172.21.15.67:0/1576355898 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x7f5d84086290 msgr2=0x7f5d840886c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:38.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.824+0000 7f5ebeb26800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:21:38.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.824+0000 7f5ebeb26800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:21:38.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.824+0000 7f5ebeb26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:38.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.824+0000 7f5ebeb26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:38.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.824+0000 7f5ebeb26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:38.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.824+0000 7f5ebeb26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:38.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.824+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.824+0000 7f5ebeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:38.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.824+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.824+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:38.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.824+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.825+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:38.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.825+0000 7f5ebeb26800 20 zone default found 2024-09-12T17:21:38.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.825+0000 7f5ebeb26800 4 Realm: () 2024-09-12T17:21:38.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.825+0000 7f5ebeb26800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:21:38.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.825+0000 7f5ebeb26800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:21:38.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.825+0000 7f5ebeb26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:38.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.825+0000 7f5ebeb26800 20 zonegroup default 2024-09-12T17:21:38.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.825+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.825+0000 7f5ebeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:38.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.825+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.825+0000 7f5ebeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:38.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.825+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.826+0000 7f5ebeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:38.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.826+0000 7f5ebeb26800 20 started sync module instance, tier type = 2024-09-12T17:21:38.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.826+0000 7f5ebeb26800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:21:38.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.835+0000 7f5ebeb26800 20 add_watcher() i=0 2024-09-12T17:21:38.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.835+0000 7f5ebeb26800 20 add_watcher() i=1 2024-09-12T17:21:38.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.835+0000 7f5ebeb26800 20 add_watcher() i=2 2024-09-12T17:21:38.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.835+0000 7f5ebeb26800 20 add_watcher() i=3 2024-09-12T17:21:38.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.835+0000 7f5ebeb26800 20 add_watcher() i=4 2024-09-12T17:21:38.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.835+0000 7f5ebeb26800 20 add_watcher() i=5 2024-09-12T17:21:38.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.836+0000 7f5ebeb26800 20 add_watcher() i=6 2024-09-12T17:21:38.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.836+0000 7f5ebeb26800 20 add_watcher() i=7 2024-09-12T17:21:38.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.836+0000 7f5ebeb26800 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:38.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.838+0000 7f5d70fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:38.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.838+0000 7f5ebeb26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:38.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.838+0000 7f5ebeb26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:38.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.873+0000 7f5ceb7fe640 20 reqs_thread_entry: start 2024-09-12T17:21:38.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.873+0000 7f5ebeb26800 20 init_complete bucket index max shards: 1 2024-09-12T17:21:38.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.873+0000 7f5ebeb26800 20 Filter name: none 2024-09-12T17:21:38.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.873+0000 7f5ce97fa640 20 reqs_thread_entry: start 2024-09-12T17:21:38.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.873+0000 7f5ebeb26800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T17:21:38.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.873+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.874+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T17:21:38.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.874+0000 7f5ebeb26800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-12T17:21:38.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.874+0000 7f5ebeb26800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:21:38.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.874+0000 7f5ebeb26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:38.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.875+0000 7f5ebeb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:06eb12d0-49d6-461d-9efe-05d212954deb.4538.5 : miss 2024-09-12T17:21:38.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.875+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.875+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=426 2024-09-12T17:21:38.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.875+0000 7f5ebeb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:06eb12d0-49d6-461d-9efe-05d212954deb.4538.5 info.flags=0x17 2024-09-12T17:21:38.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.875+0000 7f5ebeb26800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:06eb12d0-49d6-461d-9efe-05d212954deb.4538.5 to cache LRU end 2024-09-12T17:21:38.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.875+0000 7f5ebeb26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:38.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.875+0000 7f5ebeb26800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:21:38.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.875+0000 7f5ebeb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:06eb12d0-49d6-461d-9efe-05d212954deb.4538.5 2024-09-12T17:21:38.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.876+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-12T17:21:38.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.876+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-12T17:21:38.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.876+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-12T17:21:38.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.876+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-12T17:21:38.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.876+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-12T17:21:38.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.876+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-12T17:21:38.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.876+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-12T17:21:38.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.876+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-12T17:21:38.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.876+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-12T17:21:38.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.876+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def57b8f0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x563def61c2d8 s->prefetch_data=0 2024-09-12T17:21:38.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.876+0000 7f5ebeb26800 10 manifest: total_size = 7536 2024-09-12T17:21:38.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.876+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.14078759340189364716 2024-09-12T17:21:38.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.876+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def57b8f0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x563def61c2d8 s->prefetch_data=0 2024-09-12T17:21:38.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.876+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def61c2d8 2024-09-12T17:21:38.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.876+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.5.0 2024-09-12T17:21:38.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.879+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:38.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.879+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=7536 stripe_ofs=7536 part_ofs=0 rule->part_size=0 2024-09-12T17:21:38.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.879+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.14078759340189364716 2024-09-12T17:21:38.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.879+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:38.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.879+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.5__shadow_.hp_8d2_BQaDMUJMh2p-FelBwk5dgV9Q_0 2024-09-12T17:21:38.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.879+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:21:38.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.879+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:38.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.879+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.14078759340189364716 2024-09-12T17:21:38.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.880+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-12T17:21:38.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.881+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def57b8f0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x563def61bdc8 s->prefetch_data=0 2024-09-12T17:21:38.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.881+0000 7f5ebeb26800 10 manifest: total_size = 13126 2024-09-12T17:21:38.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.881+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.7571368694782825030 2024-09-12T17:21:38.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.881+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def57b8f0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x563def61bdc8 s->prefetch_data=0 2024-09-12T17:21:38.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.881+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def61bdc8 2024-09-12T17:21:38.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.881+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.5.0 2024-09-12T17:21:38.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.883+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:38.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.883+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=13126 stripe_ofs=13126 part_ofs=0 rule->part_size=0 2024-09-12T17:21:38.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.883+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.7571368694782825030 2024-09-12T17:21:38.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.883+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:38.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.883+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.5__shadow_.SwLyaE3YTbAJNwdkPU-7qpvH1qq5MiI_0 2024-09-12T17:21:38.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.883+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:21:38.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.883+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:38.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.883+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.7571368694782825030 2024-09-12T17:21:38.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.884+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-12T17:21:38.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.884+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def57b8f0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x563def61bdc8 s->prefetch_data=0 2024-09-12T17:21:38.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.885+0000 7f5ebeb26800 10 manifest: total_size = 12850 2024-09-12T17:21:38.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.885+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.12353947726874420310 2024-09-12T17:21:38.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.885+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def57b8f0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x563def61bdc8 s->prefetch_data=0 2024-09-12T17:21:38.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.885+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def61bdc8 2024-09-12T17:21:38.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.885+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.5.0 2024-09-12T17:21:38.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.887+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:38.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.887+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=12850 stripe_ofs=12850 part_ofs=0 rule->part_size=0 2024-09-12T17:21:38.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.887+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.12353947726874420310 2024-09-12T17:21:38.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.887+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:38.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.887+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.5__shadow_.zAi345jSM3l3ZRonTiATIImaaq5aWDB_0 2024-09-12T17:21:38.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.887+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:21:38.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.887+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:38.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.887+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.12353947726874420310 2024-09-12T17:21:38.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.888+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-12T17:21:38.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.888+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def57b8f0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x563def61bdc8 s->prefetch_data=0 2024-09-12T17:21:38.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.889+0000 7f5ebeb26800 10 manifest: total_size = 4904 2024-09-12T17:21:38.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.889+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.8358822059443764384 2024-09-12T17:21:38.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.889+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def57b8f0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x563def61bdc8 s->prefetch_data=0 2024-09-12T17:21:38.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.889+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def61bdc8 2024-09-12T17:21:38.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.889+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.5.0 2024-09-12T17:21:38.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.891+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:38.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.891+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=4904 stripe_ofs=4904 part_ofs=0 rule->part_size=0 2024-09-12T17:21:38.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.891+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.8358822059443764384 2024-09-12T17:21:38.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.891+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:38.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.891+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.5__shadow_.bl94px17WIxwxJG6jQO7lIhyylxMmUn_0 2024-09-12T17:21:38.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.891+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:21:38.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.891+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:38.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.891+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.8358822059443764384 2024-09-12T17:21:38.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.892+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-12T17:21:38.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.892+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def57b8f0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x563def61bdc8 s->prefetch_data=0 2024-09-12T17:21:38.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.893+0000 7f5ebeb26800 10 manifest: total_size = 4979 2024-09-12T17:21:38.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.893+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.1146327100339792596 2024-09-12T17:21:38.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.893+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def57b8f0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x563def61bdc8 s->prefetch_data=0 2024-09-12T17:21:38.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.893+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def61bdc8 2024-09-12T17:21:38.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.893+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.5.0 2024-09-12T17:21:38.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.895+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:38.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.895+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=4979 stripe_ofs=4979 part_ofs=0 rule->part_size=0 2024-09-12T17:21:38.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.895+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.1146327100339792596 2024-09-12T17:21:38.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.895+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:38.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.895+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.5__shadow_.o2TDqNbg4lKcUtIh9RinIdFju8slNOY_0 2024-09-12T17:21:38.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.895+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:21:38.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.895+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:38.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.895+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.1146327100339792596 2024-09-12T17:21:38.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.896+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def57b8f0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x563def61bdc8 s->prefetch_data=0 2024-09-12T17:21:38.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.896+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-12T17:21:38.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.896+0000 7f5ebeb26800 10 manifest: total_size = 7760 2024-09-12T17:21:38.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.896+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.10568266353538217322 2024-09-12T17:21:38.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.896+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def57b8f0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x563def61bdc8 s->prefetch_data=0 2024-09-12T17:21:38.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.896+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def61bdc8 2024-09-12T17:21:38.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.896+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.5.0 2024-09-12T17:21:38.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.899+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:38.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.899+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=7760 stripe_ofs=7760 part_ofs=0 rule->part_size=0 2024-09-12T17:21:38.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.899+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.10568266353538217322 2024-09-12T17:21:38.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.899+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:38.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.899+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.5__shadow_.frRcT0P0WU5W5u3GERP34ZsLMk6afn4_0 2024-09-12T17:21:38.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.899+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:21:38.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.899+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:38.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.899+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.10568266353538217322 2024-09-12T17:21:38.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.900+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-12T17:21:38.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.900+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def57b8f0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x563def61bdc8 s->prefetch_data=0 2024-09-12T17:21:38.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.901+0000 7f5ebeb26800 10 manifest: total_size = 7911 2024-09-12T17:21:38.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.901+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16180116736702014313 2024-09-12T17:21:38.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.901+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def57b8f0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x563def61bdc8 s->prefetch_data=0 2024-09-12T17:21:38.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.901+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def61bdc8 2024-09-12T17:21:38.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.901+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.5.0 2024-09-12T17:21:38.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.903+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:38.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.903+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=7911 stripe_ofs=7911 part_ofs=0 rule->part_size=0 2024-09-12T17:21:38.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.903+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16180116736702014313 2024-09-12T17:21:38.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.903+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:38.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.903+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.5__shadow_.w58Fl_fUOh-bK7y3PtxzceHsNI6Rrly_0 2024-09-12T17:21:38.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.903+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:21:38.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.903+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:38.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.903+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16180116736702014313 2024-09-12T17:21:38.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.904+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-12T17:21:38.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.904+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def57b8f0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x563def61bdc8 s->prefetch_data=0 2024-09-12T17:21:38.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.904+0000 7f5ebeb26800 10 manifest: total_size = 7823 2024-09-12T17:21:38.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.904+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.12710931449551971063 2024-09-12T17:21:38.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.904+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def57b8f0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x563def61bdc8 s->prefetch_data=0 2024-09-12T17:21:38.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.904+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def61bdc8 2024-09-12T17:21:38.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.904+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.5.0 2024-09-12T17:21:38.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.906+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:38.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.906+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=7823 stripe_ofs=7823 part_ofs=0 rule->part_size=0 2024-09-12T17:21:38.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.906+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.12710931449551971063 2024-09-12T17:21:38.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.906+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:38.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.906+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.5__shadow_.9D63AGlBQsvRkuzg4Ps3jyfg-OJ_orP_0 2024-09-12T17:21:38.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.906+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:21:38.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.906+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:38.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.906+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.12710931449551971063 2024-09-12T17:21:38.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.907+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-12T17:21:38.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.908+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def61aeb0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x563def61bdc8 s->prefetch_data=0 2024-09-12T17:21:38.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.908+0000 7f5ebeb26800 10 manifest: total_size = 8747 2024-09-12T17:21:38.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.908+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.18260169930131899203 2024-09-12T17:21:38.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.908+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def61aeb0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x563def61bdc8 s->prefetch_data=0 2024-09-12T17:21:38.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.908+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def61bdc8 2024-09-12T17:21:38.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.908+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.5.0 2024-09-12T17:21:38.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.910+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:38.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.910+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=8747 stripe_ofs=8747 part_ofs=0 rule->part_size=0 2024-09-12T17:21:38.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.910+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.18260169930131899203 2024-09-12T17:21:38.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.910+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:38.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.910+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.5__shadow_.q8HUnbilUsAvKTSpo7eFDUZiXDxY2YY_0 2024-09-12T17:21:38.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.910+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:21:38.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.910+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:38.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.910+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.18260169930131899203 2024-09-12T17:21:38.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.911+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-12T17:21:38.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.911+0000 7f5ebeb26800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:21:38.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.911+0000 7f5ebeb26800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:21:38.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.912+0000 7f5ebeb26800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:21:38.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.912+0000 7f5ebeb26800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:21:38.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.912+0000 7f5ebeb26800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:21:38.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.912+0000 7f5ebeb26800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:21:38.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.912+0000 7f5ebeb26800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[06eb12d0-49d6-461d-9efe-05d212954deb.4538.5])"; uploads.size()=0; is_truncated=0 2024-09-12T17:21:38.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.913+0000 7f5ebeb26800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-12T17:21:38.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.913+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.913+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=204 2024-09-12T17:21:38.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.913+0000 7f5ebeb26800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-12T17:21:38.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.913+0000 7f5ebeb26800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-12T17:21:38.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.915+0000 7f5ebeb26800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-12T17:21:38.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.915+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-12T17:21:38.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.915+0000 7f5d9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464287 cookie 94824008854832 notifier 6021 bl.length()=162 2024-09-12T17:21:38.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.918+0000 7f5ebeb26800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:06eb12d0-49d6-461d-9efe-05d212954deb.4538.5 from cache 2024-09-12T17:21:38.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.918+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:06eb12d0-49d6-461d-9efe-05d212954deb.4538.5, ofs0, ns] 2024-09-12T17:21:38.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.918+0000 7f5d9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464320 cookie 94824008898000 notifier 6021 bl.length()=219 2024-09-12T17:21:38.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.921+0000 7f5ebeb26800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/06eb12d0-49d6-461d-9efe-05d212954deb.4538.5 : miss 2024-09-12T17:21:38.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.921+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.921+0000 7f5ebeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:38.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.921+0000 7f5ebeb26800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/06eb12d0-49d6-461d-9efe-05d212954deb.4538.5 info.flags=0x0 2024-09-12T17:21:38.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.921+0000 7f5ebeb26800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/06eb12d0-49d6-461d-9efe-05d212954deb.4538.5 to cache LRU end 2024-09-12T17:21:38.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.923+0000 7f5ebeb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.12 : miss 2024-09-12T17:21:38.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.923+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.924+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=457 2024-09-12T17:21:38.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.924+0000 7f5ebeb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.12 info.flags=0x17 2024-09-12T17:21:38.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.924+0000 7f5ebeb26800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.12 to cache LRU end 2024-09-12T17:21:38.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.924+0000 7f5ebeb26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:38.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.924+0000 7f5ebeb26800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:21:38.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.924+0000 7f5ebeb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.12 2024-09-12T17:21:38.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.924+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo 2024-09-12T17:21:38.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.924+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def61b230 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x563def61b888 s->prefetch_data=0 2024-09-12T17:21:38.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.925+0000 7f5ebeb26800 10 manifest: total_size = 74198 2024-09-12T17:21:38.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.925+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.14265406155182615544 2024-09-12T17:21:38.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.925+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def61b230 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x563def61b888 s->prefetch_data=0 2024-09-12T17:21:38.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.925+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def61b888 2024-09-12T17:21:38.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.925+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.12.0 2024-09-12T17:21:38.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.927+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:21:38.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.927+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-09-12T17:21:38.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.927+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T17:21:38.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.927+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:21:38.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.927+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-09-12T17:21:38.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.927+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-12T17:21:38.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.927+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:21:38.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.927+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2024-09-12T17:21:38.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.927+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-12T17:21:38.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.927+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-12T17:21:38.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.927+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2024-09-12T17:21:38.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.927+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-12T17:21:38.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.927+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.14265406155182615544 2024-09-12T17:21:38.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.927+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:38.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.927+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.12__multipart_foo.2~COH-AgqMNLSpxCems3bIXdRTLeIhuTf.1 2024-09-12T17:21:38.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.927+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T17:21:38.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.927+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.12__multipart_foo.2~COH-AgqMNLSpxCems3bIXdRTLeIhuTf.2 2024-09-12T17:21:38.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.927+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T17:21:38.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.927+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.12__multipart_foo.2~COH-AgqMNLSpxCems3bIXdRTLeIhuTf.3 2024-09-12T17:21:38.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.927+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T17:21:38.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.927+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.12__multipart_foo.2~COH-AgqMNLSpxCems3bIXdRTLeIhuTf.4 2024-09-12T17:21:38.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.927+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T17:21:38.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.927+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:38.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.927+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.14265406155182615544 2024-09-12T17:21:38.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.928+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:21:38.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.929+0000 7f5ebeb26800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:21:38.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.929+0000 7f5ebeb26800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:21:38.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.929+0000 7f5ebeb26800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:21:38.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.929+0000 7f5ebeb26800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:21:38.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.929+0000 7f5ebeb26800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:21:38.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.929+0000 7f5ebeb26800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:21:38.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.929+0000 7f5ebeb26800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[06eb12d0-49d6-461d-9efe-05d212954deb.4538.12])"; uploads.size()=0; is_truncated=0 2024-09-12T17:21:38.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.930+0000 7f5ebeb26800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-12T17:21:38.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.930+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.931+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=235 2024-09-12T17:21:38.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.931+0000 7f5ebeb26800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-12T17:21:38.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.931+0000 7f5ebeb26800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-12T17:21:38.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.932+0000 7f5ebeb26800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-12T17:21:38.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.932+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-12T17:21:38.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.932+0000 7f5d9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464308 cookie 94824008857040 notifier 6021 bl.length()=191 2024-09-12T17:21:38.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.935+0000 7f5ebeb26800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.12 from cache 2024-09-12T17:21:38.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.935+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.12, ofs0, ns] 2024-09-12T17:21:38.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.936+0000 7f5d9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464309 cookie 94824008857040 notifier 6021 bl.length()=249 2024-09-12T17:21:38.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.939+0000 7f5ebeb26800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.12 : miss 2024-09-12T17:21:38.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.939+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.939+0000 7f5ebeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:38.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.939+0000 7f5ebeb26800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.12 info.flags=0x0 2024-09-12T17:21:38.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.939+0000 7f5ebeb26800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.12 to cache LRU end 2024-09-12T17:21:38.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.941+0000 7f5ebeb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.13 : miss 2024-09-12T17:21:38.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.941+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.942+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=464 2024-09-12T17:21:38.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.942+0000 7f5ebeb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.13 info.flags=0x17 2024-09-12T17:21:38.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.942+0000 7f5ebeb26800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.13 to cache LRU end 2024-09-12T17:21:38.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.942+0000 7f5ebeb26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:38.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.942+0000 7f5ebeb26800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:21:38.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.942+0000 7f5ebeb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.13 2024-09-12T17:21:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.942+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo 2024-09-12T17:21:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.942+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def61cb30 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x563def61b888 s->prefetch_data=0 2024-09-12T17:21:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.943+0000 7f5ebeb26800 10 manifest: total_size = 74198 2024-09-12T17:21:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.943+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.3513701217035585720 2024-09-12T17:21:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.943+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def61cb30 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x563def61b888 s->prefetch_data=0 2024-09-12T17:21:38.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.943+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def61b888 2024-09-12T17:21:38.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.943+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.13.0 2024-09-12T17:21:38.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.945+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:21:38.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.945+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-09-12T17:21:38.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.945+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T17:21:38.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.945+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:21:38.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.945+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-09-12T17:21:38.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.945+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-12T17:21:38.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.945+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:21:38.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.945+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2024-09-12T17:21:38.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.945+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-12T17:21:38.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.945+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-12T17:21:38.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.945+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2024-09-12T17:21:38.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.945+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-12T17:21:38.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.945+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.3513701217035585720 2024-09-12T17:21:38.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.945+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:38.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.945+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.13__multipart_foo.2~3uT7PR6jja9bETIaYdYkUy0lP8VEyhp.1 2024-09-12T17:21:38.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.945+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T17:21:38.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.945+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.13__multipart_foo.2~3uT7PR6jja9bETIaYdYkUy0lP8VEyhp.2 2024-09-12T17:21:38.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.945+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T17:21:38.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.945+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.13__multipart_foo.2~3uT7PR6jja9bETIaYdYkUy0lP8VEyhp.3 2024-09-12T17:21:38.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.945+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T17:21:38.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.945+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.13__multipart_foo.2~3uT7PR6jja9bETIaYdYkUy0lP8VEyhp.4 2024-09-12T17:21:38.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.945+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T17:21:38.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.945+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:38.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.945+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.3513701217035585720 2024-09-12T17:21:38.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.946+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:21:38.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.946+0000 7f5ebeb26800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:21:38.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.946+0000 7f5ebeb26800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:21:38.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.947+0000 7f5ebeb26800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:21:38.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.947+0000 7f5ebeb26800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:21:38.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.947+0000 7f5ebeb26800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:21:38.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.947+0000 7f5ebeb26800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:21:38.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.947+0000 7f5ebeb26800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[06eb12d0-49d6-461d-9efe-05d212954deb.4538.13])"; uploads.size()=0; is_truncated=0 2024-09-12T17:21:38.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.948+0000 7f5ebeb26800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-12T17:21:38.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.948+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.949+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=242 2024-09-12T17:21:38.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.949+0000 7f5ebeb26800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-12T17:21:38.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.949+0000 7f5ebeb26800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-12T17:21:38.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.950+0000 7f5ebeb26800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-12T17:21:38.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.950+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-12T17:21:38.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.950+0000 7f5d9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464275 cookie 94824008885328 notifier 6021 bl.length()=198 2024-09-12T17:21:38.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.953+0000 7f5ebeb26800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.13 from cache 2024-09-12T17:21:38.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.953+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.13, ofs0, ns] 2024-09-12T17:21:38.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.953+0000 7f5d9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464321 cookie 94824008895952 notifier 6021 bl.length()=256 2024-09-12T17:21:38.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.955+0000 7f5ebeb26800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.13 : miss 2024-09-12T17:21:38.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.955+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.956+0000 7f5ebeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:38.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.956+0000 7f5ebeb26800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.13 info.flags=0x0 2024-09-12T17:21:38.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.956+0000 7f5ebeb26800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.13 to cache LRU end 2024-09-12T17:21:38.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.958+0000 7f5ebeb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.11 : miss 2024-09-12T17:21:38.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.958+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.958+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=459 2024-09-12T17:21:38.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.958+0000 7f5ebeb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.11 info.flags=0x17 2024-09-12T17:21:38.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.958+0000 7f5ebeb26800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.11 to cache LRU end 2024-09-12T17:21:38.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.958+0000 7f5ebeb26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:38.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.958+0000 7f5ebeb26800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:21:38.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.958+0000 7f5ebeb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.11 2024-09-12T17:21:38.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.959+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo[vzxcHy80CivtWNAav8-Pusrr1Kq3tfF] 2024-09-12T17:21:38.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.959+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.11.0 2024-09-12T17:21:38.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.959+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def5a7e50 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x563def61bdc8 s->prefetch_data=0 2024-09-12T17:21:38.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.960+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to yh11gbcn3jywqgw6v27floyfj1heriih 2024-09-12T17:21:38.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.960+0000 7f5ebeb26800 20 get_obj_state_impl: setting s->olh_tag to c0mxmzcha2dvtkf3xy02urbuaxg2zogb 2024-09-12T17:21:38.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.960+0000 7f5ebeb26800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=c0mxmzcha2dvtkf3xy02urbuaxg2zogb 2024-09-12T17:21:38.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.961+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.11.0 2024-09-12T17:21:38.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.962+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.11.0 2024-09-12T17:21:38.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.962+0000 7f5ebeb26800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-12T17:21:38.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.962+0000 7f5ebeb26800 20 olh_log_entry: epoch=3 op=3 key=foo[vzxcHy80CivtWNAav8-Pusrr1Kq3tfF] 2024-09-12T17:21:38.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.962+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def5a7e50 obj=test-client.0-r-test-multipart-index-versioning.1:_:vzxcHy80CivtWNAav8-Pusrr1Kq3tfF_foo state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:38.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.963+0000 7f5ebeb26800 10 manifest: total_size = 26085 2024-09-12T17:21:38.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.963+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.6469624487687717157 2024-09-12T17:21:38.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.963+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def5a7e50 obj=test-client.0-r-test-multipart-index-versioning.1:_:vzxcHy80CivtWNAav8-Pusrr1Kq3tfF_foo state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:38.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.963+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6341c8 2024-09-12T17:21:38.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.963+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.11.0 2024-09-12T17:21:38.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.965+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=4 2024-09-12T17:21:38.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.965+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7672 2024-09-12T17:21:38.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.965+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7674 2024-09-12T17:21:38.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.965+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=7674 rules.size()=4 2024-09-12T17:21:38.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.965+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4201976 part_ofs=7672 rule->part_size=7674 2024-09-12T17:21:38.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.965+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=15346 stripe_ofs=15346 part_ofs=15346 rule->part_size=7672 2024-09-12T17:21:38.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.965+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=4 2024-09-12T17:21:38.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.965+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4209650 part_ofs=15346 rule->part_size=7672 2024-09-12T17:21:38.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.965+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=23018 stripe_ofs=23018 part_ofs=23018 rule->part_size=3067 2024-09-12T17:21:38.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.965+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2024-09-12T17:21:38.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.965+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4217322 part_ofs=23018 rule->part_size=3067 2024-09-12T17:21:38.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.965+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=26085 stripe_ofs=26085 part_ofs=26085 rule->part_size=3067 2024-09-12T17:21:38.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.965+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.6469624487687717157 2024-09-12T17:21:38.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.965+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:38.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.965+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.11__multipart_foo.2~0q9CtjnYQ9FGhYAolgUkwrKYzY3VLL6.1 2024-09-12T17:21:38.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.965+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T17:21:38.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.965+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.11__multipart_foo.2~0q9CtjnYQ9FGhYAolgUkwrKYzY3VLL6.2 2024-09-12T17:21:38.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.965+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T17:21:38.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.965+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.11__multipart_foo.2~0q9CtjnYQ9FGhYAolgUkwrKYzY3VLL6.3 2024-09-12T17:21:38.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.965+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T17:21:38.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.965+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.11__multipart_foo.2~0q9CtjnYQ9FGhYAolgUkwrKYzY3VLL6.4 2024-09-12T17:21:38.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.965+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T17:21:38.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.965+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:38.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.965+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.6469624487687717157 2024-09-12T17:21:38.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.966+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=foo[vzxcHy80CivtWNAav8-Pusrr1Kq3tfF] 2024-09-12T17:21:38.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.967+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def5a7e50 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x563def61bdc8 s->prefetch_data=0 2024-09-12T17:21:38.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.968+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.11.0 2024-09-12T17:21:38.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.969+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.11.0 2024-09-12T17:21:38.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.969+0000 7f5ebeb26800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:21:38.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.969+0000 7f5ebeb26800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:21:38.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.970+0000 7f5ebeb26800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:21:38.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.970+0000 7f5ebeb26800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:21:38.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.970+0000 7f5ebeb26800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:21:38.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.970+0000 7f5ebeb26800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:21:38.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.970+0000 7f5ebeb26800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[06eb12d0-49d6-461d-9efe-05d212954deb.4538.11])"; uploads.size()=0; is_truncated=0 2024-09-12T17:21:38.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.971+0000 7f5ebeb26800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-12T17:21:38.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.971+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.971+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=237 2024-09-12T17:21:38.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.971+0000 7f5ebeb26800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-12T17:21:38.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.971+0000 7f5ebeb26800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-12T17:21:38.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.973+0000 7f5ebeb26800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-12T17:21:38.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.973+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-12T17:21:38.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.973+0000 7f5d9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464276 cookie 94824008885328 notifier 6021 bl.length()=193 2024-09-12T17:21:38.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.975+0000 7f5ebeb26800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.11 from cache 2024-09-12T17:21:38.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.975+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.11, ofs0, ns] 2024-09-12T17:21:38.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.976+0000 7f5d9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464288 cookie 94824008891024 notifier 6021 bl.length()=251 2024-09-12T17:21:38.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.978+0000 7f5ebeb26800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.11 : miss 2024-09-12T17:21:38.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.978+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.978+0000 7f5ebeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:38.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.978+0000 7f5ebeb26800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.11 info.flags=0x0 2024-09-12T17:21:38.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.978+0000 7f5ebeb26800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.11 to cache LRU end 2024-09-12T17:21:38.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.980+0000 7f5ebeb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.10 : miss 2024-09-12T17:21:38.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.980+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.981+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=449 2024-09-12T17:21:38.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.981+0000 7f5ebeb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.10 info.flags=0x17 2024-09-12T17:21:38.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.981+0000 7f5ebeb26800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.10 to cache LRU end 2024-09-12T17:21:38.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.981+0000 7f5ebeb26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:38.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.981+0000 7f5ebeb26800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:21:38.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.981+0000 7f5ebeb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.10 2024-09-12T17:21:38.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.981+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo 2024-09-12T17:21:38.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.981+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eac08d0d0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:38.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.982+0000 7f5ebeb26800 10 manifest: total_size = 74198 2024-09-12T17:21:38.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.982+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.14298556348724947443 2024-09-12T17:21:38.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.982+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eac08d0d0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:38.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.982+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6341c8 2024-09-12T17:21:38.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.982+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.10.0 2024-09-12T17:21:38.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.984+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:21:38.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.984+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-09-12T17:21:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.984+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T17:21:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.984+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:21:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.984+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-09-12T17:21:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.984+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-12T17:21:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.984+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:21:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.984+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2024-09-12T17:21:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.984+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-12T17:21:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.984+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-12T17:21:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.984+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2024-09-12T17:21:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.984+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-12T17:21:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.984+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.14298556348724947443 2024-09-12T17:21:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.984+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.984+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.10__multipart_foo.2~QJbCa73kDKfBikYhGIAFNfZnDyG_sR_.1 2024-09-12T17:21:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.984+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T17:21:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.984+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.10__multipart_foo.2~QJbCa73kDKfBikYhGIAFNfZnDyG_sR_.2 2024-09-12T17:21:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.984+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T17:21:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.984+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.10__multipart_foo.2~QJbCa73kDKfBikYhGIAFNfZnDyG_sR_.3 2024-09-12T17:21:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.984+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T17:21:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.984+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.10__multipart_foo.2~QJbCa73kDKfBikYhGIAFNfZnDyG_sR_.4 2024-09-12T17:21:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.984+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T17:21:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.984+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.984+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.14298556348724947443 2024-09-12T17:21:38.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.985+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:21:38.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.985+0000 7f5ebeb26800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:21:38.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.985+0000 7f5ebeb26800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:21:38.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.986+0000 7f5ebeb26800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:21:38.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.986+0000 7f5ebeb26800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:21:38.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.986+0000 7f5ebeb26800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:21:38.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.986+0000 7f5ebeb26800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:21:38.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.986+0000 7f5ebeb26800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[06eb12d0-49d6-461d-9efe-05d212954deb.4538.10])"; uploads.size()=0; is_truncated=0 2024-09-12T17:21:38.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.987+0000 7f5ebeb26800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-12T17:21:38.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.987+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.988+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=227 2024-09-12T17:21:38.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.988+0000 7f5ebeb26800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-12T17:21:38.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.988+0000 7f5ebeb26800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-12T17:21:38.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.989+0000 7f5ebeb26800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-12T17:21:38.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.989+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-12T17:21:38.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.989+0000 7f5d9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464289 cookie 94824008891024 notifier 6021 bl.length()=183 2024-09-12T17:21:38.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.991+0000 7f5ebeb26800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.10 from cache 2024-09-12T17:21:38.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.991+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.10, ofs0, ns] 2024-09-12T17:21:38.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.992+0000 7f5d9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464277 cookie 94824008885328 notifier 6021 bl.length()=241 2024-09-12T17:21:38.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.994+0000 7f5ebeb26800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.10 : miss 2024-09-12T17:21:38.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.994+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.995+0000 7f5ebeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:38.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.995+0000 7f5ebeb26800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.10 info.flags=0x0 2024-09-12T17:21:38.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.995+0000 7f5ebeb26800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.10 to cache LRU end 2024-09-12T17:21:38.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.997+0000 7f5ebeb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.16 : miss 2024-09-12T17:21:38.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.997+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.997+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:21:39.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.997+0000 7f5ebeb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.16 info.flags=0x17 2024-09-12T17:21:39.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.997+0000 7f5ebeb26800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.16 to cache LRU end 2024-09-12T17:21:39.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.997+0000 7f5ebeb26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:39.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.997+0000 7f5ebeb26800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:21:39.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.997+0000 7f5ebeb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.16 2024-09-12T17:21:39.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.998+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:21:39.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.998+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T17:21:39.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.998+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T17:21:39.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.998+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T17:21:39.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.998+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:21:39.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.998+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T17:21:39.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.998+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T17:21:39.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.998+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T17:21:39.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.998+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:21:39.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.998+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T17:21:39.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.998+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T17:21:39.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.998+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T17:21:39.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.998+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def5e3be0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.999+0000 7f5ebeb26800 10 manifest: total_size = 5242880 2024-09-12T17:21:39.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.999+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.7107984525956833556 2024-09-12T17:21:39.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.999+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def5e3be0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.999+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6341c8 2024-09-12T17:21:39.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:38.999+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.16.0 2024-09-12T17:21:39.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.001+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.001+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.001+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.001+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.001+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.7107984525956833556 2024-09-12T17:21:39.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.001+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.001+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.YjmrgmKyJ-l4TIFUplGbZ7H4PQr4xZH_0 2024-09-12T17:21:39.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.001+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T17:21:39.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.001+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.YjmrgmKyJ-l4TIFUplGbZ7H4PQr4xZH_1 2024-09-12T17:21:39.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.001+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-12T17:21:39.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.001+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.001+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.7107984525956833556 2024-09-12T17:21:39.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.002+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:21:39.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.003+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def5e3be0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.003+0000 7f5ebeb26800 10 manifest: total_size = 5242880 2024-09-12T17:21:39.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.003+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17604950578775388228 2024-09-12T17:21:39.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.003+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def5e3be0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.003+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6341c8 2024-09-12T17:21:39.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.003+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.16.0 2024-09-12T17:21:39.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.006+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.006+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.006+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.006+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.006+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17604950578775388228 2024-09-12T17:21:39.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.006+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.006+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.YjmrgmKyJ-l4TIFUplGbZ7H4PQr4xZH_0 2024-09-12T17:21:39.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.006+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T17:21:39.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.006+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.YjmrgmKyJ-l4TIFUplGbZ7H4PQr4xZH_1 2024-09-12T17:21:39.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.006+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T17:21:39.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.006+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.006+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17604950578775388228 2024-09-12T17:21:39.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.007+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T17:21:39.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.007+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def5e3be0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.007+0000 7f5ebeb26800 10 manifest: total_size = 5242880 2024-09-12T17:21:39.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.007+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to _BgJo4LNQHhb_2ELkYfZHCObrmnyYXJu 2024-09-12T17:21:39.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.007+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def5e3be0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.007+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6341c8 2024-09-12T17:21:39.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.007+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.16.0 2024-09-12T17:21:39.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.010+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.010+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.010+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.010+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.010+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: _BgJo4LNQHhb_2ELkYfZHCObrmnyYXJu 2024-09-12T17:21:39.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.010+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.010+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.7VxhQF1NmY6tqBcvY-xLPNCkpR6Gqhd_0 2024-09-12T17:21:39.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.010+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:21:39.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.010+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.7VxhQF1NmY6tqBcvY-xLPNCkpR6Gqhd_1 2024-09-12T17:21:39.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.010+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T17:21:39.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.010+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.010+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _BgJo4LNQHhb_2ELkYfZHCObrmnyYXJu 2024-09-12T17:21:39.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.011+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T17:21:39.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.011+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def5e3be0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.011+0000 7f5ebeb26800 10 manifest: total_size = 5242880 2024-09-12T17:21:39.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.011+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to _K8zwDCw08lRbqDJXDEYdyVSwzpEHgBN 2024-09-12T17:21:39.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.011+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def5e3be0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.011+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6341c8 2024-09-12T17:21:39.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.011+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.16.0 2024-09-12T17:21:39.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.014+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.014+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.014+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.014+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.014+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: _K8zwDCw08lRbqDJXDEYdyVSwzpEHgBN 2024-09-12T17:21:39.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.014+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.014+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.qqj_mE8rjLGYSL-yQJ181NoEpokW8CB_0 2024-09-12T17:21:39.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.014+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:21:39.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.014+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.qqj_mE8rjLGYSL-yQJ181NoEpokW8CB_1 2024-09-12T17:21:39.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.014+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:21:39.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.014+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.014+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _K8zwDCw08lRbqDJXDEYdyVSwzpEHgBN 2024-09-12T17:21:39.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.015+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T17:21:39.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.015+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def5e3be0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.015+0000 7f5ebeb26800 10 manifest: total_size = 5242880 2024-09-12T17:21:39.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.015+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16146921142852605541 2024-09-12T17:21:39.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.015+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def5e3be0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.015+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6341c8 2024-09-12T17:21:39.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.015+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.16.0 2024-09-12T17:21:39.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.017+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.017+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.017+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.017+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.017+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16146921142852605541 2024-09-12T17:21:39.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.017+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.017+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.UsyASbPO1CdwWRiOW5shozzYAdXZy15_0 2024-09-12T17:21:39.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.017+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T17:21:39.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.017+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.UsyASbPO1CdwWRiOW5shozzYAdXZy15_1 2024-09-12T17:21:39.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.017+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-12T17:21:39.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.017+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.017+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16146921142852605541 2024-09-12T17:21:39.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.018+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:21:39.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.019+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eac08cf20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.019+0000 7f5ebeb26800 10 manifest: total_size = 5242880 2024-09-12T17:21:39.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.019+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to _zdrnRoXNdykKgP96W0PQ6L3wdpu0sMv 2024-09-12T17:21:39.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.019+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eac08cf20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.019+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6341c8 2024-09-12T17:21:39.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.019+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.16.0 2024-09-12T17:21:39.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.021+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.021+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.021+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.021+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.021+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: _zdrnRoXNdykKgP96W0PQ6L3wdpu0sMv 2024-09-12T17:21:39.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.021+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.021+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.thPNTUUqsKuaj6O9bTebRZ_qtyeir0t_0 2024-09-12T17:21:39.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.021+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:21:39.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.021+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.thPNTUUqsKuaj6O9bTebRZ_qtyeir0t_1 2024-09-12T17:21:39.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.021+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T17:21:39.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.021+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.021+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: _zdrnRoXNdykKgP96W0PQ6L3wdpu0sMv 2024-09-12T17:21:39.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.022+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T17:21:39.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.022+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eac0706e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.022+0000 7f5ebeb26800 10 manifest: total_size = 5242880 2024-09-12T17:21:39.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.022+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16787151913863957395 2024-09-12T17:21:39.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.022+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eac0706e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.022+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6341c8 2024-09-12T17:21:39.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.022+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.16.0 2024-09-12T17:21:39.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.024+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.024+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.024+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.024+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.024+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16787151913863957395 2024-09-12T17:21:39.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.024+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.024+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.UsyASbPO1CdwWRiOW5shozzYAdXZy15_0 2024-09-12T17:21:39.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.024+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T17:21:39.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.024+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.UsyASbPO1CdwWRiOW5shozzYAdXZy15_1 2024-09-12T17:21:39.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.024+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-12T17:21:39.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.024+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.024+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16787151913863957395 2024-09-12T17:21:39.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.025+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T17:21:39.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.026+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eac0706e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.026+0000 7f5ebeb26800 10 manifest: total_size = 5242880 2024-09-12T17:21:39.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.026+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to _15Spzy-zolW4V3bqGZ5jByjs1Ov3Xsj 2024-09-12T17:21:39.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.026+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eac0706e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.026+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6341c8 2024-09-12T17:21:39.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.026+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.16.0 2024-09-12T17:21:39.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.028+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.028+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.028+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.028+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.028+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: _15Spzy-zolW4V3bqGZ5jByjs1Ov3Xsj 2024-09-12T17:21:39.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.028+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.028+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.VyfktXTy_nDgI1zg3GqQpry0v4qkP7W_0 2024-09-12T17:21:39.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.028+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:21:39.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.028+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.VyfktXTy_nDgI1zg3GqQpry0v4qkP7W_1 2024-09-12T17:21:39.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.028+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:21:39.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.028+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.028+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _15Spzy-zolW4V3bqGZ5jByjs1Ov3Xsj 2024-09-12T17:21:39.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.029+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T17:21:39.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.029+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eac0706e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.030+0000 7f5ebeb26800 10 manifest: total_size = 2044 2024-09-12T17:21:39.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.030+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.2299060705636378544 2024-09-12T17:21:39.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.030+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eac0706e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.030+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6341c8 2024-09-12T17:21:39.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.030+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.16.0 2024-09-12T17:21:39.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.032+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.032+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=2044 stripe_ofs=2044 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.032+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.2299060705636378544 2024-09-12T17:21:39.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.032+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.032+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.4oZkQhZf5VHqMdHbl0KkU9B9T2uTiuv_0 2024-09-12T17:21:39.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.032+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T17:21:39.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.032+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.032+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.2299060705636378544 2024-09-12T17:21:39.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.033+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:21:39.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.033+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eb40df320 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.033+0000 7f5ebeb26800 10 manifest: total_size = 2044 2024-09-12T17:21:39.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.033+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to _uoNvnUIwZFfiI8hwZ2bRReFlHCMR-vF 2024-09-12T17:21:39.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.033+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eb40df320 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.033+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6341c8 2024-09-12T17:21:39.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.033+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.16.0 2024-09-12T17:21:39.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.035+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.035+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=2044 stripe_ofs=2044 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.035+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: _uoNvnUIwZFfiI8hwZ2bRReFlHCMR-vF 2024-09-12T17:21:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.035+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.035+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.Iewpu2PPZx-qpH1xQW1tXRAgV3r8DGj_0 2024-09-12T17:21:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.035+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:21:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.035+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.035+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: _uoNvnUIwZFfiI8hwZ2bRReFlHCMR-vF 2024-09-12T17:21:39.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.036+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T17:21:39.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.037+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eac0706e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.037+0000 7f5ebeb26800 10 manifest: total_size = 2044 2024-09-12T17:21:39.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.037+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to _vl5dAMVVd17hsAdlcWwMPmutRQ7TebP 2024-09-12T17:21:39.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.037+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eac0706e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.037+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6341c8 2024-09-12T17:21:39.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.037+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.16.0 2024-09-12T17:21:39.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.039+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.039+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=2044 stripe_ofs=2044 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.039+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: _vl5dAMVVd17hsAdlcWwMPmutRQ7TebP 2024-09-12T17:21:39.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.039+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.039+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.4Gx3HqTmQyKi8XjdME0BDVf0S8DT23d_0 2024-09-12T17:21:39.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.039+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:21:39.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.039+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.039+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: _vl5dAMVVd17hsAdlcWwMPmutRQ7TebP 2024-09-12T17:21:39.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.040+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T17:21:39.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.040+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eac0706e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.041+0000 7f5ebeb26800 10 manifest: total_size = 2044 2024-09-12T17:21:39.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.041+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.7460012008716098118 2024-09-12T17:21:39.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.041+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eac0706e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.041+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6341c8 2024-09-12T17:21:39.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.041+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.16.0 2024-09-12T17:21:39.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.043+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.043+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=2044 stripe_ofs=2044 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.043+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.7460012008716098118 2024-09-12T17:21:39.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.043+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.043+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.4oZkQhZf5VHqMdHbl0KkU9B9T2uTiuv_0 2024-09-12T17:21:39.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.043+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T17:21:39.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.043+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.043+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.7460012008716098118 2024-09-12T17:21:39.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.044+0000 7f5ebeb26800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:21:39.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.044+0000 7f5ebeb26800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:21:39.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.044+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T17:21:39.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.045+0000 7f5ebeb26800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:21:39.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.045+0000 7f5ebeb26800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:21:39.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.045+0000 7f5ebeb26800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:21:39.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.045+0000 7f5ebeb26800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:21:39.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.045+0000 7f5ebeb26800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[06eb12d0-49d6-461d-9efe-05d212954deb.4538.16])"; uploads.size()=0; is_truncated=0 2024-09-12T17:21:39.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.046+0000 7f5ebeb26800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-12T17:21:39.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.046+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.046+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=233 2024-09-12T17:21:39.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.046+0000 7f5ebeb26800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-12T17:21:39.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.046+0000 7f5ebeb26800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-12T17:21:39.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.047+0000 7f5ebeb26800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-12T17:21:39.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.047+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-12T17:21:39.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.048+0000 7f5d9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464278 cookie 94824008885328 notifier 6021 bl.length()=189 2024-09-12T17:21:39.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.051+0000 7f5ebeb26800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.16 from cache 2024-09-12T17:21:39.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.051+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.16, ofs0, ns] 2024-09-12T17:21:39.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.051+0000 7f5d9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464290 cookie 94824008891024 notifier 6021 bl.length()=247 2024-09-12T17:21:39.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.054+0000 7f5ebeb26800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.16 : miss 2024-09-12T17:21:39.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.054+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.054+0000 7f5ebeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:39.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.054+0000 7f5ebeb26800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.16 info.flags=0x0 2024-09-12T17:21:39.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.054+0000 7f5ebeb26800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.16 to cache LRU end 2024-09-12T17:21:39.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.056+0000 7f5ebeb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17 : miss 2024-09-12T17:21:39.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.056+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.056+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:21:39.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.056+0000 7f5ebeb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17 info.flags=0x17 2024-09-12T17:21:39.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.056+0000 7f5ebeb26800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17 to cache LRU end 2024-09-12T17:21:39.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.056+0000 7f5ebeb26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:39.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.056+0000 7f5ebeb26800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:21:39.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.056+0000 7f5ebeb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17 2024-09-12T17:21:39.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.057+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:21:39.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.057+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T17:21:39.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.057+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T17:21:39.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.057+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T17:21:39.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.057+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:21:39.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.057+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T17:21:39.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.057+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T17:21:39.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.057+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T17:21:39.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.057+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:21:39.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.057+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T17:21:39.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.057+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T17:21:39.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.057+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T17:21:39.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.057+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def61af70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.057+0000 7f5ebeb26800 10 manifest: total_size = 11534336 2024-09-12T17:21:39.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.057+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17049872180049035643 2024-09-12T17:21:39.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.057+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def61af70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.057+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6341c8 2024-09-12T17:21:39.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.057+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.17.0 2024-09-12T17:21:39.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:21:39.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:21:39.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:21:39.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:21:39.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:21:39.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:21:39.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:21:39.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:21:39.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:21:39.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:21:39.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:21:39.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:21:39.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:21:39.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:21:39.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:21:39.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17049872180049035643 2024-09-12T17:21:39.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-FROZEN.2~jcci9n22BHmTremR87DVrKfYQXLHZlC.1 2024-09-12T17:21:39.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T17:21:39.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_foo-FROZEN.2~jcci9n22BHmTremR87DVrKfYQXLHZlC.1_1 2024-09-12T17:21:39.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-12T17:21:39.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-FROZEN.2~jcci9n22BHmTremR87DVrKfYQXLHZlC.2 2024-09-12T17:21:39.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-12T17:21:39.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_foo-FROZEN.2~jcci9n22BHmTremR87DVrKfYQXLHZlC.2_1 2024-09-12T17:21:39.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-12T17:21:39.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-FROZEN.2~jcci9n22BHmTremR87DVrKfYQXLHZlC.3 2024-09-12T17:21:39.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-12T17:21:39.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.059+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17049872180049035643 2024-09-12T17:21:39.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.060+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:21:39.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.061+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def639cf0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.061+0000 7f5ebeb26800 10 manifest: total_size = 11534336 2024-09-12T17:21:39.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.061+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.14087454728439116224 2024-09-12T17:21:39.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.061+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def639cf0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.061+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6341c8 2024-09-12T17:21:39.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.061+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.17.0 2024-09-12T17:21:39.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:21:39.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:21:39.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:21:39.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:21:39.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:21:39.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:21:39.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:21:39.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:21:39.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:21:39.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:21:39.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:21:39.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:21:39.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:21:39.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:21:39.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:21:39.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.14087454728439116224 2024-09-12T17:21:39.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-FROZEN.2~jcci9n22BHmTremR87DVrKfYQXLHZlC.1 2024-09-12T17:21:39.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T17:21:39.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_foo-FROZEN.2~jcci9n22BHmTremR87DVrKfYQXLHZlC.1_1 2024-09-12T17:21:39.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-12T17:21:39.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-FROZEN.2~jcci9n22BHmTremR87DVrKfYQXLHZlC.2 2024-09-12T17:21:39.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-12T17:21:39.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_foo-FROZEN.2~jcci9n22BHmTremR87DVrKfYQXLHZlC.2_1 2024-09-12T17:21:39.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-12T17:21:39.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-FROZEN.2~jcci9n22BHmTremR87DVrKfYQXLHZlC.3 2024-09-12T17:21:39.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-12T17:21:39.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.063+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.14087454728439116224 2024-09-12T17:21:39.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.064+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T17:21:39.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.065+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eac0706e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.065+0000 7f5ebeb26800 10 manifest: total_size = 11534336 2024-09-12T17:21:39.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.065+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to _gHO_LTdFuUQ3WXvtmI_rjUGQh00vELf 2024-09-12T17:21:39.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.065+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eac0706e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.065+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6341c8 2024-09-12T17:21:39.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.065+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.17.0 2024-09-12T17:21:39.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.067+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.067+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.067+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.067+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.067+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.067+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.067+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: _gHO_LTdFuUQ3WXvtmI_rjUGQh00vELf 2024-09-12T17:21:39.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.067+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.067+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.v5gpMrhQttEp-LtCq4ALk-mrdiDR6kb_0 2024-09-12T17:21:39.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.067+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:21:39.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.067+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.v5gpMrhQttEp-LtCq4ALk-mrdiDR6kb_1 2024-09-12T17:21:39.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.067+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T17:21:39.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.067+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.v5gpMrhQttEp-LtCq4ALk-mrdiDR6kb_2 2024-09-12T17:21:39.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.067+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-12T17:21:39.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.067+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.067+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _gHO_LTdFuUQ3WXvtmI_rjUGQh00vELf 2024-09-12T17:21:39.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.068+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T17:21:39.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.068+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eb0078fc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.068+0000 7f5ebeb26800 10 manifest: total_size = 11534336 2024-09-12T17:21:39.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.068+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to _hoVxSPkMnHUSjMgha04k0uTVw3RBJq7 2024-09-12T17:21:39.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.068+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eb0078fc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.069+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6341c8 2024-09-12T17:21:39.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.069+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.17.0 2024-09-12T17:21:39.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.071+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.071+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.071+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.071+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.071+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.071+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.071+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: _hoVxSPkMnHUSjMgha04k0uTVw3RBJq7 2024-09-12T17:21:39.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.071+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.071+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.Lt2-Cd5mWgAo4WHO_hTVsgOrwPsJBb6_0 2024-09-12T17:21:39.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.071+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:21:39.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.071+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.Lt2-Cd5mWgAo4WHO_hTVsgOrwPsJBb6_1 2024-09-12T17:21:39.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.071+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:21:39.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.071+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.Lt2-Cd5mWgAo4WHO_hTVsgOrwPsJBb6_2 2024-09-12T17:21:39.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.071+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-12T17:21:39.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.071+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.071+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: _hoVxSPkMnHUSjMgha04k0uTVw3RBJq7 2024-09-12T17:21:39.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.072+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T17:21:39.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.072+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eac08cf20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.072+0000 7f5ebeb26800 10 manifest: total_size = 11534336 2024-09-12T17:21:39.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.072+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.9995812663938111498 2024-09-12T17:21:39.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.072+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eac08cf20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.072+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6341c8 2024-09-12T17:21:39.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.072+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.17.0 2024-09-12T17:21:39.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:21:39.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:21:39.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:21:39.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:21:39.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:21:39.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:21:39.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:21:39.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:21:39.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:21:39.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:21:39.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:21:39.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:21:39.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:21:39.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:21:39.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:21:39.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.9995812663938111498 2024-09-12T17:21:39.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-LUKEWARM.2~9omk0vlP-uGSsfapRNknN8q4WBMrZOv.1 2024-09-12T17:21:39.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T17:21:39.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_foo-LUKEWARM.2~9omk0vlP-uGSsfapRNknN8q4WBMrZOv.1_1 2024-09-12T17:21:39.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-12T17:21:39.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-LUKEWARM.2~9omk0vlP-uGSsfapRNknN8q4WBMrZOv.2 2024-09-12T17:21:39.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-12T17:21:39.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_foo-LUKEWARM.2~9omk0vlP-uGSsfapRNknN8q4WBMrZOv.2_1 2024-09-12T17:21:39.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-12T17:21:39.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-LUKEWARM.2~9omk0vlP-uGSsfapRNknN8q4WBMrZOv.3 2024-09-12T17:21:39.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-12T17:21:39.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.075+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.9995812663938111498 2024-09-12T17:21:39.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.076+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:21:39.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.076+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eb0078fc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.077+0000 7f5ebeb26800 10 manifest: total_size = 11534336 2024-09-12T17:21:39.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.077+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to _zTEKvEkJn3zdlPjTcZwK7UcUvPj1X-Y 2024-09-12T17:21:39.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.077+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eb0078fc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.077+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6341c8 2024-09-12T17:21:39.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.077+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.17.0 2024-09-12T17:21:39.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.079+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.079+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.079+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.079+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.079+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.079+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.079+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: _zTEKvEkJn3zdlPjTcZwK7UcUvPj1X-Y 2024-09-12T17:21:39.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.079+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.079+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.Q1WCE_J6kPVGFCa4WxbJ_Q-5e66GLzR_0 2024-09-12T17:21:39.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.079+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:21:39.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.079+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.Q1WCE_J6kPVGFCa4WxbJ_Q-5e66GLzR_1 2024-09-12T17:21:39.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.079+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T17:21:39.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.079+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.Q1WCE_J6kPVGFCa4WxbJ_Q-5e66GLzR_2 2024-09-12T17:21:39.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.079+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-12T17:21:39.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.079+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.079+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: _zTEKvEkJn3zdlPjTcZwK7UcUvPj1X-Y 2024-09-12T17:21:39.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.080+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T17:21:39.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.080+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eac08d0d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.080+0000 7f5ebeb26800 10 manifest: total_size = 11534336 2024-09-12T17:21:39.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.080+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.10024466635781711595 2024-09-12T17:21:39.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.080+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eac08d0d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.080+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6341c8 2024-09-12T17:21:39.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.080+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.17.0 2024-09-12T17:21:39.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:21:39.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:21:39.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:21:39.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:21:39.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:21:39.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:21:39.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:21:39.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:21:39.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:21:39.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:21:39.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:21:39.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:21:39.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:21:39.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:21:39.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:21:39.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.10024466635781711595 2024-09-12T17:21:39.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-LUKEWARM.2~9omk0vlP-uGSsfapRNknN8q4WBMrZOv.1 2024-09-12T17:21:39.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T17:21:39.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_foo-LUKEWARM.2~9omk0vlP-uGSsfapRNknN8q4WBMrZOv.1_1 2024-09-12T17:21:39.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-12T17:21:39.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-LUKEWARM.2~9omk0vlP-uGSsfapRNknN8q4WBMrZOv.2 2024-09-12T17:21:39.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-12T17:21:39.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_foo-LUKEWARM.2~9omk0vlP-uGSsfapRNknN8q4WBMrZOv.2_1 2024-09-12T17:21:39.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-12T17:21:39.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-LUKEWARM.2~9omk0vlP-uGSsfapRNknN8q4WBMrZOv.3 2024-09-12T17:21:39.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-12T17:21:39.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.082+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.10024466635781711595 2024-09-12T17:21:39.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.083+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T17:21:39.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.084+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def639b20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x563def56e308 s->prefetch_data=0 2024-09-12T17:21:39.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.084+0000 7f5ebeb26800 10 manifest: total_size = 11534336 2024-09-12T17:21:39.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.084+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to _K9nDrhI7gW7YDNmQUV-aKXd8h3VEOrk 2024-09-12T17:21:39.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.084+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def639b20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x563def56e308 s->prefetch_data=0 2024-09-12T17:21:39.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.084+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def56e308 2024-09-12T17:21:39.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.084+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.17.0 2024-09-12T17:21:39.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.086+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.086+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.086+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.086+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.086+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.086+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.086+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: _K9nDrhI7gW7YDNmQUV-aKXd8h3VEOrk 2024-09-12T17:21:39.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.086+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.086+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.FLX60aLUxF1stFHVehA3ZbG1YLkveUj_0 2024-09-12T17:21:39.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.086+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:21:39.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.086+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.FLX60aLUxF1stFHVehA3ZbG1YLkveUj_1 2024-09-12T17:21:39.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.086+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:21:39.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.086+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.FLX60aLUxF1stFHVehA3ZbG1YLkveUj_2 2024-09-12T17:21:39.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.086+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-12T17:21:39.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.086+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.086+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _K9nDrhI7gW7YDNmQUV-aKXd8h3VEOrk 2024-09-12T17:21:39.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.087+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T17:21:39.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.087+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eac08d0d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.088+0000 7f5ebeb26800 10 manifest: total_size = 1087 2024-09-12T17:21:39.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.088+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.5673311322142327809 2024-09-12T17:21:39.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.088+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eac08d0d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.088+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6341c8 2024-09-12T17:21:39.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.088+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.17.0 2024-09-12T17:21:39.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.089+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:21:39.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.089+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-09-12T17:21:39.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.089+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T17:21:39.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.089+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:21:39.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.089+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-09-12T17:21:39.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.089+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-12T17:21:39.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.089+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-12T17:21:39.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.089+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=55 2024-09-12T17:21:39.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.089+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-12T17:21:39.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.089+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.5673311322142327809 2024-09-12T17:21:39.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.089+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.089+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-STANDARD.2~wryHCHt-Fgh1VcKvrGO7SlxzddO7SzP.1 2024-09-12T17:21:39.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.089+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T17:21:39.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.089+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-STANDARD.2~wryHCHt-Fgh1VcKvrGO7SlxzddO7SzP.2 2024-09-12T17:21:39.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.089+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T17:21:39.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.089+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-STANDARD.2~wryHCHt-Fgh1VcKvrGO7SlxzddO7SzP.3 2024-09-12T17:21:39.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.089+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T17:21:39.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.089+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.089+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.5673311322142327809 2024-09-12T17:21:39.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.090+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:21:39.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.091+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def56deb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.091+0000 7f5ebeb26800 10 manifest: total_size = 1087 2024-09-12T17:21:39.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.091+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to _qnjvLymJY_x5Uy33VL_9ehibLD5Ouna 2024-09-12T17:21:39.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.091+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def56deb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.091+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6341c8 2024-09-12T17:21:39.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.091+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.17.0 2024-09-12T17:21:39.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.093+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.093+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.093+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: _qnjvLymJY_x5Uy33VL_9ehibLD5Ouna 2024-09-12T17:21:39.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.093+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.093+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.sHYeDyCoMHhmph3H9Uxq57V1RNuAoxD_0 2024-09-12T17:21:39.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.093+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:21:39.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.093+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.093+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _qnjvLymJY_x5Uy33VL_9ehibLD5Ouna 2024-09-12T17:21:39.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.094+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T17:21:39.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.094+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eac08d0d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.095+0000 7f5ebeb26800 10 manifest: total_size = 1087 2024-09-12T17:21:39.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.095+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to _qeQfEFvWvHjjl-itqLWYbXg4kKnL1FV 2024-09-12T17:21:39.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.095+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eac08d0d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.095+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6341c8 2024-09-12T17:21:39.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.095+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.17.0 2024-09-12T17:21:39.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.097+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.097+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.097+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: _qeQfEFvWvHjjl-itqLWYbXg4kKnL1FV 2024-09-12T17:21:39.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.097+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.097+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.4NRnQJ0A6QrhfR9OS5h2CJJ4sYOs9mz_0 2024-09-12T17:21:39.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.097+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:21:39.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.097+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.097+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _qeQfEFvWvHjjl-itqLWYbXg4kKnL1FV 2024-09-12T17:21:39.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.098+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def63cae0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.098+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T17:21:39.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.098+0000 7f5ebeb26800 10 manifest: total_size = 1087 2024-09-12T17:21:39.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.098+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.6185749009853802889 2024-09-12T17:21:39.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.098+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def63cae0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x563def6341c8 s->prefetch_data=0 2024-09-12T17:21:39.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.098+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6341c8 2024-09-12T17:21:39.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.098+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.17.0 2024-09-12T17:21:39.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.100+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:21:39.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.100+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-09-12T17:21:39.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.100+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T17:21:39.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.100+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:21:39.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.100+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-09-12T17:21:39.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.100+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-12T17:21:39.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.100+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-12T17:21:39.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.100+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=55 2024-09-12T17:21:39.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.100+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-12T17:21:39.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.100+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.6185749009853802889 2024-09-12T17:21:39.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.100+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.100+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-STANDARD.2~wryHCHt-Fgh1VcKvrGO7SlxzddO7SzP.1 2024-09-12T17:21:39.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.100+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T17:21:39.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.100+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-STANDARD.2~wryHCHt-Fgh1VcKvrGO7SlxzddO7SzP.2 2024-09-12T17:21:39.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.100+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T17:21:39.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.100+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-STANDARD.2~wryHCHt-Fgh1VcKvrGO7SlxzddO7SzP.3 2024-09-12T17:21:39.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.100+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T17:21:39.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.100+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.100+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.6185749009853802889 2024-09-12T17:21:39.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.101+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T17:21:39.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.101+0000 7f5ebeb26800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:21:39.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.101+0000 7f5ebeb26800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:21:39.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.102+0000 7f5ebeb26800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:21:39.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.102+0000 7f5ebeb26800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:21:39.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.102+0000 7f5ebeb26800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:21:39.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.102+0000 7f5ebeb26800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:21:39.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.102+0000 7f5ebeb26800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[06eb12d0-49d6-461d-9efe-05d212954deb.4538.17])"; uploads.size()=0; is_truncated=0 2024-09-12T17:21:39.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.103+0000 7f5ebeb26800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-12T17:21:39.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.103+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.104+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=243 2024-09-12T17:21:39.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.104+0000 7f5ebeb26800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-12T17:21:39.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.104+0000 7f5ebeb26800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-12T17:21:39.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.105+0000 7f5ebeb26800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-12T17:21:39.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.105+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-12T17:21:39.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.105+0000 7f5d9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464275 cookie 94824008887456 notifier 6021 bl.length()=199 2024-09-12T17:21:39.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.108+0000 7f5ebeb26800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17 from cache 2024-09-12T17:21:39.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.108+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17, ofs0, ns] 2024-09-12T17:21:39.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.108+0000 7f5d9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464270 cookie 94824008903456 notifier 6021 bl.length()=257 2024-09-12T17:21:39.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.111+0000 7f5ebeb26800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.17 : miss 2024-09-12T17:21:39.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.111+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.111+0000 7f5ebeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:39.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.111+0000 7f5ebeb26800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.17 info.flags=0x0 2024-09-12T17:21:39.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.111+0000 7f5ebeb26800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.17 to cache LRU end 2024-09-12T17:21:39.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.113+0000 7f5ebeb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.15 : miss 2024-09-12T17:21:39.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.113+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.116+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T17:21:39.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.116+0000 7f5ebeb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.15 info.flags=0x17 2024-09-12T17:21:39.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.116+0000 7f5ebeb26800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.15 to cache LRU end 2024-09-12T17:21:39.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.116+0000 7f5ebeb26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:39.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.116+0000 7f5ebeb26800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:21:39.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.116+0000 7f5ebeb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.15 2024-09-12T17:21:39.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.116+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:21:39.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.116+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:21:39.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.116+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:21:39.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.116+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def56f0a0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x563def63ba88 s->prefetch_data=0 2024-09-12T17:21:39.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.117+0000 7f5ebeb26800 10 manifest: total_size = 11534336 2024-09-12T17:21:39.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.117+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.2471972560853996655 2024-09-12T17:21:39.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.117+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def56f0a0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x563def63ba88 s->prefetch_data=0 2024-09-12T17:21:39.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.117+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def63ba88 2024-09-12T17:21:39.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.117+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.15.0 2024-09-12T17:21:39.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:21:39.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:21:39.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:21:39.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:21:39.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:21:39.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:21:39.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:21:39.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:21:39.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:21:39.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:21:39.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:21:39.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:21:39.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:21:39.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:21:39.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:21:39.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.2471972560853996655 2024-09-12T17:21:39.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.15__multipart_foo-FROZEN.2~SL4L9qalYx-L6CiZnYL1nKbfNe4YGEr.1 2024-09-12T17:21:39.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T17:21:39.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.15__shadow_foo-FROZEN.2~SL4L9qalYx-L6CiZnYL1nKbfNe4YGEr.1_1 2024-09-12T17:21:39.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T17:21:39.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.15__multipart_foo-FROZEN.2~SL4L9qalYx-L6CiZnYL1nKbfNe4YGEr.2 2024-09-12T17:21:39.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T17:21:39.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.15__shadow_foo-FROZEN.2~SL4L9qalYx-L6CiZnYL1nKbfNe4YGEr.2_1 2024-09-12T17:21:39.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T17:21:39.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.15__multipart_foo-FROZEN.2~SL4L9qalYx-L6CiZnYL1nKbfNe4YGEr.3 2024-09-12T17:21:39.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T17:21:39.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.119+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.120+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.2471972560853996655 2024-09-12T17:21:39.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.121+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:21:39.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.121+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eb40df320 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x563def56d748 s->prefetch_data=0 2024-09-12T17:21:39.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.121+0000 7f5ebeb26800 10 manifest: total_size = 11534336 2024-09-12T17:21:39.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.121+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.4815901023522683532 2024-09-12T17:21:39.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.121+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eb40df320 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x563def56d748 s->prefetch_data=0 2024-09-12T17:21:39.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.121+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def56d748 2024-09-12T17:21:39.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.121+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.15.0 2024-09-12T17:21:39.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:21:39.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:21:39.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:21:39.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:21:39.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:21:39.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:21:39.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:21:39.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:21:39.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:21:39.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:21:39.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:21:39.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:21:39.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:21:39.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:21:39.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:21:39.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.4815901023522683532 2024-09-12T17:21:39.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.15__multipart_foo-LUKEWARM.2~xC66n6FqYJKMJqVVQS1vw7NtDS06PpN.1 2024-09-12T17:21:39.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T17:21:39.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.15__shadow_foo-LUKEWARM.2~xC66n6FqYJKMJqVVQS1vw7NtDS06PpN.1_1 2024-09-12T17:21:39.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-12T17:21:39.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.15__multipart_foo-LUKEWARM.2~xC66n6FqYJKMJqVVQS1vw7NtDS06PpN.2 2024-09-12T17:21:39.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-12T17:21:39.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.15__shadow_foo-LUKEWARM.2~xC66n6FqYJKMJqVVQS1vw7NtDS06PpN.2_1 2024-09-12T17:21:39.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-12T17:21:39.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.15__multipart_foo-LUKEWARM.2~xC66n6FqYJKMJqVVQS1vw7NtDS06PpN.3 2024-09-12T17:21:39.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-12T17:21:39.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.124+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.4815901023522683532 2024-09-12T17:21:39.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.125+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:21:39.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.125+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def5eacb0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x563def638308 s->prefetch_data=0 2024-09-12T17:21:39.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.125+0000 7f5ebeb26800 10 manifest: total_size = 1087 2024-09-12T17:21:39.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.125+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.10335877123905621727 2024-09-12T17:21:39.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.125+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def5eacb0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x563def638308 s->prefetch_data=0 2024-09-12T17:21:39.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.125+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def638308 2024-09-12T17:21:39.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.125+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.15.0 2024-09-12T17:21:39.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.127+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:21:39.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.127+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-09-12T17:21:39.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.127+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T17:21:39.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.127+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:21:39.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.127+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-09-12T17:21:39.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.127+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-12T17:21:39.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.127+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-12T17:21:39.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.127+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=55 2024-09-12T17:21:39.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.127+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-12T17:21:39.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.127+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.10335877123905621727 2024-09-12T17:21:39.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.127+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.127+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.15__multipart_foo-STANDARD.2~pyvvfLpD-a8XTCzdMt4QqfPCJCzTSYf.1 2024-09-12T17:21:39.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.127+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T17:21:39.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.127+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.15__multipart_foo-STANDARD.2~pyvvfLpD-a8XTCzdMt4QqfPCJCzTSYf.2 2024-09-12T17:21:39.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.127+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T17:21:39.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.127+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.15__multipart_foo-STANDARD.2~pyvvfLpD-a8XTCzdMt4QqfPCJCzTSYf.3 2024-09-12T17:21:39.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.127+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T17:21:39.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.127+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.127+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.10335877123905621727 2024-09-12T17:21:39.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.128+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:21:39.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.129+0000 7f5ebeb26800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:21:39.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.129+0000 7f5ebeb26800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:21:39.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.129+0000 7f5ebeb26800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:21:39.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.129+0000 7f5ebeb26800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:21:39.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.129+0000 7f5ebeb26800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:21:39.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.129+0000 7f5ebeb26800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:21:39.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.129+0000 7f5ebeb26800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[06eb12d0-49d6-461d-9efe-05d212954deb.4538.15])"; uploads.size()=0; is_truncated=0 2024-09-12T17:21:39.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.131+0000 7f5ebeb26800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-12T17:21:39.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.131+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.131+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=238 2024-09-12T17:21:39.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.131+0000 7f5ebeb26800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-12T17:21:39.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.131+0000 7f5ebeb26800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-12T17:21:39.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.132+0000 7f5ebeb26800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-12T17:21:39.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.132+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-12T17:21:39.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.132+0000 7f5d9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464322 cookie 94824008898000 notifier 6021 bl.length()=194 2024-09-12T17:21:39.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.135+0000 7f5ebeb26800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.15 from cache 2024-09-12T17:21:39.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.135+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.15, ofs0, ns] 2024-09-12T17:21:39.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.135+0000 7f5d9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464271 cookie 94824008903456 notifier 6021 bl.length()=252 2024-09-12T17:21:39.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.138+0000 7f5ebeb26800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.15 : miss 2024-09-12T17:21:39.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.138+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.138+0000 7f5ebeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:39.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.138+0000 7f5ebeb26800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.15 info.flags=0x0 2024-09-12T17:21:39.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.138+0000 7f5ebeb26800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.15 to cache LRU end 2024-09-12T17:21:39.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.141+0000 7f5ebeb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.14 : miss 2024-09-12T17:21:39.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.141+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.141+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=450 2024-09-12T17:21:39.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.141+0000 7f5ebeb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.14 info.flags=0x17 2024-09-12T17:21:39.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.141+0000 7f5ebeb26800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.14 to cache LRU end 2024-09-12T17:21:39.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.141+0000 7f5ebeb26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:39.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.141+0000 7f5ebeb26800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:21:39.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.141+0000 7f5ebeb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.14 2024-09-12T17:21:39.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.142+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:21:39.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.142+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:21:39.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.142+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:21:39.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.142+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def62b600 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x563def6275a8 s->prefetch_data=0 2024-09-12T17:21:39.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.142+0000 7f5ebeb26800 10 manifest: total_size = 10485760 2024-09-12T17:21:39.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.142+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.10368544623771099204 2024-09-12T17:21:39.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.142+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def62b600 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x563def6275a8 s->prefetch_data=0 2024-09-12T17:21:39.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.142+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6275a8 2024-09-12T17:21:39.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.142+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.14.0 2024-09-12T17:21:39.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.145+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.145+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.145+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.145+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.145+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.145+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.145+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.10368544623771099204 2024-09-12T17:21:39.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.145+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.145+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.14__shadow_.z8ddYkTxhJD7gCTdpddP1NTgpT9-qlS_0 2024-09-12T17:21:39.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.145+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T17:21:39.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.145+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.14__shadow_.z8ddYkTxhJD7gCTdpddP1NTgpT9-qlS_1 2024-09-12T17:21:39.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.145+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T17:21:39.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.145+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.14__shadow_.z8ddYkTxhJD7gCTdpddP1NTgpT9-qlS_2 2024-09-12T17:21:39.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.145+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 812 2024-09-12T17:21:39.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.145+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.145+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.10368544623771099204 2024-09-12T17:21:39.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.145+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:21:39.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.146+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eb40df320 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x563def6275a8 s->prefetch_data=0 2024-09-12T17:21:39.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.146+0000 7f5ebeb26800 10 manifest: total_size = 10485760 2024-09-12T17:21:39.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.146+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16344864417971953614 2024-09-12T17:21:39.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.146+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eb40df320 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x563def6275a8 s->prefetch_data=0 2024-09-12T17:21:39.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.146+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6275a8 2024-09-12T17:21:39.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.146+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.14.0 2024-09-12T17:21:39.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.148+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.148+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.148+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.148+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.148+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.148+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.148+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16344864417971953614 2024-09-12T17:21:39.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.148+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.148+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.14__shadow_.HNNvGe91DxxdX8mcMurXRUMtFHClHoF_0 2024-09-12T17:21:39.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.148+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T17:21:39.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.148+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.14__shadow_.HNNvGe91DxxdX8mcMurXRUMtFHClHoF_1 2024-09-12T17:21:39.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.148+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-12T17:21:39.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.148+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.14__shadow_.HNNvGe91DxxdX8mcMurXRUMtFHClHoF_2 2024-09-12T17:21:39.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.148+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 818 2024-09-12T17:21:39.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.148+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.148+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16344864417971953614 2024-09-12T17:21:39.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.149+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:21:39.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.149+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eac05c8b0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x563def6275a8 s->prefetch_data=0 2024-09-12T17:21:39.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.150+0000 7f5ebeb26800 10 manifest: total_size = 53496 2024-09-12T17:21:39.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.150+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.1630404027329535193 2024-09-12T17:21:39.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.150+0000 7f5ebeb26800 20 get_obj_state: octx=0x7f5eac05c8b0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x563def6275a8 s->prefetch_data=0 2024-09-12T17:21:39.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.150+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def6275a8 2024-09-12T17:21:39.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.150+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.14.0 2024-09-12T17:21:39.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.152+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.152+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=53496 stripe_ofs=53496 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.152+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.1630404027329535193 2024-09-12T17:21:39.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.152+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.152+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.14__shadow_.TSOX58cp_gy3rHgmVPXzG8FuO33Z102_0 2024-09-12T17:21:39.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.152+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T17:21:39.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.152+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.152+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.1630404027329535193 2024-09-12T17:21:39.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.153+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:21:39.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.153+0000 7f5ebeb26800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:21:39.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.153+0000 7f5ebeb26800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:21:39.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.154+0000 7f5ebeb26800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:21:39.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.154+0000 7f5ebeb26800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:21:39.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.154+0000 7f5ebeb26800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:21:39.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.154+0000 7f5ebeb26800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:21:39.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.154+0000 7f5ebeb26800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[06eb12d0-49d6-461d-9efe-05d212954deb.4538.14])"; uploads.size()=0; is_truncated=0 2024-09-12T17:21:39.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.155+0000 7f5ebeb26800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-12T17:21:39.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.155+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.155+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=228 2024-09-12T17:21:39.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.155+0000 7f5ebeb26800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-12T17:21:39.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.155+0000 7f5ebeb26800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-12T17:21:39.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.157+0000 7f5ebeb26800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-12T17:21:39.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.157+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-12T17:21:39.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.157+0000 7f5d9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464279 cookie 94824008885328 notifier 6021 bl.length()=184 2024-09-12T17:21:39.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.160+0000 7f5ebeb26800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.14 from cache 2024-09-12T17:21:39.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.160+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.14, ofs0, ns] 2024-09-12T17:21:39.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.160+0000 7f5d9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464323 cookie 94824008895952 notifier 6021 bl.length()=242 2024-09-12T17:21:39.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.161+0000 7f5d9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464324 cookie 94824008895952 notifier 6021 bl.length()=242 2024-09-12T17:21:39.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.164+0000 7f5ebeb26800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.14 : miss 2024-09-12T17:21:39.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.164+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.164+0000 7f5ebeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:39.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.164+0000 7f5ebeb26800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.14 info.flags=0x0 2024-09-12T17:21:39.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.164+0000 7f5ebeb26800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.14 to cache LRU end 2024-09-12T17:21:39.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.166+0000 7f5ebeb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.7 : miss 2024-09-12T17:21:39.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.166+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.167+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:21:39.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.167+0000 7f5ebeb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.7 info.flags=0x17 2024-09-12T17:21:39.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.167+0000 7f5ebeb26800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.7 to cache LRU end 2024-09-12T17:21:39.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.167+0000 7f5ebeb26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:39.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.167+0000 7f5ebeb26800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:21:39.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.167+0000 7f5ebeb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.7 2024-09-12T17:21:39.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.167+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got __ 2024-09-12T17:21:39.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.167+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:21:39.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.167+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:21:39.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.167+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got obj 2024-09-12T17:21:39.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.167+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def61acd0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x563def638308 s->prefetch_data=0 2024-09-12T17:21:39.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.168+0000 7f5ebeb26800 10 manifest: total_size = 0 2024-09-12T17:21:39.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.168+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16032701864451867005 2024-09-12T17:21:39.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.168+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def61acd0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x563def638308 s->prefetch_data=0 2024-09-12T17:21:39.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.168+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def638308 2024-09-12T17:21:39.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.168+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.7.0 2024-09-12T17:21:39.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.170+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def61acd0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x563def638308 s->prefetch_data=0 2024-09-12T17:21:39.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.170+0000 7f5ebeb26800 10 manifest: total_size = 0 2024-09-12T17:21:39.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.170+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.6106832607367106983 2024-09-12T17:21:39.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.170+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def61acd0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x563def638308 s->prefetch_data=0 2024-09-12T17:21:39.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.170+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def638308 2024-09-12T17:21:39.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.170+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.7.0 2024-09-12T17:21:39.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.171+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:21:39.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.173+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def61acd0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x563def638308 s->prefetch_data=0 2024-09-12T17:21:39.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.173+0000 7f5ebeb26800 10 manifest: total_size = 0 2024-09-12T17:21:39.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.173+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.2110286069884144560 2024-09-12T17:21:39.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.173+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def61acd0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x563def638308 s->prefetch_data=0 2024-09-12T17:21:39.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.173+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def638308 2024-09-12T17:21:39.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.173+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.7.0 2024-09-12T17:21:39.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.174+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:21:39.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.175+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def61acd0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x563def638308 s->prefetch_data=0 2024-09-12T17:21:39.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.176+0000 7f5ebeb26800 10 manifest: total_size = 0 2024-09-12T17:21:39.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.176+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.2309840569495986662 2024-09-12T17:21:39.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.176+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def61acd0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x563def638308 s->prefetch_data=0 2024-09-12T17:21:39.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.176+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def638308 2024-09-12T17:21:39.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.176+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.7.0 2024-09-12T17:21:39.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.176+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:21:39.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.178+0000 7f5ebeb26800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:21:39.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.178+0000 7f5ebeb26800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:21:39.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.179+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:21:39.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.179+0000 7f5ebeb26800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:21:39.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.179+0000 7f5ebeb26800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:21:39.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.179+0000 7f5ebeb26800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:21:39.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.179+0000 7f5ebeb26800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:21:39.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.179+0000 7f5ebeb26800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[06eb12d0-49d6-461d-9efe-05d212954deb.4538.7])"; uploads.size()=0; is_truncated=0 2024-09-12T17:21:39.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.180+0000 7f5ebeb26800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-12T17:21:39.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.180+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.181+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:21:39.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.181+0000 7f5ebeb26800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-12T17:21:39.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.181+0000 7f5ebeb26800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-12T17:21:39.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.182+0000 7f5ebeb26800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-12T17:21:39.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.182+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-12T17:21:39.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.182+0000 7f5d9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464310 cookie 94824008857040 notifier 6021 bl.length()=181 2024-09-12T17:21:39.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.185+0000 7f5ebeb26800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.7 from cache 2024-09-12T17:21:39.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.185+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:06eb12d0-49d6-461d-9efe-05d212954deb.4538.7, ofs0, ns] 2024-09-12T17:21:39.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.186+0000 7f5d9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464291 cookie 94824008854832 notifier 6021 bl.length()=238 2024-09-12T17:21:39.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.188+0000 7f5ebeb26800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.7 : miss 2024-09-12T17:21:39.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.188+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.188+0000 7f5ebeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:39.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.188+0000 7f5ebeb26800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.7 info.flags=0x0 2024-09-12T17:21:39.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.188+0000 7f5ebeb26800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/06eb12d0-49d6-461d-9efe-05d212954deb.4538.7 to cache LRU end 2024-09-12T17:21:39.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.190+0000 7f5ebeb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:06eb12d0-49d6-461d-9efe-05d212954deb.4538.8 : miss 2024-09-12T17:21:39.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.190+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.192+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:21:39.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.192+0000 7f5ebeb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:06eb12d0-49d6-461d-9efe-05d212954deb.4538.8 info.flags=0x17 2024-09-12T17:21:39.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.192+0000 7f5ebeb26800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:06eb12d0-49d6-461d-9efe-05d212954deb.4538.8 to cache LRU end 2024-09-12T17:21:39.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.192+0000 7f5ebeb26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:39.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.192+0000 7f5ebeb26800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:21:39.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.192+0000 7f5ebeb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:06eb12d0-49d6-461d-9efe-05d212954deb.4538.8 2024-09-12T17:21:39.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.193+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got __ 2024-09-12T17:21:39.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.193+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:21:39.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.193+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:21:39.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.193+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got obj 2024-09-12T17:21:39.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.193+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def626890 obj=test-client.0-r-test-small-obj-data.2:__ state=0x563def639f88 s->prefetch_data=0 2024-09-12T17:21:39.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.193+0000 7f5ebeb26800 10 manifest: total_size = 38 2024-09-12T17:21:39.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.193+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.11512523228352842011 2024-09-12T17:21:39.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.193+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def626890 obj=test-client.0-r-test-small-obj-data.2:__ state=0x563def639f88 s->prefetch_data=0 2024-09-12T17:21:39.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.193+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def639f88 2024-09-12T17:21:39.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.193+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.8.0 2024-09-12T17:21:39.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.196+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.196+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=38 stripe_ofs=38 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.196+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.11512523228352842011 2024-09-12T17:21:39.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.196+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.196+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.8__shadow_.Z2-nJd9Us8GQSIN_pLOUCW1bSz74xem_0 2024-09-12T17:21:39.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.196+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:21:39.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.196+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.196+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.11512523228352842011 2024-09-12T17:21:39.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.197+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:21:39.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.197+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def626890 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x563def639f88 s->prefetch_data=0 2024-09-12T17:21:39.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.197+0000 7f5ebeb26800 10 manifest: total_size = 527 2024-09-12T17:21:39.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.197+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.1468243804930553256 2024-09-12T17:21:39.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.197+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def626890 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x563def639f88 s->prefetch_data=0 2024-09-12T17:21:39.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.197+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def639f88 2024-09-12T17:21:39.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.197+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.8.0 2024-09-12T17:21:39.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.199+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.199+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.199+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.1468243804930553256 2024-09-12T17:21:39.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.199+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.199+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.8__shadow_.MA7NbW5vPp5jCVthwtcxIWNl1TP0EYv_0 2024-09-12T17:21:39.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.199+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:21:39.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.199+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.199+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.1468243804930553256 2024-09-12T17:21:39.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.200+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:21:39.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.200+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def626890 obj=test-client.0-r-test-small-obj-data.2:___ state=0x563def639f88 s->prefetch_data=0 2024-09-12T17:21:39.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.201+0000 7f5ebeb26800 10 manifest: total_size = 527 2024-09-12T17:21:39.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.201+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.13785760687720410015 2024-09-12T17:21:39.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.201+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def626890 obj=test-client.0-r-test-small-obj-data.2:___ state=0x563def639f88 s->prefetch_data=0 2024-09-12T17:21:39.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.201+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def639f88 2024-09-12T17:21:39.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.201+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.8.0 2024-09-12T17:21:39.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.203+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.203+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.203+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.13785760687720410015 2024-09-12T17:21:39.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.203+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.203+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.8__shadow_.OphHW-OcFZs94kNuVWHKfOqSfBtw72Z_0 2024-09-12T17:21:39.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.203+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:21:39.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.203+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.203+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.13785760687720410015 2024-09-12T17:21:39.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.204+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:21:39.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.204+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def626890 obj=test-client.0-r-test-small-obj-data.2:obj state=0x563def617a98 s->prefetch_data=0 2024-09-12T17:21:39.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.204+0000 7f5ebeb26800 10 manifest: total_size = 524288 2024-09-12T17:21:39.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.204+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.6688935684375787706 2024-09-12T17:21:39.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.204+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def626890 obj=test-client.0-r-test-small-obj-data.2:obj state=0x563def617a98 s->prefetch_data=0 2024-09-12T17:21:39.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.204+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def617a98 2024-09-12T17:21:39.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.204+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.8.0 2024-09-12T17:21:39.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.206+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.206+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.206+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.6688935684375787706 2024-09-12T17:21:39.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.206+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.206+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.8__shadow_.J-mhakxg1ga6A76iPINmaTctTpLUB8V_0 2024-09-12T17:21:39.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.206+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:21:39.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.206+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.206+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.6688935684375787706 2024-09-12T17:21:39.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.207+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:21:39.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.208+0000 7f5ebeb26800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:21:39.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.208+0000 7f5ebeb26800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:21:39.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.208+0000 7f5ebeb26800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:21:39.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.208+0000 7f5ebeb26800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:21:39.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.208+0000 7f5ebeb26800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:21:39.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.208+0000 7f5ebeb26800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:21:39.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.208+0000 7f5ebeb26800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[06eb12d0-49d6-461d-9efe-05d212954deb.4538.8])"; uploads.size()=0; is_truncated=0 2024-09-12T17:21:39.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.209+0000 7f5ebeb26800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-12T17:21:39.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.209+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.210+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:21:39.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.210+0000 7f5ebeb26800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-12T17:21:39.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.210+0000 7f5ebeb26800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-12T17:21:39.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.211+0000 7f5ebeb26800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-12T17:21:39.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.211+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-12T17:21:39.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.211+0000 7f5d9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464311 cookie 94824008857040 notifier 6021 bl.length()=181 2024-09-12T17:21:39.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.214+0000 7f5ebeb26800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:06eb12d0-49d6-461d-9efe-05d212954deb.4538.8 from cache 2024-09-12T17:21:39.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.214+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:06eb12d0-49d6-461d-9efe-05d212954deb.4538.8, ofs0, ns] 2024-09-12T17:21:39.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.214+0000 7f5d9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464292 cookie 94824008854832 notifier 6021 bl.length()=238 2024-09-12T17:21:39.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.220+0000 7f5ebeb26800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/06eb12d0-49d6-461d-9efe-05d212954deb.4538.8 : miss 2024-09-12T17:21:39.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.220+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.221+0000 7f5ebeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:39.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.221+0000 7f5ebeb26800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/06eb12d0-49d6-461d-9efe-05d212954deb.4538.8 info.flags=0x0 2024-09-12T17:21:39.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.221+0000 7f5ebeb26800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/06eb12d0-49d6-461d-9efe-05d212954deb.4538.8 to cache LRU end 2024-09-12T17:21:39.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.223+0000 7f5ebeb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:06eb12d0-49d6-461d-9efe-05d212954deb.4538.9 : miss 2024-09-12T17:21:39.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.223+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.224+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:21:39.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.224+0000 7f5ebeb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:06eb12d0-49d6-461d-9efe-05d212954deb.4538.9 info.flags=0x17 2024-09-12T17:21:39.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.224+0000 7f5ebeb26800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:06eb12d0-49d6-461d-9efe-05d212954deb.4538.9 to cache LRU end 2024-09-12T17:21:39.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.224+0000 7f5ebeb26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:39.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.224+0000 7f5ebeb26800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:21:39.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.224+0000 7f5ebeb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:06eb12d0-49d6-461d-9efe-05d212954deb.4538.9 2024-09-12T17:21:39.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.224+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got __ 2024-09-12T17:21:39.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.224+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:21:39.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.224+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:21:39.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.224+0000 7f5ebeb26800 10 cls_bucket_list_unordered: got obj 2024-09-12T17:21:39.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.224+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def62a730 obj=test-client.0-r-test-small-obj-data.3:__ state=0x563def639f88 s->prefetch_data=0 2024-09-12T17:21:39.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.225+0000 7f5ebeb26800 10 manifest: total_size = 1035 2024-09-12T17:21:39.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.225+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.9776505931903465930 2024-09-12T17:21:39.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.225+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def62a730 obj=test-client.0-r-test-small-obj-data.3:__ state=0x563def639f88 s->prefetch_data=0 2024-09-12T17:21:39.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.225+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def639f88 2024-09-12T17:21:39.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.225+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.9.0 2024-09-12T17:21:39.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.227+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.227+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.227+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.9776505931903465930 2024-09-12T17:21:39.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.227+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.227+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.9__shadow_.bUSCPVw8Dshqtlo35DB0UpYY3jtCQkH_0 2024-09-12T17:21:39.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.227+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:21:39.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.227+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.227+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.9776505931903465930 2024-09-12T17:21:39.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.228+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:21:39.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.228+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def62a730 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x563def639f88 s->prefetch_data=0 2024-09-12T17:21:39.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.229+0000 7f5ebeb26800 10 manifest: total_size = 55 2024-09-12T17:21:39.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.229+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.7054605069273555136 2024-09-12T17:21:39.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.229+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def62a730 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x563def639f88 s->prefetch_data=0 2024-09-12T17:21:39.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.229+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def639f88 2024-09-12T17:21:39.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.229+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.9.0 2024-09-12T17:21:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.231+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.231+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.231+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.7054605069273555136 2024-09-12T17:21:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.231+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.231+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.9__shadow_.Uzt2cq06NXazJ1Htd-DVG09vRjkfOnH_0 2024-09-12T17:21:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.231+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:21:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.231+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.231+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.7054605069273555136 2024-09-12T17:21:39.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.232+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:21:39.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.232+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def62a730 obj=test-client.0-r-test-small-obj-data.3:___ state=0x563def639f88 s->prefetch_data=0 2024-09-12T17:21:39.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.232+0000 7f5ebeb26800 10 manifest: total_size = 1048576 2024-09-12T17:21:39.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.232+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.6772287774818429444 2024-09-12T17:21:39.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.232+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def62a730 obj=test-client.0-r-test-small-obj-data.3:___ state=0x563def639f88 s->prefetch_data=0 2024-09-12T17:21:39.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.232+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def639f88 2024-09-12T17:21:39.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.232+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.9.0 2024-09-12T17:21:39.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.234+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.234+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.234+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.6772287774818429444 2024-09-12T17:21:39.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.234+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.234+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.9__shadow_.RA2kZMqk3TknVgKysl9LAZLxPHwH7g2_0 2024-09-12T17:21:39.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.234+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:21:39.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.234+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.234+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.6772287774818429444 2024-09-12T17:21:39.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.236+0000 7f5d9d7fa640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:21:39.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.236+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def62a730 obj=test-client.0-r-test-small-obj-data.3:obj state=0x563def617a98 s->prefetch_data=0 2024-09-12T17:21:39.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.236+0000 7f5ebeb26800 10 manifest: total_size = 1048576 2024-09-12T17:21:39.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.236+0000 7f5ebeb26800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.15694438184546819403 2024-09-12T17:21:39.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.236+0000 7f5ebeb26800 20 get_obj_state: octx=0x563def62a730 obj=test-client.0-r-test-small-obj-data.3:obj state=0x563def617a98 s->prefetch_data=0 2024-09-12T17:21:39.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.236+0000 7f5ebeb26800 20 prepare_atomic_modification: state is not atomic. state=0x563def617a98 2024-09-12T17:21:39.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.236+0000 7f5ebeb26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.9.0 2024-09-12T17:21:39.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.238+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:21:39.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.238+0000 7f5ebeb26800 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-09-12T17:21:39.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.238+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.15694438184546819403 2024-09-12T17:21:39.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.238+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:21:39.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.238+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.9__shadow_.mHZca3aHkFxPEnwfbkkN2w5FDSZcDbv_0 2024-09-12T17:21:39.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.238+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:21:39.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.238+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:21:39.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.238+0000 7f5ebeb26800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.15694438184546819403 2024-09-12T17:21:39.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.239+0000 7f5d9dffb640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:21:39.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.239+0000 7f5ebeb26800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:21:39.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.239+0000 7f5ebeb26800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:21:39.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.240+0000 7f5ebeb26800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:21:39.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.240+0000 7f5ebeb26800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:21:39.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.240+0000 7f5ebeb26800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:21:39.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.240+0000 7f5ebeb26800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:21:39.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.240+0000 7f5ebeb26800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[06eb12d0-49d6-461d-9efe-05d212954deb.4538.9])"; uploads.size()=0; is_truncated=0 2024-09-12T17:21:39.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.241+0000 7f5ebeb26800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-12T17:21:39.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.241+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.242+0000 7f5ebeb26800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:21:39.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.242+0000 7f5ebeb26800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-12T17:21:39.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.242+0000 7f5ebeb26800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-12T17:21:39.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.243+0000 7f5ebeb26800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-12T17:21:39.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.243+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-12T17:21:39.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.243+0000 7f5d9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464312 cookie 94824008857040 notifier 6021 bl.length()=181 2024-09-12T17:21:39.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.246+0000 7f5ebeb26800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:06eb12d0-49d6-461d-9efe-05d212954deb.4538.9 from cache 2024-09-12T17:21:39.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.246+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:06eb12d0-49d6-461d-9efe-05d212954deb.4538.9, ofs0, ns] 2024-09-12T17:21:39.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.246+0000 7f5d9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464293 cookie 94824008854832 notifier 6021 bl.length()=238 2024-09-12T17:21:39.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.248+0000 7f5ebeb26800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/06eb12d0-49d6-461d-9efe-05d212954deb.4538.9 : miss 2024-09-12T17:21:39.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.248+0000 7f5ebeb26800 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.249+0000 7f5ebeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:39.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.249+0000 7f5ebeb26800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/06eb12d0-49d6-461d-9efe-05d212954deb.4538.9 info.flags=0x0 2024-09-12T17:21:39.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.249+0000 7f5ebeb26800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/06eb12d0-49d6-461d-9efe-05d212954deb.4538.9 to cache LRU end 2024-09-12T17:21:39.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.251+0000 7f5ebeb26800 10 removing key index: URVGDGXDAUHEWWNGIFEL 2024-09-12T17:21:39.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.251+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:URVGDGXDAUHEWWNGIFEL, ofs0, ns] 2024-09-12T17:21:39.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.252+0000 7f5d9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464280 cookie 94824008885328 notifier 6021 bl.length()=170 2024-09-12T17:21:39.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.253+0000 7f5ebeb26800 10 removing email index: ragweed.client.0+test@test.test 2024-09-12T17:21:39.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.254+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T17:21:39.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.254+0000 7f5d9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464281 cookie 94824008885328 notifier 6021 bl.length()=182 2024-09-12T17:21:39.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.255+0000 7f5ebeb26800 10 removing user buckets index 2024-09-12T17:21:39.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.256+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-12T17:21:39.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.256+0000 7f5d9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464325 cookie 94824008898000 notifier 6021 bl.length()=173 2024-09-12T17:21:39.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.258+0000 7f5ebeb26800 10 removing user index: ragweed.client.0 2024-09-12T17:21:39.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.259+0000 7f5ebeb26800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-12T17:21:39.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.259+0000 7f5ebeb26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T17:21:39.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.259+0000 7f5d9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464294 cookie 94824008891024 notifier 6021 bl.length()=165 2024-09-12T17:21:39.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.262+0000 7f5d70fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:39.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.265+0000 7f5ebeb26800 20 remove_watcher() i=0 2024-09-12T17:21:39.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.265+0000 7f5ebeb26800 2 removed watcher, disabling cache 2024-09-12T17:21:39.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.267+0000 7f5ebeb26800 20 remove_watcher() i=1 2024-09-12T17:21:39.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.268+0000 7f5ebeb26800 20 remove_watcher() i=2 2024-09-12T17:21:39.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.269+0000 7f5ebeb26800 20 remove_watcher() i=3 2024-09-12T17:21:39.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.270+0000 7f5ebeb26800 20 remove_watcher() i=4 2024-09-12T17:21:39.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.271+0000 7f5ebeb26800 20 remove_watcher() i=5 2024-09-12T17:21:39.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.272+0000 7f5ebeb26800 20 remove_watcher() i=6 2024-09-12T17:21:39.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.273+0000 7f5ebeb26800 20 remove_watcher() i=7 2024-09-12T17:21:39.285 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-12T17:21:39.386 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:39.386 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:39.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.622+0000 7f66fa5af800 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.624+0000 7f66fa5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:39.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.624+0000 7f66fa5af800 20 realm 2024-09-12T17:21:39.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.624+0000 7f66fa5af800 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.624+0000 7f66fa5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:39.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.624+0000 7f66fa5af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:39.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.624+0000 7f66fa5af800 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.625+0000 7f66fa5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:39.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.625+0000 7f66fa5af800 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.625+0000 7f66fa5af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:39.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.625+0000 7f66fa5af800 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.626+0000 7f66fa5af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:39.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.626+0000 7f66fa5af800 20 searching for the correct realm 2024-09-12T17:21:39.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.628+0000 7f66f789f640 0 -- 172.21.15.67:0/1084015198 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f66e8035c60 msgr2=0x7f66e804e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:39.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:39.835+0000 7f66f80a0640 0 -- 172.21.15.67:0/1084015198 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f66e008f4c0 msgr2=0x7f66e00c3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:40.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.041+0000 7f66fa5af800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:21:40.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.041+0000 7f66fa5af800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:21:40.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.041+0000 7f66fa5af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:40.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.041+0000 7f66fa5af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:40.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.041+0000 7f66fa5af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:40.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.041+0000 7f66fa5af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:40.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.041+0000 7f66fa5af800 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.042+0000 7f66fa5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:40.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.042+0000 7f66fa5af800 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.042+0000 7f66fa5af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:40.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.042+0000 7f66fa5af800 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.043+0000 7f66fa5af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:40.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.043+0000 7f66fa5af800 20 zone default found 2024-09-12T17:21:40.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.043+0000 7f66fa5af800 4 Realm: () 2024-09-12T17:21:40.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.043+0000 7f66fa5af800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:21:40.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.043+0000 7f66fa5af800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:21:40.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.043+0000 7f66fa5af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:40.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.043+0000 7f66fa5af800 20 zonegroup default 2024-09-12T17:21:40.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.043+0000 7f66fa5af800 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.043+0000 7f66fa5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:40.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.043+0000 7f66fa5af800 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.043+0000 7f66fa5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:40.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.043+0000 7f66fa5af800 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.044+0000 7f66fa5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:40.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.044+0000 7f66fa5af800 20 started sync module instance, tier type = 2024-09-12T17:21:40.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.044+0000 7f66fa5af800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:21:40.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.054+0000 7f66fa5af800 20 add_watcher() i=0 2024-09-12T17:21:40.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.054+0000 7f66fa5af800 20 add_watcher() i=1 2024-09-12T17:21:40.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.054+0000 7f66fa5af800 20 add_watcher() i=2 2024-09-12T17:21:40.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.054+0000 7f66fa5af800 20 add_watcher() i=3 2024-09-12T17:21:40.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.054+0000 7f66fa5af800 20 add_watcher() i=4 2024-09-12T17:21:40.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.054+0000 7f66fa5af800 20 add_watcher() i=5 2024-09-12T17:21:40.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.054+0000 7f66fa5af800 20 add_watcher() i=6 2024-09-12T17:21:40.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.055+0000 7f66fa5af800 20 add_watcher() i=7 2024-09-12T17:21:40.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.055+0000 7f66fa5af800 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:40.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.057+0000 7f65aefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:40.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.057+0000 7f66fa5af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:40.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.057+0000 7f66fa5af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:40.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.094+0000 7f65adfdb640 20 reqs_thread_entry: start 2024-09-12T17:21:40.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.095+0000 7f66fa5af800 20 init_complete bucket index max shards: 1 2024-09-12T17:21:40.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.095+0000 7f66fa5af800 20 Filter name: none 2024-09-12T17:21:40.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.095+0000 7f651f7fe640 20 reqs_thread_entry: start 2024-09-12T17:21:40.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.095+0000 7f66fa5af800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T17:21:40.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.095+0000 7f66fa5af800 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.096+0000 7f66fa5af800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T17:21:40.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.096+0000 7f66fa5af800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-12T17:21:40.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.096+0000 7f66fa5af800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:21:40.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.096+0000 7f66fa5af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:40.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.096+0000 7f66fa5af800 10 removing key index: BIMIRUXGBRMSACGOZPNI 2024-09-12T17:21:40.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.097+0000 7f66fa5af800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.keys:BIMIRUXGBRMSACGOZPNI, ofs0, ns] 2024-09-12T17:21:40.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.097+0000 7f65cf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464295 cookie 94612528903968 notifier 6039 bl.length()=170 2024-09-12T17:21:40.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.099+0000 7f66fa5af800 10 removing email index: sysuser.client.0+test@test.test 2024-09-12T17:21:40.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.100+0000 7f66fa5af800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T17:21:40.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.100+0000 7f65cf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464296 cookie 94612528903968 notifier 6039 bl.length()=182 2024-09-12T17:21:40.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.102+0000 7f66fa5af800 10 removing user buckets index 2024-09-12T17:21:40.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.103+0000 7f66fa5af800 10 removing user index: sysuser.client.0 2024-09-12T17:21:40.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.104+0000 7f66fa5af800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-12T17:21:40.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.104+0000 7f66fa5af800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T17:21:40.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.104+0000 7f65cf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464282 cookie 94612528905648 notifier 6039 bl.length()=165 2024-09-12T17:21:40.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.106+0000 7f65aefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:40.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.109+0000 7f66fa5af800 20 remove_watcher() i=0 2024-09-12T17:21:40.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.109+0000 7f66fa5af800 2 removed watcher, disabling cache 2024-09-12T17:21:40.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.110+0000 7f66fa5af800 20 remove_watcher() i=1 2024-09-12T17:21:40.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.111+0000 7f66fa5af800 20 remove_watcher() i=2 2024-09-12T17:21:40.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.112+0000 7f66fa5af800 20 remove_watcher() i=3 2024-09-12T17:21:40.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.113+0000 7f66fa5af800 20 remove_watcher() i=4 2024-09-12T17:21:40.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.114+0000 7f66fa5af800 20 remove_watcher() i=5 2024-09-12T17:21:40.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.115+0000 7f66fa5af800 20 remove_watcher() i=6 2024-09-12T17:21:40.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:21:40.116+0000 7f66fa5af800 20 remove_watcher() i=7 2024-09-12T17:21:40.129 INFO:tasks.ragweed:Removing ragweed... 2024-09-12T17:21:40.129 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:21:40.216 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:21:40.227 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:21:40.228 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:21:40.228 DEBUG:teuthology.orchestra.run.smithi067:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:21:40.261 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:21:40.261 INFO:teuthology.orchestra.run.smithi067.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:21:40.262 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:21:40.331 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:21:40.332 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:21:40.400 INFO:tasks.workunit:timeout=3h 2024-09-12T17:21:40.401 INFO:tasks.workunit:cleanup=True 2024-09-12T17:21:40.401 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:21:40.471 INFO:tasks.workunit.client.0.smithi067.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:22:40.375 INFO:tasks.workunit.client.0.smithi067.stderr:Updating files: 93% (11856/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:22:41.049 INFO:tasks.workunit.client.0.smithi067.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:22:41.049 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:22:41.049 INFO:tasks.workunit.client.0.smithi067.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:22:41.049 INFO:tasks.workunit.client.0.smithi067.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:22:41.050 INFO:tasks.workunit.client.0.smithi067.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:22:41.050 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:22:41.050 INFO:tasks.workunit.client.0.smithi067.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:22:41.050 INFO:tasks.workunit.client.0.smithi067.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:22:41.050 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:22:41.050 INFO:tasks.workunit.client.0.smithi067.stderr: git switch -c 2024-09-12T17:22:41.050 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:22:41.050 INFO:tasks.workunit.client.0.smithi067.stderr:Or undo this operation with: 2024-09-12T17:22:41.050 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:22:41.050 INFO:tasks.workunit.client.0.smithi067.stderr: git switch - 2024-09-12T17:22:41.050 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:22:41.050 INFO:tasks.workunit.client.0.smithi067.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:22:41.050 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:22:41.050 INFO:tasks.workunit.client.0.smithi067.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:22:41.055 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:22:41.125 INFO:tasks.workunit.client.0.smithi067.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:22:41.127 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:22:41.127 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:22:41.178 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:22:41.228 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:22:41.268 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:22:41.270 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:22:41.270 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:22:41.309 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:22:41.313 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T17:22:41.313 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:22:41.384 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-12T17:22:41.386 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-12T17:22:41.386 DEBUG:teuthology.orchestra.run.smithi067:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T17:22:41.459 INFO:tasks.workunit.client.0.smithi067.stderr:+ ulimit -c 0 2024-09-12T17:22:41.460 INFO:tasks.workunit.client.0.smithi067.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T17:22:41.460 INFO:tasks.workunit.client.0.smithi067.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:22:41.460 INFO:tasks.workunit.client.0.smithi067.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:22:43.845 INFO:tasks.workunit.client.0.smithi067.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T17:22:43.845 INFO:tasks.workunit.client.0.smithi067.stderr:++ deactivate nondestructive 2024-09-12T17:22:43.845 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T17:22:43.845 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T17:22:43.845 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:22:43.845 INFO:tasks.workunit.client.0.smithi067.stderr:++ hash -r 2024-09-12T17:22:43.845 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T17:22:43.845 INFO:tasks.workunit.client.0.smithi067.stderr:++ unset VIRTUAL_ENV 2024-09-12T17:22:43.845 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T17:22:43.845 INFO:tasks.workunit.client.0.smithi067.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:22:43.846 INFO:tasks.workunit.client.0.smithi067.stderr:++ export VIRTUAL_ENV 2024-09-12T17:22:43.846 INFO:tasks.workunit.client.0.smithi067.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:22:43.846 INFO:tasks.workunit.client.0.smithi067.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:22:43.846 INFO:tasks.workunit.client.0.smithi067.stderr:++ export PATH 2024-09-12T17:22:43.846 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T17:22:43.846 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -z '' ']' 2024-09-12T17:22:43.846 INFO:tasks.workunit.client.0.smithi067.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T17:22:43.846 INFO:tasks.workunit.client.0.smithi067.stderr:++ PS1='(rgw) ' 2024-09-12T17:22:43.846 INFO:tasks.workunit.client.0.smithi067.stderr:++ export PS1 2024-09-12T17:22:43.846 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:22:43.846 INFO:tasks.workunit.client.0.smithi067.stderr:++ hash -r 2024-09-12T17:22:43.846 INFO:tasks.workunit.client.0.smithi067.stderr:+ pip install pip --upgrade 2024-09-12T17:22:44.082 INFO:tasks.workunit.client.0.smithi067.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T17:22:44.265 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting pip 2024-09-12T17:22:44.271 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:22:44.317 INFO:tasks.workunit.client.0.smithi067.stdout:Installing collected packages: pip 2024-09-12T17:22:44.318 INFO:tasks.workunit.client.0.smithi067.stdout: Attempting uninstall: pip 2024-09-12T17:22:44.318 INFO:tasks.workunit.client.0.smithi067.stdout: Found existing installation: pip 21.3.1 2024-09-12T17:22:44.482 INFO:tasks.workunit.client.0.smithi067.stdout: Uninstalling pip-21.3.1: 2024-09-12T17:22:44.487 INFO:tasks.workunit.client.0.smithi067.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T17:22:45.269 INFO:tasks.workunit.client.0.smithi067.stdout:Successfully installed pip-24.2 2024-09-12T17:22:45.319 INFO:tasks.workunit.client.0.smithi067.stderr:+ pip install boto3 2024-09-12T17:22:46.144 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting boto3 2024-09-12T17:22:46.145 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:22:46.714 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:22:46.715 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:22:46.771 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:22:46.772 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:22:46.827 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:22:46.828 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:22:46.877 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:22:46.878 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:22:46.955 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:22:46.957 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T17:22:47.091 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:22:47.092 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:22:47.096 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:22:47.098 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:22:47.107 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:22:47.109 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:22:47.110 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:22:47.111 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T17:22:47.113 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:22:47.189 INFO:tasks.workunit.client.0.smithi067.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:22:48.254 INFO:tasks.workunit.client.0.smithi067.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T17:22:48.371 INFO:tasks.workunit.client.0.smithi067.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-12T17:22:48.499 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-12T17:22:48.534 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:48.534 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:48.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.573+0000 7fb578211800 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.574+0000 7fb578211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:48.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.574+0000 7fb578211800 20 realm 2024-09-12T17:22:48.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.574+0000 7fb578211800 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.575+0000 7fb578211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:48.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.575+0000 7fb578211800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:22:48.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.575+0000 7fb578211800 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.575+0000 7fb578211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:48.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.575+0000 7fb578211800 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.576+0000 7fb578211800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:48.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.576+0000 7fb578211800 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.577+0000 7fb578211800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:22:48.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.577+0000 7fb578211800 20 searching for the correct realm 2024-09-12T17:22:48.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.579+0000 7fb573922640 0 -- 172.21.15.67:0/248862883 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7fb56c061040 msgr2=0x7fb56c0b3f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:48.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.583+0000 7fb573922640 0 -- 172.21.15.67:0/248862883 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fb5680722f0 msgr2=0x7fb568067970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:22:48.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.791+0000 7fb578211800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:22:48.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.791+0000 7fb578211800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:22:48.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.791+0000 7fb578211800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:22:48.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.791+0000 7fb578211800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:22:48.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.791+0000 7fb578211800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:22:48.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.791+0000 7fb578211800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:22:48.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.791+0000 7fb578211800 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.791+0000 7fb578211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:48.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.791+0000 7fb578211800 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.792+0000 7fb578211800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:48.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.792+0000 7fb578211800 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.792+0000 7fb578211800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:22:48.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.792+0000 7fb578211800 20 zone default found 2024-09-12T17:22:48.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.792+0000 7fb578211800 4 Realm: () 2024-09-12T17:22:48.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.792+0000 7fb578211800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:22:48.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.792+0000 7fb578211800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:22:48.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.792+0000 7fb578211800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:22:48.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.792+0000 7fb578211800 20 zonegroup default 2024-09-12T17:22:48.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.792+0000 7fb578211800 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.792+0000 7fb578211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:48.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.792+0000 7fb578211800 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.793+0000 7fb578211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:48.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.793+0000 7fb578211800 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.793+0000 7fb578211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:48.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.793+0000 7fb578211800 20 started sync module instance, tier type = 2024-09-12T17:22:48.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.793+0000 7fb578211800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:22:48.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.803+0000 7fb578211800 20 add_watcher() i=0 2024-09-12T17:22:48.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.803+0000 7fb578211800 20 add_watcher() i=1 2024-09-12T17:22:48.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.803+0000 7fb578211800 20 add_watcher() i=2 2024-09-12T17:22:48.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.803+0000 7fb578211800 20 add_watcher() i=3 2024-09-12T17:22:48.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.803+0000 7fb578211800 20 add_watcher() i=4 2024-09-12T17:22:48.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.803+0000 7fb578211800 20 add_watcher() i=5 2024-09-12T17:22:48.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.803+0000 7fb578211800 20 add_watcher() i=6 2024-09-12T17:22:48.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.804+0000 7fb578211800 20 add_watcher() i=7 2024-09-12T17:22:48.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.804+0000 7fb578211800 2 all 8 watchers are set, enabling cache 2024-09-12T17:22:48.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.806+0000 7fb429fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:48.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.807+0000 7fb578211800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:48.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.807+0000 7fb578211800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:48.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.807+0000 7fb578211800 5 note: GC not initialized 2024-09-12T17:22:48.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.807+0000 7fb428fe1640 20 reqs_thread_entry: start 2024-09-12T17:22:48.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.807+0000 7fb578211800 20 init_complete bucket index max shards: 1 2024-09-12T17:22:48.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.807+0000 7fb578211800 20 Filter name: none 2024-09-12T17:22:48.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.807+0000 7fb3a27fc640 20 reqs_thread_entry: start 2024-09-12T17:22:48.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.807+0000 7fb578211800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-12T17:22:48.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.807+0000 7fb578211800 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.808+0000 7fb578211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:48.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.808+0000 7fb578211800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-12T17:22:48.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.808+0000 7fb578211800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T17:22:48.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.808+0000 7fb578211800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T17:22:48.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.808+0000 7fb578211800 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.808+0000 7fb578211800 20 rados_obj.operate() r=0 bl.length=22 2024-09-12T17:22:48.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.808+0000 7fb578211800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x5 2024-09-12T17:22:48.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.808+0000 7fb578211800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T17:22:48.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.808+0000 7fb578211800 10 cache get: name=default.rgw.meta+users.uid+rgw_datacache_user : miss 2024-09-12T17:22:48.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.808+0000 7fb578211800 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.809+0000 7fb578211800 20 rados_obj.operate() r=0 bl.length=420 2024-09-12T17:22:48.815 INFO:tasks.workunit.client.0.smithi067.stderr:could not create user: unable to parse parameters, duplicate key provided 2024-09-12T17:22:48.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.809+0000 7fb578211800 10 cache put: name=default.rgw.meta+users.uid+rgw_datacache_user info.flags=0x13 2024-09-12T17:22:48.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.809+0000 7fb578211800 10 adding default.rgw.meta+users.uid+rgw_datacache_user to cache LRU end 2024-09-12T17:22:48.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.809+0000 7fb578211800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:22:48.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.809+0000 7fb578211800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+rgw_datacache_user 2024-09-12T17:22:48.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.809+0000 7fb578211800 20 get_user_info_from_index found 0 xattrs 2024-09-12T17:22:48.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.810+0000 7fb429fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:48.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.812+0000 7fb578211800 20 remove_watcher() i=0 2024-09-12T17:22:48.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.812+0000 7fb578211800 2 removed watcher, disabling cache 2024-09-12T17:22:48.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.813+0000 7fb578211800 20 remove_watcher() i=1 2024-09-12T17:22:48.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.814+0000 7fb578211800 20 remove_watcher() i=2 2024-09-12T17:22:48.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.815+0000 7fb578211800 20 remove_watcher() i=3 2024-09-12T17:22:48.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.816+0000 7fb578211800 20 remove_watcher() i=4 2024-09-12T17:22:48.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.817+0000 7fb578211800 20 remove_watcher() i=5 2024-09-12T17:22:48.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.818+0000 7fb578211800 20 remove_watcher() i=6 2024-09-12T17:22:48.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:22:48.819+0000 7fb578211800 20 remove_watcher() i=7 2024-09-12T17:23:05.810 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:05.810 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:05.859 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:05.859 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:05.900 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:05.901 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:05.941 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:05.941 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:05.974 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:05.974 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:06.034 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:06.035 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:06.091 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard add 2024-09-12T17:23:06.091 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:06.092 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:23:06.121 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:06.121 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:06.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.160+0000 7fe0d5b1f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.162+0000 7fe0d5b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.162+0000 7fe0d5b1f800 20 realm 2024-09-12T17:23:06.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.162+0000 7fe0d5b1f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.162+0000 7fe0d5b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.162+0000 7fe0d5b1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:06.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.162+0000 7fe0d5b1f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.162+0000 7fe0d5b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.162+0000 7fe0d5b1f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.163+0000 7fe0d5b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:06.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.163+0000 7fe0d5b1f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.164+0000 7fe0d5b1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:06.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.164+0000 7fe0d5b1f800 20 searching for the correct realm 2024-09-12T17:23:06.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.166+0000 7fe0d100b640 0 -- 172.21.15.67:0/3418420105 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x5576d168faa0 msgr2=0x5576d1691e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:06.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.170+0000 7fe0d180c640 0 -- 172.21.15.67:0/3418420105 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fe0c8072a70 msgr2=0x7fe0c8083890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:06.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.376+0000 7fe0d5b1f800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:06.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.376+0000 7fe0d5b1f800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:06.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.376+0000 7fe0d5b1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:06.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.376+0000 7fe0d5b1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:06.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.376+0000 7fe0d5b1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:06.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.376+0000 7fe0d5b1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:06.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.376+0000 7fe0d5b1f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.376+0000 7fe0d5b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.376+0000 7fe0d5b1f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.376+0000 7fe0d5b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:06.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.376+0000 7fe0d5b1f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.377+0000 7fe0d5b1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:06.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.377+0000 7fe0d5b1f800 20 zone default found 2024-09-12T17:23:06.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.377+0000 7fe0d5b1f800 4 Realm: () 2024-09-12T17:23:06.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.377+0000 7fe0d5b1f800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:06.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.377+0000 7fe0d5b1f800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:06.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.377+0000 7fe0d5b1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:06.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.377+0000 7fe0d5b1f800 20 zonegroup default 2024-09-12T17:23:06.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.377+0000 7fe0d5b1f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.377+0000 7fe0d5b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.377+0000 7fe0d5b1f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.378+0000 7fe0d5b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.378+0000 7fe0d5b1f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.378+0000 7fe0d5b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.378+0000 7fe0d5b1f800 20 started sync module instance, tier type = 2024-09-12T17:23:06.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.378+0000 7fe0d5b1f800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:06.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.388+0000 7fe0d5b1f800 20 add_watcher() i=0 2024-09-12T17:23:06.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.388+0000 7fe0d5b1f800 20 add_watcher() i=1 2024-09-12T17:23:06.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.388+0000 7fe0d5b1f800 20 add_watcher() i=2 2024-09-12T17:23:06.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.388+0000 7fe0d5b1f800 20 add_watcher() i=3 2024-09-12T17:23:06.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.388+0000 7fe0d5b1f800 20 add_watcher() i=4 2024-09-12T17:23:06.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.388+0000 7fe0d5b1f800 20 add_watcher() i=5 2024-09-12T17:23:06.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.388+0000 7fe0d5b1f800 20 add_watcher() i=6 2024-09-12T17:23:06.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.389+0000 7fe0d5b1f800 20 add_watcher() i=7 2024-09-12T17:23:06.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.389+0000 7fe0d5b1f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:06.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.391+0000 7fdf837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:06.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.391+0000 7fe0d5b1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:06.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.391+0000 7fe0d5b1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:06.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.391+0000 7fe0d5b1f800 5 note: GC not initialized 2024-09-12T17:23:06.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.392+0000 7fdf827fc640 20 reqs_thread_entry: start 2024-09-12T17:23:06.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.392+0000 7fe0d5b1f800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:06.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.392+0000 7fe0d5b1f800 20 Filter name: none 2024-09-12T17:23:06.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.392+0000 7fdef3fff640 20 reqs_thread_entry: start 2024-09-12T17:23:06.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.392+0000 7fe0d5b1f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.393+0000 7fe0d5b1f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:23:06.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.393+0000 7fe0d5b1f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.393+0000 7fe0d5b1f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:23:06.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.393+0000 7fe0d5b1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:06.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.393+0000 7fe0d5b1f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.394+0000 7fe0d5b1f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:23:06.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.394+0000 7fe0d5b1f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.394+0000 7fe0d5b1f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:23:06.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.394+0000 7fe0d5b1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:06.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.395+0000 7fdf837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:06.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.398+0000 7fe0d5b1f800 20 remove_watcher() i=0 2024-09-12T17:23:06.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.398+0000 7fe0d5b1f800 2 removed watcher, disabling cache 2024-09-12T17:23:06.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.399+0000 7fe0d5b1f800 20 remove_watcher() i=1 2024-09-12T17:23:06.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.400+0000 7fe0d5b1f800 20 remove_watcher() i=2 2024-09-12T17:23:06.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.401+0000 7fe0d5b1f800 20 remove_watcher() i=3 2024-09-12T17:23:06.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.402+0000 7fe0d5b1f800 20 remove_watcher() i=4 2024-09-12T17:23:06.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.403+0000 7fe0d5b1f800 20 remove_watcher() i=5 2024-09-12T17:23:06.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.404+0000 7fe0d5b1f800 20 remove_watcher() i=6 2024-09-12T17:23:06.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.405+0000 7fe0d5b1f800 20 remove_watcher() i=7 2024-09-12T17:23:06.418 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:06.418 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:23:06.418 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: a-bucket id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-12T17:23:06.418 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:06.419 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 2 2024-09-12T17:23:06.451 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:06.451 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:06.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.489+0000 7f344c20e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.491+0000 7f344c20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.491+0000 7f344c20e800 20 realm 2024-09-12T17:23:06.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.491+0000 7f344c20e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.491+0000 7f344c20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.491+0000 7f344c20e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:06.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.491+0000 7f344c20e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.491+0000 7f344c20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.491+0000 7f344c20e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.492+0000 7f344c20e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:06.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.492+0000 7f344c20e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.493+0000 7f344c20e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:06.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.493+0000 7f344c20e800 20 searching for the correct realm 2024-09-12T17:23:06.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.496+0000 7f344796b640 0 -- 172.21.15.67:0/3811936100 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f344009d120 msgr2=0x7f344006dac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:06.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.499+0000 7f344796b640 0 -- 172.21.15.67:0/3811936100 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f343c00bc20 msgr2=0x7f343c0413f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:06.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.705+0000 7f344c20e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:06.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.705+0000 7f344c20e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:06.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.705+0000 7f344c20e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:06.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.705+0000 7f344c20e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:06.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.705+0000 7f344c20e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:06.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.705+0000 7f344c20e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:06.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.705+0000 7f344c20e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.705+0000 7f344c20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.705+0000 7f344c20e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.706+0000 7f344c20e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:06.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.706+0000 7f344c20e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.706+0000 7f344c20e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:06.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.706+0000 7f344c20e800 20 zone default found 2024-09-12T17:23:06.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.706+0000 7f344c20e800 4 Realm: () 2024-09-12T17:23:06.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.706+0000 7f344c20e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:06.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.706+0000 7f344c20e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:06.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.706+0000 7f344c20e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:06.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.706+0000 7f344c20e800 20 zonegroup default 2024-09-12T17:23:06.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.706+0000 7f344c20e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.706+0000 7f344c20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.706+0000 7f344c20e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.707+0000 7f344c20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.707+0000 7f344c20e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.707+0000 7f344c20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.707+0000 7f344c20e800 20 started sync module instance, tier type = 2024-09-12T17:23:06.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.707+0000 7f344c20e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:06.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.717+0000 7f344c20e800 20 add_watcher() i=0 2024-09-12T17:23:06.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.717+0000 7f344c20e800 20 add_watcher() i=1 2024-09-12T17:23:06.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.717+0000 7f344c20e800 20 add_watcher() i=2 2024-09-12T17:23:06.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.717+0000 7f344c20e800 20 add_watcher() i=3 2024-09-12T17:23:06.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.717+0000 7f344c20e800 20 add_watcher() i=4 2024-09-12T17:23:06.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.717+0000 7f344c20e800 20 add_watcher() i=5 2024-09-12T17:23:06.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.717+0000 7f344c20e800 20 add_watcher() i=6 2024-09-12T17:23:06.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.718+0000 7f344c20e800 20 add_watcher() i=7 2024-09-12T17:23:06.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.718+0000 7f344c20e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:06.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.719+0000 7f32fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:06.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.719+0000 7f344c20e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:06.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.719+0000 7f344c20e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:06.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.720+0000 7f344c20e800 5 note: GC not initialized 2024-09-12T17:23:06.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.720+0000 7f32fcfe1640 20 reqs_thread_entry: start 2024-09-12T17:23:06.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.720+0000 7f344c20e800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:06.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.720+0000 7f344c20e800 20 Filter name: none 2024-09-12T17:23:06.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.720+0000 7f32767fc640 20 reqs_thread_entry: start 2024-09-12T17:23:06.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.720+0000 7f344c20e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:23:06.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.720+0000 7f344c20e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.721+0000 7f344c20e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:23:06.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.721+0000 7f344c20e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:23:06.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.721+0000 7f344c20e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:23:06.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.721+0000 7f344c20e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : miss 2024-09-12T17:23:06.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.721+0000 7f344c20e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.721+0000 7f344c20e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:23:06.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.721+0000 7f344c20e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:23:06.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.721+0000 7f344c20e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:23:06.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.721+0000 7f344c20e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:06.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.721+0000 7f344c20e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:23:06.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.721+0000 7f344c20e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:23:06.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.723+0000 7f32fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:06.726 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.726+0000 7f344c20e800 20 remove_watcher() i=0 2024-09-12T17:23:06.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.726+0000 7f344c20e800 2 removed watcher, disabling cache 2024-09-12T17:23:06.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.727+0000 7f344c20e800 20 remove_watcher() i=1 2024-09-12T17:23:06.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.728+0000 7f344c20e800 20 remove_watcher() i=2 2024-09-12T17:23:06.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.729+0000 7f344c20e800 20 remove_watcher() i=3 2024-09-12T17:23:06.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.730+0000 7f344c20e800 20 remove_watcher() i=4 2024-09-12T17:23:06.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.731+0000 7f344c20e800 20 remove_watcher() i=5 2024-09-12T17:23:06.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.732+0000 7f344c20e800 20 remove_watcher() i=6 2024-09-12T17:23:06.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.733+0000 7f344c20e800 20 remove_watcher() i=7 2024-09-12T17:23:06.747 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin reshard list 2024-09-12T17:23:06.774 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:06.775 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:06.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.813+0000 7fbd86413800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.815+0000 7fbd86413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.815+0000 7fbd86413800 20 realm 2024-09-12T17:23:06.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.815+0000 7fbd86413800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.815+0000 7fbd86413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.815+0000 7fbd86413800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:06.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.815+0000 7fbd86413800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.815+0000 7fbd86413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.815+0000 7fbd86413800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.816+0000 7fbd86413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:06.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.816+0000 7fbd86413800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.817+0000 7fbd86413800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:06.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.817+0000 7fbd86413800 20 searching for the correct realm 2024-09-12T17:23:06.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.820+0000 7fbd81321640 0 -- 172.21.15.67:0/384384682 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x559d1d7f9550 msgr2=0x559d1d7fb940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:06.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.824+0000 7fbd82323640 0 -- 172.21.15.67:0/384384682 >> [v2:172.21.15.118:6824/1070975205,v1:172.21.15.118:6825/1070975205] conn(0x7fbd78039420 msgr2=0x7fbd780398a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:06.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.828+0000 7fbd86413800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:06.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.828+0000 7fbd86413800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:06.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.828+0000 7fbd86413800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:06.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.828+0000 7fbd86413800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:06.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.828+0000 7fbd86413800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:06.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.828+0000 7fbd86413800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:06.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.828+0000 7fbd86413800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.828+0000 7fbd86413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.828+0000 7fbd86413800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.828+0000 7fbd86413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:06.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.828+0000 7fbd86413800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.829+0000 7fbd86413800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:06.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.829+0000 7fbd86413800 20 zone default found 2024-09-12T17:23:06.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.829+0000 7fbd86413800 4 Realm: () 2024-09-12T17:23:06.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.829+0000 7fbd86413800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:06.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.829+0000 7fbd86413800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:06.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.829+0000 7fbd86413800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:06.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.829+0000 7fbd86413800 20 zonegroup default 2024-09-12T17:23:06.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.829+0000 7fbd86413800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.829+0000 7fbd86413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.829+0000 7fbd86413800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.829+0000 7fbd86413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.829+0000 7fbd86413800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.829+0000 7fbd86413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.829+0000 7fbd86413800 20 started sync module instance, tier type = 2024-09-12T17:23:06.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.829+0000 7fbd86413800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:06.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.840+0000 7fbd86413800 20 add_watcher() i=0 2024-09-12T17:23:06.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.840+0000 7fbd86413800 20 add_watcher() i=1 2024-09-12T17:23:06.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.840+0000 7fbd86413800 20 add_watcher() i=2 2024-09-12T17:23:06.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.840+0000 7fbd86413800 20 add_watcher() i=3 2024-09-12T17:23:06.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.840+0000 7fbd86413800 20 add_watcher() i=4 2024-09-12T17:23:06.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.840+0000 7fbd86413800 20 add_watcher() i=5 2024-09-12T17:23:06.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.840+0000 7fbd86413800 20 add_watcher() i=6 2024-09-12T17:23:06.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.841+0000 7fbd86413800 20 add_watcher() i=7 2024-09-12T17:23:06.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.841+0000 7fbd86413800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:06.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.843+0000 7fbc337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:06.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.843+0000 7fbd86413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:06.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.843+0000 7fbd86413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:06.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.843+0000 7fbd86413800 5 note: GC not initialized 2024-09-12T17:23:06.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.843+0000 7fbc327fc640 20 reqs_thread_entry: start 2024-09-12T17:23:06.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.843+0000 7fbd86413800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:06.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.843+0000 7fbd86413800 20 Filter name: none 2024-09-12T17:23:06.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.843+0000 7fbba3fff640 20 reqs_thread_entry: start 2024-09-12T17:23:06.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.850+0000 7fbc337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:06.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.852+0000 7fbd86413800 20 remove_watcher() i=0 2024-09-12T17:23:06.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.852+0000 7fbd86413800 2 removed watcher, disabling cache 2024-09-12T17:23:06.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.853+0000 7fbd86413800 20 remove_watcher() i=1 2024-09-12T17:23:06.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.854+0000 7fbd86413800 20 remove_watcher() i=2 2024-09-12T17:23:06.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.855+0000 7fbd86413800 20 remove_watcher() i=3 2024-09-12T17:23:06.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.856+0000 7fbd86413800 20 remove_watcher() i=4 2024-09-12T17:23:06.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.857+0000 7fbd86413800 20 remove_watcher() i=5 2024-09-12T17:23:06.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.858+0000 7fbd86413800 20 remove_watcher() i=6 2024-09-12T17:23:06.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.859+0000 7fbd86413800 20 remove_watcher() i=7 2024-09-12T17:23:06.871 INFO:tasks.workunit.client.0.smithi067.stderr:bucket name a-bucket 2024-09-12T17:23:06.872 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard process 2024-09-12T17:23:06.872 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:06.873 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin reshard process 2024-09-12T17:23:06.900 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:06.900 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:06.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.938+0000 7f307c92e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.939+0000 7f307c92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.939+0000 7f307c92e800 20 realm 2024-09-12T17:23:06.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.939+0000 7f307c92e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.940+0000 7f307c92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.940+0000 7f307c92e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:06.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.940+0000 7f307c92e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.940+0000 7f307c92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.940+0000 7f307c92e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.941+0000 7f307c92e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:06.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.941+0000 7f307c92e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.941+0000 7f307c92e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:06.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.941+0000 7f307c92e800 20 searching for the correct realm 2024-09-12T17:23:06.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.944+0000 7f3078ede640 0 -- 172.21.15.67:0/2046006936 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x561c95b166b0 msgr2=0x561c95b18b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:06.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.948+0000 7f30786dd640 0 -- 172.21.15.67:0/2046006936 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f306009bbe0 msgr2=0x7f3060094960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:06.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.952+0000 7f307c92e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:06.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.952+0000 7f307c92e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:06.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.952+0000 7f307c92e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:06.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.952+0000 7f307c92e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:06.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.952+0000 7f307c92e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:06.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.952+0000 7f307c92e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:06.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.952+0000 7f307c92e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.952+0000 7f307c92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.952+0000 7f307c92e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.953+0000 7f307c92e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:06.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.953+0000 7f307c92e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.953+0000 7f307c92e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:06.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.953+0000 7f307c92e800 20 zone default found 2024-09-12T17:23:06.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.953+0000 7f307c92e800 4 Realm: () 2024-09-12T17:23:06.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.953+0000 7f307c92e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:06.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.953+0000 7f307c92e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:06.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.953+0000 7f307c92e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:06.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.953+0000 7f307c92e800 20 zonegroup default 2024-09-12T17:23:06.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.953+0000 7f307c92e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.953+0000 7f307c92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.953+0000 7f307c92e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.953+0000 7f307c92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.953+0000 7f307c92e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.954+0000 7f307c92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:06.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.954+0000 7f307c92e800 20 started sync module instance, tier type = 2024-09-12T17:23:06.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.954+0000 7f307c92e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:06.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.963+0000 7f307c92e800 20 add_watcher() i=0 2024-09-12T17:23:06.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.963+0000 7f307c92e800 20 add_watcher() i=1 2024-09-12T17:23:06.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.963+0000 7f307c92e800 20 add_watcher() i=2 2024-09-12T17:23:06.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.963+0000 7f307c92e800 20 add_watcher() i=3 2024-09-12T17:23:06.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.963+0000 7f307c92e800 20 add_watcher() i=4 2024-09-12T17:23:06.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.963+0000 7f307c92e800 20 add_watcher() i=5 2024-09-12T17:23:06.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.963+0000 7f307c92e800 20 add_watcher() i=6 2024-09-12T17:23:06.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.964+0000 7f307c92e800 20 add_watcher() i=7 2024-09-12T17:23:06.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.964+0000 7f307c92e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:06.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.966+0000 7f2f2efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:06.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.966+0000 7f307c92e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:06.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.966+0000 7f307c92e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:06.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.966+0000 7f307c92e800 5 note: GC not initialized 2024-09-12T17:23:06.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.966+0000 7f2f2dfdb640 20 reqs_thread_entry: start 2024-09-12T17:23:06.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.966+0000 7f307c92e800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:06.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.967+0000 7f307c92e800 20 Filter name: none 2024-09-12T17:23:06.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.967+0000 7f2e9f7fe640 20 reqs_thread_entry: start 2024-09-12T17:23:06.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.967+0000 7f307c92e800 20 processing logshard = reshard.0000000000 2024-09-12T17:23:06.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.969+0000 7f307c92e800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T17:23:06.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.969+0000 7f307c92e800 20 processing logshard = reshard.0000000001 2024-09-12T17:23:06.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.972+0000 7f307c92e800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T17:23:06.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.972+0000 7f307c92e800 20 processing logshard = reshard.0000000002 2024-09-12T17:23:06.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.974+0000 7f307c92e800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T17:23:06.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.974+0000 7f307c92e800 20 processing logshard = reshard.0000000003 2024-09-12T17:23:06.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.976+0000 7f307c92e800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T17:23:06.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.976+0000 7f307c92e800 20 processing logshard = reshard.0000000004 2024-09-12T17:23:06.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.979+0000 7f307c92e800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T17:23:06.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.979+0000 7f307c92e800 20 processing logshard = reshard.0000000005 2024-09-12T17:23:06.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.981+0000 7f307c92e800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T17:23:06.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.981+0000 7f307c92e800 20 processing logshard = reshard.0000000006 2024-09-12T17:23:06.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.982+0000 7f307c92e800 20 process_entry resharding a-bucket 2024-09-12T17:23:06.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.982+0000 7f307c92e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:23:06.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.982+0000 7f307c92e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.983+0000 7f307c92e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:23:06.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.983+0000 7f307c92e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T17:23:06.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.983+0000 7f307c92e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:23:06.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.983+0000 7f307c92e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : miss 2024-09-12T17:23:06.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.983+0000 7f307c92e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:06.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.983+0000 7f307c92e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:23:06.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.983+0000 7f307c92e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:23:06.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.983+0000 7f307c92e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:23:06.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.983+0000 7f307c92e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:06.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.983+0000 7f307c92e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:23:06.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.983+0000 7f307c92e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:23:06.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.988+0000 7f307c92e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:23:06.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.988+0000 7f307c92e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:23:06.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.988+0000 7f307c92e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:23:06.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.988+0000 7f307c92e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18, ofs0, ns] 2024-09-12T17:23:06.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.988+0000 7f2f4f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464314 cookie 94680770510640 notifier 5792 bl.length()=911 2024-09-12T17:23:06.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.988+0000 7f2f4f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:23:06.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.988+0000 7f2f4f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:23:06.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.988+0000 7f2f4f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:23:06.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.990+0000 7f307c92e800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_sources= new_sources= 2024-09-12T17:23:06.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.990+0000 7f307c92e800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:23:06.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.990+0000 7f307c92e800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_dests= new_dests= 2024-09-12T17:23:06.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.990+0000 7f307c92e800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:23:06.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.993+0000 7f307c92e800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.1.0 2024-09-12T17:23:06.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.993+0000 7f307c92e800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.1.0 2024-09-12T17:23:06.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.993+0000 7f307c92e800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.1.1 2024-09-12T17:23:06.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.993+0000 7f307c92e800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.1.1 2024-09-12T17:23:06.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.993+0000 7f307c92e800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.0 2024-09-12T17:23:06.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.993+0000 7f307c92e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:23:06.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.993+0000 7f307c92e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:23:06.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.995+0000 7f307c92e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:23:06.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.995+0000 7f307c92e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:23:06.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.995+0000 7f307c92e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:23:06.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.995+0000 7f307c92e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18, ofs0, ns] 2024-09-12T17:23:06.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.995+0000 7f2f4f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464315 cookie 94680770510640 notifier 5792 bl.length()=911 2024-09-12T17:23:06.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.995+0000 7f2f4f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:23:06.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.995+0000 7f2f4f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:23:06.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.995+0000 7f2f4f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:23:06.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.997+0000 7f307c92e800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_sources= new_sources= 2024-09-12T17:23:06.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.997+0000 7f307c92e800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:23:06.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.997+0000 7f307c92e800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_dests= new_dests= 2024-09-12T17:23:06.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.997+0000 7f307c92e800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:23:06.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.998+0000 7f307c92e800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.0 2024-09-12T17:23:06.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.998+0000 7f307c92e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:23:06.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.998+0000 7f307c92e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:23:07.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.999+0000 7f307c92e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:23:07.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.999+0000 7f307c92e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:23:07.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.999+0000 7f307c92e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:23:07.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:06.999+0000 7f307c92e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18, ofs0, ns] 2024-09-12T17:23:07.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.000+0000 7f2f4f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464316 cookie 94680770510640 notifier 5792 bl.length()=879 2024-09-12T17:23:07.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.000+0000 7f2f4f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:23:07.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.000+0000 7f2f4f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:23:07.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.000+0000 7f2f4f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:23:07.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.001+0000 7f307c92e800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_sources= new_sources= 2024-09-12T17:23:07.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.001+0000 7f307c92e800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:23:07.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.001+0000 7f307c92e800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_dests= new_dests= 2024-09-12T17:23:07.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.001+0000 7f307c92e800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:23:07.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.002+0000 7f307c92e800 1 execute INFO: reshard of bucket "a-bucket" from 1 shards to 2 shards completed successfully 2024-09-12T17:23:07.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.003+0000 7f307c92e800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T17:23:07.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.005+0000 7f307c92e800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T17:23:07.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.005+0000 7f307c92e800 20 processing logshard = reshard.0000000007 2024-09-12T17:23:07.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.007+0000 7f307c92e800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T17:23:07.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.007+0000 7f307c92e800 20 processing logshard = reshard.0000000008 2024-09-12T17:23:07.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.010+0000 7f307c92e800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T17:23:07.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.010+0000 7f307c92e800 20 processing logshard = reshard.0000000009 2024-09-12T17:23:07.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.012+0000 7f307c92e800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T17:23:07.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.012+0000 7f307c92e800 20 processing logshard = reshard.0000000010 2024-09-12T17:23:07.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.015+0000 7f307c92e800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T17:23:07.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.015+0000 7f307c92e800 20 processing logshard = reshard.0000000011 2024-09-12T17:23:07.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.018+0000 7f307c92e800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T17:23:07.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.018+0000 7f307c92e800 20 processing logshard = reshard.0000000012 2024-09-12T17:23:07.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.020+0000 7f307c92e800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T17:23:07.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.020+0000 7f307c92e800 20 processing logshard = reshard.0000000013 2024-09-12T17:23:07.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.022+0000 7f307c92e800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T17:23:07.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.022+0000 7f307c92e800 20 processing logshard = reshard.0000000014 2024-09-12T17:23:07.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.025+0000 7f307c92e800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T17:23:07.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.025+0000 7f307c92e800 20 processing logshard = reshard.0000000015 2024-09-12T17:23:07.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.027+0000 7f307c92e800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T17:23:07.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.028+0000 7f2f2efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:07.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.030+0000 7f307c92e800 20 remove_watcher() i=0 2024-09-12T17:23:07.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.030+0000 7f307c92e800 2 removed watcher, disabling cache 2024-09-12T17:23:07.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.031+0000 7f307c92e800 20 remove_watcher() i=1 2024-09-12T17:23:07.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.032+0000 7f307c92e800 20 remove_watcher() i=2 2024-09-12T17:23:07.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.034+0000 7f307c92e800 20 remove_watcher() i=3 2024-09-12T17:23:07.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.035+0000 7f307c92e800 20 remove_watcher() i=4 2024-09-12T17:23:07.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.036+0000 7f307c92e800 20 remove_watcher() i=5 2024-09-12T17:23:07.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.037+0000 7f307c92e800 20 remove_watcher() i=6 2024-09-12T17:23:07.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:07.038+0000 7f307c92e800 20 remove_watcher() i=7 2024-09-12T17:23:12.057 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:23:12.091 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:12.091 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:12.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.137+0000 7fc62372e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.138+0000 7fc62372e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:12.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.138+0000 7fc62372e800 20 realm 2024-09-12T17:23:12.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.138+0000 7fc62372e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.139+0000 7fc62372e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:12.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.139+0000 7fc62372e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:12.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.139+0000 7fc62372e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.139+0000 7fc62372e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:12.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.139+0000 7fc62372e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.140+0000 7fc62372e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:12.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.140+0000 7fc62372e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.141+0000 7fc62372e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:12.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.141+0000 7fc62372e800 20 searching for the correct realm 2024-09-12T17:23:12.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.142+0000 7fc61f364640 0 -- 172.21.15.67:0/2439793748 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7fc61801fc20 msgr2=0x7fc6180645b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:12.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.349+0000 7fc616b63640 0 -- 172.21.15.67:0/2439793748 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7fc61004d2e0 msgr2=0x7fc6100b8ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:12.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.356+0000 7fc62372e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:12.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.356+0000 7fc62372e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:12.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.356+0000 7fc62372e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:12.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.356+0000 7fc62372e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:12.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.356+0000 7fc62372e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:12.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.356+0000 7fc62372e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:12.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.356+0000 7fc62372e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.356+0000 7fc62372e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:12.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.356+0000 7fc62372e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.357+0000 7fc62372e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:12.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.357+0000 7fc62372e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.357+0000 7fc62372e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:12.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.357+0000 7fc62372e800 20 zone default found 2024-09-12T17:23:12.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.357+0000 7fc62372e800 4 Realm: () 2024-09-12T17:23:12.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.357+0000 7fc62372e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:12.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.357+0000 7fc62372e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:12.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.357+0000 7fc62372e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:12.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.357+0000 7fc62372e800 20 zonegroup default 2024-09-12T17:23:12.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.357+0000 7fc62372e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.357+0000 7fc62372e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:12.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.357+0000 7fc62372e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.358+0000 7fc62372e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:12.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.358+0000 7fc62372e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.358+0000 7fc62372e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:12.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.358+0000 7fc62372e800 20 started sync module instance, tier type = 2024-09-12T17:23:12.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.358+0000 7fc62372e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:12.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.368+0000 7fc62372e800 20 add_watcher() i=0 2024-09-12T17:23:12.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.368+0000 7fc62372e800 20 add_watcher() i=1 2024-09-12T17:23:12.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.368+0000 7fc62372e800 20 add_watcher() i=2 2024-09-12T17:23:12.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.368+0000 7fc62372e800 20 add_watcher() i=3 2024-09-12T17:23:12.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.368+0000 7fc62372e800 20 add_watcher() i=4 2024-09-12T17:23:12.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.368+0000 7fc62372e800 20 add_watcher() i=5 2024-09-12T17:23:12.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.369+0000 7fc62372e800 20 add_watcher() i=6 2024-09-12T17:23:12.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.370+0000 7fc62372e800 20 add_watcher() i=7 2024-09-12T17:23:12.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.370+0000 7fc62372e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:12.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.372+0000 7fc4d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:12.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.372+0000 7fc62372e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:12.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.372+0000 7fc62372e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:12.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.372+0000 7fc62372e800 5 note: GC not initialized 2024-09-12T17:23:12.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.372+0000 7fc4d4fe1640 20 reqs_thread_entry: start 2024-09-12T17:23:12.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.372+0000 7fc62372e800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:12.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.373+0000 7fc62372e800 20 Filter name: none 2024-09-12T17:23:12.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.373+0000 7fc44e7fc640 20 reqs_thread_entry: start 2024-09-12T17:23:12.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.373+0000 7fc62372e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.373+0000 7fc62372e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:23:12.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.373+0000 7fc62372e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.374+0000 7fc62372e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:23:12.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.374+0000 7fc62372e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:12.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.374+0000 7fc62372e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.374+0000 7fc62372e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:23:12.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.374+0000 7fc62372e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.375+0000 7fc62372e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:23:12.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.375+0000 7fc62372e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:12.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.376+0000 7fc4d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:12.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.379+0000 7fc62372e800 20 remove_watcher() i=0 2024-09-12T17:23:12.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.379+0000 7fc62372e800 2 removed watcher, disabling cache 2024-09-12T17:23:12.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.380+0000 7fc62372e800 20 remove_watcher() i=1 2024-09-12T17:23:12.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.381+0000 7fc62372e800 20 remove_watcher() i=2 2024-09-12T17:23:12.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.382+0000 7fc62372e800 20 remove_watcher() i=3 2024-09-12T17:23:12.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.384+0000 7fc62372e800 20 remove_watcher() i=4 2024-09-12T17:23:12.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.385+0000 7fc62372e800 20 remove_watcher() i=5 2024-09-12T17:23:12.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.386+0000 7fc62372e800 20 remove_watcher() i=6 2024-09-12T17:23:12.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.387+0000 7fc62372e800 20 remove_watcher() i=7 2024-09-12T17:23:12.401 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:12.401 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:23:12.401 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: a-bucket id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T17:23:12.401 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:12.401 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard add non empty bucket 2024-09-12T17:23:12.401 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:12.405 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:12.405 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:12.446 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:12.446 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:12.482 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:12.482 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:12.519 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:12.519 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:12.554 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:12.555 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:12.593 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:12.593 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:12.630 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:12.631 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:12.667 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:12.668 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:12.702 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:23:12.731 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:12.731 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:12.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.770+0000 7f7429a20800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.772+0000 7f7429a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:12.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.772+0000 7f7429a20800 20 realm 2024-09-12T17:23:12.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.772+0000 7f7429a20800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.772+0000 7f7429a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:12.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.772+0000 7f7429a20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:12.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.772+0000 7f7429a20800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.772+0000 7f7429a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:12.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.772+0000 7f7429a20800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.773+0000 7f7429a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:12.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.773+0000 7f7429a20800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.774+0000 7f7429a20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:12.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.774+0000 7f7429a20800 20 searching for the correct realm 2024-09-12T17:23:12.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.777+0000 7f7427d0b640 0 -- 172.21.15.67:0/1454467979 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x56451ab19ba0 msgr2=0x56451ab1c030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:12.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.780+0000 7f742750a640 0 -- 172.21.15.67:0/1454467979 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f7410042040 msgr2=0x7f741005c930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:12.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.785+0000 7f7429a20800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:12.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.785+0000 7f7429a20800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:12.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.785+0000 7f7429a20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:12.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.785+0000 7f7429a20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:12.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.785+0000 7f7429a20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:12.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.785+0000 7f7429a20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:12.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.785+0000 7f7429a20800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.785+0000 7f7429a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:12.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.785+0000 7f7429a20800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.785+0000 7f7429a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:12.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.785+0000 7f7429a20800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.786+0000 7f7429a20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:12.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.786+0000 7f7429a20800 20 zone default found 2024-09-12T17:23:12.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.786+0000 7f7429a20800 4 Realm: () 2024-09-12T17:23:12.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.786+0000 7f7429a20800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:12.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.786+0000 7f7429a20800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:12.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.786+0000 7f7429a20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:12.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.786+0000 7f7429a20800 20 zonegroup default 2024-09-12T17:23:12.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.786+0000 7f7429a20800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.786+0000 7f7429a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:12.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.786+0000 7f7429a20800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.787+0000 7f7429a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:12.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.787+0000 7f7429a20800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.787+0000 7f7429a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:12.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.787+0000 7f7429a20800 20 started sync module instance, tier type = 2024-09-12T17:23:12.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.787+0000 7f7429a20800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:12.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.796+0000 7f7429a20800 20 add_watcher() i=0 2024-09-12T17:23:12.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.797+0000 7f7429a20800 20 add_watcher() i=1 2024-09-12T17:23:12.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.797+0000 7f7429a20800 20 add_watcher() i=2 2024-09-12T17:23:12.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.797+0000 7f7429a20800 20 add_watcher() i=3 2024-09-12T17:23:12.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.797+0000 7f7429a20800 20 add_watcher() i=4 2024-09-12T17:23:12.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.797+0000 7f7429a20800 20 add_watcher() i=5 2024-09-12T17:23:12.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.797+0000 7f7429a20800 20 add_watcher() i=6 2024-09-12T17:23:12.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.798+0000 7f7429a20800 20 add_watcher() i=7 2024-09-12T17:23:12.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.798+0000 7f7429a20800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:12.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.799+0000 7f72ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:12.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.800+0000 7f7429a20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:12.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.800+0000 7f7429a20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:12.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.800+0000 7f7429a20800 5 note: GC not initialized 2024-09-12T17:23:12.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.800+0000 7f72dcfe1640 20 reqs_thread_entry: start 2024-09-12T17:23:12.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.800+0000 7f7429a20800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:12.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.800+0000 7f7429a20800 20 Filter name: none 2024-09-12T17:23:12.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.800+0000 7f72567fc640 20 reqs_thread_entry: start 2024-09-12T17:23:12.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.800+0000 7f7429a20800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.801+0000 7f7429a20800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:23:12.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.801+0000 7f7429a20800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.801+0000 7f7429a20800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:23:12.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.801+0000 7f7429a20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:12.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.801+0000 7f7429a20800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.802+0000 7f7429a20800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:23:12.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.802+0000 7f7429a20800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.802+0000 7f7429a20800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:23:12.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.802+0000 7f7429a20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:12.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.803+0000 7f72ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:12.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.806+0000 7f7429a20800 20 remove_watcher() i=0 2024-09-12T17:23:12.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.806+0000 7f7429a20800 2 removed watcher, disabling cache 2024-09-12T17:23:12.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.806+0000 7f7429a20800 20 remove_watcher() i=1 2024-09-12T17:23:12.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.807+0000 7f7429a20800 20 remove_watcher() i=2 2024-09-12T17:23:12.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.808+0000 7f7429a20800 20 remove_watcher() i=3 2024-09-12T17:23:12.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.809+0000 7f7429a20800 20 remove_watcher() i=4 2024-09-12T17:23:12.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.811+0000 7f7429a20800 20 remove_watcher() i=5 2024-09-12T17:23:12.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.812+0000 7f7429a20800 20 remove_watcher() i=6 2024-09-12T17:23:12.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.812+0000 7f7429a20800 20 remove_watcher() i=7 2024-09-12T17:23:12.825 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:12.825 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:23:12.825 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: a-bucket id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 num_objects: 8 size_kb: 1 num_shards: 2 2024-09-12T17:23:12.825 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:12.826 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 3 2024-09-12T17:23:12.858 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:12.858 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:12.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.896+0000 7f1eee924800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.898+0000 7f1eee924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:12.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.898+0000 7f1eee924800 20 realm 2024-09-12T17:23:12.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.898+0000 7f1eee924800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.898+0000 7f1eee924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:12.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.898+0000 7f1eee924800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:12.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.898+0000 7f1eee924800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.899+0000 7f1eee924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:12.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.899+0000 7f1eee924800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.900+0000 7f1eee924800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:12.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.900+0000 7f1eee924800 20 rados->read ofs=0 len=0 2024-09-12T17:23:12.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.900+0000 7f1eee924800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:12.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.900+0000 7f1eee924800 20 searching for the correct realm 2024-09-12T17:23:12.903 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.902+0000 7f1ee9dd1640 0 -- 172.21.15.67:0/1108457879 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f1edc024070 msgr2=0x7f1edc063990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:12.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:12.906+0000 7f1eea5d2640 0 -- 172.21.15.67:0/1108457879 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f1ee00b5d80 msgr2=0x7f1ee00b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:13.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.112+0000 7f1eee924800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:13.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.112+0000 7f1eee924800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:13.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.112+0000 7f1eee924800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:13.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.112+0000 7f1eee924800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:13.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.112+0000 7f1eee924800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:13.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.112+0000 7f1eee924800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:13.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.112+0000 7f1eee924800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.113+0000 7f1eee924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:13.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.113+0000 7f1eee924800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.113+0000 7f1eee924800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:13.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.113+0000 7f1eee924800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.114+0000 7f1eee924800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:13.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.114+0000 7f1eee924800 20 zone default found 2024-09-12T17:23:13.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.114+0000 7f1eee924800 4 Realm: () 2024-09-12T17:23:13.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.114+0000 7f1eee924800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:13.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.114+0000 7f1eee924800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:13.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.114+0000 7f1eee924800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:13.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.114+0000 7f1eee924800 20 zonegroup default 2024-09-12T17:23:13.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.114+0000 7f1eee924800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.114+0000 7f1eee924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:13.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.114+0000 7f1eee924800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.114+0000 7f1eee924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:13.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.114+0000 7f1eee924800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.115+0000 7f1eee924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:13.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.115+0000 7f1eee924800 20 started sync module instance, tier type = 2024-09-12T17:23:13.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.115+0000 7f1eee924800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:13.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.124+0000 7f1eee924800 20 add_watcher() i=0 2024-09-12T17:23:13.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.124+0000 7f1eee924800 20 add_watcher() i=1 2024-09-12T17:23:13.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.124+0000 7f1eee924800 20 add_watcher() i=2 2024-09-12T17:23:13.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.124+0000 7f1eee924800 20 add_watcher() i=3 2024-09-12T17:23:13.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.124+0000 7f1eee924800 20 add_watcher() i=4 2024-09-12T17:23:13.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.124+0000 7f1eee924800 20 add_watcher() i=5 2024-09-12T17:23:13.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.124+0000 7f1eee924800 20 add_watcher() i=6 2024-09-12T17:23:13.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.125+0000 7f1eee924800 20 add_watcher() i=7 2024-09-12T17:23:13.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.125+0000 7f1eee924800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:13.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.127+0000 7f1da0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:13.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.127+0000 7f1eee924800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:13.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.127+0000 7f1eee924800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:13.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.127+0000 7f1eee924800 5 note: GC not initialized 2024-09-12T17:23:13.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.128+0000 7f1d1b7fe640 20 reqs_thread_entry: start 2024-09-12T17:23:13.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.128+0000 7f1eee924800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:13.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.128+0000 7f1eee924800 20 Filter name: none 2024-09-12T17:23:13.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.128+0000 7f1d197fa640 20 reqs_thread_entry: start 2024-09-12T17:23:13.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.128+0000 7f1eee924800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:23:13.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.128+0000 7f1eee924800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.128+0000 7f1eee924800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:23:13.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.128+0000 7f1eee924800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:23:13.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.128+0000 7f1eee924800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:23:13.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.128+0000 7f1eee924800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : miss 2024-09-12T17:23:13.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.128+0000 7f1eee924800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.129+0000 7f1eee924800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:23:13.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.129+0000 7f1eee924800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:23:13.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.129+0000 7f1eee924800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:23:13.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.129+0000 7f1eee924800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:13.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.129+0000 7f1eee924800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:23:13.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.129+0000 7f1eee924800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:23:13.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.131+0000 7f1da0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:13.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.133+0000 7f1eee924800 20 remove_watcher() i=0 2024-09-12T17:23:13.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.133+0000 7f1eee924800 2 removed watcher, disabling cache 2024-09-12T17:23:13.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.134+0000 7f1eee924800 20 remove_watcher() i=1 2024-09-12T17:23:13.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.135+0000 7f1eee924800 20 remove_watcher() i=2 2024-09-12T17:23:13.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.136+0000 7f1eee924800 20 remove_watcher() i=3 2024-09-12T17:23:13.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.138+0000 7f1eee924800 20 remove_watcher() i=4 2024-09-12T17:23:13.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.139+0000 7f1eee924800 20 remove_watcher() i=5 2024-09-12T17:23:13.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.140+0000 7f1eee924800 20 remove_watcher() i=6 2024-09-12T17:23:13.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.141+0000 7f1eee924800 20 remove_watcher() i=7 2024-09-12T17:23:13.155 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin reshard list 2024-09-12T17:23:13.182 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:13.182 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:13.424 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.423+0000 7fb832126800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.424+0000 7fb832126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:13.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.424+0000 7fb832126800 20 realm 2024-09-12T17:23:13.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.424+0000 7fb832126800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.424+0000 7fb832126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:13.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.424+0000 7fb832126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:13.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.424+0000 7fb832126800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.425+0000 7fb832126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:13.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.425+0000 7fb832126800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.426+0000 7fb832126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:13.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.426+0000 7fb832126800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.426+0000 7fb832126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:13.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.426+0000 7fb832126800 20 searching for the correct realm 2024-09-12T17:23:13.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.429+0000 7fb82d508640 0 -- 172.21.15.67:0/1299296517 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x56312f82ba10 msgr2=0x56312f82de00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:23:13.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.433+0000 7fb82dd09640 0 -- 172.21.15.67:0/1299296517 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fb82405d440 msgr2=0x7fb82405d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:23:13.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.639+0000 7fb832126800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:13.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.639+0000 7fb832126800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:13.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.639+0000 7fb832126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:13.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.639+0000 7fb832126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:13.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.639+0000 7fb832126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:13.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.639+0000 7fb832126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:13.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.640+0000 7fb832126800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.640+0000 7fb832126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:13.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.640+0000 7fb832126800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.640+0000 7fb832126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:13.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.640+0000 7fb832126800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.641+0000 7fb832126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:13.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.641+0000 7fb832126800 20 zone default found 2024-09-12T17:23:13.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.641+0000 7fb832126800 4 Realm: () 2024-09-12T17:23:13.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.641+0000 7fb832126800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:13.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.641+0000 7fb832126800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:13.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.641+0000 7fb832126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:13.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.641+0000 7fb832126800 20 zonegroup default 2024-09-12T17:23:13.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.641+0000 7fb832126800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.641+0000 7fb832126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:13.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.641+0000 7fb832126800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.641+0000 7fb832126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:13.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.641+0000 7fb832126800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.642+0000 7fb832126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:13.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.642+0000 7fb832126800 20 started sync module instance, tier type = 2024-09-12T17:23:13.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.642+0000 7fb832126800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:13.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.652+0000 7fb832126800 20 add_watcher() i=0 2024-09-12T17:23:13.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.652+0000 7fb832126800 20 add_watcher() i=1 2024-09-12T17:23:13.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.652+0000 7fb832126800 20 add_watcher() i=2 2024-09-12T17:23:13.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.652+0000 7fb832126800 20 add_watcher() i=3 2024-09-12T17:23:13.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.652+0000 7fb832126800 20 add_watcher() i=4 2024-09-12T17:23:13.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.652+0000 7fb832126800 20 add_watcher() i=5 2024-09-12T17:23:13.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.652+0000 7fb832126800 20 add_watcher() i=6 2024-09-12T17:23:13.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.653+0000 7fb832126800 20 add_watcher() i=7 2024-09-12T17:23:13.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.653+0000 7fb832126800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:13.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.655+0000 7fb6df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:13.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.656+0000 7fb832126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:13.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.656+0000 7fb832126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:13.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.656+0000 7fb832126800 5 note: GC not initialized 2024-09-12T17:23:13.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.656+0000 7fb6de7fc640 20 reqs_thread_entry: start 2024-09-12T17:23:13.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.656+0000 7fb832126800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:13.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.656+0000 7fb832126800 20 Filter name: none 2024-09-12T17:23:13.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.656+0000 7fb64ffff640 20 reqs_thread_entry: start 2024-09-12T17:23:13.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.662+0000 7fb6df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:13.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.665+0000 7fb832126800 20 remove_watcher() i=0 2024-09-12T17:23:13.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.665+0000 7fb832126800 2 removed watcher, disabling cache 2024-09-12T17:23:13.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.666+0000 7fb832126800 20 remove_watcher() i=1 2024-09-12T17:23:13.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.667+0000 7fb832126800 20 remove_watcher() i=2 2024-09-12T17:23:13.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.668+0000 7fb832126800 20 remove_watcher() i=3 2024-09-12T17:23:13.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.669+0000 7fb832126800 20 remove_watcher() i=4 2024-09-12T17:23:13.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.670+0000 7fb832126800 20 remove_watcher() i=5 2024-09-12T17:23:13.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.671+0000 7fb832126800 20 remove_watcher() i=6 2024-09-12T17:23:13.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.672+0000 7fb832126800 20 remove_watcher() i=7 2024-09-12T17:23:13.685 INFO:tasks.workunit.client.0.smithi067.stderr:bucket name a-bucket 2024-09-12T17:23:13.685 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard process non empty bucket 2024-09-12T17:23:13.685 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:13.686 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin reshard process 2024-09-12T17:23:13.713 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:13.713 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:13.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.752+0000 7f0f83014800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.753+0000 7f0f83014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:13.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.753+0000 7f0f83014800 20 realm 2024-09-12T17:23:13.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.753+0000 7f0f83014800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.753+0000 7f0f83014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:13.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.753+0000 7f0f83014800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:13.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.753+0000 7f0f83014800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.753+0000 7f0f83014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:13.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.753+0000 7f0f83014800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.754+0000 7f0f83014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:13.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.754+0000 7f0f83014800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.756 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.755+0000 7f0f83014800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:13.756 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.755+0000 7f0f83014800 20 searching for the correct realm 2024-09-12T17:23:13.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.758+0000 7f0f7eecc640 0 -- 172.21.15.67:0/924718625 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x5610bf5ce0e0 msgr2=0x5610bf5d04d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:13.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.762+0000 7f0f7e6cb640 0 -- 172.21.15.67:0/924718625 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f0f74080920 msgr2=0x7f0f74061400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:13.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.767+0000 7f0f83014800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:13.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.767+0000 7f0f83014800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:13.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.767+0000 7f0f83014800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:13.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.767+0000 7f0f83014800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:13.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.767+0000 7f0f83014800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:13.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.767+0000 7f0f83014800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:13.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.767+0000 7f0f83014800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.767+0000 7f0f83014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:13.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.767+0000 7f0f83014800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.767+0000 7f0f83014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:13.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.767+0000 7f0f83014800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.767+0000 7f0f83014800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.767+0000 7f0f83014800 20 zone default found 2024-09-12T17:23:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.767+0000 7f0f83014800 4 Realm: () 2024-09-12T17:23:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.767+0000 7f0f83014800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.767+0000 7f0f83014800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.767+0000 7f0f83014800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.767+0000 7f0f83014800 20 zonegroup default 2024-09-12T17:23:13.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.767+0000 7f0f83014800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.768+0000 7f0f83014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:13.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.768+0000 7f0f83014800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.768+0000 7f0f83014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:13.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.768+0000 7f0f83014800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.768+0000 7f0f83014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:13.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.768+0000 7f0f83014800 20 started sync module instance, tier type = 2024-09-12T17:23:13.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.768+0000 7f0f83014800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:13.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.778+0000 7f0f83014800 20 add_watcher() i=0 2024-09-12T17:23:13.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.778+0000 7f0f83014800 20 add_watcher() i=1 2024-09-12T17:23:13.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.778+0000 7f0f83014800 20 add_watcher() i=2 2024-09-12T17:23:13.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.778+0000 7f0f83014800 20 add_watcher() i=3 2024-09-12T17:23:13.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.778+0000 7f0f83014800 20 add_watcher() i=4 2024-09-12T17:23:13.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.778+0000 7f0f83014800 20 add_watcher() i=5 2024-09-12T17:23:13.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.778+0000 7f0f83014800 20 add_watcher() i=6 2024-09-12T17:23:13.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.778+0000 7f0f83014800 20 add_watcher() i=7 2024-09-12T17:23:13.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.778+0000 7f0f83014800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:13.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.780+0000 7f0e34fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:13.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.780+0000 7f0f83014800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:13.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.780+0000 7f0f83014800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:13.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.780+0000 7f0f83014800 5 note: GC not initialized 2024-09-12T17:23:13.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.781+0000 7f0daf7fe640 20 reqs_thread_entry: start 2024-09-12T17:23:13.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.781+0000 7f0f83014800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:13.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.781+0000 7f0f83014800 20 Filter name: none 2024-09-12T17:23:13.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.781+0000 7f0dad7fa640 20 reqs_thread_entry: start 2024-09-12T17:23:13.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.781+0000 7f0f83014800 20 processing logshard = reshard.0000000000 2024-09-12T17:23:13.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.783+0000 7f0f83014800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T17:23:13.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.783+0000 7f0f83014800 20 processing logshard = reshard.0000000001 2024-09-12T17:23:13.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.786+0000 7f0f83014800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T17:23:13.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.786+0000 7f0f83014800 20 processing logshard = reshard.0000000002 2024-09-12T17:23:13.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.788+0000 7f0f83014800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T17:23:13.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.788+0000 7f0f83014800 20 processing logshard = reshard.0000000003 2024-09-12T17:23:13.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.790+0000 7f0f83014800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T17:23:13.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.790+0000 7f0f83014800 20 processing logshard = reshard.0000000004 2024-09-12T17:23:13.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.793+0000 7f0f83014800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T17:23:13.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.793+0000 7f0f83014800 20 processing logshard = reshard.0000000005 2024-09-12T17:23:13.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.795+0000 7f0f83014800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T17:23:13.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.795+0000 7f0f83014800 20 processing logshard = reshard.0000000006 2024-09-12T17:23:13.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.797+0000 7f0f83014800 20 process_entry resharding a-bucket 2024-09-12T17:23:13.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.797+0000 7f0f83014800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:23:13.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.797+0000 7f0f83014800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.797+0000 7f0f83014800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:23:13.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.797+0000 7f0f83014800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T17:23:13.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.797+0000 7f0f83014800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:23:13.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.797+0000 7f0f83014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : miss 2024-09-12T17:23:13.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.797+0000 7f0f83014800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.797+0000 7f0f83014800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:23:13.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.797+0000 7f0f83014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:23:13.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.797+0000 7f0f83014800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:23:13.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.798+0000 7f0f83014800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:13.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.798+0000 7f0f83014800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:23:13.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.798+0000 7f0f83014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:23:13.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.802+0000 7f0f83014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:23:13.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.802+0000 7f0f83014800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:23:13.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.802+0000 7f0f83014800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:23:13.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.802+0000 7f0f83014800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18, ofs0, ns] 2024-09-12T17:23:13.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.803+0000 7f0e617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464317 cookie 94629930005136 notifier 5873 bl.length()=911 2024-09-12T17:23:13.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.803+0000 7f0e617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:23:13.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.803+0000 7f0e617fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:23:13.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.803+0000 7f0e617fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:23:13.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.805+0000 7f0f83014800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_sources= new_sources= 2024-09-12T17:23:13.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.805+0000 7f0f83014800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:23:13.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.805+0000 7f0f83014800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_dests= new_dests= 2024-09-12T17:23:13.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.805+0000 7f0f83014800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:23:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.807+0000 7f0f83014800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 2024-09-12T17:23:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.807+0000 7f0f83014800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 2024-09-12T17:23:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.807+0000 7f0f83014800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.1 2024-09-12T17:23:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.807+0000 7f0f83014800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.1 2024-09-12T17:23:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.807+0000 7f0f83014800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.2 2024-09-12T17:23:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.807+0000 7f0f83014800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.2 2024-09-12T17:23:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.807+0000 7f0f83014800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.1.0 2024-09-12T17:23:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.807+0000 7f0f83014800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.1.0 2024-09-12T17:23:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.808+0000 7f0f83014800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.1.1 2024-09-12T17:23:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.808+0000 7f0f83014800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.1.1 2024-09-12T17:23:13.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.810+0000 7f0f83014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:23:13.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.810+0000 7f0f83014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:23:13.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.811+0000 7f0f83014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:23:13.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.811+0000 7f0f83014800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:23:13.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.811+0000 7f0f83014800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:23:13.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.811+0000 7f0f83014800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18, ofs0, ns] 2024-09-12T17:23:13.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.811+0000 7f0e617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464318 cookie 94629930005136 notifier 5873 bl.length()=911 2024-09-12T17:23:13.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.811+0000 7f0e617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:23:13.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.811+0000 7f0e617fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:23:13.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.811+0000 7f0e617fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:23:13.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.813+0000 7f0f83014800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_sources= new_sources= 2024-09-12T17:23:13.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.813+0000 7f0f83014800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:23:13.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.813+0000 7f0f83014800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_dests= new_dests= 2024-09-12T17:23:13.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.813+0000 7f0f83014800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:23:13.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.814+0000 7f0f83014800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.1.0 2024-09-12T17:23:13.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.814+0000 7f0f83014800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.1.0 2024-09-12T17:23:13.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.814+0000 7f0f83014800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.1.1 2024-09-12T17:23:13.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.814+0000 7f0f83014800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.1.1 2024-09-12T17:23:13.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.814+0000 7f0f83014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:23:13.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.815+0000 7f0f83014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:23:13.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.816+0000 7f0f83014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:23:13.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.816+0000 7f0f83014800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:23:13.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.816+0000 7f0f83014800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:23:13.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.816+0000 7f0f83014800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18, ofs0, ns] 2024-09-12T17:23:13.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.816+0000 7f0e617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464319 cookie 94629930005136 notifier 5873 bl.length()=879 2024-09-12T17:23:13.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.816+0000 7f0e617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:23:13.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.816+0000 7f0e617fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:23:13.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.816+0000 7f0e617fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:23:13.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.817+0000 7f0f83014800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_sources= new_sources= 2024-09-12T17:23:13.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.817+0000 7f0f83014800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:23:13.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.817+0000 7f0f83014800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_dests= new_dests= 2024-09-12T17:23:13.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.817+0000 7f0f83014800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:23:13.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.819+0000 7f0f83014800 1 execute INFO: reshard of bucket "a-bucket" from 2 shards to 3 shards completed successfully 2024-09-12T17:23:13.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.819+0000 7f0f83014800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T17:23:13.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.822+0000 7f0f83014800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T17:23:13.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.822+0000 7f0f83014800 20 processing logshard = reshard.0000000007 2024-09-12T17:23:13.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.824+0000 7f0f83014800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T17:23:13.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.824+0000 7f0f83014800 20 processing logshard = reshard.0000000008 2024-09-12T17:23:13.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.826+0000 7f0f83014800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T17:23:13.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.826+0000 7f0f83014800 20 processing logshard = reshard.0000000009 2024-09-12T17:23:13.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.828+0000 7f0f83014800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T17:23:13.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.828+0000 7f0f83014800 20 processing logshard = reshard.0000000010 2024-09-12T17:23:13.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.831+0000 7f0f83014800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T17:23:13.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.831+0000 7f0f83014800 20 processing logshard = reshard.0000000011 2024-09-12T17:23:13.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.833+0000 7f0f83014800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T17:23:13.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.833+0000 7f0f83014800 20 processing logshard = reshard.0000000012 2024-09-12T17:23:13.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.835+0000 7f0f83014800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T17:23:13.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.835+0000 7f0f83014800 20 processing logshard = reshard.0000000013 2024-09-12T17:23:13.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.837+0000 7f0f83014800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T17:23:13.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.837+0000 7f0f83014800 20 processing logshard = reshard.0000000014 2024-09-12T17:23:13.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.840+0000 7f0f83014800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T17:23:13.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.840+0000 7f0f83014800 20 processing logshard = reshard.0000000015 2024-09-12T17:23:13.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.842+0000 7f0f83014800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T17:23:13.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.843+0000 7f0e34fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:13.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.845+0000 7f0f83014800 20 remove_watcher() i=0 2024-09-12T17:23:13.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.845+0000 7f0f83014800 2 removed watcher, disabling cache 2024-09-12T17:23:13.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.846+0000 7f0f83014800 20 remove_watcher() i=1 2024-09-12T17:23:13.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.847+0000 7f0f83014800 20 remove_watcher() i=2 2024-09-12T17:23:13.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.848+0000 7f0f83014800 20 remove_watcher() i=3 2024-09-12T17:23:13.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.849+0000 7f0f83014800 20 remove_watcher() i=4 2024-09-12T17:23:13.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.851+0000 7f0f83014800 20 remove_watcher() i=5 2024-09-12T17:23:13.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.851+0000 7f0f83014800 20 remove_watcher() i=6 2024-09-12T17:23:13.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.852+0000 7f0f83014800 20 remove_watcher() i=7 2024-09-12T17:23:13.866 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:23:13.895 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:13.895 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:13.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.933+0000 7f4a2213d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.935+0000 7f4a2213d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:13.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.935+0000 7f4a2213d800 20 realm 2024-09-12T17:23:13.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.935+0000 7f4a2213d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.936+0000 7f4a2213d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:13.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.936+0000 7f4a2213d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:13.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.936+0000 7f4a2213d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.936+0000 7f4a2213d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:13.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.936+0000 7f4a2213d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.937+0000 7f4a2213d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:13.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.937+0000 7f4a2213d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:13.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.937+0000 7f4a2213d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:13.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.937+0000 7f4a2213d800 20 searching for the correct realm 2024-09-12T17:23:13.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.940+0000 7f4a1de2a640 0 -- 172.21.15.67:0/1405409416 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f4a1800f3d0 msgr2=0x7f4a1800f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:13.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:13.944+0000 7f4a1de2a640 0 -- 172.21.15.67:0/1405409416 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f4a14082380 msgr2=0x7f4a1407a160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:23:14.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.151+0000 7f4a2213d800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:14.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.151+0000 7f4a2213d800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:14.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.151+0000 7f4a2213d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:14.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.151+0000 7f4a2213d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:14.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.151+0000 7f4a2213d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:14.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.151+0000 7f4a2213d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:14.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.151+0000 7f4a2213d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:14.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.151+0000 7f4a2213d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:14.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.151+0000 7f4a2213d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:14.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.152+0000 7f4a2213d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:14.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.152+0000 7f4a2213d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:14.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.152+0000 7f4a2213d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:14.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.152+0000 7f4a2213d800 20 zone default found 2024-09-12T17:23:14.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.152+0000 7f4a2213d800 4 Realm: () 2024-09-12T17:23:14.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.152+0000 7f4a2213d800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:14.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.152+0000 7f4a2213d800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:14.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.152+0000 7f4a2213d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:14.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.152+0000 7f4a2213d800 20 zonegroup default 2024-09-12T17:23:14.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.152+0000 7f4a2213d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:14.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.152+0000 7f4a2213d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:14.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.152+0000 7f4a2213d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:14.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.153+0000 7f4a2213d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:14.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.153+0000 7f4a2213d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:14.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.153+0000 7f4a2213d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:14.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.153+0000 7f4a2213d800 20 started sync module instance, tier type = 2024-09-12T17:23:14.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.153+0000 7f4a2213d800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:14.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.163+0000 7f4a2213d800 20 add_watcher() i=0 2024-09-12T17:23:14.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.163+0000 7f4a2213d800 20 add_watcher() i=1 2024-09-12T17:23:14.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.163+0000 7f4a2213d800 20 add_watcher() i=2 2024-09-12T17:23:14.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.163+0000 7f4a2213d800 20 add_watcher() i=3 2024-09-12T17:23:14.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.163+0000 7f4a2213d800 20 add_watcher() i=4 2024-09-12T17:23:14.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.163+0000 7f4a2213d800 20 add_watcher() i=5 2024-09-12T17:23:14.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.163+0000 7f4a2213d800 20 add_watcher() i=6 2024-09-12T17:23:14.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.164+0000 7f4a2213d800 20 add_watcher() i=7 2024-09-12T17:23:14.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.164+0000 7f4a2213d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:14.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.166+0000 7f48cf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:14.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.166+0000 7f4a2213d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:14.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.166+0000 7f4a2213d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:14.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.166+0000 7f4a2213d800 5 note: GC not initialized 2024-09-12T17:23:14.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.167+0000 7f48ce7fc640 20 reqs_thread_entry: start 2024-09-12T17:23:14.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.167+0000 7f4a2213d800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:14.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.167+0000 7f4a2213d800 20 Filter name: none 2024-09-12T17:23:14.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.167+0000 7f4843fff640 20 reqs_thread_entry: start 2024-09-12T17:23:14.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.167+0000 7f4a2213d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:14.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.167+0000 7f4a2213d800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:23:14.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.167+0000 7f4a2213d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:14.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.168+0000 7f4a2213d800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:23:14.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.168+0000 7f4a2213d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:14.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.168+0000 7f4a2213d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:14.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.168+0000 7f4a2213d800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:23:14.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.168+0000 7f4a2213d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:14.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.169+0000 7f4a2213d800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:23:14.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.169+0000 7f4a2213d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:14.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.170+0000 7f48cf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:14.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.173+0000 7f4a2213d800 20 remove_watcher() i=0 2024-09-12T17:23:14.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.173+0000 7f4a2213d800 2 removed watcher, disabling cache 2024-09-12T17:23:14.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.174+0000 7f4a2213d800 20 remove_watcher() i=1 2024-09-12T17:23:14.176 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.175+0000 7f4a2213d800 20 remove_watcher() i=2 2024-09-12T17:23:14.177 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.176+0000 7f4a2213d800 20 remove_watcher() i=3 2024-09-12T17:23:14.178 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.177+0000 7f4a2213d800 20 remove_watcher() i=4 2024-09-12T17:23:14.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.178+0000 7f4a2213d800 20 remove_watcher() i=5 2024-09-12T17:23:14.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.179+0000 7f4a2213d800 20 remove_watcher() i=6 2024-09-12T17:23:14.181 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:14.180+0000 7f4a2213d800 20 remove_watcher() i=7 2024-09-12T17:23:14.193 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:14.193 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:23:14.193 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: a-bucket id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-12T17:23:14.193 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:14.193 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-12T17:23:14.193 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:14.195 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:14.195 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:14.242 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:14.242 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:14.304 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:14.304 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:14.341 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:14.341 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:14.377 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:14.377 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:14.415 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:14.416 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:14.451 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:14.451 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:14.486 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:14.486 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:14.521 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:14.521 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:14.557 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:14.557 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:14.593 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:14.593 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:14.628 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:14.628 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:14.664 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:14.664 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:14.701 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:14.701 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:14.736 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:14.736 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:14.771 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:14.771 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:14.808 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:14.809 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:14.845 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:14.845 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:14.881 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:14.881 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:14.917 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:14.917 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:14.951 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:14.951 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:14.987 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:14.987 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:15.024 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:23:15.053 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:15.053 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:15.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.091+0000 7f046a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.093+0000 7f046a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:15.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.093+0000 7f046a60e800 20 realm 2024-09-12T17:23:15.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.093+0000 7f046a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.093+0000 7f046a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:15.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.093+0000 7f046a60e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:15.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.093+0000 7f046a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.094+0000 7f046a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:15.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.094+0000 7f046a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.095+0000 7f046a60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:15.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.095+0000 7f046a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.095+0000 7f046a60e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:15.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.095+0000 7f046a60e800 20 searching for the correct realm 2024-09-12T17:23:15.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.097+0000 7f0465458640 0 -- 172.21.15.67:0/960557857 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f0458096030 msgr2=0x7f045809a9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:15.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.101+0000 7f0465c59640 0 -- 172.21.15.67:0/960557857 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f045c099b90 msgr2=0x7f045c08da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:15.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.307+0000 7f046a60e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:15.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.307+0000 7f046a60e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:15.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.307+0000 7f046a60e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:15.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.307+0000 7f046a60e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:15.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.307+0000 7f046a60e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:15.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.307+0000 7f046a60e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:15.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.307+0000 7f046a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.307+0000 7f046a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:15.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.307+0000 7f046a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.308+0000 7f046a60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:15.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.308+0000 7f046a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.308+0000 7f046a60e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:15.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.308+0000 7f046a60e800 20 zone default found 2024-09-12T17:23:15.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.308+0000 7f046a60e800 4 Realm: () 2024-09-12T17:23:15.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.308+0000 7f046a60e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:15.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.308+0000 7f046a60e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:15.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.308+0000 7f046a60e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:15.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.308+0000 7f046a60e800 20 zonegroup default 2024-09-12T17:23:15.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.308+0000 7f046a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.308+0000 7f046a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:15.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.308+0000 7f046a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.309+0000 7f046a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:15.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.309+0000 7f046a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.309+0000 7f046a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:15.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.309+0000 7f046a60e800 20 started sync module instance, tier type = 2024-09-12T17:23:15.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.309+0000 7f046a60e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:15.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.319+0000 7f046a60e800 20 add_watcher() i=0 2024-09-12T17:23:15.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.319+0000 7f046a60e800 20 add_watcher() i=1 2024-09-12T17:23:15.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.319+0000 7f046a60e800 20 add_watcher() i=2 2024-09-12T17:23:15.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.319+0000 7f046a60e800 20 add_watcher() i=3 2024-09-12T17:23:15.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.319+0000 7f046a60e800 20 add_watcher() i=4 2024-09-12T17:23:15.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.319+0000 7f046a60e800 20 add_watcher() i=5 2024-09-12T17:23:15.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.319+0000 7f046a60e800 20 add_watcher() i=6 2024-09-12T17:23:15.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.320+0000 7f046a60e800 20 add_watcher() i=7 2024-09-12T17:23:15.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.320+0000 7f046a60e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:15.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.322+0000 7f03177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:15.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.322+0000 7f046a60e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:15.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.322+0000 7f046a60e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:15.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.323+0000 7f046a60e800 5 note: GC not initialized 2024-09-12T17:23:15.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.323+0000 7f03167fc640 20 reqs_thread_entry: start 2024-09-12T17:23:15.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.323+0000 7f046a60e800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:15.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.323+0000 7f046a60e800 20 Filter name: none 2024-09-12T17:23:15.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.323+0000 7f0287fff640 20 reqs_thread_entry: start 2024-09-12T17:23:15.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.323+0000 7f046a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.324+0000 7f046a60e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:23:15.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.324+0000 7f046a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.324+0000 7f046a60e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:23:15.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.324+0000 7f046a60e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:15.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.324+0000 7f046a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.325+0000 7f046a60e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:23:15.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.325+0000 7f046a60e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.325+0000 7f046a60e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:23:15.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.325+0000 7f046a60e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:15.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.326+0000 7f03177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:15.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.328+0000 7f046a60e800 20 remove_watcher() i=0 2024-09-12T17:23:15.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.328+0000 7f046a60e800 2 removed watcher, disabling cache 2024-09-12T17:23:15.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.330+0000 7f046a60e800 20 remove_watcher() i=1 2024-09-12T17:23:15.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.331+0000 7f046a60e800 20 remove_watcher() i=2 2024-09-12T17:23:15.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.332+0000 7f046a60e800 20 remove_watcher() i=3 2024-09-12T17:23:15.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.333+0000 7f046a60e800 20 remove_watcher() i=4 2024-09-12T17:23:15.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.334+0000 7f046a60e800 20 remove_watcher() i=5 2024-09-12T17:23:15.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.335+0000 7f046a60e800 20 remove_watcher() i=6 2024-09-12T17:23:15.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.336+0000 7f046a60e800 20 remove_watcher() i=7 2024-09-12T17:23:15.349 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:15.349 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:23:15.349 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-init-index id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:23:15.349 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:15.351 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-12T17:23:15.386 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:15.386 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:15.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.424+0000 7f93ffa98800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.426+0000 7f93ffa98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:15.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.426+0000 7f93ffa98800 20 realm 2024-09-12T17:23:15.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.426+0000 7f93ffa98800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.426+0000 7f93ffa98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:15.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.426+0000 7f93ffa98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:15.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.426+0000 7f93ffa98800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.426+0000 7f93ffa98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:15.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.426+0000 7f93ffa98800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.427+0000 7f93ffa98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:15.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.427+0000 7f93ffa98800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.428+0000 7f93ffa98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:15.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.428+0000 7f93ffa98800 20 searching for the correct realm 2024-09-12T17:23:15.432 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.431+0000 7f93fdd83640 0 -- 172.21.15.67:0/2809107011 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x560e175d8650 msgr2=0x560e175daae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:15.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.434+0000 7f93fcd81640 0 -- 172.21.15.67:0/2809107011 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x560e175e00d0 msgr2=0x560e175e24c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:15.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.438+0000 7f93ffa98800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:15.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.438+0000 7f93ffa98800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:15.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.438+0000 7f93ffa98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:15.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.438+0000 7f93ffa98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:15.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.438+0000 7f93ffa98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:15.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.438+0000 7f93ffa98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:15.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.438+0000 7f93ffa98800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.439+0000 7f93ffa98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:15.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.439+0000 7f93ffa98800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.439+0000 7f93ffa98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:15.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.439+0000 7f93ffa98800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.439+0000 7f93ffa98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:15.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.439+0000 7f93ffa98800 20 zone default found 2024-09-12T17:23:15.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.439+0000 7f93ffa98800 4 Realm: () 2024-09-12T17:23:15.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.439+0000 7f93ffa98800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:15.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.439+0000 7f93ffa98800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:15.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.439+0000 7f93ffa98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:15.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.439+0000 7f93ffa98800 20 zonegroup default 2024-09-12T17:23:15.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.439+0000 7f93ffa98800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.440+0000 7f93ffa98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:15.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.440+0000 7f93ffa98800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.440+0000 7f93ffa98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:15.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.440+0000 7f93ffa98800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.440+0000 7f93ffa98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:15.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.440+0000 7f93ffa98800 20 started sync module instance, tier type = 2024-09-12T17:23:15.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.440+0000 7f93ffa98800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:15.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.451+0000 7f93ffa98800 20 add_watcher() i=0 2024-09-12T17:23:15.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.451+0000 7f93ffa98800 20 add_watcher() i=1 2024-09-12T17:23:15.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.451+0000 7f93ffa98800 20 add_watcher() i=2 2024-09-12T17:23:15.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.451+0000 7f93ffa98800 20 add_watcher() i=3 2024-09-12T17:23:15.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.451+0000 7f93ffa98800 20 add_watcher() i=4 2024-09-12T17:23:15.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.451+0000 7f93ffa98800 20 add_watcher() i=5 2024-09-12T17:23:15.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.451+0000 7f93ffa98800 20 add_watcher() i=6 2024-09-12T17:23:15.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.452+0000 7f93ffa98800 20 add_watcher() i=7 2024-09-12T17:23:15.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.452+0000 7f93ffa98800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:15.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.454+0000 7f92b3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:15.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.454+0000 7f93ffa98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:15.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.454+0000 7f93ffa98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:15.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.454+0000 7f93ffa98800 5 note: GC not initialized 2024-09-12T17:23:15.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.454+0000 7f92b2fe5640 20 reqs_thread_entry: start 2024-09-12T17:23:15.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.454+0000 7f93ffa98800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:15.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.454+0000 7f93ffa98800 20 Filter name: none 2024-09-12T17:23:15.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.454+0000 7f92b0fe1640 20 reqs_thread_entry: start 2024-09-12T17:23:15.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.455+0000 7f93ffa98800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:23:15.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.455+0000 7f93ffa98800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.455+0000 7f93ffa98800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:23:15.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.455+0000 7f93ffa98800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:23:15.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.455+0000 7f93ffa98800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:23:15.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.455+0000 7f93ffa98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 : miss 2024-09-12T17:23:15.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.455+0000 7f93ffa98800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.455+0000 7f93ffa98800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:23:15.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.455+0000 7f93ffa98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 info.flags=0x17 2024-09-12T17:23:15.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.455+0000 7f93ffa98800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 to cache LRU end 2024-09-12T17:23:15.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.455+0000 7f93ffa98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:15.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.455+0000 7f93ffa98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:15.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.455+0000 7f93ffa98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 2024-09-12T17:23:15.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.457+0000 7f93ffa98800 -1 Injecting error=-5 at location=init_index 2024-09-12T17:23:15.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.457+0000 7f93ffa98800 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-12T17:23:15.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.459+0000 7f92b3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:15.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.461+0000 7f93ffa98800 20 remove_watcher() i=0 2024-09-12T17:23:15.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.461+0000 7f93ffa98800 2 removed watcher, disabling cache 2024-09-12T17:23:15.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.462+0000 7f93ffa98800 20 remove_watcher() i=1 2024-09-12T17:23:15.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.463+0000 7f93ffa98800 20 remove_watcher() i=2 2024-09-12T17:23:15.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.464+0000 7f93ffa98800 20 remove_watcher() i=3 2024-09-12T17:23:15.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.465+0000 7f93ffa98800 20 remove_watcher() i=4 2024-09-12T17:23:15.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.466+0000 7f93ffa98800 20 remove_watcher() i=5 2024-09-12T17:23:15.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.467+0000 7f93ffa98800 20 remove_watcher() i=6 2024-09-12T17:23:15.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.468+0000 7f93ffa98800 20 remove_watcher() i=7 2024-09-12T17:23:15.482 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:23:15.511 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:15.511 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:15.550 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.549+0000 7f3096614800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.551+0000 7f3096614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:15.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.551+0000 7f3096614800 20 realm 2024-09-12T17:23:15.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.551+0000 7f3096614800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.551+0000 7f3096614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:15.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.551+0000 7f3096614800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:15.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.551+0000 7f3096614800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.552+0000 7f3096614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:15.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.552+0000 7f3096614800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.552+0000 7f3096614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:15.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.552+0000 7f3096614800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.553+0000 7f3096614800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:15.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.553+0000 7f3096614800 20 searching for the correct realm 2024-09-12T17:23:15.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.557+0000 7f30914ca640 0 -- 172.21.15.67:0/17145236 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x560916aec480 msgr2=0x560916aee870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:15.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.560+0000 7f30914ca640 0 -- 172.21.15.67:0/17145236 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x7f2f5c086370 msgr2=0x7f2f5c0887a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:15.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.564+0000 7f3096614800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:15.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.564+0000 7f3096614800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:15.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.564+0000 7f3096614800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:15.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.564+0000 7f3096614800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:15.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.564+0000 7f3096614800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:15.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.564+0000 7f3096614800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:15.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.564+0000 7f3096614800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.564+0000 7f3096614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:15.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.564+0000 7f3096614800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.564+0000 7f3096614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:15.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.564+0000 7f3096614800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.564+0000 7f3096614800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:15.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.564+0000 7f3096614800 20 zone default found 2024-09-12T17:23:15.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.564+0000 7f3096614800 4 Realm: () 2024-09-12T17:23:15.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.564+0000 7f3096614800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:15.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.564+0000 7f3096614800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:15.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.564+0000 7f3096614800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:15.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.564+0000 7f3096614800 20 zonegroup default 2024-09-12T17:23:15.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.564+0000 7f3096614800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.565+0000 7f3096614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:15.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.565+0000 7f3096614800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.565+0000 7f3096614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:15.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.565+0000 7f3096614800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.565+0000 7f3096614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:15.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.565+0000 7f3096614800 20 started sync module instance, tier type = 2024-09-12T17:23:15.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.565+0000 7f3096614800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:15.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.580+0000 7f3096614800 20 add_watcher() i=0 2024-09-12T17:23:15.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.580+0000 7f3096614800 20 add_watcher() i=1 2024-09-12T17:23:15.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.580+0000 7f3096614800 20 add_watcher() i=2 2024-09-12T17:23:15.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.580+0000 7f3096614800 20 add_watcher() i=3 2024-09-12T17:23:15.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.580+0000 7f3096614800 20 add_watcher() i=4 2024-09-12T17:23:15.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.580+0000 7f3096614800 20 add_watcher() i=5 2024-09-12T17:23:15.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.580+0000 7f3096614800 20 add_watcher() i=6 2024-09-12T17:23:15.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.581+0000 7f3096614800 20 add_watcher() i=7 2024-09-12T17:23:15.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.581+0000 7f3096614800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:15.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.582+0000 7f2f43fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:15.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.583+0000 7f3096614800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:15.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.583+0000 7f3096614800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:15.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.583+0000 7f3096614800 5 note: GC not initialized 2024-09-12T17:23:15.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.583+0000 7f2f42ffd640 20 reqs_thread_entry: start 2024-09-12T17:23:15.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.583+0000 7f3096614800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:15.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.583+0000 7f3096614800 20 Filter name: none 2024-09-12T17:23:15.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.583+0000 7f2f40ff9640 20 reqs_thread_entry: start 2024-09-12T17:23:15.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.583+0000 7f3096614800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.584+0000 7f3096614800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:23:15.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.584+0000 7f3096614800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.584+0000 7f3096614800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:23:15.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.584+0000 7f3096614800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:15.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.584+0000 7f3096614800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.584+0000 7f3096614800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:23:15.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.584+0000 7f3096614800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.585+0000 7f3096614800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:23:15.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.585+0000 7f3096614800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:15.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.586+0000 7f2f43fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:15.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.588+0000 7f3096614800 20 remove_watcher() i=0 2024-09-12T17:23:15.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.588+0000 7f3096614800 2 removed watcher, disabling cache 2024-09-12T17:23:15.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.590+0000 7f3096614800 20 remove_watcher() i=1 2024-09-12T17:23:15.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.591+0000 7f3096614800 20 remove_watcher() i=2 2024-09-12T17:23:15.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.591+0000 7f3096614800 20 remove_watcher() i=3 2024-09-12T17:23:15.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.592+0000 7f3096614800 20 remove_watcher() i=4 2024-09-12T17:23:15.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.593+0000 7f3096614800 20 remove_watcher() i=5 2024-09-12T17:23:15.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.594+0000 7f3096614800 20 remove_watcher() i=6 2024-09-12T17:23:15.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.595+0000 7f3096614800 20 remove_watcher() i=7 2024-09-12T17:23:15.608 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:15.608 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:23:15.608 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-init-index id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:23:15.608 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:15.610 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:15.610 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:15.644 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:15.644 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:15.701 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:23:15.734 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:15.735 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:15.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.976+0000 7f3f5b420800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.978+0000 7f3f5b420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:15.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.978+0000 7f3f5b420800 20 realm 2024-09-12T17:23:15.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.978+0000 7f3f5b420800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.978+0000 7f3f5b420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:15.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.978+0000 7f3f5b420800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:15.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.978+0000 7f3f5b420800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.978+0000 7f3f5b420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:15.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.978+0000 7f3f5b420800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.979+0000 7f3f5b420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:15.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.979+0000 7f3f5b420800 20 rados->read ofs=0 len=0 2024-09-12T17:23:15.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.980+0000 7f3f5b420800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:15.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.980+0000 7f3f5b420800 20 searching for the correct realm 2024-09-12T17:23:15.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.982+0000 7f3f58709640 0 -- 172.21.15.67:0/2689348426 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f3f48020060 msgr2=0x7f3f48071960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:15.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:15.987+0000 7f3f58f0a640 0 -- 172.21.15.67:0/2689348426 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f3f4c0c2bc0 msgr2=0x7f3f4c0b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:23:16.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.193+0000 7f3f5b420800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:16.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.193+0000 7f3f5b420800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:16.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.193+0000 7f3f5b420800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:16.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.193+0000 7f3f5b420800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:16.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.193+0000 7f3f5b420800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:16.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.193+0000 7f3f5b420800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:16.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.193+0000 7f3f5b420800 20 rados->read ofs=0 len=0 2024-09-12T17:23:16.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.193+0000 7f3f5b420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:16.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.193+0000 7f3f5b420800 20 rados->read ofs=0 len=0 2024-09-12T17:23:16.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.194+0000 7f3f5b420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:16.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.194+0000 7f3f5b420800 20 rados->read ofs=0 len=0 2024-09-12T17:23:16.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.194+0000 7f3f5b420800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:16.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.194+0000 7f3f5b420800 20 zone default found 2024-09-12T17:23:16.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.194+0000 7f3f5b420800 4 Realm: () 2024-09-12T17:23:16.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.194+0000 7f3f5b420800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:16.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.194+0000 7f3f5b420800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:16.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.194+0000 7f3f5b420800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:16.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.194+0000 7f3f5b420800 20 zonegroup default 2024-09-12T17:23:16.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.194+0000 7f3f5b420800 20 rados->read ofs=0 len=0 2024-09-12T17:23:16.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.194+0000 7f3f5b420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:16.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.194+0000 7f3f5b420800 20 rados->read ofs=0 len=0 2024-09-12T17:23:16.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.195+0000 7f3f5b420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:16.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.195+0000 7f3f5b420800 20 rados->read ofs=0 len=0 2024-09-12T17:23:16.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.195+0000 7f3f5b420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:16.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.195+0000 7f3f5b420800 20 started sync module instance, tier type = 2024-09-12T17:23:16.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.195+0000 7f3f5b420800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:16.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.205+0000 7f3f5b420800 20 add_watcher() i=0 2024-09-12T17:23:16.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.205+0000 7f3f5b420800 20 add_watcher() i=1 2024-09-12T17:23:16.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.205+0000 7f3f5b420800 20 add_watcher() i=2 2024-09-12T17:23:16.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.205+0000 7f3f5b420800 20 add_watcher() i=3 2024-09-12T17:23:16.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.205+0000 7f3f5b420800 20 add_watcher() i=4 2024-09-12T17:23:16.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.205+0000 7f3f5b420800 20 add_watcher() i=5 2024-09-12T17:23:16.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.205+0000 7f3f5b420800 20 add_watcher() i=6 2024-09-12T17:23:16.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.206+0000 7f3f5b420800 20 add_watcher() i=7 2024-09-12T17:23:16.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.206+0000 7f3f5b420800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:16.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.208+0000 7f3e0efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:16.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.208+0000 7f3f5b420800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:16.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.208+0000 7f3f5b420800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:16.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.208+0000 7f3f5b420800 5 note: GC not initialized 2024-09-12T17:23:16.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.208+0000 7f3e0dfe3640 20 reqs_thread_entry: start 2024-09-12T17:23:16.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.208+0000 7f3f5b420800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:16.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.209+0000 7f3f5b420800 20 Filter name: none 2024-09-12T17:23:16.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.209+0000 7f3d7f7fe640 20 reqs_thread_entry: start 2024-09-12T17:23:16.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.209+0000 7f3f5b420800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:23:16.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.209+0000 7f3f5b420800 20 rados->read ofs=0 len=0 2024-09-12T17:23:16.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.209+0000 7f3f5b420800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:23:16.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.209+0000 7f3f5b420800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:23:16.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.209+0000 7f3f5b420800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:23:16.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.209+0000 7f3f5b420800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 : miss 2024-09-12T17:23:16.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.209+0000 7f3f5b420800 20 rados->read ofs=0 len=0 2024-09-12T17:23:16.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.210+0000 7f3f5b420800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:23:16.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.210+0000 7f3f5b420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 info.flags=0x17 2024-09-12T17:23:16.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.210+0000 7f3f5b420800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 to cache LRU end 2024-09-12T17:23:16.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.210+0000 7f3f5b420800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:16.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.210+0000 7f3f5b420800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:16.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.210+0000 7f3f5b420800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 2024-09-12T17:23:16.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.214+0000 7f3f5b420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 info.flags=0x17 2024-09-12T17:23:16.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.214+0000 7f3f5b420800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 to cache LRU end 2024-09-12T17:23:16.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.214+0000 7f3f5b420800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:16.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.214+0000 7f3f5b420800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20, ofs0, ns] 2024-09-12T17:23:16.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.214+0000 7f3e2ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464278 cookie 94814951003488 notifier 5957 bl.length()=995 2024-09-12T17:23:16.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.214+0000 7f3e2ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 info.flags=0x17 2024-09-12T17:23:16.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.214+0000 7f3e2ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 to cache LRU end 2024-09-12T17:23:16.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.214+0000 7f3e2ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:16.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.216+0000 7f3f5b420800 20 handle_bi_update(): bucket=:error-at-init-index[06eb12d0-49d6-461d-9efe-05d212954deb.4538.20]): orig_sources= new_sources= 2024-09-12T17:23:16.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.216+0000 7f3f5b420800 20 handle_bi_update(): bucket=:error-at-init-index[06eb12d0-49d6-461d-9efe-05d212954deb.4538.20]): potential sources added=[] removed=[] 2024-09-12T17:23:16.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.216+0000 7f3f5b420800 20 handle_bi_update(): bucket=:error-at-init-index[06eb12d0-49d6-461d-9efe-05d212954deb.4538.20]): orig_dests= new_dests= 2024-09-12T17:23:16.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.216+0000 7f3f5b420800 20 handle_bi_update(): bucket=:error-at-init-index[06eb12d0-49d6-461d-9efe-05d212954deb.4538.20]): potential dests added=[] removed=[] 2024-09-12T17:23:16.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.219+0000 7f3f5b420800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.20.1.0 2024-09-12T17:23:16.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.219+0000 7f3f5b420800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.20.1.0 2024-09-12T17:23:16.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.219+0000 7f3f5b420800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.20.1.1 2024-09-12T17:23:16.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.219+0000 7f3f5b420800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.20.1.1 2024-09-12T17:23:16.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.219+0000 7f3f5b420800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.20.0 2024-09-12T17:23:16.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.222+0000 7f3f5b420800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 : hit (requested=0x17, cached=0x17) 2024-09-12T17:23:16.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.222+0000 7f3f5b420800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 2024-09-12T17:23:16.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.223+0000 7f3f5b420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 info.flags=0x17 2024-09-12T17:23:16.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.223+0000 7f3f5b420800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 to cache LRU end 2024-09-12T17:23:16.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.223+0000 7f3f5b420800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:16.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.223+0000 7f3f5b420800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20, ofs0, ns] 2024-09-12T17:23:16.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.223+0000 7f3e2ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464279 cookie 94814951003488 notifier 5957 bl.length()=995 2024-09-12T17:23:16.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.223+0000 7f3e2ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 info.flags=0x17 2024-09-12T17:23:16.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.223+0000 7f3e2ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 to cache LRU end 2024-09-12T17:23:16.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.223+0000 7f3e2ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:16.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.225+0000 7f3f5b420800 20 handle_bi_update(): bucket=:error-at-init-index[06eb12d0-49d6-461d-9efe-05d212954deb.4538.20]): orig_sources= new_sources= 2024-09-12T17:23:16.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.225+0000 7f3f5b420800 20 handle_bi_update(): bucket=:error-at-init-index[06eb12d0-49d6-461d-9efe-05d212954deb.4538.20]): potential sources added=[] removed=[] 2024-09-12T17:23:16.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.225+0000 7f3f5b420800 20 handle_bi_update(): bucket=:error-at-init-index[06eb12d0-49d6-461d-9efe-05d212954deb.4538.20]): orig_dests= new_dests= 2024-09-12T17:23:16.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.225+0000 7f3f5b420800 20 handle_bi_update(): bucket=:error-at-init-index[06eb12d0-49d6-461d-9efe-05d212954deb.4538.20]): potential dests added=[] removed=[] 2024-09-12T17:23:16.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.226+0000 7f3f5b420800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.20.0 2024-09-12T17:23:16.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.226+0000 7f3f5b420800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 : hit (requested=0x17, cached=0x17) 2024-09-12T17:23:16.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.226+0000 7f3f5b420800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 2024-09-12T17:23:16.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.227+0000 7f3f5b420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 info.flags=0x17 2024-09-12T17:23:16.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.227+0000 7f3f5b420800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 to cache LRU end 2024-09-12T17:23:16.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.227+0000 7f3f5b420800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:16.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.227+0000 7f3f5b420800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20, ofs0, ns] 2024-09-12T17:23:16.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.228+0000 7f3e2ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464280 cookie 94814951003488 notifier 5957 bl.length()=963 2024-09-12T17:23:16.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.228+0000 7f3e2ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 info.flags=0x17 2024-09-12T17:23:16.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.228+0000 7f3e2ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 to cache LRU end 2024-09-12T17:23:16.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.228+0000 7f3e2ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:16.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.229+0000 7f3f5b420800 20 handle_bi_update(): bucket=:error-at-init-index[06eb12d0-49d6-461d-9efe-05d212954deb.4538.20]): orig_sources= new_sources= 2024-09-12T17:23:16.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.229+0000 7f3f5b420800 20 handle_bi_update(): bucket=:error-at-init-index[06eb12d0-49d6-461d-9efe-05d212954deb.4538.20]): potential sources added=[] removed=[] 2024-09-12T17:23:16.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.229+0000 7f3f5b420800 20 handle_bi_update(): bucket=:error-at-init-index[06eb12d0-49d6-461d-9efe-05d212954deb.4538.20]): orig_dests= new_dests= 2024-09-12T17:23:16.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.229+0000 7f3f5b420800 20 handle_bi_update(): bucket=:error-at-init-index[06eb12d0-49d6-461d-9efe-05d212954deb.4538.20]): potential dests added=[] removed=[] 2024-09-12T17:23:16.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.231+0000 7f3f5b420800 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-12T17:23:16.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.233+0000 7f3e0efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:16.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.235+0000 7f3f5b420800 20 remove_watcher() i=0 2024-09-12T17:23:16.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.235+0000 7f3f5b420800 2 removed watcher, disabling cache 2024-09-12T17:23:16.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.238+0000 7f3f5b420800 20 remove_watcher() i=1 2024-09-12T17:23:16.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.239+0000 7f3f5b420800 20 remove_watcher() i=2 2024-09-12T17:23:16.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.240+0000 7f3f5b420800 20 remove_watcher() i=3 2024-09-12T17:23:16.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.241+0000 7f3f5b420800 20 remove_watcher() i=4 2024-09-12T17:23:16.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.242+0000 7f3f5b420800 20 remove_watcher() i=5 2024-09-12T17:23:16.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.243+0000 7f3f5b420800 20 remove_watcher() i=6 2024-09-12T17:23:16.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.244+0000 7f3f5b420800 20 remove_watcher() i=7 2024-09-12T17:23:16.258 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:23:16.287 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:16.287 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:16.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.325+0000 7f2a9e526800 20 rados->read ofs=0 len=0 2024-09-12T17:23:16.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.327+0000 7f2a9e526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:16.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.327+0000 7f2a9e526800 20 realm 2024-09-12T17:23:16.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.327+0000 7f2a9e526800 20 rados->read ofs=0 len=0 2024-09-12T17:23:16.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.327+0000 7f2a9e526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:16.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.327+0000 7f2a9e526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:16.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.327+0000 7f2a9e526800 20 rados->read ofs=0 len=0 2024-09-12T17:23:16.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.327+0000 7f2a9e526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:16.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.327+0000 7f2a9e526800 20 rados->read ofs=0 len=0 2024-09-12T17:23:16.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.328+0000 7f2a9e526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:16.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.328+0000 7f2a9e526800 20 rados->read ofs=0 len=0 2024-09-12T17:23:16.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.329+0000 7f2a9e526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:16.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.329+0000 7f2a9e526800 20 searching for the correct realm 2024-09-12T17:23:16.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.332+0000 7f2a99908640 0 -- 172.21.15.67:0/2080799860 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55b6673f3d50 msgr2=0x55b6673f6140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:16.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.336+0000 7f2a9a90a640 0 -- 172.21.15.67:0/2080799860 >> [v2:172.21.15.118:6824/1070975205,v1:172.21.15.118:6825/1070975205] conn(0x7f2a9003c040 msgr2=0x7f2a9003b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:16.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.340+0000 7f2a9e526800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:16.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.340+0000 7f2a9e526800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:16.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.340+0000 7f2a9e526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:16.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.340+0000 7f2a9e526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:16.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.340+0000 7f2a9e526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:16.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.340+0000 7f2a9e526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:16.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.340+0000 7f2a9e526800 20 rados->read ofs=0 len=0 2024-09-12T17:23:16.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.340+0000 7f2a9e526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:16.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.340+0000 7f2a9e526800 20 rados->read ofs=0 len=0 2024-09-12T17:23:16.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.340+0000 7f2a9e526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:16.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.340+0000 7f2a9e526800 20 rados->read ofs=0 len=0 2024-09-12T17:23:16.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.341+0000 7f2a9e526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:16.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.341+0000 7f2a9e526800 20 zone default found 2024-09-12T17:23:16.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.341+0000 7f2a9e526800 4 Realm: () 2024-09-12T17:23:16.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.341+0000 7f2a9e526800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:16.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.341+0000 7f2a9e526800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:16.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.341+0000 7f2a9e526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:16.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.341+0000 7f2a9e526800 20 zonegroup default 2024-09-12T17:23:16.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.341+0000 7f2a9e526800 20 rados->read ofs=0 len=0 2024-09-12T17:23:16.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.341+0000 7f2a9e526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:16.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.341+0000 7f2a9e526800 20 rados->read ofs=0 len=0 2024-09-12T17:23:16.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.341+0000 7f2a9e526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:16.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.341+0000 7f2a9e526800 20 rados->read ofs=0 len=0 2024-09-12T17:23:16.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.341+0000 7f2a9e526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:16.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.341+0000 7f2a9e526800 20 started sync module instance, tier type = 2024-09-12T17:23:16.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.341+0000 7f2a9e526800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:16.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.351+0000 7f2a9e526800 20 add_watcher() i=0 2024-09-12T17:23:16.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.351+0000 7f2a9e526800 20 add_watcher() i=1 2024-09-12T17:23:16.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.351+0000 7f2a9e526800 20 add_watcher() i=2 2024-09-12T17:23:16.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.351+0000 7f2a9e526800 20 add_watcher() i=3 2024-09-12T17:23:16.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.351+0000 7f2a9e526800 20 add_watcher() i=4 2024-09-12T17:23:16.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.351+0000 7f2a9e526800 20 add_watcher() i=5 2024-09-12T17:23:16.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.351+0000 7f2a9e526800 20 add_watcher() i=6 2024-09-12T17:23:16.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.353+0000 7f2a9e526800 20 add_watcher() i=7 2024-09-12T17:23:16.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.353+0000 7f2a9e526800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:16.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.354+0000 7f2950fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:16.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.355+0000 7f2a9e526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:16.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.355+0000 7f2a9e526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:16.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.355+0000 7f2a9e526800 5 note: GC not initialized 2024-09-12T17:23:16.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.355+0000 7f28cb7fe640 20 reqs_thread_entry: start 2024-09-12T17:23:16.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.355+0000 7f2a9e526800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:16.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.355+0000 7f2a9e526800 20 Filter name: none 2024-09-12T17:23:16.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.355+0000 7f28c97fa640 20 reqs_thread_entry: start 2024-09-12T17:23:16.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.355+0000 7f2a9e526800 20 rados->read ofs=0 len=0 2024-09-12T17:23:16.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.356+0000 7f2a9e526800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:23:16.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.356+0000 7f2a9e526800 20 rados->read ofs=0 len=0 2024-09-12T17:23:16.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.356+0000 7f2a9e526800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:23:16.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.356+0000 7f2a9e526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:16.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.356+0000 7f2a9e526800 20 rados->read ofs=0 len=0 2024-09-12T17:23:16.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.357+0000 7f2a9e526800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:23:16.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.357+0000 7f2a9e526800 20 rados->read ofs=0 len=0 2024-09-12T17:23:16.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.357+0000 7f2a9e526800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:23:16.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.357+0000 7f2a9e526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:16.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.358+0000 7f2950fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:16.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.361+0000 7f2a9e526800 20 remove_watcher() i=0 2024-09-12T17:23:16.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.361+0000 7f2a9e526800 2 removed watcher, disabling cache 2024-09-12T17:23:16.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.362+0000 7f2a9e526800 20 remove_watcher() i=1 2024-09-12T17:23:16.364 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.363+0000 7f2a9e526800 20 remove_watcher() i=2 2024-09-12T17:23:16.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.364+0000 7f2a9e526800 20 remove_watcher() i=3 2024-09-12T17:23:16.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.365+0000 7f2a9e526800 20 remove_watcher() i=4 2024-09-12T17:23:16.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.366+0000 7f2a9e526800 20 remove_watcher() i=5 2024-09-12T17:23:16.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.368+0000 7f2a9e526800 20 remove_watcher() i=6 2024-09-12T17:23:16.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:16.369+0000 7f2a9e526800 20 remove_watcher() i=7 2024-09-12T17:23:16.382 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:16.382 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:23:16.382 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-init-index id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.20 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:23:16.382 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:16.385 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:16.385 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:16.403 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:16.403 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:16.631 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:16.631 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:16.701 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-12T17:23:16.701 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:16.702 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:16.702 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:16.743 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:16.743 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:16.800 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:16.801 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:16.834 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:16.834 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:16.871 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:16.871 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:16.906 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:16.906 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:16.943 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:16.943 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:16.978 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:16.978 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:17.014 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:17.014 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:17.050 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:17.050 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:17.086 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:17.086 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:17.123 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:17.123 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:17.158 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:17.159 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:17.195 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:17.196 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:17.230 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:17.230 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:17.266 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:17.266 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:17.303 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:17.303 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:17.338 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:17.338 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:17.375 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:17.376 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:17.412 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:17.412 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:17.448 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:17.448 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:17.485 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:17.485 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:17.521 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:23:17.550 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:17.550 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:17.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.587+0000 7f7db9925800 20 rados->read ofs=0 len=0 2024-09-12T17:23:17.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.589+0000 7f7db9925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:17.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.589+0000 7f7db9925800 20 realm 2024-09-12T17:23:17.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.589+0000 7f7db9925800 20 rados->read ofs=0 len=0 2024-09-12T17:23:17.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.589+0000 7f7db9925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:17.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.589+0000 7f7db9925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:17.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.589+0000 7f7db9925800 20 rados->read ofs=0 len=0 2024-09-12T17:23:17.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.589+0000 7f7db9925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:17.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.589+0000 7f7db9925800 20 rados->read ofs=0 len=0 2024-09-12T17:23:17.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.590+0000 7f7db9925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:17.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.590+0000 7f7db9925800 20 rados->read ofs=0 len=0 2024-09-12T17:23:17.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.591+0000 7f7db9925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:17.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.591+0000 7f7db9925800 20 searching for the correct realm 2024-09-12T17:23:17.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.593+0000 7f7db55ae640 0 -- 172.21.15.67:0/717424053 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f7db009bc20 msgr2=0x7f7db0089b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:23:17.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.597+0000 7f7db55ae640 0 -- 172.21.15.67:0/717424053 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f7dac0ad2b0 msgr2=0x7f7dac0e2270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:17.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.802+0000 7f7db9925800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:17.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.802+0000 7f7db9925800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:17.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.802+0000 7f7db9925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:17.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.802+0000 7f7db9925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:17.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.802+0000 7f7db9925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:17.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.802+0000 7f7db9925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:17.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.802+0000 7f7db9925800 20 rados->read ofs=0 len=0 2024-09-12T17:23:17.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.803+0000 7f7db9925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:17.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.803+0000 7f7db9925800 20 rados->read ofs=0 len=0 2024-09-12T17:23:17.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.803+0000 7f7db9925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:17.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.803+0000 7f7db9925800 20 rados->read ofs=0 len=0 2024-09-12T17:23:17.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.803+0000 7f7db9925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:17.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.803+0000 7f7db9925800 20 zone default found 2024-09-12T17:23:17.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.803+0000 7f7db9925800 4 Realm: () 2024-09-12T17:23:17.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.803+0000 7f7db9925800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:17.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.803+0000 7f7db9925800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:17.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.803+0000 7f7db9925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:17.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.803+0000 7f7db9925800 20 zonegroup default 2024-09-12T17:23:17.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.803+0000 7f7db9925800 20 rados->read ofs=0 len=0 2024-09-12T17:23:17.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.804+0000 7f7db9925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:17.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.804+0000 7f7db9925800 20 rados->read ofs=0 len=0 2024-09-12T17:23:17.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.804+0000 7f7db9925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:17.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.804+0000 7f7db9925800 20 rados->read ofs=0 len=0 2024-09-12T17:23:17.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.804+0000 7f7db9925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:17.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.804+0000 7f7db9925800 20 started sync module instance, tier type = 2024-09-12T17:23:17.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.804+0000 7f7db9925800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:17.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.816+0000 7f7db9925800 20 add_watcher() i=0 2024-09-12T17:23:17.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.816+0000 7f7db9925800 20 add_watcher() i=1 2024-09-12T17:23:17.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.816+0000 7f7db9925800 20 add_watcher() i=2 2024-09-12T17:23:17.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.816+0000 7f7db9925800 20 add_watcher() i=3 2024-09-12T17:23:17.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.816+0000 7f7db9925800 20 add_watcher() i=4 2024-09-12T17:23:17.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.816+0000 7f7db9925800 20 add_watcher() i=5 2024-09-12T17:23:17.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.816+0000 7f7db9925800 20 add_watcher() i=6 2024-09-12T17:23:17.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.817+0000 7f7db9925800 20 add_watcher() i=7 2024-09-12T17:23:17.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.817+0000 7f7db9925800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:17.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.818+0000 7f7c6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:17.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.818+0000 7f7db9925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:17.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.819+0000 7f7db9925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:17.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.819+0000 7f7db9925800 5 note: GC not initialized 2024-09-12T17:23:17.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.819+0000 7f7c6a7e4640 20 reqs_thread_entry: start 2024-09-12T17:23:17.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.819+0000 7f7db9925800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:17.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.819+0000 7f7db9925800 20 Filter name: none 2024-09-12T17:23:17.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.819+0000 7f7bdbfff640 20 reqs_thread_entry: start 2024-09-12T17:23:17.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.819+0000 7f7db9925800 20 rados->read ofs=0 len=0 2024-09-12T17:23:17.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.820+0000 7f7db9925800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:23:17.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.820+0000 7f7db9925800 20 rados->read ofs=0 len=0 2024-09-12T17:23:17.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.820+0000 7f7db9925800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:23:17.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.820+0000 7f7db9925800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:17.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.820+0000 7f7db9925800 20 rados->read ofs=0 len=0 2024-09-12T17:23:17.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.821+0000 7f7db9925800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:23:17.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.821+0000 7f7db9925800 20 rados->read ofs=0 len=0 2024-09-12T17:23:17.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.821+0000 7f7db9925800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:23:17.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.821+0000 7f7db9925800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:17.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.823+0000 7f7c6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:17.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.825+0000 7f7db9925800 20 remove_watcher() i=0 2024-09-12T17:23:17.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.825+0000 7f7db9925800 2 removed watcher, disabling cache 2024-09-12T17:23:17.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.826+0000 7f7db9925800 20 remove_watcher() i=1 2024-09-12T17:23:17.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.827+0000 7f7db9925800 20 remove_watcher() i=2 2024-09-12T17:23:17.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.828+0000 7f7db9925800 20 remove_watcher() i=3 2024-09-12T17:23:17.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.829+0000 7f7db9925800 20 remove_watcher() i=4 2024-09-12T17:23:17.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.830+0000 7f7db9925800 20 remove_watcher() i=5 2024-09-12T17:23:17.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.831+0000 7f7db9925800 20 remove_watcher() i=6 2024-09-12T17:23:17.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.832+0000 7f7db9925800 20 remove_watcher() i=7 2024-09-12T17:23:17.845 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:17.845 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:23:17.845 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-init-index id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:23:17.845 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:17.847 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-12T17:23:17.884 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:17.884 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:17.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.921+0000 7f72a9325800 20 rados->read ofs=0 len=0 2024-09-12T17:23:17.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.923+0000 7f72a9325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:17.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.923+0000 7f72a9325800 20 realm 2024-09-12T17:23:17.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.923+0000 7f72a9325800 20 rados->read ofs=0 len=0 2024-09-12T17:23:17.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.923+0000 7f72a9325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:17.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.923+0000 7f72a9325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:17.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.923+0000 7f72a9325800 20 rados->read ofs=0 len=0 2024-09-12T17:23:17.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.923+0000 7f72a9325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:17.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.923+0000 7f72a9325800 20 rados->read ofs=0 len=0 2024-09-12T17:23:17.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.924+0000 7f72a9325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:17.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.924+0000 7f72a9325800 20 rados->read ofs=0 len=0 2024-09-12T17:23:17.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.925+0000 7f72a9325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:17.928 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.925+0000 7f72a9325800 20 searching for the correct realm 2024-09-12T17:23:17.928 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:17.926+0000 7f72a47b4640 0 -- 172.21.15.67:0/2790095704 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f72940a7040 msgr2=0x7f72940a7930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:23:18.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.131+0000 7f72a4fb5640 0 -- 172.21.15.67:0/2790095704 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f7298074dd0 msgr2=0x7f7298082390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:18.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.337+0000 7f72a9325800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:18.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.337+0000 7f72a9325800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:18.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.337+0000 7f72a9325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:18.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.337+0000 7f72a9325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:18.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.337+0000 7f72a9325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:18.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.337+0000 7f72a9325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:18.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.337+0000 7f72a9325800 20 rados->read ofs=0 len=0 2024-09-12T17:23:18.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.337+0000 7f72a9325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:18.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.337+0000 7f72a9325800 20 rados->read ofs=0 len=0 2024-09-12T17:23:18.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.338+0000 7f72a9325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:18.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.338+0000 7f72a9325800 20 rados->read ofs=0 len=0 2024-09-12T17:23:18.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.338+0000 7f72a9325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:18.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.338+0000 7f72a9325800 20 zone default found 2024-09-12T17:23:18.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.338+0000 7f72a9325800 4 Realm: () 2024-09-12T17:23:18.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.338+0000 7f72a9325800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:18.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.338+0000 7f72a9325800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:18.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.338+0000 7f72a9325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:18.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.338+0000 7f72a9325800 20 zonegroup default 2024-09-12T17:23:18.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.338+0000 7f72a9325800 20 rados->read ofs=0 len=0 2024-09-12T17:23:18.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.338+0000 7f72a9325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:18.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.338+0000 7f72a9325800 20 rados->read ofs=0 len=0 2024-09-12T17:23:18.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.339+0000 7f72a9325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:18.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.339+0000 7f72a9325800 20 rados->read ofs=0 len=0 2024-09-12T17:23:18.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.339+0000 7f72a9325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:18.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.339+0000 7f72a9325800 20 started sync module instance, tier type = 2024-09-12T17:23:18.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.339+0000 7f72a9325800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:18.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.349+0000 7f72a9325800 20 add_watcher() i=0 2024-09-12T17:23:18.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.349+0000 7f72a9325800 20 add_watcher() i=1 2024-09-12T17:23:18.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.349+0000 7f72a9325800 20 add_watcher() i=2 2024-09-12T17:23:18.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.349+0000 7f72a9325800 20 add_watcher() i=3 2024-09-12T17:23:18.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.349+0000 7f72a9325800 20 add_watcher() i=4 2024-09-12T17:23:18.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.349+0000 7f72a9325800 20 add_watcher() i=5 2024-09-12T17:23:18.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.349+0000 7f72a9325800 20 add_watcher() i=6 2024-09-12T17:23:18.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.350+0000 7f72a9325800 20 add_watcher() i=7 2024-09-12T17:23:18.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.350+0000 7f72a9325800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:18.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.352+0000 7f715b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:18.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.352+0000 7f72a9325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:18.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.352+0000 7f72a9325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:18.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.352+0000 7f72a9325800 5 note: GC not initialized 2024-09-12T17:23:18.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.352+0000 7f715a7e4640 20 reqs_thread_entry: start 2024-09-12T17:23:18.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.352+0000 7f72a9325800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:18.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.352+0000 7f72a9325800 20 Filter name: none 2024-09-12T17:23:18.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.352+0000 7f7153fff640 20 reqs_thread_entry: start 2024-09-12T17:23:18.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.353+0000 7f72a9325800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:23:18.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.353+0000 7f72a9325800 20 rados->read ofs=0 len=0 2024-09-12T17:23:18.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.353+0000 7f72a9325800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:23:18.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.353+0000 7f72a9325800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:23:18.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.353+0000 7f72a9325800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:23:18.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.353+0000 7f72a9325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21 : miss 2024-09-12T17:23:18.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.353+0000 7f72a9325800 20 rados->read ofs=0 len=0 2024-09-12T17:23:18.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.353+0000 7f72a9325800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:23:18.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.353+0000 7f72a9325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21 info.flags=0x17 2024-09-12T17:23:18.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.353+0000 7f72a9325800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21 to cache LRU end 2024-09-12T17:23:18.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.353+0000 7f72a9325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:18.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.353+0000 7f72a9325800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:18.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.353+0000 7f72a9325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21 2024-09-12T17:23:18.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.355+0000 7f72a9325800 -1 Injecting error=-95 at location=init_index 2024-09-12T17:23:18.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.355+0000 7f72a9325800 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-12T17:23:18.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.357+0000 7f72a9325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21 info.flags=0x17 2024-09-12T17:23:18.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.357+0000 7f72a9325800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21 to cache LRU end 2024-09-12T17:23:18.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.357+0000 7f72a9325800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:18.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.357+0000 7f72a9325800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21, ofs0, ns] 2024-09-12T17:23:18.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.357+0000 7f717bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464283 cookie 94653878593392 notifier 6372 bl.length()=995 2024-09-12T17:23:18.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.357+0000 7f717bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21 info.flags=0x17 2024-09-12T17:23:18.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.357+0000 7f717bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21 to cache LRU end 2024-09-12T17:23:18.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.357+0000 7f717bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:18.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.359+0000 7f72a9325800 20 handle_bi_update(): bucket=:error-at-init-index[06eb12d0-49d6-461d-9efe-05d212954deb.4538.21]): orig_sources= new_sources= 2024-09-12T17:23:18.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.359+0000 7f72a9325800 20 handle_bi_update(): bucket=:error-at-init-index[06eb12d0-49d6-461d-9efe-05d212954deb.4538.21]): potential sources added=[] removed=[] 2024-09-12T17:23:18.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.359+0000 7f72a9325800 20 handle_bi_update(): bucket=:error-at-init-index[06eb12d0-49d6-461d-9efe-05d212954deb.4538.21]): orig_dests= new_dests= 2024-09-12T17:23:18.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.359+0000 7f72a9325800 20 handle_bi_update(): bucket=:error-at-init-index[06eb12d0-49d6-461d-9efe-05d212954deb.4538.21]): potential dests added=[] removed=[] 2024-09-12T17:23:18.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.360+0000 7f72a9325800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.21.1.0 2024-09-12T17:23:18.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.360+0000 7f72a9325800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.21.1.0 2024-09-12T17:23:18.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.360+0000 7f72a9325800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.21.1.1 2024-09-12T17:23:18.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.360+0000 7f72a9325800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.21.1.1 2024-09-12T17:23:18.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.360+0000 7f72a9325800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.21.0 2024-09-12T17:23:18.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.363+0000 7f72a9325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21 : hit (requested=0x17, cached=0x17) 2024-09-12T17:23:18.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.363+0000 7f72a9325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21 2024-09-12T17:23:18.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.364+0000 7f72a9325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21 info.flags=0x17 2024-09-12T17:23:18.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.364+0000 7f72a9325800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21 to cache LRU end 2024-09-12T17:23:18.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.364+0000 7f72a9325800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:18.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.364+0000 7f72a9325800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21, ofs0, ns] 2024-09-12T17:23:18.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.364+0000 7f717b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464284 cookie 94653878593392 notifier 6372 bl.length()=963 2024-09-12T17:23:18.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.364+0000 7f717b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21 info.flags=0x17 2024-09-12T17:23:18.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.364+0000 7f717b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21 to cache LRU end 2024-09-12T17:23:18.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.364+0000 7f717b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:18.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.366+0000 7f72a9325800 20 handle_bi_update(): bucket=:error-at-init-index[06eb12d0-49d6-461d-9efe-05d212954deb.4538.21]): orig_sources= new_sources= 2024-09-12T17:23:18.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.366+0000 7f72a9325800 20 handle_bi_update(): bucket=:error-at-init-index[06eb12d0-49d6-461d-9efe-05d212954deb.4538.21]): potential sources added=[] removed=[] 2024-09-12T17:23:18.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.366+0000 7f72a9325800 20 handle_bi_update(): bucket=:error-at-init-index[06eb12d0-49d6-461d-9efe-05d212954deb.4538.21]): orig_dests= new_dests= 2024-09-12T17:23:18.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.366+0000 7f72a9325800 20 handle_bi_update(): bucket=:error-at-init-index[06eb12d0-49d6-461d-9efe-05d212954deb.4538.21]): potential dests added=[] removed=[] 2024-09-12T17:23:18.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.367+0000 7f72a9325800 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-12T17:23:18.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.369+0000 7f715b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:18.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.372+0000 7f72a9325800 20 remove_watcher() i=0 2024-09-12T17:23:18.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.372+0000 7f72a9325800 2 removed watcher, disabling cache 2024-09-12T17:23:18.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.373+0000 7f72a9325800 20 remove_watcher() i=1 2024-09-12T17:23:18.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.374+0000 7f72a9325800 20 remove_watcher() i=2 2024-09-12T17:23:18.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.375+0000 7f72a9325800 20 remove_watcher() i=3 2024-09-12T17:23:18.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.376+0000 7f72a9325800 20 remove_watcher() i=4 2024-09-12T17:23:18.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.376+0000 7f72a9325800 20 remove_watcher() i=5 2024-09-12T17:23:18.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.377+0000 7f72a9325800 20 remove_watcher() i=6 2024-09-12T17:23:18.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.378+0000 7f72a9325800 20 remove_watcher() i=7 2024-09-12T17:23:18.393 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:23:18.423 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:18.423 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:18.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.460+0000 7f84b7915800 20 rados->read ofs=0 len=0 2024-09-12T17:23:18.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.462+0000 7f84b7915800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:18.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.462+0000 7f84b7915800 20 realm 2024-09-12T17:23:18.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.462+0000 7f84b7915800 20 rados->read ofs=0 len=0 2024-09-12T17:23:18.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.462+0000 7f84b7915800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:18.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.462+0000 7f84b7915800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:18.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.462+0000 7f84b7915800 20 rados->read ofs=0 len=0 2024-09-12T17:23:18.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.462+0000 7f84b7915800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:18.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.462+0000 7f84b7915800 20 rados->read ofs=0 len=0 2024-09-12T17:23:18.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.463+0000 7f84b7915800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:18.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.463+0000 7f84b7915800 20 rados->read ofs=0 len=0 2024-09-12T17:23:18.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.464+0000 7f84b7915800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:18.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.464+0000 7f84b7915800 20 searching for the correct realm 2024-09-12T17:23:18.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.467+0000 7f84b5c00640 0 -- 172.21.15.67:0/3397998805 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x559c9936abe0 msgr2=0x559c9936d0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:18.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.470+0000 7f84b53ff640 0 -- 172.21.15.67:0/3397998805 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f84ac0961c0 msgr2=0x7f84ac0860d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:18.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.475+0000 7f84b7915800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:18.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.475+0000 7f84b7915800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:18.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.475+0000 7f84b7915800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:18.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.475+0000 7f84b7915800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:18.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.475+0000 7f84b7915800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:18.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.475+0000 7f84b7915800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:18.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.475+0000 7f84b7915800 20 rados->read ofs=0 len=0 2024-09-12T17:23:18.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.475+0000 7f84b7915800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:18.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.475+0000 7f84b7915800 20 rados->read ofs=0 len=0 2024-09-12T17:23:18.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.475+0000 7f84b7915800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:18.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.475+0000 7f84b7915800 20 rados->read ofs=0 len=0 2024-09-12T17:23:18.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.476+0000 7f84b7915800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:18.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.476+0000 7f84b7915800 20 zone default found 2024-09-12T17:23:18.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.476+0000 7f84b7915800 4 Realm: () 2024-09-12T17:23:18.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.476+0000 7f84b7915800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:18.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.476+0000 7f84b7915800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:18.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.476+0000 7f84b7915800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:18.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.476+0000 7f84b7915800 20 zonegroup default 2024-09-12T17:23:18.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.476+0000 7f84b7915800 20 rados->read ofs=0 len=0 2024-09-12T17:23:18.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.476+0000 7f84b7915800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:18.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.476+0000 7f84b7915800 20 rados->read ofs=0 len=0 2024-09-12T17:23:18.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.476+0000 7f84b7915800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:18.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.476+0000 7f84b7915800 20 rados->read ofs=0 len=0 2024-09-12T17:23:18.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.476+0000 7f84b7915800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:18.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.476+0000 7f84b7915800 20 started sync module instance, tier type = 2024-09-12T17:23:18.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.476+0000 7f84b7915800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:18.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.485+0000 7f84b7915800 20 add_watcher() i=0 2024-09-12T17:23:18.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.485+0000 7f84b7915800 20 add_watcher() i=1 2024-09-12T17:23:18.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.485+0000 7f84b7915800 20 add_watcher() i=2 2024-09-12T17:23:18.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.485+0000 7f84b7915800 20 add_watcher() i=3 2024-09-12T17:23:18.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.485+0000 7f84b7915800 20 add_watcher() i=4 2024-09-12T17:23:18.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.485+0000 7f84b7915800 20 add_watcher() i=5 2024-09-12T17:23:18.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.485+0000 7f84b7915800 20 add_watcher() i=6 2024-09-12T17:23:18.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.486+0000 7f84b7915800 20 add_watcher() i=7 2024-09-12T17:23:18.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.486+0000 7f84b7915800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:18.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.488+0000 7f836bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:18.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.488+0000 7f84b7915800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:18.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.488+0000 7f84b7915800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:18.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.488+0000 7f84b7915800 5 note: GC not initialized 2024-09-12T17:23:18.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.489+0000 7f836afe5640 20 reqs_thread_entry: start 2024-09-12T17:23:18.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.489+0000 7f84b7915800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:18.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.489+0000 7f84b7915800 20 Filter name: none 2024-09-12T17:23:18.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.489+0000 7f8368fe1640 20 reqs_thread_entry: start 2024-09-12T17:23:18.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.489+0000 7f84b7915800 20 rados->read ofs=0 len=0 2024-09-12T17:23:18.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.489+0000 7f84b7915800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:23:18.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.489+0000 7f84b7915800 20 rados->read ofs=0 len=0 2024-09-12T17:23:18.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.490+0000 7f84b7915800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:23:18.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.490+0000 7f84b7915800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:18.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.490+0000 7f84b7915800 20 rados->read ofs=0 len=0 2024-09-12T17:23:18.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.490+0000 7f84b7915800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:23:18.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.490+0000 7f84b7915800 20 rados->read ofs=0 len=0 2024-09-12T17:23:18.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.491+0000 7f84b7915800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:23:18.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.491+0000 7f84b7915800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:18.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.492+0000 7f836bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:18.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.494+0000 7f84b7915800 20 remove_watcher() i=0 2024-09-12T17:23:18.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.494+0000 7f84b7915800 2 removed watcher, disabling cache 2024-09-12T17:23:18.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.495+0000 7f84b7915800 20 remove_watcher() i=1 2024-09-12T17:23:18.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.496+0000 7f84b7915800 20 remove_watcher() i=2 2024-09-12T17:23:18.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.498+0000 7f84b7915800 20 remove_watcher() i=3 2024-09-12T17:23:18.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.499+0000 7f84b7915800 20 remove_watcher() i=4 2024-09-12T17:23:18.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.499+0000 7f84b7915800 20 remove_watcher() i=5 2024-09-12T17:23:18.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.500+0000 7f84b7915800 20 remove_watcher() i=6 2024-09-12T17:23:18.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:18.501+0000 7f84b7915800 20 remove_watcher() i=7 2024-09-12T17:23:18.514 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:18.514 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:23:18.514 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-init-index id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.21 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T17:23:18.514 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:18.516 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:18.516 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:18.534 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:18.534 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:18.789 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:18.789 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:18.853 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with abort at init_index 2024-09-12T17:23:18.853 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:18.854 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:18.854 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:18.896 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:18.896 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:18.956 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:18.956 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:18.993 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:18.993 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:19.032 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:19.032 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:19.068 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:19.068 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:19.105 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:19.105 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:19.142 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:19.142 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:19.178 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:19.178 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:19.214 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:19.214 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:19.250 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:19.250 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:19.286 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:19.287 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:19.323 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:19.323 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:19.359 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:19.360 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:19.396 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:19.396 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:19.433 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:19.433 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:19.469 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:19.469 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:19.505 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:19.505 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:19.541 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:19.541 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:19.576 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:19.577 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:19.614 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:19.614 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:19.650 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:19.650 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:19.686 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:23:19.715 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:19.716 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:19.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.753+0000 7f28f792c800 20 rados->read ofs=0 len=0 2024-09-12T17:23:19.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.754+0000 7f28f792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:19.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.754+0000 7f28f792c800 20 realm 2024-09-12T17:23:19.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.754+0000 7f28f792c800 20 rados->read ofs=0 len=0 2024-09-12T17:23:19.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.755+0000 7f28f792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:19.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.755+0000 7f28f792c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:19.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.755+0000 7f28f792c800 20 rados->read ofs=0 len=0 2024-09-12T17:23:19.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.755+0000 7f28f792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:19.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.755+0000 7f28f792c800 20 rados->read ofs=0 len=0 2024-09-12T17:23:19.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.756+0000 7f28f792c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:19.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.756+0000 7f28f792c800 20 rados->read ofs=0 len=0 2024-09-12T17:23:19.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.756+0000 7f28f792c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:19.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.756+0000 7f28f792c800 20 searching for the correct realm 2024-09-12T17:23:19.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.758+0000 7f28f2e4e640 0 -- 172.21.15.67:0/995011953 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f28e4033040 msgr2=0x7f28e406c210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:19.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.762+0000 7f28f364f640 0 -- 172.21.15.67:0/995011953 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f28e80c7a70 msgr2=0x7f28e80d4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:19.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.969+0000 7f28f792c800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:19.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.969+0000 7f28f792c800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:19.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.969+0000 7f28f792c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:19.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.969+0000 7f28f792c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:19.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.969+0000 7f28f792c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:19.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.969+0000 7f28f792c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:19.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.969+0000 7f28f792c800 20 rados->read ofs=0 len=0 2024-09-12T17:23:19.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.969+0000 7f28f792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:19.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.969+0000 7f28f792c800 20 rados->read ofs=0 len=0 2024-09-12T17:23:19.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.969+0000 7f28f792c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:19.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.969+0000 7f28f792c800 20 rados->read ofs=0 len=0 2024-09-12T17:23:19.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.970+0000 7f28f792c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:19.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.970+0000 7f28f792c800 20 zone default found 2024-09-12T17:23:19.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.970+0000 7f28f792c800 4 Realm: () 2024-09-12T17:23:19.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.970+0000 7f28f792c800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:19.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.970+0000 7f28f792c800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:19.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.970+0000 7f28f792c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:19.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.970+0000 7f28f792c800 20 zonegroup default 2024-09-12T17:23:19.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.970+0000 7f28f792c800 20 rados->read ofs=0 len=0 2024-09-12T17:23:19.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.970+0000 7f28f792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:19.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.970+0000 7f28f792c800 20 rados->read ofs=0 len=0 2024-09-12T17:23:19.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.970+0000 7f28f792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:19.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.970+0000 7f28f792c800 20 rados->read ofs=0 len=0 2024-09-12T17:23:19.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.971+0000 7f28f792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:19.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.971+0000 7f28f792c800 20 started sync module instance, tier type = 2024-09-12T17:23:19.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.971+0000 7f28f792c800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:19.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.980+0000 7f28f792c800 20 add_watcher() i=0 2024-09-12T17:23:19.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.980+0000 7f28f792c800 20 add_watcher() i=1 2024-09-12T17:23:19.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.980+0000 7f28f792c800 20 add_watcher() i=2 2024-09-12T17:23:19.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.980+0000 7f28f792c800 20 add_watcher() i=3 2024-09-12T17:23:19.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.980+0000 7f28f792c800 20 add_watcher() i=4 2024-09-12T17:23:19.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.980+0000 7f28f792c800 20 add_watcher() i=5 2024-09-12T17:23:19.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.980+0000 7f28f792c800 20 add_watcher() i=6 2024-09-12T17:23:19.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.981+0000 7f28f792c800 20 add_watcher() i=7 2024-09-12T17:23:19.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.981+0000 7f28f792c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:19.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.983+0000 7f27a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:19.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.983+0000 7f28f792c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:19.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.983+0000 7f28f792c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:19.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.983+0000 7f28f792c800 5 note: GC not initialized 2024-09-12T17:23:19.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.984+0000 7f27a8fe1640 20 reqs_thread_entry: start 2024-09-12T17:23:19.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.984+0000 7f28f792c800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:19.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.984+0000 7f28f792c800 20 Filter name: none 2024-09-12T17:23:19.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.984+0000 7f27227fc640 20 reqs_thread_entry: start 2024-09-12T17:23:19.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.984+0000 7f28f792c800 20 rados->read ofs=0 len=0 2024-09-12T17:23:19.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.984+0000 7f28f792c800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:23:19.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.985+0000 7f28f792c800 20 rados->read ofs=0 len=0 2024-09-12T17:23:19.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.985+0000 7f28f792c800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:23:19.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.985+0000 7f28f792c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:19.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.985+0000 7f28f792c800 20 rados->read ofs=0 len=0 2024-09-12T17:23:19.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.985+0000 7f28f792c800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:23:19.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.985+0000 7f28f792c800 20 rados->read ofs=0 len=0 2024-09-12T17:23:19.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.986+0000 7f28f792c800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:23:19.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.986+0000 7f28f792c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:19.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.987+0000 7f27a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:19.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.989+0000 7f28f792c800 20 remove_watcher() i=0 2024-09-12T17:23:19.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.989+0000 7f28f792c800 2 removed watcher, disabling cache 2024-09-12T17:23:19.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.990+0000 7f28f792c800 20 remove_watcher() i=1 2024-09-12T17:23:19.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.991+0000 7f28f792c800 20 remove_watcher() i=2 2024-09-12T17:23:19.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.992+0000 7f28f792c800 20 remove_watcher() i=3 2024-09-12T17:23:19.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.993+0000 7f28f792c800 20 remove_watcher() i=4 2024-09-12T17:23:19.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.994+0000 7f28f792c800 20 remove_watcher() i=5 2024-09-12T17:23:19.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.995+0000 7f28f792c800 20 remove_watcher() i=6 2024-09-12T17:23:19.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:19.996+0000 7f28f792c800 20 remove_watcher() i=7 2024-09-12T17:23:20.009 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.009 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:23:20.009 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-init-indext id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:23:20.010 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.011 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-12T17:23:20.047 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:20.047 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:20.087 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.085+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.088 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.086+0000 7f8edd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.088 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.086+0000 7f8edd726800 20 realm 2024-09-12T17:23:20.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.086+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.086+0000 7f8edd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.086+0000 7f8edd726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:20.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.086+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.086+0000 7f8edd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.086+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.087+0000 7f8edd726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:20.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.087+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.088+0000 7f8edd726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:20.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.088+0000 7f8edd726800 20 searching for the correct realm 2024-09-12T17:23:20.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.090+0000 7f8ed8b5c640 0 -- 172.21.15.67:0/2143424926 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55c131a43b00 msgr2=0x55c131a45ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:20.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.094+0000 7f8ed935d640 0 -- 172.21.15.67:0/2143424926 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f8ed0062ad0 msgr2=0x7f8ed00928e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:20.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.300+0000 7f8edd726800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:20.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.300+0000 7f8edd726800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:20.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.300+0000 7f8edd726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:20.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.300+0000 7f8edd726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:20.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.300+0000 7f8edd726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:20.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.300+0000 7f8edd726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:20.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.300+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.300+0000 7f8edd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.300+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.301+0000 7f8edd726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:20.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.301+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.301+0000 7f8edd726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:20.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.301+0000 7f8edd726800 20 zone default found 2024-09-12T17:23:20.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.301+0000 7f8edd726800 4 Realm: () 2024-09-12T17:23:20.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.301+0000 7f8edd726800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:20.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.301+0000 7f8edd726800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:20.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.301+0000 7f8edd726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:20.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.301+0000 7f8edd726800 20 zonegroup default 2024-09-12T17:23:20.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.301+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.301+0000 7f8edd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.301+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.302+0000 7f8edd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.302+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.302+0000 7f8edd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.302+0000 7f8edd726800 20 started sync module instance, tier type = 2024-09-12T17:23:20.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.302+0000 7f8edd726800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:20.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.312+0000 7f8edd726800 20 add_watcher() i=0 2024-09-12T17:23:20.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.312+0000 7f8edd726800 20 add_watcher() i=1 2024-09-12T17:23:20.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.312+0000 7f8edd726800 20 add_watcher() i=2 2024-09-12T17:23:20.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.312+0000 7f8edd726800 20 add_watcher() i=3 2024-09-12T17:23:20.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.312+0000 7f8edd726800 20 add_watcher() i=4 2024-09-12T17:23:20.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.312+0000 7f8edd726800 20 add_watcher() i=5 2024-09-12T17:23:20.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.312+0000 7f8edd726800 20 add_watcher() i=6 2024-09-12T17:23:20.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.312+0000 7f8edd726800 20 add_watcher() i=7 2024-09-12T17:23:20.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.312+0000 7f8edd726800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:20.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.314+0000 7f8d8f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:20.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.315+0000 7f8edd726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:20.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.315+0000 7f8edd726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:20.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.315+0000 7f8edd726800 5 note: GC not initialized 2024-09-12T17:23:20.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.315+0000 7f8d8e7e4640 20 reqs_thread_entry: start 2024-09-12T17:23:20.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.315+0000 7f8edd726800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:20.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.315+0000 7f8edd726800 20 Filter name: none 2024-09-12T17:23:20.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.315+0000 7f8cfffff640 20 reqs_thread_entry: start 2024-09-12T17:23:20.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.315+0000 7f8edd726800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:23:20.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.315+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.316+0000 7f8edd726800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:23:20.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.316+0000 7f8edd726800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:23:20.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.316+0000 7f8edd726800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:23:20.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.316+0000 7f8edd726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 : miss 2024-09-12T17:23:20.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.316+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.316+0000 7f8edd726800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:23:20.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.316+0000 7f8edd726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 info.flags=0x17 2024-09-12T17:23:20.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.316+0000 7f8edd726800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 to cache LRU end 2024-09-12T17:23:20.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.316+0000 7f8edd726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:20.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.316+0000 7f8edd726800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:20.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.316+0000 7f8edd726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 2024-09-12T17:23:20.320 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8edd726800 time 2024-09-12T17:23:20.319419+0000 2024-09-12T17:23:20.320 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:23:20.320 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:20.320 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8eded8c71a] 2024-09-12T17:23:20.321 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8eded8c8d8] 2024-09-12T17:23:20.321 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c12f02e841] 2024-09-12T17:23:20.321 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd73b64) [0x55c12f53bb64] 2024-09-12T17:23:20.321 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c12f03e50d] 2024-09-12T17:23:20.321 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:23:20.321 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8edda29590] 2024-09-12T17:23:20.322 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:23:20.322 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:23:20.322 INFO:tasks.workunit.client.0.smithi067.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:23:20.322 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f8edd726800 thread_name:radosgw-admin 2024-09-12T17:23:20.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.318+0000 7f8edd726800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8edd726800 time 2024-09-12T17:23:20.319419+0000 2024-09-12T17:23:20.322 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:23:20.323 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.323 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:20.323 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8eded8c71a] 2024-09-12T17:23:20.323 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8eded8c8d8] 2024-09-12T17:23:20.323 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c12f02e841] 2024-09-12T17:23:20.323 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd73b64) [0x55c12f53bb64] 2024-09-12T17:23:20.323 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c12f03e50d] 2024-09-12T17:23:20.323 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:23:20.324 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8edda29590] 2024-09-12T17:23:20.324 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:23:20.324 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:23:20.324 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.343 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:20.343 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8edda3e6f0] 2024-09-12T17:23:20.343 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8edda8b99c] 2024-09-12T17:23:20.343 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:23:20.344 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:23:20.344 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8eded8c774] 2024-09-12T17:23:20.344 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8eded8c8d8] 2024-09-12T17:23:20.344 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c12f02e841] 2024-09-12T17:23:20.344 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd73b64) [0x55c12f53bb64] 2024-09-12T17:23:20.344 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c12f03e50d] 2024-09-12T17:23:20.344 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:23:20.344 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8edda29590] 2024-09-12T17:23:20.344 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:23:20.344 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:23:20.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.319+0000 7f8edd726800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:23:20.345 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f8edd726800 thread_name:radosgw-admin 2024-09-12T17:23:20.345 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.345 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:20.345 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8edda3e6f0] 2024-09-12T17:23:20.345 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8edda8b99c] 2024-09-12T17:23:20.345 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:23:20.345 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:23:20.345 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8eded8c774] 2024-09-12T17:23:20.345 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8eded8c8d8] 2024-09-12T17:23:20.345 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c12f02e841] 2024-09-12T17:23:20.345 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd73b64) [0x55c12f53bb64] 2024-09-12T17:23:20.345 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c12f03e50d] 2024-09-12T17:23:20.346 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:23:20.346 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8edda29590] 2024-09-12T17:23:20.346 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:23:20.346 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:23:20.346 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:23:20.346 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.346 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T17:23:20.346 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T17:23:20.067+0000 7f8dc7606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:23:20.346 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T17:23:20.067+0000 7f8dc7606640 10 monclient: dump: 2024-09-12T17:23:20.346 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:20.347 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:20.347 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.347 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.347 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.347 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.347 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:20.347 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:20.347 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:20.347 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.347 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T17:23:20.067+0000 7f8dc7606640 10 monclient: _finish_auth 0 2024-09-12T17:23:20.348 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T17:23:20.067+0000 7f8dc7606640 10 monclient: _check_auth_tickets 2024-09-12T17:23:20.348 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 monclient: authenticate success, global_id 6047 2024-09-12T17:23:20.348 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T17:23:20.067+0000 7f8dc7606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:20.348 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T17:23:20.067+0000 7f8dc7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.348 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T17:23:20.067+0000 7f8dc7606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:23:20.348 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T17:23:20.067+0000 7f8dc7606640 10 monclient: dump: 2024-09-12T17:23:20.348 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:20.348 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:20.348 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.348 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.348 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.348 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.348 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:20.349 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:20.349 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:20.349 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.349 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T17:23:20.067+0000 7f8edd726800 10 monclient: get_monmap_and_config success 2024-09-12T17:23:20.349 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T17:23:20.067+0000 7f8edd726800 4 set_mon_vals no callback set 2024-09-12T17:23:20.349 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T17:23:20.067+0000 7f8edd726800 10 monclient: shutdown 2024-09-12T17:23:20.349 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 asok(0x55c13172f730) unregister_commands rotate-key 2024-09-12T17:23:20.350 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T17:23:20.067+0000 7f8edd726800 10 monclient: build_initial_monmap 2024-09-12T17:23:20.350 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T17:23:20.067+0000 7f8edd726800 1 build_initial for_mkfs: 0 2024-09-12T17:23:20.350 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T17:23:20.067+0000 7f8edd726800 10 monclient: monmap: 2024-09-12T17:23:20.350 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:23:20.350 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:20.350 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:23:20.350 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:23:20.350 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:20.350 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.350 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:23:20.351 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:23:20.351 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:23:20.351 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.351 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding auth protocol: cephx 2024-09-12T17:23:20.351 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding auth protocol: cephx 2024-09-12T17:23:20.351 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding auth protocol: cephx 2024-09-12T17:23:20.351 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding con mode: secure 2024-09-12T17:23:20.351 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding con mode: crc 2024-09-12T17:23:20.351 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding con mode: secure 2024-09-12T17:23:20.351 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding con mode: crc 2024-09-12T17:23:20.351 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding con mode: secure 2024-09-12T17:23:20.352 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding con mode: crc 2024-09-12T17:23:20.352 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding con mode: crc 2024-09-12T17:23:20.352 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding con mode: secure 2024-09-12T17:23:20.352 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding con mode: crc 2024-09-12T17:23:20.352 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding con mode: secure 2024-09-12T17:23:20.352 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding con mode: crc 2024-09-12T17:23:20.352 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding con mode: secure 2024-09-12T17:23:20.352 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T17:23:20.068+0000 7f8edd726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.353 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T17:23:20.068+0000 7f8edd726800 1 librados: starting msgr at 2024-09-12T17:23:20.353 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T17:23:20.068+0000 7f8edd726800 1 librados: starting objecter 2024-09-12T17:23:20.353 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 asok(0x55c13172f730) register_command objecter_requests hook 0x55c131954c40 2024-09-12T17:23:20.353 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T17:23:20.068+0000 7f8edd726800 1 librados: setting wanted keys 2024-09-12T17:23:20.353 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T17:23:20.068+0000 7f8edd726800 1 librados: calling monclient init 2024-09-12T17:23:20.353 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T17:23:20.068+0000 7f8edd726800 10 monclient: init 2024-09-12T17:23:20.353 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding auth protocol: cephx 2024-09-12T17:23:20.353 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding auth protocol: cephx 2024-09-12T17:23:20.353 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding auth protocol: cephx 2024-09-12T17:23:20.353 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding con mode: secure 2024-09-12T17:23:20.354 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding con mode: crc 2024-09-12T17:23:20.354 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding con mode: secure 2024-09-12T17:23:20.354 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding con mode: crc 2024-09-12T17:23:20.354 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding con mode: secure 2024-09-12T17:23:20.354 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding con mode: crc 2024-09-12T17:23:20.354 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding con mode: crc 2024-09-12T17:23:20.354 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding con mode: secure 2024-09-12T17:23:20.354 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding con mode: crc 2024-09-12T17:23:20.355 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding con mode: secure 2024-09-12T17:23:20.355 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding con mode: crc 2024-09-12T17:23:20.355 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding con mode: secure 2024-09-12T17:23:20.355 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T17:23:20.068+0000 7f8edd726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.355 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T17:23:20.068+0000 7f8edd726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.355 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 asok(0x55c13172f730) register_command rotate-key hook 0x55c131951e98 2024-09-12T17:23:20.355 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T17:23:20.068+0000 7f8edd726800 10 monclient: _reopen_session rank -1 2024-09-12T17:23:20.355 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T17:23:20.068+0000 7f8edd726800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:23:20.355 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T17:23:20.068+0000 7f8edd726800 10 monclient(hunting): picked mon.noname-b con 0x55c131807440 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:23:20.355 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T17:23:20.068+0000 7f8edd726800 10 monclient(hunting): picked mon.noname-a con 0x55c1318979d0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:23:20.355 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T17:23:20.068+0000 7f8edd726800 10 monclient(hunting): picked mon.noname-c con 0x55c13197b7d0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:23:20.355 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T17:23:20.068+0000 7f8edd726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.356 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T17:23:20.068+0000 7f8edd726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.356 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T17:23:20.068+0000 7f8edd726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.356 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T17:23:20.068+0000 7f8edd726800 10 monclient(hunting): _renew_subs 2024-09-12T17:23:20.356 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T17:23:20.068+0000 7f8edd726800 10 monclient(hunting): authenticate will time out at 2211.419864s 2024-09-12T17:23:20.356 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T17:23:20.068+0000 7f8ed8b5c640 10 monclient(hunting): get_auth_request con 0x55c1318979d0 auth_method 0 2024-09-12T17:23:20.356 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T17:23:20.068+0000 7f8ed8b5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.356 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T17:23:20.068+0000 7f8ed8b5c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.356 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T17:23:20.068+0000 7f8ed8b5c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.356 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T17:23:20.068+0000 7f8ed9b5e640 10 monclient(hunting): get_auth_request con 0x55c13197b7d0 auth_method 0 2024-09-12T17:23:20.356 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T17:23:20.069+0000 7f8ed9b5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.356 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T17:23:20.069+0000 7f8ed9b5e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.356 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T17:23:20.069+0000 7f8ed9b5e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.356 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T17:23:20.069+0000 7f8ed8b5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.357 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T17:23:20.069+0000 7f8ed8b5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.357 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T17:23:20.069+0000 7f8ed8b5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.359 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T17:23:20.069+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.360 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T17:23:20.069+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.360 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T17:23:20.069+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.360 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T17:23:20.069+0000 7f8ed935d640 10 monclient(hunting): get_auth_request con 0x55c131807440 auth_method 0 2024-09-12T17:23:20.360 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T17:23:20.069+0000 7f8ed935d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.360 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T17:23:20.069+0000 7f8ed935d640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.360 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T17:23:20.069+0000 7f8ed935d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.360 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T17:23:20.069+0000 7f8ed8b5c640 10 monclient(hunting): handle_auth_done global_id 6420 payload 824 2024-09-12T17:23:20.360 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T17:23:20.069+0000 7f8ed8b5c640 10 monclient: _finish_hunting 0 2024-09-12T17:23:20.360 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T17:23:20.069+0000 7f8ed8b5c640 1 monclient: found mon.noname-a 2024-09-12T17:23:20.361 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T17:23:20.069+0000 7f8ed8b5c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:23:20.361 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T17:23:20.069+0000 7f8dc5e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.361 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T17:23:20.069+0000 7f8dc5e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:23:20.361 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T17:23:20.069+0000 7f8dc5e03640 10 monclient: dump: 2024-09-12T17:23:20.361 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:20.361 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:20.361 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.361 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.362 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.362 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.362 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:20.362 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:20.362 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:20.362 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.362 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T17:23:20.069+0000 7f8dc5e03640 10 monclient: _finish_auth 0 2024-09-12T17:23:20.362 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T17:23:20.069+0000 7f8dc5e03640 10 monclient: _check_auth_tickets 2024-09-12T17:23:20.362 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T17:23:20.069+0000 7f8dc5e03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:20.362 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T17:23:20.069+0000 7f8dc5e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.362 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T17:23:20.069+0000 7f8dc5e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:23:20.362 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T17:23:20.069+0000 7f8dc5e03640 10 monclient: dump: 2024-09-12T17:23:20.362 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:20.363 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:20.363 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.363 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.363 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.363 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.363 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:20.363 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:20.363 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:20.363 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.363 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T17:23:20.069+0000 7f8edd726800 5 monclient: authenticate success, global_id 6420 2024-09-12T17:23:20.364 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T17:23:20.069+0000 7f8edd726800 10 monclient: _renew_subs 2024-09-12T17:23:20.364 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T17:23:20.069+0000 7f8edd726800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:23:20.364 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T17:23:20.069+0000 7f8dc7606640 4 set_mon_vals no callback set 2024-09-12T17:23:20.364 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T17:23:20.069+0000 7f8edd726800 10 monclient: _renew_subs 2024-09-12T17:23:20.364 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T17:23:20.069+0000 7f8edd726800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:23:20.364 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T17:23:20.069+0000 7f8edd726800 1 librados: init done 2024-09-12T17:23:20.364 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T17:23:20.071+0000 7f8dc5e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:23:20.364 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T17:23:20.071+0000 7f8dc5e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:23:20.364 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T17:23:20.071+0000 7f8dc5e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:23:20.365 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T17:23:20.071+0000 7f8ed935d640 10 monclient: get_auth_request con 0x7f8dc0076470 auth_method 0 2024-09-12T17:23:20.365 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T17:23:20.072+0000 7f8ed9b5e640 10 monclient: get_auth_request con 0x55c13197a780 auth_method 0 2024-09-12T17:23:20.365 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T17:23:20.072+0000 7f8ed935d640 10 monclient: get_auth_request con 0x55c13199d2a0 auth_method 0 2024-09-12T17:23:20.365 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T17:23:20.073+0000 7f8ed8b5c640 10 monclient: get_auth_request con 0x55c1319a14e0 auth_method 0 2024-09-12T17:23:20.365 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T17:23:20.075+0000 7f8edd726800 10 monclient: build_initial_monmap 2024-09-12T17:23:20.365 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T17:23:20.075+0000 7f8edd726800 1 build_initial for_mkfs: 0 2024-09-12T17:23:20.365 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T17:23:20.075+0000 7f8edd726800 10 monclient: monmap: 2024-09-12T17:23:20.365 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:23:20.366 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:20.366 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:23:20.366 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:23:20.366 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:20.366 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.366 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:23:20.366 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:23:20.366 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:23:20.366 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.366 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding auth protocol: cephx 2024-09-12T17:23:20.366 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding auth protocol: cephx 2024-09-12T17:23:20.366 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding auth protocol: cephx 2024-09-12T17:23:20.366 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding con mode: secure 2024-09-12T17:23:20.367 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding con mode: crc 2024-09-12T17:23:20.367 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding con mode: secure 2024-09-12T17:23:20.367 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding con mode: crc 2024-09-12T17:23:20.367 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding con mode: secure 2024-09-12T17:23:20.367 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding con mode: crc 2024-09-12T17:23:20.367 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding con mode: crc 2024-09-12T17:23:20.367 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding con mode: secure 2024-09-12T17:23:20.367 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding con mode: crc 2024-09-12T17:23:20.367 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding con mode: secure 2024-09-12T17:23:20.367 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding con mode: crc 2024-09-12T17:23:20.367 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding con mode: secure 2024-09-12T17:23:20.368 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T17:23:20.075+0000 7f8edd726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.368 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 asok(0x55c13172f730) register_command objecter_requests cmddesc objecter_requests hook 0x55c1319a9800 EEXIST 2024-09-12T17:23:20.368 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T17:23:20.075+0000 7f8edd726800 10 monclient: init 2024-09-12T17:23:20.368 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding auth protocol: cephx 2024-09-12T17:23:20.368 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding auth protocol: cephx 2024-09-12T17:23:20.368 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding auth protocol: cephx 2024-09-12T17:23:20.368 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding con mode: secure 2024-09-12T17:23:20.368 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding con mode: crc 2024-09-12T17:23:20.368 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding con mode: secure 2024-09-12T17:23:20.368 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding con mode: crc 2024-09-12T17:23:20.369 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding con mode: secure 2024-09-12T17:23:20.369 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding con mode: crc 2024-09-12T17:23:20.369 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding con mode: crc 2024-09-12T17:23:20.369 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding con mode: secure 2024-09-12T17:23:20.369 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding con mode: crc 2024-09-12T17:23:20.369 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding con mode: secure 2024-09-12T17:23:20.369 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding con mode: crc 2024-09-12T17:23:20.369 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding con mode: secure 2024-09-12T17:23:20.369 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T17:23:20.076+0000 7f8edd726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.369 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T17:23:20.076+0000 7f8edd726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.369 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T17:23:20.076+0000 7f8edd726800 5 asok(0x55c13172f730) register_command rotate-key cmddesc rotate-key hook 0x55c1319a4b30 EEXIST 2024-09-12T17:23:20.369 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T17:23:20.076+0000 7f8edd726800 10 monclient: _reopen_session rank -1 2024-09-12T17:23:20.370 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T17:23:20.076+0000 7f8edd726800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:23:20.370 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T17:23:20.076+0000 7f8edd726800 10 monclient(hunting): picked mon.noname-b con 0x55c1319cdb20 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:23:20.370 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T17:23:20.076+0000 7f8edd726800 10 monclient(hunting): picked mon.noname-a con 0x55c1319cdf00 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:23:20.370 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T17:23:20.076+0000 7f8edd726800 10 monclient(hunting): picked mon.noname-c con 0x55c1319cc830 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:23:20.370 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T17:23:20.076+0000 7f8edd726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.370 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T17:23:20.076+0000 7f8edd726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.370 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T17:23:20.076+0000 7f8edd726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.370 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T17:23:20.076+0000 7f8edd726800 10 monclient(hunting): _renew_subs 2024-09-12T17:23:20.370 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T17:23:20.076+0000 7f8edd726800 10 monclient(hunting): authenticate will time out at 2211.427318s 2024-09-12T17:23:20.370 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T17:23:20.076+0000 7f8ed9b5e640 10 monclient(hunting): get_auth_request con 0x55c1319cc830 auth_method 0 2024-09-12T17:23:20.370 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T17:23:20.076+0000 7f8ed9b5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.370 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T17:23:20.076+0000 7f8ed9b5e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.370 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T17:23:20.076+0000 7f8ed9b5e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.371 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T17:23:20.076+0000 7f8ed8b5c640 10 monclient(hunting): get_auth_request con 0x55c1319cdf00 auth_method 0 2024-09-12T17:23:20.371 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T17:23:20.076+0000 7f8ed8b5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.371 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T17:23:20.076+0000 7f8ed8b5c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.371 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T17:23:20.076+0000 7f8ed8b5c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.371 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T17:23:20.076+0000 7f8ed935d640 10 monclient(hunting): get_auth_request con 0x55c1319cdb20 auth_method 0 2024-09-12T17:23:20.371 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T17:23:20.076+0000 7f8ed935d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.371 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T17:23:20.076+0000 7f8ed935d640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.371 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T17:23:20.076+0000 7f8ed935d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.371 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T17:23:20.076+0000 7f8ed8b5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.371 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T17:23:20.076+0000 7f8ed8b5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.371 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T17:23:20.076+0000 7f8ed8b5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.371 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T17:23:20.076+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.371 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T17:23:20.076+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.372 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T17:23:20.076+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.372 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T17:23:20.076+0000 7f8ed935d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.372 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T17:23:20.076+0000 7f8ed935d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.372 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T17:23:20.076+0000 7f8ed935d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.372 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T17:23:20.076+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_done global_id 6053 payload 824 2024-09-12T17:23:20.372 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T17:23:20.076+0000 7f8ed9b5e640 10 monclient: _finish_hunting 0 2024-09-12T17:23:20.372 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T17:23:20.076+0000 7f8ed9b5e640 1 monclient: found mon.noname-c 2024-09-12T17:23:20.372 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T17:23:20.076+0000 7f8ed9b5e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:23:20.372 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T17:23:20.076+0000 7f8dbeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.372 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T17:23:20.076+0000 7f8dbeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:23:20.373 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T17:23:20.076+0000 7f8dbeffd640 10 monclient: dump: 2024-09-12T17:23:20.373 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:20.373 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:20.373 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.373 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.373 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.373 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.373 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:20.373 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:20.373 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:20.373 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.373 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T17:23:20.077+0000 7f8dbeffd640 10 monclient: _finish_auth 0 2024-09-12T17:23:20.374 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T17:23:20.077+0000 7f8dbeffd640 10 monclient: _check_auth_tickets 2024-09-12T17:23:20.374 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T17:23:20.077+0000 7f8dbeffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:20.374 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T17:23:20.077+0000 7f8dbeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.374 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T17:23:20.077+0000 7f8dbeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:23:20.374 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T17:23:20.077+0000 7f8dbeffd640 10 monclient: dump: 2024-09-12T17:23:20.374 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:20.374 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:20.374 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.374 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.374 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.374 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.374 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:20.374 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:20.374 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:20.374 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.375 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T17:23:20.077+0000 7f8edd726800 5 monclient: authenticate success, global_id 6053 2024-09-12T17:23:20.375 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T17:23:20.077+0000 7f8eda35f640 4 set_mon_vals no callback set 2024-09-12T17:23:20.375 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T17:23:20.077+0000 7f8edd726800 10 monclient: _renew_subs 2024-09-12T17:23:20.375 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T17:23:20.077+0000 7f8edd726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:23:20.375 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T17:23:20.077+0000 7f8edd726800 10 monclient: _renew_subs 2024-09-12T17:23:20.375 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T17:23:20.077+0000 7f8edd726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:23:20.375 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T17:23:20.078+0000 7f8dbeffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:23:20.375 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T17:23:20.078+0000 7f8dbeffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:23:20.375 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T17:23:20.078+0000 7f8dbeffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:23:20.375 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T17:23:20.079+0000 7f8ed935d640 10 monclient: get_auth_request con 0x7f8db4076380 auth_method 0 2024-09-12T17:23:20.375 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T17:23:20.079+0000 7f8edd726800 10 monclient: get_monmap_and_config 2024-09-12T17:23:20.375 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T17:23:20.079+0000 7f8edd726800 10 monclient: build_initial_monmap 2024-09-12T17:23:20.375 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T17:23:20.079+0000 7f8edd726800 1 build_initial for_mkfs: 0 2024-09-12T17:23:20.375 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T17:23:20.079+0000 7f8edd726800 10 monclient: monmap: 2024-09-12T17:23:20.376 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:23:20.376 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:20.376 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:23:20.376 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:23:20.376 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:20.376 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.376 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:23:20.376 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:23:20.376 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:23:20.376 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.376 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding auth protocol: cephx 2024-09-12T17:23:20.376 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding auth protocol: cephx 2024-09-12T17:23:20.376 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding auth protocol: cephx 2024-09-12T17:23:20.377 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding con mode: secure 2024-09-12T17:23:20.377 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding con mode: crc 2024-09-12T17:23:20.377 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding con mode: secure 2024-09-12T17:23:20.377 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding con mode: crc 2024-09-12T17:23:20.377 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding con mode: secure 2024-09-12T17:23:20.377 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding con mode: crc 2024-09-12T17:23:20.377 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding con mode: crc 2024-09-12T17:23:20.377 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding con mode: secure 2024-09-12T17:23:20.377 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding con mode: crc 2024-09-12T17:23:20.377 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding con mode: secure 2024-09-12T17:23:20.377 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding con mode: crc 2024-09-12T17:23:20.377 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding con mode: secure 2024-09-12T17:23:20.377 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T17:23:20.079+0000 7f8edd726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.378 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T17:23:20.079+0000 7f8edd726800 10 monclient: init 2024-09-12T17:23:20.378 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding auth protocol: cephx 2024-09-12T17:23:20.378 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding auth protocol: cephx 2024-09-12T17:23:20.378 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding auth protocol: cephx 2024-09-12T17:23:20.378 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding con mode: secure 2024-09-12T17:23:20.378 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding con mode: crc 2024-09-12T17:23:20.378 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding con mode: secure 2024-09-12T17:23:20.378 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding con mode: crc 2024-09-12T17:23:20.378 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding con mode: secure 2024-09-12T17:23:20.378 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding con mode: crc 2024-09-12T17:23:20.378 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding con mode: crc 2024-09-12T17:23:20.378 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding con mode: secure 2024-09-12T17:23:20.378 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding con mode: crc 2024-09-12T17:23:20.379 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding con mode: secure 2024-09-12T17:23:20.379 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding con mode: crc 2024-09-12T17:23:20.379 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding con mode: secure 2024-09-12T17:23:20.379 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T17:23:20.080+0000 7f8edd726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.379 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T17:23:20.080+0000 7f8edd726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.379 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T17:23:20.080+0000 7f8edd726800 5 asok(0x55c13172f730) register_command rotate-key cmddesc rotate-key hook 0x7ffcdf4e2718 EEXIST 2024-09-12T17:23:20.379 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T17:23:20.080+0000 7f8edd726800 10 monclient: _reopen_session rank -1 2024-09-12T17:23:20.379 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T17:23:20.080+0000 7f8edd726800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:23:20.379 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T17:23:20.080+0000 7f8edd726800 10 monclient(hunting): picked mon.noname-c con 0x55c131a22080 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:23:20.379 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T17:23:20.080+0000 7f8edd726800 10 monclient(hunting): picked mon.noname-b con 0x55c1319f3090 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:23:20.379 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T17:23:20.080+0000 7f8edd726800 10 monclient(hunting): picked mon.noname-a con 0x55c131a1d560 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:23:20.379 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T17:23:20.080+0000 7f8edd726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.379 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T17:23:20.080+0000 7f8edd726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.380 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T17:23:20.080+0000 7f8edd726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.380 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T17:23:20.080+0000 7f8edd726800 10 monclient(hunting): _renew_subs 2024-09-12T17:23:20.380 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T17:23:20.080+0000 7f8edd726800 10 monclient(hunting): authenticate will time out at 2211.431348s 2024-09-12T17:23:20.380 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T17:23:20.080+0000 7f8ed9b5e640 10 monclient(hunting): get_auth_request con 0x55c131a1d560 auth_method 0 2024-09-12T17:23:20.380 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T17:23:20.080+0000 7f8ed9b5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.380 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T17:23:20.080+0000 7f8ed9b5e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.380 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T17:23:20.080+0000 7f8ed9b5e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.380 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T17:23:20.080+0000 7f8ed935d640 10 monclient(hunting): get_auth_request con 0x55c131a22080 auth_method 0 2024-09-12T17:23:20.380 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T17:23:20.080+0000 7f8ed935d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.381 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T17:23:20.080+0000 7f8ed935d640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.381 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T17:23:20.080+0000 7f8ed935d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.381 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T17:23:20.080+0000 7f8ed8b5c640 10 monclient(hunting): get_auth_request con 0x55c1319f3090 auth_method 0 2024-09-12T17:23:20.381 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T17:23:20.080+0000 7f8ed8b5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.381 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T17:23:20.080+0000 7f8ed8b5c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.381 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T17:23:20.080+0000 7f8ed8b5c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.381 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T17:23:20.080+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.381 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T17:23:20.080+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.381 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T17:23:20.080+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.381 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T17:23:20.080+0000 7f8ed935d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.382 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T17:23:20.080+0000 7f8ed935d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.382 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T17:23:20.080+0000 7f8ed935d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.382 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T17:23:20.080+0000 7f8ed8b5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.382 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T17:23:20.080+0000 7f8ed8b5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.382 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T17:23:20.080+0000 7f8ed8b5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.382 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T17:23:20.080+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_done global_id 6426 payload 274 2024-09-12T17:23:20.382 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T17:23:20.080+0000 7f8ed9b5e640 10 monclient: _finish_hunting 0 2024-09-12T17:23:20.383 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T17:23:20.080+0000 7f8ed9b5e640 1 monclient: found mon.noname-a 2024-09-12T17:23:20.383 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T17:23:20.080+0000 7f8ed9b5e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:23:20.383 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T17:23:20.080+0000 7f8dbcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.383 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T17:23:20.080+0000 7f8dbcff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:23:20.383 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T17:23:20.080+0000 7f8dbcff9640 10 monclient: dump: 2024-09-12T17:23:20.383 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:20.383 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:20.383 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.383 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.383 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.384 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.384 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:20.384 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:20.384 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:20.384 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.384 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T17:23:20.080+0000 7f8dbcff9640 10 monclient: _finish_auth 0 2024-09-12T17:23:20.384 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T17:23:20.080+0000 7f8dbcff9640 10 monclient: _check_auth_tickets 2024-09-12T17:23:20.384 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T17:23:20.080+0000 7f8dbcff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:20.384 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T17:23:20.080+0000 7f8dbcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.384 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T17:23:20.080+0000 7f8dbcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:23:20.384 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T17:23:20.080+0000 7f8dbcff9640 10 monclient: dump: 2024-09-12T17:23:20.384 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:20.384 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:20.384 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.385 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.385 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.385 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.385 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:20.385 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:20.385 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:20.385 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.385 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T17:23:20.080+0000 7f8edd726800 5 monclient: authenticate success, global_id 6426 2024-09-12T17:23:20.385 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T17:23:20.080+0000 7f8edd726800 10 monclient: get_monmap_and_config success 2024-09-12T17:23:20.385 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T17:23:20.080+0000 7f8edd726800 4 set_mon_vals no callback set 2024-09-12T17:23:20.385 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T17:23:20.081+0000 7f8edd726800 10 monclient: shutdown 2024-09-12T17:23:20.385 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T17:23:20.081+0000 7f8edd726800 10 monclient: build_initial_monmap 2024-09-12T17:23:20.385 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T17:23:20.081+0000 7f8edd726800 1 build_initial for_mkfs: 0 2024-09-12T17:23:20.385 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T17:23:20.081+0000 7f8edd726800 10 monclient: monmap: 2024-09-12T17:23:20.386 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:23:20.386 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:20.386 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:23:20.386 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:23:20.386 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:20.386 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.386 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:23:20.386 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:23:20.386 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:23:20.386 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.386 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding auth protocol: cephx 2024-09-12T17:23:20.387 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding auth protocol: cephx 2024-09-12T17:23:20.387 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding auth protocol: cephx 2024-09-12T17:23:20.387 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding con mode: secure 2024-09-12T17:23:20.387 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding con mode: crc 2024-09-12T17:23:20.387 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding con mode: secure 2024-09-12T17:23:20.387 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding con mode: crc 2024-09-12T17:23:20.387 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding con mode: secure 2024-09-12T17:23:20.387 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding con mode: crc 2024-09-12T17:23:20.387 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding con mode: crc 2024-09-12T17:23:20.387 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding con mode: secure 2024-09-12T17:23:20.388 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding con mode: crc 2024-09-12T17:23:20.388 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding con mode: secure 2024-09-12T17:23:20.388 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding con mode: crc 2024-09-12T17:23:20.388 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding con mode: secure 2024-09-12T17:23:20.388 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T17:23:20.081+0000 7f8edd726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.388 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T17:23:20.081+0000 7f8edd726800 1 librados: starting msgr at 2024-09-12T17:23:20.388 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T17:23:20.081+0000 7f8edd726800 1 librados: starting objecter 2024-09-12T17:23:20.388 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 asok(0x55c13172f730) register_command objecter_requests cmddesc objecter_requests hook 0x55c1319f1610 EEXIST 2024-09-12T17:23:20.388 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T17:23:20.082+0000 7f8edd726800 1 librados: setting wanted keys 2024-09-12T17:23:20.388 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T17:23:20.082+0000 7f8edd726800 1 librados: calling monclient init 2024-09-12T17:23:20.388 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T17:23:20.082+0000 7f8edd726800 10 monclient: init 2024-09-12T17:23:20.388 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding auth protocol: cephx 2024-09-12T17:23:20.388 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding auth protocol: cephx 2024-09-12T17:23:20.388 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding auth protocol: cephx 2024-09-12T17:23:20.388 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding con mode: secure 2024-09-12T17:23:20.389 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding con mode: crc 2024-09-12T17:23:20.389 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding con mode: secure 2024-09-12T17:23:20.389 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding con mode: crc 2024-09-12T17:23:20.389 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding con mode: secure 2024-09-12T17:23:20.389 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding con mode: crc 2024-09-12T17:23:20.389 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding con mode: crc 2024-09-12T17:23:20.389 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding con mode: secure 2024-09-12T17:23:20.389 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding con mode: crc 2024-09-12T17:23:20.389 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding con mode: secure 2024-09-12T17:23:20.389 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding con mode: crc 2024-09-12T17:23:20.389 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding con mode: secure 2024-09-12T17:23:20.389 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T17:23:20.082+0000 7f8edd726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.389 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T17:23:20.082+0000 7f8edd726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.390 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 asok(0x55c13172f730) register_command rotate-key cmddesc rotate-key hook 0x55c1319e2528 EEXIST 2024-09-12T17:23:20.390 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T17:23:20.082+0000 7f8edd726800 10 monclient: _reopen_session rank -1 2024-09-12T17:23:20.390 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T17:23:20.082+0000 7f8edd726800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:23:20.390 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T17:23:20.082+0000 7f8edd726800 10 monclient(hunting): picked mon.noname-c con 0x55c1319f3090 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:23:20.390 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T17:23:20.082+0000 7f8edd726800 10 monclient(hunting): picked mon.noname-b con 0x55c131a1d560 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:23:20.390 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T17:23:20.082+0000 7f8edd726800 10 monclient(hunting): picked mon.noname-a con 0x55c131a22080 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:23:20.390 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T17:23:20.082+0000 7f8edd726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.390 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T17:23:20.082+0000 7f8edd726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.390 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T17:23:20.082+0000 7f8edd726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.390 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T17:23:20.082+0000 7f8edd726800 10 monclient(hunting): _renew_subs 2024-09-12T17:23:20.390 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T17:23:20.082+0000 7f8edd726800 10 monclient(hunting): authenticate will time out at 2211.433600s 2024-09-12T17:23:20.390 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T17:23:20.082+0000 7f8ed935d640 10 monclient(hunting): get_auth_request con 0x55c1319f3090 auth_method 0 2024-09-12T17:23:20.390 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T17:23:20.082+0000 7f8ed935d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.391 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T17:23:20.082+0000 7f8ed935d640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.391 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T17:23:20.082+0000 7f8ed935d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.391 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T17:23:20.082+0000 7f8ed9b5e640 10 monclient(hunting): get_auth_request con 0x55c131a22080 auth_method 0 2024-09-12T17:23:20.391 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T17:23:20.082+0000 7f8ed9b5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.391 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T17:23:20.082+0000 7f8ed9b5e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.391 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T17:23:20.082+0000 7f8ed9b5e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.391 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T17:23:20.082+0000 7f8ed935d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.391 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T17:23:20.082+0000 7f8ed935d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.391 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T17:23:20.082+0000 7f8ed935d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.391 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T17:23:20.082+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.391 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T17:23:20.082+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.391 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T17:23:20.082+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.391 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T17:23:20.082+0000 7f8ed8b5c640 10 monclient(hunting): get_auth_request con 0x55c131a1d560 auth_method 0 2024-09-12T17:23:20.391 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T17:23:20.082+0000 7f8ed8b5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.392 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T17:23:20.082+0000 7f8ed8b5c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.392 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T17:23:20.082+0000 7f8ed8b5c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.392 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T17:23:20.082+0000 7f8ed8b5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.392 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T17:23:20.082+0000 7f8ed8b5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.392 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T17:23:20.082+0000 7f8ed8b5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.392 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T17:23:20.082+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_done global_id 6429 payload 824 2024-09-12T17:23:20.392 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T17:23:20.082+0000 7f8ed9b5e640 10 monclient: _finish_hunting 0 2024-09-12T17:23:20.392 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T17:23:20.082+0000 7f8ed9b5e640 1 monclient: found mon.noname-a 2024-09-12T17:23:20.392 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T17:23:20.082+0000 7f8ed9b5e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:23:20.392 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T17:23:20.083+0000 7f8daaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.393 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T17:23:20.083+0000 7f8daaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:23:20.393 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T17:23:20.083+0000 7f8daaffd640 10 monclient: dump: 2024-09-12T17:23:20.393 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:20.393 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:20.393 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.393 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.393 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.393 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.393 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:20.393 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:20.393 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:20.393 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.393 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T17:23:20.083+0000 7f8daaffd640 10 monclient: _finish_auth 0 2024-09-12T17:23:20.394 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T17:23:20.083+0000 7f8daaffd640 10 monclient: _check_auth_tickets 2024-09-12T17:23:20.394 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T17:23:20.083+0000 7f8daaffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:20.394 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T17:23:20.083+0000 7f8daaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.394 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T17:23:20.083+0000 7f8daaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:23:20.394 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T17:23:20.083+0000 7f8daaffd640 10 monclient: dump: 2024-09-12T17:23:20.394 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:20.394 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:20.394 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.394 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.394 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.394 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.394 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:20.394 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:20.395 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:20.395 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.395 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T17:23:20.083+0000 7f8edd726800 5 monclient: authenticate success, global_id 6429 2024-09-12T17:23:20.395 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T17:23:20.083+0000 7f8edd726800 10 monclient: _renew_subs 2024-09-12T17:23:20.395 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T17:23:20.083+0000 7f8dbcff9640 4 set_mon_vals no callback set 2024-09-12T17:23:20.395 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T17:23:20.083+0000 7f8edd726800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:23:20.395 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T17:23:20.083+0000 7f8edd726800 10 monclient: _renew_subs 2024-09-12T17:23:20.395 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T17:23:20.083+0000 7f8edd726800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:23:20.395 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T17:23:20.083+0000 7f8edd726800 1 librados: init done 2024-09-12T17:23:20.396 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T17:23:20.083+0000 7f8edd726800 5 asok(0x55c13172f730) register_command cr dump hook 0x55c131a14368 2024-09-12T17:23:20.396 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T17:23:20.085+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.396 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T17:23:20.085+0000 7f8daaffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:23:20.396 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T17:23:20.085+0000 7f8daaffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:23:20.396 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T17:23:20.085+0000 7f8daaffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:23:20.396 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T17:23:20.086+0000 7f8ed935d640 10 monclient: get_auth_request con 0x7f8da40764a0 auth_method 0 2024-09-12T17:23:20.396 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T17:23:20.086+0000 7f8ed8b5c640 10 monclient: get_auth_request con 0x55c131a3c020 auth_method 0 2024-09-12T17:23:20.396 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T17:23:20.086+0000 7f8edd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.396 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T17:23:20.086+0000 7f8edd726800 20 realm 2024-09-12T17:23:20.396 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T17:23:20.086+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.396 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T17:23:20.086+0000 7f8edd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.397 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T17:23:20.086+0000 7f8edd726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:20.397 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T17:23:20.086+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.397 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T17:23:20.086+0000 7f8edd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.397 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T17:23:20.086+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.397 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T17:23:20.087+0000 7f8ed935d640 10 monclient: get_auth_request con 0x55c131a40250 auth_method 0 2024-09-12T17:23:20.397 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T17:23:20.087+0000 7f8edd726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:20.397 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T17:23:20.087+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.397 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T17:23:20.087+0000 7f8ed8b5c640 10 monclient: get_auth_request con 0x55c131a43b00 auth_method 0 2024-09-12T17:23:20.397 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T17:23:20.088+0000 7f8edd726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:20.397 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T17:23:20.088+0000 7f8edd726800 20 searching for the correct realm 2024-09-12T17:23:20.398 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T17:23:20.088+0000 7f8ed9b5e640 10 monclient: get_auth_request con 0x55c131a48800 auth_method 0 2024-09-12T17:23:20.398 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T17:23:20.089+0000 7f8ed935d640 10 monclient: get_auth_request con 0x7f8ed4027020 auth_method 0 2024-09-12T17:23:20.398 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T17:23:20.090+0000 7f8ed8b5c640 10 monclient: get_auth_request con 0x7f8ecc07e070 auth_method 0 2024-09-12T17:23:20.398 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T17:23:20.090+0000 7f8ed8b5c640 0 -- 172.21.15.67:0/2143424926 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55c131a43b00 msgr2=0x55c131a45ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:20.398 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T17:23:20.091+0000 7f8daaffd640 1 client.6429.objecter ms_handle_reset 0x55c131a43b00 session 0x55c131a3f5a0 osd.4 2024-09-12T17:23:20.398 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T17:23:20.091+0000 7f8daaffd640 10 monclient: _renew_subs 2024-09-12T17:23:20.398 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T17:23:20.091+0000 7f8daaffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:23:20.398 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T17:23:20.091+0000 7f8ed8b5c640 10 monclient: get_auth_request con 0x7f8da4086340 auth_method 0 2024-09-12T17:23:20.398 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T17:23:20.092+0000 7f8ed9b5e640 10 monclient: get_auth_request con 0x7f8ed0084230 auth_method 0 2024-09-12T17:23:20.398 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T17:23:20.094+0000 7f8ed935d640 10 monclient: get_auth_request con 0x7f8ed0062ad0 auth_method 0 2024-09-12T17:23:20.398 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T17:23:20.094+0000 7f8ed935d640 0 -- 172.21.15.67:0/2143424926 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f8ed0062ad0 msgr2=0x7f8ed00928e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:20.399 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T17:23:20.295+0000 7f8ed935d640 10 monclient: get_auth_request con 0x7f8ed0062ad0 auth_method 0 2024-09-12T17:23:20.399 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T17:23:20.300+0000 7f8edd726800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:20.399 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T17:23:20.300+0000 7f8edd726800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:20.399 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T17:23:20.300+0000 7f8edd726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:20.399 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T17:23:20.300+0000 7f8edd726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:20.399 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T17:23:20.300+0000 7f8edd726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:20.399 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T17:23:20.300+0000 7f8edd726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:20.399 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T17:23:20.300+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.399 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T17:23:20.300+0000 7f8edd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.399 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T17:23:20.300+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.400 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T17:23:20.301+0000 7f8edd726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:20.400 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T17:23:20.301+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.400 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T17:23:20.301+0000 7f8edd726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:20.400 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T17:23:20.301+0000 7f8edd726800 20 zone default found 2024-09-12T17:23:20.400 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T17:23:20.301+0000 7f8edd726800 4 Realm: () 2024-09-12T17:23:20.400 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T17:23:20.301+0000 7f8edd726800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:20.400 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T17:23:20.301+0000 7f8edd726800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:20.400 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T17:23:20.301+0000 7f8edd726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:20.400 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T17:23:20.301+0000 7f8edd726800 20 zonegroup default 2024-09-12T17:23:20.400 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T17:23:20.301+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.400 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T17:23:20.301+0000 7f8edd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.400 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T17:23:20.301+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.401 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T17:23:20.302+0000 7f8edd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.401 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T17:23:20.302+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.401 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T17:23:20.302+0000 7f8edd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.401 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T17:23:20.302+0000 7f8edd726800 20 started sync module instance, tier type = 2024-09-12T17:23:20.401 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T17:23:20.302+0000 7f8edd726800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:20.401 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T17:23:20.312+0000 7f8edd726800 20 add_watcher() i=0 2024-09-12T17:23:20.401 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T17:23:20.312+0000 7f8edd726800 20 add_watcher() i=1 2024-09-12T17:23:20.401 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T17:23:20.312+0000 7f8edd726800 20 add_watcher() i=2 2024-09-12T17:23:20.401 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T17:23:20.312+0000 7f8edd726800 20 add_watcher() i=3 2024-09-12T17:23:20.402 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T17:23:20.312+0000 7f8edd726800 20 add_watcher() i=4 2024-09-12T17:23:20.402 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T17:23:20.312+0000 7f8edd726800 20 add_watcher() i=5 2024-09-12T17:23:20.402 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T17:23:20.312+0000 7f8edd726800 20 add_watcher() i=6 2024-09-12T17:23:20.402 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T17:23:20.312+0000 7f8edd726800 20 add_watcher() i=7 2024-09-12T17:23:20.402 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T17:23:20.312+0000 7f8edd726800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:20.403 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding auth protocol: cephx 2024-09-12T17:23:20.403 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding auth protocol: cephx 2024-09-12T17:23:20.403 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding auth protocol: cephx 2024-09-12T17:23:20.403 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding con mode: secure 2024-09-12T17:23:20.403 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding con mode: crc 2024-09-12T17:23:20.403 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding con mode: secure 2024-09-12T17:23:20.404 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding con mode: crc 2024-09-12T17:23:20.404 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding con mode: secure 2024-09-12T17:23:20.404 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding con mode: crc 2024-09-12T17:23:20.404 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding con mode: crc 2024-09-12T17:23:20.404 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding con mode: secure 2024-09-12T17:23:20.404 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding con mode: crc 2024-09-12T17:23:20.404 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding con mode: secure 2024-09-12T17:23:20.404 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding con mode: crc 2024-09-12T17:23:20.405 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding con mode: secure 2024-09-12T17:23:20.405 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T17:23:20.314+0000 7f8d8f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:20.405 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T17:23:20.315+0000 7f8edd726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.405 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T17:23:20.315+0000 7f8edd726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:20.405 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T17:23:20.315+0000 7f8edd726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:20.405 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T17:23:20.315+0000 7f8edd726800 5 asok(0x55c13172f730) register_command cache list hook 0x55c131a18fd0 2024-09-12T17:23:20.406 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T17:23:20.315+0000 7f8edd726800 5 asok(0x55c13172f730) register_command cache inspect hook 0x55c131a18fd0 2024-09-12T17:23:20.406 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T17:23:20.315+0000 7f8edd726800 5 asok(0x55c13172f730) register_command cache erase hook 0x55c131a18fd0 2024-09-12T17:23:20.406 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T17:23:20.315+0000 7f8edd726800 5 asok(0x55c13172f730) register_command cache zap hook 0x55c131a18fd0 2024-09-12T17:23:20.406 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T17:23:20.315+0000 7f8edd726800 5 note: GC not initialized 2024-09-12T17:23:20.406 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T17:23:20.315+0000 7f8d8e7e4640 20 reqs_thread_entry: start 2024-09-12T17:23:20.406 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T17:23:20.315+0000 7f8edd726800 5 asok(0x55c13172f730) register_command sync trace show hook 0x7f8ed402a030 2024-09-12T17:23:20.406 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T17:23:20.315+0000 7f8edd726800 5 asok(0x55c13172f730) register_command sync trace history hook 0x7f8ed402a030 2024-09-12T17:23:20.407 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T17:23:20.315+0000 7f8edd726800 5 asok(0x55c13172f730) register_command sync trace active hook 0x7f8ed402a030 2024-09-12T17:23:20.407 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T17:23:20.315+0000 7f8edd726800 5 asok(0x55c13172f730) register_command sync trace active_short hook 0x7f8ed402a030 2024-09-12T17:23:20.407 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T17:23:20.315+0000 7f8edd726800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:20.407 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T17:23:20.315+0000 7f8edd726800 20 Filter name: none 2024-09-12T17:23:20.407 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T17:23:20.315+0000 7f8cfffff640 20 reqs_thread_entry: start 2024-09-12T17:23:20.407 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T17:23:20.315+0000 7f8edd726800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:23:20.407 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T17:23:20.315+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.407 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T17:23:20.316+0000 7f8edd726800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:23:20.407 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T17:23:20.316+0000 7f8edd726800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:23:20.407 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T17:23:20.316+0000 7f8edd726800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:23:20.407 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T17:23:20.316+0000 7f8edd726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 : miss 2024-09-12T17:23:20.407 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T17:23:20.316+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.408 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T17:23:20.316+0000 7f8edd726800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:23:20.408 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T17:23:20.316+0000 7f8edd726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 info.flags=0x17 2024-09-12T17:23:20.408 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T17:23:20.316+0000 7f8edd726800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 to cache LRU end 2024-09-12T17:23:20.408 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T17:23:20.316+0000 7f8edd726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:20.408 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T17:23:20.316+0000 7f8edd726800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:20.408 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T17:23:20.316+0000 7f8edd726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 2024-09-12T17:23:20.408 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T17:23:20.318+0000 7f8edd726800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8edd726800 time 2024-09-12T17:23:20.319419+0000 2024-09-12T17:23:20.408 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:23:20.408 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.408 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:20.408 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8eded8c71a] 2024-09-12T17:23:20.408 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8eded8c8d8] 2024-09-12T17:23:20.409 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c12f02e841] 2024-09-12T17:23:20.409 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd73b64) [0x55c12f53bb64] 2024-09-12T17:23:20.409 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c12f03e50d] 2024-09-12T17:23:20.409 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:23:20.409 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8edda29590] 2024-09-12T17:23:20.409 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:23:20.409 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:23:20.409 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.409 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T17:23:20.319+0000 7f8edd726800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:23:20.409 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f8edd726800 thread_name:radosgw-admin 2024-09-12T17:23:20.409 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.409 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:20.410 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8edda3e6f0] 2024-09-12T17:23:20.410 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8edda8b99c] 2024-09-12T17:23:20.410 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:23:20.410 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:23:20.410 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8eded8c774] 2024-09-12T17:23:20.410 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8eded8c8d8] 2024-09-12T17:23:20.410 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c12f02e841] 2024-09-12T17:23:20.410 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd73b64) [0x55c12f53bb64] 2024-09-12T17:23:20.410 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c12f03e50d] 2024-09-12T17:23:20.410 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:23:20.410 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8edda29590] 2024-09-12T17:23:20.410 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:23:20.411 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:23:20.411 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:23:20.411 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.411 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T17:23:20.411 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T17:23:20.411 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T17:23:20.411 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T17:23:20.411 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T17:23:20.411 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T17:23:20.411 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T17:23:20.411 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T17:23:20.411 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T17:23:20.411 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T17:23:20.412 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T17:23:20.412 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T17:23:20.412 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T17:23:20.412 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T17:23:20.412 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T17:23:20.412 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T17:23:20.412 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T17:23:20.412 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T17:23:20.412 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T17:23:20.412 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T17:23:20.412 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T17:23:20.412 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T17:23:20.412 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T17:23:20.413 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T17:23:20.413 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:23:20.413 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T17:23:20.413 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T17:23:20.413 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T17:23:20.413 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T17:23:20.413 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T17:23:20.413 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T17:23:20.413 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T17:23:20.413 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T17:23:20.413 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T17:23:20.413 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T17:23:20.413 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T17:23:20.413 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T17:23:20.414 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T17:23:20.414 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T17:23:20.414 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T17:23:20.414 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T17:23:20.414 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T17:23:20.414 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T17:23:20.414 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T17:23:20.414 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T17:23:20.414 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T17:23:20.414 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:23:20.414 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T17:23:20.414 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:23:20.414 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T17:23:20.414 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T17:23:20.414 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T17:23:20.415 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T17:23:20.415 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T17:23:20.415 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T17:23:20.415 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T17:23:20.415 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T17:23:20.415 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T17:23:20.415 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T17:23:20.415 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T17:23:20.415 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T17:23:20.415 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T17:23:20.415 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T17:23:20.415 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T17:23:20.416 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T17:23:20.416 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T17:23:20.416 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T17:23:20.416 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:23:20.416 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T17:23:20.416 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:23:20.416 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T17:23:20.416 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T17:23:20.416 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T17:23:20.417 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T17:23:20.417 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T17:23:20.417 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T17:23:20.417 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:23:20.417 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T17:23:20.417 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T17:23:20.417 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:23:20.417 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T17:23:20.417 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T17:23:20.417 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T17:23:20.417 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T17:23:20.417 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T17:23:20.417 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T17:23:20.418 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T17:23:20.418 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T17:23:20.418 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T17:23:20.418 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T17:23:20.418 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T17:23:20.418 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T17:23:20.418 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T17:23:20.418 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:23:20.418 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8cfffff640 / http_manager 2024-09-12T17:23:20.418 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8d8e7e4640 / http_manager 2024-09-12T17:23:20.418 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8d8f7e6640 / rgw_dt_lg_renew 2024-09-12T17:23:20.418 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8daaffd640 / ms_dispatch 2024-09-12T17:23:20.418 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8dbcff9640 / io_context_pool 2024-09-12T17:23:20.419 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8dbeffd640 / ms_dispatch 2024-09-12T17:23:20.419 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8dc5e03640 / ms_dispatch 2024-09-12T17:23:20.419 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8dc7606640 / io_context_pool 2024-09-12T17:23:20.419 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8ed8b5c640 / msgr-worker-2 2024-09-12T17:23:20.419 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8ed935d640 / msgr-worker-1 2024-09-12T17:23:20.419 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8ed9b5e640 / msgr-worker-0 2024-09-12T17:23:20.419 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8eda35f640 / io_context_pool 2024-09-12T17:23:20.419 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8edd726800 / radosgw-admin 2024-09-12T17:23:20.419 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T17:23:20.419 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T17:23:20.419 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/log/ceph/ceph-client.admin.92130.log 2024-09-12T17:23:20.419 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T17:23:20.419 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T17:23:20.419 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T17:23:20.067+0000 7f8dc7606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:23:20.420 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T17:23:20.067+0000 7f8dc7606640 10 monclient: dump: 2024-09-12T17:23:20.420 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:20.420 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:20.420 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.420 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.420 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.420 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.420 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:20.420 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:20.420 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:20.420 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.420 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T17:23:20.067+0000 7f8dc7606640 10 monclient: _finish_auth 0 2024-09-12T17:23:20.420 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T17:23:20.067+0000 7f8dc7606640 10 monclient: _check_auth_tickets 2024-09-12T17:23:20.421 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 monclient: authenticate success, global_id 6047 2024-09-12T17:23:20.421 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T17:23:20.067+0000 7f8dc7606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:20.421 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T17:23:20.067+0000 7f8dc7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.421 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T17:23:20.067+0000 7f8dc7606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:23:20.421 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T17:23:20.067+0000 7f8dc7606640 10 monclient: dump: 2024-09-12T17:23:20.421 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:20.421 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:20.421 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.421 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.421 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.421 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.421 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:20.421 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:20.422 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:20.422 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.422 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T17:23:20.067+0000 7f8edd726800 10 monclient: get_monmap_and_config success 2024-09-12T17:23:20.422 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T17:23:20.067+0000 7f8edd726800 4 set_mon_vals no callback set 2024-09-12T17:23:20.422 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T17:23:20.067+0000 7f8edd726800 10 monclient: shutdown 2024-09-12T17:23:20.422 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 asok(0x55c13172f730) unregister_commands rotate-key 2024-09-12T17:23:20.422 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T17:23:20.067+0000 7f8edd726800 10 monclient: build_initial_monmap 2024-09-12T17:23:20.422 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T17:23:20.067+0000 7f8edd726800 1 build_initial for_mkfs: 0 2024-09-12T17:23:20.422 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T17:23:20.067+0000 7f8edd726800 10 monclient: monmap: 2024-09-12T17:23:20.422 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:23:20.423 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:20.423 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:23:20.423 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:23:20.423 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:20.423 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.423 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:23:20.423 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:23:20.423 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:23:20.424 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.424 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding auth protocol: cephx 2024-09-12T17:23:20.424 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding auth protocol: cephx 2024-09-12T17:23:20.424 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding auth protocol: cephx 2024-09-12T17:23:20.424 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding con mode: secure 2024-09-12T17:23:20.424 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding con mode: crc 2024-09-12T17:23:20.424 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding con mode: secure 2024-09-12T17:23:20.424 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding con mode: crc 2024-09-12T17:23:20.424 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding con mode: secure 2024-09-12T17:23:20.424 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding con mode: crc 2024-09-12T17:23:20.424 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding con mode: crc 2024-09-12T17:23:20.424 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding con mode: secure 2024-09-12T17:23:20.424 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding con mode: crc 2024-09-12T17:23:20.425 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding con mode: secure 2024-09-12T17:23:20.425 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding con mode: crc 2024-09-12T17:23:20.425 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T17:23:20.067+0000 7f8edd726800 5 AuthRegistry(0x55c131957440) adding con mode: secure 2024-09-12T17:23:20.425 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T17:23:20.068+0000 7f8edd726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.425 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T17:23:20.068+0000 7f8edd726800 1 librados: starting msgr at 2024-09-12T17:23:20.425 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T17:23:20.068+0000 7f8edd726800 1 librados: starting objecter 2024-09-12T17:23:20.425 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 asok(0x55c13172f730) register_command objecter_requests hook 0x55c131954c40 2024-09-12T17:23:20.425 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T17:23:20.068+0000 7f8edd726800 1 librados: setting wanted keys 2024-09-12T17:23:20.425 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T17:23:20.068+0000 7f8edd726800 1 librados: calling monclient init 2024-09-12T17:23:20.425 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T17:23:20.068+0000 7f8edd726800 10 monclient: init 2024-09-12T17:23:20.425 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding auth protocol: cephx 2024-09-12T17:23:20.425 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding auth protocol: cephx 2024-09-12T17:23:20.425 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding auth protocol: cephx 2024-09-12T17:23:20.426 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding con mode: secure 2024-09-12T17:23:20.426 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding con mode: crc 2024-09-12T17:23:20.426 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding con mode: secure 2024-09-12T17:23:20.426 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding con mode: crc 2024-09-12T17:23:20.426 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding con mode: secure 2024-09-12T17:23:20.426 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding con mode: crc 2024-09-12T17:23:20.426 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding con mode: crc 2024-09-12T17:23:20.426 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding con mode: secure 2024-09-12T17:23:20.426 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding con mode: crc 2024-09-12T17:23:20.426 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding con mode: secure 2024-09-12T17:23:20.426 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding con mode: crc 2024-09-12T17:23:20.427 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 AuthRegistry(0x55c131951d50) adding con mode: secure 2024-09-12T17:23:20.427 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T17:23:20.068+0000 7f8edd726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.427 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T17:23:20.068+0000 7f8edd726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.427 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T17:23:20.068+0000 7f8edd726800 5 asok(0x55c13172f730) register_command rotate-key hook 0x55c131951e98 2024-09-12T17:23:20.427 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T17:23:20.068+0000 7f8edd726800 10 monclient: _reopen_session rank -1 2024-09-12T17:23:20.427 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T17:23:20.068+0000 7f8edd726800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:23:20.427 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T17:23:20.068+0000 7f8edd726800 10 monclient(hunting): picked mon.noname-b con 0x55c131807440 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:23:20.428 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T17:23:20.068+0000 7f8edd726800 10 monclient(hunting): picked mon.noname-a con 0x55c1318979d0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:23:20.428 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T17:23:20.068+0000 7f8edd726800 10 monclient(hunting): picked mon.noname-c con 0x55c13197b7d0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:23:20.428 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T17:23:20.068+0000 7f8edd726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.428 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T17:23:20.068+0000 7f8edd726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.428 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T17:23:20.068+0000 7f8edd726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.428 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T17:23:20.068+0000 7f8edd726800 10 monclient(hunting): _renew_subs 2024-09-12T17:23:20.428 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T17:23:20.068+0000 7f8edd726800 10 monclient(hunting): authenticate will time out at 2211.419864s 2024-09-12T17:23:20.428 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T17:23:20.068+0000 7f8ed8b5c640 10 monclient(hunting): get_auth_request con 0x55c1318979d0 auth_method 0 2024-09-12T17:23:20.428 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T17:23:20.068+0000 7f8ed8b5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.429 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T17:23:20.068+0000 7f8ed8b5c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.429 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T17:23:20.068+0000 7f8ed8b5c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.429 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T17:23:20.068+0000 7f8ed9b5e640 10 monclient(hunting): get_auth_request con 0x55c13197b7d0 auth_method 0 2024-09-12T17:23:20.429 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T17:23:20.069+0000 7f8ed9b5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.429 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T17:23:20.069+0000 7f8ed9b5e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.429 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T17:23:20.069+0000 7f8ed9b5e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.430 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T17:23:20.069+0000 7f8ed8b5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.430 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T17:23:20.069+0000 7f8ed8b5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.430 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T17:23:20.069+0000 7f8ed8b5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.430 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T17:23:20.069+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.430 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T17:23:20.069+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.430 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T17:23:20.069+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.430 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T17:23:20.069+0000 7f8ed935d640 10 monclient(hunting): get_auth_request con 0x55c131807440 auth_method 0 2024-09-12T17:23:20.430 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T17:23:20.069+0000 7f8ed935d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.430 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T17:23:20.069+0000 7f8ed935d640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.430 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T17:23:20.069+0000 7f8ed935d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.430 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T17:23:20.069+0000 7f8ed8b5c640 10 monclient(hunting): handle_auth_done global_id 6420 payload 824 2024-09-12T17:23:20.430 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T17:23:20.069+0000 7f8ed8b5c640 10 monclient: _finish_hunting 0 2024-09-12T17:23:20.431 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T17:23:20.069+0000 7f8ed8b5c640 1 monclient: found mon.noname-a 2024-09-12T17:23:20.431 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T17:23:20.069+0000 7f8ed8b5c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:23:20.431 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T17:23:20.069+0000 7f8dc5e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.431 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T17:23:20.069+0000 7f8dc5e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:23:20.431 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T17:23:20.069+0000 7f8dc5e03640 10 monclient: dump: 2024-09-12T17:23:20.431 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:20.431 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:20.431 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.431 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.431 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.431 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.431 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:20.431 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:20.431 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:20.432 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.432 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T17:23:20.069+0000 7f8dc5e03640 10 monclient: _finish_auth 0 2024-09-12T17:23:20.432 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T17:23:20.069+0000 7f8dc5e03640 10 monclient: _check_auth_tickets 2024-09-12T17:23:20.432 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T17:23:20.069+0000 7f8dc5e03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:20.432 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T17:23:20.069+0000 7f8dc5e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.432 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T17:23:20.069+0000 7f8dc5e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:23:20.432 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T17:23:20.069+0000 7f8dc5e03640 10 monclient: dump: 2024-09-12T17:23:20.432 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:20.432 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:20.432 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.432 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.432 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.432 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.432 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:20.433 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:20.433 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:20.433 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.433 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T17:23:20.069+0000 7f8edd726800 5 monclient: authenticate success, global_id 6420 2024-09-12T17:23:20.433 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T17:23:20.069+0000 7f8edd726800 10 monclient: _renew_subs 2024-09-12T17:23:20.433 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T17:23:20.069+0000 7f8edd726800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:23:20.433 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T17:23:20.069+0000 7f8dc7606640 4 set_mon_vals no callback set 2024-09-12T17:23:20.433 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T17:23:20.069+0000 7f8edd726800 10 monclient: _renew_subs 2024-09-12T17:23:20.433 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T17:23:20.069+0000 7f8edd726800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:23:20.433 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T17:23:20.069+0000 7f8edd726800 1 librados: init done 2024-09-12T17:23:20.434 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T17:23:20.071+0000 7f8dc5e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:23:20.434 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T17:23:20.071+0000 7f8dc5e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:23:20.434 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T17:23:20.071+0000 7f8dc5e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:23:20.434 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T17:23:20.071+0000 7f8ed935d640 10 monclient: get_auth_request con 0x7f8dc0076470 auth_method 0 2024-09-12T17:23:20.434 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T17:23:20.072+0000 7f8ed9b5e640 10 monclient: get_auth_request con 0x55c13197a780 auth_method 0 2024-09-12T17:23:20.434 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T17:23:20.072+0000 7f8ed935d640 10 monclient: get_auth_request con 0x55c13199d2a0 auth_method 0 2024-09-12T17:23:20.434 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T17:23:20.073+0000 7f8ed8b5c640 10 monclient: get_auth_request con 0x55c1319a14e0 auth_method 0 2024-09-12T17:23:20.434 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T17:23:20.075+0000 7f8edd726800 10 monclient: build_initial_monmap 2024-09-12T17:23:20.434 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T17:23:20.075+0000 7f8edd726800 1 build_initial for_mkfs: 0 2024-09-12T17:23:20.434 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T17:23:20.075+0000 7f8edd726800 10 monclient: monmap: 2024-09-12T17:23:20.434 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:23:20.434 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:20.435 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:23:20.435 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:23:20.435 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:20.435 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.435 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:23:20.435 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:23:20.435 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:23:20.435 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.435 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding auth protocol: cephx 2024-09-12T17:23:20.435 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding auth protocol: cephx 2024-09-12T17:23:20.435 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding auth protocol: cephx 2024-09-12T17:23:20.435 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding con mode: secure 2024-09-12T17:23:20.436 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding con mode: crc 2024-09-12T17:23:20.436 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding con mode: secure 2024-09-12T17:23:20.436 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding con mode: crc 2024-09-12T17:23:20.436 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding con mode: secure 2024-09-12T17:23:20.436 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding con mode: crc 2024-09-12T17:23:20.436 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding con mode: crc 2024-09-12T17:23:20.436 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding con mode: secure 2024-09-12T17:23:20.436 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding con mode: crc 2024-09-12T17:23:20.436 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding con mode: secure 2024-09-12T17:23:20.436 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding con mode: crc 2024-09-12T17:23:20.436 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a6310) adding con mode: secure 2024-09-12T17:23:20.437 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T17:23:20.075+0000 7f8edd726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.437 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 asok(0x55c13172f730) register_command objecter_requests cmddesc objecter_requests hook 0x55c1319a9800 EEXIST 2024-09-12T17:23:20.437 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T17:23:20.075+0000 7f8edd726800 10 monclient: init 2024-09-12T17:23:20.437 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding auth protocol: cephx 2024-09-12T17:23:20.437 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding auth protocol: cephx 2024-09-12T17:23:20.437 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding auth protocol: cephx 2024-09-12T17:23:20.437 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding con mode: secure 2024-09-12T17:23:20.437 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding con mode: crc 2024-09-12T17:23:20.437 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding con mode: secure 2024-09-12T17:23:20.437 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding con mode: crc 2024-09-12T17:23:20.437 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding con mode: secure 2024-09-12T17:23:20.437 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding con mode: crc 2024-09-12T17:23:20.437 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding con mode: crc 2024-09-12T17:23:20.438 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding con mode: secure 2024-09-12T17:23:20.438 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding con mode: crc 2024-09-12T17:23:20.438 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding con mode: secure 2024-09-12T17:23:20.438 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding con mode: crc 2024-09-12T17:23:20.438 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T17:23:20.075+0000 7f8edd726800 5 AuthRegistry(0x55c1319a49e8) adding con mode: secure 2024-09-12T17:23:20.438 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T17:23:20.076+0000 7f8edd726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.438 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T17:23:20.076+0000 7f8edd726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.438 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T17:23:20.076+0000 7f8edd726800 5 asok(0x55c13172f730) register_command rotate-key cmddesc rotate-key hook 0x55c1319a4b30 EEXIST 2024-09-12T17:23:20.438 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T17:23:20.076+0000 7f8edd726800 10 monclient: _reopen_session rank -1 2024-09-12T17:23:20.438 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T17:23:20.076+0000 7f8edd726800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:23:20.438 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T17:23:20.076+0000 7f8edd726800 10 monclient(hunting): picked mon.noname-b con 0x55c1319cdb20 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:23:20.438 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T17:23:20.076+0000 7f8edd726800 10 monclient(hunting): picked mon.noname-a con 0x55c1319cdf00 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:23:20.439 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T17:23:20.076+0000 7f8edd726800 10 monclient(hunting): picked mon.noname-c con 0x55c1319cc830 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:23:20.439 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T17:23:20.076+0000 7f8edd726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.439 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T17:23:20.076+0000 7f8edd726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.439 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T17:23:20.076+0000 7f8edd726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.439 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T17:23:20.076+0000 7f8edd726800 10 monclient(hunting): _renew_subs 2024-09-12T17:23:20.439 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T17:23:20.076+0000 7f8edd726800 10 monclient(hunting): authenticate will time out at 2211.427318s 2024-09-12T17:23:20.439 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T17:23:20.076+0000 7f8ed9b5e640 10 monclient(hunting): get_auth_request con 0x55c1319cc830 auth_method 0 2024-09-12T17:23:20.439 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T17:23:20.076+0000 7f8ed9b5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.439 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T17:23:20.076+0000 7f8ed9b5e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.439 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T17:23:20.076+0000 7f8ed9b5e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.439 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T17:23:20.076+0000 7f8ed8b5c640 10 monclient(hunting): get_auth_request con 0x55c1319cdf00 auth_method 0 2024-09-12T17:23:20.440 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T17:23:20.076+0000 7f8ed8b5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.440 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T17:23:20.076+0000 7f8ed8b5c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.440 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T17:23:20.076+0000 7f8ed8b5c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.440 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T17:23:20.076+0000 7f8ed935d640 10 monclient(hunting): get_auth_request con 0x55c1319cdb20 auth_method 0 2024-09-12T17:23:20.440 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T17:23:20.076+0000 7f8ed935d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.440 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T17:23:20.076+0000 7f8ed935d640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.440 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T17:23:20.076+0000 7f8ed935d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.440 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T17:23:20.076+0000 7f8ed8b5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.440 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T17:23:20.076+0000 7f8ed8b5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.440 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T17:23:20.076+0000 7f8ed8b5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.440 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T17:23:20.076+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.440 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T17:23:20.076+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.441 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T17:23:20.076+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.441 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T17:23:20.076+0000 7f8ed935d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.441 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T17:23:20.076+0000 7f8ed935d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.441 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T17:23:20.076+0000 7f8ed935d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.441 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T17:23:20.076+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_done global_id 6053 payload 824 2024-09-12T17:23:20.441 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T17:23:20.076+0000 7f8ed9b5e640 10 monclient: _finish_hunting 0 2024-09-12T17:23:20.441 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T17:23:20.076+0000 7f8ed9b5e640 1 monclient: found mon.noname-c 2024-09-12T17:23:20.441 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T17:23:20.076+0000 7f8ed9b5e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:23:20.441 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T17:23:20.076+0000 7f8dbeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.441 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T17:23:20.076+0000 7f8dbeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:23:20.441 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T17:23:20.076+0000 7f8dbeffd640 10 monclient: dump: 2024-09-12T17:23:20.441 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:20.441 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:20.442 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.442 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.442 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.442 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.442 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:20.442 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:20.442 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:20.442 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.442 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T17:23:20.077+0000 7f8dbeffd640 10 monclient: _finish_auth 0 2024-09-12T17:23:20.442 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T17:23:20.077+0000 7f8dbeffd640 10 monclient: _check_auth_tickets 2024-09-12T17:23:20.442 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T17:23:20.077+0000 7f8dbeffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:20.442 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T17:23:20.077+0000 7f8dbeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.442 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T17:23:20.077+0000 7f8dbeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:23:20.442 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T17:23:20.077+0000 7f8dbeffd640 10 monclient: dump: 2024-09-12T17:23:20.442 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:20.443 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:20.443 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.443 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.443 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.443 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.443 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:20.443 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:20.443 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:20.443 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.443 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T17:23:20.077+0000 7f8edd726800 5 monclient: authenticate success, global_id 6053 2024-09-12T17:23:20.443 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T17:23:20.077+0000 7f8eda35f640 4 set_mon_vals no callback set 2024-09-12T17:23:20.443 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T17:23:20.077+0000 7f8edd726800 10 monclient: _renew_subs 2024-09-12T17:23:20.444 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T17:23:20.077+0000 7f8edd726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:23:20.444 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T17:23:20.077+0000 7f8edd726800 10 monclient: _renew_subs 2024-09-12T17:23:20.444 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T17:23:20.077+0000 7f8edd726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:23:20.444 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T17:23:20.078+0000 7f8dbeffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:23:20.444 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T17:23:20.078+0000 7f8dbeffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:23:20.444 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T17:23:20.078+0000 7f8dbeffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:23:20.444 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T17:23:20.079+0000 7f8ed935d640 10 monclient: get_auth_request con 0x7f8db4076380 auth_method 0 2024-09-12T17:23:20.444 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T17:23:20.079+0000 7f8edd726800 10 monclient: get_monmap_and_config 2024-09-12T17:23:20.444 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T17:23:20.079+0000 7f8edd726800 10 monclient: build_initial_monmap 2024-09-12T17:23:20.444 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T17:23:20.079+0000 7f8edd726800 1 build_initial for_mkfs: 0 2024-09-12T17:23:20.444 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T17:23:20.079+0000 7f8edd726800 10 monclient: monmap: 2024-09-12T17:23:20.444 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:23:20.444 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:20.445 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:23:20.445 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:23:20.445 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:20.445 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.445 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:23:20.445 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:23:20.445 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:23:20.445 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.446 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding auth protocol: cephx 2024-09-12T17:23:20.446 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding auth protocol: cephx 2024-09-12T17:23:20.446 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding auth protocol: cephx 2024-09-12T17:23:20.446 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding con mode: secure 2024-09-12T17:23:20.446 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding con mode: crc 2024-09-12T17:23:20.446 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding con mode: secure 2024-09-12T17:23:20.446 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding con mode: crc 2024-09-12T17:23:20.446 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding con mode: secure 2024-09-12T17:23:20.446 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding con mode: crc 2024-09-12T17:23:20.446 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding con mode: crc 2024-09-12T17:23:20.446 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding con mode: secure 2024-09-12T17:23:20.446 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding con mode: crc 2024-09-12T17:23:20.447 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding con mode: secure 2024-09-12T17:23:20.447 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding con mode: crc 2024-09-12T17:23:20.447 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x55c1319eda20) adding con mode: secure 2024-09-12T17:23:20.447 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T17:23:20.079+0000 7f8edd726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.447 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T17:23:20.079+0000 7f8edd726800 10 monclient: init 2024-09-12T17:23:20.447 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding auth protocol: cephx 2024-09-12T17:23:20.447 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding auth protocol: cephx 2024-09-12T17:23:20.447 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding auth protocol: cephx 2024-09-12T17:23:20.447 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding con mode: secure 2024-09-12T17:23:20.447 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding con mode: crc 2024-09-12T17:23:20.447 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding con mode: secure 2024-09-12T17:23:20.447 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding con mode: crc 2024-09-12T17:23:20.447 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding con mode: secure 2024-09-12T17:23:20.448 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding con mode: crc 2024-09-12T17:23:20.448 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding con mode: crc 2024-09-12T17:23:20.448 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding con mode: secure 2024-09-12T17:23:20.448 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding con mode: crc 2024-09-12T17:23:20.448 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding con mode: secure 2024-09-12T17:23:20.448 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding con mode: crc 2024-09-12T17:23:20.448 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T17:23:20.079+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e25d0) adding con mode: secure 2024-09-12T17:23:20.448 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T17:23:20.080+0000 7f8edd726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.448 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T17:23:20.080+0000 7f8edd726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.448 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T17:23:20.080+0000 7f8edd726800 5 asok(0x55c13172f730) register_command rotate-key cmddesc rotate-key hook 0x7ffcdf4e2718 EEXIST 2024-09-12T17:23:20.448 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T17:23:20.080+0000 7f8edd726800 10 monclient: _reopen_session rank -1 2024-09-12T17:23:20.448 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T17:23:20.080+0000 7f8edd726800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:23:20.449 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T17:23:20.080+0000 7f8edd726800 10 monclient(hunting): picked mon.noname-c con 0x55c131a22080 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:23:20.449 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T17:23:20.080+0000 7f8edd726800 10 monclient(hunting): picked mon.noname-b con 0x55c1319f3090 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:23:20.449 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T17:23:20.080+0000 7f8edd726800 10 monclient(hunting): picked mon.noname-a con 0x55c131a1d560 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:23:20.449 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T17:23:20.080+0000 7f8edd726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.449 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T17:23:20.080+0000 7f8edd726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.449 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T17:23:20.080+0000 7f8edd726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.449 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T17:23:20.080+0000 7f8edd726800 10 monclient(hunting): _renew_subs 2024-09-12T17:23:20.449 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T17:23:20.080+0000 7f8edd726800 10 monclient(hunting): authenticate will time out at 2211.431348s 2024-09-12T17:23:20.449 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T17:23:20.080+0000 7f8ed9b5e640 10 monclient(hunting): get_auth_request con 0x55c131a1d560 auth_method 0 2024-09-12T17:23:20.449 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T17:23:20.080+0000 7f8ed9b5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.450 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T17:23:20.080+0000 7f8ed9b5e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.450 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T17:23:20.080+0000 7f8ed9b5e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.450 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T17:23:20.080+0000 7f8ed935d640 10 monclient(hunting): get_auth_request con 0x55c131a22080 auth_method 0 2024-09-12T17:23:20.450 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T17:23:20.080+0000 7f8ed935d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.450 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T17:23:20.080+0000 7f8ed935d640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.450 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T17:23:20.080+0000 7f8ed935d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.450 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T17:23:20.080+0000 7f8ed8b5c640 10 monclient(hunting): get_auth_request con 0x55c1319f3090 auth_method 0 2024-09-12T17:23:20.450 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T17:23:20.080+0000 7f8ed8b5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.450 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T17:23:20.080+0000 7f8ed8b5c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.450 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T17:23:20.080+0000 7f8ed8b5c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.450 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T17:23:20.080+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.451 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T17:23:20.080+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.451 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T17:23:20.080+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.451 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T17:23:20.080+0000 7f8ed935d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.451 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T17:23:20.080+0000 7f8ed935d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.451 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T17:23:20.080+0000 7f8ed935d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.451 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T17:23:20.080+0000 7f8ed8b5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.451 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T17:23:20.080+0000 7f8ed8b5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.451 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T17:23:20.080+0000 7f8ed8b5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.451 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T17:23:20.080+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_done global_id 6426 payload 274 2024-09-12T17:23:20.451 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T17:23:20.080+0000 7f8ed9b5e640 10 monclient: _finish_hunting 0 2024-09-12T17:23:20.451 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T17:23:20.080+0000 7f8ed9b5e640 1 monclient: found mon.noname-a 2024-09-12T17:23:20.452 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T17:23:20.080+0000 7f8ed9b5e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:23:20.452 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T17:23:20.080+0000 7f8dbcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.452 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T17:23:20.080+0000 7f8dbcff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:23:20.452 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T17:23:20.080+0000 7f8dbcff9640 10 monclient: dump: 2024-09-12T17:23:20.452 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:20.452 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:20.452 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.452 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.452 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.452 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.452 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:20.453 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:20.453 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:20.453 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.453 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T17:23:20.080+0000 7f8dbcff9640 10 monclient: _finish_auth 0 2024-09-12T17:23:20.453 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T17:23:20.080+0000 7f8dbcff9640 10 monclient: _check_auth_tickets 2024-09-12T17:23:20.453 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T17:23:20.080+0000 7f8dbcff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:20.453 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T17:23:20.080+0000 7f8dbcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.453 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T17:23:20.080+0000 7f8dbcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:23:20.453 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T17:23:20.080+0000 7f8dbcff9640 10 monclient: dump: 2024-09-12T17:23:20.453 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:20.454 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:20.454 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.454 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.454 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.454 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.454 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:20.454 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:20.454 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:20.454 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.455 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T17:23:20.080+0000 7f8edd726800 5 monclient: authenticate success, global_id 6426 2024-09-12T17:23:20.455 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T17:23:20.080+0000 7f8edd726800 10 monclient: get_monmap_and_config success 2024-09-12T17:23:20.455 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T17:23:20.080+0000 7f8edd726800 4 set_mon_vals no callback set 2024-09-12T17:23:20.455 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T17:23:20.081+0000 7f8edd726800 10 monclient: shutdown 2024-09-12T17:23:20.455 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T17:23:20.081+0000 7f8edd726800 10 monclient: build_initial_monmap 2024-09-12T17:23:20.455 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T17:23:20.081+0000 7f8edd726800 1 build_initial for_mkfs: 0 2024-09-12T17:23:20.455 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T17:23:20.081+0000 7f8edd726800 10 monclient: monmap: 2024-09-12T17:23:20.455 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:23:20.455 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:20.455 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:23:20.455 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:23:20.455 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:20.455 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.455 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:23:20.456 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:23:20.456 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:23:20.456 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.456 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding auth protocol: cephx 2024-09-12T17:23:20.456 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding auth protocol: cephx 2024-09-12T17:23:20.456 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding auth protocol: cephx 2024-09-12T17:23:20.456 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding con mode: secure 2024-09-12T17:23:20.456 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding con mode: crc 2024-09-12T17:23:20.456 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding con mode: secure 2024-09-12T17:23:20.456 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding con mode: crc 2024-09-12T17:23:20.456 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding con mode: secure 2024-09-12T17:23:20.457 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding con mode: crc 2024-09-12T17:23:20.457 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding con mode: crc 2024-09-12T17:23:20.457 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding con mode: secure 2024-09-12T17:23:20.457 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding con mode: crc 2024-09-12T17:23:20.457 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding con mode: secure 2024-09-12T17:23:20.457 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding con mode: crc 2024-09-12T17:23:20.457 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 AuthRegistry(0x55c131a12870) adding con mode: secure 2024-09-12T17:23:20.457 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T17:23:20.081+0000 7f8edd726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.457 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T17:23:20.081+0000 7f8edd726800 1 librados: starting msgr at 2024-09-12T17:23:20.457 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T17:23:20.081+0000 7f8edd726800 1 librados: starting objecter 2024-09-12T17:23:20.458 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T17:23:20.081+0000 7f8edd726800 5 asok(0x55c13172f730) register_command objecter_requests cmddesc objecter_requests hook 0x55c1319f1610 EEXIST 2024-09-12T17:23:20.458 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T17:23:20.082+0000 7f8edd726800 1 librados: setting wanted keys 2024-09-12T17:23:20.458 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T17:23:20.082+0000 7f8edd726800 1 librados: calling monclient init 2024-09-12T17:23:20.458 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T17:23:20.082+0000 7f8edd726800 10 monclient: init 2024-09-12T17:23:20.458 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding auth protocol: cephx 2024-09-12T17:23:20.458 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding auth protocol: cephx 2024-09-12T17:23:20.458 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding auth protocol: cephx 2024-09-12T17:23:20.459 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding con mode: secure 2024-09-12T17:23:20.459 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding con mode: crc 2024-09-12T17:23:20.459 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding con mode: secure 2024-09-12T17:23:20.459 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding con mode: crc 2024-09-12T17:23:20.459 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding con mode: secure 2024-09-12T17:23:20.459 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding con mode: crc 2024-09-12T17:23:20.459 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding con mode: crc 2024-09-12T17:23:20.459 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding con mode: secure 2024-09-12T17:23:20.460 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding con mode: crc 2024-09-12T17:23:20.460 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding con mode: secure 2024-09-12T17:23:20.460 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding con mode: crc 2024-09-12T17:23:20.460 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 AuthRegistry(0x55c1319e23e0) adding con mode: secure 2024-09-12T17:23:20.460 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T17:23:20.082+0000 7f8edd726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.460 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T17:23:20.082+0000 7f8edd726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.460 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T17:23:20.082+0000 7f8edd726800 5 asok(0x55c13172f730) register_command rotate-key cmddesc rotate-key hook 0x55c1319e2528 EEXIST 2024-09-12T17:23:20.460 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T17:23:20.082+0000 7f8edd726800 10 monclient: _reopen_session rank -1 2024-09-12T17:23:20.461 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T17:23:20.082+0000 7f8edd726800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:23:20.461 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T17:23:20.082+0000 7f8edd726800 10 monclient(hunting): picked mon.noname-c con 0x55c1319f3090 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:23:20.461 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T17:23:20.082+0000 7f8edd726800 10 monclient(hunting): picked mon.noname-b con 0x55c131a1d560 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:23:20.461 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T17:23:20.082+0000 7f8edd726800 10 monclient(hunting): picked mon.noname-a con 0x55c131a22080 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:23:20.461 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T17:23:20.082+0000 7f8edd726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.461 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T17:23:20.082+0000 7f8edd726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.462 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T17:23:20.082+0000 7f8edd726800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.462 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T17:23:20.082+0000 7f8edd726800 10 monclient(hunting): _renew_subs 2024-09-12T17:23:20.462 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T17:23:20.082+0000 7f8edd726800 10 monclient(hunting): authenticate will time out at 2211.433600s 2024-09-12T17:23:20.462 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T17:23:20.082+0000 7f8ed935d640 10 monclient(hunting): get_auth_request con 0x55c1319f3090 auth_method 0 2024-09-12T17:23:20.462 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T17:23:20.082+0000 7f8ed935d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.462 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T17:23:20.082+0000 7f8ed935d640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.462 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T17:23:20.082+0000 7f8ed935d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.462 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T17:23:20.082+0000 7f8ed9b5e640 10 monclient(hunting): get_auth_request con 0x55c131a22080 auth_method 0 2024-09-12T17:23:20.463 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T17:23:20.082+0000 7f8ed9b5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.463 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T17:23:20.082+0000 7f8ed9b5e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.463 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T17:23:20.082+0000 7f8ed9b5e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.463 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T17:23:20.082+0000 7f8ed935d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.463 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T17:23:20.082+0000 7f8ed935d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.463 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T17:23:20.082+0000 7f8ed935d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.463 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T17:23:20.082+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.464 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T17:23:20.082+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.464 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T17:23:20.082+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.464 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T17:23:20.082+0000 7f8ed8b5c640 10 monclient(hunting): get_auth_request con 0x55c131a1d560 auth_method 0 2024-09-12T17:23:20.464 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T17:23:20.082+0000 7f8ed8b5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.464 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T17:23:20.082+0000 7f8ed8b5c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.464 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T17:23:20.082+0000 7f8ed8b5c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.465 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T17:23:20.082+0000 7f8ed8b5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.465 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T17:23:20.082+0000 7f8ed8b5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.465 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T17:23:20.082+0000 7f8ed8b5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.465 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T17:23:20.082+0000 7f8ed9b5e640 10 monclient(hunting): handle_auth_done global_id 6429 payload 824 2024-09-12T17:23:20.465 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T17:23:20.082+0000 7f8ed9b5e640 10 monclient: _finish_hunting 0 2024-09-12T17:23:20.465 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T17:23:20.082+0000 7f8ed9b5e640 1 monclient: found mon.noname-a 2024-09-12T17:23:20.465 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T17:23:20.082+0000 7f8ed9b5e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:23:20.466 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T17:23:20.083+0000 7f8daaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.466 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T17:23:20.083+0000 7f8daaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:23:20.466 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T17:23:20.083+0000 7f8daaffd640 10 monclient: dump: 2024-09-12T17:23:20.466 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:20.466 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:20.466 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.466 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.466 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.467 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.467 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:20.467 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:20.467 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:20.467 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.467 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T17:23:20.083+0000 7f8daaffd640 10 monclient: _finish_auth 0 2024-09-12T17:23:20.467 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T17:23:20.083+0000 7f8daaffd640 10 monclient: _check_auth_tickets 2024-09-12T17:23:20.467 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T17:23:20.083+0000 7f8daaffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:20.468 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T17:23:20.083+0000 7f8daaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.468 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T17:23:20.083+0000 7f8daaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:23:20.468 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T17:23:20.083+0000 7f8daaffd640 10 monclient: dump: 2024-09-12T17:23:20.468 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:20.468 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:20.468 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.468 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:20.468 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.468 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:20.469 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:20.469 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:20.469 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:20.469 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.469 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T17:23:20.083+0000 7f8edd726800 5 monclient: authenticate success, global_id 6429 2024-09-12T17:23:20.469 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T17:23:20.083+0000 7f8edd726800 10 monclient: _renew_subs 2024-09-12T17:23:20.469 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T17:23:20.083+0000 7f8dbcff9640 4 set_mon_vals no callback set 2024-09-12T17:23:20.469 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T17:23:20.083+0000 7f8edd726800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:23:20.470 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T17:23:20.083+0000 7f8edd726800 10 monclient: _renew_subs 2024-09-12T17:23:20.470 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T17:23:20.083+0000 7f8edd726800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:23:20.470 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T17:23:20.083+0000 7f8edd726800 1 librados: init done 2024-09-12T17:23:20.470 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T17:23:20.083+0000 7f8edd726800 5 asok(0x55c13172f730) register_command cr dump hook 0x55c131a14368 2024-09-12T17:23:20.470 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T17:23:20.085+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.470 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T17:23:20.085+0000 7f8daaffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:23:20.470 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T17:23:20.085+0000 7f8daaffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:23:20.470 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T17:23:20.085+0000 7f8daaffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:23:20.471 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T17:23:20.086+0000 7f8ed935d640 10 monclient: get_auth_request con 0x7f8da40764a0 auth_method 0 2024-09-12T17:23:20.471 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T17:23:20.086+0000 7f8ed8b5c640 10 monclient: get_auth_request con 0x55c131a3c020 auth_method 0 2024-09-12T17:23:20.471 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T17:23:20.086+0000 7f8edd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.471 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T17:23:20.086+0000 7f8edd726800 20 realm 2024-09-12T17:23:20.471 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T17:23:20.086+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.471 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T17:23:20.086+0000 7f8edd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.471 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T17:23:20.086+0000 7f8edd726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:20.471 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T17:23:20.086+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.471 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T17:23:20.086+0000 7f8edd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.471 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T17:23:20.086+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.471 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T17:23:20.087+0000 7f8ed935d640 10 monclient: get_auth_request con 0x55c131a40250 auth_method 0 2024-09-12T17:23:20.471 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T17:23:20.087+0000 7f8edd726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:20.471 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T17:23:20.087+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.472 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T17:23:20.087+0000 7f8ed8b5c640 10 monclient: get_auth_request con 0x55c131a43b00 auth_method 0 2024-09-12T17:23:20.472 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T17:23:20.088+0000 7f8edd726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:20.472 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T17:23:20.088+0000 7f8edd726800 20 searching for the correct realm 2024-09-12T17:23:20.472 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T17:23:20.088+0000 7f8ed9b5e640 10 monclient: get_auth_request con 0x55c131a48800 auth_method 0 2024-09-12T17:23:20.472 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T17:23:20.089+0000 7f8ed935d640 10 monclient: get_auth_request con 0x7f8ed4027020 auth_method 0 2024-09-12T17:23:20.472 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T17:23:20.090+0000 7f8ed8b5c640 10 monclient: get_auth_request con 0x7f8ecc07e070 auth_method 0 2024-09-12T17:23:20.472 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T17:23:20.090+0000 7f8ed8b5c640 0 -- 172.21.15.67:0/2143424926 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55c131a43b00 msgr2=0x55c131a45ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:20.472 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T17:23:20.091+0000 7f8daaffd640 1 client.6429.objecter ms_handle_reset 0x55c131a43b00 session 0x55c131a3f5a0 osd.4 2024-09-12T17:23:20.472 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T17:23:20.091+0000 7f8daaffd640 10 monclient: _renew_subs 2024-09-12T17:23:20.472 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T17:23:20.091+0000 7f8daaffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:23:20.472 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T17:23:20.091+0000 7f8ed8b5c640 10 monclient: get_auth_request con 0x7f8da4086340 auth_method 0 2024-09-12T17:23:20.472 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T17:23:20.092+0000 7f8ed9b5e640 10 monclient: get_auth_request con 0x7f8ed0084230 auth_method 0 2024-09-12T17:23:20.472 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T17:23:20.094+0000 7f8ed935d640 10 monclient: get_auth_request con 0x7f8ed0062ad0 auth_method 0 2024-09-12T17:23:20.473 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T17:23:20.094+0000 7f8ed935d640 0 -- 172.21.15.67:0/2143424926 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f8ed0062ad0 msgr2=0x7f8ed00928e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:20.473 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T17:23:20.295+0000 7f8ed935d640 10 monclient: get_auth_request con 0x7f8ed0062ad0 auth_method 0 2024-09-12T17:23:20.473 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T17:23:20.300+0000 7f8edd726800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:20.473 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T17:23:20.300+0000 7f8edd726800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:20.473 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T17:23:20.300+0000 7f8edd726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:20.473 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T17:23:20.300+0000 7f8edd726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:20.473 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T17:23:20.300+0000 7f8edd726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:20.473 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T17:23:20.300+0000 7f8edd726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:20.473 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T17:23:20.300+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.473 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T17:23:20.300+0000 7f8edd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.474 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T17:23:20.300+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.474 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T17:23:20.301+0000 7f8edd726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:20.474 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T17:23:20.301+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.474 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T17:23:20.301+0000 7f8edd726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:20.474 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T17:23:20.301+0000 7f8edd726800 20 zone default found 2024-09-12T17:23:20.474 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T17:23:20.301+0000 7f8edd726800 4 Realm: () 2024-09-12T17:23:20.474 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T17:23:20.301+0000 7f8edd726800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:20.474 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T17:23:20.301+0000 7f8edd726800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:20.474 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T17:23:20.301+0000 7f8edd726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:20.474 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T17:23:20.301+0000 7f8edd726800 20 zonegroup default 2024-09-12T17:23:20.474 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T17:23:20.301+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.474 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T17:23:20.301+0000 7f8edd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.474 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T17:23:20.301+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.475 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T17:23:20.302+0000 7f8edd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.475 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T17:23:20.302+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.475 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T17:23:20.302+0000 7f8edd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.475 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T17:23:20.302+0000 7f8edd726800 20 started sync module instance, tier type = 2024-09-12T17:23:20.475 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T17:23:20.302+0000 7f8edd726800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:20.475 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T17:23:20.312+0000 7f8edd726800 20 add_watcher() i=0 2024-09-12T17:23:20.475 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T17:23:20.312+0000 7f8edd726800 20 add_watcher() i=1 2024-09-12T17:23:20.475 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T17:23:20.312+0000 7f8edd726800 20 add_watcher() i=2 2024-09-12T17:23:20.475 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T17:23:20.312+0000 7f8edd726800 20 add_watcher() i=3 2024-09-12T17:23:20.475 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T17:23:20.312+0000 7f8edd726800 20 add_watcher() i=4 2024-09-12T17:23:20.475 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T17:23:20.312+0000 7f8edd726800 20 add_watcher() i=5 2024-09-12T17:23:20.475 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T17:23:20.312+0000 7f8edd726800 20 add_watcher() i=6 2024-09-12T17:23:20.475 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T17:23:20.312+0000 7f8edd726800 20 add_watcher() i=7 2024-09-12T17:23:20.475 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T17:23:20.312+0000 7f8edd726800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:20.475 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding auth protocol: cephx 2024-09-12T17:23:20.476 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding auth protocol: cephx 2024-09-12T17:23:20.476 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding auth protocol: cephx 2024-09-12T17:23:20.476 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding con mode: secure 2024-09-12T17:23:20.476 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding con mode: crc 2024-09-12T17:23:20.476 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding con mode: secure 2024-09-12T17:23:20.476 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding con mode: crc 2024-09-12T17:23:20.476 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding con mode: secure 2024-09-12T17:23:20.476 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding con mode: crc 2024-09-12T17:23:20.476 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding con mode: crc 2024-09-12T17:23:20.476 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding con mode: secure 2024-09-12T17:23:20.476 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding con mode: crc 2024-09-12T17:23:20.476 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding con mode: secure 2024-09-12T17:23:20.476 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding con mode: crc 2024-09-12T17:23:20.476 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T17:23:20.314+0000 7f8edd726800 5 AuthRegistry(0x7ffcdf4e2aa0) adding con mode: secure 2024-09-12T17:23:20.476 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T17:23:20.314+0000 7f8d8f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:20.477 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T17:23:20.315+0000 7f8edd726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.477 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T17:23:20.315+0000 7f8edd726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:20.477 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T17:23:20.315+0000 7f8edd726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:20.477 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T17:23:20.315+0000 7f8edd726800 5 asok(0x55c13172f730) register_command cache list hook 0x55c131a18fd0 2024-09-12T17:23:20.477 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T17:23:20.315+0000 7f8edd726800 5 asok(0x55c13172f730) register_command cache inspect hook 0x55c131a18fd0 2024-09-12T17:23:20.477 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T17:23:20.315+0000 7f8edd726800 5 asok(0x55c13172f730) register_command cache erase hook 0x55c131a18fd0 2024-09-12T17:23:20.477 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T17:23:20.315+0000 7f8edd726800 5 asok(0x55c13172f730) register_command cache zap hook 0x55c131a18fd0 2024-09-12T17:23:20.477 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T17:23:20.315+0000 7f8edd726800 5 note: GC not initialized 2024-09-12T17:23:20.477 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T17:23:20.315+0000 7f8d8e7e4640 20 reqs_thread_entry: start 2024-09-12T17:23:20.477 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T17:23:20.315+0000 7f8edd726800 5 asok(0x55c13172f730) register_command sync trace show hook 0x7f8ed402a030 2024-09-12T17:23:20.477 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T17:23:20.315+0000 7f8edd726800 5 asok(0x55c13172f730) register_command sync trace history hook 0x7f8ed402a030 2024-09-12T17:23:20.477 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T17:23:20.315+0000 7f8edd726800 5 asok(0x55c13172f730) register_command sync trace active hook 0x7f8ed402a030 2024-09-12T17:23:20.478 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T17:23:20.315+0000 7f8edd726800 5 asok(0x55c13172f730) register_command sync trace active_short hook 0x7f8ed402a030 2024-09-12T17:23:20.478 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T17:23:20.315+0000 7f8edd726800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:20.478 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T17:23:20.315+0000 7f8edd726800 20 Filter name: none 2024-09-12T17:23:20.478 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T17:23:20.315+0000 7f8cfffff640 20 reqs_thread_entry: start 2024-09-12T17:23:20.478 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T17:23:20.315+0000 7f8edd726800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:23:20.478 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T17:23:20.315+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.478 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T17:23:20.316+0000 7f8edd726800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:23:20.478 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T17:23:20.316+0000 7f8edd726800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:23:20.478 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T17:23:20.316+0000 7f8edd726800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:23:20.478 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T17:23:20.316+0000 7f8edd726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 : miss 2024-09-12T17:23:20.478 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T17:23:20.316+0000 7f8edd726800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.478 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T17:23:20.316+0000 7f8edd726800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:23:20.478 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T17:23:20.316+0000 7f8edd726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 info.flags=0x17 2024-09-12T17:23:20.478 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T17:23:20.316+0000 7f8edd726800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 to cache LRU end 2024-09-12T17:23:20.479 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T17:23:20.316+0000 7f8edd726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:20.479 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T17:23:20.316+0000 7f8edd726800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:20.479 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T17:23:20.316+0000 7f8edd726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 2024-09-12T17:23:20.479 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T17:23:20.318+0000 7f8edd726800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8edd726800 time 2024-09-12T17:23:20.319419+0000 2024-09-12T17:23:20.479 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:23:20.479 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.479 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:20.479 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8eded8c71a] 2024-09-12T17:23:20.479 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8eded8c8d8] 2024-09-12T17:23:20.479 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c12f02e841] 2024-09-12T17:23:20.479 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd73b64) [0x55c12f53bb64] 2024-09-12T17:23:20.479 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c12f03e50d] 2024-09-12T17:23:20.479 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:23:20.479 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8edda29590] 2024-09-12T17:23:20.479 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:23:20.480 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:23:20.480 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.480 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T17:23:20.319+0000 7f8edd726800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:23:20.480 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f8edd726800 thread_name:radosgw-admin 2024-09-12T17:23:20.480 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.480 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:20.480 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8edda3e6f0] 2024-09-12T17:23:20.480 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8edda8b99c] 2024-09-12T17:23:20.480 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:23:20.480 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:23:20.480 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8eded8c774] 2024-09-12T17:23:20.481 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8eded8c8d8] 2024-09-12T17:23:20.481 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c12f02e841] 2024-09-12T17:23:20.481 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd73b64) [0x55c12f53bb64] 2024-09-12T17:23:20.481 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c12f03e50d] 2024-09-12T17:23:20.481 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:23:20.481 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8edda29590] 2024-09-12T17:23:20.481 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:23:20.481 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:23:20.481 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:23:20.481 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.481 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T17:23:20.481 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T17:23:20.481 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T17:23:20.481 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T17:23:20.482 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T17:23:20.482 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T17:23:20.482 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T17:23:20.482 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T17:23:20.482 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T17:23:20.482 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T17:23:20.482 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T17:23:20.482 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T17:23:20.482 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T17:23:20.482 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T17:23:20.482 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T17:23:20.482 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T17:23:20.482 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T17:23:20.482 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T17:23:20.482 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T17:23:20.482 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T17:23:20.483 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T17:23:20.483 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T17:23:20.483 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T17:23:20.483 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T17:23:20.483 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:23:20.483 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T17:23:20.483 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T17:23:20.483 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T17:23:20.483 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T17:23:20.483 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T17:23:20.483 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T17:23:20.483 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T17:23:20.483 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T17:23:20.483 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T17:23:20.484 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T17:23:20.484 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T17:23:20.484 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T17:23:20.484 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T17:23:20.484 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T17:23:20.484 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T17:23:20.484 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T17:23:20.484 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T17:23:20.484 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T17:23:20.484 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T17:23:20.484 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T17:23:20.484 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T17:23:20.484 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:23:20.484 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T17:23:20.484 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:23:20.485 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T17:23:20.485 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T17:23:20.485 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T17:23:20.485 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T17:23:20.485 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T17:23:20.485 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T17:23:20.485 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T17:23:20.485 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T17:23:20.485 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T17:23:20.485 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T17:23:20.485 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T17:23:20.485 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T17:23:20.485 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T17:23:20.485 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T17:23:20.486 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T17:23:20.486 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T17:23:20.486 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T17:23:20.486 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T17:23:20.486 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:23:20.486 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T17:23:20.486 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:23:20.486 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T17:23:20.486 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T17:23:20.486 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T17:23:20.486 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T17:23:20.486 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T17:23:20.486 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T17:23:20.486 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:23:20.487 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T17:23:20.487 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T17:23:20.487 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:23:20.487 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T17:23:20.487 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T17:23:20.487 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T17:23:20.487 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T17:23:20.487 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T17:23:20.487 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T17:23:20.487 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T17:23:20.488 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T17:23:20.488 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T17:23:20.488 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T17:23:20.488 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T17:23:20.488 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T17:23:20.488 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T17:23:20.488 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:23:20.488 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8cfffff640 / http_manager 2024-09-12T17:23:20.488 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8d8e7e4640 / http_manager 2024-09-12T17:23:20.488 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8d8f7e6640 / rgw_dt_lg_renew 2024-09-12T17:23:20.488 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8daaffd640 / ms_dispatch 2024-09-12T17:23:20.488 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8dbcff9640 / io_context_pool 2024-09-12T17:23:20.489 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8dbeffd640 / ms_dispatch 2024-09-12T17:23:20.489 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8dc5e03640 / ms_dispatch 2024-09-12T17:23:20.489 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8dc7606640 / io_context_pool 2024-09-12T17:23:20.489 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8ed8b5c640 / msgr-worker-2 2024-09-12T17:23:20.489 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8ed935d640 / msgr-worker-1 2024-09-12T17:23:20.489 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8ed9b5e640 / msgr-worker-0 2024-09-12T17:23:20.489 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8eda35f640 / io_context_pool 2024-09-12T17:23:20.489 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8edd726800 / radosgw-admin 2024-09-12T17:23:20.489 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T17:23:20.489 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T17:23:20.489 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:23:20.321089Z_91a21f70-44c1-46de-a46a-8dc458124443/log 2024-09-12T17:23:20.489 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T17:23:20.489 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:23:20.491 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:20.491 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:20.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.397+0000 7f5457524800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.399+0000 7f5457524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.399+0000 7f5457524800 20 realm 2024-09-12T17:23:20.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.399+0000 7f5457524800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.399+0000 7f5457524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.399+0000 7f5457524800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:20.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.399+0000 7f5457524800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.399+0000 7f5457524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.399+0000 7f5457524800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.400+0000 7f5457524800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:20.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.400+0000 7f5457524800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.401+0000 7f5457524800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:20.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.401+0000 7f5457524800 20 searching for the correct realm 2024-09-12T17:23:20.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.405+0000 7f54539d3640 0 -- 172.21.15.67:0/2391021760 >> [v2:172.21.15.118:6824/1070975205,v1:172.21.15.118:6825/1070975205] conn(0x7f54480b1070 msgr2=0x7f5448056a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:20.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.611+0000 7f54531d2640 0 -- 172.21.15.67:0/2391021760 >> [v2:172.21.15.118:6808/1825660705,v1:172.21.15.118:6809/1825660705] conn(0x5587674254d0 msgr2=0x558767427990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:20.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.613+0000 7f5457524800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:20.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.613+0000 7f5457524800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:20.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.613+0000 7f5457524800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:20.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.613+0000 7f5457524800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:20.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.613+0000 7f5457524800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:20.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.613+0000 7f5457524800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:20.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.613+0000 7f5457524800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.614+0000 7f5457524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.614+0000 7f5457524800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.614+0000 7f5457524800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:20.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.614+0000 7f5457524800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.614+0000 7f5457524800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:20.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.614+0000 7f5457524800 20 zone default found 2024-09-12T17:23:20.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.614+0000 7f5457524800 4 Realm: () 2024-09-12T17:23:20.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.614+0000 7f5457524800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:20.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.614+0000 7f5457524800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:20.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.614+0000 7f5457524800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:20.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.614+0000 7f5457524800 20 zonegroup default 2024-09-12T17:23:20.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.614+0000 7f5457524800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.615+0000 7f5457524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.615+0000 7f5457524800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.615+0000 7f5457524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.615+0000 7f5457524800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.615+0000 7f5457524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.615+0000 7f5457524800 20 started sync module instance, tier type = 2024-09-12T17:23:20.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.615+0000 7f5457524800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:20.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.625+0000 7f5457524800 20 add_watcher() i=0 2024-09-12T17:23:20.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.625+0000 7f5457524800 20 add_watcher() i=1 2024-09-12T17:23:20.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.625+0000 7f5457524800 20 add_watcher() i=2 2024-09-12T17:23:20.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.625+0000 7f5457524800 20 add_watcher() i=3 2024-09-12T17:23:20.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.625+0000 7f5457524800 20 add_watcher() i=4 2024-09-12T17:23:20.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.625+0000 7f5457524800 20 add_watcher() i=5 2024-09-12T17:23:20.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.625+0000 7f5457524800 20 add_watcher() i=6 2024-09-12T17:23:20.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.626+0000 7f5457524800 20 add_watcher() i=7 2024-09-12T17:23:20.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.626+0000 7f5457524800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:20.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.628+0000 7f530a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:20.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.628+0000 7f5457524800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:20.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.628+0000 7f5457524800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:20.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.628+0000 7f5457524800 5 note: GC not initialized 2024-09-12T17:23:20.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.628+0000 7f53097e2640 20 reqs_thread_entry: start 2024-09-12T17:23:20.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.629+0000 7f5457524800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:20.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.629+0000 7f5457524800 20 Filter name: none 2024-09-12T17:23:20.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.629+0000 7f53027fc640 20 reqs_thread_entry: start 2024-09-12T17:23:20.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.629+0000 7f5457524800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.629+0000 7f5457524800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:23:20.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.629+0000 7f5457524800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.630+0000 7f5457524800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:23:20.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.630+0000 7f5457524800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:20.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.630+0000 7f5457524800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.630+0000 7f5457524800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:23:20.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.630+0000 7f5457524800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.630+0000 7f5457524800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:23:20.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.630+0000 7f5457524800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:20.634 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.632+0000 7f530a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:20.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.634+0000 7f5457524800 20 remove_watcher() i=0 2024-09-12T17:23:20.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.634+0000 7f5457524800 2 removed watcher, disabling cache 2024-09-12T17:23:20.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.636+0000 7f5457524800 20 remove_watcher() i=1 2024-09-12T17:23:20.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.637+0000 7f5457524800 20 remove_watcher() i=2 2024-09-12T17:23:20.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.638+0000 7f5457524800 20 remove_watcher() i=3 2024-09-12T17:23:20.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.639+0000 7f5457524800 20 remove_watcher() i=4 2024-09-12T17:23:20.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.639+0000 7f5457524800 20 remove_watcher() i=5 2024-09-12T17:23:20.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.640+0000 7f5457524800 20 remove_watcher() i=6 2024-09-12T17:23:20.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.641+0000 7f5457524800 20 remove_watcher() i=7 2024-09-12T17:23:20.654 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.655 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:23:20.655 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-init-indext id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:23:20.655 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:20.656 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:20.656 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:20.689 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:20.689 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:20.747 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:23:20.781 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:20.781 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:20.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.819+0000 7fc920921800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.820+0000 7fc920921800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.820+0000 7fc920921800 20 realm 2024-09-12T17:23:20.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.820+0000 7fc920921800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.820+0000 7fc920921800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.820+0000 7fc920921800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:20.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.820+0000 7fc920921800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.820+0000 7fc920921800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.820+0000 7fc920921800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.821+0000 7fc920921800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:20.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.821+0000 7fc920921800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.822+0000 7fc920921800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:20.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.822+0000 7fc920921800 20 searching for the correct realm 2024-09-12T17:23:20.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.826+0000 7fc91cd57640 0 -- 172.21.15.67:0/1598214295 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x55acef03ad00 msgr2=0x55acef03d1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:20.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.829+0000 7fc91c556640 0 -- 172.21.15.67:0/1598214295 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fc910030040 msgr2=0x7fc91000b930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:20.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.834+0000 7fc920921800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:20.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.834+0000 7fc920921800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:20.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.834+0000 7fc920921800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:20.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.834+0000 7fc920921800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:20.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.834+0000 7fc920921800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:20.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.834+0000 7fc920921800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:20.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.834+0000 7fc920921800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.834+0000 7fc920921800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.834+0000 7fc920921800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.834+0000 7fc920921800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:20.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.834+0000 7fc920921800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.834+0000 7fc920921800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:20.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.835+0000 7fc920921800 20 zone default found 2024-09-12T17:23:20.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.835+0000 7fc920921800 4 Realm: () 2024-09-12T17:23:20.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.835+0000 7fc920921800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:20.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.835+0000 7fc920921800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:20.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.835+0000 7fc920921800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:20.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.835+0000 7fc920921800 20 zonegroup default 2024-09-12T17:23:20.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.835+0000 7fc920921800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.835+0000 7fc920921800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.835+0000 7fc920921800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.835+0000 7fc920921800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.835+0000 7fc920921800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.835+0000 7fc920921800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.835+0000 7fc920921800 20 started sync module instance, tier type = 2024-09-12T17:23:20.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.835+0000 7fc920921800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:20.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.844+0000 7fc920921800 20 add_watcher() i=0 2024-09-12T17:23:20.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.844+0000 7fc920921800 20 add_watcher() i=1 2024-09-12T17:23:20.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.844+0000 7fc920921800 20 add_watcher() i=2 2024-09-12T17:23:20.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.844+0000 7fc920921800 20 add_watcher() i=3 2024-09-12T17:23:20.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.844+0000 7fc920921800 20 add_watcher() i=4 2024-09-12T17:23:20.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.844+0000 7fc920921800 20 add_watcher() i=5 2024-09-12T17:23:20.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.844+0000 7fc920921800 20 add_watcher() i=6 2024-09-12T17:23:20.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.845+0000 7fc920921800 20 add_watcher() i=7 2024-09-12T17:23:20.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.845+0000 7fc920921800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:20.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.847+0000 7fc7d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:20.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.847+0000 7fc920921800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:20.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.847+0000 7fc920921800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:20.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.847+0000 7fc920921800 5 note: GC not initialized 2024-09-12T17:23:20.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.848+0000 7fc7d1fdb640 20 reqs_thread_entry: start 2024-09-12T17:23:20.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.848+0000 7fc920921800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:20.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.848+0000 7fc920921800 20 Filter name: none 2024-09-12T17:23:20.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.848+0000 7fc7437fe640 20 reqs_thread_entry: start 2024-09-12T17:23:20.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.848+0000 7fc920921800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:23:20.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.848+0000 7fc920921800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.848+0000 7fc920921800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:23:20.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.848+0000 7fc920921800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:23:20.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.848+0000 7fc920921800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:23:20.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.848+0000 7fc920921800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 : miss 2024-09-12T17:23:20.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.848+0000 7fc920921800 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.849+0000 7fc920921800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:23:20.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.849+0000 7fc920921800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 info.flags=0x17 2024-09-12T17:23:20.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.849+0000 7fc920921800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 to cache LRU end 2024-09-12T17:23:20.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.849+0000 7fc920921800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:20.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.849+0000 7fc920921800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:20.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.849+0000 7fc920921800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 2024-09-12T17:23:20.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.850+0000 7fc920921800 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 to be held by another RGW process; skipping for now 2024-09-12T17:23:20.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.851+0000 7fc7d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:20.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.853+0000 7fc920921800 20 remove_watcher() i=0 2024-09-12T17:23:20.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.853+0000 7fc920921800 2 removed watcher, disabling cache 2024-09-12T17:23:20.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.854+0000 7fc920921800 20 remove_watcher() i=1 2024-09-12T17:23:20.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.855+0000 7fc920921800 20 remove_watcher() i=2 2024-09-12T17:23:20.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.856+0000 7fc920921800 20 remove_watcher() i=3 2024-09-12T17:23:20.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.857+0000 7fc920921800 20 remove_watcher() i=4 2024-09-12T17:23:20.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.858+0000 7fc920921800 20 remove_watcher() i=5 2024-09-12T17:23:20.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.859+0000 7fc920921800 20 remove_watcher() i=6 2024-09-12T17:23:20.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:20.860+0000 7fc920921800 20 remove_watcher() i=7 2024-09-12T17:23:20.873 INFO:tasks.workunit.client.0.smithi067.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:23:50.895 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:23:50.932 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:50.932 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:50.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:50.976+0000 7f8cceebb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:50.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:50.978+0000 7f8cceebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:50.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:50.978+0000 7f8cceebb800 20 realm 2024-09-12T17:23:50.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:50.978+0000 7f8cceebb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:50.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:50.978+0000 7f8cceebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:50.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:50.978+0000 7f8cceebb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:50.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:50.978+0000 7f8cceebb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:50.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:50.978+0000 7f8cceebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:50.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:50.978+0000 7f8cceebb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:50.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:50.980+0000 7f8cceebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:50.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:50.980+0000 7f8cceebb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:50.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:50.981+0000 7f8cceebb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:50.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:50.981+0000 7f8cceebb800 20 searching for the correct realm 2024-09-12T17:23:50.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:50.983+0000 7f8ccc1a4640 0 -- 172.21.15.67:0/3687990820 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x559ba3bc03c0 msgr2=0x559ba3bc27b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:50.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:50.987+0000 7f8ccc9a5640 0 -- 172.21.15.67:0/3687990820 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f8cc006fbe0 msgr2=0x7f8cc0069ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:51.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.194+0000 7f8cceebb800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:51.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.194+0000 7f8cceebb800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:51.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.194+0000 7f8cceebb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:51.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.194+0000 7f8cceebb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:51.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.194+0000 7f8cceebb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:51.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.194+0000 7f8cceebb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:51.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.194+0000 7f8cceebb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.194+0000 7f8cceebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.194+0000 7f8cceebb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.195+0000 7f8cceebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:51.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.195+0000 7f8cceebb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.195+0000 7f8cceebb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:51.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.195+0000 7f8cceebb800 20 zone default found 2024-09-12T17:23:51.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.195+0000 7f8cceebb800 4 Realm: () 2024-09-12T17:23:51.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.195+0000 7f8cceebb800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:51.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.195+0000 7f8cceebb800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:51.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.195+0000 7f8cceebb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:51.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.195+0000 7f8cceebb800 20 zonegroup default 2024-09-12T17:23:51.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.195+0000 7f8cceebb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.196+0000 7f8cceebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.196+0000 7f8cceebb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.196+0000 7f8cceebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.196+0000 7f8cceebb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.196+0000 7f8cceebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.196+0000 7f8cceebb800 20 started sync module instance, tier type = 2024-09-12T17:23:51.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.196+0000 7f8cceebb800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:51.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.207+0000 7f8cceebb800 20 add_watcher() i=0 2024-09-12T17:23:51.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.207+0000 7f8cceebb800 20 add_watcher() i=1 2024-09-12T17:23:51.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.207+0000 7f8cceebb800 20 add_watcher() i=2 2024-09-12T17:23:51.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.207+0000 7f8cceebb800 20 add_watcher() i=3 2024-09-12T17:23:51.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.207+0000 7f8cceebb800 20 add_watcher() i=4 2024-09-12T17:23:51.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.207+0000 7f8cceebb800 20 add_watcher() i=5 2024-09-12T17:23:51.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.207+0000 7f8cceebb800 20 add_watcher() i=6 2024-09-12T17:23:51.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.208+0000 7f8cceebb800 20 add_watcher() i=7 2024-09-12T17:23:51.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.208+0000 7f8cceebb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:51.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.210+0000 7f8b837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:51.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.210+0000 7f8cceebb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:51.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.210+0000 7f8cceebb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:51.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.210+0000 7f8cceebb800 5 note: GC not initialized 2024-09-12T17:23:51.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.210+0000 7f8b827e4640 20 reqs_thread_entry: start 2024-09-12T17:23:51.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.210+0000 7f8cceebb800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:51.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.211+0000 7f8cceebb800 20 Filter name: none 2024-09-12T17:23:51.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.211+0000 7f8b7b7fe640 20 reqs_thread_entry: start 2024-09-12T17:23:51.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.211+0000 7f8cceebb800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:23:51.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.211+0000 7f8cceebb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.211+0000 7f8cceebb800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:23:51.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.211+0000 7f8cceebb800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:23:51.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.211+0000 7f8cceebb800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:23:51.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.211+0000 7f8cceebb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 : miss 2024-09-12T17:23:51.214 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.211+0000 7f8cceebb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.214 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.212+0000 7f8cceebb800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:23:51.214 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.212+0000 7f8cceebb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 info.flags=0x17 2024-09-12T17:23:51.214 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.212+0000 7f8cceebb800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 to cache LRU end 2024-09-12T17:23:51.214 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.212+0000 7f8cceebb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:51.214 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.212+0000 7f8cceebb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:51.214 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.212+0000 7f8cceebb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 2024-09-12T17:23:51.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.216+0000 7f8cceebb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 info.flags=0x17 2024-09-12T17:23:51.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.216+0000 7f8cceebb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 to cache LRU end 2024-09-12T17:23:51.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.216+0000 7f8cceebb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:51.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.216+0000 7f8cceebb800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22, ofs0, ns] 2024-09-12T17:23:51.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.216+0000 7f8ba3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464287 cookie 94126955339376 notifier 6107 bl.length()=997 2024-09-12T17:23:51.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.216+0000 7f8ba3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 info.flags=0x17 2024-09-12T17:23:51.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.216+0000 7f8ba3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 to cache LRU end 2024-09-12T17:23:51.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.216+0000 7f8ba3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:51.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.218+0000 7f8cceebb800 20 handle_bi_update(): bucket=:abort-at-init-indext[06eb12d0-49d6-461d-9efe-05d212954deb.4538.22]): orig_sources= new_sources= 2024-09-12T17:23:51.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.218+0000 7f8cceebb800 20 handle_bi_update(): bucket=:abort-at-init-indext[06eb12d0-49d6-461d-9efe-05d212954deb.4538.22]): potential sources added=[] removed=[] 2024-09-12T17:23:51.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.218+0000 7f8cceebb800 20 handle_bi_update(): bucket=:abort-at-init-indext[06eb12d0-49d6-461d-9efe-05d212954deb.4538.22]): orig_dests= new_dests= 2024-09-12T17:23:51.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.218+0000 7f8cceebb800 20 handle_bi_update(): bucket=:abort-at-init-indext[06eb12d0-49d6-461d-9efe-05d212954deb.4538.22]): potential dests added=[] removed=[] 2024-09-12T17:23:51.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.221+0000 7f8cceebb800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.22.1.0 2024-09-12T17:23:51.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.221+0000 7f8cceebb800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.22.1.0 2024-09-12T17:23:51.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.221+0000 7f8cceebb800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.22.1.1 2024-09-12T17:23:51.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.221+0000 7f8cceebb800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.22.1.1 2024-09-12T17:23:51.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.221+0000 7f8cceebb800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.22.0 2024-09-12T17:23:51.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.224+0000 7f8cceebb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 : hit (requested=0x17, cached=0x17) 2024-09-12T17:23:51.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.224+0000 7f8cceebb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 2024-09-12T17:23:51.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.226+0000 7f8cceebb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 info.flags=0x17 2024-09-12T17:23:51.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.226+0000 7f8cceebb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 to cache LRU end 2024-09-12T17:23:51.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.226+0000 7f8cceebb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:51.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.226+0000 7f8cceebb800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22, ofs0, ns] 2024-09-12T17:23:51.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.226+0000 7f8ba3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464288 cookie 94126955339376 notifier 6107 bl.length()=997 2024-09-12T17:23:51.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.226+0000 7f8ba3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 info.flags=0x17 2024-09-12T17:23:51.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.226+0000 7f8ba3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 to cache LRU end 2024-09-12T17:23:51.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.226+0000 7f8ba3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:51.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.227+0000 7f8cceebb800 20 handle_bi_update(): bucket=:abort-at-init-indext[06eb12d0-49d6-461d-9efe-05d212954deb.4538.22]): orig_sources= new_sources= 2024-09-12T17:23:51.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.227+0000 7f8cceebb800 20 handle_bi_update(): bucket=:abort-at-init-indext[06eb12d0-49d6-461d-9efe-05d212954deb.4538.22]): potential sources added=[] removed=[] 2024-09-12T17:23:51.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.227+0000 7f8cceebb800 20 handle_bi_update(): bucket=:abort-at-init-indext[06eb12d0-49d6-461d-9efe-05d212954deb.4538.22]): orig_dests= new_dests= 2024-09-12T17:23:51.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.227+0000 7f8cceebb800 20 handle_bi_update(): bucket=:abort-at-init-indext[06eb12d0-49d6-461d-9efe-05d212954deb.4538.22]): potential dests added=[] removed=[] 2024-09-12T17:23:51.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.229+0000 7f8cceebb800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.22.0 2024-09-12T17:23:51.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.229+0000 7f8cceebb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 : hit (requested=0x17, cached=0x17) 2024-09-12T17:23:51.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.229+0000 7f8cceebb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 2024-09-12T17:23:51.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.230+0000 7f8cceebb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 info.flags=0x17 2024-09-12T17:23:51.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.230+0000 7f8cceebb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 to cache LRU end 2024-09-12T17:23:51.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.230+0000 7f8cceebb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:51.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.230+0000 7f8cceebb800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22, ofs0, ns] 2024-09-12T17:23:51.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.231+0000 7f8ba37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464289 cookie 94126955339376 notifier 6107 bl.length()=965 2024-09-12T17:23:51.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.231+0000 7f8ba37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 info.flags=0x17 2024-09-12T17:23:51.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.231+0000 7f8ba37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 to cache LRU end 2024-09-12T17:23:51.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.231+0000 7f8ba37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:51.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.232+0000 7f8cceebb800 20 handle_bi_update(): bucket=:abort-at-init-indext[06eb12d0-49d6-461d-9efe-05d212954deb.4538.22]): orig_sources= new_sources= 2024-09-12T17:23:51.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.232+0000 7f8cceebb800 20 handle_bi_update(): bucket=:abort-at-init-indext[06eb12d0-49d6-461d-9efe-05d212954deb.4538.22]): potential sources added=[] removed=[] 2024-09-12T17:23:51.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.232+0000 7f8cceebb800 20 handle_bi_update(): bucket=:abort-at-init-indext[06eb12d0-49d6-461d-9efe-05d212954deb.4538.22]): orig_dests= new_dests= 2024-09-12T17:23:51.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.232+0000 7f8cceebb800 20 handle_bi_update(): bucket=:abort-at-init-indext[06eb12d0-49d6-461d-9efe-05d212954deb.4538.22]): potential dests added=[] removed=[] 2024-09-12T17:23:51.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.234+0000 7f8cceebb800 1 execute INFO: reshard of bucket "abort-at-init-indext" from 1 shards to 2 shards completed successfully 2024-09-12T17:23:51.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.236+0000 7f8b837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:51.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.238+0000 7f8cceebb800 20 remove_watcher() i=0 2024-09-12T17:23:51.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.238+0000 7f8cceebb800 2 removed watcher, disabling cache 2024-09-12T17:23:51.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.239+0000 7f8cceebb800 20 remove_watcher() i=1 2024-09-12T17:23:51.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.240+0000 7f8cceebb800 20 remove_watcher() i=2 2024-09-12T17:23:51.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.242+0000 7f8cceebb800 20 remove_watcher() i=3 2024-09-12T17:23:51.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.243+0000 7f8cceebb800 20 remove_watcher() i=4 2024-09-12T17:23:51.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.244+0000 7f8cceebb800 20 remove_watcher() i=5 2024-09-12T17:23:51.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.245+0000 7f8cceebb800 20 remove_watcher() i=6 2024-09-12T17:23:51.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.246+0000 7f8cceebb800 20 remove_watcher() i=7 2024-09-12T17:23:51.260 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:23:51.291 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:51.291 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:51.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.329+0000 7f9c72f25800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.331+0000 7f9c72f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.331+0000 7f9c72f25800 20 realm 2024-09-12T17:23:51.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.331+0000 7f9c72f25800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.331+0000 7f9c72f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.331+0000 7f9c72f25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:51.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.331+0000 7f9c72f25800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.331+0000 7f9c72f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.331+0000 7f9c72f25800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.332+0000 7f9c72f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:51.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.332+0000 7f9c72f25800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.333+0000 7f9c72f25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:51.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.333+0000 7f9c72f25800 20 searching for the correct realm 2024-09-12T17:23:51.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.336+0000 7f9c6f3af640 0 -- 172.21.15.67:0/1995634743 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x5648ebd1adc0 msgr2=0x5648ebd1d230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:51.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.340+0000 7f9c6e3ad640 0 -- 172.21.15.67:0/1995634743 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x5648ebd228c0 msgr2=0x5648ebd24cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:51.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.344+0000 7f9c72f25800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:51.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.344+0000 7f9c72f25800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:51.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.344+0000 7f9c72f25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:51.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.344+0000 7f9c72f25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:51.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.344+0000 7f9c72f25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:51.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.344+0000 7f9c72f25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:51.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.344+0000 7f9c72f25800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.344+0000 7f9c72f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.344+0000 7f9c72f25800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.344+0000 7f9c72f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:51.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.344+0000 7f9c72f25800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.345+0000 7f9c72f25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:51.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.345+0000 7f9c72f25800 20 zone default found 2024-09-12T17:23:51.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.345+0000 7f9c72f25800 4 Realm: () 2024-09-12T17:23:51.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.345+0000 7f9c72f25800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:51.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.345+0000 7f9c72f25800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:51.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.345+0000 7f9c72f25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:51.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.345+0000 7f9c72f25800 20 zonegroup default 2024-09-12T17:23:51.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.345+0000 7f9c72f25800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.345+0000 7f9c72f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.345+0000 7f9c72f25800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.345+0000 7f9c72f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.345+0000 7f9c72f25800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.345+0000 7f9c72f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.345+0000 7f9c72f25800 20 started sync module instance, tier type = 2024-09-12T17:23:51.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.345+0000 7f9c72f25800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:51.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.355+0000 7f9c72f25800 20 add_watcher() i=0 2024-09-12T17:23:51.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.355+0000 7f9c72f25800 20 add_watcher() i=1 2024-09-12T17:23:51.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.355+0000 7f9c72f25800 20 add_watcher() i=2 2024-09-12T17:23:51.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.355+0000 7f9c72f25800 20 add_watcher() i=3 2024-09-12T17:23:51.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.355+0000 7f9c72f25800 20 add_watcher() i=4 2024-09-12T17:23:51.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.355+0000 7f9c72f25800 20 add_watcher() i=5 2024-09-12T17:23:51.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.355+0000 7f9c72f25800 20 add_watcher() i=6 2024-09-12T17:23:51.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.356+0000 7f9c72f25800 20 add_watcher() i=7 2024-09-12T17:23:51.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.356+0000 7f9c72f25800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:51.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.357+0000 7f9b257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:51.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.357+0000 7f9c72f25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:51.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.357+0000 7f9c72f25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:51.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.357+0000 7f9c72f25800 5 note: GC not initialized 2024-09-12T17:23:51.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.358+0000 7f9a9ffff640 20 reqs_thread_entry: start 2024-09-12T17:23:51.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.358+0000 7f9c72f25800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:51.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.358+0000 7f9c72f25800 20 Filter name: none 2024-09-12T17:23:51.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.358+0000 7f9a9dffb640 20 reqs_thread_entry: start 2024-09-12T17:23:51.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.358+0000 7f9c72f25800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.358+0000 7f9c72f25800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:23:51.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.358+0000 7f9c72f25800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.359+0000 7f9c72f25800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:23:51.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.359+0000 7f9c72f25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:51.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.359+0000 7f9c72f25800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.360+0000 7f9c72f25800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:23:51.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.360+0000 7f9c72f25800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.360+0000 7f9c72f25800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:23:51.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.360+0000 7f9c72f25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:51.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.362+0000 7f9b257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:51.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.364+0000 7f9c72f25800 20 remove_watcher() i=0 2024-09-12T17:23:51.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.364+0000 7f9c72f25800 2 removed watcher, disabling cache 2024-09-12T17:23:51.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.365+0000 7f9c72f25800 20 remove_watcher() i=1 2024-09-12T17:23:51.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.366+0000 7f9c72f25800 20 remove_watcher() i=2 2024-09-12T17:23:51.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.367+0000 7f9c72f25800 20 remove_watcher() i=3 2024-09-12T17:23:51.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.368+0000 7f9c72f25800 20 remove_watcher() i=4 2024-09-12T17:23:51.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.369+0000 7f9c72f25800 20 remove_watcher() i=5 2024-09-12T17:23:51.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.370+0000 7f9c72f25800 20 remove_watcher() i=6 2024-09-12T17:23:51.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:51.371+0000 7f9c72f25800 20 remove_watcher() i=7 2024-09-12T17:23:51.383 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:51.383 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:23:51.383 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-init-indext id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.22 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:23:51.383 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:51.385 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:51.385 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:51.406 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:51.406 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:51.625 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:51.625 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:51.689 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-12T17:23:51.689 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:51.691 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:51.691 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:51.733 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:51.733 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:51.790 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:51.790 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:51.827 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:51.828 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:51.865 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:51.865 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:51.901 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:51.901 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:51.937 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:51.937 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:51.975 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:51.975 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:52.010 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:52.010 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:52.046 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:52.046 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:52.082 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:52.082 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:52.118 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:52.118 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:52.154 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:52.154 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:52.190 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:52.190 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:52.225 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:52.226 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:52.264 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:52.264 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:52.300 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:52.300 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:52.337 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:52.337 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:52.373 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:52.373 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:52.409 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:52.409 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:52.445 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:52.445 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:52.482 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:52.482 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:52.518 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:23:52.547 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:52.547 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:52.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.584+0000 7f95fc52e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.586+0000 7f95fc52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.586+0000 7f95fc52e800 20 realm 2024-09-12T17:23:52.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.586+0000 7f95fc52e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.587+0000 7f95fc52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.587+0000 7f95fc52e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:52.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.587+0000 7f95fc52e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.587+0000 7f95fc52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.587+0000 7f95fc52e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.588+0000 7f95fc52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:52.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.588+0000 7f95fc52e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.588+0000 7f95fc52e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:52.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.588+0000 7f95fc52e800 20 searching for the correct realm 2024-09-12T17:23:52.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.591+0000 7f95f82b0640 0 -- 172.21.15.67:0/3356396773 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f95f0072040 msgr2=0x7f95f0055920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:52.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.594+0000 7f95f82b0640 0 -- 172.21.15.67:0/3356396773 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f95e001f070 msgr2=0x7f95e0052040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:52.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.800+0000 7f95fc52e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:52.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.800+0000 7f95fc52e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:52.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.800+0000 7f95fc52e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:52.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.800+0000 7f95fc52e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:52.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.800+0000 7f95fc52e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:52.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.800+0000 7f95fc52e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:52.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.800+0000 7f95fc52e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.800+0000 7f95fc52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.800+0000 7f95fc52e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.801+0000 7f95fc52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:52.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.801+0000 7f95fc52e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.801+0000 7f95fc52e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:52.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.801+0000 7f95fc52e800 20 zone default found 2024-09-12T17:23:52.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.801+0000 7f95fc52e800 4 Realm: () 2024-09-12T17:23:52.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.801+0000 7f95fc52e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:52.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.801+0000 7f95fc52e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:52.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.801+0000 7f95fc52e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:52.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.801+0000 7f95fc52e800 20 zonegroup default 2024-09-12T17:23:52.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.801+0000 7f95fc52e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.801+0000 7f95fc52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.801+0000 7f95fc52e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.802+0000 7f95fc52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.802+0000 7f95fc52e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.802+0000 7f95fc52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.802+0000 7f95fc52e800 20 started sync module instance, tier type = 2024-09-12T17:23:52.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.802+0000 7f95fc52e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:52.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.811+0000 7f95fc52e800 20 add_watcher() i=0 2024-09-12T17:23:52.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.811+0000 7f95fc52e800 20 add_watcher() i=1 2024-09-12T17:23:52.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.811+0000 7f95fc52e800 20 add_watcher() i=2 2024-09-12T17:23:52.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.811+0000 7f95fc52e800 20 add_watcher() i=3 2024-09-12T17:23:52.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.811+0000 7f95fc52e800 20 add_watcher() i=4 2024-09-12T17:23:52.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.811+0000 7f95fc52e800 20 add_watcher() i=5 2024-09-12T17:23:52.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.811+0000 7f95fc52e800 20 add_watcher() i=6 2024-09-12T17:23:52.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.812+0000 7f95fc52e800 20 add_watcher() i=7 2024-09-12T17:23:52.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.812+0000 7f95fc52e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:52.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.814+0000 7f94aefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:52.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.814+0000 7f95fc52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:52.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.814+0000 7f95fc52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:52.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.814+0000 7f95fc52e800 5 note: GC not initialized 2024-09-12T17:23:52.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.814+0000 7f94adfdb640 20 reqs_thread_entry: start 2024-09-12T17:23:52.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.814+0000 7f95fc52e800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:52.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.814+0000 7f95fc52e800 20 Filter name: none 2024-09-12T17:23:52.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.815+0000 7f941f7fe640 20 reqs_thread_entry: start 2024-09-12T17:23:52.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.815+0000 7f95fc52e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.815+0000 7f95fc52e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:23:52.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.815+0000 7f95fc52e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.816+0000 7f95fc52e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:23:52.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.816+0000 7f95fc52e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:52.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.816+0000 7f95fc52e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.816+0000 7f95fc52e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:23:52.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.816+0000 7f95fc52e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.816+0000 7f95fc52e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:23:52.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.816+0000 7f95fc52e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:52.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.818+0000 7f94aefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:52.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.820+0000 7f95fc52e800 20 remove_watcher() i=0 2024-09-12T17:23:52.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.820+0000 7f95fc52e800 2 removed watcher, disabling cache 2024-09-12T17:23:52.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.821+0000 7f95fc52e800 20 remove_watcher() i=1 2024-09-12T17:23:52.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.822+0000 7f95fc52e800 20 remove_watcher() i=2 2024-09-12T17:23:52.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.823+0000 7f95fc52e800 20 remove_watcher() i=3 2024-09-12T17:23:52.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.824+0000 7f95fc52e800 20 remove_watcher() i=4 2024-09-12T17:23:52.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.825+0000 7f95fc52e800 20 remove_watcher() i=5 2024-09-12T17:23:52.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.826+0000 7f95fc52e800 20 remove_watcher() i=6 2024-09-12T17:23:52.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.827+0000 7f95fc52e800 20 remove_watcher() i=7 2024-09-12T17:23:52.839 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:52.839 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:23:52.839 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-set-target-layout id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:23:52.839 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:52.840 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-12T17:23:52.875 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:52.876 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:52.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.913+0000 7fb1dbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.915+0000 7fb1dbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.915+0000 7fb1dbc0e800 20 realm 2024-09-12T17:23:52.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.915+0000 7fb1dbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.915+0000 7fb1dbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.915+0000 7fb1dbc0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:52.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.915+0000 7fb1dbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.915+0000 7fb1dbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.915+0000 7fb1dbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.916+0000 7fb1dbc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:52.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.916+0000 7fb1dbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.917+0000 7fb1dbc0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:52.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.917+0000 7fb1dbc0e800 20 searching for the correct realm 2024-09-12T17:23:52.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.919+0000 7fb1d6a58640 0 -- 172.21.15.67:0/1139249440 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7fb1c808c030 msgr2=0x7fb1c808c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:52.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:52.923+0000 7fb1d7259640 0 -- 172.21.15.67:0/1139249440 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fb1c006a8e0 msgr2=0x7fb1c006c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:53.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.128+0000 7fb1dbc0e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:53.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.128+0000 7fb1dbc0e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:53.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.128+0000 7fb1dbc0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:53.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.128+0000 7fb1dbc0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:53.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.128+0000 7fb1dbc0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:53.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.128+0000 7fb1dbc0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:53.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.128+0000 7fb1dbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.128+0000 7fb1dbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:53.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.128+0000 7fb1dbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.129+0000 7fb1dbc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:53.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.129+0000 7fb1dbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.129+0000 7fb1dbc0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:53.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.129+0000 7fb1dbc0e800 20 zone default found 2024-09-12T17:23:53.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.129+0000 7fb1dbc0e800 4 Realm: () 2024-09-12T17:23:53.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.129+0000 7fb1dbc0e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:53.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.129+0000 7fb1dbc0e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:53.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.129+0000 7fb1dbc0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:53.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.129+0000 7fb1dbc0e800 20 zonegroup default 2024-09-12T17:23:53.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.129+0000 7fb1dbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.129+0000 7fb1dbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:53.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.129+0000 7fb1dbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.130+0000 7fb1dbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:53.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.130+0000 7fb1dbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.130+0000 7fb1dbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:53.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.130+0000 7fb1dbc0e800 20 started sync module instance, tier type = 2024-09-12T17:23:53.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.130+0000 7fb1dbc0e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:53.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.140+0000 7fb1dbc0e800 20 add_watcher() i=0 2024-09-12T17:23:53.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.140+0000 7fb1dbc0e800 20 add_watcher() i=1 2024-09-12T17:23:53.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.140+0000 7fb1dbc0e800 20 add_watcher() i=2 2024-09-12T17:23:53.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.140+0000 7fb1dbc0e800 20 add_watcher() i=3 2024-09-12T17:23:53.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.140+0000 7fb1dbc0e800 20 add_watcher() i=4 2024-09-12T17:23:53.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.140+0000 7fb1dbc0e800 20 add_watcher() i=5 2024-09-12T17:23:53.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.140+0000 7fb1dbc0e800 20 add_watcher() i=6 2024-09-12T17:23:53.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.141+0000 7fb1dbc0e800 20 add_watcher() i=7 2024-09-12T17:23:53.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.141+0000 7fb1dbc0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:53.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.142+0000 7fb08dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:53.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.143+0000 7fb1dbc0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:53.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.143+0000 7fb1dbc0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:53.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.143+0000 7fb1dbc0e800 5 note: GC not initialized 2024-09-12T17:23:53.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.143+0000 7fb08cfe1640 20 reqs_thread_entry: start 2024-09-12T17:23:53.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.143+0000 7fb1dbc0e800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:53.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.143+0000 7fb1dbc0e800 20 Filter name: none 2024-09-12T17:23:53.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.143+0000 7fb0067fc640 20 reqs_thread_entry: start 2024-09-12T17:23:53.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.143+0000 7fb1dbc0e800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:23:53.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.143+0000 7fb1dbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.144+0000 7fb1dbc0e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:23:53.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.144+0000 7fb1dbc0e800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:23:53.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.144+0000 7fb1dbc0e800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:23:53.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.144+0000 7fb1dbc0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 : miss 2024-09-12T17:23:53.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.144+0000 7fb1dbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.144+0000 7fb1dbc0e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:23:53.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.144+0000 7fb1dbc0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 info.flags=0x17 2024-09-12T17:23:53.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.144+0000 7fb1dbc0e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 to cache LRU end 2024-09-12T17:23:53.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.144+0000 7fb1dbc0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:53.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.144+0000 7fb1dbc0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:53.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.144+0000 7fb1dbc0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 2024-09-12T17:23:53.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.147+0000 7fb1dbc0e800 -1 Injecting error=-5 at location=set_target_layout 2024-09-12T17:23:53.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.147+0000 7fb1dbc0e800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-12T17:23:53.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.150+0000 7fb08dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:53.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.152+0000 7fb1dbc0e800 20 remove_watcher() i=0 2024-09-12T17:23:53.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.152+0000 7fb1dbc0e800 2 removed watcher, disabling cache 2024-09-12T17:23:53.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.153+0000 7fb1dbc0e800 20 remove_watcher() i=1 2024-09-12T17:23:53.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.154+0000 7fb1dbc0e800 20 remove_watcher() i=2 2024-09-12T17:23:53.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.156+0000 7fb1dbc0e800 20 remove_watcher() i=3 2024-09-12T17:23:53.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.156+0000 7fb1dbc0e800 20 remove_watcher() i=4 2024-09-12T17:23:53.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.158+0000 7fb1dbc0e800 20 remove_watcher() i=5 2024-09-12T17:23:53.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.159+0000 7fb1dbc0e800 20 remove_watcher() i=6 2024-09-12T17:23:53.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.160+0000 7fb1dbc0e800 20 remove_watcher() i=7 2024-09-12T17:23:53.174 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:23:53.203 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:53.204 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:53.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.241+0000 7f4ae0232800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.243+0000 7f4ae0232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:53.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.243+0000 7f4ae0232800 20 realm 2024-09-12T17:23:53.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.243+0000 7f4ae0232800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.243+0000 7f4ae0232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:53.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.243+0000 7f4ae0232800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:53.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.243+0000 7f4ae0232800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.243+0000 7f4ae0232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:53.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.243+0000 7f4ae0232800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.244+0000 7f4ae0232800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:53.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.244+0000 7f4ae0232800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.245+0000 7f4ae0232800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:53.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.245+0000 7f4ae0232800 20 searching for the correct realm 2024-09-12T17:23:53.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.247+0000 7f4adadcb640 0 -- 172.21.15.67:0/120948454 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f4acc099940 msgr2=0x7f4acc060fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:53.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.453+0000 7f4adb5cc640 0 -- 172.21.15.67:0/120948454 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f4ad001a040 msgr2=0x7f4ad009da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:53.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.659+0000 7f4ae0232800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:53.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.659+0000 7f4ae0232800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:53.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.659+0000 7f4ae0232800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:53.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.659+0000 7f4ae0232800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:53.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.659+0000 7f4ae0232800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:53.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.659+0000 7f4ae0232800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:53.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.659+0000 7f4ae0232800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.660+0000 7f4ae0232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:53.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.660+0000 7f4ae0232800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.660+0000 7f4ae0232800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:53.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.660+0000 7f4ae0232800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.660+0000 7f4ae0232800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:53.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.660+0000 7f4ae0232800 20 zone default found 2024-09-12T17:23:53.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.660+0000 7f4ae0232800 4 Realm: () 2024-09-12T17:23:53.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.660+0000 7f4ae0232800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:53.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.660+0000 7f4ae0232800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:53.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.660+0000 7f4ae0232800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:53.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.660+0000 7f4ae0232800 20 zonegroup default 2024-09-12T17:23:53.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.660+0000 7f4ae0232800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.661+0000 7f4ae0232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:53.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.661+0000 7f4ae0232800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.661+0000 7f4ae0232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:53.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.661+0000 7f4ae0232800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.661+0000 7f4ae0232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:53.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.661+0000 7f4ae0232800 20 started sync module instance, tier type = 2024-09-12T17:23:53.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.661+0000 7f4ae0232800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:53.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.671+0000 7f4ae0232800 20 add_watcher() i=0 2024-09-12T17:23:53.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.671+0000 7f4ae0232800 20 add_watcher() i=1 2024-09-12T17:23:53.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.671+0000 7f4ae0232800 20 add_watcher() i=2 2024-09-12T17:23:53.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.671+0000 7f4ae0232800 20 add_watcher() i=3 2024-09-12T17:23:53.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.671+0000 7f4ae0232800 20 add_watcher() i=4 2024-09-12T17:23:53.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.671+0000 7f4ae0232800 20 add_watcher() i=5 2024-09-12T17:23:53.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.671+0000 7f4ae0232800 20 add_watcher() i=6 2024-09-12T17:23:53.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.672+0000 7f4ae0232800 20 add_watcher() i=7 2024-09-12T17:23:53.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.672+0000 7f4ae0232800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:53.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.674+0000 7f4991fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:53.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.674+0000 7f4ae0232800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:53.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.674+0000 7f4ae0232800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:53.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.674+0000 7f4ae0232800 5 note: GC not initialized 2024-09-12T17:23:53.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.674+0000 7f4990fe1640 20 reqs_thread_entry: start 2024-09-12T17:23:53.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.675+0000 7f4ae0232800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:53.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.675+0000 7f4ae0232800 20 Filter name: none 2024-09-12T17:23:53.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.675+0000 7f490a7fc640 20 reqs_thread_entry: start 2024-09-12T17:23:53.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.675+0000 7f4ae0232800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.675+0000 7f4ae0232800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:23:53.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.675+0000 7f4ae0232800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.676+0000 7f4ae0232800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:23:53.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.676+0000 7f4ae0232800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:53.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.676+0000 7f4ae0232800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.676+0000 7f4ae0232800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:23:53.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.676+0000 7f4ae0232800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.676+0000 7f4ae0232800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:23:53.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.676+0000 7f4ae0232800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:53.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.678+0000 7f4991fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:53.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.680+0000 7f4ae0232800 20 remove_watcher() i=0 2024-09-12T17:23:53.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.680+0000 7f4ae0232800 2 removed watcher, disabling cache 2024-09-12T17:23:53.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.681+0000 7f4ae0232800 20 remove_watcher() i=1 2024-09-12T17:23:53.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.682+0000 7f4ae0232800 20 remove_watcher() i=2 2024-09-12T17:23:53.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.683+0000 7f4ae0232800 20 remove_watcher() i=3 2024-09-12T17:23:53.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.684+0000 7f4ae0232800 20 remove_watcher() i=4 2024-09-12T17:23:53.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.685+0000 7f4ae0232800 20 remove_watcher() i=5 2024-09-12T17:23:53.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.686+0000 7f4ae0232800 20 remove_watcher() i=6 2024-09-12T17:23:53.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.687+0000 7f4ae0232800 20 remove_watcher() i=7 2024-09-12T17:23:53.699 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:53.699 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:23:53.699 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-set-target-layout id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:23:53.699 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:53.701 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:53.701 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:53.733 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:53.734 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:53.791 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:23:53.823 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:53.823 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:53.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.862+0000 7f3fb7575800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.863+0000 7f3fb7575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:53.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.863+0000 7f3fb7575800 20 realm 2024-09-12T17:23:53.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.863+0000 7f3fb7575800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.863+0000 7f3fb7575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:53.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.863+0000 7f3fb7575800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:53.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.863+0000 7f3fb7575800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.863+0000 7f3fb7575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:53.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.863+0000 7f3fb7575800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.864+0000 7f3fb7575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:53.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.864+0000 7f3fb7575800 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.865+0000 7f3fb7575800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:53.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.865+0000 7f3fb7575800 20 searching for the correct realm 2024-09-12T17:23:53.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.867+0000 7f3fb5066640 0 -- 172.21.15.67:0/1761839219 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f3fb0078070 msgr2=0x7f3fb0055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:23:53.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:53.871+0000 7f3fb5066640 0 -- 172.21.15.67:0/1761839219 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f3fac01f060 msgr2=0x7f3fac083970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:54.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.077+0000 7f3fb7575800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:54.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.077+0000 7f3fb7575800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:54.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.077+0000 7f3fb7575800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:54.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.077+0000 7f3fb7575800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:54.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.077+0000 7f3fb7575800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:54.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.077+0000 7f3fb7575800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:54.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.077+0000 7f3fb7575800 20 rados->read ofs=0 len=0 2024-09-12T17:23:54.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.077+0000 7f3fb7575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:54.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.077+0000 7f3fb7575800 20 rados->read ofs=0 len=0 2024-09-12T17:23:54.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.077+0000 7f3fb7575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:54.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.077+0000 7f3fb7575800 20 rados->read ofs=0 len=0 2024-09-12T17:23:54.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.078+0000 7f3fb7575800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:54.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.078+0000 7f3fb7575800 20 zone default found 2024-09-12T17:23:54.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.078+0000 7f3fb7575800 4 Realm: () 2024-09-12T17:23:54.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.078+0000 7f3fb7575800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:54.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.078+0000 7f3fb7575800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:54.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.078+0000 7f3fb7575800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:54.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.078+0000 7f3fb7575800 20 zonegroup default 2024-09-12T17:23:54.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.078+0000 7f3fb7575800 20 rados->read ofs=0 len=0 2024-09-12T17:23:54.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.078+0000 7f3fb7575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:54.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.078+0000 7f3fb7575800 20 rados->read ofs=0 len=0 2024-09-12T17:23:54.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.078+0000 7f3fb7575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:54.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.078+0000 7f3fb7575800 20 rados->read ofs=0 len=0 2024-09-12T17:23:54.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.078+0000 7f3fb7575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:54.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.078+0000 7f3fb7575800 20 started sync module instance, tier type = 2024-09-12T17:23:54.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.078+0000 7f3fb7575800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:54.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.088+0000 7f3fb7575800 20 add_watcher() i=0 2024-09-12T17:23:54.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.088+0000 7f3fb7575800 20 add_watcher() i=1 2024-09-12T17:23:54.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.088+0000 7f3fb7575800 20 add_watcher() i=2 2024-09-12T17:23:54.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.088+0000 7f3fb7575800 20 add_watcher() i=3 2024-09-12T17:23:54.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.088+0000 7f3fb7575800 20 add_watcher() i=4 2024-09-12T17:23:54.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.088+0000 7f3fb7575800 20 add_watcher() i=5 2024-09-12T17:23:54.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.088+0000 7f3fb7575800 20 add_watcher() i=6 2024-09-12T17:23:54.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.089+0000 7f3fb7575800 20 add_watcher() i=7 2024-09-12T17:23:54.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.089+0000 7f3fb7575800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:54.091 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.090+0000 7f3e6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:54.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.091+0000 7f3fb7575800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:54.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.091+0000 7f3fb7575800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:54.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.091+0000 7f3fb7575800 5 note: GC not initialized 2024-09-12T17:23:54.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.091+0000 7f3e6a7e4640 20 reqs_thread_entry: start 2024-09-12T17:23:54.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.091+0000 7f3fb7575800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:54.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.091+0000 7f3fb7575800 20 Filter name: none 2024-09-12T17:23:54.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.091+0000 7f3ddbfff640 20 reqs_thread_entry: start 2024-09-12T17:23:54.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.091+0000 7f3fb7575800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:23:54.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.091+0000 7f3fb7575800 20 rados->read ofs=0 len=0 2024-09-12T17:23:54.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.092+0000 7f3fb7575800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:23:54.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.092+0000 7f3fb7575800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:23:54.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.092+0000 7f3fb7575800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:23:54.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.092+0000 7f3fb7575800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 : miss 2024-09-12T17:23:54.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.092+0000 7f3fb7575800 20 rados->read ofs=0 len=0 2024-09-12T17:23:54.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.092+0000 7f3fb7575800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:23:54.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.092+0000 7f3fb7575800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 info.flags=0x17 2024-09-12T17:23:54.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.092+0000 7f3fb7575800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 to cache LRU end 2024-09-12T17:23:54.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.092+0000 7f3fb7575800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:54.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.092+0000 7f3fb7575800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:54.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.092+0000 7f3fb7575800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 2024-09-12T17:23:54.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.096+0000 7f3fb7575800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 info.flags=0x17 2024-09-12T17:23:54.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.096+0000 7f3fb7575800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 to cache LRU end 2024-09-12T17:23:54.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.096+0000 7f3fb7575800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:54.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.096+0000 7f3fb7575800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23, ofs0, ns] 2024-09-12T17:23:54.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.097+0000 7f3e98ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464323 cookie 94641983492704 notifier 6191 bl.length()=1009 2024-09-12T17:23:54.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.097+0000 7f3e98ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 info.flags=0x17 2024-09-12T17:23:54.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.097+0000 7f3e98ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 to cache LRU end 2024-09-12T17:23:54.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.097+0000 7f3e98ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:54.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.098+0000 7f3fb7575800 20 handle_bi_update(): bucket=:error-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.23]): orig_sources= new_sources= 2024-09-12T17:23:54.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.098+0000 7f3fb7575800 20 handle_bi_update(): bucket=:error-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.23]): potential sources added=[] removed=[] 2024-09-12T17:23:54.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.098+0000 7f3fb7575800 20 handle_bi_update(): bucket=:error-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.23]): orig_dests= new_dests= 2024-09-12T17:23:54.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.098+0000 7f3fb7575800 20 handle_bi_update(): bucket=:error-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.23]): potential dests added=[] removed=[] 2024-09-12T17:23:54.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.101+0000 7f3fb7575800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.23.1.0 2024-09-12T17:23:54.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.101+0000 7f3fb7575800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.23.1.0 2024-09-12T17:23:54.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.101+0000 7f3fb7575800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.23.1.1 2024-09-12T17:23:54.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.101+0000 7f3fb7575800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.23.1.1 2024-09-12T17:23:54.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.101+0000 7f3fb7575800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.23.0 2024-09-12T17:23:54.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.103+0000 7f3fb7575800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 : hit (requested=0x17, cached=0x17) 2024-09-12T17:23:54.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.103+0000 7f3fb7575800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 2024-09-12T17:23:54.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.104+0000 7f3fb7575800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 info.flags=0x17 2024-09-12T17:23:54.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.104+0000 7f3fb7575800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 to cache LRU end 2024-09-12T17:23:54.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.104+0000 7f3fb7575800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:54.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.104+0000 7f3fb7575800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23, ofs0, ns] 2024-09-12T17:23:54.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.105+0000 7f3e98ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464324 cookie 94641983492704 notifier 6191 bl.length()=1009 2024-09-12T17:23:54.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.105+0000 7f3e98ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 info.flags=0x17 2024-09-12T17:23:54.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.105+0000 7f3e98ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 to cache LRU end 2024-09-12T17:23:54.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.105+0000 7f3e98ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:54.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.106+0000 7f3fb7575800 20 handle_bi_update(): bucket=:error-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.23]): orig_sources= new_sources= 2024-09-12T17:23:54.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.106+0000 7f3fb7575800 20 handle_bi_update(): bucket=:error-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.23]): potential sources added=[] removed=[] 2024-09-12T17:23:54.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.106+0000 7f3fb7575800 20 handle_bi_update(): bucket=:error-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.23]): orig_dests= new_dests= 2024-09-12T17:23:54.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.106+0000 7f3fb7575800 20 handle_bi_update(): bucket=:error-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.23]): potential dests added=[] removed=[] 2024-09-12T17:23:54.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.108+0000 7f3fb7575800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.23.0 2024-09-12T17:23:54.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.108+0000 7f3fb7575800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 : hit (requested=0x17, cached=0x17) 2024-09-12T17:23:54.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.108+0000 7f3fb7575800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 2024-09-12T17:23:54.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.109+0000 7f3fb7575800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 info.flags=0x17 2024-09-12T17:23:54.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.109+0000 7f3fb7575800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 to cache LRU end 2024-09-12T17:23:54.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.109+0000 7f3fb7575800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:54.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.109+0000 7f3fb7575800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23, ofs0, ns] 2024-09-12T17:23:54.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.110+0000 7f3e87fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464325 cookie 94641983492704 notifier 6191 bl.length()=977 2024-09-12T17:23:54.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.110+0000 7f3e87fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 info.flags=0x17 2024-09-12T17:23:54.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.110+0000 7f3e87fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 to cache LRU end 2024-09-12T17:23:54.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.110+0000 7f3e87fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:54.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.111+0000 7f3fb7575800 20 handle_bi_update(): bucket=:error-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.23]): orig_sources= new_sources= 2024-09-12T17:23:54.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.111+0000 7f3fb7575800 20 handle_bi_update(): bucket=:error-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.23]): potential sources added=[] removed=[] 2024-09-12T17:23:54.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.111+0000 7f3fb7575800 20 handle_bi_update(): bucket=:error-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.23]): orig_dests= new_dests= 2024-09-12T17:23:54.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.111+0000 7f3fb7575800 20 handle_bi_update(): bucket=:error-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.23]): potential dests added=[] removed=[] 2024-09-12T17:23:54.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.113+0000 7f3fb7575800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T17:23:54.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.115+0000 7f3e6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:54.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.117+0000 7f3fb7575800 20 remove_watcher() i=0 2024-09-12T17:23:54.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.117+0000 7f3fb7575800 2 removed watcher, disabling cache 2024-09-12T17:23:54.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.118+0000 7f3fb7575800 20 remove_watcher() i=1 2024-09-12T17:23:54.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.119+0000 7f3fb7575800 20 remove_watcher() i=2 2024-09-12T17:23:54.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.120+0000 7f3fb7575800 20 remove_watcher() i=3 2024-09-12T17:23:54.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.121+0000 7f3fb7575800 20 remove_watcher() i=4 2024-09-12T17:23:54.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.122+0000 7f3fb7575800 20 remove_watcher() i=5 2024-09-12T17:23:54.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.123+0000 7f3fb7575800 20 remove_watcher() i=6 2024-09-12T17:23:54.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.124+0000 7f3fb7575800 20 remove_watcher() i=7 2024-09-12T17:23:54.137 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:23:54.167 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:54.167 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:54.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.205+0000 7ff5e451f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:54.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.207+0000 7ff5e451f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:54.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.207+0000 7ff5e451f800 20 realm 2024-09-12T17:23:54.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.207+0000 7ff5e451f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:54.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.207+0000 7ff5e451f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:54.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.207+0000 7ff5e451f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:54.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.207+0000 7ff5e451f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:54.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.207+0000 7ff5e451f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:54.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.207+0000 7ff5e451f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:54.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.208+0000 7ff5e451f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:54.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.208+0000 7ff5e451f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:54.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.209+0000 7ff5e451f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:54.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.209+0000 7ff5e451f800 20 searching for the correct realm 2024-09-12T17:23:54.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.211+0000 7ff5dfaa1640 0 -- 172.21.15.67:0/334678180 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55f500fcc980 msgr2=0x55f500fced70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:54.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.416+0000 7ff5e02a2640 0 -- 172.21.15.67:0/334678180 >> [v2:172.21.15.118:6808/1825660705,v1:172.21.15.118:6809/1825660705] conn(0x55f500fc9240 msgr2=0x55f500fcb630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:54.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.421+0000 7ff5e451f800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:54.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.421+0000 7ff5e451f800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:54.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.421+0000 7ff5e451f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:54.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.421+0000 7ff5e451f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:54.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.421+0000 7ff5e451f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:54.423 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.421+0000 7ff5e451f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:54.423 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.421+0000 7ff5e451f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:54.423 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.421+0000 7ff5e451f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:54.423 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.421+0000 7ff5e451f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:54.424 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.421+0000 7ff5e451f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:54.424 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.422+0000 7ff5e451f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:54.424 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.422+0000 7ff5e451f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:54.424 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.422+0000 7ff5e451f800 20 zone default found 2024-09-12T17:23:54.424 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.422+0000 7ff5e451f800 4 Realm: () 2024-09-12T17:23:54.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.422+0000 7ff5e451f800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:54.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.422+0000 7ff5e451f800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:54.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.422+0000 7ff5e451f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:54.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.422+0000 7ff5e451f800 20 zonegroup default 2024-09-12T17:23:54.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.422+0000 7ff5e451f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:54.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.422+0000 7ff5e451f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:54.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.422+0000 7ff5e451f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:54.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.422+0000 7ff5e451f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:54.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.422+0000 7ff5e451f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:54.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.423+0000 7ff5e451f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:54.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.423+0000 7ff5e451f800 20 started sync module instance, tier type = 2024-09-12T17:23:54.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.423+0000 7ff5e451f800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:54.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.432+0000 7ff5e451f800 20 add_watcher() i=0 2024-09-12T17:23:54.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.432+0000 7ff5e451f800 20 add_watcher() i=1 2024-09-12T17:23:54.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.432+0000 7ff5e451f800 20 add_watcher() i=2 2024-09-12T17:23:54.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.432+0000 7ff5e451f800 20 add_watcher() i=3 2024-09-12T17:23:54.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.432+0000 7ff5e451f800 20 add_watcher() i=4 2024-09-12T17:23:54.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.432+0000 7ff5e451f800 20 add_watcher() i=5 2024-09-12T17:23:54.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.432+0000 7ff5e451f800 20 add_watcher() i=6 2024-09-12T17:23:54.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.433+0000 7ff5e451f800 20 add_watcher() i=7 2024-09-12T17:23:54.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.433+0000 7ff5e451f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:54.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.435+0000 7ff496fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:54.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.435+0000 7ff5e451f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:54.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.435+0000 7ff5e451f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:54.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.435+0000 7ff5e451f800 5 note: GC not initialized 2024-09-12T17:23:54.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.435+0000 7ff495fe3640 20 reqs_thread_entry: start 2024-09-12T17:23:54.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.435+0000 7ff5e451f800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:54.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.436+0000 7ff5e451f800 20 Filter name: none 2024-09-12T17:23:54.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.436+0000 7ff48effd640 20 reqs_thread_entry: start 2024-09-12T17:23:54.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.436+0000 7ff5e451f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:54.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.436+0000 7ff5e451f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:23:54.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.436+0000 7ff5e451f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:54.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.437+0000 7ff5e451f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:23:54.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.437+0000 7ff5e451f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:54.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.437+0000 7ff5e451f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:54.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.437+0000 7ff5e451f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:23:54.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.437+0000 7ff5e451f800 20 rados->read ofs=0 len=0 2024-09-12T17:23:54.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.437+0000 7ff5e451f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:23:54.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.437+0000 7ff5e451f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:54.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.439+0000 7ff496fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:54.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.441+0000 7ff5e451f800 20 remove_watcher() i=0 2024-09-12T17:23:54.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.441+0000 7ff5e451f800 2 removed watcher, disabling cache 2024-09-12T17:23:54.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.442+0000 7ff5e451f800 20 remove_watcher() i=1 2024-09-12T17:23:54.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.443+0000 7ff5e451f800 20 remove_watcher() i=2 2024-09-12T17:23:54.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.445+0000 7ff5e451f800 20 remove_watcher() i=3 2024-09-12T17:23:54.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.446+0000 7ff5e451f800 20 remove_watcher() i=4 2024-09-12T17:23:54.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.447+0000 7ff5e451f800 20 remove_watcher() i=5 2024-09-12T17:23:54.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.448+0000 7ff5e451f800 20 remove_watcher() i=6 2024-09-12T17:23:54.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:54.449+0000 7ff5e451f800 20 remove_watcher() i=7 2024-09-12T17:23:54.460 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:54.461 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:23:54.461 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-set-target-layout id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.23 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:23:54.461 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:54.462 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:54.463 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:54.481 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:54.481 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:54.707 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:54.707 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:54.772 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-12T17:23:54.773 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:54.774 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:54.774 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:54.817 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:54.817 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:54.875 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:54.875 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:54.910 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:54.910 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:54.946 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:54.946 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:54.982 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:54.982 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:55.017 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:55.018 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:55.063 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:55.063 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:55.100 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:55.100 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:55.140 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:55.140 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:55.176 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:55.177 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:55.213 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:55.213 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:55.249 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:55.249 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:55.285 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:55.286 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:55.321 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:55.321 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:55.356 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:55.356 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:55.393 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:55.393 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:55.428 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:55.429 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:55.465 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:55.466 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:55.502 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:55.502 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:55.538 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:55.538 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:55.575 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:55.575 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:55.612 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:23:55.641 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:55.641 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:55.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.679+0000 7f0a4d52d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:55.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.681+0000 7f0a4d52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:55.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.681+0000 7f0a4d52d800 20 realm 2024-09-12T17:23:55.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.681+0000 7f0a4d52d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:55.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.681+0000 7f0a4d52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:55.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.681+0000 7f0a4d52d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:55.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.681+0000 7f0a4d52d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:55.683 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.681+0000 7f0a4d52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:55.683 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.681+0000 7f0a4d52d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:55.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.682+0000 7f0a4d52d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:55.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.682+0000 7f0a4d52d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:55.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.683+0000 7f0a4d52d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:55.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.683+0000 7f0a4d52d800 20 searching for the correct realm 2024-09-12T17:23:55.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.684+0000 7f0a48a75640 0 -- 172.21.15.67:0/488860039 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f0a3c0413e0 msgr2=0x7f0a3c041820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:23:55.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.688+0000 7f0a49276640 0 -- 172.21.15.67:0/488860039 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f0a400891f0 msgr2=0x7f0a40096240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:55.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.894+0000 7f0a4d52d800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:55.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.894+0000 7f0a4d52d800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:55.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.894+0000 7f0a4d52d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:55.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.894+0000 7f0a4d52d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:55.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.894+0000 7f0a4d52d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:55.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.894+0000 7f0a4d52d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:55.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.894+0000 7f0a4d52d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:55.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.894+0000 7f0a4d52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:55.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.894+0000 7f0a4d52d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:55.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.894+0000 7f0a4d52d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:55.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.894+0000 7f0a4d52d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:55.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.894+0000 7f0a4d52d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:55.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.894+0000 7f0a4d52d800 20 zone default found 2024-09-12T17:23:55.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.894+0000 7f0a4d52d800 4 Realm: () 2024-09-12T17:23:55.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.894+0000 7f0a4d52d800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:55.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.894+0000 7f0a4d52d800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:55.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.894+0000 7f0a4d52d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:55.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.894+0000 7f0a4d52d800 20 zonegroup default 2024-09-12T17:23:55.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.894+0000 7f0a4d52d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:55.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.895+0000 7f0a4d52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:55.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.895+0000 7f0a4d52d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:55.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.895+0000 7f0a4d52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:55.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.895+0000 7f0a4d52d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:55.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.895+0000 7f0a4d52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:55.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.895+0000 7f0a4d52d800 20 started sync module instance, tier type = 2024-09-12T17:23:55.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.895+0000 7f0a4d52d800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:55.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.905+0000 7f0a4d52d800 20 add_watcher() i=0 2024-09-12T17:23:55.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.905+0000 7f0a4d52d800 20 add_watcher() i=1 2024-09-12T17:23:55.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.905+0000 7f0a4d52d800 20 add_watcher() i=2 2024-09-12T17:23:55.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.905+0000 7f0a4d52d800 20 add_watcher() i=3 2024-09-12T17:23:55.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.905+0000 7f0a4d52d800 20 add_watcher() i=4 2024-09-12T17:23:55.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.905+0000 7f0a4d52d800 20 add_watcher() i=5 2024-09-12T17:23:55.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.905+0000 7f0a4d52d800 20 add_watcher() i=6 2024-09-12T17:23:55.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.906+0000 7f0a4d52d800 20 add_watcher() i=7 2024-09-12T17:23:55.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.906+0000 7f0a4d52d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:55.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.907+0000 7f08fffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:55.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.908+0000 7f0a4d52d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:55.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.908+0000 7f0a4d52d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:55.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.908+0000 7f0a4d52d800 5 note: GC not initialized 2024-09-12T17:23:55.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.908+0000 7f08fefe5640 20 reqs_thread_entry: start 2024-09-12T17:23:55.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.908+0000 7f0a4d52d800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:55.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.908+0000 7f0a4d52d800 20 Filter name: none 2024-09-12T17:23:55.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.908+0000 7f08fcfe1640 20 reqs_thread_entry: start 2024-09-12T17:23:55.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.908+0000 7f0a4d52d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:55.911 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.909+0000 7f0a4d52d800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:23:55.911 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.909+0000 7f0a4d52d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:55.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.909+0000 7f0a4d52d800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:23:55.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.909+0000 7f0a4d52d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:55.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.909+0000 7f0a4d52d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:55.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.910+0000 7f0a4d52d800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:23:55.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.910+0000 7f0a4d52d800 20 rados->read ofs=0 len=0 2024-09-12T17:23:55.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.910+0000 7f0a4d52d800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:23:55.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.910+0000 7f0a4d52d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:55.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.912+0000 7f08fffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:55.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.914+0000 7f0a4d52d800 20 remove_watcher() i=0 2024-09-12T17:23:55.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.914+0000 7f0a4d52d800 2 removed watcher, disabling cache 2024-09-12T17:23:55.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.915+0000 7f0a4d52d800 20 remove_watcher() i=1 2024-09-12T17:23:55.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.916+0000 7f0a4d52d800 20 remove_watcher() i=2 2024-09-12T17:23:55.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.917+0000 7f0a4d52d800 20 remove_watcher() i=3 2024-09-12T17:23:55.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.918+0000 7f0a4d52d800 20 remove_watcher() i=4 2024-09-12T17:23:55.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.919+0000 7f0a4d52d800 20 remove_watcher() i=5 2024-09-12T17:23:55.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.920+0000 7f0a4d52d800 20 remove_watcher() i=6 2024-09-12T17:23:55.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:55.921+0000 7f0a4d52d800 20 remove_watcher() i=7 2024-09-12T17:23:55.933 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:55.933 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:23:55.933 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-set-target-layout id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:23:55.933 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:55.935 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-12T17:23:55.971 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:55.972 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:56.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.011+0000 7f2e19a40800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.013+0000 7f2e19a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:56.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.013+0000 7f2e19a40800 20 realm 2024-09-12T17:23:56.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.013+0000 7f2e19a40800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.013+0000 7f2e19a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:56.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.013+0000 7f2e19a40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:56.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.013+0000 7f2e19a40800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.013+0000 7f2e19a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:56.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.013+0000 7f2e19a40800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.014+0000 7f2e19a40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:56.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.014+0000 7f2e19a40800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.015+0000 7f2e19a40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:56.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.015+0000 7f2e19a40800 20 searching for the correct realm 2024-09-12T17:23:56.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.015+0000 7f2e17d2b640 0 -- 172.21.15.67:0/2575873194 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x560a39da6cc0 msgr2=0x560a39da90b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:56.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.018+0000 7f2e17d2b640 0 -- 172.21.15.67:0/2575873194 >> [v2:172.21.15.118:6824/1070975205,v1:172.21.15.118:6825/1070975205] conn(0x7f2e0c068040 msgr2=0x7f2e0c068440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:23:56.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.227+0000 7f2e19a40800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:56.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.227+0000 7f2e19a40800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:56.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.227+0000 7f2e19a40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:56.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.227+0000 7f2e19a40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:56.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.227+0000 7f2e19a40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:56.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.227+0000 7f2e19a40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:56.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.227+0000 7f2e19a40800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.227+0000 7f2e19a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:56.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.227+0000 7f2e19a40800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.228+0000 7f2e19a40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:56.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.228+0000 7f2e19a40800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.228+0000 7f2e19a40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:56.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.228+0000 7f2e19a40800 20 zone default found 2024-09-12T17:23:56.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.228+0000 7f2e19a40800 4 Realm: () 2024-09-12T17:23:56.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.228+0000 7f2e19a40800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:56.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.228+0000 7f2e19a40800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:56.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.228+0000 7f2e19a40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:56.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.228+0000 7f2e19a40800 20 zonegroup default 2024-09-12T17:23:56.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.228+0000 7f2e19a40800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.228+0000 7f2e19a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:56.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.228+0000 7f2e19a40800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.229+0000 7f2e19a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:56.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.229+0000 7f2e19a40800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.229+0000 7f2e19a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:56.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.229+0000 7f2e19a40800 20 started sync module instance, tier type = 2024-09-12T17:23:56.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.229+0000 7f2e19a40800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:56.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.238+0000 7f2e19a40800 20 add_watcher() i=0 2024-09-12T17:23:56.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.238+0000 7f2e19a40800 20 add_watcher() i=1 2024-09-12T17:23:56.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.238+0000 7f2e19a40800 20 add_watcher() i=2 2024-09-12T17:23:56.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.238+0000 7f2e19a40800 20 add_watcher() i=3 2024-09-12T17:23:56.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.238+0000 7f2e19a40800 20 add_watcher() i=4 2024-09-12T17:23:56.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.238+0000 7f2e19a40800 20 add_watcher() i=5 2024-09-12T17:23:56.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.238+0000 7f2e19a40800 20 add_watcher() i=6 2024-09-12T17:23:56.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.239+0000 7f2e19a40800 20 add_watcher() i=7 2024-09-12T17:23:56.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.239+0000 7f2e19a40800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:56.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.241+0000 7f2cc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:56.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.241+0000 7f2e19a40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:56.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.241+0000 7f2e19a40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:56.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.241+0000 7f2e19a40800 5 note: GC not initialized 2024-09-12T17:23:56.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.241+0000 7f2cc8fe1640 20 reqs_thread_entry: start 2024-09-12T17:23:56.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.241+0000 7f2e19a40800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:56.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.241+0000 7f2e19a40800 20 Filter name: none 2024-09-12T17:23:56.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.241+0000 7f2c427fc640 20 reqs_thread_entry: start 2024-09-12T17:23:56.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.241+0000 7f2e19a40800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:23:56.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.241+0000 7f2e19a40800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.242+0000 7f2e19a40800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:23:56.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.242+0000 7f2e19a40800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:23:56.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.242+0000 7f2e19a40800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:23:56.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.242+0000 7f2e19a40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24 : miss 2024-09-12T17:23:56.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.242+0000 7f2e19a40800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.242+0000 7f2e19a40800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:23:56.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.242+0000 7f2e19a40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24 info.flags=0x17 2024-09-12T17:23:56.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.242+0000 7f2e19a40800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24 to cache LRU end 2024-09-12T17:23:56.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.242+0000 7f2e19a40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:56.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.242+0000 7f2e19a40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:56.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.242+0000 7f2e19a40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24 2024-09-12T17:23:56.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.245+0000 7f2e19a40800 -1 Injecting error=-125 at location=set_target_layout 2024-09-12T17:23:56.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.246+0000 7f2e19a40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24 info.flags=0x17 2024-09-12T17:23:56.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.246+0000 7f2e19a40800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24 to cache LRU end 2024-09-12T17:23:56.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.246+0000 7f2e19a40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:56.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.246+0000 7f2e19a40800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24, ofs0, ns] 2024-09-12T17:23:56.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.247+0000 7f2cfaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464328 cookie 94601920251392 notifier 6633 bl.length()=1009 2024-09-12T17:23:56.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.247+0000 7f2cfaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24 info.flags=0x17 2024-09-12T17:23:56.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.247+0000 7f2cfaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24 to cache LRU end 2024-09-12T17:23:56.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.247+0000 7f2cfaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:56.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.248+0000 7f2e19a40800 20 handle_bi_update(): bucket=:error-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.24]): orig_sources= new_sources= 2024-09-12T17:23:56.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.248+0000 7f2e19a40800 20 handle_bi_update(): bucket=:error-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.24]): potential sources added=[] removed=[] 2024-09-12T17:23:56.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.248+0000 7f2e19a40800 20 handle_bi_update(): bucket=:error-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.24]): orig_dests= new_dests= 2024-09-12T17:23:56.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.248+0000 7f2e19a40800 20 handle_bi_update(): bucket=:error-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.24]): potential dests added=[] removed=[] 2024-09-12T17:23:56.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.251+0000 7f2e19a40800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.24.1.0 2024-09-12T17:23:56.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.251+0000 7f2e19a40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.24.1.0 2024-09-12T17:23:56.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.251+0000 7f2e19a40800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.24.1.1 2024-09-12T17:23:56.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.251+0000 7f2e19a40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.24.1.1 2024-09-12T17:23:56.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.251+0000 7f2e19a40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.24.0 2024-09-12T17:23:56.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.253+0000 7f2e19a40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24 : hit (requested=0x17, cached=0x17) 2024-09-12T17:23:56.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.253+0000 7f2e19a40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24 2024-09-12T17:23:56.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.254+0000 7f2e19a40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24 info.flags=0x17 2024-09-12T17:23:56.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.254+0000 7f2e19a40800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24 to cache LRU end 2024-09-12T17:23:56.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.254+0000 7f2e19a40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:56.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.254+0000 7f2e19a40800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24, ofs0, ns] 2024-09-12T17:23:56.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.255+0000 7f2cfaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464329 cookie 94601920251392 notifier 6633 bl.length()=1009 2024-09-12T17:23:56.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.255+0000 7f2cfaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24 info.flags=0x17 2024-09-12T17:23:56.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.255+0000 7f2cfaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24 to cache LRU end 2024-09-12T17:23:56.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.255+0000 7f2cfaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:56.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.256+0000 7f2e19a40800 20 handle_bi_update(): bucket=:error-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.24]): orig_sources= new_sources= 2024-09-12T17:23:56.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.256+0000 7f2e19a40800 20 handle_bi_update(): bucket=:error-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.24]): potential sources added=[] removed=[] 2024-09-12T17:23:56.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.256+0000 7f2e19a40800 20 handle_bi_update(): bucket=:error-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.24]): orig_dests= new_dests= 2024-09-12T17:23:56.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.256+0000 7f2e19a40800 20 handle_bi_update(): bucket=:error-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.24]): potential dests added=[] removed=[] 2024-09-12T17:23:56.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.257+0000 7f2e19a40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.24.0 2024-09-12T17:23:56.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.258+0000 7f2e19a40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24 : hit (requested=0x17, cached=0x17) 2024-09-12T17:23:56.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.258+0000 7f2e19a40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24 2024-09-12T17:23:56.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.259+0000 7f2e19a40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24 info.flags=0x17 2024-09-12T17:23:56.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.259+0000 7f2e19a40800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24 to cache LRU end 2024-09-12T17:23:56.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.259+0000 7f2e19a40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:56.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.259+0000 7f2e19a40800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24, ofs0, ns] 2024-09-12T17:23:56.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.260+0000 7f2cfaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464330 cookie 94601920251392 notifier 6633 bl.length()=977 2024-09-12T17:23:56.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.260+0000 7f2cfaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24 info.flags=0x17 2024-09-12T17:23:56.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.260+0000 7f2cfaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24 to cache LRU end 2024-09-12T17:23:56.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.260+0000 7f2cfaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:56.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.261+0000 7f2e19a40800 20 handle_bi_update(): bucket=:error-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.24]): orig_sources= new_sources= 2024-09-12T17:23:56.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.261+0000 7f2e19a40800 20 handle_bi_update(): bucket=:error-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.24]): potential sources added=[] removed=[] 2024-09-12T17:23:56.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.261+0000 7f2e19a40800 20 handle_bi_update(): bucket=:error-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.24]): orig_dests= new_dests= 2024-09-12T17:23:56.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.261+0000 7f2e19a40800 20 handle_bi_update(): bucket=:error-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.24]): potential dests added=[] removed=[] 2024-09-12T17:23:56.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.262+0000 7f2e19a40800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T17:23:56.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.264+0000 7f2cc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:56.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.266+0000 7f2e19a40800 20 remove_watcher() i=0 2024-09-12T17:23:56.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.266+0000 7f2e19a40800 2 removed watcher, disabling cache 2024-09-12T17:23:56.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.267+0000 7f2e19a40800 20 remove_watcher() i=1 2024-09-12T17:23:56.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.268+0000 7f2e19a40800 20 remove_watcher() i=2 2024-09-12T17:23:56.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.269+0000 7f2e19a40800 20 remove_watcher() i=3 2024-09-12T17:23:56.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.270+0000 7f2e19a40800 20 remove_watcher() i=4 2024-09-12T17:23:56.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.271+0000 7f2e19a40800 20 remove_watcher() i=5 2024-09-12T17:23:56.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.272+0000 7f2e19a40800 20 remove_watcher() i=6 2024-09-12T17:23:56.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.273+0000 7f2e19a40800 20 remove_watcher() i=7 2024-09-12T17:23:56.287 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:23:56.316 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:56.316 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:56.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.356+0000 7f227a013800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.357+0000 7f227a013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:56.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.357+0000 7f227a013800 20 realm 2024-09-12T17:23:56.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.358+0000 7f227a013800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.358+0000 7f227a013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:56.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.358+0000 7f227a013800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:56.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.358+0000 7f227a013800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.358+0000 7f227a013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:56.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.358+0000 7f227a013800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.359+0000 7f227a013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:56.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.359+0000 7f227a013800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.360+0000 7f227a013800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:56.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.360+0000 7f227a013800 20 searching for the correct realm 2024-09-12T17:23:56.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.362+0000 7f2275792640 0 -- 172.21.15.67:0/2372628248 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f227006d040 msgr2=0x7f227007f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:56.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.366+0000 7f2275792640 0 -- 172.21.15.67:0/2372628248 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f226006c6a0 msgr2=0x7f22600a40b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:23:56.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.572+0000 7f227a013800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:56.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.572+0000 7f227a013800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:56.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.572+0000 7f227a013800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:56.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.572+0000 7f227a013800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:56.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.572+0000 7f227a013800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:56.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.572+0000 7f227a013800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:56.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.572+0000 7f227a013800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.573+0000 7f227a013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:56.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.573+0000 7f227a013800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.573+0000 7f227a013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:56.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.573+0000 7f227a013800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.573+0000 7f227a013800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:56.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.573+0000 7f227a013800 20 zone default found 2024-09-12T17:23:56.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.573+0000 7f227a013800 4 Realm: () 2024-09-12T17:23:56.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.573+0000 7f227a013800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:56.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.573+0000 7f227a013800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:56.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.573+0000 7f227a013800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:56.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.573+0000 7f227a013800 20 zonegroup default 2024-09-12T17:23:56.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.573+0000 7f227a013800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.574+0000 7f227a013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:56.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.574+0000 7f227a013800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.574+0000 7f227a013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:56.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.574+0000 7f227a013800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.574+0000 7f227a013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:56.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.574+0000 7f227a013800 20 started sync module instance, tier type = 2024-09-12T17:23:56.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.574+0000 7f227a013800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:56.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.583+0000 7f227a013800 20 add_watcher() i=0 2024-09-12T17:23:56.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.583+0000 7f227a013800 20 add_watcher() i=1 2024-09-12T17:23:56.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.583+0000 7f227a013800 20 add_watcher() i=2 2024-09-12T17:23:56.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.583+0000 7f227a013800 20 add_watcher() i=3 2024-09-12T17:23:56.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.583+0000 7f227a013800 20 add_watcher() i=4 2024-09-12T17:23:56.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.583+0000 7f227a013800 20 add_watcher() i=5 2024-09-12T17:23:56.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.583+0000 7f227a013800 20 add_watcher() i=6 2024-09-12T17:23:56.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.584+0000 7f227a013800 20 add_watcher() i=7 2024-09-12T17:23:56.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.584+0000 7f227a013800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:56.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.586+0000 7f212b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:56.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.587+0000 7f227a013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:56.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.587+0000 7f227a013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:56.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.587+0000 7f227a013800 5 note: GC not initialized 2024-09-12T17:23:56.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.587+0000 7f212a7e4640 20 reqs_thread_entry: start 2024-09-12T17:23:56.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.587+0000 7f227a013800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:56.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.587+0000 7f227a013800 20 Filter name: none 2024-09-12T17:23:56.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.587+0000 7f209bfff640 20 reqs_thread_entry: start 2024-09-12T17:23:56.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.587+0000 7f227a013800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.588+0000 7f227a013800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:23:56.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.588+0000 7f227a013800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.588+0000 7f227a013800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:23:56.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.588+0000 7f227a013800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:56.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.588+0000 7f227a013800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.588+0000 7f227a013800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:23:56.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.589+0000 7f227a013800 20 rados->read ofs=0 len=0 2024-09-12T17:23:56.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.589+0000 7f227a013800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:23:56.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.589+0000 7f227a013800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:56.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.590+0000 7f212b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:56.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.592+0000 7f227a013800 20 remove_watcher() i=0 2024-09-12T17:23:56.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.592+0000 7f227a013800 2 removed watcher, disabling cache 2024-09-12T17:23:56.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.593+0000 7f227a013800 20 remove_watcher() i=1 2024-09-12T17:23:56.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.594+0000 7f227a013800 20 remove_watcher() i=2 2024-09-12T17:23:56.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.595+0000 7f227a013800 20 remove_watcher() i=3 2024-09-12T17:23:56.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.596+0000 7f227a013800 20 remove_watcher() i=4 2024-09-12T17:23:56.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.597+0000 7f227a013800 20 remove_watcher() i=5 2024-09-12T17:23:56.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.598+0000 7f227a013800 20 remove_watcher() i=6 2024-09-12T17:23:56.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:56.599+0000 7f227a013800 20 remove_watcher() i=7 2024-09-12T17:23:56.611 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:56.611 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:23:56.612 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-set-target-layout id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.24 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T17:23:56.612 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:56.613 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:56.613 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:56.634 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:56.634 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:56.876 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:56.876 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:56.941 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-12T17:23:56.941 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:56.942 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:56.942 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:56.985 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:56.985 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:57.042 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:57.043 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:57.081 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:57.081 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:57.116 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:57.116 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:57.153 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:57.153 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:57.190 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:57.190 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:57.226 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:57.227 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:57.262 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:57.262 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:57.297 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:57.297 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:57.333 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:57.333 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:57.369 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:57.370 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:57.406 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:57.406 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:57.443 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:57.443 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:57.480 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:57.480 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:57.515 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:57.515 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:57.551 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:57.551 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:57.589 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:57.589 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:57.624 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:57.624 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:57.673 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:57.673 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:57.708 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:57.709 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:57.743 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:57.743 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:57.780 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:23:57.809 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:57.809 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:57.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:57.847+0000 7f70766bb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:57.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:57.849+0000 7f70766bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:57.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:57.849+0000 7f70766bb800 20 realm 2024-09-12T17:23:57.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:57.849+0000 7f70766bb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:57.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:57.849+0000 7f70766bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:57.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:57.849+0000 7f70766bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:57.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:57.849+0000 7f70766bb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:57.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:57.849+0000 7f70766bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:57.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:57.849+0000 7f70766bb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:57.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:57.850+0000 7f70766bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:57.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:57.850+0000 7f70766bb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:57.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:57.851+0000 7f70766bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:57.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:57.851+0000 7f70766bb800 20 searching for the correct realm 2024-09-12T17:23:57.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:57.853+0000 7f706bfff640 0 -- 172.21.15.67:0/1353912561 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f7064044040 msgr2=0x7f7064043920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:58.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.058+0000 7f70741a5640 0 -- 172.21.15.67:0/1353912561 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f705c018070 msgr2=0x7f705c061910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:23:58.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.265+0000 7f70766bb800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:58.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.265+0000 7f70766bb800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:58.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.265+0000 7f70766bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:58.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.265+0000 7f70766bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:58.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.265+0000 7f70766bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:58.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.265+0000 7f70766bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:58.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.265+0000 7f70766bb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.265+0000 7f70766bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.265+0000 7f70766bb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.266+0000 7f70766bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:58.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.266+0000 7f70766bb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.266+0000 7f70766bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:58.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.266+0000 7f70766bb800 20 zone default found 2024-09-12T17:23:58.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.266+0000 7f70766bb800 4 Realm: () 2024-09-12T17:23:58.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.266+0000 7f70766bb800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:58.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.266+0000 7f70766bb800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:58.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.266+0000 7f70766bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:58.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.266+0000 7f70766bb800 20 zonegroup default 2024-09-12T17:23:58.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.266+0000 7f70766bb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.266+0000 7f70766bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.266+0000 7f70766bb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.267+0000 7f70766bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.267+0000 7f70766bb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.267+0000 7f70766bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.267+0000 7f70766bb800 20 started sync module instance, tier type = 2024-09-12T17:23:58.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.267+0000 7f70766bb800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:58.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.277+0000 7f70766bb800 20 add_watcher() i=0 2024-09-12T17:23:58.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.277+0000 7f70766bb800 20 add_watcher() i=1 2024-09-12T17:23:58.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.277+0000 7f70766bb800 20 add_watcher() i=2 2024-09-12T17:23:58.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.277+0000 7f70766bb800 20 add_watcher() i=3 2024-09-12T17:23:58.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.277+0000 7f70766bb800 20 add_watcher() i=4 2024-09-12T17:23:58.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.277+0000 7f70766bb800 20 add_watcher() i=5 2024-09-12T17:23:58.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.277+0000 7f70766bb800 20 add_watcher() i=6 2024-09-12T17:23:58.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.278+0000 7f70766bb800 20 add_watcher() i=7 2024-09-12T17:23:58.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.278+0000 7f70766bb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:58.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.280+0000 7f6f2afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:58.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.280+0000 7f70766bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:58.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.280+0000 7f70766bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:58.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.280+0000 7f70766bb800 5 note: GC not initialized 2024-09-12T17:23:58.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.280+0000 7f6f29fdb640 20 reqs_thread_entry: start 2024-09-12T17:23:58.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.280+0000 7f70766bb800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:58.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.280+0000 7f70766bb800 20 Filter name: none 2024-09-12T17:23:58.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.281+0000 7f6e9b7fe640 20 reqs_thread_entry: start 2024-09-12T17:23:58.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.281+0000 7f70766bb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.281+0000 7f70766bb800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:23:58.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.281+0000 7f70766bb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.282+0000 7f70766bb800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:23:58.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.282+0000 7f70766bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:58.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.282+0000 7f70766bb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.282+0000 7f70766bb800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:23:58.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.282+0000 7f70766bb800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.282+0000 7f70766bb800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:23:58.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.282+0000 7f70766bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:58.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.284+0000 7f6f2afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:58.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.286+0000 7f70766bb800 20 remove_watcher() i=0 2024-09-12T17:23:58.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.286+0000 7f70766bb800 2 removed watcher, disabling cache 2024-09-12T17:23:58.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.287+0000 7f70766bb800 20 remove_watcher() i=1 2024-09-12T17:23:58.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.288+0000 7f70766bb800 20 remove_watcher() i=2 2024-09-12T17:23:58.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.289+0000 7f70766bb800 20 remove_watcher() i=3 2024-09-12T17:23:58.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.290+0000 7f70766bb800 20 remove_watcher() i=4 2024-09-12T17:23:58.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.291+0000 7f70766bb800 20 remove_watcher() i=5 2024-09-12T17:23:58.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.292+0000 7f70766bb800 20 remove_watcher() i=6 2024-09-12T17:23:58.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.293+0000 7f70766bb800 20 remove_watcher() i=7 2024-09-12T17:23:58.306 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.306 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:23:58.306 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-set-target-layout id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:23:58.306 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.307 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-12T17:23:58.343 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:58.343 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:58.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.383+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.384+0000 7f4b03335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.384+0000 7f4b03335800 20 realm 2024-09-12T17:23:58.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.384+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.384+0000 7f4b03335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.384+0000 7f4b03335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:58.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.384+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.385+0000 7f4b03335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.385+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.385+0000 7f4b03335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:58.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.385+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.386+0000 7f4b03335800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:58.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.386+0000 7f4b03335800 20 searching for the correct realm 2024-09-12T17:23:58.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.389+0000 7f4afe7c2640 0 -- 172.21.15.67:0/1767224406 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x5644abe977b0 msgr2=0x5644abe99ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:58.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.392+0000 7f4afefc3640 0 -- 172.21.15.67:0/1767224406 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f4af408cc10 msgr2=0x7f4af406e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:58.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.599+0000 7f4b03335800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:58.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.599+0000 7f4b03335800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:58.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.599+0000 7f4b03335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:58.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.599+0000 7f4b03335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:58.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.599+0000 7f4b03335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:58.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.599+0000 7f4b03335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:58.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.599+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.599+0000 7f4b03335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.599+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.599+0000 7f4b03335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:58.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.599+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.600+0000 7f4b03335800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:58.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.600+0000 7f4b03335800 20 zone default found 2024-09-12T17:23:58.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.600+0000 7f4b03335800 4 Realm: () 2024-09-12T17:23:58.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.600+0000 7f4b03335800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:58.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.600+0000 7f4b03335800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:58.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.600+0000 7f4b03335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:58.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.600+0000 7f4b03335800 20 zonegroup default 2024-09-12T17:23:58.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.600+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.600+0000 7f4b03335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.600+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.600+0000 7f4b03335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.600+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.600+0000 7f4b03335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.600+0000 7f4b03335800 20 started sync module instance, tier type = 2024-09-12T17:23:58.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.600+0000 7f4b03335800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:58.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.610+0000 7f4b03335800 20 add_watcher() i=0 2024-09-12T17:23:58.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.610+0000 7f4b03335800 20 add_watcher() i=1 2024-09-12T17:23:58.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.610+0000 7f4b03335800 20 add_watcher() i=2 2024-09-12T17:23:58.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.610+0000 7f4b03335800 20 add_watcher() i=3 2024-09-12T17:23:58.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.610+0000 7f4b03335800 20 add_watcher() i=4 2024-09-12T17:23:58.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.610+0000 7f4b03335800 20 add_watcher() i=5 2024-09-12T17:23:58.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.610+0000 7f4b03335800 20 add_watcher() i=6 2024-09-12T17:23:58.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.611+0000 7f4b03335800 20 add_watcher() i=7 2024-09-12T17:23:58.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.611+0000 7f4b03335800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:58.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.613+0000 7f49b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:58.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.614+0000 7f4b03335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:58.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.614+0000 7f4b03335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:58.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.614+0000 7f4b03335800 5 note: GC not initialized 2024-09-12T17:23:58.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.614+0000 7f492ffff640 20 reqs_thread_entry: start 2024-09-12T17:23:58.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.614+0000 7f4b03335800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:58.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.614+0000 7f4b03335800 20 Filter name: none 2024-09-12T17:23:58.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.614+0000 7f492dffb640 20 reqs_thread_entry: start 2024-09-12T17:23:58.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.614+0000 7f4b03335800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:23:58.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.614+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.615+0000 7f4b03335800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:23:58.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.615+0000 7f4b03335800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:23:58.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.615+0000 7f4b03335800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:23:58.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.615+0000 7f4b03335800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 : miss 2024-09-12T17:23:58.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.615+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.615+0000 7f4b03335800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:23:58.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.615+0000 7f4b03335800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 info.flags=0x17 2024-09-12T17:23:58.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.615+0000 7f4b03335800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 to cache LRU end 2024-09-12T17:23:58.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.615+0000 7f4b03335800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:58.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.615+0000 7f4b03335800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:58.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.615+0000 7f4b03335800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 2024-09-12T17:23:58.619 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4b03335800 time 2024-09-12T17:23:58.619129+0000 2024-09-12T17:23:58.619 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:23:58.620 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:58.620 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4b0498c71a] 2024-09-12T17:23:58.620 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4b0498c8d8] 2024-09-12T17:23:58.620 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644aa7b2841] 2024-09-12T17:23:58.620 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd73ca8) [0x5644aacbfca8] 2024-09-12T17:23:58.620 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5644aa7c250d] 2024-09-12T17:23:58.620 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:23:58.620 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4b03629590] 2024-09-12T17:23:58.620 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:23:58.621 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:23:58.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.619+0000 7f4b03335800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4b03335800 time 2024-09-12T17:23:58.619129+0000 2024-09-12T17:23:58.621 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:23:58.621 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.621 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:58.621 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4b0498c71a] 2024-09-12T17:23:58.621 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4b0498c8d8] 2024-09-12T17:23:58.621 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644aa7b2841] 2024-09-12T17:23:58.621 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd73ca8) [0x5644aacbfca8] 2024-09-12T17:23:58.621 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5644aa7c250d] 2024-09-12T17:23:58.621 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:23:58.622 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4b03629590] 2024-09-12T17:23:58.622 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:23:58.622 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:23:58.622 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.622 INFO:tasks.workunit.client.0.smithi067.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:23:58.622 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f4b03335800 thread_name:radosgw-admin 2024-09-12T17:23:58.639 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:58.639 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4b0363e6f0] 2024-09-12T17:23:58.639 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4b0368b99c] 2024-09-12T17:23:58.639 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:23:58.639 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:23:58.639 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4b0498c774] 2024-09-12T17:23:58.639 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4b0498c8d8] 2024-09-12T17:23:58.639 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644aa7b2841] 2024-09-12T17:23:58.640 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd73ca8) [0x5644aacbfca8] 2024-09-12T17:23:58.640 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5644aa7c250d] 2024-09-12T17:23:58.640 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:23:58.640 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4b03629590] 2024-09-12T17:23:58.640 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:23:58.640 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:23:58.640 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.620+0000 7f4b03335800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:23:58.640 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f4b03335800 thread_name:radosgw-admin 2024-09-12T17:23:58.640 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.640 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:58.640 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4b0363e6f0] 2024-09-12T17:23:58.640 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4b0368b99c] 2024-09-12T17:23:58.640 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:23:58.641 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:23:58.641 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4b0498c774] 2024-09-12T17:23:58.641 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4b0498c8d8] 2024-09-12T17:23:58.641 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644aa7b2841] 2024-09-12T17:23:58.641 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd73ca8) [0x5644aacbfca8] 2024-09-12T17:23:58.641 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5644aa7c250d] 2024-09-12T17:23:58.641 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:23:58.641 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4b03629590] 2024-09-12T17:23:58.641 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:23:58.641 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:23:58.641 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:23:58.641 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.642 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T17:23:58.642 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T17:23:58.365+0000 7f49ece09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:58.642 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T17:23:58.365+0000 7f49ece09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:23:58.642 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T17:23:58.365+0000 7f49ece09640 10 monclient: dump: 2024-09-12T17:23:58.642 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:58.642 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:58.642 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.642 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.642 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:58.642 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:58.642 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:58.642 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:58.642 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:58.642 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.643 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T17:23:58.365+0000 7f4b03335800 5 monclient: authenticate success, global_id 6281 2024-09-12T17:23:58.643 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T17:23:58.365+0000 7f4b03335800 10 monclient: get_monmap_and_config success 2024-09-12T17:23:58.643 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T17:23:58.365+0000 7f4b03335800 4 set_mon_vals no callback set 2024-09-12T17:23:58.643 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T17:23:58.366+0000 7f4b03335800 10 monclient: shutdown 2024-09-12T17:23:58.643 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 asok(0x5644abb85730) unregister_commands rotate-key 2024-09-12T17:23:58.643 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T17:23:58.366+0000 7f4b03335800 10 monclient: build_initial_monmap 2024-09-12T17:23:58.643 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T17:23:58.366+0000 7f4b03335800 1 build_initial for_mkfs: 0 2024-09-12T17:23:58.643 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T17:23:58.366+0000 7f4b03335800 10 monclient: monmap: 2024-09-12T17:23:58.643 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:23:58.643 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:58.643 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:23:58.643 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:23:58.644 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:58.644 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:58.644 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:23:58.644 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:23:58.644 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:23:58.644 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.644 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding auth protocol: cephx 2024-09-12T17:23:58.644 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding auth protocol: cephx 2024-09-12T17:23:58.644 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding auth protocol: cephx 2024-09-12T17:23:58.644 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding con mode: secure 2024-09-12T17:23:58.644 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding con mode: crc 2024-09-12T17:23:58.644 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding con mode: secure 2024-09-12T17:23:58.644 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding con mode: crc 2024-09-12T17:23:58.644 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding con mode: secure 2024-09-12T17:23:58.645 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding con mode: crc 2024-09-12T17:23:58.645 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding con mode: crc 2024-09-12T17:23:58.645 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding con mode: secure 2024-09-12T17:23:58.645 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding con mode: crc 2024-09-12T17:23:58.645 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding con mode: secure 2024-09-12T17:23:58.645 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding con mode: crc 2024-09-12T17:23:58.645 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding con mode: secure 2024-09-12T17:23:58.645 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T17:23:58.366+0000 7f4b03335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:58.645 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T17:23:58.366+0000 7f4b03335800 1 librados: starting msgr at 2024-09-12T17:23:58.645 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T17:23:58.366+0000 7f4b03335800 1 librados: starting objecter 2024-09-12T17:23:58.645 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 asok(0x5644abb85730) register_command objecter_requests hook 0x5644abdabdd0 2024-09-12T17:23:58.645 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T17:23:58.366+0000 7f4b03335800 1 librados: setting wanted keys 2024-09-12T17:23:58.645 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T17:23:58.366+0000 7f4b03335800 1 librados: calling monclient init 2024-09-12T17:23:58.645 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T17:23:58.366+0000 7f4b03335800 10 monclient: init 2024-09-12T17:23:58.645 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding auth protocol: cephx 2024-09-12T17:23:58.646 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding auth protocol: cephx 2024-09-12T17:23:58.646 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding auth protocol: cephx 2024-09-12T17:23:58.646 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding con mode: secure 2024-09-12T17:23:58.646 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding con mode: crc 2024-09-12T17:23:58.646 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding con mode: secure 2024-09-12T17:23:58.646 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding con mode: crc 2024-09-12T17:23:58.646 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding con mode: secure 2024-09-12T17:23:58.646 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding con mode: crc 2024-09-12T17:23:58.646 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding con mode: crc 2024-09-12T17:23:58.646 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding con mode: secure 2024-09-12T17:23:58.646 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding con mode: crc 2024-09-12T17:23:58.646 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding con mode: secure 2024-09-12T17:23:58.646 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding con mode: crc 2024-09-12T17:23:58.647 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding con mode: secure 2024-09-12T17:23:58.647 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T17:23:58.367+0000 7f4b03335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:58.647 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T17:23:58.367+0000 7f4b03335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:58.647 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T17:23:58.367+0000 7f4b03335800 5 asok(0x5644abb85730) register_command rotate-key hook 0x5644abda6c98 2024-09-12T17:23:58.647 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T17:23:58.367+0000 7f4b03335800 10 monclient: _reopen_session rank -1 2024-09-12T17:23:58.647 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T17:23:58.367+0000 7f4b03335800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:23:58.647 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T17:23:58.367+0000 7f4b03335800 10 monclient(hunting): picked mon.noname-c con 0x5644abc5fad0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:23:58.647 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T17:23:58.367+0000 7f4b03335800 10 monclient(hunting): picked mon.noname-b con 0x5644abcef8e0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:23:58.647 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T17:23:58.367+0000 7f4b03335800 10 monclient(hunting): picked mon.noname-a con 0x5644abcf0240 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:23:58.647 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T17:23:58.367+0000 7f4b03335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:58.647 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T17:23:58.367+0000 7f4b03335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:58.647 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T17:23:58.367+0000 7f4b03335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:58.647 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T17:23:58.367+0000 7f4b03335800 10 monclient(hunting): _renew_subs 2024-09-12T17:23:58.647 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T17:23:58.367+0000 7f4b03335800 10 monclient(hunting): authenticate will time out at 2249.717462s 2024-09-12T17:23:58.648 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T17:23:58.367+0000 7f4afefc3640 10 monclient(hunting): get_auth_request con 0x5644abc5fad0 auth_method 0 2024-09-12T17:23:58.648 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T17:23:58.367+0000 7f4afefc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:58.648 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T17:23:58.367+0000 7f4afefc3640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:58.648 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T17:23:58.367+0000 7f4afefc3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:58.648 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T17:23:58.367+0000 7f4aff7c4640 10 monclient(hunting): get_auth_request con 0x5644abcf0240 auth_method 0 2024-09-12T17:23:58.648 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T17:23:58.367+0000 7f4aff7c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:58.648 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T17:23:58.367+0000 7f4aff7c4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:58.648 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T17:23:58.367+0000 7f4aff7c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:58.648 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T17:23:58.367+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:58.648 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T17:23:58.367+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:58.648 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T17:23:58.367+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:58.648 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T17:23:58.367+0000 7f4afefc3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:58.648 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T17:23:58.367+0000 7f4afefc3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:58.648 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T17:23:58.367+0000 7f4afefc3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:58.649 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T17:23:58.367+0000 7f4afe7c2640 10 monclient(hunting): get_auth_request con 0x5644abcef8e0 auth_method 0 2024-09-12T17:23:58.649 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T17:23:58.367+0000 7f4afe7c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:58.649 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T17:23:58.367+0000 7f4afe7c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:58.649 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T17:23:58.367+0000 7f4afe7c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:58.649 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T17:23:58.367+0000 7f4afe7c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:58.649 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T17:23:58.367+0000 7f4afe7c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:58.649 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T17:23:58.367+0000 7f4afe7c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:58.649 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T17:23:58.367+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_done global_id 6678 payload 824 2024-09-12T17:23:58.649 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T17:23:58.367+0000 7f4aff7c4640 10 monclient: _finish_hunting 0 2024-09-12T17:23:58.649 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T17:23:58.367+0000 7f4aff7c4640 1 monclient: found mon.noname-a 2024-09-12T17:23:58.649 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T17:23:58.367+0000 7f4aff7c4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:23:58.649 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T17:23:58.368+0000 7f49eb606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:58.650 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T17:23:58.368+0000 7f49eb606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:23:58.650 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T17:23:58.368+0000 7f49eb606640 10 monclient: dump: 2024-09-12T17:23:58.650 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:58.650 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:58.650 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.650 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.650 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:58.650 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:58.650 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:58.650 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:58.650 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:58.650 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.651 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T17:23:58.368+0000 7f49eb606640 10 monclient: _finish_auth 0 2024-09-12T17:23:58.651 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T17:23:58.368+0000 7f49eb606640 10 monclient: _check_auth_tickets 2024-09-12T17:23:58.651 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T17:23:58.368+0000 7f49eb606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:58.651 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T17:23:58.368+0000 7f49eb606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:58.651 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T17:23:58.368+0000 7f49eb606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:23:58.651 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T17:23:58.368+0000 7f49eb606640 10 monclient: dump: 2024-09-12T17:23:58.651 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:58.651 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:58.651 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.651 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.651 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:58.651 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:58.651 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:58.651 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:58.651 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:58.652 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.652 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T17:23:58.368+0000 7f4b03335800 5 monclient: authenticate success, global_id 6678 2024-09-12T17:23:58.652 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T17:23:58.368+0000 7f4b03335800 10 monclient: _renew_subs 2024-09-12T17:23:58.652 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T17:23:58.368+0000 7f4b03335800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:23:58.652 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T17:23:58.368+0000 7f49ece09640 4 set_mon_vals no callback set 2024-09-12T17:23:58.652 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T17:23:58.368+0000 7f4b03335800 10 monclient: _renew_subs 2024-09-12T17:23:58.652 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T17:23:58.368+0000 7f4b03335800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:23:58.652 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T17:23:58.368+0000 7f4b03335800 1 librados: init done 2024-09-12T17:23:58.652 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T17:23:58.370+0000 7f49eb606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:23:58.652 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T17:23:58.370+0000 7f49eb606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:23:58.652 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T17:23:58.370+0000 7f49eb606640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:23:58.652 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T17:23:58.370+0000 7f4afefc3640 10 monclient: get_auth_request con 0x7f49e4076470 auth_method 0 2024-09-12T17:23:58.652 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T17:23:58.370+0000 7f4afe7c2640 10 monclient: get_auth_request con 0x5644abdcece0 auth_method 0 2024-09-12T17:23:58.653 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T17:23:58.371+0000 7f4afefc3640 10 monclient: get_auth_request con 0x5644abdf2cf0 auth_method 0 2024-09-12T17:23:58.653 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T17:23:58.372+0000 7f4afe7c2640 10 monclient: get_auth_request con 0x5644abdf70a0 auth_method 0 2024-09-12T17:23:58.653 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T17:23:58.373+0000 7f4b03335800 10 monclient: build_initial_monmap 2024-09-12T17:23:58.653 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T17:23:58.373+0000 7f4b03335800 1 build_initial for_mkfs: 0 2024-09-12T17:23:58.653 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T17:23:58.373+0000 7f4b03335800 10 monclient: monmap: 2024-09-12T17:23:58.653 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:23:58.653 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:58.653 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:23:58.653 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:23:58.653 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:58.653 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:58.653 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:23:58.653 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:23:58.654 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:23:58.654 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.654 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding auth protocol: cephx 2024-09-12T17:23:58.654 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding auth protocol: cephx 2024-09-12T17:23:58.654 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding auth protocol: cephx 2024-09-12T17:23:58.654 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding con mode: secure 2024-09-12T17:23:58.654 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding con mode: crc 2024-09-12T17:23:58.654 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding con mode: secure 2024-09-12T17:23:58.654 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding con mode: crc 2024-09-12T17:23:58.654 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding con mode: secure 2024-09-12T17:23:58.654 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding con mode: crc 2024-09-12T17:23:58.654 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding con mode: crc 2024-09-12T17:23:58.654 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding con mode: secure 2024-09-12T17:23:58.654 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding con mode: crc 2024-09-12T17:23:58.655 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding con mode: secure 2024-09-12T17:23:58.655 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding con mode: crc 2024-09-12T17:23:58.655 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding con mode: secure 2024-09-12T17:23:58.655 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T17:23:58.373+0000 7f4b03335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:58.655 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 asok(0x5644abb85730) register_command objecter_requests cmddesc objecter_requests hook 0x5644abdff900 EEXIST 2024-09-12T17:23:58.655 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T17:23:58.374+0000 7f4b03335800 10 monclient: init 2024-09-12T17:23:58.655 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding auth protocol: cephx 2024-09-12T17:23:58.655 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding auth protocol: cephx 2024-09-12T17:23:58.655 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding auth protocol: cephx 2024-09-12T17:23:58.655 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding con mode: secure 2024-09-12T17:23:58.655 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding con mode: crc 2024-09-12T17:23:58.655 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding con mode: secure 2024-09-12T17:23:58.655 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding con mode: crc 2024-09-12T17:23:58.655 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding con mode: secure 2024-09-12T17:23:58.656 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding con mode: crc 2024-09-12T17:23:58.656 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding con mode: crc 2024-09-12T17:23:58.656 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding con mode: secure 2024-09-12T17:23:58.656 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding con mode: crc 2024-09-12T17:23:58.656 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding con mode: secure 2024-09-12T17:23:58.656 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding con mode: crc 2024-09-12T17:23:58.656 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding con mode: secure 2024-09-12T17:23:58.656 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T17:23:58.374+0000 7f4b03335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:58.656 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T17:23:58.374+0000 7f4b03335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:58.656 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 asok(0x5644abb85730) register_command rotate-key cmddesc rotate-key hook 0x5644abdfa700 EEXIST 2024-09-12T17:23:58.656 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T17:23:58.374+0000 7f4b03335800 10 monclient: _reopen_session rank -1 2024-09-12T17:23:58.656 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T17:23:58.374+0000 7f4b03335800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:23:58.656 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T17:23:58.374+0000 7f4b03335800 10 monclient(hunting): picked mon.noname-c con 0x5644abe235f0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:23:58.656 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T17:23:58.374+0000 7f4b03335800 10 monclient(hunting): picked mon.noname-a con 0x5644abe258c0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:23:58.657 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T17:23:58.374+0000 7f4b03335800 10 monclient(hunting): picked mon.noname-b con 0x5644abe21dc0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:23:58.657 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T17:23:58.374+0000 7f4b03335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:58.657 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T17:23:58.374+0000 7f4b03335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:58.657 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T17:23:58.374+0000 7f4b03335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:58.657 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T17:23:58.374+0000 7f4b03335800 10 monclient(hunting): _renew_subs 2024-09-12T17:23:58.657 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T17:23:58.374+0000 7f4b03335800 10 monclient(hunting): authenticate will time out at 2249.724660s 2024-09-12T17:23:58.657 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T17:23:58.374+0000 7f4afefc3640 10 monclient(hunting): get_auth_request con 0x5644abe235f0 auth_method 0 2024-09-12T17:23:58.657 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T17:23:58.374+0000 7f4afefc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:58.657 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T17:23:58.374+0000 7f4afefc3640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:58.657 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T17:23:58.374+0000 7f4afefc3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:58.657 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T17:23:58.374+0000 7f4afe7c2640 10 monclient(hunting): get_auth_request con 0x5644abe258c0 auth_method 0 2024-09-12T17:23:58.657 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T17:23:58.374+0000 7f4afe7c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:58.657 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T17:23:58.374+0000 7f4afe7c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:58.658 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T17:23:58.374+0000 7f4afe7c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:58.658 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T17:23:58.374+0000 7f4aff7c4640 10 monclient(hunting): get_auth_request con 0x5644abe21dc0 auth_method 0 2024-09-12T17:23:58.658 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T17:23:58.374+0000 7f4aff7c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:58.658 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T17:23:58.374+0000 7f4aff7c4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:58.658 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T17:23:58.374+0000 7f4aff7c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:58.658 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T17:23:58.374+0000 7f4afefc3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:58.658 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T17:23:58.374+0000 7f4afefc3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:58.658 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T17:23:58.374+0000 7f4afefc3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:58.658 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T17:23:58.374+0000 7f4afe7c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:58.658 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T17:23:58.374+0000 7f4afe7c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:58.658 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T17:23:58.374+0000 7f4afe7c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:58.658 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T17:23:58.374+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:58.658 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T17:23:58.374+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:58.658 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T17:23:58.374+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:58.659 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T17:23:58.375+0000 7f4afefc3640 10 monclient(hunting): handle_auth_done global_id 6287 payload 824 2024-09-12T17:23:58.659 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T17:23:58.375+0000 7f4afefc3640 10 monclient: _finish_hunting 0 2024-09-12T17:23:58.659 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T17:23:58.375+0000 7f4afefc3640 1 monclient: found mon.noname-c 2024-09-12T17:23:58.659 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T17:23:58.375+0000 7f4afefc3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:23:58.659 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T17:23:58.375+0000 7f49e8e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:58.659 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T17:23:58.375+0000 7f49e8e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:23:58.659 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T17:23:58.375+0000 7f49e8e01640 10 monclient: dump: 2024-09-12T17:23:58.659 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:58.659 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:58.659 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.659 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.659 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:58.659 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:58.659 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:58.660 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:58.660 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:58.660 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.660 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T17:23:58.375+0000 7f49e8e01640 10 monclient: _finish_auth 0 2024-09-12T17:23:58.660 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T17:23:58.375+0000 7f49e8e01640 10 monclient: _check_auth_tickets 2024-09-12T17:23:58.660 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T17:23:58.375+0000 7f49e8e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:58.660 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T17:23:58.375+0000 7f49e8e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:58.660 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T17:23:58.375+0000 7f49e8e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:23:58.660 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T17:23:58.375+0000 7f49e8e01640 10 monclient: dump: 2024-09-12T17:23:58.660 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:58.660 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:58.660 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.661 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.661 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:58.661 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:58.661 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:58.661 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:58.661 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:58.661 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.661 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T17:23:58.375+0000 7f4b03335800 5 monclient: authenticate success, global_id 6287 2024-09-12T17:23:58.661 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T17:23:58.375+0000 7f4b03335800 10 monclient: _renew_subs 2024-09-12T17:23:58.661 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T17:23:58.375+0000 7f4b03335800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:23:58.661 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T17:23:58.375+0000 7f4afffc5640 4 set_mon_vals no callback set 2024-09-12T17:23:58.661 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T17:23:58.375+0000 7f4b03335800 10 monclient: _renew_subs 2024-09-12T17:23:58.662 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T17:23:58.375+0000 7f4b03335800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:23:58.662 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T17:23:58.377+0000 7f49e8e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:23:58.662 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T17:23:58.377+0000 7f49e8e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:23:58.662 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T17:23:58.377+0000 7f49e8e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:23:58.662 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T17:23:58.377+0000 7f4b03335800 10 monclient: get_monmap_and_config 2024-09-12T17:23:58.662 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T17:23:58.377+0000 7f4b03335800 10 monclient: build_initial_monmap 2024-09-12T17:23:58.662 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T17:23:58.377+0000 7f4b03335800 1 build_initial for_mkfs: 0 2024-09-12T17:23:58.662 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T17:23:58.377+0000 7f4afe7c2640 10 monclient: get_auth_request con 0x7f49d8076380 auth_method 0 2024-09-12T17:23:58.662 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T17:23:58.377+0000 7f4b03335800 10 monclient: monmap: 2024-09-12T17:23:58.662 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:23:58.662 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:58.662 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:23:58.662 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:23:58.663 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:58.663 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:58.663 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:23:58.663 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:23:58.663 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:23:58.663 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.663 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding auth protocol: cephx 2024-09-12T17:23:58.663 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding auth protocol: cephx 2024-09-12T17:23:58.663 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding auth protocol: cephx 2024-09-12T17:23:58.663 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding con mode: secure 2024-09-12T17:23:58.663 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding con mode: crc 2024-09-12T17:23:58.663 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding con mode: secure 2024-09-12T17:23:58.664 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding con mode: crc 2024-09-12T17:23:58.664 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding con mode: secure 2024-09-12T17:23:58.664 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding con mode: crc 2024-09-12T17:23:58.664 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding con mode: crc 2024-09-12T17:23:58.664 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding con mode: secure 2024-09-12T17:23:58.664 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding con mode: crc 2024-09-12T17:23:58.664 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding con mode: secure 2024-09-12T17:23:58.664 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding con mode: crc 2024-09-12T17:23:58.664 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding con mode: secure 2024-09-12T17:23:58.664 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T17:23:58.377+0000 7f4b03335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:58.664 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T17:23:58.378+0000 7f4b03335800 10 monclient: init 2024-09-12T17:23:58.664 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding auth protocol: cephx 2024-09-12T17:23:58.665 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding auth protocol: cephx 2024-09-12T17:23:58.665 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding auth protocol: cephx 2024-09-12T17:23:58.665 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding con mode: secure 2024-09-12T17:23:58.665 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding con mode: crc 2024-09-12T17:23:58.665 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding con mode: secure 2024-09-12T17:23:58.665 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding con mode: crc 2024-09-12T17:23:58.665 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding con mode: secure 2024-09-12T17:23:58.665 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding con mode: crc 2024-09-12T17:23:58.665 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding con mode: crc 2024-09-12T17:23:58.665 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding con mode: secure 2024-09-12T17:23:58.666 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding con mode: crc 2024-09-12T17:23:58.666 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding con mode: secure 2024-09-12T17:23:58.666 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding con mode: crc 2024-09-12T17:23:58.666 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding con mode: secure 2024-09-12T17:23:58.666 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T17:23:58.378+0000 7f4b03335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:58.666 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T17:23:58.378+0000 7f4b03335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:58.666 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 asok(0x5644abb85730) register_command rotate-key cmddesc rotate-key hook 0x7ffcabbf6918 EEXIST 2024-09-12T17:23:58.666 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T17:23:58.378+0000 7f4b03335800 10 monclient: _reopen_session rank -1 2024-09-12T17:23:58.666 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T17:23:58.378+0000 7f4b03335800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:23:58.666 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T17:23:58.378+0000 7f4b03335800 10 monclient(hunting): picked mon.noname-c con 0x5644abe454f0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:23:58.666 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T17:23:58.378+0000 7f4b03335800 10 monclient(hunting): picked mon.noname-b con 0x5644abe70d20 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:23:58.667 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T17:23:58.378+0000 7f4b03335800 10 monclient(hunting): picked mon.noname-a con 0x5644abe674e0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:23:58.667 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T17:23:58.378+0000 7f4b03335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:58.667 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T17:23:58.378+0000 7f4b03335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:58.667 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T17:23:58.378+0000 7f4b03335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:58.667 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T17:23:58.378+0000 7f4b03335800 10 monclient(hunting): _renew_subs 2024-09-12T17:23:58.667 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T17:23:58.378+0000 7f4b03335800 10 monclient(hunting): authenticate will time out at 2249.728648s 2024-09-12T17:23:58.667 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T17:23:58.378+0000 7f4aff7c4640 10 monclient(hunting): get_auth_request con 0x5644abe674e0 auth_method 0 2024-09-12T17:23:58.667 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T17:23:58.378+0000 7f4aff7c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:58.667 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T17:23:58.378+0000 7f4aff7c4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:58.667 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T17:23:58.378+0000 7f4aff7c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:58.667 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T17:23:58.378+0000 7f4afefc3640 10 monclient(hunting): get_auth_request con 0x5644abe454f0 auth_method 0 2024-09-12T17:23:58.668 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T17:23:58.378+0000 7f4afefc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:58.668 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T17:23:58.378+0000 7f4afefc3640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:58.668 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T17:23:58.378+0000 7f4afefc3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:58.668 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T17:23:58.378+0000 7f4afe7c2640 10 monclient(hunting): get_auth_request con 0x5644abe70d20 auth_method 0 2024-09-12T17:23:58.668 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T17:23:58.378+0000 7f4afe7c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:58.668 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T17:23:58.378+0000 7f4afe7c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:58.668 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T17:23:58.378+0000 7f4afe7c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:58.668 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T17:23:58.378+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:58.668 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T17:23:58.378+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:58.668 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T17:23:58.378+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:58.668 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T17:23:58.378+0000 7f4afefc3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:58.668 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T17:23:58.378+0000 7f4afefc3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:58.668 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T17:23:58.378+0000 7f4afefc3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:58.669 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T17:23:58.378+0000 7f4afe7c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:58.669 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T17:23:58.378+0000 7f4afe7c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:58.669 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T17:23:58.378+0000 7f4afe7c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:58.669 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T17:23:58.378+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_done global_id 6684 payload 274 2024-09-12T17:23:58.669 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T17:23:58.378+0000 7f4aff7c4640 10 monclient: _finish_hunting 0 2024-09-12T17:23:58.669 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T17:23:58.378+0000 7f4aff7c4640 1 monclient: found mon.noname-a 2024-09-12T17:23:58.669 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T17:23:58.378+0000 7f4aff7c4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:23:58.669 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T17:23:58.379+0000 7f49e27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:58.669 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T17:23:58.379+0000 7f49e27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:23:58.669 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T17:23:58.379+0000 7f49e27fc640 10 monclient: dump: 2024-09-12T17:23:58.669 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:58.669 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:58.669 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.669 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.670 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:58.670 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:58.670 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:58.670 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:58.670 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:58.670 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.670 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T17:23:58.379+0000 7f49e27fc640 10 monclient: _finish_auth 0 2024-09-12T17:23:58.670 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T17:23:58.379+0000 7f49e27fc640 10 monclient: _check_auth_tickets 2024-09-12T17:23:58.670 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T17:23:58.379+0000 7f49e27fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:58.670 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T17:23:58.379+0000 7f49e27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:58.670 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T17:23:58.379+0000 7f49e27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:23:58.670 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T17:23:58.379+0000 7f49e27fc640 10 monclient: dump: 2024-09-12T17:23:58.670 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:58.670 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:58.670 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.671 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.671 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:58.671 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:58.671 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:58.671 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:58.671 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:58.671 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.671 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 monclient: authenticate success, global_id 6684 2024-09-12T17:23:58.671 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T17:23:58.379+0000 7f4b03335800 10 monclient: get_monmap_and_config success 2024-09-12T17:23:58.671 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T17:23:58.379+0000 7f4b03335800 4 set_mon_vals no callback set 2024-09-12T17:23:58.671 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T17:23:58.379+0000 7f4b03335800 10 monclient: shutdown 2024-09-12T17:23:58.672 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T17:23:58.379+0000 7f4b03335800 10 monclient: build_initial_monmap 2024-09-12T17:23:58.672 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T17:23:58.379+0000 7f4b03335800 1 build_initial for_mkfs: 0 2024-09-12T17:23:58.672 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T17:23:58.379+0000 7f4b03335800 10 monclient: monmap: 2024-09-12T17:23:58.672 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:23:58.672 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:58.672 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:23:58.672 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:23:58.672 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:58.672 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:58.672 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:23:58.672 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:23:58.672 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:23:58.672 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.672 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding auth protocol: cephx 2024-09-12T17:23:58.673 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding auth protocol: cephx 2024-09-12T17:23:58.673 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding auth protocol: cephx 2024-09-12T17:23:58.673 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding con mode: secure 2024-09-12T17:23:58.673 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding con mode: crc 2024-09-12T17:23:58.673 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding con mode: secure 2024-09-12T17:23:58.673 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding con mode: crc 2024-09-12T17:23:58.673 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding con mode: secure 2024-09-12T17:23:58.673 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding con mode: crc 2024-09-12T17:23:58.673 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding con mode: crc 2024-09-12T17:23:58.673 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding con mode: secure 2024-09-12T17:23:58.673 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding con mode: crc 2024-09-12T17:23:58.673 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding con mode: secure 2024-09-12T17:23:58.674 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding con mode: crc 2024-09-12T17:23:58.674 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding con mode: secure 2024-09-12T17:23:58.674 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T17:23:58.380+0000 7f4b03335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:58.674 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T17:23:58.380+0000 7f4b03335800 1 librados: starting msgr at 2024-09-12T17:23:58.674 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T17:23:58.380+0000 7f4b03335800 1 librados: starting objecter 2024-09-12T17:23:58.674 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 asok(0x5644abb85730) register_command objecter_requests cmddesc objecter_requests hook 0x5644abe46db0 EEXIST 2024-09-12T17:23:58.674 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T17:23:58.380+0000 7f4b03335800 1 librados: setting wanted keys 2024-09-12T17:23:58.674 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T17:23:58.380+0000 7f4b03335800 1 librados: calling monclient init 2024-09-12T17:23:58.674 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T17:23:58.380+0000 7f4b03335800 10 monclient: init 2024-09-12T17:23:58.674 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding auth protocol: cephx 2024-09-12T17:23:58.674 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding auth protocol: cephx 2024-09-12T17:23:58.674 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding auth protocol: cephx 2024-09-12T17:23:58.674 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding con mode: secure 2024-09-12T17:23:58.674 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding con mode: crc 2024-09-12T17:23:58.674 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding con mode: secure 2024-09-12T17:23:58.675 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding con mode: crc 2024-09-12T17:23:58.675 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding con mode: secure 2024-09-12T17:23:58.675 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding con mode: crc 2024-09-12T17:23:58.675 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding con mode: crc 2024-09-12T17:23:58.675 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding con mode: secure 2024-09-12T17:23:58.675 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding con mode: crc 2024-09-12T17:23:58.675 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding con mode: secure 2024-09-12T17:23:58.675 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding con mode: crc 2024-09-12T17:23:58.675 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding con mode: secure 2024-09-12T17:23:58.675 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T17:23:58.380+0000 7f4b03335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:58.675 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T17:23:58.380+0000 7f4b03335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:58.675 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 asok(0x5644abb85730) register_command rotate-key cmddesc rotate-key hook 0x5644abe3b4e8 EEXIST 2024-09-12T17:23:58.675 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T17:23:58.380+0000 7f4b03335800 10 monclient: _reopen_session rank -1 2024-09-12T17:23:58.675 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T17:23:58.380+0000 7f4b03335800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:23:58.675 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T17:23:58.380+0000 7f4b03335800 10 monclient(hunting): picked mon.noname-b con 0x5644abe454f0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:23:58.676 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T17:23:58.380+0000 7f4b03335800 10 monclient(hunting): picked mon.noname-a con 0x5644abe674e0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:23:58.676 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T17:23:58.380+0000 7f4b03335800 10 monclient(hunting): picked mon.noname-c con 0x5644abe70d20 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:23:58.676 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T17:23:58.380+0000 7f4b03335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:58.676 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T17:23:58.380+0000 7f4b03335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:58.676 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T17:23:58.380+0000 7f4b03335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:58.676 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T17:23:58.380+0000 7f4b03335800 10 monclient(hunting): _renew_subs 2024-09-12T17:23:58.676 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T17:23:58.380+0000 7f4b03335800 10 monclient(hunting): authenticate will time out at 2249.730899s 2024-09-12T17:23:58.676 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T17:23:58.381+0000 7f4aff7c4640 10 monclient(hunting): get_auth_request con 0x5644abe70d20 auth_method 0 2024-09-12T17:23:58.676 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T17:23:58.381+0000 7f4aff7c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:58.676 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T17:23:58.381+0000 7f4aff7c4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:58.676 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T17:23:58.381+0000 7f4aff7c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:58.676 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T17:23:58.381+0000 7f4afe7c2640 10 monclient(hunting): get_auth_request con 0x5644abe674e0 auth_method 0 2024-09-12T17:23:58.676 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T17:23:58.381+0000 7f4afe7c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:58.676 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T17:23:58.381+0000 7f4afe7c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:58.677 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T17:23:58.381+0000 7f4afe7c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:58.677 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T17:23:58.381+0000 7f4afefc3640 10 monclient(hunting): get_auth_request con 0x5644abe454f0 auth_method 0 2024-09-12T17:23:58.677 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T17:23:58.381+0000 7f4afefc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:58.677 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T17:23:58.381+0000 7f4afefc3640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:58.677 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T17:23:58.381+0000 7f4afefc3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:58.677 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T17:23:58.381+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:58.677 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T17:23:58.381+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:58.677 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T17:23:58.381+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:58.677 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T17:23:58.381+0000 7f4afe7c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:58.677 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T17:23:58.381+0000 7f4afe7c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:58.677 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T17:23:58.381+0000 7f4afe7c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:58.677 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T17:23:58.381+0000 7f4afefc3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:58.677 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T17:23:58.381+0000 7f4afefc3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:58.677 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T17:23:58.381+0000 7f4afefc3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:58.678 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T17:23:58.381+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_done global_id 6293 payload 824 2024-09-12T17:23:58.678 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T17:23:58.381+0000 7f4aff7c4640 10 monclient: _finish_hunting 0 2024-09-12T17:23:58.678 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T17:23:58.381+0000 7f4aff7c4640 1 monclient: found mon.noname-c 2024-09-12T17:23:58.678 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T17:23:58.381+0000 7f4aff7c4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:23:58.678 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T17:23:58.381+0000 7f49e0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:58.678 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T17:23:58.381+0000 7f49e0ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:23:58.678 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T17:23:58.381+0000 7f49e0ff9640 10 monclient: dump: 2024-09-12T17:23:58.678 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:58.678 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:58.678 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.678 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.678 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:58.678 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:58.678 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:58.679 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:58.679 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:58.679 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.679 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T17:23:58.381+0000 7f49e0ff9640 10 monclient: _finish_auth 0 2024-09-12T17:23:58.679 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T17:23:58.381+0000 7f49e0ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:23:58.679 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T17:23:58.381+0000 7f49e0ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:58.679 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T17:23:58.381+0000 7f49e0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:58.679 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T17:23:58.381+0000 7f49e0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:23:58.679 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T17:23:58.381+0000 7f49e0ff9640 10 monclient: dump: 2024-09-12T17:23:58.679 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:58.679 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:58.680 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.680 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.680 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:58.680 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:58.680 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:58.680 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:58.680 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:58.680 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.680 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T17:23:58.381+0000 7f4b03335800 5 monclient: authenticate success, global_id 6293 2024-09-12T17:23:58.680 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T17:23:58.381+0000 7f49e27fc640 4 set_mon_vals no callback set 2024-09-12T17:23:58.680 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T17:23:58.381+0000 7f4b03335800 10 monclient: _renew_subs 2024-09-12T17:23:58.680 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T17:23:58.381+0000 7f4b03335800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:23:58.681 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T17:23:58.381+0000 7f4b03335800 10 monclient: _renew_subs 2024-09-12T17:23:58.681 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T17:23:58.381+0000 7f4b03335800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:23:58.681 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T17:23:58.381+0000 7f4b03335800 1 librados: init done 2024-09-12T17:23:58.681 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T17:23:58.381+0000 7f4b03335800 5 asok(0x5644abb85730) register_command cr dump hook 0x5644abe6a0d8 2024-09-12T17:23:58.681 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T17:23:58.383+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.681 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T17:23:58.383+0000 7f49e0ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:23:58.681 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T17:23:58.383+0000 7f49e0ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:23:58.681 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T17:23:58.383+0000 7f49e0ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:23:58.681 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T17:23:58.384+0000 7f4afefc3640 10 monclient: get_auth_request con 0x7f49c8076470 auth_method 0 2024-09-12T17:23:58.681 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T17:23:58.384+0000 7f4afe7c2640 10 monclient: get_auth_request con 0x5644abe8fd40 auth_method 0 2024-09-12T17:23:58.681 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T17:23:58.384+0000 7f4b03335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.681 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T17:23:58.384+0000 7f4b03335800 20 realm 2024-09-12T17:23:58.681 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T17:23:58.384+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.682 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T17:23:58.384+0000 7f4b03335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.682 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T17:23:58.384+0000 7f4b03335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:58.682 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T17:23:58.384+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.682 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T17:23:58.385+0000 7f4b03335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.682 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T17:23:58.385+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.682 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T17:23:58.385+0000 7f4afefc3640 10 monclient: get_auth_request con 0x5644abe93f50 auth_method 0 2024-09-12T17:23:58.682 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T17:23:58.385+0000 7f4b03335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:58.682 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T17:23:58.385+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.682 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T17:23:58.386+0000 7f4afe7c2640 10 monclient: get_auth_request con 0x5644abe977b0 auth_method 0 2024-09-12T17:23:58.682 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T17:23:58.386+0000 7f4b03335800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:58.682 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T17:23:58.386+0000 7f4b03335800 20 searching for the correct realm 2024-09-12T17:23:58.682 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T17:23:58.386+0000 7f4aff7c4640 10 monclient: get_auth_request con 0x5644abe9c280 auth_method 0 2024-09-12T17:23:58.682 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T17:23:58.387+0000 7f4afefc3640 10 monclient: get_auth_request con 0x7f4af808cbf0 auth_method 0 2024-09-12T17:23:58.683 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T17:23:58.388+0000 7f4afe7c2640 10 monclient: get_auth_request con 0x7f4af0070c20 auth_method 0 2024-09-12T17:23:58.683 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T17:23:58.389+0000 7f4afe7c2640 0 -- 172.21.15.67:0/1767224406 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x5644abe977b0 msgr2=0x5644abe99ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:58.683 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T17:23:58.389+0000 7f49e0ff9640 1 client.6293.objecter ms_handle_reset 0x5644abe977b0 session 0x5644abe932e0 osd.4 2024-09-12T17:23:58.683 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T17:23:58.389+0000 7f49e0ff9640 10 monclient: _renew_subs 2024-09-12T17:23:58.683 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T17:23:58.389+0000 7f49e0ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:23:58.683 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T17:23:58.389+0000 7f4afe7c2640 10 monclient: get_auth_request con 0x7f49c8086310 auth_method 0 2024-09-12T17:23:58.683 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T17:23:58.390+0000 7f4aff7c4640 10 monclient: get_auth_request con 0x7f4af406d040 auth_method 0 2024-09-12T17:23:58.683 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T17:23:58.392+0000 7f4afefc3640 10 monclient: get_auth_request con 0x7f4af408cc10 auth_method 0 2024-09-12T17:23:58.683 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T17:23:58.392+0000 7f4afefc3640 0 -- 172.21.15.67:0/1767224406 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f4af408cc10 msgr2=0x7f4af406e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:58.683 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T17:23:58.594+0000 7f4afefc3640 10 monclient: get_auth_request con 0x7f4af408cc10 auth_method 0 2024-09-12T17:23:58.683 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T17:23:58.599+0000 7f4b03335800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:58.683 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T17:23:58.599+0000 7f4b03335800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:58.684 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T17:23:58.599+0000 7f4b03335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:58.684 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T17:23:58.599+0000 7f4b03335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:58.684 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T17:23:58.599+0000 7f4b03335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:58.684 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T17:23:58.599+0000 7f4b03335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:58.684 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T17:23:58.599+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.684 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T17:23:58.599+0000 7f4b03335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.684 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T17:23:58.599+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.684 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T17:23:58.599+0000 7f4b03335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:58.684 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T17:23:58.599+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.684 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T17:23:58.600+0000 7f4b03335800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:58.684 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T17:23:58.600+0000 7f4b03335800 20 zone default found 2024-09-12T17:23:58.684 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T17:23:58.600+0000 7f4b03335800 4 Realm: () 2024-09-12T17:23:58.685 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T17:23:58.600+0000 7f4b03335800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:58.685 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T17:23:58.600+0000 7f4b03335800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:58.685 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T17:23:58.600+0000 7f4b03335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:58.685 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T17:23:58.600+0000 7f4b03335800 20 zonegroup default 2024-09-12T17:23:58.685 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T17:23:58.600+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.685 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T17:23:58.600+0000 7f4b03335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.685 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T17:23:58.600+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.685 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T17:23:58.600+0000 7f4b03335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.685 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T17:23:58.600+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.685 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T17:23:58.600+0000 7f4b03335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.685 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T17:23:58.600+0000 7f4b03335800 20 started sync module instance, tier type = 2024-09-12T17:23:58.685 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T17:23:58.600+0000 7f4b03335800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:58.685 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T17:23:58.610+0000 7f4b03335800 20 add_watcher() i=0 2024-09-12T17:23:58.686 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T17:23:58.610+0000 7f4b03335800 20 add_watcher() i=1 2024-09-12T17:23:58.686 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T17:23:58.610+0000 7f4b03335800 20 add_watcher() i=2 2024-09-12T17:23:58.686 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T17:23:58.610+0000 7f4b03335800 20 add_watcher() i=3 2024-09-12T17:23:58.686 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T17:23:58.610+0000 7f4b03335800 20 add_watcher() i=4 2024-09-12T17:23:58.686 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T17:23:58.610+0000 7f4b03335800 20 add_watcher() i=5 2024-09-12T17:23:58.686 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T17:23:58.610+0000 7f4b03335800 20 add_watcher() i=6 2024-09-12T17:23:58.686 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T17:23:58.611+0000 7f4b03335800 20 add_watcher() i=7 2024-09-12T17:23:58.686 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T17:23:58.611+0000 7f4b03335800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:58.686 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T17:23:58.612+0000 7f49e0ff9640 1 client.6293.objecter ms_handle_reset 0x5644abe8fd40 session 0x5644abe8f6c0 osd.1 2024-09-12T17:23:58.686 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T17:23:58.612+0000 7f4afe7c2640 10 monclient: get_auth_request con 0x5644abe977b0 auth_method 0 2024-09-12T17:23:58.686 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding auth protocol: cephx 2024-09-12T17:23:58.686 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding auth protocol: cephx 2024-09-12T17:23:58.686 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding auth protocol: cephx 2024-09-12T17:23:58.687 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding con mode: secure 2024-09-12T17:23:58.687 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding con mode: crc 2024-09-12T17:23:58.687 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding con mode: secure 2024-09-12T17:23:58.687 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding con mode: crc 2024-09-12T17:23:58.687 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding con mode: secure 2024-09-12T17:23:58.687 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding con mode: crc 2024-09-12T17:23:58.687 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding con mode: crc 2024-09-12T17:23:58.687 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding con mode: secure 2024-09-12T17:23:58.687 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T17:23:58.613+0000 7f49b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:58.687 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding con mode: crc 2024-09-12T17:23:58.687 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding con mode: secure 2024-09-12T17:23:58.687 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding con mode: crc 2024-09-12T17:23:58.687 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding con mode: secure 2024-09-12T17:23:58.687 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T17:23:58.614+0000 7f4b03335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:58.688 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T17:23:58.614+0000 7f4b03335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:58.688 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T17:23:58.614+0000 7f4b03335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:58.688 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T17:23:58.614+0000 7f4b03335800 5 asok(0x5644abb85730) register_command cache list hook 0x5644abe6bb10 2024-09-12T17:23:58.688 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T17:23:58.614+0000 7f4b03335800 5 asok(0x5644abb85730) register_command cache inspect hook 0x5644abe6bb10 2024-09-12T17:23:58.688 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T17:23:58.614+0000 7f4b03335800 5 asok(0x5644abb85730) register_command cache erase hook 0x5644abe6bb10 2024-09-12T17:23:58.688 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T17:23:58.614+0000 7f4b03335800 5 asok(0x5644abb85730) register_command cache zap hook 0x5644abe6bb10 2024-09-12T17:23:58.688 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T17:23:58.614+0000 7f4b03335800 5 note: GC not initialized 2024-09-12T17:23:58.688 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T17:23:58.614+0000 7f492ffff640 20 reqs_thread_entry: start 2024-09-12T17:23:58.688 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T17:23:58.614+0000 7f4b03335800 5 asok(0x5644abb85730) register_command sync trace show hook 0x7f4af8004670 2024-09-12T17:23:58.688 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T17:23:58.614+0000 7f4b03335800 5 asok(0x5644abb85730) register_command sync trace history hook 0x7f4af8004670 2024-09-12T17:23:58.688 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T17:23:58.614+0000 7f4b03335800 5 asok(0x5644abb85730) register_command sync trace active hook 0x7f4af8004670 2024-09-12T17:23:58.688 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T17:23:58.614+0000 7f4b03335800 5 asok(0x5644abb85730) register_command sync trace active_short hook 0x7f4af8004670 2024-09-12T17:23:58.689 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T17:23:58.614+0000 7f4b03335800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:58.689 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T17:23:58.614+0000 7f4b03335800 20 Filter name: none 2024-09-12T17:23:58.689 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T17:23:58.614+0000 7f492dffb640 20 reqs_thread_entry: start 2024-09-12T17:23:58.689 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T17:23:58.614+0000 7f4b03335800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:23:58.689 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T17:23:58.614+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.689 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T17:23:58.615+0000 7f4b03335800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:23:58.689 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T17:23:58.615+0000 7f4b03335800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:23:58.689 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T17:23:58.615+0000 7f4b03335800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:23:58.689 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T17:23:58.615+0000 7f4b03335800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 : miss 2024-09-12T17:23:58.689 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T17:23:58.615+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.689 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T17:23:58.615+0000 7f4b03335800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:23:58.689 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T17:23:58.615+0000 7f4b03335800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 info.flags=0x17 2024-09-12T17:23:58.689 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T17:23:58.615+0000 7f4b03335800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 to cache LRU end 2024-09-12T17:23:58.690 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T17:23:58.615+0000 7f4b03335800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:58.690 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T17:23:58.615+0000 7f4b03335800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:58.690 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T17:23:58.615+0000 7f4b03335800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 2024-09-12T17:23:58.690 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T17:23:58.619+0000 7f4b03335800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4b03335800 time 2024-09-12T17:23:58.619129+0000 2024-09-12T17:23:58.690 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:23:58.690 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.690 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:58.690 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4b0498c71a] 2024-09-12T17:23:58.690 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4b0498c8d8] 2024-09-12T17:23:58.690 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644aa7b2841] 2024-09-12T17:23:58.690 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd73ca8) [0x5644aacbfca8] 2024-09-12T17:23:58.690 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5644aa7c250d] 2024-09-12T17:23:58.690 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:23:58.690 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4b03629590] 2024-09-12T17:23:58.690 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:23:58.691 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:23:58.691 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.691 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T17:23:58.620+0000 7f4b03335800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:23:58.691 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f4b03335800 thread_name:radosgw-admin 2024-09-12T17:23:58.691 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.691 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:58.691 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4b0363e6f0] 2024-09-12T17:23:58.691 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4b0368b99c] 2024-09-12T17:23:58.691 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:23:58.691 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:23:58.691 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4b0498c774] 2024-09-12T17:23:58.691 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4b0498c8d8] 2024-09-12T17:23:58.691 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644aa7b2841] 2024-09-12T17:23:58.691 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd73ca8) [0x5644aacbfca8] 2024-09-12T17:23:58.691 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5644aa7c250d] 2024-09-12T17:23:58.692 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:23:58.692 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4b03629590] 2024-09-12T17:23:58.692 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:23:58.692 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:23:58.692 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:23:58.692 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.692 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T17:23:58.692 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T17:23:58.692 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T17:23:58.692 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T17:23:58.692 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T17:23:58.692 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T17:23:58.692 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T17:23:58.692 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T17:23:58.693 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T17:23:58.693 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T17:23:58.693 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T17:23:58.693 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T17:23:58.693 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T17:23:58.693 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T17:23:58.693 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T17:23:58.693 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T17:23:58.693 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T17:23:58.693 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T17:23:58.693 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T17:23:58.693 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T17:23:58.693 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T17:23:58.693 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T17:23:58.694 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T17:23:58.694 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T17:23:58.694 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:23:58.694 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T17:23:58.694 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T17:23:58.694 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T17:23:58.694 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T17:23:58.694 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T17:23:58.694 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T17:23:58.694 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T17:23:58.694 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T17:23:58.694 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T17:23:58.694 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T17:23:58.694 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T17:23:58.695 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T17:23:58.695 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T17:23:58.695 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T17:23:58.695 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T17:23:58.695 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T17:23:58.695 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T17:23:58.695 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T17:23:58.695 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T17:23:58.695 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T17:23:58.695 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T17:23:58.695 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:23:58.695 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T17:23:58.695 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:23:58.695 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T17:23:58.695 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T17:23:58.696 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T17:23:58.696 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T17:23:58.696 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T17:23:58.696 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T17:23:58.696 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T17:23:58.696 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T17:23:58.696 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T17:23:58.696 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T17:23:58.696 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T17:23:58.696 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T17:23:58.696 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T17:23:58.696 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T17:23:58.696 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T17:23:58.696 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T17:23:58.696 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T17:23:58.697 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T17:23:58.697 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:23:58.697 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T17:23:58.697 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:23:58.697 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T17:23:58.697 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T17:23:58.697 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T17:23:58.697 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T17:23:58.697 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T17:23:58.697 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T17:23:58.697 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:23:58.697 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T17:23:58.697 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T17:23:58.697 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:23:58.698 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T17:23:58.698 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T17:23:58.698 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T17:23:58.698 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T17:23:58.698 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T17:23:58.698 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T17:23:58.698 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T17:23:58.698 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T17:23:58.698 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T17:23:58.698 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T17:23:58.698 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T17:23:58.698 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T17:23:58.698 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T17:23:58.698 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:23:58.698 INFO:tasks.workunit.client.0.smithi067.stderr: 7f492dffb640 / http_manager 2024-09-12T17:23:58.699 INFO:tasks.workunit.client.0.smithi067.stderr: 7f492ffff640 / http_manager 2024-09-12T17:23:58.699 INFO:tasks.workunit.client.0.smithi067.stderr: 7f49b57e2640 / rgw_dt_lg_renew 2024-09-12T17:23:58.699 INFO:tasks.workunit.client.0.smithi067.stderr: 7f49e0ff9640 / ms_dispatch 2024-09-12T17:23:58.699 INFO:tasks.workunit.client.0.smithi067.stderr: 7f49e27fc640 / io_context_pool 2024-09-12T17:23:58.699 INFO:tasks.workunit.client.0.smithi067.stderr: 7f49e8e01640 / ms_dispatch 2024-09-12T17:23:58.699 INFO:tasks.workunit.client.0.smithi067.stderr: 7f49eb606640 / ms_dispatch 2024-09-12T17:23:58.699 INFO:tasks.workunit.client.0.smithi067.stderr: 7f49ece09640 / io_context_pool 2024-09-12T17:23:58.699 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4afe7c2640 / msgr-worker-2 2024-09-12T17:23:58.699 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4afefc3640 / msgr-worker-1 2024-09-12T17:23:58.699 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4aff7c4640 / msgr-worker-0 2024-09-12T17:23:58.699 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4afffc5640 / io_context_pool 2024-09-12T17:23:58.699 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4b03335800 / radosgw-admin 2024-09-12T17:23:58.699 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T17:23:58.699 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T17:23:58.700 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/log/ceph/ceph-client.admin.100376.log 2024-09-12T17:23:58.700 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T17:23:58.700 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T17:23:58.700 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T17:23:58.365+0000 7f49ece09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:58.700 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T17:23:58.365+0000 7f49ece09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:23:58.700 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T17:23:58.365+0000 7f49ece09640 10 monclient: dump: 2024-09-12T17:23:58.700 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:58.700 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:58.700 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.700 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.700 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:58.700 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:58.700 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:58.700 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:58.701 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:58.701 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.701 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T17:23:58.365+0000 7f4b03335800 5 monclient: authenticate success, global_id 6281 2024-09-12T17:23:58.701 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T17:23:58.365+0000 7f4b03335800 10 monclient: get_monmap_and_config success 2024-09-12T17:23:58.701 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T17:23:58.365+0000 7f4b03335800 4 set_mon_vals no callback set 2024-09-12T17:23:58.701 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T17:23:58.366+0000 7f4b03335800 10 monclient: shutdown 2024-09-12T17:23:58.701 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 asok(0x5644abb85730) unregister_commands rotate-key 2024-09-12T17:23:58.701 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T17:23:58.366+0000 7f4b03335800 10 monclient: build_initial_monmap 2024-09-12T17:23:58.701 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T17:23:58.366+0000 7f4b03335800 1 build_initial for_mkfs: 0 2024-09-12T17:23:58.701 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T17:23:58.366+0000 7f4b03335800 10 monclient: monmap: 2024-09-12T17:23:58.701 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:23:58.701 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:58.701 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:23:58.701 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:23:58.701 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:58.702 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:58.702 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:23:58.702 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:23:58.702 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:23:58.702 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.702 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding auth protocol: cephx 2024-09-12T17:23:58.702 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding auth protocol: cephx 2024-09-12T17:23:58.702 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding auth protocol: cephx 2024-09-12T17:23:58.702 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding con mode: secure 2024-09-12T17:23:58.702 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding con mode: crc 2024-09-12T17:23:58.702 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding con mode: secure 2024-09-12T17:23:58.702 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding con mode: crc 2024-09-12T17:23:58.702 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding con mode: secure 2024-09-12T17:23:58.702 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding con mode: crc 2024-09-12T17:23:58.703 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding con mode: crc 2024-09-12T17:23:58.703 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding con mode: secure 2024-09-12T17:23:58.703 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding con mode: crc 2024-09-12T17:23:58.703 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding con mode: secure 2024-09-12T17:23:58.703 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding con mode: crc 2024-09-12T17:23:58.703 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abdac2d0) adding con mode: secure 2024-09-12T17:23:58.703 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T17:23:58.366+0000 7f4b03335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:58.703 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T17:23:58.366+0000 7f4b03335800 1 librados: starting msgr at 2024-09-12T17:23:58.703 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T17:23:58.366+0000 7f4b03335800 1 librados: starting objecter 2024-09-12T17:23:58.703 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 asok(0x5644abb85730) register_command objecter_requests hook 0x5644abdabdd0 2024-09-12T17:23:58.703 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T17:23:58.366+0000 7f4b03335800 1 librados: setting wanted keys 2024-09-12T17:23:58.703 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T17:23:58.366+0000 7f4b03335800 1 librados: calling monclient init 2024-09-12T17:23:58.703 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T17:23:58.366+0000 7f4b03335800 10 monclient: init 2024-09-12T17:23:58.704 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding auth protocol: cephx 2024-09-12T17:23:58.704 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding auth protocol: cephx 2024-09-12T17:23:58.704 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding auth protocol: cephx 2024-09-12T17:23:58.704 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding con mode: secure 2024-09-12T17:23:58.704 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding con mode: crc 2024-09-12T17:23:58.704 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding con mode: secure 2024-09-12T17:23:58.704 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding con mode: crc 2024-09-12T17:23:58.704 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding con mode: secure 2024-09-12T17:23:58.704 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding con mode: crc 2024-09-12T17:23:58.704 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding con mode: crc 2024-09-12T17:23:58.704 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding con mode: secure 2024-09-12T17:23:58.704 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding con mode: crc 2024-09-12T17:23:58.705 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding con mode: secure 2024-09-12T17:23:58.705 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding con mode: crc 2024-09-12T17:23:58.705 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T17:23:58.366+0000 7f4b03335800 5 AuthRegistry(0x5644abda6b50) adding con mode: secure 2024-09-12T17:23:58.705 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T17:23:58.367+0000 7f4b03335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:58.705 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T17:23:58.367+0000 7f4b03335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:58.705 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T17:23:58.367+0000 7f4b03335800 5 asok(0x5644abb85730) register_command rotate-key hook 0x5644abda6c98 2024-09-12T17:23:58.705 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T17:23:58.367+0000 7f4b03335800 10 monclient: _reopen_session rank -1 2024-09-12T17:23:58.705 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T17:23:58.367+0000 7f4b03335800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:23:58.705 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T17:23:58.367+0000 7f4b03335800 10 monclient(hunting): picked mon.noname-c con 0x5644abc5fad0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:23:58.705 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T17:23:58.367+0000 7f4b03335800 10 monclient(hunting): picked mon.noname-b con 0x5644abcef8e0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:23:58.705 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T17:23:58.367+0000 7f4b03335800 10 monclient(hunting): picked mon.noname-a con 0x5644abcf0240 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:23:58.705 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T17:23:58.367+0000 7f4b03335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:58.705 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T17:23:58.367+0000 7f4b03335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:58.705 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T17:23:58.367+0000 7f4b03335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:58.706 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T17:23:58.367+0000 7f4b03335800 10 monclient(hunting): _renew_subs 2024-09-12T17:23:58.706 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T17:23:58.367+0000 7f4b03335800 10 monclient(hunting): authenticate will time out at 2249.717462s 2024-09-12T17:23:58.706 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T17:23:58.367+0000 7f4afefc3640 10 monclient(hunting): get_auth_request con 0x5644abc5fad0 auth_method 0 2024-09-12T17:23:58.706 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T17:23:58.367+0000 7f4afefc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:58.706 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T17:23:58.367+0000 7f4afefc3640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:58.706 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T17:23:58.367+0000 7f4afefc3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:58.706 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T17:23:58.367+0000 7f4aff7c4640 10 monclient(hunting): get_auth_request con 0x5644abcf0240 auth_method 0 2024-09-12T17:23:58.706 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T17:23:58.367+0000 7f4aff7c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:58.706 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T17:23:58.367+0000 7f4aff7c4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:58.706 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T17:23:58.367+0000 7f4aff7c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:58.706 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T17:23:58.367+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:58.706 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T17:23:58.367+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:58.706 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T17:23:58.367+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:58.706 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T17:23:58.367+0000 7f4afefc3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:58.706 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T17:23:58.367+0000 7f4afefc3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:58.707 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T17:23:58.367+0000 7f4afefc3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:58.707 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T17:23:58.367+0000 7f4afe7c2640 10 monclient(hunting): get_auth_request con 0x5644abcef8e0 auth_method 0 2024-09-12T17:23:58.707 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T17:23:58.367+0000 7f4afe7c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:58.707 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T17:23:58.367+0000 7f4afe7c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:58.707 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T17:23:58.367+0000 7f4afe7c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:58.707 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T17:23:58.367+0000 7f4afe7c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:58.707 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T17:23:58.367+0000 7f4afe7c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:58.707 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T17:23:58.367+0000 7f4afe7c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:58.707 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T17:23:58.367+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_done global_id 6678 payload 824 2024-09-12T17:23:58.707 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T17:23:58.367+0000 7f4aff7c4640 10 monclient: _finish_hunting 0 2024-09-12T17:23:58.707 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T17:23:58.367+0000 7f4aff7c4640 1 monclient: found mon.noname-a 2024-09-12T17:23:58.707 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T17:23:58.367+0000 7f4aff7c4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:23:58.707 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T17:23:58.368+0000 7f49eb606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:58.707 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T17:23:58.368+0000 7f49eb606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:23:58.707 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T17:23:58.368+0000 7f49eb606640 10 monclient: dump: 2024-09-12T17:23:58.708 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:58.708 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:58.708 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.708 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.708 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:58.708 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:58.708 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:58.708 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:58.708 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:58.708 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.708 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T17:23:58.368+0000 7f49eb606640 10 monclient: _finish_auth 0 2024-09-12T17:23:58.708 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T17:23:58.368+0000 7f49eb606640 10 monclient: _check_auth_tickets 2024-09-12T17:23:58.708 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T17:23:58.368+0000 7f49eb606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:58.709 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T17:23:58.368+0000 7f49eb606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:58.709 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T17:23:58.368+0000 7f49eb606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:23:58.709 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T17:23:58.368+0000 7f49eb606640 10 monclient: dump: 2024-09-12T17:23:58.709 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:58.709 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:58.709 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.709 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.709 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:58.709 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:58.709 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:58.709 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:58.709 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:58.709 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.709 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T17:23:58.368+0000 7f4b03335800 5 monclient: authenticate success, global_id 6678 2024-09-12T17:23:58.710 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T17:23:58.368+0000 7f4b03335800 10 monclient: _renew_subs 2024-09-12T17:23:58.710 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T17:23:58.368+0000 7f4b03335800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:23:58.710 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T17:23:58.368+0000 7f49ece09640 4 set_mon_vals no callback set 2024-09-12T17:23:58.710 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T17:23:58.368+0000 7f4b03335800 10 monclient: _renew_subs 2024-09-12T17:23:58.710 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T17:23:58.368+0000 7f4b03335800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:23:58.710 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T17:23:58.368+0000 7f4b03335800 1 librados: init done 2024-09-12T17:23:58.710 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T17:23:58.370+0000 7f49eb606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:23:58.710 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T17:23:58.370+0000 7f49eb606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:23:58.710 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T17:23:58.370+0000 7f49eb606640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:23:58.710 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T17:23:58.370+0000 7f4afefc3640 10 monclient: get_auth_request con 0x7f49e4076470 auth_method 0 2024-09-12T17:23:58.710 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T17:23:58.370+0000 7f4afe7c2640 10 monclient: get_auth_request con 0x5644abdcece0 auth_method 0 2024-09-12T17:23:58.710 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T17:23:58.371+0000 7f4afefc3640 10 monclient: get_auth_request con 0x5644abdf2cf0 auth_method 0 2024-09-12T17:23:58.711 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T17:23:58.372+0000 7f4afe7c2640 10 monclient: get_auth_request con 0x5644abdf70a0 auth_method 0 2024-09-12T17:23:58.711 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T17:23:58.373+0000 7f4b03335800 10 monclient: build_initial_monmap 2024-09-12T17:23:58.711 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T17:23:58.373+0000 7f4b03335800 1 build_initial for_mkfs: 0 2024-09-12T17:23:58.711 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T17:23:58.373+0000 7f4b03335800 10 monclient: monmap: 2024-09-12T17:23:58.711 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:23:58.711 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:58.711 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:23:58.711 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:23:58.711 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:58.711 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:58.711 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:23:58.711 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:23:58.711 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:23:58.711 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.711 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding auth protocol: cephx 2024-09-12T17:23:58.712 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding auth protocol: cephx 2024-09-12T17:23:58.712 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding auth protocol: cephx 2024-09-12T17:23:58.712 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding con mode: secure 2024-09-12T17:23:58.712 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding con mode: crc 2024-09-12T17:23:58.712 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding con mode: secure 2024-09-12T17:23:58.712 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding con mode: crc 2024-09-12T17:23:58.712 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding con mode: secure 2024-09-12T17:23:58.712 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding con mode: crc 2024-09-12T17:23:58.712 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding con mode: crc 2024-09-12T17:23:58.712 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding con mode: secure 2024-09-12T17:23:58.712 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding con mode: crc 2024-09-12T17:23:58.712 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding con mode: secure 2024-09-12T17:23:58.712 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding con mode: crc 2024-09-12T17:23:58.712 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T17:23:58.373+0000 7f4b03335800 5 AuthRegistry(0x5644abdfbf30) adding con mode: secure 2024-09-12T17:23:58.712 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T17:23:58.373+0000 7f4b03335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:58.713 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 asok(0x5644abb85730) register_command objecter_requests cmddesc objecter_requests hook 0x5644abdff900 EEXIST 2024-09-12T17:23:58.713 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T17:23:58.374+0000 7f4b03335800 10 monclient: init 2024-09-12T17:23:58.713 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding auth protocol: cephx 2024-09-12T17:23:58.713 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding auth protocol: cephx 2024-09-12T17:23:58.713 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding auth protocol: cephx 2024-09-12T17:23:58.713 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding con mode: secure 2024-09-12T17:23:58.713 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding con mode: crc 2024-09-12T17:23:58.713 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding con mode: secure 2024-09-12T17:23:58.713 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding con mode: crc 2024-09-12T17:23:58.713 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding con mode: secure 2024-09-12T17:23:58.713 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding con mode: crc 2024-09-12T17:23:58.713 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding con mode: crc 2024-09-12T17:23:58.713 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding con mode: secure 2024-09-12T17:23:58.714 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding con mode: crc 2024-09-12T17:23:58.714 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding con mode: secure 2024-09-12T17:23:58.714 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding con mode: crc 2024-09-12T17:23:58.714 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 AuthRegistry(0x5644abdfa5b8) adding con mode: secure 2024-09-12T17:23:58.714 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T17:23:58.374+0000 7f4b03335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:58.714 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T17:23:58.374+0000 7f4b03335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:58.714 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T17:23:58.374+0000 7f4b03335800 5 asok(0x5644abb85730) register_command rotate-key cmddesc rotate-key hook 0x5644abdfa700 EEXIST 2024-09-12T17:23:58.714 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T17:23:58.374+0000 7f4b03335800 10 monclient: _reopen_session rank -1 2024-09-12T17:23:58.714 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T17:23:58.374+0000 7f4b03335800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:23:58.714 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T17:23:58.374+0000 7f4b03335800 10 monclient(hunting): picked mon.noname-c con 0x5644abe235f0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:23:58.714 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T17:23:58.374+0000 7f4b03335800 10 monclient(hunting): picked mon.noname-a con 0x5644abe258c0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:23:58.714 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T17:23:58.374+0000 7f4b03335800 10 monclient(hunting): picked mon.noname-b con 0x5644abe21dc0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:23:58.714 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T17:23:58.374+0000 7f4b03335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:58.714 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T17:23:58.374+0000 7f4b03335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:58.715 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T17:23:58.374+0000 7f4b03335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:58.715 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T17:23:58.374+0000 7f4b03335800 10 monclient(hunting): _renew_subs 2024-09-12T17:23:58.715 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T17:23:58.374+0000 7f4b03335800 10 monclient(hunting): authenticate will time out at 2249.724660s 2024-09-12T17:23:58.715 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T17:23:58.374+0000 7f4afefc3640 10 monclient(hunting): get_auth_request con 0x5644abe235f0 auth_method 0 2024-09-12T17:23:58.715 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T17:23:58.374+0000 7f4afefc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:58.715 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T17:23:58.374+0000 7f4afefc3640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:58.715 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T17:23:58.374+0000 7f4afefc3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:58.715 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T17:23:58.374+0000 7f4afe7c2640 10 monclient(hunting): get_auth_request con 0x5644abe258c0 auth_method 0 2024-09-12T17:23:58.715 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T17:23:58.374+0000 7f4afe7c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:58.715 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T17:23:58.374+0000 7f4afe7c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:58.715 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T17:23:58.374+0000 7f4afe7c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:58.715 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T17:23:58.374+0000 7f4aff7c4640 10 monclient(hunting): get_auth_request con 0x5644abe21dc0 auth_method 0 2024-09-12T17:23:58.715 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T17:23:58.374+0000 7f4aff7c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:58.715 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T17:23:58.374+0000 7f4aff7c4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:58.715 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T17:23:58.374+0000 7f4aff7c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:58.716 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T17:23:58.374+0000 7f4afefc3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:58.716 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T17:23:58.374+0000 7f4afefc3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:58.716 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T17:23:58.374+0000 7f4afefc3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:58.716 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T17:23:58.374+0000 7f4afe7c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:58.716 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T17:23:58.374+0000 7f4afe7c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:58.716 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T17:23:58.374+0000 7f4afe7c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:58.716 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T17:23:58.374+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:58.716 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T17:23:58.374+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:58.716 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T17:23:58.374+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:58.716 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T17:23:58.375+0000 7f4afefc3640 10 monclient(hunting): handle_auth_done global_id 6287 payload 824 2024-09-12T17:23:58.716 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T17:23:58.375+0000 7f4afefc3640 10 monclient: _finish_hunting 0 2024-09-12T17:23:58.716 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T17:23:58.375+0000 7f4afefc3640 1 monclient: found mon.noname-c 2024-09-12T17:23:58.716 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T17:23:58.375+0000 7f4afefc3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:23:58.716 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T17:23:58.375+0000 7f49e8e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:58.716 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T17:23:58.375+0000 7f49e8e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:23:58.717 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T17:23:58.375+0000 7f49e8e01640 10 monclient: dump: 2024-09-12T17:23:58.717 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:58.717 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:58.717 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.717 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.717 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:58.717 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:58.717 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:58.717 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:58.717 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:58.717 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.717 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T17:23:58.375+0000 7f49e8e01640 10 monclient: _finish_auth 0 2024-09-12T17:23:58.717 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T17:23:58.375+0000 7f49e8e01640 10 monclient: _check_auth_tickets 2024-09-12T17:23:58.717 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T17:23:58.375+0000 7f49e8e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:58.717 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T17:23:58.375+0000 7f49e8e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:58.718 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T17:23:58.375+0000 7f49e8e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:23:58.718 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T17:23:58.375+0000 7f49e8e01640 10 monclient: dump: 2024-09-12T17:23:58.718 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:58.718 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:58.718 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.718 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.718 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:58.718 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:58.718 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:58.718 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:58.718 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:58.718 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.718 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T17:23:58.375+0000 7f4b03335800 5 monclient: authenticate success, global_id 6287 2024-09-12T17:23:58.718 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T17:23:58.375+0000 7f4b03335800 10 monclient: _renew_subs 2024-09-12T17:23:58.718 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T17:23:58.375+0000 7f4b03335800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:23:58.719 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T17:23:58.375+0000 7f4afffc5640 4 set_mon_vals no callback set 2024-09-12T17:23:58.719 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T17:23:58.375+0000 7f4b03335800 10 monclient: _renew_subs 2024-09-12T17:23:58.719 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T17:23:58.375+0000 7f4b03335800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:23:58.719 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T17:23:58.377+0000 7f49e8e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:23:58.719 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T17:23:58.377+0000 7f49e8e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:23:58.719 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T17:23:58.377+0000 7f49e8e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:23:58.719 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T17:23:58.377+0000 7f4b03335800 10 monclient: get_monmap_and_config 2024-09-12T17:23:58.719 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T17:23:58.377+0000 7f4b03335800 10 monclient: build_initial_monmap 2024-09-12T17:23:58.719 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T17:23:58.377+0000 7f4b03335800 1 build_initial for_mkfs: 0 2024-09-12T17:23:58.719 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T17:23:58.377+0000 7f4afe7c2640 10 monclient: get_auth_request con 0x7f49d8076380 auth_method 0 2024-09-12T17:23:58.719 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T17:23:58.377+0000 7f4b03335800 10 monclient: monmap: 2024-09-12T17:23:58.719 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:23:58.719 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:58.719 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:23:58.720 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:23:58.720 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:58.720 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:58.720 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:23:58.720 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:23:58.720 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:23:58.720 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.720 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding auth protocol: cephx 2024-09-12T17:23:58.720 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding auth protocol: cephx 2024-09-12T17:23:58.720 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding auth protocol: cephx 2024-09-12T17:23:58.720 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding con mode: secure 2024-09-12T17:23:58.720 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding con mode: crc 2024-09-12T17:23:58.720 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding con mode: secure 2024-09-12T17:23:58.720 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding con mode: crc 2024-09-12T17:23:58.720 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding con mode: secure 2024-09-12T17:23:58.721 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding con mode: crc 2024-09-12T17:23:58.721 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding con mode: crc 2024-09-12T17:23:58.721 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding con mode: secure 2024-09-12T17:23:58.721 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding con mode: crc 2024-09-12T17:23:58.721 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding con mode: secure 2024-09-12T17:23:58.721 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding con mode: crc 2024-09-12T17:23:58.721 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T17:23:58.377+0000 7f4b03335800 5 AuthRegistry(0x5644abdd2ea0) adding con mode: secure 2024-09-12T17:23:58.721 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T17:23:58.377+0000 7f4b03335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:58.721 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T17:23:58.378+0000 7f4b03335800 10 monclient: init 2024-09-12T17:23:58.721 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding auth protocol: cephx 2024-09-12T17:23:58.721 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding auth protocol: cephx 2024-09-12T17:23:58.721 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding auth protocol: cephx 2024-09-12T17:23:58.721 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding con mode: secure 2024-09-12T17:23:58.721 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding con mode: crc 2024-09-12T17:23:58.722 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding con mode: secure 2024-09-12T17:23:58.722 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding con mode: crc 2024-09-12T17:23:58.722 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding con mode: secure 2024-09-12T17:23:58.722 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding con mode: crc 2024-09-12T17:23:58.722 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding con mode: crc 2024-09-12T17:23:58.722 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding con mode: secure 2024-09-12T17:23:58.722 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding con mode: crc 2024-09-12T17:23:58.722 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding con mode: secure 2024-09-12T17:23:58.722 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding con mode: crc 2024-09-12T17:23:58.722 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf67d0) adding con mode: secure 2024-09-12T17:23:58.722 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T17:23:58.378+0000 7f4b03335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:58.722 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T17:23:58.378+0000 7f4b03335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:58.722 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T17:23:58.378+0000 7f4b03335800 5 asok(0x5644abb85730) register_command rotate-key cmddesc rotate-key hook 0x7ffcabbf6918 EEXIST 2024-09-12T17:23:58.722 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T17:23:58.378+0000 7f4b03335800 10 monclient: _reopen_session rank -1 2024-09-12T17:23:58.722 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T17:23:58.378+0000 7f4b03335800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:23:58.723 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T17:23:58.378+0000 7f4b03335800 10 monclient(hunting): picked mon.noname-c con 0x5644abe454f0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:23:58.723 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T17:23:58.378+0000 7f4b03335800 10 monclient(hunting): picked mon.noname-b con 0x5644abe70d20 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:23:58.723 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T17:23:58.378+0000 7f4b03335800 10 monclient(hunting): picked mon.noname-a con 0x5644abe674e0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:23:58.723 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T17:23:58.378+0000 7f4b03335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:58.723 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T17:23:58.378+0000 7f4b03335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:58.723 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T17:23:58.378+0000 7f4b03335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:58.723 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T17:23:58.378+0000 7f4b03335800 10 monclient(hunting): _renew_subs 2024-09-12T17:23:58.723 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T17:23:58.378+0000 7f4b03335800 10 monclient(hunting): authenticate will time out at 2249.728648s 2024-09-12T17:23:58.723 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T17:23:58.378+0000 7f4aff7c4640 10 monclient(hunting): get_auth_request con 0x5644abe674e0 auth_method 0 2024-09-12T17:23:58.723 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T17:23:58.378+0000 7f4aff7c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:58.723 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T17:23:58.378+0000 7f4aff7c4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:58.723 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T17:23:58.378+0000 7f4aff7c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:58.723 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T17:23:58.378+0000 7f4afefc3640 10 monclient(hunting): get_auth_request con 0x5644abe454f0 auth_method 0 2024-09-12T17:23:58.723 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T17:23:58.378+0000 7f4afefc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:58.724 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T17:23:58.378+0000 7f4afefc3640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:58.724 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T17:23:58.378+0000 7f4afefc3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:58.724 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T17:23:58.378+0000 7f4afe7c2640 10 monclient(hunting): get_auth_request con 0x5644abe70d20 auth_method 0 2024-09-12T17:23:58.724 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T17:23:58.378+0000 7f4afe7c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:58.724 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T17:23:58.378+0000 7f4afe7c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:58.724 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T17:23:58.378+0000 7f4afe7c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:58.724 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T17:23:58.378+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:58.724 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T17:23:58.378+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:58.724 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T17:23:58.378+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:58.724 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T17:23:58.378+0000 7f4afefc3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:58.724 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T17:23:58.378+0000 7f4afefc3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:58.724 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T17:23:58.378+0000 7f4afefc3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:58.724 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T17:23:58.378+0000 7f4afe7c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:58.724 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T17:23:58.378+0000 7f4afe7c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:58.725 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T17:23:58.378+0000 7f4afe7c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:58.725 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T17:23:58.378+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_done global_id 6684 payload 274 2024-09-12T17:23:58.725 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T17:23:58.378+0000 7f4aff7c4640 10 monclient: _finish_hunting 0 2024-09-12T17:23:58.725 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T17:23:58.378+0000 7f4aff7c4640 1 monclient: found mon.noname-a 2024-09-12T17:23:58.725 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T17:23:58.378+0000 7f4aff7c4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:23:58.725 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T17:23:58.379+0000 7f49e27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:58.725 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T17:23:58.379+0000 7f49e27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:23:58.725 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T17:23:58.379+0000 7f49e27fc640 10 monclient: dump: 2024-09-12T17:23:58.725 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:58.725 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:58.725 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.725 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.725 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:58.725 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:58.726 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:58.726 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:58.726 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:58.726 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.726 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T17:23:58.379+0000 7f49e27fc640 10 monclient: _finish_auth 0 2024-09-12T17:23:58.726 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T17:23:58.379+0000 7f49e27fc640 10 monclient: _check_auth_tickets 2024-09-12T17:23:58.726 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T17:23:58.379+0000 7f49e27fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:58.726 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T17:23:58.379+0000 7f49e27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:58.726 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T17:23:58.379+0000 7f49e27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:23:58.726 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T17:23:58.379+0000 7f49e27fc640 10 monclient: dump: 2024-09-12T17:23:58.726 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:58.726 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:58.726 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.726 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.727 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:58.727 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:58.727 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:58.727 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:58.727 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:58.727 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.727 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 monclient: authenticate success, global_id 6684 2024-09-12T17:23:58.727 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T17:23:58.379+0000 7f4b03335800 10 monclient: get_monmap_and_config success 2024-09-12T17:23:58.727 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T17:23:58.379+0000 7f4b03335800 4 set_mon_vals no callback set 2024-09-12T17:23:58.727 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T17:23:58.379+0000 7f4b03335800 10 monclient: shutdown 2024-09-12T17:23:58.727 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T17:23:58.379+0000 7f4b03335800 10 monclient: build_initial_monmap 2024-09-12T17:23:58.727 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T17:23:58.379+0000 7f4b03335800 1 build_initial for_mkfs: 0 2024-09-12T17:23:58.727 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T17:23:58.379+0000 7f4b03335800 10 monclient: monmap: 2024-09-12T17:23:58.727 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:23:58.727 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:58.728 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:23:58.728 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:23:58.728 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:58.728 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:58.728 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:23:58.728 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:23:58.728 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:23:58.728 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.728 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding auth protocol: cephx 2024-09-12T17:23:58.728 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding auth protocol: cephx 2024-09-12T17:23:58.728 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding auth protocol: cephx 2024-09-12T17:23:58.728 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding con mode: secure 2024-09-12T17:23:58.728 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding con mode: crc 2024-09-12T17:23:58.728 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding con mode: secure 2024-09-12T17:23:58.729 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding con mode: crc 2024-09-12T17:23:58.729 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding con mode: secure 2024-09-12T17:23:58.729 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding con mode: crc 2024-09-12T17:23:58.729 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding con mode: crc 2024-09-12T17:23:58.729 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding con mode: secure 2024-09-12T17:23:58.729 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding con mode: crc 2024-09-12T17:23:58.729 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding con mode: secure 2024-09-12T17:23:58.729 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding con mode: crc 2024-09-12T17:23:58.729 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T17:23:58.379+0000 7f4b03335800 5 AuthRegistry(0x5644abe679c0) adding con mode: secure 2024-09-12T17:23:58.729 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T17:23:58.380+0000 7f4b03335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:58.729 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T17:23:58.380+0000 7f4b03335800 1 librados: starting msgr at 2024-09-12T17:23:58.729 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T17:23:58.380+0000 7f4b03335800 1 librados: starting objecter 2024-09-12T17:23:58.730 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 asok(0x5644abb85730) register_command objecter_requests cmddesc objecter_requests hook 0x5644abe46db0 EEXIST 2024-09-12T17:23:58.730 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T17:23:58.380+0000 7f4b03335800 1 librados: setting wanted keys 2024-09-12T17:23:58.730 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T17:23:58.380+0000 7f4b03335800 1 librados: calling monclient init 2024-09-12T17:23:58.730 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T17:23:58.380+0000 7f4b03335800 10 monclient: init 2024-09-12T17:23:58.730 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding auth protocol: cephx 2024-09-12T17:23:58.730 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding auth protocol: cephx 2024-09-12T17:23:58.730 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding auth protocol: cephx 2024-09-12T17:23:58.730 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding con mode: secure 2024-09-12T17:23:58.730 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding con mode: crc 2024-09-12T17:23:58.730 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding con mode: secure 2024-09-12T17:23:58.730 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding con mode: crc 2024-09-12T17:23:58.730 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding con mode: secure 2024-09-12T17:23:58.730 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding con mode: crc 2024-09-12T17:23:58.730 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding con mode: crc 2024-09-12T17:23:58.731 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding con mode: secure 2024-09-12T17:23:58.731 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding con mode: crc 2024-09-12T17:23:58.731 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding con mode: secure 2024-09-12T17:23:58.731 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding con mode: crc 2024-09-12T17:23:58.731 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 AuthRegistry(0x5644abe3b3a0) adding con mode: secure 2024-09-12T17:23:58.731 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T17:23:58.380+0000 7f4b03335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:58.731 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T17:23:58.380+0000 7f4b03335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:58.731 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T17:23:58.380+0000 7f4b03335800 5 asok(0x5644abb85730) register_command rotate-key cmddesc rotate-key hook 0x5644abe3b4e8 EEXIST 2024-09-12T17:23:58.731 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T17:23:58.380+0000 7f4b03335800 10 monclient: _reopen_session rank -1 2024-09-12T17:23:58.731 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T17:23:58.380+0000 7f4b03335800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:23:58.731 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T17:23:58.380+0000 7f4b03335800 10 monclient(hunting): picked mon.noname-b con 0x5644abe454f0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:23:58.731 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T17:23:58.380+0000 7f4b03335800 10 monclient(hunting): picked mon.noname-a con 0x5644abe674e0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:23:58.731 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T17:23:58.380+0000 7f4b03335800 10 monclient(hunting): picked mon.noname-c con 0x5644abe70d20 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:23:58.731 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T17:23:58.380+0000 7f4b03335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:58.732 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T17:23:58.380+0000 7f4b03335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:58.732 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T17:23:58.380+0000 7f4b03335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:58.732 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T17:23:58.380+0000 7f4b03335800 10 monclient(hunting): _renew_subs 2024-09-12T17:23:58.732 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T17:23:58.380+0000 7f4b03335800 10 monclient(hunting): authenticate will time out at 2249.730899s 2024-09-12T17:23:58.732 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T17:23:58.381+0000 7f4aff7c4640 10 monclient(hunting): get_auth_request con 0x5644abe70d20 auth_method 0 2024-09-12T17:23:58.732 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T17:23:58.381+0000 7f4aff7c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:58.732 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T17:23:58.381+0000 7f4aff7c4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:58.732 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T17:23:58.381+0000 7f4aff7c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:58.732 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T17:23:58.381+0000 7f4afe7c2640 10 monclient(hunting): get_auth_request con 0x5644abe674e0 auth_method 0 2024-09-12T17:23:58.732 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T17:23:58.381+0000 7f4afe7c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:58.732 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T17:23:58.381+0000 7f4afe7c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:58.732 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T17:23:58.381+0000 7f4afe7c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:58.732 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T17:23:58.381+0000 7f4afefc3640 10 monclient(hunting): get_auth_request con 0x5644abe454f0 auth_method 0 2024-09-12T17:23:58.732 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T17:23:58.381+0000 7f4afefc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:58.733 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T17:23:58.381+0000 7f4afefc3640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:58.733 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T17:23:58.381+0000 7f4afefc3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:58.733 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T17:23:58.381+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:58.733 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T17:23:58.381+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:58.733 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T17:23:58.381+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:58.733 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T17:23:58.381+0000 7f4afe7c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:58.733 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T17:23:58.381+0000 7f4afe7c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:58.733 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T17:23:58.381+0000 7f4afe7c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:58.733 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T17:23:58.381+0000 7f4afefc3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:58.733 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T17:23:58.381+0000 7f4afefc3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:58.733 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T17:23:58.381+0000 7f4afefc3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:58.733 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T17:23:58.381+0000 7f4aff7c4640 10 monclient(hunting): handle_auth_done global_id 6293 payload 824 2024-09-12T17:23:58.733 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T17:23:58.381+0000 7f4aff7c4640 10 monclient: _finish_hunting 0 2024-09-12T17:23:58.734 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T17:23:58.381+0000 7f4aff7c4640 1 monclient: found mon.noname-c 2024-09-12T17:23:58.734 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T17:23:58.381+0000 7f4aff7c4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:23:58.734 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T17:23:58.381+0000 7f49e0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:58.734 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T17:23:58.381+0000 7f49e0ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:23:58.734 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T17:23:58.381+0000 7f49e0ff9640 10 monclient: dump: 2024-09-12T17:23:58.734 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:58.734 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:58.734 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.734 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.734 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:58.734 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:58.734 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:58.734 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:58.734 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:58.735 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.735 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T17:23:58.381+0000 7f49e0ff9640 10 monclient: _finish_auth 0 2024-09-12T17:23:58.735 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T17:23:58.381+0000 7f49e0ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:23:58.735 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T17:23:58.381+0000 7f49e0ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:58.735 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T17:23:58.381+0000 7f49e0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:58.735 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T17:23:58.381+0000 7f49e0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:23:58.735 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T17:23:58.381+0000 7f49e0ff9640 10 monclient: dump: 2024-09-12T17:23:58.735 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:23:58.735 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:23:58.735 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.735 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:23:58.735 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:58.735 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:23:58.735 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:23:58.735 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:23:58.736 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:23:58.736 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.736 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T17:23:58.381+0000 7f4b03335800 5 monclient: authenticate success, global_id 6293 2024-09-12T17:23:58.736 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T17:23:58.381+0000 7f49e27fc640 4 set_mon_vals no callback set 2024-09-12T17:23:58.736 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T17:23:58.381+0000 7f4b03335800 10 monclient: _renew_subs 2024-09-12T17:23:58.736 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T17:23:58.381+0000 7f4b03335800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:23:58.736 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T17:23:58.381+0000 7f4b03335800 10 monclient: _renew_subs 2024-09-12T17:23:58.736 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T17:23:58.381+0000 7f4b03335800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:23:58.736 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T17:23:58.381+0000 7f4b03335800 1 librados: init done 2024-09-12T17:23:58.736 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T17:23:58.381+0000 7f4b03335800 5 asok(0x5644abb85730) register_command cr dump hook 0x5644abe6a0d8 2024-09-12T17:23:58.736 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T17:23:58.383+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.736 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T17:23:58.383+0000 7f49e0ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:23:58.736 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T17:23:58.383+0000 7f49e0ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:23:58.737 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T17:23:58.383+0000 7f49e0ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:23:58.737 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T17:23:58.384+0000 7f4afefc3640 10 monclient: get_auth_request con 0x7f49c8076470 auth_method 0 2024-09-12T17:23:58.737 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T17:23:58.384+0000 7f4afe7c2640 10 monclient: get_auth_request con 0x5644abe8fd40 auth_method 0 2024-09-12T17:23:58.737 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T17:23:58.384+0000 7f4b03335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.737 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T17:23:58.384+0000 7f4b03335800 20 realm 2024-09-12T17:23:58.737 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T17:23:58.384+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.737 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T17:23:58.384+0000 7f4b03335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.737 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T17:23:58.384+0000 7f4b03335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:58.737 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T17:23:58.384+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.737 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T17:23:58.385+0000 7f4b03335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.737 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T17:23:58.385+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.737 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T17:23:58.385+0000 7f4afefc3640 10 monclient: get_auth_request con 0x5644abe93f50 auth_method 0 2024-09-12T17:23:58.737 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T17:23:58.385+0000 7f4b03335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:58.738 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T17:23:58.385+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.738 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T17:23:58.386+0000 7f4afe7c2640 10 monclient: get_auth_request con 0x5644abe977b0 auth_method 0 2024-09-12T17:23:58.738 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T17:23:58.386+0000 7f4b03335800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:58.738 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T17:23:58.386+0000 7f4b03335800 20 searching for the correct realm 2024-09-12T17:23:58.738 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T17:23:58.386+0000 7f4aff7c4640 10 monclient: get_auth_request con 0x5644abe9c280 auth_method 0 2024-09-12T17:23:58.738 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T17:23:58.387+0000 7f4afefc3640 10 monclient: get_auth_request con 0x7f4af808cbf0 auth_method 0 2024-09-12T17:23:58.738 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T17:23:58.388+0000 7f4afe7c2640 10 monclient: get_auth_request con 0x7f4af0070c20 auth_method 0 2024-09-12T17:23:58.738 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T17:23:58.389+0000 7f4afe7c2640 0 -- 172.21.15.67:0/1767224406 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x5644abe977b0 msgr2=0x5644abe99ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:58.738 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T17:23:58.389+0000 7f49e0ff9640 1 client.6293.objecter ms_handle_reset 0x5644abe977b0 session 0x5644abe932e0 osd.4 2024-09-12T17:23:58.738 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T17:23:58.389+0000 7f49e0ff9640 10 monclient: _renew_subs 2024-09-12T17:23:58.738 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T17:23:58.389+0000 7f49e0ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:23:58.738 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T17:23:58.389+0000 7f4afe7c2640 10 monclient: get_auth_request con 0x7f49c8086310 auth_method 0 2024-09-12T17:23:58.738 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T17:23:58.390+0000 7f4aff7c4640 10 monclient: get_auth_request con 0x7f4af406d040 auth_method 0 2024-09-12T17:23:58.739 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T17:23:58.392+0000 7f4afefc3640 10 monclient: get_auth_request con 0x7f4af408cc10 auth_method 0 2024-09-12T17:23:58.739 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T17:23:58.392+0000 7f4afefc3640 0 -- 172.21.15.67:0/1767224406 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f4af408cc10 msgr2=0x7f4af406e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:58.739 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T17:23:58.594+0000 7f4afefc3640 10 monclient: get_auth_request con 0x7f4af408cc10 auth_method 0 2024-09-12T17:23:58.739 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T17:23:58.599+0000 7f4b03335800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:58.739 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T17:23:58.599+0000 7f4b03335800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:58.739 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T17:23:58.599+0000 7f4b03335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:58.739 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T17:23:58.599+0000 7f4b03335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:58.739 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T17:23:58.599+0000 7f4b03335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:58.739 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T17:23:58.599+0000 7f4b03335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:58.739 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T17:23:58.599+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.739 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T17:23:58.599+0000 7f4b03335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.739 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T17:23:58.599+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.739 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T17:23:58.599+0000 7f4b03335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:58.740 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T17:23:58.599+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.740 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T17:23:58.600+0000 7f4b03335800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:58.740 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T17:23:58.600+0000 7f4b03335800 20 zone default found 2024-09-12T17:23:58.740 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T17:23:58.600+0000 7f4b03335800 4 Realm: () 2024-09-12T17:23:58.740 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T17:23:58.600+0000 7f4b03335800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:58.740 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T17:23:58.600+0000 7f4b03335800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:58.740 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T17:23:58.600+0000 7f4b03335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:58.740 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T17:23:58.600+0000 7f4b03335800 20 zonegroup default 2024-09-12T17:23:58.740 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T17:23:58.600+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.740 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T17:23:58.600+0000 7f4b03335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.740 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T17:23:58.600+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.740 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T17:23:58.600+0000 7f4b03335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.740 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T17:23:58.600+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.740 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T17:23:58.600+0000 7f4b03335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.741 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T17:23:58.600+0000 7f4b03335800 20 started sync module instance, tier type = 2024-09-12T17:23:58.741 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T17:23:58.600+0000 7f4b03335800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:58.741 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T17:23:58.610+0000 7f4b03335800 20 add_watcher() i=0 2024-09-12T17:23:58.741 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T17:23:58.610+0000 7f4b03335800 20 add_watcher() i=1 2024-09-12T17:23:58.741 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T17:23:58.610+0000 7f4b03335800 20 add_watcher() i=2 2024-09-12T17:23:58.741 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T17:23:58.610+0000 7f4b03335800 20 add_watcher() i=3 2024-09-12T17:23:58.741 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T17:23:58.610+0000 7f4b03335800 20 add_watcher() i=4 2024-09-12T17:23:58.741 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T17:23:58.610+0000 7f4b03335800 20 add_watcher() i=5 2024-09-12T17:23:58.741 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T17:23:58.610+0000 7f4b03335800 20 add_watcher() i=6 2024-09-12T17:23:58.741 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T17:23:58.611+0000 7f4b03335800 20 add_watcher() i=7 2024-09-12T17:23:58.741 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T17:23:58.611+0000 7f4b03335800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:58.741 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T17:23:58.612+0000 7f49e0ff9640 1 client.6293.objecter ms_handle_reset 0x5644abe8fd40 session 0x5644abe8f6c0 osd.1 2024-09-12T17:23:58.741 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T17:23:58.612+0000 7f4afe7c2640 10 monclient: get_auth_request con 0x5644abe977b0 auth_method 0 2024-09-12T17:23:58.741 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding auth protocol: cephx 2024-09-12T17:23:58.741 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding auth protocol: cephx 2024-09-12T17:23:58.742 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding auth protocol: cephx 2024-09-12T17:23:58.742 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding con mode: secure 2024-09-12T17:23:58.742 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding con mode: crc 2024-09-12T17:23:58.742 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding con mode: secure 2024-09-12T17:23:58.742 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding con mode: crc 2024-09-12T17:23:58.742 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding con mode: secure 2024-09-12T17:23:58.742 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding con mode: crc 2024-09-12T17:23:58.742 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding con mode: crc 2024-09-12T17:23:58.742 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding con mode: secure 2024-09-12T17:23:58.742 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T17:23:58.613+0000 7f49b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:58.742 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding con mode: crc 2024-09-12T17:23:58.742 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding con mode: secure 2024-09-12T17:23:58.742 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding con mode: crc 2024-09-12T17:23:58.743 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T17:23:58.613+0000 7f4b03335800 5 AuthRegistry(0x7ffcabbf6ca0) adding con mode: secure 2024-09-12T17:23:58.743 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T17:23:58.614+0000 7f4b03335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:58.743 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T17:23:58.614+0000 7f4b03335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:58.743 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T17:23:58.614+0000 7f4b03335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:58.743 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T17:23:58.614+0000 7f4b03335800 5 asok(0x5644abb85730) register_command cache list hook 0x5644abe6bb10 2024-09-12T17:23:58.743 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T17:23:58.614+0000 7f4b03335800 5 asok(0x5644abb85730) register_command cache inspect hook 0x5644abe6bb10 2024-09-12T17:23:58.743 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T17:23:58.614+0000 7f4b03335800 5 asok(0x5644abb85730) register_command cache erase hook 0x5644abe6bb10 2024-09-12T17:23:58.743 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T17:23:58.614+0000 7f4b03335800 5 asok(0x5644abb85730) register_command cache zap hook 0x5644abe6bb10 2024-09-12T17:23:58.743 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T17:23:58.614+0000 7f4b03335800 5 note: GC not initialized 2024-09-12T17:23:58.743 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T17:23:58.614+0000 7f492ffff640 20 reqs_thread_entry: start 2024-09-12T17:23:58.743 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T17:23:58.614+0000 7f4b03335800 5 asok(0x5644abb85730) register_command sync trace show hook 0x7f4af8004670 2024-09-12T17:23:58.743 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T17:23:58.614+0000 7f4b03335800 5 asok(0x5644abb85730) register_command sync trace history hook 0x7f4af8004670 2024-09-12T17:23:58.743 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T17:23:58.614+0000 7f4b03335800 5 asok(0x5644abb85730) register_command sync trace active hook 0x7f4af8004670 2024-09-12T17:23:58.744 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T17:23:58.614+0000 7f4b03335800 5 asok(0x5644abb85730) register_command sync trace active_short hook 0x7f4af8004670 2024-09-12T17:23:58.744 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T17:23:58.614+0000 7f4b03335800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:58.744 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T17:23:58.614+0000 7f4b03335800 20 Filter name: none 2024-09-12T17:23:58.744 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T17:23:58.614+0000 7f492dffb640 20 reqs_thread_entry: start 2024-09-12T17:23:58.744 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T17:23:58.614+0000 7f4b03335800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:23:58.744 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T17:23:58.614+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.744 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T17:23:58.615+0000 7f4b03335800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:23:58.744 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T17:23:58.615+0000 7f4b03335800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:23:58.744 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T17:23:58.615+0000 7f4b03335800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:23:58.744 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T17:23:58.615+0000 7f4b03335800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 : miss 2024-09-12T17:23:58.744 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T17:23:58.615+0000 7f4b03335800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.744 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T17:23:58.615+0000 7f4b03335800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:23:58.744 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T17:23:58.615+0000 7f4b03335800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 info.flags=0x17 2024-09-12T17:23:58.745 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T17:23:58.615+0000 7f4b03335800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 to cache LRU end 2024-09-12T17:23:58.745 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T17:23:58.615+0000 7f4b03335800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:58.745 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T17:23:58.615+0000 7f4b03335800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:58.745 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T17:23:58.615+0000 7f4b03335800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 2024-09-12T17:23:58.745 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T17:23:58.619+0000 7f4b03335800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4b03335800 time 2024-09-12T17:23:58.619129+0000 2024-09-12T17:23:58.745 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:23:58.745 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.745 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:58.745 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4b0498c71a] 2024-09-12T17:23:58.745 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4b0498c8d8] 2024-09-12T17:23:58.745 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644aa7b2841] 2024-09-12T17:23:58.745 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd73ca8) [0x5644aacbfca8] 2024-09-12T17:23:58.746 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5644aa7c250d] 2024-09-12T17:23:58.746 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:23:58.746 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4b03629590] 2024-09-12T17:23:58.746 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:23:58.746 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:23:58.746 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.746 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T17:23:58.620+0000 7f4b03335800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:23:58.746 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f4b03335800 thread_name:radosgw-admin 2024-09-12T17:23:58.746 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.746 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:58.746 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4b0363e6f0] 2024-09-12T17:23:58.746 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4b0368b99c] 2024-09-12T17:23:58.746 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:23:58.746 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:23:58.746 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4b0498c774] 2024-09-12T17:23:58.747 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4b0498c8d8] 2024-09-12T17:23:58.747 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644aa7b2841] 2024-09-12T17:23:58.747 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd73ca8) [0x5644aacbfca8] 2024-09-12T17:23:58.747 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5644aa7c250d] 2024-09-12T17:23:58.747 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:23:58.747 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4b03629590] 2024-09-12T17:23:58.747 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:23:58.747 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:23:58.747 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:23:58.747 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.747 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T17:23:58.747 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T17:23:58.747 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T17:23:58.747 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T17:23:58.748 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T17:23:58.748 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T17:23:58.748 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T17:23:58.748 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T17:23:58.748 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T17:23:58.748 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T17:23:58.748 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T17:23:58.748 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T17:23:58.748 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T17:23:58.748 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T17:23:58.748 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T17:23:58.748 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T17:23:58.748 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T17:23:58.749 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T17:23:58.749 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T17:23:58.749 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T17:23:58.749 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T17:23:58.749 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T17:23:58.749 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T17:23:58.749 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T17:23:58.749 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:23:58.749 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T17:23:58.749 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T17:23:58.749 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T17:23:58.749 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T17:23:58.749 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T17:23:58.749 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T17:23:58.750 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T17:23:58.750 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T17:23:58.750 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T17:23:58.750 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T17:23:58.750 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T17:23:58.750 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T17:23:58.750 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T17:23:58.750 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T17:23:58.750 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T17:23:58.750 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T17:23:58.750 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T17:23:58.750 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T17:23:58.750 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T17:23:58.750 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T17:23:58.750 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T17:23:58.751 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:23:58.751 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T17:23:58.751 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:23:58.751 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T17:23:58.751 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T17:23:58.751 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T17:23:58.751 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T17:23:58.751 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T17:23:58.751 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T17:23:58.751 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T17:23:58.751 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T17:23:58.751 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T17:23:58.751 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T17:23:58.751 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T17:23:58.752 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T17:23:58.752 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T17:23:58.752 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T17:23:58.752 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T17:23:58.752 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T17:23:58.752 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T17:23:58.752 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T17:23:58.752 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:23:58.752 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T17:23:58.752 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:23:58.752 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T17:23:58.752 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T17:23:58.752 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T17:23:58.753 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T17:23:58.753 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T17:23:58.753 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T17:23:58.753 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:23:58.753 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T17:23:58.753 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T17:23:58.753 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:23:58.753 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T17:23:58.753 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T17:23:58.753 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T17:23:58.753 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T17:23:58.753 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T17:23:58.753 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T17:23:58.754 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T17:23:58.754 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T17:23:58.754 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T17:23:58.754 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T17:23:58.754 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T17:23:58.754 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T17:23:58.754 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T17:23:58.754 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:23:58.754 INFO:tasks.workunit.client.0.smithi067.stderr: 7f492dffb640 / http_manager 2024-09-12T17:23:58.754 INFO:tasks.workunit.client.0.smithi067.stderr: 7f492ffff640 / http_manager 2024-09-12T17:23:58.754 INFO:tasks.workunit.client.0.smithi067.stderr: 7f49b57e2640 / rgw_dt_lg_renew 2024-09-12T17:23:58.754 INFO:tasks.workunit.client.0.smithi067.stderr: 7f49e0ff9640 / ms_dispatch 2024-09-12T17:23:58.754 INFO:tasks.workunit.client.0.smithi067.stderr: 7f49e27fc640 / io_context_pool 2024-09-12T17:23:58.755 INFO:tasks.workunit.client.0.smithi067.stderr: 7f49e8e01640 / ms_dispatch 2024-09-12T17:23:58.755 INFO:tasks.workunit.client.0.smithi067.stderr: 7f49eb606640 / ms_dispatch 2024-09-12T17:23:58.755 INFO:tasks.workunit.client.0.smithi067.stderr: 7f49ece09640 / io_context_pool 2024-09-12T17:23:58.755 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4afe7c2640 / msgr-worker-2 2024-09-12T17:23:58.755 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4afefc3640 / msgr-worker-1 2024-09-12T17:23:58.755 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4aff7c4640 / msgr-worker-0 2024-09-12T17:23:58.755 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4afffc5640 / io_context_pool 2024-09-12T17:23:58.755 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4b03335800 / radosgw-admin 2024-09-12T17:23:58.755 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T17:23:58.755 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T17:23:58.755 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:23:58.620840Z_e4774df7-5301-4008-92af-08564dacc889/log 2024-09-12T17:23:58.755 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T17:23:58.755 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:23:58.757 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:58.757 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:58.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.700+0000 7f456e019800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.702+0000 7f456e019800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.702+0000 7f456e019800 20 realm 2024-09-12T17:23:58.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.702+0000 7f456e019800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.702+0000 7f456e019800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.702+0000 7f456e019800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:58.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.702+0000 7f456e019800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.702+0000 7f456e019800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.702+0000 7f456e019800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.703+0000 7f456e019800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:58.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.703+0000 7f456e019800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.704+0000 7f456e019800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:58.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.704+0000 7f456e019800 20 searching for the correct realm 2024-09-12T17:23:58.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.705+0000 7f45697eb640 0 -- 172.21.15.67:0/3634655314 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f4564030070 msgr2=0x7f4564022430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:58.911 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.910+0000 7f4568fea640 0 -- 172.21.15.67:0/3634655314 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f455c021060 msgr2=0x7f455c022040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:58.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.915+0000 7f456e019800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:58.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.915+0000 7f456e019800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:58.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.915+0000 7f456e019800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:58.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.915+0000 7f456e019800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:58.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.915+0000 7f456e019800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:58.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.915+0000 7f456e019800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:58.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.915+0000 7f456e019800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.916+0000 7f456e019800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.916+0000 7f456e019800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.916+0000 7f456e019800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:58.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.916+0000 7f456e019800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.916+0000 7f456e019800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:58.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.916+0000 7f456e019800 20 zone default found 2024-09-12T17:23:58.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.916+0000 7f456e019800 4 Realm: () 2024-09-12T17:23:58.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.916+0000 7f456e019800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:58.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.916+0000 7f456e019800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:58.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.916+0000 7f456e019800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:58.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.916+0000 7f456e019800 20 zonegroup default 2024-09-12T17:23:58.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.916+0000 7f456e019800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.917+0000 7f456e019800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.917+0000 7f456e019800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.917+0000 7f456e019800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.917+0000 7f456e019800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.917+0000 7f456e019800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:58.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.917+0000 7f456e019800 20 started sync module instance, tier type = 2024-09-12T17:23:58.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.917+0000 7f456e019800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:58.928 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.927+0000 7f456e019800 20 add_watcher() i=0 2024-09-12T17:23:58.928 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.927+0000 7f456e019800 20 add_watcher() i=1 2024-09-12T17:23:58.928 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.927+0000 7f456e019800 20 add_watcher() i=2 2024-09-12T17:23:58.928 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.927+0000 7f456e019800 20 add_watcher() i=3 2024-09-12T17:23:58.928 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.927+0000 7f456e019800 20 add_watcher() i=4 2024-09-12T17:23:58.928 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.927+0000 7f456e019800 20 add_watcher() i=5 2024-09-12T17:23:58.928 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.927+0000 7f456e019800 20 add_watcher() i=6 2024-09-12T17:23:58.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.927+0000 7f456e019800 20 add_watcher() i=7 2024-09-12T17:23:58.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.927+0000 7f456e019800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:58.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.929+0000 7f441f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:58.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.930+0000 7f456e019800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:58.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.930+0000 7f456e019800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:58.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.930+0000 7f456e019800 5 note: GC not initialized 2024-09-12T17:23:58.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.930+0000 7f441e7e4640 20 reqs_thread_entry: start 2024-09-12T17:23:58.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.930+0000 7f456e019800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:58.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.930+0000 7f456e019800 20 Filter name: none 2024-09-12T17:23:58.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.930+0000 7f438ffff640 20 reqs_thread_entry: start 2024-09-12T17:23:58.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.930+0000 7f456e019800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.931+0000 7f456e019800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:23:58.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.931+0000 7f456e019800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.931+0000 7f456e019800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:23:58.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.931+0000 7f456e019800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:58.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.931+0000 7f456e019800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.931+0000 7f456e019800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:23:58.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.931+0000 7f456e019800 20 rados->read ofs=0 len=0 2024-09-12T17:23:58.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.932+0000 7f456e019800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:23:58.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.932+0000 7f456e019800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:58.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.933+0000 7f441f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:58.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.935+0000 7f456e019800 20 remove_watcher() i=0 2024-09-12T17:23:58.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.935+0000 7f456e019800 2 removed watcher, disabling cache 2024-09-12T17:23:58.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.936+0000 7f456e019800 20 remove_watcher() i=1 2024-09-12T17:23:58.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.937+0000 7f456e019800 20 remove_watcher() i=2 2024-09-12T17:23:58.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.938+0000 7f456e019800 20 remove_watcher() i=3 2024-09-12T17:23:58.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.940+0000 7f456e019800 20 remove_watcher() i=4 2024-09-12T17:23:58.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.941+0000 7f456e019800 20 remove_watcher() i=5 2024-09-12T17:23:58.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.942+0000 7f456e019800 20 remove_watcher() i=6 2024-09-12T17:23:58.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:58.942+0000 7f456e019800 20 remove_watcher() i=7 2024-09-12T17:23:58.955 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.955 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:23:58.955 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-set-target-layout id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:23:58.955 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:23:58.956 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:58.957 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:58.990 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:23:58.990 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:23:59.047 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:23:59.080 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:59.080 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:59.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.118+0000 7f5393010800 20 rados->read ofs=0 len=0 2024-09-12T17:23:59.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.119+0000 7f5393010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:59.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.119+0000 7f5393010800 20 realm 2024-09-12T17:23:59.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.119+0000 7f5393010800 20 rados->read ofs=0 len=0 2024-09-12T17:23:59.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.120+0000 7f5393010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:59.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.120+0000 7f5393010800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:59.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.120+0000 7f5393010800 20 rados->read ofs=0 len=0 2024-09-12T17:23:59.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.120+0000 7f5393010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:59.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.120+0000 7f5393010800 20 rados->read ofs=0 len=0 2024-09-12T17:23:59.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.121+0000 7f5393010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:59.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.121+0000 7f5393010800 20 rados->read ofs=0 len=0 2024-09-12T17:23:59.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.122+0000 7f5393010800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:59.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.122+0000 7f5393010800 20 searching for the correct realm 2024-09-12T17:23:59.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.324+0000 7f538dfbb640 0 -- 172.21.15.67:0/643324882 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f53800ce040 msgr2=0x7f5380057040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:59.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.732+0000 7f538e7bc640 0 -- 172.21.15.67:0/643324882 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f538405b400 msgr2=0x7f538405b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:59.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.939+0000 7f5393010800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:23:59.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.939+0000 7f5393010800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:23:59.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.939+0000 7f5393010800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:59.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.939+0000 7f5393010800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:59.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.939+0000 7f5393010800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:59.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.939+0000 7f5393010800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:59.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.939+0000 7f5393010800 20 rados->read ofs=0 len=0 2024-09-12T17:23:59.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.939+0000 7f5393010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:59.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.939+0000 7f5393010800 20 rados->read ofs=0 len=0 2024-09-12T17:23:59.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.940+0000 7f5393010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:59.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.940+0000 7f5393010800 20 rados->read ofs=0 len=0 2024-09-12T17:23:59.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.940+0000 7f5393010800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:59.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.940+0000 7f5393010800 20 zone default found 2024-09-12T17:23:59.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.940+0000 7f5393010800 4 Realm: () 2024-09-12T17:23:59.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.940+0000 7f5393010800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:23:59.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.940+0000 7f5393010800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:23:59.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.940+0000 7f5393010800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:59.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.940+0000 7f5393010800 20 zonegroup default 2024-09-12T17:23:59.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.940+0000 7f5393010800 20 rados->read ofs=0 len=0 2024-09-12T17:23:59.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.940+0000 7f5393010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:59.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.940+0000 7f5393010800 20 rados->read ofs=0 len=0 2024-09-12T17:23:59.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.941+0000 7f5393010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:59.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.941+0000 7f5393010800 20 rados->read ofs=0 len=0 2024-09-12T17:23:59.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.941+0000 7f5393010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:59.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.941+0000 7f5393010800 20 started sync module instance, tier type = 2024-09-12T17:23:59.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.941+0000 7f5393010800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:23:59.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.953+0000 7f5393010800 20 add_watcher() i=0 2024-09-12T17:23:59.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.953+0000 7f5393010800 20 add_watcher() i=1 2024-09-12T17:23:59.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.953+0000 7f5393010800 20 add_watcher() i=2 2024-09-12T17:23:59.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.953+0000 7f5393010800 20 add_watcher() i=3 2024-09-12T17:23:59.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.953+0000 7f5393010800 20 add_watcher() i=4 2024-09-12T17:23:59.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.953+0000 7f5393010800 20 add_watcher() i=5 2024-09-12T17:23:59.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.953+0000 7f5393010800 20 add_watcher() i=6 2024-09-12T17:23:59.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.954+0000 7f5393010800 20 add_watcher() i=7 2024-09-12T17:23:59.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.954+0000 7f5393010800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:59.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.956+0000 7f5244fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:59.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.956+0000 7f5393010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:59.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.956+0000 7f5393010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:59.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.956+0000 7f5393010800 5 note: GC not initialized 2024-09-12T17:23:59.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.957+0000 7f51bf7fe640 20 reqs_thread_entry: start 2024-09-12T17:23:59.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.957+0000 7f5393010800 20 init_complete bucket index max shards: 1 2024-09-12T17:23:59.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.957+0000 7f5393010800 20 Filter name: none 2024-09-12T17:23:59.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.957+0000 7f51bd7fa640 20 reqs_thread_entry: start 2024-09-12T17:23:59.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.957+0000 7f5393010800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:23:59.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.957+0000 7f5393010800 20 rados->read ofs=0 len=0 2024-09-12T17:23:59.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.958+0000 7f5393010800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:23:59.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.958+0000 7f5393010800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:23:59.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.958+0000 7f5393010800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:23:59.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.958+0000 7f5393010800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 : miss 2024-09-12T17:23:59.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.958+0000 7f5393010800 20 rados->read ofs=0 len=0 2024-09-12T17:23:59.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.959+0000 7f5393010800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:23:59.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.959+0000 7f5393010800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 info.flags=0x17 2024-09-12T17:23:59.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.959+0000 7f5393010800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 to cache LRU end 2024-09-12T17:23:59.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.959+0000 7f5393010800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:59.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.959+0000 7f5393010800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:23:59.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.959+0000 7f5393010800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 2024-09-12T17:23:59.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.960+0000 7f5393010800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 to be held by another RGW process; skipping for now 2024-09-12T17:23:59.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.961+0000 7f5244fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:59.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.964+0000 7f5393010800 20 remove_watcher() i=0 2024-09-12T17:23:59.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.964+0000 7f5393010800 2 removed watcher, disabling cache 2024-09-12T17:23:59.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.965+0000 7f5393010800 20 remove_watcher() i=1 2024-09-12T17:23:59.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.966+0000 7f5393010800 20 remove_watcher() i=2 2024-09-12T17:23:59.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.968+0000 7f5393010800 20 remove_watcher() i=3 2024-09-12T17:23:59.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.969+0000 7f5393010800 20 remove_watcher() i=4 2024-09-12T17:23:59.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.970+0000 7f5393010800 20 remove_watcher() i=5 2024-09-12T17:23:59.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.972+0000 7f5393010800 20 remove_watcher() i=6 2024-09-12T17:23:59.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:23:59.973+0000 7f5393010800 20 remove_watcher() i=7 2024-09-12T17:23:59.987 INFO:tasks.workunit.client.0.smithi067.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:24:30.009 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:24:30.046 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:30.046 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:30.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.091+0000 7f598880e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.093+0000 7f598880e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:30.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.093+0000 7f598880e800 20 realm 2024-09-12T17:24:30.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.093+0000 7f598880e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.093+0000 7f598880e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:30.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.093+0000 7f598880e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:30.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.093+0000 7f598880e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.093+0000 7f598880e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:30.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.093+0000 7f598880e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.094+0000 7f598880e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:30.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.094+0000 7f598880e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.095+0000 7f598880e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:30.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.095+0000 7f598880e800 20 searching for the correct realm 2024-09-12T17:24:30.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.098+0000 7f5983f6b640 0 -- 172.21.15.67:0/3183163261 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f597c075040 msgr2=0x7f597c0743b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:30.103 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.102+0000 7f5983f6b640 0 -- 172.21.15.67:0/3183163261 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f597809a280 msgr2=0x7f597806b7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:30.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.310+0000 7f598880e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:24:30.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.310+0000 7f598880e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:24:30.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.310+0000 7f598880e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:30.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.310+0000 7f598880e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:30.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.310+0000 7f598880e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:30.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.310+0000 7f598880e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:30.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.310+0000 7f598880e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.310+0000 7f598880e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:30.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.310+0000 7f598880e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.311+0000 7f598880e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:30.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.311+0000 7f598880e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.312+0000 7f598880e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:30.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.312+0000 7f598880e800 20 zone default found 2024-09-12T17:24:30.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.312+0000 7f598880e800 4 Realm: () 2024-09-12T17:24:30.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.312+0000 7f598880e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:24:30.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.312+0000 7f598880e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:24:30.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.312+0000 7f598880e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:30.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.312+0000 7f598880e800 20 zonegroup default 2024-09-12T17:24:30.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.312+0000 7f598880e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.312+0000 7f598880e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:30.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.312+0000 7f598880e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.313+0000 7f598880e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:30.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.313+0000 7f598880e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.313+0000 7f598880e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:30.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.313+0000 7f598880e800 20 started sync module instance, tier type = 2024-09-12T17:24:30.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.313+0000 7f598880e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:24:30.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.323+0000 7f598880e800 20 add_watcher() i=0 2024-09-12T17:24:30.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.323+0000 7f598880e800 20 add_watcher() i=1 2024-09-12T17:24:30.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.323+0000 7f598880e800 20 add_watcher() i=2 2024-09-12T17:24:30.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.323+0000 7f598880e800 20 add_watcher() i=3 2024-09-12T17:24:30.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.323+0000 7f598880e800 20 add_watcher() i=4 2024-09-12T17:24:30.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.323+0000 7f598880e800 20 add_watcher() i=5 2024-09-12T17:24:30.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.324+0000 7f598880e800 20 add_watcher() i=6 2024-09-12T17:24:30.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.325+0000 7f598880e800 20 add_watcher() i=7 2024-09-12T17:24:30.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.325+0000 7f598880e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:30.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.326+0000 7f583a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:30.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.327+0000 7f598880e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:30.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.327+0000 7f598880e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:30.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.327+0000 7f598880e800 5 note: GC not initialized 2024-09-12T17:24:30.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.327+0000 7f58397e2640 20 reqs_thread_entry: start 2024-09-12T17:24:30.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.327+0000 7f598880e800 20 init_complete bucket index max shards: 1 2024-09-12T17:24:30.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.327+0000 7f598880e800 20 Filter name: none 2024-09-12T17:24:30.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.327+0000 7f58327fc640 20 reqs_thread_entry: start 2024-09-12T17:24:30.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.327+0000 7f598880e800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:24:30.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.327+0000 7f598880e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.328+0000 7f598880e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:24:30.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.328+0000 7f598880e800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:24:30.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.328+0000 7f598880e800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:24:30.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.328+0000 7f598880e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 : miss 2024-09-12T17:24:30.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.328+0000 7f598880e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.328+0000 7f598880e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:24:30.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.328+0000 7f598880e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 info.flags=0x17 2024-09-12T17:24:30.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.328+0000 7f598880e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 to cache LRU end 2024-09-12T17:24:30.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.328+0000 7f598880e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:24:30.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.328+0000 7f598880e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:30.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.328+0000 7f598880e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 2024-09-12T17:24:30.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.333+0000 7f598880e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 info.flags=0x17 2024-09-12T17:24:30.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.333+0000 7f598880e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 to cache LRU end 2024-09-12T17:24:30.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.333+0000 7f598880e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:30.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.333+0000 7f598880e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25, ofs0, ns] 2024-09-12T17:24:30.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.333+0000 7f5862ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464327 cookie 94278901156112 notifier 6738 bl.length()=1009 2024-09-12T17:24:30.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.333+0000 7f5862ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 info.flags=0x17 2024-09-12T17:24:30.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.333+0000 7f5862ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 to cache LRU end 2024-09-12T17:24:30.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.333+0000 7f5862ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:30.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.335+0000 7f598880e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.25]): orig_sources= new_sources= 2024-09-12T17:24:30.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.335+0000 7f598880e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.25]): potential sources added=[] removed=[] 2024-09-12T17:24:30.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.335+0000 7f598880e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.25]): orig_dests= new_dests= 2024-09-12T17:24:30.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.335+0000 7f598880e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.25]): potential dests added=[] removed=[] 2024-09-12T17:24:30.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.338+0000 7f598880e800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.25.1.0 2024-09-12T17:24:30.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.338+0000 7f598880e800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.25.1.0 2024-09-12T17:24:30.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.338+0000 7f598880e800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.25.1.1 2024-09-12T17:24:30.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.338+0000 7f598880e800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.25.1.1 2024-09-12T17:24:30.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.338+0000 7f598880e800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.25.0 2024-09-12T17:24:30.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.340+0000 7f598880e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 : hit (requested=0x17, cached=0x17) 2024-09-12T17:24:30.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.340+0000 7f598880e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 2024-09-12T17:24:30.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.342+0000 7f598880e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 info.flags=0x17 2024-09-12T17:24:30.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.342+0000 7f598880e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 to cache LRU end 2024-09-12T17:24:30.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.342+0000 7f598880e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:30.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.342+0000 7f598880e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25, ofs0, ns] 2024-09-12T17:24:30.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.342+0000 7f5862ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464328 cookie 94278901156112 notifier 6738 bl.length()=1009 2024-09-12T17:24:30.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.342+0000 7f5862ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 info.flags=0x17 2024-09-12T17:24:30.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.342+0000 7f5862ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 to cache LRU end 2024-09-12T17:24:30.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.342+0000 7f5862ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:30.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.344+0000 7f598880e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.25]): orig_sources= new_sources= 2024-09-12T17:24:30.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.344+0000 7f598880e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.25]): potential sources added=[] removed=[] 2024-09-12T17:24:30.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.344+0000 7f598880e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.25]): orig_dests= new_dests= 2024-09-12T17:24:30.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.344+0000 7f598880e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.25]): potential dests added=[] removed=[] 2024-09-12T17:24:30.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.345+0000 7f598880e800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.25.0 2024-09-12T17:24:30.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.346+0000 7f598880e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 : hit (requested=0x17, cached=0x17) 2024-09-12T17:24:30.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.346+0000 7f598880e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 2024-09-12T17:24:30.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.347+0000 7f598880e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 info.flags=0x17 2024-09-12T17:24:30.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.347+0000 7f598880e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 to cache LRU end 2024-09-12T17:24:30.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.347+0000 7f598880e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:30.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.347+0000 7f598880e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25, ofs0, ns] 2024-09-12T17:24:30.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.347+0000 7f58627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464329 cookie 94278901156112 notifier 6738 bl.length()=977 2024-09-12T17:24:30.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.347+0000 7f58627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 info.flags=0x17 2024-09-12T17:24:30.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.347+0000 7f58627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 to cache LRU end 2024-09-12T17:24:30.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.347+0000 7f58627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:30.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.349+0000 7f598880e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.25]): orig_sources= new_sources= 2024-09-12T17:24:30.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.349+0000 7f598880e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.25]): potential sources added=[] removed=[] 2024-09-12T17:24:30.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.349+0000 7f598880e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.25]): orig_dests= new_dests= 2024-09-12T17:24:30.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.349+0000 7f598880e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.25]): potential dests added=[] removed=[] 2024-09-12T17:24:30.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.351+0000 7f598880e800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T17:24:30.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.353+0000 7f583a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:30.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.355+0000 7f598880e800 20 remove_watcher() i=0 2024-09-12T17:24:30.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.355+0000 7f598880e800 2 removed watcher, disabling cache 2024-09-12T17:24:30.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.356+0000 7f598880e800 20 remove_watcher() i=1 2024-09-12T17:24:30.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.357+0000 7f598880e800 20 remove_watcher() i=2 2024-09-12T17:24:30.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.359+0000 7f598880e800 20 remove_watcher() i=3 2024-09-12T17:24:30.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.360+0000 7f598880e800 20 remove_watcher() i=4 2024-09-12T17:24:30.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.361+0000 7f598880e800 20 remove_watcher() i=5 2024-09-12T17:24:30.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.362+0000 7f598880e800 20 remove_watcher() i=6 2024-09-12T17:24:30.364 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.363+0000 7f598880e800 20 remove_watcher() i=7 2024-09-12T17:24:30.377 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:24:30.408 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:30.408 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:30.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.448+0000 7fd01ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.450+0000 7fd01ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:30.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.450+0000 7fd01ed2e800 20 realm 2024-09-12T17:24:30.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.450+0000 7fd01ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.450+0000 7fd01ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:30.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.450+0000 7fd01ed2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:30.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.450+0000 7fd01ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.451+0000 7fd01ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:30.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.451+0000 7fd01ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.451+0000 7fd01ed2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:30.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.451+0000 7fd01ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.452+0000 7fd01ed2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:30.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.452+0000 7fd01ed2e800 20 searching for the correct realm 2024-09-12T17:24:30.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.453+0000 7fd01b165640 0 -- 172.21.15.67:0/3261334099 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x55b6c7181210 msgr2=0x55b6c71836a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:30.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.659+0000 7fd01b165640 0 -- 172.21.15.67:0/3261334099 >> [v2:172.21.15.118:6824/1070975205,v1:172.21.15.118:6825/1070975205] conn(0x7fd010071030 msgr2=0x7fd0100609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:30.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.868+0000 7fd01ed2e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:24:30.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.868+0000 7fd01ed2e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:24:30.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.868+0000 7fd01ed2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:30.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.868+0000 7fd01ed2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:30.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.868+0000 7fd01ed2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:30.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.868+0000 7fd01ed2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:30.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.868+0000 7fd01ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.868+0000 7fd01ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:30.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.868+0000 7fd01ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.869+0000 7fd01ed2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:30.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.869+0000 7fd01ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.869+0000 7fd01ed2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:30.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.869+0000 7fd01ed2e800 20 zone default found 2024-09-12T17:24:30.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.869+0000 7fd01ed2e800 4 Realm: () 2024-09-12T17:24:30.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.869+0000 7fd01ed2e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:24:30.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.869+0000 7fd01ed2e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:24:30.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.869+0000 7fd01ed2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:30.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.869+0000 7fd01ed2e800 20 zonegroup default 2024-09-12T17:24:30.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.869+0000 7fd01ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.869+0000 7fd01ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:30.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.869+0000 7fd01ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.870+0000 7fd01ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:30.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.870+0000 7fd01ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.870+0000 7fd01ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:30.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.870+0000 7fd01ed2e800 20 started sync module instance, tier type = 2024-09-12T17:24:30.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.870+0000 7fd01ed2e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:24:30.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.880+0000 7fd01ed2e800 20 add_watcher() i=0 2024-09-12T17:24:30.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.880+0000 7fd01ed2e800 20 add_watcher() i=1 2024-09-12T17:24:30.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.880+0000 7fd01ed2e800 20 add_watcher() i=2 2024-09-12T17:24:30.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.880+0000 7fd01ed2e800 20 add_watcher() i=3 2024-09-12T17:24:30.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.880+0000 7fd01ed2e800 20 add_watcher() i=4 2024-09-12T17:24:30.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.880+0000 7fd01ed2e800 20 add_watcher() i=5 2024-09-12T17:24:30.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.880+0000 7fd01ed2e800 20 add_watcher() i=6 2024-09-12T17:24:30.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.881+0000 7fd01ed2e800 20 add_watcher() i=7 2024-09-12T17:24:30.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.881+0000 7fd01ed2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:30.884 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.883+0000 7fced17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:30.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.883+0000 7fd01ed2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:30.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.883+0000 7fd01ed2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:30.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.883+0000 7fd01ed2e800 5 note: GC not initialized 2024-09-12T17:24:30.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.883+0000 7fce4bfff640 20 reqs_thread_entry: start 2024-09-12T17:24:30.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.883+0000 7fd01ed2e800 20 init_complete bucket index max shards: 1 2024-09-12T17:24:30.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.883+0000 7fd01ed2e800 20 Filter name: none 2024-09-12T17:24:30.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.884+0000 7fce49ffb640 20 reqs_thread_entry: start 2024-09-12T17:24:30.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.884+0000 7fd01ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.884+0000 7fd01ed2e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:24:30.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.884+0000 7fd01ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.885+0000 7fd01ed2e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:24:30.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.885+0000 7fd01ed2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:30.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.885+0000 7fd01ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.885+0000 7fd01ed2e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:24:30.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.885+0000 7fd01ed2e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:30.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.885+0000 7fd01ed2e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:24:30.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.885+0000 7fd01ed2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:30.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.887+0000 7fced17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:30.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.889+0000 7fd01ed2e800 20 remove_watcher() i=0 2024-09-12T17:24:30.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.889+0000 7fd01ed2e800 2 removed watcher, disabling cache 2024-09-12T17:24:30.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.890+0000 7fd01ed2e800 20 remove_watcher() i=1 2024-09-12T17:24:30.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.891+0000 7fd01ed2e800 20 remove_watcher() i=2 2024-09-12T17:24:30.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.892+0000 7fd01ed2e800 20 remove_watcher() i=3 2024-09-12T17:24:30.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.894+0000 7fd01ed2e800 20 remove_watcher() i=4 2024-09-12T17:24:30.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.895+0000 7fd01ed2e800 20 remove_watcher() i=5 2024-09-12T17:24:30.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.896+0000 7fd01ed2e800 20 remove_watcher() i=6 2024-09-12T17:24:30.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:30.897+0000 7fd01ed2e800 20 remove_watcher() i=7 2024-09-12T17:24:30.909 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:30.909 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:24:30.909 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-set-target-layout id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.25 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:24:30.909 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:30.911 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:30.911 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:30.929 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:30.929 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:31.152 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:31.152 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:31.211 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-12T17:24:31.212 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:31.213 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:31.213 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:31.255 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:31.255 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:31.313 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:31.313 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:31.351 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:31.351 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:31.388 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:31.388 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:31.425 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:31.425 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:31.462 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:31.462 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:31.498 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:31.498 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:31.534 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:31.535 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:31.574 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:31.574 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:31.611 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:31.611 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:31.648 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:31.648 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:31.684 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:31.685 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:31.722 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:31.722 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:31.758 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:31.758 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:31.796 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:31.796 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:31.832 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:31.832 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:31.902 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:31.903 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:31.939 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:31.939 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:31.974 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:31.974 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:32.011 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:32.011 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:32.049 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:32.049 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:32.087 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:24:32.117 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:32.117 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:32.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.154+0000 7f9f0a342800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.156+0000 7f9f0a342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.156+0000 7f9f0a342800 20 realm 2024-09-12T17:24:32.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.156+0000 7f9f0a342800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.156+0000 7f9f0a342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.156+0000 7f9f0a342800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:32.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.156+0000 7f9f0a342800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.157+0000 7f9f0a342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.157+0000 7f9f0a342800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.157+0000 7f9f0a342800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:32.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.157+0000 7f9f0a342800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.158+0000 7f9f0a342800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:32.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.158+0000 7f9f0a342800 20 searching for the correct realm 2024-09-12T17:24:32.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.161+0000 7f9f05885640 0 -- 172.21.15.67:0/2294907456 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x56053c93e1d0 msgr2=0x56053c9405c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:32.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.164+0000 7f9f05885640 0 -- 172.21.15.67:0/2294907456 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x56053c945c50 msgr2=0x56053c948040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:24:32.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.168+0000 7f9f0a342800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:24:32.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.168+0000 7f9f0a342800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:24:32.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.168+0000 7f9f0a342800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:32.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.168+0000 7f9f0a342800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:32.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.168+0000 7f9f0a342800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:32.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.168+0000 7f9f0a342800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:32.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.168+0000 7f9f0a342800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.169+0000 7f9f0a342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.169+0000 7f9f0a342800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.169+0000 7f9f0a342800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:32.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.169+0000 7f9f0a342800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.169+0000 7f9f0a342800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:32.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.169+0000 7f9f0a342800 20 zone default found 2024-09-12T17:24:32.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.169+0000 7f9f0a342800 4 Realm: () 2024-09-12T17:24:32.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.169+0000 7f9f0a342800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:24:32.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.169+0000 7f9f0a342800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:24:32.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.169+0000 7f9f0a342800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:32.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.169+0000 7f9f0a342800 20 zonegroup default 2024-09-12T17:24:32.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.169+0000 7f9f0a342800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.169+0000 7f9f0a342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.169+0000 7f9f0a342800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.170+0000 7f9f0a342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.170+0000 7f9f0a342800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.170+0000 7f9f0a342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.170+0000 7f9f0a342800 20 started sync module instance, tier type = 2024-09-12T17:24:32.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.170+0000 7f9f0a342800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:24:32.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.179+0000 7f9f0a342800 20 add_watcher() i=0 2024-09-12T17:24:32.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.179+0000 7f9f0a342800 20 add_watcher() i=1 2024-09-12T17:24:32.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.179+0000 7f9f0a342800 20 add_watcher() i=2 2024-09-12T17:24:32.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.179+0000 7f9f0a342800 20 add_watcher() i=3 2024-09-12T17:24:32.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.179+0000 7f9f0a342800 20 add_watcher() i=4 2024-09-12T17:24:32.181 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.179+0000 7f9f0a342800 20 add_watcher() i=5 2024-09-12T17:24:32.181 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.179+0000 7f9f0a342800 20 add_watcher() i=6 2024-09-12T17:24:32.181 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.180+0000 7f9f0a342800 20 add_watcher() i=7 2024-09-12T17:24:32.181 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.180+0000 7f9f0a342800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:32.182 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.181+0000 7f9dbcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:32.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.182+0000 7f9f0a342800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:32.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.182+0000 7f9f0a342800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:32.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.182+0000 7f9f0a342800 5 note: GC not initialized 2024-09-12T17:24:32.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.182+0000 7f9d377fe640 20 reqs_thread_entry: start 2024-09-12T17:24:32.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.182+0000 7f9f0a342800 20 init_complete bucket index max shards: 1 2024-09-12T17:24:32.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.182+0000 7f9f0a342800 20 Filter name: none 2024-09-12T17:24:32.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.182+0000 7f9d357fa640 20 reqs_thread_entry: start 2024-09-12T17:24:32.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.182+0000 7f9f0a342800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.183+0000 7f9f0a342800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:24:32.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.183+0000 7f9f0a342800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.183+0000 7f9f0a342800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:24:32.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.183+0000 7f9f0a342800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:32.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.183+0000 7f9f0a342800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.183+0000 7f9f0a342800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:24:32.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.184+0000 7f9f0a342800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.184+0000 7f9f0a342800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:24:32.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.184+0000 7f9f0a342800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:32.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.185+0000 7f9dbcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:32.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.187+0000 7f9f0a342800 20 remove_watcher() i=0 2024-09-12T17:24:32.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.187+0000 7f9f0a342800 2 removed watcher, disabling cache 2024-09-12T17:24:32.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.188+0000 7f9f0a342800 20 remove_watcher() i=1 2024-09-12T17:24:32.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.189+0000 7f9f0a342800 20 remove_watcher() i=2 2024-09-12T17:24:32.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.190+0000 7f9f0a342800 20 remove_watcher() i=3 2024-09-12T17:24:32.192 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.191+0000 7f9f0a342800 20 remove_watcher() i=4 2024-09-12T17:24:32.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.192+0000 7f9f0a342800 20 remove_watcher() i=5 2024-09-12T17:24:32.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.193+0000 7f9f0a342800 20 remove_watcher() i=6 2024-09-12T17:24:32.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.194+0000 7f9f0a342800 20 remove_watcher() i=7 2024-09-12T17:24:32.206 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:32.206 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:24:32.206 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-trim-reshard-log-entries id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:24:32.206 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:32.207 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-12T17:24:32.242 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:32.242 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:32.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.280+0000 7f8801f46800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.282+0000 7f8801f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.282+0000 7f8801f46800 20 realm 2024-09-12T17:24:32.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.282+0000 7f8801f46800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.282+0000 7f8801f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.282+0000 7f8801f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:32.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.282+0000 7f8801f46800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.282+0000 7f8801f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.282+0000 7f8801f46800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.283+0000 7f8801f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:32.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.283+0000 7f8801f46800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.284+0000 7f8801f46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:32.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.284+0000 7f8801f46800 20 searching for the correct realm 2024-09-12T17:24:32.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.286+0000 7f87ffa37640 0 -- 172.21.15.67:0/607271406 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f87f8071040 msgr2=0x7f87f8055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:32.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.289+0000 7f87ffa37640 0 -- 172.21.15.67:0/607271406 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f87f4088560 msgr2=0x7f87f4061090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:24:32.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.495+0000 7f8801f46800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:24:32.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.495+0000 7f8801f46800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:24:32.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.495+0000 7f8801f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:32.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.495+0000 7f8801f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:32.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.495+0000 7f8801f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:32.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.495+0000 7f8801f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:32.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.495+0000 7f8801f46800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.495+0000 7f8801f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.495+0000 7f8801f46800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.496+0000 7f8801f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:32.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.496+0000 7f8801f46800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.496+0000 7f8801f46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:32.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.496+0000 7f8801f46800 20 zone default found 2024-09-12T17:24:32.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.496+0000 7f8801f46800 4 Realm: () 2024-09-12T17:24:32.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.496+0000 7f8801f46800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:24:32.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.496+0000 7f8801f46800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:24:32.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.496+0000 7f8801f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:32.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.496+0000 7f8801f46800 20 zonegroup default 2024-09-12T17:24:32.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.496+0000 7f8801f46800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.496+0000 7f8801f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.496+0000 7f8801f46800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.497+0000 7f8801f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.497+0000 7f8801f46800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.497+0000 7f8801f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.497+0000 7f8801f46800 20 started sync module instance, tier type = 2024-09-12T17:24:32.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.497+0000 7f8801f46800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:24:32.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.506+0000 7f8801f46800 20 add_watcher() i=0 2024-09-12T17:24:32.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.506+0000 7f8801f46800 20 add_watcher() i=1 2024-09-12T17:24:32.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.506+0000 7f8801f46800 20 add_watcher() i=2 2024-09-12T17:24:32.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.506+0000 7f8801f46800 20 add_watcher() i=3 2024-09-12T17:24:32.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.506+0000 7f8801f46800 20 add_watcher() i=4 2024-09-12T17:24:32.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.506+0000 7f8801f46800 20 add_watcher() i=5 2024-09-12T17:24:32.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.506+0000 7f8801f46800 20 add_watcher() i=6 2024-09-12T17:24:32.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.507+0000 7f8801f46800 20 add_watcher() i=7 2024-09-12T17:24:32.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.507+0000 7f8801f46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:32.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.508+0000 7f86b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:32.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.509+0000 7f8801f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:32.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.509+0000 7f8801f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:32.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.509+0000 7f8801f46800 5 note: GC not initialized 2024-09-12T17:24:32.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.509+0000 7f86b4fe1640 20 reqs_thread_entry: start 2024-09-12T17:24:32.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.509+0000 7f8801f46800 20 init_complete bucket index max shards: 1 2024-09-12T17:24:32.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.509+0000 7f8801f46800 20 Filter name: none 2024-09-12T17:24:32.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.509+0000 7f862e7fc640 20 reqs_thread_entry: start 2024-09-12T17:24:32.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.509+0000 7f8801f46800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:24:32.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.509+0000 7f8801f46800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.510+0000 7f8801f46800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:24:32.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.510+0000 7f8801f46800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:24:32.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.510+0000 7f8801f46800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:24:32.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.510+0000 7f8801f46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 : miss 2024-09-12T17:24:32.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.510+0000 7f8801f46800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.510+0000 7f8801f46800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:24:32.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.510+0000 7f8801f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 info.flags=0x17 2024-09-12T17:24:32.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.510+0000 7f8801f46800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 to cache LRU end 2024-09-12T17:24:32.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.510+0000 7f8801f46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:24:32.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.510+0000 7f8801f46800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:32.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.510+0000 7f8801f46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 2024-09-12T17:24:32.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.514+0000 7f8801f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 info.flags=0x17 2024-09-12T17:24:32.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.514+0000 7f8801f46800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 to cache LRU end 2024-09-12T17:24:32.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.514+0000 7f8801f46800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:32.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.514+0000 7f8801f46800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26, ofs0, ns] 2024-09-12T17:24:32.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.514+0000 7f86deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464277 cookie 93964719601440 notifier 6795 bl.length()=1023 2024-09-12T17:24:32.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.514+0000 7f86deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 info.flags=0x17 2024-09-12T17:24:32.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.514+0000 7f86deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 to cache LRU end 2024-09-12T17:24:32.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.514+0000 7f86deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:32.517 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.516+0000 7f8801f46800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.26]): orig_sources= new_sources= 2024-09-12T17:24:32.517 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.516+0000 7f8801f46800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.26]): potential sources added=[] removed=[] 2024-09-12T17:24:32.517 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.516+0000 7f8801f46800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.26]): orig_dests= new_dests= 2024-09-12T17:24:32.517 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.516+0000 7f8801f46800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.26]): potential dests added=[] removed=[] 2024-09-12T17:24:32.517 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.516+0000 7f8801f46800 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-12T17:24:32.517 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.516+0000 7f8801f46800 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-12T17:24:32.518 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.518+0000 7f86b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:32.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.520+0000 7f8801f46800 20 remove_watcher() i=0 2024-09-12T17:24:32.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.520+0000 7f8801f46800 2 removed watcher, disabling cache 2024-09-12T17:24:32.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.521+0000 7f8801f46800 20 remove_watcher() i=1 2024-09-12T17:24:32.523 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.522+0000 7f8801f46800 20 remove_watcher() i=2 2024-09-12T17:24:32.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.523+0000 7f8801f46800 20 remove_watcher() i=3 2024-09-12T17:24:32.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.524+0000 7f8801f46800 20 remove_watcher() i=4 2024-09-12T17:24:32.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.525+0000 7f8801f46800 20 remove_watcher() i=5 2024-09-12T17:24:32.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.526+0000 7f8801f46800 20 remove_watcher() i=6 2024-09-12T17:24:32.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.527+0000 7f8801f46800 20 remove_watcher() i=7 2024-09-12T17:24:32.540 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:24:32.570 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:32.571 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:32.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.609+0000 7f71b440e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.610+0000 7f71b440e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.610+0000 7f71b440e800 20 realm 2024-09-12T17:24:32.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.610+0000 7f71b440e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.611+0000 7f71b440e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.611+0000 7f71b440e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:32.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.611+0000 7f71b440e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.611+0000 7f71b440e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.611+0000 7f71b440e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.612+0000 7f71b440e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:32.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.612+0000 7f71b440e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.613+0000 7f71b440e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:32.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.613+0000 7f71b440e800 20 searching for the correct realm 2024-09-12T17:24:32.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.615+0000 7f71a736a640 0 -- 172.21.15.67:0/3722726139 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f71a0033030 msgr2=0x7f71a0067630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:32.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.618+0000 7f71afb6b640 0 -- 172.21.15.67:0/3722726139 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f71980a55c0 msgr2=0x7f719806ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:32.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.823+0000 7f71b440e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:24:32.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.823+0000 7f71b440e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:24:32.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.824+0000 7f71b440e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:32.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.824+0000 7f71b440e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:32.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.824+0000 7f71b440e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:32.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.824+0000 7f71b440e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:32.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.824+0000 7f71b440e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.824+0000 7f71b440e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.824+0000 7f71b440e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.824+0000 7f71b440e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:32.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.824+0000 7f71b440e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.824+0000 7f71b440e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:32.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.824+0000 7f71b440e800 20 zone default found 2024-09-12T17:24:32.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.824+0000 7f71b440e800 4 Realm: () 2024-09-12T17:24:32.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.824+0000 7f71b440e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:24:32.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.824+0000 7f71b440e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:24:32.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.824+0000 7f71b440e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:32.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.824+0000 7f71b440e800 20 zonegroup default 2024-09-12T17:24:32.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.824+0000 7f71b440e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.825+0000 7f71b440e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.825+0000 7f71b440e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.825+0000 7f71b440e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.825+0000 7f71b440e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.825+0000 7f71b440e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:32.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.825+0000 7f71b440e800 20 started sync module instance, tier type = 2024-09-12T17:24:32.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.825+0000 7f71b440e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:24:32.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.835+0000 7f71b440e800 20 add_watcher() i=0 2024-09-12T17:24:32.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.835+0000 7f71b440e800 20 add_watcher() i=1 2024-09-12T17:24:32.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.835+0000 7f71b440e800 20 add_watcher() i=2 2024-09-12T17:24:32.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.835+0000 7f71b440e800 20 add_watcher() i=3 2024-09-12T17:24:32.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.835+0000 7f71b440e800 20 add_watcher() i=4 2024-09-12T17:24:32.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.835+0000 7f71b440e800 20 add_watcher() i=5 2024-09-12T17:24:32.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.835+0000 7f71b440e800 20 add_watcher() i=6 2024-09-12T17:24:32.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.836+0000 7f71b440e800 20 add_watcher() i=7 2024-09-12T17:24:32.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.836+0000 7f71b440e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:32.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.838+0000 7f7065fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:32.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.838+0000 7f71b440e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:32.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.838+0000 7f71b440e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:32.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.838+0000 7f71b440e800 5 note: GC not initialized 2024-09-12T17:24:32.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.838+0000 7f7064fe1640 20 reqs_thread_entry: start 2024-09-12T17:24:32.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.838+0000 7f71b440e800 20 init_complete bucket index max shards: 1 2024-09-12T17:24:32.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.838+0000 7f71b440e800 20 Filter name: none 2024-09-12T17:24:32.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.838+0000 7f6fde7fc640 20 reqs_thread_entry: start 2024-09-12T17:24:32.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.838+0000 7f71b440e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.839+0000 7f71b440e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:24:32.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.839+0000 7f71b440e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.839+0000 7f71b440e800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:24:32.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.839+0000 7f71b440e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:32.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.839+0000 7f71b440e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.840+0000 7f71b440e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:24:32.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.840+0000 7f71b440e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:32.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.840+0000 7f71b440e800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:24:32.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.840+0000 7f71b440e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:32.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.842+0000 7f7065fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:32.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.844+0000 7f71b440e800 20 remove_watcher() i=0 2024-09-12T17:24:32.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.844+0000 7f71b440e800 2 removed watcher, disabling cache 2024-09-12T17:24:32.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.845+0000 7f71b440e800 20 remove_watcher() i=1 2024-09-12T17:24:32.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.846+0000 7f71b440e800 20 remove_watcher() i=2 2024-09-12T17:24:32.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.846+0000 7f71b440e800 20 remove_watcher() i=3 2024-09-12T17:24:32.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.847+0000 7f71b440e800 20 remove_watcher() i=4 2024-09-12T17:24:32.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.848+0000 7f71b440e800 20 remove_watcher() i=5 2024-09-12T17:24:32.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.849+0000 7f71b440e800 20 remove_watcher() i=6 2024-09-12T17:24:32.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:32.850+0000 7f71b440e800 20 remove_watcher() i=7 2024-09-12T17:24:32.862 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:32.863 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:24:32.863 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-trim-reshard-log-entries id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:24:32.863 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:32.864 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:32.864 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:32.901 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:32.901 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:32.959 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:24:32.992 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:32.992 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:33.030 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.029+0000 7f456820e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.030+0000 7f456820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:33.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.030+0000 7f456820e800 20 realm 2024-09-12T17:24:33.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.030+0000 7f456820e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.031+0000 7f456820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:33.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.031+0000 7f456820e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:33.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.031+0000 7f456820e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.031+0000 7f456820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:33.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.031+0000 7f456820e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.032+0000 7f456820e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:33.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.032+0000 7f456820e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.032+0000 7f456820e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:33.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.032+0000 7f456820e800 20 searching for the correct realm 2024-09-12T17:24:33.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.035+0000 7f456396b640 0 -- 172.21.15.67:0/1521740257 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f455c01f040 msgr2=0x7f455c01f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:24:33.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.039+0000 7f456396b640 0 -- 172.21.15.67:0/1521740257 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f45580a33f0 msgr2=0x7f45580a3850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:24:33.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.246+0000 7f456820e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:24:33.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.246+0000 7f456820e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:24:33.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.246+0000 7f456820e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:33.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.246+0000 7f456820e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:33.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.246+0000 7f456820e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:33.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.246+0000 7f456820e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:33.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.246+0000 7f456820e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.246+0000 7f456820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:33.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.246+0000 7f456820e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.246+0000 7f456820e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:33.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.246+0000 7f456820e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.246+0000 7f456820e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:33.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.246+0000 7f456820e800 20 zone default found 2024-09-12T17:24:33.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.246+0000 7f456820e800 4 Realm: () 2024-09-12T17:24:33.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.246+0000 7f456820e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:24:33.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.246+0000 7f456820e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:24:33.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.246+0000 7f456820e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:33.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.246+0000 7f456820e800 20 zonegroup default 2024-09-12T17:24:33.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.246+0000 7f456820e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.247+0000 7f456820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:33.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.247+0000 7f456820e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.247+0000 7f456820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:33.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.247+0000 7f456820e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.247+0000 7f456820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:33.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.247+0000 7f456820e800 20 started sync module instance, tier type = 2024-09-12T17:24:33.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.247+0000 7f456820e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:24:33.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.257+0000 7f456820e800 20 add_watcher() i=0 2024-09-12T17:24:33.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.257+0000 7f456820e800 20 add_watcher() i=1 2024-09-12T17:24:33.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.257+0000 7f456820e800 20 add_watcher() i=2 2024-09-12T17:24:33.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.257+0000 7f456820e800 20 add_watcher() i=3 2024-09-12T17:24:33.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.257+0000 7f456820e800 20 add_watcher() i=4 2024-09-12T17:24:33.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.257+0000 7f456820e800 20 add_watcher() i=5 2024-09-12T17:24:33.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.257+0000 7f456820e800 20 add_watcher() i=6 2024-09-12T17:24:33.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.257+0000 7f456820e800 20 add_watcher() i=7 2024-09-12T17:24:33.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.257+0000 7f456820e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:33.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.259+0000 7f4419fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:33.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.259+0000 7f456820e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:33.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.259+0000 7f456820e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:33.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.260+0000 7f456820e800 5 note: GC not initialized 2024-09-12T17:24:33.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.260+0000 7f4418fe1640 20 reqs_thread_entry: start 2024-09-12T17:24:33.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.260+0000 7f456820e800 20 init_complete bucket index max shards: 1 2024-09-12T17:24:33.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.260+0000 7f456820e800 20 Filter name: none 2024-09-12T17:24:33.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.260+0000 7f43927fc640 20 reqs_thread_entry: start 2024-09-12T17:24:33.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.260+0000 7f456820e800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:24:33.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.260+0000 7f456820e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.261+0000 7f456820e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:24:33.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.261+0000 7f456820e800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:24:33.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.261+0000 7f456820e800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:24:33.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.261+0000 7f456820e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 : miss 2024-09-12T17:24:33.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.261+0000 7f456820e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.261+0000 7f456820e800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:24:33.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.261+0000 7f456820e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 info.flags=0x17 2024-09-12T17:24:33.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.261+0000 7f456820e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 to cache LRU end 2024-09-12T17:24:33.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.261+0000 7f456820e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:24:33.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.261+0000 7f456820e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:33.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.261+0000 7f456820e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 2024-09-12T17:24:33.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.262+0000 7f456820e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:24:33.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.266+0000 7f456820e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 info.flags=0x17 2024-09-12T17:24:33.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.266+0000 7f456820e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 to cache LRU end 2024-09-12T17:24:33.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.266+0000 7f456820e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:33.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.266+0000 7f456820e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26, ofs0, ns] 2024-09-12T17:24:33.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.266+0000 7f44427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464278 cookie 93997467066832 notifier 6831 bl.length()=1023 2024-09-12T17:24:33.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.266+0000 7f44427fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 info.flags=0x17 2024-09-12T17:24:33.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.266+0000 7f44427fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 to cache LRU end 2024-09-12T17:24:33.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.266+0000 7f44427fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:33.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.268+0000 7f456820e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.26]): orig_sources= new_sources= 2024-09-12T17:24:33.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.268+0000 7f456820e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.26]): potential sources added=[] removed=[] 2024-09-12T17:24:33.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.268+0000 7f456820e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.26]): orig_dests= new_dests= 2024-09-12T17:24:33.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.268+0000 7f456820e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.26]): potential dests added=[] removed=[] 2024-09-12T17:24:33.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.270+0000 7f456820e800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.26.2.0 2024-09-12T17:24:33.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.270+0000 7f456820e800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.26.2.0 2024-09-12T17:24:33.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.270+0000 7f456820e800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.26.2.1 2024-09-12T17:24:33.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.270+0000 7f456820e800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.26.2.1 2024-09-12T17:24:33.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.270+0000 7f456820e800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.26.0 2024-09-12T17:24:33.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.272+0000 7f456820e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 : hit (requested=0x17, cached=0x17) 2024-09-12T17:24:33.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.272+0000 7f456820e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 2024-09-12T17:24:33.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.273+0000 7f456820e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 info.flags=0x17 2024-09-12T17:24:33.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.273+0000 7f456820e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 to cache LRU end 2024-09-12T17:24:33.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.273+0000 7f456820e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:33.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.273+0000 7f456820e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26, ofs0, ns] 2024-09-12T17:24:33.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.273+0000 7f44427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464279 cookie 93997467066832 notifier 6831 bl.length()=1023 2024-09-12T17:24:33.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.273+0000 7f44427fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 info.flags=0x17 2024-09-12T17:24:33.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.273+0000 7f44427fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 to cache LRU end 2024-09-12T17:24:33.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.273+0000 7f44427fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:33.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.275+0000 7f456820e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.26]): orig_sources= new_sources= 2024-09-12T17:24:33.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.275+0000 7f456820e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.26]): potential sources added=[] removed=[] 2024-09-12T17:24:33.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.275+0000 7f456820e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.26]): orig_dests= new_dests= 2024-09-12T17:24:33.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.275+0000 7f456820e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.26]): potential dests added=[] removed=[] 2024-09-12T17:24:33.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.276+0000 7f456820e800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.26.0 2024-09-12T17:24:33.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.276+0000 7f456820e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 : hit (requested=0x17, cached=0x17) 2024-09-12T17:24:33.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.276+0000 7f456820e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 2024-09-12T17:24:33.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.278+0000 7f456820e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 info.flags=0x17 2024-09-12T17:24:33.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.278+0000 7f456820e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 to cache LRU end 2024-09-12T17:24:33.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.278+0000 7f456820e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:33.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.278+0000 7f456820e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26, ofs0, ns] 2024-09-12T17:24:33.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.278+0000 7f4442ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464280 cookie 93997467066832 notifier 6831 bl.length()=991 2024-09-12T17:24:33.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.278+0000 7f4442ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 info.flags=0x17 2024-09-12T17:24:33.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.278+0000 7f4442ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 to cache LRU end 2024-09-12T17:24:33.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.278+0000 7f4442ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:33.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.280+0000 7f456820e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.26]): orig_sources= new_sources= 2024-09-12T17:24:33.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.280+0000 7f456820e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.26]): potential sources added=[] removed=[] 2024-09-12T17:24:33.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.280+0000 7f456820e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.26]): orig_dests= new_dests= 2024-09-12T17:24:33.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.280+0000 7f456820e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.26]): potential dests added=[] removed=[] 2024-09-12T17:24:33.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.281+0000 7f456820e800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T17:24:33.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.283+0000 7f4419fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:33.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.285+0000 7f456820e800 20 remove_watcher() i=0 2024-09-12T17:24:33.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.285+0000 7f456820e800 2 removed watcher, disabling cache 2024-09-12T17:24:33.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.286+0000 7f456820e800 20 remove_watcher() i=1 2024-09-12T17:24:33.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.287+0000 7f456820e800 20 remove_watcher() i=2 2024-09-12T17:24:33.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.288+0000 7f456820e800 20 remove_watcher() i=3 2024-09-12T17:24:33.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.289+0000 7f456820e800 20 remove_watcher() i=4 2024-09-12T17:24:33.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.290+0000 7f456820e800 20 remove_watcher() i=5 2024-09-12T17:24:33.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.291+0000 7f456820e800 20 remove_watcher() i=6 2024-09-12T17:24:33.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.292+0000 7f456820e800 20 remove_watcher() i=7 2024-09-12T17:24:33.305 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:24:33.334 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:33.334 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:33.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.372+0000 7ff0e0308800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.374+0000 7ff0e0308800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:33.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.375+0000 7ff0e0308800 20 realm 2024-09-12T17:24:33.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.375+0000 7ff0e0308800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.375+0000 7ff0e0308800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:33.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.375+0000 7ff0e0308800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:33.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.375+0000 7ff0e0308800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.375+0000 7ff0e0308800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:33.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.375+0000 7ff0e0308800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.376+0000 7ff0e0308800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:33.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.376+0000 7ff0e0308800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.376+0000 7ff0e0308800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:33.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.376+0000 7ff0e0308800 20 searching for the correct realm 2024-09-12T17:24:33.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.378+0000 7ff0dd5f1640 0 -- 172.21.15.67:0/40606118 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7ff0d00ab3c0 msgr2=0x7ff0d0064440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:33.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.382+0000 7ff0dddf2640 0 -- 172.21.15.67:0/40606118 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7ff0d4021020 msgr2=0x7ff0d40627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:33.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.588+0000 7ff0e0308800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:24:33.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.588+0000 7ff0e0308800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:24:33.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.588+0000 7ff0e0308800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:33.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.588+0000 7ff0e0308800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:33.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.588+0000 7ff0e0308800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:33.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.588+0000 7ff0e0308800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:33.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.588+0000 7ff0e0308800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.588+0000 7ff0e0308800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:33.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.588+0000 7ff0e0308800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.588+0000 7ff0e0308800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:33.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.588+0000 7ff0e0308800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.589+0000 7ff0e0308800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:33.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.589+0000 7ff0e0308800 20 zone default found 2024-09-12T17:24:33.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.589+0000 7ff0e0308800 4 Realm: () 2024-09-12T17:24:33.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.589+0000 7ff0e0308800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:24:33.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.589+0000 7ff0e0308800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:24:33.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.589+0000 7ff0e0308800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:33.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.589+0000 7ff0e0308800 20 zonegroup default 2024-09-12T17:24:33.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.589+0000 7ff0e0308800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.589+0000 7ff0e0308800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:33.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.589+0000 7ff0e0308800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.589+0000 7ff0e0308800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:33.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.589+0000 7ff0e0308800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.590+0000 7ff0e0308800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:33.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.590+0000 7ff0e0308800 20 started sync module instance, tier type = 2024-09-12T17:24:33.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.590+0000 7ff0e0308800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:24:33.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.598+0000 7ff0e0308800 20 add_watcher() i=0 2024-09-12T17:24:33.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.598+0000 7ff0e0308800 20 add_watcher() i=1 2024-09-12T17:24:33.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.598+0000 7ff0e0308800 20 add_watcher() i=2 2024-09-12T17:24:33.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.598+0000 7ff0e0308800 20 add_watcher() i=3 2024-09-12T17:24:33.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.598+0000 7ff0e0308800 20 add_watcher() i=4 2024-09-12T17:24:33.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.598+0000 7ff0e0308800 20 add_watcher() i=5 2024-09-12T17:24:33.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.598+0000 7ff0e0308800 20 add_watcher() i=6 2024-09-12T17:24:33.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.599+0000 7ff0e0308800 20 add_watcher() i=7 2024-09-12T17:24:33.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.599+0000 7ff0e0308800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:33.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.601+0000 7fef8f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:33.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.601+0000 7ff0e0308800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:33.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.601+0000 7ff0e0308800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:33.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.601+0000 7ff0e0308800 5 note: GC not initialized 2024-09-12T17:24:33.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.602+0000 7fef8e7fc640 20 reqs_thread_entry: start 2024-09-12T17:24:33.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.602+0000 7ff0e0308800 20 init_complete bucket index max shards: 1 2024-09-12T17:24:33.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.602+0000 7ff0e0308800 20 Filter name: none 2024-09-12T17:24:33.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.602+0000 7fef03fff640 20 reqs_thread_entry: start 2024-09-12T17:24:33.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.602+0000 7ff0e0308800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.602+0000 7ff0e0308800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:24:33.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.602+0000 7ff0e0308800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.603+0000 7ff0e0308800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:24:33.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.603+0000 7ff0e0308800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:33.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.603+0000 7ff0e0308800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.603+0000 7ff0e0308800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:24:33.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.603+0000 7ff0e0308800 20 rados->read ofs=0 len=0 2024-09-12T17:24:33.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.604+0000 7ff0e0308800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:24:33.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.604+0000 7ff0e0308800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:33.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.605+0000 7fef8f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:33.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.607+0000 7ff0e0308800 20 remove_watcher() i=0 2024-09-12T17:24:33.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.607+0000 7ff0e0308800 2 removed watcher, disabling cache 2024-09-12T17:24:33.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.608+0000 7ff0e0308800 20 remove_watcher() i=1 2024-09-12T17:24:33.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.610+0000 7ff0e0308800 20 remove_watcher() i=2 2024-09-12T17:24:33.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.611+0000 7ff0e0308800 20 remove_watcher() i=3 2024-09-12T17:24:33.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.612+0000 7ff0e0308800 20 remove_watcher() i=4 2024-09-12T17:24:33.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.613+0000 7ff0e0308800 20 remove_watcher() i=5 2024-09-12T17:24:33.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.613+0000 7ff0e0308800 20 remove_watcher() i=6 2024-09-12T17:24:33.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:33.614+0000 7ff0e0308800 20 remove_watcher() i=7 2024-09-12T17:24:33.627 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:33.627 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:24:33.627 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-trim-reshard-log-entries id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.26 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:24:33.627 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:33.629 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:33.629 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:33.651 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:33.651 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:33.880 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:33.881 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:33.944 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-12T17:24:33.944 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:33.944 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:33.945 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:33.986 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:33.986 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:34.042 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:34.042 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:34.078 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:34.078 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:34.114 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:34.115 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:34.150 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:34.151 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:34.186 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:34.187 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:34.222 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:34.222 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:34.259 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:34.259 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:34.295 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:34.295 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:34.333 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:34.333 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:34.368 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:34.368 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:34.404 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:34.404 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:34.439 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:34.439 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:34.475 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:34.475 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:34.511 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:34.511 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:34.546 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:34.547 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:34.584 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:34.584 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:34.620 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:34.620 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:34.656 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:34.656 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:34.694 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:34.694 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:34.729 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:34.729 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:34.766 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:24:34.795 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:34.795 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:34.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:34.834+0000 7f4296c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:34.836+0000 7f4296c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:34.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:34.836+0000 7f4296c0e800 20 realm 2024-09-12T17:24:34.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:34.836+0000 7f4296c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:34.836+0000 7f4296c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:34.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:34.836+0000 7f4296c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:34.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:34.836+0000 7f4296c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:34.836+0000 7f4296c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:34.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:34.836+0000 7f4296c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:34.837+0000 7f4296c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:34.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:34.837+0000 7f4296c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:34.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:34.838+0000 7f4296c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:34.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:34.838+0000 7f4296c0e800 20 searching for the correct realm 2024-09-12T17:24:34.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:34.839+0000 7f4291bdf640 0 -- 172.21.15.67:0/931320722 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f428403fb70 msgr2=0x7f428408bf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:35.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.044+0000 7f42923e0640 0 -- 172.21.15.67:0/931320722 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f428807e8f0 msgr2=0x7f4288059980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:35.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.251+0000 7f4296c0e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:24:35.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.251+0000 7f4296c0e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:24:35.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.251+0000 7f4296c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:35.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.251+0000 7f4296c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:35.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.251+0000 7f4296c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:35.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.251+0000 7f4296c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:35.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.251+0000 7f4296c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.251+0000 7f4296c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.251+0000 7f4296c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.252+0000 7f4296c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:35.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.252+0000 7f4296c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.252+0000 7f4296c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:35.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.252+0000 7f4296c0e800 20 zone default found 2024-09-12T17:24:35.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.252+0000 7f4296c0e800 4 Realm: () 2024-09-12T17:24:35.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.252+0000 7f4296c0e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:24:35.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.252+0000 7f4296c0e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:24:35.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.252+0000 7f4296c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:35.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.252+0000 7f4296c0e800 20 zonegroup default 2024-09-12T17:24:35.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.252+0000 7f4296c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.252+0000 7f4296c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.252+0000 7f4296c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.253+0000 7f4296c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.253+0000 7f4296c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.253+0000 7f4296c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.253+0000 7f4296c0e800 20 started sync module instance, tier type = 2024-09-12T17:24:35.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.253+0000 7f4296c0e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:24:35.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.263+0000 7f4296c0e800 20 add_watcher() i=0 2024-09-12T17:24:35.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.263+0000 7f4296c0e800 20 add_watcher() i=1 2024-09-12T17:24:35.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.263+0000 7f4296c0e800 20 add_watcher() i=2 2024-09-12T17:24:35.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.263+0000 7f4296c0e800 20 add_watcher() i=3 2024-09-12T17:24:35.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.263+0000 7f4296c0e800 20 add_watcher() i=4 2024-09-12T17:24:35.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.263+0000 7f4296c0e800 20 add_watcher() i=5 2024-09-12T17:24:35.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.263+0000 7f4296c0e800 20 add_watcher() i=6 2024-09-12T17:24:35.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.264+0000 7f4296c0e800 20 add_watcher() i=7 2024-09-12T17:24:35.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.264+0000 7f4296c0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:35.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.265+0000 7f4148fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:35.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.266+0000 7f4296c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:35.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.266+0000 7f4296c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:35.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.266+0000 7f4296c0e800 5 note: GC not initialized 2024-09-12T17:24:35.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.266+0000 7f40c37fe640 20 reqs_thread_entry: start 2024-09-12T17:24:35.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.266+0000 7f4296c0e800 20 init_complete bucket index max shards: 1 2024-09-12T17:24:35.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.266+0000 7f4296c0e800 20 Filter name: none 2024-09-12T17:24:35.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.266+0000 7f40c17fa640 20 reqs_thread_entry: start 2024-09-12T17:24:35.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.266+0000 7f4296c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.267+0000 7f4296c0e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:24:35.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.267+0000 7f4296c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.267+0000 7f4296c0e800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:24:35.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.267+0000 7f4296c0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:35.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.267+0000 7f4296c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.267+0000 7f4296c0e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:24:35.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.267+0000 7f4296c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.268+0000 7f4296c0e800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:24:35.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.268+0000 7f4296c0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:35.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.269+0000 7f4148fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:35.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.271+0000 7f4296c0e800 20 remove_watcher() i=0 2024-09-12T17:24:35.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.271+0000 7f4296c0e800 2 removed watcher, disabling cache 2024-09-12T17:24:35.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.272+0000 7f4296c0e800 20 remove_watcher() i=1 2024-09-12T17:24:35.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.273+0000 7f4296c0e800 20 remove_watcher() i=2 2024-09-12T17:24:35.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.274+0000 7f4296c0e800 20 remove_watcher() i=3 2024-09-12T17:24:35.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.275+0000 7f4296c0e800 20 remove_watcher() i=4 2024-09-12T17:24:35.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.276+0000 7f4296c0e800 20 remove_watcher() i=5 2024-09-12T17:24:35.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.277+0000 7f4296c0e800 20 remove_watcher() i=6 2024-09-12T17:24:35.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.278+0000 7f4296c0e800 20 remove_watcher() i=7 2024-09-12T17:24:35.291 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:35.291 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:24:35.291 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-trim-reshard-log-entries id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:24:35.291 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:35.292 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-12T17:24:35.329 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:35.330 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:35.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.368+0000 7f31b5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.369+0000 7f31b5b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.369+0000 7f31b5b19800 20 realm 2024-09-12T17:24:35.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.369+0000 7f31b5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.369+0000 7f31b5b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.369+0000 7f31b5b19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:35.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.369+0000 7f31b5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.370+0000 7f31b5b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.370+0000 7f31b5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.371+0000 7f31b5b19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:35.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.371+0000 7f31b5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.371+0000 7f31b5b19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:35.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.371+0000 7f31b5b19800 20 searching for the correct realm 2024-09-12T17:24:35.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.372+0000 7f31b3603640 0 -- 172.21.15.67:0/1330735059 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f31ac064040 msgr2=0x7f31ac055410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:35.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.578+0000 7f31b2e02640 0 -- 172.21.15.67:0/1330735059 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f31a403d910 msgr2=0x7f31a40153d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:35.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.584+0000 7f31b5b19800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:24:35.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.584+0000 7f31b5b19800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:24:35.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.584+0000 7f31b5b19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:35.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.584+0000 7f31b5b19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:35.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.584+0000 7f31b5b19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:35.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.584+0000 7f31b5b19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:35.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.584+0000 7f31b5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.584+0000 7f31b5b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.584+0000 7f31b5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.584+0000 7f31b5b19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:35.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.584+0000 7f31b5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.585+0000 7f31b5b19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:35.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.585+0000 7f31b5b19800 20 zone default found 2024-09-12T17:24:35.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.585+0000 7f31b5b19800 4 Realm: () 2024-09-12T17:24:35.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.585+0000 7f31b5b19800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:24:35.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.585+0000 7f31b5b19800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:24:35.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.585+0000 7f31b5b19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:35.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.585+0000 7f31b5b19800 20 zonegroup default 2024-09-12T17:24:35.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.585+0000 7f31b5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.585+0000 7f31b5b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.585+0000 7f31b5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.585+0000 7f31b5b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.585+0000 7f31b5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.585+0000 7f31b5b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.585+0000 7f31b5b19800 20 started sync module instance, tier type = 2024-09-12T17:24:35.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.585+0000 7f31b5b19800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:24:35.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.594+0000 7f31b5b19800 20 add_watcher() i=0 2024-09-12T17:24:35.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.594+0000 7f31b5b19800 20 add_watcher() i=1 2024-09-12T17:24:35.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.594+0000 7f31b5b19800 20 add_watcher() i=2 2024-09-12T17:24:35.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.594+0000 7f31b5b19800 20 add_watcher() i=3 2024-09-12T17:24:35.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.594+0000 7f31b5b19800 20 add_watcher() i=4 2024-09-12T17:24:35.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.594+0000 7f31b5b19800 20 add_watcher() i=5 2024-09-12T17:24:35.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.594+0000 7f31b5b19800 20 add_watcher() i=6 2024-09-12T17:24:35.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.595+0000 7f31b5b19800 20 add_watcher() i=7 2024-09-12T17:24:35.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.595+0000 7f31b5b19800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:35.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.597+0000 7f3069fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:35.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.597+0000 7f31b5b19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:35.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.597+0000 7f31b5b19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:35.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.597+0000 7f31b5b19800 5 note: GC not initialized 2024-09-12T17:24:35.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.598+0000 7f3068fe1640 20 reqs_thread_entry: start 2024-09-12T17:24:35.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.598+0000 7f31b5b19800 20 init_complete bucket index max shards: 1 2024-09-12T17:24:35.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.598+0000 7f31b5b19800 20 Filter name: none 2024-09-12T17:24:35.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.598+0000 7f2fe27fc640 20 reqs_thread_entry: start 2024-09-12T17:24:35.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.598+0000 7f31b5b19800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:24:35.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.598+0000 7f31b5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.599+0000 7f31b5b19800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:24:35.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.599+0000 7f31b5b19800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:24:35.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.599+0000 7f31b5b19800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:24:35.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.599+0000 7f31b5b19800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27 : miss 2024-09-12T17:24:35.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.599+0000 7f31b5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.599+0000 7f31b5b19800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:24:35.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.599+0000 7f31b5b19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27 info.flags=0x17 2024-09-12T17:24:35.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.599+0000 7f31b5b19800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27 to cache LRU end 2024-09-12T17:24:35.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.599+0000 7f31b5b19800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:24:35.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.599+0000 7f31b5b19800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:35.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.599+0000 7f31b5b19800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27 2024-09-12T17:24:35.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.604+0000 7f31b5b19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27 info.flags=0x17 2024-09-12T17:24:35.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.604+0000 7f31b5b19800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27 to cache LRU end 2024-09-12T17:24:35.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.604+0000 7f31b5b19800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:35.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.604+0000 7f31b5b19800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27, ofs0, ns] 2024-09-12T17:24:35.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.604+0000 7f3096ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464283 cookie 93850730455616 notifier 6470 bl.length()=1023 2024-09-12T17:24:35.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.604+0000 7f3096ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27 info.flags=0x17 2024-09-12T17:24:35.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.604+0000 7f3096ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27 to cache LRU end 2024-09-12T17:24:35.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.604+0000 7f3096ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:35.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.606+0000 7f31b5b19800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.27]): orig_sources= new_sources= 2024-09-12T17:24:35.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.606+0000 7f31b5b19800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.27]): potential sources added=[] removed=[] 2024-09-12T17:24:35.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.606+0000 7f31b5b19800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.27]): orig_dests= new_dests= 2024-09-12T17:24:35.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.606+0000 7f31b5b19800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.27]): potential dests added=[] removed=[] 2024-09-12T17:24:35.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.606+0000 7f31b5b19800 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-12T17:24:35.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.606+0000 7f31b5b19800 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-12T17:24:35.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.607+0000 7f31b5b19800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.27.1.0 2024-09-12T17:24:35.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.607+0000 7f31b5b19800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.27.1.0 2024-09-12T17:24:35.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.607+0000 7f31b5b19800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.27.1.1 2024-09-12T17:24:35.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.607+0000 7f31b5b19800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.27.1.1 2024-09-12T17:24:35.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.607+0000 7f31b5b19800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.27.0 2024-09-12T17:24:35.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.610+0000 7f31b5b19800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27 : hit (requested=0x17, cached=0x17) 2024-09-12T17:24:35.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.610+0000 7f31b5b19800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27 2024-09-12T17:24:35.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.611+0000 7f31b5b19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27 info.flags=0x17 2024-09-12T17:24:35.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.611+0000 7f31b5b19800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27 to cache LRU end 2024-09-12T17:24:35.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.611+0000 7f31b5b19800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:35.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.611+0000 7f31b5b19800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27, ofs0, ns] 2024-09-12T17:24:35.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.611+0000 7f30967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464284 cookie 93850730455616 notifier 6470 bl.length()=991 2024-09-12T17:24:35.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.611+0000 7f30967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27 info.flags=0x17 2024-09-12T17:24:35.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.611+0000 7f30967fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27 to cache LRU end 2024-09-12T17:24:35.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.611+0000 7f30967fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:35.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.612+0000 7f31b5b19800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.27]): orig_sources= new_sources= 2024-09-12T17:24:35.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.612+0000 7f31b5b19800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.27]): potential sources added=[] removed=[] 2024-09-12T17:24:35.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.612+0000 7f31b5b19800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.27]): orig_dests= new_dests= 2024-09-12T17:24:35.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.612+0000 7f31b5b19800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.27]): potential dests added=[] removed=[] 2024-09-12T17:24:35.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.613+0000 7f31b5b19800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T17:24:35.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.615+0000 7f3069fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:35.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.618+0000 7f31b5b19800 20 remove_watcher() i=0 2024-09-12T17:24:35.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.618+0000 7f31b5b19800 2 removed watcher, disabling cache 2024-09-12T17:24:35.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.619+0000 7f31b5b19800 20 remove_watcher() i=1 2024-09-12T17:24:35.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.620+0000 7f31b5b19800 20 remove_watcher() i=2 2024-09-12T17:24:35.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.621+0000 7f31b5b19800 20 remove_watcher() i=3 2024-09-12T17:24:35.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.622+0000 7f31b5b19800 20 remove_watcher() i=4 2024-09-12T17:24:35.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.623+0000 7f31b5b19800 20 remove_watcher() i=5 2024-09-12T17:24:35.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.624+0000 7f31b5b19800 20 remove_watcher() i=6 2024-09-12T17:24:35.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.625+0000 7f31b5b19800 20 remove_watcher() i=7 2024-09-12T17:24:35.638 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:24:35.668 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:35.668 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:35.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.705+0000 7f4bdb11f800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.707+0000 7f4bdb11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.707+0000 7f4bdb11f800 20 realm 2024-09-12T17:24:35.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.707+0000 7f4bdb11f800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.707+0000 7f4bdb11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.707+0000 7f4bdb11f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:35.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.707+0000 7f4bdb11f800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.707+0000 7f4bdb11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.707+0000 7f4bdb11f800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.708+0000 7f4bdb11f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:35.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.708+0000 7f4bdb11f800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.709+0000 7f4bdb11f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:35.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.709+0000 7f4bdb11f800 20 searching for the correct realm 2024-09-12T17:24:35.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.712+0000 7f4bd6ea2640 0 -- 172.21.15.67:0/3312654729 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f4bd006f400 msgr2=0x7f4bd006f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:35.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.715+0000 7f4bd6ea2640 0 -- 172.21.15.67:0/3312654729 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f4bc0028040 msgr2=0x7f4bc00847c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:24:35.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.920+0000 7f4bdb11f800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:24:35.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.920+0000 7f4bdb11f800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:24:35.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.920+0000 7f4bdb11f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:35.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.920+0000 7f4bdb11f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:35.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.920+0000 7f4bdb11f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:35.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.920+0000 7f4bdb11f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:35.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.920+0000 7f4bdb11f800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.921+0000 7f4bdb11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.921+0000 7f4bdb11f800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.921+0000 7f4bdb11f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:35.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.921+0000 7f4bdb11f800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.922+0000 7f4bdb11f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:35.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.922+0000 7f4bdb11f800 20 zone default found 2024-09-12T17:24:35.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.922+0000 7f4bdb11f800 4 Realm: () 2024-09-12T17:24:35.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.922+0000 7f4bdb11f800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:24:35.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.922+0000 7f4bdb11f800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:24:35.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.922+0000 7f4bdb11f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:35.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.922+0000 7f4bdb11f800 20 zonegroup default 2024-09-12T17:24:35.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.922+0000 7f4bdb11f800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.922+0000 7f4bdb11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.922+0000 7f4bdb11f800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.922+0000 7f4bdb11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.922+0000 7f4bdb11f800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.922+0000 7f4bdb11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:35.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.922+0000 7f4bdb11f800 20 started sync module instance, tier type = 2024-09-12T17:24:35.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.922+0000 7f4bdb11f800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:24:35.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.933+0000 7f4bdb11f800 20 add_watcher() i=0 2024-09-12T17:24:35.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.933+0000 7f4bdb11f800 20 add_watcher() i=1 2024-09-12T17:24:35.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.933+0000 7f4bdb11f800 20 add_watcher() i=2 2024-09-12T17:24:35.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.933+0000 7f4bdb11f800 20 add_watcher() i=3 2024-09-12T17:24:35.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.933+0000 7f4bdb11f800 20 add_watcher() i=4 2024-09-12T17:24:35.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.933+0000 7f4bdb11f800 20 add_watcher() i=5 2024-09-12T17:24:35.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.933+0000 7f4bdb11f800 20 add_watcher() i=6 2024-09-12T17:24:35.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.934+0000 7f4bdb11f800 20 add_watcher() i=7 2024-09-12T17:24:35.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.934+0000 7f4bdb11f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:35.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.936+0000 7f4a8d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:35.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.936+0000 7f4bdb11f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:35.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.936+0000 7f4bdb11f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:35.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.936+0000 7f4bdb11f800 5 note: GC not initialized 2024-09-12T17:24:35.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.936+0000 7f4a07fff640 20 reqs_thread_entry: start 2024-09-12T17:24:35.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.936+0000 7f4bdb11f800 20 init_complete bucket index max shards: 1 2024-09-12T17:24:35.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.936+0000 7f4bdb11f800 20 Filter name: none 2024-09-12T17:24:35.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.936+0000 7f4a05ffb640 20 reqs_thread_entry: start 2024-09-12T17:24:35.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.937+0000 7f4bdb11f800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.937+0000 7f4bdb11f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:24:35.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.937+0000 7f4bdb11f800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.937+0000 7f4bdb11f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:24:35.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.937+0000 7f4bdb11f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:35.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.937+0000 7f4bdb11f800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.938+0000 7f4bdb11f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:24:35.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.938+0000 7f4bdb11f800 20 rados->read ofs=0 len=0 2024-09-12T17:24:35.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.938+0000 7f4bdb11f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:24:35.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.938+0000 7f4bdb11f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:35.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.939+0000 7f4a8d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:35.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.941+0000 7f4bdb11f800 20 remove_watcher() i=0 2024-09-12T17:24:35.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.941+0000 7f4bdb11f800 2 removed watcher, disabling cache 2024-09-12T17:24:35.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.942+0000 7f4bdb11f800 20 remove_watcher() i=1 2024-09-12T17:24:35.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.943+0000 7f4bdb11f800 20 remove_watcher() i=2 2024-09-12T17:24:35.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.944+0000 7f4bdb11f800 20 remove_watcher() i=3 2024-09-12T17:24:35.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.945+0000 7f4bdb11f800 20 remove_watcher() i=4 2024-09-12T17:24:35.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.946+0000 7f4bdb11f800 20 remove_watcher() i=5 2024-09-12T17:24:35.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.947+0000 7f4bdb11f800 20 remove_watcher() i=6 2024-09-12T17:24:35.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:35.948+0000 7f4bdb11f800 20 remove_watcher() i=7 2024-09-12T17:24:35.960 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:35.960 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:24:35.960 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-trim-reshard-log-entries id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.27 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T17:24:35.960 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:35.962 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:35.962 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:35.983 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:35.983 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:36.220 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:36.220 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:36.283 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-12T17:24:36.283 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:36.284 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:36.285 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:36.326 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:36.326 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:36.384 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:36.384 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:36.424 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:36.424 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:36.459 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:36.459 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:36.496 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:36.496 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:36.530 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:36.530 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:36.569 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:36.569 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:36.604 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:36.604 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:36.640 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:36.641 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:36.677 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:36.677 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:36.713 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:36.713 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:36.749 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:36.750 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:36.786 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:36.786 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:36.822 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:36.822 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:36.857 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:36.858 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:36.893 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:36.893 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:36.929 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:36.929 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:36.965 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:36.965 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:37.002 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:37.002 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:37.037 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:37.038 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:37.075 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:37.075 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:37.112 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:24:37.141 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:37.142 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:37.181 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.180+0000 7fc86ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.181+0000 7fc86ea20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.181+0000 7fc86ea20800 20 realm 2024-09-12T17:24:37.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.181+0000 7fc86ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.182+0000 7fc86ea20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.182+0000 7fc86ea20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:37.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.182+0000 7fc86ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.182+0000 7fc86ea20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.182+0000 7fc86ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.183+0000 7fc86ea20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:37.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.183+0000 7fc86ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.183+0000 7fc86ea20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:37.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.184+0000 7fc86ea20800 20 searching for the correct realm 2024-09-12T17:24:37.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.186+0000 7fc86bd10640 0 -- 172.21.15.67:0/744544846 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55bd29ddb010 msgr2=0x55bd29ddd400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:37.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.189+0000 7fc86c511640 0 -- 172.21.15.67:0/744544846 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fc8600b5220 msgr2=0x7fc8600e40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:37.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.395+0000 7fc86ea20800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:24:37.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.395+0000 7fc86ea20800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:24:37.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.395+0000 7fc86ea20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:37.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.395+0000 7fc86ea20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:37.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.395+0000 7fc86ea20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:37.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.395+0000 7fc86ea20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:37.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.395+0000 7fc86ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.396+0000 7fc86ea20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.396+0000 7fc86ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.396+0000 7fc86ea20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:37.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.396+0000 7fc86ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.397+0000 7fc86ea20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:37.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.397+0000 7fc86ea20800 20 zone default found 2024-09-12T17:24:37.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.397+0000 7fc86ea20800 4 Realm: () 2024-09-12T17:24:37.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.397+0000 7fc86ea20800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:24:37.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.397+0000 7fc86ea20800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:24:37.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.397+0000 7fc86ea20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:37.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.397+0000 7fc86ea20800 20 zonegroup default 2024-09-12T17:24:37.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.397+0000 7fc86ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.397+0000 7fc86ea20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.397+0000 7fc86ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.397+0000 7fc86ea20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.397+0000 7fc86ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.398+0000 7fc86ea20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.398+0000 7fc86ea20800 20 started sync module instance, tier type = 2024-09-12T17:24:37.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.398+0000 7fc86ea20800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:24:37.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.407+0000 7fc86ea20800 20 add_watcher() i=0 2024-09-12T17:24:37.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.407+0000 7fc86ea20800 20 add_watcher() i=1 2024-09-12T17:24:37.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.407+0000 7fc86ea20800 20 add_watcher() i=2 2024-09-12T17:24:37.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.407+0000 7fc86ea20800 20 add_watcher() i=3 2024-09-12T17:24:37.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.407+0000 7fc86ea20800 20 add_watcher() i=4 2024-09-12T17:24:37.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.407+0000 7fc86ea20800 20 add_watcher() i=5 2024-09-12T17:24:37.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.407+0000 7fc86ea20800 20 add_watcher() i=6 2024-09-12T17:24:37.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.408+0000 7fc86ea20800 20 add_watcher() i=7 2024-09-12T17:24:37.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.408+0000 7fc86ea20800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:37.411 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.409+0000 7fc7237de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:37.411 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.410+0000 7fc86ea20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:37.411 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.410+0000 7fc86ea20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:37.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.410+0000 7fc86ea20800 5 note: GC not initialized 2024-09-12T17:24:37.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.410+0000 7fc7227dc640 20 reqs_thread_entry: start 2024-09-12T17:24:37.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.410+0000 7fc86ea20800 20 init_complete bucket index max shards: 1 2024-09-12T17:24:37.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.410+0000 7fc86ea20800 20 Filter name: none 2024-09-12T17:24:37.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.410+0000 7fc71b7fe640 20 reqs_thread_entry: start 2024-09-12T17:24:37.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.410+0000 7fc86ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.411+0000 7fc86ea20800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:24:37.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.411+0000 7fc86ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.411+0000 7fc86ea20800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:24:37.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.411+0000 7fc86ea20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:37.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.411+0000 7fc86ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.412+0000 7fc86ea20800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:24:37.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.412+0000 7fc86ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.412+0000 7fc86ea20800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:24:37.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.412+0000 7fc86ea20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:37.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.413+0000 7fc7237de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:37.416 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.415+0000 7fc86ea20800 20 remove_watcher() i=0 2024-09-12T17:24:37.416 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.415+0000 7fc86ea20800 2 removed watcher, disabling cache 2024-09-12T17:24:37.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.417+0000 7fc86ea20800 20 remove_watcher() i=1 2024-09-12T17:24:37.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.418+0000 7fc86ea20800 20 remove_watcher() i=2 2024-09-12T17:24:37.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.418+0000 7fc86ea20800 20 remove_watcher() i=3 2024-09-12T17:24:37.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.419+0000 7fc86ea20800 20 remove_watcher() i=4 2024-09-12T17:24:37.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.420+0000 7fc86ea20800 20 remove_watcher() i=5 2024-09-12T17:24:37.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.422+0000 7fc86ea20800 20 remove_watcher() i=6 2024-09-12T17:24:37.424 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.423+0000 7fc86ea20800 20 remove_watcher() i=7 2024-09-12T17:24:37.434 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.434 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:24:37.434 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-trim-reshard-log-entries id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:24:37.434 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.436 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-12T17:24:37.471 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:37.472 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:37.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.509+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.511+0000 7f1d82b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.511+0000 7f1d82b31800 20 realm 2024-09-12T17:24:37.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.511+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.511+0000 7f1d82b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.511+0000 7f1d82b31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:37.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.511+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.511+0000 7f1d82b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.511+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.512+0000 7f1d82b31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:37.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.512+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.513+0000 7f1d82b31800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:37.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.513+0000 7f1d82b31800 20 searching for the correct realm 2024-09-12T17:24:37.517 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.516+0000 7f1d7f01b640 0 -- 172.21.15.67:0/2897692371 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x5576254c90b0 msgr2=0x5576254cb550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:37.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.520+0000 7f1d76019640 0 -- 172.21.15.67:0/2897692371 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x5576254d0b20 msgr2=0x5576254d2f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:37.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.523+0000 7f1d82b31800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:24:37.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.523+0000 7f1d82b31800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:24:37.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.523+0000 7f1d82b31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:37.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.523+0000 7f1d82b31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:37.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.523+0000 7f1d82b31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:37.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.523+0000 7f1d82b31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:37.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.523+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.524+0000 7f1d82b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.524+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.524+0000 7f1d82b31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:37.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.524+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.524+0000 7f1d82b31800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:37.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.524+0000 7f1d82b31800 20 zone default found 2024-09-12T17:24:37.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.524+0000 7f1d82b31800 4 Realm: () 2024-09-12T17:24:37.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.524+0000 7f1d82b31800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:24:37.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.524+0000 7f1d82b31800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:24:37.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.524+0000 7f1d82b31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:37.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.524+0000 7f1d82b31800 20 zonegroup default 2024-09-12T17:24:37.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.524+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.525+0000 7f1d82b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.525+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.525+0000 7f1d82b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.525+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.525+0000 7f1d82b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.525+0000 7f1d82b31800 20 started sync module instance, tier type = 2024-09-12T17:24:37.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.525+0000 7f1d82b31800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:24:37.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.535+0000 7f1d82b31800 20 add_watcher() i=0 2024-09-12T17:24:37.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.535+0000 7f1d82b31800 20 add_watcher() i=1 2024-09-12T17:24:37.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.535+0000 7f1d82b31800 20 add_watcher() i=2 2024-09-12T17:24:37.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.535+0000 7f1d82b31800 20 add_watcher() i=3 2024-09-12T17:24:37.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.535+0000 7f1d82b31800 20 add_watcher() i=4 2024-09-12T17:24:37.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.535+0000 7f1d82b31800 20 add_watcher() i=5 2024-09-12T17:24:37.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.535+0000 7f1d82b31800 20 add_watcher() i=6 2024-09-12T17:24:37.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.536+0000 7f1d82b31800 20 add_watcher() i=7 2024-09-12T17:24:37.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.536+0000 7f1d82b31800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:37.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.538+0000 7f1c357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:37.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.538+0000 7f1d82b31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:37.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.538+0000 7f1d82b31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:37.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.538+0000 7f1d82b31800 5 note: GC not initialized 2024-09-12T17:24:37.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.538+0000 7f1baffff640 20 reqs_thread_entry: start 2024-09-12T17:24:37.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.538+0000 7f1d82b31800 20 init_complete bucket index max shards: 1 2024-09-12T17:24:37.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.538+0000 7f1d82b31800 20 Filter name: none 2024-09-12T17:24:37.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.539+0000 7f1badffb640 20 reqs_thread_entry: start 2024-09-12T17:24:37.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.539+0000 7f1d82b31800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:24:37.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.539+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.539+0000 7f1d82b31800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:24:37.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.539+0000 7f1d82b31800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:24:37.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.539+0000 7f1d82b31800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:24:37.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.539+0000 7f1d82b31800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 : miss 2024-09-12T17:24:37.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.539+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.539+0000 7f1d82b31800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:24:37.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.539+0000 7f1d82b31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 info.flags=0x17 2024-09-12T17:24:37.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.539+0000 7f1d82b31800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 to cache LRU end 2024-09-12T17:24:37.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.539+0000 7f1d82b31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:24:37.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.539+0000 7f1d82b31800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:37.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.539+0000 7f1d82b31800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 2024-09-12T17:24:37.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.543+0000 7f1d82b31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 info.flags=0x17 2024-09-12T17:24:37.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.543+0000 7f1d82b31800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 to cache LRU end 2024-09-12T17:24:37.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.543+0000 7f1d82b31800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:37.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.543+0000 7f1d82b31800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28, ofs0, ns] 2024-09-12T17:24:37.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.543+0000 7f1c627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464332 cookie 93965920347312 notifier 6942 bl.length()=1023 2024-09-12T17:24:37.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.543+0000 7f1c627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 info.flags=0x17 2024-09-12T17:24:37.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.543+0000 7f1c627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 to cache LRU end 2024-09-12T17:24:37.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.543+0000 7f1c627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:37.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.545+0000 7f1d82b31800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.28]): orig_sources= new_sources= 2024-09-12T17:24:37.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.545+0000 7f1d82b31800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.28]): potential sources added=[] removed=[] 2024-09-12T17:24:37.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.545+0000 7f1d82b31800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.28]): orig_dests= new_dests= 2024-09-12T17:24:37.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.545+0000 7f1d82b31800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.28]): potential dests added=[] removed=[] 2024-09-12T17:24:37.546 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1d82b31800 time 2024-09-12T17:24:37.546174+0000 2024-09-12T17:24:37.546 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:24:37.547 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:24:37.547 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1d8418c71a] 2024-09-12T17:24:37.547 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1d8418c8d8] 2024-09-12T17:24:37.547 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557622b21841] 2024-09-12T17:24:37.547 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd7489e) [0x55762302f89e] 2024-09-12T17:24:37.547 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557622b3150d] 2024-09-12T17:24:37.547 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:24:37.547 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1d82e29590] 2024-09-12T17:24:37.548 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:24:37.548 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:24:37.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.546+0000 7f1d82b31800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1d82b31800 time 2024-09-12T17:24:37.546174+0000 2024-09-12T17:24:37.548 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:24:37.548 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.548 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:24:37.548 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1d8418c71a] 2024-09-12T17:24:37.548 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1d8418c8d8] 2024-09-12T17:24:37.549 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557622b21841] 2024-09-12T17:24:37.549 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd7489e) [0x55762302f89e] 2024-09-12T17:24:37.549 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557622b3150d] 2024-09-12T17:24:37.549 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:24:37.549 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1d82e29590] 2024-09-12T17:24:37.549 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:24:37.549 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:24:37.549 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.549 INFO:tasks.workunit.client.0.smithi067.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:24:37.550 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f1d82b31800 thread_name:radosgw-admin 2024-09-12T17:24:37.566 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:24:37.567 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1d82e3e6f0] 2024-09-12T17:24:37.567 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1d82e8b99c] 2024-09-12T17:24:37.567 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:24:37.567 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:24:37.567 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1d8418c774] 2024-09-12T17:24:37.567 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1d8418c8d8] 2024-09-12T17:24:37.567 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557622b21841] 2024-09-12T17:24:37.567 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd7489e) [0x55762302f89e] 2024-09-12T17:24:37.567 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557622b3150d] 2024-09-12T17:24:37.567 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:24:37.567 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1d82e29590] 2024-09-12T17:24:37.567 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:24:37.567 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:24:37.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.547+0000 7f1d82b31800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:24:37.568 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f1d82b31800 thread_name:radosgw-admin 2024-09-12T17:24:37.568 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.568 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:24:37.568 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1d82e3e6f0] 2024-09-12T17:24:37.568 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1d82e8b99c] 2024-09-12T17:24:37.568 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:24:37.568 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:24:37.568 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1d8418c774] 2024-09-12T17:24:37.568 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1d8418c8d8] 2024-09-12T17:24:37.568 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557622b21841] 2024-09-12T17:24:37.568 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd7489e) [0x55762302f89e] 2024-09-12T17:24:37.568 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557622b3150d] 2024-09-12T17:24:37.569 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:24:37.569 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1d82e29590] 2024-09-12T17:24:37.569 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:24:37.569 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:24:37.569 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:24:37.569 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.569 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T17:24:37.569 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T17:24:37.492+0000 7f1c6ce09640 10 monclient: dump: 2024-09-12T17:24:37.569 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:24:37.569 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:24:37.569 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.569 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.569 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:24:37.570 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:24:37.570 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:24:37.570 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:24:37.570 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:24:37.570 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.570 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T17:24:37.492+0000 7f1d82b31800 10 monclient: shutdown 2024-09-12T17:24:37.570 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T17:24:37.492+0000 7f1d82b31800 5 asok(0x5576251bd730) unregister_commands rotate-key 2024-09-12T17:24:37.570 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T17:24:37.493+0000 7f1d82b31800 10 monclient: build_initial_monmap 2024-09-12T17:24:37.570 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T17:24:37.493+0000 7f1d82b31800 1 build_initial for_mkfs: 0 2024-09-12T17:24:37.570 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T17:24:37.493+0000 7f1d82b31800 10 monclient: monmap: 2024-09-12T17:24:37.570 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:24:37.570 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:24:37.570 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:24:37.570 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:24:37.571 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:24:37.571 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:24:37.571 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:24:37.571 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:24:37.571 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:24:37.571 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.571 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding auth protocol: cephx 2024-09-12T17:24:37.571 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding auth protocol: cephx 2024-09-12T17:24:37.571 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding auth protocol: cephx 2024-09-12T17:24:37.571 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding con mode: secure 2024-09-12T17:24:37.571 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding con mode: crc 2024-09-12T17:24:37.571 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding con mode: secure 2024-09-12T17:24:37.571 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding con mode: crc 2024-09-12T17:24:37.572 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding con mode: secure 2024-09-12T17:24:37.572 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding con mode: crc 2024-09-12T17:24:37.572 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding con mode: crc 2024-09-12T17:24:37.572 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding con mode: secure 2024-09-12T17:24:37.572 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding con mode: crc 2024-09-12T17:24:37.572 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding con mode: secure 2024-09-12T17:24:37.572 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding con mode: crc 2024-09-12T17:24:37.572 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding con mode: secure 2024-09-12T17:24:37.572 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T17:24:37.493+0000 7f1d82b31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:24:37.572 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T17:24:37.493+0000 7f1d82b31800 1 librados: starting msgr at 2024-09-12T17:24:37.572 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T17:24:37.493+0000 7f1d82b31800 1 librados: starting objecter 2024-09-12T17:24:37.572 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command objecter_requests hook 0x557625409320 2024-09-12T17:24:37.572 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T17:24:37.493+0000 7f1d82b31800 1 librados: setting wanted keys 2024-09-12T17:24:37.573 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T17:24:37.493+0000 7f1d82b31800 1 librados: calling monclient init 2024-09-12T17:24:37.573 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T17:24:37.493+0000 7f1d82b31800 10 monclient: init 2024-09-12T17:24:37.573 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding auth protocol: cephx 2024-09-12T17:24:37.573 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding auth protocol: cephx 2024-09-12T17:24:37.573 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding auth protocol: cephx 2024-09-12T17:24:37.573 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding con mode: secure 2024-09-12T17:24:37.573 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding con mode: crc 2024-09-12T17:24:37.573 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding con mode: secure 2024-09-12T17:24:37.573 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding con mode: crc 2024-09-12T17:24:37.573 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding con mode: secure 2024-09-12T17:24:37.573 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding con mode: crc 2024-09-12T17:24:37.573 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding con mode: crc 2024-09-12T17:24:37.573 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding con mode: secure 2024-09-12T17:24:37.574 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding con mode: crc 2024-09-12T17:24:37.574 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding con mode: secure 2024-09-12T17:24:37.574 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding con mode: crc 2024-09-12T17:24:37.574 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding con mode: secure 2024-09-12T17:24:37.574 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T17:24:37.493+0000 7f1d82b31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:24:37.574 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T17:24:37.493+0000 7f1d82b31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:24:37.574 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command rotate-key hook 0x5576253dfcf8 2024-09-12T17:24:37.574 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T17:24:37.493+0000 7f1d82b31800 10 monclient: _reopen_session rank -1 2024-09-12T17:24:37.574 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T17:24:37.493+0000 7f1d82b31800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:24:37.574 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T17:24:37.493+0000 7f1d82b31800 10 monclient(hunting): picked mon.noname-a con 0x557625297ad0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:24:37.574 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T17:24:37.494+0000 7f1d82b31800 10 monclient(hunting): picked mon.noname-c con 0x557625321bf0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:24:37.574 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T17:24:37.494+0000 7f1d82b31800 10 monclient(hunting): picked mon.noname-b con 0x557625327e20 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:24:37.574 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T17:24:37.494+0000 7f1d82b31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:24:37.575 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T17:24:37.494+0000 7f1d82b31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:24:37.575 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T17:24:37.494+0000 7f1d82b31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:24:37.575 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T17:24:37.494+0000 7f1d82b31800 10 monclient(hunting): _renew_subs 2024-09-12T17:24:37.575 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T17:24:37.494+0000 7f1d82b31800 10 monclient(hunting): authenticate will time out at 2288.844140s 2024-09-12T17:24:37.575 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T17:24:37.494+0000 7f1d7e81a640 10 monclient(hunting): get_auth_request con 0x557625297ad0 auth_method 0 2024-09-12T17:24:37.575 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T17:24:37.494+0000 7f1d7e81a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:24:37.575 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T17:24:37.494+0000 7f1d7e81a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:24:37.575 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T17:24:37.494+0000 7f1d7e81a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:24:37.575 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T17:24:37.494+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:24:37.575 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T17:24:37.494+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:24:37.575 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T17:24:37.494+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:24:37.575 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T17:24:37.494+0000 7f1d76019640 10 monclient(hunting): get_auth_request con 0x557625321bf0 auth_method 0 2024-09-12T17:24:37.575 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T17:24:37.494+0000 7f1d76019640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:24:37.575 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T17:24:37.494+0000 7f1d76019640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:24:37.576 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T17:24:37.494+0000 7f1d76019640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:24:37.576 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T17:24:37.494+0000 7f1d76019640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:24:37.576 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T17:24:37.494+0000 7f1d76019640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:24:37.576 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T17:24:37.494+0000 7f1d76019640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:24:37.576 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T17:24:37.494+0000 7f1d7f01b640 10 monclient(hunting): get_auth_request con 0x557625327e20 auth_method 0 2024-09-12T17:24:37.576 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T17:24:37.494+0000 7f1d7f01b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:24:37.576 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T17:24:37.494+0000 7f1d7f01b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:24:37.576 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T17:24:37.494+0000 7f1d7f01b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:24:37.576 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T17:24:37.494+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_done global_id 6933 payload 824 2024-09-12T17:24:37.576 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T17:24:37.494+0000 7f1d7e81a640 10 monclient: _finish_hunting 0 2024-09-12T17:24:37.576 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T17:24:37.494+0000 7f1d7e81a640 1 monclient: found mon.noname-a 2024-09-12T17:24:37.576 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T17:24:37.494+0000 7f1d7e81a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:24:37.576 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T17:24:37.494+0000 7f1c6b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:24:37.577 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T17:24:37.494+0000 7f1c6b606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:24:37.577 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T17:24:37.494+0000 7f1c6b606640 10 monclient: dump: 2024-09-12T17:24:37.577 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:24:37.577 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:24:37.577 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.577 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.577 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:24:37.577 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:24:37.577 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:24:37.577 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:24:37.577 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:24:37.577 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.577 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T17:24:37.494+0000 7f1c6b606640 10 monclient: _finish_auth 0 2024-09-12T17:24:37.578 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T17:24:37.494+0000 7f1c6b606640 10 monclient: _check_auth_tickets 2024-09-12T17:24:37.578 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T17:24:37.494+0000 7f1c6b606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:24:37.578 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T17:24:37.494+0000 7f1c6b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:24:37.578 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T17:24:37.494+0000 7f1c6b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:24:37.578 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T17:24:37.494+0000 7f1c6b606640 10 monclient: dump: 2024-09-12T17:24:37.578 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:24:37.578 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:24:37.578 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.578 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.578 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:24:37.578 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:24:37.578 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:24:37.578 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:24:37.578 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:24:37.579 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.579 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T17:24:37.494+0000 7f1d82b31800 5 monclient: authenticate success, global_id 6933 2024-09-12T17:24:37.579 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T17:24:37.494+0000 7f1d82b31800 10 monclient: _renew_subs 2024-09-12T17:24:37.579 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T17:24:37.494+0000 7f1d82b31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:24:37.579 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T17:24:37.494+0000 7f1c6ce09640 4 set_mon_vals no callback set 2024-09-12T17:24:37.579 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T17:24:37.494+0000 7f1d82b31800 10 monclient: _renew_subs 2024-09-12T17:24:37.579 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T17:24:37.494+0000 7f1d82b31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:24:37.579 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T17:24:37.494+0000 7f1d82b31800 1 librados: init done 2024-09-12T17:24:37.579 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T17:24:37.496+0000 7f1c6b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:24:37.579 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T17:24:37.496+0000 7f1c6b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:24:37.579 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T17:24:37.496+0000 7f1c6b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:24:37.579 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T17:24:37.497+0000 7f1d76019640 10 monclient: get_auth_request con 0x7f1c64076470 auth_method 0 2024-09-12T17:24:37.579 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T17:24:37.497+0000 7f1d7f01b640 10 monclient: get_auth_request con 0x557625427d90 auth_method 0 2024-09-12T17:24:37.579 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T17:24:37.497+0000 7f1d7e81a640 10 monclient: get_auth_request con 0x55762542af70 auth_method 0 2024-09-12T17:24:37.580 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T17:24:37.498+0000 7f1d76019640 10 monclient: get_auth_request con 0x55762542f160 auth_method 0 2024-09-12T17:24:37.580 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T17:24:37.499+0000 7f1d82b31800 10 monclient: build_initial_monmap 2024-09-12T17:24:37.580 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T17:24:37.499+0000 7f1d82b31800 1 build_initial for_mkfs: 0 2024-09-12T17:24:37.580 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T17:24:37.499+0000 7f1d82b31800 10 monclient: monmap: 2024-09-12T17:24:37.580 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:24:37.580 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:24:37.580 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:24:37.580 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:24:37.580 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:24:37.580 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:24:37.580 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:24:37.580 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:24:37.580 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:24:37.580 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.580 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding auth protocol: cephx 2024-09-12T17:24:37.581 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding auth protocol: cephx 2024-09-12T17:24:37.581 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding auth protocol: cephx 2024-09-12T17:24:37.581 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding con mode: secure 2024-09-12T17:24:37.581 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding con mode: crc 2024-09-12T17:24:37.581 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding con mode: secure 2024-09-12T17:24:37.581 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding con mode: crc 2024-09-12T17:24:37.581 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding con mode: secure 2024-09-12T17:24:37.581 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding con mode: crc 2024-09-12T17:24:37.581 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding con mode: crc 2024-09-12T17:24:37.581 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding con mode: secure 2024-09-12T17:24:37.581 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding con mode: crc 2024-09-12T17:24:37.581 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding con mode: secure 2024-09-12T17:24:37.581 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding con mode: crc 2024-09-12T17:24:37.582 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding con mode: secure 2024-09-12T17:24:37.582 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T17:24:37.500+0000 7f1d82b31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:24:37.582 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command objecter_requests cmddesc objecter_requests hook 0x557625437370 EEXIST 2024-09-12T17:24:37.582 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T17:24:37.500+0000 7f1d82b31800 10 monclient: init 2024-09-12T17:24:37.582 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding auth protocol: cephx 2024-09-12T17:24:37.582 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding auth protocol: cephx 2024-09-12T17:24:37.582 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding auth protocol: cephx 2024-09-12T17:24:37.582 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding con mode: secure 2024-09-12T17:24:37.582 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding con mode: crc 2024-09-12T17:24:37.582 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding con mode: secure 2024-09-12T17:24:37.582 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding con mode: crc 2024-09-12T17:24:37.582 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding con mode: secure 2024-09-12T17:24:37.582 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding con mode: crc 2024-09-12T17:24:37.583 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding con mode: crc 2024-09-12T17:24:37.583 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding con mode: secure 2024-09-12T17:24:37.583 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding con mode: crc 2024-09-12T17:24:37.583 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding con mode: secure 2024-09-12T17:24:37.583 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding con mode: crc 2024-09-12T17:24:37.583 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding con mode: secure 2024-09-12T17:24:37.583 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T17:24:37.500+0000 7f1d82b31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:24:37.583 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T17:24:37.500+0000 7f1d82b31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:24:37.583 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command rotate-key cmddesc rotate-key hook 0x557625432650 EEXIST 2024-09-12T17:24:37.583 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T17:24:37.500+0000 7f1d82b31800 10 monclient: _reopen_session rank -1 2024-09-12T17:24:37.583 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T17:24:37.500+0000 7f1d82b31800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:24:37.583 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T17:24:37.500+0000 7f1d82b31800 10 monclient(hunting): picked mon.noname-c con 0x55762545b690 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:24:37.583 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T17:24:37.500+0000 7f1d82b31800 10 monclient(hunting): picked mon.noname-b con 0x55762545ba70 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:24:37.584 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T17:24:37.500+0000 7f1d82b31800 10 monclient(hunting): picked mon.noname-a con 0x55762545a3a0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:24:37.584 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T17:24:37.501+0000 7f1d82b31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:24:37.584 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T17:24:37.501+0000 7f1d82b31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:24:37.584 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T17:24:37.501+0000 7f1d82b31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:24:37.584 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T17:24:37.501+0000 7f1d82b31800 10 monclient(hunting): _renew_subs 2024-09-12T17:24:37.584 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T17:24:37.501+0000 7f1d82b31800 10 monclient(hunting): authenticate will time out at 2288.851021s 2024-09-12T17:24:37.584 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T17:24:37.501+0000 7f1d7e81a640 10 monclient(hunting): get_auth_request con 0x55762545b690 auth_method 0 2024-09-12T17:24:37.584 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T17:24:37.501+0000 7f1d7e81a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:24:37.584 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T17:24:37.501+0000 7f1d7e81a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:24:37.584 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T17:24:37.501+0000 7f1d7e81a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:24:37.584 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T17:24:37.501+0000 7f1d7f01b640 10 monclient(hunting): get_auth_request con 0x55762545a3a0 auth_method 0 2024-09-12T17:24:37.584 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T17:24:37.501+0000 7f1d7f01b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:24:37.584 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T17:24:37.501+0000 7f1d7f01b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:24:37.585 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T17:24:37.501+0000 7f1d7f01b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:24:37.585 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T17:24:37.501+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:24:37.585 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T17:24:37.501+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:24:37.585 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T17:24:37.501+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:24:37.585 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T17:24:37.501+0000 7f1d7f01b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:24:37.585 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T17:24:37.501+0000 7f1d7f01b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:24:37.585 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T17:24:37.501+0000 7f1d7f01b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:24:37.585 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T17:24:37.501+0000 7f1d76019640 10 monclient(hunting): get_auth_request con 0x55762545ba70 auth_method 0 2024-09-12T17:24:37.585 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T17:24:37.501+0000 7f1d76019640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:24:37.585 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T17:24:37.501+0000 7f1d76019640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:24:37.585 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T17:24:37.501+0000 7f1d76019640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:24:37.585 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T17:24:37.501+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_done global_id 6515 payload 824 2024-09-12T17:24:37.585 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T17:24:37.501+0000 7f1d7e81a640 10 monclient: _finish_hunting 0 2024-09-12T17:24:37.585 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T17:24:37.501+0000 7f1d7e81a640 1 monclient: found mon.noname-c 2024-09-12T17:24:37.585 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T17:24:37.501+0000 7f1d7e81a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:24:37.586 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T17:24:37.501+0000 7f1c68e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:24:37.586 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T17:24:37.501+0000 7f1c68e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:24:37.586 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T17:24:37.501+0000 7f1c68e01640 10 monclient: dump: 2024-09-12T17:24:37.586 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:24:37.586 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:24:37.586 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.586 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.586 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:24:37.586 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:24:37.586 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:24:37.586 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:24:37.586 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:24:37.586 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.586 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T17:24:37.501+0000 7f1c68e01640 10 monclient: _finish_auth 0 2024-09-12T17:24:37.586 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T17:24:37.501+0000 7f1c68e01640 10 monclient: _check_auth_tickets 2024-09-12T17:24:37.587 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T17:24:37.501+0000 7f1c68e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:24:37.587 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T17:24:37.501+0000 7f1c68e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:24:37.587 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T17:24:37.501+0000 7f1c68e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:24:37.587 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T17:24:37.501+0000 7f1c68e01640 10 monclient: dump: 2024-09-12T17:24:37.587 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:24:37.587 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:24:37.587 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.587 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.587 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:24:37.587 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:24:37.587 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:24:37.587 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:24:37.587 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:24:37.588 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.588 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T17:24:37.501+0000 7f1d82b31800 5 monclient: authenticate success, global_id 6515 2024-09-12T17:24:37.588 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T17:24:37.501+0000 7f1d7f81c640 4 set_mon_vals no callback set 2024-09-12T17:24:37.588 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T17:24:37.501+0000 7f1d82b31800 10 monclient: _renew_subs 2024-09-12T17:24:37.588 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T17:24:37.501+0000 7f1d82b31800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:24:37.588 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T17:24:37.501+0000 7f1d82b31800 10 monclient: _renew_subs 2024-09-12T17:24:37.588 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T17:24:37.501+0000 7f1d82b31800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:24:37.588 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T17:24:37.503+0000 7f1c68e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:24:37.588 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T17:24:37.503+0000 7f1c68e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:24:37.588 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T17:24:37.503+0000 7f1c68e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:24:37.588 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T17:24:37.503+0000 7f1d76019640 10 monclient: get_auth_request con 0x7f1c58076380 auth_method 0 2024-09-12T17:24:37.588 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T17:24:37.503+0000 7f1d82b31800 10 monclient: get_monmap_and_config 2024-09-12T17:24:37.589 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T17:24:37.503+0000 7f1d82b31800 10 monclient: build_initial_monmap 2024-09-12T17:24:37.589 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T17:24:37.503+0000 7f1d82b31800 1 build_initial for_mkfs: 0 2024-09-12T17:24:37.589 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T17:24:37.503+0000 7f1d82b31800 10 monclient: monmap: 2024-09-12T17:24:37.589 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:24:37.589 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:24:37.589 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:24:37.589 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:24:37.589 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:24:37.589 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:24:37.589 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:24:37.589 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:24:37.589 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:24:37.589 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.590 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding auth protocol: cephx 2024-09-12T17:24:37.590 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding auth protocol: cephx 2024-09-12T17:24:37.590 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding auth protocol: cephx 2024-09-12T17:24:37.590 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding con mode: secure 2024-09-12T17:24:37.590 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding con mode: crc 2024-09-12T17:24:37.590 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding con mode: secure 2024-09-12T17:24:37.590 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding con mode: crc 2024-09-12T17:24:37.590 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding con mode: secure 2024-09-12T17:24:37.590 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding con mode: crc 2024-09-12T17:24:37.590 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding con mode: crc 2024-09-12T17:24:37.590 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding con mode: secure 2024-09-12T17:24:37.590 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding con mode: crc 2024-09-12T17:24:37.590 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding con mode: secure 2024-09-12T17:24:37.590 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding con mode: crc 2024-09-12T17:24:37.591 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding con mode: secure 2024-09-12T17:24:37.591 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T17:24:37.504+0000 7f1d82b31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:24:37.591 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T17:24:37.504+0000 7f1d82b31800 10 monclient: init 2024-09-12T17:24:37.591 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding auth protocol: cephx 2024-09-12T17:24:37.591 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding auth protocol: cephx 2024-09-12T17:24:37.591 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding auth protocol: cephx 2024-09-12T17:24:37.591 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding con mode: secure 2024-09-12T17:24:37.591 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding con mode: crc 2024-09-12T17:24:37.591 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding con mode: secure 2024-09-12T17:24:37.591 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding con mode: crc 2024-09-12T17:24:37.591 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding con mode: secure 2024-09-12T17:24:37.591 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding con mode: crc 2024-09-12T17:24:37.591 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding con mode: crc 2024-09-12T17:24:37.591 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding con mode: secure 2024-09-12T17:24:37.591 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding con mode: crc 2024-09-12T17:24:37.592 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding con mode: secure 2024-09-12T17:24:37.592 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding con mode: crc 2024-09-12T17:24:37.592 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding con mode: secure 2024-09-12T17:24:37.592 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T17:24:37.504+0000 7f1d82b31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:24:37.592 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T17:24:37.504+0000 7f1d82b31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:24:37.592 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command rotate-key cmddesc rotate-key hook 0x7ffc32c7a348 EEXIST 2024-09-12T17:24:37.592 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T17:24:37.504+0000 7f1d82b31800 10 monclient: _reopen_session rank -1 2024-09-12T17:24:37.592 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T17:24:37.504+0000 7f1d82b31800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:24:37.592 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T17:24:37.504+0000 7f1d82b31800 10 monclient(hunting): picked mon.noname-b con 0x5576254af5c0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:24:37.592 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T17:24:37.504+0000 7f1d82b31800 10 monclient(hunting): picked mon.noname-a con 0x55762549ff10 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:24:37.592 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T17:24:37.504+0000 7f1d82b31800 10 monclient(hunting): picked mon.noname-c con 0x5576254aa9f0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:24:37.592 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T17:24:37.504+0000 7f1d82b31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:24:37.592 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T17:24:37.504+0000 7f1d82b31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:24:37.592 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T17:24:37.504+0000 7f1d82b31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:24:37.593 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T17:24:37.504+0000 7f1d82b31800 10 monclient(hunting): _renew_subs 2024-09-12T17:24:37.593 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T17:24:37.504+0000 7f1d82b31800 10 monclient(hunting): authenticate will time out at 2288.854849s 2024-09-12T17:24:37.593 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T17:24:37.504+0000 7f1d7f01b640 10 monclient(hunting): get_auth_request con 0x5576254aa9f0 auth_method 0 2024-09-12T17:24:37.593 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T17:24:37.504+0000 7f1d7f01b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:24:37.593 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T17:24:37.504+0000 7f1d7f01b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:24:37.593 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T17:24:37.504+0000 7f1d7f01b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:24:37.593 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T17:24:37.504+0000 7f1d76019640 10 monclient(hunting): get_auth_request con 0x55762549ff10 auth_method 0 2024-09-12T17:24:37.593 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T17:24:37.504+0000 7f1d76019640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:24:37.593 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T17:24:37.504+0000 7f1d76019640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:24:37.593 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T17:24:37.504+0000 7f1d76019640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:24:37.593 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T17:24:37.505+0000 7f1d7e81a640 10 monclient(hunting): get_auth_request con 0x5576254af5c0 auth_method 0 2024-09-12T17:24:37.593 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T17:24:37.505+0000 7f1d7e81a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:24:37.593 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T17:24:37.505+0000 7f1d7e81a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:24:37.594 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T17:24:37.505+0000 7f1d7e81a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:24:37.594 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T17:24:37.505+0000 7f1d7f01b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:24:37.594 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T17:24:37.505+0000 7f1d7f01b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:24:37.594 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T17:24:37.505+0000 7f1d7f01b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:24:37.594 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T17:24:37.505+0000 7f1d76019640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:24:37.594 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T17:24:37.505+0000 7f1d76019640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:24:37.594 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T17:24:37.505+0000 7f1d76019640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:24:37.594 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T17:24:37.505+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:24:37.594 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T17:24:37.505+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:24:37.594 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T17:24:37.505+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:24:37.594 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T17:24:37.505+0000 7f1d7f01b640 10 monclient(hunting): handle_auth_done global_id 6518 payload 274 2024-09-12T17:24:37.594 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T17:24:37.505+0000 7f1d7f01b640 10 monclient: _finish_hunting 0 2024-09-12T17:24:37.594 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T17:24:37.505+0000 7f1d7f01b640 1 monclient: found mon.noname-c 2024-09-12T17:24:37.595 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T17:24:37.505+0000 7f1d7f01b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:24:37.595 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T17:24:37.505+0000 7f1c627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:24:37.595 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T17:24:37.505+0000 7f1c627fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:24:37.595 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T17:24:37.505+0000 7f1c627fc640 10 monclient: dump: 2024-09-12T17:24:37.595 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:24:37.595 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:24:37.595 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.595 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.595 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:24:37.595 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:24:37.595 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:24:37.595 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:24:37.595 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:24:37.596 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.596 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T17:24:37.505+0000 7f1c627fc640 10 monclient: _finish_auth 0 2024-09-12T17:24:37.596 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T17:24:37.505+0000 7f1c627fc640 10 monclient: _check_auth_tickets 2024-09-12T17:24:37.596 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T17:24:37.505+0000 7f1c627fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:24:37.596 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T17:24:37.505+0000 7f1c627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:24:37.596 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T17:24:37.505+0000 7f1c627fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:24:37.596 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T17:24:37.505+0000 7f1c627fc640 10 monclient: dump: 2024-09-12T17:24:37.596 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:24:37.596 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:24:37.596 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.596 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.596 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:24:37.596 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:24:37.596 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:24:37.597 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:24:37.597 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:24:37.597 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.597 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T17:24:37.505+0000 7f1d82b31800 5 monclient: authenticate success, global_id 6518 2024-09-12T17:24:37.597 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T17:24:37.505+0000 7f1d82b31800 10 monclient: get_monmap_and_config success 2024-09-12T17:24:37.597 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T17:24:37.505+0000 7f1d82b31800 4 set_mon_vals no callback set 2024-09-12T17:24:37.597 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T17:24:37.506+0000 7f1d82b31800 10 monclient: shutdown 2024-09-12T17:24:37.597 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T17:24:37.506+0000 7f1d82b31800 10 monclient: build_initial_monmap 2024-09-12T17:24:37.597 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T17:24:37.506+0000 7f1d82b31800 1 build_initial for_mkfs: 0 2024-09-12T17:24:37.597 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T17:24:37.506+0000 7f1d82b31800 10 monclient: monmap: 2024-09-12T17:24:37.597 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:24:37.597 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:24:37.597 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:24:37.597 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:24:37.598 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:24:37.598 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:24:37.598 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:24:37.598 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:24:37.598 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:24:37.598 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.598 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding auth protocol: cephx 2024-09-12T17:24:37.598 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding auth protocol: cephx 2024-09-12T17:24:37.598 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding auth protocol: cephx 2024-09-12T17:24:37.598 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding con mode: secure 2024-09-12T17:24:37.598 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding con mode: crc 2024-09-12T17:24:37.598 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding con mode: secure 2024-09-12T17:24:37.598 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding con mode: crc 2024-09-12T17:24:37.598 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding con mode: secure 2024-09-12T17:24:37.599 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding con mode: crc 2024-09-12T17:24:37.599 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding con mode: crc 2024-09-12T17:24:37.599 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding con mode: secure 2024-09-12T17:24:37.599 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding con mode: crc 2024-09-12T17:24:37.599 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding con mode: secure 2024-09-12T17:24:37.599 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding con mode: crc 2024-09-12T17:24:37.599 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding con mode: secure 2024-09-12T17:24:37.599 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T17:24:37.506+0000 7f1d82b31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:24:37.599 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T17:24:37.506+0000 7f1d82b31800 1 librados: starting msgr at 2024-09-12T17:24:37.599 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T17:24:37.506+0000 7f1d82b31800 1 librados: starting objecter 2024-09-12T17:24:37.599 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command objecter_requests cmddesc objecter_requests hook 0x557625459ad0 EEXIST 2024-09-12T17:24:37.599 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T17:24:37.506+0000 7f1d82b31800 1 librados: setting wanted keys 2024-09-12T17:24:37.599 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T17:24:37.506+0000 7f1d82b31800 1 librados: calling monclient init 2024-09-12T17:24:37.599 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T17:24:37.506+0000 7f1d82b31800 10 monclient: init 2024-09-12T17:24:37.600 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding auth protocol: cephx 2024-09-12T17:24:37.600 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding auth protocol: cephx 2024-09-12T17:24:37.600 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding auth protocol: cephx 2024-09-12T17:24:37.600 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding con mode: secure 2024-09-12T17:24:37.600 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding con mode: crc 2024-09-12T17:24:37.600 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding con mode: secure 2024-09-12T17:24:37.600 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding con mode: crc 2024-09-12T17:24:37.600 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding con mode: secure 2024-09-12T17:24:37.600 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding con mode: crc 2024-09-12T17:24:37.600 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding con mode: crc 2024-09-12T17:24:37.600 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding con mode: secure 2024-09-12T17:24:37.600 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding con mode: crc 2024-09-12T17:24:37.600 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding con mode: secure 2024-09-12T17:24:37.601 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding con mode: crc 2024-09-12T17:24:37.601 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding con mode: secure 2024-09-12T17:24:37.601 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T17:24:37.506+0000 7f1d82b31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:24:37.601 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T17:24:37.507+0000 7f1d82b31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:24:37.601 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T17:24:37.507+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command rotate-key cmddesc rotate-key hook 0x557625470098 EEXIST 2024-09-12T17:24:37.601 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient: _reopen_session rank -1 2024-09-12T17:24:37.601 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:24:37.601 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient(hunting): picked mon.noname-a con 0x55762549ff10 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:24:37.601 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient(hunting): picked mon.noname-b con 0x5576254aa9f0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:24:37.601 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient(hunting): picked mon.noname-c con 0x5576254af5c0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:24:37.602 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:24:37.602 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:24:37.602 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:24:37.602 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient(hunting): _renew_subs 2024-09-12T17:24:37.602 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient(hunting): authenticate will time out at 2288.857286s 2024-09-12T17:24:37.602 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T17:24:37.507+0000 7f1d7e81a640 10 monclient(hunting): get_auth_request con 0x55762549ff10 auth_method 0 2024-09-12T17:24:37.602 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T17:24:37.507+0000 7f1d7e81a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:24:37.602 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T17:24:37.507+0000 7f1d7e81a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:24:37.602 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T17:24:37.507+0000 7f1d7e81a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:24:37.602 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T17:24:37.507+0000 7f1d7f01b640 10 monclient(hunting): get_auth_request con 0x5576254af5c0 auth_method 0 2024-09-12T17:24:37.602 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T17:24:37.507+0000 7f1d7f01b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:24:37.602 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T17:24:37.507+0000 7f1d7f01b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:24:37.602 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T17:24:37.507+0000 7f1d7f01b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:24:37.602 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T17:24:37.507+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:24:37.603 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T17:24:37.507+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:24:37.603 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T17:24:37.507+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:24:37.603 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T17:24:37.507+0000 7f1d7f01b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:24:37.603 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T17:24:37.507+0000 7f1d7f01b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:24:37.603 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T17:24:37.507+0000 7f1d7f01b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:24:37.603 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T17:24:37.507+0000 7f1d76019640 10 monclient(hunting): get_auth_request con 0x5576254aa9f0 auth_method 0 2024-09-12T17:24:37.603 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T17:24:37.507+0000 7f1d76019640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:24:37.603 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T17:24:37.507+0000 7f1d76019640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:24:37.603 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T17:24:37.507+0000 7f1d76019640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:24:37.603 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T17:24:37.507+0000 7f1d76019640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:24:37.603 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T17:24:37.507+0000 7f1d76019640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:24:37.603 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T17:24:37.507+0000 7f1d76019640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:24:37.603 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T17:24:37.507+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_done global_id 6942 payload 824 2024-09-12T17:24:37.603 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T17:24:37.507+0000 7f1d7e81a640 10 monclient: _finish_hunting 0 2024-09-12T17:24:37.604 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T17:24:37.507+0000 7f1d7e81a640 1 monclient: found mon.noname-a 2024-09-12T17:24:37.604 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T17:24:37.507+0000 7f1d7e81a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:24:37.604 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T17:24:37.507+0000 7f1c60ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:24:37.604 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T17:24:37.507+0000 7f1c60ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:24:37.604 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T17:24:37.507+0000 7f1c60ff9640 10 monclient: dump: 2024-09-12T17:24:37.604 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:24:37.604 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:24:37.604 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.604 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.604 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:24:37.604 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:24:37.604 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:24:37.605 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:24:37.605 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:24:37.605 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.605 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T17:24:37.507+0000 7f1c60ff9640 10 monclient: _finish_auth 0 2024-09-12T17:24:37.605 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T17:24:37.507+0000 7f1c60ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:24:37.605 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T17:24:37.507+0000 7f1c60ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:24:37.605 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T17:24:37.507+0000 7f1d82b31800 5 monclient: authenticate success, global_id 6942 2024-09-12T17:24:37.605 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient: _renew_subs 2024-09-12T17:24:37.605 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:24:37.605 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T17:24:37.507+0000 7f1c627fc640 4 set_mon_vals no callback set 2024-09-12T17:24:37.605 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T17:24:37.507+0000 7f1c60ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:24:37.605 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T17:24:37.507+0000 7f1c60ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:24:37.605 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T17:24:37.507+0000 7f1c60ff9640 10 monclient: dump: 2024-09-12T17:24:37.605 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:24:37.606 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:24:37.606 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.606 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.606 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:24:37.606 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:24:37.606 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:24:37.606 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:24:37.606 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:24:37.606 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.606 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient: _renew_subs 2024-09-12T17:24:37.606 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:24:37.606 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T17:24:37.508+0000 7f1d82b31800 1 librados: init done 2024-09-12T17:24:37.606 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T17:24:37.508+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command cr dump hook 0x5576254ab598 2024-09-12T17:24:37.606 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T17:24:37.509+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.607 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T17:24:37.510+0000 7f1c60ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:24:37.607 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T17:24:37.510+0000 7f1c60ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:24:37.607 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T17:24:37.510+0000 7f1c60ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:24:37.607 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T17:24:37.510+0000 7f1d76019640 10 monclient: get_auth_request con 0x7f1c48076470 auth_method 0 2024-09-12T17:24:37.607 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T17:24:37.510+0000 7f1d7f01b640 10 monclient: get_auth_request con 0x5576254c90b0 auth_method 0 2024-09-12T17:24:37.607 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T17:24:37.511+0000 7f1d82b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.607 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T17:24:37.511+0000 7f1d82b31800 20 realm 2024-09-12T17:24:37.607 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T17:24:37.511+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.607 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T17:24:37.511+0000 7f1d82b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.607 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T17:24:37.511+0000 7f1d82b31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:37.607 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T17:24:37.511+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.607 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T17:24:37.511+0000 7f1d82b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.607 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T17:24:37.511+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.608 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T17:24:37.512+0000 7f1d7e81a640 10 monclient: get_auth_request con 0x5576254cd2c0 auth_method 0 2024-09-12T17:24:37.608 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T17:24:37.512+0000 7f1d82b31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:37.608 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T17:24:37.512+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.608 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T17:24:37.513+0000 7f1d76019640 10 monclient: get_auth_request con 0x5576254d0b20 auth_method 0 2024-09-12T17:24:37.608 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T17:24:37.513+0000 7f1d82b31800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:37.608 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T17:24:37.513+0000 7f1d82b31800 20 searching for the correct realm 2024-09-12T17:24:37.608 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T17:24:37.513+0000 7f1d7f01b640 10 monclient: get_auth_request con 0x5576254d58e0 auth_method 0 2024-09-12T17:24:37.608 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T17:24:37.514+0000 7f1d7e81a640 10 monclient: get_auth_request con 0x7f1d78017070 auth_method 0 2024-09-12T17:24:37.608 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T17:24:37.515+0000 7f1d76019640 10 monclient: get_auth_request con 0x7f1d70007d80 auth_method 0 2024-09-12T17:24:37.608 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T17:24:37.516+0000 7f1d7f01b640 0 -- 172.21.15.67:0/2897692371 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x5576254c90b0 msgr2=0x5576254cb550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:37.608 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T17:24:37.516+0000 7f1c60ff9640 1 client.6942.objecter ms_handle_reset 0x5576254c90b0 session 0x5576254c89e0 osd.1 2024-09-12T17:24:37.608 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T17:24:37.516+0000 7f1c60ff9640 10 monclient: _renew_subs 2024-09-12T17:24:37.608 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T17:24:37.516+0000 7f1c60ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:24:37.609 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T17:24:37.516+0000 7f1d7f01b640 10 monclient: get_auth_request con 0x7f1c48086290 auth_method 0 2024-09-12T17:24:37.609 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T17:24:37.517+0000 7f1d7f01b640 10 monclient: get_auth_request con 0x7f1d68059080 auth_method 0 2024-09-12T17:24:37.609 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T17:24:37.519+0000 7f1d7e81a640 10 monclient: get_auth_request con 0x7f1d6802a040 auth_method 0 2024-09-12T17:24:37.609 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T17:24:37.520+0000 7f1d76019640 0 -- 172.21.15.67:0/2897692371 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x5576254d0b20 msgr2=0x5576254d2f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:37.609 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T17:24:37.520+0000 7f1c60ff9640 1 client.6942.objecter ms_handle_reset 0x5576254d0b20 session 0x5576254cc650 osd.4 2024-09-12T17:24:37.609 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T17:24:37.520+0000 7f1d76019640 10 monclient: get_auth_request con 0x5576254c90b0 auth_method 0 2024-09-12T17:24:37.609 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T17:24:37.523+0000 7f1d82b31800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:24:37.609 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T17:24:37.523+0000 7f1d82b31800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:24:37.609 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T17:24:37.523+0000 7f1d82b31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:37.609 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T17:24:37.523+0000 7f1d82b31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:37.609 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T17:24:37.523+0000 7f1d82b31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:37.609 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T17:24:37.523+0000 7f1d82b31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:37.609 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T17:24:37.523+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.610 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T17:24:37.524+0000 7f1d82b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.610 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T17:24:37.524+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.610 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T17:24:37.524+0000 7f1d82b31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:37.610 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T17:24:37.524+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.610 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T17:24:37.524+0000 7f1d82b31800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:37.610 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T17:24:37.524+0000 7f1d82b31800 20 zone default found 2024-09-12T17:24:37.610 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T17:24:37.524+0000 7f1d82b31800 4 Realm: () 2024-09-12T17:24:37.610 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T17:24:37.524+0000 7f1d82b31800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:24:37.610 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T17:24:37.524+0000 7f1d82b31800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:24:37.610 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T17:24:37.524+0000 7f1d82b31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:37.610 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T17:24:37.524+0000 7f1d82b31800 20 zonegroup default 2024-09-12T17:24:37.610 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T17:24:37.524+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.610 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T17:24:37.525+0000 7f1d82b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.611 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T17:24:37.525+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.611 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T17:24:37.525+0000 7f1d82b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.611 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T17:24:37.525+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.611 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T17:24:37.525+0000 7f1d82b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.611 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T17:24:37.525+0000 7f1d82b31800 20 started sync module instance, tier type = 2024-09-12T17:24:37.611 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T17:24:37.525+0000 7f1d82b31800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:24:37.611 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T17:24:37.535+0000 7f1d82b31800 20 add_watcher() i=0 2024-09-12T17:24:37.611 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T17:24:37.535+0000 7f1d82b31800 20 add_watcher() i=1 2024-09-12T17:24:37.611 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T17:24:37.535+0000 7f1d82b31800 20 add_watcher() i=2 2024-09-12T17:24:37.611 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T17:24:37.535+0000 7f1d82b31800 20 add_watcher() i=3 2024-09-12T17:24:37.611 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T17:24:37.535+0000 7f1d82b31800 20 add_watcher() i=4 2024-09-12T17:24:37.611 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T17:24:37.535+0000 7f1d82b31800 20 add_watcher() i=5 2024-09-12T17:24:37.611 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T17:24:37.535+0000 7f1d82b31800 20 add_watcher() i=6 2024-09-12T17:24:37.611 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T17:24:37.536+0000 7f1d82b31800 20 add_watcher() i=7 2024-09-12T17:24:37.612 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T17:24:37.536+0000 7f1d82b31800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:37.612 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding auth protocol: cephx 2024-09-12T17:24:37.612 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding auth protocol: cephx 2024-09-12T17:24:37.612 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding auth protocol: cephx 2024-09-12T17:24:37.612 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding con mode: secure 2024-09-12T17:24:37.612 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding con mode: crc 2024-09-12T17:24:37.612 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding con mode: secure 2024-09-12T17:24:37.612 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding con mode: crc 2024-09-12T17:24:37.612 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding con mode: secure 2024-09-12T17:24:37.612 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding con mode: crc 2024-09-12T17:24:37.612 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding con mode: crc 2024-09-12T17:24:37.612 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding con mode: secure 2024-09-12T17:24:37.612 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding con mode: crc 2024-09-12T17:24:37.613 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T17:24:37.538+0000 7f1c357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:37.613 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding con mode: secure 2024-09-12T17:24:37.613 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding con mode: crc 2024-09-12T17:24:37.613 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding con mode: secure 2024-09-12T17:24:37.613 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T17:24:37.538+0000 7f1d82b31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:24:37.613 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T17:24:37.538+0000 7f1d82b31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:37.613 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T17:24:37.538+0000 7f1d82b31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:37.613 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command cache list hook 0x5576254bcc10 2024-09-12T17:24:37.613 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command cache inspect hook 0x5576254bcc10 2024-09-12T17:24:37.613 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command cache erase hook 0x5576254bcc10 2024-09-12T17:24:37.613 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command cache zap hook 0x5576254bcc10 2024-09-12T17:24:37.613 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 note: GC not initialized 2024-09-12T17:24:37.613 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T17:24:37.538+0000 7f1baffff640 20 reqs_thread_entry: start 2024-09-12T17:24:37.614 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command sync trace show hook 0x7f1d78004530 2024-09-12T17:24:37.614 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command sync trace history hook 0x7f1d78004530 2024-09-12T17:24:37.614 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command sync trace active hook 0x7f1d78004530 2024-09-12T17:24:37.614 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command sync trace active_short hook 0x7f1d78004530 2024-09-12T17:24:37.614 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T17:24:37.538+0000 7f1d82b31800 20 init_complete bucket index max shards: 1 2024-09-12T17:24:37.614 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T17:24:37.538+0000 7f1d82b31800 20 Filter name: none 2024-09-12T17:24:37.614 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T17:24:37.539+0000 7f1badffb640 20 reqs_thread_entry: start 2024-09-12T17:24:37.614 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T17:24:37.539+0000 7f1d82b31800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:24:37.614 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T17:24:37.539+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.614 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T17:24:37.539+0000 7f1d82b31800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:24:37.614 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T17:24:37.539+0000 7f1d82b31800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:24:37.614 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T17:24:37.539+0000 7f1d82b31800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:24:37.614 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T17:24:37.539+0000 7f1d82b31800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 : miss 2024-09-12T17:24:37.614 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T17:24:37.539+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.615 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T17:24:37.539+0000 7f1d82b31800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:24:37.615 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T17:24:37.539+0000 7f1d82b31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 info.flags=0x17 2024-09-12T17:24:37.615 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T17:24:37.539+0000 7f1d82b31800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 to cache LRU end 2024-09-12T17:24:37.615 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T17:24:37.539+0000 7f1d82b31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:24:37.615 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T17:24:37.539+0000 7f1d82b31800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:37.615 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T17:24:37.539+0000 7f1d82b31800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 2024-09-12T17:24:37.615 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T17:24:37.543+0000 7f1d82b31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 info.flags=0x17 2024-09-12T17:24:37.615 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T17:24:37.543+0000 7f1d82b31800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 to cache LRU end 2024-09-12T17:24:37.615 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T17:24:37.543+0000 7f1d82b31800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:37.615 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T17:24:37.543+0000 7f1d82b31800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28, ofs0, ns] 2024-09-12T17:24:37.615 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T17:24:37.543+0000 7f1c627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464332 cookie 93965920347312 notifier 6942 bl.length()=1023 2024-09-12T17:24:37.615 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T17:24:37.543+0000 7f1c627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 info.flags=0x17 2024-09-12T17:24:37.615 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T17:24:37.543+0000 7f1c627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 to cache LRU end 2024-09-12T17:24:37.615 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T17:24:37.543+0000 7f1c627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:37.616 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T17:24:37.545+0000 7f1d82b31800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.28]): orig_sources= new_sources= 2024-09-12T17:24:37.616 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T17:24:37.545+0000 7f1d82b31800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.28]): potential sources added=[] removed=[] 2024-09-12T17:24:37.616 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T17:24:37.545+0000 7f1d82b31800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.28]): orig_dests= new_dests= 2024-09-12T17:24:37.616 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T17:24:37.545+0000 7f1d82b31800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.28]): potential dests added=[] removed=[] 2024-09-12T17:24:37.616 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T17:24:37.546+0000 7f1d82b31800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1d82b31800 time 2024-09-12T17:24:37.546174+0000 2024-09-12T17:24:37.616 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:24:37.616 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.616 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:24:37.616 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1d8418c71a] 2024-09-12T17:24:37.616 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1d8418c8d8] 2024-09-12T17:24:37.616 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557622b21841] 2024-09-12T17:24:37.616 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd7489e) [0x55762302f89e] 2024-09-12T17:24:37.616 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557622b3150d] 2024-09-12T17:24:37.616 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:24:37.617 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1d82e29590] 2024-09-12T17:24:37.617 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:24:37.617 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:24:37.617 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.617 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T17:24:37.547+0000 7f1d82b31800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:24:37.617 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f1d82b31800 thread_name:radosgw-admin 2024-09-12T17:24:37.617 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.617 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:24:37.617 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1d82e3e6f0] 2024-09-12T17:24:37.617 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1d82e8b99c] 2024-09-12T17:24:37.617 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:24:37.617 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:24:37.617 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1d8418c774] 2024-09-12T17:24:37.618 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1d8418c8d8] 2024-09-12T17:24:37.618 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557622b21841] 2024-09-12T17:24:37.618 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd7489e) [0x55762302f89e] 2024-09-12T17:24:37.618 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557622b3150d] 2024-09-12T17:24:37.618 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:24:37.618 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1d82e29590] 2024-09-12T17:24:37.618 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:24:37.618 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:24:37.618 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:24:37.618 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.618 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T17:24:37.618 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T17:24:37.618 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T17:24:37.618 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T17:24:37.619 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T17:24:37.619 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T17:24:37.619 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T17:24:37.619 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T17:24:37.619 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T17:24:37.619 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T17:24:37.619 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T17:24:37.619 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T17:24:37.619 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T17:24:37.619 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T17:24:37.619 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T17:24:37.619 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T17:24:37.619 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T17:24:37.619 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T17:24:37.619 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T17:24:37.620 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T17:24:37.620 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T17:24:37.620 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T17:24:37.620 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T17:24:37.620 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T17:24:37.620 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:24:37.620 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T17:24:37.620 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T17:24:37.620 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T17:24:37.620 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T17:24:37.620 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T17:24:37.620 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T17:24:37.620 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T17:24:37.621 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T17:24:37.621 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T17:24:37.621 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T17:24:37.621 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T17:24:37.621 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T17:24:37.621 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T17:24:37.621 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T17:24:37.621 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T17:24:37.621 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T17:24:37.621 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T17:24:37.621 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T17:24:37.621 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T17:24:37.622 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T17:24:37.622 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T17:24:37.622 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:24:37.622 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T17:24:37.622 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:24:37.622 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T17:24:37.622 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T17:24:37.622 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T17:24:37.622 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T17:24:37.622 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T17:24:37.622 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T17:24:37.622 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T17:24:37.622 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T17:24:37.622 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T17:24:37.622 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T17:24:37.623 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T17:24:37.623 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T17:24:37.623 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T17:24:37.623 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T17:24:37.623 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T17:24:37.623 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T17:24:37.623 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T17:24:37.623 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T17:24:37.623 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:24:37.623 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T17:24:37.623 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:24:37.623 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T17:24:37.624 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T17:24:37.624 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T17:24:37.624 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T17:24:37.624 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T17:24:37.624 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T17:24:37.624 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:24:37.624 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T17:24:37.624 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T17:24:37.624 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:24:37.624 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T17:24:37.624 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T17:24:37.624 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T17:24:37.624 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T17:24:37.625 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T17:24:37.625 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T17:24:37.625 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T17:24:37.625 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T17:24:37.625 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T17:24:37.625 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T17:24:37.625 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T17:24:37.625 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T17:24:37.625 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T17:24:37.625 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:24:37.625 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1badffb640 / http_manager 2024-09-12T17:24:37.625 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1baffff640 / http_manager 2024-09-12T17:24:37.625 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1c357e2640 / rgw_dt_lg_renew 2024-09-12T17:24:37.626 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1c60ff9640 / ms_dispatch 2024-09-12T17:24:37.626 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1c627fc640 / io_context_pool 2024-09-12T17:24:37.626 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1c68e01640 / ms_dispatch 2024-09-12T17:24:37.626 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1c6b606640 / ms_dispatch 2024-09-12T17:24:37.626 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1c6ce09640 / io_context_pool 2024-09-12T17:24:37.626 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1d76019640 / msgr-worker-2 2024-09-12T17:24:37.626 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1d7e81a640 / msgr-worker-1 2024-09-12T17:24:37.626 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1d7f01b640 / msgr-worker-0 2024-09-12T17:24:37.626 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1d7f81c640 / io_context_pool 2024-09-12T17:24:37.626 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1d82b31800 / radosgw-admin 2024-09-12T17:24:37.626 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T17:24:37.626 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T17:24:37.626 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/log/ceph/ceph-client.admin.108622.log 2024-09-12T17:24:37.626 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T17:24:37.626 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T17:24:37.627 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T17:24:37.492+0000 7f1c6ce09640 10 monclient: dump: 2024-09-12T17:24:37.627 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:24:37.627 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:24:37.627 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.627 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.627 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:24:37.627 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:24:37.627 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:24:37.627 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:24:37.627 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:24:37.627 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.627 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T17:24:37.492+0000 7f1d82b31800 10 monclient: shutdown 2024-09-12T17:24:37.627 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T17:24:37.492+0000 7f1d82b31800 5 asok(0x5576251bd730) unregister_commands rotate-key 2024-09-12T17:24:37.627 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T17:24:37.493+0000 7f1d82b31800 10 monclient: build_initial_monmap 2024-09-12T17:24:37.628 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T17:24:37.493+0000 7f1d82b31800 1 build_initial for_mkfs: 0 2024-09-12T17:24:37.628 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T17:24:37.493+0000 7f1d82b31800 10 monclient: monmap: 2024-09-12T17:24:37.628 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:24:37.628 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:24:37.628 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:24:37.628 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:24:37.628 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:24:37.628 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:24:37.628 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:24:37.628 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:24:37.628 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:24:37.628 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.628 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding auth protocol: cephx 2024-09-12T17:24:37.629 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding auth protocol: cephx 2024-09-12T17:24:37.629 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding auth protocol: cephx 2024-09-12T17:24:37.629 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding con mode: secure 2024-09-12T17:24:37.629 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding con mode: crc 2024-09-12T17:24:37.629 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding con mode: secure 2024-09-12T17:24:37.629 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding con mode: crc 2024-09-12T17:24:37.629 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding con mode: secure 2024-09-12T17:24:37.629 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding con mode: crc 2024-09-12T17:24:37.629 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding con mode: crc 2024-09-12T17:24:37.629 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding con mode: secure 2024-09-12T17:24:37.629 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding con mode: crc 2024-09-12T17:24:37.629 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding con mode: secure 2024-09-12T17:24:37.630 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding con mode: crc 2024-09-12T17:24:37.630 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253e51f0) adding con mode: secure 2024-09-12T17:24:37.630 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T17:24:37.493+0000 7f1d82b31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:24:37.630 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T17:24:37.493+0000 7f1d82b31800 1 librados: starting msgr at 2024-09-12T17:24:37.630 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T17:24:37.493+0000 7f1d82b31800 1 librados: starting objecter 2024-09-12T17:24:37.630 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command objecter_requests hook 0x557625409320 2024-09-12T17:24:37.630 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T17:24:37.493+0000 7f1d82b31800 1 librados: setting wanted keys 2024-09-12T17:24:37.630 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T17:24:37.493+0000 7f1d82b31800 1 librados: calling monclient init 2024-09-12T17:24:37.630 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T17:24:37.493+0000 7f1d82b31800 10 monclient: init 2024-09-12T17:24:37.630 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding auth protocol: cephx 2024-09-12T17:24:37.630 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding auth protocol: cephx 2024-09-12T17:24:37.630 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding auth protocol: cephx 2024-09-12T17:24:37.630 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding con mode: secure 2024-09-12T17:24:37.631 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding con mode: crc 2024-09-12T17:24:37.631 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding con mode: secure 2024-09-12T17:24:37.631 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding con mode: crc 2024-09-12T17:24:37.631 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding con mode: secure 2024-09-12T17:24:37.631 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding con mode: crc 2024-09-12T17:24:37.631 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding con mode: crc 2024-09-12T17:24:37.631 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding con mode: secure 2024-09-12T17:24:37.631 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding con mode: crc 2024-09-12T17:24:37.631 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding con mode: secure 2024-09-12T17:24:37.631 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding con mode: crc 2024-09-12T17:24:37.631 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 AuthRegistry(0x5576253dfbb0) adding con mode: secure 2024-09-12T17:24:37.631 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T17:24:37.493+0000 7f1d82b31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:24:37.631 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T17:24:37.493+0000 7f1d82b31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:24:37.632 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T17:24:37.493+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command rotate-key hook 0x5576253dfcf8 2024-09-12T17:24:37.632 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T17:24:37.493+0000 7f1d82b31800 10 monclient: _reopen_session rank -1 2024-09-12T17:24:37.632 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T17:24:37.493+0000 7f1d82b31800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:24:37.632 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T17:24:37.493+0000 7f1d82b31800 10 monclient(hunting): picked mon.noname-a con 0x557625297ad0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:24:37.632 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T17:24:37.494+0000 7f1d82b31800 10 monclient(hunting): picked mon.noname-c con 0x557625321bf0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:24:37.632 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T17:24:37.494+0000 7f1d82b31800 10 monclient(hunting): picked mon.noname-b con 0x557625327e20 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:24:37.632 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T17:24:37.494+0000 7f1d82b31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:24:37.632 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T17:24:37.494+0000 7f1d82b31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:24:37.632 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T17:24:37.494+0000 7f1d82b31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:24:37.632 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T17:24:37.494+0000 7f1d82b31800 10 monclient(hunting): _renew_subs 2024-09-12T17:24:37.632 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T17:24:37.494+0000 7f1d82b31800 10 monclient(hunting): authenticate will time out at 2288.844140s 2024-09-12T17:24:37.632 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T17:24:37.494+0000 7f1d7e81a640 10 monclient(hunting): get_auth_request con 0x557625297ad0 auth_method 0 2024-09-12T17:24:37.632 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T17:24:37.494+0000 7f1d7e81a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:24:37.633 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T17:24:37.494+0000 7f1d7e81a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:24:37.633 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T17:24:37.494+0000 7f1d7e81a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:24:37.633 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T17:24:37.494+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:24:37.633 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T17:24:37.494+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:24:37.633 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T17:24:37.494+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:24:37.633 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T17:24:37.494+0000 7f1d76019640 10 monclient(hunting): get_auth_request con 0x557625321bf0 auth_method 0 2024-09-12T17:24:37.633 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T17:24:37.494+0000 7f1d76019640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:24:37.633 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T17:24:37.494+0000 7f1d76019640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:24:37.633 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T17:24:37.494+0000 7f1d76019640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:24:37.633 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T17:24:37.494+0000 7f1d76019640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:24:37.633 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T17:24:37.494+0000 7f1d76019640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:24:37.633 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T17:24:37.494+0000 7f1d76019640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:24:37.633 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T17:24:37.494+0000 7f1d7f01b640 10 monclient(hunting): get_auth_request con 0x557625327e20 auth_method 0 2024-09-12T17:24:37.634 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T17:24:37.494+0000 7f1d7f01b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:24:37.634 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T17:24:37.494+0000 7f1d7f01b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:24:37.634 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T17:24:37.494+0000 7f1d7f01b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:24:37.634 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T17:24:37.494+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_done global_id 6933 payload 824 2024-09-12T17:24:37.634 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T17:24:37.494+0000 7f1d7e81a640 10 monclient: _finish_hunting 0 2024-09-12T17:24:37.634 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T17:24:37.494+0000 7f1d7e81a640 1 monclient: found mon.noname-a 2024-09-12T17:24:37.634 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T17:24:37.494+0000 7f1d7e81a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:24:37.634 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T17:24:37.494+0000 7f1c6b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:24:37.634 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T17:24:37.494+0000 7f1c6b606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:24:37.634 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T17:24:37.494+0000 7f1c6b606640 10 monclient: dump: 2024-09-12T17:24:37.634 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:24:37.634 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:24:37.634 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.635 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.635 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:24:37.635 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:24:37.635 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:24:37.635 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:24:37.635 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:24:37.635 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.635 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T17:24:37.494+0000 7f1c6b606640 10 monclient: _finish_auth 0 2024-09-12T17:24:37.635 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T17:24:37.494+0000 7f1c6b606640 10 monclient: _check_auth_tickets 2024-09-12T17:24:37.635 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T17:24:37.494+0000 7f1c6b606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:24:37.635 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T17:24:37.494+0000 7f1c6b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:24:37.635 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T17:24:37.494+0000 7f1c6b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:24:37.635 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T17:24:37.494+0000 7f1c6b606640 10 monclient: dump: 2024-09-12T17:24:37.635 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:24:37.636 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:24:37.636 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.636 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.636 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:24:37.636 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:24:37.636 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:24:37.636 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:24:37.636 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:24:37.636 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.636 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T17:24:37.494+0000 7f1d82b31800 5 monclient: authenticate success, global_id 6933 2024-09-12T17:24:37.637 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T17:24:37.494+0000 7f1d82b31800 10 monclient: _renew_subs 2024-09-12T17:24:37.637 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T17:24:37.494+0000 7f1d82b31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:24:37.637 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T17:24:37.494+0000 7f1c6ce09640 4 set_mon_vals no callback set 2024-09-12T17:24:37.637 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T17:24:37.494+0000 7f1d82b31800 10 monclient: _renew_subs 2024-09-12T17:24:37.637 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T17:24:37.494+0000 7f1d82b31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:24:37.637 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T17:24:37.494+0000 7f1d82b31800 1 librados: init done 2024-09-12T17:24:37.637 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T17:24:37.496+0000 7f1c6b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:24:37.637 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T17:24:37.496+0000 7f1c6b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:24:37.637 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T17:24:37.496+0000 7f1c6b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:24:37.637 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T17:24:37.497+0000 7f1d76019640 10 monclient: get_auth_request con 0x7f1c64076470 auth_method 0 2024-09-12T17:24:37.637 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T17:24:37.497+0000 7f1d7f01b640 10 monclient: get_auth_request con 0x557625427d90 auth_method 0 2024-09-12T17:24:37.637 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T17:24:37.497+0000 7f1d7e81a640 10 monclient: get_auth_request con 0x55762542af70 auth_method 0 2024-09-12T17:24:37.637 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T17:24:37.498+0000 7f1d76019640 10 monclient: get_auth_request con 0x55762542f160 auth_method 0 2024-09-12T17:24:37.638 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T17:24:37.499+0000 7f1d82b31800 10 monclient: build_initial_monmap 2024-09-12T17:24:37.638 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T17:24:37.499+0000 7f1d82b31800 1 build_initial for_mkfs: 0 2024-09-12T17:24:37.638 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T17:24:37.499+0000 7f1d82b31800 10 monclient: monmap: 2024-09-12T17:24:37.638 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:24:37.638 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:24:37.638 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:24:37.638 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:24:37.638 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:24:37.638 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:24:37.638 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:24:37.638 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:24:37.638 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:24:37.638 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.639 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding auth protocol: cephx 2024-09-12T17:24:37.639 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding auth protocol: cephx 2024-09-12T17:24:37.639 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding auth protocol: cephx 2024-09-12T17:24:37.639 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding con mode: secure 2024-09-12T17:24:37.639 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding con mode: crc 2024-09-12T17:24:37.639 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding con mode: secure 2024-09-12T17:24:37.639 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding con mode: crc 2024-09-12T17:24:37.639 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding con mode: secure 2024-09-12T17:24:37.639 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding con mode: crc 2024-09-12T17:24:37.639 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding con mode: crc 2024-09-12T17:24:37.639 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding con mode: secure 2024-09-12T17:24:37.639 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding con mode: crc 2024-09-12T17:24:37.639 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding con mode: secure 2024-09-12T17:24:37.639 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding con mode: crc 2024-09-12T17:24:37.639 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T17:24:37.499+0000 7f1d82b31800 5 AuthRegistry(0x557625433ee0) adding con mode: secure 2024-09-12T17:24:37.640 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T17:24:37.500+0000 7f1d82b31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:24:37.640 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command objecter_requests cmddesc objecter_requests hook 0x557625437370 EEXIST 2024-09-12T17:24:37.640 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T17:24:37.500+0000 7f1d82b31800 10 monclient: init 2024-09-12T17:24:37.640 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding auth protocol: cephx 2024-09-12T17:24:37.640 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding auth protocol: cephx 2024-09-12T17:24:37.640 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding auth protocol: cephx 2024-09-12T17:24:37.640 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding con mode: secure 2024-09-12T17:24:37.640 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding con mode: crc 2024-09-12T17:24:37.640 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding con mode: secure 2024-09-12T17:24:37.640 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding con mode: crc 2024-09-12T17:24:37.640 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding con mode: secure 2024-09-12T17:24:37.640 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding con mode: crc 2024-09-12T17:24:37.640 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding con mode: crc 2024-09-12T17:24:37.641 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding con mode: secure 2024-09-12T17:24:37.641 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding con mode: crc 2024-09-12T17:24:37.641 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding con mode: secure 2024-09-12T17:24:37.641 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding con mode: crc 2024-09-12T17:24:37.641 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 AuthRegistry(0x557625432508) adding con mode: secure 2024-09-12T17:24:37.641 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T17:24:37.500+0000 7f1d82b31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:24:37.641 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T17:24:37.500+0000 7f1d82b31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:24:37.641 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T17:24:37.500+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command rotate-key cmddesc rotate-key hook 0x557625432650 EEXIST 2024-09-12T17:24:37.641 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T17:24:37.500+0000 7f1d82b31800 10 monclient: _reopen_session rank -1 2024-09-12T17:24:37.641 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T17:24:37.500+0000 7f1d82b31800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:24:37.641 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T17:24:37.500+0000 7f1d82b31800 10 monclient(hunting): picked mon.noname-c con 0x55762545b690 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:24:37.641 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T17:24:37.500+0000 7f1d82b31800 10 monclient(hunting): picked mon.noname-b con 0x55762545ba70 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:24:37.641 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T17:24:37.500+0000 7f1d82b31800 10 monclient(hunting): picked mon.noname-a con 0x55762545a3a0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:24:37.641 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T17:24:37.501+0000 7f1d82b31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:24:37.641 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T17:24:37.501+0000 7f1d82b31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:24:37.642 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T17:24:37.501+0000 7f1d82b31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:24:37.642 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T17:24:37.501+0000 7f1d82b31800 10 monclient(hunting): _renew_subs 2024-09-12T17:24:37.642 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T17:24:37.501+0000 7f1d82b31800 10 monclient(hunting): authenticate will time out at 2288.851021s 2024-09-12T17:24:37.642 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T17:24:37.501+0000 7f1d7e81a640 10 monclient(hunting): get_auth_request con 0x55762545b690 auth_method 0 2024-09-12T17:24:37.642 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T17:24:37.501+0000 7f1d7e81a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:24:37.642 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T17:24:37.501+0000 7f1d7e81a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:24:37.642 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T17:24:37.501+0000 7f1d7e81a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:24:37.642 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T17:24:37.501+0000 7f1d7f01b640 10 monclient(hunting): get_auth_request con 0x55762545a3a0 auth_method 0 2024-09-12T17:24:37.642 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T17:24:37.501+0000 7f1d7f01b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:24:37.642 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T17:24:37.501+0000 7f1d7f01b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:24:37.642 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T17:24:37.501+0000 7f1d7f01b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:24:37.642 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T17:24:37.501+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:24:37.643 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T17:24:37.501+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:24:37.643 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T17:24:37.501+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:24:37.643 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T17:24:37.501+0000 7f1d7f01b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:24:37.643 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T17:24:37.501+0000 7f1d7f01b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:24:37.643 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T17:24:37.501+0000 7f1d7f01b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:24:37.643 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T17:24:37.501+0000 7f1d76019640 10 monclient(hunting): get_auth_request con 0x55762545ba70 auth_method 0 2024-09-12T17:24:37.643 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T17:24:37.501+0000 7f1d76019640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:24:37.643 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T17:24:37.501+0000 7f1d76019640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:24:37.643 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T17:24:37.501+0000 7f1d76019640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:24:37.643 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T17:24:37.501+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_done global_id 6515 payload 824 2024-09-12T17:24:37.643 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T17:24:37.501+0000 7f1d7e81a640 10 monclient: _finish_hunting 0 2024-09-12T17:24:37.643 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T17:24:37.501+0000 7f1d7e81a640 1 monclient: found mon.noname-c 2024-09-12T17:24:37.643 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T17:24:37.501+0000 7f1d7e81a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:24:37.643 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T17:24:37.501+0000 7f1c68e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:24:37.644 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T17:24:37.501+0000 7f1c68e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:24:37.644 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T17:24:37.501+0000 7f1c68e01640 10 monclient: dump: 2024-09-12T17:24:37.644 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:24:37.644 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:24:37.644 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.644 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.644 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:24:37.644 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:24:37.644 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:24:37.644 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:24:37.644 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:24:37.644 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.644 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T17:24:37.501+0000 7f1c68e01640 10 monclient: _finish_auth 0 2024-09-12T17:24:37.645 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T17:24:37.501+0000 7f1c68e01640 10 monclient: _check_auth_tickets 2024-09-12T17:24:37.645 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T17:24:37.501+0000 7f1c68e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:24:37.645 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T17:24:37.501+0000 7f1c68e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:24:37.645 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T17:24:37.501+0000 7f1c68e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:24:37.645 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T17:24:37.501+0000 7f1c68e01640 10 monclient: dump: 2024-09-12T17:24:37.645 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:24:37.645 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:24:37.645 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.645 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.645 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:24:37.645 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:24:37.645 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:24:37.645 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:24:37.645 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:24:37.646 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.646 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T17:24:37.501+0000 7f1d82b31800 5 monclient: authenticate success, global_id 6515 2024-09-12T17:24:37.646 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T17:24:37.501+0000 7f1d7f81c640 4 set_mon_vals no callback set 2024-09-12T17:24:37.646 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T17:24:37.501+0000 7f1d82b31800 10 monclient: _renew_subs 2024-09-12T17:24:37.646 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T17:24:37.501+0000 7f1d82b31800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:24:37.646 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T17:24:37.501+0000 7f1d82b31800 10 monclient: _renew_subs 2024-09-12T17:24:37.646 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T17:24:37.501+0000 7f1d82b31800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:24:37.646 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T17:24:37.503+0000 7f1c68e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:24:37.646 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T17:24:37.503+0000 7f1c68e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:24:37.646 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T17:24:37.503+0000 7f1c68e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:24:37.646 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T17:24:37.503+0000 7f1d76019640 10 monclient: get_auth_request con 0x7f1c58076380 auth_method 0 2024-09-12T17:24:37.646 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T17:24:37.503+0000 7f1d82b31800 10 monclient: get_monmap_and_config 2024-09-12T17:24:37.646 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T17:24:37.503+0000 7f1d82b31800 10 monclient: build_initial_monmap 2024-09-12T17:24:37.646 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T17:24:37.503+0000 7f1d82b31800 1 build_initial for_mkfs: 0 2024-09-12T17:24:37.647 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T17:24:37.503+0000 7f1d82b31800 10 monclient: monmap: 2024-09-12T17:24:37.647 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:24:37.647 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:24:37.647 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:24:37.647 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:24:37.647 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:24:37.647 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:24:37.647 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:24:37.647 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:24:37.647 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:24:37.647 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.647 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding auth protocol: cephx 2024-09-12T17:24:37.647 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding auth protocol: cephx 2024-09-12T17:24:37.647 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding auth protocol: cephx 2024-09-12T17:24:37.647 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding con mode: secure 2024-09-12T17:24:37.648 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding con mode: crc 2024-09-12T17:24:37.648 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding con mode: secure 2024-09-12T17:24:37.648 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding con mode: crc 2024-09-12T17:24:37.648 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding con mode: secure 2024-09-12T17:24:37.648 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding con mode: crc 2024-09-12T17:24:37.648 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding con mode: crc 2024-09-12T17:24:37.648 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding con mode: secure 2024-09-12T17:24:37.648 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding con mode: crc 2024-09-12T17:24:37.649 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding con mode: secure 2024-09-12T17:24:37.649 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding con mode: crc 2024-09-12T17:24:37.649 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T17:24:37.503+0000 7f1d82b31800 5 AuthRegistry(0x55762547b000) adding con mode: secure 2024-09-12T17:24:37.649 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T17:24:37.504+0000 7f1d82b31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:24:37.649 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T17:24:37.504+0000 7f1d82b31800 10 monclient: init 2024-09-12T17:24:37.649 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding auth protocol: cephx 2024-09-12T17:24:37.649 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding auth protocol: cephx 2024-09-12T17:24:37.649 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding auth protocol: cephx 2024-09-12T17:24:37.649 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding con mode: secure 2024-09-12T17:24:37.649 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding con mode: crc 2024-09-12T17:24:37.649 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding con mode: secure 2024-09-12T17:24:37.649 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding con mode: crc 2024-09-12T17:24:37.649 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding con mode: secure 2024-09-12T17:24:37.649 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding con mode: crc 2024-09-12T17:24:37.649 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding con mode: crc 2024-09-12T17:24:37.650 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding con mode: secure 2024-09-12T17:24:37.650 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding con mode: crc 2024-09-12T17:24:37.650 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding con mode: secure 2024-09-12T17:24:37.650 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding con mode: crc 2024-09-12T17:24:37.650 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a200) adding con mode: secure 2024-09-12T17:24:37.650 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T17:24:37.504+0000 7f1d82b31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:24:37.650 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T17:24:37.504+0000 7f1d82b31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:24:37.650 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T17:24:37.504+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command rotate-key cmddesc rotate-key hook 0x7ffc32c7a348 EEXIST 2024-09-12T17:24:37.650 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T17:24:37.504+0000 7f1d82b31800 10 monclient: _reopen_session rank -1 2024-09-12T17:24:37.650 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T17:24:37.504+0000 7f1d82b31800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:24:37.650 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T17:24:37.504+0000 7f1d82b31800 10 monclient(hunting): picked mon.noname-b con 0x5576254af5c0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:24:37.650 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T17:24:37.504+0000 7f1d82b31800 10 monclient(hunting): picked mon.noname-a con 0x55762549ff10 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:24:37.650 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T17:24:37.504+0000 7f1d82b31800 10 monclient(hunting): picked mon.noname-c con 0x5576254aa9f0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:24:37.650 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T17:24:37.504+0000 7f1d82b31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:24:37.651 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T17:24:37.504+0000 7f1d82b31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:24:37.651 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T17:24:37.504+0000 7f1d82b31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:24:37.651 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T17:24:37.504+0000 7f1d82b31800 10 monclient(hunting): _renew_subs 2024-09-12T17:24:37.651 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T17:24:37.504+0000 7f1d82b31800 10 monclient(hunting): authenticate will time out at 2288.854849s 2024-09-12T17:24:37.651 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T17:24:37.504+0000 7f1d7f01b640 10 monclient(hunting): get_auth_request con 0x5576254aa9f0 auth_method 0 2024-09-12T17:24:37.651 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T17:24:37.504+0000 7f1d7f01b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:24:37.651 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T17:24:37.504+0000 7f1d7f01b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:24:37.651 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T17:24:37.504+0000 7f1d7f01b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:24:37.651 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T17:24:37.504+0000 7f1d76019640 10 monclient(hunting): get_auth_request con 0x55762549ff10 auth_method 0 2024-09-12T17:24:37.651 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T17:24:37.504+0000 7f1d76019640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:24:37.651 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T17:24:37.504+0000 7f1d76019640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:24:37.651 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T17:24:37.504+0000 7f1d76019640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:24:37.651 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T17:24:37.505+0000 7f1d7e81a640 10 monclient(hunting): get_auth_request con 0x5576254af5c0 auth_method 0 2024-09-12T17:24:37.651 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T17:24:37.505+0000 7f1d7e81a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:24:37.652 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T17:24:37.505+0000 7f1d7e81a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:24:37.652 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T17:24:37.505+0000 7f1d7e81a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:24:37.652 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T17:24:37.505+0000 7f1d7f01b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:24:37.652 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T17:24:37.505+0000 7f1d7f01b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:24:37.652 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T17:24:37.505+0000 7f1d7f01b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:24:37.652 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T17:24:37.505+0000 7f1d76019640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:24:37.652 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T17:24:37.505+0000 7f1d76019640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:24:37.652 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T17:24:37.505+0000 7f1d76019640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:24:37.652 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T17:24:37.505+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:24:37.652 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T17:24:37.505+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:24:37.652 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T17:24:37.505+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:24:37.652 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T17:24:37.505+0000 7f1d7f01b640 10 monclient(hunting): handle_auth_done global_id 6518 payload 274 2024-09-12T17:24:37.653 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T17:24:37.505+0000 7f1d7f01b640 10 monclient: _finish_hunting 0 2024-09-12T17:24:37.653 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T17:24:37.505+0000 7f1d7f01b640 1 monclient: found mon.noname-c 2024-09-12T17:24:37.653 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T17:24:37.505+0000 7f1d7f01b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:24:37.653 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T17:24:37.505+0000 7f1c627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:24:37.653 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T17:24:37.505+0000 7f1c627fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:24:37.653 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T17:24:37.505+0000 7f1c627fc640 10 monclient: dump: 2024-09-12T17:24:37.653 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:24:37.653 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:24:37.653 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.653 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.653 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:24:37.653 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:24:37.654 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:24:37.654 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:24:37.654 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:24:37.654 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.654 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T17:24:37.505+0000 7f1c627fc640 10 monclient: _finish_auth 0 2024-09-12T17:24:37.654 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T17:24:37.505+0000 7f1c627fc640 10 monclient: _check_auth_tickets 2024-09-12T17:24:37.654 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T17:24:37.505+0000 7f1c627fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:24:37.654 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T17:24:37.505+0000 7f1c627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:24:37.654 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T17:24:37.505+0000 7f1c627fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:24:37.654 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T17:24:37.505+0000 7f1c627fc640 10 monclient: dump: 2024-09-12T17:24:37.654 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:24:37.654 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:24:37.654 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.654 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.655 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:24:37.655 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:24:37.655 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:24:37.655 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:24:37.655 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:24:37.655 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.655 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T17:24:37.505+0000 7f1d82b31800 5 monclient: authenticate success, global_id 6518 2024-09-12T17:24:37.655 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T17:24:37.505+0000 7f1d82b31800 10 monclient: get_monmap_and_config success 2024-09-12T17:24:37.655 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T17:24:37.505+0000 7f1d82b31800 4 set_mon_vals no callback set 2024-09-12T17:24:37.655 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T17:24:37.506+0000 7f1d82b31800 10 monclient: shutdown 2024-09-12T17:24:37.655 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T17:24:37.506+0000 7f1d82b31800 10 monclient: build_initial_monmap 2024-09-12T17:24:37.655 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T17:24:37.506+0000 7f1d82b31800 1 build_initial for_mkfs: 0 2024-09-12T17:24:37.655 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T17:24:37.506+0000 7f1d82b31800 10 monclient: monmap: 2024-09-12T17:24:37.656 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:24:37.656 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:24:37.656 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:24:37.656 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:24:37.656 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:24:37.656 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:24:37.656 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:24:37.656 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:24:37.656 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:24:37.656 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.656 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding auth protocol: cephx 2024-09-12T17:24:37.656 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding auth protocol: cephx 2024-09-12T17:24:37.656 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding auth protocol: cephx 2024-09-12T17:24:37.657 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding con mode: secure 2024-09-12T17:24:37.657 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding con mode: crc 2024-09-12T17:24:37.657 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding con mode: secure 2024-09-12T17:24:37.657 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding con mode: crc 2024-09-12T17:24:37.657 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding con mode: secure 2024-09-12T17:24:37.657 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding con mode: crc 2024-09-12T17:24:37.657 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding con mode: crc 2024-09-12T17:24:37.657 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding con mode: secure 2024-09-12T17:24:37.657 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding con mode: crc 2024-09-12T17:24:37.657 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding con mode: secure 2024-09-12T17:24:37.657 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding con mode: crc 2024-09-12T17:24:37.657 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762547eb20) adding con mode: secure 2024-09-12T17:24:37.657 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T17:24:37.506+0000 7f1d82b31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:24:37.658 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T17:24:37.506+0000 7f1d82b31800 1 librados: starting msgr at 2024-09-12T17:24:37.658 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T17:24:37.506+0000 7f1d82b31800 1 librados: starting objecter 2024-09-12T17:24:37.658 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command objecter_requests cmddesc objecter_requests hook 0x557625459ad0 EEXIST 2024-09-12T17:24:37.658 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T17:24:37.506+0000 7f1d82b31800 1 librados: setting wanted keys 2024-09-12T17:24:37.658 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T17:24:37.506+0000 7f1d82b31800 1 librados: calling monclient init 2024-09-12T17:24:37.658 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T17:24:37.506+0000 7f1d82b31800 10 monclient: init 2024-09-12T17:24:37.658 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding auth protocol: cephx 2024-09-12T17:24:37.658 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding auth protocol: cephx 2024-09-12T17:24:37.658 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding auth protocol: cephx 2024-09-12T17:24:37.658 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding con mode: secure 2024-09-12T17:24:37.658 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding con mode: crc 2024-09-12T17:24:37.658 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding con mode: secure 2024-09-12T17:24:37.658 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding con mode: crc 2024-09-12T17:24:37.659 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding con mode: secure 2024-09-12T17:24:37.659 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding con mode: crc 2024-09-12T17:24:37.659 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding con mode: crc 2024-09-12T17:24:37.659 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding con mode: secure 2024-09-12T17:24:37.659 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding con mode: crc 2024-09-12T17:24:37.659 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding con mode: secure 2024-09-12T17:24:37.659 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding con mode: crc 2024-09-12T17:24:37.659 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T17:24:37.506+0000 7f1d82b31800 5 AuthRegistry(0x55762546ff50) adding con mode: secure 2024-09-12T17:24:37.659 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T17:24:37.506+0000 7f1d82b31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:24:37.659 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T17:24:37.507+0000 7f1d82b31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:24:37.659 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T17:24:37.507+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command rotate-key cmddesc rotate-key hook 0x557625470098 EEXIST 2024-09-12T17:24:37.659 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient: _reopen_session rank -1 2024-09-12T17:24:37.659 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:24:37.659 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient(hunting): picked mon.noname-a con 0x55762549ff10 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:24:37.660 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient(hunting): picked mon.noname-b con 0x5576254aa9f0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:24:37.660 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient(hunting): picked mon.noname-c con 0x5576254af5c0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:24:37.660 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:24:37.660 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:24:37.660 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:24:37.660 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient(hunting): _renew_subs 2024-09-12T17:24:37.660 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient(hunting): authenticate will time out at 2288.857286s 2024-09-12T17:24:37.660 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T17:24:37.507+0000 7f1d7e81a640 10 monclient(hunting): get_auth_request con 0x55762549ff10 auth_method 0 2024-09-12T17:24:37.660 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T17:24:37.507+0000 7f1d7e81a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:24:37.660 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T17:24:37.507+0000 7f1d7e81a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:24:37.660 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T17:24:37.507+0000 7f1d7e81a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:24:37.660 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T17:24:37.507+0000 7f1d7f01b640 10 monclient(hunting): get_auth_request con 0x5576254af5c0 auth_method 0 2024-09-12T17:24:37.661 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T17:24:37.507+0000 7f1d7f01b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:24:37.661 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T17:24:37.507+0000 7f1d7f01b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:24:37.661 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T17:24:37.507+0000 7f1d7f01b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:24:37.661 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T17:24:37.507+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:24:37.661 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T17:24:37.507+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:24:37.661 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T17:24:37.507+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:24:37.661 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T17:24:37.507+0000 7f1d7f01b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:24:37.661 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T17:24:37.507+0000 7f1d7f01b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:24:37.661 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T17:24:37.507+0000 7f1d7f01b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:24:37.661 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T17:24:37.507+0000 7f1d76019640 10 monclient(hunting): get_auth_request con 0x5576254aa9f0 auth_method 0 2024-09-12T17:24:37.661 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T17:24:37.507+0000 7f1d76019640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:24:37.661 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T17:24:37.507+0000 7f1d76019640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:24:37.662 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T17:24:37.507+0000 7f1d76019640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:24:37.662 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T17:24:37.507+0000 7f1d76019640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:24:37.662 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T17:24:37.507+0000 7f1d76019640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:24:37.662 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T17:24:37.507+0000 7f1d76019640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:24:37.662 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T17:24:37.507+0000 7f1d7e81a640 10 monclient(hunting): handle_auth_done global_id 6942 payload 824 2024-09-12T17:24:37.662 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T17:24:37.507+0000 7f1d7e81a640 10 monclient: _finish_hunting 0 2024-09-12T17:24:37.662 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T17:24:37.507+0000 7f1d7e81a640 1 monclient: found mon.noname-a 2024-09-12T17:24:37.662 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T17:24:37.507+0000 7f1d7e81a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:24:37.662 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T17:24:37.507+0000 7f1c60ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:24:37.662 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T17:24:37.507+0000 7f1c60ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:24:37.662 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T17:24:37.507+0000 7f1c60ff9640 10 monclient: dump: 2024-09-12T17:24:37.662 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:24:37.662 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:24:37.663 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.663 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.663 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:24:37.663 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:24:37.663 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:24:37.663 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:24:37.663 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:24:37.663 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.663 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T17:24:37.507+0000 7f1c60ff9640 10 monclient: _finish_auth 0 2024-09-12T17:24:37.663 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T17:24:37.507+0000 7f1c60ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:24:37.663 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T17:24:37.507+0000 7f1c60ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:24:37.663 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T17:24:37.507+0000 7f1d82b31800 5 monclient: authenticate success, global_id 6942 2024-09-12T17:24:37.663 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient: _renew_subs 2024-09-12T17:24:37.664 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:24:37.664 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T17:24:37.507+0000 7f1c627fc640 4 set_mon_vals no callback set 2024-09-12T17:24:37.664 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T17:24:37.507+0000 7f1c60ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:24:37.664 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T17:24:37.507+0000 7f1c60ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:24:37.664 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T17:24:37.507+0000 7f1c60ff9640 10 monclient: dump: 2024-09-12T17:24:37.664 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:24:37.664 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:24:37.664 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.664 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:24:37.664 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:24:37.664 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:24:37.664 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:24:37.664 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:24:37.664 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:24:37.665 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.665 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient: _renew_subs 2024-09-12T17:24:37.665 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T17:24:37.507+0000 7f1d82b31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:24:37.665 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T17:24:37.508+0000 7f1d82b31800 1 librados: init done 2024-09-12T17:24:37.665 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T17:24:37.508+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command cr dump hook 0x5576254ab598 2024-09-12T17:24:37.665 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T17:24:37.509+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.665 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T17:24:37.510+0000 7f1c60ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:24:37.665 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T17:24:37.510+0000 7f1c60ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:24:37.665 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T17:24:37.510+0000 7f1c60ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:24:37.665 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T17:24:37.510+0000 7f1d76019640 10 monclient: get_auth_request con 0x7f1c48076470 auth_method 0 2024-09-12T17:24:37.665 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T17:24:37.510+0000 7f1d7f01b640 10 monclient: get_auth_request con 0x5576254c90b0 auth_method 0 2024-09-12T17:24:37.665 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T17:24:37.511+0000 7f1d82b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.665 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T17:24:37.511+0000 7f1d82b31800 20 realm 2024-09-12T17:24:37.666 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T17:24:37.511+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.666 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T17:24:37.511+0000 7f1d82b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.666 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T17:24:37.511+0000 7f1d82b31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:37.666 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T17:24:37.511+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.666 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T17:24:37.511+0000 7f1d82b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.666 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T17:24:37.511+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.666 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T17:24:37.512+0000 7f1d7e81a640 10 monclient: get_auth_request con 0x5576254cd2c0 auth_method 0 2024-09-12T17:24:37.666 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T17:24:37.512+0000 7f1d82b31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:37.666 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T17:24:37.512+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.666 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T17:24:37.513+0000 7f1d76019640 10 monclient: get_auth_request con 0x5576254d0b20 auth_method 0 2024-09-12T17:24:37.666 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T17:24:37.513+0000 7f1d82b31800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:37.666 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T17:24:37.513+0000 7f1d82b31800 20 searching for the correct realm 2024-09-12T17:24:37.666 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T17:24:37.513+0000 7f1d7f01b640 10 monclient: get_auth_request con 0x5576254d58e0 auth_method 0 2024-09-12T17:24:37.666 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T17:24:37.514+0000 7f1d7e81a640 10 monclient: get_auth_request con 0x7f1d78017070 auth_method 0 2024-09-12T17:24:37.666 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T17:24:37.515+0000 7f1d76019640 10 monclient: get_auth_request con 0x7f1d70007d80 auth_method 0 2024-09-12T17:24:37.667 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T17:24:37.516+0000 7f1d7f01b640 0 -- 172.21.15.67:0/2897692371 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x5576254c90b0 msgr2=0x5576254cb550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:37.667 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T17:24:37.516+0000 7f1c60ff9640 1 client.6942.objecter ms_handle_reset 0x5576254c90b0 session 0x5576254c89e0 osd.1 2024-09-12T17:24:37.667 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T17:24:37.516+0000 7f1c60ff9640 10 monclient: _renew_subs 2024-09-12T17:24:37.667 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T17:24:37.516+0000 7f1c60ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:24:37.667 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T17:24:37.516+0000 7f1d7f01b640 10 monclient: get_auth_request con 0x7f1c48086290 auth_method 0 2024-09-12T17:24:37.667 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T17:24:37.517+0000 7f1d7f01b640 10 monclient: get_auth_request con 0x7f1d68059080 auth_method 0 2024-09-12T17:24:37.667 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T17:24:37.519+0000 7f1d7e81a640 10 monclient: get_auth_request con 0x7f1d6802a040 auth_method 0 2024-09-12T17:24:37.667 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T17:24:37.520+0000 7f1d76019640 0 -- 172.21.15.67:0/2897692371 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x5576254d0b20 msgr2=0x5576254d2f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:37.667 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T17:24:37.520+0000 7f1c60ff9640 1 client.6942.objecter ms_handle_reset 0x5576254d0b20 session 0x5576254cc650 osd.4 2024-09-12T17:24:37.667 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T17:24:37.520+0000 7f1d76019640 10 monclient: get_auth_request con 0x5576254c90b0 auth_method 0 2024-09-12T17:24:37.667 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T17:24:37.523+0000 7f1d82b31800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:24:37.667 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T17:24:37.523+0000 7f1d82b31800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:24:37.667 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T17:24:37.523+0000 7f1d82b31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:37.667 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T17:24:37.523+0000 7f1d82b31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:37.668 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T17:24:37.523+0000 7f1d82b31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:37.668 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T17:24:37.523+0000 7f1d82b31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:37.668 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T17:24:37.523+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.668 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T17:24:37.524+0000 7f1d82b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.668 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T17:24:37.524+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.668 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T17:24:37.524+0000 7f1d82b31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:37.668 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T17:24:37.524+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.668 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T17:24:37.524+0000 7f1d82b31800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:37.668 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T17:24:37.524+0000 7f1d82b31800 20 zone default found 2024-09-12T17:24:37.668 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T17:24:37.524+0000 7f1d82b31800 4 Realm: () 2024-09-12T17:24:37.668 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T17:24:37.524+0000 7f1d82b31800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:24:37.668 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T17:24:37.524+0000 7f1d82b31800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:24:37.668 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T17:24:37.524+0000 7f1d82b31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:37.668 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T17:24:37.524+0000 7f1d82b31800 20 zonegroup default 2024-09-12T17:24:37.668 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T17:24:37.524+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.669 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T17:24:37.525+0000 7f1d82b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.669 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T17:24:37.525+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.669 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T17:24:37.525+0000 7f1d82b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.669 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T17:24:37.525+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.669 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T17:24:37.525+0000 7f1d82b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.669 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T17:24:37.525+0000 7f1d82b31800 20 started sync module instance, tier type = 2024-09-12T17:24:37.669 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T17:24:37.525+0000 7f1d82b31800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:24:37.669 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T17:24:37.535+0000 7f1d82b31800 20 add_watcher() i=0 2024-09-12T17:24:37.669 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T17:24:37.535+0000 7f1d82b31800 20 add_watcher() i=1 2024-09-12T17:24:37.669 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T17:24:37.535+0000 7f1d82b31800 20 add_watcher() i=2 2024-09-12T17:24:37.669 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T17:24:37.535+0000 7f1d82b31800 20 add_watcher() i=3 2024-09-12T17:24:37.669 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T17:24:37.535+0000 7f1d82b31800 20 add_watcher() i=4 2024-09-12T17:24:37.670 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T17:24:37.535+0000 7f1d82b31800 20 add_watcher() i=5 2024-09-12T17:24:37.670 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T17:24:37.535+0000 7f1d82b31800 20 add_watcher() i=6 2024-09-12T17:24:37.670 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T17:24:37.536+0000 7f1d82b31800 20 add_watcher() i=7 2024-09-12T17:24:37.670 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T17:24:37.536+0000 7f1d82b31800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:37.670 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding auth protocol: cephx 2024-09-12T17:24:37.670 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding auth protocol: cephx 2024-09-12T17:24:37.670 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding auth protocol: cephx 2024-09-12T17:24:37.670 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding con mode: secure 2024-09-12T17:24:37.670 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding con mode: crc 2024-09-12T17:24:37.670 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding con mode: secure 2024-09-12T17:24:37.670 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding con mode: crc 2024-09-12T17:24:37.670 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding con mode: secure 2024-09-12T17:24:37.670 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding con mode: crc 2024-09-12T17:24:37.670 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding con mode: crc 2024-09-12T17:24:37.670 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding con mode: secure 2024-09-12T17:24:37.671 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding con mode: crc 2024-09-12T17:24:37.671 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T17:24:37.538+0000 7f1c357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:37.671 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding con mode: secure 2024-09-12T17:24:37.671 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding con mode: crc 2024-09-12T17:24:37.671 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 AuthRegistry(0x7ffc32c7a6d0) adding con mode: secure 2024-09-12T17:24:37.671 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T17:24:37.538+0000 7f1d82b31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:24:37.671 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T17:24:37.538+0000 7f1d82b31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:37.671 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T17:24:37.538+0000 7f1d82b31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:37.671 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command cache list hook 0x5576254bcc10 2024-09-12T17:24:37.671 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command cache inspect hook 0x5576254bcc10 2024-09-12T17:24:37.671 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command cache erase hook 0x5576254bcc10 2024-09-12T17:24:37.671 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command cache zap hook 0x5576254bcc10 2024-09-12T17:24:37.671 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 note: GC not initialized 2024-09-12T17:24:37.671 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T17:24:37.538+0000 7f1baffff640 20 reqs_thread_entry: start 2024-09-12T17:24:37.671 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command sync trace show hook 0x7f1d78004530 2024-09-12T17:24:37.672 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command sync trace history hook 0x7f1d78004530 2024-09-12T17:24:37.672 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command sync trace active hook 0x7f1d78004530 2024-09-12T17:24:37.672 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T17:24:37.538+0000 7f1d82b31800 5 asok(0x5576251bd730) register_command sync trace active_short hook 0x7f1d78004530 2024-09-12T17:24:37.672 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T17:24:37.538+0000 7f1d82b31800 20 init_complete bucket index max shards: 1 2024-09-12T17:24:37.672 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T17:24:37.538+0000 7f1d82b31800 20 Filter name: none 2024-09-12T17:24:37.672 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T17:24:37.539+0000 7f1badffb640 20 reqs_thread_entry: start 2024-09-12T17:24:37.672 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T17:24:37.539+0000 7f1d82b31800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:24:37.672 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T17:24:37.539+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.672 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T17:24:37.539+0000 7f1d82b31800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:24:37.672 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T17:24:37.539+0000 7f1d82b31800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:24:37.672 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T17:24:37.539+0000 7f1d82b31800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:24:37.672 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T17:24:37.539+0000 7f1d82b31800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 : miss 2024-09-12T17:24:37.672 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T17:24:37.539+0000 7f1d82b31800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.672 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T17:24:37.539+0000 7f1d82b31800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:24:37.672 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T17:24:37.539+0000 7f1d82b31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 info.flags=0x17 2024-09-12T17:24:37.673 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T17:24:37.539+0000 7f1d82b31800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 to cache LRU end 2024-09-12T17:24:37.673 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T17:24:37.539+0000 7f1d82b31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:24:37.673 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T17:24:37.539+0000 7f1d82b31800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:37.673 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T17:24:37.539+0000 7f1d82b31800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 2024-09-12T17:24:37.673 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T17:24:37.543+0000 7f1d82b31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 info.flags=0x17 2024-09-12T17:24:37.673 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T17:24:37.543+0000 7f1d82b31800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 to cache LRU end 2024-09-12T17:24:37.673 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T17:24:37.543+0000 7f1d82b31800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:37.673 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T17:24:37.543+0000 7f1d82b31800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28, ofs0, ns] 2024-09-12T17:24:37.673 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T17:24:37.543+0000 7f1c627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464332 cookie 93965920347312 notifier 6942 bl.length()=1023 2024-09-12T17:24:37.673 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T17:24:37.543+0000 7f1c627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 info.flags=0x17 2024-09-12T17:24:37.673 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T17:24:37.543+0000 7f1c627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 to cache LRU end 2024-09-12T17:24:37.673 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T17:24:37.543+0000 7f1c627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:37.673 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T17:24:37.545+0000 7f1d82b31800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.28]): orig_sources= new_sources= 2024-09-12T17:24:37.674 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T17:24:37.545+0000 7f1d82b31800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.28]): potential sources added=[] removed=[] 2024-09-12T17:24:37.674 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T17:24:37.545+0000 7f1d82b31800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.28]): orig_dests= new_dests= 2024-09-12T17:24:37.674 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T17:24:37.545+0000 7f1d82b31800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.28]): potential dests added=[] removed=[] 2024-09-12T17:24:37.674 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T17:24:37.546+0000 7f1d82b31800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1d82b31800 time 2024-09-12T17:24:37.546174+0000 2024-09-12T17:24:37.674 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:24:37.674 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.674 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:24:37.674 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1d8418c71a] 2024-09-12T17:24:37.674 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1d8418c8d8] 2024-09-12T17:24:37.674 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557622b21841] 2024-09-12T17:24:37.674 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd7489e) [0x55762302f89e] 2024-09-12T17:24:37.674 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557622b3150d] 2024-09-12T17:24:37.674 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:24:37.674 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1d82e29590] 2024-09-12T17:24:37.675 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:24:37.675 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:24:37.675 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.675 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T17:24:37.547+0000 7f1d82b31800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:24:37.675 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f1d82b31800 thread_name:radosgw-admin 2024-09-12T17:24:37.675 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.675 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:24:37.675 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1d82e3e6f0] 2024-09-12T17:24:37.675 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1d82e8b99c] 2024-09-12T17:24:37.675 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:24:37.675 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:24:37.675 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1d8418c774] 2024-09-12T17:24:37.675 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1d8418c8d8] 2024-09-12T17:24:37.675 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557622b21841] 2024-09-12T17:24:37.675 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd7489e) [0x55762302f89e] 2024-09-12T17:24:37.676 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557622b3150d] 2024-09-12T17:24:37.676 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:24:37.676 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1d82e29590] 2024-09-12T17:24:37.676 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:24:37.676 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:24:37.676 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:24:37.676 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:37.676 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T17:24:37.676 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T17:24:37.676 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T17:24:37.676 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T17:24:37.676 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T17:24:37.676 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T17:24:37.676 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T17:24:37.676 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T17:24:37.677 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T17:24:37.677 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T17:24:37.677 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T17:24:37.677 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T17:24:37.677 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T17:24:37.677 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T17:24:37.677 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T17:24:37.677 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T17:24:37.677 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T17:24:37.677 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T17:24:37.677 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T17:24:37.677 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T17:24:37.677 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T17:24:37.677 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T17:24:37.678 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T17:24:37.678 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T17:24:37.678 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:24:37.678 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T17:24:37.678 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T17:24:37.678 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T17:24:37.678 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T17:24:37.678 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T17:24:37.678 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T17:24:37.678 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T17:24:37.678 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T17:24:37.678 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T17:24:37.678 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T17:24:37.678 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T17:24:37.678 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T17:24:37.679 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T17:24:37.679 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T17:24:37.679 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T17:24:37.679 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T17:24:37.679 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T17:24:37.679 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T17:24:37.679 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T17:24:37.679 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T17:24:37.679 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T17:24:37.679 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:24:37.679 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T17:24:37.679 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:24:37.679 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T17:24:37.679 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T17:24:37.679 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T17:24:37.680 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T17:24:37.680 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T17:24:37.680 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T17:24:37.680 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T17:24:37.680 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T17:24:37.680 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T17:24:37.680 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T17:24:37.680 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T17:24:37.680 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T17:24:37.680 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T17:24:37.680 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T17:24:37.680 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T17:24:37.680 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T17:24:37.680 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T17:24:37.680 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T17:24:37.680 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:24:37.681 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T17:24:37.681 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:24:37.681 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T17:24:37.681 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T17:24:37.681 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T17:24:37.681 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T17:24:37.681 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T17:24:37.681 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T17:24:37.681 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:24:37.681 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T17:24:37.681 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T17:24:37.681 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:24:37.681 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T17:24:37.681 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T17:24:37.681 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T17:24:37.682 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T17:24:37.682 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T17:24:37.682 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T17:24:37.682 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T17:24:37.682 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T17:24:37.682 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T17:24:37.682 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T17:24:37.682 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T17:24:37.682 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T17:24:37.682 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T17:24:37.682 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:24:37.682 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1badffb640 / http_manager 2024-09-12T17:24:37.682 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1baffff640 / http_manager 2024-09-12T17:24:37.682 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1c357e2640 / rgw_dt_lg_renew 2024-09-12T17:24:37.682 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1c60ff9640 / ms_dispatch 2024-09-12T17:24:37.682 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1c627fc640 / io_context_pool 2024-09-12T17:24:37.683 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1c68e01640 / ms_dispatch 2024-09-12T17:24:37.683 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1c6b606640 / ms_dispatch 2024-09-12T17:24:37.683 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1c6ce09640 / io_context_pool 2024-09-12T17:24:37.683 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1d76019640 / msgr-worker-2 2024-09-12T17:24:37.683 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1d7e81a640 / msgr-worker-1 2024-09-12T17:24:37.683 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1d7f01b640 / msgr-worker-0 2024-09-12T17:24:37.683 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1d7f81c640 / io_context_pool 2024-09-12T17:24:37.683 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1d82b31800 / radosgw-admin 2024-09-12T17:24:37.683 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T17:24:37.683 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T17:24:37.683 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:24:37.547832Z_62ab6528-3e70-480d-806d-d9577cae2378/log 2024-09-12T17:24:37.683 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T17:24:37.683 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:24:37.684 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:37.684 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:37.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.820+0000 7fc8eaedd640 0 --2- 172.21.15.67:0/4270034010 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5593612d9960 0x5593612dfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:24:37.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.829+0000 7fc8ef12e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.831+0000 7fc8ef12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.831+0000 7fc8ef12e800 20 realm 2024-09-12T17:24:37.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.831+0000 7fc8ef12e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.831+0000 7fc8ef12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.831+0000 7fc8ef12e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:37.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.831+0000 7fc8ef12e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.831+0000 7fc8ef12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.831+0000 7fc8ef12e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.832+0000 7fc8ef12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:37.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.832+0000 7fc8ef12e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.833+0000 7fc8ef12e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:37.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.833+0000 7fc8ef12e800 20 searching for the correct realm 2024-09-12T17:24:37.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:37.834+0000 7fc8eaedd640 0 -- 172.21.15.67:0/2178239392 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7fc8e4055a90 msgr2=0x7fc8e4072410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:24:38.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.039+0000 7fc8ea6dc640 0 -- 172.21.15.67:0/2178239392 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7fc8dc068c20 msgr2=0x7fc8dc077990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:38.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.046+0000 7fc8ef12e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:24:38.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.046+0000 7fc8ef12e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:24:38.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.046+0000 7fc8ef12e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:38.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.046+0000 7fc8ef12e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:38.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.046+0000 7fc8ef12e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:38.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.046+0000 7fc8ef12e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:38.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.046+0000 7fc8ef12e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.046+0000 7fc8ef12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:38.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.046+0000 7fc8ef12e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.047+0000 7fc8ef12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:38.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.047+0000 7fc8ef12e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.047+0000 7fc8ef12e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:38.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.047+0000 7fc8ef12e800 20 zone default found 2024-09-12T17:24:38.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.047+0000 7fc8ef12e800 4 Realm: () 2024-09-12T17:24:38.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.047+0000 7fc8ef12e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:24:38.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.047+0000 7fc8ef12e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:24:38.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.047+0000 7fc8ef12e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:38.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.047+0000 7fc8ef12e800 20 zonegroup default 2024-09-12T17:24:38.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.047+0000 7fc8ef12e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.048+0000 7fc8ef12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:38.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.048+0000 7fc8ef12e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.048+0000 7fc8ef12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:38.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.048+0000 7fc8ef12e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.049+0000 7fc8ef12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:38.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.049+0000 7fc8ef12e800 20 started sync module instance, tier type = 2024-09-12T17:24:38.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.049+0000 7fc8ef12e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:24:38.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.060+0000 7fc8ef12e800 20 add_watcher() i=0 2024-09-12T17:24:38.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.060+0000 7fc8ef12e800 20 add_watcher() i=1 2024-09-12T17:24:38.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.060+0000 7fc8ef12e800 20 add_watcher() i=2 2024-09-12T17:24:38.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.060+0000 7fc8ef12e800 20 add_watcher() i=3 2024-09-12T17:24:38.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.060+0000 7fc8ef12e800 20 add_watcher() i=4 2024-09-12T17:24:38.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.060+0000 7fc8ef12e800 20 add_watcher() i=5 2024-09-12T17:24:38.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.060+0000 7fc8ef12e800 20 add_watcher() i=6 2024-09-12T17:24:38.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.061+0000 7fc8ef12e800 20 add_watcher() i=7 2024-09-12T17:24:38.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.061+0000 7fc8ef12e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:38.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.063+0000 7fc7a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:38.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.063+0000 7fc8ef12e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:38.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.063+0000 7fc8ef12e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:38.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.063+0000 7fc8ef12e800 5 note: GC not initialized 2024-09-12T17:24:38.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.063+0000 7fc71bfff640 20 reqs_thread_entry: start 2024-09-12T17:24:38.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.063+0000 7fc8ef12e800 20 init_complete bucket index max shards: 1 2024-09-12T17:24:38.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.064+0000 7fc8ef12e800 20 Filter name: none 2024-09-12T17:24:38.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.064+0000 7fc719ffb640 20 reqs_thread_entry: start 2024-09-12T17:24:38.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.064+0000 7fc8ef12e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.064+0000 7fc8ef12e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:24:38.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.064+0000 7fc8ef12e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.065+0000 7fc8ef12e800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:24:38.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.065+0000 7fc8ef12e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:38.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.065+0000 7fc8ef12e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.065+0000 7fc8ef12e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:24:38.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.066+0000 7fc8ef12e800 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.066+0000 7fc8ef12e800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:24:38.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.066+0000 7fc8ef12e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:38.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.067+0000 7fc7a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:38.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.069+0000 7fc8ef12e800 20 remove_watcher() i=0 2024-09-12T17:24:38.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.069+0000 7fc8ef12e800 2 removed watcher, disabling cache 2024-09-12T17:24:38.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.070+0000 7fc8ef12e800 20 remove_watcher() i=1 2024-09-12T17:24:38.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.071+0000 7fc8ef12e800 20 remove_watcher() i=2 2024-09-12T17:24:38.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.073+0000 7fc8ef12e800 20 remove_watcher() i=3 2024-09-12T17:24:38.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.074+0000 7fc8ef12e800 20 remove_watcher() i=4 2024-09-12T17:24:38.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.075+0000 7fc8ef12e800 20 remove_watcher() i=5 2024-09-12T17:24:38.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.076+0000 7fc8ef12e800 20 remove_watcher() i=6 2024-09-12T17:24:38.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.077+0000 7fc8ef12e800 20 remove_watcher() i=7 2024-09-12T17:24:38.090 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:38.090 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:24:38.090 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-trim-reshard-log-entries id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:24:38.090 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:24:38.092 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:38.092 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:38.126 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:24:38.126 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:24:38.184 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:24:38.218 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:38.218 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:38.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.256+0000 7fac2c92c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.258+0000 7fac2c92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:38.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.258+0000 7fac2c92c800 20 realm 2024-09-12T17:24:38.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.258+0000 7fac2c92c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.258+0000 7fac2c92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:38.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.258+0000 7fac2c92c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:38.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.258+0000 7fac2c92c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.258+0000 7fac2c92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:38.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.258+0000 7fac2c92c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.259+0000 7fac2c92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:38.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.259+0000 7fac2c92c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.260+0000 7fac2c92c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:38.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.260+0000 7fac2c92c800 20 searching for the correct realm 2024-09-12T17:24:38.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.263+0000 7fac28d3f640 0 -- 172.21.15.67:0/3761092791 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x55937ca38990 msgr2=0x55937ca3ae50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:38.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.266+0000 7fac2853e640 0 -- 172.21.15.67:0/3761092791 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fac100a6460 msgr2=0x7fac100a68c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:24:38.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.270+0000 7fac2c92c800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:24:38.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.270+0000 7fac2c92c800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:24:38.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.270+0000 7fac2c92c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:38.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.270+0000 7fac2c92c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:38.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.270+0000 7fac2c92c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:38.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.270+0000 7fac2c92c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:38.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.270+0000 7fac2c92c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.271+0000 7fac2c92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:38.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.271+0000 7fac2c92c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.271+0000 7fac2c92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:38.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.271+0000 7fac2c92c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.271+0000 7fac2c92c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:38.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.271+0000 7fac2c92c800 20 zone default found 2024-09-12T17:24:38.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.271+0000 7fac2c92c800 4 Realm: () 2024-09-12T17:24:38.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.271+0000 7fac2c92c800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:24:38.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.271+0000 7fac2c92c800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:24:38.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.271+0000 7fac2c92c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:38.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.271+0000 7fac2c92c800 20 zonegroup default 2024-09-12T17:24:38.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.271+0000 7fac2c92c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.272+0000 7fac2c92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:38.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.272+0000 7fac2c92c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.272+0000 7fac2c92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:38.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.272+0000 7fac2c92c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.272+0000 7fac2c92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:38.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.273+0000 7fac2c92c800 20 started sync module instance, tier type = 2024-09-12T17:24:38.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.273+0000 7fac2c92c800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:24:38.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.282+0000 7fac2c92c800 20 add_watcher() i=0 2024-09-12T17:24:38.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.282+0000 7fac2c92c800 20 add_watcher() i=1 2024-09-12T17:24:38.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.282+0000 7fac2c92c800 20 add_watcher() i=2 2024-09-12T17:24:38.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.282+0000 7fac2c92c800 20 add_watcher() i=3 2024-09-12T17:24:38.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.282+0000 7fac2c92c800 20 add_watcher() i=4 2024-09-12T17:24:38.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.282+0000 7fac2c92c800 20 add_watcher() i=5 2024-09-12T17:24:38.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.282+0000 7fac2c92c800 20 add_watcher() i=6 2024-09-12T17:24:38.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.283+0000 7fac2c92c800 20 add_watcher() i=7 2024-09-12T17:24:38.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.283+0000 7fac2c92c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:38.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.284+0000 7faadefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:38.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.285+0000 7fac2c92c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:38.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.285+0000 7fac2c92c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:38.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.285+0000 7fac2c92c800 5 note: GC not initialized 2024-09-12T17:24:38.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.285+0000 7faaddfdb640 20 reqs_thread_entry: start 2024-09-12T17:24:38.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.285+0000 7fac2c92c800 20 init_complete bucket index max shards: 1 2024-09-12T17:24:38.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.285+0000 7fac2c92c800 20 Filter name: none 2024-09-12T17:24:38.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.285+0000 7faa4f7fe640 20 reqs_thread_entry: start 2024-09-12T17:24:38.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.285+0000 7fac2c92c800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:24:38.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.285+0000 7fac2c92c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.286+0000 7fac2c92c800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:24:38.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.286+0000 7fac2c92c800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:24:38.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.286+0000 7fac2c92c800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:24:38.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.286+0000 7fac2c92c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 : miss 2024-09-12T17:24:38.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.286+0000 7fac2c92c800 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.286+0000 7fac2c92c800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:24:38.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.286+0000 7fac2c92c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 info.flags=0x17 2024-09-12T17:24:38.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.286+0000 7fac2c92c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 to cache LRU end 2024-09-12T17:24:38.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.286+0000 7fac2c92c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:24:38.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.286+0000 7fac2c92c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:24:38.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.286+0000 7fac2c92c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 2024-09-12T17:24:38.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.287+0000 7fac2c92c800 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 to be held by another RGW process; skipping for now 2024-09-12T17:24:38.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.288+0000 7faadefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:38.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.290+0000 7fac2c92c800 20 remove_watcher() i=0 2024-09-12T17:24:38.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.290+0000 7fac2c92c800 2 removed watcher, disabling cache 2024-09-12T17:24:38.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.291+0000 7fac2c92c800 20 remove_watcher() i=1 2024-09-12T17:24:38.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.292+0000 7fac2c92c800 20 remove_watcher() i=2 2024-09-12T17:24:38.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.293+0000 7fac2c92c800 20 remove_watcher() i=3 2024-09-12T17:24:38.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.294+0000 7fac2c92c800 20 remove_watcher() i=4 2024-09-12T17:24:38.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.295+0000 7fac2c92c800 20 remove_watcher() i=5 2024-09-12T17:24:38.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.296+0000 7fac2c92c800 20 remove_watcher() i=6 2024-09-12T17:24:38.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:24:38.297+0000 7fac2c92c800 20 remove_watcher() i=7 2024-09-12T17:24:38.309 INFO:tasks.workunit.client.0.smithi067.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:25:08.332 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:25:08.369 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:08.369 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:08.416 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.415+0000 7f1049f40800 20 rados->read ofs=0 len=0 2024-09-12T17:25:08.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.416+0000 7f1049f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:08.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.416+0000 7f1049f40800 20 realm 2024-09-12T17:25:08.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.416+0000 7f1049f40800 20 rados->read ofs=0 len=0 2024-09-12T17:25:08.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.416+0000 7f1049f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:08.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.416+0000 7f1049f40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:08.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.416+0000 7f1049f40800 20 rados->read ofs=0 len=0 2024-09-12T17:25:08.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.416+0000 7f1049f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:08.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.416+0000 7f1049f40800 20 rados->read ofs=0 len=0 2024-09-12T17:25:08.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.417+0000 7f1049f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:08.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.417+0000 7f1049f40800 20 rados->read ofs=0 len=0 2024-09-12T17:25:08.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.418+0000 7f1049f40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:08.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.418+0000 7f1049f40800 20 searching for the correct realm 2024-09-12T17:25:08.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.421+0000 7f10454bf640 0 -- 172.21.15.67:0/2256860085 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f104003f410 msgr2=0x7f104003f830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:08.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.425+0000 7f1045cc0640 0 -- 172.21.15.67:0/2256860085 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f103c0d41e0 msgr2=0x7f103c007cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:08.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.634+0000 7f1049f40800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:08.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.634+0000 7f1049f40800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:08.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.634+0000 7f1049f40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:08.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.634+0000 7f1049f40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:08.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.634+0000 7f1049f40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:08.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.634+0000 7f1049f40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:08.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.634+0000 7f1049f40800 20 rados->read ofs=0 len=0 2024-09-12T17:25:08.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.634+0000 7f1049f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:08.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.634+0000 7f1049f40800 20 rados->read ofs=0 len=0 2024-09-12T17:25:08.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.634+0000 7f1049f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:08.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.634+0000 7f1049f40800 20 rados->read ofs=0 len=0 2024-09-12T17:25:08.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.635+0000 7f1049f40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:08.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.635+0000 7f1049f40800 20 zone default found 2024-09-12T17:25:08.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.635+0000 7f1049f40800 4 Realm: () 2024-09-12T17:25:08.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.635+0000 7f1049f40800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:08.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.635+0000 7f1049f40800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:08.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.635+0000 7f1049f40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:08.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.635+0000 7f1049f40800 20 zonegroup default 2024-09-12T17:25:08.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.635+0000 7f1049f40800 20 rados->read ofs=0 len=0 2024-09-12T17:25:08.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.635+0000 7f1049f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:08.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.635+0000 7f1049f40800 20 rados->read ofs=0 len=0 2024-09-12T17:25:08.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.636+0000 7f1049f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:08.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.636+0000 7f1049f40800 20 rados->read ofs=0 len=0 2024-09-12T17:25:08.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.636+0000 7f1049f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:08.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.636+0000 7f1049f40800 20 started sync module instance, tier type = 2024-09-12T17:25:08.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.636+0000 7f1049f40800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:08.648 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.647+0000 7f1049f40800 20 add_watcher() i=0 2024-09-12T17:25:08.648 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.647+0000 7f1049f40800 20 add_watcher() i=1 2024-09-12T17:25:08.648 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.647+0000 7f1049f40800 20 add_watcher() i=2 2024-09-12T17:25:08.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.647+0000 7f1049f40800 20 add_watcher() i=3 2024-09-12T17:25:08.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.647+0000 7f1049f40800 20 add_watcher() i=4 2024-09-12T17:25:08.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.647+0000 7f1049f40800 20 add_watcher() i=5 2024-09-12T17:25:08.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.647+0000 7f1049f40800 20 add_watcher() i=6 2024-09-12T17:25:08.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.648+0000 7f1049f40800 20 add_watcher() i=7 2024-09-12T17:25:08.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.648+0000 7f1049f40800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:08.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.650+0000 7f0ef77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:08.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.651+0000 7f1049f40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:08.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.651+0000 7f1049f40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:08.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.651+0000 7f1049f40800 5 note: GC not initialized 2024-09-12T17:25:08.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.651+0000 7f0ef67fc640 20 reqs_thread_entry: start 2024-09-12T17:25:08.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.651+0000 7f1049f40800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:08.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.651+0000 7f1049f40800 20 Filter name: none 2024-09-12T17:25:08.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.651+0000 7f0e6bfff640 20 reqs_thread_entry: start 2024-09-12T17:25:08.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.652+0000 7f1049f40800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:25:08.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.652+0000 7f1049f40800 20 rados->read ofs=0 len=0 2024-09-12T17:25:08.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.652+0000 7f1049f40800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:25:08.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.652+0000 7f1049f40800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:25:08.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.652+0000 7f1049f40800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:25:08.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.652+0000 7f1049f40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 : miss 2024-09-12T17:25:08.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.652+0000 7f1049f40800 20 rados->read ofs=0 len=0 2024-09-12T17:25:08.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.652+0000 7f1049f40800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:25:08.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.652+0000 7f1049f40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 info.flags=0x17 2024-09-12T17:25:08.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.652+0000 7f1049f40800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 to cache LRU end 2024-09-12T17:25:08.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.652+0000 7f1049f40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:25:08.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.652+0000 7f1049f40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:08.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.652+0000 7f1049f40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 2024-09-12T17:25:08.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.654+0000 7f1049f40800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:25:08.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.658+0000 7f1049f40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 info.flags=0x17 2024-09-12T17:25:08.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.658+0000 7f1049f40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 to cache LRU end 2024-09-12T17:25:08.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.658+0000 7f1049f40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:08.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.658+0000 7f1049f40800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28, ofs0, ns] 2024-09-12T17:25:08.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.658+0000 7f0f297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464333 cookie 93997400116832 notifier 6572 bl.length()=1023 2024-09-12T17:25:08.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.658+0000 7f0f297fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 info.flags=0x17 2024-09-12T17:25:08.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.658+0000 7f0f297fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 to cache LRU end 2024-09-12T17:25:08.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.658+0000 7f0f297fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:08.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.660+0000 7f1049f40800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.28]): orig_sources= new_sources= 2024-09-12T17:25:08.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.660+0000 7f1049f40800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.28]): potential sources added=[] removed=[] 2024-09-12T17:25:08.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.660+0000 7f1049f40800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.28]): orig_dests= new_dests= 2024-09-12T17:25:08.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.660+0000 7f1049f40800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.28]): potential dests added=[] removed=[] 2024-09-12T17:25:08.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.665+0000 7f1049f40800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.28.2.0 2024-09-12T17:25:08.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.665+0000 7f1049f40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.28.2.0 2024-09-12T17:25:08.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.665+0000 7f1049f40800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.28.2.1 2024-09-12T17:25:08.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.665+0000 7f1049f40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.28.2.1 2024-09-12T17:25:08.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.665+0000 7f1049f40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.28.0 2024-09-12T17:25:08.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.668+0000 7f1049f40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 : hit (requested=0x17, cached=0x17) 2024-09-12T17:25:08.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.668+0000 7f1049f40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 2024-09-12T17:25:08.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.669+0000 7f1049f40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 info.flags=0x17 2024-09-12T17:25:08.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.669+0000 7f1049f40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 to cache LRU end 2024-09-12T17:25:08.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.669+0000 7f1049f40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:08.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.669+0000 7f1049f40800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28, ofs0, ns] 2024-09-12T17:25:08.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.670+0000 7f0f297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464334 cookie 93997400116832 notifier 6572 bl.length()=1023 2024-09-12T17:25:08.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.670+0000 7f0f297fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 info.flags=0x17 2024-09-12T17:25:08.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.670+0000 7f0f297fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 to cache LRU end 2024-09-12T17:25:08.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.670+0000 7f0f297fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:08.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.672+0000 7f1049f40800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.28]): orig_sources= new_sources= 2024-09-12T17:25:08.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.672+0000 7f1049f40800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.28]): potential sources added=[] removed=[] 2024-09-12T17:25:08.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.672+0000 7f1049f40800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.28]): orig_dests= new_dests= 2024-09-12T17:25:08.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.672+0000 7f1049f40800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.28]): potential dests added=[] removed=[] 2024-09-12T17:25:08.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.673+0000 7f1049f40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.28.0 2024-09-12T17:25:08.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.673+0000 7f1049f40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 : hit (requested=0x17, cached=0x17) 2024-09-12T17:25:08.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.673+0000 7f1049f40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 2024-09-12T17:25:08.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.675+0000 7f1049f40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 info.flags=0x17 2024-09-12T17:25:08.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.675+0000 7f1049f40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 to cache LRU end 2024-09-12T17:25:08.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.675+0000 7f1049f40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:08.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.675+0000 7f1049f40800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28, ofs0, ns] 2024-09-12T17:25:08.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.675+0000 7f0f28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464335 cookie 93997400116832 notifier 6572 bl.length()=991 2024-09-12T17:25:08.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.675+0000 7f0f28ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 info.flags=0x17 2024-09-12T17:25:08.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.675+0000 7f0f28ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 to cache LRU end 2024-09-12T17:25:08.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.675+0000 7f0f28ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:08.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.677+0000 7f1049f40800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.28]): orig_sources= new_sources= 2024-09-12T17:25:08.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.677+0000 7f1049f40800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.28]): potential sources added=[] removed=[] 2024-09-12T17:25:08.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.677+0000 7f1049f40800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.28]): orig_dests= new_dests= 2024-09-12T17:25:08.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.677+0000 7f1049f40800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[06eb12d0-49d6-461d-9efe-05d212954deb.4538.28]): potential dests added=[] removed=[] 2024-09-12T17:25:08.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.678+0000 7f1049f40800 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T17:25:08.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.680+0000 7f0ef77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:08.683 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.682+0000 7f1049f40800 20 remove_watcher() i=0 2024-09-12T17:25:08.683 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.682+0000 7f1049f40800 2 removed watcher, disabling cache 2024-09-12T17:25:08.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.684+0000 7f1049f40800 20 remove_watcher() i=1 2024-09-12T17:25:08.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.685+0000 7f1049f40800 20 remove_watcher() i=2 2024-09-12T17:25:08.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.686+0000 7f1049f40800 20 remove_watcher() i=3 2024-09-12T17:25:08.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.687+0000 7f1049f40800 20 remove_watcher() i=4 2024-09-12T17:25:08.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.688+0000 7f1049f40800 20 remove_watcher() i=5 2024-09-12T17:25:08.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.689+0000 7f1049f40800 20 remove_watcher() i=6 2024-09-12T17:25:08.691 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.690+0000 7f1049f40800 20 remove_watcher() i=7 2024-09-12T17:25:08.705 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:25:08.736 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:08.736 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:08.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.776+0000 7fa195142800 20 rados->read ofs=0 len=0 2024-09-12T17:25:08.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.778+0000 7fa195142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:08.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.778+0000 7fa195142800 20 realm 2024-09-12T17:25:08.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.778+0000 7fa195142800 20 rados->read ofs=0 len=0 2024-09-12T17:25:08.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.778+0000 7fa195142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:08.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.778+0000 7fa195142800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:08.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.778+0000 7fa195142800 20 rados->read ofs=0 len=0 2024-09-12T17:25:08.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.778+0000 7fa195142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:08.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.778+0000 7fa195142800 20 rados->read ofs=0 len=0 2024-09-12T17:25:08.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.779+0000 7fa195142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:08.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.779+0000 7fa195142800 20 rados->read ofs=0 len=0 2024-09-12T17:25:08.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.780+0000 7fa195142800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:08.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.780+0000 7fa195142800 20 searching for the correct realm 2024-09-12T17:25:08.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.783+0000 7fa1906ec640 0 -- 172.21.15.67:0/1823666243 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55af6c087f80 msgr2=0x55af6c08a370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:08.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.787+0000 7fa190eed640 0 -- 172.21.15.67:0/1823666243 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fa1840b5710 msgr2=0x7fa1840ab690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:08.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.994+0000 7fa195142800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:08.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.994+0000 7fa195142800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:08.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.994+0000 7fa195142800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:08.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.994+0000 7fa195142800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:08.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.994+0000 7fa195142800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:08.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.994+0000 7fa195142800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:08.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.994+0000 7fa195142800 20 rados->read ofs=0 len=0 2024-09-12T17:25:08.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.994+0000 7fa195142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:08.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.994+0000 7fa195142800 20 rados->read ofs=0 len=0 2024-09-12T17:25:08.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.995+0000 7fa195142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:08.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.995+0000 7fa195142800 20 rados->read ofs=0 len=0 2024-09-12T17:25:08.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.995+0000 7fa195142800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:08.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.995+0000 7fa195142800 20 zone default found 2024-09-12T17:25:08.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.995+0000 7fa195142800 4 Realm: () 2024-09-12T17:25:08.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.995+0000 7fa195142800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:08.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.995+0000 7fa195142800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:08.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.995+0000 7fa195142800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:08.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.995+0000 7fa195142800 20 zonegroup default 2024-09-12T17:25:08.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.995+0000 7fa195142800 20 rados->read ofs=0 len=0 2024-09-12T17:25:08.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.995+0000 7fa195142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:08.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.995+0000 7fa195142800 20 rados->read ofs=0 len=0 2024-09-12T17:25:08.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.996+0000 7fa195142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:08.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.996+0000 7fa195142800 20 rados->read ofs=0 len=0 2024-09-12T17:25:08.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.996+0000 7fa195142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:08.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.996+0000 7fa195142800 20 started sync module instance, tier type = 2024-09-12T17:25:08.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:08.996+0000 7fa195142800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:09.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.006+0000 7fa195142800 20 add_watcher() i=0 2024-09-12T17:25:09.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.006+0000 7fa195142800 20 add_watcher() i=1 2024-09-12T17:25:09.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.006+0000 7fa195142800 20 add_watcher() i=2 2024-09-12T17:25:09.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.006+0000 7fa195142800 20 add_watcher() i=3 2024-09-12T17:25:09.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.006+0000 7fa195142800 20 add_watcher() i=4 2024-09-12T17:25:09.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.006+0000 7fa195142800 20 add_watcher() i=5 2024-09-12T17:25:09.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.006+0000 7fa195142800 20 add_watcher() i=6 2024-09-12T17:25:09.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.007+0000 7fa195142800 20 add_watcher() i=7 2024-09-12T17:25:09.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.007+0000 7fa195142800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:09.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.009+0000 7fa046fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:09.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.010+0000 7fa195142800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:09.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.010+0000 7fa195142800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:09.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.010+0000 7fa195142800 5 note: GC not initialized 2024-09-12T17:25:09.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.010+0000 7fa045fe3640 20 reqs_thread_entry: start 2024-09-12T17:25:09.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.010+0000 7fa195142800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:09.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.010+0000 7fa195142800 20 Filter name: none 2024-09-12T17:25:09.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.010+0000 7f9fb77fe640 20 reqs_thread_entry: start 2024-09-12T17:25:09.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.010+0000 7fa195142800 20 rados->read ofs=0 len=0 2024-09-12T17:25:09.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.011+0000 7fa195142800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:25:09.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.011+0000 7fa195142800 20 rados->read ofs=0 len=0 2024-09-12T17:25:09.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.011+0000 7fa195142800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:25:09.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.011+0000 7fa195142800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:09.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.011+0000 7fa195142800 20 rados->read ofs=0 len=0 2024-09-12T17:25:09.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.012+0000 7fa195142800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:25:09.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.012+0000 7fa195142800 20 rados->read ofs=0 len=0 2024-09-12T17:25:09.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.012+0000 7fa195142800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:25:09.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.012+0000 7fa195142800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:09.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.013+0000 7fa046fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:09.017 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.016+0000 7fa195142800 20 remove_watcher() i=0 2024-09-12T17:25:09.017 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.016+0000 7fa195142800 2 removed watcher, disabling cache 2024-09-12T17:25:09.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.017+0000 7fa195142800 20 remove_watcher() i=1 2024-09-12T17:25:09.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.018+0000 7fa195142800 20 remove_watcher() i=2 2024-09-12T17:25:09.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.020+0000 7fa195142800 20 remove_watcher() i=3 2024-09-12T17:25:09.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.021+0000 7fa195142800 20 remove_watcher() i=4 2024-09-12T17:25:09.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.022+0000 7fa195142800 20 remove_watcher() i=5 2024-09-12T17:25:09.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.023+0000 7fa195142800 20 remove_watcher() i=6 2024-09-12T17:25:09.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:09.024+0000 7fa195142800 20 remove_watcher() i=7 2024-09-12T17:25:09.036 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:09.036 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:25:09.036 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-trim-reshard-log-entries id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.28 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:25:09.036 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:09.038 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:09.038 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:09.060 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:09.060 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:09.283 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:09.284 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:09.353 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-12T17:25:09.353 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:09.354 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:09.354 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:09.397 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:09.397 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:09.455 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:09.455 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:09.492 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:09.493 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:09.530 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:09.530 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:09.568 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:09.568 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:09.604 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:09.604 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:09.640 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:09.640 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:09.675 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:09.675 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:09.713 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:09.713 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:09.749 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:09.749 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:09.785 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:09.785 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:09.822 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:09.822 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:09.857 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:09.858 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:09.895 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:09.895 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:09.932 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:09.932 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:09.969 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:09.969 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:10.004 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:10.005 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:10.041 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:10.041 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:10.076 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:10.077 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:10.123 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:10.123 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:10.159 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:10.159 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:10.195 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:25:10.225 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:10.225 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:10.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.262+0000 7f8ab5925800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.264+0000 7f8ab5925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:10.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.264+0000 7f8ab5925800 20 realm 2024-09-12T17:25:10.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.264+0000 7f8ab5925800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.264+0000 7f8ab5925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:10.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.264+0000 7f8ab5925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:10.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.264+0000 7f8ab5925800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.264+0000 7f8ab5925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:10.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.264+0000 7f8ab5925800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.265+0000 7f8ab5925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:10.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.265+0000 7f8ab5925800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.266+0000 7f8ab5925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:10.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.266+0000 7f8ab5925800 20 searching for the correct realm 2024-09-12T17:25:10.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.270+0000 7f8ab1daf640 0 -- 172.21.15.67:0/2904644232 >> [v2:172.21.15.118:6824/1070975205,v1:172.21.15.118:6825/1070975205] conn(0x7f8aa806b020 msgr2=0x7f8aa805a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:10.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.477+0000 7f8ab15ae640 0 -- 172.21.15.67:0/2904644232 >> [v2:172.21.15.118:6808/1825660705,v1:172.21.15.118:6809/1825660705] conn(0x559fe46e0d90 msgr2=0x559fe46e3250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:10.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.480+0000 7f8ab5925800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:10.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.480+0000 7f8ab5925800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:10.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.480+0000 7f8ab5925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:10.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.480+0000 7f8ab5925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:10.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.480+0000 7f8ab5925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:10.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.480+0000 7f8ab5925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:10.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.480+0000 7f8ab5925800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.480+0000 7f8ab5925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:10.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.480+0000 7f8ab5925800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.480+0000 7f8ab5925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:10.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.480+0000 7f8ab5925800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.481+0000 7f8ab5925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:10.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.481+0000 7f8ab5925800 20 zone default found 2024-09-12T17:25:10.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.481+0000 7f8ab5925800 4 Realm: () 2024-09-12T17:25:10.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.481+0000 7f8ab5925800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:10.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.481+0000 7f8ab5925800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:10.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.481+0000 7f8ab5925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:10.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.481+0000 7f8ab5925800 20 zonegroup default 2024-09-12T17:25:10.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.481+0000 7f8ab5925800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.481+0000 7f8ab5925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:10.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.481+0000 7f8ab5925800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.481+0000 7f8ab5925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:10.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.481+0000 7f8ab5925800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.481+0000 7f8ab5925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:10.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.481+0000 7f8ab5925800 20 started sync module instance, tier type = 2024-09-12T17:25:10.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.481+0000 7f8ab5925800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:10.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.490+0000 7f8ab5925800 20 add_watcher() i=0 2024-09-12T17:25:10.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.490+0000 7f8ab5925800 20 add_watcher() i=1 2024-09-12T17:25:10.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.490+0000 7f8ab5925800 20 add_watcher() i=2 2024-09-12T17:25:10.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.490+0000 7f8ab5925800 20 add_watcher() i=3 2024-09-12T17:25:10.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.490+0000 7f8ab5925800 20 add_watcher() i=4 2024-09-12T17:25:10.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.490+0000 7f8ab5925800 20 add_watcher() i=5 2024-09-12T17:25:10.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.490+0000 7f8ab5925800 20 add_watcher() i=6 2024-09-12T17:25:10.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.491+0000 7f8ab5925800 20 add_watcher() i=7 2024-09-12T17:25:10.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.491+0000 7f8ab5925800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:10.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.493+0000 7f89677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:10.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.493+0000 7f8ab5925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:10.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.493+0000 7f8ab5925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:10.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.493+0000 7f8ab5925800 5 note: GC not initialized 2024-09-12T17:25:10.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.494+0000 7f89667e4640 20 reqs_thread_entry: start 2024-09-12T17:25:10.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.494+0000 7f8ab5925800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:10.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.494+0000 7f8ab5925800 20 Filter name: none 2024-09-12T17:25:10.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.494+0000 7f88d7fff640 20 reqs_thread_entry: start 2024-09-12T17:25:10.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.494+0000 7f8ab5925800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.495+0000 7f8ab5925800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:25:10.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.495+0000 7f8ab5925800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.495+0000 7f8ab5925800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:25:10.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.495+0000 7f8ab5925800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:10.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.495+0000 7f8ab5925800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.496+0000 7f8ab5925800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:25:10.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.496+0000 7f8ab5925800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.496+0000 7f8ab5925800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:25:10.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.496+0000 7f8ab5925800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:10.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.497+0000 7f89677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:10.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.499+0000 7f8ab5925800 20 remove_watcher() i=0 2024-09-12T17:25:10.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.499+0000 7f8ab5925800 2 removed watcher, disabling cache 2024-09-12T17:25:10.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.500+0000 7f8ab5925800 20 remove_watcher() i=1 2024-09-12T17:25:10.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.502+0000 7f8ab5925800 20 remove_watcher() i=2 2024-09-12T17:25:10.504 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.503+0000 7f8ab5925800 20 remove_watcher() i=3 2024-09-12T17:25:10.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.504+0000 7f8ab5925800 20 remove_watcher() i=4 2024-09-12T17:25:10.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.505+0000 7f8ab5925800 20 remove_watcher() i=5 2024-09-12T17:25:10.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.506+0000 7f8ab5925800 20 remove_watcher() i=6 2024-09-12T17:25:10.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.507+0000 7f8ab5925800 20 remove_watcher() i=7 2024-09-12T17:25:10.521 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:10.521 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:25:10.521 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-block-writes id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:25:10.521 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:10.522 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-12T17:25:10.557 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:10.557 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:10.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.595+0000 7f9fc3487800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.596+0000 7f9fc3487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:10.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.596+0000 7f9fc3487800 20 realm 2024-09-12T17:25:10.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.596+0000 7f9fc3487800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.596+0000 7f9fc3487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:10.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.596+0000 7f9fc3487800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:10.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.596+0000 7f9fc3487800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.596+0000 7f9fc3487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:10.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.596+0000 7f9fc3487800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.597+0000 7f9fc3487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:10.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.597+0000 7f9fc3487800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.598+0000 7f9fc3487800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:10.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.598+0000 7f9fc3487800 20 searching for the correct realm 2024-09-12T17:25:10.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.601+0000 7f9fc1772640 0 -- 172.21.15.67:0/2905983456 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x55cc0e3d3b70 msgr2=0x55cc0e3d6030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:10.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.604+0000 7f9fc0f71640 0 -- 172.21.15.67:0/2905983456 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f9fac028040 msgr2=0x7f9fac033400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:10.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.609+0000 7f9fc3487800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:10.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.609+0000 7f9fc3487800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:10.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.609+0000 7f9fc3487800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:10.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.609+0000 7f9fc3487800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:10.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.609+0000 7f9fc3487800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:10.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.609+0000 7f9fc3487800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:10.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.609+0000 7f9fc3487800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.609+0000 7f9fc3487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:10.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.609+0000 7f9fc3487800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.609+0000 7f9fc3487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:10.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.609+0000 7f9fc3487800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.610+0000 7f9fc3487800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:10.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.610+0000 7f9fc3487800 20 zone default found 2024-09-12T17:25:10.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.610+0000 7f9fc3487800 4 Realm: () 2024-09-12T17:25:10.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.610+0000 7f9fc3487800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:10.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.610+0000 7f9fc3487800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:10.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.610+0000 7f9fc3487800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:10.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.610+0000 7f9fc3487800 20 zonegroup default 2024-09-12T17:25:10.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.610+0000 7f9fc3487800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.610+0000 7f9fc3487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:10.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.610+0000 7f9fc3487800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.611+0000 7f9fc3487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:10.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.611+0000 7f9fc3487800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.611+0000 7f9fc3487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:10.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.611+0000 7f9fc3487800 20 started sync module instance, tier type = 2024-09-12T17:25:10.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.611+0000 7f9fc3487800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:10.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.620+0000 7f9fc3487800 20 add_watcher() i=0 2024-09-12T17:25:10.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.620+0000 7f9fc3487800 20 add_watcher() i=1 2024-09-12T17:25:10.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.620+0000 7f9fc3487800 20 add_watcher() i=2 2024-09-12T17:25:10.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.620+0000 7f9fc3487800 20 add_watcher() i=3 2024-09-12T17:25:10.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.620+0000 7f9fc3487800 20 add_watcher() i=4 2024-09-12T17:25:10.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.620+0000 7f9fc3487800 20 add_watcher() i=5 2024-09-12T17:25:10.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.620+0000 7f9fc3487800 20 add_watcher() i=6 2024-09-12T17:25:10.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.621+0000 7f9fc3487800 20 add_watcher() i=7 2024-09-12T17:25:10.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.621+0000 7f9fc3487800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:10.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.622+0000 7f9e76fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:10.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.623+0000 7f9fc3487800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:10.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.623+0000 7f9fc3487800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:10.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.623+0000 7f9fc3487800 5 note: GC not initialized 2024-09-12T17:25:10.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.623+0000 7f9e75fe3640 20 reqs_thread_entry: start 2024-09-12T17:25:10.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.623+0000 7f9fc3487800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:10.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.623+0000 7f9fc3487800 20 Filter name: none 2024-09-12T17:25:10.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.623+0000 7f9de77fe640 20 reqs_thread_entry: start 2024-09-12T17:25:10.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.623+0000 7f9fc3487800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T17:25:10.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.623+0000 7f9fc3487800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.624+0000 7f9fc3487800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:25:10.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.624+0000 7f9fc3487800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T17:25:10.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.624+0000 7f9fc3487800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T17:25:10.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.624+0000 7f9fc3487800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 : miss 2024-09-12T17:25:10.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.624+0000 7f9fc3487800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.624+0000 7f9fc3487800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:25:10.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.624+0000 7f9fc3487800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 info.flags=0x17 2024-09-12T17:25:10.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.624+0000 7f9fc3487800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 to cache LRU end 2024-09-12T17:25:10.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.624+0000 7f9fc3487800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:25:10.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.624+0000 7f9fc3487800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:10.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.624+0000 7f9fc3487800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 2024-09-12T17:25:10.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.628+0000 7f9fc3487800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 info.flags=0x17 2024-09-12T17:25:10.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.628+0000 7f9fc3487800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 to cache LRU end 2024-09-12T17:25:10.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.628+0000 7f9fc3487800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:10.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.628+0000 7f9fc3487800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29, ofs0, ns] 2024-09-12T17:25:10.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.628+0000 7f9e97fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464287 cookie 94334900616240 notifier 6623 bl.length()=999 2024-09-12T17:25:10.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.628+0000 7f9e97fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 info.flags=0x17 2024-09-12T17:25:10.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.628+0000 7f9e97fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 to cache LRU end 2024-09-12T17:25:10.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.628+0000 7f9e97fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:10.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.630+0000 7f9fc3487800 20 handle_bi_update(): bucket=:error-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.29]): orig_sources= new_sources= 2024-09-12T17:25:10.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.630+0000 7f9fc3487800 20 handle_bi_update(): bucket=:error-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.29]): potential sources added=[] removed=[] 2024-09-12T17:25:10.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.630+0000 7f9fc3487800 20 handle_bi_update(): bucket=:error-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.29]): orig_dests= new_dests= 2024-09-12T17:25:10.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.630+0000 7f9fc3487800 20 handle_bi_update(): bucket=:error-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.29]): potential dests added=[] removed=[] 2024-09-12T17:25:10.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.632+0000 7f9fc3487800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.29.1.0 2024-09-12T17:25:10.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.632+0000 7f9fc3487800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.29.1.0 2024-09-12T17:25:10.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.632+0000 7f9fc3487800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.29.1.1 2024-09-12T17:25:10.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.632+0000 7f9fc3487800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.29.1.1 2024-09-12T17:25:10.634 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.632+0000 7f9fc3487800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.29.0 2024-09-12T17:25:10.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.635+0000 7f9fc3487800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:25:10.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.635+0000 7f9fc3487800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 2024-09-12T17:25:10.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.636+0000 7f9fc3487800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 info.flags=0x17 2024-09-12T17:25:10.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.636+0000 7f9fc3487800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 to cache LRU end 2024-09-12T17:25:10.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.636+0000 7f9fc3487800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:10.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.636+0000 7f9fc3487800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29, ofs0, ns] 2024-09-12T17:25:10.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.636+0000 7f9e97fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464288 cookie 94334900616240 notifier 6623 bl.length()=999 2024-09-12T17:25:10.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.636+0000 7f9e97fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 info.flags=0x17 2024-09-12T17:25:10.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.636+0000 7f9e97fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 to cache LRU end 2024-09-12T17:25:10.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.636+0000 7f9e97fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:10.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.637+0000 7f9fc3487800 20 handle_bi_update(): bucket=:error-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.29]): orig_sources= new_sources= 2024-09-12T17:25:10.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.637+0000 7f9fc3487800 20 handle_bi_update(): bucket=:error-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.29]): potential sources added=[] removed=[] 2024-09-12T17:25:10.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.637+0000 7f9fc3487800 20 handle_bi_update(): bucket=:error-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.29]): orig_dests= new_dests= 2024-09-12T17:25:10.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.637+0000 7f9fc3487800 20 handle_bi_update(): bucket=:error-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.29]): potential dests added=[] removed=[] 2024-09-12T17:25:10.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.637+0000 7f9fc3487800 -1 Injecting error=-5 at location=block_writes 2024-09-12T17:25:10.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.637+0000 7f9fc3487800 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-12T17:25:10.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.640+0000 7f9fc3487800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:25:10.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.640+0000 7f9fc3487800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 2024-09-12T17:25:10.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.641+0000 7f9fc3487800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 info.flags=0x17 2024-09-12T17:25:10.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.641+0000 7f9fc3487800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 to cache LRU end 2024-09-12T17:25:10.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.641+0000 7f9fc3487800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:10.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.641+0000 7f9fc3487800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29, ofs0, ns] 2024-09-12T17:25:10.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.641+0000 7f9e97fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464289 cookie 94334900616240 notifier 6623 bl.length()=967 2024-09-12T17:25:10.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.641+0000 7f9e97fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 info.flags=0x17 2024-09-12T17:25:10.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.641+0000 7f9e97fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 to cache LRU end 2024-09-12T17:25:10.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.641+0000 7f9e97fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:10.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.642+0000 7f9fc3487800 20 handle_bi_update(): bucket=:error-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.29]): orig_sources= new_sources= 2024-09-12T17:25:10.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.642+0000 7f9fc3487800 20 handle_bi_update(): bucket=:error-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.29]): potential sources added=[] removed=[] 2024-09-12T17:25:10.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.642+0000 7f9fc3487800 20 handle_bi_update(): bucket=:error-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.29]): orig_dests= new_dests= 2024-09-12T17:25:10.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.642+0000 7f9fc3487800 20 handle_bi_update(): bucket=:error-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.29]): potential dests added=[] removed=[] 2024-09-12T17:25:10.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.643+0000 7f9fc3487800 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-12T17:25:10.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.645+0000 7f9e76fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:10.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.648+0000 7f9fc3487800 20 remove_watcher() i=0 2024-09-12T17:25:10.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.648+0000 7f9fc3487800 2 removed watcher, disabling cache 2024-09-12T17:25:10.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.649+0000 7f9fc3487800 20 remove_watcher() i=1 2024-09-12T17:25:10.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.650+0000 7f9fc3487800 20 remove_watcher() i=2 2024-09-12T17:25:10.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.651+0000 7f9fc3487800 20 remove_watcher() i=3 2024-09-12T17:25:10.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.652+0000 7f9fc3487800 20 remove_watcher() i=4 2024-09-12T17:25:10.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.653+0000 7f9fc3487800 20 remove_watcher() i=5 2024-09-12T17:25:10.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.654+0000 7f9fc3487800 20 remove_watcher() i=6 2024-09-12T17:25:10.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.655+0000 7f9fc3487800 20 remove_watcher() i=7 2024-09-12T17:25:10.668 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:25:10.697 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:10.697 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:10.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.735+0000 7fa063820800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.737+0000 7fa063820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:10.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.737+0000 7fa063820800 20 realm 2024-09-12T17:25:10.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.737+0000 7fa063820800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.737+0000 7fa063820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:10.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.737+0000 7fa063820800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:10.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.737+0000 7fa063820800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.737+0000 7fa063820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:10.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.737+0000 7fa063820800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.738+0000 7fa063820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:10.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.738+0000 7fa063820800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.739+0000 7fa063820800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:10.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.739+0000 7fa063820800 20 searching for the correct realm 2024-09-12T17:25:10.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.741+0000 7fa060b09640 0 -- 172.21.15.67:0/478417722 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7fa054020030 msgr2=0x7fa054060ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:10.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.745+0000 7fa06130a640 0 -- 172.21.15.67:0/478417722 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fa0580b1440 msgr2=0x7fa0580b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:10.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.952+0000 7fa063820800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:10.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.952+0000 7fa063820800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:10.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.952+0000 7fa063820800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:10.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.952+0000 7fa063820800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:10.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.952+0000 7fa063820800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:10.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.952+0000 7fa063820800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:10.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.952+0000 7fa063820800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.952+0000 7fa063820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:10.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.952+0000 7fa063820800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.953+0000 7fa063820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:10.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.953+0000 7fa063820800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.953+0000 7fa063820800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:10.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.953+0000 7fa063820800 20 zone default found 2024-09-12T17:25:10.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.953+0000 7fa063820800 4 Realm: () 2024-09-12T17:25:10.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.953+0000 7fa063820800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:10.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.953+0000 7fa063820800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:10.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.953+0000 7fa063820800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:10.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.953+0000 7fa063820800 20 zonegroup default 2024-09-12T17:25:10.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.953+0000 7fa063820800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.953+0000 7fa063820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:10.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.954+0000 7fa063820800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.954+0000 7fa063820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:10.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.954+0000 7fa063820800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.954+0000 7fa063820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:10.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.954+0000 7fa063820800 20 started sync module instance, tier type = 2024-09-12T17:25:10.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.954+0000 7fa063820800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:10.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.964+0000 7fa063820800 20 add_watcher() i=0 2024-09-12T17:25:10.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.964+0000 7fa063820800 20 add_watcher() i=1 2024-09-12T17:25:10.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.964+0000 7fa063820800 20 add_watcher() i=2 2024-09-12T17:25:10.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.964+0000 7fa063820800 20 add_watcher() i=3 2024-09-12T17:25:10.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.964+0000 7fa063820800 20 add_watcher() i=4 2024-09-12T17:25:10.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.964+0000 7fa063820800 20 add_watcher() i=5 2024-09-12T17:25:10.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.964+0000 7fa063820800 20 add_watcher() i=6 2024-09-12T17:25:10.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.965+0000 7fa063820800 20 add_watcher() i=7 2024-09-12T17:25:10.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.965+0000 7fa063820800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:10.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.966+0000 7f9f17fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:10.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.967+0000 7fa063820800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:10.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.967+0000 7fa063820800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:10.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.967+0000 7fa063820800 5 note: GC not initialized 2024-09-12T17:25:10.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.967+0000 7f9f16fe5640 20 reqs_thread_entry: start 2024-09-12T17:25:10.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.967+0000 7fa063820800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:10.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.967+0000 7fa063820800 20 Filter name: none 2024-09-12T17:25:10.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.967+0000 7f9f14fe1640 20 reqs_thread_entry: start 2024-09-12T17:25:10.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.967+0000 7fa063820800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.968+0000 7fa063820800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:25:10.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.968+0000 7fa063820800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.968+0000 7fa063820800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:25:10.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.968+0000 7fa063820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:10.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.968+0000 7fa063820800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.969+0000 7fa063820800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:25:10.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.969+0000 7fa063820800 20 rados->read ofs=0 len=0 2024-09-12T17:25:10.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.969+0000 7fa063820800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:25:10.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.969+0000 7fa063820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:10.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.970+0000 7f9f17fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:10.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.972+0000 7fa063820800 20 remove_watcher() i=0 2024-09-12T17:25:10.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.972+0000 7fa063820800 2 removed watcher, disabling cache 2024-09-12T17:25:10.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.973+0000 7fa063820800 20 remove_watcher() i=1 2024-09-12T17:25:10.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.974+0000 7fa063820800 20 remove_watcher() i=2 2024-09-12T17:25:10.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.976+0000 7fa063820800 20 remove_watcher() i=3 2024-09-12T17:25:10.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.977+0000 7fa063820800 20 remove_watcher() i=4 2024-09-12T17:25:10.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.978+0000 7fa063820800 20 remove_watcher() i=5 2024-09-12T17:25:10.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.979+0000 7fa063820800 20 remove_watcher() i=6 2024-09-12T17:25:10.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:10.980+0000 7fa063820800 20 remove_watcher() i=7 2024-09-12T17:25:10.992 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:10.992 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:25:10.992 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-block-writes id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:25:10.992 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:10.993 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:10.994 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:11.029 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:11.029 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:11.087 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:25:11.121 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:11.121 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:11.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.160+0000 7ff7bb7af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.161+0000 7ff7bb7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:11.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.161+0000 7ff7bb7af800 20 realm 2024-09-12T17:25:11.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.161+0000 7ff7bb7af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.161+0000 7ff7bb7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:11.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.161+0000 7ff7bb7af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:11.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.161+0000 7ff7bb7af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.162+0000 7ff7bb7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:11.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.162+0000 7ff7bb7af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.162+0000 7ff7bb7af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:11.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.162+0000 7ff7bb7af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.163+0000 7ff7bb7af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:11.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.163+0000 7ff7bb7af800 20 searching for the correct realm 2024-09-12T17:25:11.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.165+0000 7ff7b8a98640 0 -- 172.21.15.67:0/2664664336 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7ff7ac085040 msgr2=0x7ff7ac093080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:11.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.371+0000 7ff7b9299640 0 -- 172.21.15.67:0/2664664336 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7ff7b002a040 msgr2=0x7ff7b005d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:25:11.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.578+0000 7ff7bb7af800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:11.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.578+0000 7ff7bb7af800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:11.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.578+0000 7ff7bb7af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:11.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.578+0000 7ff7bb7af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:11.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.578+0000 7ff7bb7af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:11.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.578+0000 7ff7bb7af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:11.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.578+0000 7ff7bb7af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.578+0000 7ff7bb7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:11.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.578+0000 7ff7bb7af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.579+0000 7ff7bb7af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:11.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.579+0000 7ff7bb7af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.579+0000 7ff7bb7af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:11.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.579+0000 7ff7bb7af800 20 zone default found 2024-09-12T17:25:11.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.579+0000 7ff7bb7af800 4 Realm: () 2024-09-12T17:25:11.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.579+0000 7ff7bb7af800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:11.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.579+0000 7ff7bb7af800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:11.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.579+0000 7ff7bb7af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:11.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.579+0000 7ff7bb7af800 20 zonegroup default 2024-09-12T17:25:11.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.579+0000 7ff7bb7af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.580+0000 7ff7bb7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:11.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.580+0000 7ff7bb7af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.580+0000 7ff7bb7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:11.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.580+0000 7ff7bb7af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.580+0000 7ff7bb7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:11.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.580+0000 7ff7bb7af800 20 started sync module instance, tier type = 2024-09-12T17:25:11.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.581+0000 7ff7bb7af800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:11.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.590+0000 7ff7bb7af800 20 add_watcher() i=0 2024-09-12T17:25:11.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.590+0000 7ff7bb7af800 20 add_watcher() i=1 2024-09-12T17:25:11.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.590+0000 7ff7bb7af800 20 add_watcher() i=2 2024-09-12T17:25:11.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.590+0000 7ff7bb7af800 20 add_watcher() i=3 2024-09-12T17:25:11.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.590+0000 7ff7bb7af800 20 add_watcher() i=4 2024-09-12T17:25:11.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.590+0000 7ff7bb7af800 20 add_watcher() i=5 2024-09-12T17:25:11.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.590+0000 7ff7bb7af800 20 add_watcher() i=6 2024-09-12T17:25:11.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.591+0000 7ff7bb7af800 20 add_watcher() i=7 2024-09-12T17:25:11.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.591+0000 7ff7bb7af800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:11.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.593+0000 7ff66ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:11.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.593+0000 7ff7bb7af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:11.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.593+0000 7ff7bb7af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:11.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.593+0000 7ff7bb7af800 5 note: GC not initialized 2024-09-12T17:25:11.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.593+0000 7ff66efe5640 20 reqs_thread_entry: start 2024-09-12T17:25:11.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.593+0000 7ff7bb7af800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:11.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.594+0000 7ff7bb7af800 20 Filter name: none 2024-09-12T17:25:11.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.594+0000 7ff66cfe1640 20 reqs_thread_entry: start 2024-09-12T17:25:11.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.594+0000 7ff7bb7af800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T17:25:11.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.594+0000 7ff7bb7af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.594+0000 7ff7bb7af800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:25:11.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.594+0000 7ff7bb7af800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T17:25:11.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.594+0000 7ff7bb7af800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T17:25:11.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.594+0000 7ff7bb7af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 : miss 2024-09-12T17:25:11.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.594+0000 7ff7bb7af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.595+0000 7ff7bb7af800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:25:11.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.595+0000 7ff7bb7af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 info.flags=0x17 2024-09-12T17:25:11.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.595+0000 7ff7bb7af800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 to cache LRU end 2024-09-12T17:25:11.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.595+0000 7ff7bb7af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:25:11.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.595+0000 7ff7bb7af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:11.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.595+0000 7ff7bb7af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 2024-09-12T17:25:11.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.598+0000 7ff7bb7af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 info.flags=0x17 2024-09-12T17:25:11.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.598+0000 7ff7bb7af800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 to cache LRU end 2024-09-12T17:25:11.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.598+0000 7ff7bb7af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:11.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.598+0000 7ff7bb7af800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29, ofs0, ns] 2024-09-12T17:25:11.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.599+0000 7ff69cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464290 cookie 94672256825424 notifier 6656 bl.length()=999 2024-09-12T17:25:11.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.599+0000 7ff69cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 info.flags=0x17 2024-09-12T17:25:11.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.599+0000 7ff69cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 to cache LRU end 2024-09-12T17:25:11.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.599+0000 7ff69cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:11.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.601+0000 7ff7bb7af800 20 handle_bi_update(): bucket=:error-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.29]): orig_sources= new_sources= 2024-09-12T17:25:11.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.601+0000 7ff7bb7af800 20 handle_bi_update(): bucket=:error-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.29]): potential sources added=[] removed=[] 2024-09-12T17:25:11.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.601+0000 7ff7bb7af800 20 handle_bi_update(): bucket=:error-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.29]): orig_dests= new_dests= 2024-09-12T17:25:11.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.601+0000 7ff7bb7af800 20 handle_bi_update(): bucket=:error-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.29]): potential dests added=[] removed=[] 2024-09-12T17:25:11.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.603+0000 7ff7bb7af800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.29.1.0 2024-09-12T17:25:11.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.603+0000 7ff7bb7af800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.29.1.0 2024-09-12T17:25:11.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.603+0000 7ff7bb7af800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.29.1.1 2024-09-12T17:25:11.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.603+0000 7ff7bb7af800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.29.1.1 2024-09-12T17:25:11.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.603+0000 7ff7bb7af800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.29.0 2024-09-12T17:25:11.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.606+0000 7ff7bb7af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:25:11.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.606+0000 7ff7bb7af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 2024-09-12T17:25:11.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.607+0000 7ff7bb7af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 info.flags=0x17 2024-09-12T17:25:11.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.607+0000 7ff7bb7af800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 to cache LRU end 2024-09-12T17:25:11.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.607+0000 7ff7bb7af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:11.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.607+0000 7ff7bb7af800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29, ofs0, ns] 2024-09-12T17:25:11.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.607+0000 7ff69cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464291 cookie 94672256825424 notifier 6656 bl.length()=999 2024-09-12T17:25:11.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.607+0000 7ff69cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 info.flags=0x17 2024-09-12T17:25:11.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.607+0000 7ff69cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 to cache LRU end 2024-09-12T17:25:11.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.607+0000 7ff69cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:11.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.609+0000 7ff7bb7af800 20 handle_bi_update(): bucket=:error-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.29]): orig_sources= new_sources= 2024-09-12T17:25:11.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.609+0000 7ff7bb7af800 20 handle_bi_update(): bucket=:error-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.29]): potential sources added=[] removed=[] 2024-09-12T17:25:11.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.609+0000 7ff7bb7af800 20 handle_bi_update(): bucket=:error-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.29]): orig_dests= new_dests= 2024-09-12T17:25:11.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.609+0000 7ff7bb7af800 20 handle_bi_update(): bucket=:error-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.29]): potential dests added=[] removed=[] 2024-09-12T17:25:11.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.610+0000 7ff7bb7af800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.29.0 2024-09-12T17:25:11.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.610+0000 7ff7bb7af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:25:11.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.610+0000 7ff7bb7af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 2024-09-12T17:25:11.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.612+0000 7ff7bb7af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 info.flags=0x17 2024-09-12T17:25:11.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.612+0000 7ff7bb7af800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 to cache LRU end 2024-09-12T17:25:11.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.612+0000 7ff7bb7af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:11.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.612+0000 7ff7bb7af800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29, ofs0, ns] 2024-09-12T17:25:11.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.612+0000 7ff69cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464292 cookie 94672256825424 notifier 6656 bl.length()=967 2024-09-12T17:25:11.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.612+0000 7ff69cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 info.flags=0x17 2024-09-12T17:25:11.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.612+0000 7ff69cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 to cache LRU end 2024-09-12T17:25:11.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.612+0000 7ff69cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:11.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.613+0000 7ff7bb7af800 20 handle_bi_update(): bucket=:error-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.29]): orig_sources= new_sources= 2024-09-12T17:25:11.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.613+0000 7ff7bb7af800 20 handle_bi_update(): bucket=:error-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.29]): potential sources added=[] removed=[] 2024-09-12T17:25:11.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.613+0000 7ff7bb7af800 20 handle_bi_update(): bucket=:error-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.29]): orig_dests= new_dests= 2024-09-12T17:25:11.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.613+0000 7ff7bb7af800 20 handle_bi_update(): bucket=:error-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.29]): potential dests added=[] removed=[] 2024-09-12T17:25:11.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.615+0000 7ff7bb7af800 1 execute INFO: reshard of bucket "error-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-12T17:25:11.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.617+0000 7ff66ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:11.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.620+0000 7ff7bb7af800 20 remove_watcher() i=0 2024-09-12T17:25:11.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.620+0000 7ff7bb7af800 2 removed watcher, disabling cache 2024-09-12T17:25:11.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.621+0000 7ff7bb7af800 20 remove_watcher() i=1 2024-09-12T17:25:11.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.622+0000 7ff7bb7af800 20 remove_watcher() i=2 2024-09-12T17:25:11.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.623+0000 7ff7bb7af800 20 remove_watcher() i=3 2024-09-12T17:25:11.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.624+0000 7ff7bb7af800 20 remove_watcher() i=4 2024-09-12T17:25:11.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.625+0000 7ff7bb7af800 20 remove_watcher() i=5 2024-09-12T17:25:11.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.626+0000 7ff7bb7af800 20 remove_watcher() i=6 2024-09-12T17:25:11.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.627+0000 7ff7bb7af800 20 remove_watcher() i=7 2024-09-12T17:25:11.641 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:25:11.670 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:11.670 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:11.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.708+0000 7fd75333d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.711+0000 7fd75333d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:11.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.711+0000 7fd75333d800 20 realm 2024-09-12T17:25:11.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.711+0000 7fd75333d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.711+0000 7fd75333d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:11.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.711+0000 7fd75333d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:11.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.711+0000 7fd75333d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.711+0000 7fd75333d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:11.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.711+0000 7fd75333d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.712+0000 7fd75333d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:11.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.712+0000 7fd75333d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.713+0000 7fd75333d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:11.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.713+0000 7fd75333d800 20 searching for the correct realm 2024-09-12T17:25:11.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.716+0000 7fd74f82b640 0 -- 172.21.15.67:0/1235602172 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x55b80fae1620 msgr2=0x55b80fae3a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:11.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.719+0000 7fd74f02a640 0 -- 172.21.15.67:0/1235602172 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fd7440b8210 msgr2=0x7fd7440e47f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:25:11.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.724+0000 7fd75333d800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:11.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.724+0000 7fd75333d800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:11.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.724+0000 7fd75333d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:11.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.724+0000 7fd75333d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:11.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.724+0000 7fd75333d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:11.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.724+0000 7fd75333d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:11.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.724+0000 7fd75333d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.724+0000 7fd75333d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:11.726 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.724+0000 7fd75333d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.724+0000 7fd75333d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:11.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.724+0000 7fd75333d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.725+0000 7fd75333d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:11.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.725+0000 7fd75333d800 20 zone default found 2024-09-12T17:25:11.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.725+0000 7fd75333d800 4 Realm: () 2024-09-12T17:25:11.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.725+0000 7fd75333d800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:11.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.725+0000 7fd75333d800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:11.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.725+0000 7fd75333d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:11.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.725+0000 7fd75333d800 20 zonegroup default 2024-09-12T17:25:11.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.725+0000 7fd75333d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.725+0000 7fd75333d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:11.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.725+0000 7fd75333d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.725+0000 7fd75333d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:11.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.725+0000 7fd75333d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.725+0000 7fd75333d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:11.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.725+0000 7fd75333d800 20 started sync module instance, tier type = 2024-09-12T17:25:11.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.725+0000 7fd75333d800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:11.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.734+0000 7fd75333d800 20 add_watcher() i=0 2024-09-12T17:25:11.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.734+0000 7fd75333d800 20 add_watcher() i=1 2024-09-12T17:25:11.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.734+0000 7fd75333d800 20 add_watcher() i=2 2024-09-12T17:25:11.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.734+0000 7fd75333d800 20 add_watcher() i=3 2024-09-12T17:25:11.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.734+0000 7fd75333d800 20 add_watcher() i=4 2024-09-12T17:25:11.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.734+0000 7fd75333d800 20 add_watcher() i=5 2024-09-12T17:25:11.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.734+0000 7fd75333d800 20 add_watcher() i=6 2024-09-12T17:25:11.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.735+0000 7fd75333d800 20 add_watcher() i=7 2024-09-12T17:25:11.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.735+0000 7fd75333d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:11.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.737+0000 7fd605fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:11.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.737+0000 7fd75333d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:11.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.737+0000 7fd75333d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:11.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.737+0000 7fd75333d800 5 note: GC not initialized 2024-09-12T17:25:11.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.738+0000 7fd604fe1640 20 reqs_thread_entry: start 2024-09-12T17:25:11.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.738+0000 7fd75333d800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:11.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.738+0000 7fd75333d800 20 Filter name: none 2024-09-12T17:25:11.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.738+0000 7fd57e7fc640 20 reqs_thread_entry: start 2024-09-12T17:25:11.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.738+0000 7fd75333d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.739+0000 7fd75333d800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:25:11.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.739+0000 7fd75333d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.739+0000 7fd75333d800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:25:11.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.739+0000 7fd75333d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:11.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.739+0000 7fd75333d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.740+0000 7fd75333d800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:25:11.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.740+0000 7fd75333d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:11.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.740+0000 7fd75333d800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:25:11.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.740+0000 7fd75333d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:11.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.741+0000 7fd605fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:11.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.744+0000 7fd75333d800 20 remove_watcher() i=0 2024-09-12T17:25:11.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.744+0000 7fd75333d800 2 removed watcher, disabling cache 2024-09-12T17:25:11.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.745+0000 7fd75333d800 20 remove_watcher() i=1 2024-09-12T17:25:11.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.746+0000 7fd75333d800 20 remove_watcher() i=2 2024-09-12T17:25:11.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.747+0000 7fd75333d800 20 remove_watcher() i=3 2024-09-12T17:25:11.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.748+0000 7fd75333d800 20 remove_watcher() i=4 2024-09-12T17:25:11.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.748+0000 7fd75333d800 20 remove_watcher() i=5 2024-09-12T17:25:11.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.749+0000 7fd75333d800 20 remove_watcher() i=6 2024-09-12T17:25:11.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:11.750+0000 7fd75333d800 20 remove_watcher() i=7 2024-09-12T17:25:11.762 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:11.762 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:25:11.763 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-block-writes id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.29 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:25:11.763 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:11.765 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:11.765 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:11.786 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:11.786 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:12.001 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:12.002 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:12.066 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with abort at block_writes 2024-09-12T17:25:12.066 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:12.067 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:12.067 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:12.109 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:12.109 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:12.165 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:12.166 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:12.204 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:12.204 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:12.240 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:12.240 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:12.277 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:12.277 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:12.311 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:12.311 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:12.349 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:12.349 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:12.386 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:12.386 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:12.422 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:12.422 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:12.458 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:12.458 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:12.495 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:12.495 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:12.532 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:12.532 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:12.570 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:12.570 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:12.606 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:12.606 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:12.643 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:12.643 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:12.679 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:12.679 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:12.714 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:12.714 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:12.749 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:12.749 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:12.785 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:12.785 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:12.822 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:12.822 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:12.858 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:12.859 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:12.895 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:25:12.924 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:12.924 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:13.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.155+0000 7f91b677f640 0 --2- 172.21.15.67:0/560730213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5634c06c91a0 0x5634c06c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:25:13.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.164+0000 7f91b9496800 20 rados->read ofs=0 len=0 2024-09-12T17:25:13.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.165+0000 7f91b9496800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:13.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.165+0000 7f91b9496800 20 realm 2024-09-12T17:25:13.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.165+0000 7f91b9496800 20 rados->read ofs=0 len=0 2024-09-12T17:25:13.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.166+0000 7f91b9496800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:13.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.166+0000 7f91b9496800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:13.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.166+0000 7f91b9496800 20 rados->read ofs=0 len=0 2024-09-12T17:25:13.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.166+0000 7f91b9496800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:13.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.166+0000 7f91b9496800 20 rados->read ofs=0 len=0 2024-09-12T17:25:13.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.167+0000 7f91b9496800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:13.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.167+0000 7f91b9496800 20 rados->read ofs=0 len=0 2024-09-12T17:25:13.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.168+0000 7f91b9496800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:13.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.168+0000 7f91b9496800 20 searching for the correct realm 2024-09-12T17:25:13.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.169+0000 7f91b6f80640 0 -- 172.21.15.67:0/1029674309 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f91b0035930 msgr2=0x7f91b0017420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:25:13.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.375+0000 7f91b677f640 0 -- 172.21.15.67:0/1029674309 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f91a806d060 msgr2=0x7f91a80a3080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:13.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.381+0000 7f91b9496800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:13.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.381+0000 7f91b9496800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:13.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.381+0000 7f91b9496800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:13.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.381+0000 7f91b9496800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:13.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.381+0000 7f91b9496800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:13.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.381+0000 7f91b9496800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:13.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.381+0000 7f91b9496800 20 rados->read ofs=0 len=0 2024-09-12T17:25:13.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.381+0000 7f91b9496800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:13.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.381+0000 7f91b9496800 20 rados->read ofs=0 len=0 2024-09-12T17:25:13.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.381+0000 7f91b9496800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:13.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.381+0000 7f91b9496800 20 rados->read ofs=0 len=0 2024-09-12T17:25:13.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.382+0000 7f91b9496800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:13.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.382+0000 7f91b9496800 20 zone default found 2024-09-12T17:25:13.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.382+0000 7f91b9496800 4 Realm: () 2024-09-12T17:25:13.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.382+0000 7f91b9496800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:13.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.382+0000 7f91b9496800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:13.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.382+0000 7f91b9496800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:13.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.382+0000 7f91b9496800 20 zonegroup default 2024-09-12T17:25:13.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.382+0000 7f91b9496800 20 rados->read ofs=0 len=0 2024-09-12T17:25:13.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.382+0000 7f91b9496800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:13.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.382+0000 7f91b9496800 20 rados->read ofs=0 len=0 2024-09-12T17:25:13.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.382+0000 7f91b9496800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:13.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.382+0000 7f91b9496800 20 rados->read ofs=0 len=0 2024-09-12T17:25:13.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.383+0000 7f91b9496800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:13.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.383+0000 7f91b9496800 20 started sync module instance, tier type = 2024-09-12T17:25:13.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.383+0000 7f91b9496800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:13.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.392+0000 7f91b9496800 20 add_watcher() i=0 2024-09-12T17:25:13.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.392+0000 7f91b9496800 20 add_watcher() i=1 2024-09-12T17:25:13.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.392+0000 7f91b9496800 20 add_watcher() i=2 2024-09-12T17:25:13.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.392+0000 7f91b9496800 20 add_watcher() i=3 2024-09-12T17:25:13.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.392+0000 7f91b9496800 20 add_watcher() i=4 2024-09-12T17:25:13.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.392+0000 7f91b9496800 20 add_watcher() i=5 2024-09-12T17:25:13.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.392+0000 7f91b9496800 20 add_watcher() i=6 2024-09-12T17:25:13.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.393+0000 7f91b9496800 20 add_watcher() i=7 2024-09-12T17:25:13.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.393+0000 7f91b9496800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:13.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.395+0000 7f906dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:13.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.395+0000 7f91b9496800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:13.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.395+0000 7f91b9496800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:13.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.395+0000 7f91b9496800 5 note: GC not initialized 2024-09-12T17:25:13.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.396+0000 7f906cfe1640 20 reqs_thread_entry: start 2024-09-12T17:25:13.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.396+0000 7f91b9496800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:13.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.396+0000 7f91b9496800 20 Filter name: none 2024-09-12T17:25:13.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.396+0000 7f9065ffb640 20 reqs_thread_entry: start 2024-09-12T17:25:13.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.396+0000 7f91b9496800 20 rados->read ofs=0 len=0 2024-09-12T17:25:13.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.396+0000 7f91b9496800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:25:13.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.396+0000 7f91b9496800 20 rados->read ofs=0 len=0 2024-09-12T17:25:13.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.397+0000 7f91b9496800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:25:13.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.397+0000 7f91b9496800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:13.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.397+0000 7f91b9496800 20 rados->read ofs=0 len=0 2024-09-12T17:25:13.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.397+0000 7f91b9496800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:25:13.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.397+0000 7f91b9496800 20 rados->read ofs=0 len=0 2024-09-12T17:25:13.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.398+0000 7f91b9496800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:25:13.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.398+0000 7f91b9496800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:13.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.399+0000 7f906dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:13.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.401+0000 7f91b9496800 20 remove_watcher() i=0 2024-09-12T17:25:13.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.401+0000 7f91b9496800 2 removed watcher, disabling cache 2024-09-12T17:25:13.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.402+0000 7f91b9496800 20 remove_watcher() i=1 2024-09-12T17:25:13.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.403+0000 7f91b9496800 20 remove_watcher() i=2 2024-09-12T17:25:13.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.404+0000 7f91b9496800 20 remove_watcher() i=3 2024-09-12T17:25:13.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.406+0000 7f91b9496800 20 remove_watcher() i=4 2024-09-12T17:25:13.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.407+0000 7f91b9496800 20 remove_watcher() i=5 2024-09-12T17:25:13.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.408+0000 7f91b9496800 20 remove_watcher() i=6 2024-09-12T17:25:13.410 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.409+0000 7f91b9496800 20 remove_watcher() i=7 2024-09-12T17:25:13.421 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:13.421 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:25:13.421 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-block-writes id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:25:13.421 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:13.423 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-12T17:25:13.458 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:13.458 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:13.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.698+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:13.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.900+0000 7f4fc1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:13.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.900+0000 7f4fc1519800 20 realm 2024-09-12T17:25:13.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.900+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:13.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.901+0000 7f4fc1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:13.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.901+0000 7f4fc1519800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:13.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.901+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:13.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.901+0000 7f4fc1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:13.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.901+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:13.903 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.902+0000 7f4fc1519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:13.903 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.902+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:13.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.903+0000 7f4fc1519800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:13.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.903+0000 7f4fc1519800 20 searching for the correct realm 2024-09-12T17:25:13.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:13.905+0000 7f4fbe802640 0 -- 172.21.15.67:0/2369398851 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f4fb007e070 msgr2=0x7f4fb0064970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:14.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.110+0000 7f4fbf003640 0 -- 172.21.15.67:0/2369398851 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f4fb40694a0 msgr2=0x7f4fb407ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:14.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.318+0000 7f4fc1519800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:14.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.318+0000 7f4fc1519800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:14.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.318+0000 7f4fc1519800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:14.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.318+0000 7f4fc1519800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:14.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.318+0000 7f4fc1519800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:14.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.318+0000 7f4fc1519800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:14.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.318+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.318+0000 7f4fc1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.318+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.319+0000 7f4fc1519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:14.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.319+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.319+0000 7f4fc1519800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:14.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.319+0000 7f4fc1519800 20 zone default found 2024-09-12T17:25:14.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.319+0000 7f4fc1519800 4 Realm: () 2024-09-12T17:25:14.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.319+0000 7f4fc1519800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:14.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.319+0000 7f4fc1519800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:14.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.319+0000 7f4fc1519800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:14.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.319+0000 7f4fc1519800 20 zonegroup default 2024-09-12T17:25:14.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.319+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.319+0000 7f4fc1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.319+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.320+0000 7f4fc1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.320+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.320+0000 7f4fc1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.320+0000 7f4fc1519800 20 started sync module instance, tier type = 2024-09-12T17:25:14.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.320+0000 7f4fc1519800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:14.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.331+0000 7f4fc1519800 20 add_watcher() i=0 2024-09-12T17:25:14.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.331+0000 7f4fc1519800 20 add_watcher() i=1 2024-09-12T17:25:14.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.331+0000 7f4fc1519800 20 add_watcher() i=2 2024-09-12T17:25:14.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.331+0000 7f4fc1519800 20 add_watcher() i=3 2024-09-12T17:25:14.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.331+0000 7f4fc1519800 20 add_watcher() i=4 2024-09-12T17:25:14.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.331+0000 7f4fc1519800 20 add_watcher() i=5 2024-09-12T17:25:14.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.331+0000 7f4fc1519800 20 add_watcher() i=6 2024-09-12T17:25:14.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.332+0000 7f4fc1519800 20 add_watcher() i=7 2024-09-12T17:25:14.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.332+0000 7f4fc1519800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:14.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.333+0000 7f4e757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:14.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.334+0000 7f4fc1519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:14.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.334+0000 7f4fc1519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:14.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.334+0000 7f4fc1519800 5 note: GC not initialized 2024-09-12T17:25:14.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.334+0000 7f4deffff640 20 reqs_thread_entry: start 2024-09-12T17:25:14.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.334+0000 7f4fc1519800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:14.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.334+0000 7f4fc1519800 20 Filter name: none 2024-09-12T17:25:14.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.334+0000 7f4dedffb640 20 reqs_thread_entry: start 2024-09-12T17:25:14.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.335+0000 7f4fc1519800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:25:14.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.335+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.335+0000 7f4fc1519800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:25:14.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.335+0000 7f4fc1519800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:25:14.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.335+0000 7f4fc1519800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:25:14.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.335+0000 7f4fc1519800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 : miss 2024-09-12T17:25:14.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.335+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.335+0000 7f4fc1519800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:25:14.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.335+0000 7f4fc1519800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 info.flags=0x17 2024-09-12T17:25:14.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.335+0000 7f4fc1519800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 to cache LRU end 2024-09-12T17:25:14.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.335+0000 7f4fc1519800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:25:14.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.335+0000 7f4fc1519800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:14.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.335+0000 7f4fc1519800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 2024-09-12T17:25:14.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.340+0000 7f4fc1519800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 info.flags=0x17 2024-09-12T17:25:14.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.340+0000 7f4fc1519800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 to cache LRU end 2024-09-12T17:25:14.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.340+0000 7f4fc1519800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:14.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.340+0000 7f4fc1519800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30, ofs0, ns] 2024-09-12T17:25:14.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.340+0000 7f4ea27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464338 cookie 94685826644928 notifier 7140 bl.length()=999 2024-09-12T17:25:14.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.340+0000 7f4ea27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 info.flags=0x17 2024-09-12T17:25:14.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.340+0000 7f4ea27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 to cache LRU end 2024-09-12T17:25:14.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.340+0000 7f4ea27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:14.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.342+0000 7f4fc1519800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): orig_sources= new_sources= 2024-09-12T17:25:14.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.342+0000 7f4fc1519800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): potential sources added=[] removed=[] 2024-09-12T17:25:14.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.342+0000 7f4fc1519800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): orig_dests= new_dests= 2024-09-12T17:25:14.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.342+0000 7f4fc1519800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): potential dests added=[] removed=[] 2024-09-12T17:25:14.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.345+0000 7f4fc1519800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.30.1.0 2024-09-12T17:25:14.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.345+0000 7f4fc1519800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.30.1.0 2024-09-12T17:25:14.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.345+0000 7f4fc1519800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.30.1.1 2024-09-12T17:25:14.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.345+0000 7f4fc1519800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.30.1.1 2024-09-12T17:25:14.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.345+0000 7f4fc1519800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.30.0 2024-09-12T17:25:14.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.348+0000 7f4fc1519800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:25:14.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.348+0000 7f4fc1519800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 2024-09-12T17:25:14.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.349+0000 7f4fc1519800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 info.flags=0x17 2024-09-12T17:25:14.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.349+0000 7f4fc1519800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 to cache LRU end 2024-09-12T17:25:14.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.349+0000 7f4fc1519800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:14.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.349+0000 7f4fc1519800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30, ofs0, ns] 2024-09-12T17:25:14.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.349+0000 7f4ea27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464339 cookie 94685826644928 notifier 7140 bl.length()=999 2024-09-12T17:25:14.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.349+0000 7f4ea27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 info.flags=0x17 2024-09-12T17:25:14.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.349+0000 7f4ea27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 to cache LRU end 2024-09-12T17:25:14.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.349+0000 7f4ea27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:14.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.351+0000 7f4fc1519800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): orig_sources= new_sources= 2024-09-12T17:25:14.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.351+0000 7f4fc1519800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): potential sources added=[] removed=[] 2024-09-12T17:25:14.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.351+0000 7f4fc1519800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): orig_dests= new_dests= 2024-09-12T17:25:14.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.351+0000 7f4fc1519800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): potential dests added=[] removed=[] 2024-09-12T17:25:14.352 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4fc1519800 time 2024-09-12T17:25:14.352192+0000 2024-09-12T17:25:14.352 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:25:14.353 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:25:14.353 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4fc498c71a] 2024-09-12T17:25:14.353 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4fc498c8d8] 2024-09-12T17:25:14.353 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561dc1d6c841] 2024-09-12T17:25:14.354 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x561dc1d7b79e] 2024-09-12T17:25:14.354 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x561dc1d7c5d4] 2024-09-12T17:25:14.354 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:25:14.354 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4fc3629590] 2024-09-12T17:25:14.354 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:25:14.354 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:25:14.354 INFO:tasks.workunit.client.0.smithi067.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:25:14.354 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f4fc1519800 thread_name:radosgw-admin 2024-09-12T17:25:14.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.352+0000 7f4fc1519800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4fc1519800 time 2024-09-12T17:25:14.352192+0000 2024-09-12T17:25:14.354 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:25:14.354 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.355 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:25:14.355 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4fc498c71a] 2024-09-12T17:25:14.355 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4fc498c8d8] 2024-09-12T17:25:14.355 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561dc1d6c841] 2024-09-12T17:25:14.355 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x561dc1d7b79e] 2024-09-12T17:25:14.355 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x561dc1d7c5d4] 2024-09-12T17:25:14.355 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:25:14.355 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4fc3629590] 2024-09-12T17:25:14.355 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:25:14.355 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:25:14.355 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.371 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:25:14.371 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4fc363e6f0] 2024-09-12T17:25:14.371 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4fc368b99c] 2024-09-12T17:25:14.371 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:25:14.371 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:25:14.371 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4fc498c774] 2024-09-12T17:25:14.371 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4fc498c8d8] 2024-09-12T17:25:14.371 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561dc1d6c841] 2024-09-12T17:25:14.371 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x561dc1d7b79e] 2024-09-12T17:25:14.371 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x561dc1d7c5d4] 2024-09-12T17:25:14.371 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:25:14.372 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4fc3629590] 2024-09-12T17:25:14.372 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:25:14.372 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:25:14.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.353+0000 7f4fc1519800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:25:14.372 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f4fc1519800 thread_name:radosgw-admin 2024-09-12T17:25:14.372 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.372 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:25:14.372 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4fc363e6f0] 2024-09-12T17:25:14.372 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4fc368b99c] 2024-09-12T17:25:14.372 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:25:14.373 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:25:14.373 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4fc498c774] 2024-09-12T17:25:14.373 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4fc498c8d8] 2024-09-12T17:25:14.373 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561dc1d6c841] 2024-09-12T17:25:14.373 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x561dc1d7b79e] 2024-09-12T17:25:14.373 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x561dc1d7c5d4] 2024-09-12T17:25:14.373 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:25:14.373 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4fc3629590] 2024-09-12T17:25:14.373 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:25:14.373 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:25:14.373 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:25:14.373 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.374 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T17:25:14.374 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc3005590) adding con mode: secure 2024-09-12T17:25:14.374 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc3005590) adding con mode: crc 2024-09-12T17:25:14.374 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc3005590) adding con mode: secure 2024-09-12T17:25:14.374 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T17:25:13.480+0000 7f4fc1519800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:14.374 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T17:25:13.480+0000 7f4fc1519800 1 librados: starting msgr at 2024-09-12T17:25:14.374 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T17:25:13.480+0000 7f4fc1519800 1 librados: starting objecter 2024-09-12T17:25:14.374 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command objecter_requests hook 0x561dc3004b50 2024-09-12T17:25:14.374 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T17:25:13.480+0000 7f4fc1519800 1 librados: setting wanted keys 2024-09-12T17:25:14.374 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T17:25:13.480+0000 7f4fc1519800 1 librados: calling monclient init 2024-09-12T17:25:14.374 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T17:25:13.480+0000 7f4fc1519800 10 monclient: init 2024-09-12T17:25:14.374 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding auth protocol: cephx 2024-09-12T17:25:14.374 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding auth protocol: cephx 2024-09-12T17:25:14.375 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding auth protocol: cephx 2024-09-12T17:25:14.375 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding con mode: secure 2024-09-12T17:25:14.375 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding con mode: crc 2024-09-12T17:25:14.375 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding con mode: secure 2024-09-12T17:25:14.375 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding con mode: crc 2024-09-12T17:25:14.375 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding con mode: secure 2024-09-12T17:25:14.375 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding con mode: crc 2024-09-12T17:25:14.375 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding con mode: crc 2024-09-12T17:25:14.375 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding con mode: secure 2024-09-12T17:25:14.375 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding con mode: crc 2024-09-12T17:25:14.375 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding con mode: secure 2024-09-12T17:25:14.375 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding con mode: crc 2024-09-12T17:25:14.375 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding con mode: secure 2024-09-12T17:25:14.376 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T17:25:13.481+0000 7f4fc1519800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:14.376 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T17:25:13.481+0000 7f4fc1519800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:14.376 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T17:25:13.481+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command rotate-key hook 0x561dc2ffff58 2024-09-12T17:25:14.376 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T17:25:13.481+0000 7f4fc1519800 10 monclient: _reopen_session rank -1 2024-09-12T17:25:14.376 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T17:25:13.481+0000 7f4fc1519800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:25:14.376 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T17:25:13.481+0000 7f4fc1519800 10 monclient(hunting): picked mon.noname-b con 0x561dc2f48a40 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:25:14.376 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T17:25:13.481+0000 7f4fc1519800 10 monclient(hunting): picked mon.noname-a con 0x561dc2f49380 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:25:14.376 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T17:25:13.481+0000 7f4fc1519800 10 monclient(hunting): picked mon.noname-c con 0x561dc30318b0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:25:14.376 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T17:25:13.481+0000 7f4fc1519800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:14.376 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T17:25:13.481+0000 7f4fc1519800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:14.376 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T17:25:13.481+0000 7f4fc1519800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:14.376 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T17:25:13.481+0000 7f4fc1519800 10 monclient(hunting): _renew_subs 2024-09-12T17:25:14.376 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T17:25:13.481+0000 7f4fc1519800 10 monclient(hunting): authenticate will time out at 2324.831377s 2024-09-12T17:25:14.377 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T17:25:13.481+0000 7f4fbf804640 10 monclient(hunting): get_auth_request con 0x561dc30318b0 auth_method 0 2024-09-12T17:25:14.377 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T17:25:13.481+0000 7f4fbf804640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:14.377 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T17:25:13.481+0000 7f4fbf804640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:14.377 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T17:25:13.481+0000 7f4fbf804640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:14.377 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T17:25:13.481+0000 7f4fbe802640 10 monclient(hunting): get_auth_request con 0x561dc2f49380 auth_method 0 2024-09-12T17:25:14.377 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T17:25:13.481+0000 7f4fbe802640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:14.377 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T17:25:13.481+0000 7f4fbe802640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:14.377 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T17:25:13.481+0000 7f4fbe802640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:14.377 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T17:25:13.481+0000 7f4fbf804640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:14.377 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T17:25:13.481+0000 7f4fbf804640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:14.377 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T17:25:13.481+0000 7f4fbf804640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:14.377 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T17:25:13.481+0000 7f4fbe802640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:14.378 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T17:25:13.481+0000 7f4fbe802640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:14.378 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T17:25:13.481+0000 7f4fbe802640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:14.378 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T17:25:13.481+0000 7f4fbf003640 10 monclient(hunting): get_auth_request con 0x561dc2f48a40 auth_method 0 2024-09-12T17:25:14.378 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T17:25:13.481+0000 7f4fbf003640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:14.378 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T17:25:13.481+0000 7f4fbf003640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:14.378 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T17:25:13.481+0000 7f4fbf003640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:14.378 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T17:25:13.481+0000 7f4fbf804640 10 monclient(hunting): handle_auth_done global_id 6698 payload 824 2024-09-12T17:25:14.378 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T17:25:13.481+0000 7f4fbf804640 10 monclient: _finish_hunting 0 2024-09-12T17:25:14.378 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T17:25:13.481+0000 7f4fbf804640 1 monclient: found mon.noname-c 2024-09-12T17:25:14.378 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T17:25:13.481+0000 7f4fbf804640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:25:14.378 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T17:25:13.482+0000 7f4eab606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:14.378 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T17:25:13.482+0000 7f4eab606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:25:14.379 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T17:25:13.482+0000 7f4eab606640 10 monclient: dump: 2024-09-12T17:25:14.379 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:14.379 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:14.379 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.379 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.379 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:14.379 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:14.379 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:14.379 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:14.379 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:14.379 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.379 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T17:25:13.482+0000 7f4eab606640 10 monclient: _finish_auth 0 2024-09-12T17:25:14.379 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T17:25:13.482+0000 7f4eab606640 10 monclient: _check_auth_tickets 2024-09-12T17:25:14.380 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T17:25:13.482+0000 7f4fc1519800 5 monclient: authenticate success, global_id 6698 2024-09-12T17:25:14.380 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T17:25:13.482+0000 7f4fc1519800 10 monclient: _renew_subs 2024-09-12T17:25:14.380 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T17:25:13.482+0000 7f4fc1519800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:25:14.380 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T17:25:13.482+0000 7f4eab606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:25:14.380 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T17:25:13.482+0000 7f4eab606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:14.380 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T17:25:13.482+0000 7f4eab606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:25:14.380 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T17:25:13.482+0000 7f4eab606640 10 monclient: dump: 2024-09-12T17:25:14.380 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:14.380 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:14.380 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.380 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.380 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:14.380 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:14.381 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:14.381 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:14.381 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:14.381 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.381 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T17:25:13.482+0000 7f4eace09640 4 set_mon_vals no callback set 2024-09-12T17:25:14.381 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T17:25:13.482+0000 7f4fc1519800 10 monclient: _renew_subs 2024-09-12T17:25:14.381 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T17:25:13.482+0000 7f4fc1519800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:25:14.381 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T17:25:13.482+0000 7f4fc1519800 1 librados: init done 2024-09-12T17:25:14.381 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T17:25:13.484+0000 7f4eab606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:25:14.381 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T17:25:13.484+0000 7f4eab606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:25:14.381 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T17:25:13.484+0000 7f4eab606640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:25:14.381 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T17:25:13.484+0000 7f4fbf003640 10 monclient: get_auth_request con 0x7f4ea4076470 auth_method 0 2024-09-12T17:25:14.381 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T17:25:13.685+0000 7f4fbe802640 10 monclient: get_auth_request con 0x561dc30289f0 auth_method 0 2024-09-12T17:25:14.382 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T17:25:13.686+0000 7f4fbf003640 10 monclient: get_auth_request con 0x561dc304b440 auth_method 0 2024-09-12T17:25:14.382 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T17:25:13.686+0000 7f4fbe802640 10 monclient: get_auth_request con 0x561dc304f7a0 auth_method 0 2024-09-12T17:25:14.382 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T17:25:13.688+0000 7f4fc1519800 10 monclient: build_initial_monmap 2024-09-12T17:25:14.382 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T17:25:13.688+0000 7f4fc1519800 1 build_initial for_mkfs: 0 2024-09-12T17:25:14.382 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T17:25:13.688+0000 7f4fc1519800 10 monclient: monmap: 2024-09-12T17:25:14.382 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:25:14.382 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:25:14.382 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:25:14.382 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:25:14.382 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:25:14.382 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:14.382 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:25:14.382 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:25:14.382 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:25:14.383 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.383 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding auth protocol: cephx 2024-09-12T17:25:14.383 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding auth protocol: cephx 2024-09-12T17:25:14.383 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding auth protocol: cephx 2024-09-12T17:25:14.383 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding con mode: secure 2024-09-12T17:25:14.383 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding con mode: crc 2024-09-12T17:25:14.383 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding con mode: secure 2024-09-12T17:25:14.383 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding con mode: crc 2024-09-12T17:25:14.383 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding con mode: secure 2024-09-12T17:25:14.383 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding con mode: crc 2024-09-12T17:25:14.383 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding con mode: crc 2024-09-12T17:25:14.383 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding con mode: secure 2024-09-12T17:25:14.384 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding con mode: crc 2024-09-12T17:25:14.384 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding con mode: secure 2024-09-12T17:25:14.384 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding con mode: crc 2024-09-12T17:25:14.384 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding con mode: secure 2024-09-12T17:25:14.384 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T17:25:13.688+0000 7f4fc1519800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:14.384 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command objecter_requests cmddesc objecter_requests hook 0x561dc3057940 EEXIST 2024-09-12T17:25:14.384 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T17:25:13.688+0000 7f4fc1519800 10 monclient: init 2024-09-12T17:25:14.384 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding auth protocol: cephx 2024-09-12T17:25:14.384 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding auth protocol: cephx 2024-09-12T17:25:14.384 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding auth protocol: cephx 2024-09-12T17:25:14.384 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding con mode: secure 2024-09-12T17:25:14.384 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding con mode: crc 2024-09-12T17:25:14.385 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding con mode: secure 2024-09-12T17:25:14.385 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding con mode: crc 2024-09-12T17:25:14.385 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding con mode: secure 2024-09-12T17:25:14.385 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding con mode: crc 2024-09-12T17:25:14.385 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding con mode: crc 2024-09-12T17:25:14.385 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding con mode: secure 2024-09-12T17:25:14.385 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding con mode: crc 2024-09-12T17:25:14.385 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding con mode: secure 2024-09-12T17:25:14.385 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding con mode: crc 2024-09-12T17:25:14.385 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding con mode: secure 2024-09-12T17:25:14.385 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T17:25:13.689+0000 7f4fc1519800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:14.385 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T17:25:13.689+0000 7f4fc1519800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:14.385 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T17:25:13.689+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command rotate-key cmddesc rotate-key hook 0x561dc3052c70 EEXIST 2024-09-12T17:25:14.385 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T17:25:13.689+0000 7f4fc1519800 10 monclient: _reopen_session rank -1 2024-09-12T17:25:14.386 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T17:25:13.689+0000 7f4fc1519800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:25:14.386 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T17:25:13.689+0000 7f4fc1519800 10 monclient(hunting): picked mon.noname-a con 0x561dc307bc60 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:25:14.386 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T17:25:13.689+0000 7f4fc1519800 10 monclient(hunting): picked mon.noname-b con 0x561dc307c040 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:25:14.386 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T17:25:13.689+0000 7f4fc1519800 10 monclient(hunting): picked mon.noname-c con 0x561dc307a970 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:25:14.386 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T17:25:13.689+0000 7f4fc1519800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:14.386 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T17:25:13.689+0000 7f4fc1519800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:14.386 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T17:25:13.689+0000 7f4fc1519800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:14.386 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T17:25:13.689+0000 7f4fc1519800 10 monclient(hunting): _renew_subs 2024-09-12T17:25:14.386 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T17:25:13.689+0000 7f4fc1519800 10 monclient(hunting): authenticate will time out at 2325.039525s 2024-09-12T17:25:14.386 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T17:25:13.689+0000 7f4fbf003640 10 monclient(hunting): get_auth_request con 0x561dc307bc60 auth_method 0 2024-09-12T17:25:14.386 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T17:25:13.689+0000 7f4fbf003640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:14.386 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T17:25:13.689+0000 7f4fbf003640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:14.386 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T17:25:13.689+0000 7f4fbf003640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:14.387 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T17:25:13.689+0000 7f4fbf804640 10 monclient(hunting): get_auth_request con 0x561dc307a970 auth_method 0 2024-09-12T17:25:14.387 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T17:25:13.689+0000 7f4fbf804640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:14.387 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T17:25:13.689+0000 7f4fbf804640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:14.387 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T17:25:13.689+0000 7f4fbf804640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:14.387 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T17:25:13.689+0000 7f4fbe802640 10 monclient(hunting): get_auth_request con 0x561dc307c040 auth_method 0 2024-09-12T17:25:14.387 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T17:25:13.689+0000 7f4fbe802640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:14.387 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T17:25:13.689+0000 7f4fbe802640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:14.387 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T17:25:13.689+0000 7f4fbe802640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:14.387 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T17:25:13.689+0000 7f4fbf804640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:14.387 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T17:25:13.689+0000 7f4fbf804640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:14.387 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T17:25:13.689+0000 7f4fbf804640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:14.387 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T17:25:13.689+0000 7f4fbf003640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:14.387 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T17:25:13.689+0000 7f4fbf003640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:14.387 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T17:25:13.689+0000 7f4fbf003640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:14.388 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T17:25:13.689+0000 7f4fbe802640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:14.388 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T17:25:13.689+0000 7f4fbe802640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:14.388 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T17:25:13.689+0000 7f4fbe802640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:14.388 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T17:25:13.689+0000 7f4fbf804640 10 monclient(hunting): handle_auth_done global_id 6701 payload 824 2024-09-12T17:25:14.388 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T17:25:13.690+0000 7f4fbf804640 10 monclient: _finish_hunting 0 2024-09-12T17:25:14.388 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T17:25:13.690+0000 7f4fbf804640 1 monclient: found mon.noname-c 2024-09-12T17:25:14.388 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T17:25:13.690+0000 7f4fbf804640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:25:14.388 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T17:25:13.690+0000 7f4ea8e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:14.388 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T17:25:13.690+0000 7f4ea8e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:25:14.388 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T17:25:13.690+0000 7f4ea8e01640 10 monclient: dump: 2024-09-12T17:25:14.388 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:14.388 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:14.388 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.388 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.388 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:14.389 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:14.389 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:14.389 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:14.389 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:14.389 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.389 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T17:25:13.690+0000 7f4ea8e01640 10 monclient: _finish_auth 0 2024-09-12T17:25:14.389 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T17:25:13.690+0000 7f4ea8e01640 10 monclient: _check_auth_tickets 2024-09-12T17:25:14.389 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T17:25:13.690+0000 7f4ea8e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:25:14.389 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T17:25:13.690+0000 7f4ea8e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:14.389 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T17:25:13.690+0000 7f4ea8e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:25:14.389 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T17:25:13.690+0000 7f4ea8e01640 10 monclient: dump: 2024-09-12T17:25:14.389 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:14.389 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:14.389 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.390 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.390 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:14.390 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:14.390 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:14.390 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:14.390 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:14.390 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.390 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T17:25:13.690+0000 7f4fc1519800 5 monclient: authenticate success, global_id 6701 2024-09-12T17:25:14.390 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T17:25:13.690+0000 7f4fc1519800 10 monclient: _renew_subs 2024-09-12T17:25:14.390 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T17:25:13.690+0000 7f4fc1519800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:25:14.390 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T17:25:13.690+0000 7f4fc0005640 4 set_mon_vals no callback set 2024-09-12T17:25:14.390 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T17:25:13.690+0000 7f4fc1519800 10 monclient: _renew_subs 2024-09-12T17:25:14.390 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T17:25:13.690+0000 7f4fc1519800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:25:14.390 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T17:25:13.692+0000 7f4ea8e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:25:14.391 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T17:25:13.692+0000 7f4ea8e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:25:14.391 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T17:25:13.692+0000 7f4ea8e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:25:14.391 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T17:25:13.692+0000 7f4fbf003640 10 monclient: get_auth_request con 0x7f4e98076380 auth_method 0 2024-09-12T17:25:14.391 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T17:25:13.692+0000 7f4fc1519800 10 monclient: get_monmap_and_config 2024-09-12T17:25:14.391 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T17:25:13.692+0000 7f4fc1519800 10 monclient: build_initial_monmap 2024-09-12T17:25:14.391 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T17:25:13.692+0000 7f4fc1519800 1 build_initial for_mkfs: 0 2024-09-12T17:25:14.391 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T17:25:13.692+0000 7f4fc1519800 10 monclient: monmap: 2024-09-12T17:25:14.391 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:25:14.391 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:25:14.391 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:25:14.391 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:25:14.391 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:25:14.391 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:14.392 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:25:14.392 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:25:14.392 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:25:14.392 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.392 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding auth protocol: cephx 2024-09-12T17:25:14.392 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding auth protocol: cephx 2024-09-12T17:25:14.392 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding auth protocol: cephx 2024-09-12T17:25:14.392 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding con mode: secure 2024-09-12T17:25:14.392 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding con mode: crc 2024-09-12T17:25:14.392 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding con mode: secure 2024-09-12T17:25:14.392 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding con mode: crc 2024-09-12T17:25:14.392 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding con mode: secure 2024-09-12T17:25:14.393 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding con mode: crc 2024-09-12T17:25:14.393 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding con mode: crc 2024-09-12T17:25:14.393 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding con mode: secure 2024-09-12T17:25:14.393 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding con mode: crc 2024-09-12T17:25:14.393 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding con mode: secure 2024-09-12T17:25:14.393 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding con mode: crc 2024-09-12T17:25:14.393 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding con mode: secure 2024-09-12T17:25:14.393 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T17:25:13.692+0000 7f4fc1519800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:14.393 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T17:25:13.693+0000 7f4fc1519800 10 monclient: init 2024-09-12T17:25:14.393 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding auth protocol: cephx 2024-09-12T17:25:14.393 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding auth protocol: cephx 2024-09-12T17:25:14.393 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding auth protocol: cephx 2024-09-12T17:25:14.393 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding con mode: secure 2024-09-12T17:25:14.394 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding con mode: crc 2024-09-12T17:25:14.394 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding con mode: secure 2024-09-12T17:25:14.394 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding con mode: crc 2024-09-12T17:25:14.394 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding con mode: secure 2024-09-12T17:25:14.394 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding con mode: crc 2024-09-12T17:25:14.394 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding con mode: crc 2024-09-12T17:25:14.394 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding con mode: secure 2024-09-12T17:25:14.394 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding con mode: crc 2024-09-12T17:25:14.394 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding con mode: secure 2024-09-12T17:25:14.394 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding con mode: crc 2024-09-12T17:25:14.394 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding con mode: secure 2024-09-12T17:25:14.394 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T17:25:13.693+0000 7f4fc1519800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:14.394 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T17:25:13.693+0000 7f4fc1519800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:14.395 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command rotate-key cmddesc rotate-key hook 0x7ffeaf5ec5b8 EEXIST 2024-09-12T17:25:14.395 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T17:25:13.693+0000 7f4fc1519800 10 monclient: _reopen_session rank -1 2024-09-12T17:25:14.395 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T17:25:13.693+0000 7f4fc1519800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:25:14.395 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T17:25:13.693+0000 7f4fc1519800 10 monclient(hunting): picked mon.noname-b con 0x561dc30cfca0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:25:14.395 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T17:25:13.693+0000 7f4fc1519800 10 monclient(hunting): picked mon.noname-c con 0x561dc30a0bf0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:25:14.395 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T17:25:13.693+0000 7f4fc1519800 10 monclient(hunting): picked mon.noname-a con 0x561dc30cb540 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:25:14.395 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T17:25:13.693+0000 7f4fc1519800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:14.395 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T17:25:13.693+0000 7f4fc1519800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:14.395 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T17:25:13.693+0000 7f4fc1519800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:14.395 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T17:25:13.693+0000 7f4fc1519800 10 monclient(hunting): _renew_subs 2024-09-12T17:25:14.395 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T17:25:13.693+0000 7f4fc1519800 10 monclient(hunting): authenticate will time out at 2325.043597s 2024-09-12T17:25:14.395 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T17:25:13.693+0000 7f4fbf804640 10 monclient(hunting): get_auth_request con 0x561dc30cb540 auth_method 0 2024-09-12T17:25:14.395 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T17:25:13.693+0000 7f4fbf804640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:14.396 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T17:25:13.693+0000 7f4fbf804640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:14.396 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T17:25:13.693+0000 7f4fbf804640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:14.396 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T17:25:13.693+0000 7f4fbe802640 10 monclient(hunting): get_auth_request con 0x561dc30a0bf0 auth_method 0 2024-09-12T17:25:14.396 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T17:25:13.693+0000 7f4fbe802640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:14.396 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T17:25:13.693+0000 7f4fbe802640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:14.396 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T17:25:13.693+0000 7f4fbe802640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:14.396 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T17:25:13.693+0000 7f4fbf003640 10 monclient(hunting): get_auth_request con 0x561dc30cfca0 auth_method 0 2024-09-12T17:25:14.396 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T17:25:13.693+0000 7f4fbf003640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:14.396 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T17:25:13.693+0000 7f4fbf003640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:14.396 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T17:25:13.693+0000 7f4fbf003640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:14.396 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T17:25:13.693+0000 7f4fbf804640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:14.396 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T17:25:13.693+0000 7f4fbf804640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:14.396 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T17:25:13.693+0000 7f4fbf804640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:14.396 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T17:25:13.693+0000 7f4fbe802640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:14.397 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T17:25:13.693+0000 7f4fbe802640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:14.397 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T17:25:13.693+0000 7f4fbe802640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:14.397 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T17:25:13.693+0000 7f4fbf003640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:14.397 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T17:25:13.693+0000 7f4fbf003640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:14.397 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T17:25:13.693+0000 7f4fbf003640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:14.397 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T17:25:13.693+0000 7f4fbf804640 10 monclient(hunting): handle_auth_done global_id 7137 payload 274 2024-09-12T17:25:14.397 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T17:25:13.693+0000 7f4fbf804640 10 monclient: _finish_hunting 0 2024-09-12T17:25:14.397 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T17:25:13.693+0000 7f4fbf804640 1 monclient: found mon.noname-a 2024-09-12T17:25:14.397 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T17:25:13.693+0000 7f4fbf804640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:25:14.397 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T17:25:13.694+0000 7f4ea27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:14.397 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T17:25:13.694+0000 7f4ea27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:25:14.397 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T17:25:13.694+0000 7f4ea27fc640 10 monclient: dump: 2024-09-12T17:25:14.397 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:14.398 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:14.398 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.398 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.398 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:14.398 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:14.398 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:14.398 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:14.398 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:14.398 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.398 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T17:25:13.694+0000 7f4ea27fc640 10 monclient: _finish_auth 0 2024-09-12T17:25:14.398 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T17:25:13.694+0000 7f4ea27fc640 10 monclient: _check_auth_tickets 2024-09-12T17:25:14.398 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T17:25:13.694+0000 7f4fc1519800 5 monclient: authenticate success, global_id 7137 2024-09-12T17:25:14.399 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T17:25:13.694+0000 7f4ea27fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:25:14.399 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T17:25:13.694+0000 7f4fc1519800 10 monclient: get_monmap_and_config success 2024-09-12T17:25:14.399 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T17:25:13.694+0000 7f4fc1519800 4 set_mon_vals no callback set 2024-09-12T17:25:14.399 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T17:25:13.694+0000 7f4ea27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:14.399 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T17:25:13.694+0000 7f4ea27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:25:14.399 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T17:25:13.694+0000 7f4ea27fc640 10 monclient: dump: 2024-09-12T17:25:14.399 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:14.399 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:14.399 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.399 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.399 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:14.399 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:14.399 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:14.399 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:14.400 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:14.400 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.400 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T17:25:13.694+0000 7f4fc1519800 10 monclient: shutdown 2024-09-12T17:25:14.400 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T17:25:13.695+0000 7f4fc1519800 10 monclient: build_initial_monmap 2024-09-12T17:25:14.400 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T17:25:13.695+0000 7f4fc1519800 1 build_initial for_mkfs: 0 2024-09-12T17:25:14.400 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T17:25:13.695+0000 7f4fc1519800 10 monclient: monmap: 2024-09-12T17:25:14.400 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:25:14.400 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:25:14.400 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:25:14.400 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:25:14.400 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:25:14.400 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:14.400 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:25:14.401 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:25:14.401 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:25:14.401 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.401 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding auth protocol: cephx 2024-09-12T17:25:14.401 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding auth protocol: cephx 2024-09-12T17:25:14.401 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding auth protocol: cephx 2024-09-12T17:25:14.401 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding con mode: secure 2024-09-12T17:25:14.401 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding con mode: crc 2024-09-12T17:25:14.401 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding con mode: secure 2024-09-12T17:25:14.401 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding con mode: crc 2024-09-12T17:25:14.401 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding con mode: secure 2024-09-12T17:25:14.401 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding con mode: crc 2024-09-12T17:25:14.402 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding con mode: crc 2024-09-12T17:25:14.402 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding con mode: secure 2024-09-12T17:25:14.402 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding con mode: crc 2024-09-12T17:25:14.402 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding con mode: secure 2024-09-12T17:25:14.402 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding con mode: crc 2024-09-12T17:25:14.402 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding con mode: secure 2024-09-12T17:25:14.402 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T17:25:13.695+0000 7f4fc1519800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:14.402 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T17:25:13.695+0000 7f4fc1519800 1 librados: starting msgr at 2024-09-12T17:25:14.402 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T17:25:13.695+0000 7f4fc1519800 1 librados: starting objecter 2024-09-12T17:25:14.402 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command objecter_requests cmddesc objecter_requests hook 0x561dc309fa30 EEXIST 2024-09-12T17:25:14.402 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T17:25:13.695+0000 7f4fc1519800 1 librados: setting wanted keys 2024-09-12T17:25:14.402 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T17:25:13.695+0000 7f4fc1519800 1 librados: calling monclient init 2024-09-12T17:25:14.402 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T17:25:13.695+0000 7f4fc1519800 10 monclient: init 2024-09-12T17:25:14.403 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding auth protocol: cephx 2024-09-12T17:25:14.403 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding auth protocol: cephx 2024-09-12T17:25:14.403 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding auth protocol: cephx 2024-09-12T17:25:14.403 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding con mode: secure 2024-09-12T17:25:14.403 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding con mode: crc 2024-09-12T17:25:14.403 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding con mode: secure 2024-09-12T17:25:14.403 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding con mode: crc 2024-09-12T17:25:14.403 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding con mode: secure 2024-09-12T17:25:14.403 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding con mode: crc 2024-09-12T17:25:14.403 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding con mode: crc 2024-09-12T17:25:14.403 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding con mode: secure 2024-09-12T17:25:14.403 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding con mode: crc 2024-09-12T17:25:14.403 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding con mode: secure 2024-09-12T17:25:14.404 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding con mode: crc 2024-09-12T17:25:14.404 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding con mode: secure 2024-09-12T17:25:14.404 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T17:25:13.695+0000 7f4fc1519800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:14.404 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T17:25:13.695+0000 7f4fc1519800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:14.404 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command rotate-key cmddesc rotate-key hook 0x561dc3090668 EEXIST 2024-09-12T17:25:14.404 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T17:25:13.695+0000 7f4fc1519800 10 monclient: _reopen_session rank -1 2024-09-12T17:25:14.404 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T17:25:13.695+0000 7f4fc1519800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:25:14.404 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T17:25:13.695+0000 7f4fc1519800 10 monclient(hunting): picked mon.noname-c con 0x561dc30a0bf0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:25:14.404 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T17:25:13.696+0000 7f4fc1519800 10 monclient(hunting): picked mon.noname-a con 0x561dc30cb540 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:25:14.404 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T17:25:13.696+0000 7f4fc1519800 10 monclient(hunting): picked mon.noname-b con 0x561dc30cfca0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:25:14.404 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T17:25:13.696+0000 7f4fc1519800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:14.404 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T17:25:13.696+0000 7f4fc1519800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:14.405 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T17:25:13.696+0000 7f4fc1519800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:14.405 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T17:25:13.696+0000 7f4fc1519800 10 monclient(hunting): _renew_subs 2024-09-12T17:25:14.405 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T17:25:13.696+0000 7f4fc1519800 10 monclient(hunting): authenticate will time out at 2325.046044s 2024-09-12T17:25:14.405 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T17:25:13.696+0000 7f4fbf003640 10 monclient(hunting): get_auth_request con 0x561dc30a0bf0 auth_method 0 2024-09-12T17:25:14.405 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T17:25:13.696+0000 7f4fbf003640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:14.405 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T17:25:13.696+0000 7f4fbf003640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:14.405 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T17:25:13.696+0000 7f4fbf003640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:14.405 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T17:25:13.696+0000 7f4fbe802640 10 monclient(hunting): get_auth_request con 0x561dc30cb540 auth_method 0 2024-09-12T17:25:14.405 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T17:25:13.696+0000 7f4fbe802640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:14.405 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T17:25:13.696+0000 7f4fbe802640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:14.405 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T17:25:13.696+0000 7f4fbe802640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:14.405 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T17:25:13.696+0000 7f4fbe802640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:14.406 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T17:25:13.696+0000 7f4fbe802640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:14.406 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T17:25:13.696+0000 7f4fbe802640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:14.406 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T17:25:13.696+0000 7f4fbf804640 10 monclient(hunting): get_auth_request con 0x561dc30cfca0 auth_method 0 2024-09-12T17:25:14.406 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T17:25:13.696+0000 7f4fbf804640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:14.406 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T17:25:13.696+0000 7f4fbf804640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:14.406 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T17:25:13.696+0000 7f4fbf804640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:14.406 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T17:25:13.696+0000 7f4fbf003640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:14.406 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T17:25:13.696+0000 7f4fbf003640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:14.406 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T17:25:13.696+0000 7f4fbf003640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:14.406 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T17:25:13.696+0000 7f4fbf804640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:14.406 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T17:25:13.696+0000 7f4fbf804640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:14.406 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T17:25:13.696+0000 7f4fbf804640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:14.406 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T17:25:13.696+0000 7f4fbe802640 10 monclient(hunting): handle_auth_done global_id 7140 payload 824 2024-09-12T17:25:14.407 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T17:25:13.696+0000 7f4fbe802640 10 monclient: _finish_hunting 0 2024-09-12T17:25:14.407 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T17:25:13.696+0000 7f4fbe802640 1 monclient: found mon.noname-a 2024-09-12T17:25:14.407 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T17:25:13.696+0000 7f4fbe802640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:25:14.407 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T17:25:13.696+0000 7f4ea0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:14.407 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T17:25:13.696+0000 7f4ea0ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:25:14.407 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T17:25:13.696+0000 7f4ea0ff9640 10 monclient: dump: 2024-09-12T17:25:14.407 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:14.407 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:14.407 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.407 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.407 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:14.407 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:14.407 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:14.408 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:14.408 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:14.408 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.408 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T17:25:13.696+0000 7f4ea0ff9640 10 monclient: _finish_auth 0 2024-09-12T17:25:14.408 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T17:25:13.696+0000 7f4ea0ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:25:14.408 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T17:25:13.696+0000 7f4ea0ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:25:14.408 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T17:25:13.696+0000 7f4ea0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:14.408 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T17:25:13.696+0000 7f4ea0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:25:14.408 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T17:25:13.696+0000 7f4ea0ff9640 10 monclient: dump: 2024-09-12T17:25:14.408 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:14.408 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:14.408 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.409 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.409 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:14.409 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:14.409 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:14.409 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:14.409 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:14.409 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.409 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T17:25:13.696+0000 7f4fc1519800 5 monclient: authenticate success, global_id 7140 2024-09-12T17:25:14.409 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T17:25:13.696+0000 7f4fc1519800 10 monclient: _renew_subs 2024-09-12T17:25:14.409 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T17:25:13.696+0000 7f4ea27fc640 4 set_mon_vals no callback set 2024-09-12T17:25:14.409 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T17:25:13.696+0000 7f4fc1519800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:25:14.409 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T17:25:13.696+0000 7f4fc1519800 10 monclient: _renew_subs 2024-09-12T17:25:14.409 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T17:25:13.696+0000 7f4fc1519800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:25:14.409 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T17:25:13.696+0000 7f4fc1519800 1 librados: init done 2024-09-12T17:25:14.410 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T17:25:13.696+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command cr dump hook 0x561dc30bdda8 2024-09-12T17:25:14.410 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T17:25:13.698+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.410 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T17:25:13.699+0000 7f4ea0ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:25:14.410 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T17:25:13.699+0000 7f4ea0ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:25:14.410 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T17:25:13.699+0000 7f4ea0ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:25:14.410 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T17:25:13.699+0000 7f4fbf003640 10 monclient: get_auth_request con 0x7f4e880764a0 auth_method 0 2024-09-12T17:25:14.410 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T17:25:13.699+0000 7f4fbf804640 10 monclient: get_auth_request con 0x561dc30e9fd0 auth_method 0 2024-09-12T17:25:14.410 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T17:25:13.900+0000 7f4fbf804640 10 monclient: get_auth_request con 0x561dc30e9fd0 auth_method 0 2024-09-12T17:25:14.410 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T17:25:13.900+0000 7f4fc1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.410 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T17:25:13.900+0000 7f4fc1519800 20 realm 2024-09-12T17:25:14.410 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T17:25:13.900+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.410 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T17:25:13.901+0000 7f4fc1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.410 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T17:25:13.901+0000 7f4fc1519800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:14.410 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T17:25:13.901+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.411 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T17:25:13.901+0000 7f4fc1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.411 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T17:25:13.901+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.411 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T17:25:13.901+0000 7f4fbf003640 10 monclient: get_auth_request con 0x561dc30ee170 auth_method 0 2024-09-12T17:25:14.411 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T17:25:13.902+0000 7f4fc1519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:14.411 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T17:25:13.902+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.411 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T17:25:13.902+0000 7f4fbe802640 10 monclient: get_auth_request con 0x561dc30f1a20 auth_method 0 2024-09-12T17:25:14.411 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T17:25:13.903+0000 7f4fc1519800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:14.411 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T17:25:13.903+0000 7f4fc1519800 20 searching for the correct realm 2024-09-12T17:25:14.411 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T17:25:13.903+0000 7f4fbf804640 10 monclient: get_auth_request con 0x561dc30f67a0 auth_method 0 2024-09-12T17:25:14.411 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T17:25:13.904+0000 7f4fbf003640 10 monclient: get_auth_request con 0x7f4fb8097010 auth_method 0 2024-09-12T17:25:14.411 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T17:25:13.905+0000 7f4fbe802640 10 monclient: get_auth_request con 0x7f4fb007e070 auth_method 0 2024-09-12T17:25:14.411 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T17:25:13.905+0000 7f4fbe802640 0 -- 172.21.15.67:0/2369398851 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f4fb007e070 msgr2=0x7f4fb0064970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:14.411 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T17:25:14.106+0000 7f4fbe802640 10 monclient: get_auth_request con 0x7f4fb007e070 auth_method 0 2024-09-12T17:25:14.411 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T17:25:14.108+0000 7f4fbf804640 10 monclient: get_auth_request con 0x7f4fb401b040 auth_method 0 2024-09-12T17:25:14.412 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T17:25:14.110+0000 7f4fbf003640 0 -- 172.21.15.67:0/2369398851 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f4fb40694a0 msgr2=0x7f4fb407ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:14.412 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T17:25:14.312+0000 7f4fbf003640 10 monclient: get_auth_request con 0x7f4fb40694a0 auth_method 0 2024-09-12T17:25:14.412 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T17:25:14.318+0000 7f4fc1519800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:14.412 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T17:25:14.318+0000 7f4fc1519800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:14.412 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T17:25:14.318+0000 7f4fc1519800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:14.412 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T17:25:14.318+0000 7f4fc1519800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:14.412 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T17:25:14.318+0000 7f4fc1519800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:14.412 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T17:25:14.318+0000 7f4fc1519800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:14.412 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T17:25:14.318+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.412 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T17:25:14.318+0000 7f4fc1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.412 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T17:25:14.318+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.412 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T17:25:14.319+0000 7f4fc1519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:14.412 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T17:25:14.319+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.413 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T17:25:14.319+0000 7f4fc1519800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:14.413 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T17:25:14.319+0000 7f4fc1519800 20 zone default found 2024-09-12T17:25:14.413 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T17:25:14.319+0000 7f4fc1519800 4 Realm: () 2024-09-12T17:25:14.413 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T17:25:14.319+0000 7f4fc1519800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:14.413 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T17:25:14.319+0000 7f4fc1519800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:14.413 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T17:25:14.319+0000 7f4fc1519800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:14.413 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T17:25:14.319+0000 7f4fc1519800 20 zonegroup default 2024-09-12T17:25:14.413 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T17:25:14.319+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.413 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T17:25:14.319+0000 7f4fc1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.413 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T17:25:14.319+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.413 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T17:25:14.320+0000 7f4fc1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.413 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T17:25:14.320+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.413 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T17:25:14.320+0000 7f4fc1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.414 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T17:25:14.320+0000 7f4fc1519800 20 started sync module instance, tier type = 2024-09-12T17:25:14.414 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T17:25:14.320+0000 7f4fc1519800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:14.414 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T17:25:14.331+0000 7f4fc1519800 20 add_watcher() i=0 2024-09-12T17:25:14.414 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T17:25:14.331+0000 7f4fc1519800 20 add_watcher() i=1 2024-09-12T17:25:14.414 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T17:25:14.331+0000 7f4fc1519800 20 add_watcher() i=2 2024-09-12T17:25:14.414 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T17:25:14.331+0000 7f4fc1519800 20 add_watcher() i=3 2024-09-12T17:25:14.414 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T17:25:14.331+0000 7f4fc1519800 20 add_watcher() i=4 2024-09-12T17:25:14.414 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T17:25:14.331+0000 7f4fc1519800 20 add_watcher() i=5 2024-09-12T17:25:14.414 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T17:25:14.331+0000 7f4fc1519800 20 add_watcher() i=6 2024-09-12T17:25:14.414 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T17:25:14.332+0000 7f4fc1519800 20 add_watcher() i=7 2024-09-12T17:25:14.414 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T17:25:14.332+0000 7f4fc1519800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:14.414 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding auth protocol: cephx 2024-09-12T17:25:14.414 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding auth protocol: cephx 2024-09-12T17:25:14.414 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding auth protocol: cephx 2024-09-12T17:25:14.415 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding con mode: secure 2024-09-12T17:25:14.415 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding con mode: crc 2024-09-12T17:25:14.415 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding con mode: secure 2024-09-12T17:25:14.415 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding con mode: crc 2024-09-12T17:25:14.415 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding con mode: secure 2024-09-12T17:25:14.415 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding con mode: crc 2024-09-12T17:25:14.415 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding con mode: crc 2024-09-12T17:25:14.415 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T17:25:14.333+0000 7f4e757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:14.415 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding con mode: secure 2024-09-12T17:25:14.415 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding con mode: crc 2024-09-12T17:25:14.415 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding con mode: secure 2024-09-12T17:25:14.415 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding con mode: crc 2024-09-12T17:25:14.415 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding con mode: secure 2024-09-12T17:25:14.415 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T17:25:14.334+0000 7f4fc1519800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:14.416 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T17:25:14.334+0000 7f4fc1519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:14.416 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T17:25:14.334+0000 7f4fc1519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:14.416 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T17:25:14.334+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command cache list hook 0x561dc30ddbf0 2024-09-12T17:25:14.416 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T17:25:14.334+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command cache inspect hook 0x561dc30ddbf0 2024-09-12T17:25:14.416 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T17:25:14.334+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command cache erase hook 0x561dc30ddbf0 2024-09-12T17:25:14.416 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T17:25:14.334+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command cache zap hook 0x561dc30ddbf0 2024-09-12T17:25:14.416 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T17:25:14.334+0000 7f4fc1519800 5 note: GC not initialized 2024-09-12T17:25:14.416 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T17:25:14.334+0000 7f4deffff640 20 reqs_thread_entry: start 2024-09-12T17:25:14.416 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T17:25:14.334+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command sync trace show hook 0x7f4fb004e970 2024-09-12T17:25:14.416 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T17:25:14.334+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command sync trace history hook 0x7f4fb004e970 2024-09-12T17:25:14.416 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T17:25:14.334+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command sync trace active hook 0x7f4fb004e970 2024-09-12T17:25:14.416 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T17:25:14.334+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command sync trace active_short hook 0x7f4fb004e970 2024-09-12T17:25:14.416 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T17:25:14.334+0000 7f4fc1519800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:14.416 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T17:25:14.334+0000 7f4fc1519800 20 Filter name: none 2024-09-12T17:25:14.417 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T17:25:14.334+0000 7f4dedffb640 20 reqs_thread_entry: start 2024-09-12T17:25:14.417 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T17:25:14.335+0000 7f4fc1519800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:25:14.417 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T17:25:14.335+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.417 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T17:25:14.335+0000 7f4fc1519800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:25:14.417 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T17:25:14.335+0000 7f4fc1519800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:25:14.417 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T17:25:14.335+0000 7f4fc1519800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:25:14.417 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T17:25:14.335+0000 7f4fc1519800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 : miss 2024-09-12T17:25:14.417 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T17:25:14.335+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.417 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T17:25:14.335+0000 7f4fc1519800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:25:14.417 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T17:25:14.335+0000 7f4fc1519800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 info.flags=0x17 2024-09-12T17:25:14.417 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T17:25:14.335+0000 7f4fc1519800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 to cache LRU end 2024-09-12T17:25:14.417 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T17:25:14.335+0000 7f4fc1519800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:25:14.417 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T17:25:14.335+0000 7f4fc1519800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:14.417 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T17:25:14.335+0000 7f4fc1519800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 2024-09-12T17:25:14.418 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T17:25:14.340+0000 7f4fc1519800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 info.flags=0x17 2024-09-12T17:25:14.418 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T17:25:14.340+0000 7f4fc1519800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 to cache LRU end 2024-09-12T17:25:14.418 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T17:25:14.340+0000 7f4fc1519800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:14.418 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T17:25:14.340+0000 7f4fc1519800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30, ofs0, ns] 2024-09-12T17:25:14.418 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T17:25:14.340+0000 7f4ea27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464338 cookie 94685826644928 notifier 7140 bl.length()=999 2024-09-12T17:25:14.418 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T17:25:14.340+0000 7f4ea27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 info.flags=0x17 2024-09-12T17:25:14.418 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T17:25:14.340+0000 7f4ea27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 to cache LRU end 2024-09-12T17:25:14.418 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T17:25:14.340+0000 7f4ea27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:14.418 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T17:25:14.342+0000 7f4fc1519800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): orig_sources= new_sources= 2024-09-12T17:25:14.418 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T17:25:14.342+0000 7f4fc1519800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): potential sources added=[] removed=[] 2024-09-12T17:25:14.418 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T17:25:14.342+0000 7f4fc1519800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): orig_dests= new_dests= 2024-09-12T17:25:14.418 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T17:25:14.342+0000 7f4fc1519800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): potential dests added=[] removed=[] 2024-09-12T17:25:14.418 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T17:25:14.345+0000 7f4fc1519800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.30.1.0 2024-09-12T17:25:14.419 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T17:25:14.345+0000 7f4fc1519800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.30.1.0 2024-09-12T17:25:14.419 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T17:25:14.345+0000 7f4fc1519800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.30.1.1 2024-09-12T17:25:14.419 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T17:25:14.345+0000 7f4fc1519800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.30.1.1 2024-09-12T17:25:14.419 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T17:25:14.345+0000 7f4fc1519800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.30.0 2024-09-12T17:25:14.419 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T17:25:14.348+0000 7f4fc1519800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:25:14.419 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T17:25:14.348+0000 7f4fc1519800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 2024-09-12T17:25:14.419 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T17:25:14.349+0000 7f4fc1519800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 info.flags=0x17 2024-09-12T17:25:14.419 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T17:25:14.349+0000 7f4fc1519800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 to cache LRU end 2024-09-12T17:25:14.419 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T17:25:14.349+0000 7f4fc1519800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:14.419 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T17:25:14.349+0000 7f4fc1519800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30, ofs0, ns] 2024-09-12T17:25:14.419 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T17:25:14.349+0000 7f4ea27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464339 cookie 94685826644928 notifier 7140 bl.length()=999 2024-09-12T17:25:14.419 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T17:25:14.349+0000 7f4ea27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 info.flags=0x17 2024-09-12T17:25:14.419 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T17:25:14.349+0000 7f4ea27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 to cache LRU end 2024-09-12T17:25:14.420 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T17:25:14.349+0000 7f4ea27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:14.420 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T17:25:14.351+0000 7f4fc1519800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): orig_sources= new_sources= 2024-09-12T17:25:14.420 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T17:25:14.351+0000 7f4fc1519800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): potential sources added=[] removed=[] 2024-09-12T17:25:14.420 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T17:25:14.351+0000 7f4fc1519800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): orig_dests= new_dests= 2024-09-12T17:25:14.420 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T17:25:14.351+0000 7f4fc1519800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): potential dests added=[] removed=[] 2024-09-12T17:25:14.420 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T17:25:14.352+0000 7f4fc1519800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4fc1519800 time 2024-09-12T17:25:14.352192+0000 2024-09-12T17:25:14.420 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:25:14.420 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.420 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:25:14.420 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4fc498c71a] 2024-09-12T17:25:14.420 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4fc498c8d8] 2024-09-12T17:25:14.420 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561dc1d6c841] 2024-09-12T17:25:14.420 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x561dc1d7b79e] 2024-09-12T17:25:14.421 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x561dc1d7c5d4] 2024-09-12T17:25:14.421 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:25:14.421 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4fc3629590] 2024-09-12T17:25:14.421 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:25:14.421 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:25:14.421 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.421 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T17:25:14.353+0000 7f4fc1519800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:25:14.421 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f4fc1519800 thread_name:radosgw-admin 2024-09-12T17:25:14.421 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.421 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:25:14.421 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4fc363e6f0] 2024-09-12T17:25:14.421 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4fc368b99c] 2024-09-12T17:25:14.421 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:25:14.422 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:25:14.422 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4fc498c774] 2024-09-12T17:25:14.422 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4fc498c8d8] 2024-09-12T17:25:14.422 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561dc1d6c841] 2024-09-12T17:25:14.422 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x561dc1d7b79e] 2024-09-12T17:25:14.422 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x561dc1d7c5d4] 2024-09-12T17:25:14.422 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:25:14.422 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4fc3629590] 2024-09-12T17:25:14.422 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:25:14.422 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:25:14.422 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:25:14.422 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.422 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T17:25:14.423 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T17:25:14.423 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T17:25:14.423 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T17:25:14.423 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T17:25:14.423 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T17:25:14.423 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T17:25:14.423 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T17:25:14.423 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T17:25:14.423 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T17:25:14.423 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T17:25:14.423 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T17:25:14.423 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T17:25:14.423 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T17:25:14.424 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T17:25:14.424 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T17:25:14.424 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T17:25:14.424 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T17:25:14.424 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T17:25:14.424 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T17:25:14.424 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T17:25:14.424 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T17:25:14.424 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T17:25:14.424 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T17:25:14.424 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:25:14.424 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T17:25:14.424 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T17:25:14.424 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T17:25:14.425 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T17:25:14.425 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T17:25:14.425 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T17:25:14.425 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T17:25:14.425 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T17:25:14.425 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T17:25:14.425 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T17:25:14.425 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T17:25:14.425 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T17:25:14.425 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T17:25:14.425 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T17:25:14.425 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T17:25:14.425 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T17:25:14.425 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T17:25:14.425 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T17:25:14.426 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T17:25:14.426 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T17:25:14.426 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T17:25:14.426 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:25:14.426 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T17:25:14.426 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:25:14.426 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T17:25:14.426 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T17:25:14.426 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T17:25:14.426 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T17:25:14.426 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T17:25:14.426 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T17:25:14.426 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T17:25:14.426 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T17:25:14.427 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T17:25:14.427 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T17:25:14.427 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T17:25:14.427 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T17:25:14.427 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T17:25:14.427 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T17:25:14.427 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T17:25:14.427 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T17:25:14.427 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T17:25:14.427 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T17:25:14.427 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:25:14.427 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T17:25:14.427 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:25:14.427 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T17:25:14.427 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T17:25:14.428 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T17:25:14.428 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T17:25:14.428 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T17:25:14.428 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T17:25:14.428 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:25:14.428 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T17:25:14.428 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T17:25:14.428 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:25:14.428 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T17:25:14.428 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T17:25:14.428 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T17:25:14.428 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T17:25:14.428 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T17:25:14.428 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T17:25:14.429 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T17:25:14.429 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T17:25:14.429 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T17:25:14.429 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T17:25:14.429 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T17:25:14.429 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T17:25:14.429 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T17:25:14.429 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:25:14.429 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4dedffb640 / http_manager 2024-09-12T17:25:14.429 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4deffff640 / http_manager 2024-09-12T17:25:14.429 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4e757e2640 / rgw_dt_lg_renew 2024-09-12T17:25:14.429 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4ea0ff9640 / ms_dispatch 2024-09-12T17:25:14.429 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4ea27fc640 / io_context_pool 2024-09-12T17:25:14.430 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4ea8e01640 / ms_dispatch 2024-09-12T17:25:14.430 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4eab606640 / ms_dispatch 2024-09-12T17:25:14.430 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4eace09640 / io_context_pool 2024-09-12T17:25:14.430 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4fbe802640 / msgr-worker-2 2024-09-12T17:25:14.430 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4fbf003640 / msgr-worker-1 2024-09-12T17:25:14.430 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4fbf804640 / msgr-worker-0 2024-09-12T17:25:14.430 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4fc0005640 / io_context_pool 2024-09-12T17:25:14.430 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4fc1519800 / radosgw-admin 2024-09-12T17:25:14.430 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T17:25:14.430 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T17:25:14.430 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/log/ceph/ceph-client.admin.115101.log 2024-09-12T17:25:14.430 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T17:25:14.431 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T17:25:14.431 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc3005590) adding con mode: secure 2024-09-12T17:25:14.431 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc3005590) adding con mode: crc 2024-09-12T17:25:14.431 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc3005590) adding con mode: secure 2024-09-12T17:25:14.431 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T17:25:13.480+0000 7f4fc1519800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:14.431 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T17:25:13.480+0000 7f4fc1519800 1 librados: starting msgr at 2024-09-12T17:25:14.431 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T17:25:13.480+0000 7f4fc1519800 1 librados: starting objecter 2024-09-12T17:25:14.431 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command objecter_requests hook 0x561dc3004b50 2024-09-12T17:25:14.431 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T17:25:13.480+0000 7f4fc1519800 1 librados: setting wanted keys 2024-09-12T17:25:14.431 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T17:25:13.480+0000 7f4fc1519800 1 librados: calling monclient init 2024-09-12T17:25:14.431 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T17:25:13.480+0000 7f4fc1519800 10 monclient: init 2024-09-12T17:25:14.431 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding auth protocol: cephx 2024-09-12T17:25:14.431 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding auth protocol: cephx 2024-09-12T17:25:14.432 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding auth protocol: cephx 2024-09-12T17:25:14.432 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding con mode: secure 2024-09-12T17:25:14.432 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding con mode: crc 2024-09-12T17:25:14.432 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding con mode: secure 2024-09-12T17:25:14.432 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding con mode: crc 2024-09-12T17:25:14.432 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding con mode: secure 2024-09-12T17:25:14.432 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding con mode: crc 2024-09-12T17:25:14.432 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding con mode: crc 2024-09-12T17:25:14.432 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding con mode: secure 2024-09-12T17:25:14.432 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding con mode: crc 2024-09-12T17:25:14.432 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding con mode: secure 2024-09-12T17:25:14.432 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding con mode: crc 2024-09-12T17:25:14.432 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T17:25:13.480+0000 7f4fc1519800 5 AuthRegistry(0x561dc2fffe10) adding con mode: secure 2024-09-12T17:25:14.433 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T17:25:13.481+0000 7f4fc1519800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:14.433 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T17:25:13.481+0000 7f4fc1519800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:14.433 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T17:25:13.481+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command rotate-key hook 0x561dc2ffff58 2024-09-12T17:25:14.433 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T17:25:13.481+0000 7f4fc1519800 10 monclient: _reopen_session rank -1 2024-09-12T17:25:14.433 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T17:25:13.481+0000 7f4fc1519800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:25:14.433 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T17:25:13.481+0000 7f4fc1519800 10 monclient(hunting): picked mon.noname-b con 0x561dc2f48a40 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:25:14.433 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T17:25:13.481+0000 7f4fc1519800 10 monclient(hunting): picked mon.noname-a con 0x561dc2f49380 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:25:14.433 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T17:25:13.481+0000 7f4fc1519800 10 monclient(hunting): picked mon.noname-c con 0x561dc30318b0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:25:14.433 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T17:25:13.481+0000 7f4fc1519800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:14.433 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T17:25:13.481+0000 7f4fc1519800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:14.433 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T17:25:13.481+0000 7f4fc1519800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:14.433 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T17:25:13.481+0000 7f4fc1519800 10 monclient(hunting): _renew_subs 2024-09-12T17:25:14.433 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T17:25:13.481+0000 7f4fc1519800 10 monclient(hunting): authenticate will time out at 2324.831377s 2024-09-12T17:25:14.434 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T17:25:13.481+0000 7f4fbf804640 10 monclient(hunting): get_auth_request con 0x561dc30318b0 auth_method 0 2024-09-12T17:25:14.434 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T17:25:13.481+0000 7f4fbf804640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:14.434 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T17:25:13.481+0000 7f4fbf804640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:14.434 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T17:25:13.481+0000 7f4fbf804640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:14.434 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T17:25:13.481+0000 7f4fbe802640 10 monclient(hunting): get_auth_request con 0x561dc2f49380 auth_method 0 2024-09-12T17:25:14.434 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T17:25:13.481+0000 7f4fbe802640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:14.434 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T17:25:13.481+0000 7f4fbe802640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:14.434 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T17:25:13.481+0000 7f4fbe802640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:14.434 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T17:25:13.481+0000 7f4fbf804640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:14.434 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T17:25:13.481+0000 7f4fbf804640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:14.434 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T17:25:13.481+0000 7f4fbf804640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:14.434 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T17:25:13.481+0000 7f4fbe802640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:14.434 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T17:25:13.481+0000 7f4fbe802640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:14.435 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T17:25:13.481+0000 7f4fbe802640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:14.435 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T17:25:13.481+0000 7f4fbf003640 10 monclient(hunting): get_auth_request con 0x561dc2f48a40 auth_method 0 2024-09-12T17:25:14.435 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T17:25:13.481+0000 7f4fbf003640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:14.435 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T17:25:13.481+0000 7f4fbf003640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:14.435 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T17:25:13.481+0000 7f4fbf003640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:14.435 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T17:25:13.481+0000 7f4fbf804640 10 monclient(hunting): handle_auth_done global_id 6698 payload 824 2024-09-12T17:25:14.435 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T17:25:13.481+0000 7f4fbf804640 10 monclient: _finish_hunting 0 2024-09-12T17:25:14.435 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T17:25:13.481+0000 7f4fbf804640 1 monclient: found mon.noname-c 2024-09-12T17:25:14.435 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T17:25:13.481+0000 7f4fbf804640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:25:14.435 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T17:25:13.482+0000 7f4eab606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:14.435 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T17:25:13.482+0000 7f4eab606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:25:14.435 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T17:25:13.482+0000 7f4eab606640 10 monclient: dump: 2024-09-12T17:25:14.435 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:14.436 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:14.436 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.436 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.436 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:14.436 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:14.436 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:14.436 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:14.436 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:14.436 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.436 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T17:25:13.482+0000 7f4eab606640 10 monclient: _finish_auth 0 2024-09-12T17:25:14.436 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T17:25:13.482+0000 7f4eab606640 10 monclient: _check_auth_tickets 2024-09-12T17:25:14.436 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T17:25:13.482+0000 7f4fc1519800 5 monclient: authenticate success, global_id 6698 2024-09-12T17:25:14.436 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T17:25:13.482+0000 7f4fc1519800 10 monclient: _renew_subs 2024-09-12T17:25:14.437 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T17:25:13.482+0000 7f4fc1519800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:25:14.437 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T17:25:13.482+0000 7f4eab606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:25:14.437 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T17:25:13.482+0000 7f4eab606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:14.437 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T17:25:13.482+0000 7f4eab606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:25:14.437 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T17:25:13.482+0000 7f4eab606640 10 monclient: dump: 2024-09-12T17:25:14.437 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:14.437 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:14.437 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.437 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.437 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:14.437 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:14.437 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:14.437 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:14.438 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:14.438 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.438 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T17:25:13.482+0000 7f4eace09640 4 set_mon_vals no callback set 2024-09-12T17:25:14.438 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T17:25:13.482+0000 7f4fc1519800 10 monclient: _renew_subs 2024-09-12T17:25:14.438 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T17:25:13.482+0000 7f4fc1519800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:25:14.438 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T17:25:13.482+0000 7f4fc1519800 1 librados: init done 2024-09-12T17:25:14.438 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T17:25:13.484+0000 7f4eab606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:25:14.438 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T17:25:13.484+0000 7f4eab606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:25:14.438 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T17:25:13.484+0000 7f4eab606640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:25:14.438 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T17:25:13.484+0000 7f4fbf003640 10 monclient: get_auth_request con 0x7f4ea4076470 auth_method 0 2024-09-12T17:25:14.438 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T17:25:13.685+0000 7f4fbe802640 10 monclient: get_auth_request con 0x561dc30289f0 auth_method 0 2024-09-12T17:25:14.438 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T17:25:13.686+0000 7f4fbf003640 10 monclient: get_auth_request con 0x561dc304b440 auth_method 0 2024-09-12T17:25:14.439 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T17:25:13.686+0000 7f4fbe802640 10 monclient: get_auth_request con 0x561dc304f7a0 auth_method 0 2024-09-12T17:25:14.439 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T17:25:13.688+0000 7f4fc1519800 10 monclient: build_initial_monmap 2024-09-12T17:25:14.439 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T17:25:13.688+0000 7f4fc1519800 1 build_initial for_mkfs: 0 2024-09-12T17:25:14.439 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T17:25:13.688+0000 7f4fc1519800 10 monclient: monmap: 2024-09-12T17:25:14.439 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:25:14.439 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:25:14.439 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:25:14.439 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:25:14.439 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:25:14.439 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:14.439 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:25:14.440 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:25:14.440 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:25:14.440 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.440 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding auth protocol: cephx 2024-09-12T17:25:14.440 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding auth protocol: cephx 2024-09-12T17:25:14.440 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding auth protocol: cephx 2024-09-12T17:25:14.440 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding con mode: secure 2024-09-12T17:25:14.440 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding con mode: crc 2024-09-12T17:25:14.440 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding con mode: secure 2024-09-12T17:25:14.440 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding con mode: crc 2024-09-12T17:25:14.440 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding con mode: secure 2024-09-12T17:25:14.440 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding con mode: crc 2024-09-12T17:25:14.440 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding con mode: crc 2024-09-12T17:25:14.441 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding con mode: secure 2024-09-12T17:25:14.441 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding con mode: crc 2024-09-12T17:25:14.441 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding con mode: secure 2024-09-12T17:25:14.441 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding con mode: crc 2024-09-12T17:25:14.441 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3054450) adding con mode: secure 2024-09-12T17:25:14.441 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T17:25:13.688+0000 7f4fc1519800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:14.441 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command objecter_requests cmddesc objecter_requests hook 0x561dc3057940 EEXIST 2024-09-12T17:25:14.441 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T17:25:13.688+0000 7f4fc1519800 10 monclient: init 2024-09-12T17:25:14.441 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding auth protocol: cephx 2024-09-12T17:25:14.441 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding auth protocol: cephx 2024-09-12T17:25:14.441 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding auth protocol: cephx 2024-09-12T17:25:14.441 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding con mode: secure 2024-09-12T17:25:14.441 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding con mode: crc 2024-09-12T17:25:14.442 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding con mode: secure 2024-09-12T17:25:14.442 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding con mode: crc 2024-09-12T17:25:14.442 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding con mode: secure 2024-09-12T17:25:14.442 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding con mode: crc 2024-09-12T17:25:14.442 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding con mode: crc 2024-09-12T17:25:14.442 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding con mode: secure 2024-09-12T17:25:14.442 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding con mode: crc 2024-09-12T17:25:14.442 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding con mode: secure 2024-09-12T17:25:14.442 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding con mode: crc 2024-09-12T17:25:14.442 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T17:25:13.688+0000 7f4fc1519800 5 AuthRegistry(0x561dc3052b28) adding con mode: secure 2024-09-12T17:25:14.442 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T17:25:13.689+0000 7f4fc1519800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:14.442 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T17:25:13.689+0000 7f4fc1519800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:14.442 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T17:25:13.689+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command rotate-key cmddesc rotate-key hook 0x561dc3052c70 EEXIST 2024-09-12T17:25:14.443 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T17:25:13.689+0000 7f4fc1519800 10 monclient: _reopen_session rank -1 2024-09-12T17:25:14.443 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T17:25:13.689+0000 7f4fc1519800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:25:14.443 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T17:25:13.689+0000 7f4fc1519800 10 monclient(hunting): picked mon.noname-a con 0x561dc307bc60 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:25:14.443 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T17:25:13.689+0000 7f4fc1519800 10 monclient(hunting): picked mon.noname-b con 0x561dc307c040 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:25:14.443 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T17:25:13.689+0000 7f4fc1519800 10 monclient(hunting): picked mon.noname-c con 0x561dc307a970 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:25:14.443 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T17:25:13.689+0000 7f4fc1519800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:14.443 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T17:25:13.689+0000 7f4fc1519800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:14.443 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T17:25:13.689+0000 7f4fc1519800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:14.443 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T17:25:13.689+0000 7f4fc1519800 10 monclient(hunting): _renew_subs 2024-09-12T17:25:14.443 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T17:25:13.689+0000 7f4fc1519800 10 monclient(hunting): authenticate will time out at 2325.039525s 2024-09-12T17:25:14.443 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T17:25:13.689+0000 7f4fbf003640 10 monclient(hunting): get_auth_request con 0x561dc307bc60 auth_method 0 2024-09-12T17:25:14.443 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T17:25:13.689+0000 7f4fbf003640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:14.443 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T17:25:13.689+0000 7f4fbf003640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:14.444 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T17:25:13.689+0000 7f4fbf003640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:14.444 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T17:25:13.689+0000 7f4fbf804640 10 monclient(hunting): get_auth_request con 0x561dc307a970 auth_method 0 2024-09-12T17:25:14.444 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T17:25:13.689+0000 7f4fbf804640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:14.444 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T17:25:13.689+0000 7f4fbf804640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:14.444 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T17:25:13.689+0000 7f4fbf804640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:14.444 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T17:25:13.689+0000 7f4fbe802640 10 monclient(hunting): get_auth_request con 0x561dc307c040 auth_method 0 2024-09-12T17:25:14.444 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T17:25:13.689+0000 7f4fbe802640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:14.444 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T17:25:13.689+0000 7f4fbe802640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:14.444 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T17:25:13.689+0000 7f4fbe802640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:14.444 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T17:25:13.689+0000 7f4fbf804640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:14.444 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T17:25:13.689+0000 7f4fbf804640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:14.444 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T17:25:13.689+0000 7f4fbf804640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:14.445 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T17:25:13.689+0000 7f4fbf003640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:14.445 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T17:25:13.689+0000 7f4fbf003640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:14.445 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T17:25:13.689+0000 7f4fbf003640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:14.445 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T17:25:13.689+0000 7f4fbe802640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:14.445 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T17:25:13.689+0000 7f4fbe802640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:14.445 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T17:25:13.689+0000 7f4fbe802640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:14.445 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T17:25:13.689+0000 7f4fbf804640 10 monclient(hunting): handle_auth_done global_id 6701 payload 824 2024-09-12T17:25:14.445 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T17:25:13.690+0000 7f4fbf804640 10 monclient: _finish_hunting 0 2024-09-12T17:25:14.445 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T17:25:13.690+0000 7f4fbf804640 1 monclient: found mon.noname-c 2024-09-12T17:25:14.445 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T17:25:13.690+0000 7f4fbf804640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:25:14.445 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T17:25:13.690+0000 7f4ea8e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:14.445 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T17:25:13.690+0000 7f4ea8e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:25:14.445 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T17:25:13.690+0000 7f4ea8e01640 10 monclient: dump: 2024-09-12T17:25:14.446 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:14.446 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:14.446 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.446 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.446 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:14.446 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:14.446 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:14.446 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:14.446 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:14.446 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.446 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T17:25:13.690+0000 7f4ea8e01640 10 monclient: _finish_auth 0 2024-09-12T17:25:14.446 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T17:25:13.690+0000 7f4ea8e01640 10 monclient: _check_auth_tickets 2024-09-12T17:25:14.446 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T17:25:13.690+0000 7f4ea8e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:25:14.446 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T17:25:13.690+0000 7f4ea8e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:14.447 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T17:25:13.690+0000 7f4ea8e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:25:14.447 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T17:25:13.690+0000 7f4ea8e01640 10 monclient: dump: 2024-09-12T17:25:14.447 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:14.447 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:14.447 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.447 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.447 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:14.447 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:14.447 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:14.447 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:14.447 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:14.447 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.447 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T17:25:13.690+0000 7f4fc1519800 5 monclient: authenticate success, global_id 6701 2024-09-12T17:25:14.447 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T17:25:13.690+0000 7f4fc1519800 10 monclient: _renew_subs 2024-09-12T17:25:14.448 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T17:25:13.690+0000 7f4fc1519800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:25:14.448 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T17:25:13.690+0000 7f4fc0005640 4 set_mon_vals no callback set 2024-09-12T17:25:14.448 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T17:25:13.690+0000 7f4fc1519800 10 monclient: _renew_subs 2024-09-12T17:25:14.448 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T17:25:13.690+0000 7f4fc1519800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:25:14.448 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T17:25:13.692+0000 7f4ea8e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:25:14.448 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T17:25:13.692+0000 7f4ea8e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:25:14.448 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T17:25:13.692+0000 7f4ea8e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:25:14.448 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T17:25:13.692+0000 7f4fbf003640 10 monclient: get_auth_request con 0x7f4e98076380 auth_method 0 2024-09-12T17:25:14.448 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T17:25:13.692+0000 7f4fc1519800 10 monclient: get_monmap_and_config 2024-09-12T17:25:14.448 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T17:25:13.692+0000 7f4fc1519800 10 monclient: build_initial_monmap 2024-09-12T17:25:14.448 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T17:25:13.692+0000 7f4fc1519800 1 build_initial for_mkfs: 0 2024-09-12T17:25:14.448 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T17:25:13.692+0000 7f4fc1519800 10 monclient: monmap: 2024-09-12T17:25:14.448 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:25:14.449 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:25:14.449 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:25:14.449 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:25:14.449 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:25:14.449 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:14.449 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:25:14.449 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:25:14.449 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:25:14.449 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.449 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding auth protocol: cephx 2024-09-12T17:25:14.449 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding auth protocol: cephx 2024-09-12T17:25:14.449 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding auth protocol: cephx 2024-09-12T17:25:14.450 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding con mode: secure 2024-09-12T17:25:14.450 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding con mode: crc 2024-09-12T17:25:14.450 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding con mode: secure 2024-09-12T17:25:14.450 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding con mode: crc 2024-09-12T17:25:14.450 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding con mode: secure 2024-09-12T17:25:14.450 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding con mode: crc 2024-09-12T17:25:14.450 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding con mode: crc 2024-09-12T17:25:14.450 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding con mode: secure 2024-09-12T17:25:14.450 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding con mode: crc 2024-09-12T17:25:14.450 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding con mode: secure 2024-09-12T17:25:14.450 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding con mode: crc 2024-09-12T17:25:14.450 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T17:25:13.692+0000 7f4fc1519800 5 AuthRegistry(0x561dc309b620) adding con mode: secure 2024-09-12T17:25:14.450 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T17:25:13.692+0000 7f4fc1519800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:14.450 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T17:25:13.693+0000 7f4fc1519800 10 monclient: init 2024-09-12T17:25:14.451 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding auth protocol: cephx 2024-09-12T17:25:14.451 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding auth protocol: cephx 2024-09-12T17:25:14.451 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding auth protocol: cephx 2024-09-12T17:25:14.451 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding con mode: secure 2024-09-12T17:25:14.451 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding con mode: crc 2024-09-12T17:25:14.451 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding con mode: secure 2024-09-12T17:25:14.451 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding con mode: crc 2024-09-12T17:25:14.451 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding con mode: secure 2024-09-12T17:25:14.451 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding con mode: crc 2024-09-12T17:25:14.451 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding con mode: crc 2024-09-12T17:25:14.451 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding con mode: secure 2024-09-12T17:25:14.451 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding con mode: crc 2024-09-12T17:25:14.452 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding con mode: secure 2024-09-12T17:25:14.452 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding con mode: crc 2024-09-12T17:25:14.452 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec470) adding con mode: secure 2024-09-12T17:25:14.452 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T17:25:13.693+0000 7f4fc1519800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:14.452 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T17:25:13.693+0000 7f4fc1519800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:14.452 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T17:25:13.693+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command rotate-key cmddesc rotate-key hook 0x7ffeaf5ec5b8 EEXIST 2024-09-12T17:25:14.452 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T17:25:13.693+0000 7f4fc1519800 10 monclient: _reopen_session rank -1 2024-09-12T17:25:14.452 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T17:25:13.693+0000 7f4fc1519800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:25:14.452 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T17:25:13.693+0000 7f4fc1519800 10 monclient(hunting): picked mon.noname-b con 0x561dc30cfca0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:25:14.452 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T17:25:13.693+0000 7f4fc1519800 10 monclient(hunting): picked mon.noname-c con 0x561dc30a0bf0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:25:14.452 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T17:25:13.693+0000 7f4fc1519800 10 monclient(hunting): picked mon.noname-a con 0x561dc30cb540 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:25:14.452 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T17:25:13.693+0000 7f4fc1519800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:14.453 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T17:25:13.693+0000 7f4fc1519800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:14.453 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T17:25:13.693+0000 7f4fc1519800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:14.453 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T17:25:13.693+0000 7f4fc1519800 10 monclient(hunting): _renew_subs 2024-09-12T17:25:14.453 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T17:25:13.693+0000 7f4fc1519800 10 monclient(hunting): authenticate will time out at 2325.043597s 2024-09-12T17:25:14.453 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T17:25:13.693+0000 7f4fbf804640 10 monclient(hunting): get_auth_request con 0x561dc30cb540 auth_method 0 2024-09-12T17:25:14.453 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T17:25:13.693+0000 7f4fbf804640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:14.453 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T17:25:13.693+0000 7f4fbf804640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:14.453 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T17:25:13.693+0000 7f4fbf804640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:14.453 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T17:25:13.693+0000 7f4fbe802640 10 monclient(hunting): get_auth_request con 0x561dc30a0bf0 auth_method 0 2024-09-12T17:25:14.453 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T17:25:13.693+0000 7f4fbe802640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:14.453 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T17:25:13.693+0000 7f4fbe802640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:14.453 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T17:25:13.693+0000 7f4fbe802640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:14.453 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T17:25:13.693+0000 7f4fbf003640 10 monclient(hunting): get_auth_request con 0x561dc30cfca0 auth_method 0 2024-09-12T17:25:14.454 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T17:25:13.693+0000 7f4fbf003640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:14.454 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T17:25:13.693+0000 7f4fbf003640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:14.454 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T17:25:13.693+0000 7f4fbf003640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:14.454 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T17:25:13.693+0000 7f4fbf804640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:14.454 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T17:25:13.693+0000 7f4fbf804640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:14.454 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T17:25:13.693+0000 7f4fbf804640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:14.454 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T17:25:13.693+0000 7f4fbe802640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:14.454 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T17:25:13.693+0000 7f4fbe802640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:14.454 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T17:25:13.693+0000 7f4fbe802640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:14.454 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T17:25:13.693+0000 7f4fbf003640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:14.454 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T17:25:13.693+0000 7f4fbf003640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:14.454 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T17:25:13.693+0000 7f4fbf003640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:14.455 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T17:25:13.693+0000 7f4fbf804640 10 monclient(hunting): handle_auth_done global_id 7137 payload 274 2024-09-12T17:25:14.455 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T17:25:13.693+0000 7f4fbf804640 10 monclient: _finish_hunting 0 2024-09-12T17:25:14.455 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T17:25:13.693+0000 7f4fbf804640 1 monclient: found mon.noname-a 2024-09-12T17:25:14.455 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T17:25:13.693+0000 7f4fbf804640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:25:14.455 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T17:25:13.694+0000 7f4ea27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:14.455 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T17:25:13.694+0000 7f4ea27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:25:14.455 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T17:25:13.694+0000 7f4ea27fc640 10 monclient: dump: 2024-09-12T17:25:14.455 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:14.455 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:14.455 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.455 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.455 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:14.455 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:14.455 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:14.456 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:14.456 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:14.456 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.456 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T17:25:13.694+0000 7f4ea27fc640 10 monclient: _finish_auth 0 2024-09-12T17:25:14.456 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T17:25:13.694+0000 7f4ea27fc640 10 monclient: _check_auth_tickets 2024-09-12T17:25:14.456 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T17:25:13.694+0000 7f4fc1519800 5 monclient: authenticate success, global_id 7137 2024-09-12T17:25:14.456 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T17:25:13.694+0000 7f4ea27fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:25:14.456 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T17:25:13.694+0000 7f4fc1519800 10 monclient: get_monmap_and_config success 2024-09-12T17:25:14.456 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T17:25:13.694+0000 7f4fc1519800 4 set_mon_vals no callback set 2024-09-12T17:25:14.456 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T17:25:13.694+0000 7f4ea27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:14.456 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T17:25:13.694+0000 7f4ea27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:25:14.456 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T17:25:13.694+0000 7f4ea27fc640 10 monclient: dump: 2024-09-12T17:25:14.457 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:14.457 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:14.457 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.457 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.457 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:14.457 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:14.457 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:14.457 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:14.457 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:14.457 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.457 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T17:25:13.694+0000 7f4fc1519800 10 monclient: shutdown 2024-09-12T17:25:14.457 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T17:25:13.695+0000 7f4fc1519800 10 monclient: build_initial_monmap 2024-09-12T17:25:14.457 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T17:25:13.695+0000 7f4fc1519800 1 build_initial for_mkfs: 0 2024-09-12T17:25:14.457 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T17:25:13.695+0000 7f4fc1519800 10 monclient: monmap: 2024-09-12T17:25:14.458 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:25:14.458 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:25:14.458 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:25:14.458 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:25:14.458 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:25:14.458 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:14.458 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:25:14.458 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:25:14.458 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:25:14.458 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.458 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding auth protocol: cephx 2024-09-12T17:25:14.458 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding auth protocol: cephx 2024-09-12T17:25:14.458 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding auth protocol: cephx 2024-09-12T17:25:14.458 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding con mode: secure 2024-09-12T17:25:14.459 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding con mode: crc 2024-09-12T17:25:14.459 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding con mode: secure 2024-09-12T17:25:14.459 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding con mode: crc 2024-09-12T17:25:14.459 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding con mode: secure 2024-09-12T17:25:14.459 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding con mode: crc 2024-09-12T17:25:14.459 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding con mode: crc 2024-09-12T17:25:14.459 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding con mode: secure 2024-09-12T17:25:14.459 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding con mode: crc 2024-09-12T17:25:14.459 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding con mode: secure 2024-09-12T17:25:14.459 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding con mode: crc 2024-09-12T17:25:14.459 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc30cbe70) adding con mode: secure 2024-09-12T17:25:14.459 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T17:25:13.695+0000 7f4fc1519800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:14.459 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T17:25:13.695+0000 7f4fc1519800 1 librados: starting msgr at 2024-09-12T17:25:14.459 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T17:25:13.695+0000 7f4fc1519800 1 librados: starting objecter 2024-09-12T17:25:14.460 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command objecter_requests cmddesc objecter_requests hook 0x561dc309fa30 EEXIST 2024-09-12T17:25:14.460 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T17:25:13.695+0000 7f4fc1519800 1 librados: setting wanted keys 2024-09-12T17:25:14.460 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T17:25:13.695+0000 7f4fc1519800 1 librados: calling monclient init 2024-09-12T17:25:14.460 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T17:25:13.695+0000 7f4fc1519800 10 monclient: init 2024-09-12T17:25:14.460 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding auth protocol: cephx 2024-09-12T17:25:14.460 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding auth protocol: cephx 2024-09-12T17:25:14.460 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding auth protocol: cephx 2024-09-12T17:25:14.460 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding con mode: secure 2024-09-12T17:25:14.460 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding con mode: crc 2024-09-12T17:25:14.460 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding con mode: secure 2024-09-12T17:25:14.460 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding con mode: crc 2024-09-12T17:25:14.460 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding con mode: secure 2024-09-12T17:25:14.460 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding con mode: crc 2024-09-12T17:25:14.460 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding con mode: crc 2024-09-12T17:25:14.461 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding con mode: secure 2024-09-12T17:25:14.461 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding con mode: crc 2024-09-12T17:25:14.461 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding con mode: secure 2024-09-12T17:25:14.461 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding con mode: crc 2024-09-12T17:25:14.461 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 AuthRegistry(0x561dc3090520) adding con mode: secure 2024-09-12T17:25:14.461 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T17:25:13.695+0000 7f4fc1519800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:14.461 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T17:25:13.695+0000 7f4fc1519800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:14.461 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T17:25:13.695+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command rotate-key cmddesc rotate-key hook 0x561dc3090668 EEXIST 2024-09-12T17:25:14.461 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T17:25:13.695+0000 7f4fc1519800 10 monclient: _reopen_session rank -1 2024-09-12T17:25:14.461 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T17:25:13.695+0000 7f4fc1519800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:25:14.461 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T17:25:13.695+0000 7f4fc1519800 10 monclient(hunting): picked mon.noname-c con 0x561dc30a0bf0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:25:14.461 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T17:25:13.696+0000 7f4fc1519800 10 monclient(hunting): picked mon.noname-a con 0x561dc30cb540 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:25:14.461 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T17:25:13.696+0000 7f4fc1519800 10 monclient(hunting): picked mon.noname-b con 0x561dc30cfca0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:25:14.462 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T17:25:13.696+0000 7f4fc1519800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:14.462 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T17:25:13.696+0000 7f4fc1519800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:14.462 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T17:25:13.696+0000 7f4fc1519800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:14.462 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T17:25:13.696+0000 7f4fc1519800 10 monclient(hunting): _renew_subs 2024-09-12T17:25:14.462 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T17:25:13.696+0000 7f4fc1519800 10 monclient(hunting): authenticate will time out at 2325.046044s 2024-09-12T17:25:14.462 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T17:25:13.696+0000 7f4fbf003640 10 monclient(hunting): get_auth_request con 0x561dc30a0bf0 auth_method 0 2024-09-12T17:25:14.462 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T17:25:13.696+0000 7f4fbf003640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:14.462 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T17:25:13.696+0000 7f4fbf003640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:14.462 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T17:25:13.696+0000 7f4fbf003640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:14.462 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T17:25:13.696+0000 7f4fbe802640 10 monclient(hunting): get_auth_request con 0x561dc30cb540 auth_method 0 2024-09-12T17:25:14.462 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T17:25:13.696+0000 7f4fbe802640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:14.462 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T17:25:13.696+0000 7f4fbe802640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:14.462 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T17:25:13.696+0000 7f4fbe802640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:14.463 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T17:25:13.696+0000 7f4fbe802640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:14.463 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T17:25:13.696+0000 7f4fbe802640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:14.463 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T17:25:13.696+0000 7f4fbe802640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:14.463 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T17:25:13.696+0000 7f4fbf804640 10 monclient(hunting): get_auth_request con 0x561dc30cfca0 auth_method 0 2024-09-12T17:25:14.463 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T17:25:13.696+0000 7f4fbf804640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:14.463 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T17:25:13.696+0000 7f4fbf804640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:14.463 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T17:25:13.696+0000 7f4fbf804640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:14.463 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T17:25:13.696+0000 7f4fbf003640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:14.463 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T17:25:13.696+0000 7f4fbf003640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:14.463 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T17:25:13.696+0000 7f4fbf003640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:14.463 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T17:25:13.696+0000 7f4fbf804640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:14.463 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T17:25:13.696+0000 7f4fbf804640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:14.463 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T17:25:13.696+0000 7f4fbf804640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:14.464 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T17:25:13.696+0000 7f4fbe802640 10 monclient(hunting): handle_auth_done global_id 7140 payload 824 2024-09-12T17:25:14.464 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T17:25:13.696+0000 7f4fbe802640 10 monclient: _finish_hunting 0 2024-09-12T17:25:14.464 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T17:25:13.696+0000 7f4fbe802640 1 monclient: found mon.noname-a 2024-09-12T17:25:14.464 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T17:25:13.696+0000 7f4fbe802640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:25:14.464 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T17:25:13.696+0000 7f4ea0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:14.464 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T17:25:13.696+0000 7f4ea0ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:25:14.464 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T17:25:13.696+0000 7f4ea0ff9640 10 monclient: dump: 2024-09-12T17:25:14.464 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:14.464 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:14.464 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.464 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.464 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:14.464 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:14.464 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:14.464 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:14.465 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:14.465 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.465 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T17:25:13.696+0000 7f4ea0ff9640 10 monclient: _finish_auth 0 2024-09-12T17:25:14.465 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T17:25:13.696+0000 7f4ea0ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:25:14.465 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T17:25:13.696+0000 7f4ea0ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:25:14.465 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T17:25:13.696+0000 7f4ea0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:14.465 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T17:25:13.696+0000 7f4ea0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:25:14.465 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T17:25:13.696+0000 7f4ea0ff9640 10 monclient: dump: 2024-09-12T17:25:14.465 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:14.465 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:14.465 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.465 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:14.465 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:14.465 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:14.466 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:14.466 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:14.466 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:14.466 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.466 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T17:25:13.696+0000 7f4fc1519800 5 monclient: authenticate success, global_id 7140 2024-09-12T17:25:14.466 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T17:25:13.696+0000 7f4fc1519800 10 monclient: _renew_subs 2024-09-12T17:25:14.466 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T17:25:13.696+0000 7f4ea27fc640 4 set_mon_vals no callback set 2024-09-12T17:25:14.466 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T17:25:13.696+0000 7f4fc1519800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:25:14.466 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T17:25:13.696+0000 7f4fc1519800 10 monclient: _renew_subs 2024-09-12T17:25:14.466 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T17:25:13.696+0000 7f4fc1519800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:25:14.466 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T17:25:13.696+0000 7f4fc1519800 1 librados: init done 2024-09-12T17:25:14.467 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T17:25:13.696+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command cr dump hook 0x561dc30bdda8 2024-09-12T17:25:14.467 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T17:25:13.698+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.467 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T17:25:13.699+0000 7f4ea0ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:25:14.467 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T17:25:13.699+0000 7f4ea0ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:25:14.467 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T17:25:13.699+0000 7f4ea0ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:25:14.467 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T17:25:13.699+0000 7f4fbf003640 10 monclient: get_auth_request con 0x7f4e880764a0 auth_method 0 2024-09-12T17:25:14.467 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T17:25:13.699+0000 7f4fbf804640 10 monclient: get_auth_request con 0x561dc30e9fd0 auth_method 0 2024-09-12T17:25:14.467 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T17:25:13.900+0000 7f4fbf804640 10 monclient: get_auth_request con 0x561dc30e9fd0 auth_method 0 2024-09-12T17:25:14.467 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T17:25:13.900+0000 7f4fc1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.467 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T17:25:13.900+0000 7f4fc1519800 20 realm 2024-09-12T17:25:14.467 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T17:25:13.900+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.467 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T17:25:13.901+0000 7f4fc1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.467 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T17:25:13.901+0000 7f4fc1519800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:14.467 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T17:25:13.901+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.467 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T17:25:13.901+0000 7f4fc1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.468 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T17:25:13.901+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.468 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T17:25:13.901+0000 7f4fbf003640 10 monclient: get_auth_request con 0x561dc30ee170 auth_method 0 2024-09-12T17:25:14.468 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T17:25:13.902+0000 7f4fc1519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:14.468 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T17:25:13.902+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.468 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T17:25:13.902+0000 7f4fbe802640 10 monclient: get_auth_request con 0x561dc30f1a20 auth_method 0 2024-09-12T17:25:14.468 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T17:25:13.903+0000 7f4fc1519800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:14.468 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T17:25:13.903+0000 7f4fc1519800 20 searching for the correct realm 2024-09-12T17:25:14.468 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T17:25:13.903+0000 7f4fbf804640 10 monclient: get_auth_request con 0x561dc30f67a0 auth_method 0 2024-09-12T17:25:14.468 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T17:25:13.904+0000 7f4fbf003640 10 monclient: get_auth_request con 0x7f4fb8097010 auth_method 0 2024-09-12T17:25:14.468 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T17:25:13.905+0000 7f4fbe802640 10 monclient: get_auth_request con 0x7f4fb007e070 auth_method 0 2024-09-12T17:25:14.468 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T17:25:13.905+0000 7f4fbe802640 0 -- 172.21.15.67:0/2369398851 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f4fb007e070 msgr2=0x7f4fb0064970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:14.468 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T17:25:14.106+0000 7f4fbe802640 10 monclient: get_auth_request con 0x7f4fb007e070 auth_method 0 2024-09-12T17:25:14.468 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T17:25:14.108+0000 7f4fbf804640 10 monclient: get_auth_request con 0x7f4fb401b040 auth_method 0 2024-09-12T17:25:14.468 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T17:25:14.110+0000 7f4fbf003640 0 -- 172.21.15.67:0/2369398851 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f4fb40694a0 msgr2=0x7f4fb407ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:14.469 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T17:25:14.312+0000 7f4fbf003640 10 monclient: get_auth_request con 0x7f4fb40694a0 auth_method 0 2024-09-12T17:25:14.469 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T17:25:14.318+0000 7f4fc1519800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:14.469 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T17:25:14.318+0000 7f4fc1519800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:14.469 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T17:25:14.318+0000 7f4fc1519800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:14.469 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T17:25:14.318+0000 7f4fc1519800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:14.469 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T17:25:14.318+0000 7f4fc1519800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:14.469 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T17:25:14.318+0000 7f4fc1519800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:14.469 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T17:25:14.318+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.469 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T17:25:14.318+0000 7f4fc1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.469 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T17:25:14.318+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.469 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T17:25:14.319+0000 7f4fc1519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:14.469 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T17:25:14.319+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.469 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T17:25:14.319+0000 7f4fc1519800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:14.470 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T17:25:14.319+0000 7f4fc1519800 20 zone default found 2024-09-12T17:25:14.470 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T17:25:14.319+0000 7f4fc1519800 4 Realm: () 2024-09-12T17:25:14.470 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T17:25:14.319+0000 7f4fc1519800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:14.470 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T17:25:14.319+0000 7f4fc1519800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:14.470 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T17:25:14.319+0000 7f4fc1519800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:14.470 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T17:25:14.319+0000 7f4fc1519800 20 zonegroup default 2024-09-12T17:25:14.470 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T17:25:14.319+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.470 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T17:25:14.319+0000 7f4fc1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.470 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T17:25:14.319+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.470 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T17:25:14.320+0000 7f4fc1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.470 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T17:25:14.320+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.470 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T17:25:14.320+0000 7f4fc1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.470 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T17:25:14.320+0000 7f4fc1519800 20 started sync module instance, tier type = 2024-09-12T17:25:14.470 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T17:25:14.320+0000 7f4fc1519800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:14.470 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T17:25:14.331+0000 7f4fc1519800 20 add_watcher() i=0 2024-09-12T17:25:14.471 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T17:25:14.331+0000 7f4fc1519800 20 add_watcher() i=1 2024-09-12T17:25:14.471 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T17:25:14.331+0000 7f4fc1519800 20 add_watcher() i=2 2024-09-12T17:25:14.471 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T17:25:14.331+0000 7f4fc1519800 20 add_watcher() i=3 2024-09-12T17:25:14.471 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T17:25:14.331+0000 7f4fc1519800 20 add_watcher() i=4 2024-09-12T17:25:14.471 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T17:25:14.331+0000 7f4fc1519800 20 add_watcher() i=5 2024-09-12T17:25:14.471 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T17:25:14.331+0000 7f4fc1519800 20 add_watcher() i=6 2024-09-12T17:25:14.471 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T17:25:14.332+0000 7f4fc1519800 20 add_watcher() i=7 2024-09-12T17:25:14.471 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T17:25:14.332+0000 7f4fc1519800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:14.471 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding auth protocol: cephx 2024-09-12T17:25:14.471 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding auth protocol: cephx 2024-09-12T17:25:14.471 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding auth protocol: cephx 2024-09-12T17:25:14.471 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding con mode: secure 2024-09-12T17:25:14.471 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding con mode: crc 2024-09-12T17:25:14.471 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding con mode: secure 2024-09-12T17:25:14.472 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding con mode: crc 2024-09-12T17:25:14.472 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding con mode: secure 2024-09-12T17:25:14.472 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding con mode: crc 2024-09-12T17:25:14.472 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding con mode: crc 2024-09-12T17:25:14.472 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T17:25:14.333+0000 7f4e757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:14.472 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding con mode: secure 2024-09-12T17:25:14.472 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding con mode: crc 2024-09-12T17:25:14.472 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding con mode: secure 2024-09-12T17:25:14.472 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding con mode: crc 2024-09-12T17:25:14.472 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T17:25:14.333+0000 7f4fc1519800 5 AuthRegistry(0x7ffeaf5ec940) adding con mode: secure 2024-09-12T17:25:14.472 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T17:25:14.334+0000 7f4fc1519800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:14.472 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T17:25:14.334+0000 7f4fc1519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:14.472 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T17:25:14.334+0000 7f4fc1519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:14.473 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T17:25:14.334+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command cache list hook 0x561dc30ddbf0 2024-09-12T17:25:14.473 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T17:25:14.334+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command cache inspect hook 0x561dc30ddbf0 2024-09-12T17:25:14.473 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T17:25:14.334+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command cache erase hook 0x561dc30ddbf0 2024-09-12T17:25:14.473 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T17:25:14.334+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command cache zap hook 0x561dc30ddbf0 2024-09-12T17:25:14.473 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T17:25:14.334+0000 7f4fc1519800 5 note: GC not initialized 2024-09-12T17:25:14.473 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T17:25:14.334+0000 7f4deffff640 20 reqs_thread_entry: start 2024-09-12T17:25:14.473 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T17:25:14.334+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command sync trace show hook 0x7f4fb004e970 2024-09-12T17:25:14.473 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T17:25:14.334+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command sync trace history hook 0x7f4fb004e970 2024-09-12T17:25:14.473 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T17:25:14.334+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command sync trace active hook 0x7f4fb004e970 2024-09-12T17:25:14.473 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T17:25:14.334+0000 7f4fc1519800 5 asok(0x561dc2ddd730) register_command sync trace active_short hook 0x7f4fb004e970 2024-09-12T17:25:14.473 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T17:25:14.334+0000 7f4fc1519800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:14.473 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T17:25:14.334+0000 7f4fc1519800 20 Filter name: none 2024-09-12T17:25:14.474 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T17:25:14.334+0000 7f4dedffb640 20 reqs_thread_entry: start 2024-09-12T17:25:14.474 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T17:25:14.335+0000 7f4fc1519800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:25:14.474 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T17:25:14.335+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.474 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T17:25:14.335+0000 7f4fc1519800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:25:14.474 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T17:25:14.335+0000 7f4fc1519800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:25:14.474 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T17:25:14.335+0000 7f4fc1519800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:25:14.474 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T17:25:14.335+0000 7f4fc1519800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 : miss 2024-09-12T17:25:14.474 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T17:25:14.335+0000 7f4fc1519800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.474 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T17:25:14.335+0000 7f4fc1519800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:25:14.474 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T17:25:14.335+0000 7f4fc1519800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 info.flags=0x17 2024-09-12T17:25:14.474 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T17:25:14.335+0000 7f4fc1519800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 to cache LRU end 2024-09-12T17:25:14.474 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T17:25:14.335+0000 7f4fc1519800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:25:14.474 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T17:25:14.335+0000 7f4fc1519800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:14.475 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T17:25:14.335+0000 7f4fc1519800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 2024-09-12T17:25:14.475 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T17:25:14.340+0000 7f4fc1519800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 info.flags=0x17 2024-09-12T17:25:14.475 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T17:25:14.340+0000 7f4fc1519800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 to cache LRU end 2024-09-12T17:25:14.475 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T17:25:14.340+0000 7f4fc1519800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:14.475 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T17:25:14.340+0000 7f4fc1519800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30, ofs0, ns] 2024-09-12T17:25:14.475 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T17:25:14.340+0000 7f4ea27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464338 cookie 94685826644928 notifier 7140 bl.length()=999 2024-09-12T17:25:14.475 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T17:25:14.340+0000 7f4ea27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 info.flags=0x17 2024-09-12T17:25:14.475 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T17:25:14.340+0000 7f4ea27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 to cache LRU end 2024-09-12T17:25:14.475 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T17:25:14.340+0000 7f4ea27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:14.475 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T17:25:14.342+0000 7f4fc1519800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): orig_sources= new_sources= 2024-09-12T17:25:14.475 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T17:25:14.342+0000 7f4fc1519800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): potential sources added=[] removed=[] 2024-09-12T17:25:14.475 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T17:25:14.342+0000 7f4fc1519800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): orig_dests= new_dests= 2024-09-12T17:25:14.475 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T17:25:14.342+0000 7f4fc1519800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): potential dests added=[] removed=[] 2024-09-12T17:25:14.476 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T17:25:14.345+0000 7f4fc1519800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.30.1.0 2024-09-12T17:25:14.476 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T17:25:14.345+0000 7f4fc1519800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.30.1.0 2024-09-12T17:25:14.476 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T17:25:14.345+0000 7f4fc1519800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.30.1.1 2024-09-12T17:25:14.476 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T17:25:14.345+0000 7f4fc1519800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.30.1.1 2024-09-12T17:25:14.476 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T17:25:14.345+0000 7f4fc1519800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.30.0 2024-09-12T17:25:14.476 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T17:25:14.348+0000 7f4fc1519800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:25:14.476 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T17:25:14.348+0000 7f4fc1519800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 2024-09-12T17:25:14.476 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T17:25:14.349+0000 7f4fc1519800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 info.flags=0x17 2024-09-12T17:25:14.476 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T17:25:14.349+0000 7f4fc1519800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 to cache LRU end 2024-09-12T17:25:14.476 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T17:25:14.349+0000 7f4fc1519800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:14.476 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T17:25:14.349+0000 7f4fc1519800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30, ofs0, ns] 2024-09-12T17:25:14.476 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T17:25:14.349+0000 7f4ea27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464339 cookie 94685826644928 notifier 7140 bl.length()=999 2024-09-12T17:25:14.476 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T17:25:14.349+0000 7f4ea27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 info.flags=0x17 2024-09-12T17:25:14.477 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T17:25:14.349+0000 7f4ea27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 to cache LRU end 2024-09-12T17:25:14.477 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T17:25:14.349+0000 7f4ea27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:14.477 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T17:25:14.351+0000 7f4fc1519800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): orig_sources= new_sources= 2024-09-12T17:25:14.477 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T17:25:14.351+0000 7f4fc1519800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): potential sources added=[] removed=[] 2024-09-12T17:25:14.477 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T17:25:14.351+0000 7f4fc1519800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): orig_dests= new_dests= 2024-09-12T17:25:14.477 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T17:25:14.351+0000 7f4fc1519800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): potential dests added=[] removed=[] 2024-09-12T17:25:14.477 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T17:25:14.352+0000 7f4fc1519800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4fc1519800 time 2024-09-12T17:25:14.352192+0000 2024-09-12T17:25:14.477 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:25:14.477 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.477 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:25:14.477 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4fc498c71a] 2024-09-12T17:25:14.477 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4fc498c8d8] 2024-09-12T17:25:14.477 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561dc1d6c841] 2024-09-12T17:25:14.478 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x561dc1d7b79e] 2024-09-12T17:25:14.478 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x561dc1d7c5d4] 2024-09-12T17:25:14.478 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:25:14.478 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4fc3629590] 2024-09-12T17:25:14.478 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:25:14.478 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:25:14.478 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.478 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T17:25:14.353+0000 7f4fc1519800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:25:14.478 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f4fc1519800 thread_name:radosgw-admin 2024-09-12T17:25:14.478 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.478 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:25:14.478 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4fc363e6f0] 2024-09-12T17:25:14.479 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4fc368b99c] 2024-09-12T17:25:14.479 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:25:14.479 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:25:14.479 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4fc498c774] 2024-09-12T17:25:14.479 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4fc498c8d8] 2024-09-12T17:25:14.479 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561dc1d6c841] 2024-09-12T17:25:14.479 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x561dc1d7b79e] 2024-09-12T17:25:14.479 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x561dc1d7c5d4] 2024-09-12T17:25:14.479 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:25:14.479 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4fc3629590] 2024-09-12T17:25:14.479 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:25:14.479 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:25:14.479 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:25:14.479 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.480 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T17:25:14.480 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T17:25:14.480 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T17:25:14.480 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T17:25:14.480 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T17:25:14.480 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T17:25:14.480 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T17:25:14.480 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T17:25:14.480 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T17:25:14.480 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T17:25:14.480 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T17:25:14.480 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T17:25:14.480 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T17:25:14.481 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T17:25:14.481 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T17:25:14.481 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T17:25:14.481 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T17:25:14.481 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T17:25:14.481 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T17:25:14.481 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T17:25:14.481 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T17:25:14.481 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T17:25:14.481 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T17:25:14.481 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T17:25:14.481 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:25:14.481 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T17:25:14.481 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T17:25:14.482 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T17:25:14.482 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T17:25:14.482 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T17:25:14.482 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T17:25:14.482 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T17:25:14.482 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T17:25:14.482 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T17:25:14.482 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T17:25:14.482 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T17:25:14.482 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T17:25:14.482 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T17:25:14.482 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T17:25:14.482 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T17:25:14.482 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T17:25:14.483 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T17:25:14.483 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T17:25:14.483 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T17:25:14.483 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T17:25:14.483 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T17:25:14.483 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:25:14.483 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T17:25:14.483 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:25:14.483 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T17:25:14.483 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T17:25:14.483 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T17:25:14.483 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T17:25:14.483 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T17:25:14.483 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T17:25:14.484 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T17:25:14.484 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T17:25:14.484 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T17:25:14.484 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T17:25:14.484 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T17:25:14.484 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T17:25:14.484 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T17:25:14.484 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T17:25:14.484 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T17:25:14.484 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T17:25:14.484 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T17:25:14.484 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T17:25:14.484 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:25:14.485 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T17:25:14.485 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:25:14.485 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T17:25:14.485 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T17:25:14.485 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T17:25:14.485 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T17:25:14.485 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T17:25:14.485 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T17:25:14.485 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:25:14.485 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T17:25:14.485 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T17:25:14.485 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:25:14.485 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T17:25:14.486 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T17:25:14.486 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T17:25:14.486 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T17:25:14.486 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T17:25:14.486 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T17:25:14.486 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T17:25:14.486 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T17:25:14.486 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T17:25:14.486 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T17:25:14.486 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T17:25:14.486 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T17:25:14.486 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T17:25:14.486 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:25:14.486 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4dedffb640 / http_manager 2024-09-12T17:25:14.486 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4deffff640 / http_manager 2024-09-12T17:25:14.486 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4e757e2640 / rgw_dt_lg_renew 2024-09-12T17:25:14.487 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4ea0ff9640 / ms_dispatch 2024-09-12T17:25:14.487 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4ea27fc640 / io_context_pool 2024-09-12T17:25:14.487 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4ea8e01640 / ms_dispatch 2024-09-12T17:25:14.487 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4eab606640 / ms_dispatch 2024-09-12T17:25:14.487 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4eace09640 / io_context_pool 2024-09-12T17:25:14.487 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4fbe802640 / msgr-worker-2 2024-09-12T17:25:14.487 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4fbf003640 / msgr-worker-1 2024-09-12T17:25:14.487 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4fbf804640 / msgr-worker-0 2024-09-12T17:25:14.487 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4fc0005640 / io_context_pool 2024-09-12T17:25:14.487 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4fc1519800 / radosgw-admin 2024-09-12T17:25:14.487 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T17:25:14.487 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T17:25:14.487 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:25:14.353864Z_c397a301-8da8-40c1-8132-301caacd8d2d/log 2024-09-12T17:25:14.488 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T17:25:14.488 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:25:14.490 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:14.490 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:14.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.435+0000 7f1a4c240800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.437+0000 7f1a4c240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.437+0000 7f1a4c240800 20 realm 2024-09-12T17:25:14.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.437+0000 7f1a4c240800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.437+0000 7f1a4c240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.437+0000 7f1a4c240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:14.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.437+0000 7f1a4c240800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.438+0000 7f1a4c240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.438+0000 7f1a4c240800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.438+0000 7f1a4c240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:14.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.438+0000 7f1a4c240800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.439+0000 7f1a4c240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:14.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.439+0000 7f1a4c240800 20 searching for the correct realm 2024-09-12T17:25:14.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.442+0000 7f1a4a52b640 0 -- 172.21.15.67:0/2953958569 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x55be658fffa0 msgr2=0x55be65902390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:14.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.446+0000 7f1a49529640 0 -- 172.21.15.67:0/2953958569 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55be659079b0 msgr2=0x55be65909da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:25:14.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.450+0000 7f1a4c240800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:14.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.450+0000 7f1a4c240800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:14.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.450+0000 7f1a4c240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:14.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.450+0000 7f1a4c240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:14.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.450+0000 7f1a4c240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:14.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.450+0000 7f1a4c240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:14.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.450+0000 7f1a4c240800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.451+0000 7f1a4c240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.451+0000 7f1a4c240800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.451+0000 7f1a4c240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:14.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.451+0000 7f1a4c240800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.451+0000 7f1a4c240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:14.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.451+0000 7f1a4c240800 20 zone default found 2024-09-12T17:25:14.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.451+0000 7f1a4c240800 4 Realm: () 2024-09-12T17:25:14.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.451+0000 7f1a4c240800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:14.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.451+0000 7f1a4c240800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:14.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.451+0000 7f1a4c240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:14.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.451+0000 7f1a4c240800 20 zonegroup default 2024-09-12T17:25:14.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.451+0000 7f1a4c240800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.452+0000 7f1a4c240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.452+0000 7f1a4c240800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.452+0000 7f1a4c240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.452+0000 7f1a4c240800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.452+0000 7f1a4c240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.452+0000 7f1a4c240800 20 started sync module instance, tier type = 2024-09-12T17:25:14.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.452+0000 7f1a4c240800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:14.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.462+0000 7f1a4c240800 20 add_watcher() i=0 2024-09-12T17:25:14.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.462+0000 7f1a4c240800 20 add_watcher() i=1 2024-09-12T17:25:14.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.462+0000 7f1a4c240800 20 add_watcher() i=2 2024-09-12T17:25:14.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.661+0000 7f1a4c240800 20 add_watcher() i=3 2024-09-12T17:25:14.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.661+0000 7f1a4c240800 20 add_watcher() i=4 2024-09-12T17:25:14.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.661+0000 7f1a4c240800 20 add_watcher() i=5 2024-09-12T17:25:14.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.661+0000 7f1a4c240800 20 add_watcher() i=6 2024-09-12T17:25:14.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.661+0000 7f1a4c240800 20 add_watcher() i=7 2024-09-12T17:25:14.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.661+0000 7f1a4c240800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:14.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.662+0000 7f18fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:14.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.663+0000 7f1a4c240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:14.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.663+0000 7f1a4c240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:14.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.663+0000 7f1a4c240800 5 note: GC not initialized 2024-09-12T17:25:14.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.663+0000 7f18fa7fc640 20 reqs_thread_entry: start 2024-09-12T17:25:14.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.663+0000 7f1a4c240800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:14.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.663+0000 7f1a4c240800 20 Filter name: none 2024-09-12T17:25:14.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.663+0000 7f186bfff640 20 reqs_thread_entry: start 2024-09-12T17:25:14.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.663+0000 7f1a4c240800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.664+0000 7f1a4c240800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:25:14.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.664+0000 7f1a4c240800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.664+0000 7f1a4c240800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T17:25:14.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.664+0000 7f1a4c240800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:14.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.664+0000 7f1a4c240800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.665+0000 7f1a4c240800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:25:14.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.665+0000 7f1a4c240800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.665+0000 7f1a4c240800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T17:25:14.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.665+0000 7f1a4c240800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:14.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.667+0000 7f18fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:14.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.669+0000 7f1a4c240800 20 remove_watcher() i=0 2024-09-12T17:25:14.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.669+0000 7f1a4c240800 2 removed watcher, disabling cache 2024-09-12T17:25:14.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.670+0000 7f1a4c240800 20 remove_watcher() i=1 2024-09-12T17:25:14.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.671+0000 7f1a4c240800 20 remove_watcher() i=2 2024-09-12T17:25:14.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.672+0000 7f1a4c240800 20 remove_watcher() i=3 2024-09-12T17:25:14.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.673+0000 7f1a4c240800 20 remove_watcher() i=4 2024-09-12T17:25:14.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.674+0000 7f1a4c240800 20 remove_watcher() i=5 2024-09-12T17:25:14.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.675+0000 7f1a4c240800 20 remove_watcher() i=6 2024-09-12T17:25:14.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.676+0000 7f1a4c240800 20 remove_watcher() i=7 2024-09-12T17:25:14.688 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.688 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:25:14.688 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-block-writes id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:25:14.688 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:14.690 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:14.690 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:14.724 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:14.724 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:14.781 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:25:14.813 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:14.813 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:14.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.852+0000 7fbf0ed1f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.853+0000 7fbf0ed1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.853+0000 7fbf0ed1f800 20 realm 2024-09-12T17:25:14.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.853+0000 7fbf0ed1f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.854+0000 7fbf0ed1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.854+0000 7fbf0ed1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:14.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.854+0000 7fbf0ed1f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.854+0000 7fbf0ed1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:14.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.854+0000 7fbf0ed1f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.855+0000 7fbf0ed1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:14.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.855+0000 7fbf0ed1f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:14.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.855+0000 7fbf0ed1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:14.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.855+0000 7fbf0ed1f800 20 searching for the correct realm 2024-09-12T17:25:14.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.858+0000 7fbf0a2a8640 0 -- 172.21.15.67:0/2910428546 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x563478811de0 msgr2=0x5634788141d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:14.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:14.861+0000 7fbf0aaa9640 0 -- 172.21.15.67:0/2910428546 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fbf00028030 msgr2=0x7fbf0009a040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:15.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.068+0000 7fbf0ed1f800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:15.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.068+0000 7fbf0ed1f800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:15.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.068+0000 7fbf0ed1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:15.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.068+0000 7fbf0ed1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:15.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.068+0000 7fbf0ed1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:15.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.068+0000 7fbf0ed1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:15.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.068+0000 7fbf0ed1f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:15.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.068+0000 7fbf0ed1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:15.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.068+0000 7fbf0ed1f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:15.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.068+0000 7fbf0ed1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:15.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.068+0000 7fbf0ed1f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:15.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.069+0000 7fbf0ed1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:15.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.069+0000 7fbf0ed1f800 20 zone default found 2024-09-12T17:25:15.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.069+0000 7fbf0ed1f800 4 Realm: () 2024-09-12T17:25:15.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.069+0000 7fbf0ed1f800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:15.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.069+0000 7fbf0ed1f800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:15.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.069+0000 7fbf0ed1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:15.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.069+0000 7fbf0ed1f800 20 zonegroup default 2024-09-12T17:25:15.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.069+0000 7fbf0ed1f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:15.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.069+0000 7fbf0ed1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:15.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.069+0000 7fbf0ed1f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:15.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.070+0000 7fbf0ed1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:15.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.070+0000 7fbf0ed1f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:15.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.070+0000 7fbf0ed1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:15.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.070+0000 7fbf0ed1f800 20 started sync module instance, tier type = 2024-09-12T17:25:15.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.070+0000 7fbf0ed1f800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:15.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.079+0000 7fbf0ed1f800 20 add_watcher() i=0 2024-09-12T17:25:15.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.079+0000 7fbf0ed1f800 20 add_watcher() i=1 2024-09-12T17:25:15.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.079+0000 7fbf0ed1f800 20 add_watcher() i=2 2024-09-12T17:25:15.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.079+0000 7fbf0ed1f800 20 add_watcher() i=3 2024-09-12T17:25:15.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.079+0000 7fbf0ed1f800 20 add_watcher() i=4 2024-09-12T17:25:15.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.079+0000 7fbf0ed1f800 20 add_watcher() i=5 2024-09-12T17:25:15.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.079+0000 7fbf0ed1f800 20 add_watcher() i=6 2024-09-12T17:25:15.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.080+0000 7fbf0ed1f800 20 add_watcher() i=7 2024-09-12T17:25:15.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.080+0000 7fbf0ed1f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:15.083 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.083+0000 7fbdc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:15.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.083+0000 7fbf0ed1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:15.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.083+0000 7fbf0ed1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:15.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.083+0000 7fbf0ed1f800 5 note: GC not initialized 2024-09-12T17:25:15.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.083+0000 7fbd3bfff640 20 reqs_thread_entry: start 2024-09-12T17:25:15.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.083+0000 7fbf0ed1f800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:15.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.083+0000 7fbf0ed1f800 20 Filter name: none 2024-09-12T17:25:15.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.083+0000 7fbd39ffb640 20 reqs_thread_entry: start 2024-09-12T17:25:15.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.083+0000 7fbf0ed1f800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:25:15.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.083+0000 7fbf0ed1f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:15.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.084+0000 7fbf0ed1f800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:25:15.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.084+0000 7fbf0ed1f800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:25:15.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.084+0000 7fbf0ed1f800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:25:15.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.084+0000 7fbf0ed1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 : miss 2024-09-12T17:25:15.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.084+0000 7fbf0ed1f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:15.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.084+0000 7fbf0ed1f800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T17:25:15.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.084+0000 7fbf0ed1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 info.flags=0x17 2024-09-12T17:25:15.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.084+0000 7fbf0ed1f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 to cache LRU end 2024-09-12T17:25:15.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.084+0000 7fbf0ed1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:25:15.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.084+0000 7fbf0ed1f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:15.087 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.084+0000 7fbf0ed1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 2024-09-12T17:25:15.087 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.085+0000 7fbf0ed1f800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 to be held by another RGW process; skipping for now 2024-09-12T17:25:15.087 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.086+0000 7fbdc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:15.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.089+0000 7fbf0ed1f800 20 remove_watcher() i=0 2024-09-12T17:25:15.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.089+0000 7fbf0ed1f800 2 removed watcher, disabling cache 2024-09-12T17:25:15.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.090+0000 7fbf0ed1f800 20 remove_watcher() i=1 2024-09-12T17:25:15.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.091+0000 7fbf0ed1f800 20 remove_watcher() i=2 2024-09-12T17:25:15.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.092+0000 7fbf0ed1f800 20 remove_watcher() i=3 2024-09-12T17:25:15.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.093+0000 7fbf0ed1f800 20 remove_watcher() i=4 2024-09-12T17:25:15.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.094+0000 7fbf0ed1f800 20 remove_watcher() i=5 2024-09-12T17:25:15.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.095+0000 7fbf0ed1f800 20 remove_watcher() i=6 2024-09-12T17:25:15.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:15.096+0000 7fbf0ed1f800 20 remove_watcher() i=7 2024-09-12T17:25:15.108 INFO:tasks.workunit.client.0.smithi067.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:25:45.120 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:25:45.156 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:45.156 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:45.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.201+0000 7f67d9e11800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.203+0000 7f67d9e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:45.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.203+0000 7f67d9e11800 20 realm 2024-09-12T17:25:45.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.203+0000 7f67d9e11800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.203+0000 7f67d9e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:45.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.203+0000 7f67d9e11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:45.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.203+0000 7f67d9e11800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.203+0000 7f67d9e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:45.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.203+0000 7f67d9e11800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.204+0000 7f67d9e11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:45.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.204+0000 7f67d9e11800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.205+0000 7f67d9e11800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:45.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.205+0000 7f67d9e11800 20 searching for the correct realm 2024-09-12T17:25:45.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.206+0000 7f67d5522640 0 -- 172.21.15.67:0/1071726067 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f67d002f060 msgr2=0x7f67d009b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:45.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.413+0000 7f67d4d21640 0 -- 172.21.15.67:0/1071726067 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f67c8011040 msgr2=0x7f67c8081110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:45.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.421+0000 7f67d9e11800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:45.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.421+0000 7f67d9e11800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:45.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.421+0000 7f67d9e11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:45.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.421+0000 7f67d9e11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:45.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.421+0000 7f67d9e11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:45.423 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.421+0000 7f67d9e11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:45.423 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.421+0000 7f67d9e11800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.423 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.421+0000 7f67d9e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:45.423 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.421+0000 7f67d9e11800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.424 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.421+0000 7f67d9e11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:45.424 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.421+0000 7f67d9e11800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.424 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.422+0000 7f67d9e11800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:45.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.422+0000 7f67d9e11800 20 zone default found 2024-09-12T17:25:45.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.422+0000 7f67d9e11800 4 Realm: () 2024-09-12T17:25:45.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.422+0000 7f67d9e11800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:45.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.422+0000 7f67d9e11800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:45.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.422+0000 7f67d9e11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:45.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.422+0000 7f67d9e11800 20 zonegroup default 2024-09-12T17:25:45.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.422+0000 7f67d9e11800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.422+0000 7f67d9e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:45.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.422+0000 7f67d9e11800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.422+0000 7f67d9e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:45.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.422+0000 7f67d9e11800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.423+0000 7f67d9e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:45.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.423+0000 7f67d9e11800 20 started sync module instance, tier type = 2024-09-12T17:25:45.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.423+0000 7f67d9e11800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:45.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.436+0000 7f67d9e11800 20 add_watcher() i=0 2024-09-12T17:25:45.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.436+0000 7f67d9e11800 20 add_watcher() i=1 2024-09-12T17:25:45.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.436+0000 7f67d9e11800 20 add_watcher() i=2 2024-09-12T17:25:45.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.436+0000 7f67d9e11800 20 add_watcher() i=3 2024-09-12T17:25:45.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.436+0000 7f67d9e11800 20 add_watcher() i=4 2024-09-12T17:25:45.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.436+0000 7f67d9e11800 20 add_watcher() i=5 2024-09-12T17:25:45.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.436+0000 7f67d9e11800 20 add_watcher() i=6 2024-09-12T17:25:45.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.437+0000 7f67d9e11800 20 add_watcher() i=7 2024-09-12T17:25:45.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.437+0000 7f67d9e11800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:45.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.439+0000 7f668bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:45.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.439+0000 7f67d9e11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:45.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.439+0000 7f67d9e11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:45.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.440+0000 7f67d9e11800 5 note: GC not initialized 2024-09-12T17:25:45.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.440+0000 7f668afe5640 20 reqs_thread_entry: start 2024-09-12T17:25:45.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.440+0000 7f67d9e11800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:45.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.440+0000 7f67d9e11800 20 Filter name: none 2024-09-12T17:25:45.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.440+0000 7f6688fe1640 20 reqs_thread_entry: start 2024-09-12T17:25:45.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.440+0000 7f67d9e11800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:25:45.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.440+0000 7f67d9e11800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.441+0000 7f67d9e11800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:25:45.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.441+0000 7f67d9e11800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:25:45.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.441+0000 7f67d9e11800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:25:45.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.441+0000 7f67d9e11800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 : miss 2024-09-12T17:25:45.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.441+0000 7f67d9e11800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.441+0000 7f67d9e11800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T17:25:45.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.441+0000 7f67d9e11800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 info.flags=0x17 2024-09-12T17:25:45.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.441+0000 7f67d9e11800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 to cache LRU end 2024-09-12T17:25:45.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.441+0000 7f67d9e11800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:25:45.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.441+0000 7f67d9e11800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:45.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.441+0000 7f67d9e11800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 2024-09-12T17:25:45.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.443+0000 7f67d9e11800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:25:45.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.447+0000 7f67d9e11800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 info.flags=0x17 2024-09-12T17:25:45.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.447+0000 7f67d9e11800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 to cache LRU end 2024-09-12T17:25:45.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.447+0000 7f67d9e11800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:45.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.447+0000 7f67d9e11800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30, ofs0, ns] 2024-09-12T17:25:45.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.447+0000 7f66b8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464340 cookie 94276574768912 notifier 7191 bl.length()=999 2024-09-12T17:25:45.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.447+0000 7f66b8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 info.flags=0x17 2024-09-12T17:25:45.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.447+0000 7f66b8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 to cache LRU end 2024-09-12T17:25:45.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.447+0000 7f66b8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:45.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.449+0000 7f67d9e11800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): orig_sources= new_sources= 2024-09-12T17:25:45.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.449+0000 7f67d9e11800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): potential sources added=[] removed=[] 2024-09-12T17:25:45.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.449+0000 7f67d9e11800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): orig_dests= new_dests= 2024-09-12T17:25:45.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.449+0000 7f67d9e11800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): potential dests added=[] removed=[] 2024-09-12T17:25:45.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.453+0000 7f67d9e11800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.30.2.0 2024-09-12T17:25:45.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.453+0000 7f67d9e11800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.30.2.0 2024-09-12T17:25:45.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.453+0000 7f67d9e11800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.30.2.1 2024-09-12T17:25:45.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.453+0000 7f67d9e11800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.30.2.1 2024-09-12T17:25:45.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.453+0000 7f67d9e11800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.30.0 2024-09-12T17:25:45.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.456+0000 7f67d9e11800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:25:45.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.456+0000 7f67d9e11800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 2024-09-12T17:25:45.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.457+0000 7f67d9e11800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 info.flags=0x17 2024-09-12T17:25:45.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.457+0000 7f67d9e11800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 to cache LRU end 2024-09-12T17:25:45.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.457+0000 7f67d9e11800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:45.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.457+0000 7f67d9e11800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30, ofs0, ns] 2024-09-12T17:25:45.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.458+0000 7f66b8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464341 cookie 94276574768912 notifier 7191 bl.length()=999 2024-09-12T17:25:45.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.458+0000 7f66b8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 info.flags=0x17 2024-09-12T17:25:45.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.458+0000 7f66b8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 to cache LRU end 2024-09-12T17:25:45.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.458+0000 7f66b8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:45.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.459+0000 7f67d9e11800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): orig_sources= new_sources= 2024-09-12T17:25:45.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.459+0000 7f67d9e11800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): potential sources added=[] removed=[] 2024-09-12T17:25:45.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.459+0000 7f67d9e11800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): orig_dests= new_dests= 2024-09-12T17:25:45.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.459+0000 7f67d9e11800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): potential dests added=[] removed=[] 2024-09-12T17:25:45.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.461+0000 7f67d9e11800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.30.0 2024-09-12T17:25:45.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.462+0000 7f67d9e11800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:25:45.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.462+0000 7f67d9e11800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 2024-09-12T17:25:45.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.463+0000 7f67d9e11800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 info.flags=0x17 2024-09-12T17:25:45.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.463+0000 7f67d9e11800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 to cache LRU end 2024-09-12T17:25:45.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.463+0000 7f67d9e11800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:45.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.463+0000 7f67d9e11800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30, ofs0, ns] 2024-09-12T17:25:45.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.463+0000 7f66a7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464342 cookie 94276574768912 notifier 7191 bl.length()=967 2024-09-12T17:25:45.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.463+0000 7f66a7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 info.flags=0x17 2024-09-12T17:25:45.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.463+0000 7f66a7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 to cache LRU end 2024-09-12T17:25:45.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.463+0000 7f66a7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:45.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.465+0000 7f67d9e11800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): orig_sources= new_sources= 2024-09-12T17:25:45.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.465+0000 7f67d9e11800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): potential sources added=[] removed=[] 2024-09-12T17:25:45.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.465+0000 7f67d9e11800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): orig_dests= new_dests= 2024-09-12T17:25:45.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.465+0000 7f67d9e11800 20 handle_bi_update(): bucket=:abort-at-block-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.30]): potential dests added=[] removed=[] 2024-09-12T17:25:45.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.466+0000 7f67d9e11800 1 execute INFO: reshard of bucket "abort-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-12T17:25:45.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.468+0000 7f668bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:45.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.471+0000 7f67d9e11800 20 remove_watcher() i=0 2024-09-12T17:25:45.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.471+0000 7f67d9e11800 2 removed watcher, disabling cache 2024-09-12T17:25:45.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.472+0000 7f67d9e11800 20 remove_watcher() i=1 2024-09-12T17:25:45.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.473+0000 7f67d9e11800 20 remove_watcher() i=2 2024-09-12T17:25:45.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.474+0000 7f67d9e11800 20 remove_watcher() i=3 2024-09-12T17:25:45.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.475+0000 7f67d9e11800 20 remove_watcher() i=4 2024-09-12T17:25:45.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.476+0000 7f67d9e11800 20 remove_watcher() i=5 2024-09-12T17:25:45.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.477+0000 7f67d9e11800 20 remove_watcher() i=6 2024-09-12T17:25:45.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.479+0000 7f67d9e11800 20 remove_watcher() i=7 2024-09-12T17:25:45.494 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:25:45.524 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:45.524 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:45.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.563+0000 7f728c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.566+0000 7f728c12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:45.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.566+0000 7f728c12c800 20 realm 2024-09-12T17:25:45.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.566+0000 7f728c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.566+0000 7f728c12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:45.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.566+0000 7f728c12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:45.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.566+0000 7f728c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.566+0000 7f728c12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:45.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.566+0000 7f728c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.567+0000 7f728c12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:45.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.567+0000 7f728c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.568+0000 7f728c12c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:45.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.568+0000 7f728c12c800 20 searching for the correct realm 2024-09-12T17:25:45.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.571+0000 7f72886ae640 0 -- 172.21.15.67:0/408796159 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x564f81b9fb90 msgr2=0x564f81ba2050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:45.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.575+0000 7f7287ead640 0 -- 172.21.15.67:0/408796159 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f7270029920 msgr2=0x7f727003f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:45.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.580+0000 7f728c12c800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:45.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.580+0000 7f728c12c800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:45.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.580+0000 7f728c12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:45.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.580+0000 7f728c12c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:45.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.580+0000 7f728c12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:45.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.580+0000 7f728c12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:45.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.580+0000 7f728c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.580+0000 7f728c12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:45.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.580+0000 7f728c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.580+0000 7f728c12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:45.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.580+0000 7f728c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.580+0000 7f728c12c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:45.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.580+0000 7f728c12c800 20 zone default found 2024-09-12T17:25:45.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.580+0000 7f728c12c800 4 Realm: () 2024-09-12T17:25:45.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.581+0000 7f728c12c800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:45.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.581+0000 7f728c12c800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:45.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.581+0000 7f728c12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:45.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.581+0000 7f728c12c800 20 zonegroup default 2024-09-12T17:25:45.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.581+0000 7f728c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.581+0000 7f728c12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:45.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.581+0000 7f728c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.581+0000 7f728c12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:45.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.581+0000 7f728c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.581+0000 7f728c12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:45.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.581+0000 7f728c12c800 20 started sync module instance, tier type = 2024-09-12T17:25:45.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.581+0000 7f728c12c800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:45.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.590+0000 7f728c12c800 20 add_watcher() i=0 2024-09-12T17:25:45.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.590+0000 7f728c12c800 20 add_watcher() i=1 2024-09-12T17:25:45.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.590+0000 7f728c12c800 20 add_watcher() i=2 2024-09-12T17:25:45.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.590+0000 7f728c12c800 20 add_watcher() i=3 2024-09-12T17:25:45.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.590+0000 7f728c12c800 20 add_watcher() i=4 2024-09-12T17:25:45.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.590+0000 7f728c12c800 20 add_watcher() i=5 2024-09-12T17:25:45.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.590+0000 7f728c12c800 20 add_watcher() i=6 2024-09-12T17:25:45.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.591+0000 7f728c12c800 20 add_watcher() i=7 2024-09-12T17:25:45.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.591+0000 7f728c12c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:45.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.593+0000 7f713dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:45.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.593+0000 7f728c12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:45.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.593+0000 7f728c12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:45.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.594+0000 7f728c12c800 5 note: GC not initialized 2024-09-12T17:25:45.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.594+0000 7f713cfe1640 20 reqs_thread_entry: start 2024-09-12T17:25:45.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.594+0000 7f728c12c800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:45.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.594+0000 7f728c12c800 20 Filter name: none 2024-09-12T17:25:45.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.594+0000 7f70b67fc640 20 reqs_thread_entry: start 2024-09-12T17:25:45.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.594+0000 7f728c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.594+0000 7f728c12c800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:25:45.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.594+0000 7f728c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.595+0000 7f728c12c800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:25:45.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.595+0000 7f728c12c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:45.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.595+0000 7f728c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.595+0000 7f728c12c800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:25:45.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.595+0000 7f728c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:25:45.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.596+0000 7f728c12c800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:25:45.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.596+0000 7f728c12c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:45.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.597+0000 7f713dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:45.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.599+0000 7f728c12c800 20 remove_watcher() i=0 2024-09-12T17:25:45.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.599+0000 7f728c12c800 2 removed watcher, disabling cache 2024-09-12T17:25:45.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.600+0000 7f728c12c800 20 remove_watcher() i=1 2024-09-12T17:25:45.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.601+0000 7f728c12c800 20 remove_watcher() i=2 2024-09-12T17:25:45.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.602+0000 7f728c12c800 20 remove_watcher() i=3 2024-09-12T17:25:45.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.604+0000 7f728c12c800 20 remove_watcher() i=4 2024-09-12T17:25:45.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.605+0000 7f728c12c800 20 remove_watcher() i=5 2024-09-12T17:25:45.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.606+0000 7f728c12c800 20 remove_watcher() i=6 2024-09-12T17:25:45.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:45.607+0000 7f728c12c800 20 remove_watcher() i=7 2024-09-12T17:25:45.618 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:45.618 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:25:45.618 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-block-writes id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.30 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:25:45.618 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:45.620 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:45.620 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:45.642 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:45.642 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:45.894 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:45.894 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:45.958 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-12T17:25:45.958 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:45.960 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:45.960 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:46.003 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:46.004 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:46.060 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:46.061 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:46.099 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:46.099 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:46.134 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:46.134 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:46.175 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:46.175 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:46.211 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:46.211 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:46.247 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:46.247 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:46.283 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:46.284 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:46.320 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:46.320 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:46.356 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:46.356 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:46.392 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:46.392 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:46.428 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:46.428 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:46.466 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:46.466 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:46.501 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:46.501 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:46.537 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:46.537 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:46.574 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:46.574 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:46.611 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:46.611 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:46.647 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:46.648 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:46.684 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:46.684 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:46.721 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:46.721 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:46.757 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:46.757 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:46.792 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:25:46.822 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:46.822 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:46.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:46.860+0000 7f803660f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:46.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:46.862+0000 7f803660f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:46.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:46.862+0000 7f803660f800 20 realm 2024-09-12T17:25:46.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:46.862+0000 7f803660f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:46.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:46.862+0000 7f803660f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:46.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:46.862+0000 7f803660f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:46.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:46.862+0000 7f803660f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:46.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:46.862+0000 7f803660f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:46.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:46.862+0000 7f803660f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:46.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:46.863+0000 7f803660f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:46.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:46.863+0000 7f803660f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:46.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:46.864+0000 7f803660f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:46.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:46.864+0000 7f803660f800 20 searching for the correct realm 2024-09-12T17:25:46.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:46.866+0000 7f8031d22640 0 -- 172.21.15.67:0/435782722 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f802c061500 msgr2=0x7f802c05ff70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:46.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:46.870+0000 7f8031d22640 0 -- 172.21.15.67:0/435782722 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f802806c040 msgr2=0x7f802806d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:47.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.076+0000 7f803660f800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:47.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.076+0000 7f803660f800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:47.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.076+0000 7f803660f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:47.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.076+0000 7f803660f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:47.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.076+0000 7f803660f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:47.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.076+0000 7f803660f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:47.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.076+0000 7f803660f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.076+0000 7f803660f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:47.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.076+0000 7f803660f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.077+0000 7f803660f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:47.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.077+0000 7f803660f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.077+0000 7f803660f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:47.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.077+0000 7f803660f800 20 zone default found 2024-09-12T17:25:47.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.077+0000 7f803660f800 4 Realm: () 2024-09-12T17:25:47.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.077+0000 7f803660f800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:47.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.077+0000 7f803660f800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:47.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.077+0000 7f803660f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:47.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.077+0000 7f803660f800 20 zonegroup default 2024-09-12T17:25:47.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.077+0000 7f803660f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.077+0000 7f803660f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:47.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.077+0000 7f803660f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.078+0000 7f803660f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:47.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.078+0000 7f803660f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.078+0000 7f803660f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:47.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.078+0000 7f803660f800 20 started sync module instance, tier type = 2024-09-12T17:25:47.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.078+0000 7f803660f800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:47.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.087+0000 7f803660f800 20 add_watcher() i=0 2024-09-12T17:25:47.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.087+0000 7f803660f800 20 add_watcher() i=1 2024-09-12T17:25:47.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.087+0000 7f803660f800 20 add_watcher() i=2 2024-09-12T17:25:47.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.087+0000 7f803660f800 20 add_watcher() i=3 2024-09-12T17:25:47.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.087+0000 7f803660f800 20 add_watcher() i=4 2024-09-12T17:25:47.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.087+0000 7f803660f800 20 add_watcher() i=5 2024-09-12T17:25:47.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.087+0000 7f803660f800 20 add_watcher() i=6 2024-09-12T17:25:47.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.088+0000 7f803660f800 20 add_watcher() i=7 2024-09-12T17:25:47.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.088+0000 7f803660f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:47.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.090+0000 7f7ee37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:47.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.090+0000 7f803660f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:47.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.090+0000 7f803660f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:47.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.090+0000 7f803660f800 5 note: GC not initialized 2024-09-12T17:25:47.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.090+0000 7f7ee27fc640 20 reqs_thread_entry: start 2024-09-12T17:25:47.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.091+0000 7f803660f800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:47.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.091+0000 7f803660f800 20 Filter name: none 2024-09-12T17:25:47.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.091+0000 7f7e53fff640 20 reqs_thread_entry: start 2024-09-12T17:25:47.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.091+0000 7f803660f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.092+0000 7f803660f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:25:47.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.092+0000 7f803660f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.092+0000 7f803660f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:25:47.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.092+0000 7f803660f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:47.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.092+0000 7f803660f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.092+0000 7f803660f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:25:47.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.092+0000 7f803660f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.093+0000 7f803660f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:25:47.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.093+0000 7f803660f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:47.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.094+0000 7f7ee37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:47.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.096+0000 7f803660f800 20 remove_watcher() i=0 2024-09-12T17:25:47.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.096+0000 7f803660f800 2 removed watcher, disabling cache 2024-09-12T17:25:47.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.097+0000 7f803660f800 20 remove_watcher() i=1 2024-09-12T17:25:47.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.098+0000 7f803660f800 20 remove_watcher() i=2 2024-09-12T17:25:47.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.099+0000 7f803660f800 20 remove_watcher() i=3 2024-09-12T17:25:47.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.100+0000 7f803660f800 20 remove_watcher() i=4 2024-09-12T17:25:47.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.101+0000 7f803660f800 20 remove_watcher() i=5 2024-09-12T17:25:47.103 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.102+0000 7f803660f800 20 remove_watcher() i=6 2024-09-12T17:25:47.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.103+0000 7f803660f800 20 remove_watcher() i=7 2024-09-12T17:25:47.115 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:47.115 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:25:47.115 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-commit-target-layout id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:25:47.115 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:47.117 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-12T17:25:47.151 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:47.152 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:47.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.189+0000 7fac9a540800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.192 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.191+0000 7fac9a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:47.192 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.191+0000 7fac9a540800 20 realm 2024-09-12T17:25:47.192 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.191+0000 7fac9a540800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.192 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.191+0000 7fac9a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:47.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.191+0000 7fac9a540800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:47.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.191+0000 7fac9a540800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.191+0000 7fac9a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:47.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.191+0000 7fac9a540800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.192+0000 7fac9a540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:47.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.192+0000 7fac9a540800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.193+0000 7fac9a540800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:47.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.193+0000 7fac9a540800 20 searching for the correct realm 2024-09-12T17:25:47.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.196+0000 7fac96ac1640 0 -- 172.21.15.67:0/660757797 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x558be12fa7c0 msgr2=0x558be12fcc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:47.200 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.199+0000 7fac962c0640 0 -- 172.21.15.67:0/660757797 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fac8c031040 msgr2=0x7fac8c03d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:47.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.203+0000 7fac9a540800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:47.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.203+0000 7fac9a540800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:47.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.203+0000 7fac9a540800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:47.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.203+0000 7fac9a540800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:47.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.203+0000 7fac9a540800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:47.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.203+0000 7fac9a540800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:47.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.203+0000 7fac9a540800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.203+0000 7fac9a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:47.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.203+0000 7fac9a540800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.203+0000 7fac9a540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:47.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.203+0000 7fac9a540800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.204+0000 7fac9a540800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:47.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.204+0000 7fac9a540800 20 zone default found 2024-09-12T17:25:47.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.204+0000 7fac9a540800 4 Realm: () 2024-09-12T17:25:47.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.204+0000 7fac9a540800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:47.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.204+0000 7fac9a540800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:47.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.204+0000 7fac9a540800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:47.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.204+0000 7fac9a540800 20 zonegroup default 2024-09-12T17:25:47.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.204+0000 7fac9a540800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.204+0000 7fac9a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:47.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.204+0000 7fac9a540800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.204+0000 7fac9a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:47.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.204+0000 7fac9a540800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.205+0000 7fac9a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:47.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.205+0000 7fac9a540800 20 started sync module instance, tier type = 2024-09-12T17:25:47.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.205+0000 7fac9a540800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:47.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.214+0000 7fac9a540800 20 add_watcher() i=0 2024-09-12T17:25:47.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.214+0000 7fac9a540800 20 add_watcher() i=1 2024-09-12T17:25:47.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.214+0000 7fac9a540800 20 add_watcher() i=2 2024-09-12T17:25:47.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.214+0000 7fac9a540800 20 add_watcher() i=3 2024-09-12T17:25:47.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.214+0000 7fac9a540800 20 add_watcher() i=4 2024-09-12T17:25:47.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.214+0000 7fac9a540800 20 add_watcher() i=5 2024-09-12T17:25:47.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.214+0000 7fac9a540800 20 add_watcher() i=6 2024-09-12T17:25:47.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.215+0000 7fac9a540800 20 add_watcher() i=7 2024-09-12T17:25:47.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.215+0000 7fac9a540800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:47.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.216+0000 7fab4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:47.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.217+0000 7fac9a540800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:47.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.217+0000 7fac9a540800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:47.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.217+0000 7fac9a540800 5 note: GC not initialized 2024-09-12T17:25:47.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.217+0000 7faac77fe640 20 reqs_thread_entry: start 2024-09-12T17:25:47.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.217+0000 7fac9a540800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:47.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.217+0000 7fac9a540800 20 Filter name: none 2024-09-12T17:25:47.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.217+0000 7faac57fa640 20 reqs_thread_entry: start 2024-09-12T17:25:47.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.217+0000 7fac9a540800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:25:47.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.217+0000 7fac9a540800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.218+0000 7fac9a540800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:25:47.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.218+0000 7fac9a540800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:25:47.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.218+0000 7fac9a540800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:25:47.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.218+0000 7fac9a540800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 : miss 2024-09-12T17:25:47.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.218+0000 7fac9a540800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.218+0000 7fac9a540800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:25:47.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.218+0000 7fac9a540800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 info.flags=0x17 2024-09-12T17:25:47.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.218+0000 7fac9a540800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 to cache LRU end 2024-09-12T17:25:47.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.218+0000 7fac9a540800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:25:47.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.218+0000 7fac9a540800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:47.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.218+0000 7fac9a540800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 2024-09-12T17:25:47.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.222+0000 7fac9a540800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 info.flags=0x17 2024-09-12T17:25:47.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.222+0000 7fac9a540800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 to cache LRU end 2024-09-12T17:25:47.224 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.222+0000 7fac9a540800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:47.224 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.222+0000 7fac9a540800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31, ofs0, ns] 2024-09-12T17:25:47.224 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.222+0000 7fab79ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464288 cookie 94059266828352 notifier 7245 bl.length()=1015 2024-09-12T17:25:47.224 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.222+0000 7fab79ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 info.flags=0x17 2024-09-12T17:25:47.224 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.222+0000 7fab79ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 to cache LRU end 2024-09-12T17:25:47.224 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.222+0000 7fab79ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:47.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.224+0000 7fac9a540800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.31]): orig_sources= new_sources= 2024-09-12T17:25:47.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.224+0000 7fac9a540800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.31]): potential sources added=[] removed=[] 2024-09-12T17:25:47.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.224+0000 7fac9a540800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.31]): orig_dests= new_dests= 2024-09-12T17:25:47.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.224+0000 7fac9a540800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.31]): potential dests added=[] removed=[] 2024-09-12T17:25:47.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.226+0000 7fac9a540800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.31.1.0 2024-09-12T17:25:47.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.226+0000 7fac9a540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.31.1.0 2024-09-12T17:25:47.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.226+0000 7fac9a540800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.31.1.1 2024-09-12T17:25:47.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.226+0000 7fac9a540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.31.1.1 2024-09-12T17:25:47.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.226+0000 7fac9a540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.31.0 2024-09-12T17:25:47.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.228+0000 7fac9a540800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 : hit (requested=0x17, cached=0x17) 2024-09-12T17:25:47.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.228+0000 7fac9a540800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 2024-09-12T17:25:47.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.230+0000 7fac9a540800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 info.flags=0x17 2024-09-12T17:25:47.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.230+0000 7fac9a540800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 to cache LRU end 2024-09-12T17:25:47.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.230+0000 7fac9a540800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:47.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.230+0000 7fac9a540800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31, ofs0, ns] 2024-09-12T17:25:47.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.230+0000 7fab79ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464289 cookie 94059266828352 notifier 7245 bl.length()=1015 2024-09-12T17:25:47.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.230+0000 7fab79ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 info.flags=0x17 2024-09-12T17:25:47.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.230+0000 7fab79ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 to cache LRU end 2024-09-12T17:25:47.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.230+0000 7fab79ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:47.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.232+0000 7fac9a540800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.31]): orig_sources= new_sources= 2024-09-12T17:25:47.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.232+0000 7fac9a540800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.31]): potential sources added=[] removed=[] 2024-09-12T17:25:47.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.232+0000 7fac9a540800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.31]): orig_dests= new_dests= 2024-09-12T17:25:47.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.232+0000 7fac9a540800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.31]): potential dests added=[] removed=[] 2024-09-12T17:25:47.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.233+0000 7fac9a540800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.31.0 2024-09-12T17:25:47.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.233+0000 7fac9a540800 -1 Injecting error=-5 at location=commit_target_layout 2024-09-12T17:25:47.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.233+0000 7fac9a540800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-12T17:25:47.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.236+0000 7fab4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:47.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.239+0000 7fac9a540800 20 remove_watcher() i=0 2024-09-12T17:25:47.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.239+0000 7fac9a540800 2 removed watcher, disabling cache 2024-09-12T17:25:47.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.240+0000 7fac9a540800 20 remove_watcher() i=1 2024-09-12T17:25:47.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.240+0000 7fac9a540800 20 remove_watcher() i=2 2024-09-12T17:25:47.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.241+0000 7fac9a540800 20 remove_watcher() i=3 2024-09-12T17:25:47.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.242+0000 7fac9a540800 20 remove_watcher() i=4 2024-09-12T17:25:47.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.244+0000 7fac9a540800 20 remove_watcher() i=5 2024-09-12T17:25:47.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.244+0000 7fac9a540800 20 remove_watcher() i=6 2024-09-12T17:25:47.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.245+0000 7fac9a540800 20 remove_watcher() i=7 2024-09-12T17:25:47.259 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:25:47.288 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:47.289 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:47.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.326+0000 7ff9ceb39800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.328+0000 7ff9ceb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:47.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.328+0000 7ff9ceb39800 20 realm 2024-09-12T17:25:47.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.328+0000 7ff9ceb39800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.328+0000 7ff9ceb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:47.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.328+0000 7ff9ceb39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:47.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.328+0000 7ff9ceb39800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.328+0000 7ff9ceb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:47.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.328+0000 7ff9ceb39800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.329+0000 7ff9ceb39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:47.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.329+0000 7ff9ceb39800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.330+0000 7ff9ceb39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:47.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.330+0000 7ff9ceb39800 20 searching for the correct realm 2024-09-12T17:25:47.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.332+0000 7ff9c1fc6640 0 -- 172.21.15.67:0/3687046677 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x564480735d10 msgr2=0x564480738100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:47.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.335+0000 7ff9ca7c7640 0 -- 172.21.15.67:0/3687046677 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7ff9b4027040 msgr2=0x7ff9b4068530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:25:47.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.540+0000 7ff9ceb39800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:47.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.540+0000 7ff9ceb39800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:47.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.540+0000 7ff9ceb39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:47.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.540+0000 7ff9ceb39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:47.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.540+0000 7ff9ceb39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:47.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.540+0000 7ff9ceb39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:47.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.540+0000 7ff9ceb39800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.541+0000 7ff9ceb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:47.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.541+0000 7ff9ceb39800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.541+0000 7ff9ceb39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:47.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.541+0000 7ff9ceb39800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.541+0000 7ff9ceb39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:47.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.541+0000 7ff9ceb39800 20 zone default found 2024-09-12T17:25:47.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.541+0000 7ff9ceb39800 4 Realm: () 2024-09-12T17:25:47.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.542+0000 7ff9ceb39800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:47.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.542+0000 7ff9ceb39800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:47.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.542+0000 7ff9ceb39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:47.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.542+0000 7ff9ceb39800 20 zonegroup default 2024-09-12T17:25:47.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.542+0000 7ff9ceb39800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.542+0000 7ff9ceb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:47.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.542+0000 7ff9ceb39800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.542+0000 7ff9ceb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:47.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.542+0000 7ff9ceb39800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.543+0000 7ff9ceb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:47.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.543+0000 7ff9ceb39800 20 started sync module instance, tier type = 2024-09-12T17:25:47.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.543+0000 7ff9ceb39800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:47.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.552+0000 7ff9ceb39800 20 add_watcher() i=0 2024-09-12T17:25:47.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.552+0000 7ff9ceb39800 20 add_watcher() i=1 2024-09-12T17:25:47.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.552+0000 7ff9ceb39800 20 add_watcher() i=2 2024-09-12T17:25:47.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.552+0000 7ff9ceb39800 20 add_watcher() i=3 2024-09-12T17:25:47.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.552+0000 7ff9ceb39800 20 add_watcher() i=4 2024-09-12T17:25:47.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.552+0000 7ff9ceb39800 20 add_watcher() i=5 2024-09-12T17:25:47.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.552+0000 7ff9ceb39800 20 add_watcher() i=6 2024-09-12T17:25:47.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.553+0000 7ff9ceb39800 20 add_watcher() i=7 2024-09-12T17:25:47.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.553+0000 7ff9ceb39800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:47.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.555+0000 7ff880fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:47.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.555+0000 7ff9ceb39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:47.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.555+0000 7ff9ceb39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:47.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.555+0000 7ff9ceb39800 5 note: GC not initialized 2024-09-12T17:25:47.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.555+0000 7ff7fb7fe640 20 reqs_thread_entry: start 2024-09-12T17:25:47.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.556+0000 7ff9ceb39800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:47.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.556+0000 7ff9ceb39800 20 Filter name: none 2024-09-12T17:25:47.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.556+0000 7ff7f97fa640 20 reqs_thread_entry: start 2024-09-12T17:25:47.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.556+0000 7ff9ceb39800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.556+0000 7ff9ceb39800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:25:47.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.556+0000 7ff9ceb39800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.557+0000 7ff9ceb39800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:25:47.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.557+0000 7ff9ceb39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:47.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.557+0000 7ff9ceb39800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.557+0000 7ff9ceb39800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:25:47.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.557+0000 7ff9ceb39800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.558+0000 7ff9ceb39800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:25:47.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.558+0000 7ff9ceb39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:47.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.559+0000 7ff880fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:47.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.561+0000 7ff9ceb39800 20 remove_watcher() i=0 2024-09-12T17:25:47.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.561+0000 7ff9ceb39800 2 removed watcher, disabling cache 2024-09-12T17:25:47.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.562+0000 7ff9ceb39800 20 remove_watcher() i=1 2024-09-12T17:25:47.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.563+0000 7ff9ceb39800 20 remove_watcher() i=2 2024-09-12T17:25:47.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.564+0000 7ff9ceb39800 20 remove_watcher() i=3 2024-09-12T17:25:47.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.565+0000 7ff9ceb39800 20 remove_watcher() i=4 2024-09-12T17:25:47.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.566+0000 7ff9ceb39800 20 remove_watcher() i=5 2024-09-12T17:25:47.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.567+0000 7ff9ceb39800 20 remove_watcher() i=6 2024-09-12T17:25:47.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.568+0000 7ff9ceb39800 20 remove_watcher() i=7 2024-09-12T17:25:47.581 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:47.581 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:25:47.581 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-commit-target-layout id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:25:47.581 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:47.583 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:47.583 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:47.618 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:47.618 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:47.676 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:25:47.708 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:47.708 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:47.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.747+0000 7f1f3dc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.748+0000 7f1f3dc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:47.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.748+0000 7f1f3dc0e800 20 realm 2024-09-12T17:25:47.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.748+0000 7f1f3dc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.749+0000 7f1f3dc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:47.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.749+0000 7f1f3dc0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:47.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.749+0000 7f1f3dc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.749+0000 7f1f3dc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:47.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.749+0000 7f1f3dc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.750+0000 7f1f3dc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:47.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.750+0000 7f1f3dc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.751+0000 7f1f3dc0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:47.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.751+0000 7f1f3dc0e800 20 searching for the correct realm 2024-09-12T17:25:47.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.753+0000 7f1f393e0640 0 -- 172.21.15.67:0/2823037288 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f1f3400c7a0 msgr2=0x7f1f34088130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:47.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.757+0000 7f1f393e0640 0 -- 172.21.15.67:0/2823037288 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f1f30074920 msgr2=0x7f1f30082400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:25:47.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.963+0000 7f1f3dc0e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:47.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.963+0000 7f1f3dc0e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:47.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.963+0000 7f1f3dc0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:47.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.963+0000 7f1f3dc0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:47.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.963+0000 7f1f3dc0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:47.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.963+0000 7f1f3dc0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:47.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.963+0000 7f1f3dc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.963+0000 7f1f3dc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:47.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.963+0000 7f1f3dc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.964+0000 7f1f3dc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:47.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.964+0000 7f1f3dc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.964+0000 7f1f3dc0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:47.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.964+0000 7f1f3dc0e800 20 zone default found 2024-09-12T17:25:47.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.964+0000 7f1f3dc0e800 4 Realm: () 2024-09-12T17:25:47.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.964+0000 7f1f3dc0e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:47.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.964+0000 7f1f3dc0e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:47.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.964+0000 7f1f3dc0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:47.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.964+0000 7f1f3dc0e800 20 zonegroup default 2024-09-12T17:25:47.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.964+0000 7f1f3dc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.964+0000 7f1f3dc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:47.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.964+0000 7f1f3dc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.965+0000 7f1f3dc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:47.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.965+0000 7f1f3dc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.965+0000 7f1f3dc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:47.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.965+0000 7f1f3dc0e800 20 started sync module instance, tier type = 2024-09-12T17:25:47.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.965+0000 7f1f3dc0e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:47.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.974+0000 7f1f3dc0e800 20 add_watcher() i=0 2024-09-12T17:25:47.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.974+0000 7f1f3dc0e800 20 add_watcher() i=1 2024-09-12T17:25:47.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.974+0000 7f1f3dc0e800 20 add_watcher() i=2 2024-09-12T17:25:47.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.974+0000 7f1f3dc0e800 20 add_watcher() i=3 2024-09-12T17:25:47.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.974+0000 7f1f3dc0e800 20 add_watcher() i=4 2024-09-12T17:25:47.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.974+0000 7f1f3dc0e800 20 add_watcher() i=5 2024-09-12T17:25:47.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.974+0000 7f1f3dc0e800 20 add_watcher() i=6 2024-09-12T17:25:47.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.975+0000 7f1f3dc0e800 20 add_watcher() i=7 2024-09-12T17:25:47.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.975+0000 7f1f3dc0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:47.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.976+0000 7f1deffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:47.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.977+0000 7f1f3dc0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:47.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.977+0000 7f1f3dc0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:47.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.977+0000 7f1f3dc0e800 5 note: GC not initialized 2024-09-12T17:25:47.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.977+0000 7f1deefe5640 20 reqs_thread_entry: start 2024-09-12T17:25:47.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.977+0000 7f1f3dc0e800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:47.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.977+0000 7f1f3dc0e800 20 Filter name: none 2024-09-12T17:25:47.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.977+0000 7f1decfe1640 20 reqs_thread_entry: start 2024-09-12T17:25:47.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.977+0000 7f1f3dc0e800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:25:47.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.977+0000 7f1f3dc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.978+0000 7f1f3dc0e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:25:47.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.978+0000 7f1f3dc0e800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:25:47.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.978+0000 7f1f3dc0e800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:25:47.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.978+0000 7f1f3dc0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 : miss 2024-09-12T17:25:47.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.978+0000 7f1f3dc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:47.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.979+0000 7f1f3dc0e800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:25:47.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.979+0000 7f1f3dc0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 info.flags=0x17 2024-09-12T17:25:47.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.979+0000 7f1f3dc0e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 to cache LRU end 2024-09-12T17:25:47.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.979+0000 7f1f3dc0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:25:47.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.979+0000 7f1f3dc0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:47.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.979+0000 7f1f3dc0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 2024-09-12T17:25:47.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.980+0000 7f1f3dc0e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:25:47.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.983+0000 7f1f3dc0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 info.flags=0x17 2024-09-12T17:25:47.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.983+0000 7f1f3dc0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 to cache LRU end 2024-09-12T17:25:47.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.983+0000 7f1f3dc0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:47.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.983+0000 7f1f3dc0e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31, ofs0, ns] 2024-09-12T17:25:47.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.984+0000 7f1e1cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464290 cookie 94846658396624 notifier 7281 bl.length()=1015 2024-09-12T17:25:47.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.984+0000 7f1e1cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 info.flags=0x17 2024-09-12T17:25:47.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.984+0000 7f1e1cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 to cache LRU end 2024-09-12T17:25:47.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.984+0000 7f1e1cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:47.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.985+0000 7f1f3dc0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.31]): orig_sources= new_sources= 2024-09-12T17:25:47.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.985+0000 7f1f3dc0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.31]): potential sources added=[] removed=[] 2024-09-12T17:25:47.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.985+0000 7f1f3dc0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.31]): orig_dests= new_dests= 2024-09-12T17:25:47.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.985+0000 7f1f3dc0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.31]): potential dests added=[] removed=[] 2024-09-12T17:25:47.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.988+0000 7f1f3dc0e800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.31.2.0 2024-09-12T17:25:47.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.988+0000 7f1f3dc0e800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.31.2.0 2024-09-12T17:25:47.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.988+0000 7f1f3dc0e800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.31.2.1 2024-09-12T17:25:47.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.988+0000 7f1f3dc0e800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.31.2.1 2024-09-12T17:25:47.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.988+0000 7f1f3dc0e800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.31.0 2024-09-12T17:25:47.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.990+0000 7f1f3dc0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 : hit (requested=0x17, cached=0x17) 2024-09-12T17:25:47.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.990+0000 7f1f3dc0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 2024-09-12T17:25:47.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.991+0000 7f1f3dc0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 info.flags=0x17 2024-09-12T17:25:47.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.991+0000 7f1f3dc0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 to cache LRU end 2024-09-12T17:25:47.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.991+0000 7f1f3dc0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:47.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.991+0000 7f1f3dc0e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31, ofs0, ns] 2024-09-12T17:25:47.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.992+0000 7f1e1cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464291 cookie 94846658396624 notifier 7281 bl.length()=1015 2024-09-12T17:25:47.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.992+0000 7f1e1cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 info.flags=0x17 2024-09-12T17:25:47.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.992+0000 7f1e1cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 to cache LRU end 2024-09-12T17:25:47.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.992+0000 7f1e1cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:47.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.993+0000 7f1f3dc0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.31]): orig_sources= new_sources= 2024-09-12T17:25:47.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.993+0000 7f1f3dc0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.31]): potential sources added=[] removed=[] 2024-09-12T17:25:47.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.993+0000 7f1f3dc0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.31]): orig_dests= new_dests= 2024-09-12T17:25:47.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.993+0000 7f1f3dc0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.31]): potential dests added=[] removed=[] 2024-09-12T17:25:47.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.994+0000 7f1f3dc0e800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.31.0 2024-09-12T17:25:47.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.995+0000 7f1f3dc0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 : hit (requested=0x17, cached=0x17) 2024-09-12T17:25:47.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.995+0000 7f1f3dc0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 2024-09-12T17:25:47.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.996+0000 7f1f3dc0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 info.flags=0x17 2024-09-12T17:25:47.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.996+0000 7f1f3dc0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 to cache LRU end 2024-09-12T17:25:47.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.996+0000 7f1f3dc0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:47.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.996+0000 7f1f3dc0e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31, ofs0, ns] 2024-09-12T17:25:47.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.996+0000 7f1e0bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464292 cookie 94846658396624 notifier 7281 bl.length()=983 2024-09-12T17:25:47.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.996+0000 7f1e0bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 info.flags=0x17 2024-09-12T17:25:47.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.996+0000 7f1e0bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 to cache LRU end 2024-09-12T17:25:47.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.996+0000 7f1e0bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:47.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.998+0000 7f1f3dc0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.31]): orig_sources= new_sources= 2024-09-12T17:25:47.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.998+0000 7f1f3dc0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.31]): potential sources added=[] removed=[] 2024-09-12T17:25:47.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.998+0000 7f1f3dc0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.31]): orig_dests= new_dests= 2024-09-12T17:25:47.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.998+0000 7f1f3dc0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.31]): potential dests added=[] removed=[] 2024-09-12T17:25:48.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:47.999+0000 7f1f3dc0e800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T17:25:48.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.001+0000 7f1deffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:48.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.002+0000 7f1f3dc0e800 20 remove_watcher() i=0 2024-09-12T17:25:48.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.002+0000 7f1f3dc0e800 2 removed watcher, disabling cache 2024-09-12T17:25:48.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.003+0000 7f1f3dc0e800 20 remove_watcher() i=1 2024-09-12T17:25:48.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.004+0000 7f1f3dc0e800 20 remove_watcher() i=2 2024-09-12T17:25:48.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.005+0000 7f1f3dc0e800 20 remove_watcher() i=3 2024-09-12T17:25:48.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.007+0000 7f1f3dc0e800 20 remove_watcher() i=4 2024-09-12T17:25:48.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.008+0000 7f1f3dc0e800 20 remove_watcher() i=5 2024-09-12T17:25:48.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.009+0000 7f1f3dc0e800 20 remove_watcher() i=6 2024-09-12T17:25:48.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.010+0000 7f1f3dc0e800 20 remove_watcher() i=7 2024-09-12T17:25:48.023 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:25:48.053 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:48.053 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:48.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.091+0000 7f8e1fc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:48.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.093+0000 7f8e1fc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:48.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.093+0000 7f8e1fc0e800 20 realm 2024-09-12T17:25:48.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.093+0000 7f8e1fc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:48.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.093+0000 7f8e1fc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:48.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.093+0000 7f8e1fc0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:48.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.093+0000 7f8e1fc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:48.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.093+0000 7f8e1fc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:48.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.093+0000 7f8e1fc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:48.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.094+0000 7f8e1fc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:48.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.094+0000 7f8e1fc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:48.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.095+0000 7f8e1fc0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:48.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.095+0000 7f8e1fc0e800 20 searching for the correct realm 2024-09-12T17:25:48.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.096+0000 7f8e1b259640 0 -- 172.21.15.67:0/874821067 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f8e1406da40 msgr2=0x7f8e140639c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:48.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.100+0000 7f8e1b259640 0 -- 172.21.15.67:0/874821067 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f8ce4086290 msgr2=0x7f8ce40886c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:48.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.105+0000 7f8e1fc0e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:48.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.105+0000 7f8e1fc0e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:48.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.105+0000 7f8e1fc0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:48.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.105+0000 7f8e1fc0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:48.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.105+0000 7f8e1fc0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:48.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.105+0000 7f8e1fc0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:48.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.105+0000 7f8e1fc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:48.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.105+0000 7f8e1fc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:48.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.105+0000 7f8e1fc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:48.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.106+0000 7f8e1fc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:48.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.106+0000 7f8e1fc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:48.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.106+0000 7f8e1fc0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:48.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.106+0000 7f8e1fc0e800 20 zone default found 2024-09-12T17:25:48.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.106+0000 7f8e1fc0e800 4 Realm: () 2024-09-12T17:25:48.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.106+0000 7f8e1fc0e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:48.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.106+0000 7f8e1fc0e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:48.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.106+0000 7f8e1fc0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:48.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.106+0000 7f8e1fc0e800 20 zonegroup default 2024-09-12T17:25:48.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.106+0000 7f8e1fc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:48.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.106+0000 7f8e1fc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:48.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.106+0000 7f8e1fc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:48.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.107+0000 7f8e1fc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:48.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.107+0000 7f8e1fc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:48.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.107+0000 7f8e1fc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:48.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.107+0000 7f8e1fc0e800 20 started sync module instance, tier type = 2024-09-12T17:25:48.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.107+0000 7f8e1fc0e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:48.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.116+0000 7f8e1fc0e800 20 add_watcher() i=0 2024-09-12T17:25:48.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.116+0000 7f8e1fc0e800 20 add_watcher() i=1 2024-09-12T17:25:48.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.116+0000 7f8e1fc0e800 20 add_watcher() i=2 2024-09-12T17:25:48.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.116+0000 7f8e1fc0e800 20 add_watcher() i=3 2024-09-12T17:25:48.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.116+0000 7f8e1fc0e800 20 add_watcher() i=4 2024-09-12T17:25:48.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.116+0000 7f8e1fc0e800 20 add_watcher() i=5 2024-09-12T17:25:48.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.116+0000 7f8e1fc0e800 20 add_watcher() i=6 2024-09-12T17:25:48.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.117+0000 7f8e1fc0e800 20 add_watcher() i=7 2024-09-12T17:25:48.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.117+0000 7f8e1fc0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:48.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.118+0000 7f8cd1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:48.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.118+0000 7f8e1fc0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:48.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.118+0000 7f8e1fc0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:48.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.118+0000 7f8e1fc0e800 5 note: GC not initialized 2024-09-12T17:25:48.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.119+0000 7f8cd0fe1640 20 reqs_thread_entry: start 2024-09-12T17:25:48.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.119+0000 7f8e1fc0e800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:48.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.119+0000 7f8e1fc0e800 20 Filter name: none 2024-09-12T17:25:48.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.119+0000 7f8c4a7fc640 20 reqs_thread_entry: start 2024-09-12T17:25:48.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.119+0000 7f8e1fc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:48.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.119+0000 7f8e1fc0e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:25:48.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.119+0000 7f8e1fc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:48.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.120+0000 7f8e1fc0e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:25:48.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.120+0000 7f8e1fc0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:48.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.120+0000 7f8e1fc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:48.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.120+0000 7f8e1fc0e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:25:48.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.120+0000 7f8e1fc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:25:48.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.121+0000 7f8e1fc0e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:25:48.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.121+0000 7f8e1fc0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:48.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.122+0000 7f8cd1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:48.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.124+0000 7f8e1fc0e800 20 remove_watcher() i=0 2024-09-12T17:25:48.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.124+0000 7f8e1fc0e800 2 removed watcher, disabling cache 2024-09-12T17:25:48.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.125+0000 7f8e1fc0e800 20 remove_watcher() i=1 2024-09-12T17:25:48.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.126+0000 7f8e1fc0e800 20 remove_watcher() i=2 2024-09-12T17:25:48.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.127+0000 7f8e1fc0e800 20 remove_watcher() i=3 2024-09-12T17:25:48.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.128+0000 7f8e1fc0e800 20 remove_watcher() i=4 2024-09-12T17:25:48.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.129+0000 7f8e1fc0e800 20 remove_watcher() i=5 2024-09-12T17:25:48.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.130+0000 7f8e1fc0e800 20 remove_watcher() i=6 2024-09-12T17:25:48.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:48.131+0000 7f8e1fc0e800 20 remove_watcher() i=7 2024-09-12T17:25:48.143 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:48.143 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:25:48.143 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-commit-target-layout id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.31 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:25:48.143 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:48.145 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:48.145 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:48.167 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:48.167 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:48.387 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:48.387 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:48.452 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-12T17:25:48.453 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:48.454 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:48.454 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:48.495 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:48.496 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:48.552 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:48.552 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:48.586 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:48.586 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:48.623 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:48.623 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:48.659 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:48.659 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:48.695 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:48.695 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:48.733 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:48.733 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:48.768 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:48.768 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:48.803 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:48.803 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:48.840 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:48.840 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:48.875 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:48.876 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:48.912 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:48.912 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:48.948 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:48.949 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:48.985 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:48.985 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:49.022 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:49.022 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:49.059 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:49.059 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:49.095 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:49.095 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:49.131 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:49.131 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:49.168 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:49.168 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:49.205 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:49.205 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:49.241 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:49.241 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:49.279 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:25:49.308 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:49.308 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:49.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.346+0000 7fe777117800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.348+0000 7fe777117800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:49.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.348+0000 7fe777117800 20 realm 2024-09-12T17:25:49.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.348+0000 7fe777117800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.349+0000 7fe777117800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:49.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.349+0000 7fe777117800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:49.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.349+0000 7fe777117800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.349+0000 7fe777117800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:49.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.349+0000 7fe777117800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.350+0000 7fe777117800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:49.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.350+0000 7fe777117800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.350+0000 7fe777117800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:49.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.350+0000 7fe777117800 20 searching for the correct realm 2024-09-12T17:25:49.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.353+0000 7fe774c01640 0 -- 172.21.15.67:0/3499488316 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7fe76c064d30 msgr2=0x7fe76c0637a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:49.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.356+0000 7fe774c01640 0 -- 172.21.15.67:0/3499488316 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fe768086b80 msgr2=0x7fe76804c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:49.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.562+0000 7fe777117800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:49.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.562+0000 7fe777117800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:49.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.562+0000 7fe777117800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:49.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.562+0000 7fe777117800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:49.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.562+0000 7fe777117800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:49.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.562+0000 7fe777117800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:49.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.562+0000 7fe777117800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.562+0000 7fe777117800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:49.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.562+0000 7fe777117800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.562+0000 7fe777117800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:49.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.562+0000 7fe777117800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.563+0000 7fe777117800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:49.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.563+0000 7fe777117800 20 zone default found 2024-09-12T17:25:49.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.563+0000 7fe777117800 4 Realm: () 2024-09-12T17:25:49.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.563+0000 7fe777117800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:49.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.563+0000 7fe777117800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:49.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.563+0000 7fe777117800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:49.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.563+0000 7fe777117800 20 zonegroup default 2024-09-12T17:25:49.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.563+0000 7fe777117800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.563+0000 7fe777117800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:49.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.563+0000 7fe777117800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.563+0000 7fe777117800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:49.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.563+0000 7fe777117800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.564+0000 7fe777117800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:49.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.564+0000 7fe777117800 20 started sync module instance, tier type = 2024-09-12T17:25:49.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.564+0000 7fe777117800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:49.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.573+0000 7fe777117800 20 add_watcher() i=0 2024-09-12T17:25:49.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.573+0000 7fe777117800 20 add_watcher() i=1 2024-09-12T17:25:49.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.573+0000 7fe777117800 20 add_watcher() i=2 2024-09-12T17:25:49.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.573+0000 7fe777117800 20 add_watcher() i=3 2024-09-12T17:25:49.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.573+0000 7fe777117800 20 add_watcher() i=4 2024-09-12T17:25:49.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.573+0000 7fe777117800 20 add_watcher() i=5 2024-09-12T17:25:49.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.573+0000 7fe777117800 20 add_watcher() i=6 2024-09-12T17:25:49.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.574+0000 7fe777117800 20 add_watcher() i=7 2024-09-12T17:25:49.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.574+0000 7fe777117800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:49.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.576+0000 7fe62afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:49.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.576+0000 7fe777117800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:49.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.576+0000 7fe777117800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:49.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.576+0000 7fe777117800 5 note: GC not initialized 2024-09-12T17:25:49.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.576+0000 7fe629fe3640 20 reqs_thread_entry: start 2024-09-12T17:25:49.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.576+0000 7fe777117800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:49.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.576+0000 7fe777117800 20 Filter name: none 2024-09-12T17:25:49.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.577+0000 7fe59b7fe640 20 reqs_thread_entry: start 2024-09-12T17:25:49.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.577+0000 7fe777117800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.577+0000 7fe777117800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:25:49.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.577+0000 7fe777117800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.578+0000 7fe777117800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:25:49.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.578+0000 7fe777117800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:49.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.578+0000 7fe777117800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.578+0000 7fe777117800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:25:49.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.578+0000 7fe777117800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.578+0000 7fe777117800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:25:49.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.578+0000 7fe777117800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:49.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.579+0000 7fe62afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:49.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.582+0000 7fe777117800 20 remove_watcher() i=0 2024-09-12T17:25:49.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.582+0000 7fe777117800 2 removed watcher, disabling cache 2024-09-12T17:25:49.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.583+0000 7fe777117800 20 remove_watcher() i=1 2024-09-12T17:25:49.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.583+0000 7fe777117800 20 remove_watcher() i=2 2024-09-12T17:25:49.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.585+0000 7fe777117800 20 remove_watcher() i=3 2024-09-12T17:25:49.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.586+0000 7fe777117800 20 remove_watcher() i=4 2024-09-12T17:25:49.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.587+0000 7fe777117800 20 remove_watcher() i=5 2024-09-12T17:25:49.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.588+0000 7fe777117800 20 remove_watcher() i=6 2024-09-12T17:25:49.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.589+0000 7fe777117800 20 remove_watcher() i=7 2024-09-12T17:25:49.601 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:49.601 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:25:49.601 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-commit-target-layout id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.32 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:25:49.601 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:49.603 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-12T17:25:49.639 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:49.639 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:49.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.677+0000 7f250ca2f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.679+0000 7f250ca2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:49.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.679+0000 7f250ca2f800 20 realm 2024-09-12T17:25:49.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.679+0000 7f250ca2f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.679+0000 7f250ca2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:49.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.679+0000 7f250ca2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:49.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.679+0000 7f250ca2f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.679+0000 7f250ca2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:49.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.679+0000 7f250ca2f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.680+0000 7f250ca2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:49.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.680+0000 7f250ca2f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.681+0000 7f250ca2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:49.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.681+0000 7f250ca2f800 20 searching for the correct realm 2024-09-12T17:25:49.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.683+0000 7f250ad21640 0 -- 172.21.15.67:0/1156896791 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x55cce797bc40 msgr2=0x55cce797e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:25:49.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.687+0000 7f250a520640 0 -- 172.21.15.67:0/1156896791 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f25000093c0 msgr2=0x7f25000c3040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:49.692 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.691+0000 7f250ca2f800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:49.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.691+0000 7f250ca2f800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:49.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.691+0000 7f250ca2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:49.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.691+0000 7f250ca2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:49.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.691+0000 7f250ca2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:49.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.691+0000 7f250ca2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:49.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.691+0000 7f250ca2f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.692+0000 7f250ca2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:49.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.692+0000 7f250ca2f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.692+0000 7f250ca2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:49.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.692+0000 7f250ca2f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.692+0000 7f250ca2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:49.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.692+0000 7f250ca2f800 20 zone default found 2024-09-12T17:25:49.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.692+0000 7f250ca2f800 4 Realm: () 2024-09-12T17:25:49.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.692+0000 7f250ca2f800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:49.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.692+0000 7f250ca2f800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:49.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.692+0000 7f250ca2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:49.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.692+0000 7f250ca2f800 20 zonegroup default 2024-09-12T17:25:49.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.692+0000 7f250ca2f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.692+0000 7f250ca2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:49.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.692+0000 7f250ca2f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.693+0000 7f250ca2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:49.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.693+0000 7f250ca2f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.693+0000 7f250ca2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:49.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.693+0000 7f250ca2f800 20 started sync module instance, tier type = 2024-09-12T17:25:49.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.693+0000 7f250ca2f800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:49.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.702+0000 7f250ca2f800 20 add_watcher() i=0 2024-09-12T17:25:49.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.702+0000 7f250ca2f800 20 add_watcher() i=1 2024-09-12T17:25:49.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.702+0000 7f250ca2f800 20 add_watcher() i=2 2024-09-12T17:25:49.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.702+0000 7f250ca2f800 20 add_watcher() i=3 2024-09-12T17:25:49.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.702+0000 7f250ca2f800 20 add_watcher() i=4 2024-09-12T17:25:49.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.702+0000 7f250ca2f800 20 add_watcher() i=5 2024-09-12T17:25:49.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.702+0000 7f250ca2f800 20 add_watcher() i=6 2024-09-12T17:25:49.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.703+0000 7f250ca2f800 20 add_watcher() i=7 2024-09-12T17:25:49.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.703+0000 7f250ca2f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:49.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.705+0000 7f23c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:49.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.705+0000 7f250ca2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:49.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.705+0000 7f250ca2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:49.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.705+0000 7f250ca2f800 5 note: GC not initialized 2024-09-12T17:25:49.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.705+0000 7f233b7fe640 20 reqs_thread_entry: start 2024-09-12T17:25:49.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.705+0000 7f250ca2f800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:49.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.705+0000 7f250ca2f800 20 Filter name: none 2024-09-12T17:25:49.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.705+0000 7f23397fa640 20 reqs_thread_entry: start 2024-09-12T17:25:49.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.705+0000 7f250ca2f800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:25:49.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.706+0000 7f250ca2f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.706+0000 7f250ca2f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:25:49.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.706+0000 7f250ca2f800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:25:49.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.706+0000 7f250ca2f800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:25:49.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.706+0000 7f250ca2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32 : miss 2024-09-12T17:25:49.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.706+0000 7f250ca2f800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.706+0000 7f250ca2f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:25:49.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.706+0000 7f250ca2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32 info.flags=0x17 2024-09-12T17:25:49.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.706+0000 7f250ca2f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32 to cache LRU end 2024-09-12T17:25:49.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.706+0000 7f250ca2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:25:49.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.706+0000 7f250ca2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:49.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.706+0000 7f250ca2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32 2024-09-12T17:25:49.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.710+0000 7f250ca2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32 info.flags=0x17 2024-09-12T17:25:49.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.710+0000 7f250ca2f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32 to cache LRU end 2024-09-12T17:25:49.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.710+0000 7f250ca2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:49.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.710+0000 7f250ca2f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32, ofs0, ns] 2024-09-12T17:25:49.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.710+0000 7f23edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464295 cookie 94338547185584 notifier 6896 bl.length()=1015 2024-09-12T17:25:49.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.710+0000 7f23edffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32 info.flags=0x17 2024-09-12T17:25:49.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.710+0000 7f23edffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32 to cache LRU end 2024-09-12T17:25:49.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.710+0000 7f23edffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:49.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.712+0000 7f250ca2f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.32]): orig_sources= new_sources= 2024-09-12T17:25:49.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.712+0000 7f250ca2f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.32]): potential sources added=[] removed=[] 2024-09-12T17:25:49.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.712+0000 7f250ca2f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.32]): orig_dests= new_dests= 2024-09-12T17:25:49.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.712+0000 7f250ca2f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.32]): potential dests added=[] removed=[] 2024-09-12T17:25:49.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.714+0000 7f250ca2f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.32.1.0 2024-09-12T17:25:49.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.714+0000 7f250ca2f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.32.1.0 2024-09-12T17:25:49.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.714+0000 7f250ca2f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.32.1.1 2024-09-12T17:25:49.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.714+0000 7f250ca2f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.32.1.1 2024-09-12T17:25:49.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.714+0000 7f250ca2f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.32.0 2024-09-12T17:25:49.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.716+0000 7f250ca2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:25:49.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.716+0000 7f250ca2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32 2024-09-12T17:25:49.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.717+0000 7f250ca2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32 info.flags=0x17 2024-09-12T17:25:49.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.717+0000 7f250ca2f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32 to cache LRU end 2024-09-12T17:25:49.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.717+0000 7f250ca2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:49.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.717+0000 7f250ca2f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32, ofs0, ns] 2024-09-12T17:25:49.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.718+0000 7f23edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464296 cookie 94338547185584 notifier 6896 bl.length()=1015 2024-09-12T17:25:49.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.718+0000 7f23edffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32 info.flags=0x17 2024-09-12T17:25:49.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.718+0000 7f23edffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32 to cache LRU end 2024-09-12T17:25:49.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.718+0000 7f23edffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:49.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.719+0000 7f250ca2f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.32]): orig_sources= new_sources= 2024-09-12T17:25:49.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.719+0000 7f250ca2f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.32]): potential sources added=[] removed=[] 2024-09-12T17:25:49.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.719+0000 7f250ca2f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.32]): orig_dests= new_dests= 2024-09-12T17:25:49.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.719+0000 7f250ca2f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.32]): potential dests added=[] removed=[] 2024-09-12T17:25:49.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.720+0000 7f250ca2f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.32.0 2024-09-12T17:25:49.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.720+0000 7f250ca2f800 -1 Injecting error=-125 at location=commit_target_layout 2024-09-12T17:25:49.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.720+0000 7f250ca2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:25:49.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.720+0000 7f250ca2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32 2024-09-12T17:25:49.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.721+0000 7f250ca2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32 info.flags=0x17 2024-09-12T17:25:49.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.721+0000 7f250ca2f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32 to cache LRU end 2024-09-12T17:25:49.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.721+0000 7f250ca2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:49.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.721+0000 7f250ca2f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32, ofs0, ns] 2024-09-12T17:25:49.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.722+0000 7f23ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464297 cookie 94338547185584 notifier 6896 bl.length()=983 2024-09-12T17:25:49.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.722+0000 7f23ed7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32 info.flags=0x17 2024-09-12T17:25:49.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.722+0000 7f23ed7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32 to cache LRU end 2024-09-12T17:25:49.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.722+0000 7f23ed7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:49.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.723+0000 7f250ca2f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.32]): orig_sources= new_sources= 2024-09-12T17:25:49.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.723+0000 7f250ca2f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.32]): potential sources added=[] removed=[] 2024-09-12T17:25:49.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.723+0000 7f250ca2f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.32]): orig_dests= new_dests= 2024-09-12T17:25:49.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.723+0000 7f250ca2f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.32]): potential dests added=[] removed=[] 2024-09-12T17:25:49.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.724+0000 7f250ca2f800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T17:25:49.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.726+0000 7f23c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:49.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.728+0000 7f250ca2f800 20 remove_watcher() i=0 2024-09-12T17:25:49.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.728+0000 7f250ca2f800 2 removed watcher, disabling cache 2024-09-12T17:25:49.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.729+0000 7f250ca2f800 20 remove_watcher() i=1 2024-09-12T17:25:49.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.730+0000 7f250ca2f800 20 remove_watcher() i=2 2024-09-12T17:25:49.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.731+0000 7f250ca2f800 20 remove_watcher() i=3 2024-09-12T17:25:49.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.732+0000 7f250ca2f800 20 remove_watcher() i=4 2024-09-12T17:25:49.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.733+0000 7f250ca2f800 20 remove_watcher() i=5 2024-09-12T17:25:49.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.734+0000 7f250ca2f800 20 remove_watcher() i=6 2024-09-12T17:25:49.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.735+0000 7f250ca2f800 20 remove_watcher() i=7 2024-09-12T17:25:49.748 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:25:49.777 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:49.778 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:49.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.816+0000 7f48d0f35800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.817+0000 7f48d0f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:49.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.817+0000 7f48d0f35800 20 realm 2024-09-12T17:25:49.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.817+0000 7f48d0f35800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.818+0000 7f48d0f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:49.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.818+0000 7f48d0f35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:49.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.818+0000 7f48d0f35800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.818+0000 7f48d0f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:49.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.818+0000 7f48d0f35800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.819+0000 7f48d0f35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:49.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.819+0000 7f48d0f35800 20 rados->read ofs=0 len=0 2024-09-12T17:25:49.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.820+0000 7f48d0f35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:49.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.820+0000 7f48d0f35800 20 searching for the correct realm 2024-09-12T17:25:49.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.822+0000 7f48cc4e3640 0 -- 172.21.15.67:0/473416598 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x560d27b40d30 msgr2=0x560d27b43120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:49.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:49.825+0000 7f48ccce4640 0 -- 172.21.15.67:0/473416598 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f48c008a040 msgr2=0x7f48c008b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:50.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.032+0000 7f48d0f35800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:50.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.032+0000 7f48d0f35800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:50.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.032+0000 7f48d0f35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:50.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.032+0000 7f48d0f35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:50.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.032+0000 7f48d0f35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:50.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.032+0000 7f48d0f35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:50.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.032+0000 7f48d0f35800 20 rados->read ofs=0 len=0 2024-09-12T17:25:50.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.032+0000 7f48d0f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:50.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.032+0000 7f48d0f35800 20 rados->read ofs=0 len=0 2024-09-12T17:25:50.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.032+0000 7f48d0f35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:50.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.032+0000 7f48d0f35800 20 rados->read ofs=0 len=0 2024-09-12T17:25:50.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.033+0000 7f48d0f35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:50.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.033+0000 7f48d0f35800 20 zone default found 2024-09-12T17:25:50.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.033+0000 7f48d0f35800 4 Realm: () 2024-09-12T17:25:50.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.033+0000 7f48d0f35800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:50.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.033+0000 7f48d0f35800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:50.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.033+0000 7f48d0f35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:50.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.033+0000 7f48d0f35800 20 zonegroup default 2024-09-12T17:25:50.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.033+0000 7f48d0f35800 20 rados->read ofs=0 len=0 2024-09-12T17:25:50.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.033+0000 7f48d0f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:50.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.033+0000 7f48d0f35800 20 rados->read ofs=0 len=0 2024-09-12T17:25:50.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.034+0000 7f48d0f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:50.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.034+0000 7f48d0f35800 20 rados->read ofs=0 len=0 2024-09-12T17:25:50.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.034+0000 7f48d0f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:50.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.034+0000 7f48d0f35800 20 started sync module instance, tier type = 2024-09-12T17:25:50.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.034+0000 7f48d0f35800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:50.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.043+0000 7f48d0f35800 20 add_watcher() i=0 2024-09-12T17:25:50.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.043+0000 7f48d0f35800 20 add_watcher() i=1 2024-09-12T17:25:50.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.043+0000 7f48d0f35800 20 add_watcher() i=2 2024-09-12T17:25:50.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.043+0000 7f48d0f35800 20 add_watcher() i=3 2024-09-12T17:25:50.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.043+0000 7f48d0f35800 20 add_watcher() i=4 2024-09-12T17:25:50.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.043+0000 7f48d0f35800 20 add_watcher() i=5 2024-09-12T17:25:50.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.043+0000 7f48d0f35800 20 add_watcher() i=6 2024-09-12T17:25:50.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.044+0000 7f48d0f35800 20 add_watcher() i=7 2024-09-12T17:25:50.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.044+0000 7f48d0f35800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:50.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.045+0000 7f4782fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:50.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.046+0000 7f48d0f35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:50.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.046+0000 7f48d0f35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:50.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.046+0000 7f48d0f35800 5 note: GC not initialized 2024-09-12T17:25:50.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.046+0000 7f4781fe3640 20 reqs_thread_entry: start 2024-09-12T17:25:50.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.046+0000 7f48d0f35800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:50.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.046+0000 7f48d0f35800 20 Filter name: none 2024-09-12T17:25:50.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.046+0000 7f46f37fe640 20 reqs_thread_entry: start 2024-09-12T17:25:50.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.046+0000 7f48d0f35800 20 rados->read ofs=0 len=0 2024-09-12T17:25:50.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.047+0000 7f48d0f35800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:25:50.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.047+0000 7f48d0f35800 20 rados->read ofs=0 len=0 2024-09-12T17:25:50.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.048+0000 7f48d0f35800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:25:50.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.048+0000 7f48d0f35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:50.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.048+0000 7f48d0f35800 20 rados->read ofs=0 len=0 2024-09-12T17:25:50.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.048+0000 7f48d0f35800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:25:50.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.048+0000 7f48d0f35800 20 rados->read ofs=0 len=0 2024-09-12T17:25:50.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.049+0000 7f48d0f35800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:25:50.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.049+0000 7f48d0f35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:50.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.050+0000 7f4782fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:50.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.052+0000 7f48d0f35800 20 remove_watcher() i=0 2024-09-12T17:25:50.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.052+0000 7f48d0f35800 2 removed watcher, disabling cache 2024-09-12T17:25:50.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.053+0000 7f48d0f35800 20 remove_watcher() i=1 2024-09-12T17:25:50.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.054+0000 7f48d0f35800 20 remove_watcher() i=2 2024-09-12T17:25:50.056 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.055+0000 7f48d0f35800 20 remove_watcher() i=3 2024-09-12T17:25:50.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.056+0000 7f48d0f35800 20 remove_watcher() i=4 2024-09-12T17:25:50.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.057+0000 7f48d0f35800 20 remove_watcher() i=5 2024-09-12T17:25:50.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.058+0000 7f48d0f35800 20 remove_watcher() i=6 2024-09-12T17:25:50.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:50.059+0000 7f48d0f35800 20 remove_watcher() i=7 2024-09-12T17:25:50.071 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:50.071 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:25:50.071 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-commit-target-layout id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.32 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T17:25:50.072 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:50.073 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:50.074 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:50.095 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:50.095 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:50.337 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:50.338 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:50.403 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-12T17:25:50.403 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:50.405 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:50.405 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:50.447 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:50.447 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:50.504 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:50.505 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:50.543 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:50.543 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:50.580 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:50.580 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:50.615 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:50.615 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:50.651 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:50.652 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:50.687 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:50.687 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:50.727 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:50.727 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:50.764 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:50.764 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:50.798 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:50.798 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:50.834 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:50.834 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:50.869 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:50.870 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:50.906 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:50.906 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:50.941 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:50.941 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:50.977 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:50.978 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:51.012 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:51.012 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:51.048 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:51.049 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:51.088 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:51.088 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:51.124 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:51.124 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:51.160 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:51.160 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:51.197 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:51.197 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:25:51.233 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:25:51.262 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:51.262 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:51.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.300+0000 7f94c193d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.302+0000 7f94c193d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.302+0000 7f94c193d800 20 realm 2024-09-12T17:25:51.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.302+0000 7f94c193d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.302+0000 7f94c193d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.302+0000 7f94c193d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:51.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.302+0000 7f94c193d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.302+0000 7f94c193d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.302+0000 7f94c193d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.303+0000 7f94c193d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:51.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.303+0000 7f94c193d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.304+0000 7f94c193d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:51.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.304+0000 7f94c193d800 20 searching for the correct realm 2024-09-12T17:25:51.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.306+0000 7f94bde2b640 0 -- 172.21.15.67:0/2807892605 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x559a98f44660 msgr2=0x559a98f46b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:25:51.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.310+0000 7f94bd62a640 0 -- 172.21.15.67:0/2807892605 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f94b4096b60 msgr2=0x7f94b408f8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:51.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.315+0000 7f94c193d800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:51.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.315+0000 7f94c193d800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:51.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.315+0000 7f94c193d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:51.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.315+0000 7f94c193d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:51.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.315+0000 7f94c193d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:51.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.315+0000 7f94c193d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:51.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.315+0000 7f94c193d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.315+0000 7f94c193d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.315+0000 7f94c193d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.315+0000 7f94c193d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:51.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.315+0000 7f94c193d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.316+0000 7f94c193d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:51.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.316+0000 7f94c193d800 20 zone default found 2024-09-12T17:25:51.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.316+0000 7f94c193d800 4 Realm: () 2024-09-12T17:25:51.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.316+0000 7f94c193d800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:51.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.316+0000 7f94c193d800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:51.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.316+0000 7f94c193d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:51.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.316+0000 7f94c193d800 20 zonegroup default 2024-09-12T17:25:51.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.316+0000 7f94c193d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.316+0000 7f94c193d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.316+0000 7f94c193d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.316+0000 7f94c193d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.316+0000 7f94c193d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.317+0000 7f94c193d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.317+0000 7f94c193d800 20 started sync module instance, tier type = 2024-09-12T17:25:51.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.317+0000 7f94c193d800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:51.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.325+0000 7f94c193d800 20 add_watcher() i=0 2024-09-12T17:25:51.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.325+0000 7f94c193d800 20 add_watcher() i=1 2024-09-12T17:25:51.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.325+0000 7f94c193d800 20 add_watcher() i=2 2024-09-12T17:25:51.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.325+0000 7f94c193d800 20 add_watcher() i=3 2024-09-12T17:25:51.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.325+0000 7f94c193d800 20 add_watcher() i=4 2024-09-12T17:25:51.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.325+0000 7f94c193d800 20 add_watcher() i=5 2024-09-12T17:25:51.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.325+0000 7f94c193d800 20 add_watcher() i=6 2024-09-12T17:25:51.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.326+0000 7f94c193d800 20 add_watcher() i=7 2024-09-12T17:25:51.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.326+0000 7f94c193d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:51.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.328+0000 7f93737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:51.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.328+0000 7f94c193d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:51.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.328+0000 7f94c193d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:51.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.328+0000 7f94c193d800 5 note: GC not initialized 2024-09-12T17:25:51.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.328+0000 7f93727e4640 20 reqs_thread_entry: start 2024-09-12T17:25:51.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.329+0000 7f94c193d800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:51.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.329+0000 7f94c193d800 20 Filter name: none 2024-09-12T17:25:51.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.329+0000 7f92e3fff640 20 reqs_thread_entry: start 2024-09-12T17:25:51.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.329+0000 7f94c193d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.329+0000 7f94c193d800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:25:51.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.329+0000 7f94c193d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.330+0000 7f94c193d800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:25:51.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.330+0000 7f94c193d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:51.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.330+0000 7f94c193d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.330+0000 7f94c193d800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:25:51.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.330+0000 7f94c193d800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.330+0000 7f94c193d800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:25:51.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.330+0000 7f94c193d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:51.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.332+0000 7f93737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:51.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.334+0000 7f94c193d800 20 remove_watcher() i=0 2024-09-12T17:25:51.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.334+0000 7f94c193d800 2 removed watcher, disabling cache 2024-09-12T17:25:51.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.335+0000 7f94c193d800 20 remove_watcher() i=1 2024-09-12T17:25:51.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.336+0000 7f94c193d800 20 remove_watcher() i=2 2024-09-12T17:25:51.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.337+0000 7f94c193d800 20 remove_watcher() i=3 2024-09-12T17:25:51.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.338+0000 7f94c193d800 20 remove_watcher() i=4 2024-09-12T17:25:51.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.339+0000 7f94c193d800 20 remove_watcher() i=5 2024-09-12T17:25:51.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.340+0000 7f94c193d800 20 remove_watcher() i=6 2024-09-12T17:25:51.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.341+0000 7f94c193d800 20 remove_watcher() i=7 2024-09-12T17:25:51.353 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.353 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:25:51.353 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-commit-target-layout id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:25:51.353 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.354 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-12T17:25:51.389 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:51.389 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:51.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.426+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.428+0000 7f594cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.428+0000 7f594cd42800 20 realm 2024-09-12T17:25:51.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.428+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.429+0000 7f594cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.429+0000 7f594cd42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:51.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.429+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.429+0000 7f594cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.429+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.429+0000 7f594cd42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:51.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.429+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.430+0000 7f594cd42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:51.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.430+0000 7f594cd42800 20 searching for the correct realm 2024-09-12T17:25:51.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.433+0000 7f5949287640 0 -- 172.21.15.67:0/1645958681 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x55c2265e92a0 msgr2=0x55c2265eb760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:51.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.437+0000 7f5948a86640 0 -- 172.21.15.67:0/1645958681 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f5930046b70 msgr2=0x7f593003e460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:51.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.441+0000 7f594cd42800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:51.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.441+0000 7f594cd42800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:51.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.441+0000 7f594cd42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:51.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.441+0000 7f594cd42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:51.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.441+0000 7f594cd42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:51.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.441+0000 7f594cd42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:51.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.441+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.441+0000 7f594cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.441+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.441+0000 7f594cd42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:51.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.441+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.441+0000 7f594cd42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:51.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.441+0000 7f594cd42800 20 zone default found 2024-09-12T17:25:51.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.441+0000 7f594cd42800 4 Realm: () 2024-09-12T17:25:51.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.441+0000 7f594cd42800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:51.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.441+0000 7f594cd42800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:51.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.441+0000 7f594cd42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:51.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.441+0000 7f594cd42800 20 zonegroup default 2024-09-12T17:25:51.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.441+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.442+0000 7f594cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.442+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.442+0000 7f594cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.442+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.442+0000 7f594cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.442+0000 7f594cd42800 20 started sync module instance, tier type = 2024-09-12T17:25:51.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.442+0000 7f594cd42800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:51.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.451+0000 7f594cd42800 20 add_watcher() i=0 2024-09-12T17:25:51.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.451+0000 7f594cd42800 20 add_watcher() i=1 2024-09-12T17:25:51.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.451+0000 7f594cd42800 20 add_watcher() i=2 2024-09-12T17:25:51.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.451+0000 7f594cd42800 20 add_watcher() i=3 2024-09-12T17:25:51.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.451+0000 7f594cd42800 20 add_watcher() i=4 2024-09-12T17:25:51.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.451+0000 7f594cd42800 20 add_watcher() i=5 2024-09-12T17:25:51.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.451+0000 7f594cd42800 20 add_watcher() i=6 2024-09-12T17:25:51.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.452+0000 7f594cd42800 20 add_watcher() i=7 2024-09-12T17:25:51.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.452+0000 7f594cd42800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:51.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.453+0000 7f57ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:51.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.453+0000 7f594cd42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:51.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.453+0000 7f594cd42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:51.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.453+0000 7f594cd42800 5 note: GC not initialized 2024-09-12T17:25:51.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.454+0000 7f57fe7e4640 20 reqs_thread_entry: start 2024-09-12T17:25:51.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.454+0000 7f594cd42800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:51.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.454+0000 7f594cd42800 20 Filter name: none 2024-09-12T17:25:51.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.454+0000 7f57f7fff640 20 reqs_thread_entry: start 2024-09-12T17:25:51.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.454+0000 7f594cd42800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:25:51.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.454+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.454+0000 7f594cd42800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:25:51.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.454+0000 7f594cd42800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:25:51.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.454+0000 7f594cd42800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:25:51.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.454+0000 7f594cd42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 : miss 2024-09-12T17:25:51.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.454+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.455+0000 7f594cd42800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:25:51.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.455+0000 7f594cd42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 info.flags=0x17 2024-09-12T17:25:51.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.455+0000 7f594cd42800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 to cache LRU end 2024-09-12T17:25:51.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.455+0000 7f594cd42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:25:51.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.455+0000 7f594cd42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:51.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.455+0000 7f594cd42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 2024-09-12T17:25:51.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.459+0000 7f594cd42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 info.flags=0x17 2024-09-12T17:25:51.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.459+0000 7f594cd42800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 to cache LRU end 2024-09-12T17:25:51.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.459+0000 7f594cd42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:51.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.459+0000 7f594cd42800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33, ofs0, ns] 2024-09-12T17:25:51.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.459+0000 7f581ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464334 cookie 94292355755632 notifier 7389 bl.length()=1015 2024-09-12T17:25:51.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.459+0000 7f581ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 info.flags=0x17 2024-09-12T17:25:51.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.459+0000 7f581ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 to cache LRU end 2024-09-12T17:25:51.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.459+0000 7f581ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:51.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.461+0000 7f594cd42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): orig_sources= new_sources= 2024-09-12T17:25:51.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.461+0000 7f594cd42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): potential sources added=[] removed=[] 2024-09-12T17:25:51.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.461+0000 7f594cd42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): orig_dests= new_dests= 2024-09-12T17:25:51.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.461+0000 7f594cd42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): potential dests added=[] removed=[] 2024-09-12T17:25:51.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.463+0000 7f594cd42800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.33.1.0 2024-09-12T17:25:51.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.463+0000 7f594cd42800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.33.1.0 2024-09-12T17:25:51.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.463+0000 7f594cd42800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.33.1.1 2024-09-12T17:25:51.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.463+0000 7f594cd42800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.33.1.1 2024-09-12T17:25:51.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.463+0000 7f594cd42800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.33.0 2024-09-12T17:25:51.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.465+0000 7f594cd42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:25:51.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.465+0000 7f594cd42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 2024-09-12T17:25:51.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.466+0000 7f594cd42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 info.flags=0x17 2024-09-12T17:25:51.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.466+0000 7f594cd42800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 to cache LRU end 2024-09-12T17:25:51.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.466+0000 7f594cd42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:51.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.466+0000 7f594cd42800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33, ofs0, ns] 2024-09-12T17:25:51.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.466+0000 7f581ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464335 cookie 94292355755632 notifier 7389 bl.length()=1015 2024-09-12T17:25:51.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.466+0000 7f581ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 info.flags=0x17 2024-09-12T17:25:51.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.466+0000 7f581ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 to cache LRU end 2024-09-12T17:25:51.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.466+0000 7f581ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:51.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.468+0000 7f594cd42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): orig_sources= new_sources= 2024-09-12T17:25:51.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.468+0000 7f594cd42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): potential sources added=[] removed=[] 2024-09-12T17:25:51.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.468+0000 7f594cd42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): orig_dests= new_dests= 2024-09-12T17:25:51.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.468+0000 7f594cd42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): potential dests added=[] removed=[] 2024-09-12T17:25:51.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.469+0000 7f594cd42800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.33.0 2024-09-12T17:25:51.470 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f594cd42800 time 2024-09-12T17:25:51.470333+0000 2024-09-12T17:25:51.470 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:25:51.471 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:25:51.471 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f594e58c71a] 2024-09-12T17:25:51.471 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f594e58c8d8] 2024-09-12T17:25:51.471 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c22479c841] 2024-09-12T17:25:51.471 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55c2247ac827] 2024-09-12T17:25:51.471 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T17:25:51.471 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f594d229590] 2024-09-12T17:25:51.471 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T17:25:51.471 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T17:25:51.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.470+0000 7f594cd42800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f594cd42800 time 2024-09-12T17:25:51.470333+0000 2024-09-12T17:25:51.471 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:25:51.472 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.472 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:25:51.472 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f594e58c71a] 2024-09-12T17:25:51.472 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f594e58c8d8] 2024-09-12T17:25:51.472 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c22479c841] 2024-09-12T17:25:51.472 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55c2247ac827] 2024-09-12T17:25:51.472 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T17:25:51.472 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f594d229590] 2024-09-12T17:25:51.472 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T17:25:51.472 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T17:25:51.472 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.472 INFO:tasks.workunit.client.0.smithi067.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:25:51.472 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f594cd42800 thread_name:radosgw-admin 2024-09-12T17:25:51.490 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:25:51.490 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f594d23e6f0] 2024-09-12T17:25:51.490 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f594d28b99c] 2024-09-12T17:25:51.490 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:25:51.490 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:25:51.490 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f594e58c774] 2024-09-12T17:25:51.491 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f594e58c8d8] 2024-09-12T17:25:51.491 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c22479c841] 2024-09-12T17:25:51.491 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55c2247ac827] 2024-09-12T17:25:51.491 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T17:25:51.491 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f594d229590] 2024-09-12T17:25:51.491 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T17:25:51.491 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T17:25:51.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.470+0000 7f594cd42800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:25:51.491 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f594cd42800 thread_name:radosgw-admin 2024-09-12T17:25:51.491 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.491 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:25:51.491 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f594d23e6f0] 2024-09-12T17:25:51.491 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f594d28b99c] 2024-09-12T17:25:51.492 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:25:51.492 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:25:51.492 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f594e58c774] 2024-09-12T17:25:51.492 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f594e58c8d8] 2024-09-12T17:25:51.492 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c22479c841] 2024-09-12T17:25:51.492 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55c2247ac827] 2024-09-12T17:25:51.492 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T17:25:51.492 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f594d229590] 2024-09-12T17:25:51.492 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T17:25:51.492 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T17:25:51.492 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:25:51.492 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.493 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T17:25:51.493 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T17:25:51.410+0000 7f594cd42800 5 AuthRegistry(0x55c2264f6f30) adding con mode: secure 2024-09-12T17:25:51.493 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T17:25:51.410+0000 7f594cd42800 5 AuthRegistry(0x55c2264f6f30) adding con mode: crc 2024-09-12T17:25:51.493 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T17:25:51.410+0000 7f594cd42800 5 AuthRegistry(0x55c2264f6f30) adding con mode: secure 2024-09-12T17:25:51.493 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T17:25:51.410+0000 7f594cd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:51.493 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T17:25:51.410+0000 7f594cd42800 1 librados: starting msgr at 2024-09-12T17:25:51.493 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T17:25:51.410+0000 7f594cd42800 1 librados: starting objecter 2024-09-12T17:25:51.493 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command objecter_requests hook 0x55c2264f2ba0 2024-09-12T17:25:51.493 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T17:25:51.411+0000 7f594cd42800 1 librados: setting wanted keys 2024-09-12T17:25:51.493 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T17:25:51.411+0000 7f594cd42800 1 librados: calling monclient init 2024-09-12T17:25:51.493 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T17:25:51.411+0000 7f594cd42800 10 monclient: init 2024-09-12T17:25:51.493 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding auth protocol: cephx 2024-09-12T17:25:51.493 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding auth protocol: cephx 2024-09-12T17:25:51.494 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding auth protocol: cephx 2024-09-12T17:25:51.494 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding con mode: secure 2024-09-12T17:25:51.494 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding con mode: crc 2024-09-12T17:25:51.494 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding con mode: secure 2024-09-12T17:25:51.494 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding con mode: crc 2024-09-12T17:25:51.494 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding con mode: secure 2024-09-12T17:25:51.494 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding con mode: crc 2024-09-12T17:25:51.494 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding con mode: crc 2024-09-12T17:25:51.494 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding con mode: secure 2024-09-12T17:25:51.494 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding con mode: crc 2024-09-12T17:25:51.494 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding con mode: secure 2024-09-12T17:25:51.494 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding con mode: crc 2024-09-12T17:25:51.494 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding con mode: secure 2024-09-12T17:25:51.494 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T17:25:51.411+0000 7f594cd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:51.495 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T17:25:51.411+0000 7f594cd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:51.495 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command rotate-key hook 0x55c2264f18a8 2024-09-12T17:25:51.495 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T17:25:51.411+0000 7f594cd42800 10 monclient: _reopen_session rank -1 2024-09-12T17:25:51.495 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T17:25:51.411+0000 7f594cd42800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:25:51.495 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T17:25:51.411+0000 7f594cd42800 10 monclient(hunting): picked mon.noname-c con 0x55c2263aaad0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:25:51.495 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T17:25:51.411+0000 7f594cd42800 10 monclient(hunting): picked mon.noname-b con 0x55c226434bf0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:25:51.495 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T17:25:51.411+0000 7f594cd42800 10 monclient(hunting): picked mon.noname-a con 0x55c22643aff0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:25:51.495 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T17:25:51.411+0000 7f594cd42800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:51.495 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T17:25:51.411+0000 7f594cd42800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:51.495 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T17:25:51.411+0000 7f594cd42800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:51.495 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T17:25:51.411+0000 7f594cd42800 10 monclient(hunting): _renew_subs 2024-09-12T17:25:51.495 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T17:25:51.411+0000 7f594cd42800 10 monclient(hunting): authenticate will time out at 2362.761655s 2024-09-12T17:25:51.495 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T17:25:51.411+0000 7f5949287640 10 monclient(hunting): get_auth_request con 0x55c22643aff0 auth_method 0 2024-09-12T17:25:51.495 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T17:25:51.411+0000 7f5949287640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:51.496 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T17:25:51.411+0000 7f5949287640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:51.496 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T17:25:51.411+0000 7f5949287640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:51.496 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T17:25:51.411+0000 7f5948a86640 10 monclient(hunting): get_auth_request con 0x55c2263aaad0 auth_method 0 2024-09-12T17:25:51.496 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T17:25:51.411+0000 7f5948a86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:51.496 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T17:25:51.411+0000 7f5948a86640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:51.496 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T17:25:51.411+0000 7f5948a86640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:51.496 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T17:25:51.411+0000 7f5948a86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:51.496 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T17:25:51.411+0000 7f5948a86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:51.496 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T17:25:51.411+0000 7f5948a86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:51.496 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T17:25:51.411+0000 7f5949287640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:51.496 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T17:25:51.411+0000 7f5949287640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:51.496 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T17:25:51.411+0000 7f5949287640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:51.496 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T17:25:51.411+0000 7f5948a86640 10 monclient(hunting): handle_auth_done global_id 6938 payload 824 2024-09-12T17:25:51.497 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T17:25:51.411+0000 7f5948a86640 10 monclient: _finish_hunting 0 2024-09-12T17:25:51.497 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T17:25:51.411+0000 7f5948a86640 1 monclient: found mon.noname-c 2024-09-12T17:25:51.497 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T17:25:51.411+0000 7f5948a86640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:25:51.497 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T17:25:51.412+0000 7f583560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:51.497 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T17:25:51.412+0000 7f583560a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:25:51.497 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T17:25:51.412+0000 7f583560a640 10 monclient: dump: 2024-09-12T17:25:51.497 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:51.497 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:51.497 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.497 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.497 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:51.497 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:51.497 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:51.498 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:51.498 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:51.498 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.498 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T17:25:51.412+0000 7f583560a640 10 monclient: _finish_auth 0 2024-09-12T17:25:51.498 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T17:25:51.412+0000 7f583560a640 10 monclient: _check_auth_tickets 2024-09-12T17:25:51.498 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T17:25:51.412+0000 7f583560a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:25:51.498 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T17:25:51.412+0000 7f583560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:51.498 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T17:25:51.412+0000 7f583560a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:25:51.498 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T17:25:51.412+0000 7f583560a640 10 monclient: dump: 2024-09-12T17:25:51.498 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:51.498 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:51.498 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.498 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.498 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:51.499 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:51.499 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:51.499 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:51.499 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:51.499 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.499 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T17:25:51.412+0000 7f594cd42800 5 monclient: authenticate success, global_id 6938 2024-09-12T17:25:51.499 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T17:25:51.412+0000 7f594cd42800 10 monclient: _renew_subs 2024-09-12T17:25:51.499 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T17:25:51.412+0000 7f594cd42800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:25:51.499 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T17:25:51.412+0000 7f5836e0d640 4 set_mon_vals no callback set 2024-09-12T17:25:51.499 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T17:25:51.412+0000 7f594cd42800 10 monclient: _renew_subs 2024-09-12T17:25:51.499 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T17:25:51.412+0000 7f594cd42800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:25:51.500 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T17:25:51.412+0000 7f594cd42800 1 librados: init done 2024-09-12T17:25:51.500 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T17:25:51.414+0000 7f583560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:25:51.500 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T17:25:51.414+0000 7f583560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:25:51.500 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T17:25:51.414+0000 7f583560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:25:51.500 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T17:25:51.414+0000 7f5948285640 10 monclient: get_auth_request con 0x7f5830076470 auth_method 0 2024-09-12T17:25:51.500 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T17:25:51.414+0000 7f5949287640 10 monclient: get_auth_request con 0x55c226539fa0 auth_method 0 2024-09-12T17:25:51.500 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T17:25:51.415+0000 7f5948a86640 10 monclient: get_auth_request con 0x55c22653cde0 auth_method 0 2024-09-12T17:25:51.500 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T17:25:51.416+0000 7f5948285640 10 monclient: get_auth_request con 0x55c226541140 auth_method 0 2024-09-12T17:25:51.500 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T17:25:51.417+0000 7f594cd42800 10 monclient: build_initial_monmap 2024-09-12T17:25:51.500 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T17:25:51.417+0000 7f594cd42800 1 build_initial for_mkfs: 0 2024-09-12T17:25:51.500 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T17:25:51.417+0000 7f594cd42800 10 monclient: monmap: 2024-09-12T17:25:51.500 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:25:51.501 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:25:51.501 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:25:51.501 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:25:51.501 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:25:51.501 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:51.501 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:25:51.501 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:25:51.501 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:25:51.501 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.501 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding auth protocol: cephx 2024-09-12T17:25:51.501 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding auth protocol: cephx 2024-09-12T17:25:51.501 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding auth protocol: cephx 2024-09-12T17:25:51.501 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding con mode: secure 2024-09-12T17:25:51.501 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding con mode: crc 2024-09-12T17:25:51.502 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding con mode: secure 2024-09-12T17:25:51.502 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding con mode: crc 2024-09-12T17:25:51.502 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding con mode: secure 2024-09-12T17:25:51.502 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding con mode: crc 2024-09-12T17:25:51.502 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding con mode: crc 2024-09-12T17:25:51.502 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding con mode: secure 2024-09-12T17:25:51.502 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding con mode: crc 2024-09-12T17:25:51.502 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding con mode: secure 2024-09-12T17:25:51.502 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding con mode: crc 2024-09-12T17:25:51.502 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding con mode: secure 2024-09-12T17:25:51.502 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T17:25:51.417+0000 7f594cd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:51.502 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command objecter_requests cmddesc objecter_requests hook 0x55c226549900 EEXIST 2024-09-12T17:25:51.502 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T17:25:51.417+0000 7f594cd42800 10 monclient: init 2024-09-12T17:25:51.503 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding auth protocol: cephx 2024-09-12T17:25:51.503 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding auth protocol: cephx 2024-09-12T17:25:51.503 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding auth protocol: cephx 2024-09-12T17:25:51.503 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding con mode: secure 2024-09-12T17:25:51.503 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding con mode: crc 2024-09-12T17:25:51.503 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T17:25:51.418+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding con mode: secure 2024-09-12T17:25:51.503 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T17:25:51.418+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding con mode: crc 2024-09-12T17:25:51.503 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T17:25:51.418+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding con mode: secure 2024-09-12T17:25:51.503 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T17:25:51.418+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding con mode: crc 2024-09-12T17:25:51.503 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T17:25:51.418+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding con mode: crc 2024-09-12T17:25:51.503 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T17:25:51.418+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding con mode: secure 2024-09-12T17:25:51.503 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T17:25:51.418+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding con mode: crc 2024-09-12T17:25:51.503 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T17:25:51.418+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding con mode: secure 2024-09-12T17:25:51.503 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T17:25:51.418+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding con mode: crc 2024-09-12T17:25:51.504 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T17:25:51.418+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding con mode: secure 2024-09-12T17:25:51.504 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T17:25:51.418+0000 7f594cd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:51.504 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T17:25:51.418+0000 7f594cd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:51.504 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T17:25:51.418+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command rotate-key cmddesc rotate-key hook 0x55c2265446d0 EEXIST 2024-09-12T17:25:51.504 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T17:25:51.418+0000 7f594cd42800 10 monclient: _reopen_session rank -1 2024-09-12T17:25:51.504 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T17:25:51.418+0000 7f594cd42800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:25:51.504 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T17:25:51.418+0000 7f594cd42800 10 monclient(hunting): picked mon.noname-a con 0x55c22656d5f0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:25:51.504 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T17:25:51.418+0000 7f594cd42800 10 monclient(hunting): picked mon.noname-c con 0x55c22656f8c0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:25:51.504 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T17:25:51.418+0000 7f594cd42800 10 monclient(hunting): picked mon.noname-b con 0x55c22656bdc0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:25:51.504 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T17:25:51.418+0000 7f594cd42800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:51.504 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T17:25:51.418+0000 7f594cd42800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:51.504 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T17:25:51.418+0000 7f594cd42800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:51.505 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T17:25:51.418+0000 7f594cd42800 10 monclient(hunting): _renew_subs 2024-09-12T17:25:51.505 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T17:25:51.418+0000 7f594cd42800 10 monclient(hunting): authenticate will time out at 2362.768542s 2024-09-12T17:25:51.505 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T17:25:51.418+0000 7f5948a86640 10 monclient(hunting): get_auth_request con 0x55c22656d5f0 auth_method 0 2024-09-12T17:25:51.505 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T17:25:51.418+0000 7f5948a86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:51.505 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T17:25:51.418+0000 7f5948a86640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:51.505 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T17:25:51.418+0000 7f5948a86640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:51.505 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T17:25:51.418+0000 7f5948285640 10 monclient(hunting): get_auth_request con 0x55c22656f8c0 auth_method 0 2024-09-12T17:25:51.505 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T17:25:51.418+0000 7f5948285640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:51.505 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T17:25:51.418+0000 7f5948285640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:51.505 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T17:25:51.418+0000 7f5948285640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:51.505 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T17:25:51.418+0000 7f5948a86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:51.505 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T17:25:51.418+0000 7f5948a86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:51.505 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T17:25:51.418+0000 7f5948a86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:51.505 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T17:25:51.418+0000 7f5948285640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:51.506 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T17:25:51.418+0000 7f5948285640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:51.506 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T17:25:51.418+0000 7f5948285640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:51.506 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T17:25:51.418+0000 7f5949287640 10 monclient(hunting): get_auth_request con 0x55c22656bdc0 auth_method 0 2024-09-12T17:25:51.506 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T17:25:51.418+0000 7f5949287640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:51.506 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T17:25:51.418+0000 7f5949287640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:51.506 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T17:25:51.418+0000 7f5949287640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:51.506 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T17:25:51.418+0000 7f5948a86640 10 monclient(hunting): handle_auth_done global_id 7383 payload 824 2024-09-12T17:25:51.506 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T17:25:51.418+0000 7f5948a86640 10 monclient: _finish_hunting 0 2024-09-12T17:25:51.506 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T17:25:51.418+0000 7f5948a86640 1 monclient: found mon.noname-a 2024-09-12T17:25:51.506 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T17:25:51.418+0000 7f5948a86640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:25:51.506 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T17:25:51.419+0000 7f582e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:51.506 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T17:25:51.419+0000 7f582e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:25:51.506 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T17:25:51.419+0000 7f582e7fc640 10 monclient: dump: 2024-09-12T17:25:51.506 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:51.506 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:51.507 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.507 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.507 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:51.507 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:51.507 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:51.507 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:51.507 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:51.507 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.507 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T17:25:51.419+0000 7f582e7fc640 10 monclient: _finish_auth 0 2024-09-12T17:25:51.507 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T17:25:51.419+0000 7f582e7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:25:51.507 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T17:25:51.419+0000 7f582e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:25:51.507 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T17:25:51.419+0000 7f582e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:51.507 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T17:25:51.419+0000 7f582e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:25:51.508 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T17:25:51.419+0000 7f582e7fc640 10 monclient: dump: 2024-09-12T17:25:51.508 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:51.508 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:51.508 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.508 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.508 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:51.508 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:51.508 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:51.508 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:51.508 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:51.508 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.508 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T17:25:51.419+0000 7f594cd42800 5 monclient: authenticate success, global_id 7383 2024-09-12T17:25:51.509 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T17:25:51.419+0000 7f594cd42800 10 monclient: _renew_subs 2024-09-12T17:25:51.509 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T17:25:51.419+0000 7f5949a88640 4 set_mon_vals no callback set 2024-09-12T17:25:51.509 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T17:25:51.419+0000 7f594cd42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:25:51.509 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T17:25:51.419+0000 7f594cd42800 10 monclient: _renew_subs 2024-09-12T17:25:51.509 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T17:25:51.419+0000 7f594cd42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:25:51.509 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T17:25:51.421+0000 7f582e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:25:51.509 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T17:25:51.421+0000 7f582e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:25:51.509 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T17:25:51.421+0000 7f582e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:25:51.509 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T17:25:51.421+0000 7f5948285640 10 monclient: get_auth_request con 0x7f5820076380 auth_method 0 2024-09-12T17:25:51.509 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T17:25:51.421+0000 7f594cd42800 10 monclient: get_monmap_and_config 2024-09-12T17:25:51.509 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T17:25:51.421+0000 7f594cd42800 10 monclient: build_initial_monmap 2024-09-12T17:25:51.509 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T17:25:51.421+0000 7f594cd42800 1 build_initial for_mkfs: 0 2024-09-12T17:25:51.509 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T17:25:51.421+0000 7f594cd42800 10 monclient: monmap: 2024-09-12T17:25:51.510 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:25:51.510 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:25:51.510 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:25:51.510 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:25:51.510 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:25:51.510 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:51.510 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:25:51.510 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:25:51.510 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:25:51.510 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.510 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding auth protocol: cephx 2024-09-12T17:25:51.510 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding auth protocol: cephx 2024-09-12T17:25:51.510 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding auth protocol: cephx 2024-09-12T17:25:51.511 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding con mode: secure 2024-09-12T17:25:51.511 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding con mode: crc 2024-09-12T17:25:51.511 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding con mode: secure 2024-09-12T17:25:51.511 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding con mode: crc 2024-09-12T17:25:51.511 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding con mode: secure 2024-09-12T17:25:51.511 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding con mode: crc 2024-09-12T17:25:51.511 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding con mode: crc 2024-09-12T17:25:51.511 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding con mode: secure 2024-09-12T17:25:51.511 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding con mode: crc 2024-09-12T17:25:51.511 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding con mode: secure 2024-09-12T17:25:51.511 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding con mode: crc 2024-09-12T17:25:51.511 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding con mode: secure 2024-09-12T17:25:51.511 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T17:25:51.421+0000 7f594cd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:51.512 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T17:25:51.421+0000 7f594cd42800 10 monclient: init 2024-09-12T17:25:51.512 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding auth protocol: cephx 2024-09-12T17:25:51.512 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding auth protocol: cephx 2024-09-12T17:25:51.512 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding auth protocol: cephx 2024-09-12T17:25:51.512 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding con mode: secure 2024-09-12T17:25:51.512 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding con mode: crc 2024-09-12T17:25:51.512 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding con mode: secure 2024-09-12T17:25:51.512 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding con mode: crc 2024-09-12T17:25:51.512 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding con mode: secure 2024-09-12T17:25:51.512 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding con mode: crc 2024-09-12T17:25:51.512 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding con mode: crc 2024-09-12T17:25:51.512 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding con mode: secure 2024-09-12T17:25:51.513 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding con mode: crc 2024-09-12T17:25:51.513 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding con mode: secure 2024-09-12T17:25:51.513 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding con mode: crc 2024-09-12T17:25:51.513 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding con mode: secure 2024-09-12T17:25:51.513 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T17:25:51.422+0000 7f594cd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:51.513 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T17:25:51.422+0000 7f594cd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:51.513 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T17:25:51.422+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command rotate-key cmddesc rotate-key hook 0x7ffccad487e8 EEXIST 2024-09-12T17:25:51.513 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T17:25:51.422+0000 7f594cd42800 10 monclient: _reopen_session rank -1 2024-09-12T17:25:51.513 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T17:25:51.422+0000 7f594cd42800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:25:51.513 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T17:25:51.422+0000 7f594cd42800 10 monclient(hunting): picked mon.noname-c con 0x55c2265bc5e0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:25:51.513 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T17:25:51.422+0000 7f594cd42800 10 monclient(hunting): picked mon.noname-a con 0x55c2265bc9c0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:25:51.513 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T17:25:51.422+0000 7f594cd42800 10 monclient(hunting): picked mon.noname-b con 0x55c2265c1b00 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:25:51.513 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T17:25:51.422+0000 7f594cd42800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:51.513 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T17:25:51.422+0000 7f594cd42800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:51.514 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T17:25:51.422+0000 7f594cd42800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:51.514 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T17:25:51.422+0000 7f594cd42800 10 monclient(hunting): _renew_subs 2024-09-12T17:25:51.514 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T17:25:51.422+0000 7f594cd42800 10 monclient(hunting): authenticate will time out at 2362.772360s 2024-09-12T17:25:51.514 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T17:25:51.422+0000 7f5948a86640 10 monclient(hunting): get_auth_request con 0x55c2265bc5e0 auth_method 0 2024-09-12T17:25:51.514 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T17:25:51.422+0000 7f5948a86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:51.514 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T17:25:51.422+0000 7f5948a86640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:51.514 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T17:25:51.422+0000 7f5948a86640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:51.514 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T17:25:51.422+0000 7f5948285640 10 monclient(hunting): get_auth_request con 0x55c2265bc9c0 auth_method 0 2024-09-12T17:25:51.514 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T17:25:51.422+0000 7f5948285640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:51.514 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T17:25:51.422+0000 7f5948285640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:51.514 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T17:25:51.422+0000 7f5948285640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:51.514 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T17:25:51.422+0000 7f5949287640 10 monclient(hunting): get_auth_request con 0x55c2265c1b00 auth_method 0 2024-09-12T17:25:51.514 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T17:25:51.422+0000 7f5949287640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:51.515 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T17:25:51.422+0000 7f5949287640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:51.515 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T17:25:51.422+0000 7f5949287640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:51.515 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T17:25:51.422+0000 7f5948a86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:51.515 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T17:25:51.422+0000 7f5948a86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:51.515 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T17:25:51.422+0000 7f5948a86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:51.515 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T17:25:51.422+0000 7f5948285640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:51.515 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T17:25:51.422+0000 7f5948285640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:51.515 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T17:25:51.422+0000 7f5948285640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:51.515 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T17:25:51.422+0000 7f5949287640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:51.515 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T17:25:51.422+0000 7f5949287640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:51.515 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T17:25:51.422+0000 7f5949287640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:51.515 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T17:25:51.422+0000 7f5948a86640 10 monclient(hunting): handle_auth_done global_id 6944 payload 274 2024-09-12T17:25:51.516 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T17:25:51.422+0000 7f5948a86640 10 monclient: _finish_hunting 0 2024-09-12T17:25:51.516 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T17:25:51.422+0000 7f5948a86640 1 monclient: found mon.noname-c 2024-09-12T17:25:51.516 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T17:25:51.422+0000 7f5948a86640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:25:51.516 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T17:25:51.422+0000 7f581ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:51.516 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T17:25:51.422+0000 7f581ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:25:51.516 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T17:25:51.422+0000 7f581ffff640 10 monclient: dump: 2024-09-12T17:25:51.516 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:51.516 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:51.516 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.516 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.516 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:51.516 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:51.516 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:51.517 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:51.517 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:51.517 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.517 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T17:25:51.423+0000 7f581ffff640 10 monclient: _finish_auth 0 2024-09-12T17:25:51.517 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T17:25:51.423+0000 7f581ffff640 10 monclient: _check_auth_tickets 2024-09-12T17:25:51.517 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T17:25:51.423+0000 7f581ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:25:51.517 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T17:25:51.423+0000 7f581ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:51.517 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T17:25:51.423+0000 7f581ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:25:51.517 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T17:25:51.423+0000 7f581ffff640 10 monclient: dump: 2024-09-12T17:25:51.517 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:51.517 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:51.517 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.517 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.517 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:51.518 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:51.518 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:51.518 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:51.518 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:51.518 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.518 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 monclient: authenticate success, global_id 6944 2024-09-12T17:25:51.518 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T17:25:51.423+0000 7f594cd42800 10 monclient: get_monmap_and_config success 2024-09-12T17:25:51.518 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T17:25:51.423+0000 7f594cd42800 4 set_mon_vals no callback set 2024-09-12T17:25:51.518 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T17:25:51.423+0000 7f594cd42800 10 monclient: shutdown 2024-09-12T17:25:51.518 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T17:25:51.423+0000 7f594cd42800 10 monclient: build_initial_monmap 2024-09-12T17:25:51.518 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T17:25:51.423+0000 7f594cd42800 1 build_initial for_mkfs: 0 2024-09-12T17:25:51.518 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T17:25:51.423+0000 7f594cd42800 10 monclient: monmap: 2024-09-12T17:25:51.518 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:25:51.519 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:25:51.519 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:25:51.519 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:25:51.519 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:25:51.519 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:51.519 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:25:51.519 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:25:51.519 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:25:51.519 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.519 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding auth protocol: cephx 2024-09-12T17:25:51.519 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding auth protocol: cephx 2024-09-12T17:25:51.519 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding auth protocol: cephx 2024-09-12T17:25:51.519 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding con mode: secure 2024-09-12T17:25:51.520 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding con mode: crc 2024-09-12T17:25:51.520 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding con mode: secure 2024-09-12T17:25:51.520 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding con mode: crc 2024-09-12T17:25:51.520 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding con mode: secure 2024-09-12T17:25:51.520 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding con mode: crc 2024-09-12T17:25:51.520 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding con mode: crc 2024-09-12T17:25:51.520 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding con mode: secure 2024-09-12T17:25:51.520 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding con mode: crc 2024-09-12T17:25:51.520 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding con mode: secure 2024-09-12T17:25:51.520 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding con mode: crc 2024-09-12T17:25:51.520 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding con mode: secure 2024-09-12T17:25:51.520 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T17:25:51.423+0000 7f594cd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:51.520 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T17:25:51.423+0000 7f594cd42800 1 librados: starting msgr at 2024-09-12T17:25:51.521 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T17:25:51.423+0000 7f594cd42800 1 librados: starting objecter 2024-09-12T17:25:51.521 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command objecter_requests cmddesc objecter_requests hook 0x55c226593cb0 EEXIST 2024-09-12T17:25:51.521 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T17:25:51.424+0000 7f594cd42800 1 librados: setting wanted keys 2024-09-12T17:25:51.521 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T17:25:51.424+0000 7f594cd42800 1 librados: calling monclient init 2024-09-12T17:25:51.521 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T17:25:51.424+0000 7f594cd42800 10 monclient: init 2024-09-12T17:25:51.521 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding auth protocol: cephx 2024-09-12T17:25:51.521 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding auth protocol: cephx 2024-09-12T17:25:51.521 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding auth protocol: cephx 2024-09-12T17:25:51.521 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding con mode: secure 2024-09-12T17:25:51.521 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding con mode: crc 2024-09-12T17:25:51.521 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding con mode: secure 2024-09-12T17:25:51.521 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding con mode: crc 2024-09-12T17:25:51.521 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding con mode: secure 2024-09-12T17:25:51.521 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding con mode: crc 2024-09-12T17:25:51.522 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding con mode: crc 2024-09-12T17:25:51.522 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding con mode: secure 2024-09-12T17:25:51.522 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding con mode: crc 2024-09-12T17:25:51.522 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding con mode: secure 2024-09-12T17:25:51.522 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding con mode: crc 2024-09-12T17:25:51.522 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding con mode: secure 2024-09-12T17:25:51.522 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T17:25:51.424+0000 7f594cd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:51.522 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T17:25:51.424+0000 7f594cd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:51.522 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command rotate-key cmddesc rotate-key hook 0x55c2265854e8 EEXIST 2024-09-12T17:25:51.522 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T17:25:51.424+0000 7f594cd42800 10 monclient: _reopen_session rank -1 2024-09-12T17:25:51.522 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T17:25:51.424+0000 7f594cd42800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:25:51.522 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T17:25:51.424+0000 7f594cd42800 10 monclient(hunting): picked mon.noname-b con 0x55c2265bc5e0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:25:51.522 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T17:25:51.424+0000 7f594cd42800 10 monclient(hunting): picked mon.noname-c con 0x55c2265c1b00 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:25:51.523 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T17:25:51.424+0000 7f594cd42800 10 monclient(hunting): picked mon.noname-a con 0x55c2265cfb30 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:25:51.523 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T17:25:51.424+0000 7f594cd42800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:51.523 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T17:25:51.424+0000 7f594cd42800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:51.523 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T17:25:51.424+0000 7f594cd42800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:51.523 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T17:25:51.424+0000 7f594cd42800 10 monclient(hunting): _renew_subs 2024-09-12T17:25:51.523 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T17:25:51.424+0000 7f594cd42800 10 monclient(hunting): authenticate will time out at 2362.774595s 2024-09-12T17:25:51.523 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T17:25:51.424+0000 7f5948285640 10 monclient(hunting): get_auth_request con 0x55c2265c1b00 auth_method 0 2024-09-12T17:25:51.523 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T17:25:51.424+0000 7f5948285640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:51.523 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T17:25:51.424+0000 7f5948285640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:51.523 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T17:25:51.424+0000 7f5948285640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:51.523 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T17:25:51.424+0000 7f5949287640 10 monclient(hunting): get_auth_request con 0x55c2265cfb30 auth_method 0 2024-09-12T17:25:51.523 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T17:25:51.424+0000 7f5949287640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:51.523 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T17:25:51.424+0000 7f5949287640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:51.524 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T17:25:51.424+0000 7f5949287640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:51.524 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T17:25:51.424+0000 7f5948a86640 10 monclient(hunting): get_auth_request con 0x55c2265bc5e0 auth_method 0 2024-09-12T17:25:51.524 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T17:25:51.424+0000 7f5948a86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:51.524 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T17:25:51.424+0000 7f5948a86640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:51.524 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T17:25:51.424+0000 7f5948a86640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:51.524 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T17:25:51.424+0000 7f5949287640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:51.524 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T17:25:51.424+0000 7f5949287640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:51.524 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T17:25:51.424+0000 7f5949287640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:51.524 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T17:25:51.424+0000 7f5948285640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:51.524 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T17:25:51.424+0000 7f5948285640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:51.524 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T17:25:51.424+0000 7f5948285640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:51.524 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T17:25:51.424+0000 7f5948a86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:51.525 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T17:25:51.424+0000 7f5948a86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:51.525 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T17:25:51.424+0000 7f5948a86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:51.525 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T17:25:51.424+0000 7f5949287640 10 monclient(hunting): handle_auth_done global_id 7389 payload 824 2024-09-12T17:25:51.525 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T17:25:51.424+0000 7f5949287640 10 monclient: _finish_hunting 0 2024-09-12T17:25:51.525 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T17:25:51.424+0000 7f5949287640 1 monclient: found mon.noname-a 2024-09-12T17:25:51.525 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T17:25:51.424+0000 7f5949287640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:25:51.525 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T17:25:51.425+0000 7f581e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:51.525 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T17:25:51.425+0000 7f581e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:25:51.525 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T17:25:51.425+0000 7f581e7fc640 10 monclient: dump: 2024-09-12T17:25:51.525 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:51.525 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:51.525 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.525 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.525 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:51.526 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:51.526 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:51.526 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:51.526 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:51.526 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.526 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T17:25:51.425+0000 7f581e7fc640 10 monclient: _finish_auth 0 2024-09-12T17:25:51.526 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T17:25:51.425+0000 7f581e7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:25:51.526 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T17:25:51.425+0000 7f581e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:25:51.526 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T17:25:51.425+0000 7f581e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:51.526 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T17:25:51.425+0000 7f581e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:25:51.526 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T17:25:51.425+0000 7f581e7fc640 10 monclient: dump: 2024-09-12T17:25:51.526 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:51.526 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:51.527 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.527 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.527 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:51.527 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:51.527 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:51.527 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:51.527 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:51.527 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.527 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T17:25:51.425+0000 7f594cd42800 5 monclient: authenticate success, global_id 7389 2024-09-12T17:25:51.527 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T17:25:51.425+0000 7f594cd42800 10 monclient: _renew_subs 2024-09-12T17:25:51.527 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T17:25:51.425+0000 7f594cd42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:25:51.527 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T17:25:51.425+0000 7f581ffff640 4 set_mon_vals no callback set 2024-09-12T17:25:51.527 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T17:25:51.425+0000 7f594cd42800 10 monclient: _renew_subs 2024-09-12T17:25:51.528 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T17:25:51.425+0000 7f594cd42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:25:51.528 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T17:25:51.425+0000 7f594cd42800 1 librados: init done 2024-09-12T17:25:51.528 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T17:25:51.425+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command cr dump hook 0x55c2265bbea8 2024-09-12T17:25:51.528 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T17:25:51.426+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.528 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T17:25:51.427+0000 7f581e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:25:51.528 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T17:25:51.427+0000 7f581e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:25:51.528 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T17:25:51.427+0000 7f581e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:25:51.528 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T17:25:51.427+0000 7f5948a86640 10 monclient: get_auth_request con 0x7f5814076470 auth_method 0 2024-09-12T17:25:51.528 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T17:25:51.428+0000 7f5948285640 10 monclient: get_auth_request con 0x55c2265dcb10 auth_method 0 2024-09-12T17:25:51.528 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T17:25:51.428+0000 7f594cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.529 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T17:25:51.428+0000 7f594cd42800 20 realm 2024-09-12T17:25:51.529 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T17:25:51.428+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.529 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T17:25:51.429+0000 7f594cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.529 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T17:25:51.429+0000 7f594cd42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:51.529 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T17:25:51.429+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.529 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T17:25:51.429+0000 7f594cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.529 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T17:25:51.429+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.529 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T17:25:51.429+0000 7f5948a86640 10 monclient: get_auth_request con 0x55c2265e0d10 auth_method 0 2024-09-12T17:25:51.529 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T17:25:51.429+0000 7f594cd42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:51.529 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T17:25:51.429+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.530 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T17:25:51.430+0000 7f5948285640 10 monclient: get_auth_request con 0x55c2265e4570 auth_method 0 2024-09-12T17:25:51.530 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T17:25:51.430+0000 7f594cd42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:51.530 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T17:25:51.430+0000 7f594cd42800 20 searching for the correct realm 2024-09-12T17:25:51.530 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T17:25:51.430+0000 7f5949287640 10 monclient: get_auth_request con 0x55c2265e92a0 auth_method 0 2024-09-12T17:25:51.530 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T17:25:51.431+0000 7f5948a86640 10 monclient: get_auth_request con 0x7f5940016050 auth_method 0 2024-09-12T17:25:51.530 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T17:25:51.432+0000 7f5948285640 10 monclient: get_auth_request con 0x7f5938007cb0 auth_method 0 2024-09-12T17:25:51.530 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T17:25:51.433+0000 7f5949287640 0 -- 172.21.15.67:0/1645958681 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x55c2265e92a0 msgr2=0x55c2265eb760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:51.530 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T17:25:51.433+0000 7f581e7fc640 1 client.7389.objecter ms_handle_reset 0x55c2265e92a0 session 0x55c2265e8c20 osd.3 2024-09-12T17:25:51.530 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T17:25:51.433+0000 7f581e7fc640 10 monclient: _renew_subs 2024-09-12T17:25:51.530 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T17:25:51.433+0000 7f581e7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:25:51.530 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T17:25:51.433+0000 7f5949287640 10 monclient: get_auth_request con 0x7f5814086310 auth_method 0 2024-09-12T17:25:51.530 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T17:25:51.434+0000 7f5949287640 10 monclient: get_auth_request con 0x7f5930026040 auth_method 0 2024-09-12T17:25:51.530 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T17:25:51.436+0000 7f5948a86640 10 monclient: get_auth_request con 0x7f5930046b70 auth_method 0 2024-09-12T17:25:51.531 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T17:25:51.437+0000 7f5948a86640 0 -- 172.21.15.67:0/1645958681 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f5930046b70 msgr2=0x7f593003e460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:51.531 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T17:25:51.437+0000 7f581e7fc640 1 client.7389.objecter ms_handle_reset 0x7f5930046b70 session 0x7f593002a070 osd.0 2024-09-12T17:25:51.531 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T17:25:51.437+0000 7f5948a86640 10 monclient: get_auth_request con 0x55c2265e92a0 auth_method 0 2024-09-12T17:25:51.531 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:51.531 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:51.531 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:51.531 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:51.531 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:51.531 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:51.531 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.531 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.531 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.531 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:51.531 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.532 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:51.532 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 zone default found 2024-09-12T17:25:51.532 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T17:25:51.441+0000 7f594cd42800 4 Realm: () 2024-09-12T17:25:51.532 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T17:25:51.441+0000 7f594cd42800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:51.532 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T17:25:51.441+0000 7f594cd42800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:51.532 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T17:25:51.441+0000 7f594cd42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:51.532 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 zonegroup default 2024-09-12T17:25:51.532 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.532 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T17:25:51.442+0000 7f594cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.532 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T17:25:51.442+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.532 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T17:25:51.442+0000 7f594cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.532 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T17:25:51.442+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.532 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T17:25:51.442+0000 7f594cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.532 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T17:25:51.442+0000 7f594cd42800 20 started sync module instance, tier type = 2024-09-12T17:25:51.533 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T17:25:51.442+0000 7f594cd42800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:51.533 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T17:25:51.451+0000 7f594cd42800 20 add_watcher() i=0 2024-09-12T17:25:51.533 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T17:25:51.451+0000 7f594cd42800 20 add_watcher() i=1 2024-09-12T17:25:51.533 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T17:25:51.451+0000 7f594cd42800 20 add_watcher() i=2 2024-09-12T17:25:51.533 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T17:25:51.451+0000 7f594cd42800 20 add_watcher() i=3 2024-09-12T17:25:51.533 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T17:25:51.451+0000 7f594cd42800 20 add_watcher() i=4 2024-09-12T17:25:51.533 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T17:25:51.451+0000 7f594cd42800 20 add_watcher() i=5 2024-09-12T17:25:51.533 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T17:25:51.451+0000 7f594cd42800 20 add_watcher() i=6 2024-09-12T17:25:51.533 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T17:25:51.452+0000 7f594cd42800 20 add_watcher() i=7 2024-09-12T17:25:51.533 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T17:25:51.452+0000 7f594cd42800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:51.533 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding auth protocol: cephx 2024-09-12T17:25:51.533 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding auth protocol: cephx 2024-09-12T17:25:51.534 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding auth protocol: cephx 2024-09-12T17:25:51.534 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding con mode: secure 2024-09-12T17:25:51.534 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding con mode: crc 2024-09-12T17:25:51.534 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding con mode: secure 2024-09-12T17:25:51.534 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding con mode: crc 2024-09-12T17:25:51.534 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding con mode: secure 2024-09-12T17:25:51.534 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding con mode: crc 2024-09-12T17:25:51.534 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding con mode: crc 2024-09-12T17:25:51.534 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding con mode: secure 2024-09-12T17:25:51.534 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T17:25:51.453+0000 7f57ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:51.534 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding con mode: crc 2024-09-12T17:25:51.534 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding con mode: secure 2024-09-12T17:25:51.534 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding con mode: crc 2024-09-12T17:25:51.535 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding con mode: secure 2024-09-12T17:25:51.535 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T17:25:51.453+0000 7f594cd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:51.535 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T17:25:51.453+0000 7f594cd42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:51.535 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T17:25:51.453+0000 7f594cd42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:51.535 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command cache list hook 0x55c2265ba4c0 2024-09-12T17:25:51.535 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command cache inspect hook 0x55c2265ba4c0 2024-09-12T17:25:51.535 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command cache erase hook 0x55c2265ba4c0 2024-09-12T17:25:51.535 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command cache zap hook 0x55c2265ba4c0 2024-09-12T17:25:51.535 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 note: GC not initialized 2024-09-12T17:25:51.535 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T17:25:51.454+0000 7f57fe7e4640 20 reqs_thread_entry: start 2024-09-12T17:25:51.535 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T17:25:51.454+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command sync trace show hook 0x7f59380bf070 2024-09-12T17:25:51.535 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T17:25:51.454+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command sync trace history hook 0x7f59380bf070 2024-09-12T17:25:51.535 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T17:25:51.454+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command sync trace active hook 0x7f59380bf070 2024-09-12T17:25:51.535 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T17:25:51.454+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command sync trace active_short hook 0x7f59380bf070 2024-09-12T17:25:51.536 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T17:25:51.454+0000 7f594cd42800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:51.536 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T17:25:51.454+0000 7f594cd42800 20 Filter name: none 2024-09-12T17:25:51.536 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T17:25:51.454+0000 7f57f7fff640 20 reqs_thread_entry: start 2024-09-12T17:25:51.536 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T17:25:51.454+0000 7f594cd42800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:25:51.536 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T17:25:51.454+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.536 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T17:25:51.454+0000 7f594cd42800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:25:51.536 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T17:25:51.454+0000 7f594cd42800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:25:51.536 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T17:25:51.454+0000 7f594cd42800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:25:51.536 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T17:25:51.454+0000 7f594cd42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 : miss 2024-09-12T17:25:51.536 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T17:25:51.454+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.536 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T17:25:51.455+0000 7f594cd42800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:25:51.536 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T17:25:51.455+0000 7f594cd42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 info.flags=0x17 2024-09-12T17:25:51.536 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T17:25:51.455+0000 7f594cd42800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 to cache LRU end 2024-09-12T17:25:51.537 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T17:25:51.455+0000 7f594cd42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:25:51.537 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T17:25:51.455+0000 7f594cd42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:51.537 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T17:25:51.455+0000 7f594cd42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 2024-09-12T17:25:51.537 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T17:25:51.456+0000 7f581e7fc640 1 client.7389.objecter ms_handle_reset 0x7f5814086310 session 0x55c2265e8c20 osd.3 2024-09-12T17:25:51.537 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T17:25:51.456+0000 7f5949287640 10 monclient: get_auth_request con 0x7f5930046b70 auth_method 0 2024-09-12T17:25:51.537 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T17:25:51.459+0000 7f594cd42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 info.flags=0x17 2024-09-12T17:25:51.537 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T17:25:51.459+0000 7f594cd42800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 to cache LRU end 2024-09-12T17:25:51.537 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T17:25:51.459+0000 7f594cd42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:51.537 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T17:25:51.459+0000 7f594cd42800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33, ofs0, ns] 2024-09-12T17:25:51.537 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T17:25:51.459+0000 7f581ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464334 cookie 94292355755632 notifier 7389 bl.length()=1015 2024-09-12T17:25:51.537 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T17:25:51.459+0000 7f581ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 info.flags=0x17 2024-09-12T17:25:51.537 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T17:25:51.459+0000 7f581ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 to cache LRU end 2024-09-12T17:25:51.537 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T17:25:51.459+0000 7f581ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:51.538 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T17:25:51.461+0000 7f594cd42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): orig_sources= new_sources= 2024-09-12T17:25:51.538 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T17:25:51.461+0000 7f594cd42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): potential sources added=[] removed=[] 2024-09-12T17:25:51.538 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T17:25:51.461+0000 7f594cd42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): orig_dests= new_dests= 2024-09-12T17:25:51.538 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T17:25:51.461+0000 7f594cd42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): potential dests added=[] removed=[] 2024-09-12T17:25:51.538 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T17:25:51.463+0000 7f594cd42800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.33.1.0 2024-09-12T17:25:51.538 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T17:25:51.463+0000 7f594cd42800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.33.1.0 2024-09-12T17:25:51.538 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T17:25:51.463+0000 7f594cd42800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.33.1.1 2024-09-12T17:25:51.538 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T17:25:51.463+0000 7f594cd42800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.33.1.1 2024-09-12T17:25:51.538 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T17:25:51.463+0000 7f594cd42800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.33.0 2024-09-12T17:25:51.538 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T17:25:51.465+0000 7f594cd42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:25:51.538 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T17:25:51.465+0000 7f594cd42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 2024-09-12T17:25:51.538 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T17:25:51.466+0000 7f594cd42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 info.flags=0x17 2024-09-12T17:25:51.538 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T17:25:51.466+0000 7f594cd42800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 to cache LRU end 2024-09-12T17:25:51.539 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T17:25:51.466+0000 7f594cd42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:51.539 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T17:25:51.466+0000 7f594cd42800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33, ofs0, ns] 2024-09-12T17:25:51.539 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T17:25:51.466+0000 7f581ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464335 cookie 94292355755632 notifier 7389 bl.length()=1015 2024-09-12T17:25:51.539 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T17:25:51.466+0000 7f581ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 info.flags=0x17 2024-09-12T17:25:51.539 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T17:25:51.466+0000 7f581ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 to cache LRU end 2024-09-12T17:25:51.539 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T17:25:51.466+0000 7f581ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:51.539 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T17:25:51.468+0000 7f594cd42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): orig_sources= new_sources= 2024-09-12T17:25:51.539 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T17:25:51.468+0000 7f594cd42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): potential sources added=[] removed=[] 2024-09-12T17:25:51.539 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T17:25:51.468+0000 7f594cd42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): orig_dests= new_dests= 2024-09-12T17:25:51.539 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T17:25:51.468+0000 7f594cd42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): potential dests added=[] removed=[] 2024-09-12T17:25:51.539 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T17:25:51.469+0000 7f594cd42800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.33.0 2024-09-12T17:25:51.539 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T17:25:51.470+0000 7f594cd42800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f594cd42800 time 2024-09-12T17:25:51.470333+0000 2024-09-12T17:25:51.539 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:25:51.540 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.540 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:25:51.540 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f594e58c71a] 2024-09-12T17:25:51.540 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f594e58c8d8] 2024-09-12T17:25:51.540 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c22479c841] 2024-09-12T17:25:51.540 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55c2247ac827] 2024-09-12T17:25:51.540 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T17:25:51.540 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f594d229590] 2024-09-12T17:25:51.540 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T17:25:51.540 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T17:25:51.540 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.540 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T17:25:51.470+0000 7f594cd42800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:25:51.540 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f594cd42800 thread_name:radosgw-admin 2024-09-12T17:25:51.541 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.541 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:25:51.541 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f594d23e6f0] 2024-09-12T17:25:51.541 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f594d28b99c] 2024-09-12T17:25:51.541 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:25:51.541 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:25:51.541 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f594e58c774] 2024-09-12T17:25:51.541 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f594e58c8d8] 2024-09-12T17:25:51.541 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c22479c841] 2024-09-12T17:25:51.541 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55c2247ac827] 2024-09-12T17:25:51.541 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T17:25:51.541 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f594d229590] 2024-09-12T17:25:51.542 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T17:25:51.542 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T17:25:51.542 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:25:51.542 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.542 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T17:25:51.542 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T17:25:51.542 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T17:25:51.542 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T17:25:51.542 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T17:25:51.542 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T17:25:51.542 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T17:25:51.542 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T17:25:51.542 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T17:25:51.542 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T17:25:51.543 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T17:25:51.543 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T17:25:51.543 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T17:25:51.543 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T17:25:51.543 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T17:25:51.543 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T17:25:51.543 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T17:25:51.543 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T17:25:51.543 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T17:25:51.543 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T17:25:51.543 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T17:25:51.543 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T17:25:51.544 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T17:25:51.544 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T17:25:51.544 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:25:51.544 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T17:25:51.544 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T17:25:51.544 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T17:25:51.544 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T17:25:51.544 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T17:25:51.544 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T17:25:51.544 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T17:25:51.544 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T17:25:51.544 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T17:25:51.544 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T17:25:51.545 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T17:25:51.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T17:25:51.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T17:25:51.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T17:25:51.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T17:25:51.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T17:25:51.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T17:25:51.545 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T17:25:51.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T17:25:51.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T17:25:51.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T17:25:51.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:25:51.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T17:25:51.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:25:51.546 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T17:25:51.546 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T17:25:51.546 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T17:25:51.546 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T17:25:51.546 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T17:25:51.546 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T17:25:51.546 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T17:25:51.546 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T17:25:51.546 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T17:25:51.546 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T17:25:51.546 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T17:25:51.546 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T17:25:51.546 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T17:25:51.546 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T17:25:51.547 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T17:25:51.547 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T17:25:51.547 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T17:25:51.547 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T17:25:51.547 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:25:51.547 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T17:25:51.547 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:25:51.547 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T17:25:51.547 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T17:25:51.547 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T17:25:51.547 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T17:25:51.547 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T17:25:51.547 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T17:25:51.548 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:25:51.548 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T17:25:51.548 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T17:25:51.548 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:25:51.548 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T17:25:51.548 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T17:25:51.548 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T17:25:51.548 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T17:25:51.548 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T17:25:51.548 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T17:25:51.548 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T17:25:51.548 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T17:25:51.548 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T17:25:51.549 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T17:25:51.549 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T17:25:51.549 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T17:25:51.549 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T17:25:51.549 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:25:51.549 INFO:tasks.workunit.client.0.smithi067.stderr: 7f57f7fff640 / http_manager 2024-09-12T17:25:51.549 INFO:tasks.workunit.client.0.smithi067.stderr: 7f57fe7e4640 / http_manager 2024-09-12T17:25:51.549 INFO:tasks.workunit.client.0.smithi067.stderr: 7f57ff7e6640 / rgw_dt_lg_renew 2024-09-12T17:25:51.549 INFO:tasks.workunit.client.0.smithi067.stderr: 7f581e7fc640 / ms_dispatch 2024-09-12T17:25:51.549 INFO:tasks.workunit.client.0.smithi067.stderr: 7f581ffff640 / io_context_pool 2024-09-12T17:25:51.549 INFO:tasks.workunit.client.0.smithi067.stderr: 7f582e7fc640 / ms_dispatch 2024-09-12T17:25:51.549 INFO:tasks.workunit.client.0.smithi067.stderr: 7f583560a640 / ms_dispatch 2024-09-12T17:25:51.549 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5836e0d640 / io_context_pool 2024-09-12T17:25:51.550 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5948285640 / msgr-worker-2 2024-09-12T17:25:51.550 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5948a86640 / msgr-worker-1 2024-09-12T17:25:51.550 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5949287640 / msgr-worker-0 2024-09-12T17:25:51.550 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5949a88640 / io_context_pool 2024-09-12T17:25:51.550 INFO:tasks.workunit.client.0.smithi067.stderr: 7f594cd42800 / radosgw-admin 2024-09-12T17:25:51.550 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T17:25:51.550 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T17:25:51.550 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/log/ceph/ceph-client.admin.123347.log 2024-09-12T17:25:51.550 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T17:25:51.550 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T17:25:51.550 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T17:25:51.410+0000 7f594cd42800 5 AuthRegistry(0x55c2264f6f30) adding con mode: secure 2024-09-12T17:25:51.550 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T17:25:51.410+0000 7f594cd42800 5 AuthRegistry(0x55c2264f6f30) adding con mode: crc 2024-09-12T17:25:51.550 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T17:25:51.410+0000 7f594cd42800 5 AuthRegistry(0x55c2264f6f30) adding con mode: secure 2024-09-12T17:25:51.550 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T17:25:51.410+0000 7f594cd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:51.551 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T17:25:51.410+0000 7f594cd42800 1 librados: starting msgr at 2024-09-12T17:25:51.551 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T17:25:51.410+0000 7f594cd42800 1 librados: starting objecter 2024-09-12T17:25:51.551 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command objecter_requests hook 0x55c2264f2ba0 2024-09-12T17:25:51.551 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T17:25:51.411+0000 7f594cd42800 1 librados: setting wanted keys 2024-09-12T17:25:51.551 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T17:25:51.411+0000 7f594cd42800 1 librados: calling monclient init 2024-09-12T17:25:51.551 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T17:25:51.411+0000 7f594cd42800 10 monclient: init 2024-09-12T17:25:51.551 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding auth protocol: cephx 2024-09-12T17:25:51.551 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding auth protocol: cephx 2024-09-12T17:25:51.551 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding auth protocol: cephx 2024-09-12T17:25:51.551 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding con mode: secure 2024-09-12T17:25:51.551 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding con mode: crc 2024-09-12T17:25:51.551 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding con mode: secure 2024-09-12T17:25:51.551 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding con mode: crc 2024-09-12T17:25:51.552 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding con mode: secure 2024-09-12T17:25:51.552 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding con mode: crc 2024-09-12T17:25:51.552 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding con mode: crc 2024-09-12T17:25:51.552 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding con mode: secure 2024-09-12T17:25:51.552 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding con mode: crc 2024-09-12T17:25:51.552 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding con mode: secure 2024-09-12T17:25:51.552 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding con mode: crc 2024-09-12T17:25:51.552 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 AuthRegistry(0x55c2264f1760) adding con mode: secure 2024-09-12T17:25:51.552 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T17:25:51.411+0000 7f594cd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:51.552 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T17:25:51.411+0000 7f594cd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:51.552 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T17:25:51.411+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command rotate-key hook 0x55c2264f18a8 2024-09-12T17:25:51.552 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T17:25:51.411+0000 7f594cd42800 10 monclient: _reopen_session rank -1 2024-09-12T17:25:51.553 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T17:25:51.411+0000 7f594cd42800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:25:51.553 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T17:25:51.411+0000 7f594cd42800 10 monclient(hunting): picked mon.noname-c con 0x55c2263aaad0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:25:51.553 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T17:25:51.411+0000 7f594cd42800 10 monclient(hunting): picked mon.noname-b con 0x55c226434bf0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:25:51.553 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T17:25:51.411+0000 7f594cd42800 10 monclient(hunting): picked mon.noname-a con 0x55c22643aff0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:25:51.553 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T17:25:51.411+0000 7f594cd42800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:51.553 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T17:25:51.411+0000 7f594cd42800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:51.553 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T17:25:51.411+0000 7f594cd42800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:51.553 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T17:25:51.411+0000 7f594cd42800 10 monclient(hunting): _renew_subs 2024-09-12T17:25:51.553 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T17:25:51.411+0000 7f594cd42800 10 monclient(hunting): authenticate will time out at 2362.761655s 2024-09-12T17:25:51.553 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T17:25:51.411+0000 7f5949287640 10 monclient(hunting): get_auth_request con 0x55c22643aff0 auth_method 0 2024-09-12T17:25:51.553 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T17:25:51.411+0000 7f5949287640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:51.553 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T17:25:51.411+0000 7f5949287640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:51.553 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T17:25:51.411+0000 7f5949287640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:51.554 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T17:25:51.411+0000 7f5948a86640 10 monclient(hunting): get_auth_request con 0x55c2263aaad0 auth_method 0 2024-09-12T17:25:51.554 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T17:25:51.411+0000 7f5948a86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:51.554 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T17:25:51.411+0000 7f5948a86640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:51.554 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T17:25:51.411+0000 7f5948a86640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:51.554 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T17:25:51.411+0000 7f5948a86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:51.554 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T17:25:51.411+0000 7f5948a86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:51.554 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T17:25:51.411+0000 7f5948a86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:51.554 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T17:25:51.411+0000 7f5949287640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:51.554 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T17:25:51.411+0000 7f5949287640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:51.554 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T17:25:51.411+0000 7f5949287640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:51.554 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T17:25:51.411+0000 7f5948a86640 10 monclient(hunting): handle_auth_done global_id 6938 payload 824 2024-09-12T17:25:51.554 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T17:25:51.411+0000 7f5948a86640 10 monclient: _finish_hunting 0 2024-09-12T17:25:51.554 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T17:25:51.411+0000 7f5948a86640 1 monclient: found mon.noname-c 2024-09-12T17:25:51.555 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T17:25:51.411+0000 7f5948a86640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:25:51.555 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T17:25:51.412+0000 7f583560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:51.555 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T17:25:51.412+0000 7f583560a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:25:51.555 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T17:25:51.412+0000 7f583560a640 10 monclient: dump: 2024-09-12T17:25:51.555 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:51.555 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:51.555 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.555 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.555 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:51.555 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:51.555 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:51.555 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:51.555 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:51.556 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.556 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T17:25:51.412+0000 7f583560a640 10 monclient: _finish_auth 0 2024-09-12T17:25:51.556 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T17:25:51.412+0000 7f583560a640 10 monclient: _check_auth_tickets 2024-09-12T17:25:51.556 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T17:25:51.412+0000 7f583560a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:25:51.556 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T17:25:51.412+0000 7f583560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:51.556 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T17:25:51.412+0000 7f583560a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:25:51.556 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T17:25:51.412+0000 7f583560a640 10 monclient: dump: 2024-09-12T17:25:51.556 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:51.556 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:51.556 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.556 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.556 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:51.556 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:51.557 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:51.557 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:51.557 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:51.557 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.557 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T17:25:51.412+0000 7f594cd42800 5 monclient: authenticate success, global_id 6938 2024-09-12T17:25:51.557 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T17:25:51.412+0000 7f594cd42800 10 monclient: _renew_subs 2024-09-12T17:25:51.557 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T17:25:51.412+0000 7f594cd42800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:25:51.557 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T17:25:51.412+0000 7f5836e0d640 4 set_mon_vals no callback set 2024-09-12T17:25:51.557 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T17:25:51.412+0000 7f594cd42800 10 monclient: _renew_subs 2024-09-12T17:25:51.557 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T17:25:51.412+0000 7f594cd42800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:25:51.557 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T17:25:51.412+0000 7f594cd42800 1 librados: init done 2024-09-12T17:25:51.557 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T17:25:51.414+0000 7f583560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:25:51.557 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T17:25:51.414+0000 7f583560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:25:51.558 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T17:25:51.414+0000 7f583560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:25:51.558 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T17:25:51.414+0000 7f5948285640 10 monclient: get_auth_request con 0x7f5830076470 auth_method 0 2024-09-12T17:25:51.558 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T17:25:51.414+0000 7f5949287640 10 monclient: get_auth_request con 0x55c226539fa0 auth_method 0 2024-09-12T17:25:51.558 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T17:25:51.415+0000 7f5948a86640 10 monclient: get_auth_request con 0x55c22653cde0 auth_method 0 2024-09-12T17:25:51.558 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T17:25:51.416+0000 7f5948285640 10 monclient: get_auth_request con 0x55c226541140 auth_method 0 2024-09-12T17:25:51.558 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T17:25:51.417+0000 7f594cd42800 10 monclient: build_initial_monmap 2024-09-12T17:25:51.558 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T17:25:51.417+0000 7f594cd42800 1 build_initial for_mkfs: 0 2024-09-12T17:25:51.558 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T17:25:51.417+0000 7f594cd42800 10 monclient: monmap: 2024-09-12T17:25:51.558 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:25:51.558 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:25:51.558 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:25:51.558 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:25:51.558 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:25:51.559 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:51.559 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:25:51.559 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:25:51.559 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:25:51.559 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.559 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding auth protocol: cephx 2024-09-12T17:25:51.559 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding auth protocol: cephx 2024-09-12T17:25:51.559 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding auth protocol: cephx 2024-09-12T17:25:51.559 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding con mode: secure 2024-09-12T17:25:51.559 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding con mode: crc 2024-09-12T17:25:51.559 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding con mode: secure 2024-09-12T17:25:51.559 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding con mode: crc 2024-09-12T17:25:51.559 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding con mode: secure 2024-09-12T17:25:51.560 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding con mode: crc 2024-09-12T17:25:51.560 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding con mode: crc 2024-09-12T17:25:51.560 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding con mode: secure 2024-09-12T17:25:51.560 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding con mode: crc 2024-09-12T17:25:51.560 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding con mode: secure 2024-09-12T17:25:51.560 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding con mode: crc 2024-09-12T17:25:51.560 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226545eb0) adding con mode: secure 2024-09-12T17:25:51.560 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T17:25:51.417+0000 7f594cd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:51.560 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command objecter_requests cmddesc objecter_requests hook 0x55c226549900 EEXIST 2024-09-12T17:25:51.560 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T17:25:51.417+0000 7f594cd42800 10 monclient: init 2024-09-12T17:25:51.560 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding auth protocol: cephx 2024-09-12T17:25:51.560 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding auth protocol: cephx 2024-09-12T17:25:51.560 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding auth protocol: cephx 2024-09-12T17:25:51.560 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding con mode: secure 2024-09-12T17:25:51.561 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T17:25:51.417+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding con mode: crc 2024-09-12T17:25:51.561 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T17:25:51.418+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding con mode: secure 2024-09-12T17:25:51.561 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T17:25:51.418+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding con mode: crc 2024-09-12T17:25:51.561 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T17:25:51.418+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding con mode: secure 2024-09-12T17:25:51.561 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T17:25:51.418+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding con mode: crc 2024-09-12T17:25:51.561 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T17:25:51.418+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding con mode: crc 2024-09-12T17:25:51.561 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T17:25:51.418+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding con mode: secure 2024-09-12T17:25:51.561 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T17:25:51.418+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding con mode: crc 2024-09-12T17:25:51.561 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T17:25:51.418+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding con mode: secure 2024-09-12T17:25:51.561 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T17:25:51.418+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding con mode: crc 2024-09-12T17:25:51.561 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T17:25:51.418+0000 7f594cd42800 5 AuthRegistry(0x55c226544588) adding con mode: secure 2024-09-12T17:25:51.561 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T17:25:51.418+0000 7f594cd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:51.561 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T17:25:51.418+0000 7f594cd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:51.562 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T17:25:51.418+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command rotate-key cmddesc rotate-key hook 0x55c2265446d0 EEXIST 2024-09-12T17:25:51.562 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T17:25:51.418+0000 7f594cd42800 10 monclient: _reopen_session rank -1 2024-09-12T17:25:51.562 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T17:25:51.418+0000 7f594cd42800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:25:51.562 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T17:25:51.418+0000 7f594cd42800 10 monclient(hunting): picked mon.noname-a con 0x55c22656d5f0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:25:51.562 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T17:25:51.418+0000 7f594cd42800 10 monclient(hunting): picked mon.noname-c con 0x55c22656f8c0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:25:51.562 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T17:25:51.418+0000 7f594cd42800 10 monclient(hunting): picked mon.noname-b con 0x55c22656bdc0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:25:51.562 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T17:25:51.418+0000 7f594cd42800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:51.562 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T17:25:51.418+0000 7f594cd42800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:51.562 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T17:25:51.418+0000 7f594cd42800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:51.562 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T17:25:51.418+0000 7f594cd42800 10 monclient(hunting): _renew_subs 2024-09-12T17:25:51.562 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T17:25:51.418+0000 7f594cd42800 10 monclient(hunting): authenticate will time out at 2362.768542s 2024-09-12T17:25:51.562 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T17:25:51.418+0000 7f5948a86640 10 monclient(hunting): get_auth_request con 0x55c22656d5f0 auth_method 0 2024-09-12T17:25:51.562 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T17:25:51.418+0000 7f5948a86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:51.563 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T17:25:51.418+0000 7f5948a86640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:51.563 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T17:25:51.418+0000 7f5948a86640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:51.563 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T17:25:51.418+0000 7f5948285640 10 monclient(hunting): get_auth_request con 0x55c22656f8c0 auth_method 0 2024-09-12T17:25:51.563 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T17:25:51.418+0000 7f5948285640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:51.563 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T17:25:51.418+0000 7f5948285640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:51.563 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T17:25:51.418+0000 7f5948285640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:51.563 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T17:25:51.418+0000 7f5948a86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:51.563 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T17:25:51.418+0000 7f5948a86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:51.564 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T17:25:51.418+0000 7f5948a86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:51.564 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T17:25:51.418+0000 7f5948285640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:51.564 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T17:25:51.418+0000 7f5948285640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:51.564 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T17:25:51.418+0000 7f5948285640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:51.564 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T17:25:51.418+0000 7f5949287640 10 monclient(hunting): get_auth_request con 0x55c22656bdc0 auth_method 0 2024-09-12T17:25:51.564 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T17:25:51.418+0000 7f5949287640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:51.564 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T17:25:51.418+0000 7f5949287640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:51.564 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T17:25:51.418+0000 7f5949287640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:51.564 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T17:25:51.418+0000 7f5948a86640 10 monclient(hunting): handle_auth_done global_id 7383 payload 824 2024-09-12T17:25:51.564 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T17:25:51.418+0000 7f5948a86640 10 monclient: _finish_hunting 0 2024-09-12T17:25:51.564 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T17:25:51.418+0000 7f5948a86640 1 monclient: found mon.noname-a 2024-09-12T17:25:51.564 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T17:25:51.418+0000 7f5948a86640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:25:51.564 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T17:25:51.419+0000 7f582e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:51.565 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T17:25:51.419+0000 7f582e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:25:51.565 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T17:25:51.419+0000 7f582e7fc640 10 monclient: dump: 2024-09-12T17:25:51.565 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:51.565 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:51.565 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.565 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.565 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:51.565 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:51.565 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:51.565 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:51.565 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:51.565 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.565 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T17:25:51.419+0000 7f582e7fc640 10 monclient: _finish_auth 0 2024-09-12T17:25:51.566 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T17:25:51.419+0000 7f582e7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:25:51.566 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T17:25:51.419+0000 7f582e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:25:51.566 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T17:25:51.419+0000 7f582e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:51.566 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T17:25:51.419+0000 7f582e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:25:51.566 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T17:25:51.419+0000 7f582e7fc640 10 monclient: dump: 2024-09-12T17:25:51.566 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:51.566 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:51.566 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.566 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.566 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:51.566 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:51.566 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:51.566 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:51.567 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:51.567 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.567 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T17:25:51.419+0000 7f594cd42800 5 monclient: authenticate success, global_id 7383 2024-09-12T17:25:51.567 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T17:25:51.419+0000 7f594cd42800 10 monclient: _renew_subs 2024-09-12T17:25:51.567 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T17:25:51.419+0000 7f5949a88640 4 set_mon_vals no callback set 2024-09-12T17:25:51.567 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T17:25:51.419+0000 7f594cd42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:25:51.567 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T17:25:51.419+0000 7f594cd42800 10 monclient: _renew_subs 2024-09-12T17:25:51.567 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T17:25:51.419+0000 7f594cd42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:25:51.567 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T17:25:51.421+0000 7f582e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:25:51.567 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T17:25:51.421+0000 7f582e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:25:51.567 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T17:25:51.421+0000 7f582e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:25:51.567 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T17:25:51.421+0000 7f5948285640 10 monclient: get_auth_request con 0x7f5820076380 auth_method 0 2024-09-12T17:25:51.567 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T17:25:51.421+0000 7f594cd42800 10 monclient: get_monmap_and_config 2024-09-12T17:25:51.567 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T17:25:51.421+0000 7f594cd42800 10 monclient: build_initial_monmap 2024-09-12T17:25:51.568 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T17:25:51.421+0000 7f594cd42800 1 build_initial for_mkfs: 0 2024-09-12T17:25:51.568 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T17:25:51.421+0000 7f594cd42800 10 monclient: monmap: 2024-09-12T17:25:51.568 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:25:51.568 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:25:51.568 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:25:51.568 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:25:51.568 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:25:51.568 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:51.568 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:25:51.568 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:25:51.568 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:25:51.568 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.568 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding auth protocol: cephx 2024-09-12T17:25:51.568 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding auth protocol: cephx 2024-09-12T17:25:51.569 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding auth protocol: cephx 2024-09-12T17:25:51.569 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding con mode: secure 2024-09-12T17:25:51.569 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding con mode: crc 2024-09-12T17:25:51.569 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding con mode: secure 2024-09-12T17:25:51.569 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding con mode: crc 2024-09-12T17:25:51.569 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding con mode: secure 2024-09-12T17:25:51.569 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding con mode: crc 2024-09-12T17:25:51.569 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding con mode: crc 2024-09-12T17:25:51.569 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding con mode: secure 2024-09-12T17:25:51.569 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding con mode: crc 2024-09-12T17:25:51.569 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding con mode: secure 2024-09-12T17:25:51.569 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding con mode: crc 2024-09-12T17:25:51.569 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x55c22658ce50) adding con mode: secure 2024-09-12T17:25:51.570 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T17:25:51.421+0000 7f594cd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:51.570 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T17:25:51.421+0000 7f594cd42800 10 monclient: init 2024-09-12T17:25:51.570 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding auth protocol: cephx 2024-09-12T17:25:51.570 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding auth protocol: cephx 2024-09-12T17:25:51.570 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding auth protocol: cephx 2024-09-12T17:25:51.570 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding con mode: secure 2024-09-12T17:25:51.570 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding con mode: crc 2024-09-12T17:25:51.570 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding con mode: secure 2024-09-12T17:25:51.570 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding con mode: crc 2024-09-12T17:25:51.570 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding con mode: secure 2024-09-12T17:25:51.570 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding con mode: crc 2024-09-12T17:25:51.570 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding con mode: crc 2024-09-12T17:25:51.570 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding con mode: secure 2024-09-12T17:25:51.571 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding con mode: crc 2024-09-12T17:25:51.571 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding con mode: secure 2024-09-12T17:25:51.571 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding con mode: crc 2024-09-12T17:25:51.571 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T17:25:51.421+0000 7f594cd42800 5 AuthRegistry(0x7ffccad486a0) adding con mode: secure 2024-09-12T17:25:51.571 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T17:25:51.422+0000 7f594cd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:51.571 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T17:25:51.422+0000 7f594cd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:51.571 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T17:25:51.422+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command rotate-key cmddesc rotate-key hook 0x7ffccad487e8 EEXIST 2024-09-12T17:25:51.571 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T17:25:51.422+0000 7f594cd42800 10 monclient: _reopen_session rank -1 2024-09-12T17:25:51.571 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T17:25:51.422+0000 7f594cd42800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:25:51.571 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T17:25:51.422+0000 7f594cd42800 10 monclient(hunting): picked mon.noname-c con 0x55c2265bc5e0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:25:51.571 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T17:25:51.422+0000 7f594cd42800 10 monclient(hunting): picked mon.noname-a con 0x55c2265bc9c0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:25:51.571 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T17:25:51.422+0000 7f594cd42800 10 monclient(hunting): picked mon.noname-b con 0x55c2265c1b00 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:25:51.571 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T17:25:51.422+0000 7f594cd42800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:51.572 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T17:25:51.422+0000 7f594cd42800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:51.572 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T17:25:51.422+0000 7f594cd42800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:51.572 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T17:25:51.422+0000 7f594cd42800 10 monclient(hunting): _renew_subs 2024-09-12T17:25:51.572 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T17:25:51.422+0000 7f594cd42800 10 monclient(hunting): authenticate will time out at 2362.772360s 2024-09-12T17:25:51.572 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T17:25:51.422+0000 7f5948a86640 10 monclient(hunting): get_auth_request con 0x55c2265bc5e0 auth_method 0 2024-09-12T17:25:51.572 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T17:25:51.422+0000 7f5948a86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:51.572 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T17:25:51.422+0000 7f5948a86640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:51.572 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T17:25:51.422+0000 7f5948a86640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:51.572 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T17:25:51.422+0000 7f5948285640 10 monclient(hunting): get_auth_request con 0x55c2265bc9c0 auth_method 0 2024-09-12T17:25:51.572 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T17:25:51.422+0000 7f5948285640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:51.572 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T17:25:51.422+0000 7f5948285640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:51.572 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T17:25:51.422+0000 7f5948285640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:51.572 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T17:25:51.422+0000 7f5949287640 10 monclient(hunting): get_auth_request con 0x55c2265c1b00 auth_method 0 2024-09-12T17:25:51.573 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T17:25:51.422+0000 7f5949287640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:51.573 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T17:25:51.422+0000 7f5949287640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:51.573 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T17:25:51.422+0000 7f5949287640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:51.573 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T17:25:51.422+0000 7f5948a86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:51.573 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T17:25:51.422+0000 7f5948a86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:51.573 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T17:25:51.422+0000 7f5948a86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:51.573 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T17:25:51.422+0000 7f5948285640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:51.573 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T17:25:51.422+0000 7f5948285640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:51.573 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T17:25:51.422+0000 7f5948285640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:51.573 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T17:25:51.422+0000 7f5949287640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:51.573 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T17:25:51.422+0000 7f5949287640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:51.573 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T17:25:51.422+0000 7f5949287640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:51.573 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T17:25:51.422+0000 7f5948a86640 10 monclient(hunting): handle_auth_done global_id 6944 payload 274 2024-09-12T17:25:51.573 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T17:25:51.422+0000 7f5948a86640 10 monclient: _finish_hunting 0 2024-09-12T17:25:51.574 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T17:25:51.422+0000 7f5948a86640 1 monclient: found mon.noname-c 2024-09-12T17:25:51.574 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T17:25:51.422+0000 7f5948a86640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:25:51.574 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T17:25:51.422+0000 7f581ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:51.574 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T17:25:51.422+0000 7f581ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:25:51.574 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T17:25:51.422+0000 7f581ffff640 10 monclient: dump: 2024-09-12T17:25:51.574 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:51.574 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:51.574 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.574 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.574 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:51.574 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:51.574 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:51.574 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:51.574 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:51.574 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.575 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T17:25:51.423+0000 7f581ffff640 10 monclient: _finish_auth 0 2024-09-12T17:25:51.575 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T17:25:51.423+0000 7f581ffff640 10 monclient: _check_auth_tickets 2024-09-12T17:25:51.575 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T17:25:51.423+0000 7f581ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:25:51.575 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T17:25:51.423+0000 7f581ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:51.575 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T17:25:51.423+0000 7f581ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:25:51.575 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T17:25:51.423+0000 7f581ffff640 10 monclient: dump: 2024-09-12T17:25:51.575 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:51.575 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:51.575 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.575 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.575 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:51.575 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:51.575 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:51.576 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:51.576 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:51.576 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.576 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 monclient: authenticate success, global_id 6944 2024-09-12T17:25:51.576 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T17:25:51.423+0000 7f594cd42800 10 monclient: get_monmap_and_config success 2024-09-12T17:25:51.576 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T17:25:51.423+0000 7f594cd42800 4 set_mon_vals no callback set 2024-09-12T17:25:51.576 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T17:25:51.423+0000 7f594cd42800 10 monclient: shutdown 2024-09-12T17:25:51.576 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T17:25:51.423+0000 7f594cd42800 10 monclient: build_initial_monmap 2024-09-12T17:25:51.576 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T17:25:51.423+0000 7f594cd42800 1 build_initial for_mkfs: 0 2024-09-12T17:25:51.576 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T17:25:51.423+0000 7f594cd42800 10 monclient: monmap: 2024-09-12T17:25:51.576 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:25:51.576 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:25:51.576 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:25:51.576 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:25:51.577 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:25:51.577 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:51.577 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:25:51.577 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:25:51.577 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:25:51.577 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.577 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding auth protocol: cephx 2024-09-12T17:25:51.577 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding auth protocol: cephx 2024-09-12T17:25:51.577 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding auth protocol: cephx 2024-09-12T17:25:51.577 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding con mode: secure 2024-09-12T17:25:51.577 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding con mode: crc 2024-09-12T17:25:51.577 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding con mode: secure 2024-09-12T17:25:51.577 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding con mode: crc 2024-09-12T17:25:51.578 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding con mode: secure 2024-09-12T17:25:51.578 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding con mode: crc 2024-09-12T17:25:51.578 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding con mode: crc 2024-09-12T17:25:51.578 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding con mode: secure 2024-09-12T17:25:51.578 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding con mode: crc 2024-09-12T17:25:51.578 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding con mode: secure 2024-09-12T17:25:51.578 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding con mode: crc 2024-09-12T17:25:51.578 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 AuthRegistry(0x55c22637c2f0) adding con mode: secure 2024-09-12T17:25:51.578 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T17:25:51.423+0000 7f594cd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:51.578 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T17:25:51.423+0000 7f594cd42800 1 librados: starting msgr at 2024-09-12T17:25:51.578 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T17:25:51.423+0000 7f594cd42800 1 librados: starting objecter 2024-09-12T17:25:51.578 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T17:25:51.423+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command objecter_requests cmddesc objecter_requests hook 0x55c226593cb0 EEXIST 2024-09-12T17:25:51.578 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T17:25:51.424+0000 7f594cd42800 1 librados: setting wanted keys 2024-09-12T17:25:51.578 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T17:25:51.424+0000 7f594cd42800 1 librados: calling monclient init 2024-09-12T17:25:51.579 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T17:25:51.424+0000 7f594cd42800 10 monclient: init 2024-09-12T17:25:51.579 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding auth protocol: cephx 2024-09-12T17:25:51.579 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding auth protocol: cephx 2024-09-12T17:25:51.579 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding auth protocol: cephx 2024-09-12T17:25:51.579 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding con mode: secure 2024-09-12T17:25:51.579 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding con mode: crc 2024-09-12T17:25:51.579 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding con mode: secure 2024-09-12T17:25:51.579 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding con mode: crc 2024-09-12T17:25:51.579 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding con mode: secure 2024-09-12T17:25:51.579 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding con mode: crc 2024-09-12T17:25:51.579 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding con mode: crc 2024-09-12T17:25:51.579 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding con mode: secure 2024-09-12T17:25:51.579 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding con mode: crc 2024-09-12T17:25:51.579 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding con mode: secure 2024-09-12T17:25:51.579 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding con mode: crc 2024-09-12T17:25:51.580 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 AuthRegistry(0x55c2265853a0) adding con mode: secure 2024-09-12T17:25:51.580 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T17:25:51.424+0000 7f594cd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:51.580 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T17:25:51.424+0000 7f594cd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:51.580 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T17:25:51.424+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command rotate-key cmddesc rotate-key hook 0x55c2265854e8 EEXIST 2024-09-12T17:25:51.580 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T17:25:51.424+0000 7f594cd42800 10 monclient: _reopen_session rank -1 2024-09-12T17:25:51.580 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T17:25:51.424+0000 7f594cd42800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:25:51.580 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T17:25:51.424+0000 7f594cd42800 10 monclient(hunting): picked mon.noname-b con 0x55c2265bc5e0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:25:51.580 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T17:25:51.424+0000 7f594cd42800 10 monclient(hunting): picked mon.noname-c con 0x55c2265c1b00 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:25:51.580 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T17:25:51.424+0000 7f594cd42800 10 monclient(hunting): picked mon.noname-a con 0x55c2265cfb30 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:25:51.580 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T17:25:51.424+0000 7f594cd42800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:51.580 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T17:25:51.424+0000 7f594cd42800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:51.580 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T17:25:51.424+0000 7f594cd42800 10 monclient(hunting): start opening mon connection 2024-09-12T17:25:51.581 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T17:25:51.424+0000 7f594cd42800 10 monclient(hunting): _renew_subs 2024-09-12T17:25:51.581 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T17:25:51.424+0000 7f594cd42800 10 monclient(hunting): authenticate will time out at 2362.774595s 2024-09-12T17:25:51.581 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T17:25:51.424+0000 7f5948285640 10 monclient(hunting): get_auth_request con 0x55c2265c1b00 auth_method 0 2024-09-12T17:25:51.581 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T17:25:51.424+0000 7f5948285640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:51.581 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T17:25:51.424+0000 7f5948285640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:51.581 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T17:25:51.424+0000 7f5948285640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:51.581 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T17:25:51.424+0000 7f5949287640 10 monclient(hunting): get_auth_request con 0x55c2265cfb30 auth_method 0 2024-09-12T17:25:51.581 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T17:25:51.424+0000 7f5949287640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:51.581 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T17:25:51.424+0000 7f5949287640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:51.581 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T17:25:51.424+0000 7f5949287640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:51.581 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T17:25:51.424+0000 7f5948a86640 10 monclient(hunting): get_auth_request con 0x55c2265bc5e0 auth_method 0 2024-09-12T17:25:51.581 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T17:25:51.424+0000 7f5948a86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:25:51.581 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T17:25:51.424+0000 7f5948a86640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:25:51.582 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T17:25:51.424+0000 7f5948a86640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:25:51.582 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T17:25:51.424+0000 7f5949287640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:51.582 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T17:25:51.424+0000 7f5949287640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:51.582 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T17:25:51.424+0000 7f5949287640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:51.582 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T17:25:51.424+0000 7f5948285640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:51.582 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T17:25:51.424+0000 7f5948285640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:51.582 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T17:25:51.424+0000 7f5948285640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:51.582 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T17:25:51.424+0000 7f5948a86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:25:51.582 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T17:25:51.424+0000 7f5948a86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:25:51.582 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T17:25:51.424+0000 7f5948a86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:25:51.582 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T17:25:51.424+0000 7f5949287640 10 monclient(hunting): handle_auth_done global_id 7389 payload 824 2024-09-12T17:25:51.582 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T17:25:51.424+0000 7f5949287640 10 monclient: _finish_hunting 0 2024-09-12T17:25:51.583 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T17:25:51.424+0000 7f5949287640 1 monclient: found mon.noname-a 2024-09-12T17:25:51.583 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T17:25:51.424+0000 7f5949287640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:25:51.583 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T17:25:51.425+0000 7f581e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:51.583 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T17:25:51.425+0000 7f581e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:25:51.583 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T17:25:51.425+0000 7f581e7fc640 10 monclient: dump: 2024-09-12T17:25:51.583 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:51.583 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:51.583 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.583 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.583 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:51.583 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:51.583 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:51.583 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:51.584 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:51.584 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.584 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T17:25:51.425+0000 7f581e7fc640 10 monclient: _finish_auth 0 2024-09-12T17:25:51.584 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T17:25:51.425+0000 7f581e7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:25:51.584 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T17:25:51.425+0000 7f581e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:25:51.584 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T17:25:51.425+0000 7f581e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:25:51.584 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T17:25:51.425+0000 7f581e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:25:51.584 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T17:25:51.425+0000 7f581e7fc640 10 monclient: dump: 2024-09-12T17:25:51.584 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:25:51.584 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:25:51.584 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.584 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:25:51.584 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:25:51.585 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:25:51.585 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:25:51.585 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:25:51.585 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:25:51.585 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.585 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T17:25:51.425+0000 7f594cd42800 5 monclient: authenticate success, global_id 7389 2024-09-12T17:25:51.585 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T17:25:51.425+0000 7f594cd42800 10 monclient: _renew_subs 2024-09-12T17:25:51.585 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T17:25:51.425+0000 7f594cd42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:25:51.585 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T17:25:51.425+0000 7f581ffff640 4 set_mon_vals no callback set 2024-09-12T17:25:51.585 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T17:25:51.425+0000 7f594cd42800 10 monclient: _renew_subs 2024-09-12T17:25:51.585 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T17:25:51.425+0000 7f594cd42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:25:51.585 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T17:25:51.425+0000 7f594cd42800 1 librados: init done 2024-09-12T17:25:51.585 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T17:25:51.425+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command cr dump hook 0x55c2265bbea8 2024-09-12T17:25:51.586 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T17:25:51.426+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.586 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T17:25:51.427+0000 7f581e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:25:51.586 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T17:25:51.427+0000 7f581e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:25:51.586 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T17:25:51.427+0000 7f581e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:25:51.586 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T17:25:51.427+0000 7f5948a86640 10 monclient: get_auth_request con 0x7f5814076470 auth_method 0 2024-09-12T17:25:51.586 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T17:25:51.428+0000 7f5948285640 10 monclient: get_auth_request con 0x55c2265dcb10 auth_method 0 2024-09-12T17:25:51.586 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T17:25:51.428+0000 7f594cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.586 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T17:25:51.428+0000 7f594cd42800 20 realm 2024-09-12T17:25:51.586 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T17:25:51.428+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.586 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T17:25:51.429+0000 7f594cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.586 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T17:25:51.429+0000 7f594cd42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:51.586 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T17:25:51.429+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.586 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T17:25:51.429+0000 7f594cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.587 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T17:25:51.429+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.587 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T17:25:51.429+0000 7f5948a86640 10 monclient: get_auth_request con 0x55c2265e0d10 auth_method 0 2024-09-12T17:25:51.587 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T17:25:51.429+0000 7f594cd42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:51.587 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T17:25:51.429+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.587 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T17:25:51.430+0000 7f5948285640 10 monclient: get_auth_request con 0x55c2265e4570 auth_method 0 2024-09-12T17:25:51.587 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T17:25:51.430+0000 7f594cd42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:51.587 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T17:25:51.430+0000 7f594cd42800 20 searching for the correct realm 2024-09-12T17:25:51.587 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T17:25:51.430+0000 7f5949287640 10 monclient: get_auth_request con 0x55c2265e92a0 auth_method 0 2024-09-12T17:25:51.587 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T17:25:51.431+0000 7f5948a86640 10 monclient: get_auth_request con 0x7f5940016050 auth_method 0 2024-09-12T17:25:51.587 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T17:25:51.432+0000 7f5948285640 10 monclient: get_auth_request con 0x7f5938007cb0 auth_method 0 2024-09-12T17:25:51.587 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T17:25:51.433+0000 7f5949287640 0 -- 172.21.15.67:0/1645958681 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x55c2265e92a0 msgr2=0x55c2265eb760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:51.587 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T17:25:51.433+0000 7f581e7fc640 1 client.7389.objecter ms_handle_reset 0x55c2265e92a0 session 0x55c2265e8c20 osd.3 2024-09-12T17:25:51.587 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T17:25:51.433+0000 7f581e7fc640 10 monclient: _renew_subs 2024-09-12T17:25:51.588 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T17:25:51.433+0000 7f581e7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:25:51.588 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T17:25:51.433+0000 7f5949287640 10 monclient: get_auth_request con 0x7f5814086310 auth_method 0 2024-09-12T17:25:51.588 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T17:25:51.434+0000 7f5949287640 10 monclient: get_auth_request con 0x7f5930026040 auth_method 0 2024-09-12T17:25:51.588 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T17:25:51.436+0000 7f5948a86640 10 monclient: get_auth_request con 0x7f5930046b70 auth_method 0 2024-09-12T17:25:51.588 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T17:25:51.437+0000 7f5948a86640 0 -- 172.21.15.67:0/1645958681 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f5930046b70 msgr2=0x7f593003e460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:51.588 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T17:25:51.437+0000 7f581e7fc640 1 client.7389.objecter ms_handle_reset 0x7f5930046b70 session 0x7f593002a070 osd.0 2024-09-12T17:25:51.588 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T17:25:51.437+0000 7f5948a86640 10 monclient: get_auth_request con 0x55c2265e92a0 auth_method 0 2024-09-12T17:25:51.588 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:51.588 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:51.588 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:51.588 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:51.588 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:51.588 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:51.589 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.589 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.589 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.589 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:51.589 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.589 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:51.589 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 zone default found 2024-09-12T17:25:51.589 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T17:25:51.441+0000 7f594cd42800 4 Realm: () 2024-09-12T17:25:51.589 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T17:25:51.441+0000 7f594cd42800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:51.589 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T17:25:51.441+0000 7f594cd42800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:51.589 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T17:25:51.441+0000 7f594cd42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:51.589 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 zonegroup default 2024-09-12T17:25:51.589 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T17:25:51.441+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.589 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T17:25:51.442+0000 7f594cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.590 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T17:25:51.442+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.590 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T17:25:51.442+0000 7f594cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.590 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T17:25:51.442+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.590 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T17:25:51.442+0000 7f594cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.590 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T17:25:51.442+0000 7f594cd42800 20 started sync module instance, tier type = 2024-09-12T17:25:51.590 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T17:25:51.442+0000 7f594cd42800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:51.590 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T17:25:51.451+0000 7f594cd42800 20 add_watcher() i=0 2024-09-12T17:25:51.590 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T17:25:51.451+0000 7f594cd42800 20 add_watcher() i=1 2024-09-12T17:25:51.590 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T17:25:51.451+0000 7f594cd42800 20 add_watcher() i=2 2024-09-12T17:25:51.590 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T17:25:51.451+0000 7f594cd42800 20 add_watcher() i=3 2024-09-12T17:25:51.590 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T17:25:51.451+0000 7f594cd42800 20 add_watcher() i=4 2024-09-12T17:25:51.590 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T17:25:51.451+0000 7f594cd42800 20 add_watcher() i=5 2024-09-12T17:25:51.590 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T17:25:51.451+0000 7f594cd42800 20 add_watcher() i=6 2024-09-12T17:25:51.590 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T17:25:51.452+0000 7f594cd42800 20 add_watcher() i=7 2024-09-12T17:25:51.591 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T17:25:51.452+0000 7f594cd42800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:51.591 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding auth protocol: cephx 2024-09-12T17:25:51.591 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding auth protocol: cephx 2024-09-12T17:25:51.591 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding auth protocol: cephx 2024-09-12T17:25:51.591 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding con mode: secure 2024-09-12T17:25:51.591 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding con mode: crc 2024-09-12T17:25:51.591 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding con mode: secure 2024-09-12T17:25:51.591 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding con mode: crc 2024-09-12T17:25:51.591 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding con mode: secure 2024-09-12T17:25:51.591 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding con mode: crc 2024-09-12T17:25:51.591 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding con mode: crc 2024-09-12T17:25:51.591 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding con mode: secure 2024-09-12T17:25:51.591 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T17:25:51.453+0000 7f57ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:51.591 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding con mode: crc 2024-09-12T17:25:51.592 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding con mode: secure 2024-09-12T17:25:51.592 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding con mode: crc 2024-09-12T17:25:51.592 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 AuthRegistry(0x7ffccad48b70) adding con mode: secure 2024-09-12T17:25:51.592 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T17:25:51.453+0000 7f594cd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:25:51.592 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T17:25:51.453+0000 7f594cd42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:51.592 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T17:25:51.453+0000 7f594cd42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:51.592 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command cache list hook 0x55c2265ba4c0 2024-09-12T17:25:51.592 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command cache inspect hook 0x55c2265ba4c0 2024-09-12T17:25:51.592 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command cache erase hook 0x55c2265ba4c0 2024-09-12T17:25:51.592 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command cache zap hook 0x55c2265ba4c0 2024-09-12T17:25:51.592 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T17:25:51.453+0000 7f594cd42800 5 note: GC not initialized 2024-09-12T17:25:51.592 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T17:25:51.454+0000 7f57fe7e4640 20 reqs_thread_entry: start 2024-09-12T17:25:51.593 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T17:25:51.454+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command sync trace show hook 0x7f59380bf070 2024-09-12T17:25:51.593 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T17:25:51.454+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command sync trace history hook 0x7f59380bf070 2024-09-12T17:25:51.593 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T17:25:51.454+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command sync trace active hook 0x7f59380bf070 2024-09-12T17:25:51.593 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T17:25:51.454+0000 7f594cd42800 5 asok(0x55c2262d0730) register_command sync trace active_short hook 0x7f59380bf070 2024-09-12T17:25:51.593 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T17:25:51.454+0000 7f594cd42800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:51.593 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T17:25:51.454+0000 7f594cd42800 20 Filter name: none 2024-09-12T17:25:51.593 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T17:25:51.454+0000 7f57f7fff640 20 reqs_thread_entry: start 2024-09-12T17:25:51.593 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T17:25:51.454+0000 7f594cd42800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:25:51.593 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T17:25:51.454+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.593 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T17:25:51.454+0000 7f594cd42800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:25:51.593 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T17:25:51.454+0000 7f594cd42800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:25:51.593 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T17:25:51.454+0000 7f594cd42800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:25:51.593 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T17:25:51.454+0000 7f594cd42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 : miss 2024-09-12T17:25:51.593 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T17:25:51.454+0000 7f594cd42800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.594 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T17:25:51.455+0000 7f594cd42800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:25:51.594 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T17:25:51.455+0000 7f594cd42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 info.flags=0x17 2024-09-12T17:25:51.594 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T17:25:51.455+0000 7f594cd42800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 to cache LRU end 2024-09-12T17:25:51.594 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T17:25:51.455+0000 7f594cd42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:25:51.594 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T17:25:51.455+0000 7f594cd42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:51.594 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T17:25:51.455+0000 7f594cd42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 2024-09-12T17:25:51.594 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T17:25:51.456+0000 7f581e7fc640 1 client.7389.objecter ms_handle_reset 0x7f5814086310 session 0x55c2265e8c20 osd.3 2024-09-12T17:25:51.594 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T17:25:51.456+0000 7f5949287640 10 monclient: get_auth_request con 0x7f5930046b70 auth_method 0 2024-09-12T17:25:51.594 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T17:25:51.459+0000 7f594cd42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 info.flags=0x17 2024-09-12T17:25:51.594 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T17:25:51.459+0000 7f594cd42800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 to cache LRU end 2024-09-12T17:25:51.594 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T17:25:51.459+0000 7f594cd42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:51.594 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T17:25:51.459+0000 7f594cd42800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33, ofs0, ns] 2024-09-12T17:25:51.594 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T17:25:51.459+0000 7f581ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464334 cookie 94292355755632 notifier 7389 bl.length()=1015 2024-09-12T17:25:51.594 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T17:25:51.459+0000 7f581ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 info.flags=0x17 2024-09-12T17:25:51.595 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T17:25:51.459+0000 7f581ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 to cache LRU end 2024-09-12T17:25:51.595 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T17:25:51.459+0000 7f581ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:51.595 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T17:25:51.461+0000 7f594cd42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): orig_sources= new_sources= 2024-09-12T17:25:51.595 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T17:25:51.461+0000 7f594cd42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): potential sources added=[] removed=[] 2024-09-12T17:25:51.595 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T17:25:51.461+0000 7f594cd42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): orig_dests= new_dests= 2024-09-12T17:25:51.595 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T17:25:51.461+0000 7f594cd42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): potential dests added=[] removed=[] 2024-09-12T17:25:51.595 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T17:25:51.463+0000 7f594cd42800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.33.1.0 2024-09-12T17:25:51.595 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T17:25:51.463+0000 7f594cd42800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.33.1.0 2024-09-12T17:25:51.595 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T17:25:51.463+0000 7f594cd42800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.33.1.1 2024-09-12T17:25:51.595 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T17:25:51.463+0000 7f594cd42800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.33.1.1 2024-09-12T17:25:51.595 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T17:25:51.463+0000 7f594cd42800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.33.0 2024-09-12T17:25:51.595 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T17:25:51.465+0000 7f594cd42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:25:51.595 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T17:25:51.465+0000 7f594cd42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 2024-09-12T17:25:51.595 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T17:25:51.466+0000 7f594cd42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 info.flags=0x17 2024-09-12T17:25:51.596 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T17:25:51.466+0000 7f594cd42800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 to cache LRU end 2024-09-12T17:25:51.596 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T17:25:51.466+0000 7f594cd42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:51.596 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T17:25:51.466+0000 7f594cd42800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33, ofs0, ns] 2024-09-12T17:25:51.596 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T17:25:51.466+0000 7f581ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464335 cookie 94292355755632 notifier 7389 bl.length()=1015 2024-09-12T17:25:51.596 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T17:25:51.466+0000 7f581ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 info.flags=0x17 2024-09-12T17:25:51.596 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T17:25:51.466+0000 7f581ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 to cache LRU end 2024-09-12T17:25:51.596 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T17:25:51.466+0000 7f581ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:25:51.596 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T17:25:51.468+0000 7f594cd42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): orig_sources= new_sources= 2024-09-12T17:25:51.596 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T17:25:51.468+0000 7f594cd42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): potential sources added=[] removed=[] 2024-09-12T17:25:51.596 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T17:25:51.468+0000 7f594cd42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): orig_dests= new_dests= 2024-09-12T17:25:51.596 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T17:25:51.468+0000 7f594cd42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): potential dests added=[] removed=[] 2024-09-12T17:25:51.596 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T17:25:51.469+0000 7f594cd42800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.33.0 2024-09-12T17:25:51.596 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T17:25:51.470+0000 7f594cd42800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f594cd42800 time 2024-09-12T17:25:51.470333+0000 2024-09-12T17:25:51.597 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:25:51.597 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.597 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:25:51.597 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f594e58c71a] 2024-09-12T17:25:51.597 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f594e58c8d8] 2024-09-12T17:25:51.597 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c22479c841] 2024-09-12T17:25:51.597 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55c2247ac827] 2024-09-12T17:25:51.597 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T17:25:51.597 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f594d229590] 2024-09-12T17:25:51.597 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T17:25:51.597 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T17:25:51.597 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.597 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T17:25:51.470+0000 7f594cd42800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:25:51.597 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f594cd42800 thread_name:radosgw-admin 2024-09-12T17:25:51.598 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.598 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:25:51.598 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f594d23e6f0] 2024-09-12T17:25:51.598 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f594d28b99c] 2024-09-12T17:25:51.598 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:25:51.598 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:25:51.598 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f594e58c774] 2024-09-12T17:25:51.598 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f594e58c8d8] 2024-09-12T17:25:51.598 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c22479c841] 2024-09-12T17:25:51.598 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55c2247ac827] 2024-09-12T17:25:51.598 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T17:25:51.598 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f594d229590] 2024-09-12T17:25:51.598 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T17:25:51.598 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T17:25:51.598 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:25:51.599 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.599 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T17:25:51.599 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T17:25:51.599 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T17:25:51.599 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T17:25:51.599 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T17:25:51.599 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T17:25:51.599 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T17:25:51.599 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T17:25:51.599 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T17:25:51.599 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T17:25:51.599 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T17:25:51.599 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T17:25:51.599 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T17:25:51.599 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T17:25:51.600 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T17:25:51.600 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T17:25:51.600 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T17:25:51.600 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T17:25:51.600 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T17:25:51.600 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T17:25:51.600 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T17:25:51.600 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T17:25:51.600 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T17:25:51.600 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T17:25:51.600 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:25:51.600 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T17:25:51.600 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T17:25:51.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T17:25:51.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T17:25:51.601 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T17:25:51.601 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T17:25:51.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T17:25:51.601 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T17:25:51.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T17:25:51.601 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T17:25:51.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T17:25:51.601 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T17:25:51.601 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T17:25:51.601 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T17:25:51.601 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T17:25:51.601 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T17:25:51.601 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T17:25:51.602 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T17:25:51.602 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T17:25:51.602 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T17:25:51.602 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T17:25:51.602 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:25:51.602 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T17:25:51.602 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:25:51.602 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T17:25:51.602 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T17:25:51.602 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T17:25:51.602 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T17:25:51.602 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T17:25:51.602 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T17:25:51.602 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T17:25:51.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T17:25:51.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T17:25:51.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T17:25:51.603 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T17:25:51.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T17:25:51.603 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T17:25:51.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T17:25:51.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T17:25:51.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T17:25:51.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T17:25:51.603 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T17:25:51.603 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:25:51.603 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T17:25:51.604 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:25:51.604 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T17:25:51.604 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T17:25:51.604 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T17:25:51.604 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T17:25:51.604 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T17:25:51.604 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T17:25:51.604 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:25:51.604 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T17:25:51.604 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T17:25:51.604 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:25:51.604 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T17:25:51.604 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T17:25:51.604 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T17:25:51.605 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T17:25:51.605 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T17:25:51.605 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T17:25:51.605 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T17:25:51.605 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T17:25:51.605 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T17:25:51.605 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T17:25:51.605 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T17:25:51.605 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T17:25:51.605 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T17:25:51.605 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:25:51.605 INFO:tasks.workunit.client.0.smithi067.stderr: 7f57f7fff640 / http_manager 2024-09-12T17:25:51.605 INFO:tasks.workunit.client.0.smithi067.stderr: 7f57fe7e4640 / http_manager 2024-09-12T17:25:51.605 INFO:tasks.workunit.client.0.smithi067.stderr: 7f57ff7e6640 / rgw_dt_lg_renew 2024-09-12T17:25:51.606 INFO:tasks.workunit.client.0.smithi067.stderr: 7f581e7fc640 / ms_dispatch 2024-09-12T17:25:51.606 INFO:tasks.workunit.client.0.smithi067.stderr: 7f581ffff640 / io_context_pool 2024-09-12T17:25:51.606 INFO:tasks.workunit.client.0.smithi067.stderr: 7f582e7fc640 / ms_dispatch 2024-09-12T17:25:51.606 INFO:tasks.workunit.client.0.smithi067.stderr: 7f583560a640 / ms_dispatch 2024-09-12T17:25:51.606 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5836e0d640 / io_context_pool 2024-09-12T17:25:51.606 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5948285640 / msgr-worker-2 2024-09-12T17:25:51.606 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5948a86640 / msgr-worker-1 2024-09-12T17:25:51.606 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5949287640 / msgr-worker-0 2024-09-12T17:25:51.606 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5949a88640 / io_context_pool 2024-09-12T17:25:51.606 INFO:tasks.workunit.client.0.smithi067.stderr: 7f594cd42800 / radosgw-admin 2024-09-12T17:25:51.606 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T17:25:51.606 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T17:25:51.606 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:25:51.471708Z_de995c13-1af8-43f6-a0cf-2ab979ec4d9a/log 2024-09-12T17:25:51.606 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T17:25:51.607 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:25:51.608 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:51.608 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:51.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.548+0000 7fc71b3af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.550+0000 7fc71b3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.550+0000 7fc71b3af800 20 realm 2024-09-12T17:25:51.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.550+0000 7fc71b3af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.550+0000 7fc71b3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.550+0000 7fc71b3af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:51.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.550+0000 7fc71b3af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.550+0000 7fc71b3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.550+0000 7fc71b3af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.551+0000 7fc71b3af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:51.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.551+0000 7fc71b3af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.551+0000 7fc71b3af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:51.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.551+0000 7fc71b3af800 20 searching for the correct realm 2024-09-12T17:25:51.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.553+0000 7fc713fff640 0 -- 172.21.15.67:0/74347074 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7fc70c097070 msgr2=0x7fc70c0829d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:51.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.557+0000 7fc718ea0640 0 -- 172.21.15.67:0/74347074 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fc70406ba20 msgr2=0x7fc704046960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:51.767 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.765+0000 7fc71b3af800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:25:51.767 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.765+0000 7fc71b3af800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:25:51.767 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.765+0000 7fc71b3af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:51.767 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.765+0000 7fc71b3af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:51.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.765+0000 7fc71b3af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:51.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.765+0000 7fc71b3af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:51.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.765+0000 7fc71b3af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.765+0000 7fc71b3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.765+0000 7fc71b3af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.766+0000 7fc71b3af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:51.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.766+0000 7fc71b3af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.766+0000 7fc71b3af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:51.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.766+0000 7fc71b3af800 20 zone default found 2024-09-12T17:25:51.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.766+0000 7fc71b3af800 4 Realm: () 2024-09-12T17:25:51.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.766+0000 7fc71b3af800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:25:51.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.766+0000 7fc71b3af800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:25:51.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.766+0000 7fc71b3af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:51.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.766+0000 7fc71b3af800 20 zonegroup default 2024-09-12T17:25:51.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.766+0000 7fc71b3af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.766+0000 7fc71b3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.766+0000 7fc71b3af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.767+0000 7fc71b3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.767+0000 7fc71b3af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.767+0000 7fc71b3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:51.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.767+0000 7fc71b3af800 20 started sync module instance, tier type = 2024-09-12T17:25:51.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.767+0000 7fc71b3af800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:25:51.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.776+0000 7fc71b3af800 20 add_watcher() i=0 2024-09-12T17:25:51.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.776+0000 7fc71b3af800 20 add_watcher() i=1 2024-09-12T17:25:51.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.776+0000 7fc71b3af800 20 add_watcher() i=2 2024-09-12T17:25:51.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.776+0000 7fc71b3af800 20 add_watcher() i=3 2024-09-12T17:25:51.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.776+0000 7fc71b3af800 20 add_watcher() i=4 2024-09-12T17:25:51.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.776+0000 7fc71b3af800 20 add_watcher() i=5 2024-09-12T17:25:51.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.776+0000 7fc71b3af800 20 add_watcher() i=6 2024-09-12T17:25:51.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.777+0000 7fc71b3af800 20 add_watcher() i=7 2024-09-12T17:25:51.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.777+0000 7fc71b3af800 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:51.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.778+0000 7fc5cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:51.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.778+0000 7fc71b3af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:51.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.778+0000 7fc71b3af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:51.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.779+0000 7fc71b3af800 5 note: GC not initialized 2024-09-12T17:25:51.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.779+0000 7fc5ccfe1640 20 reqs_thread_entry: start 2024-09-12T17:25:51.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.779+0000 7fc71b3af800 20 init_complete bucket index max shards: 1 2024-09-12T17:25:51.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.779+0000 7fc71b3af800 20 Filter name: none 2024-09-12T17:25:51.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.779+0000 7fc5467fc640 20 reqs_thread_entry: start 2024-09-12T17:25:51.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.779+0000 7fc71b3af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.779+0000 7fc71b3af800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:25:51.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.779+0000 7fc71b3af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.780+0000 7fc71b3af800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:25:51.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.780+0000 7fc71b3af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:51.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.780+0000 7fc71b3af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.780+0000 7fc71b3af800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:25:51.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.780+0000 7fc71b3af800 20 rados->read ofs=0 len=0 2024-09-12T17:25:51.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.781+0000 7fc71b3af800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:25:51.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.781+0000 7fc71b3af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:25:51.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.782+0000 7fc5cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:51.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.784+0000 7fc71b3af800 20 remove_watcher() i=0 2024-09-12T17:25:51.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.784+0000 7fc71b3af800 2 removed watcher, disabling cache 2024-09-12T17:25:51.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.785+0000 7fc71b3af800 20 remove_watcher() i=1 2024-09-12T17:25:51.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.786+0000 7fc71b3af800 20 remove_watcher() i=2 2024-09-12T17:25:51.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.787+0000 7fc71b3af800 20 remove_watcher() i=3 2024-09-12T17:25:51.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.788+0000 7fc71b3af800 20 remove_watcher() i=4 2024-09-12T17:25:51.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.789+0000 7fc71b3af800 20 remove_watcher() i=5 2024-09-12T17:25:51.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.790+0000 7fc71b3af800 20 remove_watcher() i=6 2024-09-12T17:25:51.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:25:51.790+0000 7fc71b3af800 20 remove_watcher() i=7 2024-09-12T17:25:51.802 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.802 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:25:51.802 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-commit-target-layout id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:25:51.803 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:25:51.804 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:25:51.804 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:21.943 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:21.943 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:22.000 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:26:22.036 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:22.036 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:22.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.076+0000 7efe12e40800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.078+0000 7efe12e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.078+0000 7efe12e40800 20 realm 2024-09-12T17:26:22.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.078+0000 7efe12e40800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.078+0000 7efe12e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.078+0000 7efe12e40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:22.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.078+0000 7efe12e40800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.078+0000 7efe12e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.078+0000 7efe12e40800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.079+0000 7efe12e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:22.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.079+0000 7efe12e40800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.080+0000 7efe12e40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:22.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.080+0000 7efe12e40800 20 searching for the correct realm 2024-09-12T17:26:22.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.082+0000 7efe10129640 0 -- 172.21.15.67:0/2945669071 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7efe00070b30 msgr2=0x7efe000b00c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:22.088 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.087+0000 7efe1092a640 0 -- 172.21.15.67:0/2945669071 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7efe040650c0 msgr2=0x7efe04066210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:22.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.294+0000 7efe12e40800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:26:22.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.294+0000 7efe12e40800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:26:22.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.294+0000 7efe12e40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:22.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.294+0000 7efe12e40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:22.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.294+0000 7efe12e40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:22.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.294+0000 7efe12e40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:22.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.294+0000 7efe12e40800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.295+0000 7efe12e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.295+0000 7efe12e40800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.295+0000 7efe12e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:22.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.295+0000 7efe12e40800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.295+0000 7efe12e40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:22.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.295+0000 7efe12e40800 20 zone default found 2024-09-12T17:26:22.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.295+0000 7efe12e40800 4 Realm: () 2024-09-12T17:26:22.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.295+0000 7efe12e40800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:26:22.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.295+0000 7efe12e40800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:26:22.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.295+0000 7efe12e40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:22.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.295+0000 7efe12e40800 20 zonegroup default 2024-09-12T17:26:22.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.295+0000 7efe12e40800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.296+0000 7efe12e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.296+0000 7efe12e40800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.296+0000 7efe12e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.296+0000 7efe12e40800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.297+0000 7efe12e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.297+0000 7efe12e40800 20 started sync module instance, tier type = 2024-09-12T17:26:22.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.297+0000 7efe12e40800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:26:22.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.307+0000 7efe12e40800 20 add_watcher() i=0 2024-09-12T17:26:22.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.307+0000 7efe12e40800 20 add_watcher() i=1 2024-09-12T17:26:22.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.307+0000 7efe12e40800 20 add_watcher() i=2 2024-09-12T17:26:22.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.307+0000 7efe12e40800 20 add_watcher() i=3 2024-09-12T17:26:22.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.307+0000 7efe12e40800 20 add_watcher() i=4 2024-09-12T17:26:22.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.307+0000 7efe12e40800 20 add_watcher() i=5 2024-09-12T17:26:22.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.307+0000 7efe12e40800 20 add_watcher() i=6 2024-09-12T17:26:22.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.308+0000 7efe12e40800 20 add_watcher() i=7 2024-09-12T17:26:22.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.308+0000 7efe12e40800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:22.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.309+0000 7efcc6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:22.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.310+0000 7efe12e40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:22.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.310+0000 7efe12e40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:22.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.310+0000 7efe12e40800 5 note: GC not initialized 2024-09-12T17:26:22.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.310+0000 7efcc5fe3640 20 reqs_thread_entry: start 2024-09-12T17:26:22.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.310+0000 7efe12e40800 20 init_complete bucket index max shards: 1 2024-09-12T17:26:22.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.310+0000 7efe12e40800 20 Filter name: none 2024-09-12T17:26:22.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.310+0000 7efc377fe640 20 reqs_thread_entry: start 2024-09-12T17:26:22.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.310+0000 7efe12e40800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:26:22.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.310+0000 7efe12e40800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.311+0000 7efe12e40800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:26:22.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.311+0000 7efe12e40800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:26:22.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.311+0000 7efe12e40800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:26:22.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.311+0000 7efe12e40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 : miss 2024-09-12T17:26:22.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.311+0000 7efe12e40800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.312+0000 7efe12e40800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:26:22.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.312+0000 7efe12e40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 info.flags=0x17 2024-09-12T17:26:22.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.312+0000 7efe12e40800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 to cache LRU end 2024-09-12T17:26:22.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.312+0000 7efe12e40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:26:22.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.312+0000 7efe12e40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:22.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.312+0000 7efe12e40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 2024-09-12T17:26:22.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.315+0000 7efe12e40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 info.flags=0x17 2024-09-12T17:26:22.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.315+0000 7efe12e40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 to cache LRU end 2024-09-12T17:26:22.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.315+0000 7efe12e40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:22.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.315+0000 7efe12e40800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33, ofs0, ns] 2024-09-12T17:26:22.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.316+0000 7efce7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464337 cookie 94889986575760 notifier 7428 bl.length()=1015 2024-09-12T17:26:22.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.316+0000 7efce7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 info.flags=0x17 2024-09-12T17:26:22.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.316+0000 7efce7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 to cache LRU end 2024-09-12T17:26:22.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.316+0000 7efce7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:22.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.318+0000 7efe12e40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): orig_sources= new_sources= 2024-09-12T17:26:22.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.318+0000 7efe12e40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): potential sources added=[] removed=[] 2024-09-12T17:26:22.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.318+0000 7efe12e40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): orig_dests= new_dests= 2024-09-12T17:26:22.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.318+0000 7efe12e40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): potential dests added=[] removed=[] 2024-09-12T17:26:22.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.321+0000 7efe12e40800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.33.1.0 2024-09-12T17:26:22.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.321+0000 7efe12e40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.33.1.0 2024-09-12T17:26:22.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.321+0000 7efe12e40800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.33.1.1 2024-09-12T17:26:22.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.321+0000 7efe12e40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.33.1.1 2024-09-12T17:26:22.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.321+0000 7efe12e40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.33.0 2024-09-12T17:26:22.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.323+0000 7efe12e40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:26:22.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.323+0000 7efe12e40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 2024-09-12T17:26:22.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.325+0000 7efe12e40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 info.flags=0x17 2024-09-12T17:26:22.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.325+0000 7efe12e40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 to cache LRU end 2024-09-12T17:26:22.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.325+0000 7efe12e40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:22.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.325+0000 7efe12e40800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33, ofs0, ns] 2024-09-12T17:26:22.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.325+0000 7efce7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464338 cookie 94889986575760 notifier 7428 bl.length()=1015 2024-09-12T17:26:22.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.325+0000 7efce7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 info.flags=0x17 2024-09-12T17:26:22.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.325+0000 7efce7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 to cache LRU end 2024-09-12T17:26:22.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.325+0000 7efce7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:22.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.327+0000 7efe12e40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): orig_sources= new_sources= 2024-09-12T17:26:22.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.327+0000 7efe12e40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): potential sources added=[] removed=[] 2024-09-12T17:26:22.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.327+0000 7efe12e40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): orig_dests= new_dests= 2024-09-12T17:26:22.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.327+0000 7efe12e40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): potential dests added=[] removed=[] 2024-09-12T17:26:22.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.328+0000 7efe12e40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.33.0 2024-09-12T17:26:22.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.328+0000 7efe12e40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:26:22.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.329+0000 7efe12e40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 2024-09-12T17:26:22.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.330+0000 7efe12e40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 info.flags=0x17 2024-09-12T17:26:22.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.330+0000 7efe12e40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 to cache LRU end 2024-09-12T17:26:22.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.330+0000 7efe12e40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:22.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.330+0000 7efe12e40800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33, ofs0, ns] 2024-09-12T17:26:22.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.330+0000 7efce77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464339 cookie 94889986575760 notifier 7428 bl.length()=983 2024-09-12T17:26:22.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.330+0000 7efce77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 info.flags=0x17 2024-09-12T17:26:22.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.330+0000 7efce77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 to cache LRU end 2024-09-12T17:26:22.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.330+0000 7efce77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:22.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.332+0000 7efe12e40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): orig_sources= new_sources= 2024-09-12T17:26:22.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.332+0000 7efe12e40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): potential sources added=[] removed=[] 2024-09-12T17:26:22.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.332+0000 7efe12e40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): orig_dests= new_dests= 2024-09-12T17:26:22.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.332+0000 7efe12e40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[06eb12d0-49d6-461d-9efe-05d212954deb.4538.33]): potential dests added=[] removed=[] 2024-09-12T17:26:22.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.334+0000 7efe12e40800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T17:26:22.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.336+0000 7efcc6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:22.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.338+0000 7efe12e40800 20 remove_watcher() i=0 2024-09-12T17:26:22.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.338+0000 7efe12e40800 2 removed watcher, disabling cache 2024-09-12T17:26:22.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.340+0000 7efe12e40800 20 remove_watcher() i=1 2024-09-12T17:26:22.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.341+0000 7efe12e40800 20 remove_watcher() i=2 2024-09-12T17:26:22.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.342+0000 7efe12e40800 20 remove_watcher() i=3 2024-09-12T17:26:22.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.343+0000 7efe12e40800 20 remove_watcher() i=4 2024-09-12T17:26:22.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.344+0000 7efe12e40800 20 remove_watcher() i=5 2024-09-12T17:26:22.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.345+0000 7efe12e40800 20 remove_watcher() i=6 2024-09-12T17:26:22.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.347+0000 7efe12e40800 20 remove_watcher() i=7 2024-09-12T17:26:22.363 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:26:22.392 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:22.392 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:22.432 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.430+0000 7f67fbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.432+0000 7f67fbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.432+0000 7f67fbc0e800 20 realm 2024-09-12T17:26:22.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.432+0000 7f67fbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.432+0000 7f67fbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.432+0000 7f67fbc0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:22.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.432+0000 7f67fbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.432+0000 7f67fbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.432+0000 7f67fbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.433+0000 7f67fbc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:22.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.433+0000 7f67fbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.434+0000 7f67fbc0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:22.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.434+0000 7f67fbc0e800 20 searching for the correct realm 2024-09-12T17:26:22.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.436+0000 7f67f6b6a640 0 -- 172.21.15.67:0/16045686 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f67e8017050 msgr2=0x7f67e8024420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:22.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.440+0000 7f67f736b640 0 -- 172.21.15.67:0/16045686 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f67ec078920 msgr2=0x7f67ec0b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:22.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.647+0000 7f67fbc0e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:26:22.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.647+0000 7f67fbc0e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:26:22.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.647+0000 7f67fbc0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:22.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.647+0000 7f67fbc0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:22.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.647+0000 7f67fbc0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:22.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.647+0000 7f67fbc0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:22.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.647+0000 7f67fbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.648+0000 7f67fbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.648+0000 7f67fbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.648+0000 7f67fbc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:22.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.648+0000 7f67fbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.648+0000 7f67fbc0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:22.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.648+0000 7f67fbc0e800 20 zone default found 2024-09-12T17:26:22.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.648+0000 7f67fbc0e800 4 Realm: () 2024-09-12T17:26:22.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.648+0000 7f67fbc0e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:26:22.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.648+0000 7f67fbc0e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:26:22.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.648+0000 7f67fbc0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:22.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.648+0000 7f67fbc0e800 20 zonegroup default 2024-09-12T17:26:22.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.648+0000 7f67fbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.649+0000 7f67fbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.649+0000 7f67fbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.649+0000 7f67fbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.649+0000 7f67fbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.650+0000 7f67fbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.650+0000 7f67fbc0e800 20 started sync module instance, tier type = 2024-09-12T17:26:22.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.650+0000 7f67fbc0e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:26:22.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.658+0000 7f67fbc0e800 20 add_watcher() i=0 2024-09-12T17:26:22.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.658+0000 7f67fbc0e800 20 add_watcher() i=1 2024-09-12T17:26:22.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.658+0000 7f67fbc0e800 20 add_watcher() i=2 2024-09-12T17:26:22.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.658+0000 7f67fbc0e800 20 add_watcher() i=3 2024-09-12T17:26:22.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.658+0000 7f67fbc0e800 20 add_watcher() i=4 2024-09-12T17:26:22.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.658+0000 7f67fbc0e800 20 add_watcher() i=5 2024-09-12T17:26:22.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.658+0000 7f67fbc0e800 20 add_watcher() i=6 2024-09-12T17:26:22.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.659+0000 7f67fbc0e800 20 add_watcher() i=7 2024-09-12T17:26:22.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.659+0000 7f67fbc0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:22.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.661+0000 7f66adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:22.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.662+0000 7f67fbc0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:22.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.662+0000 7f67fbc0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:22.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.662+0000 7f67fbc0e800 5 note: GC not initialized 2024-09-12T17:26:22.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.662+0000 7f66acfe1640 20 reqs_thread_entry: start 2024-09-12T17:26:22.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.662+0000 7f67fbc0e800 20 init_complete bucket index max shards: 1 2024-09-12T17:26:22.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.662+0000 7f67fbc0e800 20 Filter name: none 2024-09-12T17:26:22.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.662+0000 7f66267fc640 20 reqs_thread_entry: start 2024-09-12T17:26:22.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.662+0000 7f67fbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.663+0000 7f67fbc0e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:26:22.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.663+0000 7f67fbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.663+0000 7f67fbc0e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:26:22.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.663+0000 7f67fbc0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:22.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.663+0000 7f67fbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.664+0000 7f67fbc0e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:26:22.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.664+0000 7f67fbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.664+0000 7f67fbc0e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:26:22.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.664+0000 7f67fbc0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:22.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.665+0000 7f66adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:22.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.668+0000 7f67fbc0e800 20 remove_watcher() i=0 2024-09-12T17:26:22.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.668+0000 7f67fbc0e800 2 removed watcher, disabling cache 2024-09-12T17:26:22.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.669+0000 7f67fbc0e800 20 remove_watcher() i=1 2024-09-12T17:26:22.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.670+0000 7f67fbc0e800 20 remove_watcher() i=2 2024-09-12T17:26:22.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.671+0000 7f67fbc0e800 20 remove_watcher() i=3 2024-09-12T17:26:22.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.672+0000 7f67fbc0e800 20 remove_watcher() i=4 2024-09-12T17:26:22.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.673+0000 7f67fbc0e800 20 remove_watcher() i=5 2024-09-12T17:26:22.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.674+0000 7f67fbc0e800 20 remove_watcher() i=6 2024-09-12T17:26:22.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:22.675+0000 7f67fbc0e800 20 remove_watcher() i=7 2024-09-12T17:26:22.688 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:22.688 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:26:22.688 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-commit-target-layout id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.33 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:26:22.688 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:22.690 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:22.690 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:22.708 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:22.708 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:22.932 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:22.933 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:22.998 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-12T17:26:22.998 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:22.999 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:22.999 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:23.041 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:23.041 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:23.099 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:23.099 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:23.136 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:23.136 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:23.174 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:23.174 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:23.209 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:23.209 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:23.245 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:23.245 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:23.281 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:23.282 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:23.319 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:23.319 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:23.354 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:23.354 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:23.426 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:23.426 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:23.462 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:23.462 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:23.498 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:23.498 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:23.534 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:23.534 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:23.572 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:23.572 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:23.608 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:23.608 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:23.644 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:23.644 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:23.680 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:23.680 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:23.716 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:23.716 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:23.752 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:23.752 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:23.788 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:23.788 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:23.824 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:23.824 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:23.860 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:26:23.889 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:23.890 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:23.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:23.926+0000 7f1ad1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:23.928+0000 7f1ad1d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:23.928+0000 7f1ad1d2c800 20 realm 2024-09-12T17:26:23.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:23.928+0000 7f1ad1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:23.928+0000 7f1ad1d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:23.928+0000 7f1ad1d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:23.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:23.928+0000 7f1ad1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:23.928+0000 7f1ad1d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:23.928+0000 7f1ad1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:23.929+0000 7f1ad1d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:23.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:23.929+0000 7f1ad1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:23.930+0000 7f1ad1d2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:23.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:23.930+0000 7f1ad1d2c800 20 searching for the correct realm 2024-09-12T17:26:23.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:23.932+0000 7f1acd24e640 0 -- 172.21.15.67:0/2941907650 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55844b1df0f0 msgr2=0x55844b1e14e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:23.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:23.936+0000 7f1acda4f640 0 -- 172.21.15.67:0/2941907650 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f1ac4067990 msgr2=0x7f1ac40699c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:24.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.141+0000 7f1ad1d2c800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:26:24.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.141+0000 7f1ad1d2c800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:26:24.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.141+0000 7f1ad1d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:24.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.141+0000 7f1ad1d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:24.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.141+0000 7f1ad1d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:24.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.141+0000 7f1ad1d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:24.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.141+0000 7f1ad1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.141+0000 7f1ad1d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.141+0000 7f1ad1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.142+0000 7f1ad1d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:24.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.142+0000 7f1ad1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.142+0000 7f1ad1d2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:24.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.142+0000 7f1ad1d2c800 20 zone default found 2024-09-12T17:26:24.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.142+0000 7f1ad1d2c800 4 Realm: () 2024-09-12T17:26:24.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.142+0000 7f1ad1d2c800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:26:24.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.142+0000 7f1ad1d2c800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:26:24.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.142+0000 7f1ad1d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:24.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.142+0000 7f1ad1d2c800 20 zonegroup default 2024-09-12T17:26:24.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.142+0000 7f1ad1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.142+0000 7f1ad1d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.142+0000 7f1ad1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.143+0000 7f1ad1d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.143+0000 7f1ad1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.143+0000 7f1ad1d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.143+0000 7f1ad1d2c800 20 started sync module instance, tier type = 2024-09-12T17:26:24.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.143+0000 7f1ad1d2c800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:26:24.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.152+0000 7f1ad1d2c800 20 add_watcher() i=0 2024-09-12T17:26:24.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.152+0000 7f1ad1d2c800 20 add_watcher() i=1 2024-09-12T17:26:24.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.152+0000 7f1ad1d2c800 20 add_watcher() i=2 2024-09-12T17:26:24.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.152+0000 7f1ad1d2c800 20 add_watcher() i=3 2024-09-12T17:26:24.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.152+0000 7f1ad1d2c800 20 add_watcher() i=4 2024-09-12T17:26:24.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.152+0000 7f1ad1d2c800 20 add_watcher() i=5 2024-09-12T17:26:24.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.152+0000 7f1ad1d2c800 20 add_watcher() i=6 2024-09-12T17:26:24.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.153+0000 7f1ad1d2c800 20 add_watcher() i=7 2024-09-12T17:26:24.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.153+0000 7f1ad1d2c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:24.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.155+0000 7f197f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:24.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.155+0000 7f1ad1d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:24.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.155+0000 7f1ad1d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:24.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.155+0000 7f1ad1d2c800 5 note: GC not initialized 2024-09-12T17:26:24.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.155+0000 7f197e7fc640 20 reqs_thread_entry: start 2024-09-12T17:26:24.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.155+0000 7f1ad1d2c800 20 init_complete bucket index max shards: 1 2024-09-12T17:26:24.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.155+0000 7f1ad1d2c800 20 Filter name: none 2024-09-12T17:26:24.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.155+0000 7f18effff640 20 reqs_thread_entry: start 2024-09-12T17:26:24.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.156+0000 7f1ad1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.156+0000 7f1ad1d2c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:26:24.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.156+0000 7f1ad1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.157+0000 7f1ad1d2c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:26:24.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.157+0000 7f1ad1d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:24.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.157+0000 7f1ad1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.157+0000 7f1ad1d2c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:26:24.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.157+0000 7f1ad1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.157+0000 7f1ad1d2c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:26:24.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.158+0000 7f1ad1d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:24.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.159+0000 7f197f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:24.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.161+0000 7f1ad1d2c800 20 remove_watcher() i=0 2024-09-12T17:26:24.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.161+0000 7f1ad1d2c800 2 removed watcher, disabling cache 2024-09-12T17:26:24.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.162+0000 7f1ad1d2c800 20 remove_watcher() i=1 2024-09-12T17:26:24.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.163+0000 7f1ad1d2c800 20 remove_watcher() i=2 2024-09-12T17:26:24.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.164+0000 7f1ad1d2c800 20 remove_watcher() i=3 2024-09-12T17:26:24.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.165+0000 7f1ad1d2c800 20 remove_watcher() i=4 2024-09-12T17:26:24.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.166+0000 7f1ad1d2c800 20 remove_watcher() i=5 2024-09-12T17:26:24.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.167+0000 7f1ad1d2c800 20 remove_watcher() i=6 2024-09-12T17:26:24.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.168+0000 7f1ad1d2c800 20 remove_watcher() i=7 2024-09-12T17:26:24.181 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:24.181 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:26:24.181 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-do-reshard id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:26:24.181 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:24.182 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-12T17:26:24.217 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:24.217 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:24.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.255+0000 7f184f811800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.256+0000 7f184f811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.256+0000 7f184f811800 20 realm 2024-09-12T17:26:24.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.256+0000 7f184f811800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.256+0000 7f184f811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.256+0000 7f184f811800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:24.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.256+0000 7f184f811800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.256+0000 7f184f811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.256+0000 7f184f811800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.257+0000 7f184f811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:24.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.257+0000 7f184f811800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.258+0000 7f184f811800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:24.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.258+0000 7f184f811800 20 searching for the correct realm 2024-09-12T17:26:24.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.260+0000 7f184a721640 0 -- 172.21.15.67:0/686121114 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x557a017f6580 msgr2=0x557a017f8970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:24.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.264+0000 7f184af22640 0 -- 172.21.15.67:0/686121114 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f1840073460 msgr2=0x7f1840043a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:24.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.471+0000 7f184f811800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:26:24.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.471+0000 7f184f811800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:26:24.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.471+0000 7f184f811800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:24.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.471+0000 7f184f811800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:24.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.471+0000 7f184f811800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:24.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.471+0000 7f184f811800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:24.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.471+0000 7f184f811800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.471+0000 7f184f811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.471+0000 7f184f811800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.471+0000 7f184f811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:24.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.471+0000 7f184f811800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.472+0000 7f184f811800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:24.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.472+0000 7f184f811800 20 zone default found 2024-09-12T17:26:24.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.472+0000 7f184f811800 4 Realm: () 2024-09-12T17:26:24.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.472+0000 7f184f811800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:26:24.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.472+0000 7f184f811800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:26:24.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.472+0000 7f184f811800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:24.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.472+0000 7f184f811800 20 zonegroup default 2024-09-12T17:26:24.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.472+0000 7f184f811800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.472+0000 7f184f811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.472+0000 7f184f811800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.472+0000 7f184f811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.472+0000 7f184f811800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.472+0000 7f184f811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.472+0000 7f184f811800 20 started sync module instance, tier type = 2024-09-12T17:26:24.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.472+0000 7f184f811800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:26:24.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.481+0000 7f184f811800 20 add_watcher() i=0 2024-09-12T17:26:24.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.481+0000 7f184f811800 20 add_watcher() i=1 2024-09-12T17:26:24.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.481+0000 7f184f811800 20 add_watcher() i=2 2024-09-12T17:26:24.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.481+0000 7f184f811800 20 add_watcher() i=3 2024-09-12T17:26:24.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.481+0000 7f184f811800 20 add_watcher() i=4 2024-09-12T17:26:24.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.481+0000 7f184f811800 20 add_watcher() i=5 2024-09-12T17:26:24.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.481+0000 7f184f811800 20 add_watcher() i=6 2024-09-12T17:26:24.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.482+0000 7f184f811800 20 add_watcher() i=7 2024-09-12T17:26:24.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.482+0000 7f184f811800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:24.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.484+0000 7f17017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:24.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.485+0000 7f184f811800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:24.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.485+0000 7f184f811800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:24.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.485+0000 7f184f811800 5 note: GC not initialized 2024-09-12T17:26:24.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.485+0000 7f167bfff640 20 reqs_thread_entry: start 2024-09-12T17:26:24.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.485+0000 7f184f811800 20 init_complete bucket index max shards: 1 2024-09-12T17:26:24.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.485+0000 7f184f811800 20 Filter name: none 2024-09-12T17:26:24.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.485+0000 7f1679ffb640 20 reqs_thread_entry: start 2024-09-12T17:26:24.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.485+0000 7f184f811800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T17:26:24.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.485+0000 7f184f811800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.486+0000 7f184f811800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:26:24.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.486+0000 7f184f811800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T17:26:24.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.486+0000 7f184f811800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T17:26:24.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.486+0000 7f184f811800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 : miss 2024-09-12T17:26:24.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.486+0000 7f184f811800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.486+0000 7f184f811800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:26:24.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.486+0000 7f184f811800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 info.flags=0x17 2024-09-12T17:26:24.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.486+0000 7f184f811800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 to cache LRU end 2024-09-12T17:26:24.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.486+0000 7f184f811800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:26:24.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.486+0000 7f184f811800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:24.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.486+0000 7f184f811800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 2024-09-12T17:26:24.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.490+0000 7f184f811800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 info.flags=0x17 2024-09-12T17:26:24.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.490+0000 7f184f811800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 to cache LRU end 2024-09-12T17:26:24.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.490+0000 7f184f811800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:24.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.490+0000 7f184f811800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34, ofs0, ns] 2024-09-12T17:26:24.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.490+0000 7f172e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464345 cookie 93982499542416 notifier 7037 bl.length()=995 2024-09-12T17:26:24.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.490+0000 7f172e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 info.flags=0x17 2024-09-12T17:26:24.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.490+0000 7f172e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 to cache LRU end 2024-09-12T17:26:24.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.490+0000 7f172e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:24.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.491+0000 7f184f811800 20 handle_bi_update(): bucket=:error-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.34]): orig_sources= new_sources= 2024-09-12T17:26:24.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.491+0000 7f184f811800 20 handle_bi_update(): bucket=:error-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.34]): potential sources added=[] removed=[] 2024-09-12T17:26:24.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.491+0000 7f184f811800 20 handle_bi_update(): bucket=:error-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.34]): orig_dests= new_dests= 2024-09-12T17:26:24.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.491+0000 7f184f811800 20 handle_bi_update(): bucket=:error-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.34]): potential dests added=[] removed=[] 2024-09-12T17:26:24.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.494+0000 7f184f811800 -1 Injecting error=-5 at location=do_reshard 2024-09-12T17:26:24.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.497+0000 7f184f811800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 : hit (requested=0x17, cached=0x17) 2024-09-12T17:26:24.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.497+0000 7f184f811800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 2024-09-12T17:26:24.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.498+0000 7f184f811800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 info.flags=0x17 2024-09-12T17:26:24.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.498+0000 7f184f811800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 to cache LRU end 2024-09-12T17:26:24.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.498+0000 7f184f811800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:24.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.498+0000 7f184f811800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34, ofs0, ns] 2024-09-12T17:26:24.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.498+0000 7f172dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464346 cookie 93982499542416 notifier 7037 bl.length()=963 2024-09-12T17:26:24.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.498+0000 7f172dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 info.flags=0x17 2024-09-12T17:26:24.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.498+0000 7f172dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 to cache LRU end 2024-09-12T17:26:24.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.498+0000 7f172dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:24.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.499+0000 7f184f811800 20 handle_bi_update(): bucket=:error-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.34]): orig_sources= new_sources= 2024-09-12T17:26:24.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.499+0000 7f184f811800 20 handle_bi_update(): bucket=:error-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.34]): potential sources added=[] removed=[] 2024-09-12T17:26:24.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.499+0000 7f184f811800 20 handle_bi_update(): bucket=:error-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.34]): orig_dests= new_dests= 2024-09-12T17:26:24.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.499+0000 7f184f811800 20 handle_bi_update(): bucket=:error-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.34]): potential dests added=[] removed=[] 2024-09-12T17:26:24.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.499+0000 7f184f811800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-12T17:26:24.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.501+0000 7f17017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:24.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.503+0000 7f184f811800 20 remove_watcher() i=0 2024-09-12T17:26:24.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.503+0000 7f184f811800 2 removed watcher, disabling cache 2024-09-12T17:26:24.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.504+0000 7f184f811800 20 remove_watcher() i=1 2024-09-12T17:26:24.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.505+0000 7f184f811800 20 remove_watcher() i=2 2024-09-12T17:26:24.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.506+0000 7f184f811800 20 remove_watcher() i=3 2024-09-12T17:26:24.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.507+0000 7f184f811800 20 remove_watcher() i=4 2024-09-12T17:26:24.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.509+0000 7f184f811800 20 remove_watcher() i=5 2024-09-12T17:26:24.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.510+0000 7f184f811800 20 remove_watcher() i=6 2024-09-12T17:26:24.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.511+0000 7f184f811800 20 remove_watcher() i=7 2024-09-12T17:26:24.525 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:26:24.555 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:24.555 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:24.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.591+0000 7f48ff136800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.593+0000 7f48ff136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.593+0000 7f48ff136800 20 realm 2024-09-12T17:26:24.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.593+0000 7f48ff136800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.594+0000 7f48ff136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.594+0000 7f48ff136800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:24.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.594+0000 7f48ff136800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.594+0000 7f48ff136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.594+0000 7f48ff136800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.594+0000 7f48ff136800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:24.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.594+0000 7f48ff136800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.595+0000 7f48ff136800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:24.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.595+0000 7f48ff136800 20 searching for the correct realm 2024-09-12T17:26:24.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:24.596+0000 7f48faeb7640 0 -- 172.21.15.67:0/2723555185 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f48f402d020 msgr2=0x7f48f4063910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:25.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.003+0000 7f48fb6b8640 0 -- 172.21.15.67:0/2723555185 >> [v2:172.21.15.118:6824/1070975205,v1:172.21.15.118:6825/1070975205] conn(0x7f48f0042040 msgr2=0x7f48f005c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:25.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.412+0000 7f48ff136800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:26:25.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.412+0000 7f48ff136800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:26:25.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.412+0000 7f48ff136800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:25.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.412+0000 7f48ff136800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:25.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.412+0000 7f48ff136800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:25.416 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.412+0000 7f48ff136800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:25.416 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.412+0000 7f48ff136800 20 rados->read ofs=0 len=0 2024-09-12T17:26:25.416 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.412+0000 7f48ff136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:25.416 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.412+0000 7f48ff136800 20 rados->read ofs=0 len=0 2024-09-12T17:26:25.416 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.413+0000 7f48ff136800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:25.416 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.413+0000 7f48ff136800 20 rados->read ofs=0 len=0 2024-09-12T17:26:25.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.413+0000 7f48ff136800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:25.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.413+0000 7f48ff136800 20 zone default found 2024-09-12T17:26:25.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.413+0000 7f48ff136800 4 Realm: () 2024-09-12T17:26:25.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.413+0000 7f48ff136800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:26:25.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.413+0000 7f48ff136800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:26:25.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.413+0000 7f48ff136800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:25.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.413+0000 7f48ff136800 20 zonegroup default 2024-09-12T17:26:25.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.413+0000 7f48ff136800 20 rados->read ofs=0 len=0 2024-09-12T17:26:25.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.413+0000 7f48ff136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:25.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.413+0000 7f48ff136800 20 rados->read ofs=0 len=0 2024-09-12T17:26:25.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.414+0000 7f48ff136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:25.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.414+0000 7f48ff136800 20 rados->read ofs=0 len=0 2024-09-12T17:26:25.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.414+0000 7f48ff136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:25.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.414+0000 7f48ff136800 20 started sync module instance, tier type = 2024-09-12T17:26:25.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.414+0000 7f48ff136800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:26:25.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.426+0000 7f48ff136800 20 add_watcher() i=0 2024-09-12T17:26:25.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.426+0000 7f48ff136800 20 add_watcher() i=1 2024-09-12T17:26:25.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.426+0000 7f48ff136800 20 add_watcher() i=2 2024-09-12T17:26:25.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.426+0000 7f48ff136800 20 add_watcher() i=3 2024-09-12T17:26:25.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.426+0000 7f48ff136800 20 add_watcher() i=4 2024-09-12T17:26:25.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.426+0000 7f48ff136800 20 add_watcher() i=5 2024-09-12T17:26:25.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.426+0000 7f48ff136800 20 add_watcher() i=6 2024-09-12T17:26:25.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.427+0000 7f48ff136800 20 add_watcher() i=7 2024-09-12T17:26:25.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.427+0000 7f48ff136800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:25.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.429+0000 7f47b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:25.432 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.429+0000 7f48ff136800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:25.432 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.429+0000 7f48ff136800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:25.432 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.429+0000 7f48ff136800 5 note: GC not initialized 2024-09-12T17:26:25.432 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.429+0000 7f472bfff640 20 reqs_thread_entry: start 2024-09-12T17:26:25.432 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.429+0000 7f48ff136800 20 init_complete bucket index max shards: 1 2024-09-12T17:26:25.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.430+0000 7f48ff136800 20 Filter name: none 2024-09-12T17:26:25.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.430+0000 7f4729ffb640 20 reqs_thread_entry: start 2024-09-12T17:26:25.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.430+0000 7f48ff136800 20 rados->read ofs=0 len=0 2024-09-12T17:26:25.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.430+0000 7f48ff136800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:26:25.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.430+0000 7f48ff136800 20 rados->read ofs=0 len=0 2024-09-12T17:26:25.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.431+0000 7f48ff136800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:26:25.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.431+0000 7f48ff136800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:25.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.431+0000 7f48ff136800 20 rados->read ofs=0 len=0 2024-09-12T17:26:25.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.431+0000 7f48ff136800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:26:25.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.431+0000 7f48ff136800 20 rados->read ofs=0 len=0 2024-09-12T17:26:25.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.432+0000 7f48ff136800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:26:25.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.432+0000 7f48ff136800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:25.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.433+0000 7f47b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:25.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.435+0000 7f48ff136800 20 remove_watcher() i=0 2024-09-12T17:26:25.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.435+0000 7f48ff136800 2 removed watcher, disabling cache 2024-09-12T17:26:25.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.436+0000 7f48ff136800 20 remove_watcher() i=1 2024-09-12T17:26:25.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.438+0000 7f48ff136800 20 remove_watcher() i=2 2024-09-12T17:26:25.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.439+0000 7f48ff136800 20 remove_watcher() i=3 2024-09-12T17:26:25.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.440+0000 7f48ff136800 20 remove_watcher() i=4 2024-09-12T17:26:25.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.441+0000 7f48ff136800 20 remove_watcher() i=5 2024-09-12T17:26:25.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.442+0000 7f48ff136800 20 remove_watcher() i=6 2024-09-12T17:26:25.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.444+0000 7f48ff136800 20 remove_watcher() i=7 2024-09-12T17:26:25.458 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:25.458 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:26:25.458 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-do-reshard id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:26:25.458 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:25.460 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:25.460 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:25.495 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:25.495 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:25.554 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:26:25.587 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:25.588 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:25.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.830+0000 7f9755c13800 20 rados->read ofs=0 len=0 2024-09-12T17:26:25.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.831+0000 7f9755c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:25.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.831+0000 7f9755c13800 20 realm 2024-09-12T17:26:25.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.831+0000 7f9755c13800 20 rados->read ofs=0 len=0 2024-09-12T17:26:25.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.832+0000 7f9755c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:25.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.832+0000 7f9755c13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:25.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.832+0000 7f9755c13800 20 rados->read ofs=0 len=0 2024-09-12T17:26:25.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.832+0000 7f9755c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:25.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.832+0000 7f9755c13800 20 rados->read ofs=0 len=0 2024-09-12T17:26:25.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.833+0000 7f9755c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:25.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.833+0000 7f9755c13800 20 rados->read ofs=0 len=0 2024-09-12T17:26:25.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.833+0000 7f9755c13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:25.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.834+0000 7f9755c13800 20 searching for the correct realm 2024-09-12T17:26:25.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:25.835+0000 7f9750b47640 0 -- 172.21.15.67:0/4200486154 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f9744026020 msgr2=0x7f97440971d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:26.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.042+0000 7f9751348640 0 -- 172.21.15.67:0/4200486154 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f97480744b0 msgr2=0x7f97480a34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:26.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.249+0000 7f9755c13800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:26:26.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.249+0000 7f9755c13800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:26:26.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.249+0000 7f9755c13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:26.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.249+0000 7f9755c13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:26.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.249+0000 7f9755c13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:26.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.249+0000 7f9755c13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:26.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.249+0000 7f9755c13800 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.250+0000 7f9755c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:26.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.250+0000 7f9755c13800 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.250+0000 7f9755c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:26.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.250+0000 7f9755c13800 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.251+0000 7f9755c13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:26.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.251+0000 7f9755c13800 20 zone default found 2024-09-12T17:26:26.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.251+0000 7f9755c13800 4 Realm: () 2024-09-12T17:26:26.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.251+0000 7f9755c13800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:26:26.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.251+0000 7f9755c13800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:26:26.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.251+0000 7f9755c13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:26.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.251+0000 7f9755c13800 20 zonegroup default 2024-09-12T17:26:26.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.251+0000 7f9755c13800 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.251+0000 7f9755c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:26.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.251+0000 7f9755c13800 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.251+0000 7f9755c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:26.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.251+0000 7f9755c13800 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.252+0000 7f9755c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:26.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.252+0000 7f9755c13800 20 started sync module instance, tier type = 2024-09-12T17:26:26.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.252+0000 7f9755c13800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:26:26.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.263+0000 7f9755c13800 20 add_watcher() i=0 2024-09-12T17:26:26.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.263+0000 7f9755c13800 20 add_watcher() i=1 2024-09-12T17:26:26.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.263+0000 7f9755c13800 20 add_watcher() i=2 2024-09-12T17:26:26.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.263+0000 7f9755c13800 20 add_watcher() i=3 2024-09-12T17:26:26.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.263+0000 7f9755c13800 20 add_watcher() i=4 2024-09-12T17:26:26.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.263+0000 7f9755c13800 20 add_watcher() i=5 2024-09-12T17:26:26.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.263+0000 7f9755c13800 20 add_watcher() i=6 2024-09-12T17:26:26.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.264+0000 7f9755c13800 20 add_watcher() i=7 2024-09-12T17:26:26.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.264+0000 7f9755c13800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:26.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.266+0000 7f96077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:26.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.266+0000 7f9755c13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:26.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.266+0000 7f9755c13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:26.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.266+0000 7f9755c13800 5 note: GC not initialized 2024-09-12T17:26:26.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.266+0000 7f96067e4640 20 reqs_thread_entry: start 2024-09-12T17:26:26.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.266+0000 7f9755c13800 20 init_complete bucket index max shards: 1 2024-09-12T17:26:26.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.267+0000 7f9755c13800 20 Filter name: none 2024-09-12T17:26:26.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.267+0000 7f9577fff640 20 reqs_thread_entry: start 2024-09-12T17:26:26.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.267+0000 7f9755c13800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T17:26:26.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.267+0000 7f9755c13800 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.267+0000 7f9755c13800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:26:26.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.267+0000 7f9755c13800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T17:26:26.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.267+0000 7f9755c13800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T17:26:26.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.267+0000 7f9755c13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 : miss 2024-09-12T17:26:26.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.267+0000 7f9755c13800 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.268+0000 7f9755c13800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:26:26.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.268+0000 7f9755c13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 info.flags=0x17 2024-09-12T17:26:26.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.268+0000 7f9755c13800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 to cache LRU end 2024-09-12T17:26:26.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.268+0000 7f9755c13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:26:26.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.268+0000 7f9755c13800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:26.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.268+0000 7f9755c13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 2024-09-12T17:26:26.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.272+0000 7f9755c13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 info.flags=0x17 2024-09-12T17:26:26.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.272+0000 7f9755c13800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 to cache LRU end 2024-09-12T17:26:26.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.272+0000 7f9755c13800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:26.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.272+0000 7f9755c13800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34, ofs0, ns] 2024-09-12T17:26:26.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.272+0000 7f9634ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464347 cookie 93855891274688 notifier 7518 bl.length()=995 2024-09-12T17:26:26.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.272+0000 7f9634ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 info.flags=0x17 2024-09-12T17:26:26.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.272+0000 7f9634ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 to cache LRU end 2024-09-12T17:26:26.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.272+0000 7f9634ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:26.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.274+0000 7f9627fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464348 cookie 93855891274688 notifier 7518 bl.length()=995 2024-09-12T17:26:26.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.274+0000 7f9627fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 info.flags=0x17 2024-09-12T17:26:26.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.274+0000 7f9627fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 to cache LRU end 2024-09-12T17:26:26.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.274+0000 7f9627fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:26.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.276+0000 7f9755c13800 20 handle_bi_update(): bucket=:error-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.34]): orig_sources= new_sources= 2024-09-12T17:26:26.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.276+0000 7f9755c13800 20 handle_bi_update(): bucket=:error-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.34]): potential sources added=[] removed=[] 2024-09-12T17:26:26.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.276+0000 7f9755c13800 20 handle_bi_update(): bucket=:error-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.34]): orig_dests= new_dests= 2024-09-12T17:26:26.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.276+0000 7f9755c13800 20 handle_bi_update(): bucket=:error-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.34]): potential dests added=[] removed=[] 2024-09-12T17:26:26.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.278+0000 7f9755c13800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.34.1.0 2024-09-12T17:26:26.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.278+0000 7f9755c13800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.34.1.0 2024-09-12T17:26:26.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.278+0000 7f9755c13800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.34.1.1 2024-09-12T17:26:26.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.278+0000 7f9755c13800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.34.1.1 2024-09-12T17:26:26.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.278+0000 7f9755c13800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.34.0 2024-09-12T17:26:26.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.281+0000 7f9755c13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 : hit (requested=0x17, cached=0x17) 2024-09-12T17:26:26.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.281+0000 7f9755c13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 2024-09-12T17:26:26.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.282+0000 7f9755c13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 info.flags=0x17 2024-09-12T17:26:26.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.282+0000 7f9755c13800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 to cache LRU end 2024-09-12T17:26:26.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.282+0000 7f9755c13800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:26.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.282+0000 7f9755c13800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34, ofs0, ns] 2024-09-12T17:26:26.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.283+0000 7f9627fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464349 cookie 93855891274688 notifier 7518 bl.length()=995 2024-09-12T17:26:26.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.283+0000 7f9627fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 info.flags=0x17 2024-09-12T17:26:26.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.283+0000 7f9627fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 to cache LRU end 2024-09-12T17:26:26.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.283+0000 7f9627fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:26.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.284+0000 7f9755c13800 20 handle_bi_update(): bucket=:error-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.34]): orig_sources= new_sources= 2024-09-12T17:26:26.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.284+0000 7f9755c13800 20 handle_bi_update(): bucket=:error-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.34]): potential sources added=[] removed=[] 2024-09-12T17:26:26.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.284+0000 7f9755c13800 20 handle_bi_update(): bucket=:error-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.34]): orig_dests= new_dests= 2024-09-12T17:26:26.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.284+0000 7f9755c13800 20 handle_bi_update(): bucket=:error-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.34]): potential dests added=[] removed=[] 2024-09-12T17:26:26.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.285+0000 7f9755c13800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.34.0 2024-09-12T17:26:26.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.286+0000 7f9755c13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 : hit (requested=0x17, cached=0x17) 2024-09-12T17:26:26.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.286+0000 7f9755c13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 2024-09-12T17:26:26.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.287+0000 7f9755c13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 info.flags=0x17 2024-09-12T17:26:26.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.287+0000 7f9755c13800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 to cache LRU end 2024-09-12T17:26:26.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.287+0000 7f9755c13800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:26.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.287+0000 7f9755c13800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34, ofs0, ns] 2024-09-12T17:26:26.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.288+0000 7f9627fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464350 cookie 93855891274688 notifier 7518 bl.length()=963 2024-09-12T17:26:26.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.288+0000 7f9627fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 info.flags=0x17 2024-09-12T17:26:26.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.288+0000 7f9627fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 to cache LRU end 2024-09-12T17:26:26.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.288+0000 7f9627fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:26.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.289+0000 7f9755c13800 20 handle_bi_update(): bucket=:error-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.34]): orig_sources= new_sources= 2024-09-12T17:26:26.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.289+0000 7f9755c13800 20 handle_bi_update(): bucket=:error-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.34]): potential sources added=[] removed=[] 2024-09-12T17:26:26.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.289+0000 7f9755c13800 20 handle_bi_update(): bucket=:error-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.34]): orig_dests= new_dests= 2024-09-12T17:26:26.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.289+0000 7f9755c13800 20 handle_bi_update(): bucket=:error-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.34]): potential dests added=[] removed=[] 2024-09-12T17:26:26.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.290+0000 7f9755c13800 1 execute INFO: reshard of bucket "error-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-12T17:26:26.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.292+0000 7f96077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:26.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.295+0000 7f9755c13800 20 remove_watcher() i=0 2024-09-12T17:26:26.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.295+0000 7f9755c13800 2 removed watcher, disabling cache 2024-09-12T17:26:26.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.296+0000 7f9755c13800 20 remove_watcher() i=1 2024-09-12T17:26:26.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.297+0000 7f9755c13800 20 remove_watcher() i=2 2024-09-12T17:26:26.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.298+0000 7f9755c13800 20 remove_watcher() i=3 2024-09-12T17:26:26.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.299+0000 7f9755c13800 20 remove_watcher() i=4 2024-09-12T17:26:26.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.300+0000 7f9755c13800 20 remove_watcher() i=5 2024-09-12T17:26:26.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.301+0000 7f9755c13800 20 remove_watcher() i=6 2024-09-12T17:26:26.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.302+0000 7f9755c13800 20 remove_watcher() i=7 2024-09-12T17:26:26.316 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:26:26.346 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:26.347 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:26.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.386+0000 7f5f92414800 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.388+0000 7f5f92414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:26.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.388+0000 7f5f92414800 20 realm 2024-09-12T17:26:26.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.388+0000 7f5f92414800 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.389+0000 7f5f92414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:26.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.389+0000 7f5f92414800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:26.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.389+0000 7f5f92414800 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.389+0000 7f5f92414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:26.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.389+0000 7f5f92414800 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.390+0000 7f5f92414800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:26.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.390+0000 7f5f92414800 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.391+0000 7f5f92414800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:26.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.391+0000 7f5f92414800 20 searching for the correct realm 2024-09-12T17:26:26.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.392+0000 7f5f8d3df640 0 -- 172.21.15.67:0/424606150 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f5f8003f060 msgr2=0x7f5f8008e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:26.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.598+0000 7f5f8dbe0640 0 -- 172.21.15.67:0/424606150 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f5f84034040 msgr2=0x7f5f8400fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:26.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.805+0000 7f5f92414800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:26:26.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.805+0000 7f5f92414800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:26:26.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.805+0000 7f5f92414800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:26.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.805+0000 7f5f92414800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:26.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.805+0000 7f5f92414800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:26.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.805+0000 7f5f92414800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:26.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.805+0000 7f5f92414800 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.805+0000 7f5f92414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:26.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.805+0000 7f5f92414800 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.805+0000 7f5f92414800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:26.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.805+0000 7f5f92414800 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.806+0000 7f5f92414800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:26.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.806+0000 7f5f92414800 20 zone default found 2024-09-12T17:26:26.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.806+0000 7f5f92414800 4 Realm: () 2024-09-12T17:26:26.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.806+0000 7f5f92414800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:26:26.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.806+0000 7f5f92414800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:26:26.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.806+0000 7f5f92414800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:26.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.806+0000 7f5f92414800 20 zonegroup default 2024-09-12T17:26:26.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.806+0000 7f5f92414800 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.806+0000 7f5f92414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:26.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.806+0000 7f5f92414800 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.806+0000 7f5f92414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:26.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.806+0000 7f5f92414800 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.807+0000 7f5f92414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:26.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.807+0000 7f5f92414800 20 started sync module instance, tier type = 2024-09-12T17:26:26.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.807+0000 7f5f92414800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:26:26.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.817+0000 7f5f92414800 20 add_watcher() i=0 2024-09-12T17:26:26.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.817+0000 7f5f92414800 20 add_watcher() i=1 2024-09-12T17:26:26.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.817+0000 7f5f92414800 20 add_watcher() i=2 2024-09-12T17:26:26.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.817+0000 7f5f92414800 20 add_watcher() i=3 2024-09-12T17:26:26.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.817+0000 7f5f92414800 20 add_watcher() i=4 2024-09-12T17:26:26.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.817+0000 7f5f92414800 20 add_watcher() i=5 2024-09-12T17:26:26.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.817+0000 7f5f92414800 20 add_watcher() i=6 2024-09-12T17:26:26.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.818+0000 7f5f92414800 20 add_watcher() i=7 2024-09-12T17:26:26.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.818+0000 7f5f92414800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:26.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.819+0000 7f5e3f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:26.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.820+0000 7f5f92414800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:26.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.820+0000 7f5f92414800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:26.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.820+0000 7f5f92414800 5 note: GC not initialized 2024-09-12T17:26:26.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.820+0000 7f5e3e7fc640 20 reqs_thread_entry: start 2024-09-12T17:26:26.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.820+0000 7f5f92414800 20 init_complete bucket index max shards: 1 2024-09-12T17:26:26.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.820+0000 7f5f92414800 20 Filter name: none 2024-09-12T17:26:26.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.820+0000 7f5daffff640 20 reqs_thread_entry: start 2024-09-12T17:26:26.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.820+0000 7f5f92414800 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.821+0000 7f5f92414800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:26:26.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.821+0000 7f5f92414800 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.821+0000 7f5f92414800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:26:26.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.821+0000 7f5f92414800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:26.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.821+0000 7f5f92414800 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.822+0000 7f5f92414800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:26:26.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.822+0000 7f5f92414800 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.822+0000 7f5f92414800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:26:26.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.822+0000 7f5f92414800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:26.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.824+0000 7f5e3f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:26.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.827+0000 7f5f92414800 20 remove_watcher() i=0 2024-09-12T17:26:26.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.827+0000 7f5f92414800 2 removed watcher, disabling cache 2024-09-12T17:26:26.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.829+0000 7f5f92414800 20 remove_watcher() i=1 2024-09-12T17:26:26.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.830+0000 7f5f92414800 20 remove_watcher() i=2 2024-09-12T17:26:26.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.831+0000 7f5f92414800 20 remove_watcher() i=3 2024-09-12T17:26:26.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.833+0000 7f5f92414800 20 remove_watcher() i=4 2024-09-12T17:26:26.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.834+0000 7f5f92414800 20 remove_watcher() i=5 2024-09-12T17:26:26.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.835+0000 7f5f92414800 20 remove_watcher() i=6 2024-09-12T17:26:26.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:26.836+0000 7f5f92414800 20 remove_watcher() i=7 2024-09-12T17:26:26.849 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:26.849 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:26:26.849 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-do-reshard id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.34 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:26:26.849 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:26.851 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:26.851 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:26.869 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:26.869 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:27.092 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:27.092 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:27.155 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-12T17:26:27.156 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:27.156 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:27.157 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:27.201 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:27.201 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:27.259 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:27.259 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:27.295 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:27.296 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:27.331 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:27.332 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:27.367 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:27.367 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:27.403 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:27.403 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:27.440 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:27.441 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:27.475 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:27.475 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:27.514 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:27.514 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:27.550 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:27.550 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:27.586 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:27.586 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:27.621 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:27.621 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:27.657 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:27.658 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:27.694 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:27.694 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:27.730 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:27.730 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:27.765 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:27.766 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:27.802 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:27.802 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:27.839 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:27.839 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:27.875 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:27.875 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:27.913 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:27.913 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:27.949 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:27.949 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:27.987 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:26:28.017 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:28.017 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:28.056 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.055+0000 7f88b8335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.056+0000 7f88b8335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.056+0000 7f88b8335800 20 realm 2024-09-12T17:26:28.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.056+0000 7f88b8335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.057+0000 7f88b8335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.057+0000 7f88b8335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:28.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.057+0000 7f88b8335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.057+0000 7f88b8335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.057+0000 7f88b8335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.058+0000 7f88b8335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:28.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.058+0000 7f88b8335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.058+0000 7f88b8335800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:28.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.058+0000 7f88b8335800 20 searching for the correct realm 2024-09-12T17:26:28.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.061+0000 7f88b37c2640 0 -- 172.21.15.67:0/903158426 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f88a4066ae0 msgr2=0x7f88a4081980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:28.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.064+0000 7f88b3fc3640 0 -- 172.21.15.67:0/903158426 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f88a8064920 msgr2=0x7f88a808c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:28.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.271+0000 7f88b8335800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:26:28.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.271+0000 7f88b8335800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:26:28.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.271+0000 7f88b8335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:28.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.271+0000 7f88b8335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:28.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.271+0000 7f88b8335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:28.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.271+0000 7f88b8335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:28.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.271+0000 7f88b8335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.271+0000 7f88b8335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.271+0000 7f88b8335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.271+0000 7f88b8335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:28.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.271+0000 7f88b8335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.272+0000 7f88b8335800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:28.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.272+0000 7f88b8335800 20 zone default found 2024-09-12T17:26:28.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.272+0000 7f88b8335800 4 Realm: () 2024-09-12T17:26:28.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.272+0000 7f88b8335800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:26:28.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.272+0000 7f88b8335800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:26:28.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.272+0000 7f88b8335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:28.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.272+0000 7f88b8335800 20 zonegroup default 2024-09-12T17:26:28.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.272+0000 7f88b8335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.272+0000 7f88b8335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.272+0000 7f88b8335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.272+0000 7f88b8335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.272+0000 7f88b8335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.273+0000 7f88b8335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.273+0000 7f88b8335800 20 started sync module instance, tier type = 2024-09-12T17:26:28.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.273+0000 7f88b8335800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:26:28.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.282+0000 7f88b8335800 20 add_watcher() i=0 2024-09-12T17:26:28.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.282+0000 7f88b8335800 20 add_watcher() i=1 2024-09-12T17:26:28.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.282+0000 7f88b8335800 20 add_watcher() i=2 2024-09-12T17:26:28.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.282+0000 7f88b8335800 20 add_watcher() i=3 2024-09-12T17:26:28.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.282+0000 7f88b8335800 20 add_watcher() i=4 2024-09-12T17:26:28.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.282+0000 7f88b8335800 20 add_watcher() i=5 2024-09-12T17:26:28.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.282+0000 7f88b8335800 20 add_watcher() i=6 2024-09-12T17:26:28.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.283+0000 7f88b8335800 20 add_watcher() i=7 2024-09-12T17:26:28.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.283+0000 7f88b8335800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:28.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.284+0000 7f8769fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:28.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.285+0000 7f88b8335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:28.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.285+0000 7f88b8335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:28.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.285+0000 7f88b8335800 5 note: GC not initialized 2024-09-12T17:26:28.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.285+0000 7f8768fe1640 20 reqs_thread_entry: start 2024-09-12T17:26:28.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.285+0000 7f88b8335800 20 init_complete bucket index max shards: 1 2024-09-12T17:26:28.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.285+0000 7f88b8335800 20 Filter name: none 2024-09-12T17:26:28.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.285+0000 7f86e27fc640 20 reqs_thread_entry: start 2024-09-12T17:26:28.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.285+0000 7f88b8335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.286+0000 7f88b8335800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:26:28.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.286+0000 7f88b8335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.287+0000 7f88b8335800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:26:28.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.287+0000 7f88b8335800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:28.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.287+0000 7f88b8335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.287+0000 7f88b8335800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:26:28.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.287+0000 7f88b8335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.288+0000 7f88b8335800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:26:28.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.288+0000 7f88b8335800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:28.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.289+0000 7f8769fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:28.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.291+0000 7f88b8335800 20 remove_watcher() i=0 2024-09-12T17:26:28.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.291+0000 7f88b8335800 2 removed watcher, disabling cache 2024-09-12T17:26:28.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.292+0000 7f88b8335800 20 remove_watcher() i=1 2024-09-12T17:26:28.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.294+0000 7f88b8335800 20 remove_watcher() i=2 2024-09-12T17:26:28.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.295+0000 7f88b8335800 20 remove_watcher() i=3 2024-09-12T17:26:28.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.296+0000 7f88b8335800 20 remove_watcher() i=4 2024-09-12T17:26:28.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.297+0000 7f88b8335800 20 remove_watcher() i=5 2024-09-12T17:26:28.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.298+0000 7f88b8335800 20 remove_watcher() i=6 2024-09-12T17:26:28.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.299+0000 7f88b8335800 20 remove_watcher() i=7 2024-09-12T17:26:28.311 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.311 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:26:28.311 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-do-reshard id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:26:28.311 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.312 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T17:26:28.347 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:28.347 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:28.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.386+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.388+0000 7f84e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.388+0000 7f84e7f2c800 20 realm 2024-09-12T17:26:28.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.388+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.388+0000 7f84e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.388+0000 7f84e7f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:28.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.388+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.388+0000 7f84e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.388+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.389+0000 7f84e7f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:28.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.389+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.390+0000 7f84e7f2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:28.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.390+0000 7f84e7f2c800 20 searching for the correct realm 2024-09-12T17:26:28.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.393+0000 7f84e3b61640 0 -- 172.21.15.67:0/348757332 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f84dc070920 msgr2=0x7f84dc055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:28.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.396+0000 7f84e3b61640 0 -- 172.21.15.67:0/348757332 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f84d80642e0 msgr2=0x7f84d80a2a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:26:28.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.602+0000 7f84e7f2c800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:26:28.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.602+0000 7f84e7f2c800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:26:28.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.602+0000 7f84e7f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:28.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.602+0000 7f84e7f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:28.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.602+0000 7f84e7f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:28.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.602+0000 7f84e7f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:28.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.602+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.603+0000 7f84e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.603+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.603+0000 7f84e7f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:28.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.603+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.603+0000 7f84e7f2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:28.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.603+0000 7f84e7f2c800 20 zone default found 2024-09-12T17:26:28.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.603+0000 7f84e7f2c800 4 Realm: () 2024-09-12T17:26:28.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.603+0000 7f84e7f2c800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:26:28.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.603+0000 7f84e7f2c800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:26:28.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.603+0000 7f84e7f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:28.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.603+0000 7f84e7f2c800 20 zonegroup default 2024-09-12T17:26:28.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.603+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.604+0000 7f84e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.604+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.604+0000 7f84e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.604+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.604+0000 7f84e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.604+0000 7f84e7f2c800 20 started sync module instance, tier type = 2024-09-12T17:26:28.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.604+0000 7f84e7f2c800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:26:28.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.614+0000 7f84e7f2c800 20 add_watcher() i=0 2024-09-12T17:26:28.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.614+0000 7f84e7f2c800 20 add_watcher() i=1 2024-09-12T17:26:28.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.614+0000 7f84e7f2c800 20 add_watcher() i=2 2024-09-12T17:26:28.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.614+0000 7f84e7f2c800 20 add_watcher() i=3 2024-09-12T17:26:28.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.614+0000 7f84e7f2c800 20 add_watcher() i=4 2024-09-12T17:26:28.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.614+0000 7f84e7f2c800 20 add_watcher() i=5 2024-09-12T17:26:28.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.614+0000 7f84e7f2c800 20 add_watcher() i=6 2024-09-12T17:26:28.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.615+0000 7f84e7f2c800 20 add_watcher() i=7 2024-09-12T17:26:28.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.615+0000 7f84e7f2c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:28.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.617+0000 7f839a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:28.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.617+0000 7f84e7f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:28.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.617+0000 7f84e7f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:28.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 note: GC not initialized 2024-09-12T17:26:28.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.617+0000 7f83997e2640 20 reqs_thread_entry: start 2024-09-12T17:26:28.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.617+0000 7f84e7f2c800 20 init_complete bucket index max shards: 1 2024-09-12T17:26:28.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.618+0000 7f84e7f2c800 20 Filter name: none 2024-09-12T17:26:28.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.618+0000 7f83927fc640 20 reqs_thread_entry: start 2024-09-12T17:26:28.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.618+0000 7f84e7f2c800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:26:28.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.618+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.618+0000 7f84e7f2c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:26:28.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.618+0000 7f84e7f2c800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:26:28.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.618+0000 7f84e7f2c800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:26:28.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.618+0000 7f84e7f2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 : miss 2024-09-12T17:26:28.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.618+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.619+0000 7f84e7f2c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:26:28.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.619+0000 7f84e7f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 info.flags=0x17 2024-09-12T17:26:28.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.619+0000 7f84e7f2c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 to cache LRU end 2024-09-12T17:26:28.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.619+0000 7f84e7f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:26:28.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.619+0000 7f84e7f2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:28.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.619+0000 7f84e7f2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 2024-09-12T17:26:28.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.623+0000 7f84e7f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 info.flags=0x17 2024-09-12T17:26:28.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.623+0000 7f84e7f2c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 to cache LRU end 2024-09-12T17:26:28.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.623+0000 7f84e7f2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:28.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.623+0000 7f84e7f2c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35, ofs0, ns] 2024-09-12T17:26:28.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.623+0000 7f83c2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464354 cookie 94280806881904 notifier 7575 bl.length()=995 2024-09-12T17:26:28.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.624+0000 7f83c2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 info.flags=0x17 2024-09-12T17:26:28.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.624+0000 7f83c2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 to cache LRU end 2024-09-12T17:26:28.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.624+0000 7f83c2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:28.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.625+0000 7f84e7f2c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.35]): orig_sources= new_sources= 2024-09-12T17:26:28.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.625+0000 7f84e7f2c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.35]): potential sources added=[] removed=[] 2024-09-12T17:26:28.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.625+0000 7f84e7f2c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.35]): orig_dests= new_dests= 2024-09-12T17:26:28.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.625+0000 7f84e7f2c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.35]): potential dests added=[] removed=[] 2024-09-12T17:26:28.628 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f84e7f2c800 time 2024-09-12T17:26:28.628955+0000 2024-09-12T17:26:28.629 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:26:28.661 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:26:28.661 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f84e958c71a] 2024-09-12T17:26:28.661 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f84e958c8d8] 2024-09-12T17:26:28.662 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bf74d6b841] 2024-09-12T17:26:28.662 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55bf74d7b57a] 2024-09-12T17:26:28.662 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T17:26:28.662 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f84e8229590] 2024-09-12T17:26:28.662 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T17:26:28.662 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T17:26:28.662 INFO:tasks.workunit.client.0.smithi067.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:26:28.662 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f84e7f2c800 thread_name:radosgw-admin 2024-09-12T17:26:28.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.628+0000 7f84e7f2c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f84e7f2c800 time 2024-09-12T17:26:28.628955+0000 2024-09-12T17:26:28.663 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:26:28.663 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.663 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:26:28.663 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f84e958c71a] 2024-09-12T17:26:28.663 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f84e958c8d8] 2024-09-12T17:26:28.663 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bf74d6b841] 2024-09-12T17:26:28.663 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55bf74d7b57a] 2024-09-12T17:26:28.663 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T17:26:28.663 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f84e8229590] 2024-09-12T17:26:28.664 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T17:26:28.664 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T17:26:28.664 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.664 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:26:28.664 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f84e823e6f0] 2024-09-12T17:26:28.664 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f84e828b99c] 2024-09-12T17:26:28.664 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:26:28.664 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:26:28.664 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f84e958c774] 2024-09-12T17:26:28.664 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f84e958c8d8] 2024-09-12T17:26:28.665 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bf74d6b841] 2024-09-12T17:26:28.665 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55bf74d7b57a] 2024-09-12T17:26:28.665 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T17:26:28.665 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f84e8229590] 2024-09-12T17:26:28.665 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T17:26:28.665 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T17:26:28.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.629+0000 7f84e7f2c800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:26:28.665 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f84e7f2c800 thread_name:radosgw-admin 2024-09-12T17:26:28.665 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.665 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:26:28.665 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f84e823e6f0] 2024-09-12T17:26:28.666 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f84e828b99c] 2024-09-12T17:26:28.666 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:26:28.666 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:26:28.666 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f84e958c774] 2024-09-12T17:26:28.666 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f84e958c8d8] 2024-09-12T17:26:28.666 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bf74d6b841] 2024-09-12T17:26:28.666 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55bf74d7b57a] 2024-09-12T17:26:28.666 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T17:26:28.666 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f84e8229590] 2024-09-12T17:26:28.666 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T17:26:28.666 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T17:26:28.667 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:26:28.667 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.667 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T17:26:28.667 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T17:26:28.368+0000 7f84e7f2c800 10 monclient: get_monmap_and_config success 2024-09-12T17:26:28.667 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T17:26:28.368+0000 7f84e7f2c800 4 set_mon_vals no callback set 2024-09-12T17:26:28.667 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T17:26:28.368+0000 7f83d1e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:26:28.667 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T17:26:28.368+0000 7f83d1e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:26:28.667 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T17:26:28.368+0000 7f83d1e0b640 10 monclient: dump: 2024-09-12T17:26:28.667 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:26:28.667 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:26:28.667 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.667 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.668 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:26:28.668 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:26:28.668 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:26:28.668 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:26:28.668 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:26:28.668 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.668 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T17:26:28.368+0000 7f84e7f2c800 10 monclient: shutdown 2024-09-12T17:26:28.668 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T17:26:28.368+0000 7f84e7f2c800 5 asok(0x55bf75cea730) unregister_commands rotate-key 2024-09-12T17:26:28.668 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 10 monclient: build_initial_monmap 2024-09-12T17:26:28.668 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 1 build_initial for_mkfs: 0 2024-09-12T17:26:28.668 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 10 monclient: monmap: 2024-09-12T17:26:28.669 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:26:28.669 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:26:28.669 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:26:28.669 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:26:28.669 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:26:28.669 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:26:28.669 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:26:28.669 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:26:28.669 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:26:28.669 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.669 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding auth protocol: cephx 2024-09-12T17:26:28.670 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding auth protocol: cephx 2024-09-12T17:26:28.670 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding auth protocol: cephx 2024-09-12T17:26:28.670 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding con mode: secure 2024-09-12T17:26:28.670 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding con mode: crc 2024-09-12T17:26:28.670 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding con mode: secure 2024-09-12T17:26:28.670 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding con mode: crc 2024-09-12T17:26:28.670 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding con mode: secure 2024-09-12T17:26:28.670 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding con mode: crc 2024-09-12T17:26:28.670 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding con mode: crc 2024-09-12T17:26:28.670 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding con mode: secure 2024-09-12T17:26:28.670 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding con mode: crc 2024-09-12T17:26:28.671 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding con mode: secure 2024-09-12T17:26:28.671 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding con mode: crc 2024-09-12T17:26:28.671 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding con mode: secure 2024-09-12T17:26:28.671 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:26:28.671 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 1 librados: starting msgr at 2024-09-12T17:26:28.671 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 1 librados: starting objecter 2024-09-12T17:26:28.671 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command objecter_requests hook 0x55bf75f39420 2024-09-12T17:26:28.671 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 1 librados: setting wanted keys 2024-09-12T17:26:28.671 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 1 librados: calling monclient init 2024-09-12T17:26:28.671 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 10 monclient: init 2024-09-12T17:26:28.671 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding auth protocol: cephx 2024-09-12T17:26:28.672 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding auth protocol: cephx 2024-09-12T17:26:28.672 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding auth protocol: cephx 2024-09-12T17:26:28.672 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding con mode: secure 2024-09-12T17:26:28.672 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding con mode: crc 2024-09-12T17:26:28.672 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding con mode: secure 2024-09-12T17:26:28.672 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding con mode: crc 2024-09-12T17:26:28.672 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding con mode: secure 2024-09-12T17:26:28.672 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding con mode: crc 2024-09-12T17:26:28.672 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding con mode: crc 2024-09-12T17:26:28.672 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding con mode: secure 2024-09-12T17:26:28.673 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding con mode: crc 2024-09-12T17:26:28.673 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding con mode: secure 2024-09-12T17:26:28.673 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding con mode: crc 2024-09-12T17:26:28.673 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding con mode: secure 2024-09-12T17:26:28.673 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:26:28.673 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T17:26:28.370+0000 7f84e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:26:28.673 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T17:26:28.370+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command rotate-key hook 0x55bf75f0ef98 2024-09-12T17:26:28.673 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T17:26:28.370+0000 7f84e7f2c800 10 monclient: _reopen_session rank -1 2024-09-12T17:26:28.673 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T17:26:28.370+0000 7f84e7f2c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:26:28.673 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T17:26:28.370+0000 7f84e7f2c800 10 monclient(hunting): picked mon.noname-b con 0x55bf75dc4a90 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:26:28.673 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T17:26:28.370+0000 7f84e7f2c800 10 monclient(hunting): picked mon.noname-a con 0x55bf75dc8000 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:26:28.673 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T17:26:28.370+0000 7f84e7f2c800 10 monclient(hunting): picked mon.noname-c con 0x55bf75e57df0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:26:28.674 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T17:26:28.370+0000 7f84e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:26:28.674 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T17:26:28.370+0000 7f84e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:26:28.674 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T17:26:28.370+0000 7f84e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:26:28.674 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T17:26:28.370+0000 7f84e7f2c800 10 monclient(hunting): _renew_subs 2024-09-12T17:26:28.674 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T17:26:28.370+0000 7f84e7f2c800 10 monclient(hunting): authenticate will time out at 2399.720238s 2024-09-12T17:26:28.674 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T17:26:28.370+0000 7f84e3b61640 10 monclient(hunting): get_auth_request con 0x55bf75dc4a90 auth_method 0 2024-09-12T17:26:28.674 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T17:26:28.370+0000 7f84e3b61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:26:28.674 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T17:26:28.370+0000 7f84e3b61640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:26:28.674 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T17:26:28.370+0000 7f84e3b61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:26:28.674 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T17:26:28.370+0000 7f84e3360640 10 monclient(hunting): get_auth_request con 0x55bf75dc8000 auth_method 0 2024-09-12T17:26:28.674 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T17:26:28.370+0000 7f84e3360640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:26:28.675 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T17:26:28.370+0000 7f84e3360640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:26:28.675 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T17:26:28.370+0000 7f84e3360640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:26:28.675 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T17:26:28.370+0000 7f84e3360640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:26:28.675 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T17:26:28.370+0000 7f84e3360640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:26:28.675 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T17:26:28.370+0000 7f84e3360640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:26:28.675 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T17:26:28.370+0000 7f84e3b61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:26:28.675 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T17:26:28.370+0000 7f84e3b61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:26:28.675 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T17:26:28.370+0000 7f84e3b61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:26:28.675 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T17:26:28.370+0000 7f84e4362640 10 monclient(hunting): get_auth_request con 0x55bf75e57df0 auth_method 0 2024-09-12T17:26:28.675 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T17:26:28.370+0000 7f84e4362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:26:28.675 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T17:26:28.370+0000 7f84e4362640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:26:28.676 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T17:26:28.370+0000 7f84e4362640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:26:28.676 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T17:26:28.370+0000 7f84e3360640 10 monclient(hunting): handle_auth_done global_id 7566 payload 824 2024-09-12T17:26:28.676 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T17:26:28.370+0000 7f84e3360640 10 monclient: _finish_hunting 0 2024-09-12T17:26:28.676 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T17:26:28.370+0000 7f84e3360640 1 monclient: found mon.noname-a 2024-09-12T17:26:28.676 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T17:26:28.370+0000 7f84e3360640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:26:28.676 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T17:26:28.371+0000 7f83cbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:26:28.676 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T17:26:28.371+0000 7f83cbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:26:28.676 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T17:26:28.371+0000 7f83cbfff640 10 monclient: dump: 2024-09-12T17:26:28.676 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:26:28.676 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:26:28.676 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.676 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.677 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:26:28.677 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:26:28.677 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:26:28.677 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:26:28.677 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:26:28.677 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.677 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T17:26:28.371+0000 7f83cbfff640 10 monclient: _finish_auth 0 2024-09-12T17:26:28.677 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T17:26:28.371+0000 7f83cbfff640 10 monclient: _check_auth_tickets 2024-09-12T17:26:28.677 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T17:26:28.371+0000 7f83cbfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:26:28.677 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T17:26:28.371+0000 7f83cbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:26:28.677 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T17:26:28.371+0000 7f83cbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:26:28.678 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T17:26:28.371+0000 7f83cbfff640 10 monclient: dump: 2024-09-12T17:26:28.678 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:26:28.678 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:26:28.678 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.678 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.678 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:26:28.678 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:26:28.678 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:26:28.678 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:26:28.678 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:26:28.678 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.679 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T17:26:28.371+0000 7f84e7f2c800 5 monclient: authenticate success, global_id 7566 2024-09-12T17:26:28.679 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T17:26:28.371+0000 7f84e7f2c800 10 monclient: _renew_subs 2024-09-12T17:26:28.679 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T17:26:28.371+0000 7f84e7f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:26:28.679 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T17:26:28.371+0000 7f84e7f2c800 10 monclient: _renew_subs 2024-09-12T17:26:28.679 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T17:26:28.371+0000 7f84e7f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:26:28.679 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T17:26:28.371+0000 7f84e7f2c800 1 librados: init done 2024-09-12T17:26:28.679 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T17:26:28.371+0000 7f83d1e0b640 4 set_mon_vals no callback set 2024-09-12T17:26:28.679 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T17:26:28.373+0000 7f83cbfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:26:28.679 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T17:26:28.373+0000 7f83cbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:26:28.679 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T17:26:28.373+0000 7f83cbfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:26:28.679 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T17:26:28.373+0000 7f84e3b61640 10 monclient: get_auth_request con 0x7f83cc0764c0 auth_method 0 2024-09-12T17:26:28.680 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T17:26:28.374+0000 7f84e4362640 10 monclient: get_auth_request con 0x55bf75f573a0 auth_method 0 2024-09-12T17:26:28.680 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T17:26:28.374+0000 7f84e3b61640 10 monclient: get_auth_request con 0x55bf75f5a580 auth_method 0 2024-09-12T17:26:28.680 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T17:26:28.375+0000 7f84e3360640 10 monclient: get_auth_request con 0x55bf75f5e770 auth_method 0 2024-09-12T17:26:28.680 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 10 monclient: build_initial_monmap 2024-09-12T17:26:28.680 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 1 build_initial for_mkfs: 0 2024-09-12T17:26:28.680 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 10 monclient: monmap: 2024-09-12T17:26:28.680 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:26:28.680 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:26:28.680 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:26:28.680 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:26:28.681 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:26:28.681 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:26:28.681 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:26:28.681 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:26:28.681 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:26:28.681 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.681 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding auth protocol: cephx 2024-09-12T17:26:28.681 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding auth protocol: cephx 2024-09-12T17:26:28.681 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding auth protocol: cephx 2024-09-12T17:26:28.681 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding con mode: secure 2024-09-12T17:26:28.681 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding con mode: crc 2024-09-12T17:26:28.682 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding con mode: secure 2024-09-12T17:26:28.682 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding con mode: crc 2024-09-12T17:26:28.682 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding con mode: secure 2024-09-12T17:26:28.682 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding con mode: crc 2024-09-12T17:26:28.682 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding con mode: crc 2024-09-12T17:26:28.682 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding con mode: secure 2024-09-12T17:26:28.682 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding con mode: crc 2024-09-12T17:26:28.682 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding con mode: secure 2024-09-12T17:26:28.682 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding con mode: crc 2024-09-12T17:26:28.682 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding con mode: secure 2024-09-12T17:26:28.682 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:26:28.683 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command objecter_requests cmddesc objecter_requests hook 0x55bf75f66d60 EEXIST 2024-09-12T17:26:28.683 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 10 monclient: init 2024-09-12T17:26:28.683 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding auth protocol: cephx 2024-09-12T17:26:28.683 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding auth protocol: cephx 2024-09-12T17:26:28.683 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding auth protocol: cephx 2024-09-12T17:26:28.683 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding con mode: secure 2024-09-12T17:26:28.683 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding con mode: crc 2024-09-12T17:26:28.683 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding con mode: secure 2024-09-12T17:26:28.683 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding con mode: crc 2024-09-12T17:26:28.683 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding con mode: secure 2024-09-12T17:26:28.683 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding con mode: crc 2024-09-12T17:26:28.684 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding con mode: crc 2024-09-12T17:26:28.684 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding con mode: secure 2024-09-12T17:26:28.684 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding con mode: crc 2024-09-12T17:26:28.684 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding con mode: secure 2024-09-12T17:26:28.684 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding con mode: crc 2024-09-12T17:26:28.684 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding con mode: secure 2024-09-12T17:26:28.684 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T17:26:28.378+0000 7f84e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:26:28.684 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T17:26:28.378+0000 7f84e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:26:28.684 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T17:26:28.378+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command rotate-key cmddesc rotate-key hook 0x55bf75f61c60 EEXIST 2024-09-12T17:26:28.684 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T17:26:28.378+0000 7f84e7f2c800 10 monclient: _reopen_session rank -1 2024-09-12T17:26:28.684 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T17:26:28.378+0000 7f84e7f2c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:26:28.684 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T17:26:28.378+0000 7f84e7f2c800 10 monclient(hunting): picked mon.noname-b con 0x55bf75f8aa50 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:26:28.685 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T17:26:28.378+0000 7f84e7f2c800 10 monclient(hunting): picked mon.noname-a con 0x55bf75f8cd20 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:26:28.685 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T17:26:28.378+0000 7f84e7f2c800 10 monclient(hunting): picked mon.noname-c con 0x55bf75f89220 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:26:28.685 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T17:26:28.378+0000 7f84e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:26:28.685 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T17:26:28.378+0000 7f84e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:26:28.685 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T17:26:28.378+0000 7f84e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:26:28.685 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T17:26:28.378+0000 7f84e7f2c800 10 monclient(hunting): _renew_subs 2024-09-12T17:26:28.685 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T17:26:28.378+0000 7f84e7f2c800 10 monclient(hunting): authenticate will time out at 2399.728450s 2024-09-12T17:26:28.685 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T17:26:28.378+0000 7f84e3360640 10 monclient(hunting): get_auth_request con 0x55bf75f8cd20 auth_method 0 2024-09-12T17:26:28.685 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T17:26:28.378+0000 7f84e3360640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:26:28.685 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T17:26:28.378+0000 7f84e3360640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:26:28.686 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T17:26:28.378+0000 7f84e3360640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:26:28.686 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T17:26:28.378+0000 7f84e3b61640 10 monclient(hunting): get_auth_request con 0x55bf75f8aa50 auth_method 0 2024-09-12T17:26:28.686 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T17:26:28.378+0000 7f84e3b61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:26:28.686 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T17:26:28.378+0000 7f84e3b61640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:26:28.686 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T17:26:28.378+0000 7f84e3b61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:26:28.686 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T17:26:28.378+0000 7f84e4362640 10 monclient(hunting): get_auth_request con 0x55bf75f89220 auth_method 0 2024-09-12T17:26:28.686 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T17:26:28.378+0000 7f84e4362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:26:28.686 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T17:26:28.378+0000 7f84e4362640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:26:28.686 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T17:26:28.378+0000 7f84e4362640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:26:28.686 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T17:26:28.378+0000 7f84e3360640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:26:28.686 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T17:26:28.378+0000 7f84e3360640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:26:28.686 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T17:26:28.378+0000 7f84e3360640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:26:28.687 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T17:26:28.378+0000 7f84e4362640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:26:28.687 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T17:26:28.378+0000 7f84e4362640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:26:28.687 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T17:26:28.378+0000 7f84e4362640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:26:28.687 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T17:26:28.378+0000 7f84e3b61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:26:28.687 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T17:26:28.378+0000 7f84e3b61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:26:28.687 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T17:26:28.378+0000 7f84e3b61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:26:28.687 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T17:26:28.378+0000 7f84e3360640 10 monclient(hunting): handle_auth_done global_id 7569 payload 824 2024-09-12T17:26:28.687 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T17:26:28.378+0000 7f84e3360640 10 monclient: _finish_hunting 0 2024-09-12T17:26:28.687 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T17:26:28.378+0000 7f84e3360640 1 monclient: found mon.noname-a 2024-09-12T17:26:28.687 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T17:26:28.378+0000 7f84e3360640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:26:28.687 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T17:26:28.379+0000 7f83c97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:26:28.688 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T17:26:28.379+0000 7f83c97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:26:28.688 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T17:26:28.379+0000 7f83c97fa640 10 monclient: dump: 2024-09-12T17:26:28.688 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:26:28.688 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:26:28.688 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.688 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.688 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:26:28.688 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:26:28.688 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:26:28.688 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:26:28.688 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:26:28.689 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.689 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T17:26:28.379+0000 7f83c97fa640 10 monclient: _finish_auth 0 2024-09-12T17:26:28.689 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T17:26:28.379+0000 7f83c97fa640 10 monclient: _check_auth_tickets 2024-09-12T17:26:28.689 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T17:26:28.379+0000 7f83c97fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:26:28.689 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T17:26:28.379+0000 7f83c97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:26:28.689 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T17:26:28.379+0000 7f83c97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:26:28.689 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T17:26:28.379+0000 7f83c97fa640 10 monclient: dump: 2024-09-12T17:26:28.689 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:26:28.690 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:26:28.690 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.690 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.690 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:26:28.690 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:26:28.690 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:26:28.690 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:26:28.690 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:26:28.690 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.690 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T17:26:28.379+0000 7f84e7f2c800 5 monclient: authenticate success, global_id 7569 2024-09-12T17:26:28.690 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T17:26:28.379+0000 7f84e7f2c800 10 monclient: _renew_subs 2024-09-12T17:26:28.691 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T17:26:28.379+0000 7f84e4b63640 4 set_mon_vals no callback set 2024-09-12T17:26:28.691 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T17:26:28.379+0000 7f84e7f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:26:28.691 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T17:26:28.379+0000 7f84e7f2c800 10 monclient: _renew_subs 2024-09-12T17:26:28.691 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T17:26:28.379+0000 7f84e7f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:26:28.691 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T17:26:28.380+0000 7f83c97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:26:28.691 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T17:26:28.380+0000 7f83c97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:26:28.691 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T17:26:28.380+0000 7f83c97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:26:28.691 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T17:26:28.381+0000 7f84e3b61640 10 monclient: get_auth_request con 0x7f83bc076380 auth_method 0 2024-09-12T17:26:28.691 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 10 monclient: get_monmap_and_config 2024-09-12T17:26:28.691 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 10 monclient: build_initial_monmap 2024-09-12T17:26:28.691 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 1 build_initial for_mkfs: 0 2024-09-12T17:26:28.692 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 10 monclient: monmap: 2024-09-12T17:26:28.692 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:26:28.692 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:26:28.692 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:26:28.692 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:26:28.692 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:26:28.692 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:26:28.692 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:26:28.692 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:26:28.692 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:26:28.692 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.693 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding auth protocol: cephx 2024-09-12T17:26:28.693 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding auth protocol: cephx 2024-09-12T17:26:28.693 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding auth protocol: cephx 2024-09-12T17:26:28.693 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding con mode: secure 2024-09-12T17:26:28.693 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding con mode: crc 2024-09-12T17:26:28.693 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding con mode: secure 2024-09-12T17:26:28.693 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding con mode: crc 2024-09-12T17:26:28.693 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding con mode: secure 2024-09-12T17:26:28.693 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding con mode: crc 2024-09-12T17:26:28.693 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding con mode: crc 2024-09-12T17:26:28.693 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding con mode: secure 2024-09-12T17:26:28.693 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding con mode: crc 2024-09-12T17:26:28.694 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding con mode: secure 2024-09-12T17:26:28.694 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding con mode: crc 2024-09-12T17:26:28.694 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding con mode: secure 2024-09-12T17:26:28.694 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:26:28.694 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 10 monclient: init 2024-09-12T17:26:28.694 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding auth protocol: cephx 2024-09-12T17:26:28.694 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding auth protocol: cephx 2024-09-12T17:26:28.694 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding auth protocol: cephx 2024-09-12T17:26:28.694 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding con mode: secure 2024-09-12T17:26:28.694 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding con mode: crc 2024-09-12T17:26:28.695 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding con mode: secure 2024-09-12T17:26:28.695 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding con mode: crc 2024-09-12T17:26:28.695 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding con mode: secure 2024-09-12T17:26:28.695 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding con mode: crc 2024-09-12T17:26:28.695 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding con mode: crc 2024-09-12T17:26:28.695 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding con mode: secure 2024-09-12T17:26:28.695 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding con mode: crc 2024-09-12T17:26:28.695 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding con mode: secure 2024-09-12T17:26:28.695 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding con mode: crc 2024-09-12T17:26:28.696 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding con mode: secure 2024-09-12T17:26:28.696 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:26:28.696 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:26:28.696 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command rotate-key cmddesc rotate-key hook 0x7fff182348b8 EEXIST 2024-09-12T17:26:28.696 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 10 monclient: _reopen_session rank -1 2024-09-12T17:26:28.696 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:26:28.696 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 10 monclient(hunting): picked mon.noname-c con 0x55bf75fdef70 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:26:28.696 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 10 monclient(hunting): picked mon.noname-a con 0x55bf75fcf8c0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:26:28.696 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 10 monclient(hunting): picked mon.noname-b con 0x55bf75fda3a0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:26:28.696 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:26:28.697 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:26:28.697 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:26:28.697 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 10 monclient(hunting): _renew_subs 2024-09-12T17:26:28.697 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 10 monclient(hunting): authenticate will time out at 2399.732250s 2024-09-12T17:26:28.697 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T17:26:28.382+0000 7f84e3b61640 10 monclient(hunting): get_auth_request con 0x55bf75fdef70 auth_method 0 2024-09-12T17:26:28.697 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T17:26:28.382+0000 7f84e3b61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:26:28.697 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T17:26:28.382+0000 7f84e3b61640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:26:28.697 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T17:26:28.382+0000 7f84e3b61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:26:28.697 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T17:26:28.382+0000 7f84e3360640 10 monclient(hunting): get_auth_request con 0x55bf75fcf8c0 auth_method 0 2024-09-12T17:26:28.697 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T17:26:28.382+0000 7f84e3360640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:26:28.697 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T17:26:28.382+0000 7f84e3360640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:26:28.698 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T17:26:28.382+0000 7f84e3360640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:26:28.698 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T17:26:28.382+0000 7f84e3360640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:26:28.698 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T17:26:28.382+0000 7f84e3360640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:26:28.698 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T17:26:28.382+0000 7f84e3360640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:26:28.698 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T17:26:28.382+0000 7f84e3b61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:26:28.698 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T17:26:28.382+0000 7f84e3b61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:26:28.698 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T17:26:28.382+0000 7f84e3b61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:26:28.698 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T17:26:28.382+0000 7f84e4362640 10 monclient(hunting): get_auth_request con 0x55bf75fda3a0 auth_method 0 2024-09-12T17:26:28.698 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T17:26:28.382+0000 7f84e4362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:26:28.698 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T17:26:28.382+0000 7f84e4362640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:26:28.699 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T17:26:28.382+0000 7f84e4362640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:26:28.699 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T17:26:28.382+0000 7f84e3360640 10 monclient(hunting): handle_auth_done global_id 7572 payload 274 2024-09-12T17:26:28.699 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T17:26:28.382+0000 7f84e3360640 10 monclient: _finish_hunting 0 2024-09-12T17:26:28.699 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T17:26:28.382+0000 7f84e3360640 1 monclient: found mon.noname-a 2024-09-12T17:26:28.699 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T17:26:28.382+0000 7f84e3360640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:26:28.699 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T17:26:28.382+0000 7f83c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:26:28.699 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T17:26:28.382+0000 7f83c2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:26:28.699 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T17:26:28.382+0000 7f83c2ffd640 10 monclient: dump: 2024-09-12T17:26:28.699 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:26:28.699 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:26:28.699 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.700 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.700 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:26:28.700 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:26:28.700 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:26:28.700 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:26:28.700 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:26:28.700 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.700 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T17:26:28.382+0000 7f83c2ffd640 10 monclient: _finish_auth 0 2024-09-12T17:26:28.700 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T17:26:28.382+0000 7f83c2ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:26:28.700 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T17:26:28.382+0000 7f83c2ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:26:28.700 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T17:26:28.382+0000 7f83c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:26:28.701 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T17:26:28.382+0000 7f83c2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:26:28.701 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T17:26:28.382+0000 7f83c2ffd640 10 monclient: dump: 2024-09-12T17:26:28.701 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:26:28.701 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:26:28.701 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.701 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.701 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:26:28.701 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:26:28.701 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:26:28.701 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:26:28.701 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:26:28.702 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.702 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 5 monclient: authenticate success, global_id 7572 2024-09-12T17:26:28.702 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 10 monclient: get_monmap_and_config success 2024-09-12T17:26:28.702 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 4 set_mon_vals no callback set 2024-09-12T17:26:28.702 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 10 monclient: shutdown 2024-09-12T17:26:28.702 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 10 monclient: build_initial_monmap 2024-09-12T17:26:28.702 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 1 build_initial for_mkfs: 0 2024-09-12T17:26:28.702 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 10 monclient: monmap: 2024-09-12T17:26:28.702 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:26:28.702 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:26:28.702 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:26:28.703 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:26:28.703 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:26:28.703 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:26:28.703 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:26:28.703 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:26:28.703 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:26:28.703 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.703 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding auth protocol: cephx 2024-09-12T17:26:28.703 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding auth protocol: cephx 2024-09-12T17:26:28.703 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding auth protocol: cephx 2024-09-12T17:26:28.703 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding con mode: secure 2024-09-12T17:26:28.704 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding con mode: crc 2024-09-12T17:26:28.704 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding con mode: secure 2024-09-12T17:26:28.704 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding con mode: crc 2024-09-12T17:26:28.704 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding con mode: secure 2024-09-12T17:26:28.704 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding con mode: crc 2024-09-12T17:26:28.704 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding con mode: crc 2024-09-12T17:26:28.704 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding con mode: secure 2024-09-12T17:26:28.704 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding con mode: crc 2024-09-12T17:26:28.704 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding con mode: secure 2024-09-12T17:26:28.704 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding con mode: crc 2024-09-12T17:26:28.704 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding con mode: secure 2024-09-12T17:26:28.704 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:26:28.705 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 1 librados: starting msgr at 2024-09-12T17:26:28.705 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 1 librados: starting objecter 2024-09-12T17:26:28.705 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command objecter_requests cmddesc objecter_requests hook 0x55bf75f8cc50 EEXIST 2024-09-12T17:26:28.705 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 1 librados: setting wanted keys 2024-09-12T17:26:28.705 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 1 librados: calling monclient init 2024-09-12T17:26:28.705 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 10 monclient: init 2024-09-12T17:26:28.705 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding auth protocol: cephx 2024-09-12T17:26:28.705 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding auth protocol: cephx 2024-09-12T17:26:28.705 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding auth protocol: cephx 2024-09-12T17:26:28.705 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding con mode: secure 2024-09-12T17:26:28.705 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding con mode: crc 2024-09-12T17:26:28.706 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding con mode: secure 2024-09-12T17:26:28.706 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding con mode: crc 2024-09-12T17:26:28.706 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding con mode: secure 2024-09-12T17:26:28.706 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding con mode: crc 2024-09-12T17:26:28.706 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding con mode: crc 2024-09-12T17:26:28.706 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding con mode: secure 2024-09-12T17:26:28.706 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding con mode: crc 2024-09-12T17:26:28.706 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding con mode: secure 2024-09-12T17:26:28.706 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding con mode: crc 2024-09-12T17:26:28.706 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding con mode: secure 2024-09-12T17:26:28.706 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:26:28.706 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:26:28.707 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command rotate-key cmddesc rotate-key hook 0x55bf75fa2948 EEXIST 2024-09-12T17:26:28.707 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 10 monclient: _reopen_session rank -1 2024-09-12T17:26:28.707 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:26:28.707 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 10 monclient(hunting): picked mon.noname-c con 0x55bf75fcf8c0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:26:28.707 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 10 monclient(hunting): picked mon.noname-a con 0x55bf75fda3a0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:26:28.707 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 10 monclient(hunting): picked mon.noname-b con 0x55bf75fdef70 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:26:28.707 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:26:28.707 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:26:28.707 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:26:28.707 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 10 monclient(hunting): _renew_subs 2024-09-12T17:26:28.707 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 10 monclient(hunting): authenticate will time out at 2399.734654s 2024-09-12T17:26:28.707 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T17:26:28.384+0000 7f84e3360640 10 monclient(hunting): get_auth_request con 0x55bf75fda3a0 auth_method 0 2024-09-12T17:26:28.707 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T17:26:28.384+0000 7f84e3360640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:26:28.708 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T17:26:28.384+0000 7f84e3360640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:26:28.708 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T17:26:28.384+0000 7f84e3360640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:26:28.708 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T17:26:28.384+0000 7f84e3b61640 10 monclient(hunting): get_auth_request con 0x55bf75fcf8c0 auth_method 0 2024-09-12T17:26:28.708 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T17:26:28.384+0000 7f84e3b61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:26:28.708 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T17:26:28.384+0000 7f84e3b61640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:26:28.708 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T17:26:28.384+0000 7f84e3b61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:26:28.708 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T17:26:28.384+0000 7f84e3360640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:26:28.708 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T17:26:28.384+0000 7f84e3360640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:26:28.708 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T17:26:28.384+0000 7f84e3360640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:26:28.708 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T17:26:28.384+0000 7f84e3b61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:26:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T17:26:28.384+0000 7f84e3b61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:26:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T17:26:28.384+0000 7f84e3b61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:26:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T17:26:28.384+0000 7f84e4362640 10 monclient(hunting): get_auth_request con 0x55bf75fdef70 auth_method 0 2024-09-12T17:26:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T17:26:28.384+0000 7f84e4362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:26:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T17:26:28.384+0000 7f84e4362640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:26:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T17:26:28.384+0000 7f84e4362640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:26:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T17:26:28.384+0000 7f84e3360640 10 monclient(hunting): handle_auth_done global_id 7575 payload 824 2024-09-12T17:26:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T17:26:28.384+0000 7f84e3360640 10 monclient: _finish_hunting 0 2024-09-12T17:26:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T17:26:28.384+0000 7f84e3360640 1 monclient: found mon.noname-a 2024-09-12T17:26:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T17:26:28.384+0000 7f84e3360640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:26:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T17:26:28.385+0000 7f83c17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:26:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T17:26:28.385+0000 7f83c17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:26:28.710 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T17:26:28.385+0000 7f83c17fa640 10 monclient: dump: 2024-09-12T17:26:28.710 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:26:28.710 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:26:28.710 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.710 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.710 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:26:28.710 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:26:28.710 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:26:28.710 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:26:28.710 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:26:28.710 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.710 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T17:26:28.385+0000 7f83c17fa640 10 monclient: _finish_auth 0 2024-09-12T17:26:28.711 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T17:26:28.385+0000 7f83c17fa640 10 monclient: _check_auth_tickets 2024-09-12T17:26:28.711 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T17:26:28.385+0000 7f83c17fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:26:28.711 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T17:26:28.385+0000 7f83c17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:26:28.711 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T17:26:28.385+0000 7f83c17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:26:28.711 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T17:26:28.385+0000 7f83c17fa640 10 monclient: dump: 2024-09-12T17:26:28.711 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:26:28.711 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:26:28.711 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.711 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.712 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:26:28.712 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:26:28.712 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:26:28.712 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:26:28.712 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:26:28.712 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.712 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T17:26:28.385+0000 7f84e7f2c800 5 monclient: authenticate success, global_id 7575 2024-09-12T17:26:28.712 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T17:26:28.385+0000 7f83c2ffd640 4 set_mon_vals no callback set 2024-09-12T17:26:28.712 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T17:26:28.385+0000 7f84e7f2c800 10 monclient: _renew_subs 2024-09-12T17:26:28.712 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T17:26:28.385+0000 7f84e7f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:26:28.712 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T17:26:28.385+0000 7f84e7f2c800 10 monclient: _renew_subs 2024-09-12T17:26:28.713 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T17:26:28.385+0000 7f84e7f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:26:28.713 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T17:26:28.385+0000 7f84e7f2c800 1 librados: init done 2024-09-12T17:26:28.713 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T17:26:28.385+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command cr dump hook 0x55bf75fd93b8 2024-09-12T17:26:28.713 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T17:26:28.386+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.713 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T17:26:28.387+0000 7f83c17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:26:28.713 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T17:26:28.387+0000 7f83c17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:26:28.713 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T17:26:28.387+0000 7f83c17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:26:28.713 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T17:26:28.387+0000 7f84e3b61640 10 monclient: get_auth_request con 0x7f83ac076470 auth_method 0 2024-09-12T17:26:28.713 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T17:26:28.387+0000 7f84e4362640 10 monclient: get_auth_request con 0x55bf75ff8770 auth_method 0 2024-09-12T17:26:28.713 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T17:26:28.388+0000 7f84e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.713 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T17:26:28.388+0000 7f84e7f2c800 20 realm 2024-09-12T17:26:28.714 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T17:26:28.388+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.714 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T17:26:28.388+0000 7f84e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.714 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T17:26:28.388+0000 7f84e7f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:28.714 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T17:26:28.388+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.714 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T17:26:28.388+0000 7f84e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.714 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T17:26:28.388+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.714 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T17:26:28.389+0000 7f84e3b61640 10 monclient: get_auth_request con 0x55bf75ffc940 auth_method 0 2024-09-12T17:26:28.714 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T17:26:28.389+0000 7f84e7f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:28.714 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T17:26:28.389+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.714 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T17:26:28.389+0000 7f84e3360640 10 monclient: get_auth_request con 0x55bf760001a0 auth_method 0 2024-09-12T17:26:28.714 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T17:26:28.390+0000 7f84e7f2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:28.715 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T17:26:28.390+0000 7f84e7f2c800 20 searching for the correct realm 2024-09-12T17:26:28.715 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T17:26:28.390+0000 7f84e4362640 10 monclient: get_auth_request con 0x55bf76004f60 auth_method 0 2024-09-12T17:26:28.715 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T17:26:28.391+0000 7f84e3b61640 10 monclient: get_auth_request con 0x7f84dc070920 auth_method 0 2024-09-12T17:26:28.715 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T17:26:28.392+0000 7f84e3360640 10 monclient: get_auth_request con 0x7f84d4049040 auth_method 0 2024-09-12T17:26:28.715 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T17:26:28.393+0000 7f84e3b61640 0 -- 172.21.15.67:0/348757332 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f84dc070920 msgr2=0x7f84dc055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:28.715 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T17:26:28.393+0000 7f83c17fa640 1 client.7575.objecter ms_handle_reset 0x7f84dc070920 session 0x7f84dc064120 osd.7 2024-09-12T17:26:28.715 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T17:26:28.393+0000 7f83c17fa640 10 monclient: _renew_subs 2024-09-12T17:26:28.715 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T17:26:28.393+0000 7f83c17fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:26:28.715 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T17:26:28.393+0000 7f84e3b61640 10 monclient: get_auth_request con 0x7f83ac086290 auth_method 0 2024-09-12T17:26:28.715 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T17:26:28.394+0000 7f84e4362640 10 monclient: get_auth_request con 0x7f84d8077020 auth_method 0 2024-09-12T17:26:28.716 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T17:26:28.396+0000 7f84e3b61640 10 monclient: get_auth_request con 0x7f84d80642e0 auth_method 0 2024-09-12T17:26:28.716 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T17:26:28.396+0000 7f84e3b61640 0 -- 172.21.15.67:0/348757332 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f84d80642e0 msgr2=0x7f84d80a2a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:26:28.716 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T17:26:28.597+0000 7f84e3b61640 10 monclient: get_auth_request con 0x7f84d80642e0 auth_method 0 2024-09-12T17:26:28.716 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T17:26:28.602+0000 7f84e7f2c800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:26:28.716 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T17:26:28.602+0000 7f84e7f2c800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:26:28.716 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T17:26:28.602+0000 7f84e7f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:28.716 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T17:26:28.602+0000 7f84e7f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:28.716 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T17:26:28.602+0000 7f84e7f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:28.716 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T17:26:28.602+0000 7f84e7f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:28.716 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T17:26:28.602+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.716 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T17:26:28.603+0000 7f84e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.717 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T17:26:28.603+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.717 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T17:26:28.603+0000 7f84e7f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:28.717 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T17:26:28.603+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.717 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T17:26:28.603+0000 7f84e7f2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:28.717 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T17:26:28.603+0000 7f84e7f2c800 20 zone default found 2024-09-12T17:26:28.717 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T17:26:28.603+0000 7f84e7f2c800 4 Realm: () 2024-09-12T17:26:28.717 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T17:26:28.603+0000 7f84e7f2c800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:26:28.717 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T17:26:28.603+0000 7f84e7f2c800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:26:28.717 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T17:26:28.603+0000 7f84e7f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:28.717 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T17:26:28.603+0000 7f84e7f2c800 20 zonegroup default 2024-09-12T17:26:28.718 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T17:26:28.603+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.718 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T17:26:28.604+0000 7f84e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.718 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T17:26:28.604+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.718 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T17:26:28.604+0000 7f84e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.718 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T17:26:28.604+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.718 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T17:26:28.604+0000 7f84e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.718 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T17:26:28.604+0000 7f84e7f2c800 20 started sync module instance, tier type = 2024-09-12T17:26:28.718 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T17:26:28.604+0000 7f84e7f2c800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:26:28.718 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T17:26:28.614+0000 7f84e7f2c800 20 add_watcher() i=0 2024-09-12T17:26:28.718 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T17:26:28.614+0000 7f84e7f2c800 20 add_watcher() i=1 2024-09-12T17:26:28.719 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T17:26:28.614+0000 7f84e7f2c800 20 add_watcher() i=2 2024-09-12T17:26:28.719 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T17:26:28.614+0000 7f84e7f2c800 20 add_watcher() i=3 2024-09-12T17:26:28.719 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T17:26:28.614+0000 7f84e7f2c800 20 add_watcher() i=4 2024-09-12T17:26:28.719 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T17:26:28.614+0000 7f84e7f2c800 20 add_watcher() i=5 2024-09-12T17:26:28.719 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T17:26:28.614+0000 7f84e7f2c800 20 add_watcher() i=6 2024-09-12T17:26:28.719 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T17:26:28.615+0000 7f84e7f2c800 20 add_watcher() i=7 2024-09-12T17:26:28.719 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T17:26:28.615+0000 7f84e7f2c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:28.719 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding auth protocol: cephx 2024-09-12T17:26:28.719 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding auth protocol: cephx 2024-09-12T17:26:28.719 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding auth protocol: cephx 2024-09-12T17:26:28.719 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding con mode: secure 2024-09-12T17:26:28.720 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding con mode: crc 2024-09-12T17:26:28.720 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding con mode: secure 2024-09-12T17:26:28.720 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding con mode: crc 2024-09-12T17:26:28.720 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding con mode: secure 2024-09-12T17:26:28.720 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding con mode: crc 2024-09-12T17:26:28.720 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding con mode: crc 2024-09-12T17:26:28.720 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding con mode: secure 2024-09-12T17:26:28.720 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding con mode: crc 2024-09-12T17:26:28.720 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T17:26:28.617+0000 7f839a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:28.721 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding con mode: secure 2024-09-12T17:26:28.721 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding con mode: crc 2024-09-12T17:26:28.721 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding con mode: secure 2024-09-12T17:26:28.721 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:26:28.721 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:28.721 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:28.721 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command cache list hook 0x55bf75fed140 2024-09-12T17:26:28.721 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command cache inspect hook 0x55bf75fed140 2024-09-12T17:26:28.721 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command cache erase hook 0x55bf75fed140 2024-09-12T17:26:28.721 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command cache zap hook 0x55bf75fed140 2024-09-12T17:26:28.721 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 note: GC not initialized 2024-09-12T17:26:28.722 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T17:26:28.617+0000 7f83997e2640 20 reqs_thread_entry: start 2024-09-12T17:26:28.722 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command sync trace show hook 0x7f84d40043a0 2024-09-12T17:26:28.722 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command sync trace history hook 0x7f84d40043a0 2024-09-12T17:26:28.722 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command sync trace active hook 0x7f84d40043a0 2024-09-12T17:26:28.722 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command sync trace active_short hook 0x7f84d40043a0 2024-09-12T17:26:28.722 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 20 init_complete bucket index max shards: 1 2024-09-12T17:26:28.722 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T17:26:28.618+0000 7f84e7f2c800 20 Filter name: none 2024-09-12T17:26:28.722 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T17:26:28.618+0000 7f83927fc640 20 reqs_thread_entry: start 2024-09-12T17:26:28.722 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T17:26:28.618+0000 7f84e7f2c800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:26:28.722 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T17:26:28.618+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.722 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T17:26:28.618+0000 7f84e7f2c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:26:28.722 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T17:26:28.618+0000 7f84e7f2c800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:26:28.723 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T17:26:28.618+0000 7f84e7f2c800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:26:28.723 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T17:26:28.618+0000 7f84e7f2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 : miss 2024-09-12T17:26:28.723 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T17:26:28.618+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.723 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T17:26:28.619+0000 7f84e7f2c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:26:28.723 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T17:26:28.619+0000 7f84e7f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 info.flags=0x17 2024-09-12T17:26:28.723 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T17:26:28.619+0000 7f84e7f2c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 to cache LRU end 2024-09-12T17:26:28.723 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T17:26:28.619+0000 7f84e7f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:26:28.723 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T17:26:28.619+0000 7f84e7f2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:28.723 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T17:26:28.619+0000 7f84e7f2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 2024-09-12T17:26:28.723 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T17:26:28.623+0000 7f84e7f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 info.flags=0x17 2024-09-12T17:26:28.724 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T17:26:28.623+0000 7f84e7f2c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 to cache LRU end 2024-09-12T17:26:28.724 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T17:26:28.623+0000 7f84e7f2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:28.724 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T17:26:28.623+0000 7f84e7f2c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35, ofs0, ns] 2024-09-12T17:26:28.724 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T17:26:28.623+0000 7f83c2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464354 cookie 94280806881904 notifier 7575 bl.length()=995 2024-09-12T17:26:28.724 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T17:26:28.624+0000 7f83c2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 info.flags=0x17 2024-09-12T17:26:28.724 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T17:26:28.624+0000 7f83c2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 to cache LRU end 2024-09-12T17:26:28.724 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T17:26:28.624+0000 7f83c2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:28.724 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T17:26:28.625+0000 7f84e7f2c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.35]): orig_sources= new_sources= 2024-09-12T17:26:28.724 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T17:26:28.625+0000 7f84e7f2c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.35]): potential sources added=[] removed=[] 2024-09-12T17:26:28.724 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T17:26:28.625+0000 7f84e7f2c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.35]): orig_dests= new_dests= 2024-09-12T17:26:28.725 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T17:26:28.625+0000 7f84e7f2c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.35]): potential dests added=[] removed=[] 2024-09-12T17:26:28.725 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T17:26:28.628+0000 7f84e7f2c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f84e7f2c800 time 2024-09-12T17:26:28.628955+0000 2024-09-12T17:26:28.725 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:26:28.725 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.725 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:26:28.725 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f84e958c71a] 2024-09-12T17:26:28.725 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f84e958c8d8] 2024-09-12T17:26:28.725 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bf74d6b841] 2024-09-12T17:26:28.725 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55bf74d7b57a] 2024-09-12T17:26:28.725 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T17:26:28.726 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f84e8229590] 2024-09-12T17:26:28.726 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T17:26:28.726 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T17:26:28.726 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.726 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T17:26:28.629+0000 7f84e7f2c800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:26:28.726 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f84e7f2c800 thread_name:radosgw-admin 2024-09-12T17:26:28.726 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.726 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:26:28.726 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f84e823e6f0] 2024-09-12T17:26:28.726 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f84e828b99c] 2024-09-12T17:26:28.727 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:26:28.727 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:26:28.727 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f84e958c774] 2024-09-12T17:26:28.727 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f84e958c8d8] 2024-09-12T17:26:28.727 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bf74d6b841] 2024-09-12T17:26:28.727 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55bf74d7b57a] 2024-09-12T17:26:28.727 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T17:26:28.727 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f84e8229590] 2024-09-12T17:26:28.727 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T17:26:28.727 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T17:26:28.727 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:26:28.728 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.728 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T17:26:28.728 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T17:26:28.728 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T17:26:28.728 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T17:26:28.728 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T17:26:28.728 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T17:26:28.728 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T17:26:28.728 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T17:26:28.728 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T17:26:28.728 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T17:26:28.729 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T17:26:28.729 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T17:26:28.729 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T17:26:28.729 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T17:26:28.729 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T17:26:28.729 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T17:26:28.729 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T17:26:28.729 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T17:26:28.729 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T17:26:28.730 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T17:26:28.730 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T17:26:28.730 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T17:26:28.730 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T17:26:28.730 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T17:26:28.730 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:26:28.730 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T17:26:28.730 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T17:26:28.730 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T17:26:28.730 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T17:26:28.730 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T17:26:28.731 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T17:26:28.731 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T17:26:28.731 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T17:26:28.731 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T17:26:28.731 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T17:26:28.731 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T17:26:28.731 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T17:26:28.731 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T17:26:28.731 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T17:26:28.731 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T17:26:28.731 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T17:26:28.732 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T17:26:28.732 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T17:26:28.732 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T17:26:28.732 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T17:26:28.732 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T17:26:28.732 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:26:28.732 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T17:26:28.732 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:26:28.732 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T17:26:28.732 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T17:26:28.733 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T17:26:28.733 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T17:26:28.733 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T17:26:28.733 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T17:26:28.733 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T17:26:28.733 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T17:26:28.733 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T17:26:28.733 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T17:26:28.733 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T17:26:28.733 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T17:26:28.733 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T17:26:28.734 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T17:26:28.734 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T17:26:28.734 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T17:26:28.734 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T17:26:28.734 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T17:26:28.734 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:26:28.734 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T17:26:28.734 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:26:28.734 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T17:26:28.734 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T17:26:28.734 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T17:26:28.735 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T17:26:28.735 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T17:26:28.735 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T17:26:28.735 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:26:28.735 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T17:26:28.735 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T17:26:28.735 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:26:28.735 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T17:26:28.735 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T17:26:28.735 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T17:26:28.735 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T17:26:28.736 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T17:26:28.736 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T17:26:28.736 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T17:26:28.736 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T17:26:28.736 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T17:26:28.736 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T17:26:28.736 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T17:26:28.736 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T17:26:28.736 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T17:26:28.736 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:26:28.736 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83927fc640 / http_manager 2024-09-12T17:26:28.737 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83997e2640 / http_manager 2024-09-12T17:26:28.737 INFO:tasks.workunit.client.0.smithi067.stderr: 7f839a7e4640 / rgw_dt_lg_renew 2024-09-12T17:26:28.737 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83c17fa640 / ms_dispatch 2024-09-12T17:26:28.737 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83c2ffd640 / io_context_pool 2024-09-12T17:26:28.737 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83c97fa640 / ms_dispatch 2024-09-12T17:26:28.737 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83cbfff640 / ms_dispatch 2024-09-12T17:26:28.737 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83d1e0b640 / io_context_pool 2024-09-12T17:26:28.737 INFO:tasks.workunit.client.0.smithi067.stderr: 7f84e3360640 / msgr-worker-2 2024-09-12T17:26:28.737 INFO:tasks.workunit.client.0.smithi067.stderr: 7f84e3b61640 / msgr-worker-1 2024-09-12T17:26:28.737 INFO:tasks.workunit.client.0.smithi067.stderr: 7f84e4362640 / msgr-worker-0 2024-09-12T17:26:28.737 INFO:tasks.workunit.client.0.smithi067.stderr: 7f84e4b63640 / io_context_pool 2024-09-12T17:26:28.738 INFO:tasks.workunit.client.0.smithi067.stderr: 7f84e7f2c800 / radosgw-admin 2024-09-12T17:26:28.738 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T17:26:28.738 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T17:26:28.738 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/log/ceph/ceph-client.admin.129238.log 2024-09-12T17:26:28.738 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T17:26:28.738 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T17:26:28.738 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T17:26:28.368+0000 7f84e7f2c800 10 monclient: get_monmap_and_config success 2024-09-12T17:26:28.738 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T17:26:28.368+0000 7f84e7f2c800 4 set_mon_vals no callback set 2024-09-12T17:26:28.738 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T17:26:28.368+0000 7f83d1e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:26:28.738 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T17:26:28.368+0000 7f83d1e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:26:28.738 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T17:26:28.368+0000 7f83d1e0b640 10 monclient: dump: 2024-09-12T17:26:28.739 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:26:28.739 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:26:28.739 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.739 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.739 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:26:28.739 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:26:28.739 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:26:28.739 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:26:28.739 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:26:28.739 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.739 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T17:26:28.368+0000 7f84e7f2c800 10 monclient: shutdown 2024-09-12T17:26:28.739 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T17:26:28.368+0000 7f84e7f2c800 5 asok(0x55bf75cea730) unregister_commands rotate-key 2024-09-12T17:26:28.740 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 10 monclient: build_initial_monmap 2024-09-12T17:26:28.740 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 1 build_initial for_mkfs: 0 2024-09-12T17:26:28.740 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 10 monclient: monmap: 2024-09-12T17:26:28.740 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:26:28.740 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:26:28.740 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:26:28.740 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:26:28.740 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:26:28.740 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:26:28.740 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:26:28.740 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:26:28.741 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:26:28.741 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.741 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding auth protocol: cephx 2024-09-12T17:26:28.741 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding auth protocol: cephx 2024-09-12T17:26:28.741 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding auth protocol: cephx 2024-09-12T17:26:28.741 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding con mode: secure 2024-09-12T17:26:28.741 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding con mode: crc 2024-09-12T17:26:28.741 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding con mode: secure 2024-09-12T17:26:28.741 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding con mode: crc 2024-09-12T17:26:28.741 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding con mode: secure 2024-09-12T17:26:28.742 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding con mode: crc 2024-09-12T17:26:28.742 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding con mode: crc 2024-09-12T17:26:28.742 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding con mode: secure 2024-09-12T17:26:28.742 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding con mode: crc 2024-09-12T17:26:28.742 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding con mode: secure 2024-09-12T17:26:28.742 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding con mode: crc 2024-09-12T17:26:28.742 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f14570) adding con mode: secure 2024-09-12T17:26:28.742 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:26:28.743 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 1 librados: starting msgr at 2024-09-12T17:26:28.743 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 1 librados: starting objecter 2024-09-12T17:26:28.743 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command objecter_requests hook 0x55bf75f39420 2024-09-12T17:26:28.743 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 1 librados: setting wanted keys 2024-09-12T17:26:28.743 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 1 librados: calling monclient init 2024-09-12T17:26:28.743 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 10 monclient: init 2024-09-12T17:26:28.743 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding auth protocol: cephx 2024-09-12T17:26:28.743 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding auth protocol: cephx 2024-09-12T17:26:28.743 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding auth protocol: cephx 2024-09-12T17:26:28.743 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding con mode: secure 2024-09-12T17:26:28.743 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding con mode: crc 2024-09-12T17:26:28.744 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding con mode: secure 2024-09-12T17:26:28.744 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding con mode: crc 2024-09-12T17:26:28.744 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding con mode: secure 2024-09-12T17:26:28.744 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding con mode: crc 2024-09-12T17:26:28.744 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding con mode: crc 2024-09-12T17:26:28.744 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding con mode: secure 2024-09-12T17:26:28.744 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding con mode: crc 2024-09-12T17:26:28.744 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding con mode: secure 2024-09-12T17:26:28.744 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding con mode: crc 2024-09-12T17:26:28.744 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f0ee50) adding con mode: secure 2024-09-12T17:26:28.744 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T17:26:28.369+0000 7f84e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:26:28.745 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T17:26:28.370+0000 7f84e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:26:28.745 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T17:26:28.370+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command rotate-key hook 0x55bf75f0ef98 2024-09-12T17:26:28.745 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T17:26:28.370+0000 7f84e7f2c800 10 monclient: _reopen_session rank -1 2024-09-12T17:26:28.745 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T17:26:28.370+0000 7f84e7f2c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:26:28.745 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T17:26:28.370+0000 7f84e7f2c800 10 monclient(hunting): picked mon.noname-b con 0x55bf75dc4a90 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:26:28.745 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T17:26:28.370+0000 7f84e7f2c800 10 monclient(hunting): picked mon.noname-a con 0x55bf75dc8000 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:26:28.745 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T17:26:28.370+0000 7f84e7f2c800 10 monclient(hunting): picked mon.noname-c con 0x55bf75e57df0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:26:28.745 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T17:26:28.370+0000 7f84e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:26:28.745 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T17:26:28.370+0000 7f84e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:26:28.745 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T17:26:28.370+0000 7f84e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:26:28.745 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T17:26:28.370+0000 7f84e7f2c800 10 monclient(hunting): _renew_subs 2024-09-12T17:26:28.746 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T17:26:28.370+0000 7f84e7f2c800 10 monclient(hunting): authenticate will time out at 2399.720238s 2024-09-12T17:26:28.746 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T17:26:28.370+0000 7f84e3b61640 10 monclient(hunting): get_auth_request con 0x55bf75dc4a90 auth_method 0 2024-09-12T17:26:28.746 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T17:26:28.370+0000 7f84e3b61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:26:28.746 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T17:26:28.370+0000 7f84e3b61640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:26:28.746 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T17:26:28.370+0000 7f84e3b61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:26:28.746 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T17:26:28.370+0000 7f84e3360640 10 monclient(hunting): get_auth_request con 0x55bf75dc8000 auth_method 0 2024-09-12T17:26:28.746 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T17:26:28.370+0000 7f84e3360640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:26:28.746 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T17:26:28.370+0000 7f84e3360640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:26:28.746 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T17:26:28.370+0000 7f84e3360640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:26:28.746 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T17:26:28.370+0000 7f84e3360640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:26:28.746 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T17:26:28.370+0000 7f84e3360640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:26:28.747 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T17:26:28.370+0000 7f84e3360640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:26:28.747 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T17:26:28.370+0000 7f84e3b61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:26:28.747 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T17:26:28.370+0000 7f84e3b61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:26:28.747 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T17:26:28.370+0000 7f84e3b61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:26:28.747 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T17:26:28.370+0000 7f84e4362640 10 monclient(hunting): get_auth_request con 0x55bf75e57df0 auth_method 0 2024-09-12T17:26:28.747 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T17:26:28.370+0000 7f84e4362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:26:28.747 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T17:26:28.370+0000 7f84e4362640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:26:28.747 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T17:26:28.370+0000 7f84e4362640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:26:28.747 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T17:26:28.370+0000 7f84e3360640 10 monclient(hunting): handle_auth_done global_id 7566 payload 824 2024-09-12T17:26:28.747 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T17:26:28.370+0000 7f84e3360640 10 monclient: _finish_hunting 0 2024-09-12T17:26:28.748 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T17:26:28.370+0000 7f84e3360640 1 monclient: found mon.noname-a 2024-09-12T17:26:28.748 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T17:26:28.370+0000 7f84e3360640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:26:28.748 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T17:26:28.371+0000 7f83cbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:26:28.748 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T17:26:28.371+0000 7f83cbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:26:28.748 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T17:26:28.371+0000 7f83cbfff640 10 monclient: dump: 2024-09-12T17:26:28.748 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:26:28.748 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:26:28.748 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.748 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.748 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:26:28.748 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:26:28.748 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:26:28.749 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:26:28.749 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:26:28.749 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.749 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T17:26:28.371+0000 7f83cbfff640 10 monclient: _finish_auth 0 2024-09-12T17:26:28.749 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T17:26:28.371+0000 7f83cbfff640 10 monclient: _check_auth_tickets 2024-09-12T17:26:28.749 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T17:26:28.371+0000 7f83cbfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:26:28.749 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T17:26:28.371+0000 7f83cbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:26:28.749 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T17:26:28.371+0000 7f83cbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:26:28.749 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T17:26:28.371+0000 7f83cbfff640 10 monclient: dump: 2024-09-12T17:26:28.749 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:26:28.750 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:26:28.750 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.750 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.750 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:26:28.750 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:26:28.750 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:26:28.750 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:26:28.750 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:26:28.750 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.750 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T17:26:28.371+0000 7f84e7f2c800 5 monclient: authenticate success, global_id 7566 2024-09-12T17:26:28.750 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T17:26:28.371+0000 7f84e7f2c800 10 monclient: _renew_subs 2024-09-12T17:26:28.750 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T17:26:28.371+0000 7f84e7f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:26:28.751 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T17:26:28.371+0000 7f84e7f2c800 10 monclient: _renew_subs 2024-09-12T17:26:28.751 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T17:26:28.371+0000 7f84e7f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:26:28.751 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T17:26:28.371+0000 7f84e7f2c800 1 librados: init done 2024-09-12T17:26:28.751 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T17:26:28.371+0000 7f83d1e0b640 4 set_mon_vals no callback set 2024-09-12T17:26:28.751 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T17:26:28.373+0000 7f83cbfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:26:28.751 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T17:26:28.373+0000 7f83cbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:26:28.751 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T17:26:28.373+0000 7f83cbfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:26:28.751 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T17:26:28.373+0000 7f84e3b61640 10 monclient: get_auth_request con 0x7f83cc0764c0 auth_method 0 2024-09-12T17:26:28.751 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T17:26:28.374+0000 7f84e4362640 10 monclient: get_auth_request con 0x55bf75f573a0 auth_method 0 2024-09-12T17:26:28.751 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T17:26:28.374+0000 7f84e3b61640 10 monclient: get_auth_request con 0x55bf75f5a580 auth_method 0 2024-09-12T17:26:28.751 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T17:26:28.375+0000 7f84e3360640 10 monclient: get_auth_request con 0x55bf75f5e770 auth_method 0 2024-09-12T17:26:28.752 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 10 monclient: build_initial_monmap 2024-09-12T17:26:28.752 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 1 build_initial for_mkfs: 0 2024-09-12T17:26:28.752 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 10 monclient: monmap: 2024-09-12T17:26:28.752 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:26:28.752 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:26:28.752 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:26:28.752 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:26:28.752 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:26:28.752 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:26:28.752 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:26:28.753 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:26:28.753 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:26:28.753 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.753 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding auth protocol: cephx 2024-09-12T17:26:28.753 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding auth protocol: cephx 2024-09-12T17:26:28.753 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding auth protocol: cephx 2024-09-12T17:26:28.753 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding con mode: secure 2024-09-12T17:26:28.753 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding con mode: crc 2024-09-12T17:26:28.753 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding con mode: secure 2024-09-12T17:26:28.753 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding con mode: crc 2024-09-12T17:26:28.753 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding con mode: secure 2024-09-12T17:26:28.754 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding con mode: crc 2024-09-12T17:26:28.754 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding con mode: crc 2024-09-12T17:26:28.754 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding con mode: secure 2024-09-12T17:26:28.754 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding con mode: crc 2024-09-12T17:26:28.754 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding con mode: secure 2024-09-12T17:26:28.754 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding con mode: crc 2024-09-12T17:26:28.754 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f63400) adding con mode: secure 2024-09-12T17:26:28.754 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:26:28.754 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command objecter_requests cmddesc objecter_requests hook 0x55bf75f66d60 EEXIST 2024-09-12T17:26:28.754 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 10 monclient: init 2024-09-12T17:26:28.755 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding auth protocol: cephx 2024-09-12T17:26:28.755 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding auth protocol: cephx 2024-09-12T17:26:28.755 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding auth protocol: cephx 2024-09-12T17:26:28.755 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding con mode: secure 2024-09-12T17:26:28.755 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding con mode: crc 2024-09-12T17:26:28.755 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding con mode: secure 2024-09-12T17:26:28.755 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding con mode: crc 2024-09-12T17:26:28.755 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding con mode: secure 2024-09-12T17:26:28.755 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding con mode: crc 2024-09-12T17:26:28.755 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding con mode: crc 2024-09-12T17:26:28.756 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding con mode: secure 2024-09-12T17:26:28.756 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding con mode: crc 2024-09-12T17:26:28.756 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding con mode: secure 2024-09-12T17:26:28.756 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding con mode: crc 2024-09-12T17:26:28.756 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T17:26:28.377+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75f61b18) adding con mode: secure 2024-09-12T17:26:28.756 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T17:26:28.378+0000 7f84e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:26:28.756 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T17:26:28.378+0000 7f84e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:26:28.756 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T17:26:28.378+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command rotate-key cmddesc rotate-key hook 0x55bf75f61c60 EEXIST 2024-09-12T17:26:28.756 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T17:26:28.378+0000 7f84e7f2c800 10 monclient: _reopen_session rank -1 2024-09-12T17:26:28.756 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T17:26:28.378+0000 7f84e7f2c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:26:28.757 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T17:26:28.378+0000 7f84e7f2c800 10 monclient(hunting): picked mon.noname-b con 0x55bf75f8aa50 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:26:28.757 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T17:26:28.378+0000 7f84e7f2c800 10 monclient(hunting): picked mon.noname-a con 0x55bf75f8cd20 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:26:28.757 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T17:26:28.378+0000 7f84e7f2c800 10 monclient(hunting): picked mon.noname-c con 0x55bf75f89220 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:26:28.757 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T17:26:28.378+0000 7f84e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:26:28.757 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T17:26:28.378+0000 7f84e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:26:28.757 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T17:26:28.378+0000 7f84e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:26:28.757 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T17:26:28.378+0000 7f84e7f2c800 10 monclient(hunting): _renew_subs 2024-09-12T17:26:28.757 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T17:26:28.378+0000 7f84e7f2c800 10 monclient(hunting): authenticate will time out at 2399.728450s 2024-09-12T17:26:28.757 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T17:26:28.378+0000 7f84e3360640 10 monclient(hunting): get_auth_request con 0x55bf75f8cd20 auth_method 0 2024-09-12T17:26:28.757 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T17:26:28.378+0000 7f84e3360640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:26:28.757 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T17:26:28.378+0000 7f84e3360640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:26:28.758 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T17:26:28.378+0000 7f84e3360640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:26:28.758 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T17:26:28.378+0000 7f84e3b61640 10 monclient(hunting): get_auth_request con 0x55bf75f8aa50 auth_method 0 2024-09-12T17:26:28.758 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T17:26:28.378+0000 7f84e3b61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:26:28.758 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T17:26:28.378+0000 7f84e3b61640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:26:28.758 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T17:26:28.378+0000 7f84e3b61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:26:28.758 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T17:26:28.378+0000 7f84e4362640 10 monclient(hunting): get_auth_request con 0x55bf75f89220 auth_method 0 2024-09-12T17:26:28.758 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T17:26:28.378+0000 7f84e4362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:26:28.758 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T17:26:28.378+0000 7f84e4362640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:26:28.758 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T17:26:28.378+0000 7f84e4362640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:26:28.758 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T17:26:28.378+0000 7f84e3360640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:26:28.758 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T17:26:28.378+0000 7f84e3360640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:26:28.758 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T17:26:28.378+0000 7f84e3360640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:26:28.758 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T17:26:28.378+0000 7f84e4362640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:26:28.759 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T17:26:28.378+0000 7f84e4362640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:26:28.759 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T17:26:28.378+0000 7f84e4362640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:26:28.759 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T17:26:28.378+0000 7f84e3b61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:26:28.759 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T17:26:28.378+0000 7f84e3b61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:26:28.759 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T17:26:28.378+0000 7f84e3b61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:26:28.759 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T17:26:28.378+0000 7f84e3360640 10 monclient(hunting): handle_auth_done global_id 7569 payload 824 2024-09-12T17:26:28.759 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T17:26:28.378+0000 7f84e3360640 10 monclient: _finish_hunting 0 2024-09-12T17:26:28.759 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T17:26:28.378+0000 7f84e3360640 1 monclient: found mon.noname-a 2024-09-12T17:26:28.759 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T17:26:28.378+0000 7f84e3360640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:26:28.759 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T17:26:28.379+0000 7f83c97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:26:28.759 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T17:26:28.379+0000 7f83c97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:26:28.760 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T17:26:28.379+0000 7f83c97fa640 10 monclient: dump: 2024-09-12T17:26:28.760 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:26:28.760 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:26:28.760 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.760 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.760 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:26:28.760 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:26:28.760 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:26:28.760 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:26:28.760 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:26:28.760 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.760 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T17:26:28.379+0000 7f83c97fa640 10 monclient: _finish_auth 0 2024-09-12T17:26:28.761 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T17:26:28.379+0000 7f83c97fa640 10 monclient: _check_auth_tickets 2024-09-12T17:26:28.761 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T17:26:28.379+0000 7f83c97fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:26:28.761 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T17:26:28.379+0000 7f83c97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:26:28.761 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T17:26:28.379+0000 7f83c97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:26:28.761 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T17:26:28.379+0000 7f83c97fa640 10 monclient: dump: 2024-09-12T17:26:28.761 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:26:28.761 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:26:28.761 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.761 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.761 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:26:28.761 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:26:28.762 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:26:28.762 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:26:28.762 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:26:28.762 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.762 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T17:26:28.379+0000 7f84e7f2c800 5 monclient: authenticate success, global_id 7569 2024-09-12T17:26:28.762 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T17:26:28.379+0000 7f84e7f2c800 10 monclient: _renew_subs 2024-09-12T17:26:28.762 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T17:26:28.379+0000 7f84e4b63640 4 set_mon_vals no callback set 2024-09-12T17:26:28.762 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T17:26:28.379+0000 7f84e7f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:26:28.762 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T17:26:28.379+0000 7f84e7f2c800 10 monclient: _renew_subs 2024-09-12T17:26:28.762 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T17:26:28.379+0000 7f84e7f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:26:28.763 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T17:26:28.380+0000 7f83c97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:26:28.763 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T17:26:28.380+0000 7f83c97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:26:28.763 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T17:26:28.380+0000 7f83c97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:26:28.763 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T17:26:28.381+0000 7f84e3b61640 10 monclient: get_auth_request con 0x7f83bc076380 auth_method 0 2024-09-12T17:26:28.763 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 10 monclient: get_monmap_and_config 2024-09-12T17:26:28.763 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 10 monclient: build_initial_monmap 2024-09-12T17:26:28.763 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 1 build_initial for_mkfs: 0 2024-09-12T17:26:28.763 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 10 monclient: monmap: 2024-09-12T17:26:28.763 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:26:28.763 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:26:28.763 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:26:28.764 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:26:28.764 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:26:28.764 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:26:28.764 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:26:28.764 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:26:28.764 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:26:28.764 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.764 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding auth protocol: cephx 2024-09-12T17:26:28.764 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding auth protocol: cephx 2024-09-12T17:26:28.764 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding auth protocol: cephx 2024-09-12T17:26:28.764 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding con mode: secure 2024-09-12T17:26:28.765 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding con mode: crc 2024-09-12T17:26:28.765 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding con mode: secure 2024-09-12T17:26:28.765 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding con mode: crc 2024-09-12T17:26:28.765 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding con mode: secure 2024-09-12T17:26:28.765 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding con mode: crc 2024-09-12T17:26:28.765 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding con mode: crc 2024-09-12T17:26:28.765 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding con mode: secure 2024-09-12T17:26:28.765 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding con mode: crc 2024-09-12T17:26:28.765 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding con mode: secure 2024-09-12T17:26:28.765 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding con mode: crc 2024-09-12T17:26:28.765 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75faa970) adding con mode: secure 2024-09-12T17:26:28.766 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:26:28.766 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 10 monclient: init 2024-09-12T17:26:28.766 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding auth protocol: cephx 2024-09-12T17:26:28.766 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding auth protocol: cephx 2024-09-12T17:26:28.766 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding auth protocol: cephx 2024-09-12T17:26:28.766 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding con mode: secure 2024-09-12T17:26:28.766 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding con mode: crc 2024-09-12T17:26:28.766 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding con mode: secure 2024-09-12T17:26:28.766 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding con mode: crc 2024-09-12T17:26:28.766 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding con mode: secure 2024-09-12T17:26:28.766 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding con mode: crc 2024-09-12T17:26:28.767 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding con mode: crc 2024-09-12T17:26:28.767 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding con mode: secure 2024-09-12T17:26:28.767 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding con mode: crc 2024-09-12T17:26:28.767 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding con mode: secure 2024-09-12T17:26:28.767 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding con mode: crc 2024-09-12T17:26:28.767 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234770) adding con mode: secure 2024-09-12T17:26:28.767 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T17:26:28.381+0000 7f84e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:26:28.767 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:26:28.767 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command rotate-key cmddesc rotate-key hook 0x7fff182348b8 EEXIST 2024-09-12T17:26:28.767 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 10 monclient: _reopen_session rank -1 2024-09-12T17:26:28.767 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:26:28.767 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 10 monclient(hunting): picked mon.noname-c con 0x55bf75fdef70 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:26:28.768 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 10 monclient(hunting): picked mon.noname-a con 0x55bf75fcf8c0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:26:28.768 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 10 monclient(hunting): picked mon.noname-b con 0x55bf75fda3a0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:26:28.768 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:26:28.768 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:26:28.768 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:26:28.768 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 10 monclient(hunting): _renew_subs 2024-09-12T17:26:28.768 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 10 monclient(hunting): authenticate will time out at 2399.732250s 2024-09-12T17:26:28.768 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T17:26:28.382+0000 7f84e3b61640 10 monclient(hunting): get_auth_request con 0x55bf75fdef70 auth_method 0 2024-09-12T17:26:28.768 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T17:26:28.382+0000 7f84e3b61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:26:28.768 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T17:26:28.382+0000 7f84e3b61640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:26:28.768 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T17:26:28.382+0000 7f84e3b61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:26:28.769 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T17:26:28.382+0000 7f84e3360640 10 monclient(hunting): get_auth_request con 0x55bf75fcf8c0 auth_method 0 2024-09-12T17:26:28.769 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T17:26:28.382+0000 7f84e3360640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:26:28.769 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T17:26:28.382+0000 7f84e3360640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:26:28.769 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T17:26:28.382+0000 7f84e3360640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:26:28.769 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T17:26:28.382+0000 7f84e3360640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:26:28.769 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T17:26:28.382+0000 7f84e3360640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:26:28.769 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T17:26:28.382+0000 7f84e3360640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:26:28.769 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T17:26:28.382+0000 7f84e3b61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:26:28.769 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T17:26:28.382+0000 7f84e3b61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:26:28.769 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T17:26:28.382+0000 7f84e3b61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:26:28.769 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T17:26:28.382+0000 7f84e4362640 10 monclient(hunting): get_auth_request con 0x55bf75fda3a0 auth_method 0 2024-09-12T17:26:28.770 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T17:26:28.382+0000 7f84e4362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:26:28.770 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T17:26:28.382+0000 7f84e4362640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:26:28.770 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T17:26:28.382+0000 7f84e4362640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:26:28.770 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T17:26:28.382+0000 7f84e3360640 10 monclient(hunting): handle_auth_done global_id 7572 payload 274 2024-09-12T17:26:28.770 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T17:26:28.382+0000 7f84e3360640 10 monclient: _finish_hunting 0 2024-09-12T17:26:28.770 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T17:26:28.382+0000 7f84e3360640 1 monclient: found mon.noname-a 2024-09-12T17:26:28.770 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T17:26:28.382+0000 7f84e3360640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:26:28.770 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T17:26:28.382+0000 7f83c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:26:28.770 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T17:26:28.382+0000 7f83c2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:26:28.770 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T17:26:28.382+0000 7f83c2ffd640 10 monclient: dump: 2024-09-12T17:26:28.770 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:26:28.771 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:26:28.771 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.771 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.771 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:26:28.771 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:26:28.771 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:26:28.771 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:26:28.771 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:26:28.771 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.771 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T17:26:28.382+0000 7f83c2ffd640 10 monclient: _finish_auth 0 2024-09-12T17:26:28.771 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T17:26:28.382+0000 7f83c2ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:26:28.772 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T17:26:28.382+0000 7f83c2ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:26:28.772 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T17:26:28.382+0000 7f83c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:26:28.772 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T17:26:28.382+0000 7f83c2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:26:28.772 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T17:26:28.382+0000 7f83c2ffd640 10 monclient: dump: 2024-09-12T17:26:28.772 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:26:28.772 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:26:28.772 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.772 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.772 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:26:28.772 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:26:28.772 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:26:28.773 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:26:28.773 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:26:28.773 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.773 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 5 monclient: authenticate success, global_id 7572 2024-09-12T17:26:28.773 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 10 monclient: get_monmap_and_config success 2024-09-12T17:26:28.773 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T17:26:28.382+0000 7f84e7f2c800 4 set_mon_vals no callback set 2024-09-12T17:26:28.773 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 10 monclient: shutdown 2024-09-12T17:26:28.773 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 10 monclient: build_initial_monmap 2024-09-12T17:26:28.773 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 1 build_initial for_mkfs: 0 2024-09-12T17:26:28.773 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 10 monclient: monmap: 2024-09-12T17:26:28.773 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:26:28.774 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:26:28.774 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:26:28.774 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:26:28.774 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:26:28.774 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:26:28.774 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:26:28.774 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:26:28.774 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:26:28.774 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.774 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding auth protocol: cephx 2024-09-12T17:26:28.774 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding auth protocol: cephx 2024-09-12T17:26:28.775 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding auth protocol: cephx 2024-09-12T17:26:28.775 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding con mode: secure 2024-09-12T17:26:28.775 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding con mode: crc 2024-09-12T17:26:28.775 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding con mode: secure 2024-09-12T17:26:28.775 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding con mode: crc 2024-09-12T17:26:28.775 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding con mode: secure 2024-09-12T17:26:28.775 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding con mode: crc 2024-09-12T17:26:28.775 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding con mode: crc 2024-09-12T17:26:28.775 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding con mode: secure 2024-09-12T17:26:28.775 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding con mode: crc 2024-09-12T17:26:28.775 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding con mode: secure 2024-09-12T17:26:28.776 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding con mode: crc 2024-09-12T17:26:28.776 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fae4d0) adding con mode: secure 2024-09-12T17:26:28.776 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:26:28.776 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 1 librados: starting msgr at 2024-09-12T17:26:28.776 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 1 librados: starting objecter 2024-09-12T17:26:28.776 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T17:26:28.383+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command objecter_requests cmddesc objecter_requests hook 0x55bf75f8cc50 EEXIST 2024-09-12T17:26:28.776 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 1 librados: setting wanted keys 2024-09-12T17:26:28.776 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 1 librados: calling monclient init 2024-09-12T17:26:28.776 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 10 monclient: init 2024-09-12T17:26:28.776 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding auth protocol: cephx 2024-09-12T17:26:28.776 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding auth protocol: cephx 2024-09-12T17:26:28.777 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding auth protocol: cephx 2024-09-12T17:26:28.777 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding con mode: secure 2024-09-12T17:26:28.777 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding con mode: crc 2024-09-12T17:26:28.777 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding con mode: secure 2024-09-12T17:26:28.777 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding con mode: crc 2024-09-12T17:26:28.777 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding con mode: secure 2024-09-12T17:26:28.777 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding con mode: crc 2024-09-12T17:26:28.777 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding con mode: crc 2024-09-12T17:26:28.777 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding con mode: secure 2024-09-12T17:26:28.777 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding con mode: crc 2024-09-12T17:26:28.777 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding con mode: secure 2024-09-12T17:26:28.777 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding con mode: crc 2024-09-12T17:26:28.778 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 AuthRegistry(0x55bf75fa2800) adding con mode: secure 2024-09-12T17:26:28.778 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:26:28.778 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:26:28.778 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command rotate-key cmddesc rotate-key hook 0x55bf75fa2948 EEXIST 2024-09-12T17:26:28.778 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 10 monclient: _reopen_session rank -1 2024-09-12T17:26:28.778 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:26:28.778 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 10 monclient(hunting): picked mon.noname-c con 0x55bf75fcf8c0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:26:28.778 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 10 monclient(hunting): picked mon.noname-a con 0x55bf75fda3a0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:26:28.778 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 10 monclient(hunting): picked mon.noname-b con 0x55bf75fdef70 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:26:28.778 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:26:28.778 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:26:28.779 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:26:28.779 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 10 monclient(hunting): _renew_subs 2024-09-12T17:26:28.779 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T17:26:28.384+0000 7f84e7f2c800 10 monclient(hunting): authenticate will time out at 2399.734654s 2024-09-12T17:26:28.779 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T17:26:28.384+0000 7f84e3360640 10 monclient(hunting): get_auth_request con 0x55bf75fda3a0 auth_method 0 2024-09-12T17:26:28.779 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T17:26:28.384+0000 7f84e3360640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:26:28.779 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T17:26:28.384+0000 7f84e3360640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:26:28.779 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T17:26:28.384+0000 7f84e3360640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:26:28.779 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T17:26:28.384+0000 7f84e3b61640 10 monclient(hunting): get_auth_request con 0x55bf75fcf8c0 auth_method 0 2024-09-12T17:26:28.779 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T17:26:28.384+0000 7f84e3b61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:26:28.779 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T17:26:28.384+0000 7f84e3b61640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:26:28.779 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T17:26:28.384+0000 7f84e3b61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:26:28.780 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T17:26:28.384+0000 7f84e3360640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:26:28.780 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T17:26:28.384+0000 7f84e3360640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:26:28.780 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T17:26:28.384+0000 7f84e3360640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:26:28.780 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T17:26:28.384+0000 7f84e3b61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:26:28.780 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T17:26:28.384+0000 7f84e3b61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:26:28.780 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T17:26:28.384+0000 7f84e3b61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:26:28.780 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T17:26:28.384+0000 7f84e4362640 10 monclient(hunting): get_auth_request con 0x55bf75fdef70 auth_method 0 2024-09-12T17:26:28.780 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T17:26:28.384+0000 7f84e4362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:26:28.780 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T17:26:28.384+0000 7f84e4362640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:26:28.780 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T17:26:28.384+0000 7f84e4362640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:26:28.780 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T17:26:28.384+0000 7f84e3360640 10 monclient(hunting): handle_auth_done global_id 7575 payload 824 2024-09-12T17:26:28.781 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T17:26:28.384+0000 7f84e3360640 10 monclient: _finish_hunting 0 2024-09-12T17:26:28.781 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T17:26:28.384+0000 7f84e3360640 1 monclient: found mon.noname-a 2024-09-12T17:26:28.781 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T17:26:28.384+0000 7f84e3360640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:26:28.781 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T17:26:28.385+0000 7f83c17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:26:28.781 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T17:26:28.385+0000 7f83c17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:26:28.781 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T17:26:28.385+0000 7f83c17fa640 10 monclient: dump: 2024-09-12T17:26:28.781 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:26:28.781 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:26:28.781 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.781 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.781 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:26:28.782 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:26:28.782 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:26:28.782 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:26:28.782 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:26:28.782 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.782 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T17:26:28.385+0000 7f83c17fa640 10 monclient: _finish_auth 0 2024-09-12T17:26:28.782 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T17:26:28.385+0000 7f83c17fa640 10 monclient: _check_auth_tickets 2024-09-12T17:26:28.782 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T17:26:28.385+0000 7f83c17fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:26:28.782 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T17:26:28.385+0000 7f83c17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:26:28.782 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T17:26:28.385+0000 7f83c17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:26:28.782 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T17:26:28.385+0000 7f83c17fa640 10 monclient: dump: 2024-09-12T17:26:28.783 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:26:28.783 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:26:28.783 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.783 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:26:28.783 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:26:28.783 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:26:28.783 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:26:28.783 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:26:28.783 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:26:28.783 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.783 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T17:26:28.385+0000 7f84e7f2c800 5 monclient: authenticate success, global_id 7575 2024-09-12T17:26:28.784 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T17:26:28.385+0000 7f83c2ffd640 4 set_mon_vals no callback set 2024-09-12T17:26:28.784 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T17:26:28.385+0000 7f84e7f2c800 10 monclient: _renew_subs 2024-09-12T17:26:28.784 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T17:26:28.385+0000 7f84e7f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:26:28.784 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T17:26:28.385+0000 7f84e7f2c800 10 monclient: _renew_subs 2024-09-12T17:26:28.784 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T17:26:28.385+0000 7f84e7f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:26:28.784 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T17:26:28.385+0000 7f84e7f2c800 1 librados: init done 2024-09-12T17:26:28.784 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T17:26:28.385+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command cr dump hook 0x55bf75fd93b8 2024-09-12T17:26:28.784 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T17:26:28.386+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.784 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T17:26:28.387+0000 7f83c17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:26:28.784 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T17:26:28.387+0000 7f83c17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:26:28.784 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T17:26:28.387+0000 7f83c17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:26:28.785 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T17:26:28.387+0000 7f84e3b61640 10 monclient: get_auth_request con 0x7f83ac076470 auth_method 0 2024-09-12T17:26:28.785 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T17:26:28.387+0000 7f84e4362640 10 monclient: get_auth_request con 0x55bf75ff8770 auth_method 0 2024-09-12T17:26:28.785 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T17:26:28.388+0000 7f84e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.785 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T17:26:28.388+0000 7f84e7f2c800 20 realm 2024-09-12T17:26:28.785 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T17:26:28.388+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.785 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T17:26:28.388+0000 7f84e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.785 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T17:26:28.388+0000 7f84e7f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:28.785 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T17:26:28.388+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.785 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T17:26:28.388+0000 7f84e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.785 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T17:26:28.388+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.786 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T17:26:28.389+0000 7f84e3b61640 10 monclient: get_auth_request con 0x55bf75ffc940 auth_method 0 2024-09-12T17:26:28.786 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T17:26:28.389+0000 7f84e7f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:28.786 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T17:26:28.389+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.786 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T17:26:28.389+0000 7f84e3360640 10 monclient: get_auth_request con 0x55bf760001a0 auth_method 0 2024-09-12T17:26:28.786 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T17:26:28.390+0000 7f84e7f2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:28.786 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T17:26:28.390+0000 7f84e7f2c800 20 searching for the correct realm 2024-09-12T17:26:28.786 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T17:26:28.390+0000 7f84e4362640 10 monclient: get_auth_request con 0x55bf76004f60 auth_method 0 2024-09-12T17:26:28.786 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T17:26:28.391+0000 7f84e3b61640 10 monclient: get_auth_request con 0x7f84dc070920 auth_method 0 2024-09-12T17:26:28.786 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T17:26:28.392+0000 7f84e3360640 10 monclient: get_auth_request con 0x7f84d4049040 auth_method 0 2024-09-12T17:26:28.786 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T17:26:28.393+0000 7f84e3b61640 0 -- 172.21.15.67:0/348757332 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f84dc070920 msgr2=0x7f84dc055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:28.786 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T17:26:28.393+0000 7f83c17fa640 1 client.7575.objecter ms_handle_reset 0x7f84dc070920 session 0x7f84dc064120 osd.7 2024-09-12T17:26:28.787 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T17:26:28.393+0000 7f83c17fa640 10 monclient: _renew_subs 2024-09-12T17:26:28.787 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T17:26:28.393+0000 7f83c17fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:26:28.787 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T17:26:28.393+0000 7f84e3b61640 10 monclient: get_auth_request con 0x7f83ac086290 auth_method 0 2024-09-12T17:26:28.787 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T17:26:28.394+0000 7f84e4362640 10 monclient: get_auth_request con 0x7f84d8077020 auth_method 0 2024-09-12T17:26:28.787 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T17:26:28.396+0000 7f84e3b61640 10 monclient: get_auth_request con 0x7f84d80642e0 auth_method 0 2024-09-12T17:26:28.787 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T17:26:28.396+0000 7f84e3b61640 0 -- 172.21.15.67:0/348757332 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f84d80642e0 msgr2=0x7f84d80a2a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:26:28.787 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T17:26:28.597+0000 7f84e3b61640 10 monclient: get_auth_request con 0x7f84d80642e0 auth_method 0 2024-09-12T17:26:28.787 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T17:26:28.602+0000 7f84e7f2c800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:26:28.787 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T17:26:28.602+0000 7f84e7f2c800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:26:28.787 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T17:26:28.602+0000 7f84e7f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:28.787 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T17:26:28.602+0000 7f84e7f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:28.788 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T17:26:28.602+0000 7f84e7f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:28.788 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T17:26:28.602+0000 7f84e7f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:28.788 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T17:26:28.602+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.788 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T17:26:28.603+0000 7f84e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.788 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T17:26:28.603+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.788 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T17:26:28.603+0000 7f84e7f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:28.788 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T17:26:28.603+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.788 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T17:26:28.603+0000 7f84e7f2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:28.788 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T17:26:28.603+0000 7f84e7f2c800 20 zone default found 2024-09-12T17:26:28.788 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T17:26:28.603+0000 7f84e7f2c800 4 Realm: () 2024-09-12T17:26:28.788 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T17:26:28.603+0000 7f84e7f2c800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:26:28.789 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T17:26:28.603+0000 7f84e7f2c800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:26:28.789 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T17:26:28.603+0000 7f84e7f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:28.789 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T17:26:28.603+0000 7f84e7f2c800 20 zonegroup default 2024-09-12T17:26:28.789 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T17:26:28.603+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.789 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T17:26:28.604+0000 7f84e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.789 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T17:26:28.604+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.789 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T17:26:28.604+0000 7f84e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.789 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T17:26:28.604+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.789 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T17:26:28.604+0000 7f84e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.789 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T17:26:28.604+0000 7f84e7f2c800 20 started sync module instance, tier type = 2024-09-12T17:26:28.789 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T17:26:28.604+0000 7f84e7f2c800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:26:28.790 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T17:26:28.614+0000 7f84e7f2c800 20 add_watcher() i=0 2024-09-12T17:26:28.790 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T17:26:28.614+0000 7f84e7f2c800 20 add_watcher() i=1 2024-09-12T17:26:28.790 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T17:26:28.614+0000 7f84e7f2c800 20 add_watcher() i=2 2024-09-12T17:26:28.790 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T17:26:28.614+0000 7f84e7f2c800 20 add_watcher() i=3 2024-09-12T17:26:28.790 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T17:26:28.614+0000 7f84e7f2c800 20 add_watcher() i=4 2024-09-12T17:26:28.790 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T17:26:28.614+0000 7f84e7f2c800 20 add_watcher() i=5 2024-09-12T17:26:28.790 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T17:26:28.614+0000 7f84e7f2c800 20 add_watcher() i=6 2024-09-12T17:26:28.790 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T17:26:28.615+0000 7f84e7f2c800 20 add_watcher() i=7 2024-09-12T17:26:28.790 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T17:26:28.615+0000 7f84e7f2c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:28.790 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding auth protocol: cephx 2024-09-12T17:26:28.790 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding auth protocol: cephx 2024-09-12T17:26:28.790 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding auth protocol: cephx 2024-09-12T17:26:28.791 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding con mode: secure 2024-09-12T17:26:28.791 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding con mode: crc 2024-09-12T17:26:28.791 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding con mode: secure 2024-09-12T17:26:28.791 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding con mode: crc 2024-09-12T17:26:28.791 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding con mode: secure 2024-09-12T17:26:28.791 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding con mode: crc 2024-09-12T17:26:28.791 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding con mode: crc 2024-09-12T17:26:28.791 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding con mode: secure 2024-09-12T17:26:28.791 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding con mode: crc 2024-09-12T17:26:28.791 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T17:26:28.617+0000 7f839a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:28.791 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding con mode: secure 2024-09-12T17:26:28.791 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding con mode: crc 2024-09-12T17:26:28.792 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 AuthRegistry(0x7fff18234c40) adding con mode: secure 2024-09-12T17:26:28.792 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:26:28.792 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:28.792 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:28.792 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command cache list hook 0x55bf75fed140 2024-09-12T17:26:28.792 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command cache inspect hook 0x55bf75fed140 2024-09-12T17:26:28.792 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command cache erase hook 0x55bf75fed140 2024-09-12T17:26:28.792 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command cache zap hook 0x55bf75fed140 2024-09-12T17:26:28.792 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 note: GC not initialized 2024-09-12T17:26:28.792 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T17:26:28.617+0000 7f83997e2640 20 reqs_thread_entry: start 2024-09-12T17:26:28.792 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command sync trace show hook 0x7f84d40043a0 2024-09-12T17:26:28.793 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command sync trace history hook 0x7f84d40043a0 2024-09-12T17:26:28.793 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command sync trace active hook 0x7f84d40043a0 2024-09-12T17:26:28.793 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 5 asok(0x55bf75cea730) register_command sync trace active_short hook 0x7f84d40043a0 2024-09-12T17:26:28.793 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T17:26:28.617+0000 7f84e7f2c800 20 init_complete bucket index max shards: 1 2024-09-12T17:26:28.793 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T17:26:28.618+0000 7f84e7f2c800 20 Filter name: none 2024-09-12T17:26:28.793 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T17:26:28.618+0000 7f83927fc640 20 reqs_thread_entry: start 2024-09-12T17:26:28.793 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T17:26:28.618+0000 7f84e7f2c800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:26:28.793 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T17:26:28.618+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.793 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T17:26:28.618+0000 7f84e7f2c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:26:28.793 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T17:26:28.618+0000 7f84e7f2c800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:26:28.793 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T17:26:28.618+0000 7f84e7f2c800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:26:28.793 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T17:26:28.618+0000 7f84e7f2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 : miss 2024-09-12T17:26:28.794 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T17:26:28.618+0000 7f84e7f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.794 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T17:26:28.619+0000 7f84e7f2c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:26:28.794 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T17:26:28.619+0000 7f84e7f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 info.flags=0x17 2024-09-12T17:26:28.794 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T17:26:28.619+0000 7f84e7f2c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 to cache LRU end 2024-09-12T17:26:28.794 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T17:26:28.619+0000 7f84e7f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:26:28.794 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T17:26:28.619+0000 7f84e7f2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:28.794 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T17:26:28.619+0000 7f84e7f2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 2024-09-12T17:26:28.794 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T17:26:28.623+0000 7f84e7f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 info.flags=0x17 2024-09-12T17:26:28.794 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T17:26:28.623+0000 7f84e7f2c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 to cache LRU end 2024-09-12T17:26:28.794 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T17:26:28.623+0000 7f84e7f2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:28.794 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T17:26:28.623+0000 7f84e7f2c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35, ofs0, ns] 2024-09-12T17:26:28.795 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T17:26:28.623+0000 7f83c2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464354 cookie 94280806881904 notifier 7575 bl.length()=995 2024-09-12T17:26:28.795 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T17:26:28.624+0000 7f83c2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 info.flags=0x17 2024-09-12T17:26:28.795 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T17:26:28.624+0000 7f83c2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 to cache LRU end 2024-09-12T17:26:28.795 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T17:26:28.624+0000 7f83c2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:28.795 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T17:26:28.625+0000 7f84e7f2c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.35]): orig_sources= new_sources= 2024-09-12T17:26:28.795 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T17:26:28.625+0000 7f84e7f2c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.35]): potential sources added=[] removed=[] 2024-09-12T17:26:28.795 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T17:26:28.625+0000 7f84e7f2c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.35]): orig_dests= new_dests= 2024-09-12T17:26:28.795 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T17:26:28.625+0000 7f84e7f2c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.35]): potential dests added=[] removed=[] 2024-09-12T17:26:28.795 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T17:26:28.628+0000 7f84e7f2c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f84e7f2c800 time 2024-09-12T17:26:28.628955+0000 2024-09-12T17:26:28.795 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:26:28.795 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.795 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:26:28.796 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f84e958c71a] 2024-09-12T17:26:28.796 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f84e958c8d8] 2024-09-12T17:26:28.796 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bf74d6b841] 2024-09-12T17:26:28.796 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55bf74d7b57a] 2024-09-12T17:26:28.796 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T17:26:28.796 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f84e8229590] 2024-09-12T17:26:28.796 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T17:26:28.796 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T17:26:28.796 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.796 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T17:26:28.629+0000 7f84e7f2c800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:26:28.796 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f84e7f2c800 thread_name:radosgw-admin 2024-09-12T17:26:28.797 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.797 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:26:28.797 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f84e823e6f0] 2024-09-12T17:26:28.797 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f84e828b99c] 2024-09-12T17:26:28.797 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:26:28.797 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:26:28.797 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f84e958c774] 2024-09-12T17:26:28.797 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f84e958c8d8] 2024-09-12T17:26:28.797 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bf74d6b841] 2024-09-12T17:26:28.797 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55bf74d7b57a] 2024-09-12T17:26:28.797 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T17:26:28.798 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f84e8229590] 2024-09-12T17:26:28.798 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T17:26:28.798 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T17:26:28.798 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:26:28.798 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.798 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T17:26:28.798 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T17:26:28.798 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T17:26:28.798 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T17:26:28.798 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T17:26:28.798 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T17:26:28.798 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T17:26:28.799 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T17:26:28.799 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T17:26:28.799 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T17:26:28.799 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T17:26:28.799 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T17:26:28.799 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T17:26:28.799 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T17:26:28.799 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T17:26:28.799 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T17:26:28.799 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T17:26:28.799 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T17:26:28.800 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T17:26:28.800 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T17:26:28.800 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T17:26:28.800 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T17:26:28.800 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T17:26:28.800 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T17:26:28.800 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:26:28.800 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T17:26:28.800 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T17:26:28.800 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T17:26:28.800 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T17:26:28.800 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T17:26:28.801 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T17:26:28.801 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T17:26:28.801 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T17:26:28.801 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T17:26:28.801 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T17:26:28.801 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T17:26:28.801 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T17:26:28.801 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T17:26:28.801 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T17:26:28.801 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T17:26:28.801 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T17:26:28.801 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T17:26:28.802 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T17:26:28.802 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T17:26:28.802 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T17:26:28.802 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T17:26:28.802 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:26:28.802 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T17:26:28.802 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:26:28.802 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T17:26:28.802 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T17:26:28.802 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T17:26:28.802 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T17:26:28.802 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T17:26:28.803 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T17:26:28.803 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T17:26:28.803 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T17:26:28.803 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T17:26:28.803 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T17:26:28.803 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T17:26:28.803 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T17:26:28.803 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T17:26:28.803 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T17:26:28.803 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T17:26:28.803 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T17:26:28.803 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T17:26:28.804 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T17:26:28.804 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:26:28.804 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T17:26:28.804 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:26:28.804 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T17:26:28.804 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T17:26:28.804 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T17:26:28.804 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T17:26:28.804 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T17:26:28.804 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T17:26:28.804 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:26:28.805 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T17:26:28.805 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T17:26:28.805 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:26:28.805 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T17:26:28.805 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T17:26:28.805 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T17:26:28.805 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T17:26:28.805 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T17:26:28.805 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T17:26:28.805 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T17:26:28.805 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T17:26:28.805 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T17:26:28.806 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T17:26:28.806 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T17:26:28.806 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T17:26:28.806 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T17:26:28.806 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:26:28.806 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83927fc640 / http_manager 2024-09-12T17:26:28.806 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83997e2640 / http_manager 2024-09-12T17:26:28.806 INFO:tasks.workunit.client.0.smithi067.stderr: 7f839a7e4640 / rgw_dt_lg_renew 2024-09-12T17:26:28.806 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83c17fa640 / ms_dispatch 2024-09-12T17:26:28.806 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83c2ffd640 / io_context_pool 2024-09-12T17:26:28.806 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83c97fa640 / ms_dispatch 2024-09-12T17:26:28.807 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83cbfff640 / ms_dispatch 2024-09-12T17:26:28.807 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83d1e0b640 / io_context_pool 2024-09-12T17:26:28.807 INFO:tasks.workunit.client.0.smithi067.stderr: 7f84e3360640 / msgr-worker-2 2024-09-12T17:26:28.807 INFO:tasks.workunit.client.0.smithi067.stderr: 7f84e3b61640 / msgr-worker-1 2024-09-12T17:26:28.807 INFO:tasks.workunit.client.0.smithi067.stderr: 7f84e4362640 / msgr-worker-0 2024-09-12T17:26:28.807 INFO:tasks.workunit.client.0.smithi067.stderr: 7f84e4b63640 / io_context_pool 2024-09-12T17:26:28.807 INFO:tasks.workunit.client.0.smithi067.stderr: 7f84e7f2c800 / radosgw-admin 2024-09-12T17:26:28.807 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T17:26:28.807 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T17:26:28.807 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:26:28.630475Z_cbf0a662-a376-4a12-be7f-aceb61be0871/log 2024-09-12T17:26:28.807 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T17:26:28.808 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:26:28.813 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:28.813 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:28.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.709+0000 7f747873e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.711+0000 7f747873e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.711+0000 7f747873e800 20 realm 2024-09-12T17:26:28.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.711+0000 7f747873e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.711+0000 7f747873e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.711+0000 7f747873e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:28.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.711+0000 7f747873e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.711+0000 7f747873e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.711+0000 7f747873e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.712+0000 7f747873e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:28.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.712+0000 7f747873e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.713+0000 7f747873e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:28.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.713+0000 7f747873e800 20 searching for the correct realm 2024-09-12T17:26:28.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.716+0000 7f7474c87640 0 -- 172.21.15.67:0/1466047403 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x558632fe7950 msgr2=0x558632fe9e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:28.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.720+0000 7f7474486640 0 -- 172.21.15.67:0/1466047403 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f745c027070 msgr2=0x7f745c092150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:28.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.724+0000 7f747873e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:26:28.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.724+0000 7f747873e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:26:28.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.724+0000 7f747873e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:28.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.724+0000 7f747873e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:28.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.724+0000 7f747873e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:28.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.724+0000 7f747873e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:28.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.724+0000 7f747873e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.724+0000 7f747873e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.724+0000 7f747873e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.725+0000 7f747873e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:28.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.725+0000 7f747873e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.725+0000 7f747873e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:28.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.725+0000 7f747873e800 20 zone default found 2024-09-12T17:26:28.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.725+0000 7f747873e800 4 Realm: () 2024-09-12T17:26:28.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.725+0000 7f747873e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:26:28.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.725+0000 7f747873e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:26:28.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.725+0000 7f747873e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:28.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.725+0000 7f747873e800 20 zonegroup default 2024-09-12T17:26:28.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.725+0000 7f747873e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.725+0000 7f747873e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.726+0000 7f747873e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.726+0000 7f747873e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.726+0000 7f747873e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.726+0000 7f747873e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.726+0000 7f747873e800 20 started sync module instance, tier type = 2024-09-12T17:26:28.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.726+0000 7f747873e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:26:28.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.735+0000 7f747873e800 20 add_watcher() i=0 2024-09-12T17:26:28.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.735+0000 7f747873e800 20 add_watcher() i=1 2024-09-12T17:26:28.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.735+0000 7f747873e800 20 add_watcher() i=2 2024-09-12T17:26:28.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.735+0000 7f747873e800 20 add_watcher() i=3 2024-09-12T17:26:28.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.735+0000 7f747873e800 20 add_watcher() i=4 2024-09-12T17:26:28.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.735+0000 7f747873e800 20 add_watcher() i=5 2024-09-12T17:26:28.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.735+0000 7f747873e800 20 add_watcher() i=6 2024-09-12T17:26:28.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.736+0000 7f747873e800 20 add_watcher() i=7 2024-09-12T17:26:28.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.736+0000 7f747873e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:28.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.739+0000 7f732a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:28.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.739+0000 7f747873e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:28.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.739+0000 7f747873e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:28.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.739+0000 7f747873e800 5 note: GC not initialized 2024-09-12T17:26:28.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.739+0000 7f73297e2640 20 reqs_thread_entry: start 2024-09-12T17:26:28.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.739+0000 7f747873e800 20 init_complete bucket index max shards: 1 2024-09-12T17:26:28.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.740+0000 7f747873e800 20 Filter name: none 2024-09-12T17:26:28.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.740+0000 7f729affd640 20 reqs_thread_entry: start 2024-09-12T17:26:28.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.740+0000 7f747873e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.740+0000 7f747873e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:26:28.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.740+0000 7f747873e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.741+0000 7f747873e800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:26:28.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.741+0000 7f747873e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:28.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.741+0000 7f747873e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.741+0000 7f747873e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:26:28.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.741+0000 7f747873e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.742+0000 7f747873e800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:26:28.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.742+0000 7f747873e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:28.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.743+0000 7f732a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:28.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.745+0000 7f747873e800 20 remove_watcher() i=0 2024-09-12T17:26:28.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.745+0000 7f747873e800 2 removed watcher, disabling cache 2024-09-12T17:26:28.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.747+0000 7f747873e800 20 remove_watcher() i=1 2024-09-12T17:26:28.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.748+0000 7f747873e800 20 remove_watcher() i=2 2024-09-12T17:26:28.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.749+0000 7f747873e800 20 remove_watcher() i=3 2024-09-12T17:26:28.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.750+0000 7f747873e800 20 remove_watcher() i=4 2024-09-12T17:26:28.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.751+0000 7f747873e800 20 remove_watcher() i=5 2024-09-12T17:26:28.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.751+0000 7f747873e800 20 remove_watcher() i=6 2024-09-12T17:26:28.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:28.752+0000 7f747873e800 20 remove_watcher() i=7 2024-09-12T17:26:28.821 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.821 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:26:28.821 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-do-reshard id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:26:28.821 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:26:28.821 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:28.821 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:28.821 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:26:28.821 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:26:28.858 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:26:28.891 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:28.891 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:29.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.132+0000 7f8c91696800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.134+0000 7f8c91696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:29.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.134+0000 7f8c91696800 20 realm 2024-09-12T17:26:29.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.134+0000 7f8c91696800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.134+0000 7f8c91696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:29.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.134+0000 7f8c91696800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:29.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.134+0000 7f8c91696800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.135+0000 7f8c91696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:29.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.135+0000 7f8c91696800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.136+0000 7f8c91696800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:29.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.136+0000 7f8c91696800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.136+0000 7f8c91696800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:29.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.136+0000 7f8c91696800 20 searching for the correct realm 2024-09-12T17:26:29.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.139+0000 7f8c8e97f640 0 -- 172.21.15.67:0/1718514685 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x560f61ffe840 msgr2=0x560f62000c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:29.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.143+0000 7f8c8f180640 0 -- 172.21.15.67:0/1718514685 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f8c8408ba40 msgr2=0x7f8c84071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:29.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.350+0000 7f8c91696800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:26:29.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.350+0000 7f8c91696800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:26:29.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.350+0000 7f8c91696800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:29.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.350+0000 7f8c91696800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:29.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.350+0000 7f8c91696800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:29.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.350+0000 7f8c91696800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:29.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.350+0000 7f8c91696800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.350+0000 7f8c91696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:29.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.350+0000 7f8c91696800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.351+0000 7f8c91696800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:29.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.351+0000 7f8c91696800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.351+0000 7f8c91696800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:29.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.351+0000 7f8c91696800 20 zone default found 2024-09-12T17:26:29.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.351+0000 7f8c91696800 4 Realm: () 2024-09-12T17:26:29.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.351+0000 7f8c91696800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:26:29.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.351+0000 7f8c91696800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:26:29.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.351+0000 7f8c91696800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:29.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.351+0000 7f8c91696800 20 zonegroup default 2024-09-12T17:26:29.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.351+0000 7f8c91696800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.351+0000 7f8c91696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:29.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.351+0000 7f8c91696800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.352+0000 7f8c91696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:29.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.352+0000 7f8c91696800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.352+0000 7f8c91696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:29.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.352+0000 7f8c91696800 20 started sync module instance, tier type = 2024-09-12T17:26:29.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.352+0000 7f8c91696800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:26:29.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.362+0000 7f8c91696800 20 add_watcher() i=0 2024-09-12T17:26:29.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.362+0000 7f8c91696800 20 add_watcher() i=1 2024-09-12T17:26:29.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.362+0000 7f8c91696800 20 add_watcher() i=2 2024-09-12T17:26:29.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.362+0000 7f8c91696800 20 add_watcher() i=3 2024-09-12T17:26:29.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.362+0000 7f8c91696800 20 add_watcher() i=4 2024-09-12T17:26:29.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.362+0000 7f8c91696800 20 add_watcher() i=5 2024-09-12T17:26:29.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.362+0000 7f8c91696800 20 add_watcher() i=6 2024-09-12T17:26:29.364 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.363+0000 7f8c91696800 20 add_watcher() i=7 2024-09-12T17:26:29.364 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.363+0000 7f8c91696800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:29.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.365+0000 7f8b45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:29.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.365+0000 7f8c91696800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:29.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.365+0000 7f8c91696800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:29.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.365+0000 7f8c91696800 5 note: GC not initialized 2024-09-12T17:26:29.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.365+0000 7f8b44fe1640 20 reqs_thread_entry: start 2024-09-12T17:26:29.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.366+0000 7f8c91696800 20 init_complete bucket index max shards: 1 2024-09-12T17:26:29.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.366+0000 7f8c91696800 20 Filter name: none 2024-09-12T17:26:29.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.366+0000 7f8abe7fc640 20 reqs_thread_entry: start 2024-09-12T17:26:29.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.366+0000 7f8c91696800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:26:29.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.366+0000 7f8c91696800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.366+0000 7f8c91696800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:26:29.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.366+0000 7f8c91696800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:26:29.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.366+0000 7f8c91696800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:26:29.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.366+0000 7f8c91696800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 : miss 2024-09-12T17:26:29.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.366+0000 7f8c91696800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.367+0000 7f8c91696800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:26:29.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.367+0000 7f8c91696800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 info.flags=0x17 2024-09-12T17:26:29.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.367+0000 7f8c91696800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 to cache LRU end 2024-09-12T17:26:29.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.367+0000 7f8c91696800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:26:29.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.367+0000 7f8c91696800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:29.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.367+0000 7f8c91696800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 2024-09-12T17:26:29.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.368+0000 7f8c91696800 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 to be held by another RGW process; skipping for now 2024-09-12T17:26:29.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.369+0000 7f8b45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:29.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.372+0000 7f8c91696800 20 remove_watcher() i=0 2024-09-12T17:26:29.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.372+0000 7f8c91696800 2 removed watcher, disabling cache 2024-09-12T17:26:29.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.373+0000 7f8c91696800 20 remove_watcher() i=1 2024-09-12T17:26:29.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.374+0000 7f8c91696800 20 remove_watcher() i=2 2024-09-12T17:26:29.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.375+0000 7f8c91696800 20 remove_watcher() i=3 2024-09-12T17:26:29.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.376+0000 7f8c91696800 20 remove_watcher() i=4 2024-09-12T17:26:29.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.377+0000 7f8c91696800 20 remove_watcher() i=5 2024-09-12T17:26:29.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.378+0000 7f8c91696800 20 remove_watcher() i=6 2024-09-12T17:26:29.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:29.379+0000 7f8c91696800 20 remove_watcher() i=7 2024-09-12T17:26:29.391 INFO:tasks.workunit.client.0.smithi067.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:26:59.403 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:26:59.439 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:59.439 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:59.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.484+0000 7fd286b23800 20 rados->read ofs=0 len=0 2024-09-12T17:26:59.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.485+0000 7fd286b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:59.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.485+0000 7fd286b23800 20 realm 2024-09-12T17:26:59.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.485+0000 7fd286b23800 20 rados->read ofs=0 len=0 2024-09-12T17:26:59.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.486+0000 7fd286b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:59.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.486+0000 7fd286b23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:59.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.486+0000 7fd286b23800 20 rados->read ofs=0 len=0 2024-09-12T17:26:59.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.486+0000 7fd286b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:59.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.486+0000 7fd286b23800 20 rados->read ofs=0 len=0 2024-09-12T17:26:59.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.487+0000 7fd286b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:59.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.487+0000 7fd286b23800 20 rados->read ofs=0 len=0 2024-09-12T17:26:59.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.488+0000 7fd286b23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:59.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.488+0000 7fd286b23800 20 searching for the correct realm 2024-09-12T17:26:59.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.490+0000 7fd282012640 0 -- 172.21.15.67:0/4229907050 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7fd274028040 msgr2=0x7fd2740a10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:59.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.697+0000 7fd282813640 0 -- 172.21.15.67:0/4229907050 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fd278010440 msgr2=0x7fd2780108c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:26:59.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.905+0000 7fd286b23800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:26:59.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.905+0000 7fd286b23800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:26:59.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.905+0000 7fd286b23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:59.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.905+0000 7fd286b23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:59.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.905+0000 7fd286b23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:59.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.905+0000 7fd286b23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:59.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.905+0000 7fd286b23800 20 rados->read ofs=0 len=0 2024-09-12T17:26:59.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.905+0000 7fd286b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:59.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.905+0000 7fd286b23800 20 rados->read ofs=0 len=0 2024-09-12T17:26:59.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.905+0000 7fd286b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:59.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.905+0000 7fd286b23800 20 rados->read ofs=0 len=0 2024-09-12T17:26:59.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.906+0000 7fd286b23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:59.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.906+0000 7fd286b23800 20 zone default found 2024-09-12T17:26:59.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.906+0000 7fd286b23800 4 Realm: () 2024-09-12T17:26:59.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.906+0000 7fd286b23800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:26:59.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.906+0000 7fd286b23800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:26:59.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.906+0000 7fd286b23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:59.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.906+0000 7fd286b23800 20 zonegroup default 2024-09-12T17:26:59.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.906+0000 7fd286b23800 20 rados->read ofs=0 len=0 2024-09-12T17:26:59.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.906+0000 7fd286b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:59.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.906+0000 7fd286b23800 20 rados->read ofs=0 len=0 2024-09-12T17:26:59.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.907+0000 7fd286b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:59.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.907+0000 7fd286b23800 20 rados->read ofs=0 len=0 2024-09-12T17:26:59.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.908+0000 7fd286b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:59.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.908+0000 7fd286b23800 20 started sync module instance, tier type = 2024-09-12T17:26:59.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.908+0000 7fd286b23800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:26:59.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.919+0000 7fd286b23800 20 add_watcher() i=0 2024-09-12T17:26:59.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.919+0000 7fd286b23800 20 add_watcher() i=1 2024-09-12T17:26:59.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.919+0000 7fd286b23800 20 add_watcher() i=2 2024-09-12T17:26:59.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.919+0000 7fd286b23800 20 add_watcher() i=3 2024-09-12T17:26:59.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.919+0000 7fd286b23800 20 add_watcher() i=4 2024-09-12T17:26:59.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.919+0000 7fd286b23800 20 add_watcher() i=5 2024-09-12T17:26:59.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.919+0000 7fd286b23800 20 add_watcher() i=6 2024-09-12T17:26:59.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.920+0000 7fd286b23800 20 add_watcher() i=7 2024-09-12T17:26:59.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.920+0000 7fd286b23800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:59.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.923+0000 7fd1397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:59.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.923+0000 7fd286b23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:59.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.923+0000 7fd286b23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:59.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.923+0000 7fd286b23800 5 note: GC not initialized 2024-09-12T17:26:59.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.924+0000 7fd0b3fff640 20 reqs_thread_entry: start 2024-09-12T17:26:59.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.924+0000 7fd286b23800 20 init_complete bucket index max shards: 1 2024-09-12T17:26:59.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.924+0000 7fd286b23800 20 Filter name: none 2024-09-12T17:26:59.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.924+0000 7fd0b1ffb640 20 reqs_thread_entry: start 2024-09-12T17:26:59.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.924+0000 7fd286b23800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:26:59.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.924+0000 7fd286b23800 20 rados->read ofs=0 len=0 2024-09-12T17:26:59.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.925+0000 7fd286b23800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:26:59.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.925+0000 7fd286b23800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:26:59.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.925+0000 7fd286b23800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:26:59.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.925+0000 7fd286b23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 : miss 2024-09-12T17:26:59.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.925+0000 7fd286b23800 20 rados->read ofs=0 len=0 2024-09-12T17:26:59.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.925+0000 7fd286b23800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:26:59.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.925+0000 7fd286b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 info.flags=0x17 2024-09-12T17:26:59.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.925+0000 7fd286b23800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 to cache LRU end 2024-09-12T17:26:59.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.925+0000 7fd286b23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:26:59.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.925+0000 7fd286b23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:59.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.925+0000 7fd286b23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 2024-09-12T17:26:59.928 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.926+0000 7fd286b23800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:26:59.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.931+0000 7fd286b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 info.flags=0x17 2024-09-12T17:26:59.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.931+0000 7fd286b23800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 to cache LRU end 2024-09-12T17:26:59.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.931+0000 7fd286b23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:59.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.931+0000 7fd286b23800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35, ofs0, ns] 2024-09-12T17:26:59.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.932+0000 7fd1667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464355 cookie 94881271776128 notifier 7626 bl.length()=995 2024-09-12T17:26:59.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.932+0000 7fd1667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 info.flags=0x17 2024-09-12T17:26:59.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.932+0000 7fd1667fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 to cache LRU end 2024-09-12T17:26:59.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.932+0000 7fd1667fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:59.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.933+0000 7fd286b23800 20 handle_bi_update(): bucket=:abort-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.35]): orig_sources= new_sources= 2024-09-12T17:26:59.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.933+0000 7fd286b23800 20 handle_bi_update(): bucket=:abort-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.35]): potential sources added=[] removed=[] 2024-09-12T17:26:59.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.933+0000 7fd286b23800 20 handle_bi_update(): bucket=:abort-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.35]): orig_dests= new_dests= 2024-09-12T17:26:59.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.933+0000 7fd286b23800 20 handle_bi_update(): bucket=:abort-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.35]): potential dests added=[] removed=[] 2024-09-12T17:26:59.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.939+0000 7fd286b23800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.35.2.0 2024-09-12T17:26:59.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.939+0000 7fd286b23800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.35.2.0 2024-09-12T17:26:59.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.939+0000 7fd286b23800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.35.2.1 2024-09-12T17:26:59.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.939+0000 7fd286b23800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.35.2.1 2024-09-12T17:26:59.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.939+0000 7fd286b23800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.35.0 2024-09-12T17:26:59.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.942+0000 7fd286b23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 : hit (requested=0x17, cached=0x17) 2024-09-12T17:26:59.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.942+0000 7fd286b23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 2024-09-12T17:26:59.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.943+0000 7fd286b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 info.flags=0x17 2024-09-12T17:26:59.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.943+0000 7fd286b23800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 to cache LRU end 2024-09-12T17:26:59.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.943+0000 7fd286b23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:59.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.943+0000 7fd286b23800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35, ofs0, ns] 2024-09-12T17:26:59.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.944+0000 7fd165ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464356 cookie 94881271776128 notifier 7626 bl.length()=995 2024-09-12T17:26:59.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.944+0000 7fd165ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 info.flags=0x17 2024-09-12T17:26:59.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.944+0000 7fd165ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 to cache LRU end 2024-09-12T17:26:59.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.944+0000 7fd165ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:59.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.945+0000 7fd286b23800 20 handle_bi_update(): bucket=:abort-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.35]): orig_sources= new_sources= 2024-09-12T17:26:59.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.945+0000 7fd286b23800 20 handle_bi_update(): bucket=:abort-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.35]): potential sources added=[] removed=[] 2024-09-12T17:26:59.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.945+0000 7fd286b23800 20 handle_bi_update(): bucket=:abort-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.35]): orig_dests= new_dests= 2024-09-12T17:26:59.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.945+0000 7fd286b23800 20 handle_bi_update(): bucket=:abort-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.35]): potential dests added=[] removed=[] 2024-09-12T17:26:59.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.947+0000 7fd286b23800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.35.0 2024-09-12T17:26:59.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.948+0000 7fd286b23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 : hit (requested=0x17, cached=0x17) 2024-09-12T17:26:59.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.948+0000 7fd286b23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 2024-09-12T17:26:59.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.949+0000 7fd286b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 info.flags=0x17 2024-09-12T17:26:59.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.949+0000 7fd286b23800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 to cache LRU end 2024-09-12T17:26:59.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.949+0000 7fd286b23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:59.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.949+0000 7fd286b23800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35, ofs0, ns] 2024-09-12T17:26:59.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.949+0000 7fd1667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464357 cookie 94881271776128 notifier 7626 bl.length()=963 2024-09-12T17:26:59.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.949+0000 7fd1667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 info.flags=0x17 2024-09-12T17:26:59.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.949+0000 7fd1667fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 to cache LRU end 2024-09-12T17:26:59.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.949+0000 7fd1667fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:26:59.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.951+0000 7fd286b23800 20 handle_bi_update(): bucket=:abort-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.35]): orig_sources= new_sources= 2024-09-12T17:26:59.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.951+0000 7fd286b23800 20 handle_bi_update(): bucket=:abort-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.35]): potential sources added=[] removed=[] 2024-09-12T17:26:59.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.951+0000 7fd286b23800 20 handle_bi_update(): bucket=:abort-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.35]): orig_dests= new_dests= 2024-09-12T17:26:59.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.951+0000 7fd286b23800 20 handle_bi_update(): bucket=:abort-at-do-reshard[06eb12d0-49d6-461d-9efe-05d212954deb.4538.35]): potential dests added=[] removed=[] 2024-09-12T17:26:59.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.952+0000 7fd286b23800 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-12T17:26:59.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.955+0000 7fd1397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:59.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.957+0000 7fd286b23800 20 remove_watcher() i=0 2024-09-12T17:26:59.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.957+0000 7fd286b23800 2 removed watcher, disabling cache 2024-09-12T17:26:59.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.959+0000 7fd286b23800 20 remove_watcher() i=1 2024-09-12T17:26:59.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.960+0000 7fd286b23800 20 remove_watcher() i=2 2024-09-12T17:26:59.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.961+0000 7fd286b23800 20 remove_watcher() i=3 2024-09-12T17:26:59.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.962+0000 7fd286b23800 20 remove_watcher() i=4 2024-09-12T17:26:59.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.963+0000 7fd286b23800 20 remove_watcher() i=5 2024-09-12T17:26:59.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.964+0000 7fd286b23800 20 remove_watcher() i=6 2024-09-12T17:26:59.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:26:59.965+0000 7fd286b23800 20 remove_watcher() i=7 2024-09-12T17:26:59.981 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:27:00.011 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:00.011 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:00.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.052+0000 7f9fb8131800 20 rados->read ofs=0 len=0 2024-09-12T17:27:00.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.053+0000 7f9fb8131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:00.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.053+0000 7f9fb8131800 20 realm 2024-09-12T17:27:00.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.053+0000 7f9fb8131800 20 rados->read ofs=0 len=0 2024-09-12T17:27:00.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.054+0000 7f9fb8131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:00.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.054+0000 7f9fb8131800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:00.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.054+0000 7f9fb8131800 20 rados->read ofs=0 len=0 2024-09-12T17:27:00.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.054+0000 7f9fb8131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:00.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.054+0000 7f9fb8131800 20 rados->read ofs=0 len=0 2024-09-12T17:27:00.056 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.055+0000 7f9fb8131800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:00.056 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.055+0000 7f9fb8131800 20 rados->read ofs=0 len=0 2024-09-12T17:27:00.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.056+0000 7f9fb8131800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:00.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.056+0000 7f9fb8131800 20 searching for the correct realm 2024-09-12T17:27:00.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.058+0000 7f9fb3e1a640 0 -- 172.21.15.67:0/727103470 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f9fac018070 msgr2=0x7f9fac029930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:00.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.062+0000 7f9fb3e1a640 0 -- 172.21.15.67:0/727103470 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f9f9c0e0860 msgr2=0x7f9f9c003090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:00.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.067+0000 7f9fb8131800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:00.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.067+0000 7f9fb8131800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:00.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.067+0000 7f9fb8131800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:00.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.067+0000 7f9fb8131800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:00.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.067+0000 7f9fb8131800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:00.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.067+0000 7f9fb8131800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:00.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.067+0000 7f9fb8131800 20 rados->read ofs=0 len=0 2024-09-12T17:27:00.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.067+0000 7f9fb8131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:00.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.067+0000 7f9fb8131800 20 rados->read ofs=0 len=0 2024-09-12T17:27:00.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.067+0000 7f9fb8131800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:00.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.067+0000 7f9fb8131800 20 rados->read ofs=0 len=0 2024-09-12T17:27:00.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.067+0000 7f9fb8131800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:00.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.068+0000 7f9fb8131800 20 zone default found 2024-09-12T17:27:00.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.068+0000 7f9fb8131800 4 Realm: () 2024-09-12T17:27:00.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.068+0000 7f9fb8131800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:00.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.068+0000 7f9fb8131800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:00.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.068+0000 7f9fb8131800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:00.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.068+0000 7f9fb8131800 20 zonegroup default 2024-09-12T17:27:00.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.068+0000 7f9fb8131800 20 rados->read ofs=0 len=0 2024-09-12T17:27:00.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.068+0000 7f9fb8131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:00.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.068+0000 7f9fb8131800 20 rados->read ofs=0 len=0 2024-09-12T17:27:00.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.068+0000 7f9fb8131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:00.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.068+0000 7f9fb8131800 20 rados->read ofs=0 len=0 2024-09-12T17:27:00.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.068+0000 7f9fb8131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:00.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.068+0000 7f9fb8131800 20 started sync module instance, tier type = 2024-09-12T17:27:00.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.068+0000 7f9fb8131800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:00.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.078+0000 7f9fb8131800 20 add_watcher() i=0 2024-09-12T17:27:00.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.078+0000 7f9fb8131800 20 add_watcher() i=1 2024-09-12T17:27:00.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.078+0000 7f9fb8131800 20 add_watcher() i=2 2024-09-12T17:27:00.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.078+0000 7f9fb8131800 20 add_watcher() i=3 2024-09-12T17:27:00.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.078+0000 7f9fb8131800 20 add_watcher() i=4 2024-09-12T17:27:00.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.078+0000 7f9fb8131800 20 add_watcher() i=5 2024-09-12T17:27:00.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.078+0000 7f9fb8131800 20 add_watcher() i=6 2024-09-12T17:27:00.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.079+0000 7f9fb8131800 20 add_watcher() i=7 2024-09-12T17:27:00.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.079+0000 7f9fb8131800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:00.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.080+0000 7f9e6a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:00.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.081+0000 7f9fb8131800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:00.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.081+0000 7f9fb8131800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:00.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.081+0000 7f9fb8131800 5 note: GC not initialized 2024-09-12T17:27:00.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.081+0000 7f9e697e2640 20 reqs_thread_entry: start 2024-09-12T17:27:00.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.081+0000 7f9fb8131800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:00.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.081+0000 7f9fb8131800 20 Filter name: none 2024-09-12T17:27:00.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.081+0000 7f9e627fc640 20 reqs_thread_entry: start 2024-09-12T17:27:00.083 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.081+0000 7f9fb8131800 20 rados->read ofs=0 len=0 2024-09-12T17:27:00.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.082+0000 7f9fb8131800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:27:00.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.082+0000 7f9fb8131800 20 rados->read ofs=0 len=0 2024-09-12T17:27:00.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.082+0000 7f9fb8131800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:27:00.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.082+0000 7f9fb8131800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:00.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.082+0000 7f9fb8131800 20 rados->read ofs=0 len=0 2024-09-12T17:27:00.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.082+0000 7f9fb8131800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:27:00.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.082+0000 7f9fb8131800 20 rados->read ofs=0 len=0 2024-09-12T17:27:00.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.083+0000 7f9fb8131800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:27:00.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.083+0000 7f9fb8131800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:00.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.084+0000 7f9e6a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:00.087 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.086+0000 7f9fb8131800 20 remove_watcher() i=0 2024-09-12T17:27:00.087 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.086+0000 7f9fb8131800 2 removed watcher, disabling cache 2024-09-12T17:27:00.088 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.087+0000 7f9fb8131800 20 remove_watcher() i=1 2024-09-12T17:27:00.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.088+0000 7f9fb8131800 20 remove_watcher() i=2 2024-09-12T17:27:00.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.089+0000 7f9fb8131800 20 remove_watcher() i=3 2024-09-12T17:27:00.091 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.090+0000 7f9fb8131800 20 remove_watcher() i=4 2024-09-12T17:27:00.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.091+0000 7f9fb8131800 20 remove_watcher() i=5 2024-09-12T17:27:00.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.092+0000 7f9fb8131800 20 remove_watcher() i=6 2024-09-12T17:27:00.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:00.093+0000 7f9fb8131800 20 remove_watcher() i=7 2024-09-12T17:27:00.105 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:00.105 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:27:00.105 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-do-reshard id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.35 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:27:00.105 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:00.107 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:00.107 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:00.129 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:00.129 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:00.362 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:00.362 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:00.426 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-12T17:27:00.426 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:00.428 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:00.428 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:00.470 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:00.470 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:00.527 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:00.527 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:00.565 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:00.565 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:00.600 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:00.600 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:00.636 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:00.636 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:00.673 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:00.673 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:00.710 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:00.710 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:00.747 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:00.747 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:00.783 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:00.783 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:00.820 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:00.820 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:00.857 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:00.858 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:00.892 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:00.893 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:00.929 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:00.929 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:00.965 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:00.965 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:01.001 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:01.002 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:01.037 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:01.037 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:01.074 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:01.074 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:01.110 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:01.110 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:01.149 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:01.149 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:01.184 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:01.184 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:01.221 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:01.221 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:01.257 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:27:01.286 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:01.286 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:01.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.324+0000 7f6c26faf800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.325+0000 7f6c26faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:01.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.325+0000 7f6c26faf800 20 realm 2024-09-12T17:27:01.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.325+0000 7f6c26faf800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.326+0000 7f6c26faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:01.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.326+0000 7f6c26faf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:01.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.326+0000 7f6c26faf800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.326+0000 7f6c26faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:01.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.326+0000 7f6c26faf800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.327+0000 7f6c26faf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:01.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.327+0000 7f6c26faf800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.327+0000 7f6c26faf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:01.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.327+0000 7f6c26faf800 20 searching for the correct realm 2024-09-12T17:27:01.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.331+0000 7f6c1ffff640 0 -- 172.21.15.67:0/2112906066 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x5595882961b0 msgr2=0x559588298650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:01.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.334+0000 7f6c1ffff640 0 -- 172.21.15.67:0/2112906066 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55958829dc70 msgr2=0x5595882a0060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:01.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.338+0000 7f6c26faf800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:01.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.338+0000 7f6c26faf800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:01.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.338+0000 7f6c26faf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:01.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.338+0000 7f6c26faf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:01.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.338+0000 7f6c26faf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:01.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.338+0000 7f6c26faf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:01.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.338+0000 7f6c26faf800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.338+0000 7f6c26faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:01.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.338+0000 7f6c26faf800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.338+0000 7f6c26faf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:01.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.338+0000 7f6c26faf800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.339+0000 7f6c26faf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:01.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.339+0000 7f6c26faf800 20 zone default found 2024-09-12T17:27:01.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.339+0000 7f6c26faf800 4 Realm: () 2024-09-12T17:27:01.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.339+0000 7f6c26faf800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:01.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.339+0000 7f6c26faf800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:01.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.339+0000 7f6c26faf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:01.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.339+0000 7f6c26faf800 20 zonegroup default 2024-09-12T17:27:01.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.339+0000 7f6c26faf800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.339+0000 7f6c26faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:01.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.339+0000 7f6c26faf800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.339+0000 7f6c26faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:01.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.339+0000 7f6c26faf800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.339+0000 7f6c26faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:01.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.339+0000 7f6c26faf800 20 started sync module instance, tier type = 2024-09-12T17:27:01.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.339+0000 7f6c26faf800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:01.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.348+0000 7f6c26faf800 20 add_watcher() i=0 2024-09-12T17:27:01.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.348+0000 7f6c26faf800 20 add_watcher() i=1 2024-09-12T17:27:01.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.348+0000 7f6c26faf800 20 add_watcher() i=2 2024-09-12T17:27:01.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.348+0000 7f6c26faf800 20 add_watcher() i=3 2024-09-12T17:27:01.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.348+0000 7f6c26faf800 20 add_watcher() i=4 2024-09-12T17:27:01.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.348+0000 7f6c26faf800 20 add_watcher() i=5 2024-09-12T17:27:01.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.348+0000 7f6c26faf800 20 add_watcher() i=6 2024-09-12T17:27:01.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.349+0000 7f6c26faf800 20 add_watcher() i=7 2024-09-12T17:27:01.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.349+0000 7f6c26faf800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:01.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.350+0000 7f6adb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:01.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.351+0000 7f6c26faf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:01.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.351+0000 7f6c26faf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:01.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.351+0000 7f6c26faf800 5 note: GC not initialized 2024-09-12T17:27:01.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.351+0000 7f6ada7e4640 20 reqs_thread_entry: start 2024-09-12T17:27:01.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.351+0000 7f6c26faf800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:01.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.351+0000 7f6c26faf800 20 Filter name: none 2024-09-12T17:27:01.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.351+0000 7f6ad37fe640 20 reqs_thread_entry: start 2024-09-12T17:27:01.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.351+0000 7f6c26faf800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.352+0000 7f6c26faf800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:27:01.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.352+0000 7f6c26faf800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.352+0000 7f6c26faf800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:27:01.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.352+0000 7f6c26faf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:01.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.352+0000 7f6c26faf800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.353+0000 7f6c26faf800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:27:01.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.353+0000 7f6c26faf800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.353+0000 7f6c26faf800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:27:01.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.353+0000 7f6c26faf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:01.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.354+0000 7f6adb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:01.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.356+0000 7f6c26faf800 20 remove_watcher() i=0 2024-09-12T17:27:01.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.356+0000 7f6c26faf800 2 removed watcher, disabling cache 2024-09-12T17:27:01.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.357+0000 7f6c26faf800 20 remove_watcher() i=1 2024-09-12T17:27:01.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.358+0000 7f6c26faf800 20 remove_watcher() i=2 2024-09-12T17:27:01.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.359+0000 7f6c26faf800 20 remove_watcher() i=3 2024-09-12T17:27:01.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.360+0000 7f6c26faf800 20 remove_watcher() i=4 2024-09-12T17:27:01.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.361+0000 7f6c26faf800 20 remove_watcher() i=5 2024-09-12T17:27:01.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.362+0000 7f6c26faf800 20 remove_watcher() i=6 2024-09-12T17:27:01.364 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.363+0000 7f6c26faf800 20 remove_watcher() i=7 2024-09-12T17:27:01.374 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:01.375 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:27:01.375 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-logrecord-writes id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:27:01.375 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:01.376 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-12T17:27:01.411 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:01.411 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:01.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.449+0000 7f993ad0c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.451+0000 7f993ad0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:01.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.451+0000 7f993ad0c800 20 realm 2024-09-12T17:27:01.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.451+0000 7f993ad0c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.451+0000 7f993ad0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:01.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.451+0000 7f993ad0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:01.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.451+0000 7f993ad0c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.451+0000 7f993ad0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:01.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.451+0000 7f993ad0c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.452+0000 7f993ad0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:01.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.452+0000 7f993ad0c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.453+0000 7f993ad0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:01.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.453+0000 7f993ad0c800 20 searching for the correct realm 2024-09-12T17:27:01.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.455+0000 7f99387f6640 0 -- 172.21.15.67:0/485303750 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f9930064770 msgr2=0x7f99300631e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:01.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.458+0000 7f99387f6640 0 -- 172.21.15.67:0/485303750 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f9920017070 msgr2=0x7f9920033980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:27:01.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.665+0000 7f993ad0c800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:01.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.665+0000 7f993ad0c800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:01.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.665+0000 7f993ad0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:01.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.665+0000 7f993ad0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:01.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.665+0000 7f993ad0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:01.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.665+0000 7f993ad0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:01.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.665+0000 7f993ad0c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.665+0000 7f993ad0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:01.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.665+0000 7f993ad0c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.665+0000 7f993ad0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:01.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.665+0000 7f993ad0c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.666+0000 7f993ad0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:01.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.666+0000 7f993ad0c800 20 zone default found 2024-09-12T17:27:01.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.666+0000 7f993ad0c800 4 Realm: () 2024-09-12T17:27:01.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.666+0000 7f993ad0c800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:01.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.666+0000 7f993ad0c800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:01.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.666+0000 7f993ad0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:01.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.666+0000 7f993ad0c800 20 zonegroup default 2024-09-12T17:27:01.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.666+0000 7f993ad0c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.666+0000 7f993ad0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:01.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.666+0000 7f993ad0c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.666+0000 7f993ad0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:01.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.666+0000 7f993ad0c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.667+0000 7f993ad0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:01.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.667+0000 7f993ad0c800 20 started sync module instance, tier type = 2024-09-12T17:27:01.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.667+0000 7f993ad0c800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:01.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.676+0000 7f993ad0c800 20 add_watcher() i=0 2024-09-12T17:27:01.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.676+0000 7f993ad0c800 20 add_watcher() i=1 2024-09-12T17:27:01.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.676+0000 7f993ad0c800 20 add_watcher() i=2 2024-09-12T17:27:01.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.676+0000 7f993ad0c800 20 add_watcher() i=3 2024-09-12T17:27:01.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.676+0000 7f993ad0c800 20 add_watcher() i=4 2024-09-12T17:27:01.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.676+0000 7f993ad0c800 20 add_watcher() i=5 2024-09-12T17:27:01.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.676+0000 7f993ad0c800 20 add_watcher() i=6 2024-09-12T17:27:01.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.677+0000 7f993ad0c800 20 add_watcher() i=7 2024-09-12T17:27:01.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.677+0000 7f993ad0c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:01.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.680+0000 7f97ee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:01.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.680+0000 7f993ad0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:01.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.680+0000 7f993ad0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:01.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.681+0000 7f993ad0c800 5 note: GC not initialized 2024-09-12T17:27:01.683 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.681+0000 7f97ed7e2640 20 reqs_thread_entry: start 2024-09-12T17:27:01.683 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.681+0000 7f993ad0c800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:01.683 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.681+0000 7f993ad0c800 20 Filter name: none 2024-09-12T17:27:01.683 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.681+0000 7f975effd640 20 reqs_thread_entry: start 2024-09-12T17:27:01.683 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.681+0000 7f993ad0c800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T17:27:01.683 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.681+0000 7f993ad0c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.682+0000 7f993ad0c800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:27:01.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.682+0000 7f993ad0c800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T17:27:01.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.682+0000 7f993ad0c800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T17:27:01.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.682+0000 7f993ad0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 : miss 2024-09-12T17:27:01.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.682+0000 7f993ad0c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.682+0000 7f993ad0c800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:27:01.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.682+0000 7f993ad0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 info.flags=0x17 2024-09-12T17:27:01.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.682+0000 7f993ad0c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 to cache LRU end 2024-09-12T17:27:01.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.682+0000 7f993ad0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:01.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.682+0000 7f993ad0c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:01.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.682+0000 7f993ad0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 2024-09-12T17:27:01.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.686+0000 7f993ad0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 info.flags=0x17 2024-09-12T17:27:01.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.686+0000 7f993ad0c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 to cache LRU end 2024-09-12T17:27:01.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.686+0000 7f993ad0c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:01.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.686+0000 7f993ad0c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36, ofs0, ns] 2024-09-12T17:27:01.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.686+0000 7f98177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464344 cookie 94797959241504 notifier 7683 bl.length()=1007 2024-09-12T17:27:01.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.686+0000 7f98177fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 info.flags=0x17 2024-09-12T17:27:01.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.686+0000 7f98177fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 to cache LRU end 2024-09-12T17:27:01.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.686+0000 7f98177fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:01.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.688+0000 7f993ad0c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.36]): orig_sources= new_sources= 2024-09-12T17:27:01.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.688+0000 7f993ad0c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.36]): potential sources added=[] removed=[] 2024-09-12T17:27:01.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.688+0000 7f993ad0c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.36]): orig_dests= new_dests= 2024-09-12T17:27:01.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.688+0000 7f993ad0c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.36]): potential dests added=[] removed=[] 2024-09-12T17:27:01.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.689+0000 7f993ad0c800 -1 Injecting error=-5 at location=logrecord_writes 2024-09-12T17:27:01.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.689+0000 7f993ad0c800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-12T17:27:01.692 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.691+0000 7f993ad0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 : hit (requested=0x17, cached=0x17) 2024-09-12T17:27:01.692 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.691+0000 7f993ad0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 2024-09-12T17:27:01.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.692+0000 7f993ad0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 info.flags=0x17 2024-09-12T17:27:01.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.693+0000 7f993ad0c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 to cache LRU end 2024-09-12T17:27:01.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.693+0000 7f993ad0c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:01.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.693+0000 7f993ad0c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36, ofs0, ns] 2024-09-12T17:27:01.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.693+0000 7f98177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464345 cookie 94797959241504 notifier 7683 bl.length()=975 2024-09-12T17:27:01.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.693+0000 7f98177fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 info.flags=0x17 2024-09-12T17:27:01.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.693+0000 7f98177fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 to cache LRU end 2024-09-12T17:27:01.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.693+0000 7f98177fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:01.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.694+0000 7f993ad0c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.36]): orig_sources= new_sources= 2024-09-12T17:27:01.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.694+0000 7f993ad0c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.36]): potential sources added=[] removed=[] 2024-09-12T17:27:01.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.694+0000 7f993ad0c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.36]): orig_dests= new_dests= 2024-09-12T17:27:01.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.694+0000 7f993ad0c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.36]): potential dests added=[] removed=[] 2024-09-12T17:27:01.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.696+0000 7f97ee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:01.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.698+0000 7f993ad0c800 20 remove_watcher() i=0 2024-09-12T17:27:01.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.698+0000 7f993ad0c800 2 removed watcher, disabling cache 2024-09-12T17:27:01.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.699+0000 7f993ad0c800 20 remove_watcher() i=1 2024-09-12T17:27:01.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.701+0000 7f993ad0c800 20 remove_watcher() i=2 2024-09-12T17:27:01.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.702+0000 7f993ad0c800 20 remove_watcher() i=3 2024-09-12T17:27:01.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.703+0000 7f993ad0c800 20 remove_watcher() i=4 2024-09-12T17:27:01.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.704+0000 7f993ad0c800 20 remove_watcher() i=5 2024-09-12T17:27:01.705 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.705+0000 7f993ad0c800 20 remove_watcher() i=6 2024-09-12T17:27:01.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.706+0000 7f993ad0c800 20 remove_watcher() i=7 2024-09-12T17:27:01.719 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:27:01.748 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:01.748 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:01.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.786+0000 7fb65b335800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.788+0000 7fb65b335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:01.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.788+0000 7fb65b335800 20 realm 2024-09-12T17:27:01.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.788+0000 7fb65b335800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.788+0000 7fb65b335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:01.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.788+0000 7fb65b335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:01.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.788+0000 7fb65b335800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.788+0000 7fb65b335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:01.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.788+0000 7fb65b335800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.789+0000 7fb65b335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:01.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.789+0000 7fb65b335800 20 rados->read ofs=0 len=0 2024-09-12T17:27:01.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.790+0000 7fb65b335800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:01.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.790+0000 7fb65b335800 20 searching for the correct realm 2024-09-12T17:27:01.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.792+0000 7fb6570e4640 0 -- 172.21.15.67:0/2729714850 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7fb650020040 msgr2=0x7fb650010440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:01.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:01.796+0000 7fb6570e4640 0 -- 172.21.15.67:0/2729714850 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fb640075070 msgr2=0x7fb640056a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:27:02.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.002+0000 7fb65b335800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:02.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.002+0000 7fb65b335800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:02.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.002+0000 7fb65b335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:02.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.002+0000 7fb65b335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:02.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.002+0000 7fb65b335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:02.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.002+0000 7fb65b335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:02.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.002+0000 7fb65b335800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.003+0000 7fb65b335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:02.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.003+0000 7fb65b335800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.003+0000 7fb65b335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:02.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.003+0000 7fb65b335800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.003+0000 7fb65b335800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:02.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.003+0000 7fb65b335800 20 zone default found 2024-09-12T17:27:02.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.003+0000 7fb65b335800 4 Realm: () 2024-09-12T17:27:02.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.003+0000 7fb65b335800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:02.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.003+0000 7fb65b335800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:02.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.003+0000 7fb65b335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:02.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.003+0000 7fb65b335800 20 zonegroup default 2024-09-12T17:27:02.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.003+0000 7fb65b335800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.004+0000 7fb65b335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:02.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.004+0000 7fb65b335800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.004+0000 7fb65b335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:02.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.004+0000 7fb65b335800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.004+0000 7fb65b335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:02.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.004+0000 7fb65b335800 20 started sync module instance, tier type = 2024-09-12T17:27:02.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.004+0000 7fb65b335800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:02.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.013+0000 7fb65b335800 20 add_watcher() i=0 2024-09-12T17:27:02.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.013+0000 7fb65b335800 20 add_watcher() i=1 2024-09-12T17:27:02.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.013+0000 7fb65b335800 20 add_watcher() i=2 2024-09-12T17:27:02.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.013+0000 7fb65b335800 20 add_watcher() i=3 2024-09-12T17:27:02.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.013+0000 7fb65b335800 20 add_watcher() i=4 2024-09-12T17:27:02.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.013+0000 7fb65b335800 20 add_watcher() i=5 2024-09-12T17:27:02.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.013+0000 7fb65b335800 20 add_watcher() i=6 2024-09-12T17:27:02.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.014+0000 7fb65b335800 20 add_watcher() i=7 2024-09-12T17:27:02.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.014+0000 7fb65b335800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:02.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.015+0000 7fb50dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:02.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.016+0000 7fb65b335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:02.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.016+0000 7fb65b335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:02.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.016+0000 7fb65b335800 5 note: GC not initialized 2024-09-12T17:27:02.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.016+0000 7fb50cfe1640 20 reqs_thread_entry: start 2024-09-12T17:27:02.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.016+0000 7fb65b335800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:02.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.016+0000 7fb65b335800 20 Filter name: none 2024-09-12T17:27:02.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.016+0000 7fb4867fc640 20 reqs_thread_entry: start 2024-09-12T17:27:02.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.016+0000 7fb65b335800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.017+0000 7fb65b335800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:27:02.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.017+0000 7fb65b335800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.017+0000 7fb65b335800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:27:02.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.017+0000 7fb65b335800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:02.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.017+0000 7fb65b335800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.018+0000 7fb65b335800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:27:02.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.018+0000 7fb65b335800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.018+0000 7fb65b335800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:27:02.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.018+0000 7fb65b335800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:02.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.019+0000 7fb50dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:02.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.021+0000 7fb65b335800 20 remove_watcher() i=0 2024-09-12T17:27:02.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.021+0000 7fb65b335800 2 removed watcher, disabling cache 2024-09-12T17:27:02.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.022+0000 7fb65b335800 20 remove_watcher() i=1 2024-09-12T17:27:02.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.023+0000 7fb65b335800 20 remove_watcher() i=2 2024-09-12T17:27:02.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.024+0000 7fb65b335800 20 remove_watcher() i=3 2024-09-12T17:27:02.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.025+0000 7fb65b335800 20 remove_watcher() i=4 2024-09-12T17:27:02.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.026+0000 7fb65b335800 20 remove_watcher() i=5 2024-09-12T17:27:02.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.027+0000 7fb65b335800 20 remove_watcher() i=6 2024-09-12T17:27:02.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.028+0000 7fb65b335800 20 remove_watcher() i=7 2024-09-12T17:27:02.040 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:02.040 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:27:02.040 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-logrecord-writes id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:27:02.040 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:02.042 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:02.042 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:02.075 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:02.075 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:02.132 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:27:02.165 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:02.165 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:02.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.203+0000 7f5f13d24800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.204+0000 7f5f13d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:02.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.204+0000 7f5f13d24800 20 realm 2024-09-12T17:27:02.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.204+0000 7f5f13d24800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.205+0000 7f5f13d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:02.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.205+0000 7f5f13d24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:02.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.205+0000 7f5f13d24800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.205+0000 7f5f13d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:02.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.205+0000 7f5f13d24800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.206+0000 7f5f13d24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:02.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.206+0000 7f5f13d24800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.206+0000 7f5f13d24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:02.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.206+0000 7f5f13d24800 20 searching for the correct realm 2024-09-12T17:27:02.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.209+0000 7f5f101d3640 0 -- 172.21.15.67:0/2440422453 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x561534e12d40 msgr2=0x561534e15200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:02.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.213+0000 7f5f0f9d2640 0 -- 172.21.15.67:0/2440422453 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f5f04056b70 msgr2=0x7f5f04082940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:02.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.216+0000 7f5f13d24800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:02.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.216+0000 7f5f13d24800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:02.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.216+0000 7f5f13d24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:02.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.216+0000 7f5f13d24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:02.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.216+0000 7f5f13d24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:02.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.216+0000 7f5f13d24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:02.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.216+0000 7f5f13d24800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.217+0000 7f5f13d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:02.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.217+0000 7f5f13d24800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.217+0000 7f5f13d24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:02.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.217+0000 7f5f13d24800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.217+0000 7f5f13d24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:02.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.217+0000 7f5f13d24800 20 zone default found 2024-09-12T17:27:02.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.217+0000 7f5f13d24800 4 Realm: () 2024-09-12T17:27:02.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.217+0000 7f5f13d24800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:02.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.217+0000 7f5f13d24800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:02.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.217+0000 7f5f13d24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:02.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.217+0000 7f5f13d24800 20 zonegroup default 2024-09-12T17:27:02.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.217+0000 7f5f13d24800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.218+0000 7f5f13d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:02.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.218+0000 7f5f13d24800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.218+0000 7f5f13d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:02.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.218+0000 7f5f13d24800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.218+0000 7f5f13d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:02.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.218+0000 7f5f13d24800 20 started sync module instance, tier type = 2024-09-12T17:27:02.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.218+0000 7f5f13d24800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:02.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.227+0000 7f5f13d24800 20 add_watcher() i=0 2024-09-12T17:27:02.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.227+0000 7f5f13d24800 20 add_watcher() i=1 2024-09-12T17:27:02.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.227+0000 7f5f13d24800 20 add_watcher() i=2 2024-09-12T17:27:02.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.227+0000 7f5f13d24800 20 add_watcher() i=3 2024-09-12T17:27:02.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.227+0000 7f5f13d24800 20 add_watcher() i=4 2024-09-12T17:27:02.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.227+0000 7f5f13d24800 20 add_watcher() i=5 2024-09-12T17:27:02.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.227+0000 7f5f13d24800 20 add_watcher() i=6 2024-09-12T17:27:02.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.228+0000 7f5f13d24800 20 add_watcher() i=7 2024-09-12T17:27:02.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.228+0000 7f5f13d24800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:02.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.229+0000 7f5dc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:02.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.229+0000 7f5f13d24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:02.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.230+0000 7f5f13d24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:02.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.230+0000 7f5f13d24800 5 note: GC not initialized 2024-09-12T17:27:02.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.230+0000 7f5dc4fe1640 20 reqs_thread_entry: start 2024-09-12T17:27:02.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.230+0000 7f5f13d24800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:02.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.230+0000 7f5f13d24800 20 Filter name: none 2024-09-12T17:27:02.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.230+0000 7f5d3e7fc640 20 reqs_thread_entry: start 2024-09-12T17:27:02.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.230+0000 7f5f13d24800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T17:27:02.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.230+0000 7f5f13d24800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.231+0000 7f5f13d24800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:27:02.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.231+0000 7f5f13d24800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T17:27:02.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.231+0000 7f5f13d24800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T17:27:02.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.231+0000 7f5f13d24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 : miss 2024-09-12T17:27:02.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.231+0000 7f5f13d24800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.231+0000 7f5f13d24800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:27:02.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.231+0000 7f5f13d24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 info.flags=0x17 2024-09-12T17:27:02.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.231+0000 7f5f13d24800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 to cache LRU end 2024-09-12T17:27:02.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.231+0000 7f5f13d24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:02.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.231+0000 7f5f13d24800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:02.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.231+0000 7f5f13d24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 2024-09-12T17:27:02.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.235+0000 7f5f13d24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 info.flags=0x17 2024-09-12T17:27:02.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.235+0000 7f5f13d24800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 to cache LRU end 2024-09-12T17:27:02.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.235+0000 7f5f13d24800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:02.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.235+0000 7f5f13d24800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36, ofs0, ns] 2024-09-12T17:27:02.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.235+0000 7f5deeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464346 cookie 94649081481344 notifier 7719 bl.length()=1007 2024-09-12T17:27:02.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.235+0000 7f5deeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 info.flags=0x17 2024-09-12T17:27:02.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.235+0000 7f5deeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 to cache LRU end 2024-09-12T17:27:02.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.235+0000 7f5deeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:02.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.237+0000 7f5f13d24800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.36]): orig_sources= new_sources= 2024-09-12T17:27:02.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.237+0000 7f5f13d24800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.36]): potential sources added=[] removed=[] 2024-09-12T17:27:02.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.237+0000 7f5f13d24800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.36]): orig_dests= new_dests= 2024-09-12T17:27:02.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.237+0000 7f5f13d24800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.36]): potential dests added=[] removed=[] 2024-09-12T17:27:02.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.239+0000 7f5f13d24800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.36.1.0 2024-09-12T17:27:02.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.239+0000 7f5f13d24800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.36.1.0 2024-09-12T17:27:02.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.239+0000 7f5f13d24800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.36.1.1 2024-09-12T17:27:02.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.239+0000 7f5f13d24800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.36.1.1 2024-09-12T17:27:02.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.239+0000 7f5f13d24800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.36.0 2024-09-12T17:27:02.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.241+0000 7f5f13d24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 : hit (requested=0x17, cached=0x17) 2024-09-12T17:27:02.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.241+0000 7f5f13d24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 2024-09-12T17:27:02.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.242+0000 7f5f13d24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 info.flags=0x17 2024-09-12T17:27:02.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.242+0000 7f5f13d24800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 to cache LRU end 2024-09-12T17:27:02.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.242+0000 7f5f13d24800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:02.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.242+0000 7f5f13d24800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36, ofs0, ns] 2024-09-12T17:27:02.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.243+0000 7f5deeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464347 cookie 94649081481344 notifier 7719 bl.length()=1007 2024-09-12T17:27:02.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.243+0000 7f5deeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 info.flags=0x17 2024-09-12T17:27:02.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.243+0000 7f5deeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 to cache LRU end 2024-09-12T17:27:02.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.243+0000 7f5deeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:02.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.244+0000 7f5f13d24800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.36]): orig_sources= new_sources= 2024-09-12T17:27:02.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.244+0000 7f5f13d24800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.36]): potential sources added=[] removed=[] 2024-09-12T17:27:02.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.244+0000 7f5f13d24800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.36]): orig_dests= new_dests= 2024-09-12T17:27:02.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.244+0000 7f5f13d24800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.36]): potential dests added=[] removed=[] 2024-09-12T17:27:02.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.245+0000 7f5f13d24800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.36.0 2024-09-12T17:27:02.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.246+0000 7f5f13d24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 : hit (requested=0x17, cached=0x17) 2024-09-12T17:27:02.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.246+0000 7f5f13d24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 2024-09-12T17:27:02.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.247+0000 7f5f13d24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 info.flags=0x17 2024-09-12T17:27:02.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.247+0000 7f5f13d24800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 to cache LRU end 2024-09-12T17:27:02.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.247+0000 7f5f13d24800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:02.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.247+0000 7f5f13d24800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36, ofs0, ns] 2024-09-12T17:27:02.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.247+0000 7f5dee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464348 cookie 94649081481344 notifier 7719 bl.length()=975 2024-09-12T17:27:02.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.247+0000 7f5dee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 info.flags=0x17 2024-09-12T17:27:02.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.247+0000 7f5dee7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 to cache LRU end 2024-09-12T17:27:02.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.247+0000 7f5dee7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:02.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.249+0000 7f5f13d24800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.36]): orig_sources= new_sources= 2024-09-12T17:27:02.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.249+0000 7f5f13d24800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.36]): potential sources added=[] removed=[] 2024-09-12T17:27:02.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.249+0000 7f5f13d24800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.36]): orig_dests= new_dests= 2024-09-12T17:27:02.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.249+0000 7f5f13d24800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.36]): potential dests added=[] removed=[] 2024-09-12T17:27:02.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.250+0000 7f5f13d24800 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-12T17:27:02.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.252+0000 7f5dc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:02.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.254+0000 7f5f13d24800 20 remove_watcher() i=0 2024-09-12T17:27:02.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.254+0000 7f5f13d24800 2 removed watcher, disabling cache 2024-09-12T17:27:02.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.255+0000 7f5f13d24800 20 remove_watcher() i=1 2024-09-12T17:27:02.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.256+0000 7f5f13d24800 20 remove_watcher() i=2 2024-09-12T17:27:02.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.257+0000 7f5f13d24800 20 remove_watcher() i=3 2024-09-12T17:27:02.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.258+0000 7f5f13d24800 20 remove_watcher() i=4 2024-09-12T17:27:02.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.259+0000 7f5f13d24800 20 remove_watcher() i=5 2024-09-12T17:27:02.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.260+0000 7f5f13d24800 20 remove_watcher() i=6 2024-09-12T17:27:02.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.261+0000 7f5f13d24800 20 remove_watcher() i=7 2024-09-12T17:27:02.274 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:27:02.303 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:02.303 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:02.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.341+0000 7effabb36800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.342+0000 7effabb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:02.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.342+0000 7effabb36800 20 realm 2024-09-12T17:27:02.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.342+0000 7effabb36800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.342+0000 7effabb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:02.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.342+0000 7effabb36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:02.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.342+0000 7effabb36800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.343+0000 7effabb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:02.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.343+0000 7effabb36800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.344+0000 7effabb36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:02.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.344+0000 7effabb36800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.344+0000 7effabb36800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:02.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.344+0000 7effabb36800 20 searching for the correct realm 2024-09-12T17:27:02.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.347+0000 7effa70b6640 0 -- 172.21.15.67:0/2209466483 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55e709722f40 msgr2=0x55e709725330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:02.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.350+0000 7effa78b7640 0 -- 172.21.15.67:0/2209466483 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7eff9c0843f0 msgr2=0x7eff9c084870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:02.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.556+0000 7effabb36800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:02.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.556+0000 7effabb36800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:02.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.556+0000 7effabb36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:02.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.556+0000 7effabb36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:02.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.556+0000 7effabb36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:02.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.556+0000 7effabb36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:02.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.556+0000 7effabb36800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.556+0000 7effabb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:02.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.556+0000 7effabb36800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.556+0000 7effabb36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:02.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.556+0000 7effabb36800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.557+0000 7effabb36800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:02.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.557+0000 7effabb36800 20 zone default found 2024-09-12T17:27:02.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.557+0000 7effabb36800 4 Realm: () 2024-09-12T17:27:02.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.557+0000 7effabb36800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:02.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.557+0000 7effabb36800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:02.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.557+0000 7effabb36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:02.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.557+0000 7effabb36800 20 zonegroup default 2024-09-12T17:27:02.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.557+0000 7effabb36800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.557+0000 7effabb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:02.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.557+0000 7effabb36800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.557+0000 7effabb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:02.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.557+0000 7effabb36800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.558+0000 7effabb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:02.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.558+0000 7effabb36800 20 started sync module instance, tier type = 2024-09-12T17:27:02.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.558+0000 7effabb36800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:02.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.566+0000 7effabb36800 20 add_watcher() i=0 2024-09-12T17:27:02.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.566+0000 7effabb36800 20 add_watcher() i=1 2024-09-12T17:27:02.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.566+0000 7effabb36800 20 add_watcher() i=2 2024-09-12T17:27:02.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.566+0000 7effabb36800 20 add_watcher() i=3 2024-09-12T17:27:02.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.566+0000 7effabb36800 20 add_watcher() i=4 2024-09-12T17:27:02.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.566+0000 7effabb36800 20 add_watcher() i=5 2024-09-12T17:27:02.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.567+0000 7effabb36800 20 add_watcher() i=6 2024-09-12T17:27:02.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.568+0000 7effabb36800 20 add_watcher() i=7 2024-09-12T17:27:02.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.568+0000 7effabb36800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:02.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.569+0000 7efe5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:02.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.569+0000 7effabb36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:02.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.569+0000 7effabb36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:02.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.569+0000 7effabb36800 5 note: GC not initialized 2024-09-12T17:27:02.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.570+0000 7efe5cfe1640 20 reqs_thread_entry: start 2024-09-12T17:27:02.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.570+0000 7effabb36800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:02.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.570+0000 7effabb36800 20 Filter name: none 2024-09-12T17:27:02.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.570+0000 7efdd67fc640 20 reqs_thread_entry: start 2024-09-12T17:27:02.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.570+0000 7effabb36800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.570+0000 7effabb36800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:27:02.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.570+0000 7effabb36800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.571+0000 7effabb36800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:27:02.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.571+0000 7effabb36800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:02.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.571+0000 7effabb36800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.571+0000 7effabb36800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:27:02.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.571+0000 7effabb36800 20 rados->read ofs=0 len=0 2024-09-12T17:27:02.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.572+0000 7effabb36800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:27:02.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.572+0000 7effabb36800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:02.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.573+0000 7efe5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:02.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.575+0000 7effabb36800 20 remove_watcher() i=0 2024-09-12T17:27:02.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.575+0000 7effabb36800 2 removed watcher, disabling cache 2024-09-12T17:27:02.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.576+0000 7effabb36800 20 remove_watcher() i=1 2024-09-12T17:27:02.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.577+0000 7effabb36800 20 remove_watcher() i=2 2024-09-12T17:27:02.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.578+0000 7effabb36800 20 remove_watcher() i=3 2024-09-12T17:27:02.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.579+0000 7effabb36800 20 remove_watcher() i=4 2024-09-12T17:27:02.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.580+0000 7effabb36800 20 remove_watcher() i=5 2024-09-12T17:27:02.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.581+0000 7effabb36800 20 remove_watcher() i=6 2024-09-12T17:27:02.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:02.582+0000 7effabb36800 20 remove_watcher() i=7 2024-09-12T17:27:02.595 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:02.595 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:27:02.595 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-logrecord-writes id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.36 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:27:02.595 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:02.597 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:02.597 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:02.618 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:02.619 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:02.839 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:02.839 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:02.904 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-12T17:27:02.904 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:02.905 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:02.906 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:02.948 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:02.948 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:03.005 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:03.006 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:03.045 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:03.045 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:03.081 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:03.081 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:03.118 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:03.118 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:03.154 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:03.154 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:03.191 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:03.191 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:03.227 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:03.228 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:03.265 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:03.265 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:03.300 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:03.300 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:03.338 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:03.338 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:03.375 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:03.375 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:03.410 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:03.410 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:03.446 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:03.446 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:03.482 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:03.482 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:03.518 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:03.518 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:03.555 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:03.555 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:03.591 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:03.591 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:03.627 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:03.627 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:03.666 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:03.666 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:03.702 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:03.703 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:03.739 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T17:27:03.768 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:03.768 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:03.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:03.805+0000 7fdd6452c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:03.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:03.807+0000 7fdd6452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:03.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:03.807+0000 7fdd6452c800 20 realm 2024-09-12T17:27:03.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:03.807+0000 7fdd6452c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:03.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:03.807+0000 7fdd6452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:03.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:03.807+0000 7fdd6452c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:03.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:03.807+0000 7fdd6452c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:03.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:03.807+0000 7fdd6452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:03.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:03.807+0000 7fdd6452c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:03.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:03.808+0000 7fdd6452c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:03.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:03.808+0000 7fdd6452c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:03.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:03.809+0000 7fdd6452c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:03.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:03.809+0000 7fdd6452c800 20 searching for the correct realm 2024-09-12T17:27:03.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:03.811+0000 7fdd5f960640 0 -- 172.21.15.67:0/3447524022 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55981b001b30 msgr2=0x55981b003f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:03.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:03.815+0000 7fdd60161640 0 -- 172.21.15.67:0/3447524022 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fdd54040ba0 msgr2=0x7fdd54035930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:04.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.022+0000 7fdd6452c800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:04.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.022+0000 7fdd6452c800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:04.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.022+0000 7fdd6452c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:04.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.022+0000 7fdd6452c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:04.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.022+0000 7fdd6452c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:04.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.022+0000 7fdd6452c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:04.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.022+0000 7fdd6452c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.023+0000 7fdd6452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.023+0000 7fdd6452c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.023+0000 7fdd6452c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:04.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.023+0000 7fdd6452c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.023+0000 7fdd6452c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:04.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.023+0000 7fdd6452c800 20 zone default found 2024-09-12T17:27:04.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.023+0000 7fdd6452c800 4 Realm: () 2024-09-12T17:27:04.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.023+0000 7fdd6452c800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:04.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.023+0000 7fdd6452c800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:04.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.023+0000 7fdd6452c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:04.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.023+0000 7fdd6452c800 20 zonegroup default 2024-09-12T17:27:04.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.023+0000 7fdd6452c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.024+0000 7fdd6452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.024+0000 7fdd6452c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.024+0000 7fdd6452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.024+0000 7fdd6452c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.025+0000 7fdd6452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.025+0000 7fdd6452c800 20 started sync module instance, tier type = 2024-09-12T17:27:04.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.025+0000 7fdd6452c800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:04.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.033+0000 7fdd6452c800 20 add_watcher() i=0 2024-09-12T17:27:04.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.033+0000 7fdd6452c800 20 add_watcher() i=1 2024-09-12T17:27:04.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.033+0000 7fdd6452c800 20 add_watcher() i=2 2024-09-12T17:27:04.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.033+0000 7fdd6452c800 20 add_watcher() i=3 2024-09-12T17:27:04.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.033+0000 7fdd6452c800 20 add_watcher() i=4 2024-09-12T17:27:04.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.033+0000 7fdd6452c800 20 add_watcher() i=5 2024-09-12T17:27:04.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.033+0000 7fdd6452c800 20 add_watcher() i=6 2024-09-12T17:27:04.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.035+0000 7fdd6452c800 20 add_watcher() i=7 2024-09-12T17:27:04.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.035+0000 7fdd6452c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:04.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.036+0000 7fdc16fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:04.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.036+0000 7fdd6452c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:04.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.036+0000 7fdd6452c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:04.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.036+0000 7fdd6452c800 5 note: GC not initialized 2024-09-12T17:27:04.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.037+0000 7fdc15fdb640 20 reqs_thread_entry: start 2024-09-12T17:27:04.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.037+0000 7fdd6452c800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:04.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.037+0000 7fdd6452c800 20 Filter name: none 2024-09-12T17:27:04.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.037+0000 7fdb877fe640 20 reqs_thread_entry: start 2024-09-12T17:27:04.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.037+0000 7fdd6452c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.037+0000 7fdd6452c800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:27:04.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.037+0000 7fdd6452c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.038+0000 7fdd6452c800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:27:04.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.038+0000 7fdd6452c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:04.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.038+0000 7fdd6452c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.038+0000 7fdd6452c800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:27:04.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.038+0000 7fdd6452c800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.039+0000 7fdd6452c800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:27:04.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.039+0000 7fdd6452c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:04.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.040+0000 7fdc16fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:04.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.042+0000 7fdd6452c800 20 remove_watcher() i=0 2024-09-12T17:27:04.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.042+0000 7fdd6452c800 2 removed watcher, disabling cache 2024-09-12T17:27:04.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.043+0000 7fdd6452c800 20 remove_watcher() i=1 2024-09-12T17:27:04.046 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.044+0000 7fdd6452c800 20 remove_watcher() i=2 2024-09-12T17:27:04.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.045+0000 7fdd6452c800 20 remove_watcher() i=3 2024-09-12T17:27:04.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.046+0000 7fdd6452c800 20 remove_watcher() i=4 2024-09-12T17:27:04.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.047+0000 7fdd6452c800 20 remove_watcher() i=5 2024-09-12T17:27:04.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.048+0000 7fdd6452c800 20 remove_watcher() i=6 2024-09-12T17:27:04.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.049+0000 7fdd6452c800 20 remove_watcher() i=7 2024-09-12T17:27:04.062 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.062 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:27:04.062 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-logrecord-writes id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:27:04.062 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.065 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T17:27:04.099 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:04.099 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:04.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.137+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.138+0000 7f59dbc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.138+0000 7f59dbc1b800 20 realm 2024-09-12T17:27:04.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.138+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.138+0000 7f59dbc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.138+0000 7f59dbc1b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:04.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.138+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.139+0000 7f59dbc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.139+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.140+0000 7f59dbc1b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:04.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.140+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.140+0000 7f59dbc1b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:04.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.140+0000 7f59dbc1b800 20 searching for the correct realm 2024-09-12T17:27:04.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.144+0000 7f59d6bea640 0 -- 172.21.15.67:0/4236327666 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x5621879b6070 msgr2=0x5621879b84f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:04.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.147+0000 7f59d6bea640 0 -- 172.21.15.67:0/4236327666 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x5621879bdb70 msgr2=0x5621879bff60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:27:04.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:04.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:04.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:04.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:04.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:04.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:04.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:04.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:04.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 zone default found 2024-09-12T17:27:04.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.153+0000 7f59dbc1b800 4 Realm: () 2024-09-12T17:27:04.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.153+0000 7f59dbc1b800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:04.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.153+0000 7f59dbc1b800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:04.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.153+0000 7f59dbc1b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:04.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 zonegroup default 2024-09-12T17:27:04.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 started sync module instance, tier type = 2024-09-12T17:27:04.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:04.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.162+0000 7f59dbc1b800 20 add_watcher() i=0 2024-09-12T17:27:04.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.162+0000 7f59dbc1b800 20 add_watcher() i=1 2024-09-12T17:27:04.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.162+0000 7f59dbc1b800 20 add_watcher() i=2 2024-09-12T17:27:04.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.162+0000 7f59dbc1b800 20 add_watcher() i=3 2024-09-12T17:27:04.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.162+0000 7f59dbc1b800 20 add_watcher() i=4 2024-09-12T17:27:04.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.162+0000 7f59dbc1b800 20 add_watcher() i=5 2024-09-12T17:27:04.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.162+0000 7f59dbc1b800 20 add_watcher() i=6 2024-09-12T17:27:04.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.163+0000 7f59dbc1b800 20 add_watcher() i=7 2024-09-12T17:27:04.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.163+0000 7f59dbc1b800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:04.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.164+0000 7f588dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:04.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.165+0000 7f59dbc1b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:04.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.165+0000 7f59dbc1b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:04.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.165+0000 7f59dbc1b800 5 note: GC not initialized 2024-09-12T17:27:04.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.165+0000 7f588cfe1640 20 reqs_thread_entry: start 2024-09-12T17:27:04.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.165+0000 7f59dbc1b800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:04.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.165+0000 7f59dbc1b800 20 Filter name: none 2024-09-12T17:27:04.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.165+0000 7f58067fc640 20 reqs_thread_entry: start 2024-09-12T17:27:04.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.165+0000 7f59dbc1b800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:27:04.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.165+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.166+0000 7f59dbc1b800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:27:04.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.166+0000 7f59dbc1b800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:27:04.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.166+0000 7f59dbc1b800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:27:04.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.166+0000 7f59dbc1b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 : miss 2024-09-12T17:27:04.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.166+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.166+0000 7f59dbc1b800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:27:04.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.166+0000 7f59dbc1b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 info.flags=0x17 2024-09-12T17:27:04.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.166+0000 7f59dbc1b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 to cache LRU end 2024-09-12T17:27:04.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.166+0000 7f59dbc1b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:04.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.166+0000 7f59dbc1b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:04.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.166+0000 7f59dbc1b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 2024-09-12T17:27:04.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.170+0000 7f59dbc1b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 info.flags=0x17 2024-09-12T17:27:04.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.170+0000 7f59dbc1b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 to cache LRU end 2024-09-12T17:27:04.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.170+0000 7f59dbc1b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:04.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.170+0000 7f59dbc1b800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37, ofs0, ns] 2024-09-12T17:27:04.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.170+0000 7f58baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464309 cookie 94702009052544 notifier 7310 bl.length()=1007 2024-09-12T17:27:04.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.170+0000 7f58baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 info.flags=0x17 2024-09-12T17:27:04.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.170+0000 7f58baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 to cache LRU end 2024-09-12T17:27:04.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.170+0000 7f58baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:04.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.172+0000 7f59dbc1b800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.37]): orig_sources= new_sources= 2024-09-12T17:27:04.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.172+0000 7f59dbc1b800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.37]): potential sources added=[] removed=[] 2024-09-12T17:27:04.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.172+0000 7f59dbc1b800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.37]): orig_dests= new_dests= 2024-09-12T17:27:04.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.172+0000 7f59dbc1b800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.37]): potential dests added=[] removed=[] 2024-09-12T17:27:04.175 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f59dbc1b800 time 2024-09-12T17:27:04.175547+0000 2024-09-12T17:27:04.175 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:27:04.176 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:27:04.176 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f59dcd8c71a] 2024-09-12T17:27:04.176 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f59dcd8c8d8] 2024-09-12T17:27:04.176 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562184fde841] 2024-09-12T17:27:04.176 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd7490c) [0x5621854ec90c] 2024-09-12T17:27:04.176 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562184fee50d] 2024-09-12T17:27:04.177 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:27:04.177 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f59dba29590] 2024-09-12T17:27:04.177 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:27:04.177 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:27:04.177 INFO:tasks.workunit.client.0.smithi067.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:27:04.177 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f59dbc1b800 thread_name:radosgw-admin 2024-09-12T17:27:04.177 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.174+0000 7f59dbc1b800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f59dbc1b800 time 2024-09-12T17:27:04.175547+0000 2024-09-12T17:27:04.177 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:27:04.177 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.177 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:27:04.177 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f59dcd8c71a] 2024-09-12T17:27:04.177 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f59dcd8c8d8] 2024-09-12T17:27:04.177 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562184fde841] 2024-09-12T17:27:04.178 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd7490c) [0x5621854ec90c] 2024-09-12T17:27:04.178 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562184fee50d] 2024-09-12T17:27:04.178 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:27:04.178 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f59dba29590] 2024-09-12T17:27:04.178 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:27:04.178 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:27:04.178 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.197 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:27:04.197 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f59dba3e6f0] 2024-09-12T17:27:04.197 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f59dba8b99c] 2024-09-12T17:27:04.197 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:27:04.197 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:27:04.197 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f59dcd8c774] 2024-09-12T17:27:04.197 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f59dcd8c8d8] 2024-09-12T17:27:04.197 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562184fde841] 2024-09-12T17:27:04.197 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd7490c) [0x5621854ec90c] 2024-09-12T17:27:04.198 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562184fee50d] 2024-09-12T17:27:04.198 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:27:04.198 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f59dba29590] 2024-09-12T17:27:04.198 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:27:04.198 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:27:04.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.175+0000 7f59dbc1b800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:27:04.198 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f59dbc1b800 thread_name:radosgw-admin 2024-09-12T17:27:04.198 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.198 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:27:04.198 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f59dba3e6f0] 2024-09-12T17:27:04.198 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f59dba8b99c] 2024-09-12T17:27:04.198 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:27:04.198 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:27:04.198 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f59dcd8c774] 2024-09-12T17:27:04.199 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f59dcd8c8d8] 2024-09-12T17:27:04.199 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562184fde841] 2024-09-12T17:27:04.199 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd7490c) [0x5621854ec90c] 2024-09-12T17:27:04.199 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562184fee50d] 2024-09-12T17:27:04.199 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:27:04.199 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f59dba29590] 2024-09-12T17:27:04.199 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:27:04.199 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:27:04.199 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:27:04.199 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.199 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T17:27:04.199 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T17:27:04.119+0000 7f59dbc1b800 4 set_mon_vals no callback set 2024-09-12T17:27:04.199 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T17:27:04.119+0000 7f59dbc1b800 10 monclient: shutdown 2024-09-12T17:27:04.200 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T17:27:04.119+0000 7f59dbc1b800 5 asok(0x5621876a7730) unregister_commands rotate-key 2024-09-12T17:27:04.200 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 10 monclient: build_initial_monmap 2024-09-12T17:27:04.200 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 1 build_initial for_mkfs: 0 2024-09-12T17:27:04.200 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 10 monclient: monmap: 2024-09-12T17:27:04.200 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:27:04.200 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:27:04.200 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:27:04.200 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:27:04.200 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:27:04.200 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:04.200 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:27:04.200 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:27:04.200 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:27:04.201 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.201 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding auth protocol: cephx 2024-09-12T17:27:04.201 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding auth protocol: cephx 2024-09-12T17:27:04.201 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding auth protocol: cephx 2024-09-12T17:27:04.201 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding con mode: secure 2024-09-12T17:27:04.201 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding con mode: crc 2024-09-12T17:27:04.201 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding con mode: secure 2024-09-12T17:27:04.201 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding con mode: crc 2024-09-12T17:27:04.201 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding con mode: secure 2024-09-12T17:27:04.201 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding con mode: crc 2024-09-12T17:27:04.201 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding con mode: crc 2024-09-12T17:27:04.201 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding con mode: secure 2024-09-12T17:27:04.201 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding con mode: crc 2024-09-12T17:27:04.202 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding con mode: secure 2024-09-12T17:27:04.202 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding con mode: crc 2024-09-12T17:27:04.202 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding con mode: secure 2024-09-12T17:27:04.202 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:04.202 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 1 librados: starting msgr at 2024-09-12T17:27:04.202 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 1 librados: starting objecter 2024-09-12T17:27:04.202 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command objecter_requests hook 0x5621878d1e70 2024-09-12T17:27:04.202 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 1 librados: setting wanted keys 2024-09-12T17:27:04.202 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 1 librados: calling monclient init 2024-09-12T17:27:04.202 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 10 monclient: init 2024-09-12T17:27:04.202 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding auth protocol: cephx 2024-09-12T17:27:04.202 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding auth protocol: cephx 2024-09-12T17:27:04.202 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding auth protocol: cephx 2024-09-12T17:27:04.202 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding con mode: secure 2024-09-12T17:27:04.203 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding con mode: crc 2024-09-12T17:27:04.203 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding con mode: secure 2024-09-12T17:27:04.203 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding con mode: crc 2024-09-12T17:27:04.203 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding con mode: secure 2024-09-12T17:27:04.203 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding con mode: crc 2024-09-12T17:27:04.203 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding con mode: crc 2024-09-12T17:27:04.203 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding con mode: secure 2024-09-12T17:27:04.203 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding con mode: crc 2024-09-12T17:27:04.203 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding con mode: secure 2024-09-12T17:27:04.203 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding con mode: crc 2024-09-12T17:27:04.203 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding con mode: secure 2024-09-12T17:27:04.203 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:04.203 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:04.203 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command rotate-key hook 0x5621878cbe38 2024-09-12T17:27:04.204 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient: _reopen_session rank -1 2024-09-12T17:27:04.204 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:27:04.204 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient(hunting): picked mon.noname-a con 0x562187781ad0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:27:04.204 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient(hunting): picked mon.noname-c con 0x56218780ef70 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:27:04.204 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient(hunting): picked mon.noname-b con 0x562187812040 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:27:04.204 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:04.204 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:04.204 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:04.204 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient(hunting): _renew_subs 2024-09-12T17:27:04.204 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient(hunting): authenticate will time out at 2435.472133s 2024-09-12T17:27:04.204 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T17:27:04.121+0000 7f59d73eb640 10 monclient(hunting): get_auth_request con 0x562187781ad0 auth_method 0 2024-09-12T17:27:04.204 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T17:27:04.121+0000 7f59d73eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:04.204 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T17:27:04.121+0000 7f59d73eb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:04.205 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T17:27:04.121+0000 7f59d73eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:04.205 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T17:27:04.121+0000 7f59d6bea640 10 monclient(hunting): get_auth_request con 0x56218780ef70 auth_method 0 2024-09-12T17:27:04.205 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T17:27:04.121+0000 7f59d6bea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:04.205 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T17:27:04.121+0000 7f59d6bea640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:04.205 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T17:27:04.121+0000 7f59d6bea640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:04.205 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T17:27:04.121+0000 7f59d6bea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:04.205 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T17:27:04.121+0000 7f59d6bea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:04.205 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T17:27:04.121+0000 7f59d6bea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:04.205 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T17:27:04.121+0000 7f59d73eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:04.205 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T17:27:04.121+0000 7f59d73eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:04.205 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T17:27:04.121+0000 7f59d73eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:04.205 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T17:27:04.121+0000 7f59d7bec640 10 monclient(hunting): get_auth_request con 0x562187812040 auth_method 0 2024-09-12T17:27:04.205 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T17:27:04.121+0000 7f59d7bec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:04.206 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T17:27:04.121+0000 7f59d7bec640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:04.206 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T17:27:04.121+0000 7f59d7bec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:04.206 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T17:27:04.121+0000 7f59d6bea640 10 monclient(hunting): handle_auth_done global_id 7301 payload 824 2024-09-12T17:27:04.206 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T17:27:04.121+0000 7f59d6bea640 10 monclient: _finish_hunting 0 2024-09-12T17:27:04.206 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T17:27:04.121+0000 7f59d6bea640 1 monclient: found mon.noname-c 2024-09-12T17:27:04.206 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T17:27:04.121+0000 7f59d6bea640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:27:04.206 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T17:27:04.121+0000 7f58c3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:04.206 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T17:27:04.121+0000 7f58c3e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:27:04.206 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T17:27:04.121+0000 7f58c3e07640 10 monclient: dump: 2024-09-12T17:27:04.206 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:04.206 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:04.206 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.206 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.206 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:04.207 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:04.207 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:04.207 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:04.207 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:04.207 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.207 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T17:27:04.121+0000 7f58c3e07640 10 monclient: _finish_auth 0 2024-09-12T17:27:04.207 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T17:27:04.121+0000 7f58c3e07640 10 monclient: _check_auth_tickets 2024-09-12T17:27:04.207 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T17:27:04.121+0000 7f58c3e07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:27:04.207 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T17:27:04.121+0000 7f58c3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:04.207 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T17:27:04.121+0000 7f58c3e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:27:04.207 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T17:27:04.121+0000 7f58c3e07640 10 monclient: dump: 2024-09-12T17:27:04.207 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:04.208 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:04.208 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.208 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.208 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:04.208 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:04.208 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:04.208 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:04.208 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:04.208 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.208 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 5 monclient: authenticate success, global_id 7301 2024-09-12T17:27:04.208 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient: _renew_subs 2024-09-12T17:27:04.208 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T17:27:04.121+0000 7f58c560a640 4 set_mon_vals no callback set 2024-09-12T17:27:04.208 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:04.209 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient: _renew_subs 2024-09-12T17:27:04.209 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:04.209 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 1 librados: init done 2024-09-12T17:27:04.209 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T17:27:04.123+0000 7f58c3e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:27:04.209 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T17:27:04.123+0000 7f58c3e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:27:04.209 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T17:27:04.123+0000 7f58c3e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:27:04.209 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T17:27:04.123+0000 7f59d73eb640 10 monclient: get_auth_request con 0x7f58bc076470 auth_method 0 2024-09-12T17:27:04.209 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T17:27:04.124+0000 7f59d7bec640 10 monclient: get_auth_request con 0x5621878f47d0 auth_method 0 2024-09-12T17:27:04.209 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T17:27:04.124+0000 7f59d73eb640 10 monclient: get_auth_request con 0x562187917240 auth_method 0 2024-09-12T17:27:04.209 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T17:27:04.125+0000 7f59d6bea640 10 monclient: get_auth_request con 0x56218791b430 auth_method 0 2024-09-12T17:27:04.209 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 10 monclient: build_initial_monmap 2024-09-12T17:27:04.209 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 1 build_initial for_mkfs: 0 2024-09-12T17:27:04.210 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 10 monclient: monmap: 2024-09-12T17:27:04.210 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:27:04.210 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:27:04.210 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:27:04.210 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:27:04.210 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:27:04.210 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:04.210 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:27:04.210 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:27:04.210 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:27:04.210 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.210 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding auth protocol: cephx 2024-09-12T17:27:04.210 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding auth protocol: cephx 2024-09-12T17:27:04.211 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding auth protocol: cephx 2024-09-12T17:27:04.211 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding con mode: secure 2024-09-12T17:27:04.211 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding con mode: crc 2024-09-12T17:27:04.211 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding con mode: secure 2024-09-12T17:27:04.211 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding con mode: crc 2024-09-12T17:27:04.211 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding con mode: secure 2024-09-12T17:27:04.211 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding con mode: crc 2024-09-12T17:27:04.211 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding con mode: crc 2024-09-12T17:27:04.211 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding con mode: secure 2024-09-12T17:27:04.211 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding con mode: crc 2024-09-12T17:27:04.211 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding con mode: secure 2024-09-12T17:27:04.211 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding con mode: crc 2024-09-12T17:27:04.211 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding con mode: secure 2024-09-12T17:27:04.212 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:04.212 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command objecter_requests cmddesc objecter_requests hook 0x562187923600 EEXIST 2024-09-12T17:27:04.212 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 10 monclient: init 2024-09-12T17:27:04.212 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding auth protocol: cephx 2024-09-12T17:27:04.212 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding auth protocol: cephx 2024-09-12T17:27:04.212 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding auth protocol: cephx 2024-09-12T17:27:04.212 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding con mode: secure 2024-09-12T17:27:04.212 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding con mode: crc 2024-09-12T17:27:04.212 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding con mode: secure 2024-09-12T17:27:04.212 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding con mode: crc 2024-09-12T17:27:04.212 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding con mode: secure 2024-09-12T17:27:04.212 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding con mode: crc 2024-09-12T17:27:04.213 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding con mode: crc 2024-09-12T17:27:04.213 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding con mode: secure 2024-09-12T17:27:04.213 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding con mode: crc 2024-09-12T17:27:04.213 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding con mode: secure 2024-09-12T17:27:04.213 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding con mode: crc 2024-09-12T17:27:04.213 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding con mode: secure 2024-09-12T17:27:04.213 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T17:27:04.128+0000 7f59dbc1b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:04.213 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T17:27:04.128+0000 7f59dbc1b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:04.213 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T17:27:04.128+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command rotate-key cmddesc rotate-key hook 0x56218791e9a0 EEXIST 2024-09-12T17:27:04.213 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T17:27:04.128+0000 7f59dbc1b800 10 monclient: _reopen_session rank -1 2024-09-12T17:27:04.213 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T17:27:04.128+0000 7f59dbc1b800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:27:04.213 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T17:27:04.128+0000 7f59dbc1b800 10 monclient(hunting): picked mon.noname-a con 0x562187947920 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:27:04.213 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T17:27:04.128+0000 7f59dbc1b800 10 monclient(hunting): picked mon.noname-b con 0x562187947d00 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:27:04.214 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T17:27:04.128+0000 7f59dbc1b800 10 monclient(hunting): picked mon.noname-c con 0x562187946630 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:27:04.214 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T17:27:04.128+0000 7f59dbc1b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:04.214 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T17:27:04.128+0000 7f59dbc1b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:04.214 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T17:27:04.128+0000 7f59dbc1b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:04.214 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T17:27:04.128+0000 7f59dbc1b800 10 monclient(hunting): _renew_subs 2024-09-12T17:27:04.214 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T17:27:04.128+0000 7f59dbc1b800 10 monclient(hunting): authenticate will time out at 2435.479465s 2024-09-12T17:27:04.214 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T17:27:04.128+0000 7f59d73eb640 10 monclient(hunting): get_auth_request con 0x562187947920 auth_method 0 2024-09-12T17:27:04.214 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T17:27:04.128+0000 7f59d73eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:04.214 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T17:27:04.128+0000 7f59d73eb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:04.214 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T17:27:04.128+0000 7f59d73eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:04.214 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T17:27:04.128+0000 7f59d7bec640 10 monclient(hunting): get_auth_request con 0x562187946630 auth_method 0 2024-09-12T17:27:04.214 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T17:27:04.128+0000 7f59d7bec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:04.214 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T17:27:04.128+0000 7f59d7bec640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:04.215 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T17:27:04.128+0000 7f59d7bec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:04.215 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T17:27:04.128+0000 7f59d6bea640 10 monclient(hunting): get_auth_request con 0x562187947d00 auth_method 0 2024-09-12T17:27:04.215 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T17:27:04.128+0000 7f59d6bea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:04.215 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T17:27:04.128+0000 7f59d6bea640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:04.215 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T17:27:04.128+0000 7f59d6bea640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:04.215 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T17:27:04.128+0000 7f59d73eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:04.215 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T17:27:04.128+0000 7f59d73eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:04.215 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T17:27:04.128+0000 7f59d73eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:04.215 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T17:27:04.128+0000 7f59d7bec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:04.215 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T17:27:04.128+0000 7f59d7bec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:04.215 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T17:27:04.128+0000 7f59d7bec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:04.215 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T17:27:04.128+0000 7f59d6bea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:04.215 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T17:27:04.128+0000 7f59d6bea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:04.216 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T17:27:04.128+0000 7f59d6bea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:04.216 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T17:27:04.128+0000 7f59d7bec640 10 monclient(hunting): handle_auth_done global_id 7304 payload 824 2024-09-12T17:27:04.216 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T17:27:04.128+0000 7f59d7bec640 10 monclient: _finish_hunting 0 2024-09-12T17:27:04.216 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T17:27:04.128+0000 7f59d7bec640 1 monclient: found mon.noname-c 2024-09-12T17:27:04.216 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T17:27:04.128+0000 7f59d7bec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:27:04.216 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T17:27:04.129+0000 7f58c1602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:04.216 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T17:27:04.129+0000 7f58c1602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:27:04.216 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T17:27:04.129+0000 7f58c1602640 10 monclient: dump: 2024-09-12T17:27:04.216 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:04.216 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:04.216 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.216 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.216 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:04.217 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:04.217 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:04.217 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:04.217 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:04.217 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.217 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T17:27:04.129+0000 7f58c1602640 10 monclient: _finish_auth 0 2024-09-12T17:27:04.217 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T17:27:04.129+0000 7f58c1602640 10 monclient: _check_auth_tickets 2024-09-12T17:27:04.217 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T17:27:04.129+0000 7f58c1602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:27:04.217 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T17:27:04.129+0000 7f58c1602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:04.217 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T17:27:04.129+0000 7f58c1602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:27:04.217 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T17:27:04.129+0000 7f58c1602640 10 monclient: dump: 2024-09-12T17:27:04.217 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:04.217 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:04.217 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.218 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.218 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:04.218 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:04.220 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:04.220 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:04.221 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:04.221 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.221 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T17:27:04.129+0000 7f59dbc1b800 5 monclient: authenticate success, global_id 7304 2024-09-12T17:27:04.221 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T17:27:04.129+0000 7f59dbc1b800 10 monclient: _renew_subs 2024-09-12T17:27:04.221 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T17:27:04.129+0000 7f59dbc1b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:04.221 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T17:27:04.129+0000 7f59d83ed640 4 set_mon_vals no callback set 2024-09-12T17:27:04.221 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T17:27:04.129+0000 7f59dbc1b800 10 monclient: _renew_subs 2024-09-12T17:27:04.221 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T17:27:04.129+0000 7f59dbc1b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:04.221 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T17:27:04.131+0000 7f58c1602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:27:04.221 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T17:27:04.131+0000 7f58c1602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:27:04.221 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T17:27:04.131+0000 7f58c1602640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:27:04.221 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T17:27:04.131+0000 7f59d73eb640 10 monclient: get_auth_request con 0x7f58b0076380 auth_method 0 2024-09-12T17:27:04.221 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 10 monclient: get_monmap_and_config 2024-09-12T17:27:04.222 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 10 monclient: build_initial_monmap 2024-09-12T17:27:04.222 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 1 build_initial for_mkfs: 0 2024-09-12T17:27:04.222 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 10 monclient: monmap: 2024-09-12T17:27:04.222 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:27:04.222 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:27:04.222 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:27:04.222 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:27:04.222 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:27:04.222 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:04.222 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:27:04.222 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:27:04.222 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:27:04.222 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.223 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding auth protocol: cephx 2024-09-12T17:27:04.223 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding auth protocol: cephx 2024-09-12T17:27:04.223 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding auth protocol: cephx 2024-09-12T17:27:04.223 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding con mode: secure 2024-09-12T17:27:04.223 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding con mode: crc 2024-09-12T17:27:04.223 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding con mode: secure 2024-09-12T17:27:04.223 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding con mode: crc 2024-09-12T17:27:04.223 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding con mode: secure 2024-09-12T17:27:04.223 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding con mode: crc 2024-09-12T17:27:04.223 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding con mode: crc 2024-09-12T17:27:04.223 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding con mode: secure 2024-09-12T17:27:04.223 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding con mode: crc 2024-09-12T17:27:04.224 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding con mode: secure 2024-09-12T17:27:04.224 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding con mode: crc 2024-09-12T17:27:04.224 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding con mode: secure 2024-09-12T17:27:04.224 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:04.224 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 10 monclient: init 2024-09-12T17:27:04.224 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding auth protocol: cephx 2024-09-12T17:27:04.224 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding auth protocol: cephx 2024-09-12T17:27:04.224 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding auth protocol: cephx 2024-09-12T17:27:04.224 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding con mode: secure 2024-09-12T17:27:04.224 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding con mode: crc 2024-09-12T17:27:04.224 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding con mode: secure 2024-09-12T17:27:04.224 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding con mode: crc 2024-09-12T17:27:04.224 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding con mode: secure 2024-09-12T17:27:04.225 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding con mode: crc 2024-09-12T17:27:04.225 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding con mode: crc 2024-09-12T17:27:04.225 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding con mode: secure 2024-09-12T17:27:04.225 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding con mode: crc 2024-09-12T17:27:04.225 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding con mode: secure 2024-09-12T17:27:04.225 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding con mode: crc 2024-09-12T17:27:04.225 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding con mode: secure 2024-09-12T17:27:04.225 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T17:27:04.132+0000 7f59dbc1b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:04.225 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T17:27:04.132+0000 7f59dbc1b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:04.225 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T17:27:04.132+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command rotate-key cmddesc rotate-key hook 0x7ffc2b03cae8 EEXIST 2024-09-12T17:27:04.225 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T17:27:04.132+0000 7f59dbc1b800 10 monclient: _reopen_session rank -1 2024-09-12T17:27:04.225 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T17:27:04.132+0000 7f59dbc1b800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:27:04.226 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T17:27:04.132+0000 7f59dbc1b800 10 monclient(hunting): picked mon.noname-b con 0x56218799bdf0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:27:04.226 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T17:27:04.132+0000 7f59dbc1b800 10 monclient(hunting): picked mon.noname-a con 0x56218798c740 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:27:04.226 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T17:27:04.132+0000 7f59dbc1b800 10 monclient(hunting): picked mon.noname-c con 0x562187997220 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:27:04.226 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T17:27:04.132+0000 7f59dbc1b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:04.226 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T17:27:04.132+0000 7f59dbc1b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:04.226 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T17:27:04.132+0000 7f59dbc1b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:04.226 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T17:27:04.132+0000 7f59dbc1b800 10 monclient(hunting): _renew_subs 2024-09-12T17:27:04.226 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T17:27:04.132+0000 7f59dbc1b800 10 monclient(hunting): authenticate will time out at 2435.483415s 2024-09-12T17:27:04.226 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T17:27:04.132+0000 7f59d7bec640 10 monclient(hunting): get_auth_request con 0x562187997220 auth_method 0 2024-09-12T17:27:04.226 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T17:27:04.132+0000 7f59d7bec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:04.226 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T17:27:04.132+0000 7f59d7bec640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:04.226 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T17:27:04.132+0000 7f59d7bec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:04.226 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T17:27:04.132+0000 7f59d6bea640 10 monclient(hunting): get_auth_request con 0x56218798c740 auth_method 0 2024-09-12T17:27:04.227 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T17:27:04.132+0000 7f59d6bea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:04.227 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T17:27:04.132+0000 7f59d6bea640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:04.227 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T17:27:04.132+0000 7f59d6bea640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:04.227 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T17:27:04.132+0000 7f59d7bec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:04.227 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T17:27:04.132+0000 7f59d7bec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:04.227 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T17:27:04.132+0000 7f59d7bec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:04.227 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T17:27:04.132+0000 7f59d6bea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:04.227 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T17:27:04.132+0000 7f59d6bea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:04.227 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T17:27:04.132+0000 7f59d6bea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:04.227 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T17:27:04.132+0000 7f59d73eb640 10 monclient(hunting): get_auth_request con 0x56218799bdf0 auth_method 0 2024-09-12T17:27:04.227 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T17:27:04.132+0000 7f59d73eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:04.227 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T17:27:04.132+0000 7f59d73eb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:04.227 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T17:27:04.132+0000 7f59d73eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:04.228 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T17:27:04.132+0000 7f59d7bec640 10 monclient(hunting): handle_auth_done global_id 7307 payload 274 2024-09-12T17:27:04.228 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T17:27:04.132+0000 7f59d7bec640 10 monclient: _finish_hunting 0 2024-09-12T17:27:04.228 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T17:27:04.132+0000 7f59d7bec640 1 monclient: found mon.noname-c 2024-09-12T17:27:04.228 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T17:27:04.132+0000 7f59d7bec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:27:04.228 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T17:27:04.132+0000 7f58baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:04.228 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T17:27:04.132+0000 7f58baffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:27:04.228 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T17:27:04.132+0000 7f58baffd640 10 monclient: dump: 2024-09-12T17:27:04.228 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:04.228 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:04.228 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.228 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.228 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:04.229 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:04.229 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:04.229 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:04.229 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:04.229 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.229 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T17:27:04.132+0000 7f58baffd640 10 monclient: _finish_auth 0 2024-09-12T17:27:04.229 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T17:27:04.132+0000 7f58baffd640 10 monclient: _check_auth_tickets 2024-09-12T17:27:04.229 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 monclient: authenticate success, global_id 7307 2024-09-12T17:27:04.229 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T17:27:04.133+0000 7f58baffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:27:04.229 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T17:27:04.133+0000 7f58baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:04.229 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T17:27:04.133+0000 7f58baffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:27:04.229 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T17:27:04.133+0000 7f58baffd640 10 monclient: dump: 2024-09-12T17:27:04.229 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:04.230 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:04.230 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.230 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.230 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:04.230 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:04.230 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:04.230 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:04.230 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:04.230 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.230 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 10 monclient: get_monmap_and_config success 2024-09-12T17:27:04.230 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 4 set_mon_vals no callback set 2024-09-12T17:27:04.230 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 10 monclient: shutdown 2024-09-12T17:27:04.230 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 10 monclient: build_initial_monmap 2024-09-12T17:27:04.231 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 1 build_initial for_mkfs: 0 2024-09-12T17:27:04.231 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 10 monclient: monmap: 2024-09-12T17:27:04.231 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:27:04.231 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:27:04.231 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:27:04.231 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:27:04.231 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:27:04.231 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:04.231 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:27:04.231 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:27:04.231 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:27:04.231 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.231 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding auth protocol: cephx 2024-09-12T17:27:04.231 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding auth protocol: cephx 2024-09-12T17:27:04.232 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding auth protocol: cephx 2024-09-12T17:27:04.232 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding con mode: secure 2024-09-12T17:27:04.232 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding con mode: crc 2024-09-12T17:27:04.232 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding con mode: secure 2024-09-12T17:27:04.232 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding con mode: crc 2024-09-12T17:27:04.232 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding con mode: secure 2024-09-12T17:27:04.232 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding con mode: crc 2024-09-12T17:27:04.232 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding con mode: crc 2024-09-12T17:27:04.232 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding con mode: secure 2024-09-12T17:27:04.232 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding con mode: crc 2024-09-12T17:27:04.232 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding con mode: secure 2024-09-12T17:27:04.232 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding con mode: crc 2024-09-12T17:27:04.232 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding con mode: secure 2024-09-12T17:27:04.233 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:04.233 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 1 librados: starting msgr at 2024-09-12T17:27:04.233 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 1 librados: starting objecter 2024-09-12T17:27:04.233 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command objecter_requests cmddesc objecter_requests hook 0x562187945d60 EEXIST 2024-09-12T17:27:04.233 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 1 librados: setting wanted keys 2024-09-12T17:27:04.233 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 1 librados: calling monclient init 2024-09-12T17:27:04.233 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 10 monclient: init 2024-09-12T17:27:04.233 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding auth protocol: cephx 2024-09-12T17:27:04.233 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding auth protocol: cephx 2024-09-12T17:27:04.233 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding auth protocol: cephx 2024-09-12T17:27:04.233 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding con mode: secure 2024-09-12T17:27:04.233 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding con mode: crc 2024-09-12T17:27:04.233 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding con mode: secure 2024-09-12T17:27:04.234 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding con mode: crc 2024-09-12T17:27:04.234 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding con mode: secure 2024-09-12T17:27:04.234 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding con mode: crc 2024-09-12T17:27:04.234 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding con mode: crc 2024-09-12T17:27:04.234 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding con mode: secure 2024-09-12T17:27:04.234 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding con mode: crc 2024-09-12T17:27:04.234 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding con mode: secure 2024-09-12T17:27:04.234 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding con mode: crc 2024-09-12T17:27:04.234 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding con mode: secure 2024-09-12T17:27:04.234 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:04.234 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:04.234 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command rotate-key cmddesc rotate-key hook 0x56218795c328 EEXIST 2024-09-12T17:27:04.234 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 10 monclient: _reopen_session rank -1 2024-09-12T17:27:04.235 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:27:04.235 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 10 monclient(hunting): picked mon.noname-b con 0x56218798c740 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:27:04.235 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 10 monclient(hunting): picked mon.noname-a con 0x562187997220 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:27:04.235 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 10 monclient(hunting): picked mon.noname-c con 0x56218799bdf0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:27:04.235 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:04.235 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:04.235 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:04.235 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 10 monclient(hunting): _renew_subs 2024-09-12T17:27:04.235 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 10 monclient(hunting): authenticate will time out at 2435.485624s 2024-09-12T17:27:04.235 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T17:27:04.134+0000 7f59d7bec640 10 monclient(hunting): get_auth_request con 0x56218799bdf0 auth_method 0 2024-09-12T17:27:04.235 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T17:27:04.134+0000 7f59d7bec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:04.235 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T17:27:04.134+0000 7f59d7bec640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:04.235 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T17:27:04.134+0000 7f59d7bec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:04.236 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T17:27:04.134+0000 7f59d6bea640 10 monclient(hunting): get_auth_request con 0x562187997220 auth_method 0 2024-09-12T17:27:04.236 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T17:27:04.134+0000 7f59d6bea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:04.236 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T17:27:04.134+0000 7f59d6bea640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:04.236 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T17:27:04.134+0000 7f59d6bea640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:04.236 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T17:27:04.134+0000 7f59d7bec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:04.236 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T17:27:04.134+0000 7f59d7bec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:04.236 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T17:27:04.134+0000 7f59d7bec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:04.236 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T17:27:04.134+0000 7f59d6bea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:04.236 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T17:27:04.134+0000 7f59d6bea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:04.236 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T17:27:04.134+0000 7f59d6bea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:04.236 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T17:27:04.134+0000 7f59d73eb640 10 monclient(hunting): get_auth_request con 0x56218798c740 auth_method 0 2024-09-12T17:27:04.236 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T17:27:04.134+0000 7f59d73eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:04.236 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T17:27:04.134+0000 7f59d73eb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:04.236 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T17:27:04.134+0000 7f59d73eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:04.237 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T17:27:04.134+0000 7f59d73eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:04.237 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T17:27:04.134+0000 7f59d73eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:04.237 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T17:27:04.134+0000 7f59d73eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:04.237 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T17:27:04.134+0000 7f59d7bec640 10 monclient(hunting): handle_auth_done global_id 7310 payload 824 2024-09-12T17:27:04.237 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T17:27:04.134+0000 7f59d7bec640 10 monclient: _finish_hunting 0 2024-09-12T17:27:04.237 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T17:27:04.134+0000 7f59d7bec640 1 monclient: found mon.noname-c 2024-09-12T17:27:04.237 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T17:27:04.134+0000 7f59d7bec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:27:04.237 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T17:27:04.135+0000 7f58b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:04.237 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T17:27:04.135+0000 7f58b97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:27:04.237 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T17:27:04.135+0000 7f58b97fa640 10 monclient: dump: 2024-09-12T17:27:04.237 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:04.237 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:04.237 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.237 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.238 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:04.238 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:04.238 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:04.238 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:04.238 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:04.238 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.238 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T17:27:04.135+0000 7f58b97fa640 10 monclient: _finish_auth 0 2024-09-12T17:27:04.238 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T17:27:04.135+0000 7f58b97fa640 10 monclient: _check_auth_tickets 2024-09-12T17:27:04.238 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T17:27:04.135+0000 7f58b97fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:27:04.238 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T17:27:04.135+0000 7f58b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:04.238 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T17:27:04.135+0000 7f58b97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:27:04.238 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T17:27:04.135+0000 7f58b97fa640 10 monclient: dump: 2024-09-12T17:27:04.238 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:04.238 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:04.239 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.239 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.239 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:04.239 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:04.239 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:04.239 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:04.239 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:04.239 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.239 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T17:27:04.135+0000 7f59dbc1b800 5 monclient: authenticate success, global_id 7310 2024-09-12T17:27:04.239 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T17:27:04.135+0000 7f59dbc1b800 10 monclient: _renew_subs 2024-09-12T17:27:04.239 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T17:27:04.135+0000 7f59dbc1b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:04.239 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T17:27:04.135+0000 7f58baffd640 4 set_mon_vals no callback set 2024-09-12T17:27:04.239 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T17:27:04.135+0000 7f59dbc1b800 10 monclient: _renew_subs 2024-09-12T17:27:04.240 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T17:27:04.135+0000 7f59dbc1b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:04.240 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T17:27:04.135+0000 7f59dbc1b800 1 librados: init done 2024-09-12T17:27:04.240 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T17:27:04.135+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command cr dump hook 0x562187997dc8 2024-09-12T17:27:04.240 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T17:27:04.137+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.240 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T17:27:04.137+0000 7f58b97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:27:04.240 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T17:27:04.137+0000 7f58b97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:27:04.240 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T17:27:04.137+0000 7f58b97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:27:04.240 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T17:27:04.137+0000 7f59d73eb640 10 monclient: get_auth_request con 0x7f58a0076470 auth_method 0 2024-09-12T17:27:04.240 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T17:27:04.138+0000 7f59d6bea640 10 monclient: get_auth_request con 0x5621879b6070 auth_method 0 2024-09-12T17:27:04.240 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T17:27:04.138+0000 7f59dbc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.240 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T17:27:04.138+0000 7f59dbc1b800 20 realm 2024-09-12T17:27:04.240 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T17:27:04.138+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.241 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T17:27:04.138+0000 7f59dbc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.241 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T17:27:04.138+0000 7f59dbc1b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:04.241 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T17:27:04.138+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.241 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T17:27:04.139+0000 7f59dbc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.241 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T17:27:04.139+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.241 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T17:27:04.139+0000 7f59d73eb640 10 monclient: get_auth_request con 0x5621879ba310 auth_method 0 2024-09-12T17:27:04.241 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T17:27:04.140+0000 7f59dbc1b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:04.241 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T17:27:04.140+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.241 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T17:27:04.140+0000 7f59d6bea640 10 monclient: get_auth_request con 0x5621879bdb70 auth_method 0 2024-09-12T17:27:04.241 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T17:27:04.140+0000 7f59dbc1b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:04.241 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T17:27:04.140+0000 7f59dbc1b800 20 searching for the correct realm 2024-09-12T17:27:04.241 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T17:27:04.140+0000 7f59d7bec640 10 monclient: get_auth_request con 0x5621879c28a0 auth_method 0 2024-09-12T17:27:04.241 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T17:27:04.141+0000 7f59d73eb640 10 monclient: get_auth_request con 0x7f59d001e070 auth_method 0 2024-09-12T17:27:04.241 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T17:27:04.142+0000 7f59d6bea640 10 monclient: get_auth_request con 0x7f59c807f040 auth_method 0 2024-09-12T17:27:04.242 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T17:27:04.144+0000 7f59d6bea640 0 -- 172.21.15.67:0/4236327666 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x5621879b6070 msgr2=0x5621879b84f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:04.242 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T17:27:04.144+0000 7f58b97fa640 1 client.7310.objecter ms_handle_reset 0x5621879b6070 session 0x5621879b59f0 osd.1 2024-09-12T17:27:04.242 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T17:27:04.144+0000 7f58b97fa640 10 monclient: _renew_subs 2024-09-12T17:27:04.242 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T17:27:04.144+0000 7f58b97fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:04.242 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T17:27:04.144+0000 7f59d6bea640 10 monclient: get_auth_request con 0x7f58a0086310 auth_method 0 2024-09-12T17:27:04.242 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T17:27:04.144+0000 7f59d7bec640 10 monclient: get_auth_request con 0x7f59cc062800 auth_method 0 2024-09-12T17:27:04.242 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T17:27:04.146+0000 7f59d73eb640 10 monclient: get_auth_request con 0x7f59cc0638d0 auth_method 0 2024-09-12T17:27:04.242 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T17:27:04.147+0000 7f59d6bea640 0 -- 172.21.15.67:0/4236327666 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x5621879bdb70 msgr2=0x5621879bff60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:27:04.242 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T17:27:04.147+0000 7f58b97fa640 1 client.7310.objecter ms_handle_reset 0x5621879bdb70 session 0x5621879b9660 osd.4 2024-09-12T17:27:04.242 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T17:27:04.147+0000 7f59d6bea640 10 monclient: get_auth_request con 0x5621879b6070 auth_method 0 2024-09-12T17:27:04.242 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:04.242 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:04.243 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:04.243 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:04.243 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:04.243 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:04.243 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.243 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.243 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.243 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:04.243 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.243 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:04.243 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 zone default found 2024-09-12T17:27:04.243 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 4 Realm: () 2024-09-12T17:27:04.243 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:04.244 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:04.244 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:04.244 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 zonegroup default 2024-09-12T17:27:04.244 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.244 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.244 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.244 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.244 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.244 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.244 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 started sync module instance, tier type = 2024-09-12T17:27:04.244 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:04.244 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T17:27:04.162+0000 7f59dbc1b800 20 add_watcher() i=0 2024-09-12T17:27:04.244 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T17:27:04.162+0000 7f59dbc1b800 20 add_watcher() i=1 2024-09-12T17:27:04.245 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T17:27:04.162+0000 7f59dbc1b800 20 add_watcher() i=2 2024-09-12T17:27:04.245 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T17:27:04.162+0000 7f59dbc1b800 20 add_watcher() i=3 2024-09-12T17:27:04.245 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T17:27:04.162+0000 7f59dbc1b800 20 add_watcher() i=4 2024-09-12T17:27:04.245 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T17:27:04.162+0000 7f59dbc1b800 20 add_watcher() i=5 2024-09-12T17:27:04.245 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T17:27:04.162+0000 7f59dbc1b800 20 add_watcher() i=6 2024-09-12T17:27:04.245 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T17:27:04.163+0000 7f59dbc1b800 20 add_watcher() i=7 2024-09-12T17:27:04.245 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T17:27:04.163+0000 7f59dbc1b800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:04.245 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding auth protocol: cephx 2024-09-12T17:27:04.245 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding auth protocol: cephx 2024-09-12T17:27:04.245 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding auth protocol: cephx 2024-09-12T17:27:04.245 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding con mode: secure 2024-09-12T17:27:04.245 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding con mode: crc 2024-09-12T17:27:04.245 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding con mode: secure 2024-09-12T17:27:04.246 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding con mode: crc 2024-09-12T17:27:04.246 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding con mode: secure 2024-09-12T17:27:04.246 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding con mode: crc 2024-09-12T17:27:04.246 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding con mode: crc 2024-09-12T17:27:04.246 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding con mode: secure 2024-09-12T17:27:04.246 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding con mode: crc 2024-09-12T17:27:04.246 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding con mode: secure 2024-09-12T17:27:04.246 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding con mode: crc 2024-09-12T17:27:04.246 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T17:27:04.164+0000 7f588dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:04.246 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding con mode: secure 2024-09-12T17:27:04.246 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:04.246 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:04.246 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:04.246 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command cache list hook 0x56218798fcf0 2024-09-12T17:27:04.247 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command cache inspect hook 0x56218798fcf0 2024-09-12T17:27:04.247 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command cache erase hook 0x56218798fcf0 2024-09-12T17:27:04.247 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command cache zap hook 0x56218798fcf0 2024-09-12T17:27:04.247 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 5 note: GC not initialized 2024-09-12T17:27:04.247 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T17:27:04.165+0000 7f588cfe1640 20 reqs_thread_entry: start 2024-09-12T17:27:04.247 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command sync trace show hook 0x7f59d0014030 2024-09-12T17:27:04.247 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command sync trace history hook 0x7f59d0014030 2024-09-12T17:27:04.247 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command sync trace active hook 0x7f59d0014030 2024-09-12T17:27:04.247 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command sync trace active_short hook 0x7f59d0014030 2024-09-12T17:27:04.247 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:04.247 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 20 Filter name: none 2024-09-12T17:27:04.247 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T17:27:04.165+0000 7f58067fc640 20 reqs_thread_entry: start 2024-09-12T17:27:04.247 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:27:04.248 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.248 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T17:27:04.166+0000 7f59dbc1b800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:27:04.248 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T17:27:04.166+0000 7f59dbc1b800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:27:04.248 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T17:27:04.166+0000 7f59dbc1b800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:27:04.248 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T17:27:04.166+0000 7f59dbc1b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 : miss 2024-09-12T17:27:04.248 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T17:27:04.166+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.248 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T17:27:04.166+0000 7f59dbc1b800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:27:04.248 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T17:27:04.166+0000 7f59dbc1b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 info.flags=0x17 2024-09-12T17:27:04.248 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T17:27:04.166+0000 7f59dbc1b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 to cache LRU end 2024-09-12T17:27:04.248 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T17:27:04.166+0000 7f59dbc1b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:04.248 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T17:27:04.166+0000 7f59dbc1b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:04.248 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T17:27:04.166+0000 7f59dbc1b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 2024-09-12T17:27:04.249 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T17:27:04.170+0000 7f59dbc1b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 info.flags=0x17 2024-09-12T17:27:04.249 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T17:27:04.170+0000 7f59dbc1b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 to cache LRU end 2024-09-12T17:27:04.249 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T17:27:04.170+0000 7f59dbc1b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:04.249 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T17:27:04.170+0000 7f59dbc1b800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37, ofs0, ns] 2024-09-12T17:27:04.249 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T17:27:04.170+0000 7f58baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464309 cookie 94702009052544 notifier 7310 bl.length()=1007 2024-09-12T17:27:04.249 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T17:27:04.170+0000 7f58baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 info.flags=0x17 2024-09-12T17:27:04.249 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T17:27:04.170+0000 7f58baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 to cache LRU end 2024-09-12T17:27:04.249 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T17:27:04.170+0000 7f58baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:04.249 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T17:27:04.172+0000 7f59dbc1b800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.37]): orig_sources= new_sources= 2024-09-12T17:27:04.249 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T17:27:04.172+0000 7f59dbc1b800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.37]): potential sources added=[] removed=[] 2024-09-12T17:27:04.249 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T17:27:04.172+0000 7f59dbc1b800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.37]): orig_dests= new_dests= 2024-09-12T17:27:04.249 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T17:27:04.172+0000 7f59dbc1b800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.37]): potential dests added=[] removed=[] 2024-09-12T17:27:04.249 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T17:27:04.174+0000 7f59dbc1b800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f59dbc1b800 time 2024-09-12T17:27:04.175547+0000 2024-09-12T17:27:04.250 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:27:04.250 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.250 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:27:04.250 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f59dcd8c71a] 2024-09-12T17:27:04.250 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f59dcd8c8d8] 2024-09-12T17:27:04.250 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562184fde841] 2024-09-12T17:27:04.250 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd7490c) [0x5621854ec90c] 2024-09-12T17:27:04.250 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562184fee50d] 2024-09-12T17:27:04.250 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:27:04.250 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f59dba29590] 2024-09-12T17:27:04.250 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:27:04.250 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:27:04.250 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.250 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T17:27:04.175+0000 7f59dbc1b800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:27:04.250 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f59dbc1b800 thread_name:radosgw-admin 2024-09-12T17:27:04.251 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.251 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:27:04.251 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f59dba3e6f0] 2024-09-12T17:27:04.251 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f59dba8b99c] 2024-09-12T17:27:04.251 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:27:04.251 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:27:04.251 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f59dcd8c774] 2024-09-12T17:27:04.251 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f59dcd8c8d8] 2024-09-12T17:27:04.251 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562184fde841] 2024-09-12T17:27:04.251 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd7490c) [0x5621854ec90c] 2024-09-12T17:27:04.251 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562184fee50d] 2024-09-12T17:27:04.251 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:27:04.251 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f59dba29590] 2024-09-12T17:27:04.252 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:27:04.252 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:27:04.252 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:27:04.252 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.252 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T17:27:04.252 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T17:27:04.252 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T17:27:04.252 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T17:27:04.252 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T17:27:04.252 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T17:27:04.252 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T17:27:04.253 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T17:27:04.253 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T17:27:04.253 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T17:27:04.253 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T17:27:04.253 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T17:27:04.253 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T17:27:04.253 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T17:27:04.253 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T17:27:04.253 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T17:27:04.253 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T17:27:04.253 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T17:27:04.253 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T17:27:04.253 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T17:27:04.253 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T17:27:04.254 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T17:27:04.254 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T17:27:04.254 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T17:27:04.254 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:27:04.254 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T17:27:04.254 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T17:27:04.254 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T17:27:04.254 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T17:27:04.254 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T17:27:04.254 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T17:27:04.255 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T17:27:04.255 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T17:27:04.255 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T17:27:04.255 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T17:27:04.255 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T17:27:04.255 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T17:27:04.255 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T17:27:04.255 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T17:27:04.255 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T17:27:04.255 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T17:27:04.255 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T17:27:04.255 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T17:27:04.255 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T17:27:04.256 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T17:27:04.256 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T17:27:04.256 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:27:04.256 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T17:27:04.256 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:27:04.256 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T17:27:04.256 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T17:27:04.256 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T17:27:04.256 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T17:27:04.256 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T17:27:04.256 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T17:27:04.256 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T17:27:04.257 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T17:27:04.257 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T17:27:04.257 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T17:27:04.257 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T17:27:04.257 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T17:27:04.257 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T17:27:04.257 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T17:27:04.257 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T17:27:04.257 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T17:27:04.257 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T17:27:04.257 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T17:27:04.257 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:27:04.257 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T17:27:04.257 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:27:04.258 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T17:27:04.258 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T17:27:04.258 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T17:27:04.258 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T17:27:04.258 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T17:27:04.258 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T17:27:04.258 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:27:04.258 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T17:27:04.258 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T17:27:04.258 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:27:04.258 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T17:27:04.258 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T17:27:04.258 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T17:27:04.259 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T17:27:04.259 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T17:27:04.259 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T17:27:04.259 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T17:27:04.259 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T17:27:04.259 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T17:27:04.259 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T17:27:04.259 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T17:27:04.259 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T17:27:04.259 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T17:27:04.259 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:27:04.259 INFO:tasks.workunit.client.0.smithi067.stderr: 7f58067fc640 / http_manager 2024-09-12T17:27:04.259 INFO:tasks.workunit.client.0.smithi067.stderr: 7f588cfe1640 / http_manager 2024-09-12T17:27:04.259 INFO:tasks.workunit.client.0.smithi067.stderr: 7f588dfe3640 / rgw_dt_lg_renew 2024-09-12T17:27:04.260 INFO:tasks.workunit.client.0.smithi067.stderr: 7f58b97fa640 / ms_dispatch 2024-09-12T17:27:04.260 INFO:tasks.workunit.client.0.smithi067.stderr: 7f58baffd640 / io_context_pool 2024-09-12T17:27:04.260 INFO:tasks.workunit.client.0.smithi067.stderr: 7f58c1602640 / ms_dispatch 2024-09-12T17:27:04.260 INFO:tasks.workunit.client.0.smithi067.stderr: 7f58c3e07640 / ms_dispatch 2024-09-12T17:27:04.260 INFO:tasks.workunit.client.0.smithi067.stderr: 7f58c560a640 / io_context_pool 2024-09-12T17:27:04.260 INFO:tasks.workunit.client.0.smithi067.stderr: 7f59d6bea640 / msgr-worker-2 2024-09-12T17:27:04.260 INFO:tasks.workunit.client.0.smithi067.stderr: 7f59d73eb640 / msgr-worker-1 2024-09-12T17:27:04.260 INFO:tasks.workunit.client.0.smithi067.stderr: 7f59d7bec640 / msgr-worker-0 2024-09-12T17:27:04.260 INFO:tasks.workunit.client.0.smithi067.stderr: 7f59d83ed640 / io_context_pool 2024-09-12T17:27:04.260 INFO:tasks.workunit.client.0.smithi067.stderr: 7f59dbc1b800 / radosgw-admin 2024-09-12T17:27:04.260 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T17:27:04.260 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T17:27:04.261 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/log/ceph/ceph-client.admin.135717.log 2024-09-12T17:27:04.261 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T17:27:04.261 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T17:27:04.261 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T17:27:04.119+0000 7f59dbc1b800 4 set_mon_vals no callback set 2024-09-12T17:27:04.261 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T17:27:04.119+0000 7f59dbc1b800 10 monclient: shutdown 2024-09-12T17:27:04.261 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T17:27:04.119+0000 7f59dbc1b800 5 asok(0x5621876a7730) unregister_commands rotate-key 2024-09-12T17:27:04.261 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 10 monclient: build_initial_monmap 2024-09-12T17:27:04.261 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 1 build_initial for_mkfs: 0 2024-09-12T17:27:04.261 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 10 monclient: monmap: 2024-09-12T17:27:04.261 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:27:04.261 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:27:04.261 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:27:04.261 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:27:04.262 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:27:04.262 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:04.262 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:27:04.262 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:27:04.262 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:27:04.262 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.262 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding auth protocol: cephx 2024-09-12T17:27:04.262 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding auth protocol: cephx 2024-09-12T17:27:04.262 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding auth protocol: cephx 2024-09-12T17:27:04.262 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding con mode: secure 2024-09-12T17:27:04.262 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding con mode: crc 2024-09-12T17:27:04.262 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding con mode: secure 2024-09-12T17:27:04.262 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding con mode: crc 2024-09-12T17:27:04.263 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding con mode: secure 2024-09-12T17:27:04.263 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding con mode: crc 2024-09-12T17:27:04.263 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding con mode: crc 2024-09-12T17:27:04.263 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding con mode: secure 2024-09-12T17:27:04.263 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding con mode: crc 2024-09-12T17:27:04.263 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding con mode: secure 2024-09-12T17:27:04.263 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding con mode: crc 2024-09-12T17:27:04.263 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878d1460) adding con mode: secure 2024-09-12T17:27:04.263 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:04.263 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 1 librados: starting msgr at 2024-09-12T17:27:04.263 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 1 librados: starting objecter 2024-09-12T17:27:04.263 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command objecter_requests hook 0x5621878d1e70 2024-09-12T17:27:04.263 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 1 librados: setting wanted keys 2024-09-12T17:27:04.263 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 1 librados: calling monclient init 2024-09-12T17:27:04.264 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 10 monclient: init 2024-09-12T17:27:04.264 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding auth protocol: cephx 2024-09-12T17:27:04.264 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding auth protocol: cephx 2024-09-12T17:27:04.264 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding auth protocol: cephx 2024-09-12T17:27:04.264 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding con mode: secure 2024-09-12T17:27:04.264 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding con mode: crc 2024-09-12T17:27:04.264 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding con mode: secure 2024-09-12T17:27:04.264 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding con mode: crc 2024-09-12T17:27:04.264 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding con mode: secure 2024-09-12T17:27:04.264 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding con mode: crc 2024-09-12T17:27:04.264 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding con mode: crc 2024-09-12T17:27:04.264 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding con mode: secure 2024-09-12T17:27:04.264 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding con mode: crc 2024-09-12T17:27:04.264 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding con mode: secure 2024-09-12T17:27:04.265 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding con mode: crc 2024-09-12T17:27:04.265 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 5 AuthRegistry(0x5621878cbcf0) adding con mode: secure 2024-09-12T17:27:04.265 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T17:27:04.120+0000 7f59dbc1b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:04.265 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:04.265 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command rotate-key hook 0x5621878cbe38 2024-09-12T17:27:04.265 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient: _reopen_session rank -1 2024-09-12T17:27:04.265 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:27:04.265 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient(hunting): picked mon.noname-a con 0x562187781ad0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:27:04.265 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient(hunting): picked mon.noname-c con 0x56218780ef70 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:27:04.265 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient(hunting): picked mon.noname-b con 0x562187812040 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:27:04.265 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:04.265 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:04.265 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:04.266 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient(hunting): _renew_subs 2024-09-12T17:27:04.266 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient(hunting): authenticate will time out at 2435.472133s 2024-09-12T17:27:04.266 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T17:27:04.121+0000 7f59d73eb640 10 monclient(hunting): get_auth_request con 0x562187781ad0 auth_method 0 2024-09-12T17:27:04.266 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T17:27:04.121+0000 7f59d73eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:04.266 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T17:27:04.121+0000 7f59d73eb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:04.266 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T17:27:04.121+0000 7f59d73eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:04.266 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T17:27:04.121+0000 7f59d6bea640 10 monclient(hunting): get_auth_request con 0x56218780ef70 auth_method 0 2024-09-12T17:27:04.266 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T17:27:04.121+0000 7f59d6bea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:04.266 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T17:27:04.121+0000 7f59d6bea640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:04.266 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T17:27:04.121+0000 7f59d6bea640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:04.266 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T17:27:04.121+0000 7f59d6bea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:04.266 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T17:27:04.121+0000 7f59d6bea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:04.266 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T17:27:04.121+0000 7f59d6bea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:04.266 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T17:27:04.121+0000 7f59d73eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:04.267 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T17:27:04.121+0000 7f59d73eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:04.267 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T17:27:04.121+0000 7f59d73eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:04.267 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T17:27:04.121+0000 7f59d7bec640 10 monclient(hunting): get_auth_request con 0x562187812040 auth_method 0 2024-09-12T17:27:04.267 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T17:27:04.121+0000 7f59d7bec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:04.267 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T17:27:04.121+0000 7f59d7bec640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:04.267 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T17:27:04.121+0000 7f59d7bec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:04.267 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T17:27:04.121+0000 7f59d6bea640 10 monclient(hunting): handle_auth_done global_id 7301 payload 824 2024-09-12T17:27:04.267 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T17:27:04.121+0000 7f59d6bea640 10 monclient: _finish_hunting 0 2024-09-12T17:27:04.267 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T17:27:04.121+0000 7f59d6bea640 1 monclient: found mon.noname-c 2024-09-12T17:27:04.267 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T17:27:04.121+0000 7f59d6bea640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:27:04.267 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T17:27:04.121+0000 7f58c3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:04.267 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T17:27:04.121+0000 7f58c3e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:27:04.267 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T17:27:04.121+0000 7f58c3e07640 10 monclient: dump: 2024-09-12T17:27:04.267 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:04.268 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:04.268 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.268 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.268 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:04.268 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:04.268 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:04.268 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:04.268 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:04.268 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.268 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T17:27:04.121+0000 7f58c3e07640 10 monclient: _finish_auth 0 2024-09-12T17:27:04.268 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T17:27:04.121+0000 7f58c3e07640 10 monclient: _check_auth_tickets 2024-09-12T17:27:04.268 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T17:27:04.121+0000 7f58c3e07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:27:04.268 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T17:27:04.121+0000 7f58c3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:04.269 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T17:27:04.121+0000 7f58c3e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:27:04.269 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T17:27:04.121+0000 7f58c3e07640 10 monclient: dump: 2024-09-12T17:27:04.269 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:04.269 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:04.269 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.269 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.269 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:04.269 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:04.269 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:04.269 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:04.269 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:04.269 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.269 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 5 monclient: authenticate success, global_id 7301 2024-09-12T17:27:04.270 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient: _renew_subs 2024-09-12T17:27:04.270 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T17:27:04.121+0000 7f58c560a640 4 set_mon_vals no callback set 2024-09-12T17:27:04.270 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:04.270 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient: _renew_subs 2024-09-12T17:27:04.270 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:04.270 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T17:27:04.121+0000 7f59dbc1b800 1 librados: init done 2024-09-12T17:27:04.270 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T17:27:04.123+0000 7f58c3e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:27:04.270 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T17:27:04.123+0000 7f58c3e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:27:04.270 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T17:27:04.123+0000 7f58c3e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:27:04.270 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T17:27:04.123+0000 7f59d73eb640 10 monclient: get_auth_request con 0x7f58bc076470 auth_method 0 2024-09-12T17:27:04.270 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T17:27:04.124+0000 7f59d7bec640 10 monclient: get_auth_request con 0x5621878f47d0 auth_method 0 2024-09-12T17:27:04.270 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T17:27:04.124+0000 7f59d73eb640 10 monclient: get_auth_request con 0x562187917240 auth_method 0 2024-09-12T17:27:04.270 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T17:27:04.125+0000 7f59d6bea640 10 monclient: get_auth_request con 0x56218791b430 auth_method 0 2024-09-12T17:27:04.271 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 10 monclient: build_initial_monmap 2024-09-12T17:27:04.271 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 1 build_initial for_mkfs: 0 2024-09-12T17:27:04.271 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 10 monclient: monmap: 2024-09-12T17:27:04.271 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:27:04.271 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:27:04.271 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:27:04.271 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:27:04.271 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:27:04.271 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:04.271 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:27:04.271 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:27:04.271 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:27:04.271 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.271 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding auth protocol: cephx 2024-09-12T17:27:04.272 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding auth protocol: cephx 2024-09-12T17:27:04.272 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding auth protocol: cephx 2024-09-12T17:27:04.272 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding con mode: secure 2024-09-12T17:27:04.272 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding con mode: crc 2024-09-12T17:27:04.272 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding con mode: secure 2024-09-12T17:27:04.272 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding con mode: crc 2024-09-12T17:27:04.272 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding con mode: secure 2024-09-12T17:27:04.272 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding con mode: crc 2024-09-12T17:27:04.272 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding con mode: crc 2024-09-12T17:27:04.272 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding con mode: secure 2024-09-12T17:27:04.272 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding con mode: crc 2024-09-12T17:27:04.272 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding con mode: secure 2024-09-12T17:27:04.272 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding con mode: crc 2024-09-12T17:27:04.272 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x562187920130) adding con mode: secure 2024-09-12T17:27:04.273 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:04.273 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command objecter_requests cmddesc objecter_requests hook 0x562187923600 EEXIST 2024-09-12T17:27:04.273 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 10 monclient: init 2024-09-12T17:27:04.273 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding auth protocol: cephx 2024-09-12T17:27:04.273 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding auth protocol: cephx 2024-09-12T17:27:04.273 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding auth protocol: cephx 2024-09-12T17:27:04.273 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding con mode: secure 2024-09-12T17:27:04.273 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding con mode: crc 2024-09-12T17:27:04.273 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding con mode: secure 2024-09-12T17:27:04.273 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding con mode: crc 2024-09-12T17:27:04.273 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding con mode: secure 2024-09-12T17:27:04.273 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding con mode: crc 2024-09-12T17:27:04.273 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding con mode: crc 2024-09-12T17:27:04.274 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding con mode: secure 2024-09-12T17:27:04.274 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding con mode: crc 2024-09-12T17:27:04.274 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding con mode: secure 2024-09-12T17:27:04.274 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding con mode: crc 2024-09-12T17:27:04.274 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T17:27:04.127+0000 7f59dbc1b800 5 AuthRegistry(0x56218791e858) adding con mode: secure 2024-09-12T17:27:04.274 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T17:27:04.128+0000 7f59dbc1b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:04.274 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T17:27:04.128+0000 7f59dbc1b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:04.274 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T17:27:04.128+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command rotate-key cmddesc rotate-key hook 0x56218791e9a0 EEXIST 2024-09-12T17:27:04.274 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T17:27:04.128+0000 7f59dbc1b800 10 monclient: _reopen_session rank -1 2024-09-12T17:27:04.274 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T17:27:04.128+0000 7f59dbc1b800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:27:04.274 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T17:27:04.128+0000 7f59dbc1b800 10 monclient(hunting): picked mon.noname-a con 0x562187947920 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:27:04.274 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T17:27:04.128+0000 7f59dbc1b800 10 monclient(hunting): picked mon.noname-b con 0x562187947d00 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:27:04.274 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T17:27:04.128+0000 7f59dbc1b800 10 monclient(hunting): picked mon.noname-c con 0x562187946630 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:27:04.275 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T17:27:04.128+0000 7f59dbc1b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:04.275 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T17:27:04.128+0000 7f59dbc1b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:04.275 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T17:27:04.128+0000 7f59dbc1b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:04.275 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T17:27:04.128+0000 7f59dbc1b800 10 monclient(hunting): _renew_subs 2024-09-12T17:27:04.275 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T17:27:04.128+0000 7f59dbc1b800 10 monclient(hunting): authenticate will time out at 2435.479465s 2024-09-12T17:27:04.275 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T17:27:04.128+0000 7f59d73eb640 10 monclient(hunting): get_auth_request con 0x562187947920 auth_method 0 2024-09-12T17:27:04.275 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T17:27:04.128+0000 7f59d73eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:04.275 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T17:27:04.128+0000 7f59d73eb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:04.275 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T17:27:04.128+0000 7f59d73eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:04.275 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T17:27:04.128+0000 7f59d7bec640 10 monclient(hunting): get_auth_request con 0x562187946630 auth_method 0 2024-09-12T17:27:04.275 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T17:27:04.128+0000 7f59d7bec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:04.275 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T17:27:04.128+0000 7f59d7bec640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:04.275 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T17:27:04.128+0000 7f59d7bec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:04.276 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T17:27:04.128+0000 7f59d6bea640 10 monclient(hunting): get_auth_request con 0x562187947d00 auth_method 0 2024-09-12T17:27:04.276 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T17:27:04.128+0000 7f59d6bea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:04.276 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T17:27:04.128+0000 7f59d6bea640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:04.276 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T17:27:04.128+0000 7f59d6bea640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:04.276 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T17:27:04.128+0000 7f59d73eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:04.276 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T17:27:04.128+0000 7f59d73eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:04.276 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T17:27:04.128+0000 7f59d73eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:04.276 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T17:27:04.128+0000 7f59d7bec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:04.276 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T17:27:04.128+0000 7f59d7bec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:04.276 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T17:27:04.128+0000 7f59d7bec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:04.276 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T17:27:04.128+0000 7f59d6bea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:04.276 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T17:27:04.128+0000 7f59d6bea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:04.276 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T17:27:04.128+0000 7f59d6bea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:04.277 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T17:27:04.128+0000 7f59d7bec640 10 monclient(hunting): handle_auth_done global_id 7304 payload 824 2024-09-12T17:27:04.277 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T17:27:04.128+0000 7f59d7bec640 10 monclient: _finish_hunting 0 2024-09-12T17:27:04.277 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T17:27:04.128+0000 7f59d7bec640 1 monclient: found mon.noname-c 2024-09-12T17:27:04.277 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T17:27:04.128+0000 7f59d7bec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:27:04.277 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T17:27:04.129+0000 7f58c1602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:04.277 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T17:27:04.129+0000 7f58c1602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:27:04.277 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T17:27:04.129+0000 7f58c1602640 10 monclient: dump: 2024-09-12T17:27:04.277 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:04.277 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:04.277 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.277 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.277 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:04.277 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:04.278 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:04.278 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:04.278 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:04.278 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.278 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T17:27:04.129+0000 7f58c1602640 10 monclient: _finish_auth 0 2024-09-12T17:27:04.278 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T17:27:04.129+0000 7f58c1602640 10 monclient: _check_auth_tickets 2024-09-12T17:27:04.278 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T17:27:04.129+0000 7f58c1602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:27:04.278 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T17:27:04.129+0000 7f58c1602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:04.278 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T17:27:04.129+0000 7f58c1602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:27:04.278 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T17:27:04.129+0000 7f58c1602640 10 monclient: dump: 2024-09-12T17:27:04.278 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:04.278 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:04.278 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.279 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.279 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:04.279 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:04.279 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:04.279 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:04.279 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:04.279 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.279 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T17:27:04.129+0000 7f59dbc1b800 5 monclient: authenticate success, global_id 7304 2024-09-12T17:27:04.279 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T17:27:04.129+0000 7f59dbc1b800 10 monclient: _renew_subs 2024-09-12T17:27:04.279 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T17:27:04.129+0000 7f59dbc1b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:04.279 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T17:27:04.129+0000 7f59d83ed640 4 set_mon_vals no callback set 2024-09-12T17:27:04.279 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T17:27:04.129+0000 7f59dbc1b800 10 monclient: _renew_subs 2024-09-12T17:27:04.279 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T17:27:04.129+0000 7f59dbc1b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:04.279 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T17:27:04.131+0000 7f58c1602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:27:04.280 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T17:27:04.131+0000 7f58c1602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:27:04.280 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T17:27:04.131+0000 7f58c1602640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:27:04.280 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T17:27:04.131+0000 7f59d73eb640 10 monclient: get_auth_request con 0x7f58b0076380 auth_method 0 2024-09-12T17:27:04.280 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 10 monclient: get_monmap_and_config 2024-09-12T17:27:04.280 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 10 monclient: build_initial_monmap 2024-09-12T17:27:04.280 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 1 build_initial for_mkfs: 0 2024-09-12T17:27:04.280 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 10 monclient: monmap: 2024-09-12T17:27:04.280 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:27:04.280 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:27:04.280 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:27:04.280 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:27:04.280 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:27:04.280 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:04.281 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:27:04.281 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:27:04.281 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:27:04.281 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.281 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding auth protocol: cephx 2024-09-12T17:27:04.281 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding auth protocol: cephx 2024-09-12T17:27:04.281 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding auth protocol: cephx 2024-09-12T17:27:04.281 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding con mode: secure 2024-09-12T17:27:04.281 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding con mode: crc 2024-09-12T17:27:04.281 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding con mode: secure 2024-09-12T17:27:04.281 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding con mode: crc 2024-09-12T17:27:04.281 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding con mode: secure 2024-09-12T17:27:04.281 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding con mode: crc 2024-09-12T17:27:04.282 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding con mode: crc 2024-09-12T17:27:04.282 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding con mode: secure 2024-09-12T17:27:04.282 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding con mode: crc 2024-09-12T17:27:04.282 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding con mode: secure 2024-09-12T17:27:04.282 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding con mode: crc 2024-09-12T17:27:04.282 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x562187967820) adding con mode: secure 2024-09-12T17:27:04.282 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:04.282 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 10 monclient: init 2024-09-12T17:27:04.282 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding auth protocol: cephx 2024-09-12T17:27:04.282 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding auth protocol: cephx 2024-09-12T17:27:04.282 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding auth protocol: cephx 2024-09-12T17:27:04.282 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding con mode: secure 2024-09-12T17:27:04.282 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding con mode: crc 2024-09-12T17:27:04.283 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding con mode: secure 2024-09-12T17:27:04.283 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding con mode: crc 2024-09-12T17:27:04.283 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding con mode: secure 2024-09-12T17:27:04.283 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding con mode: crc 2024-09-12T17:27:04.283 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding con mode: crc 2024-09-12T17:27:04.283 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding con mode: secure 2024-09-12T17:27:04.283 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding con mode: crc 2024-09-12T17:27:04.283 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding con mode: secure 2024-09-12T17:27:04.283 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding con mode: crc 2024-09-12T17:27:04.283 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T17:27:04.131+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03c9a0) adding con mode: secure 2024-09-12T17:27:04.283 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T17:27:04.132+0000 7f59dbc1b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:04.283 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T17:27:04.132+0000 7f59dbc1b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:04.283 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T17:27:04.132+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command rotate-key cmddesc rotate-key hook 0x7ffc2b03cae8 EEXIST 2024-09-12T17:27:04.283 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T17:27:04.132+0000 7f59dbc1b800 10 monclient: _reopen_session rank -1 2024-09-12T17:27:04.284 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T17:27:04.132+0000 7f59dbc1b800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:27:04.284 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T17:27:04.132+0000 7f59dbc1b800 10 monclient(hunting): picked mon.noname-b con 0x56218799bdf0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:27:04.284 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T17:27:04.132+0000 7f59dbc1b800 10 monclient(hunting): picked mon.noname-a con 0x56218798c740 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:27:04.284 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T17:27:04.132+0000 7f59dbc1b800 10 monclient(hunting): picked mon.noname-c con 0x562187997220 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:27:04.284 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T17:27:04.132+0000 7f59dbc1b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:04.284 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T17:27:04.132+0000 7f59dbc1b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:04.284 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T17:27:04.132+0000 7f59dbc1b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:04.284 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T17:27:04.132+0000 7f59dbc1b800 10 monclient(hunting): _renew_subs 2024-09-12T17:27:04.284 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T17:27:04.132+0000 7f59dbc1b800 10 monclient(hunting): authenticate will time out at 2435.483415s 2024-09-12T17:27:04.284 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T17:27:04.132+0000 7f59d7bec640 10 monclient(hunting): get_auth_request con 0x562187997220 auth_method 0 2024-09-12T17:27:04.284 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T17:27:04.132+0000 7f59d7bec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:04.284 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T17:27:04.132+0000 7f59d7bec640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:04.284 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T17:27:04.132+0000 7f59d7bec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:04.285 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T17:27:04.132+0000 7f59d6bea640 10 monclient(hunting): get_auth_request con 0x56218798c740 auth_method 0 2024-09-12T17:27:04.285 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T17:27:04.132+0000 7f59d6bea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:04.285 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T17:27:04.132+0000 7f59d6bea640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:04.285 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T17:27:04.132+0000 7f59d6bea640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:04.285 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T17:27:04.132+0000 7f59d7bec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:04.285 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T17:27:04.132+0000 7f59d7bec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:04.285 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T17:27:04.132+0000 7f59d7bec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:04.285 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T17:27:04.132+0000 7f59d6bea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:04.285 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T17:27:04.132+0000 7f59d6bea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:04.285 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T17:27:04.132+0000 7f59d6bea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:04.285 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T17:27:04.132+0000 7f59d73eb640 10 monclient(hunting): get_auth_request con 0x56218799bdf0 auth_method 0 2024-09-12T17:27:04.285 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T17:27:04.132+0000 7f59d73eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:04.285 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T17:27:04.132+0000 7f59d73eb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:04.286 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T17:27:04.132+0000 7f59d73eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:04.286 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T17:27:04.132+0000 7f59d7bec640 10 monclient(hunting): handle_auth_done global_id 7307 payload 274 2024-09-12T17:27:04.286 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T17:27:04.132+0000 7f59d7bec640 10 monclient: _finish_hunting 0 2024-09-12T17:27:04.286 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T17:27:04.132+0000 7f59d7bec640 1 monclient: found mon.noname-c 2024-09-12T17:27:04.286 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T17:27:04.132+0000 7f59d7bec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:27:04.286 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T17:27:04.132+0000 7f58baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:04.286 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T17:27:04.132+0000 7f58baffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:27:04.286 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T17:27:04.132+0000 7f58baffd640 10 monclient: dump: 2024-09-12T17:27:04.286 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:04.286 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:04.286 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.286 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.286 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:04.287 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:04.287 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:04.287 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:04.287 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:04.287 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.287 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T17:27:04.132+0000 7f58baffd640 10 monclient: _finish_auth 0 2024-09-12T17:27:04.287 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T17:27:04.132+0000 7f58baffd640 10 monclient: _check_auth_tickets 2024-09-12T17:27:04.287 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 monclient: authenticate success, global_id 7307 2024-09-12T17:27:04.287 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T17:27:04.133+0000 7f58baffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:27:04.287 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T17:27:04.133+0000 7f58baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:04.287 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T17:27:04.133+0000 7f58baffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:27:04.287 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T17:27:04.133+0000 7f58baffd640 10 monclient: dump: 2024-09-12T17:27:04.287 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:04.288 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:04.288 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.288 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.288 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:04.288 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:04.288 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:04.288 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:04.288 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:04.288 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.288 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 10 monclient: get_monmap_and_config success 2024-09-12T17:27:04.288 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 4 set_mon_vals no callback set 2024-09-12T17:27:04.288 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 10 monclient: shutdown 2024-09-12T17:27:04.288 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 10 monclient: build_initial_monmap 2024-09-12T17:27:04.289 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 1 build_initial for_mkfs: 0 2024-09-12T17:27:04.289 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 10 monclient: monmap: 2024-09-12T17:27:04.289 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:27:04.289 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:27:04.289 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:27:04.289 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:27:04.289 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:27:04.289 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:04.289 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:27:04.289 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:27:04.289 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:27:04.289 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.289 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding auth protocol: cephx 2024-09-12T17:27:04.289 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding auth protocol: cephx 2024-09-12T17:27:04.290 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding auth protocol: cephx 2024-09-12T17:27:04.290 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding con mode: secure 2024-09-12T17:27:04.290 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding con mode: crc 2024-09-12T17:27:04.290 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding con mode: secure 2024-09-12T17:27:04.290 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding con mode: crc 2024-09-12T17:27:04.290 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding con mode: secure 2024-09-12T17:27:04.290 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding con mode: crc 2024-09-12T17:27:04.290 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding con mode: crc 2024-09-12T17:27:04.290 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding con mode: secure 2024-09-12T17:27:04.290 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding con mode: crc 2024-09-12T17:27:04.290 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding con mode: secure 2024-09-12T17:27:04.290 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding con mode: crc 2024-09-12T17:27:04.290 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 5 AuthRegistry(0x56218796b350) adding con mode: secure 2024-09-12T17:27:04.291 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:04.291 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 1 librados: starting msgr at 2024-09-12T17:27:04.291 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T17:27:04.133+0000 7f59dbc1b800 1 librados: starting objecter 2024-09-12T17:27:04.291 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command objecter_requests cmddesc objecter_requests hook 0x562187945d60 EEXIST 2024-09-12T17:27:04.291 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 1 librados: setting wanted keys 2024-09-12T17:27:04.291 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 1 librados: calling monclient init 2024-09-12T17:27:04.291 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 10 monclient: init 2024-09-12T17:27:04.291 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding auth protocol: cephx 2024-09-12T17:27:04.291 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding auth protocol: cephx 2024-09-12T17:27:04.291 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding auth protocol: cephx 2024-09-12T17:27:04.291 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding con mode: secure 2024-09-12T17:27:04.291 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding con mode: crc 2024-09-12T17:27:04.291 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding con mode: secure 2024-09-12T17:27:04.292 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding con mode: crc 2024-09-12T17:27:04.292 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding con mode: secure 2024-09-12T17:27:04.292 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding con mode: crc 2024-09-12T17:27:04.292 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding con mode: crc 2024-09-12T17:27:04.292 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding con mode: secure 2024-09-12T17:27:04.292 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding con mode: crc 2024-09-12T17:27:04.292 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding con mode: secure 2024-09-12T17:27:04.292 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding con mode: crc 2024-09-12T17:27:04.292 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 AuthRegistry(0x56218795c1e0) adding con mode: secure 2024-09-12T17:27:04.292 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:04.292 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:04.292 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command rotate-key cmddesc rotate-key hook 0x56218795c328 EEXIST 2024-09-12T17:27:04.292 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 10 monclient: _reopen_session rank -1 2024-09-12T17:27:04.292 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:27:04.293 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 10 monclient(hunting): picked mon.noname-b con 0x56218798c740 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:27:04.293 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 10 monclient(hunting): picked mon.noname-a con 0x562187997220 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:27:04.293 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 10 monclient(hunting): picked mon.noname-c con 0x56218799bdf0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:27:04.293 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:04.293 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:04.293 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:04.293 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 10 monclient(hunting): _renew_subs 2024-09-12T17:27:04.293 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T17:27:04.134+0000 7f59dbc1b800 10 monclient(hunting): authenticate will time out at 2435.485624s 2024-09-12T17:27:04.293 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T17:27:04.134+0000 7f59d7bec640 10 monclient(hunting): get_auth_request con 0x56218799bdf0 auth_method 0 2024-09-12T17:27:04.293 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T17:27:04.134+0000 7f59d7bec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:04.293 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T17:27:04.134+0000 7f59d7bec640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:04.293 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T17:27:04.134+0000 7f59d7bec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:04.293 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T17:27:04.134+0000 7f59d6bea640 10 monclient(hunting): get_auth_request con 0x562187997220 auth_method 0 2024-09-12T17:27:04.293 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T17:27:04.134+0000 7f59d6bea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:04.294 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T17:27:04.134+0000 7f59d6bea640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:04.294 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T17:27:04.134+0000 7f59d6bea640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:04.294 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T17:27:04.134+0000 7f59d7bec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:04.294 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T17:27:04.134+0000 7f59d7bec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:04.294 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T17:27:04.134+0000 7f59d7bec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:04.294 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T17:27:04.134+0000 7f59d6bea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:04.294 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T17:27:04.134+0000 7f59d6bea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:04.294 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T17:27:04.134+0000 7f59d6bea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:04.294 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T17:27:04.134+0000 7f59d73eb640 10 monclient(hunting): get_auth_request con 0x56218798c740 auth_method 0 2024-09-12T17:27:04.294 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T17:27:04.134+0000 7f59d73eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:04.294 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T17:27:04.134+0000 7f59d73eb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:04.294 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T17:27:04.134+0000 7f59d73eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:04.294 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T17:27:04.134+0000 7f59d73eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:04.295 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T17:27:04.134+0000 7f59d73eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:04.295 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T17:27:04.134+0000 7f59d73eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:04.295 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T17:27:04.134+0000 7f59d7bec640 10 monclient(hunting): handle_auth_done global_id 7310 payload 824 2024-09-12T17:27:04.295 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T17:27:04.134+0000 7f59d7bec640 10 monclient: _finish_hunting 0 2024-09-12T17:27:04.295 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T17:27:04.134+0000 7f59d7bec640 1 monclient: found mon.noname-c 2024-09-12T17:27:04.295 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T17:27:04.134+0000 7f59d7bec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:27:04.295 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T17:27:04.135+0000 7f58b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:04.295 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T17:27:04.135+0000 7f58b97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:27:04.295 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T17:27:04.135+0000 7f58b97fa640 10 monclient: dump: 2024-09-12T17:27:04.295 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:04.296 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:04.296 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.296 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.296 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:04.296 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:04.296 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:04.296 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:04.296 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:04.296 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.296 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T17:27:04.135+0000 7f58b97fa640 10 monclient: _finish_auth 0 2024-09-12T17:27:04.296 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T17:27:04.135+0000 7f58b97fa640 10 monclient: _check_auth_tickets 2024-09-12T17:27:04.296 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T17:27:04.135+0000 7f58b97fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:27:04.296 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T17:27:04.135+0000 7f58b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:04.297 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T17:27:04.135+0000 7f58b97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:27:04.297 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T17:27:04.135+0000 7f58b97fa640 10 monclient: dump: 2024-09-12T17:27:04.297 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:04.297 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:04.297 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.297 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:04.297 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:04.297 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:04.297 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:04.297 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:04.297 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:04.297 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.297 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T17:27:04.135+0000 7f59dbc1b800 5 monclient: authenticate success, global_id 7310 2024-09-12T17:27:04.297 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T17:27:04.135+0000 7f59dbc1b800 10 monclient: _renew_subs 2024-09-12T17:27:04.298 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T17:27:04.135+0000 7f59dbc1b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:04.298 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T17:27:04.135+0000 7f58baffd640 4 set_mon_vals no callback set 2024-09-12T17:27:04.298 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T17:27:04.135+0000 7f59dbc1b800 10 monclient: _renew_subs 2024-09-12T17:27:04.298 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T17:27:04.135+0000 7f59dbc1b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:04.298 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T17:27:04.135+0000 7f59dbc1b800 1 librados: init done 2024-09-12T17:27:04.298 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T17:27:04.135+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command cr dump hook 0x562187997dc8 2024-09-12T17:27:04.298 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T17:27:04.137+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.298 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T17:27:04.137+0000 7f58b97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:27:04.298 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T17:27:04.137+0000 7f58b97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:27:04.298 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T17:27:04.137+0000 7f58b97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:27:04.298 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T17:27:04.137+0000 7f59d73eb640 10 monclient: get_auth_request con 0x7f58a0076470 auth_method 0 2024-09-12T17:27:04.298 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T17:27:04.138+0000 7f59d6bea640 10 monclient: get_auth_request con 0x5621879b6070 auth_method 0 2024-09-12T17:27:04.298 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T17:27:04.138+0000 7f59dbc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.298 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T17:27:04.138+0000 7f59dbc1b800 20 realm 2024-09-12T17:27:04.299 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T17:27:04.138+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.299 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T17:27:04.138+0000 7f59dbc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.299 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T17:27:04.138+0000 7f59dbc1b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:04.299 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T17:27:04.138+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.299 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T17:27:04.139+0000 7f59dbc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.299 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T17:27:04.139+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.299 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T17:27:04.139+0000 7f59d73eb640 10 monclient: get_auth_request con 0x5621879ba310 auth_method 0 2024-09-12T17:27:04.299 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T17:27:04.140+0000 7f59dbc1b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:04.299 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T17:27:04.140+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.299 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T17:27:04.140+0000 7f59d6bea640 10 monclient: get_auth_request con 0x5621879bdb70 auth_method 0 2024-09-12T17:27:04.299 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T17:27:04.140+0000 7f59dbc1b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:04.299 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T17:27:04.140+0000 7f59dbc1b800 20 searching for the correct realm 2024-09-12T17:27:04.299 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T17:27:04.140+0000 7f59d7bec640 10 monclient: get_auth_request con 0x5621879c28a0 auth_method 0 2024-09-12T17:27:04.300 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T17:27:04.141+0000 7f59d73eb640 10 monclient: get_auth_request con 0x7f59d001e070 auth_method 0 2024-09-12T17:27:04.300 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T17:27:04.142+0000 7f59d6bea640 10 monclient: get_auth_request con 0x7f59c807f040 auth_method 0 2024-09-12T17:27:04.300 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T17:27:04.144+0000 7f59d6bea640 0 -- 172.21.15.67:0/4236327666 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x5621879b6070 msgr2=0x5621879b84f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:04.300 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T17:27:04.144+0000 7f58b97fa640 1 client.7310.objecter ms_handle_reset 0x5621879b6070 session 0x5621879b59f0 osd.1 2024-09-12T17:27:04.300 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T17:27:04.144+0000 7f58b97fa640 10 monclient: _renew_subs 2024-09-12T17:27:04.300 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T17:27:04.144+0000 7f58b97fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:04.300 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T17:27:04.144+0000 7f59d6bea640 10 monclient: get_auth_request con 0x7f58a0086310 auth_method 0 2024-09-12T17:27:04.300 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T17:27:04.144+0000 7f59d7bec640 10 monclient: get_auth_request con 0x7f59cc062800 auth_method 0 2024-09-12T17:27:04.300 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T17:27:04.146+0000 7f59d73eb640 10 monclient: get_auth_request con 0x7f59cc0638d0 auth_method 0 2024-09-12T17:27:04.300 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T17:27:04.147+0000 7f59d6bea640 0 -- 172.21.15.67:0/4236327666 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x5621879bdb70 msgr2=0x5621879bff60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:27:04.300 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T17:27:04.147+0000 7f58b97fa640 1 client.7310.objecter ms_handle_reset 0x5621879bdb70 session 0x5621879b9660 osd.4 2024-09-12T17:27:04.300 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T17:27:04.147+0000 7f59d6bea640 10 monclient: get_auth_request con 0x5621879b6070 auth_method 0 2024-09-12T17:27:04.300 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:04.301 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:04.301 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:04.301 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:04.301 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:04.301 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:04.301 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.301 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.301 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.301 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:04.301 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T17:27:04.152+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.301 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:04.301 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 zone default found 2024-09-12T17:27:04.301 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 4 Realm: () 2024-09-12T17:27:04.302 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:04.302 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:04.302 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:04.302 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 zonegroup default 2024-09-12T17:27:04.302 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.302 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.302 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.302 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.302 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.302 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.302 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 started sync module instance, tier type = 2024-09-12T17:27:04.302 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T17:27:04.153+0000 7f59dbc1b800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:04.302 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T17:27:04.162+0000 7f59dbc1b800 20 add_watcher() i=0 2024-09-12T17:27:04.303 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T17:27:04.162+0000 7f59dbc1b800 20 add_watcher() i=1 2024-09-12T17:27:04.303 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T17:27:04.162+0000 7f59dbc1b800 20 add_watcher() i=2 2024-09-12T17:27:04.303 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T17:27:04.162+0000 7f59dbc1b800 20 add_watcher() i=3 2024-09-12T17:27:04.303 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T17:27:04.162+0000 7f59dbc1b800 20 add_watcher() i=4 2024-09-12T17:27:04.303 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T17:27:04.162+0000 7f59dbc1b800 20 add_watcher() i=5 2024-09-12T17:27:04.303 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T17:27:04.162+0000 7f59dbc1b800 20 add_watcher() i=6 2024-09-12T17:27:04.303 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T17:27:04.163+0000 7f59dbc1b800 20 add_watcher() i=7 2024-09-12T17:27:04.303 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T17:27:04.163+0000 7f59dbc1b800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:04.303 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding auth protocol: cephx 2024-09-12T17:27:04.303 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding auth protocol: cephx 2024-09-12T17:27:04.303 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding auth protocol: cephx 2024-09-12T17:27:04.303 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding con mode: secure 2024-09-12T17:27:04.303 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding con mode: crc 2024-09-12T17:27:04.303 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding con mode: secure 2024-09-12T17:27:04.304 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding con mode: crc 2024-09-12T17:27:04.304 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding con mode: secure 2024-09-12T17:27:04.304 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding con mode: crc 2024-09-12T17:27:04.304 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding con mode: crc 2024-09-12T17:27:04.304 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding con mode: secure 2024-09-12T17:27:04.304 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding con mode: crc 2024-09-12T17:27:04.304 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding con mode: secure 2024-09-12T17:27:04.304 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding con mode: crc 2024-09-12T17:27:04.304 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T17:27:04.164+0000 7f588dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:04.304 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T17:27:04.164+0000 7f59dbc1b800 5 AuthRegistry(0x7ffc2b03ce70) adding con mode: secure 2024-09-12T17:27:04.304 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:04.304 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:04.304 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:04.305 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command cache list hook 0x56218798fcf0 2024-09-12T17:27:04.305 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command cache inspect hook 0x56218798fcf0 2024-09-12T17:27:04.305 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command cache erase hook 0x56218798fcf0 2024-09-12T17:27:04.305 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command cache zap hook 0x56218798fcf0 2024-09-12T17:27:04.305 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 5 note: GC not initialized 2024-09-12T17:27:04.305 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T17:27:04.165+0000 7f588cfe1640 20 reqs_thread_entry: start 2024-09-12T17:27:04.305 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command sync trace show hook 0x7f59d0014030 2024-09-12T17:27:04.305 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command sync trace history hook 0x7f59d0014030 2024-09-12T17:27:04.305 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command sync trace active hook 0x7f59d0014030 2024-09-12T17:27:04.305 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 5 asok(0x5621876a7730) register_command sync trace active_short hook 0x7f59d0014030 2024-09-12T17:27:04.305 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:04.305 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 20 Filter name: none 2024-09-12T17:27:04.305 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T17:27:04.165+0000 7f58067fc640 20 reqs_thread_entry: start 2024-09-12T17:27:04.306 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:27:04.306 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T17:27:04.165+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.306 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T17:27:04.166+0000 7f59dbc1b800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:27:04.306 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T17:27:04.166+0000 7f59dbc1b800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:27:04.306 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T17:27:04.166+0000 7f59dbc1b800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:27:04.306 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T17:27:04.166+0000 7f59dbc1b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 : miss 2024-09-12T17:27:04.306 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T17:27:04.166+0000 7f59dbc1b800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.306 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T17:27:04.166+0000 7f59dbc1b800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:27:04.306 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T17:27:04.166+0000 7f59dbc1b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 info.flags=0x17 2024-09-12T17:27:04.306 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T17:27:04.166+0000 7f59dbc1b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 to cache LRU end 2024-09-12T17:27:04.306 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T17:27:04.166+0000 7f59dbc1b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:04.306 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T17:27:04.166+0000 7f59dbc1b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:04.306 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T17:27:04.166+0000 7f59dbc1b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 2024-09-12T17:27:04.306 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T17:27:04.170+0000 7f59dbc1b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 info.flags=0x17 2024-09-12T17:27:04.307 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T17:27:04.170+0000 7f59dbc1b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 to cache LRU end 2024-09-12T17:27:04.307 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T17:27:04.170+0000 7f59dbc1b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:04.307 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T17:27:04.170+0000 7f59dbc1b800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37, ofs0, ns] 2024-09-12T17:27:04.307 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T17:27:04.170+0000 7f58baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464309 cookie 94702009052544 notifier 7310 bl.length()=1007 2024-09-12T17:27:04.307 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T17:27:04.170+0000 7f58baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 info.flags=0x17 2024-09-12T17:27:04.307 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T17:27:04.170+0000 7f58baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 to cache LRU end 2024-09-12T17:27:04.307 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T17:27:04.170+0000 7f58baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:04.307 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T17:27:04.172+0000 7f59dbc1b800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.37]): orig_sources= new_sources= 2024-09-12T17:27:04.307 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T17:27:04.172+0000 7f59dbc1b800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.37]): potential sources added=[] removed=[] 2024-09-12T17:27:04.307 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T17:27:04.172+0000 7f59dbc1b800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.37]): orig_dests= new_dests= 2024-09-12T17:27:04.307 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T17:27:04.172+0000 7f59dbc1b800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.37]): potential dests added=[] removed=[] 2024-09-12T17:27:04.307 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T17:27:04.174+0000 7f59dbc1b800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f59dbc1b800 time 2024-09-12T17:27:04.175547+0000 2024-09-12T17:27:04.307 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:27:04.308 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.308 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:27:04.308 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f59dcd8c71a] 2024-09-12T17:27:04.308 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f59dcd8c8d8] 2024-09-12T17:27:04.308 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562184fde841] 2024-09-12T17:27:04.308 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd7490c) [0x5621854ec90c] 2024-09-12T17:27:04.308 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562184fee50d] 2024-09-12T17:27:04.308 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:27:04.308 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f59dba29590] 2024-09-12T17:27:04.308 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:27:04.308 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:27:04.308 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.308 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T17:27:04.175+0000 7f59dbc1b800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:27:04.309 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f59dbc1b800 thread_name:radosgw-admin 2024-09-12T17:27:04.309 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.309 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:27:04.309 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f59dba3e6f0] 2024-09-12T17:27:04.309 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f59dba8b99c] 2024-09-12T17:27:04.309 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:27:04.309 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:27:04.309 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f59dcd8c774] 2024-09-12T17:27:04.309 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f59dcd8c8d8] 2024-09-12T17:27:04.309 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562184fde841] 2024-09-12T17:27:04.309 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd7490c) [0x5621854ec90c] 2024-09-12T17:27:04.309 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562184fee50d] 2024-09-12T17:27:04.309 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:27:04.310 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f59dba29590] 2024-09-12T17:27:04.310 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:27:04.310 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:27:04.310 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:27:04.310 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.310 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T17:27:04.310 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T17:27:04.310 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T17:27:04.310 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T17:27:04.310 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T17:27:04.310 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T17:27:04.310 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T17:27:04.310 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T17:27:04.310 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T17:27:04.311 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T17:27:04.311 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T17:27:04.311 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T17:27:04.311 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T17:27:04.311 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T17:27:04.311 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T17:27:04.311 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T17:27:04.311 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T17:27:04.311 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T17:27:04.311 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T17:27:04.311 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T17:27:04.311 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T17:27:04.311 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T17:27:04.311 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T17:27:04.312 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T17:27:04.312 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:27:04.312 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T17:27:04.312 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T17:27:04.312 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T17:27:04.312 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T17:27:04.312 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T17:27:04.312 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T17:27:04.312 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T17:27:04.312 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T17:27:04.312 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T17:27:04.312 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T17:27:04.312 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T17:27:04.312 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T17:27:04.313 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T17:27:04.313 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T17:27:04.313 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T17:27:04.313 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T17:27:04.313 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T17:27:04.313 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T17:27:04.313 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T17:27:04.313 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T17:27:04.313 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T17:27:04.313 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:27:04.313 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T17:27:04.313 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:27:04.313 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T17:27:04.313 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T17:27:04.314 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T17:27:04.314 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T17:27:04.314 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T17:27:04.314 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T17:27:04.314 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T17:27:04.314 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T17:27:04.314 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T17:27:04.314 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T17:27:04.314 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T17:27:04.314 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T17:27:04.314 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T17:27:04.314 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T17:27:04.314 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T17:27:04.314 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T17:27:04.315 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T17:27:04.315 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T17:27:04.315 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:27:04.315 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T17:27:04.315 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:27:04.315 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T17:27:04.315 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T17:27:04.315 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T17:27:04.315 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T17:27:04.315 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T17:27:04.315 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T17:27:04.315 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:27:04.315 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T17:27:04.315 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T17:27:04.316 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:27:04.316 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T17:27:04.316 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T17:27:04.316 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T17:27:04.316 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T17:27:04.316 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T17:27:04.316 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T17:27:04.316 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T17:27:04.316 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T17:27:04.316 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T17:27:04.316 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T17:27:04.316 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T17:27:04.316 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T17:27:04.316 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T17:27:04.317 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:27:04.317 INFO:tasks.workunit.client.0.smithi067.stderr: 7f58067fc640 / http_manager 2024-09-12T17:27:04.317 INFO:tasks.workunit.client.0.smithi067.stderr: 7f588cfe1640 / http_manager 2024-09-12T17:27:04.317 INFO:tasks.workunit.client.0.smithi067.stderr: 7f588dfe3640 / rgw_dt_lg_renew 2024-09-12T17:27:04.317 INFO:tasks.workunit.client.0.smithi067.stderr: 7f58b97fa640 / ms_dispatch 2024-09-12T17:27:04.317 INFO:tasks.workunit.client.0.smithi067.stderr: 7f58baffd640 / io_context_pool 2024-09-12T17:27:04.317 INFO:tasks.workunit.client.0.smithi067.stderr: 7f58c1602640 / ms_dispatch 2024-09-12T17:27:04.317 INFO:tasks.workunit.client.0.smithi067.stderr: 7f58c3e07640 / ms_dispatch 2024-09-12T17:27:04.317 INFO:tasks.workunit.client.0.smithi067.stderr: 7f58c560a640 / io_context_pool 2024-09-12T17:27:04.317 INFO:tasks.workunit.client.0.smithi067.stderr: 7f59d6bea640 / msgr-worker-2 2024-09-12T17:27:04.317 INFO:tasks.workunit.client.0.smithi067.stderr: 7f59d73eb640 / msgr-worker-1 2024-09-12T17:27:04.317 INFO:tasks.workunit.client.0.smithi067.stderr: 7f59d7bec640 / msgr-worker-0 2024-09-12T17:27:04.317 INFO:tasks.workunit.client.0.smithi067.stderr: 7f59d83ed640 / io_context_pool 2024-09-12T17:27:04.317 INFO:tasks.workunit.client.0.smithi067.stderr: 7f59dbc1b800 / radosgw-admin 2024-09-12T17:27:04.318 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T17:27:04.318 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T17:27:04.318 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:27:04.177211Z_5c3797eb-c38e-4e5d-b917-547ababf74d2/log 2024-09-12T17:27:04.318 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T17:27:04.318 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T17:27:04.319 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:04.319 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:04.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.253+0000 7f3087c14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.255+0000 7f3087c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.255+0000 7f3087c14800 20 realm 2024-09-12T17:27:04.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.255+0000 7f3087c14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.255+0000 7f3087c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.255+0000 7f3087c14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:04.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.255+0000 7f3087c14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.255+0000 7f3087c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.255+0000 7f3087c14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.256+0000 7f3087c14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:04.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.256+0000 7f3087c14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.257+0000 7f3087c14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:04.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.257+0000 7f3087c14800 20 searching for the correct realm 2024-09-12T17:27:04.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.259+0000 7f3082aca640 0 -- 172.21.15.67:0/2955927770 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f307406c910 msgr2=0x7f30740610b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:04.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.262+0000 7f30832cb640 0 -- 172.21.15.67:0/2955927770 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f30780c2ba0 msgr2=0x7f30780c23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:04.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.469+0000 7f3087c14800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:04.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.469+0000 7f3087c14800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:04.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.469+0000 7f3087c14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:04.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.469+0000 7f3087c14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:04.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.469+0000 7f3087c14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:04.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.469+0000 7f3087c14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:04.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.469+0000 7f3087c14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.469+0000 7f3087c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.469+0000 7f3087c14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.469+0000 7f3087c14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:04.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.469+0000 7f3087c14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.470+0000 7f3087c14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:04.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.470+0000 7f3087c14800 20 zone default found 2024-09-12T17:27:04.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.470+0000 7f3087c14800 4 Realm: () 2024-09-12T17:27:04.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.470+0000 7f3087c14800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:04.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.470+0000 7f3087c14800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:04.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.470+0000 7f3087c14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:04.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.470+0000 7f3087c14800 20 zonegroup default 2024-09-12T17:27:04.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.470+0000 7f3087c14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.470+0000 7f3087c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.470+0000 7f3087c14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.470+0000 7f3087c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.470+0000 7f3087c14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.471+0000 7f3087c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.471+0000 7f3087c14800 20 started sync module instance, tier type = 2024-09-12T17:27:04.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.471+0000 7f3087c14800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:04.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.479+0000 7f3087c14800 20 add_watcher() i=0 2024-09-12T17:27:04.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.479+0000 7f3087c14800 20 add_watcher() i=1 2024-09-12T17:27:04.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.479+0000 7f3087c14800 20 add_watcher() i=2 2024-09-12T17:27:04.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.479+0000 7f3087c14800 20 add_watcher() i=3 2024-09-12T17:27:04.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.479+0000 7f3087c14800 20 add_watcher() i=4 2024-09-12T17:27:04.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.479+0000 7f3087c14800 20 add_watcher() i=5 2024-09-12T17:27:04.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.479+0000 7f3087c14800 20 add_watcher() i=6 2024-09-12T17:27:04.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.480+0000 7f3087c14800 20 add_watcher() i=7 2024-09-12T17:27:04.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.480+0000 7f3087c14800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:04.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.482+0000 7f2f39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:04.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.482+0000 7f3087c14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:04.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.482+0000 7f3087c14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:04.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.482+0000 7f3087c14800 5 note: GC not initialized 2024-09-12T17:27:04.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.483+0000 7f2f38fe1640 20 reqs_thread_entry: start 2024-09-12T17:27:04.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.483+0000 7f3087c14800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:04.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.483+0000 7f3087c14800 20 Filter name: none 2024-09-12T17:27:04.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.483+0000 7f2eb27fc640 20 reqs_thread_entry: start 2024-09-12T17:27:04.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.483+0000 7f3087c14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.484+0000 7f3087c14800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:27:04.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.484+0000 7f3087c14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.484+0000 7f3087c14800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T17:27:04.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.484+0000 7f3087c14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:04.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.484+0000 7f3087c14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.485+0000 7f3087c14800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:27:04.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.485+0000 7f3087c14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.485+0000 7f3087c14800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T17:27:04.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.485+0000 7f3087c14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:04.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.486+0000 7f2f39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:04.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.488+0000 7f3087c14800 20 remove_watcher() i=0 2024-09-12T17:27:04.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.488+0000 7f3087c14800 2 removed watcher, disabling cache 2024-09-12T17:27:04.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.489+0000 7f3087c14800 20 remove_watcher() i=1 2024-09-12T17:27:04.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.490+0000 7f3087c14800 20 remove_watcher() i=2 2024-09-12T17:27:04.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.492+0000 7f3087c14800 20 remove_watcher() i=3 2024-09-12T17:27:04.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.493+0000 7f3087c14800 20 remove_watcher() i=4 2024-09-12T17:27:04.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.494+0000 7f3087c14800 20 remove_watcher() i=5 2024-09-12T17:27:04.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.495+0000 7f3087c14800 20 remove_watcher() i=6 2024-09-12T17:27:04.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.496+0000 7f3087c14800 20 remove_watcher() i=7 2024-09-12T17:27:04.509 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.509 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:27:04.509 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-logrecord-writes id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:27:04.509 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:04.510 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:04.510 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:04.545 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:04.545 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:04.603 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:27:04.637 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:04.637 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:04.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.674+0000 7fd475b40800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.676+0000 7fd475b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.676+0000 7fd475b40800 20 realm 2024-09-12T17:27:04.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.676+0000 7fd475b40800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.676+0000 7fd475b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.676+0000 7fd475b40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:04.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.676+0000 7fd475b40800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.676+0000 7fd475b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.676+0000 7fd475b40800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.677+0000 7fd475b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:04.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.677+0000 7fd475b40800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.678+0000 7fd475b40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:04.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.678+0000 7fd475b40800 20 searching for the correct realm 2024-09-12T17:27:04.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.680+0000 7fd471085640 0 -- 172.21.15.67:0/3224223090 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x5567ad11dd60 msgr2=0x5567ad120170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:04.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.684+0000 7fd471886640 0 -- 172.21.15.67:0/3224223090 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fd468064940 msgr2=0x7fd468084410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:04.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.891+0000 7fd475b40800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:04.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.891+0000 7fd475b40800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:04.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.891+0000 7fd475b40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:04.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.891+0000 7fd475b40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:04.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.891+0000 7fd475b40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:04.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.891+0000 7fd475b40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:04.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.891+0000 7fd475b40800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.891+0000 7fd475b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.891+0000 7fd475b40800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.891+0000 7fd475b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:04.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.891+0000 7fd475b40800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.892+0000 7fd475b40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:04.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.892+0000 7fd475b40800 20 zone default found 2024-09-12T17:27:04.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.892+0000 7fd475b40800 4 Realm: () 2024-09-12T17:27:04.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.892+0000 7fd475b40800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:04.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.892+0000 7fd475b40800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:04.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.892+0000 7fd475b40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:04.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.892+0000 7fd475b40800 20 zonegroup default 2024-09-12T17:27:04.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.892+0000 7fd475b40800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.892+0000 7fd475b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.892+0000 7fd475b40800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.892+0000 7fd475b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.892+0000 7fd475b40800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.892+0000 7fd475b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:04.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.892+0000 7fd475b40800 20 started sync module instance, tier type = 2024-09-12T17:27:04.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.892+0000 7fd475b40800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:04.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.902+0000 7fd475b40800 20 add_watcher() i=0 2024-09-12T17:27:04.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.902+0000 7fd475b40800 20 add_watcher() i=1 2024-09-12T17:27:04.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.902+0000 7fd475b40800 20 add_watcher() i=2 2024-09-12T17:27:04.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.902+0000 7fd475b40800 20 add_watcher() i=3 2024-09-12T17:27:04.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.902+0000 7fd475b40800 20 add_watcher() i=4 2024-09-12T17:27:04.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.902+0000 7fd475b40800 20 add_watcher() i=5 2024-09-12T17:27:04.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.902+0000 7fd475b40800 20 add_watcher() i=6 2024-09-12T17:27:04.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.903+0000 7fd475b40800 20 add_watcher() i=7 2024-09-12T17:27:04.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.903+0000 7fd475b40800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:04.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.905+0000 7fd323fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:04.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.905+0000 7fd475b40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:04.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.905+0000 7fd475b40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:04.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.905+0000 7fd475b40800 5 note: GC not initialized 2024-09-12T17:27:04.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.905+0000 7fd322ffd640 20 reqs_thread_entry: start 2024-09-12T17:27:04.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.906+0000 7fd475b40800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:04.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.906+0000 7fd475b40800 20 Filter name: none 2024-09-12T17:27:04.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.906+0000 7fd320ff9640 20 reqs_thread_entry: start 2024-09-12T17:27:04.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.906+0000 7fd475b40800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:27:04.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.906+0000 7fd475b40800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.906+0000 7fd475b40800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:27:04.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.906+0000 7fd475b40800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:27:04.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.906+0000 7fd475b40800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:27:04.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.906+0000 7fd475b40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 : miss 2024-09-12T17:27:04.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.906+0000 7fd475b40800 20 rados->read ofs=0 len=0 2024-09-12T17:27:04.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.907+0000 7fd475b40800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T17:27:04.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.907+0000 7fd475b40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 info.flags=0x17 2024-09-12T17:27:04.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.907+0000 7fd475b40800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 to cache LRU end 2024-09-12T17:27:04.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.907+0000 7fd475b40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:04.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.907+0000 7fd475b40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:04.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.907+0000 7fd475b40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 2024-09-12T17:27:04.911 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.908+0000 7fd475b40800 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 to be held by another RGW process; skipping for now 2024-09-12T17:27:04.911 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.909+0000 7fd323fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:04.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.911+0000 7fd475b40800 20 remove_watcher() i=0 2024-09-12T17:27:04.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.911+0000 7fd475b40800 2 removed watcher, disabling cache 2024-09-12T17:27:04.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.912+0000 7fd475b40800 20 remove_watcher() i=1 2024-09-12T17:27:04.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.913+0000 7fd475b40800 20 remove_watcher() i=2 2024-09-12T17:27:04.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.914+0000 7fd475b40800 20 remove_watcher() i=3 2024-09-12T17:27:04.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.915+0000 7fd475b40800 20 remove_watcher() i=4 2024-09-12T17:27:04.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.916+0000 7fd475b40800 20 remove_watcher() i=5 2024-09-12T17:27:04.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.917+0000 7fd475b40800 20 remove_watcher() i=6 2024-09-12T17:27:04.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:04.918+0000 7fd475b40800 20 remove_watcher() i=7 2024-09-12T17:27:04.931 INFO:tasks.workunit.client.0.smithi067.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:27:34.941 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:27:34.977 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:34.977 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:35.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.021+0000 7f3776d25800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.023+0000 7f3776d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:35.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.023+0000 7f3776d25800 20 realm 2024-09-12T17:27:35.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.023+0000 7f3776d25800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.023+0000 7f3776d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:35.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.023+0000 7f3776d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:35.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.023+0000 7f3776d25800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.023+0000 7f3776d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:35.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.023+0000 7f3776d25800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.024+0000 7f3776d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:35.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.024+0000 7f3776d25800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.025+0000 7f3776d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:35.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.025+0000 7f3776d25800 20 searching for the correct realm 2024-09-12T17:27:35.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.028+0000 7f3772132640 0 -- 172.21.15.67:0/1191345850 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55de60d0a3e0 msgr2=0x55de60d0c7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:35.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.032+0000 7f3772933640 0 -- 172.21.15.67:0/1191345850 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f3768027040 msgr2=0x7f3768026920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:27:35.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.239+0000 7f3776d25800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:35.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.239+0000 7f3776d25800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:35.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.239+0000 7f3776d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:35.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.239+0000 7f3776d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:35.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.239+0000 7f3776d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:35.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.239+0000 7f3776d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:35.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.239+0000 7f3776d25800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.239+0000 7f3776d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:35.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.239+0000 7f3776d25800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.240+0000 7f3776d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:35.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.240+0000 7f3776d25800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.240+0000 7f3776d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:35.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.240+0000 7f3776d25800 20 zone default found 2024-09-12T17:27:35.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.240+0000 7f3776d25800 4 Realm: () 2024-09-12T17:27:35.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.240+0000 7f3776d25800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:35.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.240+0000 7f3776d25800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:35.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.240+0000 7f3776d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:35.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.240+0000 7f3776d25800 20 zonegroup default 2024-09-12T17:27:35.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.240+0000 7f3776d25800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.241+0000 7f3776d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:35.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.241+0000 7f3776d25800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.241+0000 7f3776d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:35.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.241+0000 7f3776d25800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.241+0000 7f3776d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:35.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.241+0000 7f3776d25800 20 started sync module instance, tier type = 2024-09-12T17:27:35.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.241+0000 7f3776d25800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:35.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.251+0000 7f3776d25800 20 add_watcher() i=0 2024-09-12T17:27:35.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.251+0000 7f3776d25800 20 add_watcher() i=1 2024-09-12T17:27:35.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.251+0000 7f3776d25800 20 add_watcher() i=2 2024-09-12T17:27:35.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.251+0000 7f3776d25800 20 add_watcher() i=3 2024-09-12T17:27:35.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.251+0000 7f3776d25800 20 add_watcher() i=4 2024-09-12T17:27:35.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.251+0000 7f3776d25800 20 add_watcher() i=5 2024-09-12T17:27:35.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.251+0000 7f3776d25800 20 add_watcher() i=6 2024-09-12T17:27:35.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.253+0000 7f3776d25800 20 add_watcher() i=7 2024-09-12T17:27:35.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.253+0000 7f3776d25800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:35.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.254+0000 7f36297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:35.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.255+0000 7f3776d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:35.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.255+0000 7f3776d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:35.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.255+0000 7f3776d25800 5 note: GC not initialized 2024-09-12T17:27:35.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.255+0000 7f35a3fff640 20 reqs_thread_entry: start 2024-09-12T17:27:35.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.255+0000 7f3776d25800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:35.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.255+0000 7f3776d25800 20 Filter name: none 2024-09-12T17:27:35.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.255+0000 7f35a1ffb640 20 reqs_thread_entry: start 2024-09-12T17:27:35.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.255+0000 7f3776d25800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:27:35.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.255+0000 7f3776d25800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.256+0000 7f3776d25800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:27:35.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.256+0000 7f3776d25800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:27:35.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.256+0000 7f3776d25800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:27:35.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.256+0000 7f3776d25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 : miss 2024-09-12T17:27:35.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.256+0000 7f3776d25800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.256+0000 7f3776d25800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T17:27:35.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.256+0000 7f3776d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 info.flags=0x17 2024-09-12T17:27:35.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.256+0000 7f3776d25800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 to cache LRU end 2024-09-12T17:27:35.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.256+0000 7f3776d25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:35.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.256+0000 7f3776d25800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:35.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.256+0000 7f3776d25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 2024-09-12T17:27:35.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.258+0000 7f3776d25800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:27:35.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.262+0000 7f3776d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 info.flags=0x17 2024-09-12T17:27:35.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.262+0000 7f3776d25800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 to cache LRU end 2024-09-12T17:27:35.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.262+0000 7f3776d25800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:35.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.262+0000 7f3776d25800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37, ofs0, ns] 2024-09-12T17:27:35.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.262+0000 7f3655ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464310 cookie 94413595395776 notifier 7827 bl.length()=1007 2024-09-12T17:27:35.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.262+0000 7f3655ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 info.flags=0x17 2024-09-12T17:27:35.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.262+0000 7f3655ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 to cache LRU end 2024-09-12T17:27:35.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.262+0000 7f3655ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:35.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.264+0000 7f3776d25800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.37]): orig_sources= new_sources= 2024-09-12T17:27:35.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.264+0000 7f3776d25800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.37]): potential sources added=[] removed=[] 2024-09-12T17:27:35.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.264+0000 7f3776d25800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.37]): orig_dests= new_dests= 2024-09-12T17:27:35.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.264+0000 7f3776d25800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.37]): potential dests added=[] removed=[] 2024-09-12T17:27:35.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.267+0000 7f3776d25800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.37.2.0 2024-09-12T17:27:35.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.267+0000 7f3776d25800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.37.2.0 2024-09-12T17:27:35.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.267+0000 7f3776d25800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.37.2.1 2024-09-12T17:27:35.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.267+0000 7f3776d25800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.37.2.1 2024-09-12T17:27:35.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.267+0000 7f3776d25800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.37.0 2024-09-12T17:27:35.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.269+0000 7f3776d25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 : hit (requested=0x17, cached=0x17) 2024-09-12T17:27:35.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.269+0000 7f3776d25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 2024-09-12T17:27:35.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.271+0000 7f3776d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 info.flags=0x17 2024-09-12T17:27:35.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.271+0000 7f3776d25800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 to cache LRU end 2024-09-12T17:27:35.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.271+0000 7f3776d25800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:35.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.271+0000 7f3776d25800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37, ofs0, ns] 2024-09-12T17:27:35.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.271+0000 7f3655ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464311 cookie 94413595395776 notifier 7827 bl.length()=1007 2024-09-12T17:27:35.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.271+0000 7f3655ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 info.flags=0x17 2024-09-12T17:27:35.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.271+0000 7f3655ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 to cache LRU end 2024-09-12T17:27:35.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.271+0000 7f3655ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:35.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.273+0000 7f3776d25800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.37]): orig_sources= new_sources= 2024-09-12T17:27:35.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.273+0000 7f3776d25800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.37]): potential sources added=[] removed=[] 2024-09-12T17:27:35.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.273+0000 7f3776d25800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.37]): orig_dests= new_dests= 2024-09-12T17:27:35.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.273+0000 7f3776d25800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.37]): potential dests added=[] removed=[] 2024-09-12T17:27:35.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.274+0000 7f3776d25800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.37.0 2024-09-12T17:27:35.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.274+0000 7f3776d25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 : hit (requested=0x17, cached=0x17) 2024-09-12T17:27:35.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.274+0000 7f3776d25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 2024-09-12T17:27:35.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.276+0000 7f3776d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 info.flags=0x17 2024-09-12T17:27:35.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.276+0000 7f3776d25800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 to cache LRU end 2024-09-12T17:27:35.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.276+0000 7f3776d25800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:35.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.276+0000 7f3776d25800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37, ofs0, ns] 2024-09-12T17:27:35.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.276+0000 7f36567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464312 cookie 94413595395776 notifier 7827 bl.length()=975 2024-09-12T17:27:35.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.276+0000 7f36567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 info.flags=0x17 2024-09-12T17:27:35.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.276+0000 7f36567fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 to cache LRU end 2024-09-12T17:27:35.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.276+0000 7f36567fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:35.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.278+0000 7f3776d25800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.37]): orig_sources= new_sources= 2024-09-12T17:27:35.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.278+0000 7f3776d25800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.37]): potential sources added=[] removed=[] 2024-09-12T17:27:35.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.278+0000 7f3776d25800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.37]): orig_dests= new_dests= 2024-09-12T17:27:35.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.278+0000 7f3776d25800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[06eb12d0-49d6-461d-9efe-05d212954deb.4538.37]): potential dests added=[] removed=[] 2024-09-12T17:27:35.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.279+0000 7f3776d25800 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-12T17:27:35.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.281+0000 7f36297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:35.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.283+0000 7f3776d25800 20 remove_watcher() i=0 2024-09-12T17:27:35.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.283+0000 7f3776d25800 2 removed watcher, disabling cache 2024-09-12T17:27:35.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.284+0000 7f3776d25800 20 remove_watcher() i=1 2024-09-12T17:27:35.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.285+0000 7f3776d25800 20 remove_watcher() i=2 2024-09-12T17:27:35.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.286+0000 7f3776d25800 20 remove_watcher() i=3 2024-09-12T17:27:35.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.288+0000 7f3776d25800 20 remove_watcher() i=4 2024-09-12T17:27:35.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.289+0000 7f3776d25800 20 remove_watcher() i=5 2024-09-12T17:27:35.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.290+0000 7f3776d25800 20 remove_watcher() i=6 2024-09-12T17:27:35.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.291+0000 7f3776d25800 20 remove_watcher() i=7 2024-09-12T17:27:35.305 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T17:27:35.335 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:35.335 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:35.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.374+0000 7efd77546800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.376+0000 7efd77546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:35.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.376+0000 7efd77546800 20 realm 2024-09-12T17:27:35.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.376+0000 7efd77546800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.376+0000 7efd77546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:35.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.376+0000 7efd77546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:35.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.376+0000 7efd77546800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.376+0000 7efd77546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:35.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.376+0000 7efd77546800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.377+0000 7efd77546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:35.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.377+0000 7efd77546800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.378+0000 7efd77546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:35.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.378+0000 7efd77546800 20 searching for the correct realm 2024-09-12T17:27:35.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.380+0000 7efd6c836640 0 -- 172.21.15.67:0/1227448092 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55e3f17f6a50 msgr2=0x55e3f17f8e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:27:35.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.384+0000 7efd75037640 0 -- 172.21.15.67:0/1227448092 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7efd600b6240 msgr2=0x7efd600c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:35.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.591+0000 7efd77546800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:35.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.591+0000 7efd77546800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:35.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.591+0000 7efd77546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:35.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.591+0000 7efd77546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:35.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.591+0000 7efd77546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:35.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.591+0000 7efd77546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:35.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.591+0000 7efd77546800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.591+0000 7efd77546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:35.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.591+0000 7efd77546800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.591+0000 7efd77546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:35.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.591+0000 7efd77546800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.592+0000 7efd77546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:35.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.592+0000 7efd77546800 20 zone default found 2024-09-12T17:27:35.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.592+0000 7efd77546800 4 Realm: () 2024-09-12T17:27:35.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.592+0000 7efd77546800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:35.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.592+0000 7efd77546800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:35.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.592+0000 7efd77546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:35.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.592+0000 7efd77546800 20 zonegroup default 2024-09-12T17:27:35.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.592+0000 7efd77546800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.592+0000 7efd77546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:35.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.592+0000 7efd77546800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.592+0000 7efd77546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:35.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.592+0000 7efd77546800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.592+0000 7efd77546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:35.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.592+0000 7efd77546800 20 started sync module instance, tier type = 2024-09-12T17:27:35.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.592+0000 7efd77546800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:35.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.602+0000 7efd77546800 20 add_watcher() i=0 2024-09-12T17:27:35.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.602+0000 7efd77546800 20 add_watcher() i=1 2024-09-12T17:27:35.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.602+0000 7efd77546800 20 add_watcher() i=2 2024-09-12T17:27:35.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.602+0000 7efd77546800 20 add_watcher() i=3 2024-09-12T17:27:35.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.602+0000 7efd77546800 20 add_watcher() i=4 2024-09-12T17:27:35.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.602+0000 7efd77546800 20 add_watcher() i=5 2024-09-12T17:27:35.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.602+0000 7efd77546800 20 add_watcher() i=6 2024-09-12T17:27:35.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.603+0000 7efd77546800 20 add_watcher() i=7 2024-09-12T17:27:35.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.603+0000 7efd77546800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:35.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.605+0000 7efc2bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:35.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.605+0000 7efd77546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:35.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.605+0000 7efd77546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:35.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.605+0000 7efd77546800 5 note: GC not initialized 2024-09-12T17:27:35.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.605+0000 7efc2afe5640 20 reqs_thread_entry: start 2024-09-12T17:27:35.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.606+0000 7efd77546800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:35.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.606+0000 7efd77546800 20 Filter name: none 2024-09-12T17:27:35.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.606+0000 7efc28fe1640 20 reqs_thread_entry: start 2024-09-12T17:27:35.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.606+0000 7efd77546800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.607+0000 7efd77546800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:27:35.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.607+0000 7efd77546800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.607+0000 7efd77546800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:27:35.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.607+0000 7efd77546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:35.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.607+0000 7efd77546800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.607+0000 7efd77546800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:27:35.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.607+0000 7efd77546800 20 rados->read ofs=0 len=0 2024-09-12T17:27:35.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.608+0000 7efd77546800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:27:35.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.608+0000 7efd77546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:35.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.609+0000 7efc2bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:35.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.612+0000 7efd77546800 20 remove_watcher() i=0 2024-09-12T17:27:35.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.612+0000 7efd77546800 2 removed watcher, disabling cache 2024-09-12T17:27:35.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.613+0000 7efd77546800 20 remove_watcher() i=1 2024-09-12T17:27:35.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.614+0000 7efd77546800 20 remove_watcher() i=2 2024-09-12T17:27:35.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.615+0000 7efd77546800 20 remove_watcher() i=3 2024-09-12T17:27:35.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.616+0000 7efd77546800 20 remove_watcher() i=4 2024-09-12T17:27:35.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.617+0000 7efd77546800 20 remove_watcher() i=5 2024-09-12T17:27:35.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.618+0000 7efd77546800 20 remove_watcher() i=6 2024-09-12T17:27:35.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:35.619+0000 7efd77546800 20 remove_watcher() i=7 2024-09-12T17:27:35.632 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:35.632 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:27:35.632 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-logrecord-writes id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.37 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:27:35.632 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:35.633 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:35.633 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:35.655 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:35.655 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:35.873 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:35.873 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:35.938 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-12T17:27:35.938 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:35.940 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:35.940 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:35.983 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:35.984 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:36.041 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:36.041 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:36.080 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:36.080 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:36.117 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:36.117 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:36.153 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:36.153 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:36.190 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:36.190 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:36.226 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:36.226 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:36.263 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:36.263 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:36.298 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:36.299 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:36.335 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:36.336 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:36.372 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:36.372 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:36.408 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:36.409 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:36.444 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:36.444 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:36.480 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:36.480 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:36.515 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:36.515 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:36.551 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:36.551 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:36.588 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:36.589 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:36.625 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:36.625 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:36.661 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:36.662 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:36.698 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:36.698 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:36.734 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:36.734 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:36.771 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:27:36.800 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:36.800 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:36.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.838+0000 7fa9f2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.840+0000 7fa9f2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:36.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.840+0000 7fa9f2b23800 20 realm 2024-09-12T17:27:36.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.840+0000 7fa9f2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.840+0000 7fa9f2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:36.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.840+0000 7fa9f2b23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:36.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.840+0000 7fa9f2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.841+0000 7fa9f2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:36.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.841+0000 7fa9f2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.841+0000 7fa9f2b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:36.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.841+0000 7fa9f2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.842+0000 7fa9f2b23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:36.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.842+0000 7fa9f2b23800 20 searching for the correct realm 2024-09-12T17:27:36.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.845+0000 7fa9ee012640 0 -- 172.21.15.67:0/3637292789 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x5600d6c81c30 msgr2=0x5600d6c84020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:36.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.848+0000 7fa9ee813640 0 -- 172.21.15.67:0/3637292789 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fa9e408f160 msgr2=0x7fa9e408c8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:36.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.852+0000 7fa9f2b23800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:36.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.852+0000 7fa9f2b23800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:36.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.852+0000 7fa9f2b23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:36.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.852+0000 7fa9f2b23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:36.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.852+0000 7fa9f2b23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:36.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.852+0000 7fa9f2b23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:36.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.852+0000 7fa9f2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.852+0000 7fa9f2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:36.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.852+0000 7fa9f2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.853+0000 7fa9f2b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:36.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.853+0000 7fa9f2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.853+0000 7fa9f2b23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:36.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.853+0000 7fa9f2b23800 20 zone default found 2024-09-12T17:27:36.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.853+0000 7fa9f2b23800 4 Realm: () 2024-09-12T17:27:36.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.853+0000 7fa9f2b23800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:36.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.853+0000 7fa9f2b23800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:36.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.853+0000 7fa9f2b23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:36.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.853+0000 7fa9f2b23800 20 zonegroup default 2024-09-12T17:27:36.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.853+0000 7fa9f2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.853+0000 7fa9f2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:36.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.853+0000 7fa9f2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.853+0000 7fa9f2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:36.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.853+0000 7fa9f2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.854+0000 7fa9f2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:36.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.854+0000 7fa9f2b23800 20 started sync module instance, tier type = 2024-09-12T17:27:36.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.854+0000 7fa9f2b23800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:36.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.862+0000 7fa9f2b23800 20 add_watcher() i=0 2024-09-12T17:27:36.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.862+0000 7fa9f2b23800 20 add_watcher() i=1 2024-09-12T17:27:36.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.862+0000 7fa9f2b23800 20 add_watcher() i=2 2024-09-12T17:27:36.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.862+0000 7fa9f2b23800 20 add_watcher() i=3 2024-09-12T17:27:36.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.862+0000 7fa9f2b23800 20 add_watcher() i=4 2024-09-12T17:27:36.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.862+0000 7fa9f2b23800 20 add_watcher() i=5 2024-09-12T17:27:36.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.862+0000 7fa9f2b23800 20 add_watcher() i=6 2024-09-12T17:27:36.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.863+0000 7fa9f2b23800 20 add_watcher() i=7 2024-09-12T17:27:36.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.863+0000 7fa9f2b23800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:36.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.865+0000 7fa8a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:36.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.865+0000 7fa9f2b23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:36.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.865+0000 7fa9f2b23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:36.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.865+0000 7fa9f2b23800 5 note: GC not initialized 2024-09-12T17:27:36.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.865+0000 7fa81ffff640 20 reqs_thread_entry: start 2024-09-12T17:27:36.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.865+0000 7fa9f2b23800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:36.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.865+0000 7fa9f2b23800 20 Filter name: none 2024-09-12T17:27:36.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.866+0000 7fa81dffb640 20 reqs_thread_entry: start 2024-09-12T17:27:36.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.866+0000 7fa9f2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.866+0000 7fa9f2b23800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:27:36.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.866+0000 7fa9f2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.867+0000 7fa9f2b23800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:27:36.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.867+0000 7fa9f2b23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:36.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.867+0000 7fa9f2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.867+0000 7fa9f2b23800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:27:36.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.867+0000 7fa9f2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.867+0000 7fa9f2b23800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:27:36.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.867+0000 7fa9f2b23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:36.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.869+0000 7fa8a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:36.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.871+0000 7fa9f2b23800 20 remove_watcher() i=0 2024-09-12T17:27:36.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.871+0000 7fa9f2b23800 2 removed watcher, disabling cache 2024-09-12T17:27:36.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.872+0000 7fa9f2b23800 20 remove_watcher() i=1 2024-09-12T17:27:36.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.873+0000 7fa9f2b23800 20 remove_watcher() i=2 2024-09-12T17:27:36.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.874+0000 7fa9f2b23800 20 remove_watcher() i=3 2024-09-12T17:27:36.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.875+0000 7fa9f2b23800 20 remove_watcher() i=4 2024-09-12T17:27:36.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.876+0000 7fa9f2b23800 20 remove_watcher() i=5 2024-09-12T17:27:36.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.877+0000 7fa9f2b23800 20 remove_watcher() i=6 2024-09-12T17:27:36.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.878+0000 7fa9f2b23800 20 remove_watcher() i=7 2024-09-12T17:27:36.889 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:36.889 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:27:36.889 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-change-reshard-state id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:27:36.889 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:36.891 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-12T17:27:36.925 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:36.925 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:36.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.963+0000 7f7fb4610800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.965+0000 7f7fb4610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:36.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.965+0000 7f7fb4610800 20 realm 2024-09-12T17:27:36.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.965+0000 7f7fb4610800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.965+0000 7f7fb4610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:36.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.965+0000 7f7fb4610800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:36.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.965+0000 7f7fb4610800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.965+0000 7f7fb4610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:36.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.965+0000 7f7fb4610800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.966+0000 7f7fb4610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:36.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.966+0000 7f7fb4610800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.967+0000 7f7fb4610800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:36.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.967+0000 7f7fb4610800 20 searching for the correct realm 2024-09-12T17:27:36.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.970+0000 7f7fb05bd640 0 -- 172.21.15.67:0/155371048 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x5572f51c8490 msgr2=0x5572f51ca950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:36.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.973+0000 7f7fafdbc640 0 -- 172.21.15.67:0/155371048 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f7fa40776b0 msgr2=0x7f7fa4034740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:36.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.977+0000 7f7fb4610800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:36.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.977+0000 7f7fb4610800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:36.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.977+0000 7f7fb4610800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:36.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.977+0000 7f7fb4610800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:36.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.977+0000 7f7fb4610800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:36.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.977+0000 7f7fb4610800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:36.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.977+0000 7f7fb4610800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.977+0000 7f7fb4610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:36.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.977+0000 7f7fb4610800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.978+0000 7f7fb4610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:36.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.978+0000 7f7fb4610800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.978+0000 7f7fb4610800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:36.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.978+0000 7f7fb4610800 20 zone default found 2024-09-12T17:27:36.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.978+0000 7f7fb4610800 4 Realm: () 2024-09-12T17:27:36.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.978+0000 7f7fb4610800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:36.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.978+0000 7f7fb4610800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:36.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.978+0000 7f7fb4610800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:36.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.978+0000 7f7fb4610800 20 zonegroup default 2024-09-12T17:27:36.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.978+0000 7f7fb4610800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.978+0000 7f7fb4610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:36.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.978+0000 7f7fb4610800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.978+0000 7f7fb4610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:36.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.979+0000 7f7fb4610800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.979+0000 7f7fb4610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:36.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.979+0000 7f7fb4610800 20 started sync module instance, tier type = 2024-09-12T17:27:36.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.979+0000 7f7fb4610800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:36.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.987+0000 7f7fb4610800 20 add_watcher() i=0 2024-09-12T17:27:36.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.987+0000 7f7fb4610800 20 add_watcher() i=1 2024-09-12T17:27:36.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.987+0000 7f7fb4610800 20 add_watcher() i=2 2024-09-12T17:27:36.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.987+0000 7f7fb4610800 20 add_watcher() i=3 2024-09-12T17:27:36.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.987+0000 7f7fb4610800 20 add_watcher() i=4 2024-09-12T17:27:36.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.987+0000 7f7fb4610800 20 add_watcher() i=5 2024-09-12T17:27:36.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.987+0000 7f7fb4610800 20 add_watcher() i=6 2024-09-12T17:27:36.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.988+0000 7f7fb4610800 20 add_watcher() i=7 2024-09-12T17:27:36.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.988+0000 7f7fb4610800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:36.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.990+0000 7f7e65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:36.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.990+0000 7f7fb4610800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:36.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.990+0000 7f7fb4610800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:36.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.990+0000 7f7fb4610800 5 note: GC not initialized 2024-09-12T17:27:36.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.990+0000 7f7e64fe1640 20 reqs_thread_entry: start 2024-09-12T17:27:36.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.990+0000 7f7fb4610800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:36.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.991+0000 7f7fb4610800 20 Filter name: none 2024-09-12T17:27:36.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.991+0000 7f7dde7fc640 20 reqs_thread_entry: start 2024-09-12T17:27:36.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.991+0000 7f7fb4610800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T17:27:36.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.991+0000 7f7fb4610800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.991+0000 7f7fb4610800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:27:36.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.991+0000 7f7fb4610800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T17:27:36.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.991+0000 7f7fb4610800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T17:27:36.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.991+0000 7f7fb4610800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 : miss 2024-09-12T17:27:36.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.991+0000 7f7fb4610800 20 rados->read ofs=0 len=0 2024-09-12T17:27:36.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.991+0000 7f7fb4610800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:27:36.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.991+0000 7f7fb4610800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 info.flags=0x17 2024-09-12T17:27:36.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.991+0000 7f7fb4610800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 to cache LRU end 2024-09-12T17:27:36.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.991+0000 7f7fb4610800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:36.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.991+0000 7f7fb4610800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:36.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.992+0000 7f7fb4610800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 2024-09-12T17:27:36.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.995+0000 7f7fb4610800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 info.flags=0x17 2024-09-12T17:27:36.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.995+0000 7f7fb4610800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 to cache LRU end 2024-09-12T17:27:36.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.995+0000 7f7fb4610800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:36.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.995+0000 7f7fb4610800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38, ofs0, ns] 2024-09-12T17:27:36.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.995+0000 7f7e8effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464353 cookie 93952226934048 notifier 7409 bl.length()=1015 2024-09-12T17:27:36.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.995+0000 7f7e8effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 info.flags=0x17 2024-09-12T17:27:36.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.995+0000 7f7e8effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 to cache LRU end 2024-09-12T17:27:36.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.995+0000 7f7e8effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:36.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.997+0000 7f7fb4610800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.38]): orig_sources= new_sources= 2024-09-12T17:27:36.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.997+0000 7f7fb4610800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.38]): potential sources added=[] removed=[] 2024-09-12T17:27:36.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.997+0000 7f7fb4610800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.38]): orig_dests= new_dests= 2024-09-12T17:27:36.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:36.997+0000 7f7fb4610800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.38]): potential dests added=[] removed=[] 2024-09-12T17:27:37.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.000+0000 7f7fb4610800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.38.1.0 2024-09-12T17:27:37.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.000+0000 7f7fb4610800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.38.1.0 2024-09-12T17:27:37.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.000+0000 7f7fb4610800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.38.1.1 2024-09-12T17:27:37.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.000+0000 7f7fb4610800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.38.1.1 2024-09-12T17:27:37.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.000+0000 7f7fb4610800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.38.0 2024-09-12T17:27:37.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.002+0000 7f7fb4610800 -1 Injecting error=-5 at location=change_reshard_state 2024-09-12T17:27:37.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.002+0000 7f7fb4610800 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-12T17:27:37.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.007+0000 7f7fb4610800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 : hit (requested=0x17, cached=0x17) 2024-09-12T17:27:37.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.007+0000 7f7fb4610800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 2024-09-12T17:27:37.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.009+0000 7f7fb4610800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 info.flags=0x17 2024-09-12T17:27:37.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.009+0000 7f7fb4610800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 to cache LRU end 2024-09-12T17:27:37.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.009+0000 7f7fb4610800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:37.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.009+0000 7f7fb4610800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38, ofs0, ns] 2024-09-12T17:27:37.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.009+0000 7f7e8e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464354 cookie 93952226934048 notifier 7409 bl.length()=983 2024-09-12T17:27:37.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.009+0000 7f7e8e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 info.flags=0x17 2024-09-12T17:27:37.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.009+0000 7f7e8e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 to cache LRU end 2024-09-12T17:27:37.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.009+0000 7f7e8e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:37.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.011+0000 7f7fb4610800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.38]): orig_sources= new_sources= 2024-09-12T17:27:37.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.011+0000 7f7fb4610800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.38]): potential sources added=[] removed=[] 2024-09-12T17:27:37.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.011+0000 7f7fb4610800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.38]): orig_dests= new_dests= 2024-09-12T17:27:37.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.011+0000 7f7fb4610800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.38]): potential dests added=[] removed=[] 2024-09-12T17:27:37.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.011+0000 7f7fb4610800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-12T17:27:37.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.012+0000 7f7e65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:37.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.014+0000 7f7fb4610800 20 remove_watcher() i=0 2024-09-12T17:27:37.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.014+0000 7f7fb4610800 2 removed watcher, disabling cache 2024-09-12T17:27:37.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.015+0000 7f7fb4610800 20 remove_watcher() i=1 2024-09-12T17:27:37.017 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.016+0000 7f7fb4610800 20 remove_watcher() i=2 2024-09-12T17:27:37.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.017+0000 7f7fb4610800 20 remove_watcher() i=3 2024-09-12T17:27:37.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.018+0000 7f7fb4610800 20 remove_watcher() i=4 2024-09-12T17:27:37.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.019+0000 7f7fb4610800 20 remove_watcher() i=5 2024-09-12T17:27:37.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.020+0000 7f7fb4610800 20 remove_watcher() i=6 2024-09-12T17:27:37.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.021+0000 7f7fb4610800 20 remove_watcher() i=7 2024-09-12T17:27:37.035 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:27:37.065 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:37.065 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:37.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.103+0000 7f6e1c82f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.104+0000 7f6e1c82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:37.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.104+0000 7f6e1c82f800 20 realm 2024-09-12T17:27:37.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.104+0000 7f6e1c82f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.105+0000 7f6e1c82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:37.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.105+0000 7f6e1c82f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:37.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.105+0000 7f6e1c82f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.105+0000 7f6e1c82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:37.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.105+0000 7f6e1c82f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.106+0000 7f6e1c82f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:37.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.106+0000 7f6e1c82f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.106+0000 7f6e1c82f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:37.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.106+0000 7f6e1c82f800 20 searching for the correct realm 2024-09-12T17:27:37.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.108+0000 7f6e19b18640 0 -- 172.21.15.67:0/1127477795 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f6e0c041bb0 msgr2=0x7f6e0c04f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:27:37.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.314+0000 7f6e1a319640 0 -- 172.21.15.67:0/1127477795 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f6e10059580 msgr2=0x7f6e100d5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:37.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.520+0000 7f6e1c82f800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:37.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.520+0000 7f6e1c82f800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:37.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.520+0000 7f6e1c82f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:37.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.520+0000 7f6e1c82f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:37.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.520+0000 7f6e1c82f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:37.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.520+0000 7f6e1c82f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:37.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.520+0000 7f6e1c82f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.521+0000 7f6e1c82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:37.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.521+0000 7f6e1c82f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.523 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.521+0000 7f6e1c82f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:37.523 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.521+0000 7f6e1c82f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.523 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.521+0000 7f6e1c82f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:37.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.521+0000 7f6e1c82f800 20 zone default found 2024-09-12T17:27:37.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.521+0000 7f6e1c82f800 4 Realm: () 2024-09-12T17:27:37.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.521+0000 7f6e1c82f800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:37.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.521+0000 7f6e1c82f800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:37.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.521+0000 7f6e1c82f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:37.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.521+0000 7f6e1c82f800 20 zonegroup default 2024-09-12T17:27:37.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.521+0000 7f6e1c82f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.522+0000 7f6e1c82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:37.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.522+0000 7f6e1c82f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.522+0000 7f6e1c82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:37.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.522+0000 7f6e1c82f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.522+0000 7f6e1c82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:37.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.523+0000 7f6e1c82f800 20 started sync module instance, tier type = 2024-09-12T17:27:37.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.523+0000 7f6e1c82f800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:37.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.532+0000 7f6e1c82f800 20 add_watcher() i=0 2024-09-12T17:27:37.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.532+0000 7f6e1c82f800 20 add_watcher() i=1 2024-09-12T17:27:37.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.532+0000 7f6e1c82f800 20 add_watcher() i=2 2024-09-12T17:27:37.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.532+0000 7f6e1c82f800 20 add_watcher() i=3 2024-09-12T17:27:37.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.532+0000 7f6e1c82f800 20 add_watcher() i=4 2024-09-12T17:27:37.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.532+0000 7f6e1c82f800 20 add_watcher() i=5 2024-09-12T17:27:37.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.532+0000 7f6e1c82f800 20 add_watcher() i=6 2024-09-12T17:27:37.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.533+0000 7f6e1c82f800 20 add_watcher() i=7 2024-09-12T17:27:37.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.533+0000 7f6e1c82f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:37.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.535+0000 7f6cd0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:37.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.536+0000 7f6e1c82f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:37.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.536+0000 7f6e1c82f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:37.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.536+0000 7f6e1c82f800 5 note: GC not initialized 2024-09-12T17:27:37.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.536+0000 7f6c4b7fe640 20 reqs_thread_entry: start 2024-09-12T17:27:37.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.536+0000 7f6e1c82f800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:37.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.536+0000 7f6e1c82f800 20 Filter name: none 2024-09-12T17:27:37.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.536+0000 7f6c497fa640 20 reqs_thread_entry: start 2024-09-12T17:27:37.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.536+0000 7f6e1c82f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.537+0000 7f6e1c82f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:27:37.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.537+0000 7f6e1c82f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.537+0000 7f6e1c82f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:27:37.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.537+0000 7f6e1c82f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:37.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.537+0000 7f6e1c82f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.538+0000 7f6e1c82f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:27:37.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.538+0000 7f6e1c82f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.538+0000 7f6e1c82f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:27:37.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.538+0000 7f6e1c82f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:37.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.540+0000 7f6cd0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:37.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.542+0000 7f6e1c82f800 20 remove_watcher() i=0 2024-09-12T17:27:37.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.542+0000 7f6e1c82f800 2 removed watcher, disabling cache 2024-09-12T17:27:37.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.543+0000 7f6e1c82f800 20 remove_watcher() i=1 2024-09-12T17:27:37.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.544+0000 7f6e1c82f800 20 remove_watcher() i=2 2024-09-12T17:27:37.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.545+0000 7f6e1c82f800 20 remove_watcher() i=3 2024-09-12T17:27:37.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.546+0000 7f6e1c82f800 20 remove_watcher() i=4 2024-09-12T17:27:37.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.547+0000 7f6e1c82f800 20 remove_watcher() i=5 2024-09-12T17:27:37.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.548+0000 7f6e1c82f800 20 remove_watcher() i=6 2024-09-12T17:27:37.550 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.549+0000 7f6e1c82f800 20 remove_watcher() i=7 2024-09-12T17:27:37.561 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:37.561 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:27:37.561 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-change-reshard-state id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:27:37.562 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:37.563 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:37.563 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:37.598 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:37.598 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:37.656 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:27:37.689 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:37.689 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:37.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.727+0000 7f0df3a14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.729+0000 7f0df3a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:37.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.729+0000 7f0df3a14800 20 realm 2024-09-12T17:27:37.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.729+0000 7f0df3a14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.730+0000 7f0df3a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:37.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.730+0000 7f0df3a14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:37.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.730+0000 7f0df3a14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.730+0000 7f0df3a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:37.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.730+0000 7f0df3a14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.731+0000 7f0df3a14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:37.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.731+0000 7f0df3a14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.732+0000 7f0df3a14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:37.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.732+0000 7f0df3a14800 20 searching for the correct realm 2024-09-12T17:27:37.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.734+0000 7f0dee8ca640 0 -- 172.21.15.67:0/2748686003 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f0de004c060 msgr2=0x7f0de0070050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:37.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.738+0000 7f0def0cb640 0 -- 172.21.15.67:0/2748686003 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f0de402b420 msgr2=0x7f0de402b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:37.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.945+0000 7f0df3a14800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:37.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.945+0000 7f0df3a14800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:37.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.945+0000 7f0df3a14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:37.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.945+0000 7f0df3a14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:37.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.945+0000 7f0df3a14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:37.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.945+0000 7f0df3a14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:37.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.945+0000 7f0df3a14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.945+0000 7f0df3a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:37.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.945+0000 7f0df3a14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.946+0000 7f0df3a14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:37.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.946+0000 7f0df3a14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.946+0000 7f0df3a14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:37.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.946+0000 7f0df3a14800 20 zone default found 2024-09-12T17:27:37.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.946+0000 7f0df3a14800 4 Realm: () 2024-09-12T17:27:37.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.946+0000 7f0df3a14800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:37.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.946+0000 7f0df3a14800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:37.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.946+0000 7f0df3a14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:37.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.946+0000 7f0df3a14800 20 zonegroup default 2024-09-12T17:27:37.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.946+0000 7f0df3a14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.946+0000 7f0df3a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:37.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.946+0000 7f0df3a14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.947+0000 7f0df3a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:37.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.947+0000 7f0df3a14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.947+0000 7f0df3a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:37.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.947+0000 7f0df3a14800 20 started sync module instance, tier type = 2024-09-12T17:27:37.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.947+0000 7f0df3a14800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:37.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.956+0000 7f0df3a14800 20 add_watcher() i=0 2024-09-12T17:27:37.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.956+0000 7f0df3a14800 20 add_watcher() i=1 2024-09-12T17:27:37.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.956+0000 7f0df3a14800 20 add_watcher() i=2 2024-09-12T17:27:37.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.956+0000 7f0df3a14800 20 add_watcher() i=3 2024-09-12T17:27:37.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.956+0000 7f0df3a14800 20 add_watcher() i=4 2024-09-12T17:27:37.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.956+0000 7f0df3a14800 20 add_watcher() i=5 2024-09-12T17:27:37.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.956+0000 7f0df3a14800 20 add_watcher() i=6 2024-09-12T17:27:37.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.957+0000 7f0df3a14800 20 add_watcher() i=7 2024-09-12T17:27:37.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.957+0000 7f0df3a14800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:37.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.958+0000 7f0ca5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:37.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.959+0000 7f0df3a14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:37.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.959+0000 7f0df3a14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:37.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.959+0000 7f0df3a14800 5 note: GC not initialized 2024-09-12T17:27:37.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.959+0000 7f0ca4fe1640 20 reqs_thread_entry: start 2024-09-12T17:27:37.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.959+0000 7f0df3a14800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:37.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.959+0000 7f0df3a14800 20 Filter name: none 2024-09-12T17:27:37.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.959+0000 7f0c1e7fc640 20 reqs_thread_entry: start 2024-09-12T17:27:37.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.959+0000 7f0df3a14800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T17:27:37.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.959+0000 7f0df3a14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.960+0000 7f0df3a14800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:27:37.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.960+0000 7f0df3a14800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T17:27:37.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.960+0000 7f0df3a14800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T17:27:37.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.960+0000 7f0df3a14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 : miss 2024-09-12T17:27:37.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.960+0000 7f0df3a14800 20 rados->read ofs=0 len=0 2024-09-12T17:27:37.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.960+0000 7f0df3a14800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:27:37.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.960+0000 7f0df3a14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 info.flags=0x17 2024-09-12T17:27:37.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.960+0000 7f0df3a14800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 to cache LRU end 2024-09-12T17:27:37.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.960+0000 7f0df3a14800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:37.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.960+0000 7f0df3a14800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:37.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.960+0000 7f0df3a14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 2024-09-12T17:27:37.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.964+0000 7f0df3a14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 info.flags=0x17 2024-09-12T17:27:37.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.964+0000 7f0df3a14800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 to cache LRU end 2024-09-12T17:27:37.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.964+0000 7f0df3a14800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:37.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.964+0000 7f0df3a14800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38, ofs0, ns] 2024-09-12T17:27:37.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.965+0000 7f0cd2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464355 cookie 94328758374944 notifier 7445 bl.length()=1015 2024-09-12T17:27:37.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.965+0000 7f0cd2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 info.flags=0x17 2024-09-12T17:27:37.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.965+0000 7f0cd2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 to cache LRU end 2024-09-12T17:27:37.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.965+0000 7f0cd2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:37.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.966+0000 7f0df3a14800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.38]): orig_sources= new_sources= 2024-09-12T17:27:37.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.966+0000 7f0df3a14800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.38]): potential sources added=[] removed=[] 2024-09-12T17:27:37.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.966+0000 7f0df3a14800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.38]): orig_dests= new_dests= 2024-09-12T17:27:37.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.966+0000 7f0df3a14800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.38]): potential dests added=[] removed=[] 2024-09-12T17:27:37.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.969+0000 7f0df3a14800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.38.1.0 2024-09-12T17:27:37.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.969+0000 7f0df3a14800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.38.1.0 2024-09-12T17:27:37.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.969+0000 7f0df3a14800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.38.1.1 2024-09-12T17:27:37.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.969+0000 7f0df3a14800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.38.1.1 2024-09-12T17:27:37.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.969+0000 7f0df3a14800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.38.0 2024-09-12T17:27:37.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.971+0000 7f0df3a14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 : hit (requested=0x17, cached=0x17) 2024-09-12T17:27:37.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.971+0000 7f0df3a14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 2024-09-12T17:27:37.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.972+0000 7f0df3a14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 info.flags=0x17 2024-09-12T17:27:37.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.972+0000 7f0df3a14800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 to cache LRU end 2024-09-12T17:27:37.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.972+0000 7f0df3a14800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:37.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.972+0000 7f0df3a14800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38, ofs0, ns] 2024-09-12T17:27:37.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.973+0000 7f0cd2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464356 cookie 94328758374944 notifier 7445 bl.length()=1015 2024-09-12T17:27:37.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.973+0000 7f0cd2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 info.flags=0x17 2024-09-12T17:27:37.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.973+0000 7f0cd2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 to cache LRU end 2024-09-12T17:27:37.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.973+0000 7f0cd2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:37.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.974+0000 7f0df3a14800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.38]): orig_sources= new_sources= 2024-09-12T17:27:37.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.974+0000 7f0df3a14800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.38]): potential sources added=[] removed=[] 2024-09-12T17:27:37.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.974+0000 7f0df3a14800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.38]): orig_dests= new_dests= 2024-09-12T17:27:37.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.974+0000 7f0df3a14800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.38]): potential dests added=[] removed=[] 2024-09-12T17:27:37.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.975+0000 7f0df3a14800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.38.0 2024-09-12T17:27:37.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.976+0000 7f0df3a14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 : hit (requested=0x17, cached=0x17) 2024-09-12T17:27:37.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.976+0000 7f0df3a14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 2024-09-12T17:27:37.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.977+0000 7f0df3a14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 info.flags=0x17 2024-09-12T17:27:37.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.977+0000 7f0df3a14800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 to cache LRU end 2024-09-12T17:27:37.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.977+0000 7f0df3a14800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:37.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.977+0000 7f0df3a14800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38, ofs0, ns] 2024-09-12T17:27:37.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.978+0000 7f0cd27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464357 cookie 94328758374944 notifier 7445 bl.length()=983 2024-09-12T17:27:37.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.978+0000 7f0cd27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 info.flags=0x17 2024-09-12T17:27:37.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.978+0000 7f0cd27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 to cache LRU end 2024-09-12T17:27:37.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.978+0000 7f0cd27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:37.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.979+0000 7f0df3a14800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.38]): orig_sources= new_sources= 2024-09-12T17:27:37.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.979+0000 7f0df3a14800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.38]): potential sources added=[] removed=[] 2024-09-12T17:27:37.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.979+0000 7f0df3a14800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.38]): orig_dests= new_dests= 2024-09-12T17:27:37.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.979+0000 7f0df3a14800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.38]): potential dests added=[] removed=[] 2024-09-12T17:27:37.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.980+0000 7f0df3a14800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T17:27:37.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.982+0000 7f0ca5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:37.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.985+0000 7f0df3a14800 20 remove_watcher() i=0 2024-09-12T17:27:37.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.985+0000 7f0df3a14800 2 removed watcher, disabling cache 2024-09-12T17:27:37.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.986+0000 7f0df3a14800 20 remove_watcher() i=1 2024-09-12T17:27:37.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.987+0000 7f0df3a14800 20 remove_watcher() i=2 2024-09-12T17:27:37.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.988+0000 7f0df3a14800 20 remove_watcher() i=3 2024-09-12T17:27:37.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.989+0000 7f0df3a14800 20 remove_watcher() i=4 2024-09-12T17:27:37.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.990+0000 7f0df3a14800 20 remove_watcher() i=5 2024-09-12T17:27:37.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.991+0000 7f0df3a14800 20 remove_watcher() i=6 2024-09-12T17:27:37.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:37.992+0000 7f0df3a14800 20 remove_watcher() i=7 2024-09-12T17:27:38.005 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:27:38.035 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:38.035 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:38.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.073+0000 7ffb22b46800 20 rados->read ofs=0 len=0 2024-09-12T17:27:38.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.075+0000 7ffb22b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:38.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.075+0000 7ffb22b46800 20 realm 2024-09-12T17:27:38.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.075+0000 7ffb22b46800 20 rados->read ofs=0 len=0 2024-09-12T17:27:38.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.075+0000 7ffb22b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:38.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.075+0000 7ffb22b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:38.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.075+0000 7ffb22b46800 20 rados->read ofs=0 len=0 2024-09-12T17:27:38.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.075+0000 7ffb22b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:38.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.075+0000 7ffb22b46800 20 rados->read ofs=0 len=0 2024-09-12T17:27:38.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.076+0000 7ffb22b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:38.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.076+0000 7ffb22b46800 20 rados->read ofs=0 len=0 2024-09-12T17:27:38.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.077+0000 7ffb22b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:38.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.077+0000 7ffb22b46800 20 searching for the correct realm 2024-09-12T17:27:38.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.079+0000 7ffb1fe36640 0 -- 172.21.15.67:0/710568958 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55a4373fdea0 msgr2=0x55a437400290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:38.083 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.082+0000 7ffb1fe36640 0 -- 172.21.15.67:0/710568958 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55a4373fdea0 msgr2=0x7ff9e808b0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:38.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.288+0000 7ffb22b46800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:38.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.288+0000 7ffb22b46800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:38.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.288+0000 7ffb22b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:38.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.288+0000 7ffb22b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:38.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.288+0000 7ffb22b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:38.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.288+0000 7ffb22b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:38.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.288+0000 7ffb22b46800 20 rados->read ofs=0 len=0 2024-09-12T17:27:38.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.289+0000 7ffb22b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:38.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.289+0000 7ffb22b46800 20 rados->read ofs=0 len=0 2024-09-12T17:27:38.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.289+0000 7ffb22b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:38.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.289+0000 7ffb22b46800 20 rados->read ofs=0 len=0 2024-09-12T17:27:38.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.289+0000 7ffb22b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:38.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.289+0000 7ffb22b46800 20 zone default found 2024-09-12T17:27:38.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.289+0000 7ffb22b46800 4 Realm: () 2024-09-12T17:27:38.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.289+0000 7ffb22b46800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:38.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.289+0000 7ffb22b46800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:38.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.289+0000 7ffb22b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:38.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.289+0000 7ffb22b46800 20 zonegroup default 2024-09-12T17:27:38.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.289+0000 7ffb22b46800 20 rados->read ofs=0 len=0 2024-09-12T17:27:38.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.289+0000 7ffb22b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:38.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.289+0000 7ffb22b46800 20 rados->read ofs=0 len=0 2024-09-12T17:27:38.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.290+0000 7ffb22b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:38.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.290+0000 7ffb22b46800 20 rados->read ofs=0 len=0 2024-09-12T17:27:38.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.290+0000 7ffb22b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:38.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.290+0000 7ffb22b46800 20 started sync module instance, tier type = 2024-09-12T17:27:38.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.290+0000 7ffb22b46800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:38.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.299+0000 7ffb22b46800 20 add_watcher() i=0 2024-09-12T17:27:38.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.299+0000 7ffb22b46800 20 add_watcher() i=1 2024-09-12T17:27:38.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.299+0000 7ffb22b46800 20 add_watcher() i=2 2024-09-12T17:27:38.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.299+0000 7ffb22b46800 20 add_watcher() i=3 2024-09-12T17:27:38.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.299+0000 7ffb22b46800 20 add_watcher() i=4 2024-09-12T17:27:38.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.299+0000 7ffb22b46800 20 add_watcher() i=5 2024-09-12T17:27:38.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.299+0000 7ffb22b46800 20 add_watcher() i=6 2024-09-12T17:27:38.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.300+0000 7ffb22b46800 20 add_watcher() i=7 2024-09-12T17:27:38.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.300+0000 7ffb22b46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:38.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.301+0000 7ff9d6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:38.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.302+0000 7ffb22b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:38.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.302+0000 7ffb22b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:38.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.302+0000 7ffb22b46800 5 note: GC not initialized 2024-09-12T17:27:38.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.302+0000 7ff9d5fdb640 20 reqs_thread_entry: start 2024-09-12T17:27:38.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.302+0000 7ffb22b46800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:38.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.302+0000 7ffb22b46800 20 Filter name: none 2024-09-12T17:27:38.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.302+0000 7ff9477fe640 20 reqs_thread_entry: start 2024-09-12T17:27:38.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.302+0000 7ffb22b46800 20 rados->read ofs=0 len=0 2024-09-12T17:27:38.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.303+0000 7ffb22b46800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:27:38.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.303+0000 7ffb22b46800 20 rados->read ofs=0 len=0 2024-09-12T17:27:38.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.303+0000 7ffb22b46800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:27:38.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.303+0000 7ffb22b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:38.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.303+0000 7ffb22b46800 20 rados->read ofs=0 len=0 2024-09-12T17:27:38.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.304+0000 7ffb22b46800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:27:38.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.304+0000 7ffb22b46800 20 rados->read ofs=0 len=0 2024-09-12T17:27:38.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.304+0000 7ffb22b46800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:27:38.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.304+0000 7ffb22b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:38.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.306+0000 7ff9d6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:38.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.308+0000 7ffb22b46800 20 remove_watcher() i=0 2024-09-12T17:27:38.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.308+0000 7ffb22b46800 2 removed watcher, disabling cache 2024-09-12T17:27:38.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.309+0000 7ffb22b46800 20 remove_watcher() i=1 2024-09-12T17:27:38.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.310+0000 7ffb22b46800 20 remove_watcher() i=2 2024-09-12T17:27:38.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.311+0000 7ffb22b46800 20 remove_watcher() i=3 2024-09-12T17:27:38.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.312+0000 7ffb22b46800 20 remove_watcher() i=4 2024-09-12T17:27:38.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.313+0000 7ffb22b46800 20 remove_watcher() i=5 2024-09-12T17:27:38.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.314+0000 7ffb22b46800 20 remove_watcher() i=6 2024-09-12T17:27:38.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:38.315+0000 7ffb22b46800 20 remove_watcher() i=7 2024-09-12T17:27:38.327 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:38.327 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:27:38.327 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-change-reshard-state id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.38 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:27:38.327 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:38.329 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:38.329 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:38.352 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:38.353 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:38.578 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:38.578 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:38.642 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-12T17:27:38.642 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:38.643 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:38.643 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:38.685 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:38.685 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:38.742 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:38.742 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:38.777 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:38.777 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:38.813 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:38.813 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:38.850 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:38.850 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:38.887 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:38.887 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:38.922 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:38.922 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:38.959 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:38.959 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:38.996 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:38.996 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:39.032 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:39.032 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:39.067 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:39.067 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:39.105 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:39.105 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:39.142 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:39.142 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:39.178 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:39.178 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:39.214 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:39.214 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:39.252 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:39.252 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:39.287 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:39.287 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:39.323 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:39.323 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:39.361 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:39.361 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:39.397 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:39.397 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:39.435 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:39.435 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:39.471 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:27:39.501 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:39.501 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:39.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.539+0000 7f7f85521800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.540+0000 7f7f85521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:39.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.540+0000 7f7f85521800 20 realm 2024-09-12T17:27:39.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.540+0000 7f7f85521800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.541+0000 7f7f85521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:39.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.541+0000 7f7f85521800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:39.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.541+0000 7f7f85521800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.541+0000 7f7f85521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:39.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.541+0000 7f7f85521800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.542+0000 7f7f85521800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:39.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.542+0000 7f7f85521800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.543+0000 7f7f85521800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:39.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.543+0000 7f7f85521800 20 searching for the correct realm 2024-09-12T17:27:39.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.546+0000 7f7f81957640 0 -- 172.21.15.67:0/3764449644 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x55573c2c6460 msgr2=0x55573c2c8920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:39.550 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.549+0000 7f7f81156640 0 -- 172.21.15.67:0/3764449644 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f7f7803fbb0 msgr2=0x7f7f7804c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:39.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.553+0000 7f7f85521800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:39.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.553+0000 7f7f85521800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:39.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.553+0000 7f7f85521800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:39.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.553+0000 7f7f85521800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:39.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.553+0000 7f7f85521800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:39.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.553+0000 7f7f85521800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:39.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.553+0000 7f7f85521800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.553+0000 7f7f85521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:39.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.553+0000 7f7f85521800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.554+0000 7f7f85521800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:39.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.554+0000 7f7f85521800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.554+0000 7f7f85521800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:39.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.554+0000 7f7f85521800 20 zone default found 2024-09-12T17:27:39.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.554+0000 7f7f85521800 4 Realm: () 2024-09-12T17:27:39.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.554+0000 7f7f85521800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:39.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.554+0000 7f7f85521800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:39.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.554+0000 7f7f85521800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:39.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.554+0000 7f7f85521800 20 zonegroup default 2024-09-12T17:27:39.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.554+0000 7f7f85521800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.555+0000 7f7f85521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:39.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.555+0000 7f7f85521800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.555+0000 7f7f85521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:39.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.555+0000 7f7f85521800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.556+0000 7f7f85521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:39.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.556+0000 7f7f85521800 20 started sync module instance, tier type = 2024-09-12T17:27:39.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.556+0000 7f7f85521800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:39.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.565+0000 7f7f85521800 20 add_watcher() i=0 2024-09-12T17:27:39.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.565+0000 7f7f85521800 20 add_watcher() i=1 2024-09-12T17:27:39.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.565+0000 7f7f85521800 20 add_watcher() i=2 2024-09-12T17:27:39.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.565+0000 7f7f85521800 20 add_watcher() i=3 2024-09-12T17:27:39.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.565+0000 7f7f85521800 20 add_watcher() i=4 2024-09-12T17:27:39.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.565+0000 7f7f85521800 20 add_watcher() i=5 2024-09-12T17:27:39.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.565+0000 7f7f85521800 20 add_watcher() i=6 2024-09-12T17:27:39.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.566+0000 7f7f85521800 20 add_watcher() i=7 2024-09-12T17:27:39.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.566+0000 7f7f85521800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:39.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.567+0000 7f7e37fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:39.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.567+0000 7f7f85521800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:39.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.567+0000 7f7f85521800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:39.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.568+0000 7f7f85521800 5 note: GC not initialized 2024-09-12T17:27:39.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.568+0000 7f7e36fe5640 20 reqs_thread_entry: start 2024-09-12T17:27:39.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.568+0000 7f7f85521800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:39.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.568+0000 7f7f85521800 20 Filter name: none 2024-09-12T17:27:39.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.568+0000 7f7e34fe1640 20 reqs_thread_entry: start 2024-09-12T17:27:39.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.568+0000 7f7f85521800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.569+0000 7f7f85521800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:27:39.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.569+0000 7f7f85521800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.569+0000 7f7f85521800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:27:39.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.569+0000 7f7f85521800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:39.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.569+0000 7f7f85521800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.570+0000 7f7f85521800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:27:39.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.570+0000 7f7f85521800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.570+0000 7f7f85521800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:27:39.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.570+0000 7f7f85521800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:39.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.571+0000 7f7e37fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:39.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.573+0000 7f7f85521800 20 remove_watcher() i=0 2024-09-12T17:27:39.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.573+0000 7f7f85521800 2 removed watcher, disabling cache 2024-09-12T17:27:39.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.574+0000 7f7f85521800 20 remove_watcher() i=1 2024-09-12T17:27:39.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.575+0000 7f7f85521800 20 remove_watcher() i=2 2024-09-12T17:27:39.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.576+0000 7f7f85521800 20 remove_watcher() i=3 2024-09-12T17:27:39.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.577+0000 7f7f85521800 20 remove_watcher() i=4 2024-09-12T17:27:39.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.578+0000 7f7f85521800 20 remove_watcher() i=5 2024-09-12T17:27:39.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.579+0000 7f7f85521800 20 remove_watcher() i=6 2024-09-12T17:27:39.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.580+0000 7f7f85521800 20 remove_watcher() i=7 2024-09-12T17:27:39.592 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:39.592 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:27:39.592 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-change-reshard-state id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.39 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:27:39.592 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:39.593 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-12T17:27:39.630 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:39.630 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:39.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.669+0000 7f2615f19800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.670+0000 7f2615f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:39.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.671+0000 7f2615f19800 20 realm 2024-09-12T17:27:39.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.671+0000 7f2615f19800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.671+0000 7f2615f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:39.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.671+0000 7f2615f19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:39.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.671+0000 7f2615f19800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.671+0000 7f2615f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:39.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.671+0000 7f2615f19800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.672+0000 7f2615f19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:39.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.672+0000 7f2615f19800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.672+0000 7f2615f19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:39.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.672+0000 7f2615f19800 20 searching for the correct realm 2024-09-12T17:27:39.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.675+0000 7f2613a03640 0 -- 172.21.15.67:0/2314874666 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f260c018050 msgr2=0x7f260c063f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:39.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.678+0000 7f2613a03640 0 -- 172.21.15.67:0/2314874666 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f2608017040 msgr2=0x7f2608017420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:39.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.884+0000 7f2615f19800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:39.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.884+0000 7f2615f19800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:39.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.884+0000 7f2615f19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:39.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.884+0000 7f2615f19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:39.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.884+0000 7f2615f19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:39.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.884+0000 7f2615f19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:39.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.884+0000 7f2615f19800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.884+0000 7f2615f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:39.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.884+0000 7f2615f19800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.885+0000 7f2615f19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:39.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.885+0000 7f2615f19800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.885+0000 7f2615f19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:39.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.885+0000 7f2615f19800 20 zone default found 2024-09-12T17:27:39.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.885+0000 7f2615f19800 4 Realm: () 2024-09-12T17:27:39.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.885+0000 7f2615f19800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:39.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.885+0000 7f2615f19800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:39.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.885+0000 7f2615f19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:39.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.885+0000 7f2615f19800 20 zonegroup default 2024-09-12T17:27:39.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.885+0000 7f2615f19800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.885+0000 7f2615f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:39.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.885+0000 7f2615f19800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.886+0000 7f2615f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:39.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.886+0000 7f2615f19800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.886+0000 7f2615f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:39.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.886+0000 7f2615f19800 20 started sync module instance, tier type = 2024-09-12T17:27:39.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.886+0000 7f2615f19800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:39.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.895+0000 7f2615f19800 20 add_watcher() i=0 2024-09-12T17:27:39.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.895+0000 7f2615f19800 20 add_watcher() i=1 2024-09-12T17:27:39.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.895+0000 7f2615f19800 20 add_watcher() i=2 2024-09-12T17:27:39.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.895+0000 7f2615f19800 20 add_watcher() i=3 2024-09-12T17:27:39.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.895+0000 7f2615f19800 20 add_watcher() i=4 2024-09-12T17:27:39.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.895+0000 7f2615f19800 20 add_watcher() i=5 2024-09-12T17:27:39.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.895+0000 7f2615f19800 20 add_watcher() i=6 2024-09-12T17:27:39.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.896+0000 7f2615f19800 20 add_watcher() i=7 2024-09-12T17:27:39.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.896+0000 7f2615f19800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:39.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.898+0000 7f24c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:39.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.898+0000 7f2615f19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:39.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.898+0000 7f2615f19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:39.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.898+0000 7f2615f19800 5 note: GC not initialized 2024-09-12T17:27:39.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.898+0000 7f24c8fe1640 20 reqs_thread_entry: start 2024-09-12T17:27:39.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.898+0000 7f2615f19800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:39.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.898+0000 7f2615f19800 20 Filter name: none 2024-09-12T17:27:39.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.899+0000 7f24427fc640 20 reqs_thread_entry: start 2024-09-12T17:27:39.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.899+0000 7f2615f19800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T17:27:39.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.899+0000 7f2615f19800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.899+0000 7f2615f19800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:27:39.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.899+0000 7f2615f19800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T17:27:39.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.899+0000 7f2615f19800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T17:27:39.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.899+0000 7f2615f19800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39 : miss 2024-09-12T17:27:39.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.899+0000 7f2615f19800 20 rados->read ofs=0 len=0 2024-09-12T17:27:39.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.900+0000 7f2615f19800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:27:39.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.900+0000 7f2615f19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39 info.flags=0x17 2024-09-12T17:27:39.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.900+0000 7f2615f19800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39 to cache LRU end 2024-09-12T17:27:39.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.900+0000 7f2615f19800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:39.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.900+0000 7f2615f19800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:39.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.900+0000 7f2615f19800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39 2024-09-12T17:27:39.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.903+0000 7f2615f19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39 info.flags=0x17 2024-09-12T17:27:39.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.903+0000 7f2615f19800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39 to cache LRU end 2024-09-12T17:27:39.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.903+0000 7f2615f19800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:39.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.903+0000 7f2615f19800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39, ofs0, ns] 2024-09-12T17:27:39.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.904+0000 7f24f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464362 cookie 93989507712752 notifier 7968 bl.length()=1015 2024-09-12T17:27:39.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.904+0000 7f24f2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39 info.flags=0x17 2024-09-12T17:27:39.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.904+0000 7f24f2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39 to cache LRU end 2024-09-12T17:27:39.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.904+0000 7f24f2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:39.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.906+0000 7f2615f19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.39]): orig_sources= new_sources= 2024-09-12T17:27:39.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.906+0000 7f2615f19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.39]): potential sources added=[] removed=[] 2024-09-12T17:27:39.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.906+0000 7f2615f19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.39]): orig_dests= new_dests= 2024-09-12T17:27:39.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.906+0000 7f2615f19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.39]): potential dests added=[] removed=[] 2024-09-12T17:27:39.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.908+0000 7f2615f19800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.39.1.0 2024-09-12T17:27:39.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.908+0000 7f2615f19800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.39.1.0 2024-09-12T17:27:39.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.908+0000 7f2615f19800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.39.1.1 2024-09-12T17:27:39.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.908+0000 7f2615f19800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.39.1.1 2024-09-12T17:27:39.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.908+0000 7f2615f19800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.39.0 2024-09-12T17:27:39.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.910+0000 7f2615f19800 -1 Injecting error=-125 at location=change_reshard_state 2024-09-12T17:27:39.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.910+0000 7f2615f19800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39 : hit (requested=0x17, cached=0x17) 2024-09-12T17:27:39.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.910+0000 7f2615f19800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39 2024-09-12T17:27:39.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.912+0000 7f2615f19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39 info.flags=0x17 2024-09-12T17:27:39.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.912+0000 7f2615f19800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39 to cache LRU end 2024-09-12T17:27:39.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.912+0000 7f2615f19800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:39.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.912+0000 7f2615f19800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39, ofs0, ns] 2024-09-12T17:27:39.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.912+0000 7f24f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464363 cookie 93989507712752 notifier 7968 bl.length()=1015 2024-09-12T17:27:39.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.912+0000 7f24f2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39 info.flags=0x17 2024-09-12T17:27:39.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.912+0000 7f24f2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39 to cache LRU end 2024-09-12T17:27:39.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.912+0000 7f24f2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:39.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.914+0000 7f2615f19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.39]): orig_sources= new_sources= 2024-09-12T17:27:39.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.914+0000 7f2615f19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.39]): potential sources added=[] removed=[] 2024-09-12T17:27:39.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.914+0000 7f2615f19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.39]): orig_dests= new_dests= 2024-09-12T17:27:39.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.914+0000 7f2615f19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.39]): potential dests added=[] removed=[] 2024-09-12T17:27:39.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.915+0000 7f2615f19800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.39.0 2024-09-12T17:27:39.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.915+0000 7f2615f19800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39 : hit (requested=0x17, cached=0x17) 2024-09-12T17:27:39.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.915+0000 7f2615f19800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39 2024-09-12T17:27:39.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.916+0000 7f2615f19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39 info.flags=0x17 2024-09-12T17:27:39.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.916+0000 7f2615f19800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39 to cache LRU end 2024-09-12T17:27:39.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.916+0000 7f2615f19800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:39.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.916+0000 7f2615f19800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39, ofs0, ns] 2024-09-12T17:27:39.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.917+0000 7f24f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464364 cookie 93989507712752 notifier 7968 bl.length()=983 2024-09-12T17:27:39.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.917+0000 7f24f27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39 info.flags=0x17 2024-09-12T17:27:39.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.917+0000 7f24f27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39 to cache LRU end 2024-09-12T17:27:39.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.917+0000 7f24f27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:39.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.918+0000 7f2615f19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.39]): orig_sources= new_sources= 2024-09-12T17:27:39.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.918+0000 7f2615f19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.39]): potential sources added=[] removed=[] 2024-09-12T17:27:39.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.918+0000 7f2615f19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.39]): orig_dests= new_dests= 2024-09-12T17:27:39.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.918+0000 7f2615f19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.39]): potential dests added=[] removed=[] 2024-09-12T17:27:39.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.919+0000 7f2615f19800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T17:27:39.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.921+0000 7f24c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:39.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.923+0000 7f2615f19800 20 remove_watcher() i=0 2024-09-12T17:27:39.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.923+0000 7f2615f19800 2 removed watcher, disabling cache 2024-09-12T17:27:39.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.924+0000 7f2615f19800 20 remove_watcher() i=1 2024-09-12T17:27:39.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.926+0000 7f2615f19800 20 remove_watcher() i=2 2024-09-12T17:27:39.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.927+0000 7f2615f19800 20 remove_watcher() i=3 2024-09-12T17:27:39.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.928+0000 7f2615f19800 20 remove_watcher() i=4 2024-09-12T17:27:39.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.929+0000 7f2615f19800 20 remove_watcher() i=5 2024-09-12T17:27:39.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.930+0000 7f2615f19800 20 remove_watcher() i=6 2024-09-12T17:27:39.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:39.931+0000 7f2615f19800 20 remove_watcher() i=7 2024-09-12T17:27:39.944 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:27:39.974 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:39.974 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:40.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.011+0000 7f53b5f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:40.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.013+0000 7f53b5f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:40.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.013+0000 7f53b5f1f800 20 realm 2024-09-12T17:27:40.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.013+0000 7f53b5f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:40.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.013+0000 7f53b5f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:40.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.013+0000 7f53b5f1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:40.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.014+0000 7f53b5f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:40.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.014+0000 7f53b5f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:40.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.014+0000 7f53b5f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:40.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.015+0000 7f53b5f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:40.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.015+0000 7f53b5f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:40.017 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.015+0000 7f53b5f1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:40.017 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.015+0000 7f53b5f1f800 20 searching for the correct realm 2024-09-12T17:27:40.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.018+0000 7f53b14a1640 0 -- 172.21.15.67:0/2073536670 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55d2fa43f380 msgr2=0x55d2fa441770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:40.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.021+0000 7f53b1ca2640 0 -- 172.21.15.67:0/2073536670 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f53a80762f0 msgr2=0x7f53a8016720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:40.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.228+0000 7f53b5f1f800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:40.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.228+0000 7f53b5f1f800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:40.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.228+0000 7f53b5f1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:40.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.228+0000 7f53b5f1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:40.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.228+0000 7f53b5f1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:40.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.228+0000 7f53b5f1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:40.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.228+0000 7f53b5f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:40.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.228+0000 7f53b5f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:40.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.228+0000 7f53b5f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:40.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.229+0000 7f53b5f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:40.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.229+0000 7f53b5f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:40.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.229+0000 7f53b5f1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:40.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.229+0000 7f53b5f1f800 20 zone default found 2024-09-12T17:27:40.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.229+0000 7f53b5f1f800 4 Realm: () 2024-09-12T17:27:40.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.229+0000 7f53b5f1f800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:40.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.229+0000 7f53b5f1f800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:40.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.229+0000 7f53b5f1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:40.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.229+0000 7f53b5f1f800 20 zonegroup default 2024-09-12T17:27:40.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.229+0000 7f53b5f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:40.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.229+0000 7f53b5f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:40.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.229+0000 7f53b5f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:40.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.230+0000 7f53b5f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:40.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.230+0000 7f53b5f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:40.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.230+0000 7f53b5f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:40.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.230+0000 7f53b5f1f800 20 started sync module instance, tier type = 2024-09-12T17:27:40.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.230+0000 7f53b5f1f800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:40.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.240+0000 7f53b5f1f800 20 add_watcher() i=0 2024-09-12T17:27:40.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.240+0000 7f53b5f1f800 20 add_watcher() i=1 2024-09-12T17:27:40.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.240+0000 7f53b5f1f800 20 add_watcher() i=2 2024-09-12T17:27:40.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.240+0000 7f53b5f1f800 20 add_watcher() i=3 2024-09-12T17:27:40.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.240+0000 7f53b5f1f800 20 add_watcher() i=4 2024-09-12T17:27:40.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.240+0000 7f53b5f1f800 20 add_watcher() i=5 2024-09-12T17:27:40.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.240+0000 7f53b5f1f800 20 add_watcher() i=6 2024-09-12T17:27:40.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.241+0000 7f53b5f1f800 20 add_watcher() i=7 2024-09-12T17:27:40.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.241+0000 7f53b5f1f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:40.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.242+0000 7f52637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:40.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.243+0000 7f53b5f1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:40.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.243+0000 7f53b5f1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:40.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.243+0000 7f53b5f1f800 5 note: GC not initialized 2024-09-12T17:27:40.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.243+0000 7f52627fc640 20 reqs_thread_entry: start 2024-09-12T17:27:40.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.243+0000 7f53b5f1f800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:40.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.243+0000 7f53b5f1f800 20 Filter name: none 2024-09-12T17:27:40.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.243+0000 7f51d3fff640 20 reqs_thread_entry: start 2024-09-12T17:27:40.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.243+0000 7f53b5f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:40.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.244+0000 7f53b5f1f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:27:40.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.244+0000 7f53b5f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:40.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.244+0000 7f53b5f1f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:27:40.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.244+0000 7f53b5f1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:40.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.244+0000 7f53b5f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:40.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.245+0000 7f53b5f1f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:27:40.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.245+0000 7f53b5f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:27:40.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.245+0000 7f53b5f1f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:27:40.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.245+0000 7f53b5f1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:40.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.246+0000 7f52637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:40.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.249+0000 7f53b5f1f800 20 remove_watcher() i=0 2024-09-12T17:27:40.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.249+0000 7f53b5f1f800 2 removed watcher, disabling cache 2024-09-12T17:27:40.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.250+0000 7f53b5f1f800 20 remove_watcher() i=1 2024-09-12T17:27:40.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.251+0000 7f53b5f1f800 20 remove_watcher() i=2 2024-09-12T17:27:40.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.252+0000 7f53b5f1f800 20 remove_watcher() i=3 2024-09-12T17:27:40.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.253+0000 7f53b5f1f800 20 remove_watcher() i=4 2024-09-12T17:27:40.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.254+0000 7f53b5f1f800 20 remove_watcher() i=5 2024-09-12T17:27:40.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.256+0000 7f53b5f1f800 20 remove_watcher() i=6 2024-09-12T17:27:40.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:40.257+0000 7f53b5f1f800 20 remove_watcher() i=7 2024-09-12T17:27:40.268 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:40.268 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:27:40.268 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-change-reshard-state id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.39 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T17:27:40.268 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:40.270 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:40.271 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:40.288 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:40.288 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:40.525 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:40.525 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:40.590 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-12T17:27:40.590 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:40.591 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:40.591 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:40.632 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:40.632 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:40.689 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:40.690 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:40.726 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:40.726 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:40.763 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:40.763 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:40.799 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:40.799 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:40.836 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:40.836 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:40.872 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:40.873 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:40.910 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:40.910 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:40.945 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:40.945 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:40.981 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:40.981 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:41.017 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:41.017 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:41.052 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:41.052 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:41.088 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:41.088 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:41.124 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:41.125 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:41.159 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:41.160 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:41.198 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:41.198 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:41.234 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:41.235 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:41.272 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:41.273 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:41.309 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:41.309 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:41.346 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:41.346 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:41.383 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:41.383 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:41.419 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T17:27:41.448 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:41.448 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:41.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.486+0000 7f1dbb298800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.488+0000 7f1dbb298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:41.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.488+0000 7f1dbb298800 20 realm 2024-09-12T17:27:41.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.488+0000 7f1dbb298800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.488+0000 7f1dbb298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:41.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.488+0000 7f1dbb298800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:41.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.488+0000 7f1dbb298800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.488+0000 7f1dbb298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:41.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.488+0000 7f1dbb298800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.489+0000 7f1dbb298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:41.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.489+0000 7f1dbb298800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.490+0000 7f1dbb298800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:41.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.490+0000 7f1dbb298800 20 searching for the correct realm 2024-09-12T17:27:41.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.491+0000 7f1db8581640 0 -- 172.21.15.67:0/4229149778 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f1da807ebf0 msgr2=0x7f1da805a460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:27:41.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.495+0000 7f1db8d82640 0 -- 172.21.15.67:0/4229149778 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f1dac04c8c0 msgr2=0x7f1dac082490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:27:41.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.701+0000 7f1dbb298800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:41.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.701+0000 7f1dbb298800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:41.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.701+0000 7f1dbb298800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:41.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.701+0000 7f1dbb298800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:41.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.701+0000 7f1dbb298800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:41.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.701+0000 7f1dbb298800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:41.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.701+0000 7f1dbb298800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.701+0000 7f1dbb298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:41.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.701+0000 7f1dbb298800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.702+0000 7f1dbb298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:41.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.702+0000 7f1dbb298800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.705 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.702+0000 7f1dbb298800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:41.705 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.702+0000 7f1dbb298800 20 zone default found 2024-09-12T17:27:41.705 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.702+0000 7f1dbb298800 4 Realm: () 2024-09-12T17:27:41.705 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.702+0000 7f1dbb298800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:41.705 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.702+0000 7f1dbb298800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:41.705 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.702+0000 7f1dbb298800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:41.705 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.702+0000 7f1dbb298800 20 zonegroup default 2024-09-12T17:27:41.705 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.702+0000 7f1dbb298800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.705 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.703+0000 7f1dbb298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:41.705 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.703+0000 7f1dbb298800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.703+0000 7f1dbb298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:41.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.703+0000 7f1dbb298800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.703+0000 7f1dbb298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:41.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.703+0000 7f1dbb298800 20 started sync module instance, tier type = 2024-09-12T17:27:41.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.703+0000 7f1dbb298800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:41.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.712+0000 7f1dbb298800 20 add_watcher() i=0 2024-09-12T17:27:41.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.712+0000 7f1dbb298800 20 add_watcher() i=1 2024-09-12T17:27:41.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.712+0000 7f1dbb298800 20 add_watcher() i=2 2024-09-12T17:27:41.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.712+0000 7f1dbb298800 20 add_watcher() i=3 2024-09-12T17:27:41.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.712+0000 7f1dbb298800 20 add_watcher() i=4 2024-09-12T17:27:41.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.712+0000 7f1dbb298800 20 add_watcher() i=5 2024-09-12T17:27:41.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.712+0000 7f1dbb298800 20 add_watcher() i=6 2024-09-12T17:27:41.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.713+0000 7f1dbb298800 20 add_watcher() i=7 2024-09-12T17:27:41.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.713+0000 7f1dbb298800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:41.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.715+0000 7f1c6efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:41.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.715+0000 7f1dbb298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:41.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.715+0000 7f1dbb298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:41.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.715+0000 7f1dbb298800 5 note: GC not initialized 2024-09-12T17:27:41.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.715+0000 7f1c6dfe3640 20 reqs_thread_entry: start 2024-09-12T17:27:41.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.715+0000 7f1dbb298800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:41.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.715+0000 7f1dbb298800 20 Filter name: none 2024-09-12T17:27:41.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.716+0000 7f1bdf7fe640 20 reqs_thread_entry: start 2024-09-12T17:27:41.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.716+0000 7f1dbb298800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.716+0000 7f1dbb298800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:27:41.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.716+0000 7f1dbb298800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.717+0000 7f1dbb298800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:27:41.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.717+0000 7f1dbb298800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:41.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.717+0000 7f1dbb298800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.717+0000 7f1dbb298800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:27:41.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.717+0000 7f1dbb298800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.717+0000 7f1dbb298800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:27:41.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.717+0000 7f1dbb298800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:41.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.719+0000 7f1c6efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:41.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.721+0000 7f1dbb298800 20 remove_watcher() i=0 2024-09-12T17:27:41.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.721+0000 7f1dbb298800 2 removed watcher, disabling cache 2024-09-12T17:27:41.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.721+0000 7f1dbb298800 20 remove_watcher() i=1 2024-09-12T17:27:41.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.722+0000 7f1dbb298800 20 remove_watcher() i=2 2024-09-12T17:27:41.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.723+0000 7f1dbb298800 20 remove_watcher() i=3 2024-09-12T17:27:41.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.724+0000 7f1dbb298800 20 remove_watcher() i=4 2024-09-12T17:27:41.726 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.725+0000 7f1dbb298800 20 remove_watcher() i=5 2024-09-12T17:27:41.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.726+0000 7f1dbb298800 20 remove_watcher() i=6 2024-09-12T17:27:41.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.727+0000 7f1dbb298800 20 remove_watcher() i=7 2024-09-12T17:27:41.740 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.740 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:27:41.740 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-change-reshard-state id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:27:41.740 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.742 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T17:27:41.776 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:41.777 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:41.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.815+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.816+0000 7fd064abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:41.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.816+0000 7fd064abb800 20 realm 2024-09-12T17:27:41.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.816+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.816+0000 7fd064abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:41.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.816+0000 7fd064abb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:41.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.816+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.816+0000 7fd064abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:41.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.816+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.817+0000 7fd064abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:41.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.817+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.818+0000 7fd064abb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:41.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.818+0000 7fd064abb800 20 searching for the correct realm 2024-09-12T17:27:41.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.821+0000 7fd061da4640 0 -- 172.21.15.67:0/373219513 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x5632759da480 msgr2=0x5632759dc870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:41.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.824+0000 7fd062da6640 0 -- 172.21.15.67:0/373219513 >> [v2:172.21.15.118:6824/1070975205,v1:172.21.15.118:6825/1070975205] conn(0x7fd05806d040 msgr2=0x7fd0580b4050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:41.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.828+0000 7fd064abb800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:41.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.828+0000 7fd064abb800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:41.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.828+0000 7fd064abb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:41.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.828+0000 7fd064abb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:41.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.828+0000 7fd064abb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:41.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.828+0000 7fd064abb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:41.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.828+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.828+0000 7fd064abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:41.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.828+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.828+0000 7fd064abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:41.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.828+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.829+0000 7fd064abb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:41.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.829+0000 7fd064abb800 20 zone default found 2024-09-12T17:27:41.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.829+0000 7fd064abb800 4 Realm: () 2024-09-12T17:27:41.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.829+0000 7fd064abb800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:41.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.829+0000 7fd064abb800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:41.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.829+0000 7fd064abb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:41.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.829+0000 7fd064abb800 20 zonegroup default 2024-09-12T17:27:41.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.829+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.829+0000 7fd064abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:41.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.829+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.829+0000 7fd064abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:41.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.829+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.830+0000 7fd064abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:41.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.830+0000 7fd064abb800 20 started sync module instance, tier type = 2024-09-12T17:27:41.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.830+0000 7fd064abb800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:41.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.839+0000 7fd064abb800 20 add_watcher() i=0 2024-09-12T17:27:41.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.839+0000 7fd064abb800 20 add_watcher() i=1 2024-09-12T17:27:41.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.839+0000 7fd064abb800 20 add_watcher() i=2 2024-09-12T17:27:41.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.839+0000 7fd064abb800 20 add_watcher() i=3 2024-09-12T17:27:41.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.839+0000 7fd064abb800 20 add_watcher() i=4 2024-09-12T17:27:41.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.839+0000 7fd064abb800 20 add_watcher() i=5 2024-09-12T17:27:41.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.839+0000 7fd064abb800 20 add_watcher() i=6 2024-09-12T17:27:41.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.840+0000 7fd064abb800 20 add_watcher() i=7 2024-09-12T17:27:41.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.840+0000 7fd064abb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:41.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.841+0000 7fcf18fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:41.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.842+0000 7fd064abb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:41.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.842+0000 7fd064abb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:41.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.842+0000 7fd064abb800 5 note: GC not initialized 2024-09-12T17:27:41.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.842+0000 7fce937fe640 20 reqs_thread_entry: start 2024-09-12T17:27:41.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.842+0000 7fd064abb800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:41.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.842+0000 7fd064abb800 20 Filter name: none 2024-09-12T17:27:41.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.842+0000 7fce917fa640 20 reqs_thread_entry: start 2024-09-12T17:27:41.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.842+0000 7fd064abb800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:27:41.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.842+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.843+0000 7fd064abb800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:27:41.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.843+0000 7fd064abb800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:27:41.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.843+0000 7fd064abb800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:27:41.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.843+0000 7fd064abb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 : miss 2024-09-12T17:27:41.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.843+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.843+0000 7fd064abb800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:27:41.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.843+0000 7fd064abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 info.flags=0x17 2024-09-12T17:27:41.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.843+0000 7fd064abb800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 to cache LRU end 2024-09-12T17:27:41.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.843+0000 7fd064abb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:41.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.843+0000 7fd064abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:41.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.843+0000 7fd064abb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 2024-09-12T17:27:41.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.847+0000 7fd064abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 info.flags=0x17 2024-09-12T17:27:41.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.847+0000 7fd064abb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 to cache LRU end 2024-09-12T17:27:41.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.847+0000 7fd064abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:41.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.847+0000 7fd064abb800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40, ofs0, ns] 2024-09-12T17:27:41.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.847+0000 7fcf45ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464315 cookie 94774721623824 notifier 7544 bl.length()=1015 2024-09-12T17:27:41.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.847+0000 7fcf45ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 info.flags=0x17 2024-09-12T17:27:41.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.847+0000 7fcf45ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 to cache LRU end 2024-09-12T17:27:41.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.847+0000 7fcf45ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:41.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.849+0000 7fd064abb800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.40]): orig_sources= new_sources= 2024-09-12T17:27:41.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.849+0000 7fd064abb800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.40]): potential sources added=[] removed=[] 2024-09-12T17:27:41.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.849+0000 7fd064abb800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.40]): orig_dests= new_dests= 2024-09-12T17:27:41.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.849+0000 7fd064abb800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.40]): potential dests added=[] removed=[] 2024-09-12T17:27:41.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.851+0000 7fd064abb800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.40.1.0 2024-09-12T17:27:41.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.851+0000 7fd064abb800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.40.1.0 2024-09-12T17:27:41.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.851+0000 7fd064abb800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.40.1.1 2024-09-12T17:27:41.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.851+0000 7fd064abb800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.40.1.1 2024-09-12T17:27:41.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.851+0000 7fd064abb800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.40.0 2024-09-12T17:27:41.854 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd064abb800 time 2024-09-12T17:27:41.854371+0000 2024-09-12T17:27:41.854 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:27:41.855 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:27:41.855 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd067f8c71a] 2024-09-12T17:27:41.855 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd067f8c8d8] 2024-09-12T17:27:41.855 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56327356e841] 2024-09-12T17:27:41.855 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x56327357d734] 2024-09-12T17:27:41.856 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56327357e5d4] 2024-09-12T17:27:41.856 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:27:41.856 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd066c29590] 2024-09-12T17:27:41.856 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:27:41.856 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:27:41.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.854+0000 7fd064abb800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd064abb800 time 2024-09-12T17:27:41.854371+0000 2024-09-12T17:27:41.856 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:27:41.856 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.856 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:27:41.856 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd067f8c71a] 2024-09-12T17:27:41.856 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd067f8c8d8] 2024-09-12T17:27:41.857 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56327356e841] 2024-09-12T17:27:41.857 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x56327357d734] 2024-09-12T17:27:41.857 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56327357e5d4] 2024-09-12T17:27:41.857 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:27:41.857 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd066c29590] 2024-09-12T17:27:41.857 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:27:41.857 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:27:41.858 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.858 INFO:tasks.workunit.client.0.smithi067.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:27:41.858 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7fd064abb800 thread_name:radosgw-admin 2024-09-12T17:27:41.882 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:27:41.882 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd066c3e6f0] 2024-09-12T17:27:41.882 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd066c8b99c] 2024-09-12T17:27:41.882 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:27:41.882 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:27:41.882 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd067f8c774] 2024-09-12T17:27:41.882 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd067f8c8d8] 2024-09-12T17:27:41.882 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56327356e841] 2024-09-12T17:27:41.882 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x56327357d734] 2024-09-12T17:27:41.883 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56327357e5d4] 2024-09-12T17:27:41.883 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:27:41.883 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd066c29590] 2024-09-12T17:27:41.883 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:27:41.883 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:27:41.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.855+0000 7fd064abb800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:27:41.883 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7fd064abb800 thread_name:radosgw-admin 2024-09-12T17:27:41.883 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.883 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:27:41.883 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd066c3e6f0] 2024-09-12T17:27:41.883 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd066c8b99c] 2024-09-12T17:27:41.883 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:27:41.883 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:27:41.884 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd067f8c774] 2024-09-12T17:27:41.884 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd067f8c8d8] 2024-09-12T17:27:41.884 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56327356e841] 2024-09-12T17:27:41.884 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x56327357d734] 2024-09-12T17:27:41.884 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56327357e5d4] 2024-09-12T17:27:41.884 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:27:41.884 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd066c29590] 2024-09-12T17:27:41.884 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:27:41.885 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:27:41.885 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:27:41.885 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.885 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T17:27:41.885 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T17:27:41.797+0000 7fd064abb800 5 monclient: authenticate success, global_id 7532 2024-09-12T17:27:41.885 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T17:27:41.797+0000 7fd064abb800 10 monclient: get_monmap_and_config success 2024-09-12T17:27:41.885 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T17:27:41.797+0000 7fd064abb800 4 set_mon_vals no callback set 2024-09-12T17:27:41.885 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T17:27:41.797+0000 7fcf50608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:41.885 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T17:27:41.797+0000 7fcf50608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:27:41.886 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T17:27:41.797+0000 7fcf50608640 10 monclient: dump: 2024-09-12T17:27:41.886 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:41.886 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:41.886 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.886 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.886 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:41.886 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:41.886 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:41.887 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:41.887 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:41.887 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.887 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T17:27:41.798+0000 7fd064abb800 10 monclient: shutdown 2024-09-12T17:27:41.887 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 asok(0x5632756c5730) unregister_commands rotate-key 2024-09-12T17:27:41.887 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T17:27:41.798+0000 7fd064abb800 10 monclient: build_initial_monmap 2024-09-12T17:27:41.887 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T17:27:41.798+0000 7fd064abb800 1 build_initial for_mkfs: 0 2024-09-12T17:27:41.887 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T17:27:41.798+0000 7fd064abb800 10 monclient: monmap: 2024-09-12T17:27:41.888 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:27:41.888 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:27:41.888 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:27:41.888 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:27:41.888 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:27:41.888 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:41.888 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:27:41.888 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:27:41.888 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:27:41.889 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.889 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding auth protocol: cephx 2024-09-12T17:27:41.889 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding auth protocol: cephx 2024-09-12T17:27:41.889 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding auth protocol: cephx 2024-09-12T17:27:41.889 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding con mode: secure 2024-09-12T17:27:41.889 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding con mode: crc 2024-09-12T17:27:41.889 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding con mode: secure 2024-09-12T17:27:41.889 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding con mode: crc 2024-09-12T17:27:41.889 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding con mode: secure 2024-09-12T17:27:41.889 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding con mode: crc 2024-09-12T17:27:41.889 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding con mode: crc 2024-09-12T17:27:41.889 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding con mode: secure 2024-09-12T17:27:41.889 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding con mode: crc 2024-09-12T17:27:41.890 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding con mode: secure 2024-09-12T17:27:41.890 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding con mode: crc 2024-09-12T17:27:41.890 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding con mode: secure 2024-09-12T17:27:41.890 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T17:27:41.798+0000 7fd064abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:41.890 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T17:27:41.798+0000 7fd064abb800 1 librados: starting msgr at 2024-09-12T17:27:41.890 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T17:27:41.798+0000 7fd064abb800 1 librados: starting objecter 2024-09-12T17:27:41.890 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 asok(0x5632756c5730) register_command objecter_requests hook 0x5632758edf00 2024-09-12T17:27:41.890 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T17:27:41.798+0000 7fd064abb800 1 librados: setting wanted keys 2024-09-12T17:27:41.890 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T17:27:41.798+0000 7fd064abb800 1 librados: calling monclient init 2024-09-12T17:27:41.890 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T17:27:41.798+0000 7fd064abb800 10 monclient: init 2024-09-12T17:27:41.890 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding auth protocol: cephx 2024-09-12T17:27:41.890 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding auth protocol: cephx 2024-09-12T17:27:41.890 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding auth protocol: cephx 2024-09-12T17:27:41.891 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding con mode: secure 2024-09-12T17:27:41.891 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding con mode: crc 2024-09-12T17:27:41.891 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding con mode: secure 2024-09-12T17:27:41.891 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding con mode: crc 2024-09-12T17:27:41.891 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding con mode: secure 2024-09-12T17:27:41.891 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding con mode: crc 2024-09-12T17:27:41.891 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding con mode: crc 2024-09-12T17:27:41.891 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding con mode: secure 2024-09-12T17:27:41.891 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding con mode: crc 2024-09-12T17:27:41.891 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding con mode: secure 2024-09-12T17:27:41.892 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding con mode: crc 2024-09-12T17:27:41.892 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding con mode: secure 2024-09-12T17:27:41.892 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T17:27:41.798+0000 7fd064abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:41.892 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T17:27:41.799+0000 7fd064abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:41.892 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T17:27:41.799+0000 7fd064abb800 5 asok(0x5632756c5730) register_command rotate-key hook 0x5632758e7ec8 2024-09-12T17:27:41.892 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T17:27:41.799+0000 7fd064abb800 10 monclient: _reopen_session rank -1 2024-09-12T17:27:41.892 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T17:27:41.799+0000 7fd064abb800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:27:41.892 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T17:27:41.799+0000 7fd064abb800 10 monclient(hunting): picked mon.noname-b con 0x563275830a40 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:27:41.892 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T17:27:41.799+0000 7fd064abb800 10 monclient(hunting): picked mon.noname-a con 0x563275831380 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:27:41.893 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T17:27:41.799+0000 7fd064abb800 10 monclient(hunting): picked mon.noname-c con 0x5632758eeb00 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:27:41.893 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T17:27:41.799+0000 7fd064abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:41.893 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T17:27:41.799+0000 7fd064abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:41.893 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T17:27:41.799+0000 7fd064abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:41.893 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T17:27:41.799+0000 7fd064abb800 10 monclient(hunting): _renew_subs 2024-09-12T17:27:41.893 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T17:27:41.799+0000 7fd064abb800 10 monclient(hunting): authenticate will time out at 2473.149269s 2024-09-12T17:27:41.893 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T17:27:41.799+0000 7fd061da4640 10 monclient(hunting): get_auth_request con 0x563275831380 auth_method 0 2024-09-12T17:27:41.893 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T17:27:41.799+0000 7fd061da4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:41.893 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T17:27:41.799+0000 7fd061da4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:41.893 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T17:27:41.799+0000 7fd061da4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:41.893 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T17:27:41.799+0000 7fd062da6640 10 monclient(hunting): get_auth_request con 0x5632758eeb00 auth_method 0 2024-09-12T17:27:41.893 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T17:27:41.799+0000 7fd062da6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:41.894 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T17:27:41.799+0000 7fd062da6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:41.894 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T17:27:41.799+0000 7fd062da6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:41.894 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T17:27:41.799+0000 7fd062da6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:41.894 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T17:27:41.799+0000 7fd062da6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:41.894 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T17:27:41.799+0000 7fd062da6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:41.894 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T17:27:41.799+0000 7fd061da4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:41.894 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T17:27:41.799+0000 7fd061da4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:41.894 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T17:27:41.799+0000 7fd061da4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:41.894 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T17:27:41.799+0000 7fd062da6640 10 monclient(hunting): handle_auth_done global_id 7535 payload 824 2024-09-12T17:27:41.894 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T17:27:41.799+0000 7fd062da6640 10 monclient: _finish_hunting 0 2024-09-12T17:27:41.894 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T17:27:41.799+0000 7fd062da6640 1 monclient: found mon.noname-c 2024-09-12T17:27:41.895 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T17:27:41.799+0000 7fd062da6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:27:41.895 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T17:27:41.799+0000 7fcf4ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:41.895 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T17:27:41.799+0000 7fcf4ee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:27:41.895 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T17:27:41.799+0000 7fcf4ee05640 10 monclient: dump: 2024-09-12T17:27:41.895 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:41.895 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:41.895 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.895 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.895 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:41.895 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:41.895 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:41.895 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:41.896 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:41.896 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.896 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T17:27:41.799+0000 7fcf4ee05640 10 monclient: _finish_auth 0 2024-09-12T17:27:41.896 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T17:27:41.799+0000 7fcf4ee05640 10 monclient: _check_auth_tickets 2024-09-12T17:27:41.896 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T17:27:41.799+0000 7fcf4ee05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:27:41.896 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T17:27:41.799+0000 7fcf4ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:41.896 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T17:27:41.799+0000 7fcf4ee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:27:41.896 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T17:27:41.799+0000 7fcf4ee05640 10 monclient: dump: 2024-09-12T17:27:41.896 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:41.896 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:41.896 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.896 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.897 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:41.897 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:41.897 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:41.897 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:41.897 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:41.897 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.897 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T17:27:41.799+0000 7fd064abb800 5 monclient: authenticate success, global_id 7535 2024-09-12T17:27:41.897 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T17:27:41.799+0000 7fd064abb800 10 monclient: _renew_subs 2024-09-12T17:27:41.897 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T17:27:41.799+0000 7fd064abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:41.897 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T17:27:41.799+0000 7fcf50608640 4 set_mon_vals no callback set 2024-09-12T17:27:41.897 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T17:27:41.800+0000 7fd064abb800 10 monclient: _renew_subs 2024-09-12T17:27:41.897 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T17:27:41.800+0000 7fd064abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:41.897 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T17:27:41.800+0000 7fd064abb800 1 librados: init done 2024-09-12T17:27:41.898 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T17:27:41.801+0000 7fcf4ee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:27:41.898 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T17:27:41.801+0000 7fcf4ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:27:41.898 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T17:27:41.801+0000 7fcf4ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:27:41.898 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T17:27:41.802+0000 7fd0625a5640 10 monclient: get_auth_request con 0x7fcf48076470 auth_method 0 2024-09-12T17:27:41.898 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T17:27:41.802+0000 7fd061da4640 10 monclient: get_auth_request con 0x563275928fb0 auth_method 0 2024-09-12T17:27:41.898 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T17:27:41.803+0000 7fd0625a5640 10 monclient: get_auth_request con 0x563275933140 auth_method 0 2024-09-12T17:27:41.898 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T17:27:41.804+0000 7fd061da4640 10 monclient: get_auth_request con 0x5632759377e0 auth_method 0 2024-09-12T17:27:41.898 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T17:27:41.805+0000 7fd064abb800 10 monclient: build_initial_monmap 2024-09-12T17:27:41.898 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T17:27:41.805+0000 7fd064abb800 1 build_initial for_mkfs: 0 2024-09-12T17:27:41.898 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T17:27:41.805+0000 7fd064abb800 10 monclient: monmap: 2024-09-12T17:27:41.898 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:27:41.898 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:27:41.899 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:27:41.899 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:27:41.899 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:27:41.899 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:41.899 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:27:41.899 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:27:41.899 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:27:41.899 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.899 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding auth protocol: cephx 2024-09-12T17:27:41.899 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding auth protocol: cephx 2024-09-12T17:27:41.899 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding auth protocol: cephx 2024-09-12T17:27:41.899 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding con mode: secure 2024-09-12T17:27:41.900 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding con mode: crc 2024-09-12T17:27:41.900 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding con mode: secure 2024-09-12T17:27:41.900 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding con mode: crc 2024-09-12T17:27:41.900 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding con mode: secure 2024-09-12T17:27:41.900 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding con mode: crc 2024-09-12T17:27:41.900 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding con mode: crc 2024-09-12T17:27:41.900 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding con mode: secure 2024-09-12T17:27:41.900 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding con mode: crc 2024-09-12T17:27:41.900 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding con mode: secure 2024-09-12T17:27:41.900 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding con mode: crc 2024-09-12T17:27:41.900 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding con mode: secure 2024-09-12T17:27:41.901 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T17:27:41.805+0000 7fd064abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:41.901 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 asok(0x5632756c5730) register_command objecter_requests cmddesc objecter_requests hook 0x56327593f930 EEXIST 2024-09-12T17:27:41.901 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T17:27:41.806+0000 7fd064abb800 10 monclient: init 2024-09-12T17:27:41.901 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding auth protocol: cephx 2024-09-12T17:27:41.901 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding auth protocol: cephx 2024-09-12T17:27:41.901 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding auth protocol: cephx 2024-09-12T17:27:41.901 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding con mode: secure 2024-09-12T17:27:41.901 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding con mode: crc 2024-09-12T17:27:41.901 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding con mode: secure 2024-09-12T17:27:41.901 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding con mode: crc 2024-09-12T17:27:41.902 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding con mode: secure 2024-09-12T17:27:41.902 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding con mode: crc 2024-09-12T17:27:41.902 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding con mode: crc 2024-09-12T17:27:41.902 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding con mode: secure 2024-09-12T17:27:41.902 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding con mode: crc 2024-09-12T17:27:41.902 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding con mode: secure 2024-09-12T17:27:41.902 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding con mode: crc 2024-09-12T17:27:41.902 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding con mode: secure 2024-09-12T17:27:41.902 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T17:27:41.806+0000 7fd064abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:41.902 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T17:27:41.806+0000 7fd064abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:41.902 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 asok(0x5632756c5730) register_command rotate-key cmddesc rotate-key hook 0x56327593ac60 EEXIST 2024-09-12T17:27:41.903 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T17:27:41.806+0000 7fd064abb800 10 monclient: _reopen_session rank -1 2024-09-12T17:27:41.903 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T17:27:41.806+0000 7fd064abb800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:27:41.903 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T17:27:41.806+0000 7fd064abb800 10 monclient(hunting): picked mon.noname-a con 0x563275963c50 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:27:41.903 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T17:27:41.806+0000 7fd064abb800 10 monclient(hunting): picked mon.noname-c con 0x563275964030 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:27:41.903 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T17:27:41.806+0000 7fd064abb800 10 monclient(hunting): picked mon.noname-b con 0x563275962960 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:27:41.903 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T17:27:41.806+0000 7fd064abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:41.903 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T17:27:41.806+0000 7fd064abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:41.903 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T17:27:41.806+0000 7fd064abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:41.904 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T17:27:41.806+0000 7fd064abb800 10 monclient(hunting): _renew_subs 2024-09-12T17:27:41.904 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T17:27:41.806+0000 7fd064abb800 10 monclient(hunting): authenticate will time out at 2473.156552s 2024-09-12T17:27:41.904 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T17:27:41.806+0000 7fd061da4640 10 monclient(hunting): get_auth_request con 0x563275964030 auth_method 0 2024-09-12T17:27:41.904 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T17:27:41.806+0000 7fd061da4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:41.904 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T17:27:41.806+0000 7fd061da4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:41.904 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T17:27:41.806+0000 7fd061da4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:41.904 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T17:27:41.806+0000 7fd0625a5640 10 monclient(hunting): get_auth_request con 0x563275963c50 auth_method 0 2024-09-12T17:27:41.904 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T17:27:41.806+0000 7fd0625a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:41.904 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T17:27:41.806+0000 7fd0625a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:41.904 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T17:27:41.806+0000 7fd0625a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:41.904 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T17:27:41.806+0000 7fd061da4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:41.905 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T17:27:41.806+0000 7fd061da4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:41.905 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T17:27:41.806+0000 7fd061da4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:41.905 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T17:27:41.806+0000 7fd0625a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:41.905 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T17:27:41.806+0000 7fd0625a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:41.905 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T17:27:41.806+0000 7fd0625a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:41.905 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T17:27:41.806+0000 7fd062da6640 10 monclient(hunting): get_auth_request con 0x563275962960 auth_method 0 2024-09-12T17:27:41.905 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T17:27:41.806+0000 7fd062da6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:41.905 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T17:27:41.806+0000 7fd062da6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:41.905 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T17:27:41.806+0000 7fd062da6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:41.905 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T17:27:41.806+0000 7fd061da4640 10 monclient(hunting): handle_auth_done global_id 7538 payload 824 2024-09-12T17:27:41.905 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T17:27:41.806+0000 7fd061da4640 10 monclient: _finish_hunting 0 2024-09-12T17:27:41.905 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T17:27:41.806+0000 7fd061da4640 1 monclient: found mon.noname-c 2024-09-12T17:27:41.905 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T17:27:41.806+0000 7fd061da4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:27:41.906 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T17:27:41.807+0000 7fcf47fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:41.906 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T17:27:41.807+0000 7fcf47fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:27:41.906 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T17:27:41.807+0000 7fcf47fff640 10 monclient: dump: 2024-09-12T17:27:41.906 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:41.906 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:41.906 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.906 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.906 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:41.906 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:41.906 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:41.906 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:41.906 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:41.907 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.907 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T17:27:41.807+0000 7fcf47fff640 10 monclient: _finish_auth 0 2024-09-12T17:27:41.907 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T17:27:41.807+0000 7fcf47fff640 10 monclient: _check_auth_tickets 2024-09-12T17:27:41.907 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T17:27:41.807+0000 7fcf47fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:27:41.907 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T17:27:41.807+0000 7fcf47fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:41.907 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T17:27:41.807+0000 7fcf47fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:27:41.907 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T17:27:41.807+0000 7fcf47fff640 10 monclient: dump: 2024-09-12T17:27:41.907 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:41.907 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:41.907 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.907 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.907 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:41.907 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:41.907 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:41.908 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:41.908 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:41.908 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.908 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T17:27:41.807+0000 7fd064abb800 5 monclient: authenticate success, global_id 7538 2024-09-12T17:27:41.908 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T17:27:41.807+0000 7fd064abb800 10 monclient: _renew_subs 2024-09-12T17:27:41.908 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T17:27:41.807+0000 7fd064abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:41.908 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T17:27:41.807+0000 7fd0635a7640 4 set_mon_vals no callback set 2024-09-12T17:27:41.908 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T17:27:41.807+0000 7fd064abb800 10 monclient: _renew_subs 2024-09-12T17:27:41.908 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T17:27:41.807+0000 7fd064abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:41.908 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T17:27:41.809+0000 7fcf47fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:27:41.908 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T17:27:41.809+0000 7fcf47fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:27:41.908 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T17:27:41.809+0000 7fcf47fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:27:41.908 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T17:27:41.809+0000 7fd0625a5640 10 monclient: get_auth_request con 0x7fcf3c076380 auth_method 0 2024-09-12T17:27:41.908 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T17:27:41.809+0000 7fd064abb800 10 monclient: get_monmap_and_config 2024-09-12T17:27:41.909 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T17:27:41.809+0000 7fd064abb800 10 monclient: build_initial_monmap 2024-09-12T17:27:41.909 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T17:27:41.809+0000 7fd064abb800 1 build_initial for_mkfs: 0 2024-09-12T17:27:41.909 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T17:27:41.809+0000 7fd064abb800 10 monclient: monmap: 2024-09-12T17:27:41.909 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:27:41.909 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:27:41.909 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:27:41.909 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:27:41.909 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:27:41.909 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:41.909 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:27:41.909 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:27:41.909 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:27:41.909 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.909 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding auth protocol: cephx 2024-09-12T17:27:41.910 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding auth protocol: cephx 2024-09-12T17:27:41.910 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding auth protocol: cephx 2024-09-12T17:27:41.910 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding con mode: secure 2024-09-12T17:27:41.910 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding con mode: crc 2024-09-12T17:27:41.910 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding con mode: secure 2024-09-12T17:27:41.910 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding con mode: crc 2024-09-12T17:27:41.910 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding con mode: secure 2024-09-12T17:27:41.910 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding con mode: crc 2024-09-12T17:27:41.910 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding con mode: crc 2024-09-12T17:27:41.910 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding con mode: secure 2024-09-12T17:27:41.910 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding con mode: crc 2024-09-12T17:27:41.911 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding con mode: secure 2024-09-12T17:27:41.911 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding con mode: crc 2024-09-12T17:27:41.911 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding con mode: secure 2024-09-12T17:27:41.911 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T17:27:41.809+0000 7fd064abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:41.911 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T17:27:41.809+0000 7fd064abb800 10 monclient: init 2024-09-12T17:27:41.911 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding auth protocol: cephx 2024-09-12T17:27:41.911 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding auth protocol: cephx 2024-09-12T17:27:41.911 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding auth protocol: cephx 2024-09-12T17:27:41.911 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding con mode: secure 2024-09-12T17:27:41.911 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding con mode: crc 2024-09-12T17:27:41.912 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding con mode: secure 2024-09-12T17:27:41.912 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding con mode: crc 2024-09-12T17:27:41.912 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding con mode: secure 2024-09-12T17:27:41.912 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding con mode: crc 2024-09-12T17:27:41.912 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding con mode: crc 2024-09-12T17:27:41.912 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding con mode: secure 2024-09-12T17:27:41.912 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding con mode: crc 2024-09-12T17:27:41.912 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding con mode: secure 2024-09-12T17:27:41.912 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding con mode: crc 2024-09-12T17:27:41.912 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding con mode: secure 2024-09-12T17:27:41.913 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T17:27:41.810+0000 7fd064abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:41.913 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T17:27:41.810+0000 7fd064abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:41.913 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T17:27:41.810+0000 7fd064abb800 5 asok(0x5632756c5730) register_command rotate-key cmddesc rotate-key hook 0x7fff863efe28 EEXIST 2024-09-12T17:27:41.913 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T17:27:41.810+0000 7fd064abb800 10 monclient: _reopen_session rank -1 2024-09-12T17:27:41.913 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T17:27:41.810+0000 7fd064abb800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:27:41.913 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T17:27:41.810+0000 7fd064abb800 10 monclient(hunting): picked mon.noname-a con 0x5632759b7d20 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:27:41.913 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T17:27:41.810+0000 7fd064abb800 10 monclient(hunting): picked mon.noname-b con 0x563275988d30 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:27:41.914 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T17:27:41.810+0000 7fd064abb800 10 monclient(hunting): picked mon.noname-c con 0x5632759b3200 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:27:41.914 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T17:27:41.810+0000 7fd064abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:41.914 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T17:27:41.810+0000 7fd064abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:41.914 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T17:27:41.810+0000 7fd064abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:41.914 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T17:27:41.810+0000 7fd064abb800 10 monclient(hunting): _renew_subs 2024-09-12T17:27:41.914 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T17:27:41.810+0000 7fd064abb800 10 monclient(hunting): authenticate will time out at 2473.160452s 2024-09-12T17:27:41.914 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T17:27:41.810+0000 7fd0625a5640 10 monclient(hunting): get_auth_request con 0x5632759b7d20 auth_method 0 2024-09-12T17:27:41.914 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T17:27:41.810+0000 7fd0625a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:41.914 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T17:27:41.810+0000 7fd0625a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:41.914 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T17:27:41.810+0000 7fd0625a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:41.914 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T17:27:41.810+0000 7fd062da6640 10 monclient(hunting): get_auth_request con 0x5632759b3200 auth_method 0 2024-09-12T17:27:41.915 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T17:27:41.810+0000 7fd062da6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:41.915 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T17:27:41.810+0000 7fd062da6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:41.915 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T17:27:41.810+0000 7fd062da6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:41.915 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T17:27:41.810+0000 7fd0625a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:41.915 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T17:27:41.810+0000 7fd0625a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:41.915 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T17:27:41.810+0000 7fd0625a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:41.915 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T17:27:41.810+0000 7fd062da6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:41.915 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T17:27:41.810+0000 7fd062da6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:41.915 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T17:27:41.810+0000 7fd062da6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:41.915 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T17:27:41.810+0000 7fd061da4640 10 monclient(hunting): get_auth_request con 0x563275988d30 auth_method 0 2024-09-12T17:27:41.915 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T17:27:41.810+0000 7fd061da4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:41.915 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T17:27:41.810+0000 7fd061da4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:41.915 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T17:27:41.810+0000 7fd061da4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:41.916 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T17:27:41.810+0000 7fd0625a5640 10 monclient(hunting): handle_auth_done global_id 8019 payload 274 2024-09-12T17:27:41.916 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T17:27:41.810+0000 7fd0625a5640 10 monclient: _finish_hunting 0 2024-09-12T17:27:41.916 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T17:27:41.810+0000 7fd0625a5640 1 monclient: found mon.noname-a 2024-09-12T17:27:41.916 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T17:27:41.810+0000 7fd0625a5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:27:41.916 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T17:27:41.811+0000 7fcf45ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:41.916 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T17:27:41.811+0000 7fcf45ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:27:41.916 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T17:27:41.811+0000 7fcf45ffb640 10 monclient: dump: 2024-09-12T17:27:41.916 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:41.916 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:41.916 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.916 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.917 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:41.917 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:41.917 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:41.917 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:41.917 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:41.917 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.917 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T17:27:41.811+0000 7fcf45ffb640 10 monclient: _finish_auth 0 2024-09-12T17:27:41.917 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T17:27:41.811+0000 7fcf45ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:27:41.917 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 monclient: authenticate success, global_id 8019 2024-09-12T17:27:41.917 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T17:27:41.811+0000 7fcf45ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:27:41.917 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T17:27:41.811+0000 7fd064abb800 10 monclient: get_monmap_and_config success 2024-09-12T17:27:41.917 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T17:27:41.811+0000 7fd064abb800 4 set_mon_vals no callback set 2024-09-12T17:27:41.918 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T17:27:41.811+0000 7fcf45ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:41.918 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T17:27:41.811+0000 7fcf45ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:27:41.918 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T17:27:41.811+0000 7fcf45ffb640 10 monclient: dump: 2024-09-12T17:27:41.918 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:41.918 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:41.918 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.918 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.918 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:41.918 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:41.918 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:41.918 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:41.918 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:41.919 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.919 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T17:27:41.811+0000 7fd064abb800 10 monclient: shutdown 2024-09-12T17:27:41.919 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T17:27:41.811+0000 7fd064abb800 10 monclient: build_initial_monmap 2024-09-12T17:27:41.919 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T17:27:41.811+0000 7fd064abb800 1 build_initial for_mkfs: 0 2024-09-12T17:27:41.919 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T17:27:41.811+0000 7fd064abb800 10 monclient: monmap: 2024-09-12T17:27:41.919 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:27:41.919 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:27:41.919 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:27:41.919 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:27:41.919 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:27:41.919 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:41.919 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:27:41.920 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:27:41.920 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:27:41.920 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.920 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding auth protocol: cephx 2024-09-12T17:27:41.920 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding auth protocol: cephx 2024-09-12T17:27:41.920 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding auth protocol: cephx 2024-09-12T17:27:41.920 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding con mode: secure 2024-09-12T17:27:41.920 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding con mode: crc 2024-09-12T17:27:41.920 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding con mode: secure 2024-09-12T17:27:41.920 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding con mode: crc 2024-09-12T17:27:41.920 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding con mode: secure 2024-09-12T17:27:41.921 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding con mode: crc 2024-09-12T17:27:41.921 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding con mode: crc 2024-09-12T17:27:41.921 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding con mode: secure 2024-09-12T17:27:41.921 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding con mode: crc 2024-09-12T17:27:41.921 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding con mode: secure 2024-09-12T17:27:41.921 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding con mode: crc 2024-09-12T17:27:41.921 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding con mode: secure 2024-09-12T17:27:41.921 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T17:27:41.812+0000 7fd064abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:41.921 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T17:27:41.812+0000 7fd064abb800 1 librados: starting msgr at 2024-09-12T17:27:41.922 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T17:27:41.812+0000 7fd064abb800 1 librados: starting objecter 2024-09-12T17:27:41.922 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 asok(0x5632756c5730) register_command objecter_requests cmddesc objecter_requests hook 0x5632759630b0 EEXIST 2024-09-12T17:27:41.922 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T17:27:41.812+0000 7fd064abb800 1 librados: setting wanted keys 2024-09-12T17:27:41.922 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T17:27:41.812+0000 7fd064abb800 1 librados: calling monclient init 2024-09-12T17:27:41.922 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T17:27:41.812+0000 7fd064abb800 10 monclient: init 2024-09-12T17:27:41.922 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding auth protocol: cephx 2024-09-12T17:27:41.922 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding auth protocol: cephx 2024-09-12T17:27:41.922 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding auth protocol: cephx 2024-09-12T17:27:41.922 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding con mode: secure 2024-09-12T17:27:41.922 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding con mode: crc 2024-09-12T17:27:41.922 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding con mode: secure 2024-09-12T17:27:41.922 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding con mode: crc 2024-09-12T17:27:41.922 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding con mode: secure 2024-09-12T17:27:41.923 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding con mode: crc 2024-09-12T17:27:41.924 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding con mode: crc 2024-09-12T17:27:41.925 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding con mode: secure 2024-09-12T17:27:41.925 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding con mode: crc 2024-09-12T17:27:41.925 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding con mode: secure 2024-09-12T17:27:41.925 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding con mode: crc 2024-09-12T17:27:41.925 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding con mode: secure 2024-09-12T17:27:41.925 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T17:27:41.812+0000 7fd064abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:41.925 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T17:27:41.812+0000 7fd064abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:41.925 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 asok(0x5632756c5730) register_command rotate-key cmddesc rotate-key hook 0x563275978658 EEXIST 2024-09-12T17:27:41.925 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T17:27:41.812+0000 7fd064abb800 10 monclient: _reopen_session rank -1 2024-09-12T17:27:41.925 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T17:27:41.812+0000 7fd064abb800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:27:41.925 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T17:27:41.812+0000 7fd064abb800 10 monclient(hunting): picked mon.noname-a con 0x563275988d30 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:27:41.926 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T17:27:41.812+0000 7fd064abb800 10 monclient(hunting): picked mon.noname-b con 0x5632759b3200 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:27:41.926 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T17:27:41.812+0000 7fd064abb800 10 monclient(hunting): picked mon.noname-c con 0x5632759b7d20 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:27:41.926 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T17:27:41.812+0000 7fd064abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:41.926 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T17:27:41.812+0000 7fd064abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:41.926 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T17:27:41.812+0000 7fd064abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:41.926 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T17:27:41.812+0000 7fd064abb800 10 monclient(hunting): _renew_subs 2024-09-12T17:27:41.926 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T17:27:41.812+0000 7fd064abb800 10 monclient(hunting): authenticate will time out at 2473.162873s 2024-09-12T17:27:41.926 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T17:27:41.812+0000 7fd0625a5640 10 monclient(hunting): get_auth_request con 0x563275988d30 auth_method 0 2024-09-12T17:27:41.926 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T17:27:41.812+0000 7fd0625a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:41.926 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T17:27:41.812+0000 7fd0625a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:41.927 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T17:27:41.812+0000 7fd0625a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:41.927 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T17:27:41.812+0000 7fd062da6640 10 monclient(hunting): get_auth_request con 0x5632759b7d20 auth_method 0 2024-09-12T17:27:41.927 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T17:27:41.812+0000 7fd062da6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:41.927 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T17:27:41.813+0000 7fd062da6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:41.927 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T17:27:41.813+0000 7fd062da6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:41.927 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T17:27:41.813+0000 7fd062da6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:41.927 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T17:27:41.813+0000 7fd062da6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:41.927 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T17:27:41.813+0000 7fd062da6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:41.927 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T17:27:41.813+0000 7fd0625a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:41.927 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T17:27:41.813+0000 7fd0625a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:41.927 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T17:27:41.813+0000 7fd0625a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:41.927 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T17:27:41.813+0000 7fd061da4640 10 monclient(hunting): get_auth_request con 0x5632759b3200 auth_method 0 2024-09-12T17:27:41.927 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T17:27:41.813+0000 7fd061da4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:41.928 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T17:27:41.813+0000 7fd061da4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:41.928 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T17:27:41.813+0000 7fd061da4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:41.928 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T17:27:41.813+0000 7fd062da6640 10 monclient(hunting): handle_auth_done global_id 7544 payload 824 2024-09-12T17:27:41.928 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T17:27:41.813+0000 7fd062da6640 10 monclient: _finish_hunting 0 2024-09-12T17:27:41.928 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T17:27:41.813+0000 7fd062da6640 1 monclient: found mon.noname-c 2024-09-12T17:27:41.928 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T17:27:41.813+0000 7fd062da6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:27:41.928 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T17:27:41.813+0000 7fcf33fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:41.928 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T17:27:41.813+0000 7fcf33fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:27:41.928 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T17:27:41.813+0000 7fcf33fff640 10 monclient: dump: 2024-09-12T17:27:41.928 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:41.928 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:41.928 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.928 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.928 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:41.929 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:41.929 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:41.929 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:41.929 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:41.929 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.929 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T17:27:41.813+0000 7fcf33fff640 10 monclient: _finish_auth 0 2024-09-12T17:27:41.929 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T17:27:41.813+0000 7fcf33fff640 10 monclient: _check_auth_tickets 2024-09-12T17:27:41.929 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T17:27:41.813+0000 7fcf33fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:27:41.929 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T17:27:41.813+0000 7fcf33fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:41.929 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T17:27:41.813+0000 7fcf33fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:27:41.929 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T17:27:41.813+0000 7fcf33fff640 10 monclient: dump: 2024-09-12T17:27:41.929 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:41.929 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:41.929 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.930 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.930 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:41.930 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:41.930 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:41.930 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:41.930 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:41.930 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.930 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T17:27:41.813+0000 7fd064abb800 5 monclient: authenticate success, global_id 7544 2024-09-12T17:27:41.930 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T17:27:41.813+0000 7fd064abb800 10 monclient: _renew_subs 2024-09-12T17:27:41.930 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T17:27:41.813+0000 7fcf45ffb640 4 set_mon_vals no callback set 2024-09-12T17:27:41.930 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T17:27:41.813+0000 7fd064abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:41.930 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T17:27:41.813+0000 7fd064abb800 10 monclient: _renew_subs 2024-09-12T17:27:41.930 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T17:27:41.813+0000 7fd064abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:41.930 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T17:27:41.813+0000 7fd064abb800 1 librados: init done 2024-09-12T17:27:41.931 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T17:27:41.813+0000 7fd064abb800 5 asok(0x5632756c5730) register_command cr dump hook 0x7fd05400ef08 2024-09-12T17:27:41.931 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T17:27:41.815+0000 7fcf33fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:27:41.931 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T17:27:41.815+0000 7fcf33fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:27:41.931 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T17:27:41.815+0000 7fcf33fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:27:41.931 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T17:27:41.815+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.931 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T17:27:41.815+0000 7fd0625a5640 10 monclient: get_auth_request con 0x7fcf2c0764a0 auth_method 0 2024-09-12T17:27:41.931 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T17:27:41.815+0000 7fd061da4640 10 monclient: get_auth_request con 0x5632759d2910 auth_method 0 2024-09-12T17:27:41.931 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T17:27:41.816+0000 7fd064abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:41.931 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T17:27:41.816+0000 7fd064abb800 20 realm 2024-09-12T17:27:41.931 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T17:27:41.816+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.931 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T17:27:41.816+0000 7fd064abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:41.931 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T17:27:41.816+0000 7fd064abb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:41.931 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T17:27:41.816+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.931 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T17:27:41.816+0000 7fd064abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:41.932 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T17:27:41.816+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.932 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T17:27:41.816+0000 7fd0625a5640 10 monclient: get_auth_request con 0x5632759d6bd0 auth_method 0 2024-09-12T17:27:41.932 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T17:27:41.817+0000 7fd064abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:41.932 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T17:27:41.817+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.932 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T17:27:41.817+0000 7fd061da4640 10 monclient: get_auth_request con 0x5632759da480 auth_method 0 2024-09-12T17:27:41.932 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T17:27:41.818+0000 7fd064abb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:41.932 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T17:27:41.818+0000 7fd064abb800 20 searching for the correct realm 2024-09-12T17:27:41.932 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T17:27:41.818+0000 7fd062da6640 10 monclient: get_auth_request con 0x5632759def30 auth_method 0 2024-09-12T17:27:41.932 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T17:27:41.819+0000 7fd0625a5640 10 monclient: get_auth_request con 0x7fd05c0900b0 auth_method 0 2024-09-12T17:27:41.932 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T17:27:41.819+0000 7fd061da4640 10 monclient: get_auth_request con 0x7fd054038070 auth_method 0 2024-09-12T17:27:41.933 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T17:27:41.821+0000 7fd061da4640 0 -- 172.21.15.67:0/373219513 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x5632759da480 msgr2=0x5632759dc870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:41.933 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T17:27:41.821+0000 7fcf33fff640 1 client.7544.objecter ms_handle_reset 0x5632759da480 session 0x5632759d5f20 osd.4 2024-09-12T17:27:41.933 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T17:27:41.821+0000 7fcf33fff640 10 monclient: _renew_subs 2024-09-12T17:27:41.933 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T17:27:41.821+0000 7fcf33fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:41.933 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T17:27:41.821+0000 7fd061da4640 10 monclient: get_auth_request con 0x7fcf2c086340 auth_method 0 2024-09-12T17:27:41.933 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T17:27:41.821+0000 7fd062da6640 10 monclient: get_auth_request con 0x7fd05806d040 auth_method 0 2024-09-12T17:27:41.933 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T17:27:41.823+0000 7fd0625a5640 10 monclient: get_auth_request con 0x7fd0580b5e00 auth_method 0 2024-09-12T17:27:41.933 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T17:27:41.824+0000 7fd062da6640 0 -- 172.21.15.67:0/373219513 >> [v2:172.21.15.118:6824/1070975205,v1:172.21.15.118:6825/1070975205] conn(0x7fd05806d040 msgr2=0x7fd0580b4050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:41.933 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T17:27:41.825+0000 7fcf33fff640 1 client.7544.objecter ms_handle_reset 0x7fd05806d040 session 0x7fd0580dbe90 osd.6 2024-09-12T17:27:41.933 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T17:27:41.825+0000 7fd062da6640 10 monclient: get_auth_request con 0x5632759da480 auth_method 0 2024-09-12T17:27:41.933 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T17:27:41.828+0000 7fd064abb800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:41.933 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T17:27:41.828+0000 7fd064abb800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:41.933 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T17:27:41.828+0000 7fd064abb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:41.934 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T17:27:41.828+0000 7fd064abb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:41.934 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T17:27:41.828+0000 7fd064abb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:41.934 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T17:27:41.828+0000 7fd064abb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:41.934 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T17:27:41.828+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.934 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T17:27:41.828+0000 7fd064abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:41.934 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T17:27:41.828+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.934 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T17:27:41.828+0000 7fd064abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:41.934 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T17:27:41.828+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.934 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T17:27:41.829+0000 7fd064abb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:41.934 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T17:27:41.829+0000 7fd064abb800 20 zone default found 2024-09-12T17:27:41.934 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T17:27:41.829+0000 7fd064abb800 4 Realm: () 2024-09-12T17:27:41.934 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T17:27:41.829+0000 7fd064abb800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:41.935 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T17:27:41.829+0000 7fd064abb800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:41.935 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T17:27:41.829+0000 7fd064abb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:41.935 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T17:27:41.829+0000 7fd064abb800 20 zonegroup default 2024-09-12T17:27:41.935 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T17:27:41.829+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.935 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T17:27:41.829+0000 7fd064abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:41.935 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T17:27:41.829+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.935 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T17:27:41.829+0000 7fd064abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:41.935 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T17:27:41.829+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.935 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T17:27:41.830+0000 7fd064abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:41.935 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T17:27:41.830+0000 7fd064abb800 20 started sync module instance, tier type = 2024-09-12T17:27:41.935 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T17:27:41.830+0000 7fd064abb800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:41.936 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T17:27:41.839+0000 7fd064abb800 20 add_watcher() i=0 2024-09-12T17:27:41.936 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T17:27:41.839+0000 7fd064abb800 20 add_watcher() i=1 2024-09-12T17:27:41.936 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T17:27:41.839+0000 7fd064abb800 20 add_watcher() i=2 2024-09-12T17:27:41.936 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T17:27:41.839+0000 7fd064abb800 20 add_watcher() i=3 2024-09-12T17:27:41.936 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T17:27:41.839+0000 7fd064abb800 20 add_watcher() i=4 2024-09-12T17:27:41.936 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T17:27:41.839+0000 7fd064abb800 20 add_watcher() i=5 2024-09-12T17:27:41.936 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T17:27:41.839+0000 7fd064abb800 20 add_watcher() i=6 2024-09-12T17:27:41.936 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T17:27:41.840+0000 7fd064abb800 20 add_watcher() i=7 2024-09-12T17:27:41.937 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T17:27:41.840+0000 7fd064abb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:41.937 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding auth protocol: cephx 2024-09-12T17:27:41.937 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding auth protocol: cephx 2024-09-12T17:27:41.937 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding auth protocol: cephx 2024-09-12T17:27:41.937 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding con mode: secure 2024-09-12T17:27:41.937 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding con mode: crc 2024-09-12T17:27:41.937 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding con mode: secure 2024-09-12T17:27:41.937 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding con mode: crc 2024-09-12T17:27:41.937 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding con mode: secure 2024-09-12T17:27:41.937 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding con mode: crc 2024-09-12T17:27:41.937 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding con mode: crc 2024-09-12T17:27:41.937 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding con mode: secure 2024-09-12T17:27:41.937 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding con mode: crc 2024-09-12T17:27:41.938 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding con mode: secure 2024-09-12T17:27:41.938 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding con mode: crc 2024-09-12T17:27:41.938 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding con mode: secure 2024-09-12T17:27:41.938 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T17:27:41.841+0000 7fcf18fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:41.938 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T17:27:41.842+0000 7fd064abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:41.938 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T17:27:41.842+0000 7fd064abb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:41.938 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T17:27:41.842+0000 7fd064abb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:41.938 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T17:27:41.842+0000 7fd064abb800 5 asok(0x5632756c5730) register_command cache list hook 0x5632759b71f0 2024-09-12T17:27:41.938 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T17:27:41.842+0000 7fd064abb800 5 asok(0x5632756c5730) register_command cache inspect hook 0x5632759b71f0 2024-09-12T17:27:41.938 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T17:27:41.842+0000 7fd064abb800 5 asok(0x5632756c5730) register_command cache erase hook 0x5632759b71f0 2024-09-12T17:27:41.938 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T17:27:41.842+0000 7fd064abb800 5 asok(0x5632756c5730) register_command cache zap hook 0x5632759b71f0 2024-09-12T17:27:41.939 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T17:27:41.842+0000 7fd064abb800 5 note: GC not initialized 2024-09-12T17:27:41.939 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T17:27:41.842+0000 7fce937fe640 20 reqs_thread_entry: start 2024-09-12T17:27:41.939 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T17:27:41.842+0000 7fd064abb800 5 asok(0x5632756c5730) register_command sync trace show hook 0x7fd0540109e0 2024-09-12T17:27:41.939 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T17:27:41.842+0000 7fd064abb800 5 asok(0x5632756c5730) register_command sync trace history hook 0x7fd0540109e0 2024-09-12T17:27:41.939 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T17:27:41.842+0000 7fd064abb800 5 asok(0x5632756c5730) register_command sync trace active hook 0x7fd0540109e0 2024-09-12T17:27:41.939 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T17:27:41.842+0000 7fd064abb800 5 asok(0x5632756c5730) register_command sync trace active_short hook 0x7fd0540109e0 2024-09-12T17:27:41.940 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T17:27:41.842+0000 7fd064abb800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:41.940 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T17:27:41.842+0000 7fd064abb800 20 Filter name: none 2024-09-12T17:27:41.940 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T17:27:41.842+0000 7fce917fa640 20 reqs_thread_entry: start 2024-09-12T17:27:41.940 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T17:27:41.842+0000 7fd064abb800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:27:41.940 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T17:27:41.842+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.940 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T17:27:41.843+0000 7fd064abb800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:27:41.941 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T17:27:41.843+0000 7fd064abb800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:27:41.941 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T17:27:41.843+0000 7fd064abb800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:27:41.941 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T17:27:41.843+0000 7fd064abb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 : miss 2024-09-12T17:27:41.941 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T17:27:41.843+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.941 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T17:27:41.843+0000 7fd064abb800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:27:41.941 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T17:27:41.843+0000 7fd064abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 info.flags=0x17 2024-09-12T17:27:41.942 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T17:27:41.843+0000 7fd064abb800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 to cache LRU end 2024-09-12T17:27:41.942 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T17:27:41.843+0000 7fd064abb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:41.942 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T17:27:41.843+0000 7fd064abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:41.942 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T17:27:41.843+0000 7fd064abb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 2024-09-12T17:27:41.942 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T17:27:41.847+0000 7fd064abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 info.flags=0x17 2024-09-12T17:27:41.942 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T17:27:41.847+0000 7fd064abb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 to cache LRU end 2024-09-12T17:27:41.942 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T17:27:41.847+0000 7fd064abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:41.942 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T17:27:41.847+0000 7fd064abb800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40, ofs0, ns] 2024-09-12T17:27:41.942 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T17:27:41.847+0000 7fcf45ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464315 cookie 94774721623824 notifier 7544 bl.length()=1015 2024-09-12T17:27:41.942 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T17:27:41.847+0000 7fcf45ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 info.flags=0x17 2024-09-12T17:27:41.942 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T17:27:41.847+0000 7fcf45ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 to cache LRU end 2024-09-12T17:27:41.942 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T17:27:41.847+0000 7fcf45ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:41.942 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T17:27:41.849+0000 7fd064abb800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.40]): orig_sources= new_sources= 2024-09-12T17:27:41.943 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T17:27:41.849+0000 7fd064abb800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.40]): potential sources added=[] removed=[] 2024-09-12T17:27:41.943 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T17:27:41.849+0000 7fd064abb800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.40]): orig_dests= new_dests= 2024-09-12T17:27:41.943 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T17:27:41.849+0000 7fd064abb800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.40]): potential dests added=[] removed=[] 2024-09-12T17:27:41.943 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T17:27:41.851+0000 7fd064abb800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.40.1.0 2024-09-12T17:27:41.943 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T17:27:41.851+0000 7fd064abb800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.40.1.0 2024-09-12T17:27:41.943 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T17:27:41.851+0000 7fd064abb800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.40.1.1 2024-09-12T17:27:41.943 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T17:27:41.851+0000 7fd064abb800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.40.1.1 2024-09-12T17:27:41.943 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T17:27:41.851+0000 7fd064abb800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.40.0 2024-09-12T17:27:41.943 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T17:27:41.854+0000 7fd064abb800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd064abb800 time 2024-09-12T17:27:41.854371+0000 2024-09-12T17:27:41.943 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:27:41.943 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.943 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:27:41.944 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd067f8c71a] 2024-09-12T17:27:41.944 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd067f8c8d8] 2024-09-12T17:27:41.944 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56327356e841] 2024-09-12T17:27:41.944 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x56327357d734] 2024-09-12T17:27:41.944 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56327357e5d4] 2024-09-12T17:27:41.944 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:27:41.944 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd066c29590] 2024-09-12T17:27:41.944 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:27:41.944 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:27:41.944 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.944 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T17:27:41.855+0000 7fd064abb800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:27:41.944 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7fd064abb800 thread_name:radosgw-admin 2024-09-12T17:27:41.944 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.945 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:27:41.945 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd066c3e6f0] 2024-09-12T17:27:41.945 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd066c8b99c] 2024-09-12T17:27:41.945 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:27:41.945 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:27:41.945 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd067f8c774] 2024-09-12T17:27:41.945 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd067f8c8d8] 2024-09-12T17:27:41.945 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56327356e841] 2024-09-12T17:27:41.945 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x56327357d734] 2024-09-12T17:27:41.945 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56327357e5d4] 2024-09-12T17:27:41.946 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:27:41.946 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd066c29590] 2024-09-12T17:27:41.946 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:27:41.946 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:27:41.946 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:27:41.946 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.946 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T17:27:41.946 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T17:27:41.946 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T17:27:41.946 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T17:27:41.946 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T17:27:41.946 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T17:27:41.946 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T17:27:41.946 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T17:27:41.947 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T17:27:41.947 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T17:27:41.947 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T17:27:41.947 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T17:27:41.947 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T17:27:41.947 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T17:27:41.947 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T17:27:41.947 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T17:27:41.947 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T17:27:41.947 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T17:27:41.947 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T17:27:41.947 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T17:27:41.947 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T17:27:41.948 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T17:27:41.948 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T17:27:41.948 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T17:27:41.948 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:27:41.948 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T17:27:41.948 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T17:27:41.948 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T17:27:41.948 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T17:27:41.948 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T17:27:41.948 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T17:27:41.949 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T17:27:41.949 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T17:27:41.949 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T17:27:41.949 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T17:27:41.949 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T17:27:41.949 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T17:27:41.949 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T17:27:41.949 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T17:27:41.949 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T17:27:41.949 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T17:27:41.949 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T17:27:41.949 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T17:27:41.949 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T17:27:41.950 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T17:27:41.950 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T17:27:41.950 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:27:41.950 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T17:27:41.950 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:27:41.950 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T17:27:41.950 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T17:27:41.950 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T17:27:41.950 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T17:27:41.950 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T17:27:41.950 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T17:27:41.950 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T17:27:41.950 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T17:27:41.951 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T17:27:41.951 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T17:27:41.951 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T17:27:41.951 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T17:27:41.951 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T17:27:41.951 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T17:27:41.951 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T17:27:41.951 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T17:27:41.951 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T17:27:41.951 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T17:27:41.952 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:27:41.952 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T17:27:41.952 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:27:41.952 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T17:27:41.952 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T17:27:41.952 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T17:27:41.952 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T17:27:41.952 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T17:27:41.952 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T17:27:41.952 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:27:41.953 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T17:27:41.953 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T17:27:41.953 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:27:41.953 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T17:27:41.953 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T17:27:41.953 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T17:27:41.953 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T17:27:41.953 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T17:27:41.953 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T17:27:41.953 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T17:27:41.953 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T17:27:41.953 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T17:27:41.953 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T17:27:41.954 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T17:27:41.954 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T17:27:41.954 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T17:27:41.954 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:27:41.954 INFO:tasks.workunit.client.0.smithi067.stderr: 7fce917fa640 / http_manager 2024-09-12T17:27:41.954 INFO:tasks.workunit.client.0.smithi067.stderr: 7fce937fe640 / http_manager 2024-09-12T17:27:41.954 INFO:tasks.workunit.client.0.smithi067.stderr: 7fcf18fe1640 / rgw_dt_lg_renew 2024-09-12T17:27:41.954 INFO:tasks.workunit.client.0.smithi067.stderr: 7fcf33fff640 / ms_dispatch 2024-09-12T17:27:41.954 INFO:tasks.workunit.client.0.smithi067.stderr: 7fcf45ffb640 / io_context_pool 2024-09-12T17:27:41.954 INFO:tasks.workunit.client.0.smithi067.stderr: 7fcf47fff640 / ms_dispatch 2024-09-12T17:27:41.954 INFO:tasks.workunit.client.0.smithi067.stderr: 7fcf4ee05640 / ms_dispatch 2024-09-12T17:27:41.955 INFO:tasks.workunit.client.0.smithi067.stderr: 7fcf50608640 / io_context_pool 2024-09-12T17:27:41.955 INFO:tasks.workunit.client.0.smithi067.stderr: 7fd061da4640 / msgr-worker-2 2024-09-12T17:27:41.955 INFO:tasks.workunit.client.0.smithi067.stderr: 7fd0625a5640 / msgr-worker-1 2024-09-12T17:27:41.955 INFO:tasks.workunit.client.0.smithi067.stderr: 7fd062da6640 / msgr-worker-0 2024-09-12T17:27:41.955 INFO:tasks.workunit.client.0.smithi067.stderr: 7fd0635a7640 / io_context_pool 2024-09-12T17:27:41.955 INFO:tasks.workunit.client.0.smithi067.stderr: 7fd064abb800 / radosgw-admin 2024-09-12T17:27:41.955 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T17:27:41.955 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T17:27:41.955 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/log/ceph/ceph-client.admin.143964.log 2024-09-12T17:27:41.955 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T17:27:41.956 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T17:27:41.956 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T17:27:41.797+0000 7fd064abb800 5 monclient: authenticate success, global_id 7532 2024-09-12T17:27:41.956 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T17:27:41.797+0000 7fd064abb800 10 monclient: get_monmap_and_config success 2024-09-12T17:27:41.956 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T17:27:41.797+0000 7fd064abb800 4 set_mon_vals no callback set 2024-09-12T17:27:41.956 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T17:27:41.797+0000 7fcf50608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:41.956 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T17:27:41.797+0000 7fcf50608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:27:41.956 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T17:27:41.797+0000 7fcf50608640 10 monclient: dump: 2024-09-12T17:27:41.956 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:41.956 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:41.956 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.956 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.956 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:41.957 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:41.957 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:41.957 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:41.957 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:41.957 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.957 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T17:27:41.798+0000 7fd064abb800 10 monclient: shutdown 2024-09-12T17:27:41.957 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 asok(0x5632756c5730) unregister_commands rotate-key 2024-09-12T17:27:41.957 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T17:27:41.798+0000 7fd064abb800 10 monclient: build_initial_monmap 2024-09-12T17:27:41.957 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T17:27:41.798+0000 7fd064abb800 1 build_initial for_mkfs: 0 2024-09-12T17:27:41.957 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T17:27:41.798+0000 7fd064abb800 10 monclient: monmap: 2024-09-12T17:27:41.958 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:27:41.958 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:27:41.958 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:27:41.958 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:27:41.958 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:27:41.958 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:41.958 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:27:41.958 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:27:41.958 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:27:41.958 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.958 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding auth protocol: cephx 2024-09-12T17:27:41.958 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding auth protocol: cephx 2024-09-12T17:27:41.959 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding auth protocol: cephx 2024-09-12T17:27:41.959 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding con mode: secure 2024-09-12T17:27:41.959 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding con mode: crc 2024-09-12T17:27:41.959 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding con mode: secure 2024-09-12T17:27:41.959 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding con mode: crc 2024-09-12T17:27:41.959 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding con mode: secure 2024-09-12T17:27:41.959 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding con mode: crc 2024-09-12T17:27:41.959 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding con mode: crc 2024-09-12T17:27:41.960 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding con mode: secure 2024-09-12T17:27:41.960 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding con mode: crc 2024-09-12T17:27:41.960 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding con mode: secure 2024-09-12T17:27:41.960 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding con mode: crc 2024-09-12T17:27:41.960 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758ed4c0) adding con mode: secure 2024-09-12T17:27:41.960 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T17:27:41.798+0000 7fd064abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:41.960 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T17:27:41.798+0000 7fd064abb800 1 librados: starting msgr at 2024-09-12T17:27:41.960 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T17:27:41.798+0000 7fd064abb800 1 librados: starting objecter 2024-09-12T17:27:41.961 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 asok(0x5632756c5730) register_command objecter_requests hook 0x5632758edf00 2024-09-12T17:27:41.961 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T17:27:41.798+0000 7fd064abb800 1 librados: setting wanted keys 2024-09-12T17:27:41.961 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T17:27:41.798+0000 7fd064abb800 1 librados: calling monclient init 2024-09-12T17:27:41.961 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T17:27:41.798+0000 7fd064abb800 10 monclient: init 2024-09-12T17:27:41.961 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding auth protocol: cephx 2024-09-12T17:27:41.961 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding auth protocol: cephx 2024-09-12T17:27:41.961 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding auth protocol: cephx 2024-09-12T17:27:41.961 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding con mode: secure 2024-09-12T17:27:41.961 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding con mode: crc 2024-09-12T17:27:41.961 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding con mode: secure 2024-09-12T17:27:41.961 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding con mode: crc 2024-09-12T17:27:41.961 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding con mode: secure 2024-09-12T17:27:41.961 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding con mode: crc 2024-09-12T17:27:41.962 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding con mode: crc 2024-09-12T17:27:41.962 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding con mode: secure 2024-09-12T17:27:41.962 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding con mode: crc 2024-09-12T17:27:41.962 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding con mode: secure 2024-09-12T17:27:41.962 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding con mode: crc 2024-09-12T17:27:41.962 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T17:27:41.798+0000 7fd064abb800 5 AuthRegistry(0x5632758e7d80) adding con mode: secure 2024-09-12T17:27:41.962 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T17:27:41.798+0000 7fd064abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:41.962 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T17:27:41.799+0000 7fd064abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:41.962 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T17:27:41.799+0000 7fd064abb800 5 asok(0x5632756c5730) register_command rotate-key hook 0x5632758e7ec8 2024-09-12T17:27:41.962 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T17:27:41.799+0000 7fd064abb800 10 monclient: _reopen_session rank -1 2024-09-12T17:27:41.962 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T17:27:41.799+0000 7fd064abb800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:27:41.962 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T17:27:41.799+0000 7fd064abb800 10 monclient(hunting): picked mon.noname-b con 0x563275830a40 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:27:41.963 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T17:27:41.799+0000 7fd064abb800 10 monclient(hunting): picked mon.noname-a con 0x563275831380 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:27:41.963 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T17:27:41.799+0000 7fd064abb800 10 monclient(hunting): picked mon.noname-c con 0x5632758eeb00 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:27:41.963 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T17:27:41.799+0000 7fd064abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:41.963 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T17:27:41.799+0000 7fd064abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:41.963 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T17:27:41.799+0000 7fd064abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:41.963 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T17:27:41.799+0000 7fd064abb800 10 monclient(hunting): _renew_subs 2024-09-12T17:27:41.963 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T17:27:41.799+0000 7fd064abb800 10 monclient(hunting): authenticate will time out at 2473.149269s 2024-09-12T17:27:41.963 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T17:27:41.799+0000 7fd061da4640 10 monclient(hunting): get_auth_request con 0x563275831380 auth_method 0 2024-09-12T17:27:41.963 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T17:27:41.799+0000 7fd061da4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:41.963 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T17:27:41.799+0000 7fd061da4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:41.963 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T17:27:41.799+0000 7fd061da4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:41.963 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T17:27:41.799+0000 7fd062da6640 10 monclient(hunting): get_auth_request con 0x5632758eeb00 auth_method 0 2024-09-12T17:27:41.963 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T17:27:41.799+0000 7fd062da6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:41.963 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T17:27:41.799+0000 7fd062da6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:41.964 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T17:27:41.799+0000 7fd062da6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:41.964 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T17:27:41.799+0000 7fd062da6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:41.964 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T17:27:41.799+0000 7fd062da6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:41.964 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T17:27:41.799+0000 7fd062da6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:41.964 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T17:27:41.799+0000 7fd061da4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:41.964 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T17:27:41.799+0000 7fd061da4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:41.964 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T17:27:41.799+0000 7fd061da4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:41.964 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T17:27:41.799+0000 7fd062da6640 10 monclient(hunting): handle_auth_done global_id 7535 payload 824 2024-09-12T17:27:41.964 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T17:27:41.799+0000 7fd062da6640 10 monclient: _finish_hunting 0 2024-09-12T17:27:41.964 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T17:27:41.799+0000 7fd062da6640 1 monclient: found mon.noname-c 2024-09-12T17:27:41.964 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T17:27:41.799+0000 7fd062da6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:27:41.964 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T17:27:41.799+0000 7fcf4ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:41.964 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T17:27:41.799+0000 7fcf4ee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:27:41.964 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T17:27:41.799+0000 7fcf4ee05640 10 monclient: dump: 2024-09-12T17:27:41.965 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:41.965 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:41.965 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.965 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.965 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:41.965 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:41.965 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:41.965 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:41.965 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:41.965 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.965 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T17:27:41.799+0000 7fcf4ee05640 10 monclient: _finish_auth 0 2024-09-12T17:27:41.965 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T17:27:41.799+0000 7fcf4ee05640 10 monclient: _check_auth_tickets 2024-09-12T17:27:41.965 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T17:27:41.799+0000 7fcf4ee05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:27:41.965 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T17:27:41.799+0000 7fcf4ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:41.966 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T17:27:41.799+0000 7fcf4ee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:27:41.966 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T17:27:41.799+0000 7fcf4ee05640 10 monclient: dump: 2024-09-12T17:27:41.966 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:41.966 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:41.966 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.966 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.966 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:41.966 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:41.966 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:41.966 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:41.966 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:41.966 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.966 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T17:27:41.799+0000 7fd064abb800 5 monclient: authenticate success, global_id 7535 2024-09-12T17:27:41.966 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T17:27:41.799+0000 7fd064abb800 10 monclient: _renew_subs 2024-09-12T17:27:41.966 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T17:27:41.799+0000 7fd064abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:41.967 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T17:27:41.799+0000 7fcf50608640 4 set_mon_vals no callback set 2024-09-12T17:27:41.967 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T17:27:41.800+0000 7fd064abb800 10 monclient: _renew_subs 2024-09-12T17:27:41.967 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T17:27:41.800+0000 7fd064abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:41.967 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T17:27:41.800+0000 7fd064abb800 1 librados: init done 2024-09-12T17:27:41.967 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T17:27:41.801+0000 7fcf4ee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:27:41.967 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T17:27:41.801+0000 7fcf4ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:27:41.967 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T17:27:41.801+0000 7fcf4ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:27:41.967 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T17:27:41.802+0000 7fd0625a5640 10 monclient: get_auth_request con 0x7fcf48076470 auth_method 0 2024-09-12T17:27:41.967 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T17:27:41.802+0000 7fd061da4640 10 monclient: get_auth_request con 0x563275928fb0 auth_method 0 2024-09-12T17:27:41.967 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T17:27:41.803+0000 7fd0625a5640 10 monclient: get_auth_request con 0x563275933140 auth_method 0 2024-09-12T17:27:41.967 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T17:27:41.804+0000 7fd061da4640 10 monclient: get_auth_request con 0x5632759377e0 auth_method 0 2024-09-12T17:27:41.967 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T17:27:41.805+0000 7fd064abb800 10 monclient: build_initial_monmap 2024-09-12T17:27:41.967 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T17:27:41.805+0000 7fd064abb800 1 build_initial for_mkfs: 0 2024-09-12T17:27:41.967 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T17:27:41.805+0000 7fd064abb800 10 monclient: monmap: 2024-09-12T17:27:41.967 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:27:41.968 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:27:41.968 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:27:41.968 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:27:41.968 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:27:41.968 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:41.968 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:27:41.968 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:27:41.968 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:27:41.968 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.968 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding auth protocol: cephx 2024-09-12T17:27:41.968 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding auth protocol: cephx 2024-09-12T17:27:41.968 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding auth protocol: cephx 2024-09-12T17:27:41.968 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding con mode: secure 2024-09-12T17:27:41.969 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding con mode: crc 2024-09-12T17:27:41.969 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding con mode: secure 2024-09-12T17:27:41.969 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding con mode: crc 2024-09-12T17:27:41.969 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding con mode: secure 2024-09-12T17:27:41.969 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding con mode: crc 2024-09-12T17:27:41.969 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding con mode: crc 2024-09-12T17:27:41.969 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding con mode: secure 2024-09-12T17:27:41.969 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding con mode: crc 2024-09-12T17:27:41.969 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding con mode: secure 2024-09-12T17:27:41.969 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding con mode: crc 2024-09-12T17:27:41.969 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 AuthRegistry(0x56327593c440) adding con mode: secure 2024-09-12T17:27:41.970 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T17:27:41.805+0000 7fd064abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:41.970 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T17:27:41.805+0000 7fd064abb800 5 asok(0x5632756c5730) register_command objecter_requests cmddesc objecter_requests hook 0x56327593f930 EEXIST 2024-09-12T17:27:41.970 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T17:27:41.806+0000 7fd064abb800 10 monclient: init 2024-09-12T17:27:41.970 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding auth protocol: cephx 2024-09-12T17:27:41.970 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding auth protocol: cephx 2024-09-12T17:27:41.970 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding auth protocol: cephx 2024-09-12T17:27:41.970 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding con mode: secure 2024-09-12T17:27:41.970 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding con mode: crc 2024-09-12T17:27:41.970 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding con mode: secure 2024-09-12T17:27:41.970 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding con mode: crc 2024-09-12T17:27:41.970 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding con mode: secure 2024-09-12T17:27:41.970 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding con mode: crc 2024-09-12T17:27:41.971 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding con mode: crc 2024-09-12T17:27:41.971 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding con mode: secure 2024-09-12T17:27:41.971 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding con mode: crc 2024-09-12T17:27:41.971 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding con mode: secure 2024-09-12T17:27:41.971 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding con mode: crc 2024-09-12T17:27:41.971 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 AuthRegistry(0x56327593ab18) adding con mode: secure 2024-09-12T17:27:41.971 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T17:27:41.806+0000 7fd064abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:41.971 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T17:27:41.806+0000 7fd064abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:41.971 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T17:27:41.806+0000 7fd064abb800 5 asok(0x5632756c5730) register_command rotate-key cmddesc rotate-key hook 0x56327593ac60 EEXIST 2024-09-12T17:27:41.971 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T17:27:41.806+0000 7fd064abb800 10 monclient: _reopen_session rank -1 2024-09-12T17:27:41.971 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T17:27:41.806+0000 7fd064abb800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:27:41.971 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T17:27:41.806+0000 7fd064abb800 10 monclient(hunting): picked mon.noname-a con 0x563275963c50 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:27:41.972 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T17:27:41.806+0000 7fd064abb800 10 monclient(hunting): picked mon.noname-c con 0x563275964030 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:27:41.972 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T17:27:41.806+0000 7fd064abb800 10 monclient(hunting): picked mon.noname-b con 0x563275962960 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:27:41.972 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T17:27:41.806+0000 7fd064abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:41.972 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T17:27:41.806+0000 7fd064abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:41.972 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T17:27:41.806+0000 7fd064abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:41.972 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T17:27:41.806+0000 7fd064abb800 10 monclient(hunting): _renew_subs 2024-09-12T17:27:41.972 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T17:27:41.806+0000 7fd064abb800 10 monclient(hunting): authenticate will time out at 2473.156552s 2024-09-12T17:27:41.972 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T17:27:41.806+0000 7fd061da4640 10 monclient(hunting): get_auth_request con 0x563275964030 auth_method 0 2024-09-12T17:27:41.972 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T17:27:41.806+0000 7fd061da4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:41.972 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T17:27:41.806+0000 7fd061da4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:41.972 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T17:27:41.806+0000 7fd061da4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:41.973 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T17:27:41.806+0000 7fd0625a5640 10 monclient(hunting): get_auth_request con 0x563275963c50 auth_method 0 2024-09-12T17:27:41.973 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T17:27:41.806+0000 7fd0625a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:41.973 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T17:27:41.806+0000 7fd0625a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:41.973 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T17:27:41.806+0000 7fd0625a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:41.973 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T17:27:41.806+0000 7fd061da4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:41.973 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T17:27:41.806+0000 7fd061da4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:41.973 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T17:27:41.806+0000 7fd061da4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:41.973 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T17:27:41.806+0000 7fd0625a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:41.973 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T17:27:41.806+0000 7fd0625a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:41.973 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T17:27:41.806+0000 7fd0625a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:41.973 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T17:27:41.806+0000 7fd062da6640 10 monclient(hunting): get_auth_request con 0x563275962960 auth_method 0 2024-09-12T17:27:41.974 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T17:27:41.806+0000 7fd062da6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:41.974 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T17:27:41.806+0000 7fd062da6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:41.974 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T17:27:41.806+0000 7fd062da6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:41.974 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T17:27:41.806+0000 7fd061da4640 10 monclient(hunting): handle_auth_done global_id 7538 payload 824 2024-09-12T17:27:41.974 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T17:27:41.806+0000 7fd061da4640 10 monclient: _finish_hunting 0 2024-09-12T17:27:41.974 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T17:27:41.806+0000 7fd061da4640 1 monclient: found mon.noname-c 2024-09-12T17:27:41.974 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T17:27:41.806+0000 7fd061da4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:27:41.974 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T17:27:41.807+0000 7fcf47fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:41.974 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T17:27:41.807+0000 7fcf47fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:27:41.974 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T17:27:41.807+0000 7fcf47fff640 10 monclient: dump: 2024-09-12T17:27:41.974 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:41.974 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:41.975 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.975 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.975 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:41.975 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:41.975 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:41.975 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:41.975 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:41.975 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.975 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T17:27:41.807+0000 7fcf47fff640 10 monclient: _finish_auth 0 2024-09-12T17:27:41.976 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T17:27:41.807+0000 7fcf47fff640 10 monclient: _check_auth_tickets 2024-09-12T17:27:41.976 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T17:27:41.807+0000 7fcf47fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:27:41.976 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T17:27:41.807+0000 7fcf47fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:41.976 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T17:27:41.807+0000 7fcf47fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:27:41.976 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T17:27:41.807+0000 7fcf47fff640 10 monclient: dump: 2024-09-12T17:27:41.976 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:41.976 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:41.976 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.976 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.976 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:41.977 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:41.977 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:41.977 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:41.977 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:41.977 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.977 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T17:27:41.807+0000 7fd064abb800 5 monclient: authenticate success, global_id 7538 2024-09-12T17:27:41.977 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T17:27:41.807+0000 7fd064abb800 10 monclient: _renew_subs 2024-09-12T17:27:41.977 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T17:27:41.807+0000 7fd064abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:41.978 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T17:27:41.807+0000 7fd0635a7640 4 set_mon_vals no callback set 2024-09-12T17:27:41.978 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T17:27:41.807+0000 7fd064abb800 10 monclient: _renew_subs 2024-09-12T17:27:41.978 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T17:27:41.807+0000 7fd064abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:41.978 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T17:27:41.809+0000 7fcf47fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:27:41.978 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T17:27:41.809+0000 7fcf47fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:27:41.978 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T17:27:41.809+0000 7fcf47fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:27:41.978 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T17:27:41.809+0000 7fd0625a5640 10 monclient: get_auth_request con 0x7fcf3c076380 auth_method 0 2024-09-12T17:27:41.978 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T17:27:41.809+0000 7fd064abb800 10 monclient: get_monmap_and_config 2024-09-12T17:27:41.978 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T17:27:41.809+0000 7fd064abb800 10 monclient: build_initial_monmap 2024-09-12T17:27:41.978 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T17:27:41.809+0000 7fd064abb800 1 build_initial for_mkfs: 0 2024-09-12T17:27:41.978 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T17:27:41.809+0000 7fd064abb800 10 monclient: monmap: 2024-09-12T17:27:41.978 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:27:41.978 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:27:41.979 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:27:41.979 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:27:41.979 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:27:41.979 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:41.979 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:27:41.979 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:27:41.979 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:27:41.979 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.979 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding auth protocol: cephx 2024-09-12T17:27:41.979 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding auth protocol: cephx 2024-09-12T17:27:41.979 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding auth protocol: cephx 2024-09-12T17:27:41.979 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding con mode: secure 2024-09-12T17:27:41.979 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding con mode: crc 2024-09-12T17:27:41.979 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding con mode: secure 2024-09-12T17:27:41.980 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding con mode: crc 2024-09-12T17:27:41.980 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding con mode: secure 2024-09-12T17:27:41.980 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding con mode: crc 2024-09-12T17:27:41.980 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding con mode: crc 2024-09-12T17:27:41.980 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding con mode: secure 2024-09-12T17:27:41.980 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding con mode: crc 2024-09-12T17:27:41.980 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding con mode: secure 2024-09-12T17:27:41.980 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding con mode: crc 2024-09-12T17:27:41.980 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x563275983720) adding con mode: secure 2024-09-12T17:27:41.980 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T17:27:41.809+0000 7fd064abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:41.980 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T17:27:41.809+0000 7fd064abb800 10 monclient: init 2024-09-12T17:27:41.981 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding auth protocol: cephx 2024-09-12T17:27:41.981 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding auth protocol: cephx 2024-09-12T17:27:41.981 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding auth protocol: cephx 2024-09-12T17:27:41.981 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding con mode: secure 2024-09-12T17:27:41.981 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding con mode: crc 2024-09-12T17:27:41.981 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding con mode: secure 2024-09-12T17:27:41.981 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding con mode: crc 2024-09-12T17:27:41.981 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding con mode: secure 2024-09-12T17:27:41.981 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding con mode: crc 2024-09-12T17:27:41.981 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding con mode: crc 2024-09-12T17:27:41.981 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding con mode: secure 2024-09-12T17:27:41.981 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding con mode: crc 2024-09-12T17:27:41.981 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding con mode: secure 2024-09-12T17:27:41.982 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding con mode: crc 2024-09-12T17:27:41.982 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T17:27:41.809+0000 7fd064abb800 5 AuthRegistry(0x7fff863efce0) adding con mode: secure 2024-09-12T17:27:41.982 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T17:27:41.810+0000 7fd064abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:41.982 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T17:27:41.810+0000 7fd064abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:41.982 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T17:27:41.810+0000 7fd064abb800 5 asok(0x5632756c5730) register_command rotate-key cmddesc rotate-key hook 0x7fff863efe28 EEXIST 2024-09-12T17:27:41.982 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T17:27:41.810+0000 7fd064abb800 10 monclient: _reopen_session rank -1 2024-09-12T17:27:41.982 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T17:27:41.810+0000 7fd064abb800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:27:41.982 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T17:27:41.810+0000 7fd064abb800 10 monclient(hunting): picked mon.noname-a con 0x5632759b7d20 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:27:41.982 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T17:27:41.810+0000 7fd064abb800 10 monclient(hunting): picked mon.noname-b con 0x563275988d30 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:27:41.982 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T17:27:41.810+0000 7fd064abb800 10 monclient(hunting): picked mon.noname-c con 0x5632759b3200 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:27:41.982 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T17:27:41.810+0000 7fd064abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:41.982 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T17:27:41.810+0000 7fd064abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:41.982 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T17:27:41.810+0000 7fd064abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:41.982 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T17:27:41.810+0000 7fd064abb800 10 monclient(hunting): _renew_subs 2024-09-12T17:27:41.983 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T17:27:41.810+0000 7fd064abb800 10 monclient(hunting): authenticate will time out at 2473.160452s 2024-09-12T17:27:41.983 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T17:27:41.810+0000 7fd0625a5640 10 monclient(hunting): get_auth_request con 0x5632759b7d20 auth_method 0 2024-09-12T17:27:41.983 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T17:27:41.810+0000 7fd0625a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:41.983 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T17:27:41.810+0000 7fd0625a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:41.983 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T17:27:41.810+0000 7fd0625a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:41.983 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T17:27:41.810+0000 7fd062da6640 10 monclient(hunting): get_auth_request con 0x5632759b3200 auth_method 0 2024-09-12T17:27:41.983 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T17:27:41.810+0000 7fd062da6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:41.983 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T17:27:41.810+0000 7fd062da6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:41.983 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T17:27:41.810+0000 7fd062da6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:41.983 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T17:27:41.810+0000 7fd0625a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:41.983 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T17:27:41.810+0000 7fd0625a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:41.983 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T17:27:41.810+0000 7fd0625a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:41.983 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T17:27:41.810+0000 7fd062da6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:41.983 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T17:27:41.810+0000 7fd062da6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:41.984 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T17:27:41.810+0000 7fd062da6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:41.984 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T17:27:41.810+0000 7fd061da4640 10 monclient(hunting): get_auth_request con 0x563275988d30 auth_method 0 2024-09-12T17:27:41.984 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T17:27:41.810+0000 7fd061da4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:41.984 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T17:27:41.810+0000 7fd061da4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:41.984 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T17:27:41.810+0000 7fd061da4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:41.984 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T17:27:41.810+0000 7fd0625a5640 10 monclient(hunting): handle_auth_done global_id 8019 payload 274 2024-09-12T17:27:41.984 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T17:27:41.810+0000 7fd0625a5640 10 monclient: _finish_hunting 0 2024-09-12T17:27:41.984 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T17:27:41.810+0000 7fd0625a5640 1 monclient: found mon.noname-a 2024-09-12T17:27:41.984 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T17:27:41.810+0000 7fd0625a5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:27:41.984 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T17:27:41.811+0000 7fcf45ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:41.985 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T17:27:41.811+0000 7fcf45ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:27:41.985 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T17:27:41.811+0000 7fcf45ffb640 10 monclient: dump: 2024-09-12T17:27:41.985 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:41.985 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:41.985 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.985 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.985 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:41.985 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:41.985 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:41.985 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:41.985 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:41.985 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.985 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T17:27:41.811+0000 7fcf45ffb640 10 monclient: _finish_auth 0 2024-09-12T17:27:41.986 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T17:27:41.811+0000 7fcf45ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:27:41.986 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 monclient: authenticate success, global_id 8019 2024-09-12T17:27:41.986 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T17:27:41.811+0000 7fcf45ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:27:41.986 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T17:27:41.811+0000 7fd064abb800 10 monclient: get_monmap_and_config success 2024-09-12T17:27:41.986 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T17:27:41.811+0000 7fd064abb800 4 set_mon_vals no callback set 2024-09-12T17:27:41.986 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T17:27:41.811+0000 7fcf45ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:41.986 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T17:27:41.811+0000 7fcf45ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:27:41.986 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T17:27:41.811+0000 7fcf45ffb640 10 monclient: dump: 2024-09-12T17:27:41.986 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:41.986 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:41.986 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.986 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.986 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:41.987 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:41.987 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:41.987 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:41.987 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:41.987 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.987 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T17:27:41.811+0000 7fd064abb800 10 monclient: shutdown 2024-09-12T17:27:41.987 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T17:27:41.811+0000 7fd064abb800 10 monclient: build_initial_monmap 2024-09-12T17:27:41.987 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T17:27:41.811+0000 7fd064abb800 1 build_initial for_mkfs: 0 2024-09-12T17:27:41.987 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T17:27:41.811+0000 7fd064abb800 10 monclient: monmap: 2024-09-12T17:27:41.987 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:27:41.987 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:27:41.987 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:27:41.987 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:27:41.987 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:27:41.988 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:41.988 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:27:41.988 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:27:41.988 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:27:41.988 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.988 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding auth protocol: cephx 2024-09-12T17:27:41.988 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding auth protocol: cephx 2024-09-12T17:27:41.988 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding auth protocol: cephx 2024-09-12T17:27:41.988 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding con mode: secure 2024-09-12T17:27:41.988 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding con mode: crc 2024-09-12T17:27:41.988 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding con mode: secure 2024-09-12T17:27:41.988 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding con mode: crc 2024-09-12T17:27:41.988 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding con mode: secure 2024-09-12T17:27:41.989 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding con mode: crc 2024-09-12T17:27:41.989 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding con mode: crc 2024-09-12T17:27:41.989 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding con mode: secure 2024-09-12T17:27:41.989 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding con mode: crc 2024-09-12T17:27:41.989 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding con mode: secure 2024-09-12T17:27:41.989 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding con mode: crc 2024-09-12T17:27:41.989 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T17:27:41.811+0000 7fd064abb800 5 AuthRegistry(0x5632759a8510) adding con mode: secure 2024-09-12T17:27:41.989 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T17:27:41.812+0000 7fd064abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:41.989 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T17:27:41.812+0000 7fd064abb800 1 librados: starting msgr at 2024-09-12T17:27:41.989 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T17:27:41.812+0000 7fd064abb800 1 librados: starting objecter 2024-09-12T17:27:41.989 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 asok(0x5632756c5730) register_command objecter_requests cmddesc objecter_requests hook 0x5632759630b0 EEXIST 2024-09-12T17:27:41.989 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T17:27:41.812+0000 7fd064abb800 1 librados: setting wanted keys 2024-09-12T17:27:41.990 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T17:27:41.812+0000 7fd064abb800 1 librados: calling monclient init 2024-09-12T17:27:41.990 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T17:27:41.812+0000 7fd064abb800 10 monclient: init 2024-09-12T17:27:41.990 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding auth protocol: cephx 2024-09-12T17:27:41.990 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding auth protocol: cephx 2024-09-12T17:27:41.990 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding auth protocol: cephx 2024-09-12T17:27:41.990 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding con mode: secure 2024-09-12T17:27:41.990 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding con mode: crc 2024-09-12T17:27:41.990 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding con mode: secure 2024-09-12T17:27:41.990 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding con mode: crc 2024-09-12T17:27:41.990 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding con mode: secure 2024-09-12T17:27:41.990 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding con mode: crc 2024-09-12T17:27:41.990 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding con mode: crc 2024-09-12T17:27:41.990 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding con mode: secure 2024-09-12T17:27:41.991 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding con mode: crc 2024-09-12T17:27:41.991 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding con mode: secure 2024-09-12T17:27:41.991 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding con mode: crc 2024-09-12T17:27:41.991 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 AuthRegistry(0x563275978510) adding con mode: secure 2024-09-12T17:27:41.991 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T17:27:41.812+0000 7fd064abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:41.991 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T17:27:41.812+0000 7fd064abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:41.991 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T17:27:41.812+0000 7fd064abb800 5 asok(0x5632756c5730) register_command rotate-key cmddesc rotate-key hook 0x563275978658 EEXIST 2024-09-12T17:27:41.991 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T17:27:41.812+0000 7fd064abb800 10 monclient: _reopen_session rank -1 2024-09-12T17:27:41.991 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T17:27:41.812+0000 7fd064abb800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:27:41.991 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T17:27:41.812+0000 7fd064abb800 10 monclient(hunting): picked mon.noname-a con 0x563275988d30 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:27:41.991 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T17:27:41.812+0000 7fd064abb800 10 monclient(hunting): picked mon.noname-b con 0x5632759b3200 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:27:41.992 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T17:27:41.812+0000 7fd064abb800 10 monclient(hunting): picked mon.noname-c con 0x5632759b7d20 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:27:41.992 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T17:27:41.812+0000 7fd064abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:41.992 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T17:27:41.812+0000 7fd064abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:41.992 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T17:27:41.812+0000 7fd064abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:27:41.992 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T17:27:41.812+0000 7fd064abb800 10 monclient(hunting): _renew_subs 2024-09-12T17:27:41.992 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T17:27:41.812+0000 7fd064abb800 10 monclient(hunting): authenticate will time out at 2473.162873s 2024-09-12T17:27:41.992 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T17:27:41.812+0000 7fd0625a5640 10 monclient(hunting): get_auth_request con 0x563275988d30 auth_method 0 2024-09-12T17:27:41.992 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T17:27:41.812+0000 7fd0625a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:41.992 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T17:27:41.812+0000 7fd0625a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:41.992 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T17:27:41.812+0000 7fd0625a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:41.992 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T17:27:41.812+0000 7fd062da6640 10 monclient(hunting): get_auth_request con 0x5632759b7d20 auth_method 0 2024-09-12T17:27:41.992 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T17:27:41.812+0000 7fd062da6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:41.993 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T17:27:41.813+0000 7fd062da6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:41.993 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T17:27:41.813+0000 7fd062da6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:41.993 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T17:27:41.813+0000 7fd062da6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:41.993 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T17:27:41.813+0000 7fd062da6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:41.993 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T17:27:41.813+0000 7fd062da6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:41.993 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T17:27:41.813+0000 7fd0625a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:27:41.993 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T17:27:41.813+0000 7fd0625a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:27:41.993 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T17:27:41.813+0000 7fd0625a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:27:41.994 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T17:27:41.813+0000 7fd061da4640 10 monclient(hunting): get_auth_request con 0x5632759b3200 auth_method 0 2024-09-12T17:27:41.994 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T17:27:41.813+0000 7fd061da4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:27:41.994 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T17:27:41.813+0000 7fd061da4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:27:41.994 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T17:27:41.813+0000 7fd061da4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:27:41.994 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T17:27:41.813+0000 7fd062da6640 10 monclient(hunting): handle_auth_done global_id 7544 payload 824 2024-09-12T17:27:41.994 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T17:27:41.813+0000 7fd062da6640 10 monclient: _finish_hunting 0 2024-09-12T17:27:41.994 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T17:27:41.813+0000 7fd062da6640 1 monclient: found mon.noname-c 2024-09-12T17:27:41.994 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T17:27:41.813+0000 7fd062da6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:27:41.995 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T17:27:41.813+0000 7fcf33fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:41.995 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T17:27:41.813+0000 7fcf33fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:27:41.995 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T17:27:41.813+0000 7fcf33fff640 10 monclient: dump: 2024-09-12T17:27:41.995 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:41.995 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:41.995 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.995 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.995 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:41.995 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:41.995 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:41.995 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:41.995 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:41.995 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.995 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T17:27:41.813+0000 7fcf33fff640 10 monclient: _finish_auth 0 2024-09-12T17:27:41.996 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T17:27:41.813+0000 7fcf33fff640 10 monclient: _check_auth_tickets 2024-09-12T17:27:41.996 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T17:27:41.813+0000 7fcf33fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:27:41.996 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T17:27:41.813+0000 7fcf33fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:27:41.996 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T17:27:41.813+0000 7fcf33fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:27:41.996 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T17:27:41.813+0000 7fcf33fff640 10 monclient: dump: 2024-09-12T17:27:41.996 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:27:41.996 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:27:41.996 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.996 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:27:41.996 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:27:41.996 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:27:41.997 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:27:41.997 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:27:41.997 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:27:41.997 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:41.997 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T17:27:41.813+0000 7fd064abb800 5 monclient: authenticate success, global_id 7544 2024-09-12T17:27:41.997 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T17:27:41.813+0000 7fd064abb800 10 monclient: _renew_subs 2024-09-12T17:27:41.997 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T17:27:41.813+0000 7fcf45ffb640 4 set_mon_vals no callback set 2024-09-12T17:27:41.997 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T17:27:41.813+0000 7fd064abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:41.997 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T17:27:41.813+0000 7fd064abb800 10 monclient: _renew_subs 2024-09-12T17:27:41.997 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T17:27:41.813+0000 7fd064abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:41.997 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T17:27:41.813+0000 7fd064abb800 1 librados: init done 2024-09-12T17:27:41.997 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T17:27:41.813+0000 7fd064abb800 5 asok(0x5632756c5730) register_command cr dump hook 0x7fd05400ef08 2024-09-12T17:27:41.997 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T17:27:41.815+0000 7fcf33fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:27:41.998 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T17:27:41.815+0000 7fcf33fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:27:41.998 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T17:27:41.815+0000 7fcf33fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:27:41.998 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T17:27:41.815+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.998 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T17:27:41.815+0000 7fd0625a5640 10 monclient: get_auth_request con 0x7fcf2c0764a0 auth_method 0 2024-09-12T17:27:41.998 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T17:27:41.815+0000 7fd061da4640 10 monclient: get_auth_request con 0x5632759d2910 auth_method 0 2024-09-12T17:27:41.998 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T17:27:41.816+0000 7fd064abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:41.998 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T17:27:41.816+0000 7fd064abb800 20 realm 2024-09-12T17:27:41.998 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T17:27:41.816+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.998 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T17:27:41.816+0000 7fd064abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:41.998 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T17:27:41.816+0000 7fd064abb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:41.998 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T17:27:41.816+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.998 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T17:27:41.816+0000 7fd064abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:41.998 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T17:27:41.816+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.999 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T17:27:41.816+0000 7fd0625a5640 10 monclient: get_auth_request con 0x5632759d6bd0 auth_method 0 2024-09-12T17:27:41.999 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T17:27:41.817+0000 7fd064abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:41.999 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T17:27:41.817+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:41.999 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T17:27:41.817+0000 7fd061da4640 10 monclient: get_auth_request con 0x5632759da480 auth_method 0 2024-09-12T17:27:41.999 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T17:27:41.818+0000 7fd064abb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:41.999 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T17:27:41.818+0000 7fd064abb800 20 searching for the correct realm 2024-09-12T17:27:41.999 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T17:27:41.818+0000 7fd062da6640 10 monclient: get_auth_request con 0x5632759def30 auth_method 0 2024-09-12T17:27:41.999 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T17:27:41.819+0000 7fd0625a5640 10 monclient: get_auth_request con 0x7fd05c0900b0 auth_method 0 2024-09-12T17:27:41.999 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T17:27:41.819+0000 7fd061da4640 10 monclient: get_auth_request con 0x7fd054038070 auth_method 0 2024-09-12T17:27:41.999 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T17:27:41.821+0000 7fd061da4640 0 -- 172.21.15.67:0/373219513 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x5632759da480 msgr2=0x5632759dc870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:41.999 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T17:27:41.821+0000 7fcf33fff640 1 client.7544.objecter ms_handle_reset 0x5632759da480 session 0x5632759d5f20 osd.4 2024-09-12T17:27:41.999 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T17:27:41.821+0000 7fcf33fff640 10 monclient: _renew_subs 2024-09-12T17:27:41.999 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T17:27:41.821+0000 7fcf33fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:27:42.000 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T17:27:41.821+0000 7fd061da4640 10 monclient: get_auth_request con 0x7fcf2c086340 auth_method 0 2024-09-12T17:27:42.000 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T17:27:41.821+0000 7fd062da6640 10 monclient: get_auth_request con 0x7fd05806d040 auth_method 0 2024-09-12T17:27:42.000 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T17:27:41.823+0000 7fd0625a5640 10 monclient: get_auth_request con 0x7fd0580b5e00 auth_method 0 2024-09-12T17:27:42.000 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T17:27:41.824+0000 7fd062da6640 0 -- 172.21.15.67:0/373219513 >> [v2:172.21.15.118:6824/1070975205,v1:172.21.15.118:6825/1070975205] conn(0x7fd05806d040 msgr2=0x7fd0580b4050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:42.000 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T17:27:41.825+0000 7fcf33fff640 1 client.7544.objecter ms_handle_reset 0x7fd05806d040 session 0x7fd0580dbe90 osd.6 2024-09-12T17:27:42.000 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T17:27:41.825+0000 7fd062da6640 10 monclient: get_auth_request con 0x5632759da480 auth_method 0 2024-09-12T17:27:42.000 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T17:27:41.828+0000 7fd064abb800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:42.000 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T17:27:41.828+0000 7fd064abb800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:42.000 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T17:27:41.828+0000 7fd064abb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:42.000 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T17:27:41.828+0000 7fd064abb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:42.000 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T17:27:41.828+0000 7fd064abb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:42.001 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T17:27:41.828+0000 7fd064abb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:42.001 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T17:27:41.828+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.001 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T17:27:41.828+0000 7fd064abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:42.001 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T17:27:41.828+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.001 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T17:27:41.828+0000 7fd064abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:42.001 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T17:27:41.828+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.001 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T17:27:41.829+0000 7fd064abb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:42.001 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T17:27:41.829+0000 7fd064abb800 20 zone default found 2024-09-12T17:27:42.001 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T17:27:41.829+0000 7fd064abb800 4 Realm: () 2024-09-12T17:27:42.001 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T17:27:41.829+0000 7fd064abb800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:42.001 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T17:27:41.829+0000 7fd064abb800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:42.001 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T17:27:41.829+0000 7fd064abb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:42.001 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T17:27:41.829+0000 7fd064abb800 20 zonegroup default 2024-09-12T17:27:42.002 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T17:27:41.829+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.002 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T17:27:41.829+0000 7fd064abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:42.002 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T17:27:41.829+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.002 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T17:27:41.829+0000 7fd064abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:42.002 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T17:27:41.829+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.002 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T17:27:41.830+0000 7fd064abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:42.002 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T17:27:41.830+0000 7fd064abb800 20 started sync module instance, tier type = 2024-09-12T17:27:42.002 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T17:27:41.830+0000 7fd064abb800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:42.002 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T17:27:41.839+0000 7fd064abb800 20 add_watcher() i=0 2024-09-12T17:27:42.002 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T17:27:41.839+0000 7fd064abb800 20 add_watcher() i=1 2024-09-12T17:27:42.002 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T17:27:41.839+0000 7fd064abb800 20 add_watcher() i=2 2024-09-12T17:27:42.002 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T17:27:41.839+0000 7fd064abb800 20 add_watcher() i=3 2024-09-12T17:27:42.002 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T17:27:41.839+0000 7fd064abb800 20 add_watcher() i=4 2024-09-12T17:27:42.003 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T17:27:41.839+0000 7fd064abb800 20 add_watcher() i=5 2024-09-12T17:27:42.003 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T17:27:41.839+0000 7fd064abb800 20 add_watcher() i=6 2024-09-12T17:27:42.003 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T17:27:41.840+0000 7fd064abb800 20 add_watcher() i=7 2024-09-12T17:27:42.003 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T17:27:41.840+0000 7fd064abb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:42.003 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding auth protocol: cephx 2024-09-12T17:27:42.003 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding auth protocol: cephx 2024-09-12T17:27:42.003 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding auth protocol: cephx 2024-09-12T17:27:42.003 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding con mode: secure 2024-09-12T17:27:42.003 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding con mode: crc 2024-09-12T17:27:42.003 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding con mode: secure 2024-09-12T17:27:42.003 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding con mode: crc 2024-09-12T17:27:42.003 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding con mode: secure 2024-09-12T17:27:42.003 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding con mode: crc 2024-09-12T17:27:42.003 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding con mode: crc 2024-09-12T17:27:42.004 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding con mode: secure 2024-09-12T17:27:42.004 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding con mode: crc 2024-09-12T17:27:42.004 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding con mode: secure 2024-09-12T17:27:42.004 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding con mode: crc 2024-09-12T17:27:42.004 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T17:27:41.841+0000 7fd064abb800 5 AuthRegistry(0x7fff863f01b0) adding con mode: secure 2024-09-12T17:27:42.004 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T17:27:41.841+0000 7fcf18fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:42.004 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T17:27:41.842+0000 7fd064abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:27:42.004 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T17:27:41.842+0000 7fd064abb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:42.004 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T17:27:41.842+0000 7fd064abb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:42.004 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T17:27:41.842+0000 7fd064abb800 5 asok(0x5632756c5730) register_command cache list hook 0x5632759b71f0 2024-09-12T17:27:42.004 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T17:27:41.842+0000 7fd064abb800 5 asok(0x5632756c5730) register_command cache inspect hook 0x5632759b71f0 2024-09-12T17:27:42.004 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T17:27:41.842+0000 7fd064abb800 5 asok(0x5632756c5730) register_command cache erase hook 0x5632759b71f0 2024-09-12T17:27:42.005 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T17:27:41.842+0000 7fd064abb800 5 asok(0x5632756c5730) register_command cache zap hook 0x5632759b71f0 2024-09-12T17:27:42.005 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T17:27:41.842+0000 7fd064abb800 5 note: GC not initialized 2024-09-12T17:27:42.005 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T17:27:41.842+0000 7fce937fe640 20 reqs_thread_entry: start 2024-09-12T17:27:42.005 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T17:27:41.842+0000 7fd064abb800 5 asok(0x5632756c5730) register_command sync trace show hook 0x7fd0540109e0 2024-09-12T17:27:42.005 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T17:27:41.842+0000 7fd064abb800 5 asok(0x5632756c5730) register_command sync trace history hook 0x7fd0540109e0 2024-09-12T17:27:42.005 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T17:27:41.842+0000 7fd064abb800 5 asok(0x5632756c5730) register_command sync trace active hook 0x7fd0540109e0 2024-09-12T17:27:42.005 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T17:27:41.842+0000 7fd064abb800 5 asok(0x5632756c5730) register_command sync trace active_short hook 0x7fd0540109e0 2024-09-12T17:27:42.005 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T17:27:41.842+0000 7fd064abb800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:42.005 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T17:27:41.842+0000 7fd064abb800 20 Filter name: none 2024-09-12T17:27:42.005 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T17:27:41.842+0000 7fce917fa640 20 reqs_thread_entry: start 2024-09-12T17:27:42.005 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T17:27:41.842+0000 7fd064abb800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:27:42.005 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T17:27:41.842+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.005 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T17:27:41.843+0000 7fd064abb800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:27:42.005 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T17:27:41.843+0000 7fd064abb800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:27:42.006 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T17:27:41.843+0000 7fd064abb800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:27:42.006 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T17:27:41.843+0000 7fd064abb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 : miss 2024-09-12T17:27:42.006 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T17:27:41.843+0000 7fd064abb800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.006 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T17:27:41.843+0000 7fd064abb800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:27:42.006 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T17:27:41.843+0000 7fd064abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 info.flags=0x17 2024-09-12T17:27:42.006 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T17:27:41.843+0000 7fd064abb800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 to cache LRU end 2024-09-12T17:27:42.006 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T17:27:41.843+0000 7fd064abb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:42.006 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T17:27:41.843+0000 7fd064abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:42.006 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T17:27:41.843+0000 7fd064abb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 2024-09-12T17:27:42.006 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T17:27:41.847+0000 7fd064abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 info.flags=0x17 2024-09-12T17:27:42.006 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T17:27:41.847+0000 7fd064abb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 to cache LRU end 2024-09-12T17:27:42.006 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T17:27:41.847+0000 7fd064abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:42.006 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T17:27:41.847+0000 7fd064abb800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40, ofs0, ns] 2024-09-12T17:27:42.006 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T17:27:41.847+0000 7fcf45ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464315 cookie 94774721623824 notifier 7544 bl.length()=1015 2024-09-12T17:27:42.007 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T17:27:41.847+0000 7fcf45ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 info.flags=0x17 2024-09-12T17:27:42.007 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T17:27:41.847+0000 7fcf45ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 to cache LRU end 2024-09-12T17:27:42.007 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T17:27:41.847+0000 7fcf45ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:42.007 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T17:27:41.849+0000 7fd064abb800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.40]): orig_sources= new_sources= 2024-09-12T17:27:42.007 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T17:27:41.849+0000 7fd064abb800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.40]): potential sources added=[] removed=[] 2024-09-12T17:27:42.007 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T17:27:41.849+0000 7fd064abb800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.40]): orig_dests= new_dests= 2024-09-12T17:27:42.007 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T17:27:41.849+0000 7fd064abb800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.40]): potential dests added=[] removed=[] 2024-09-12T17:27:42.007 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T17:27:41.851+0000 7fd064abb800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.40.1.0 2024-09-12T17:27:42.007 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T17:27:41.851+0000 7fd064abb800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.40.1.0 2024-09-12T17:27:42.007 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T17:27:41.851+0000 7fd064abb800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.40.1.1 2024-09-12T17:27:42.007 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T17:27:41.851+0000 7fd064abb800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.40.1.1 2024-09-12T17:27:42.007 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T17:27:41.851+0000 7fd064abb800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.40.0 2024-09-12T17:27:42.007 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T17:27:41.854+0000 7fd064abb800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd064abb800 time 2024-09-12T17:27:41.854371+0000 2024-09-12T17:27:42.008 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:27:42.008 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:42.008 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:27:42.008 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd067f8c71a] 2024-09-12T17:27:42.008 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd067f8c8d8] 2024-09-12T17:27:42.008 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56327356e841] 2024-09-12T17:27:42.008 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x56327357d734] 2024-09-12T17:27:42.008 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56327357e5d4] 2024-09-12T17:27:42.008 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:27:42.008 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd066c29590] 2024-09-12T17:27:42.008 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:27:42.008 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:27:42.008 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:42.009 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T17:27:41.855+0000 7fd064abb800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:27:42.009 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7fd064abb800 thread_name:radosgw-admin 2024-09-12T17:27:42.009 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:42.009 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:27:42.009 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd066c3e6f0] 2024-09-12T17:27:42.009 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd066c8b99c] 2024-09-12T17:27:42.009 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:27:42.009 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:27:42.009 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd067f8c774] 2024-09-12T17:27:42.009 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd067f8c8d8] 2024-09-12T17:27:42.009 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56327356e841] 2024-09-12T17:27:42.010 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x56327357d734] 2024-09-12T17:27:42.010 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56327357e5d4] 2024-09-12T17:27:42.010 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:27:42.010 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd066c29590] 2024-09-12T17:27:42.010 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:27:42.010 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:27:42.010 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:27:42.010 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:42.010 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T17:27:42.010 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T17:27:42.010 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T17:27:42.010 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T17:27:42.011 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T17:27:42.011 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T17:27:42.011 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T17:27:42.011 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T17:27:42.011 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T17:27:42.011 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T17:27:42.011 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T17:27:42.011 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T17:27:42.011 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T17:27:42.011 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T17:27:42.012 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T17:27:42.012 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T17:27:42.012 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T17:27:42.012 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T17:27:42.012 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T17:27:42.012 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T17:27:42.012 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T17:27:42.012 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T17:27:42.012 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T17:27:42.012 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T17:27:42.013 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:27:42.013 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T17:27:42.013 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T17:27:42.013 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T17:27:42.013 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T17:27:42.013 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T17:27:42.013 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T17:27:42.013 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T17:27:42.013 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T17:27:42.013 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T17:27:42.013 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T17:27:42.013 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T17:27:42.013 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T17:27:42.014 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T17:27:42.014 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T17:27:42.014 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T17:27:42.014 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T17:27:42.014 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T17:27:42.014 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T17:27:42.014 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T17:27:42.014 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T17:27:42.014 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T17:27:42.015 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:27:42.015 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T17:27:42.015 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:27:42.015 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T17:27:42.015 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T17:27:42.015 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T17:27:42.015 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T17:27:42.015 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T17:27:42.016 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T17:27:42.016 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T17:27:42.016 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T17:27:42.016 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T17:27:42.016 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T17:27:42.016 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T17:27:42.016 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T17:27:42.016 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T17:27:42.016 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T17:27:42.016 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T17:27:42.016 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T17:27:42.016 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T17:27:42.017 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T17:27:42.017 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:27:42.017 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T17:27:42.017 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:27:42.017 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T17:27:42.017 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T17:27:42.017 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T17:27:42.017 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T17:27:42.017 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T17:27:42.017 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T17:27:42.017 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:27:42.017 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T17:27:42.017 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T17:27:42.018 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:27:42.018 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T17:27:42.018 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T17:27:42.018 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T17:27:42.018 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T17:27:42.018 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T17:27:42.018 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T17:27:42.018 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T17:27:42.018 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T17:27:42.018 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T17:27:42.018 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T17:27:42.018 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T17:27:42.018 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T17:27:42.019 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T17:27:42.019 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:27:42.019 INFO:tasks.workunit.client.0.smithi067.stderr: 7fce917fa640 / http_manager 2024-09-12T17:27:42.019 INFO:tasks.workunit.client.0.smithi067.stderr: 7fce937fe640 / http_manager 2024-09-12T17:27:42.019 INFO:tasks.workunit.client.0.smithi067.stderr: 7fcf18fe1640 / rgw_dt_lg_renew 2024-09-12T17:27:42.019 INFO:tasks.workunit.client.0.smithi067.stderr: 7fcf33fff640 / ms_dispatch 2024-09-12T17:27:42.019 INFO:tasks.workunit.client.0.smithi067.stderr: 7fcf45ffb640 / io_context_pool 2024-09-12T17:27:42.019 INFO:tasks.workunit.client.0.smithi067.stderr: 7fcf47fff640 / ms_dispatch 2024-09-12T17:27:42.019 INFO:tasks.workunit.client.0.smithi067.stderr: 7fcf4ee05640 / ms_dispatch 2024-09-12T17:27:42.019 INFO:tasks.workunit.client.0.smithi067.stderr: 7fcf50608640 / io_context_pool 2024-09-12T17:27:42.019 INFO:tasks.workunit.client.0.smithi067.stderr: 7fd061da4640 / msgr-worker-2 2024-09-12T17:27:42.019 INFO:tasks.workunit.client.0.smithi067.stderr: 7fd0625a5640 / msgr-worker-1 2024-09-12T17:27:42.019 INFO:tasks.workunit.client.0.smithi067.stderr: 7fd062da6640 / msgr-worker-0 2024-09-12T17:27:42.020 INFO:tasks.workunit.client.0.smithi067.stderr: 7fd0635a7640 / io_context_pool 2024-09-12T17:27:42.020 INFO:tasks.workunit.client.0.smithi067.stderr: 7fd064abb800 / radosgw-admin 2024-09-12T17:27:42.020 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T17:27:42.020 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T17:27:42.020 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:27:41.856046Z_39237893-c9eb-4cdb-bec3-cb5de6e2aa35/log 2024-09-12T17:27:42.020 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T17:27:42.020 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T17:27:42.022 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:42.022 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:42.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.934+0000 7fa15bb23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.936+0000 7fa15bb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:42.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.936+0000 7fa15bb23800 20 realm 2024-09-12T17:27:42.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.936+0000 7fa15bb23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.936+0000 7fa15bb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:42.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.936+0000 7fa15bb23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:42.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.936+0000 7fa15bb23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.936+0000 7fa15bb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:42.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.936+0000 7fa15bb23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.937+0000 7fa15bb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:42.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.937+0000 7fa15bb23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.938+0000 7fa15bb23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:42.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.938+0000 7fa15bb23800 20 searching for the correct realm 2024-09-12T17:27:42.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.940+0000 7fa157813640 0 -- 172.21.15.67:0/794355900 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7fa15008c350 msgr2=0x7fa15008adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:42.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:41.943+0000 7fa157813640 0 -- 172.21.15.67:0/794355900 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fa14c073910 msgr2=0x7fa14c08e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:42.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.149+0000 7fa15bb23800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:42.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.149+0000 7fa15bb23800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:42.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.149+0000 7fa15bb23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:42.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.149+0000 7fa15bb23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:42.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.149+0000 7fa15bb23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:42.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.149+0000 7fa15bb23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:42.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.149+0000 7fa15bb23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.149+0000 7fa15bb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:42.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.149+0000 7fa15bb23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.150+0000 7fa15bb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:42.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.150+0000 7fa15bb23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.150+0000 7fa15bb23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:42.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.150+0000 7fa15bb23800 20 zone default found 2024-09-12T17:27:42.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.150+0000 7fa15bb23800 4 Realm: () 2024-09-12T17:27:42.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.150+0000 7fa15bb23800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:42.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.150+0000 7fa15bb23800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:42.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.150+0000 7fa15bb23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:42.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.150+0000 7fa15bb23800 20 zonegroup default 2024-09-12T17:27:42.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.150+0000 7fa15bb23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.150+0000 7fa15bb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:42.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.150+0000 7fa15bb23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.150+0000 7fa15bb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:42.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.150+0000 7fa15bb23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.151+0000 7fa15bb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:42.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.151+0000 7fa15bb23800 20 started sync module instance, tier type = 2024-09-12T17:27:42.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.151+0000 7fa15bb23800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:42.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.160+0000 7fa15bb23800 20 add_watcher() i=0 2024-09-12T17:27:42.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.160+0000 7fa15bb23800 20 add_watcher() i=1 2024-09-12T17:27:42.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.160+0000 7fa15bb23800 20 add_watcher() i=2 2024-09-12T17:27:42.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.160+0000 7fa15bb23800 20 add_watcher() i=3 2024-09-12T17:27:42.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.160+0000 7fa15bb23800 20 add_watcher() i=4 2024-09-12T17:27:42.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.160+0000 7fa15bb23800 20 add_watcher() i=5 2024-09-12T17:27:42.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.160+0000 7fa15bb23800 20 add_watcher() i=6 2024-09-12T17:27:42.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.161+0000 7fa15bb23800 20 add_watcher() i=7 2024-09-12T17:27:42.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.161+0000 7fa15bb23800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:42.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.163+0000 7fa00dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:42.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.163+0000 7fa15bb23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:42.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.163+0000 7fa15bb23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:42.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.163+0000 7fa15bb23800 5 note: GC not initialized 2024-09-12T17:27:42.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.163+0000 7fa00cfe1640 20 reqs_thread_entry: start 2024-09-12T17:27:42.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.164+0000 7fa15bb23800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:42.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.164+0000 7fa15bb23800 20 Filter name: none 2024-09-12T17:27:42.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.164+0000 7f9f867fc640 20 reqs_thread_entry: start 2024-09-12T17:27:42.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.164+0000 7fa15bb23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.164+0000 7fa15bb23800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:27:42.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.164+0000 7fa15bb23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.165+0000 7fa15bb23800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:27:42.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.165+0000 7fa15bb23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:42.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.165+0000 7fa15bb23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.165+0000 7fa15bb23800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:27:42.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.165+0000 7fa15bb23800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.165+0000 7fa15bb23800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:27:42.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.165+0000 7fa15bb23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:27:42.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.167+0000 7fa00dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:42.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.168+0000 7fa15bb23800 20 remove_watcher() i=0 2024-09-12T17:27:42.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.168+0000 7fa15bb23800 2 removed watcher, disabling cache 2024-09-12T17:27:42.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.169+0000 7fa15bb23800 20 remove_watcher() i=1 2024-09-12T17:27:42.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.170+0000 7fa15bb23800 20 remove_watcher() i=2 2024-09-12T17:27:42.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.171+0000 7fa15bb23800 20 remove_watcher() i=3 2024-09-12T17:27:42.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.173+0000 7fa15bb23800 20 remove_watcher() i=4 2024-09-12T17:27:42.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.174+0000 7fa15bb23800 20 remove_watcher() i=5 2024-09-12T17:27:42.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.175+0000 7fa15bb23800 20 remove_watcher() i=6 2024-09-12T17:27:42.177 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.176+0000 7fa15bb23800 20 remove_watcher() i=7 2024-09-12T17:27:42.187 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:42.187 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:27:42.187 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-change-reshard-state id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:27:42.187 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:27:42.189 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:42.190 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:42.222 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:27:42.222 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:27:42.280 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:27:42.313 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:42.313 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:42.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.554+0000 7f5127211800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.555+0000 7f5127211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:42.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.555+0000 7f5127211800 20 realm 2024-09-12T17:27:42.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.555+0000 7f5127211800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.555+0000 7f5127211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:42.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.555+0000 7f5127211800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:42.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.555+0000 7f5127211800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.556+0000 7f5127211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:42.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.556+0000 7f5127211800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.556+0000 7f5127211800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:42.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.556+0000 7f5127211800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.557+0000 7f5127211800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:42.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.557+0000 7f5127211800 20 searching for the correct realm 2024-09-12T17:27:42.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.559+0000 7f5122121640 0 -- 172.21.15.67:0/431357325 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f511403d1b0 msgr2=0x7f511408f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:42.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.765+0000 7f5122922640 0 -- 172.21.15.67:0/431357325 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f5118033030 msgr2=0x7f51180549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:42.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.971+0000 7f5127211800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:27:42.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.971+0000 7f5127211800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:27:42.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.971+0000 7f5127211800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:42.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.971+0000 7f5127211800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:42.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.971+0000 7f5127211800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:42.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.971+0000 7f5127211800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:42.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.971+0000 7f5127211800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.971+0000 7f5127211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:42.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.971+0000 7f5127211800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.972+0000 7f5127211800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:42.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.972+0000 7f5127211800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.972+0000 7f5127211800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:42.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.972+0000 7f5127211800 20 zone default found 2024-09-12T17:27:42.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.972+0000 7f5127211800 4 Realm: () 2024-09-12T17:27:42.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.972+0000 7f5127211800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:27:42.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.972+0000 7f5127211800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:27:42.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.972+0000 7f5127211800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:42.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.972+0000 7f5127211800 20 zonegroup default 2024-09-12T17:27:42.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.972+0000 7f5127211800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.972+0000 7f5127211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:42.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.972+0000 7f5127211800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.973+0000 7f5127211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:42.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.973+0000 7f5127211800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.973+0000 7f5127211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:42.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.973+0000 7f5127211800 20 started sync module instance, tier type = 2024-09-12T17:27:42.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.973+0000 7f5127211800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:27:42.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.982+0000 7f5127211800 20 add_watcher() i=0 2024-09-12T17:27:42.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.982+0000 7f5127211800 20 add_watcher() i=1 2024-09-12T17:27:42.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.982+0000 7f5127211800 20 add_watcher() i=2 2024-09-12T17:27:42.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.982+0000 7f5127211800 20 add_watcher() i=3 2024-09-12T17:27:42.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.982+0000 7f5127211800 20 add_watcher() i=4 2024-09-12T17:27:42.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.982+0000 7f5127211800 20 add_watcher() i=5 2024-09-12T17:27:42.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.982+0000 7f5127211800 20 add_watcher() i=6 2024-09-12T17:27:42.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.983+0000 7f5127211800 20 add_watcher() i=7 2024-09-12T17:27:42.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.983+0000 7f5127211800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:42.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.985+0000 7f4fd97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:42.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.985+0000 7f5127211800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:42.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.985+0000 7f5127211800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:42.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.985+0000 7f5127211800 5 note: GC not initialized 2024-09-12T17:27:42.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.985+0000 7f4f53fff640 20 reqs_thread_entry: start 2024-09-12T17:27:42.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.986+0000 7f5127211800 20 init_complete bucket index max shards: 1 2024-09-12T17:27:42.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.986+0000 7f5127211800 20 Filter name: none 2024-09-12T17:27:42.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.986+0000 7f4f51ffb640 20 reqs_thread_entry: start 2024-09-12T17:27:42.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.986+0000 7f5127211800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:27:42.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.986+0000 7f5127211800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.986+0000 7f5127211800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:27:42.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.986+0000 7f5127211800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:27:42.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.986+0000 7f5127211800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:27:42.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.986+0000 7f5127211800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 : miss 2024-09-12T17:27:42.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.986+0000 7f5127211800 20 rados->read ofs=0 len=0 2024-09-12T17:27:42.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.987+0000 7f5127211800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:27:42.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.987+0000 7f5127211800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 info.flags=0x17 2024-09-12T17:27:42.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.987+0000 7f5127211800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 to cache LRU end 2024-09-12T17:27:42.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.987+0000 7f5127211800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:42.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.987+0000 7f5127211800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:27:42.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.987+0000 7f5127211800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 2024-09-12T17:27:42.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.988+0000 7f5127211800 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 to be held by another RGW process; skipping for now 2024-09-12T17:27:42.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.989+0000 7f4fd97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:42.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.991+0000 7f5127211800 20 remove_watcher() i=0 2024-09-12T17:27:42.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.991+0000 7f5127211800 2 removed watcher, disabling cache 2024-09-12T17:27:42.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.992+0000 7f5127211800 20 remove_watcher() i=1 2024-09-12T17:27:42.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.993+0000 7f5127211800 20 remove_watcher() i=2 2024-09-12T17:27:42.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.994+0000 7f5127211800 20 remove_watcher() i=3 2024-09-12T17:27:42.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.995+0000 7f5127211800 20 remove_watcher() i=4 2024-09-12T17:27:42.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.996+0000 7f5127211800 20 remove_watcher() i=5 2024-09-12T17:27:42.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.997+0000 7f5127211800 20 remove_watcher() i=6 2024-09-12T17:27:42.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:27:42.998+0000 7f5127211800 20 remove_watcher() i=7 2024-09-12T17:27:43.010 INFO:tasks.workunit.client.0.smithi067.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:28:13.020 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:28:13.056 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:13.056 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:13.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.102+0000 7f0705d23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.102+0000 7f0705d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:13.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.102+0000 7f0705d23800 20 realm 2024-09-12T17:28:13.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.102+0000 7f0705d23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.103+0000 7f0705d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:13.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.103+0000 7f0705d23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:13.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.103+0000 7f0705d23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.103+0000 7f0705d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:13.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.103+0000 7f0705d23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.104+0000 7f0705d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:13.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.104+0000 7f0705d23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.105+0000 7f0705d23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:28:13.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.105+0000 7f0705d23800 20 searching for the correct realm 2024-09-12T17:28:13.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.108+0000 7f0701212640 0 -- 172.21.15.67:0/3950249981 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x558196983670 msgr2=0x558196985a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:13.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.112+0000 7f0701a13640 0 -- 172.21.15.67:0/3950249981 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f06f8073040 msgr2=0x7f06f807e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:13.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.319+0000 7f0705d23800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:28:13.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.319+0000 7f0705d23800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:28:13.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.319+0000 7f0705d23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:13.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.319+0000 7f0705d23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:13.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.319+0000 7f0705d23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:13.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.319+0000 7f0705d23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:13.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.319+0000 7f0705d23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.320+0000 7f0705d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:13.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.320+0000 7f0705d23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.320+0000 7f0705d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:13.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.320+0000 7f0705d23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.320+0000 7f0705d23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:28:13.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.320+0000 7f0705d23800 20 zone default found 2024-09-12T17:28:13.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.320+0000 7f0705d23800 4 Realm: () 2024-09-12T17:28:13.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.320+0000 7f0705d23800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:28:13.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.320+0000 7f0705d23800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:28:13.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.320+0000 7f0705d23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:13.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.320+0000 7f0705d23800 20 zonegroup default 2024-09-12T17:28:13.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.320+0000 7f0705d23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.321+0000 7f0705d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:13.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.321+0000 7f0705d23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.321+0000 7f0705d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:13.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.321+0000 7f0705d23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.321+0000 7f0705d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:13.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.321+0000 7f0705d23800 20 started sync module instance, tier type = 2024-09-12T17:28:13.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.321+0000 7f0705d23800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:28:13.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.332+0000 7f0705d23800 20 add_watcher() i=0 2024-09-12T17:28:13.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.332+0000 7f0705d23800 20 add_watcher() i=1 2024-09-12T17:28:13.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.332+0000 7f0705d23800 20 add_watcher() i=2 2024-09-12T17:28:13.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.332+0000 7f0705d23800 20 add_watcher() i=3 2024-09-12T17:28:13.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.332+0000 7f0705d23800 20 add_watcher() i=4 2024-09-12T17:28:13.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.332+0000 7f0705d23800 20 add_watcher() i=5 2024-09-12T17:28:13.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.332+0000 7f0705d23800 20 add_watcher() i=6 2024-09-12T17:28:13.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.333+0000 7f0705d23800 20 add_watcher() i=7 2024-09-12T17:28:13.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.333+0000 7f0705d23800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:13.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.335+0000 7f05b37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:13.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.335+0000 7f0705d23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:13.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.335+0000 7f0705d23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:13.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.335+0000 7f0705d23800 5 note: GC not initialized 2024-09-12T17:28:13.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.336+0000 7f05b27fc640 20 reqs_thread_entry: start 2024-09-12T17:28:13.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.336+0000 7f0705d23800 20 init_complete bucket index max shards: 1 2024-09-12T17:28:13.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.336+0000 7f0705d23800 20 Filter name: none 2024-09-12T17:28:13.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.336+0000 7f0523fff640 20 reqs_thread_entry: start 2024-09-12T17:28:13.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.336+0000 7f0705d23800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:28:13.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.336+0000 7f0705d23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.336+0000 7f0705d23800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:28:13.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.336+0000 7f0705d23800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:28:13.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.336+0000 7f0705d23800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:28:13.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.336+0000 7f0705d23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 : miss 2024-09-12T17:28:13.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.336+0000 7f0705d23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.337+0000 7f0705d23800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:28:13.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.337+0000 7f0705d23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 info.flags=0x17 2024-09-12T17:28:13.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.337+0000 7f0705d23800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 to cache LRU end 2024-09-12T17:28:13.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.337+0000 7f0705d23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:13.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.337+0000 7f0705d23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:28:13.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.337+0000 7f0705d23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 2024-09-12T17:28:13.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.338+0000 7f0705d23800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:28:13.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.342+0000 7f0705d23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 info.flags=0x17 2024-09-12T17:28:13.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.342+0000 7f0705d23800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 to cache LRU end 2024-09-12T17:28:13.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.342+0000 7f0705d23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:28:13.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.342+0000 7f0705d23800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40, ofs0, ns] 2024-09-12T17:28:13.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.343+0000 7f05e4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464316 cookie 94015065707744 notifier 7592 bl.length()=1015 2024-09-12T17:28:13.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.343+0000 7f05e4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 info.flags=0x17 2024-09-12T17:28:13.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.343+0000 7f05e4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 to cache LRU end 2024-09-12T17:28:13.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.343+0000 7f05e4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:28:13.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.345+0000 7f0705d23800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.40]): orig_sources= new_sources= 2024-09-12T17:28:13.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.345+0000 7f0705d23800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.40]): potential sources added=[] removed=[] 2024-09-12T17:28:13.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.345+0000 7f0705d23800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.40]): orig_dests= new_dests= 2024-09-12T17:28:13.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.345+0000 7f0705d23800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.40]): potential dests added=[] removed=[] 2024-09-12T17:28:13.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.349+0000 7f0705d23800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.40.2.0 2024-09-12T17:28:13.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.349+0000 7f0705d23800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.40.2.0 2024-09-12T17:28:13.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.349+0000 7f0705d23800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.40.2.1 2024-09-12T17:28:13.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.349+0000 7f0705d23800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.40.2.1 2024-09-12T17:28:13.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.349+0000 7f0705d23800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.40.0 2024-09-12T17:28:13.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.352+0000 7f0705d23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 : hit (requested=0x17, cached=0x17) 2024-09-12T17:28:13.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.352+0000 7f0705d23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 2024-09-12T17:28:13.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.354+0000 7f0705d23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 info.flags=0x17 2024-09-12T17:28:13.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.354+0000 7f0705d23800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 to cache LRU end 2024-09-12T17:28:13.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.354+0000 7f0705d23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:28:13.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.354+0000 7f0705d23800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40, ofs0, ns] 2024-09-12T17:28:13.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.354+0000 7f05e57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464317 cookie 94015065707744 notifier 7592 bl.length()=1015 2024-09-12T17:28:13.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.354+0000 7f05e57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 info.flags=0x17 2024-09-12T17:28:13.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.354+0000 7f05e57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 to cache LRU end 2024-09-12T17:28:13.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.354+0000 7f05e57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:28:13.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.356+0000 7f0705d23800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.40]): orig_sources= new_sources= 2024-09-12T17:28:13.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.356+0000 7f0705d23800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.40]): potential sources added=[] removed=[] 2024-09-12T17:28:13.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.356+0000 7f0705d23800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.40]): orig_dests= new_dests= 2024-09-12T17:28:13.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.356+0000 7f0705d23800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.40]): potential dests added=[] removed=[] 2024-09-12T17:28:13.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.357+0000 7f0705d23800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.40.0 2024-09-12T17:28:13.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.357+0000 7f0705d23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 : hit (requested=0x17, cached=0x17) 2024-09-12T17:28:13.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.357+0000 7f0705d23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 2024-09-12T17:28:13.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.359+0000 7f0705d23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 info.flags=0x17 2024-09-12T17:28:13.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.359+0000 7f0705d23800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 to cache LRU end 2024-09-12T17:28:13.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.359+0000 7f0705d23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:28:13.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.359+0000 7f0705d23800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40, ofs0, ns] 2024-09-12T17:28:13.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.359+0000 7f05e4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464318 cookie 94015065707744 notifier 7592 bl.length()=983 2024-09-12T17:28:13.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.359+0000 7f05e4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 info.flags=0x17 2024-09-12T17:28:13.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.359+0000 7f05e4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 to cache LRU end 2024-09-12T17:28:13.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.359+0000 7f05e4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:28:13.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.361+0000 7f0705d23800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.40]): orig_sources= new_sources= 2024-09-12T17:28:13.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.361+0000 7f0705d23800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.40]): potential sources added=[] removed=[] 2024-09-12T17:28:13.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.361+0000 7f0705d23800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.40]): orig_dests= new_dests= 2024-09-12T17:28:13.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.361+0000 7f0705d23800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[06eb12d0-49d6-461d-9efe-05d212954deb.4538.40]): potential dests added=[] removed=[] 2024-09-12T17:28:13.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.362+0000 7f0705d23800 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T17:28:13.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.364+0000 7f05b37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:13.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.366+0000 7f0705d23800 20 remove_watcher() i=0 2024-09-12T17:28:13.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.366+0000 7f0705d23800 2 removed watcher, disabling cache 2024-09-12T17:28:13.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.367+0000 7f0705d23800 20 remove_watcher() i=1 2024-09-12T17:28:13.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.369+0000 7f0705d23800 20 remove_watcher() i=2 2024-09-12T17:28:13.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.370+0000 7f0705d23800 20 remove_watcher() i=3 2024-09-12T17:28:13.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.371+0000 7f0705d23800 20 remove_watcher() i=4 2024-09-12T17:28:13.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.372+0000 7f0705d23800 20 remove_watcher() i=5 2024-09-12T17:28:13.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.374+0000 7f0705d23800 20 remove_watcher() i=6 2024-09-12T17:28:13.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.375+0000 7f0705d23800 20 remove_watcher() i=7 2024-09-12T17:28:13.389 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T17:28:13.419 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:13.419 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:13.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.458+0000 7f1a5af23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.460+0000 7f1a5af23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:13.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.460+0000 7f1a5af23800 20 realm 2024-09-12T17:28:13.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.460+0000 7f1a5af23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.460+0000 7f1a5af23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:13.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.460+0000 7f1a5af23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:13.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.460+0000 7f1a5af23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.460+0000 7f1a5af23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:13.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.460+0000 7f1a5af23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.461+0000 7f1a5af23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:13.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.461+0000 7f1a5af23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.462+0000 7f1a5af23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:28:13.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.462+0000 7f1a5af23800 20 searching for the correct realm 2024-09-12T17:28:13.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.464+0000 7f1a56c13640 0 -- 172.21.15.67:0/1887596834 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f1a500897c0 msgr2=0x7f1a50088230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:13.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.468+0000 7f1a56c13640 0 -- 172.21.15.67:0/1887596834 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f1a4c0abd80 msgr2=0x7f1a4c0c5690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:13.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.473+0000 7f1a5af23800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:28:13.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.473+0000 7f1a5af23800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:28:13.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.473+0000 7f1a5af23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:13.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.473+0000 7f1a5af23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:13.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.473+0000 7f1a5af23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:13.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.473+0000 7f1a5af23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:13.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.473+0000 7f1a5af23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.473+0000 7f1a5af23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:13.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.473+0000 7f1a5af23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.473+0000 7f1a5af23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:13.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.473+0000 7f1a5af23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.474+0000 7f1a5af23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:28:13.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.474+0000 7f1a5af23800 20 zone default found 2024-09-12T17:28:13.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.474+0000 7f1a5af23800 4 Realm: () 2024-09-12T17:28:13.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.474+0000 7f1a5af23800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:28:13.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.474+0000 7f1a5af23800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:28:13.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.474+0000 7f1a5af23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:13.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.474+0000 7f1a5af23800 20 zonegroup default 2024-09-12T17:28:13.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.474+0000 7f1a5af23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.474+0000 7f1a5af23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:13.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.474+0000 7f1a5af23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.474+0000 7f1a5af23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:13.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.474+0000 7f1a5af23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.475+0000 7f1a5af23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:13.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.475+0000 7f1a5af23800 20 started sync module instance, tier type = 2024-09-12T17:28:13.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.475+0000 7f1a5af23800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:28:13.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.484+0000 7f1a5af23800 20 add_watcher() i=0 2024-09-12T17:28:13.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.484+0000 7f1a5af23800 20 add_watcher() i=1 2024-09-12T17:28:13.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.484+0000 7f1a5af23800 20 add_watcher() i=2 2024-09-12T17:28:13.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.484+0000 7f1a5af23800 20 add_watcher() i=3 2024-09-12T17:28:13.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.484+0000 7f1a5af23800 20 add_watcher() i=4 2024-09-12T17:28:13.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.484+0000 7f1a5af23800 20 add_watcher() i=5 2024-09-12T17:28:13.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.484+0000 7f1a5af23800 20 add_watcher() i=6 2024-09-12T17:28:13.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.485+0000 7f1a5af23800 20 add_watcher() i=7 2024-09-12T17:28:13.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.485+0000 7f1a5af23800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:13.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.487+0000 7f190d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:13.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.487+0000 7f1a5af23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:13.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.487+0000 7f1a5af23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:13.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.487+0000 7f1a5af23800 5 note: GC not initialized 2024-09-12T17:28:13.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.487+0000 7f1887fff640 20 reqs_thread_entry: start 2024-09-12T17:28:13.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.488+0000 7f1a5af23800 20 init_complete bucket index max shards: 1 2024-09-12T17:28:13.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.488+0000 7f1a5af23800 20 Filter name: none 2024-09-12T17:28:13.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.488+0000 7f1885ffb640 20 reqs_thread_entry: start 2024-09-12T17:28:13.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.488+0000 7f1a5af23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.488+0000 7f1a5af23800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:28:13.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.488+0000 7f1a5af23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.489+0000 7f1a5af23800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:28:13.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.489+0000 7f1a5af23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:28:13.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.489+0000 7f1a5af23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.489+0000 7f1a5af23800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:28:13.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.489+0000 7f1a5af23800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.489+0000 7f1a5af23800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:28:13.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.489+0000 7f1a5af23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:28:13.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.491+0000 7f190d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:13.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.493+0000 7f1a5af23800 20 remove_watcher() i=0 2024-09-12T17:28:13.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.493+0000 7f1a5af23800 2 removed watcher, disabling cache 2024-09-12T17:28:13.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.494+0000 7f1a5af23800 20 remove_watcher() i=1 2024-09-12T17:28:13.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.495+0000 7f1a5af23800 20 remove_watcher() i=2 2024-09-12T17:28:13.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.496+0000 7f1a5af23800 20 remove_watcher() i=3 2024-09-12T17:28:13.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.498+0000 7f1a5af23800 20 remove_watcher() i=4 2024-09-12T17:28:13.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.498+0000 7f1a5af23800 20 remove_watcher() i=5 2024-09-12T17:28:13.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.499+0000 7f1a5af23800 20 remove_watcher() i=6 2024-09-12T17:28:13.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.500+0000 7f1a5af23800 20 remove_watcher() i=7 2024-09-12T17:28:13.512 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:13.512 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:28:13.512 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-change-reshard-state id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.40 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:28:13.512 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:13.514 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:28:13.514 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:28:13.536 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:28:13.536 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:28:13.758 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:28:13.758 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:28:13.823 INFO:tasks.workunit.client.0.smithi067.stderr: test: logrecord could be stopped after reshard failed 2024-09-12T17:28:13.825 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:28:13.854 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:13.854 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:13.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.892+0000 7f6c5760f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.894+0000 7f6c5760f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:13.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.894+0000 7f6c5760f800 20 realm 2024-09-12T17:28:13.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.894+0000 7f6c5760f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.894+0000 7f6c5760f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:13.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.894+0000 7f6c5760f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:13.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.894+0000 7f6c5760f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.895+0000 7f6c5760f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:13.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.895+0000 7f6c5760f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.895+0000 7f6c5760f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:13.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.895+0000 7f6c5760f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:13.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.896+0000 7f6c5760f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:28:13.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.896+0000 7f6c5760f800 20 searching for the correct realm 2024-09-12T17:28:13.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.897+0000 7f6c55901640 0 -- 172.21.15.67:0/116267711 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x563fb2e1d0b0 msgr2=0x563fb2e1f570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:13.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:13.900+0000 7f6c55901640 0 -- 172.21.15.67:0/116267711 >> [v2:172.21.15.118:6824/1070975205,v1:172.21.15.118:6825/1070975205] conn(0x7f6c4c064040 msgr2=0x7f6c4c05fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:14.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.108+0000 7f6c5760f800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:28:14.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.108+0000 7f6c5760f800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:28:14.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.108+0000 7f6c5760f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:14.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.108+0000 7f6c5760f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:14.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.108+0000 7f6c5760f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:14.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.108+0000 7f6c5760f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:14.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.108+0000 7f6c5760f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.109+0000 7f6c5760f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.109+0000 7f6c5760f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.109+0000 7f6c5760f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:14.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.109+0000 7f6c5760f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.109+0000 7f6c5760f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:28:14.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.109+0000 7f6c5760f800 20 zone default found 2024-09-12T17:28:14.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.109+0000 7f6c5760f800 4 Realm: () 2024-09-12T17:28:14.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.109+0000 7f6c5760f800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:28:14.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.109+0000 7f6c5760f800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:28:14.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.109+0000 7f6c5760f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:14.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.109+0000 7f6c5760f800 20 zonegroup default 2024-09-12T17:28:14.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.109+0000 7f6c5760f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.109+0000 7f6c5760f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.109+0000 7f6c5760f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.110+0000 7f6c5760f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.110+0000 7f6c5760f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.110+0000 7f6c5760f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.110+0000 7f6c5760f800 20 started sync module instance, tier type = 2024-09-12T17:28:14.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.110+0000 7f6c5760f800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:28:14.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.119+0000 7f6c5760f800 20 add_watcher() i=0 2024-09-12T17:28:14.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.119+0000 7f6c5760f800 20 add_watcher() i=1 2024-09-12T17:28:14.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.119+0000 7f6c5760f800 20 add_watcher() i=2 2024-09-12T17:28:14.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.119+0000 7f6c5760f800 20 add_watcher() i=3 2024-09-12T17:28:14.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.119+0000 7f6c5760f800 20 add_watcher() i=4 2024-09-12T17:28:14.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.119+0000 7f6c5760f800 20 add_watcher() i=5 2024-09-12T17:28:14.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.119+0000 7f6c5760f800 20 add_watcher() i=6 2024-09-12T17:28:14.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.120+0000 7f6c5760f800 20 add_watcher() i=7 2024-09-12T17:28:14.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.120+0000 7f6c5760f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:14.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.122+0000 7f6b0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:14.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.122+0000 7f6c5760f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:14.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.122+0000 7f6c5760f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:14.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.122+0000 7f6c5760f800 5 note: GC not initialized 2024-09-12T17:28:14.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.122+0000 7f6b0a7e4640 20 reqs_thread_entry: start 2024-09-12T17:28:14.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.122+0000 7f6c5760f800 20 init_complete bucket index max shards: 1 2024-09-12T17:28:14.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.123+0000 7f6c5760f800 20 Filter name: none 2024-09-12T17:28:14.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.123+0000 7f6a7bfff640 20 reqs_thread_entry: start 2024-09-12T17:28:14.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.123+0000 7f6c5760f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.123+0000 7f6c5760f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:28:14.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.123+0000 7f6c5760f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.124+0000 7f6c5760f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:28:14.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.124+0000 7f6c5760f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:28:14.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.124+0000 7f6c5760f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.124+0000 7f6c5760f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:28:14.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.124+0000 7f6c5760f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.124+0000 7f6c5760f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:28:14.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.125+0000 7f6c5760f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:28:14.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.126+0000 7f6b0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:14.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.128+0000 7f6c5760f800 20 remove_watcher() i=0 2024-09-12T17:28:14.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.128+0000 7f6c5760f800 2 removed watcher, disabling cache 2024-09-12T17:28:14.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.129+0000 7f6c5760f800 20 remove_watcher() i=1 2024-09-12T17:28:14.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.130+0000 7f6c5760f800 20 remove_watcher() i=2 2024-09-12T17:28:14.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.131+0000 7f6c5760f800 20 remove_watcher() i=3 2024-09-12T17:28:14.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.132+0000 7f6c5760f800 20 remove_watcher() i=4 2024-09-12T17:28:14.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.133+0000 7f6c5760f800 20 remove_watcher() i=5 2024-09-12T17:28:14.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.134+0000 7f6c5760f800 20 remove_watcher() i=6 2024-09-12T17:28:14.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.135+0000 7f6c5760f800 20 remove_watcher() i=7 2024-09-12T17:28:14.146 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.147 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:28:14.147 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: a-bucket id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-12T17:28:14.147 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.148 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:28:14.178 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:14.178 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:14.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.215+0000 7fd6a7887800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.217+0000 7fd6a7887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.217+0000 7fd6a7887800 20 realm 2024-09-12T17:28:14.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.217+0000 7fd6a7887800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.218+0000 7fd6a7887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.218+0000 7fd6a7887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:14.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.218+0000 7fd6a7887800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.218+0000 7fd6a7887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.218+0000 7fd6a7887800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.219+0000 7fd6a7887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:14.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.219+0000 7fd6a7887800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.219+0000 7fd6a7887800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:28:14.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.219+0000 7fd6a7887800 20 searching for the correct realm 2024-09-12T17:28:14.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.222+0000 7fd6a5371640 0 -- 172.21.15.67:0/4226422919 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7fd6a000e070 msgr2=0x7fd6a00611a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:28:14.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.226+0000 7fd6a5371640 0 -- 172.21.15.67:0/4226422919 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fd69002b020 msgr2=0x7fd690088a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:14.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.432+0000 7fd6a7887800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:28:14.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.432+0000 7fd6a7887800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:28:14.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.432+0000 7fd6a7887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:14.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.432+0000 7fd6a7887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:14.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.432+0000 7fd6a7887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:14.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.432+0000 7fd6a7887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:14.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.432+0000 7fd6a7887800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.432+0000 7fd6a7887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.432+0000 7fd6a7887800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.433+0000 7fd6a7887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:14.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.433+0000 7fd6a7887800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.433+0000 7fd6a7887800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:28:14.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.433+0000 7fd6a7887800 20 zone default found 2024-09-12T17:28:14.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.433+0000 7fd6a7887800 4 Realm: () 2024-09-12T17:28:14.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.433+0000 7fd6a7887800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:28:14.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.433+0000 7fd6a7887800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:28:14.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.433+0000 7fd6a7887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:14.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.433+0000 7fd6a7887800 20 zonegroup default 2024-09-12T17:28:14.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.433+0000 7fd6a7887800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.433+0000 7fd6a7887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.433+0000 7fd6a7887800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.434+0000 7fd6a7887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.434+0000 7fd6a7887800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.434+0000 7fd6a7887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.434+0000 7fd6a7887800 20 started sync module instance, tier type = 2024-09-12T17:28:14.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.434+0000 7fd6a7887800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:28:14.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.443+0000 7fd6a7887800 20 add_watcher() i=0 2024-09-12T17:28:14.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.443+0000 7fd6a7887800 20 add_watcher() i=1 2024-09-12T17:28:14.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.443+0000 7fd6a7887800 20 add_watcher() i=2 2024-09-12T17:28:14.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.443+0000 7fd6a7887800 20 add_watcher() i=3 2024-09-12T17:28:14.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.443+0000 7fd6a7887800 20 add_watcher() i=4 2024-09-12T17:28:14.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.443+0000 7fd6a7887800 20 add_watcher() i=5 2024-09-12T17:28:14.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.443+0000 7fd6a7887800 20 add_watcher() i=6 2024-09-12T17:28:14.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.444+0000 7fd6a7887800 20 add_watcher() i=7 2024-09-12T17:28:14.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.444+0000 7fd6a7887800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:14.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.446+0000 7fd55b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:14.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.446+0000 7fd6a7887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:14.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.446+0000 7fd6a7887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:14.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.446+0000 7fd6a7887800 5 note: GC not initialized 2024-09-12T17:28:14.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.447+0000 7fd55a7e4640 20 reqs_thread_entry: start 2024-09-12T17:28:14.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.447+0000 7fd6a7887800 20 init_complete bucket index max shards: 1 2024-09-12T17:28:14.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.447+0000 7fd6a7887800 20 Filter name: none 2024-09-12T17:28:14.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.447+0000 7fd4cbfff640 20 reqs_thread_entry: start 2024-09-12T17:28:14.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.447+0000 7fd6a7887800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.447+0000 7fd6a7887800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:28:14.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.447+0000 7fd6a7887800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.448+0000 7fd6a7887800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:28:14.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.448+0000 7fd6a7887800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:28:14.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.448+0000 7fd6a7887800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.448+0000 7fd6a7887800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:28:14.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.448+0000 7fd6a7887800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.449+0000 7fd6a7887800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:28:14.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.449+0000 7fd6a7887800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:28:14.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.450+0000 7fd55b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:14.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.452+0000 7fd6a7887800 20 remove_watcher() i=0 2024-09-12T17:28:14.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.452+0000 7fd6a7887800 2 removed watcher, disabling cache 2024-09-12T17:28:14.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.453+0000 7fd6a7887800 20 remove_watcher() i=1 2024-09-12T17:28:14.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.454+0000 7fd6a7887800 20 remove_watcher() i=2 2024-09-12T17:28:14.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.456+0000 7fd6a7887800 20 remove_watcher() i=3 2024-09-12T17:28:14.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.456+0000 7fd6a7887800 20 remove_watcher() i=4 2024-09-12T17:28:14.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.457+0000 7fd6a7887800 20 remove_watcher() i=5 2024-09-12T17:28:14.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.458+0000 7fd6a7887800 20 remove_watcher() i=6 2024-09-12T17:28:14.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.459+0000 7fd6a7887800 20 remove_watcher() i=7 2024-09-12T17:28:14.473 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T17:28:14.507 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:14.507 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:14.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.546+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.547+0000 7fbba751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.547+0000 7fbba751f800 20 realm 2024-09-12T17:28:14.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.547+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.547+0000 7fbba751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.547+0000 7fbba751f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:14.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.547+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.547+0000 7fbba751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.547+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.548+0000 7fbba751f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:14.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.548+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.550 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.549+0000 7fbba751f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:28:14.550 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.549+0000 7fbba751f800 20 searching for the correct realm 2024-09-12T17:28:14.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.552+0000 7fbba3aaa640 0 -- 172.21.15.67:0/3569898042 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x55e65a8cae30 msgr2=0x55e65a8cd270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:14.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.555+0000 7fbba2aa8640 0 -- 172.21.15.67:0/3569898042 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55e65a8d28c0 msgr2=0x55e65a8d4cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:14.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.559+0000 7fbba751f800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:28:14.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.559+0000 7fbba751f800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:28:14.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.559+0000 7fbba751f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:14.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.559+0000 7fbba751f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:14.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.559+0000 7fbba751f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:14.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.559+0000 7fbba751f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:14.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.559+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.559+0000 7fbba751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.559+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.559+0000 7fbba751f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:14.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.559+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.560+0000 7fbba751f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:28:14.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.560+0000 7fbba751f800 20 zone default found 2024-09-12T17:28:14.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.560+0000 7fbba751f800 4 Realm: () 2024-09-12T17:28:14.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.560+0000 7fbba751f800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:28:14.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.560+0000 7fbba751f800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:28:14.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.560+0000 7fbba751f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:14.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.560+0000 7fbba751f800 20 zonegroup default 2024-09-12T17:28:14.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.560+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.560+0000 7fbba751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.560+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.560+0000 7fbba751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.560+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.560+0000 7fbba751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.560+0000 7fbba751f800 20 started sync module instance, tier type = 2024-09-12T17:28:14.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.560+0000 7fbba751f800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:28:14.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.572+0000 7fbba751f800 20 add_watcher() i=0 2024-09-12T17:28:14.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.572+0000 7fbba751f800 20 add_watcher() i=1 2024-09-12T17:28:14.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.572+0000 7fbba751f800 20 add_watcher() i=2 2024-09-12T17:28:14.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.572+0000 7fbba751f800 20 add_watcher() i=3 2024-09-12T17:28:14.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.572+0000 7fbba751f800 20 add_watcher() i=4 2024-09-12T17:28:14.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.572+0000 7fbba751f800 20 add_watcher() i=5 2024-09-12T17:28:14.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.572+0000 7fbba751f800 20 add_watcher() i=6 2024-09-12T17:28:14.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.573+0000 7fbba751f800 20 add_watcher() i=7 2024-09-12T17:28:14.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.573+0000 7fbba751f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:14.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.574+0000 7fba59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:14.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.574+0000 7fbba751f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:14.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.574+0000 7fbba751f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:14.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.574+0000 7fbba751f800 5 note: GC not initialized 2024-09-12T17:28:14.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.575+0000 7fba58fe1640 20 reqs_thread_entry: start 2024-09-12T17:28:14.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.575+0000 7fbba751f800 20 init_complete bucket index max shards: 1 2024-09-12T17:28:14.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.575+0000 7fbba751f800 20 Filter name: none 2024-09-12T17:28:14.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.575+0000 7fb9d27fc640 20 reqs_thread_entry: start 2024-09-12T17:28:14.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.575+0000 7fbba751f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:28:14.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.575+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.575+0000 7fbba751f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:28:14.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.575+0000 7fbba751f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:28:14.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.575+0000 7fbba751f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:28:14.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.575+0000 7fbba751f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : miss 2024-09-12T17:28:14.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.575+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.576+0000 7fbba751f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:28:14.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.576+0000 7fbba751f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:28:14.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.576+0000 7fbba751f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:28:14.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.576+0000 7fbba751f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:14.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.576+0000 7fbba751f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:28:14.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.576+0000 7fbba751f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:28:14.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.580+0000 7fbba751f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:28:14.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.580+0000 7fbba751f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:28:14.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.580+0000 7fbba751f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:28:14.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.580+0000 7fbba751f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18, ofs0, ns] 2024-09-12T17:28:14.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.580+0000 7fba867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464367 cookie 94447850009184 notifier 8157 bl.length()=911 2024-09-12T17:28:14.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.580+0000 7fba867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:28:14.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.580+0000 7fba867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:28:14.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.580+0000 7fba867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:28:14.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.582+0000 7fbba751f800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_sources= new_sources= 2024-09-12T17:28:14.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.582+0000 7fbba751f800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:28:14.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.582+0000 7fbba751f800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_dests= new_dests= 2024-09-12T17:28:14.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.582+0000 7fbba751f800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:28:14.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.585+0000 7fbba751f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.0 2024-09-12T17:28:14.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.585+0000 7fbba751f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.0 2024-09-12T17:28:14.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.585+0000 7fbba751f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.1 2024-09-12T17:28:14.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.585+0000 7fbba751f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.1 2024-09-12T17:28:14.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.585+0000 7fbba751f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.2 2024-09-12T17:28:14.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.585+0000 7fbba751f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.2 2024-09-12T17:28:14.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.585+0000 7fbba751f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.3 2024-09-12T17:28:14.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.585+0000 7fbba751f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.3 2024-09-12T17:28:14.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.585+0000 7fbba751f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 2024-09-12T17:28:14.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.585+0000 7fbba751f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 2024-09-12T17:28:14.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.585+0000 7fbba751f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.1 2024-09-12T17:28:14.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.585+0000 7fbba751f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.1 2024-09-12T17:28:14.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.585+0000 7fbba751f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.2 2024-09-12T17:28:14.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.585+0000 7fbba751f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.2 2024-09-12T17:28:14.588 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbba751f800 time 2024-09-12T17:28:14.588570+0000 2024-09-12T17:28:14.589 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:28:14.589 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:28:14.589 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbba8d8c71a] 2024-09-12T17:28:14.589 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fbba8d8c8d8] 2024-09-12T17:28:14.590 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e658354841] 2024-09-12T17:28:14.590 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55e658363734] 2024-09-12T17:28:14.590 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e6583645d4] 2024-09-12T17:28:14.590 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:28:14.590 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fbba7a29590] 2024-09-12T17:28:14.591 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:28:14.591 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:28:14.591 INFO:tasks.workunit.client.0.smithi067.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:28:14.591 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7fbba751f800 thread_name:radosgw-admin 2024-09-12T17:28:14.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.588+0000 7fbba751f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbba751f800 time 2024-09-12T17:28:14.588570+0000 2024-09-12T17:28:14.591 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:28:14.591 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.591 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:28:14.591 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbba8d8c71a] 2024-09-12T17:28:14.591 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fbba8d8c8d8] 2024-09-12T17:28:14.591 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e658354841] 2024-09-12T17:28:14.592 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55e658363734] 2024-09-12T17:28:14.592 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e6583645d4] 2024-09-12T17:28:14.592 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:28:14.592 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fbba7a29590] 2024-09-12T17:28:14.592 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:28:14.592 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:28:14.592 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.613 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:28:14.613 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbba7a3e6f0] 2024-09-12T17:28:14.613 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbba7a8b99c] 2024-09-12T17:28:14.614 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:28:14.614 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:28:14.614 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbba8d8c774] 2024-09-12T17:28:14.614 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fbba8d8c8d8] 2024-09-12T17:28:14.614 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e658354841] 2024-09-12T17:28:14.614 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55e658363734] 2024-09-12T17:28:14.614 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e6583645d4] 2024-09-12T17:28:14.614 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:28:14.614 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fbba7a29590] 2024-09-12T17:28:14.614 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:28:14.614 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:28:14.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.589+0000 7fbba751f800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:28:14.615 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7fbba751f800 thread_name:radosgw-admin 2024-09-12T17:28:14.615 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.615 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:28:14.615 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbba7a3e6f0] 2024-09-12T17:28:14.615 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbba7a8b99c] 2024-09-12T17:28:14.615 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:28:14.615 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:28:14.615 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbba8d8c774] 2024-09-12T17:28:14.615 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fbba8d8c8d8] 2024-09-12T17:28:14.615 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e658354841] 2024-09-12T17:28:14.615 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55e658363734] 2024-09-12T17:28:14.615 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e6583645d4] 2024-09-12T17:28:14.616 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:28:14.616 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fbba7a29590] 2024-09-12T17:28:14.616 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:28:14.616 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:28:14.616 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:28:14.616 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.616 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T17:28:14.616 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e74c0) adding con mode: crc 2024-09-12T17:28:14.616 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e74c0) adding con mode: secure 2024-09-12T17:28:14.616 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e74c0) adding con mode: crc 2024-09-12T17:28:14.616 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e74c0) adding con mode: secure 2024-09-12T17:28:14.616 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T17:28:14.529+0000 7fbba751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:14.616 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T17:28:14.529+0000 7fbba751f800 1 librados: starting msgr at 2024-09-12T17:28:14.617 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T17:28:14.529+0000 7fbba751f800 1 librados: starting objecter 2024-09-12T17:28:14.617 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command objecter_requests hook 0x55e65a7e4220 2024-09-12T17:28:14.617 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T17:28:14.529+0000 7fbba751f800 1 librados: setting wanted keys 2024-09-12T17:28:14.617 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T17:28:14.529+0000 7fbba751f800 1 librados: calling monclient init 2024-09-12T17:28:14.617 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T17:28:14.529+0000 7fbba751f800 10 monclient: init 2024-09-12T17:28:14.617 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding auth protocol: cephx 2024-09-12T17:28:14.617 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding auth protocol: cephx 2024-09-12T17:28:14.617 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding auth protocol: cephx 2024-09-12T17:28:14.617 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding con mode: secure 2024-09-12T17:28:14.617 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding con mode: crc 2024-09-12T17:28:14.617 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding con mode: secure 2024-09-12T17:28:14.617 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding con mode: crc 2024-09-12T17:28:14.617 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding con mode: secure 2024-09-12T17:28:14.618 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding con mode: crc 2024-09-12T17:28:14.618 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding con mode: crc 2024-09-12T17:28:14.618 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding con mode: secure 2024-09-12T17:28:14.618 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding con mode: crc 2024-09-12T17:28:14.618 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding con mode: secure 2024-09-12T17:28:14.618 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding con mode: crc 2024-09-12T17:28:14.618 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding con mode: secure 2024-09-12T17:28:14.618 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T17:28:14.529+0000 7fbba751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:14.618 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T17:28:14.529+0000 7fbba751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:14.618 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T17:28:14.530+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command rotate-key hook 0x55e65a7e1fb8 2024-09-12T17:28:14.618 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient: _reopen_session rank -1 2024-09-12T17:28:14.618 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:28:14.618 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient(hunting): picked mon.noname-c con 0x55e65a697ad0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:28:14.619 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient(hunting): picked mon.noname-a con 0x55e65a724f70 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:28:14.619 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient(hunting): picked mon.noname-b con 0x55e65a727e70 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:28:14.619 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:14.619 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:14.619 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:14.619 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient(hunting): _renew_subs 2024-09-12T17:28:14.619 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient(hunting): authenticate will time out at 2505.880104s 2024-09-12T17:28:14.619 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T17:28:14.530+0000 7fbba32a9640 10 monclient(hunting): get_auth_request con 0x55e65a697ad0 auth_method 0 2024-09-12T17:28:14.619 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T17:28:14.530+0000 7fbba32a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:14.619 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T17:28:14.530+0000 7fbba32a9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:14.619 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T17:28:14.530+0000 7fbba32a9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:14.619 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T17:28:14.530+0000 7fbba2aa8640 10 monclient(hunting): get_auth_request con 0x55e65a724f70 auth_method 0 2024-09-12T17:28:14.619 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T17:28:14.530+0000 7fbba2aa8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:14.620 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T17:28:14.530+0000 7fbba2aa8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:14.620 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T17:28:14.530+0000 7fbba2aa8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:14.620 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T17:28:14.530+0000 7fbba32a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:14.620 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T17:28:14.530+0000 7fbba32a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:14.620 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T17:28:14.530+0000 7fbba32a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:14.620 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T17:28:14.530+0000 7fbba2aa8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:14.620 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T17:28:14.530+0000 7fbba2aa8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:14.620 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T17:28:14.530+0000 7fbba2aa8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:14.620 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T17:28:14.530+0000 7fbba3aaa640 10 monclient(hunting): get_auth_request con 0x55e65a727e70 auth_method 0 2024-09-12T17:28:14.620 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T17:28:14.530+0000 7fbba3aaa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:14.620 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T17:28:14.530+0000 7fbba3aaa640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:14.620 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T17:28:14.530+0000 7fbba3aaa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:14.620 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T17:28:14.530+0000 7fbba32a9640 10 monclient(hunting): handle_auth_done global_id 7646 payload 824 2024-09-12T17:28:14.620 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T17:28:14.530+0000 7fbba32a9640 10 monclient: _finish_hunting 0 2024-09-12T17:28:14.621 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T17:28:14.530+0000 7fbba32a9640 1 monclient: found mon.noname-c 2024-09-12T17:28:14.621 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T17:28:14.530+0000 7fbba32a9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:28:14.621 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T17:28:14.530+0000 7fba8fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:14.621 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T17:28:14.530+0000 7fba8fe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:28:14.621 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T17:28:14.530+0000 7fba8fe07640 10 monclient: dump: 2024-09-12T17:28:14.621 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:14.621 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:14.621 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.621 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.621 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:14.621 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:14.621 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:14.621 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:14.622 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:14.622 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.622 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T17:28:14.530+0000 7fba8fe07640 10 monclient: _finish_auth 0 2024-09-12T17:28:14.622 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T17:28:14.530+0000 7fba8fe07640 10 monclient: _check_auth_tickets 2024-09-12T17:28:14.622 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T17:28:14.530+0000 7fbba751f800 5 monclient: authenticate success, global_id 7646 2024-09-12T17:28:14.622 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient: _renew_subs 2024-09-12T17:28:14.622 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:28:14.622 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T17:28:14.530+0000 7fba8fe07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:28:14.622 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T17:28:14.530+0000 7fba8fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:14.622 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T17:28:14.530+0000 7fba8fe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:28:14.622 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T17:28:14.530+0000 7fba8fe07640 10 monclient: dump: 2024-09-12T17:28:14.622 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:14.622 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:14.622 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.623 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.623 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:14.623 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:14.623 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:14.623 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:14.623 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:14.623 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.623 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T17:28:14.530+0000 7fba9160a640 4 set_mon_vals no callback set 2024-09-12T17:28:14.623 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient: _renew_subs 2024-09-12T17:28:14.623 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:28:14.623 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T17:28:14.530+0000 7fbba751f800 1 librados: init done 2024-09-12T17:28:14.623 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T17:28:14.532+0000 7fba8fe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:28:14.623 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T17:28:14.532+0000 7fba8fe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:28:14.624 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T17:28:14.532+0000 7fba8fe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:28:14.624 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T17:28:14.532+0000 7fbba2aa8640 10 monclient: get_auth_request con 0x7fba88076470 auth_method 0 2024-09-12T17:28:14.624 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T17:28:14.533+0000 7fbba3aaa640 10 monclient: get_auth_request con 0x55e65a809b70 auth_method 0 2024-09-12T17:28:14.624 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T17:28:14.533+0000 7fbba32a9640 10 monclient: get_auth_request con 0x55e65a82d020 auth_method 0 2024-09-12T17:28:14.624 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T17:28:14.534+0000 7fbba2aa8640 10 monclient: get_auth_request con 0x55e65a831380 auth_method 0 2024-09-12T17:28:14.624 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T17:28:14.536+0000 7fbba751f800 10 monclient: build_initial_monmap 2024-09-12T17:28:14.624 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T17:28:14.536+0000 7fbba751f800 1 build_initial for_mkfs: 0 2024-09-12T17:28:14.624 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T17:28:14.536+0000 7fbba751f800 10 monclient: monmap: 2024-09-12T17:28:14.624 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:28:14.624 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:28:14.624 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:28:14.624 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:28:14.624 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:28:14.624 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:14.625 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:28:14.625 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:28:14.625 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:28:14.625 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.625 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding auth protocol: cephx 2024-09-12T17:28:14.625 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding auth protocol: cephx 2024-09-12T17:28:14.625 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding auth protocol: cephx 2024-09-12T17:28:14.625 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding con mode: secure 2024-09-12T17:28:14.625 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding con mode: crc 2024-09-12T17:28:14.625 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding con mode: secure 2024-09-12T17:28:14.625 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding con mode: crc 2024-09-12T17:28:14.625 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding con mode: secure 2024-09-12T17:28:14.625 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding con mode: crc 2024-09-12T17:28:14.625 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding con mode: crc 2024-09-12T17:28:14.626 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding con mode: secure 2024-09-12T17:28:14.626 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding con mode: crc 2024-09-12T17:28:14.626 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding con mode: secure 2024-09-12T17:28:14.626 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding con mode: crc 2024-09-12T17:28:14.626 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding con mode: secure 2024-09-12T17:28:14.626 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T17:28:14.536+0000 7fbba751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:14.626 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command objecter_requests cmddesc objecter_requests hook 0x55e65a8392d0 EEXIST 2024-09-12T17:28:14.626 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T17:28:14.536+0000 7fbba751f800 10 monclient: init 2024-09-12T17:28:14.626 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding auth protocol: cephx 2024-09-12T17:28:14.626 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding auth protocol: cephx 2024-09-12T17:28:14.626 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding auth protocol: cephx 2024-09-12T17:28:14.626 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding con mode: secure 2024-09-12T17:28:14.626 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding con mode: crc 2024-09-12T17:28:14.626 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding con mode: secure 2024-09-12T17:28:14.627 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding con mode: crc 2024-09-12T17:28:14.627 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding con mode: secure 2024-09-12T17:28:14.627 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding con mode: crc 2024-09-12T17:28:14.627 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding con mode: crc 2024-09-12T17:28:14.627 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding con mode: secure 2024-09-12T17:28:14.627 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding con mode: crc 2024-09-12T17:28:14.627 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding con mode: secure 2024-09-12T17:28:14.627 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding con mode: crc 2024-09-12T17:28:14.627 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding con mode: secure 2024-09-12T17:28:14.627 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T17:28:14.536+0000 7fbba751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:14.627 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T17:28:14.537+0000 7fbba751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:14.627 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T17:28:14.537+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command rotate-key cmddesc rotate-key hook 0x55e65a8346f0 EEXIST 2024-09-12T17:28:14.627 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T17:28:14.537+0000 7fbba751f800 10 monclient: _reopen_session rank -1 2024-09-12T17:28:14.628 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T17:28:14.537+0000 7fbba751f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:28:14.628 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T17:28:14.537+0000 7fbba751f800 10 monclient(hunting): picked mon.noname-c con 0x55e65a85d5f0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:28:14.628 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T17:28:14.537+0000 7fbba751f800 10 monclient(hunting): picked mon.noname-b con 0x55e65a85d9d0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:28:14.628 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T17:28:14.537+0000 7fbba751f800 10 monclient(hunting): picked mon.noname-a con 0x55e65a85c300 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:28:14.628 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T17:28:14.537+0000 7fbba751f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:14.628 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T17:28:14.537+0000 7fbba751f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:14.628 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T17:28:14.537+0000 7fbba751f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:14.628 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T17:28:14.537+0000 7fbba751f800 10 monclient(hunting): _renew_subs 2024-09-12T17:28:14.628 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T17:28:14.537+0000 7fbba751f800 10 monclient(hunting): authenticate will time out at 2505.887318s 2024-09-12T17:28:14.628 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T17:28:14.537+0000 7fbba32a9640 10 monclient(hunting): get_auth_request con 0x55e65a85d5f0 auth_method 0 2024-09-12T17:28:14.628 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T17:28:14.537+0000 7fbba32a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:14.628 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T17:28:14.537+0000 7fbba32a9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:14.628 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T17:28:14.537+0000 7fbba32a9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:14.629 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T17:28:14.537+0000 7fbba3aaa640 10 monclient(hunting): get_auth_request con 0x55e65a85c300 auth_method 0 2024-09-12T17:28:14.629 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T17:28:14.537+0000 7fbba3aaa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:14.629 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T17:28:14.537+0000 7fbba3aaa640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:14.629 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T17:28:14.537+0000 7fbba3aaa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:14.629 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T17:28:14.537+0000 7fbba2aa8640 10 monclient(hunting): get_auth_request con 0x55e65a85d9d0 auth_method 0 2024-09-12T17:28:14.629 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T17:28:14.537+0000 7fbba2aa8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:14.629 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T17:28:14.537+0000 7fbba2aa8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:14.629 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T17:28:14.537+0000 7fbba2aa8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:14.629 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T17:28:14.537+0000 7fbba32a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:14.629 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T17:28:14.537+0000 7fbba32a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:14.629 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T17:28:14.537+0000 7fbba32a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:14.629 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T17:28:14.537+0000 7fbba3aaa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:14.629 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T17:28:14.537+0000 7fbba3aaa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:14.629 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T17:28:14.537+0000 7fbba3aaa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:14.630 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T17:28:14.537+0000 7fbba2aa8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:14.630 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T17:28:14.537+0000 7fbba2aa8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:14.630 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T17:28:14.537+0000 7fbba2aa8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:14.630 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T17:28:14.537+0000 7fbba32a9640 10 monclient(hunting): handle_auth_done global_id 7649 payload 824 2024-09-12T17:28:14.630 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T17:28:14.537+0000 7fbba32a9640 10 monclient: _finish_hunting 0 2024-09-12T17:28:14.630 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T17:28:14.537+0000 7fbba32a9640 1 monclient: found mon.noname-c 2024-09-12T17:28:14.630 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T17:28:14.537+0000 7fbba32a9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:28:14.630 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T17:28:14.537+0000 7fba8d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:14.630 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T17:28:14.537+0000 7fba8d602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:28:14.630 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T17:28:14.537+0000 7fba8d602640 10 monclient: dump: 2024-09-12T17:28:14.630 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:14.630 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:14.630 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.631 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.631 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:14.631 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:14.631 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:14.631 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:14.631 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:14.631 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.631 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T17:28:14.537+0000 7fba8d602640 10 monclient: _finish_auth 0 2024-09-12T17:28:14.631 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T17:28:14.537+0000 7fba8d602640 10 monclient: _check_auth_tickets 2024-09-12T17:28:14.631 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T17:28:14.537+0000 7fba8d602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:28:14.631 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T17:28:14.537+0000 7fba8d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:14.631 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T17:28:14.537+0000 7fba8d602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:28:14.631 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T17:28:14.537+0000 7fba8d602640 10 monclient: dump: 2024-09-12T17:28:14.631 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:14.632 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:14.632 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.632 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.632 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:14.632 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:14.632 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:14.632 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:14.632 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:14.632 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.632 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T17:28:14.537+0000 7fbba751f800 5 monclient: authenticate success, global_id 7649 2024-09-12T17:28:14.632 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T17:28:14.537+0000 7fbba751f800 10 monclient: _renew_subs 2024-09-12T17:28:14.632 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T17:28:14.538+0000 7fbba751f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:28:14.632 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T17:28:14.537+0000 7fbba42ab640 4 set_mon_vals no callback set 2024-09-12T17:28:14.632 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T17:28:14.538+0000 7fbba751f800 10 monclient: _renew_subs 2024-09-12T17:28:14.633 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T17:28:14.538+0000 7fbba751f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:28:14.633 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T17:28:14.540+0000 7fba8d602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:28:14.633 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T17:28:14.540+0000 7fba8d602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:28:14.633 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T17:28:14.540+0000 7fba8d602640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:28:14.633 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T17:28:14.540+0000 7fbba2aa8640 10 monclient: get_auth_request con 0x7fba7c076370 auth_method 0 2024-09-12T17:28:14.633 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T17:28:14.540+0000 7fbba751f800 10 monclient: get_monmap_and_config 2024-09-12T17:28:14.633 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T17:28:14.540+0000 7fbba751f800 10 monclient: build_initial_monmap 2024-09-12T17:28:14.633 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T17:28:14.540+0000 7fbba751f800 1 build_initial for_mkfs: 0 2024-09-12T17:28:14.633 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T17:28:14.540+0000 7fbba751f800 10 monclient: monmap: 2024-09-12T17:28:14.633 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:28:14.633 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:28:14.633 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:28:14.634 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:28:14.634 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:28:14.634 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:14.634 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:28:14.634 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:28:14.634 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:28:14.634 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.634 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding auth protocol: cephx 2024-09-12T17:28:14.634 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding auth protocol: cephx 2024-09-12T17:28:14.634 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding auth protocol: cephx 2024-09-12T17:28:14.634 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding con mode: secure 2024-09-12T17:28:14.634 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding con mode: crc 2024-09-12T17:28:14.634 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding con mode: secure 2024-09-12T17:28:14.635 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding con mode: crc 2024-09-12T17:28:14.635 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding con mode: secure 2024-09-12T17:28:14.635 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding con mode: crc 2024-09-12T17:28:14.635 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding con mode: crc 2024-09-12T17:28:14.635 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding con mode: secure 2024-09-12T17:28:14.635 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding con mode: crc 2024-09-12T17:28:14.635 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding con mode: secure 2024-09-12T17:28:14.635 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding con mode: crc 2024-09-12T17:28:14.635 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding con mode: secure 2024-09-12T17:28:14.635 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T17:28:14.540+0000 7fbba751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:14.635 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T17:28:14.540+0000 7fbba751f800 10 monclient: init 2024-09-12T17:28:14.635 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding auth protocol: cephx 2024-09-12T17:28:14.635 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding auth protocol: cephx 2024-09-12T17:28:14.635 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding auth protocol: cephx 2024-09-12T17:28:14.636 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding con mode: secure 2024-09-12T17:28:14.636 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding con mode: crc 2024-09-12T17:28:14.636 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding con mode: secure 2024-09-12T17:28:14.636 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding con mode: crc 2024-09-12T17:28:14.636 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding con mode: secure 2024-09-12T17:28:14.636 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding con mode: crc 2024-09-12T17:28:14.636 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding con mode: crc 2024-09-12T17:28:14.636 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding con mode: secure 2024-09-12T17:28:14.636 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding con mode: crc 2024-09-12T17:28:14.636 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding con mode: secure 2024-09-12T17:28:14.636 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding con mode: crc 2024-09-12T17:28:14.636 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding con mode: secure 2024-09-12T17:28:14.636 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T17:28:14.541+0000 7fbba751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:14.637 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T17:28:14.541+0000 7fbba751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:14.637 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T17:28:14.541+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command rotate-key cmddesc rotate-key hook 0x7ffe9da0b118 EEXIST 2024-09-12T17:28:14.637 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T17:28:14.541+0000 7fbba751f800 10 monclient: _reopen_session rank -1 2024-09-12T17:28:14.637 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T17:28:14.541+0000 7fbba751f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:28:14.637 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T17:28:14.541+0000 7fbba751f800 10 monclient(hunting): picked mon.noname-c con 0x55e65a8b1550 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:28:14.637 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T17:28:14.541+0000 7fbba751f800 10 monclient(hunting): picked mon.noname-b con 0x55e65a881360 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:28:14.637 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T17:28:14.541+0000 7fbba751f800 10 monclient(hunting): picked mon.noname-a con 0x55e65a8ac910 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:28:14.637 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T17:28:14.541+0000 7fbba751f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:14.637 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T17:28:14.541+0000 7fbba751f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:14.637 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T17:28:14.541+0000 7fbba751f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:14.637 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T17:28:14.541+0000 7fbba751f800 10 monclient(hunting): _renew_subs 2024-09-12T17:28:14.637 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T17:28:14.541+0000 7fbba751f800 10 monclient(hunting): authenticate will time out at 2505.891368s 2024-09-12T17:28:14.637 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T17:28:14.541+0000 7fbba32a9640 10 monclient(hunting): get_auth_request con 0x55e65a8b1550 auth_method 0 2024-09-12T17:28:14.637 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T17:28:14.541+0000 7fbba32a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:14.638 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T17:28:14.541+0000 7fbba32a9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:14.638 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T17:28:14.541+0000 7fbba32a9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:14.638 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T17:28:14.541+0000 7fbba3aaa640 10 monclient(hunting): get_auth_request con 0x55e65a8ac910 auth_method 0 2024-09-12T17:28:14.638 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T17:28:14.541+0000 7fbba3aaa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:14.638 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T17:28:14.541+0000 7fbba3aaa640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:14.638 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T17:28:14.541+0000 7fbba3aaa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:14.638 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T17:28:14.541+0000 7fbba2aa8640 10 monclient(hunting): get_auth_request con 0x55e65a881360 auth_method 0 2024-09-12T17:28:14.638 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T17:28:14.541+0000 7fbba2aa8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:14.638 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T17:28:14.541+0000 7fbba2aa8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:14.638 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T17:28:14.541+0000 7fbba2aa8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:14.638 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T17:28:14.541+0000 7fbba32a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:14.638 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T17:28:14.541+0000 7fbba32a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:14.638 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T17:28:14.541+0000 7fbba32a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:14.639 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T17:28:14.541+0000 7fbba3aaa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:14.639 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T17:28:14.541+0000 7fbba3aaa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:14.639 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T17:28:14.541+0000 7fbba3aaa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:14.639 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T17:28:14.541+0000 7fbba2aa8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:14.639 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T17:28:14.541+0000 7fbba2aa8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:14.639 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T17:28:14.541+0000 7fbba2aa8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:14.639 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T17:28:14.541+0000 7fbba32a9640 10 monclient(hunting): handle_auth_done global_id 7652 payload 274 2024-09-12T17:28:14.639 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T17:28:14.541+0000 7fbba32a9640 10 monclient: _finish_hunting 0 2024-09-12T17:28:14.639 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T17:28:14.541+0000 7fbba32a9640 1 monclient: found mon.noname-c 2024-09-12T17:28:14.639 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T17:28:14.541+0000 7fbba32a9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:28:14.639 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T17:28:14.541+0000 7fba86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:14.639 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T17:28:14.541+0000 7fba86ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:28:14.639 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T17:28:14.541+0000 7fba86ffd640 10 monclient: dump: 2024-09-12T17:28:14.639 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:14.640 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:14.640 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.640 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.640 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:14.640 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:14.640 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:14.640 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:14.640 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:14.640 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.640 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T17:28:14.541+0000 7fba86ffd640 10 monclient: _finish_auth 0 2024-09-12T17:28:14.640 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T17:28:14.541+0000 7fba86ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:28:14.640 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T17:28:14.541+0000 7fba86ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:28:14.640 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T17:28:14.541+0000 7fbba751f800 5 monclient: authenticate success, global_id 7652 2024-09-12T17:28:14.641 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T17:28:14.541+0000 7fbba751f800 10 monclient: get_monmap_and_config success 2024-09-12T17:28:14.641 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T17:28:14.541+0000 7fbba751f800 4 set_mon_vals no callback set 2024-09-12T17:28:14.641 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T17:28:14.541+0000 7fba86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:14.641 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T17:28:14.541+0000 7fba86ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:28:14.641 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T17:28:14.541+0000 7fba86ffd640 10 monclient: dump: 2024-09-12T17:28:14.641 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:14.641 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:14.641 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.641 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.641 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:14.641 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:14.641 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:14.642 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:14.642 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:14.642 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.642 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T17:28:14.542+0000 7fbba751f800 10 monclient: shutdown 2024-09-12T17:28:14.642 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T17:28:14.542+0000 7fbba751f800 10 monclient: build_initial_monmap 2024-09-12T17:28:14.642 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T17:28:14.542+0000 7fbba751f800 1 build_initial for_mkfs: 0 2024-09-12T17:28:14.642 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T17:28:14.542+0000 7fbba751f800 10 monclient: monmap: 2024-09-12T17:28:14.642 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:28:14.642 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:28:14.642 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:28:14.642 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:28:14.642 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:28:14.642 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:14.642 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:28:14.643 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:28:14.643 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:28:14.643 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.643 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding auth protocol: cephx 2024-09-12T17:28:14.643 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding auth protocol: cephx 2024-09-12T17:28:14.643 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding auth protocol: cephx 2024-09-12T17:28:14.643 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding con mode: secure 2024-09-12T17:28:14.643 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding con mode: crc 2024-09-12T17:28:14.643 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding con mode: secure 2024-09-12T17:28:14.643 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding con mode: crc 2024-09-12T17:28:14.643 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding con mode: secure 2024-09-12T17:28:14.643 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding con mode: crc 2024-09-12T17:28:14.643 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding con mode: crc 2024-09-12T17:28:14.643 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding con mode: secure 2024-09-12T17:28:14.644 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding con mode: crc 2024-09-12T17:28:14.644 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding con mode: secure 2024-09-12T17:28:14.644 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding con mode: crc 2024-09-12T17:28:14.644 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding con mode: secure 2024-09-12T17:28:14.644 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T17:28:14.543+0000 7fbba751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:14.644 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T17:28:14.543+0000 7fbba751f800 1 librados: starting msgr at 2024-09-12T17:28:14.644 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T17:28:14.543+0000 7fbba751f800 1 librados: starting objecter 2024-09-12T17:28:14.644 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command objecter_requests cmddesc objecter_requests hook 0x55e65a87fa70 EEXIST 2024-09-12T17:28:14.644 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T17:28:14.543+0000 7fbba751f800 1 librados: setting wanted keys 2024-09-12T17:28:14.644 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T17:28:14.543+0000 7fbba751f800 1 librados: calling monclient init 2024-09-12T17:28:14.644 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T17:28:14.543+0000 7fbba751f800 10 monclient: init 2024-09-12T17:28:14.644 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding auth protocol: cephx 2024-09-12T17:28:14.644 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding auth protocol: cephx 2024-09-12T17:28:14.644 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding auth protocol: cephx 2024-09-12T17:28:14.645 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding con mode: secure 2024-09-12T17:28:14.645 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding con mode: crc 2024-09-12T17:28:14.645 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding con mode: secure 2024-09-12T17:28:14.645 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding con mode: crc 2024-09-12T17:28:14.645 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding con mode: secure 2024-09-12T17:28:14.645 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding con mode: crc 2024-09-12T17:28:14.645 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding con mode: crc 2024-09-12T17:28:14.645 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding con mode: secure 2024-09-12T17:28:14.645 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding con mode: crc 2024-09-12T17:28:14.645 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding con mode: secure 2024-09-12T17:28:14.645 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding con mode: crc 2024-09-12T17:28:14.645 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding con mode: secure 2024-09-12T17:28:14.645 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T17:28:14.543+0000 7fbba751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:14.645 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T17:28:14.543+0000 7fbba751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:14.646 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command rotate-key cmddesc rotate-key hook 0x55e65a871ff8 EEXIST 2024-09-12T17:28:14.646 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T17:28:14.543+0000 7fbba751f800 10 monclient: _reopen_session rank -1 2024-09-12T17:28:14.646 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T17:28:14.543+0000 7fbba751f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:28:14.646 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T17:28:14.543+0000 7fbba751f800 10 monclient(hunting): picked mon.noname-a con 0x55e65a881360 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:28:14.646 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T17:28:14.543+0000 7fbba751f800 10 monclient(hunting): picked mon.noname-c con 0x55e65a8ac910 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:28:14.646 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T17:28:14.543+0000 7fbba751f800 10 monclient(hunting): picked mon.noname-b con 0x55e65a8b1550 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:28:14.646 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T17:28:14.543+0000 7fbba751f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:14.646 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T17:28:14.543+0000 7fbba751f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:14.646 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T17:28:14.543+0000 7fbba751f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:14.646 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T17:28:14.543+0000 7fbba751f800 10 monclient(hunting): _renew_subs 2024-09-12T17:28:14.646 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T17:28:14.543+0000 7fbba751f800 10 monclient(hunting): authenticate will time out at 2505.893967s 2024-09-12T17:28:14.646 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T17:28:14.544+0000 7fbba32a9640 10 monclient(hunting): get_auth_request con 0x55e65a881360 auth_method 0 2024-09-12T17:28:14.646 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T17:28:14.544+0000 7fbba32a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:14.646 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T17:28:14.544+0000 7fbba32a9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:14.647 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T17:28:14.544+0000 7fbba32a9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:14.647 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T17:28:14.544+0000 7fbba32a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:14.647 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T17:28:14.544+0000 7fbba32a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:14.647 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T17:28:14.544+0000 7fbba32a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:14.647 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T17:28:14.544+0000 7fbba2aa8640 10 monclient(hunting): get_auth_request con 0x55e65a8ac910 auth_method 0 2024-09-12T17:28:14.647 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T17:28:14.544+0000 7fbba2aa8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:14.647 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T17:28:14.544+0000 7fbba2aa8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:14.647 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T17:28:14.544+0000 7fbba2aa8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:14.647 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T17:28:14.544+0000 7fbba3aaa640 10 monclient(hunting): get_auth_request con 0x55e65a8b1550 auth_method 0 2024-09-12T17:28:14.647 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T17:28:14.544+0000 7fbba3aaa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:14.647 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T17:28:14.544+0000 7fbba3aaa640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:14.647 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T17:28:14.544+0000 7fbba3aaa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:14.647 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T17:28:14.544+0000 7fbba2aa8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:14.648 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T17:28:14.544+0000 7fbba2aa8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:14.648 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T17:28:14.544+0000 7fbba2aa8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:14.648 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T17:28:14.544+0000 7fbba3aaa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:14.648 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T17:28:14.544+0000 7fbba3aaa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:14.648 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T17:28:14.544+0000 7fbba3aaa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:14.648 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T17:28:14.544+0000 7fbba32a9640 10 monclient(hunting): handle_auth_done global_id 8157 payload 824 2024-09-12T17:28:14.648 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T17:28:14.544+0000 7fbba32a9640 10 monclient: _finish_hunting 0 2024-09-12T17:28:14.648 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T17:28:14.544+0000 7fbba32a9640 1 monclient: found mon.noname-a 2024-09-12T17:28:14.648 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T17:28:14.544+0000 7fbba32a9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:28:14.648 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T17:28:14.544+0000 7fba857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:14.648 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T17:28:14.544+0000 7fba857fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:28:14.648 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T17:28:14.544+0000 7fba857fa640 10 monclient: dump: 2024-09-12T17:28:14.648 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:14.649 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:14.649 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.649 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.649 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:14.649 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:14.649 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:14.649 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:14.649 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:14.649 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.649 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T17:28:14.544+0000 7fba857fa640 10 monclient: _finish_auth 0 2024-09-12T17:28:14.649 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T17:28:14.544+0000 7fba857fa640 10 monclient: _check_auth_tickets 2024-09-12T17:28:14.649 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T17:28:14.544+0000 7fba857fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:28:14.649 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T17:28:14.544+0000 7fba857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:14.649 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T17:28:14.544+0000 7fba857fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:28:14.650 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T17:28:14.544+0000 7fba857fa640 10 monclient: dump: 2024-09-12T17:28:14.650 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:14.650 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:14.650 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.650 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.650 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:14.650 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:14.650 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:14.650 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:14.650 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:14.650 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.650 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T17:28:14.544+0000 7fbba751f800 5 monclient: authenticate success, global_id 8157 2024-09-12T17:28:14.650 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T17:28:14.544+0000 7fbba751f800 10 monclient: _renew_subs 2024-09-12T17:28:14.650 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T17:28:14.544+0000 7fbba751f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:28:14.651 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T17:28:14.544+0000 7fba86ffd640 4 set_mon_vals no callback set 2024-09-12T17:28:14.651 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T17:28:14.544+0000 7fbba751f800 10 monclient: _renew_subs 2024-09-12T17:28:14.651 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T17:28:14.544+0000 7fbba751f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:28:14.651 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T17:28:14.544+0000 7fbba751f800 1 librados: init done 2024-09-12T17:28:14.651 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T17:28:14.544+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command cr dump hook 0x55e65a8a51d8 2024-09-12T17:28:14.651 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T17:28:14.546+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.651 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T17:28:14.546+0000 7fba857fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:28:14.651 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T17:28:14.546+0000 7fba857fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:28:14.651 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T17:28:14.546+0000 7fba857fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:28:14.651 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T17:28:14.546+0000 7fbba2aa8640 10 monclient: get_auth_request con 0x7fba6c0764a0 auth_method 0 2024-09-12T17:28:14.651 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T17:28:14.546+0000 7fbba3aaa640 10 monclient: get_auth_request con 0x55e65a8cae30 auth_method 0 2024-09-12T17:28:14.651 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T17:28:14.547+0000 7fbba751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.651 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T17:28:14.547+0000 7fbba751f800 20 realm 2024-09-12T17:28:14.652 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T17:28:14.547+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.652 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T17:28:14.547+0000 7fbba751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.652 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T17:28:14.547+0000 7fbba751f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:14.652 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T17:28:14.547+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.652 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T17:28:14.547+0000 7fbba751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.652 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T17:28:14.547+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.652 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T17:28:14.548+0000 7fbba32a9640 10 monclient: get_auth_request con 0x55e65a8cf1a0 auth_method 0 2024-09-12T17:28:14.652 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T17:28:14.548+0000 7fbba751f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:14.652 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T17:28:14.548+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.652 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T17:28:14.548+0000 7fbba2aa8640 10 monclient: get_auth_request con 0x55e65a8d28c0 auth_method 0 2024-09-12T17:28:14.652 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T17:28:14.549+0000 7fbba751f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:28:14.652 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T17:28:14.549+0000 7fbba751f800 20 searching for the correct realm 2024-09-12T17:28:14.652 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T17:28:14.549+0000 7fbba3aaa640 10 monclient: get_auth_request con 0x55e65a8d7680 auth_method 0 2024-09-12T17:28:14.652 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T17:28:14.550+0000 7fbba32a9640 10 monclient: get_auth_request con 0x7fbb9c015900 auth_method 0 2024-09-12T17:28:14.652 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T17:28:14.551+0000 7fbba2aa8640 10 monclient: get_auth_request con 0x7fbb94029060 auth_method 0 2024-09-12T17:28:14.653 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T17:28:14.552+0000 7fbba3aaa640 0 -- 172.21.15.67:0/3569898042 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x55e65a8cae30 msgr2=0x55e65a8cd270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:14.653 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T17:28:14.552+0000 7fba857fa640 1 client.8157.objecter ms_handle_reset 0x55e65a8cae30 session 0x55e65a8ca7b0 osd.1 2024-09-12T17:28:14.653 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T17:28:14.552+0000 7fba857fa640 10 monclient: _renew_subs 2024-09-12T17:28:14.653 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T17:28:14.552+0000 7fba857fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:28:14.653 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T17:28:14.552+0000 7fbba3aaa640 10 monclient: get_auth_request con 0x7fba6c086340 auth_method 0 2024-09-12T17:28:14.653 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T17:28:14.553+0000 7fbba3aaa640 10 monclient: get_auth_request con 0x7fbb980a5080 auth_method 0 2024-09-12T17:28:14.653 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T17:28:14.555+0000 7fbba32a9640 10 monclient: get_auth_request con 0x7fbb980996f0 auth_method 0 2024-09-12T17:28:14.653 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T17:28:14.555+0000 7fbba2aa8640 0 -- 172.21.15.67:0/3569898042 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55e65a8d28c0 msgr2=0x55e65a8d4cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:14.653 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T17:28:14.555+0000 7fba857fa640 1 client.8157.objecter ms_handle_reset 0x55e65a8d28c0 session 0x55e65a8cea40 osd.4 2024-09-12T17:28:14.653 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T17:28:14.556+0000 7fbba2aa8640 10 monclient: get_auth_request con 0x55e65a8cae30 auth_method 0 2024-09-12T17:28:14.654 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T17:28:14.559+0000 7fbba751f800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:28:14.654 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T17:28:14.559+0000 7fbba751f800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:28:14.654 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T17:28:14.559+0000 7fbba751f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:14.654 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T17:28:14.559+0000 7fbba751f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:14.654 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T17:28:14.559+0000 7fbba751f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:14.654 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T17:28:14.559+0000 7fbba751f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:14.654 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T17:28:14.559+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.654 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T17:28:14.559+0000 7fbba751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.654 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T17:28:14.559+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.654 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T17:28:14.559+0000 7fbba751f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:14.654 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T17:28:14.559+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.655 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T17:28:14.560+0000 7fbba751f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:28:14.655 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T17:28:14.560+0000 7fbba751f800 20 zone default found 2024-09-12T17:28:14.655 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T17:28:14.560+0000 7fbba751f800 4 Realm: () 2024-09-12T17:28:14.655 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T17:28:14.560+0000 7fbba751f800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:28:14.655 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T17:28:14.560+0000 7fbba751f800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:28:14.655 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T17:28:14.560+0000 7fbba751f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:14.655 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T17:28:14.560+0000 7fbba751f800 20 zonegroup default 2024-09-12T17:28:14.655 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T17:28:14.560+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.655 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T17:28:14.560+0000 7fbba751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.655 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T17:28:14.560+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.655 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T17:28:14.560+0000 7fbba751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.655 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T17:28:14.560+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.655 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T17:28:14.560+0000 7fbba751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.656 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T17:28:14.560+0000 7fbba751f800 20 started sync module instance, tier type = 2024-09-12T17:28:14.656 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T17:28:14.560+0000 7fbba751f800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:28:14.656 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T17:28:14.572+0000 7fbba751f800 20 add_watcher() i=0 2024-09-12T17:28:14.656 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T17:28:14.572+0000 7fbba751f800 20 add_watcher() i=1 2024-09-12T17:28:14.656 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T17:28:14.572+0000 7fbba751f800 20 add_watcher() i=2 2024-09-12T17:28:14.656 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T17:28:14.572+0000 7fbba751f800 20 add_watcher() i=3 2024-09-12T17:28:14.656 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T17:28:14.572+0000 7fbba751f800 20 add_watcher() i=4 2024-09-12T17:28:14.656 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T17:28:14.572+0000 7fbba751f800 20 add_watcher() i=5 2024-09-12T17:28:14.656 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T17:28:14.572+0000 7fbba751f800 20 add_watcher() i=6 2024-09-12T17:28:14.656 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T17:28:14.573+0000 7fbba751f800 20 add_watcher() i=7 2024-09-12T17:28:14.656 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T17:28:14.573+0000 7fbba751f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:14.656 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding auth protocol: cephx 2024-09-12T17:28:14.656 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding auth protocol: cephx 2024-09-12T17:28:14.656 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding auth protocol: cephx 2024-09-12T17:28:14.657 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding con mode: secure 2024-09-12T17:28:14.657 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding con mode: crc 2024-09-12T17:28:14.657 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding con mode: secure 2024-09-12T17:28:14.657 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding con mode: crc 2024-09-12T17:28:14.657 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding con mode: secure 2024-09-12T17:28:14.657 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding con mode: crc 2024-09-12T17:28:14.657 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding con mode: crc 2024-09-12T17:28:14.657 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding con mode: secure 2024-09-12T17:28:14.657 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T17:28:14.574+0000 7fba59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:14.657 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding con mode: crc 2024-09-12T17:28:14.657 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding con mode: secure 2024-09-12T17:28:14.657 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding con mode: crc 2024-09-12T17:28:14.657 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding con mode: secure 2024-09-12T17:28:14.658 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T17:28:14.574+0000 7fbba751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:14.658 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T17:28:14.574+0000 7fbba751f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:14.658 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T17:28:14.574+0000 7fbba751f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:14.658 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command cache list hook 0x55e65a8a7c50 2024-09-12T17:28:14.658 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command cache inspect hook 0x55e65a8a7c50 2024-09-12T17:28:14.658 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command cache erase hook 0x55e65a8a7c50 2024-09-12T17:28:14.658 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command cache zap hook 0x55e65a8a7c50 2024-09-12T17:28:14.658 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 note: GC not initialized 2024-09-12T17:28:14.658 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T17:28:14.575+0000 7fba58fe1640 20 reqs_thread_entry: start 2024-09-12T17:28:14.658 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T17:28:14.575+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command sync trace show hook 0x7fbb9c0050a0 2024-09-12T17:28:14.658 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T17:28:14.575+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command sync trace history hook 0x7fbb9c0050a0 2024-09-12T17:28:14.658 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T17:28:14.575+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command sync trace active hook 0x7fbb9c0050a0 2024-09-12T17:28:14.658 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T17:28:14.575+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command sync trace active_short hook 0x7fbb9c0050a0 2024-09-12T17:28:14.658 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T17:28:14.575+0000 7fbba751f800 20 init_complete bucket index max shards: 1 2024-09-12T17:28:14.659 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T17:28:14.575+0000 7fbba751f800 20 Filter name: none 2024-09-12T17:28:14.659 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T17:28:14.575+0000 7fb9d27fc640 20 reqs_thread_entry: start 2024-09-12T17:28:14.659 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T17:28:14.575+0000 7fbba751f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:28:14.659 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T17:28:14.575+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.659 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T17:28:14.575+0000 7fbba751f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:28:14.659 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T17:28:14.575+0000 7fbba751f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:28:14.659 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T17:28:14.575+0000 7fbba751f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:28:14.659 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T17:28:14.575+0000 7fbba751f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : miss 2024-09-12T17:28:14.659 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T17:28:14.575+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.659 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T17:28:14.576+0000 7fbba751f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:28:14.659 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T17:28:14.576+0000 7fbba751f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:28:14.659 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T17:28:14.576+0000 7fbba751f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:28:14.659 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T17:28:14.576+0000 7fbba751f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:14.659 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T17:28:14.576+0000 7fbba751f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:28:14.660 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T17:28:14.576+0000 7fbba751f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:28:14.660 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T17:28:14.580+0000 7fbba751f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:28:14.660 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T17:28:14.580+0000 7fbba751f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:28:14.660 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T17:28:14.580+0000 7fbba751f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:28:14.660 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T17:28:14.580+0000 7fbba751f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18, ofs0, ns] 2024-09-12T17:28:14.660 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T17:28:14.580+0000 7fba867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464367 cookie 94447850009184 notifier 8157 bl.length()=911 2024-09-12T17:28:14.660 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T17:28:14.580+0000 7fba867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:28:14.660 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T17:28:14.580+0000 7fba867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:28:14.660 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T17:28:14.580+0000 7fba867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:28:14.660 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T17:28:14.582+0000 7fbba751f800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_sources= new_sources= 2024-09-12T17:28:14.660 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T17:28:14.582+0000 7fbba751f800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:28:14.660 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T17:28:14.582+0000 7fbba751f800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_dests= new_dests= 2024-09-12T17:28:14.661 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T17:28:14.582+0000 7fbba751f800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:28:14.661 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T17:28:14.585+0000 7fbba751f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.0 2024-09-12T17:28:14.661 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T17:28:14.585+0000 7fbba751f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.0 2024-09-12T17:28:14.661 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T17:28:14.585+0000 7fbba751f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.1 2024-09-12T17:28:14.661 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T17:28:14.585+0000 7fbba751f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.1 2024-09-12T17:28:14.661 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T17:28:14.585+0000 7fbba751f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.2 2024-09-12T17:28:14.661 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T17:28:14.585+0000 7fbba751f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.2 2024-09-12T17:28:14.661 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T17:28:14.585+0000 7fbba751f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.3 2024-09-12T17:28:14.661 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T17:28:14.585+0000 7fbba751f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.3 2024-09-12T17:28:14.661 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T17:28:14.585+0000 7fbba751f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 2024-09-12T17:28:14.661 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T17:28:14.585+0000 7fbba751f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 2024-09-12T17:28:14.661 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T17:28:14.585+0000 7fbba751f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.1 2024-09-12T17:28:14.661 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T17:28:14.585+0000 7fbba751f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.1 2024-09-12T17:28:14.661 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T17:28:14.585+0000 7fbba751f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.2 2024-09-12T17:28:14.662 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T17:28:14.585+0000 7fbba751f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.2 2024-09-12T17:28:14.662 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T17:28:14.588+0000 7fbba751f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbba751f800 time 2024-09-12T17:28:14.588570+0000 2024-09-12T17:28:14.662 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:28:14.662 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.662 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:28:14.662 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbba8d8c71a] 2024-09-12T17:28:14.662 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fbba8d8c8d8] 2024-09-12T17:28:14.662 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e658354841] 2024-09-12T17:28:14.662 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55e658363734] 2024-09-12T17:28:14.662 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e6583645d4] 2024-09-12T17:28:14.662 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:28:14.662 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fbba7a29590] 2024-09-12T17:28:14.662 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:28:14.663 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:28:14.663 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.663 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T17:28:14.589+0000 7fbba751f800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:28:14.663 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7fbba751f800 thread_name:radosgw-admin 2024-09-12T17:28:14.663 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.663 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:28:14.663 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbba7a3e6f0] 2024-09-12T17:28:14.663 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbba7a8b99c] 2024-09-12T17:28:14.663 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:28:14.663 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:28:14.663 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbba8d8c774] 2024-09-12T17:28:14.663 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fbba8d8c8d8] 2024-09-12T17:28:14.663 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e658354841] 2024-09-12T17:28:14.663 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55e658363734] 2024-09-12T17:28:14.664 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e6583645d4] 2024-09-12T17:28:14.664 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:28:14.664 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fbba7a29590] 2024-09-12T17:28:14.664 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:28:14.664 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:28:14.664 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:28:14.664 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.664 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T17:28:14.664 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T17:28:14.664 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T17:28:14.664 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T17:28:14.664 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T17:28:14.664 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T17:28:14.664 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T17:28:14.665 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T17:28:14.665 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T17:28:14.665 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T17:28:14.665 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T17:28:14.665 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T17:28:14.665 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T17:28:14.665 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T17:28:14.665 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T17:28:14.665 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T17:28:14.665 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T17:28:14.665 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T17:28:14.665 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T17:28:14.665 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T17:28:14.666 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T17:28:14.666 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T17:28:14.666 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T17:28:14.666 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T17:28:14.666 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:28:14.666 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T17:28:14.666 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T17:28:14.666 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T17:28:14.666 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T17:28:14.666 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T17:28:14.666 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T17:28:14.666 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T17:28:14.666 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T17:28:14.667 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T17:28:14.667 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T17:28:14.667 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T17:28:14.667 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T17:28:14.667 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T17:28:14.667 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T17:28:14.667 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T17:28:14.667 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T17:28:14.667 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T17:28:14.667 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T17:28:14.667 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T17:28:14.667 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T17:28:14.667 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T17:28:14.667 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:28:14.668 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T17:28:14.668 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:28:14.668 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T17:28:14.668 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T17:28:14.668 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T17:28:14.668 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T17:28:14.668 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T17:28:14.668 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T17:28:14.668 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T17:28:14.668 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T17:28:14.668 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T17:28:14.668 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T17:28:14.668 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T17:28:14.668 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T17:28:14.669 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T17:28:14.669 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T17:28:14.669 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T17:28:14.669 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T17:28:14.669 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T17:28:14.669 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T17:28:14.669 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:28:14.669 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T17:28:14.669 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:28:14.669 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T17:28:14.669 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T17:28:14.669 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T17:28:14.669 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T17:28:14.669 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T17:28:14.670 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T17:28:14.670 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:28:14.670 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T17:28:14.670 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T17:28:14.670 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:28:14.670 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T17:28:14.670 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T17:28:14.670 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T17:28:14.670 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T17:28:14.670 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T17:28:14.670 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T17:28:14.670 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T17:28:14.670 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T17:28:14.670 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T17:28:14.671 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T17:28:14.671 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T17:28:14.671 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T17:28:14.671 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T17:28:14.671 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:28:14.671 INFO:tasks.workunit.client.0.smithi067.stderr: 7fb9d27fc640 / http_manager 2024-09-12T17:28:14.671 INFO:tasks.workunit.client.0.smithi067.stderr: 7fba58fe1640 / http_manager 2024-09-12T17:28:14.671 INFO:tasks.workunit.client.0.smithi067.stderr: 7fba59fe3640 / rgw_dt_lg_renew 2024-09-12T17:28:14.671 INFO:tasks.workunit.client.0.smithi067.stderr: 7fba857fa640 / ms_dispatch 2024-09-12T17:28:14.671 INFO:tasks.workunit.client.0.smithi067.stderr: 7fba867fc640 / io_context_pool 2024-09-12T17:28:14.671 INFO:tasks.workunit.client.0.smithi067.stderr: 7fba86ffd640 / io_context_pool 2024-09-12T17:28:14.671 INFO:tasks.workunit.client.0.smithi067.stderr: 7fba8d602640 / ms_dispatch 2024-09-12T17:28:14.671 INFO:tasks.workunit.client.0.smithi067.stderr: 7fba8fe07640 / ms_dispatch 2024-09-12T17:28:14.671 INFO:tasks.workunit.client.0.smithi067.stderr: 7fba9160a640 / io_context_pool 2024-09-12T17:28:14.672 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbba2aa8640 / msgr-worker-2 2024-09-12T17:28:14.672 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbba32a9640 / msgr-worker-1 2024-09-12T17:28:14.672 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbba3aaa640 / msgr-worker-0 2024-09-12T17:28:14.672 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbba42ab640 / io_context_pool 2024-09-12T17:28:14.672 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbba751f800 / radosgw-admin 2024-09-12T17:28:14.672 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T17:28:14.672 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T17:28:14.672 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/log/ceph/ceph-client.admin.148087.log 2024-09-12T17:28:14.672 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T17:28:14.673 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T17:28:14.673 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e74c0) adding con mode: crc 2024-09-12T17:28:14.673 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e74c0) adding con mode: secure 2024-09-12T17:28:14.673 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e74c0) adding con mode: crc 2024-09-12T17:28:14.673 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e74c0) adding con mode: secure 2024-09-12T17:28:14.673 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T17:28:14.529+0000 7fbba751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:14.673 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T17:28:14.529+0000 7fbba751f800 1 librados: starting msgr at 2024-09-12T17:28:14.673 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T17:28:14.529+0000 7fbba751f800 1 librados: starting objecter 2024-09-12T17:28:14.673 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command objecter_requests hook 0x55e65a7e4220 2024-09-12T17:28:14.673 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T17:28:14.529+0000 7fbba751f800 1 librados: setting wanted keys 2024-09-12T17:28:14.673 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T17:28:14.529+0000 7fbba751f800 1 librados: calling monclient init 2024-09-12T17:28:14.673 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T17:28:14.529+0000 7fbba751f800 10 monclient: init 2024-09-12T17:28:14.673 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding auth protocol: cephx 2024-09-12T17:28:14.673 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding auth protocol: cephx 2024-09-12T17:28:14.674 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding auth protocol: cephx 2024-09-12T17:28:14.674 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding con mode: secure 2024-09-12T17:28:14.674 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding con mode: crc 2024-09-12T17:28:14.674 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding con mode: secure 2024-09-12T17:28:14.674 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding con mode: crc 2024-09-12T17:28:14.674 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding con mode: secure 2024-09-12T17:28:14.674 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding con mode: crc 2024-09-12T17:28:14.674 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding con mode: crc 2024-09-12T17:28:14.674 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding con mode: secure 2024-09-12T17:28:14.674 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding con mode: crc 2024-09-12T17:28:14.674 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding con mode: secure 2024-09-12T17:28:14.674 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding con mode: crc 2024-09-12T17:28:14.674 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T17:28:14.529+0000 7fbba751f800 5 AuthRegistry(0x55e65a7e1e70) adding con mode: secure 2024-09-12T17:28:14.675 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T17:28:14.529+0000 7fbba751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:14.675 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T17:28:14.529+0000 7fbba751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:14.675 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T17:28:14.530+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command rotate-key hook 0x55e65a7e1fb8 2024-09-12T17:28:14.675 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient: _reopen_session rank -1 2024-09-12T17:28:14.675 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:28:14.675 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient(hunting): picked mon.noname-c con 0x55e65a697ad0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:28:14.675 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient(hunting): picked mon.noname-a con 0x55e65a724f70 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:28:14.675 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient(hunting): picked mon.noname-b con 0x55e65a727e70 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:28:14.675 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:14.675 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:14.675 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:14.675 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient(hunting): _renew_subs 2024-09-12T17:28:14.675 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient(hunting): authenticate will time out at 2505.880104s 2024-09-12T17:28:14.675 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T17:28:14.530+0000 7fbba32a9640 10 monclient(hunting): get_auth_request con 0x55e65a697ad0 auth_method 0 2024-09-12T17:28:14.676 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T17:28:14.530+0000 7fbba32a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:14.676 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T17:28:14.530+0000 7fbba32a9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:14.676 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T17:28:14.530+0000 7fbba32a9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:14.676 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T17:28:14.530+0000 7fbba2aa8640 10 monclient(hunting): get_auth_request con 0x55e65a724f70 auth_method 0 2024-09-12T17:28:14.676 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T17:28:14.530+0000 7fbba2aa8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:14.676 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T17:28:14.530+0000 7fbba2aa8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:14.676 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T17:28:14.530+0000 7fbba2aa8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:14.676 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T17:28:14.530+0000 7fbba32a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:14.676 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T17:28:14.530+0000 7fbba32a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:14.676 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T17:28:14.530+0000 7fbba32a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:14.677 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T17:28:14.530+0000 7fbba2aa8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:14.677 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T17:28:14.530+0000 7fbba2aa8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:14.677 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T17:28:14.530+0000 7fbba2aa8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:14.677 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T17:28:14.530+0000 7fbba3aaa640 10 monclient(hunting): get_auth_request con 0x55e65a727e70 auth_method 0 2024-09-12T17:28:14.677 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T17:28:14.530+0000 7fbba3aaa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:14.677 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T17:28:14.530+0000 7fbba3aaa640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:14.677 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T17:28:14.530+0000 7fbba3aaa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:14.677 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T17:28:14.530+0000 7fbba32a9640 10 monclient(hunting): handle_auth_done global_id 7646 payload 824 2024-09-12T17:28:14.677 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T17:28:14.530+0000 7fbba32a9640 10 monclient: _finish_hunting 0 2024-09-12T17:28:14.677 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T17:28:14.530+0000 7fbba32a9640 1 monclient: found mon.noname-c 2024-09-12T17:28:14.677 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T17:28:14.530+0000 7fbba32a9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:28:14.677 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T17:28:14.530+0000 7fba8fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:14.677 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T17:28:14.530+0000 7fba8fe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:28:14.678 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T17:28:14.530+0000 7fba8fe07640 10 monclient: dump: 2024-09-12T17:28:14.678 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:14.678 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:14.678 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.678 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.678 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:14.678 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:14.678 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:14.678 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:14.678 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:14.678 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.678 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T17:28:14.530+0000 7fba8fe07640 10 monclient: _finish_auth 0 2024-09-12T17:28:14.678 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T17:28:14.530+0000 7fba8fe07640 10 monclient: _check_auth_tickets 2024-09-12T17:28:14.678 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T17:28:14.530+0000 7fbba751f800 5 monclient: authenticate success, global_id 7646 2024-09-12T17:28:14.679 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient: _renew_subs 2024-09-12T17:28:14.679 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:28:14.679 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T17:28:14.530+0000 7fba8fe07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:28:14.679 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T17:28:14.530+0000 7fba8fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:14.679 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T17:28:14.530+0000 7fba8fe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:28:14.679 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T17:28:14.530+0000 7fba8fe07640 10 monclient: dump: 2024-09-12T17:28:14.679 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:14.679 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:14.679 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.679 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.679 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:14.679 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:14.679 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:14.679 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:14.680 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:14.680 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.680 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T17:28:14.530+0000 7fba9160a640 4 set_mon_vals no callback set 2024-09-12T17:28:14.680 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient: _renew_subs 2024-09-12T17:28:14.680 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T17:28:14.530+0000 7fbba751f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:28:14.680 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T17:28:14.530+0000 7fbba751f800 1 librados: init done 2024-09-12T17:28:14.680 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T17:28:14.532+0000 7fba8fe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:28:14.680 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T17:28:14.532+0000 7fba8fe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:28:14.680 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T17:28:14.532+0000 7fba8fe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:28:14.680 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T17:28:14.532+0000 7fbba2aa8640 10 monclient: get_auth_request con 0x7fba88076470 auth_method 0 2024-09-12T17:28:14.680 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T17:28:14.533+0000 7fbba3aaa640 10 monclient: get_auth_request con 0x55e65a809b70 auth_method 0 2024-09-12T17:28:14.680 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T17:28:14.533+0000 7fbba32a9640 10 monclient: get_auth_request con 0x55e65a82d020 auth_method 0 2024-09-12T17:28:14.680 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T17:28:14.534+0000 7fbba2aa8640 10 monclient: get_auth_request con 0x55e65a831380 auth_method 0 2024-09-12T17:28:14.681 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T17:28:14.536+0000 7fbba751f800 10 monclient: build_initial_monmap 2024-09-12T17:28:14.681 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T17:28:14.536+0000 7fbba751f800 1 build_initial for_mkfs: 0 2024-09-12T17:28:14.681 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T17:28:14.536+0000 7fbba751f800 10 monclient: monmap: 2024-09-12T17:28:14.681 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:28:14.681 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:28:14.681 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:28:14.681 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:28:14.681 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:28:14.681 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:14.681 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:28:14.682 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:28:14.682 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:28:14.682 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.682 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding auth protocol: cephx 2024-09-12T17:28:14.682 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding auth protocol: cephx 2024-09-12T17:28:14.682 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding auth protocol: cephx 2024-09-12T17:28:14.682 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding con mode: secure 2024-09-12T17:28:14.682 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding con mode: crc 2024-09-12T17:28:14.682 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding con mode: secure 2024-09-12T17:28:14.682 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding con mode: crc 2024-09-12T17:28:14.682 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding con mode: secure 2024-09-12T17:28:14.682 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding con mode: crc 2024-09-12T17:28:14.682 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding con mode: crc 2024-09-12T17:28:14.682 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding con mode: secure 2024-09-12T17:28:14.683 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding con mode: crc 2024-09-12T17:28:14.683 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding con mode: secure 2024-09-12T17:28:14.683 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding con mode: crc 2024-09-12T17:28:14.683 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a835da0) adding con mode: secure 2024-09-12T17:28:14.683 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T17:28:14.536+0000 7fbba751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:14.683 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command objecter_requests cmddesc objecter_requests hook 0x55e65a8392d0 EEXIST 2024-09-12T17:28:14.683 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T17:28:14.536+0000 7fbba751f800 10 monclient: init 2024-09-12T17:28:14.683 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding auth protocol: cephx 2024-09-12T17:28:14.683 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding auth protocol: cephx 2024-09-12T17:28:14.683 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding auth protocol: cephx 2024-09-12T17:28:14.683 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding con mode: secure 2024-09-12T17:28:14.683 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding con mode: crc 2024-09-12T17:28:14.683 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding con mode: secure 2024-09-12T17:28:14.683 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding con mode: crc 2024-09-12T17:28:14.684 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding con mode: secure 2024-09-12T17:28:14.684 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding con mode: crc 2024-09-12T17:28:14.684 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding con mode: crc 2024-09-12T17:28:14.684 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding con mode: secure 2024-09-12T17:28:14.684 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding con mode: crc 2024-09-12T17:28:14.684 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding con mode: secure 2024-09-12T17:28:14.684 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding con mode: crc 2024-09-12T17:28:14.684 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T17:28:14.536+0000 7fbba751f800 5 AuthRegistry(0x55e65a8345a8) adding con mode: secure 2024-09-12T17:28:14.684 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T17:28:14.536+0000 7fbba751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:14.684 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T17:28:14.537+0000 7fbba751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:14.685 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T17:28:14.537+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command rotate-key cmddesc rotate-key hook 0x55e65a8346f0 EEXIST 2024-09-12T17:28:14.685 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T17:28:14.537+0000 7fbba751f800 10 monclient: _reopen_session rank -1 2024-09-12T17:28:14.685 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T17:28:14.537+0000 7fbba751f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:28:14.685 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T17:28:14.537+0000 7fbba751f800 10 monclient(hunting): picked mon.noname-c con 0x55e65a85d5f0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:28:14.685 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T17:28:14.537+0000 7fbba751f800 10 monclient(hunting): picked mon.noname-b con 0x55e65a85d9d0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:28:14.685 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T17:28:14.537+0000 7fbba751f800 10 monclient(hunting): picked mon.noname-a con 0x55e65a85c300 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:28:14.685 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T17:28:14.537+0000 7fbba751f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:14.685 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T17:28:14.537+0000 7fbba751f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:14.685 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T17:28:14.537+0000 7fbba751f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:14.685 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T17:28:14.537+0000 7fbba751f800 10 monclient(hunting): _renew_subs 2024-09-12T17:28:14.685 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T17:28:14.537+0000 7fbba751f800 10 monclient(hunting): authenticate will time out at 2505.887318s 2024-09-12T17:28:14.685 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T17:28:14.537+0000 7fbba32a9640 10 monclient(hunting): get_auth_request con 0x55e65a85d5f0 auth_method 0 2024-09-12T17:28:14.685 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T17:28:14.537+0000 7fbba32a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:14.685 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T17:28:14.537+0000 7fbba32a9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:14.686 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T17:28:14.537+0000 7fbba32a9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:14.686 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T17:28:14.537+0000 7fbba3aaa640 10 monclient(hunting): get_auth_request con 0x55e65a85c300 auth_method 0 2024-09-12T17:28:14.686 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T17:28:14.537+0000 7fbba3aaa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:14.686 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T17:28:14.537+0000 7fbba3aaa640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:14.686 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T17:28:14.537+0000 7fbba3aaa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:14.686 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T17:28:14.537+0000 7fbba2aa8640 10 monclient(hunting): get_auth_request con 0x55e65a85d9d0 auth_method 0 2024-09-12T17:28:14.686 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T17:28:14.537+0000 7fbba2aa8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:14.686 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T17:28:14.537+0000 7fbba2aa8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:14.686 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T17:28:14.537+0000 7fbba2aa8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:14.686 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T17:28:14.537+0000 7fbba32a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:14.686 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T17:28:14.537+0000 7fbba32a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:14.686 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T17:28:14.537+0000 7fbba32a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:14.686 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T17:28:14.537+0000 7fbba3aaa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:14.686 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T17:28:14.537+0000 7fbba3aaa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:14.687 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T17:28:14.537+0000 7fbba3aaa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:14.687 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T17:28:14.537+0000 7fbba2aa8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:14.687 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T17:28:14.537+0000 7fbba2aa8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:14.687 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T17:28:14.537+0000 7fbba2aa8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:14.687 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T17:28:14.537+0000 7fbba32a9640 10 monclient(hunting): handle_auth_done global_id 7649 payload 824 2024-09-12T17:28:14.687 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T17:28:14.537+0000 7fbba32a9640 10 monclient: _finish_hunting 0 2024-09-12T17:28:14.687 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T17:28:14.537+0000 7fbba32a9640 1 monclient: found mon.noname-c 2024-09-12T17:28:14.687 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T17:28:14.537+0000 7fbba32a9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:28:14.687 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T17:28:14.537+0000 7fba8d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:14.687 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T17:28:14.537+0000 7fba8d602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:28:14.687 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T17:28:14.537+0000 7fba8d602640 10 monclient: dump: 2024-09-12T17:28:14.687 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:14.687 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:14.687 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.688 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.688 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:14.688 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:14.688 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:14.688 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:14.688 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:14.688 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.688 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T17:28:14.537+0000 7fba8d602640 10 monclient: _finish_auth 0 2024-09-12T17:28:14.688 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T17:28:14.537+0000 7fba8d602640 10 monclient: _check_auth_tickets 2024-09-12T17:28:14.688 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T17:28:14.537+0000 7fba8d602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:28:14.688 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T17:28:14.537+0000 7fba8d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:14.688 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T17:28:14.537+0000 7fba8d602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:28:14.688 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T17:28:14.537+0000 7fba8d602640 10 monclient: dump: 2024-09-12T17:28:14.689 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:14.689 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:14.689 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.689 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.689 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:14.689 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:14.689 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:14.689 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:14.689 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:14.689 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.689 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T17:28:14.537+0000 7fbba751f800 5 monclient: authenticate success, global_id 7649 2024-09-12T17:28:14.689 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T17:28:14.537+0000 7fbba751f800 10 monclient: _renew_subs 2024-09-12T17:28:14.689 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T17:28:14.538+0000 7fbba751f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:28:14.689 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T17:28:14.537+0000 7fbba42ab640 4 set_mon_vals no callback set 2024-09-12T17:28:14.690 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T17:28:14.538+0000 7fbba751f800 10 monclient: _renew_subs 2024-09-12T17:28:14.690 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T17:28:14.538+0000 7fbba751f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:28:14.690 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T17:28:14.540+0000 7fba8d602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:28:14.690 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T17:28:14.540+0000 7fba8d602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:28:14.690 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T17:28:14.540+0000 7fba8d602640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:28:14.690 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T17:28:14.540+0000 7fbba2aa8640 10 monclient: get_auth_request con 0x7fba7c076370 auth_method 0 2024-09-12T17:28:14.690 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T17:28:14.540+0000 7fbba751f800 10 monclient: get_monmap_and_config 2024-09-12T17:28:14.690 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T17:28:14.540+0000 7fbba751f800 10 monclient: build_initial_monmap 2024-09-12T17:28:14.690 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T17:28:14.540+0000 7fbba751f800 1 build_initial for_mkfs: 0 2024-09-12T17:28:14.690 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T17:28:14.540+0000 7fbba751f800 10 monclient: monmap: 2024-09-12T17:28:14.690 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:28:14.690 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:28:14.690 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:28:14.690 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:28:14.690 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:28:14.691 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:14.691 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:28:14.691 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:28:14.691 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:28:14.691 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.691 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding auth protocol: cephx 2024-09-12T17:28:14.691 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding auth protocol: cephx 2024-09-12T17:28:14.691 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding auth protocol: cephx 2024-09-12T17:28:14.691 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding con mode: secure 2024-09-12T17:28:14.691 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding con mode: crc 2024-09-12T17:28:14.691 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding con mode: secure 2024-09-12T17:28:14.691 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding con mode: crc 2024-09-12T17:28:14.691 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding con mode: secure 2024-09-12T17:28:14.692 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding con mode: crc 2024-09-12T17:28:14.692 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding con mode: crc 2024-09-12T17:28:14.692 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding con mode: secure 2024-09-12T17:28:14.692 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding con mode: crc 2024-09-12T17:28:14.692 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding con mode: secure 2024-09-12T17:28:14.692 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding con mode: crc 2024-09-12T17:28:14.692 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x55e65a87ced0) adding con mode: secure 2024-09-12T17:28:14.692 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T17:28:14.540+0000 7fbba751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:14.692 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T17:28:14.540+0000 7fbba751f800 10 monclient: init 2024-09-12T17:28:14.692 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding auth protocol: cephx 2024-09-12T17:28:14.692 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding auth protocol: cephx 2024-09-12T17:28:14.692 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding auth protocol: cephx 2024-09-12T17:28:14.692 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding con mode: secure 2024-09-12T17:28:14.693 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding con mode: crc 2024-09-12T17:28:14.693 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding con mode: secure 2024-09-12T17:28:14.693 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding con mode: crc 2024-09-12T17:28:14.693 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding con mode: secure 2024-09-12T17:28:14.693 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding con mode: crc 2024-09-12T17:28:14.693 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding con mode: crc 2024-09-12T17:28:14.693 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding con mode: secure 2024-09-12T17:28:14.693 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding con mode: crc 2024-09-12T17:28:14.693 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding con mode: secure 2024-09-12T17:28:14.693 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding con mode: crc 2024-09-12T17:28:14.693 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T17:28:14.540+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0afd0) adding con mode: secure 2024-09-12T17:28:14.693 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T17:28:14.541+0000 7fbba751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:14.693 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T17:28:14.541+0000 7fbba751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:14.694 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T17:28:14.541+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command rotate-key cmddesc rotate-key hook 0x7ffe9da0b118 EEXIST 2024-09-12T17:28:14.694 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T17:28:14.541+0000 7fbba751f800 10 monclient: _reopen_session rank -1 2024-09-12T17:28:14.694 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T17:28:14.541+0000 7fbba751f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:28:14.694 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T17:28:14.541+0000 7fbba751f800 10 monclient(hunting): picked mon.noname-c con 0x55e65a8b1550 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:28:14.694 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T17:28:14.541+0000 7fbba751f800 10 monclient(hunting): picked mon.noname-b con 0x55e65a881360 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:28:14.694 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T17:28:14.541+0000 7fbba751f800 10 monclient(hunting): picked mon.noname-a con 0x55e65a8ac910 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:28:14.694 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T17:28:14.541+0000 7fbba751f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:14.694 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T17:28:14.541+0000 7fbba751f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:14.694 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T17:28:14.541+0000 7fbba751f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:14.694 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T17:28:14.541+0000 7fbba751f800 10 monclient(hunting): _renew_subs 2024-09-12T17:28:14.694 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T17:28:14.541+0000 7fbba751f800 10 monclient(hunting): authenticate will time out at 2505.891368s 2024-09-12T17:28:14.694 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T17:28:14.541+0000 7fbba32a9640 10 monclient(hunting): get_auth_request con 0x55e65a8b1550 auth_method 0 2024-09-12T17:28:14.694 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T17:28:14.541+0000 7fbba32a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:14.695 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T17:28:14.541+0000 7fbba32a9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:14.695 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T17:28:14.541+0000 7fbba32a9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:14.695 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T17:28:14.541+0000 7fbba3aaa640 10 monclient(hunting): get_auth_request con 0x55e65a8ac910 auth_method 0 2024-09-12T17:28:14.695 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T17:28:14.541+0000 7fbba3aaa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:14.695 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T17:28:14.541+0000 7fbba3aaa640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:14.695 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T17:28:14.541+0000 7fbba3aaa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:14.695 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T17:28:14.541+0000 7fbba2aa8640 10 monclient(hunting): get_auth_request con 0x55e65a881360 auth_method 0 2024-09-12T17:28:14.695 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T17:28:14.541+0000 7fbba2aa8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:14.695 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T17:28:14.541+0000 7fbba2aa8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:14.695 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T17:28:14.541+0000 7fbba2aa8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:14.695 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T17:28:14.541+0000 7fbba32a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:14.695 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T17:28:14.541+0000 7fbba32a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:14.695 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T17:28:14.541+0000 7fbba32a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:14.695 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T17:28:14.541+0000 7fbba3aaa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:14.696 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T17:28:14.541+0000 7fbba3aaa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:14.696 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T17:28:14.541+0000 7fbba3aaa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:14.696 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T17:28:14.541+0000 7fbba2aa8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:14.696 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T17:28:14.541+0000 7fbba2aa8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:14.696 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T17:28:14.541+0000 7fbba2aa8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:14.696 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T17:28:14.541+0000 7fbba32a9640 10 monclient(hunting): handle_auth_done global_id 7652 payload 274 2024-09-12T17:28:14.696 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T17:28:14.541+0000 7fbba32a9640 10 monclient: _finish_hunting 0 2024-09-12T17:28:14.696 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T17:28:14.541+0000 7fbba32a9640 1 monclient: found mon.noname-c 2024-09-12T17:28:14.696 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T17:28:14.541+0000 7fbba32a9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:28:14.696 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T17:28:14.541+0000 7fba86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:14.696 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T17:28:14.541+0000 7fba86ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:28:14.696 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T17:28:14.541+0000 7fba86ffd640 10 monclient: dump: 2024-09-12T17:28:14.696 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:14.696 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:14.697 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.697 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.697 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:14.697 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:14.697 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:14.697 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:14.697 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:14.697 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.697 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T17:28:14.541+0000 7fba86ffd640 10 monclient: _finish_auth 0 2024-09-12T17:28:14.697 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T17:28:14.541+0000 7fba86ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:28:14.697 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T17:28:14.541+0000 7fba86ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:28:14.697 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T17:28:14.541+0000 7fbba751f800 5 monclient: authenticate success, global_id 7652 2024-09-12T17:28:14.697 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T17:28:14.541+0000 7fbba751f800 10 monclient: get_monmap_and_config success 2024-09-12T17:28:14.698 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T17:28:14.541+0000 7fbba751f800 4 set_mon_vals no callback set 2024-09-12T17:28:14.698 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T17:28:14.541+0000 7fba86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:14.698 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T17:28:14.541+0000 7fba86ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:28:14.698 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T17:28:14.541+0000 7fba86ffd640 10 monclient: dump: 2024-09-12T17:28:14.698 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:14.698 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:14.698 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.698 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.698 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:14.698 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:14.698 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:14.698 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:14.698 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:14.698 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.699 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T17:28:14.542+0000 7fbba751f800 10 monclient: shutdown 2024-09-12T17:28:14.699 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T17:28:14.542+0000 7fbba751f800 10 monclient: build_initial_monmap 2024-09-12T17:28:14.699 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T17:28:14.542+0000 7fbba751f800 1 build_initial for_mkfs: 0 2024-09-12T17:28:14.699 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T17:28:14.542+0000 7fbba751f800 10 monclient: monmap: 2024-09-12T17:28:14.699 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:28:14.699 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:28:14.699 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:28:14.699 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:28:14.699 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:28:14.699 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:14.699 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:28:14.699 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:28:14.699 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:28:14.699 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.700 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding auth protocol: cephx 2024-09-12T17:28:14.700 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding auth protocol: cephx 2024-09-12T17:28:14.700 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding auth protocol: cephx 2024-09-12T17:28:14.700 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding con mode: secure 2024-09-12T17:28:14.700 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding con mode: crc 2024-09-12T17:28:14.700 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding con mode: secure 2024-09-12T17:28:14.700 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding con mode: crc 2024-09-12T17:28:14.700 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding con mode: secure 2024-09-12T17:28:14.700 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding con mode: crc 2024-09-12T17:28:14.700 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding con mode: crc 2024-09-12T17:28:14.700 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding con mode: secure 2024-09-12T17:28:14.700 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding con mode: crc 2024-09-12T17:28:14.701 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding con mode: secure 2024-09-12T17:28:14.701 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding con mode: crc 2024-09-12T17:28:14.701 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T17:28:14.542+0000 7fbba751f800 5 AuthRegistry(0x55e65a8821a0) adding con mode: secure 2024-09-12T17:28:14.701 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T17:28:14.543+0000 7fbba751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:14.701 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T17:28:14.543+0000 7fbba751f800 1 librados: starting msgr at 2024-09-12T17:28:14.701 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T17:28:14.543+0000 7fbba751f800 1 librados: starting objecter 2024-09-12T17:28:14.701 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command objecter_requests cmddesc objecter_requests hook 0x55e65a87fa70 EEXIST 2024-09-12T17:28:14.701 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T17:28:14.543+0000 7fbba751f800 1 librados: setting wanted keys 2024-09-12T17:28:14.701 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T17:28:14.543+0000 7fbba751f800 1 librados: calling monclient init 2024-09-12T17:28:14.701 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T17:28:14.543+0000 7fbba751f800 10 monclient: init 2024-09-12T17:28:14.701 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding auth protocol: cephx 2024-09-12T17:28:14.701 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding auth protocol: cephx 2024-09-12T17:28:14.701 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding auth protocol: cephx 2024-09-12T17:28:14.701 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding con mode: secure 2024-09-12T17:28:14.702 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding con mode: crc 2024-09-12T17:28:14.702 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding con mode: secure 2024-09-12T17:28:14.702 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding con mode: crc 2024-09-12T17:28:14.702 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding con mode: secure 2024-09-12T17:28:14.702 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding con mode: crc 2024-09-12T17:28:14.702 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding con mode: crc 2024-09-12T17:28:14.702 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding con mode: secure 2024-09-12T17:28:14.702 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding con mode: crc 2024-09-12T17:28:14.702 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding con mode: secure 2024-09-12T17:28:14.702 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding con mode: crc 2024-09-12T17:28:14.702 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 AuthRegistry(0x55e65a871eb0) adding con mode: secure 2024-09-12T17:28:14.702 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T17:28:14.543+0000 7fbba751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:14.702 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T17:28:14.543+0000 7fbba751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:14.703 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T17:28:14.543+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command rotate-key cmddesc rotate-key hook 0x55e65a871ff8 EEXIST 2024-09-12T17:28:14.703 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T17:28:14.543+0000 7fbba751f800 10 monclient: _reopen_session rank -1 2024-09-12T17:28:14.703 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T17:28:14.543+0000 7fbba751f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:28:14.703 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T17:28:14.543+0000 7fbba751f800 10 monclient(hunting): picked mon.noname-a con 0x55e65a881360 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:28:14.703 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T17:28:14.543+0000 7fbba751f800 10 monclient(hunting): picked mon.noname-c con 0x55e65a8ac910 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:28:14.703 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T17:28:14.543+0000 7fbba751f800 10 monclient(hunting): picked mon.noname-b con 0x55e65a8b1550 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:28:14.703 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T17:28:14.543+0000 7fbba751f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:14.703 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T17:28:14.543+0000 7fbba751f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:14.703 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T17:28:14.543+0000 7fbba751f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:14.703 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T17:28:14.543+0000 7fbba751f800 10 monclient(hunting): _renew_subs 2024-09-12T17:28:14.703 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T17:28:14.543+0000 7fbba751f800 10 monclient(hunting): authenticate will time out at 2505.893967s 2024-09-12T17:28:14.703 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T17:28:14.544+0000 7fbba32a9640 10 monclient(hunting): get_auth_request con 0x55e65a881360 auth_method 0 2024-09-12T17:28:14.703 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T17:28:14.544+0000 7fbba32a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:14.704 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T17:28:14.544+0000 7fbba32a9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:14.704 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T17:28:14.544+0000 7fbba32a9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:14.704 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T17:28:14.544+0000 7fbba32a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:14.704 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T17:28:14.544+0000 7fbba32a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:14.704 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T17:28:14.544+0000 7fbba32a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:14.704 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T17:28:14.544+0000 7fbba2aa8640 10 monclient(hunting): get_auth_request con 0x55e65a8ac910 auth_method 0 2024-09-12T17:28:14.704 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T17:28:14.544+0000 7fbba2aa8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:14.704 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T17:28:14.544+0000 7fbba2aa8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:14.704 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T17:28:14.544+0000 7fbba2aa8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:14.704 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T17:28:14.544+0000 7fbba3aaa640 10 monclient(hunting): get_auth_request con 0x55e65a8b1550 auth_method 0 2024-09-12T17:28:14.704 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T17:28:14.544+0000 7fbba3aaa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:14.704 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T17:28:14.544+0000 7fbba3aaa640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:14.704 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T17:28:14.544+0000 7fbba3aaa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:14.705 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T17:28:14.544+0000 7fbba2aa8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:14.705 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T17:28:14.544+0000 7fbba2aa8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:14.705 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T17:28:14.544+0000 7fbba2aa8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:14.705 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T17:28:14.544+0000 7fbba3aaa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:14.705 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T17:28:14.544+0000 7fbba3aaa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:14.705 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T17:28:14.544+0000 7fbba3aaa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:14.705 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T17:28:14.544+0000 7fbba32a9640 10 monclient(hunting): handle_auth_done global_id 8157 payload 824 2024-09-12T17:28:14.705 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T17:28:14.544+0000 7fbba32a9640 10 monclient: _finish_hunting 0 2024-09-12T17:28:14.705 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T17:28:14.544+0000 7fbba32a9640 1 monclient: found mon.noname-a 2024-09-12T17:28:14.705 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T17:28:14.544+0000 7fbba32a9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:28:14.705 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T17:28:14.544+0000 7fba857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:14.705 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T17:28:14.544+0000 7fba857fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:28:14.705 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T17:28:14.544+0000 7fba857fa640 10 monclient: dump: 2024-09-12T17:28:14.706 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:14.706 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:14.706 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.706 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.706 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:14.706 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:14.706 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:14.706 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:14.706 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:14.706 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.706 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T17:28:14.544+0000 7fba857fa640 10 monclient: _finish_auth 0 2024-09-12T17:28:14.706 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T17:28:14.544+0000 7fba857fa640 10 monclient: _check_auth_tickets 2024-09-12T17:28:14.706 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T17:28:14.544+0000 7fba857fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:28:14.706 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T17:28:14.544+0000 7fba857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:14.707 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T17:28:14.544+0000 7fba857fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:28:14.707 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T17:28:14.544+0000 7fba857fa640 10 monclient: dump: 2024-09-12T17:28:14.707 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:14.707 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:14.707 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.707 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:14.707 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:14.707 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:14.707 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:14.707 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:14.707 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:14.707 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.707 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T17:28:14.544+0000 7fbba751f800 5 monclient: authenticate success, global_id 8157 2024-09-12T17:28:14.707 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T17:28:14.544+0000 7fbba751f800 10 monclient: _renew_subs 2024-09-12T17:28:14.708 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T17:28:14.544+0000 7fbba751f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:28:14.708 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T17:28:14.544+0000 7fba86ffd640 4 set_mon_vals no callback set 2024-09-12T17:28:14.708 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T17:28:14.544+0000 7fbba751f800 10 monclient: _renew_subs 2024-09-12T17:28:14.708 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T17:28:14.544+0000 7fbba751f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:28:14.708 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T17:28:14.544+0000 7fbba751f800 1 librados: init done 2024-09-12T17:28:14.708 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T17:28:14.544+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command cr dump hook 0x55e65a8a51d8 2024-09-12T17:28:14.708 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T17:28:14.546+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.708 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T17:28:14.546+0000 7fba857fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:28:14.708 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T17:28:14.546+0000 7fba857fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:28:14.708 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T17:28:14.546+0000 7fba857fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:28:14.708 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T17:28:14.546+0000 7fbba2aa8640 10 monclient: get_auth_request con 0x7fba6c0764a0 auth_method 0 2024-09-12T17:28:14.708 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T17:28:14.546+0000 7fbba3aaa640 10 monclient: get_auth_request con 0x55e65a8cae30 auth_method 0 2024-09-12T17:28:14.708 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T17:28:14.547+0000 7fbba751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.709 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T17:28:14.547+0000 7fbba751f800 20 realm 2024-09-12T17:28:14.709 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T17:28:14.547+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.709 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T17:28:14.547+0000 7fbba751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.709 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T17:28:14.547+0000 7fbba751f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:14.709 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T17:28:14.547+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.709 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T17:28:14.547+0000 7fbba751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.709 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T17:28:14.547+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.709 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T17:28:14.548+0000 7fbba32a9640 10 monclient: get_auth_request con 0x55e65a8cf1a0 auth_method 0 2024-09-12T17:28:14.709 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T17:28:14.548+0000 7fbba751f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:14.709 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T17:28:14.548+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.709 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T17:28:14.548+0000 7fbba2aa8640 10 monclient: get_auth_request con 0x55e65a8d28c0 auth_method 0 2024-09-12T17:28:14.709 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T17:28:14.549+0000 7fbba751f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:28:14.709 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T17:28:14.549+0000 7fbba751f800 20 searching for the correct realm 2024-09-12T17:28:14.709 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T17:28:14.549+0000 7fbba3aaa640 10 monclient: get_auth_request con 0x55e65a8d7680 auth_method 0 2024-09-12T17:28:14.710 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T17:28:14.550+0000 7fbba32a9640 10 monclient: get_auth_request con 0x7fbb9c015900 auth_method 0 2024-09-12T17:28:14.710 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T17:28:14.551+0000 7fbba2aa8640 10 monclient: get_auth_request con 0x7fbb94029060 auth_method 0 2024-09-12T17:28:14.710 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T17:28:14.552+0000 7fbba3aaa640 0 -- 172.21.15.67:0/3569898042 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x55e65a8cae30 msgr2=0x55e65a8cd270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:14.710 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T17:28:14.552+0000 7fba857fa640 1 client.8157.objecter ms_handle_reset 0x55e65a8cae30 session 0x55e65a8ca7b0 osd.1 2024-09-12T17:28:14.710 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T17:28:14.552+0000 7fba857fa640 10 monclient: _renew_subs 2024-09-12T17:28:14.710 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T17:28:14.552+0000 7fba857fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:28:14.710 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T17:28:14.552+0000 7fbba3aaa640 10 monclient: get_auth_request con 0x7fba6c086340 auth_method 0 2024-09-12T17:28:14.710 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T17:28:14.553+0000 7fbba3aaa640 10 monclient: get_auth_request con 0x7fbb980a5080 auth_method 0 2024-09-12T17:28:14.710 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T17:28:14.555+0000 7fbba32a9640 10 monclient: get_auth_request con 0x7fbb980996f0 auth_method 0 2024-09-12T17:28:14.710 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T17:28:14.555+0000 7fbba2aa8640 0 -- 172.21.15.67:0/3569898042 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55e65a8d28c0 msgr2=0x55e65a8d4cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:14.710 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T17:28:14.555+0000 7fba857fa640 1 client.8157.objecter ms_handle_reset 0x55e65a8d28c0 session 0x55e65a8cea40 osd.4 2024-09-12T17:28:14.710 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T17:28:14.556+0000 7fbba2aa8640 10 monclient: get_auth_request con 0x55e65a8cae30 auth_method 0 2024-09-12T17:28:14.710 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T17:28:14.559+0000 7fbba751f800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:28:14.710 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T17:28:14.559+0000 7fbba751f800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:28:14.711 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T17:28:14.559+0000 7fbba751f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:14.711 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T17:28:14.559+0000 7fbba751f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:14.711 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T17:28:14.559+0000 7fbba751f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:14.711 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T17:28:14.559+0000 7fbba751f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:14.711 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T17:28:14.559+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.711 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T17:28:14.559+0000 7fbba751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.711 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T17:28:14.559+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.711 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T17:28:14.559+0000 7fbba751f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:14.711 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T17:28:14.559+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.711 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T17:28:14.560+0000 7fbba751f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:28:14.711 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T17:28:14.560+0000 7fbba751f800 20 zone default found 2024-09-12T17:28:14.712 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T17:28:14.560+0000 7fbba751f800 4 Realm: () 2024-09-12T17:28:14.712 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T17:28:14.560+0000 7fbba751f800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:28:14.712 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T17:28:14.560+0000 7fbba751f800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:28:14.712 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T17:28:14.560+0000 7fbba751f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:14.712 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T17:28:14.560+0000 7fbba751f800 20 zonegroup default 2024-09-12T17:28:14.712 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T17:28:14.560+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.712 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T17:28:14.560+0000 7fbba751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.712 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T17:28:14.560+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.712 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T17:28:14.560+0000 7fbba751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.712 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T17:28:14.560+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.712 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T17:28:14.560+0000 7fbba751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.713 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T17:28:14.560+0000 7fbba751f800 20 started sync module instance, tier type = 2024-09-12T17:28:14.713 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T17:28:14.560+0000 7fbba751f800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:28:14.713 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T17:28:14.572+0000 7fbba751f800 20 add_watcher() i=0 2024-09-12T17:28:14.713 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T17:28:14.572+0000 7fbba751f800 20 add_watcher() i=1 2024-09-12T17:28:14.713 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T17:28:14.572+0000 7fbba751f800 20 add_watcher() i=2 2024-09-12T17:28:14.713 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T17:28:14.572+0000 7fbba751f800 20 add_watcher() i=3 2024-09-12T17:28:14.713 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T17:28:14.572+0000 7fbba751f800 20 add_watcher() i=4 2024-09-12T17:28:14.713 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T17:28:14.572+0000 7fbba751f800 20 add_watcher() i=5 2024-09-12T17:28:14.713 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T17:28:14.572+0000 7fbba751f800 20 add_watcher() i=6 2024-09-12T17:28:14.713 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T17:28:14.573+0000 7fbba751f800 20 add_watcher() i=7 2024-09-12T17:28:14.713 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T17:28:14.573+0000 7fbba751f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:14.713 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding auth protocol: cephx 2024-09-12T17:28:14.713 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding auth protocol: cephx 2024-09-12T17:28:14.713 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding auth protocol: cephx 2024-09-12T17:28:14.714 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding con mode: secure 2024-09-12T17:28:14.714 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding con mode: crc 2024-09-12T17:28:14.714 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding con mode: secure 2024-09-12T17:28:14.714 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding con mode: crc 2024-09-12T17:28:14.714 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding con mode: secure 2024-09-12T17:28:14.714 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding con mode: crc 2024-09-12T17:28:14.714 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding con mode: crc 2024-09-12T17:28:14.714 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding con mode: secure 2024-09-12T17:28:14.714 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T17:28:14.574+0000 7fba59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:14.714 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding con mode: crc 2024-09-12T17:28:14.714 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding con mode: secure 2024-09-12T17:28:14.714 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding con mode: crc 2024-09-12T17:28:14.714 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 AuthRegistry(0x7ffe9da0b4a0) adding con mode: secure 2024-09-12T17:28:14.714 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T17:28:14.574+0000 7fbba751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:14.715 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T17:28:14.574+0000 7fbba751f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:14.715 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T17:28:14.574+0000 7fbba751f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:14.715 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command cache list hook 0x55e65a8a7c50 2024-09-12T17:28:14.715 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command cache inspect hook 0x55e65a8a7c50 2024-09-12T17:28:14.715 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command cache erase hook 0x55e65a8a7c50 2024-09-12T17:28:14.715 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command cache zap hook 0x55e65a8a7c50 2024-09-12T17:28:14.715 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T17:28:14.574+0000 7fbba751f800 5 note: GC not initialized 2024-09-12T17:28:14.715 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T17:28:14.575+0000 7fba58fe1640 20 reqs_thread_entry: start 2024-09-12T17:28:14.715 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T17:28:14.575+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command sync trace show hook 0x7fbb9c0050a0 2024-09-12T17:28:14.715 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T17:28:14.575+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command sync trace history hook 0x7fbb9c0050a0 2024-09-12T17:28:14.715 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T17:28:14.575+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command sync trace active hook 0x7fbb9c0050a0 2024-09-12T17:28:14.715 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T17:28:14.575+0000 7fbba751f800 5 asok(0x55e65a5bd730) register_command sync trace active_short hook 0x7fbb9c0050a0 2024-09-12T17:28:14.715 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T17:28:14.575+0000 7fbba751f800 20 init_complete bucket index max shards: 1 2024-09-12T17:28:14.715 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T17:28:14.575+0000 7fbba751f800 20 Filter name: none 2024-09-12T17:28:14.716 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T17:28:14.575+0000 7fb9d27fc640 20 reqs_thread_entry: start 2024-09-12T17:28:14.716 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T17:28:14.575+0000 7fbba751f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:28:14.716 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T17:28:14.575+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.716 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T17:28:14.575+0000 7fbba751f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:28:14.716 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T17:28:14.575+0000 7fbba751f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:28:14.716 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T17:28:14.575+0000 7fbba751f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:28:14.716 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T17:28:14.575+0000 7fbba751f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : miss 2024-09-12T17:28:14.716 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T17:28:14.575+0000 7fbba751f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.716 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T17:28:14.576+0000 7fbba751f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:28:14.716 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T17:28:14.576+0000 7fbba751f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:28:14.716 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T17:28:14.576+0000 7fbba751f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:28:14.716 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T17:28:14.576+0000 7fbba751f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:14.716 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T17:28:14.576+0000 7fbba751f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:28:14.717 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T17:28:14.576+0000 7fbba751f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:28:14.717 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T17:28:14.580+0000 7fbba751f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:28:14.717 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T17:28:14.580+0000 7fbba751f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:28:14.717 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T17:28:14.580+0000 7fbba751f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:28:14.717 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T17:28:14.580+0000 7fbba751f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18, ofs0, ns] 2024-09-12T17:28:14.717 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T17:28:14.580+0000 7fba867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464367 cookie 94447850009184 notifier 8157 bl.length()=911 2024-09-12T17:28:14.717 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T17:28:14.580+0000 7fba867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:28:14.717 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T17:28:14.580+0000 7fba867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:28:14.717 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T17:28:14.580+0000 7fba867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:28:14.717 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T17:28:14.582+0000 7fbba751f800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_sources= new_sources= 2024-09-12T17:28:14.717 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T17:28:14.582+0000 7fbba751f800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:28:14.717 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T17:28:14.582+0000 7fbba751f800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_dests= new_dests= 2024-09-12T17:28:14.717 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T17:28:14.582+0000 7fbba751f800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:28:14.717 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T17:28:14.585+0000 7fbba751f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.0 2024-09-12T17:28:14.718 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T17:28:14.585+0000 7fbba751f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.0 2024-09-12T17:28:14.718 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T17:28:14.585+0000 7fbba751f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.1 2024-09-12T17:28:14.718 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T17:28:14.585+0000 7fbba751f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.1 2024-09-12T17:28:14.718 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T17:28:14.585+0000 7fbba751f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.2 2024-09-12T17:28:14.718 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T17:28:14.585+0000 7fbba751f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.2 2024-09-12T17:28:14.718 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T17:28:14.585+0000 7fbba751f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.3 2024-09-12T17:28:14.718 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T17:28:14.585+0000 7fbba751f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.3 2024-09-12T17:28:14.718 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T17:28:14.585+0000 7fbba751f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 2024-09-12T17:28:14.718 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T17:28:14.585+0000 7fbba751f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 2024-09-12T17:28:14.718 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T17:28:14.585+0000 7fbba751f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.1 2024-09-12T17:28:14.718 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T17:28:14.585+0000 7fbba751f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.1 2024-09-12T17:28:14.718 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T17:28:14.585+0000 7fbba751f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.2 2024-09-12T17:28:14.718 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T17:28:14.585+0000 7fbba751f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.2 2024-09-12T17:28:14.718 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T17:28:14.588+0000 7fbba751f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbba751f800 time 2024-09-12T17:28:14.588570+0000 2024-09-12T17:28:14.719 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:28:14.719 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.719 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:28:14.719 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbba8d8c71a] 2024-09-12T17:28:14.719 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fbba8d8c8d8] 2024-09-12T17:28:14.719 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e658354841] 2024-09-12T17:28:14.719 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55e658363734] 2024-09-12T17:28:14.719 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e6583645d4] 2024-09-12T17:28:14.719 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:28:14.719 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fbba7a29590] 2024-09-12T17:28:14.719 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:28:14.719 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:28:14.719 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.720 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T17:28:14.589+0000 7fbba751f800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:28:14.720 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7fbba751f800 thread_name:radosgw-admin 2024-09-12T17:28:14.720 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.720 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:28:14.720 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbba7a3e6f0] 2024-09-12T17:28:14.720 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbba7a8b99c] 2024-09-12T17:28:14.720 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:28:14.720 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:28:14.720 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbba8d8c774] 2024-09-12T17:28:14.720 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fbba8d8c8d8] 2024-09-12T17:28:14.720 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e658354841] 2024-09-12T17:28:14.720 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55e658363734] 2024-09-12T17:28:14.720 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e6583645d4] 2024-09-12T17:28:14.720 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:28:14.721 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fbba7a29590] 2024-09-12T17:28:14.721 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:28:14.721 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:28:14.721 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:28:14.721 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:14.721 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T17:28:14.721 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T17:28:14.721 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T17:28:14.721 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T17:28:14.721 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T17:28:14.721 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T17:28:14.721 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T17:28:14.721 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T17:28:14.721 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T17:28:14.722 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T17:28:14.722 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T17:28:14.722 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T17:28:14.722 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T17:28:14.722 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T17:28:14.722 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T17:28:14.722 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T17:28:14.722 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T17:28:14.722 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T17:28:14.722 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T17:28:14.722 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T17:28:14.722 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T17:28:14.722 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T17:28:14.722 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T17:28:14.722 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T17:28:14.723 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:28:14.723 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T17:28:14.723 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T17:28:14.723 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T17:28:14.723 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T17:28:14.723 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T17:28:14.723 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T17:28:14.723 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T17:28:14.723 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T17:28:14.723 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T17:28:14.723 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T17:28:14.723 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T17:28:14.723 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T17:28:14.723 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T17:28:14.724 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T17:28:14.724 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T17:28:14.724 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T17:28:14.724 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T17:28:14.724 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T17:28:14.724 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T17:28:14.724 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T17:28:14.724 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T17:28:14.724 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:28:14.724 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T17:28:14.724 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:28:14.724 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T17:28:14.724 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T17:28:14.724 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T17:28:14.725 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T17:28:14.725 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T17:28:14.725 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T17:28:14.725 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T17:28:14.725 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T17:28:14.725 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T17:28:14.725 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T17:28:14.725 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T17:28:14.725 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T17:28:14.725 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T17:28:14.725 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T17:28:14.725 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T17:28:14.725 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T17:28:14.725 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T17:28:14.725 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T17:28:14.726 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:28:14.726 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T17:28:14.726 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:28:14.726 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T17:28:14.726 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T17:28:14.726 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T17:28:14.726 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T17:28:14.726 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T17:28:14.726 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T17:28:14.726 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:28:14.726 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T17:28:14.726 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T17:28:14.726 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:28:14.726 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T17:28:14.727 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T17:28:14.727 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T17:28:14.727 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T17:28:14.727 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T17:28:14.727 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T17:28:14.727 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T17:28:14.727 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T17:28:14.727 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T17:28:14.727 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T17:28:14.727 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T17:28:14.727 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T17:28:14.727 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T17:28:14.727 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:28:14.727 INFO:tasks.workunit.client.0.smithi067.stderr: 7fb9d27fc640 / http_manager 2024-09-12T17:28:14.728 INFO:tasks.workunit.client.0.smithi067.stderr: 7fba58fe1640 / http_manager 2024-09-12T17:28:14.728 INFO:tasks.workunit.client.0.smithi067.stderr: 7fba59fe3640 / rgw_dt_lg_renew 2024-09-12T17:28:14.728 INFO:tasks.workunit.client.0.smithi067.stderr: 7fba857fa640 / ms_dispatch 2024-09-12T17:28:14.728 INFO:tasks.workunit.client.0.smithi067.stderr: 7fba867fc640 / io_context_pool 2024-09-12T17:28:14.728 INFO:tasks.workunit.client.0.smithi067.stderr: 7fba86ffd640 / io_context_pool 2024-09-12T17:28:14.728 INFO:tasks.workunit.client.0.smithi067.stderr: 7fba8d602640 / ms_dispatch 2024-09-12T17:28:14.728 INFO:tasks.workunit.client.0.smithi067.stderr: 7fba8fe07640 / ms_dispatch 2024-09-12T17:28:14.728 INFO:tasks.workunit.client.0.smithi067.stderr: 7fba9160a640 / io_context_pool 2024-09-12T17:28:14.728 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbba2aa8640 / msgr-worker-2 2024-09-12T17:28:14.728 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbba32a9640 / msgr-worker-1 2024-09-12T17:28:14.728 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbba3aaa640 / msgr-worker-0 2024-09-12T17:28:14.728 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbba42ab640 / io_context_pool 2024-09-12T17:28:14.728 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbba751f800 / radosgw-admin 2024-09-12T17:28:14.728 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T17:28:14.728 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T17:28:14.729 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:28:14.590230Z_5ba6bad7-e7d9-44ad-ade5-0448fc365bbc/log 2024-09-12T17:28:14.729 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T17:28:14.729 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:28:14.730 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:14.730 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:14.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.667+0000 7f6f53332800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.669+0000 7f6f53332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.669+0000 7f6f53332800 20 realm 2024-09-12T17:28:14.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.669+0000 7f6f53332800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.669+0000 7f6f53332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.669+0000 7f6f53332800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:14.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.669+0000 7f6f53332800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.669+0000 7f6f53332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.669+0000 7f6f53332800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.670+0000 7f6f53332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:14.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.670+0000 7f6f53332800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.671+0000 7f6f53332800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:28:14.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.671+0000 7f6f53332800 20 searching for the correct realm 2024-09-12T17:28:14.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.673+0000 7f6f4e7bb640 0 -- 172.21.15.67:0/1454778887 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f6f40095420 msgr2=0x7f6f40095840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:14.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.677+0000 7f6f4efbc640 0 -- 172.21.15.67:0/1454778887 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f6f44018bf0 msgr2=0x7f6f4404da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:14.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.884+0000 7f6f53332800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:28:14.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.884+0000 7f6f53332800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:28:14.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.884+0000 7f6f53332800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:14.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.884+0000 7f6f53332800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:14.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.884+0000 7f6f53332800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:14.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.884+0000 7f6f53332800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:14.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.884+0000 7f6f53332800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.884+0000 7f6f53332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.884+0000 7f6f53332800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.884+0000 7f6f53332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:14.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.884+0000 7f6f53332800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.885+0000 7f6f53332800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:28:14.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.885+0000 7f6f53332800 20 zone default found 2024-09-12T17:28:14.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.885+0000 7f6f53332800 4 Realm: () 2024-09-12T17:28:14.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.885+0000 7f6f53332800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:28:14.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.885+0000 7f6f53332800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:28:14.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.885+0000 7f6f53332800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:14.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.885+0000 7f6f53332800 20 zonegroup default 2024-09-12T17:28:14.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.885+0000 7f6f53332800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.885+0000 7f6f53332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.885+0000 7f6f53332800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.885+0000 7f6f53332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.885+0000 7f6f53332800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.886+0000 7f6f53332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:14.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.886+0000 7f6f53332800 20 started sync module instance, tier type = 2024-09-12T17:28:14.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.886+0000 7f6f53332800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:28:14.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.895+0000 7f6f53332800 20 add_watcher() i=0 2024-09-12T17:28:14.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.895+0000 7f6f53332800 20 add_watcher() i=1 2024-09-12T17:28:14.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.895+0000 7f6f53332800 20 add_watcher() i=2 2024-09-12T17:28:14.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.895+0000 7f6f53332800 20 add_watcher() i=3 2024-09-12T17:28:14.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.895+0000 7f6f53332800 20 add_watcher() i=4 2024-09-12T17:28:14.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.895+0000 7f6f53332800 20 add_watcher() i=5 2024-09-12T17:28:14.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.895+0000 7f6f53332800 20 add_watcher() i=6 2024-09-12T17:28:14.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.896+0000 7f6f53332800 20 add_watcher() i=7 2024-09-12T17:28:14.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.896+0000 7f6f53332800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:14.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.898+0000 7f6e057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:14.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.898+0000 7f6f53332800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:14.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.898+0000 7f6f53332800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:14.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.898+0000 7f6f53332800 5 note: GC not initialized 2024-09-12T17:28:14.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.898+0000 7f6d7ffff640 20 reqs_thread_entry: start 2024-09-12T17:28:14.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.899+0000 7f6f53332800 20 init_complete bucket index max shards: 1 2024-09-12T17:28:14.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.899+0000 7f6f53332800 20 Filter name: none 2024-09-12T17:28:14.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.899+0000 7f6d7dffb640 20 reqs_thread_entry: start 2024-09-12T17:28:14.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.899+0000 7f6f53332800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.899+0000 7f6f53332800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:28:14.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.899+0000 7f6f53332800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.900+0000 7f6f53332800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:28:14.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.900+0000 7f6f53332800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:28:14.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.900+0000 7f6f53332800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.900+0000 7f6f53332800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:28:14.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.900+0000 7f6f53332800 20 rados->read ofs=0 len=0 2024-09-12T17:28:14.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.901+0000 7f6f53332800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:28:14.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.901+0000 7f6f53332800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:28:14.903 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.902+0000 7f6e057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:14.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.904+0000 7f6f53332800 20 remove_watcher() i=0 2024-09-12T17:28:14.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.904+0000 7f6f53332800 2 removed watcher, disabling cache 2024-09-12T17:28:14.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.905+0000 7f6f53332800 20 remove_watcher() i=1 2024-09-12T17:28:14.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.906+0000 7f6f53332800 20 remove_watcher() i=2 2024-09-12T17:28:14.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.907+0000 7f6f53332800 20 remove_watcher() i=3 2024-09-12T17:28:14.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.908+0000 7f6f53332800 20 remove_watcher() i=4 2024-09-12T17:28:14.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.909+0000 7f6f53332800 20 remove_watcher() i=5 2024-09-12T17:28:14.911 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.910+0000 7f6f53332800 20 remove_watcher() i=6 2024-09-12T17:28:14.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:14.911+0000 7f6f53332800 20 remove_watcher() i=7 2024-09-12T17:28:14.925 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:28:14.925 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:28:14.964 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:28:14.993 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:14.993 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:15.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.032+0000 7ffa80d35800 20 rados->read ofs=0 len=0 2024-09-12T17:28:15.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.033+0000 7ffa80d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:15.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.033+0000 7ffa80d35800 20 realm 2024-09-12T17:28:15.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.033+0000 7ffa80d35800 20 rados->read ofs=0 len=0 2024-09-12T17:28:15.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.033+0000 7ffa80d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:15.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.033+0000 7ffa80d35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:15.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.033+0000 7ffa80d35800 20 rados->read ofs=0 len=0 2024-09-12T17:28:15.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.033+0000 7ffa80d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:15.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.033+0000 7ffa80d35800 20 rados->read ofs=0 len=0 2024-09-12T17:28:15.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.034+0000 7ffa80d35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:15.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.034+0000 7ffa80d35800 20 rados->read ofs=0 len=0 2024-09-12T17:28:15.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.035+0000 7ffa80d35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:28:15.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.035+0000 7ffa80d35800 20 searching for the correct realm 2024-09-12T17:28:15.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.036+0000 7ffa7cae4640 0 -- 172.21.15.67:0/96811981 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x55d01a52e1b0 msgr2=0x7ffa78056970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:28:15.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.241+0000 7ffa77fff640 0 -- 172.21.15.67:0/96811981 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7ffa70017020 msgr2=0x7ffa700723b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:15.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.246+0000 7ffa80d35800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:28:15.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.246+0000 7ffa80d35800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:28:15.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.246+0000 7ffa80d35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:15.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.246+0000 7ffa80d35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:15.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.246+0000 7ffa80d35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:15.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.246+0000 7ffa80d35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:15.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.246+0000 7ffa80d35800 20 rados->read ofs=0 len=0 2024-09-12T17:28:15.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.246+0000 7ffa80d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:15.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.247+0000 7ffa80d35800 20 rados->read ofs=0 len=0 2024-09-12T17:28:15.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.247+0000 7ffa80d35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:15.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.247+0000 7ffa80d35800 20 rados->read ofs=0 len=0 2024-09-12T17:28:15.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.247+0000 7ffa80d35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:28:15.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.247+0000 7ffa80d35800 20 zone default found 2024-09-12T17:28:15.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.247+0000 7ffa80d35800 4 Realm: () 2024-09-12T17:28:15.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.247+0000 7ffa80d35800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:28:15.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.247+0000 7ffa80d35800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:28:15.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.247+0000 7ffa80d35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:15.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.247+0000 7ffa80d35800 20 zonegroup default 2024-09-12T17:28:15.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.247+0000 7ffa80d35800 20 rados->read ofs=0 len=0 2024-09-12T17:28:15.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.247+0000 7ffa80d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:15.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.247+0000 7ffa80d35800 20 rados->read ofs=0 len=0 2024-09-12T17:28:15.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.248+0000 7ffa80d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:15.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.248+0000 7ffa80d35800 20 rados->read ofs=0 len=0 2024-09-12T17:28:15.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.248+0000 7ffa80d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:15.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.248+0000 7ffa80d35800 20 started sync module instance, tier type = 2024-09-12T17:28:15.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.248+0000 7ffa80d35800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:28:15.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.257+0000 7ffa80d35800 20 add_watcher() i=0 2024-09-12T17:28:15.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.257+0000 7ffa80d35800 20 add_watcher() i=1 2024-09-12T17:28:15.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.257+0000 7ffa80d35800 20 add_watcher() i=2 2024-09-12T17:28:15.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.257+0000 7ffa80d35800 20 add_watcher() i=3 2024-09-12T17:28:15.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.257+0000 7ffa80d35800 20 add_watcher() i=4 2024-09-12T17:28:15.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.257+0000 7ffa80d35800 20 add_watcher() i=5 2024-09-12T17:28:15.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.257+0000 7ffa80d35800 20 add_watcher() i=6 2024-09-12T17:28:15.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.258+0000 7ffa80d35800 20 add_watcher() i=7 2024-09-12T17:28:15.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.258+0000 7ffa80d35800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:15.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.259+0000 7ff932fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:15.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.260+0000 7ffa80d35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:15.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.260+0000 7ffa80d35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:15.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.260+0000 7ffa80d35800 5 note: GC not initialized 2024-09-12T17:28:15.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.260+0000 7ff931fe3640 20 reqs_thread_entry: start 2024-09-12T17:28:15.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.260+0000 7ffa80d35800 20 init_complete bucket index max shards: 1 2024-09-12T17:28:15.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.260+0000 7ffa80d35800 20 Filter name: none 2024-09-12T17:28:15.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.260+0000 7ff8a37fe640 20 reqs_thread_entry: start 2024-09-12T17:28:15.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.260+0000 7ffa80d35800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:28:15.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.260+0000 7ffa80d35800 20 rados->read ofs=0 len=0 2024-09-12T17:28:15.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.261+0000 7ffa80d35800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:28:15.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.261+0000 7ffa80d35800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:28:15.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.261+0000 7ffa80d35800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:28:15.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.261+0000 7ffa80d35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : miss 2024-09-12T17:28:15.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.261+0000 7ffa80d35800 20 rados->read ofs=0 len=0 2024-09-12T17:28:15.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.261+0000 7ffa80d35800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:28:15.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.261+0000 7ffa80d35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:28:15.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.261+0000 7ffa80d35800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:28:15.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.261+0000 7ffa80d35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:15.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.261+0000 7ffa80d35800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:28:15.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.261+0000 7ffa80d35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:28:15.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.261+0000 7ffa80d35800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 2024-09-12T17:28:15.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.261+0000 7ffa80d35800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 2024-09-12T17:28:15.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.262+0000 7ffa80d35800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.1 2024-09-12T17:28:15.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.262+0000 7ffa80d35800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.1 2024-09-12T17:28:15.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.262+0000 7ffa80d35800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.2 2024-09-12T17:28:15.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.262+0000 7ffa80d35800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.2 2024-09-12T17:28:15.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.263+0000 7ff932fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:15.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.265+0000 7ffa80d35800 20 remove_watcher() i=0 2024-09-12T17:28:15.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.265+0000 7ffa80d35800 2 removed watcher, disabling cache 2024-09-12T17:28:15.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.266+0000 7ffa80d35800 20 remove_watcher() i=1 2024-09-12T17:28:15.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.267+0000 7ffa80d35800 20 remove_watcher() i=2 2024-09-12T17:28:15.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.268+0000 7ffa80d35800 20 remove_watcher() i=3 2024-09-12T17:28:15.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.269+0000 7ffa80d35800 20 remove_watcher() i=4 2024-09-12T17:28:15.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.270+0000 7ffa80d35800 20 remove_watcher() i=5 2024-09-12T17:28:15.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.271+0000 7ffa80d35800 20 remove_watcher() i=6 2024-09-12T17:28:15.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:15.272+0000 7ffa80d35800 20 remove_watcher() i=7 2024-09-12T17:28:45.294 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:28:45.327 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:45.327 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:45.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.371+0000 7fe918c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:45.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.373+0000 7fe918c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:45.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.373+0000 7fe918c0e800 20 realm 2024-09-12T17:28:45.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.373+0000 7fe918c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:45.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.373+0000 7fe918c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:45.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.373+0000 7fe918c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:45.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.373+0000 7fe918c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:45.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.373+0000 7fe918c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:45.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.373+0000 7fe918c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:45.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.374+0000 7fe918c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:45.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.374+0000 7fe918c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:45.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.375+0000 7fe918c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:28:45.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.375+0000 7fe918c0e800 20 searching for the correct realm 2024-09-12T17:28:45.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.378+0000 7fe91436b640 0 -- 172.21.15.67:0/3485123501 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7fe90c01f040 msgr2=0x7fe90c00e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:45.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.382+0000 7fe91436b640 0 -- 172.21.15.67:0/3485123501 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fe9080c6bb0 msgr2=0x7fe9080ac840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:45.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.591+0000 7fe918c0e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:28:45.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.591+0000 7fe918c0e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:28:45.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.591+0000 7fe918c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:45.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.591+0000 7fe918c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:45.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.591+0000 7fe918c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:45.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.591+0000 7fe918c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:45.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.591+0000 7fe918c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:45.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.591+0000 7fe918c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:45.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.591+0000 7fe918c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:45.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.592+0000 7fe918c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:45.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.592+0000 7fe918c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:45.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.592+0000 7fe918c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:28:45.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.592+0000 7fe918c0e800 20 zone default found 2024-09-12T17:28:45.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.592+0000 7fe918c0e800 4 Realm: () 2024-09-12T17:28:45.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.592+0000 7fe918c0e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:28:45.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.592+0000 7fe918c0e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:28:45.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.592+0000 7fe918c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:45.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.592+0000 7fe918c0e800 20 zonegroup default 2024-09-12T17:28:45.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.592+0000 7fe918c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:45.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.592+0000 7fe918c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:45.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.592+0000 7fe918c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:45.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.593+0000 7fe918c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:45.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.593+0000 7fe918c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:45.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.593+0000 7fe918c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:45.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.593+0000 7fe918c0e800 20 started sync module instance, tier type = 2024-09-12T17:28:45.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.593+0000 7fe918c0e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:28:45.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.604+0000 7fe918c0e800 20 add_watcher() i=0 2024-09-12T17:28:45.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.604+0000 7fe918c0e800 20 add_watcher() i=1 2024-09-12T17:28:45.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.604+0000 7fe918c0e800 20 add_watcher() i=2 2024-09-12T17:28:45.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.604+0000 7fe918c0e800 20 add_watcher() i=3 2024-09-12T17:28:45.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.604+0000 7fe918c0e800 20 add_watcher() i=4 2024-09-12T17:28:45.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.604+0000 7fe918c0e800 20 add_watcher() i=5 2024-09-12T17:28:45.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.604+0000 7fe918c0e800 20 add_watcher() i=6 2024-09-12T17:28:45.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.606+0000 7fe918c0e800 20 add_watcher() i=7 2024-09-12T17:28:45.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.606+0000 7fe918c0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:45.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.608+0000 7fe7cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:45.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.608+0000 7fe918c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:45.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.608+0000 7fe918c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:45.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.608+0000 7fe918c0e800 5 note: GC not initialized 2024-09-12T17:28:45.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.608+0000 7fe7c9fdb640 20 reqs_thread_entry: start 2024-09-12T17:28:45.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.609+0000 7fe918c0e800 20 init_complete bucket index max shards: 1 2024-09-12T17:28:45.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.609+0000 7fe918c0e800 20 Filter name: none 2024-09-12T17:28:45.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.609+0000 7fe73b7fe640 20 reqs_thread_entry: start 2024-09-12T17:28:45.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.609+0000 7fe918c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:45.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.610+0000 7fe918c0e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:28:45.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.610+0000 7fe918c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:45.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.610+0000 7fe918c0e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:28:45.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.610+0000 7fe918c0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:28:45.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.610+0000 7fe918c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:45.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.610+0000 7fe918c0e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:28:45.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.610+0000 7fe918c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:45.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.611+0000 7fe918c0e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:28:45.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.611+0000 7fe918c0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:28:45.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.612+0000 7fe7cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:45.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.615+0000 7fe918c0e800 20 remove_watcher() i=0 2024-09-12T17:28:45.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.615+0000 7fe918c0e800 2 removed watcher, disabling cache 2024-09-12T17:28:45.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.617+0000 7fe918c0e800 20 remove_watcher() i=1 2024-09-12T17:28:45.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.618+0000 7fe918c0e800 20 remove_watcher() i=2 2024-09-12T17:28:45.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.619+0000 7fe918c0e800 20 remove_watcher() i=3 2024-09-12T17:28:45.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.620+0000 7fe918c0e800 20 remove_watcher() i=4 2024-09-12T17:28:45.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.621+0000 7fe918c0e800 20 remove_watcher() i=5 2024-09-12T17:28:45.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.622+0000 7fe918c0e800 20 remove_watcher() i=6 2024-09-12T17:28:45.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.624+0000 7fe918c0e800 20 remove_watcher() i=7 2024-09-12T17:28:45.640 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:28:45.640 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:28:45.712 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:28:45.742 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:45.742 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:45.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.780+0000 7fab57546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:45.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.781+0000 7fab57546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:45.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.781+0000 7fab57546800 20 realm 2024-09-12T17:28:45.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.781+0000 7fab57546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:45.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.781+0000 7fab57546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:45.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.781+0000 7fab57546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:45.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.781+0000 7fab57546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:45.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.782+0000 7fab57546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:45.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.782+0000 7fab57546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:45.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.783+0000 7fab57546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:45.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.783+0000 7fab57546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:45.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.783+0000 7fab57546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:28:45.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.783+0000 7fab57546800 20 searching for the correct realm 2024-09-12T17:28:45.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.787+0000 7fab55838640 0 -- 172.21.15.67:0/2251405079 >> [v2:172.21.15.118:6824/1070975205,v1:172.21.15.118:6825/1070975205] conn(0x7fab4c096040 msgr2=0x7fab4c0a2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:45.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.994+0000 7fab55037640 0 -- 172.21.15.67:0/2251405079 >> [v2:172.21.15.118:6808/1825660705,v1:172.21.15.118:6809/1825660705] conn(0x55ef7f7683f0 msgr2=0x55ef7f76a820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:45.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.997+0000 7fab57546800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:28:45.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.997+0000 7fab57546800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:28:45.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.997+0000 7fab57546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:45.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.997+0000 7fab57546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:45.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.997+0000 7fab57546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:45.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.997+0000 7fab57546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:45.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.997+0000 7fab57546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:45.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.997+0000 7fab57546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:45.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.997+0000 7fab57546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:45.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.998+0000 7fab57546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:45.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.998+0000 7fab57546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.998+0000 7fab57546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:28:46.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.998+0000 7fab57546800 20 zone default found 2024-09-12T17:28:46.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.998+0000 7fab57546800 4 Realm: () 2024-09-12T17:28:46.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.998+0000 7fab57546800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:28:46.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.998+0000 7fab57546800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:28:46.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.998+0000 7fab57546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:46.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.998+0000 7fab57546800 20 zonegroup default 2024-09-12T17:28:46.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.998+0000 7fab57546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.999+0000 7fab57546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.999+0000 7fab57546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.999+0000 7fab57546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.999+0000 7fab57546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.999+0000 7fab57546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.999+0000 7fab57546800 20 started sync module instance, tier type = 2024-09-12T17:28:46.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:45.999+0000 7fab57546800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:28:46.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.009+0000 7fab57546800 20 add_watcher() i=0 2024-09-12T17:28:46.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.009+0000 7fab57546800 20 add_watcher() i=1 2024-09-12T17:28:46.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.009+0000 7fab57546800 20 add_watcher() i=2 2024-09-12T17:28:46.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.009+0000 7fab57546800 20 add_watcher() i=3 2024-09-12T17:28:46.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.009+0000 7fab57546800 20 add_watcher() i=4 2024-09-12T17:28:46.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.009+0000 7fab57546800 20 add_watcher() i=5 2024-09-12T17:28:46.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.009+0000 7fab57546800 20 add_watcher() i=6 2024-09-12T17:28:46.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.010+0000 7fab57546800 20 add_watcher() i=7 2024-09-12T17:28:46.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.010+0000 7fab57546800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:46.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.011+0000 7faa0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:46.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.012+0000 7fab57546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:46.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.012+0000 7fab57546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:46.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.012+0000 7fab57546800 5 note: GC not initialized 2024-09-12T17:28:46.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.012+0000 7faa0a7e4640 20 reqs_thread_entry: start 2024-09-12T17:28:46.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.012+0000 7fab57546800 20 init_complete bucket index max shards: 1 2024-09-12T17:28:46.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.012+0000 7fab57546800 20 Filter name: none 2024-09-12T17:28:46.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.012+0000 7fa97bfff640 20 reqs_thread_entry: start 2024-09-12T17:28:46.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.012+0000 7fab57546800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:28:46.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.012+0000 7fab57546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.013+0000 7fab57546800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:28:46.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.013+0000 7fab57546800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:28:46.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.013+0000 7fab57546800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:28:46.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.013+0000 7fab57546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : miss 2024-09-12T17:28:46.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.013+0000 7fab57546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.013+0000 7fab57546800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:28:46.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.013+0000 7fab57546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:28:46.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.013+0000 7fab57546800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:28:46.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.013+0000 7fab57546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:46.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.013+0000 7fab57546800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:28:46.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.013+0000 7fab57546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:28:46.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.013+0000 7fab57546800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 2024-09-12T17:28:46.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.013+0000 7fab57546800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 2024-09-12T17:28:46.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.014+0000 7fab57546800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.1 2024-09-12T17:28:46.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.014+0000 7fab57546800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.1 2024-09-12T17:28:46.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.014+0000 7fab57546800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.2 2024-09-12T17:28:46.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.014+0000 7fab57546800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.2 2024-09-12T17:28:46.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.015+0000 7faa0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:46.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.018+0000 7fab57546800 20 remove_watcher() i=0 2024-09-12T17:28:46.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.018+0000 7fab57546800 2 removed watcher, disabling cache 2024-09-12T17:28:46.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.019+0000 7fab57546800 20 remove_watcher() i=1 2024-09-12T17:28:46.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.020+0000 7fab57546800 20 remove_watcher() i=2 2024-09-12T17:28:46.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.021+0000 7fab57546800 20 remove_watcher() i=3 2024-09-12T17:28:46.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.022+0000 7fab57546800 20 remove_watcher() i=4 2024-09-12T17:28:46.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.023+0000 7fab57546800 20 remove_watcher() i=5 2024-09-12T17:28:46.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.024+0000 7fab57546800 20 remove_watcher() i=6 2024-09-12T17:28:46.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.025+0000 7fab57546800 20 remove_watcher() i=7 2024-09-12T17:28:46.038 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:28:46.068 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:46.068 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:46.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.105+0000 7f6570523800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.107+0000 7f6570523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.107+0000 7f6570523800 20 realm 2024-09-12T17:28:46.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.107+0000 7f6570523800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.108+0000 7f6570523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.108+0000 7f6570523800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:46.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.108+0000 7f6570523800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.108+0000 7f6570523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.108+0000 7f6570523800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.109+0000 7f6570523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:46.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.109+0000 7f6570523800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.109+0000 7f6570523800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:28:46.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.110+0000 7f6570523800 20 searching for the correct realm 2024-09-12T17:28:46.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.112+0000 7f6563fff640 0 -- 172.21.15.67:0/804395200 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f655c086ba0 msgr2=0x7f655c07a9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:46.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.116+0000 7f656c20c640 0 -- 172.21.15.67:0/804395200 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f6554025040 msgr2=0x7f655405d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:46.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.322+0000 7f6570523800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:28:46.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.322+0000 7f6570523800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:28:46.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.322+0000 7f6570523800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:46.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.322+0000 7f6570523800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:46.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.322+0000 7f6570523800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:46.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.322+0000 7f6570523800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:46.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.323+0000 7f6570523800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.323+0000 7f6570523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.323+0000 7f6570523800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.323+0000 7f6570523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:46.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.323+0000 7f6570523800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.323+0000 7f6570523800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:28:46.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.323+0000 7f6570523800 20 zone default found 2024-09-12T17:28:46.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.323+0000 7f6570523800 4 Realm: () 2024-09-12T17:28:46.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.323+0000 7f6570523800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:28:46.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.323+0000 7f6570523800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:28:46.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.323+0000 7f6570523800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:46.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.323+0000 7f6570523800 20 zonegroup default 2024-09-12T17:28:46.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.323+0000 7f6570523800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.324+0000 7f6570523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.324+0000 7f6570523800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.324+0000 7f6570523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.324+0000 7f6570523800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.325+0000 7f6570523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.325+0000 7f6570523800 20 started sync module instance, tier type = 2024-09-12T17:28:46.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.325+0000 7f6570523800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:28:46.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.334+0000 7f6570523800 20 add_watcher() i=0 2024-09-12T17:28:46.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.334+0000 7f6570523800 20 add_watcher() i=1 2024-09-12T17:28:46.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.334+0000 7f6570523800 20 add_watcher() i=2 2024-09-12T17:28:46.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.334+0000 7f6570523800 20 add_watcher() i=3 2024-09-12T17:28:46.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.334+0000 7f6570523800 20 add_watcher() i=4 2024-09-12T17:28:46.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.334+0000 7f6570523800 20 add_watcher() i=5 2024-09-12T17:28:46.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.334+0000 7f6570523800 20 add_watcher() i=6 2024-09-12T17:28:46.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.335+0000 7f6570523800 20 add_watcher() i=7 2024-09-12T17:28:46.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.335+0000 7f6570523800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:46.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.337+0000 7f6422fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:46.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.337+0000 7f6570523800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:46.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.337+0000 7f6570523800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:46.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.337+0000 7f6570523800 5 note: GC not initialized 2024-09-12T17:28:46.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.338+0000 7f6421fdb640 20 reqs_thread_entry: start 2024-09-12T17:28:46.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.338+0000 7f6570523800 20 init_complete bucket index max shards: 1 2024-09-12T17:28:46.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.338+0000 7f6570523800 20 Filter name: none 2024-09-12T17:28:46.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.338+0000 7f63937fe640 20 reqs_thread_entry: start 2024-09-12T17:28:46.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.338+0000 7f6570523800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.338+0000 7f6570523800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:28:46.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.338+0000 7f6570523800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.339+0000 7f6570523800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:28:46.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.339+0000 7f6570523800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:28:46.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.339+0000 7f6570523800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.339+0000 7f6570523800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:28:46.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.339+0000 7f6570523800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.339+0000 7f6570523800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:28:46.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.339+0000 7f6570523800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:28:46.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.341+0000 7f6422fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:46.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.344+0000 7f6570523800 20 remove_watcher() i=0 2024-09-12T17:28:46.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.344+0000 7f6570523800 2 removed watcher, disabling cache 2024-09-12T17:28:46.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.345+0000 7f6570523800 20 remove_watcher() i=1 2024-09-12T17:28:46.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.346+0000 7f6570523800 20 remove_watcher() i=2 2024-09-12T17:28:46.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.347+0000 7f6570523800 20 remove_watcher() i=3 2024-09-12T17:28:46.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.348+0000 7f6570523800 20 remove_watcher() i=4 2024-09-12T17:28:46.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.350+0000 7f6570523800 20 remove_watcher() i=5 2024-09-12T17:28:46.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.351+0000 7f6570523800 20 remove_watcher() i=6 2024-09-12T17:28:46.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.352+0000 7f6570523800 20 remove_watcher() i=7 2024-09-12T17:28:46.364 INFO:tasks.workunit.client.0.smithi067.stderr: test: duplicated entries should be purged before reshard 2024-09-12T17:28:46.365 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:28:46.395 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:46.396 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:46.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.433+0000 7fa51ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.435+0000 7fa51ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.435+0000 7fa51ec87800 20 realm 2024-09-12T17:28:46.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.435+0000 7fa51ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.435+0000 7fa51ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.435+0000 7fa51ec87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:46.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.435+0000 7fa51ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.436+0000 7fa51ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.436+0000 7fa51ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.436+0000 7fa51ec87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:46.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.436+0000 7fa51ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.437+0000 7fa51ec87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:28:46.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.437+0000 7fa51ec87800 20 searching for the correct realm 2024-09-12T17:28:46.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.440+0000 7fa51cf72640 0 -- 172.21.15.67:0/2666347450 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x55b1db639a30 msgr2=0x55b1db63be20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:28:46.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.444+0000 7fa51c771640 0 -- 172.21.15.67:0/2666347450 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fa510007eb0 msgr2=0x7fa5100db930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:46.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.448+0000 7fa51ec87800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:28:46.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.448+0000 7fa51ec87800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:28:46.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.448+0000 7fa51ec87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:46.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.448+0000 7fa51ec87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:46.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.448+0000 7fa51ec87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:46.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.448+0000 7fa51ec87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:46.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.448+0000 7fa51ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.448+0000 7fa51ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.448+0000 7fa51ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.448+0000 7fa51ec87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:46.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.448+0000 7fa51ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.449+0000 7fa51ec87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:28:46.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.449+0000 7fa51ec87800 20 zone default found 2024-09-12T17:28:46.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.449+0000 7fa51ec87800 4 Realm: () 2024-09-12T17:28:46.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.449+0000 7fa51ec87800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:28:46.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.449+0000 7fa51ec87800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:28:46.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.449+0000 7fa51ec87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:46.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.449+0000 7fa51ec87800 20 zonegroup default 2024-09-12T17:28:46.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.449+0000 7fa51ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.449+0000 7fa51ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.449+0000 7fa51ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.449+0000 7fa51ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.449+0000 7fa51ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.449+0000 7fa51ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.449+0000 7fa51ec87800 20 started sync module instance, tier type = 2024-09-12T17:28:46.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.449+0000 7fa51ec87800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:28:46.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.458+0000 7fa51ec87800 20 add_watcher() i=0 2024-09-12T17:28:46.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.458+0000 7fa51ec87800 20 add_watcher() i=1 2024-09-12T17:28:46.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.458+0000 7fa51ec87800 20 add_watcher() i=2 2024-09-12T17:28:46.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.458+0000 7fa51ec87800 20 add_watcher() i=3 2024-09-12T17:28:46.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.458+0000 7fa51ec87800 20 add_watcher() i=4 2024-09-12T17:28:46.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.458+0000 7fa51ec87800 20 add_watcher() i=5 2024-09-12T17:28:46.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.458+0000 7fa51ec87800 20 add_watcher() i=6 2024-09-12T17:28:46.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.459+0000 7fa51ec87800 20 add_watcher() i=7 2024-09-12T17:28:46.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.459+0000 7fa51ec87800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:46.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.460+0000 7fa3d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:46.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.461+0000 7fa51ec87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:46.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.461+0000 7fa51ec87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:46.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.461+0000 7fa51ec87800 5 note: GC not initialized 2024-09-12T17:28:46.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.461+0000 7fa3d1fdb640 20 reqs_thread_entry: start 2024-09-12T17:28:46.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.461+0000 7fa51ec87800 20 init_complete bucket index max shards: 1 2024-09-12T17:28:46.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.461+0000 7fa51ec87800 20 Filter name: none 2024-09-12T17:28:46.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.461+0000 7fa3437fe640 20 reqs_thread_entry: start 2024-09-12T17:28:46.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.461+0000 7fa51ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.462+0000 7fa51ec87800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:28:46.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.462+0000 7fa51ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.462+0000 7fa51ec87800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:28:46.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.462+0000 7fa51ec87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:28:46.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.462+0000 7fa51ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.463+0000 7fa51ec87800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:28:46.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.463+0000 7fa51ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.463+0000 7fa51ec87800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:28:46.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.463+0000 7fa51ec87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:28:46.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.464+0000 7fa3d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:46.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.466+0000 7fa51ec87800 20 remove_watcher() i=0 2024-09-12T17:28:46.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.466+0000 7fa51ec87800 2 removed watcher, disabling cache 2024-09-12T17:28:46.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.467+0000 7fa51ec87800 20 remove_watcher() i=1 2024-09-12T17:28:46.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.468+0000 7fa51ec87800 20 remove_watcher() i=2 2024-09-12T17:28:46.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.469+0000 7fa51ec87800 20 remove_watcher() i=3 2024-09-12T17:28:46.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.470+0000 7fa51ec87800 20 remove_watcher() i=4 2024-09-12T17:28:46.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.471+0000 7fa51ec87800 20 remove_watcher() i=5 2024-09-12T17:28:46.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.472+0000 7fa51ec87800 20 remove_watcher() i=6 2024-09-12T17:28:46.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.473+0000 7fa51ec87800 20 remove_watcher() i=7 2024-09-12T17:28:46.485 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.485 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:28:46.485 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: a-bucket id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 num_objects: 10 size_kb: 1 num_shards: 3 2024-09-12T17:28:46.485 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.487 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T17:28:46.521 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:46.521 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:46.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.561+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.562+0000 7f6faab17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.562+0000 7f6faab17800 20 realm 2024-09-12T17:28:46.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.562+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.562+0000 7f6faab17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.562+0000 7f6faab17800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:46.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.562+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.562+0000 7f6faab17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.562+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.563+0000 7f6faab17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:46.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.563+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.564+0000 7f6faab17800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:28:46.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.564+0000 7f6faab17800 20 searching for the correct realm 2024-09-12T17:28:46.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.566+0000 7f6fa7e00640 0 -- 172.21.15.67:0/2094100010 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f6f98018070 msgr2=0x7f6f9808c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:46.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.570+0000 7f6fa8601640 0 -- 172.21.15.67:0/2094100010 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f6f9c0a0b10 msgr2=0x7f6f9c0ab920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:46.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.776+0000 7f6faab17800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:28:46.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.776+0000 7f6faab17800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:28:46.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.776+0000 7f6faab17800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:46.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.776+0000 7f6faab17800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:46.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.776+0000 7f6faab17800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:46.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.776+0000 7f6faab17800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:46.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.776+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.776+0000 7f6faab17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.776+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.776+0000 7f6faab17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:46.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.776+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.777+0000 7f6faab17800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:28:46.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.777+0000 7f6faab17800 20 zone default found 2024-09-12T17:28:46.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.777+0000 7f6faab17800 4 Realm: () 2024-09-12T17:28:46.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.777+0000 7f6faab17800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:28:46.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.777+0000 7f6faab17800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:28:46.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.777+0000 7f6faab17800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:46.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.777+0000 7f6faab17800 20 zonegroup default 2024-09-12T17:28:46.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.777+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.777+0000 7f6faab17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.777+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.777+0000 7f6faab17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.777+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.777+0000 7f6faab17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.777+0000 7f6faab17800 20 started sync module instance, tier type = 2024-09-12T17:28:46.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.777+0000 7f6faab17800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:28:46.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.787+0000 7f6faab17800 20 add_watcher() i=0 2024-09-12T17:28:46.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.787+0000 7f6faab17800 20 add_watcher() i=1 2024-09-12T17:28:46.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.787+0000 7f6faab17800 20 add_watcher() i=2 2024-09-12T17:28:46.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.787+0000 7f6faab17800 20 add_watcher() i=3 2024-09-12T17:28:46.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.787+0000 7f6faab17800 20 add_watcher() i=4 2024-09-12T17:28:46.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.787+0000 7f6faab17800 20 add_watcher() i=5 2024-09-12T17:28:46.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.787+0000 7f6faab17800 20 add_watcher() i=6 2024-09-12T17:28:46.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.788+0000 7f6faab17800 20 add_watcher() i=7 2024-09-12T17:28:46.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.788+0000 7f6faab17800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:46.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.790+0000 7f6e5efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:46.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.790+0000 7f6faab17800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:46.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.790+0000 7f6faab17800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:46.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.790+0000 7f6faab17800 5 note: GC not initialized 2024-09-12T17:28:46.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.790+0000 7f6e5dfdb640 20 reqs_thread_entry: start 2024-09-12T17:28:46.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.790+0000 7f6faab17800 20 init_complete bucket index max shards: 1 2024-09-12T17:28:46.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.790+0000 7f6faab17800 20 Filter name: none 2024-09-12T17:28:46.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.791+0000 7f6dcf7fe640 20 reqs_thread_entry: start 2024-09-12T17:28:46.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.791+0000 7f6faab17800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:28:46.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.791+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.791+0000 7f6faab17800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:28:46.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.791+0000 7f6faab17800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:28:46.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.791+0000 7f6faab17800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:28:46.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.791+0000 7f6faab17800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : miss 2024-09-12T17:28:46.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.791+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.792+0000 7f6faab17800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:28:46.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.792+0000 7f6faab17800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:28:46.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.792+0000 7f6faab17800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:28:46.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.792+0000 7f6faab17800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:46.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.792+0000 7f6faab17800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:28:46.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.792+0000 7f6faab17800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:28:46.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.796+0000 7f6faab17800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:28:46.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.796+0000 7f6faab17800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:28:46.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.796+0000 7f6faab17800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:28:46.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.796+0000 7f6faab17800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18, ofs0, ns] 2024-09-12T17:28:46.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.796+0000 7f6e7f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464369 cookie 94556300812704 notifier 8286 bl.length()=911 2024-09-12T17:28:46.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.796+0000 7f6e7f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:28:46.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.796+0000 7f6e7f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:28:46.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.796+0000 7f6e7f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:28:46.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.798+0000 7f6faab17800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_sources= new_sources= 2024-09-12T17:28:46.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.798+0000 7f6faab17800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:28:46.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.798+0000 7f6faab17800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_dests= new_dests= 2024-09-12T17:28:46.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.798+0000 7f6faab17800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:28:46.801 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6faab17800 time 2024-09-12T17:28:46.801718+0000 2024-09-12T17:28:46.801 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:28:46.802 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:28:46.802 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6fadf8c71a] 2024-09-12T17:28:46.802 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6fadf8c8d8] 2024-09-12T17:28:46.802 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff98e04841] 2024-09-12T17:28:46.802 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ff98e1457a] 2024-09-12T17:28:46.803 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T17:28:46.803 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f6facc29590] 2024-09-12T17:28:46.803 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T17:28:46.803 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T17:28:46.803 INFO:tasks.workunit.client.0.smithi067.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:28:46.803 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f6faab17800 thread_name:radosgw-admin 2024-09-12T17:28:46.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.801+0000 7f6faab17800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6faab17800 time 2024-09-12T17:28:46.801718+0000 2024-09-12T17:28:46.803 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:28:46.803 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.803 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:28:46.803 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6fadf8c71a] 2024-09-12T17:28:46.803 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6fadf8c8d8] 2024-09-12T17:28:46.803 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff98e04841] 2024-09-12T17:28:46.804 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ff98e1457a] 2024-09-12T17:28:46.804 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T17:28:46.804 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f6facc29590] 2024-09-12T17:28:46.804 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T17:28:46.804 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T17:28:46.804 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.818 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:28:46.818 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6facc3e6f0] 2024-09-12T17:28:46.818 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6facc8b99c] 2024-09-12T17:28:46.819 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:28:46.819 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:28:46.819 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6fadf8c774] 2024-09-12T17:28:46.819 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6fadf8c8d8] 2024-09-12T17:28:46.819 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff98e04841] 2024-09-12T17:28:46.819 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ff98e1457a] 2024-09-12T17:28:46.819 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T17:28:46.819 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f6facc29590] 2024-09-12T17:28:46.819 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T17:28:46.819 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T17:28:46.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.802+0000 7f6faab17800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:28:46.819 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f6faab17800 thread_name:radosgw-admin 2024-09-12T17:28:46.819 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.820 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:28:46.820 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6facc3e6f0] 2024-09-12T17:28:46.820 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6facc8b99c] 2024-09-12T17:28:46.820 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:28:46.820 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:28:46.820 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6fadf8c774] 2024-09-12T17:28:46.821 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6fadf8c8d8] 2024-09-12T17:28:46.821 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff98e04841] 2024-09-12T17:28:46.821 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ff98e1457a] 2024-09-12T17:28:46.821 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T17:28:46.821 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f6facc29590] 2024-09-12T17:28:46.821 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T17:28:46.821 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T17:28:46.822 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:28:46.822 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.822 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T17:28:46.822 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T17:28:46.544+0000 7f6faab17800 10 monclient: monmap: 2024-09-12T17:28:46.822 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:28:46.822 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:28:46.823 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:28:46.823 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:28:46.823 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:28:46.823 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:46.823 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:28:46.823 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:28:46.824 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:28:46.824 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.824 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding auth protocol: cephx 2024-09-12T17:28:46.824 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding auth protocol: cephx 2024-09-12T17:28:46.824 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding auth protocol: cephx 2024-09-12T17:28:46.824 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding con mode: secure 2024-09-12T17:28:46.825 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding con mode: crc 2024-09-12T17:28:46.825 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding con mode: secure 2024-09-12T17:28:46.825 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding con mode: crc 2024-09-12T17:28:46.825 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding con mode: secure 2024-09-12T17:28:46.825 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding con mode: crc 2024-09-12T17:28:46.826 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding con mode: crc 2024-09-12T17:28:46.826 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding con mode: secure 2024-09-12T17:28:46.826 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding con mode: crc 2024-09-12T17:28:46.826 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding con mode: secure 2024-09-12T17:28:46.826 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding con mode: crc 2024-09-12T17:28:46.826 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding con mode: secure 2024-09-12T17:28:46.827 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T17:28:46.544+0000 7f6faab17800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:46.827 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T17:28:46.544+0000 7f6faab17800 1 librados: starting msgr at 2024-09-12T17:28:46.827 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T17:28:46.544+0000 7f6faab17800 1 librados: starting objecter 2024-09-12T17:28:46.827 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command objecter_requests hook 0x55ff9aa91680 2024-09-12T17:28:46.827 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T17:28:46.544+0000 7f6faab17800 1 librados: setting wanted keys 2024-09-12T17:28:46.827 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T17:28:46.544+0000 7f6faab17800 1 librados: calling monclient init 2024-09-12T17:28:46.827 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T17:28:46.544+0000 7f6faab17800 10 monclient: init 2024-09-12T17:28:46.828 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding auth protocol: cephx 2024-09-12T17:28:46.829 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding auth protocol: cephx 2024-09-12T17:28:46.829 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding auth protocol: cephx 2024-09-12T17:28:46.829 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding con mode: secure 2024-09-12T17:28:46.829 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding con mode: crc 2024-09-12T17:28:46.829 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding con mode: secure 2024-09-12T17:28:46.830 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding con mode: crc 2024-09-12T17:28:46.830 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding con mode: secure 2024-09-12T17:28:46.830 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding con mode: crc 2024-09-12T17:28:46.830 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding con mode: crc 2024-09-12T17:28:46.830 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding con mode: secure 2024-09-12T17:28:46.831 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T17:28:46.545+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding con mode: crc 2024-09-12T17:28:46.831 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T17:28:46.545+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding con mode: secure 2024-09-12T17:28:46.831 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T17:28:46.545+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding con mode: crc 2024-09-12T17:28:46.831 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T17:28:46.545+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding con mode: secure 2024-09-12T17:28:46.831 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T17:28:46.545+0000 7f6faab17800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:46.831 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T17:28:46.545+0000 7f6faab17800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:46.832 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T17:28:46.545+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command rotate-key hook 0x55ff9aa8d9c8 2024-09-12T17:28:46.832 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T17:28:46.545+0000 7f6faab17800 10 monclient: _reopen_session rank -1 2024-09-12T17:28:46.832 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T17:28:46.545+0000 7f6faab17800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:28:46.832 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T17:28:46.545+0000 7f6faab17800 10 monclient(hunting): picked mon.noname-c con 0x55ff9a946ad0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:28:46.832 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T17:28:46.545+0000 7f6faab17800 10 monclient(hunting): picked mon.noname-a con 0x55ff9a9d68e0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:28:46.833 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T17:28:46.545+0000 7f6faab17800 10 monclient(hunting): picked mon.noname-b con 0x55ff9a9d7270 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:28:46.833 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T17:28:46.545+0000 7f6faab17800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:46.833 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T17:28:46.545+0000 7f6faab17800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:46.833 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T17:28:46.545+0000 7f6faab17800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:46.833 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T17:28:46.545+0000 7f6faab17800 10 monclient(hunting): _renew_subs 2024-09-12T17:28:46.833 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T17:28:46.545+0000 7f6faab17800 10 monclient(hunting): authenticate will time out at 2537.895519s 2024-09-12T17:28:46.833 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T17:28:46.545+0000 7f6fa8601640 10 monclient(hunting): get_auth_request con 0x55ff9a946ad0 auth_method 0 2024-09-12T17:28:46.833 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T17:28:46.545+0000 7f6fa8601640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:46.834 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T17:28:46.545+0000 7f6fa8601640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:46.834 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T17:28:46.545+0000 7f6fa8601640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:46.834 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T17:28:46.545+0000 7f6fa7e00640 10 monclient(hunting): get_auth_request con 0x55ff9a9d68e0 auth_method 0 2024-09-12T17:28:46.834 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T17:28:46.545+0000 7f6fa7e00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:46.834 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T17:28:46.545+0000 7f6fa7e00640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:46.834 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T17:28:46.545+0000 7f6fa7e00640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:46.834 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T17:28:46.545+0000 7f6fa8601640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:46.834 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T17:28:46.545+0000 7f6fa8601640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:46.834 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T17:28:46.545+0000 7f6fa8601640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:46.834 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T17:28:46.545+0000 7f6fa8e02640 10 monclient(hunting): get_auth_request con 0x55ff9a9d7270 auth_method 0 2024-09-12T17:28:46.835 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T17:28:46.545+0000 7f6fa8e02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:46.835 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T17:28:46.545+0000 7f6fa8e02640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:46.835 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T17:28:46.545+0000 7f6fa8e02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:46.835 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T17:28:46.545+0000 7f6fa7e00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:46.835 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T17:28:46.545+0000 7f6fa7e00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:46.835 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T17:28:46.545+0000 7f6fa7e00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:46.835 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T17:28:46.545+0000 7f6fa8e02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:46.835 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T17:28:46.545+0000 7f6fa8e02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:46.835 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T17:28:46.545+0000 7f6fa8e02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:46.835 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T17:28:46.545+0000 7f6fa8601640 10 monclient(hunting): handle_auth_done global_id 7760 payload 824 2024-09-12T17:28:46.835 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T17:28:46.545+0000 7f6fa8601640 10 monclient: _finish_hunting 0 2024-09-12T17:28:46.836 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T17:28:46.545+0000 7f6fa8601640 1 monclient: found mon.noname-c 2024-09-12T17:28:46.836 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T17:28:46.545+0000 7f6fa8601640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:28:46.836 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T17:28:46.546+0000 7f6e94e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:46.836 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T17:28:46.546+0000 7f6e94e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:28:46.836 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T17:28:46.546+0000 7f6e94e09640 10 monclient: dump: 2024-09-12T17:28:46.836 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:46.836 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:46.836 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.836 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.836 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:46.836 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:46.836 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:46.836 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:46.837 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:46.837 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.837 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T17:28:46.546+0000 7f6e94e09640 10 monclient: _finish_auth 0 2024-09-12T17:28:46.837 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T17:28:46.546+0000 7f6e94e09640 10 monclient: _check_auth_tickets 2024-09-12T17:28:46.837 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T17:28:46.546+0000 7f6e94e09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:28:46.837 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T17:28:46.546+0000 7f6e94e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:46.837 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T17:28:46.546+0000 7f6e94e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:28:46.837 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T17:28:46.546+0000 7f6e94e09640 10 monclient: dump: 2024-09-12T17:28:46.837 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:46.837 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:46.837 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.837 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.837 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:46.837 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:46.838 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:46.838 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:46.838 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:46.838 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.838 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T17:28:46.546+0000 7f6faab17800 5 monclient: authenticate success, global_id 7760 2024-09-12T17:28:46.838 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T17:28:46.546+0000 7f6faab17800 10 monclient: _renew_subs 2024-09-12T17:28:46.838 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T17:28:46.546+0000 7f6faab17800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:28:46.838 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T17:28:46.546+0000 7f6e9660c640 4 set_mon_vals no callback set 2024-09-12T17:28:46.838 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T17:28:46.546+0000 7f6faab17800 10 monclient: _renew_subs 2024-09-12T17:28:46.838 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T17:28:46.546+0000 7f6faab17800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:28:46.838 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T17:28:46.546+0000 7f6faab17800 1 librados: init done 2024-09-12T17:28:46.838 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T17:28:46.548+0000 7f6e94e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:28:46.839 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T17:28:46.548+0000 7f6e94e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:28:46.839 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T17:28:46.548+0000 7f6e94e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:28:46.839 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T17:28:46.548+0000 7f6fa7e00640 10 monclient: get_auth_request con 0x7f6e900764c0 auth_method 0 2024-09-12T17:28:46.839 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T17:28:46.548+0000 7f6fa8e02640 10 monclient: get_auth_request con 0x55ff9aad6840 auth_method 0 2024-09-12T17:28:46.839 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T17:28:46.549+0000 7f6fa8601640 10 monclient: get_auth_request con 0x55ff9aad9a20 auth_method 0 2024-09-12T17:28:46.839 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T17:28:46.550+0000 7f6fa7e00640 10 monclient: get_auth_request con 0x55ff9aade0c0 auth_method 0 2024-09-12T17:28:46.839 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T17:28:46.551+0000 7f6faab17800 10 monclient: build_initial_monmap 2024-09-12T17:28:46.839 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T17:28:46.551+0000 7f6faab17800 1 build_initial for_mkfs: 0 2024-09-12T17:28:46.839 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T17:28:46.551+0000 7f6faab17800 10 monclient: monmap: 2024-09-12T17:28:46.839 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:28:46.840 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:28:46.840 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:28:46.840 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:28:46.840 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:28:46.840 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:46.840 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:28:46.840 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:28:46.840 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:28:46.840 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.840 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding auth protocol: cephx 2024-09-12T17:28:46.840 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding auth protocol: cephx 2024-09-12T17:28:46.840 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding auth protocol: cephx 2024-09-12T17:28:46.841 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding con mode: secure 2024-09-12T17:28:46.841 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding con mode: crc 2024-09-12T17:28:46.841 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding con mode: secure 2024-09-12T17:28:46.841 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding con mode: crc 2024-09-12T17:28:46.841 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding con mode: secure 2024-09-12T17:28:46.841 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding con mode: crc 2024-09-12T17:28:46.841 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding con mode: crc 2024-09-12T17:28:46.841 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding con mode: secure 2024-09-12T17:28:46.841 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding con mode: crc 2024-09-12T17:28:46.841 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding con mode: secure 2024-09-12T17:28:46.841 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding con mode: crc 2024-09-12T17:28:46.841 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding con mode: secure 2024-09-12T17:28:46.841 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T17:28:46.551+0000 7f6faab17800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:46.842 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command objecter_requests cmddesc objecter_requests hook 0x55ff9aae6200 EEXIST 2024-09-12T17:28:46.842 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T17:28:46.552+0000 7f6faab17800 10 monclient: init 2024-09-12T17:28:46.842 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding auth protocol: cephx 2024-09-12T17:28:46.842 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding auth protocol: cephx 2024-09-12T17:28:46.842 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding auth protocol: cephx 2024-09-12T17:28:46.842 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding con mode: secure 2024-09-12T17:28:46.842 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding con mode: crc 2024-09-12T17:28:46.842 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding con mode: secure 2024-09-12T17:28:46.842 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding con mode: crc 2024-09-12T17:28:46.843 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding con mode: secure 2024-09-12T17:28:46.843 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding con mode: crc 2024-09-12T17:28:46.843 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding con mode: crc 2024-09-12T17:28:46.843 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding con mode: secure 2024-09-12T17:28:46.843 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding con mode: crc 2024-09-12T17:28:46.843 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding con mode: secure 2024-09-12T17:28:46.844 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding con mode: crc 2024-09-12T17:28:46.844 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding con mode: secure 2024-09-12T17:28:46.844 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T17:28:46.552+0000 7f6faab17800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:46.844 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T17:28:46.552+0000 7f6faab17800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:46.844 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command rotate-key cmddesc rotate-key hook 0x55ff9aae15b0 EEXIST 2024-09-12T17:28:46.844 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T17:28:46.552+0000 7f6faab17800 10 monclient: _reopen_session rank -1 2024-09-12T17:28:46.845 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T17:28:46.552+0000 7f6faab17800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:28:46.845 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T17:28:46.552+0000 7f6faab17800 10 monclient(hunting): picked mon.noname-b con 0x55ff9ab0a520 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:28:46.845 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T17:28:46.552+0000 7f6faab17800 10 monclient(hunting): picked mon.noname-a con 0x55ff9ab0a900 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:28:46.845 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T17:28:46.552+0000 7f6faab17800 10 monclient(hunting): picked mon.noname-c con 0x55ff9ab09230 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:28:46.845 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T17:28:46.552+0000 7f6faab17800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:46.845 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T17:28:46.552+0000 7f6faab17800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:46.845 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T17:28:46.552+0000 7f6faab17800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:46.846 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T17:28:46.552+0000 7f6faab17800 10 monclient(hunting): _renew_subs 2024-09-12T17:28:46.846 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T17:28:46.552+0000 7f6faab17800 10 monclient(hunting): authenticate will time out at 2537.902784s 2024-09-12T17:28:46.846 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T17:28:46.552+0000 7f6fa8601640 10 monclient(hunting): get_auth_request con 0x55ff9ab0a520 auth_method 0 2024-09-12T17:28:46.846 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T17:28:46.552+0000 7f6fa8601640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:46.846 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T17:28:46.552+0000 7f6fa8601640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:46.846 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T17:28:46.552+0000 7f6fa8601640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:46.846 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T17:28:46.552+0000 7f6fa7e00640 10 monclient(hunting): get_auth_request con 0x55ff9ab0a900 auth_method 0 2024-09-12T17:28:46.846 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T17:28:46.552+0000 7f6fa7e00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:46.847 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T17:28:46.552+0000 7f6fa7e00640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:46.847 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T17:28:46.552+0000 7f6fa7e00640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:46.847 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T17:28:46.552+0000 7f6fa8e02640 10 monclient(hunting): get_auth_request con 0x55ff9ab09230 auth_method 0 2024-09-12T17:28:46.847 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T17:28:46.552+0000 7f6fa8e02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:46.847 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T17:28:46.552+0000 7f6fa8e02640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:46.847 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T17:28:46.552+0000 7f6fa8e02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:46.848 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T17:28:46.552+0000 7f6fa8601640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:46.848 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T17:28:46.552+0000 7f6fa8601640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:46.848 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T17:28:46.552+0000 7f6fa8601640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:46.848 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T17:28:46.552+0000 7f6fa7e00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:46.848 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T17:28:46.552+0000 7f6fa7e00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:46.848 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T17:28:46.552+0000 7f6fa7e00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:46.848 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T17:28:46.552+0000 7f6fa8e02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:46.849 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T17:28:46.552+0000 7f6fa8e02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:46.849 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T17:28:46.552+0000 7f6fa8e02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:46.849 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T17:28:46.553+0000 7f6fa8601640 10 monclient(hunting): handle_auth_done global_id 7588 payload 824 2024-09-12T17:28:46.849 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T17:28:46.553+0000 7f6fa8601640 10 monclient: _finish_hunting 0 2024-09-12T17:28:46.849 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T17:28:46.553+0000 7f6fa8601640 1 monclient: found mon.noname-b 2024-09-12T17:28:46.849 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T17:28:46.553+0000 7f6fa8601640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.118:3300/0 2024-09-12T17:28:46.850 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T17:28:46.553+0000 7f6e8dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:46.850 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T17:28:46.553+0000 7f6e8dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-12T17:28:46.850 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T17:28:46.553+0000 7f6e8dffb640 10 monclient: dump: 2024-09-12T17:28:46.850 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:46.850 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:46.850 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.850 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.850 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:46.850 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:46.850 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:46.851 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:46.851 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:46.851 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.851 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T17:28:46.553+0000 7f6e8dffb640 10 monclient: _finish_auth 0 2024-09-12T17:28:46.851 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T17:28:46.553+0000 7f6e8dffb640 10 monclient: _check_auth_tickets 2024-09-12T17:28:46.851 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T17:28:46.553+0000 7f6e8dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:28:46.851 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T17:28:46.553+0000 7f6faab17800 5 monclient: authenticate success, global_id 7588 2024-09-12T17:28:46.851 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T17:28:46.553+0000 7f6e8dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:46.851 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T17:28:46.553+0000 7f6e8dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-12T17:28:46.851 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T17:28:46.553+0000 7f6e8dffb640 10 monclient: dump: 2024-09-12T17:28:46.852 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:46.852 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:46.852 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.852 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.852 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:46.852 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:46.852 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:46.852 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:46.852 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:46.853 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.853 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T17:28:46.553+0000 7f6faab17800 10 monclient: _renew_subs 2024-09-12T17:28:46.853 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T17:28:46.553+0000 7f6fa9603640 4 set_mon_vals no callback set 2024-09-12T17:28:46.853 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T17:28:46.553+0000 7f6faab17800 10 monclient: _send_mon_message to mon.b at v2:172.21.15.118:3300/0 2024-09-12T17:28:46.853 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T17:28:46.553+0000 7f6faab17800 10 monclient: _renew_subs 2024-09-12T17:28:46.853 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T17:28:46.553+0000 7f6faab17800 10 monclient: _send_mon_message to mon.b at v2:172.21.15.118:3300/0 2024-09-12T17:28:46.853 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T17:28:46.555+0000 7f6e8dffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:28:46.853 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T17:28:46.555+0000 7f6e8dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:28:46.854 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T17:28:46.555+0000 7f6e8dffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:28:46.854 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T17:28:46.555+0000 7f6fa7e00640 10 monclient: get_auth_request con 0x7f6e80076380 auth_method 0 2024-09-12T17:28:46.854 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T17:28:46.555+0000 7f6faab17800 10 monclient: get_monmap_and_config 2024-09-12T17:28:46.854 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T17:28:46.555+0000 7f6faab17800 10 monclient: build_initial_monmap 2024-09-12T17:28:46.854 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T17:28:46.555+0000 7f6faab17800 1 build_initial for_mkfs: 0 2024-09-12T17:28:46.854 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T17:28:46.555+0000 7f6faab17800 10 monclient: monmap: 2024-09-12T17:28:46.855 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:28:46.855 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:28:46.855 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:28:46.855 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:28:46.855 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:28:46.855 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:46.856 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:28:46.856 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:28:46.856 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:28:46.856 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.856 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding auth protocol: cephx 2024-09-12T17:28:46.856 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding auth protocol: cephx 2024-09-12T17:28:46.857 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding auth protocol: cephx 2024-09-12T17:28:46.857 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding con mode: secure 2024-09-12T17:28:46.857 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding con mode: crc 2024-09-12T17:28:46.857 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding con mode: secure 2024-09-12T17:28:46.857 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding con mode: crc 2024-09-12T17:28:46.858 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding con mode: secure 2024-09-12T17:28:46.858 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding con mode: crc 2024-09-12T17:28:46.858 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding con mode: crc 2024-09-12T17:28:46.858 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding con mode: secure 2024-09-12T17:28:46.858 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding con mode: crc 2024-09-12T17:28:46.858 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding con mode: secure 2024-09-12T17:28:46.858 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding con mode: crc 2024-09-12T17:28:46.858 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding con mode: secure 2024-09-12T17:28:46.858 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T17:28:46.555+0000 7f6faab17800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:46.858 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T17:28:46.556+0000 7f6faab17800 10 monclient: init 2024-09-12T17:28:46.858 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding auth protocol: cephx 2024-09-12T17:28:46.858 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding auth protocol: cephx 2024-09-12T17:28:46.859 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding auth protocol: cephx 2024-09-12T17:28:46.859 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding con mode: secure 2024-09-12T17:28:46.859 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding con mode: crc 2024-09-12T17:28:46.859 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding con mode: secure 2024-09-12T17:28:46.859 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding con mode: crc 2024-09-12T17:28:46.859 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding con mode: secure 2024-09-12T17:28:46.859 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding con mode: crc 2024-09-12T17:28:46.859 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding con mode: crc 2024-09-12T17:28:46.859 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding con mode: secure 2024-09-12T17:28:46.859 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding con mode: crc 2024-09-12T17:28:46.859 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding con mode: secure 2024-09-12T17:28:46.860 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding con mode: crc 2024-09-12T17:28:46.860 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding con mode: secure 2024-09-12T17:28:46.860 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T17:28:46.556+0000 7f6faab17800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:46.860 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T17:28:46.556+0000 7f6faab17800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:46.860 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command rotate-key cmddesc rotate-key hook 0x7ffe1b16f8a8 EEXIST 2024-09-12T17:28:46.860 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T17:28:46.556+0000 7f6faab17800 10 monclient: _reopen_session rank -1 2024-09-12T17:28:46.860 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T17:28:46.556+0000 7f6faab17800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:28:46.860 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T17:28:46.556+0000 7f6faab17800 10 monclient(hunting): picked mon.noname-b con 0x55ff9ab5eb10 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:28:46.860 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T17:28:46.556+0000 7f6faab17800 10 monclient(hunting): picked mon.noname-c con 0x55ff9ab2fa60 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:28:46.860 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T17:28:46.556+0000 7f6faab17800 10 monclient(hunting): picked mon.noname-a con 0x55ff9ab5a3b0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:28:46.860 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T17:28:46.556+0000 7f6faab17800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:46.860 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T17:28:46.556+0000 7f6faab17800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:46.861 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T17:28:46.556+0000 7f6faab17800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:46.861 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T17:28:46.556+0000 7f6faab17800 10 monclient(hunting): _renew_subs 2024-09-12T17:28:46.861 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T17:28:46.556+0000 7f6faab17800 10 monclient(hunting): authenticate will time out at 2537.906602s 2024-09-12T17:28:46.861 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T17:28:46.556+0000 7f6fa8e02640 10 monclient(hunting): get_auth_request con 0x55ff9ab5a3b0 auth_method 0 2024-09-12T17:28:46.861 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T17:28:46.556+0000 7f6fa8e02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:46.861 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T17:28:46.556+0000 7f6fa8e02640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:46.861 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T17:28:46.556+0000 7f6fa8e02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:46.861 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T17:28:46.556+0000 7f6fa7e00640 10 monclient(hunting): get_auth_request con 0x55ff9ab2fa60 auth_method 0 2024-09-12T17:28:46.861 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T17:28:46.556+0000 7f6fa7e00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:46.861 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T17:28:46.556+0000 7f6fa7e00640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:46.861 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T17:28:46.556+0000 7f6fa7e00640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:46.862 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T17:28:46.556+0000 7f6fa8601640 10 monclient(hunting): get_auth_request con 0x55ff9ab5eb10 auth_method 0 2024-09-12T17:28:46.862 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T17:28:46.556+0000 7f6fa8601640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:46.862 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T17:28:46.556+0000 7f6fa8601640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:46.862 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T17:28:46.556+0000 7f6fa8601640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:46.862 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T17:28:46.556+0000 7f6fa8e02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:46.862 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T17:28:46.556+0000 7f6fa8e02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:46.862 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T17:28:46.556+0000 7f6fa8e02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:46.862 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T17:28:46.556+0000 7f6fa7e00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:46.862 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T17:28:46.556+0000 7f6fa7e00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:46.862 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T17:28:46.556+0000 7f6fa7e00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:46.863 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T17:28:46.556+0000 7f6fa8601640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:46.863 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T17:28:46.556+0000 7f6fa8601640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:46.863 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T17:28:46.556+0000 7f6fa8601640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:46.863 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T17:28:46.556+0000 7f6fa8e02640 10 monclient(hunting): handle_auth_done global_id 8283 payload 274 2024-09-12T17:28:46.863 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T17:28:46.556+0000 7f6fa8e02640 10 monclient: _finish_hunting 0 2024-09-12T17:28:46.863 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T17:28:46.556+0000 7f6fa8e02640 1 monclient: found mon.noname-a 2024-09-12T17:28:46.863 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T17:28:46.556+0000 7f6fa8e02640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:28:46.863 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T17:28:46.557+0000 7f6e7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:46.864 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T17:28:46.557+0000 7f6e7f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:28:46.864 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T17:28:46.557+0000 7f6e7f7fe640 10 monclient: dump: 2024-09-12T17:28:46.864 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:46.864 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:46.864 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.864 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.864 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:46.864 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:46.864 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:46.864 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:46.865 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:46.865 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.865 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T17:28:46.557+0000 7f6e7f7fe640 10 monclient: _finish_auth 0 2024-09-12T17:28:46.865 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T17:28:46.557+0000 7f6e7f7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:28:46.865 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T17:28:46.557+0000 7f6e7f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:28:46.865 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 monclient: authenticate success, global_id 8283 2024-09-12T17:28:46.865 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T17:28:46.557+0000 7f6faab17800 10 monclient: get_monmap_and_config success 2024-09-12T17:28:46.865 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T17:28:46.557+0000 7f6faab17800 4 set_mon_vals no callback set 2024-09-12T17:28:46.865 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T17:28:46.557+0000 7f6e7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:46.865 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T17:28:46.557+0000 7f6e7f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:28:46.865 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T17:28:46.557+0000 7f6e7f7fe640 10 monclient: dump: 2024-09-12T17:28:46.865 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:46.865 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:46.866 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.866 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.866 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:46.866 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:46.866 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:46.866 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:46.866 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:46.866 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.866 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T17:28:46.557+0000 7f6faab17800 10 monclient: shutdown 2024-09-12T17:28:46.866 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T17:28:46.557+0000 7f6faab17800 10 monclient: build_initial_monmap 2024-09-12T17:28:46.866 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T17:28:46.557+0000 7f6faab17800 1 build_initial for_mkfs: 0 2024-09-12T17:28:46.866 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T17:28:46.557+0000 7f6faab17800 10 monclient: monmap: 2024-09-12T17:28:46.866 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:28:46.867 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:28:46.867 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:28:46.867 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:28:46.867 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:28:46.867 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:46.867 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:28:46.867 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:28:46.867 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:28:46.867 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.867 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding auth protocol: cephx 2024-09-12T17:28:46.867 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding auth protocol: cephx 2024-09-12T17:28:46.867 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding auth protocol: cephx 2024-09-12T17:28:46.868 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding con mode: secure 2024-09-12T17:28:46.868 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding con mode: crc 2024-09-12T17:28:46.868 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding con mode: secure 2024-09-12T17:28:46.868 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding con mode: crc 2024-09-12T17:28:46.868 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding con mode: secure 2024-09-12T17:28:46.868 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding con mode: crc 2024-09-12T17:28:46.868 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding con mode: crc 2024-09-12T17:28:46.869 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding con mode: secure 2024-09-12T17:28:46.869 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding con mode: crc 2024-09-12T17:28:46.869 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding con mode: secure 2024-09-12T17:28:46.869 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding con mode: crc 2024-09-12T17:28:46.869 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding con mode: secure 2024-09-12T17:28:46.869 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T17:28:46.558+0000 7f6faab17800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:46.869 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T17:28:46.558+0000 7f6faab17800 1 librados: starting msgr at 2024-09-12T17:28:46.869 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T17:28:46.558+0000 7f6faab17800 1 librados: starting objecter 2024-09-12T17:28:46.869 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command objecter_requests cmddesc objecter_requests hook 0x55ff9ab0f680 EEXIST 2024-09-12T17:28:46.869 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T17:28:46.558+0000 7f6faab17800 1 librados: setting wanted keys 2024-09-12T17:28:46.869 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T17:28:46.558+0000 7f6faab17800 1 librados: calling monclient init 2024-09-12T17:28:46.869 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T17:28:46.558+0000 7f6faab17800 10 monclient: init 2024-09-12T17:28:46.869 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding auth protocol: cephx 2024-09-12T17:28:46.870 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding auth protocol: cephx 2024-09-12T17:28:46.870 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding auth protocol: cephx 2024-09-12T17:28:46.870 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding con mode: secure 2024-09-12T17:28:46.870 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding con mode: crc 2024-09-12T17:28:46.870 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding con mode: secure 2024-09-12T17:28:46.870 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding con mode: crc 2024-09-12T17:28:46.870 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding con mode: secure 2024-09-12T17:28:46.870 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding con mode: crc 2024-09-12T17:28:46.870 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding con mode: crc 2024-09-12T17:28:46.870 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding con mode: secure 2024-09-12T17:28:46.870 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding con mode: crc 2024-09-12T17:28:46.871 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding con mode: secure 2024-09-12T17:28:46.871 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding con mode: crc 2024-09-12T17:28:46.871 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding con mode: secure 2024-09-12T17:28:46.871 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T17:28:46.558+0000 7f6faab17800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:46.871 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T17:28:46.558+0000 7f6faab17800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:46.871 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command rotate-key cmddesc rotate-key hook 0x55ff9ab1ef28 EEXIST 2024-09-12T17:28:46.871 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T17:28:46.558+0000 7f6faab17800 10 monclient: _reopen_session rank -1 2024-09-12T17:28:46.871 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T17:28:46.558+0000 7f6faab17800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:28:46.871 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T17:28:46.558+0000 7f6faab17800 10 monclient(hunting): picked mon.noname-a con 0x55ff9ab2fa60 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:28:46.871 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T17:28:46.558+0000 7f6faab17800 10 monclient(hunting): picked mon.noname-c con 0x55ff9ab5a3b0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:28:46.871 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T17:28:46.558+0000 7f6faab17800 10 monclient(hunting): picked mon.noname-b con 0x55ff9ab5eb10 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:28:46.871 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T17:28:46.558+0000 7f6faab17800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:46.871 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T17:28:46.558+0000 7f6faab17800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:46.872 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T17:28:46.558+0000 7f6faab17800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:46.872 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T17:28:46.558+0000 7f6faab17800 10 monclient(hunting): _renew_subs 2024-09-12T17:28:46.872 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T17:28:46.558+0000 7f6faab17800 10 monclient(hunting): authenticate will time out at 2537.908954s 2024-09-12T17:28:46.872 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T17:28:46.559+0000 7f6fa8601640 10 monclient(hunting): get_auth_request con 0x55ff9ab2fa60 auth_method 0 2024-09-12T17:28:46.872 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T17:28:46.559+0000 7f6fa8601640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:46.872 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T17:28:46.559+0000 7f6fa8601640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:46.872 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T17:28:46.559+0000 7f6fa8601640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:46.872 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T17:28:46.559+0000 7f6fa7e00640 10 monclient(hunting): get_auth_request con 0x55ff9ab5a3b0 auth_method 0 2024-09-12T17:28:46.872 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T17:28:46.559+0000 7f6fa7e00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:46.872 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T17:28:46.559+0000 7f6fa7e00640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:46.872 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T17:28:46.559+0000 7f6fa7e00640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:46.873 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T17:28:46.559+0000 7f6fa8601640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:46.873 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T17:28:46.559+0000 7f6fa8601640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:46.873 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T17:28:46.559+0000 7f6fa8601640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:46.873 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T17:28:46.559+0000 7f6fa8e02640 10 monclient(hunting): get_auth_request con 0x55ff9ab5eb10 auth_method 0 2024-09-12T17:28:46.873 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T17:28:46.559+0000 7f6fa8e02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:46.873 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T17:28:46.559+0000 7f6fa8e02640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:46.874 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T17:28:46.559+0000 7f6fa8e02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:46.874 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T17:28:46.559+0000 7f6fa7e00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:46.874 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T17:28:46.559+0000 7f6fa7e00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:46.874 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T17:28:46.559+0000 7f6fa7e00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:46.874 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T17:28:46.559+0000 7f6fa8e02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:46.874 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T17:28:46.559+0000 7f6fa8e02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:46.874 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T17:28:46.559+0000 7f6fa8e02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:46.874 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T17:28:46.559+0000 7f6fa8601640 10 monclient(hunting): handle_auth_done global_id 8286 payload 824 2024-09-12T17:28:46.874 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T17:28:46.559+0000 7f6fa8601640 10 monclient: _finish_hunting 0 2024-09-12T17:28:46.874 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T17:28:46.559+0000 7f6fa8601640 1 monclient: found mon.noname-a 2024-09-12T17:28:46.874 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T17:28:46.559+0000 7f6fa8601640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:28:46.874 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T17:28:46.559+0000 7f6e7dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:46.875 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T17:28:46.559+0000 7f6e7dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:28:46.875 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T17:28:46.559+0000 7f6e7dffb640 10 monclient: dump: 2024-09-12T17:28:46.875 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:46.875 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:46.875 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.875 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.875 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:46.875 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:46.875 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:46.875 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:46.875 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:46.875 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.876 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T17:28:46.559+0000 7f6e7dffb640 10 monclient: _finish_auth 0 2024-09-12T17:28:46.876 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T17:28:46.559+0000 7f6e7dffb640 10 monclient: _check_auth_tickets 2024-09-12T17:28:46.876 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T17:28:46.559+0000 7f6e7dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:28:46.876 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T17:28:46.559+0000 7f6e7dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:46.876 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T17:28:46.559+0000 7f6e7dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:28:46.876 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T17:28:46.559+0000 7f6e7dffb640 10 monclient: dump: 2024-09-12T17:28:46.876 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:46.876 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:46.876 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.876 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.877 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:46.877 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:46.877 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:46.877 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:46.877 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:46.877 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.877 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T17:28:46.559+0000 7f6faab17800 5 monclient: authenticate success, global_id 8286 2024-09-12T17:28:46.877 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T17:28:46.559+0000 7f6e7f7fe640 4 set_mon_vals no callback set 2024-09-12T17:28:46.877 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T17:28:46.559+0000 7f6faab17800 10 monclient: _renew_subs 2024-09-12T17:28:46.877 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T17:28:46.559+0000 7f6faab17800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:28:46.877 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T17:28:46.559+0000 7f6faab17800 10 monclient: _renew_subs 2024-09-12T17:28:46.877 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T17:28:46.559+0000 7f6faab17800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:28:46.877 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T17:28:46.559+0000 7f6faab17800 1 librados: init done 2024-09-12T17:28:46.878 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T17:28:46.559+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command cr dump hook 0x55ff9ab579a8 2024-09-12T17:28:46.878 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T17:28:46.561+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.878 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T17:28:46.561+0000 7f6e7dffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:28:46.878 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T17:28:46.561+0000 7f6e7dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:28:46.878 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T17:28:46.561+0000 7f6e7dffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:28:46.879 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T17:28:46.561+0000 7f6fa7e00640 10 monclient: get_auth_request con 0x7f6e70076470 auth_method 0 2024-09-12T17:28:46.879 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T17:28:46.561+0000 7f6fa8e02640 10 monclient: get_auth_request con 0x55ff9ab786f0 auth_method 0 2024-09-12T17:28:46.879 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T17:28:46.562+0000 7f6faab17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.879 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T17:28:46.562+0000 7f6faab17800 20 realm 2024-09-12T17:28:46.879 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T17:28:46.562+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.880 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T17:28:46.562+0000 7f6faab17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.880 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T17:28:46.562+0000 7f6faab17800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:46.880 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T17:28:46.562+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.880 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T17:28:46.562+0000 7f6faab17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.880 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T17:28:46.562+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.880 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T17:28:46.563+0000 7f6fa8601640 10 monclient: get_auth_request con 0x55ff9ab7c900 auth_method 0 2024-09-12T17:28:46.880 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T17:28:46.563+0000 7f6faab17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:46.880 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T17:28:46.563+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.880 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T17:28:46.563+0000 7f6fa7e00640 10 monclient: get_auth_request con 0x55ff9ab80160 auth_method 0 2024-09-12T17:28:46.880 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T17:28:46.564+0000 7f6faab17800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:28:46.881 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T17:28:46.564+0000 7f6faab17800 20 searching for the correct realm 2024-09-12T17:28:46.881 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T17:28:46.564+0000 7f6fa8e02640 10 monclient: get_auth_request con 0x55ff9ab84f00 auth_method 0 2024-09-12T17:28:46.881 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T17:28:46.565+0000 7f6fa8601640 10 monclient: get_auth_request con 0x7f6fa0033040 auth_method 0 2024-09-12T17:28:46.881 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T17:28:46.566+0000 7f6fa7e00640 10 monclient: get_auth_request con 0x7f6f98018070 auth_method 0 2024-09-12T17:28:46.881 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T17:28:46.566+0000 7f6fa7e00640 0 -- 172.21.15.67:0/2094100010 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f6f98018070 msgr2=0x7f6f9808c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:46.881 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T17:28:46.566+0000 7f6e7dffb640 1 client.8286.objecter ms_handle_reset 0x7f6f98018070 session 0x7f6f98084020 osd.2 2024-09-12T17:28:46.881 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T17:28:46.566+0000 7f6e7dffb640 10 monclient: _renew_subs 2024-09-12T17:28:46.881 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T17:28:46.566+0000 7f6e7dffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:28:46.881 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T17:28:46.566+0000 7f6fa7e00640 10 monclient: get_auth_request con 0x7f6e70086310 auth_method 0 2024-09-12T17:28:46.881 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T17:28:46.568+0000 7f6fa8e02640 10 monclient: get_auth_request con 0x7f6f9c06d070 auth_method 0 2024-09-12T17:28:46.881 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T17:28:46.570+0000 7f6fa8601640 0 -- 172.21.15.67:0/2094100010 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f6f9c0a0b10 msgr2=0x7f6f9c0ab920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:46.881 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T17:28:46.570+0000 7f6fa8601640 10 monclient: get_auth_request con 0x7f6f9c0a0b10 auth_method 0 2024-09-12T17:28:46.881 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T17:28:46.771+0000 7f6fa8601640 10 monclient: get_auth_request con 0x7f6f9c0a0b10 auth_method 0 2024-09-12T17:28:46.882 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T17:28:46.776+0000 7f6faab17800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:28:46.882 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T17:28:46.776+0000 7f6faab17800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:28:46.882 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T17:28:46.776+0000 7f6faab17800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:46.882 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T17:28:46.776+0000 7f6faab17800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:46.882 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T17:28:46.776+0000 7f6faab17800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:46.882 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T17:28:46.776+0000 7f6faab17800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:46.882 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T17:28:46.776+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.882 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T17:28:46.776+0000 7f6faab17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.882 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T17:28:46.776+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.882 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T17:28:46.776+0000 7f6faab17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:46.882 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T17:28:46.776+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.882 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T17:28:46.777+0000 7f6faab17800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:28:46.882 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T17:28:46.777+0000 7f6faab17800 20 zone default found 2024-09-12T17:28:46.882 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T17:28:46.777+0000 7f6faab17800 4 Realm: () 2024-09-12T17:28:46.883 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T17:28:46.777+0000 7f6faab17800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:28:46.883 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T17:28:46.777+0000 7f6faab17800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:28:46.883 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T17:28:46.777+0000 7f6faab17800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:46.883 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T17:28:46.777+0000 7f6faab17800 20 zonegroup default 2024-09-12T17:28:46.883 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T17:28:46.777+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.883 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T17:28:46.777+0000 7f6faab17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.883 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T17:28:46.777+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.884 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T17:28:46.777+0000 7f6faab17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.884 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T17:28:46.777+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.884 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T17:28:46.777+0000 7f6faab17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.884 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T17:28:46.777+0000 7f6faab17800 20 started sync module instance, tier type = 2024-09-12T17:28:46.884 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T17:28:46.777+0000 7f6faab17800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:28:46.884 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T17:28:46.787+0000 7f6faab17800 20 add_watcher() i=0 2024-09-12T17:28:46.884 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T17:28:46.787+0000 7f6faab17800 20 add_watcher() i=1 2024-09-12T17:28:46.884 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T17:28:46.787+0000 7f6faab17800 20 add_watcher() i=2 2024-09-12T17:28:46.884 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T17:28:46.787+0000 7f6faab17800 20 add_watcher() i=3 2024-09-12T17:28:46.884 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T17:28:46.787+0000 7f6faab17800 20 add_watcher() i=4 2024-09-12T17:28:46.885 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T17:28:46.787+0000 7f6faab17800 20 add_watcher() i=5 2024-09-12T17:28:46.885 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T17:28:46.787+0000 7f6faab17800 20 add_watcher() i=6 2024-09-12T17:28:46.885 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T17:28:46.788+0000 7f6faab17800 20 add_watcher() i=7 2024-09-12T17:28:46.885 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T17:28:46.788+0000 7f6faab17800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:46.885 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding auth protocol: cephx 2024-09-12T17:28:46.885 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding auth protocol: cephx 2024-09-12T17:28:46.885 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding auth protocol: cephx 2024-09-12T17:28:46.885 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding con mode: secure 2024-09-12T17:28:46.885 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding con mode: crc 2024-09-12T17:28:46.885 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding con mode: secure 2024-09-12T17:28:46.885 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding con mode: crc 2024-09-12T17:28:46.885 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding con mode: secure 2024-09-12T17:28:46.885 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding con mode: crc 2024-09-12T17:28:46.886 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding con mode: crc 2024-09-12T17:28:46.886 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding con mode: secure 2024-09-12T17:28:46.886 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding con mode: crc 2024-09-12T17:28:46.886 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding con mode: secure 2024-09-12T17:28:46.886 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding con mode: crc 2024-09-12T17:28:46.886 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding con mode: secure 2024-09-12T17:28:46.886 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T17:28:46.790+0000 7f6e5efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:46.886 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T17:28:46.790+0000 7f6faab17800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:46.886 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T17:28:46.790+0000 7f6faab17800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:46.886 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T17:28:46.790+0000 7f6faab17800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:46.886 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command cache list hook 0x55ff9ab6c090 2024-09-12T17:28:46.887 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command cache inspect hook 0x55ff9ab6c090 2024-09-12T17:28:46.887 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command cache erase hook 0x55ff9ab6c090 2024-09-12T17:28:46.887 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command cache zap hook 0x55ff9ab6c090 2024-09-12T17:28:46.887 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 note: GC not initialized 2024-09-12T17:28:46.887 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T17:28:46.790+0000 7f6e5dfdb640 20 reqs_thread_entry: start 2024-09-12T17:28:46.887 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command sync trace show hook 0x7f6fa000cc20 2024-09-12T17:28:46.887 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command sync trace history hook 0x7f6fa000cc20 2024-09-12T17:28:46.887 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command sync trace active hook 0x7f6fa000cc20 2024-09-12T17:28:46.887 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command sync trace active_short hook 0x7f6fa000cc20 2024-09-12T17:28:46.887 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T17:28:46.790+0000 7f6faab17800 20 init_complete bucket index max shards: 1 2024-09-12T17:28:46.887 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T17:28:46.790+0000 7f6faab17800 20 Filter name: none 2024-09-12T17:28:46.887 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T17:28:46.791+0000 7f6dcf7fe640 20 reqs_thread_entry: start 2024-09-12T17:28:46.887 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T17:28:46.791+0000 7f6faab17800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:28:46.887 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T17:28:46.791+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.888 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T17:28:46.791+0000 7f6faab17800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:28:46.888 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T17:28:46.791+0000 7f6faab17800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:28:46.888 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T17:28:46.791+0000 7f6faab17800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:28:46.888 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T17:28:46.791+0000 7f6faab17800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : miss 2024-09-12T17:28:46.888 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T17:28:46.791+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.888 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T17:28:46.792+0000 7f6faab17800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:28:46.888 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T17:28:46.792+0000 7f6faab17800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:28:46.889 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T17:28:46.792+0000 7f6faab17800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:28:46.889 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T17:28:46.792+0000 7f6faab17800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:46.889 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T17:28:46.792+0000 7f6faab17800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:28:46.889 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T17:28:46.792+0000 7f6faab17800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:28:46.889 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T17:28:46.796+0000 7f6faab17800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:28:46.889 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T17:28:46.796+0000 7f6faab17800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:28:46.889 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T17:28:46.796+0000 7f6faab17800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:28:46.889 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T17:28:46.796+0000 7f6faab17800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18, ofs0, ns] 2024-09-12T17:28:46.889 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T17:28:46.796+0000 7f6e7f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464369 cookie 94556300812704 notifier 8286 bl.length()=911 2024-09-12T17:28:46.889 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T17:28:46.796+0000 7f6e7f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:28:46.890 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T17:28:46.796+0000 7f6e7f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:28:46.890 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T17:28:46.796+0000 7f6e7f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:28:46.890 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T17:28:46.798+0000 7f6faab17800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_sources= new_sources= 2024-09-12T17:28:46.890 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T17:28:46.798+0000 7f6faab17800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:28:46.890 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T17:28:46.798+0000 7f6faab17800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_dests= new_dests= 2024-09-12T17:28:46.890 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T17:28:46.798+0000 7f6faab17800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:28:46.890 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T17:28:46.801+0000 7f6faab17800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6faab17800 time 2024-09-12T17:28:46.801718+0000 2024-09-12T17:28:46.890 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:28:46.890 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.890 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:28:46.890 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6fadf8c71a] 2024-09-12T17:28:46.890 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6fadf8c8d8] 2024-09-12T17:28:46.890 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff98e04841] 2024-09-12T17:28:46.891 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ff98e1457a] 2024-09-12T17:28:46.891 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T17:28:46.891 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f6facc29590] 2024-09-12T17:28:46.891 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T17:28:46.891 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T17:28:46.891 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.891 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T17:28:46.802+0000 7f6faab17800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:28:46.891 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f6faab17800 thread_name:radosgw-admin 2024-09-12T17:28:46.891 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.891 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:28:46.891 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6facc3e6f0] 2024-09-12T17:28:46.891 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6facc8b99c] 2024-09-12T17:28:46.891 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:28:46.891 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:28:46.892 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6fadf8c774] 2024-09-12T17:28:46.892 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6fadf8c8d8] 2024-09-12T17:28:46.892 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff98e04841] 2024-09-12T17:28:46.892 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ff98e1457a] 2024-09-12T17:28:46.892 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T17:28:46.892 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f6facc29590] 2024-09-12T17:28:46.892 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T17:28:46.892 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T17:28:46.892 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:28:46.892 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.892 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T17:28:46.892 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T17:28:46.892 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T17:28:46.893 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T17:28:46.893 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T17:28:46.893 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T17:28:46.893 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T17:28:46.893 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T17:28:46.893 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T17:28:46.893 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T17:28:46.896 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T17:28:46.896 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T17:28:46.896 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T17:28:46.896 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T17:28:46.897 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T17:28:46.897 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T17:28:46.897 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T17:28:46.897 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T17:28:46.897 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T17:28:46.897 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T17:28:46.897 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T17:28:46.897 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T17:28:46.898 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T17:28:46.898 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T17:28:46.898 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:28:46.898 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T17:28:46.898 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T17:28:46.898 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T17:28:46.898 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T17:28:46.898 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T17:28:46.898 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T17:28:46.898 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T17:28:46.898 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T17:28:46.898 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T17:28:46.898 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T17:28:46.898 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T17:28:46.899 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T17:28:46.899 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T17:28:46.899 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T17:28:46.899 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T17:28:46.899 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T17:28:46.899 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T17:28:46.899 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T17:28:46.899 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T17:28:46.900 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T17:28:46.900 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T17:28:46.900 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:28:46.900 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T17:28:46.900 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:28:46.900 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T17:28:46.900 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T17:28:46.900 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T17:28:46.900 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T17:28:46.900 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T17:28:46.900 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T17:28:46.900 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T17:28:46.901 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T17:28:46.901 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T17:28:46.901 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T17:28:46.901 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T17:28:46.901 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T17:28:46.901 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T17:28:46.901 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T17:28:46.901 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T17:28:46.901 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T17:28:46.902 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T17:28:46.902 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T17:28:46.902 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:28:46.902 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T17:28:46.902 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:28:46.902 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T17:28:46.903 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T17:28:46.903 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T17:28:46.903 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T17:28:46.903 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T17:28:46.903 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T17:28:46.903 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:28:46.903 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T17:28:46.903 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T17:28:46.903 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:28:46.903 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T17:28:46.903 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T17:28:46.904 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T17:28:46.904 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T17:28:46.904 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T17:28:46.904 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T17:28:46.904 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T17:28:46.904 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T17:28:46.904 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T17:28:46.904 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T17:28:46.904 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T17:28:46.904 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T17:28:46.904 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T17:28:46.904 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:28:46.904 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6dcf7fe640 / http_manager 2024-09-12T17:28:46.905 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6e5dfdb640 / http_manager 2024-09-12T17:28:46.905 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6e5efdd640 / rgw_dt_lg_renew 2024-09-12T17:28:46.905 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6e7dffb640 / ms_dispatch 2024-09-12T17:28:46.905 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6e7f7fe640 / io_context_pool 2024-09-12T17:28:46.905 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6e8dffb640 / ms_dispatch 2024-09-12T17:28:46.905 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6e94e09640 / ms_dispatch 2024-09-12T17:28:46.905 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6e9660c640 / io_context_pool 2024-09-12T17:28:46.905 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6fa7e00640 / msgr-worker-2 2024-09-12T17:28:46.905 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6fa8601640 / msgr-worker-1 2024-09-12T17:28:46.905 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6fa8e02640 / msgr-worker-0 2024-09-12T17:28:46.905 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6fa9603640 / io_context_pool 2024-09-12T17:28:46.905 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6faab17800 / radosgw-admin 2024-09-12T17:28:46.905 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T17:28:46.905 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T17:28:46.906 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/log/ceph/ceph-client.admin.152211.log 2024-09-12T17:28:46.906 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T17:28:46.906 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T17:28:46.906 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T17:28:46.544+0000 7f6faab17800 10 monclient: monmap: 2024-09-12T17:28:46.906 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:28:46.906 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:28:46.906 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:28:46.906 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:28:46.906 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:28:46.906 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:46.906 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:28:46.906 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:28:46.906 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:28:46.906 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.907 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding auth protocol: cephx 2024-09-12T17:28:46.907 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding auth protocol: cephx 2024-09-12T17:28:46.907 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding auth protocol: cephx 2024-09-12T17:28:46.907 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding con mode: secure 2024-09-12T17:28:46.907 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding con mode: crc 2024-09-12T17:28:46.907 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding con mode: secure 2024-09-12T17:28:46.908 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding con mode: crc 2024-09-12T17:28:46.908 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding con mode: secure 2024-09-12T17:28:46.908 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding con mode: crc 2024-09-12T17:28:46.908 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding con mode: crc 2024-09-12T17:28:46.908 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding con mode: secure 2024-09-12T17:28:46.908 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding con mode: crc 2024-09-12T17:28:46.908 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding con mode: secure 2024-09-12T17:28:46.908 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding con mode: crc 2024-09-12T17:28:46.908 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa92fb0) adding con mode: secure 2024-09-12T17:28:46.908 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T17:28:46.544+0000 7f6faab17800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:46.908 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T17:28:46.544+0000 7f6faab17800 1 librados: starting msgr at 2024-09-12T17:28:46.909 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T17:28:46.544+0000 7f6faab17800 1 librados: starting objecter 2024-09-12T17:28:46.909 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command objecter_requests hook 0x55ff9aa91680 2024-09-12T17:28:46.909 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T17:28:46.544+0000 7f6faab17800 1 librados: setting wanted keys 2024-09-12T17:28:46.909 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T17:28:46.544+0000 7f6faab17800 1 librados: calling monclient init 2024-09-12T17:28:46.909 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T17:28:46.544+0000 7f6faab17800 10 monclient: init 2024-09-12T17:28:46.909 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding auth protocol: cephx 2024-09-12T17:28:46.909 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding auth protocol: cephx 2024-09-12T17:28:46.909 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding auth protocol: cephx 2024-09-12T17:28:46.909 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding con mode: secure 2024-09-12T17:28:46.909 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding con mode: crc 2024-09-12T17:28:46.909 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding con mode: secure 2024-09-12T17:28:46.909 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding con mode: crc 2024-09-12T17:28:46.909 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding con mode: secure 2024-09-12T17:28:46.910 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding con mode: crc 2024-09-12T17:28:46.910 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding con mode: crc 2024-09-12T17:28:46.910 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T17:28:46.544+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding con mode: secure 2024-09-12T17:28:46.910 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T17:28:46.545+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding con mode: crc 2024-09-12T17:28:46.910 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T17:28:46.545+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding con mode: secure 2024-09-12T17:28:46.910 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T17:28:46.545+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding con mode: crc 2024-09-12T17:28:46.910 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T17:28:46.545+0000 7f6faab17800 5 AuthRegistry(0x55ff9aa8d880) adding con mode: secure 2024-09-12T17:28:46.910 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T17:28:46.545+0000 7f6faab17800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:46.910 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T17:28:46.545+0000 7f6faab17800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:46.910 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T17:28:46.545+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command rotate-key hook 0x55ff9aa8d9c8 2024-09-12T17:28:46.910 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T17:28:46.545+0000 7f6faab17800 10 monclient: _reopen_session rank -1 2024-09-12T17:28:46.910 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T17:28:46.545+0000 7f6faab17800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:28:46.910 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T17:28:46.545+0000 7f6faab17800 10 monclient(hunting): picked mon.noname-c con 0x55ff9a946ad0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:28:46.910 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T17:28:46.545+0000 7f6faab17800 10 monclient(hunting): picked mon.noname-a con 0x55ff9a9d68e0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:28:46.911 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T17:28:46.545+0000 7f6faab17800 10 monclient(hunting): picked mon.noname-b con 0x55ff9a9d7270 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:28:46.911 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T17:28:46.545+0000 7f6faab17800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:46.911 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T17:28:46.545+0000 7f6faab17800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:46.911 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T17:28:46.545+0000 7f6faab17800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:46.911 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T17:28:46.545+0000 7f6faab17800 10 monclient(hunting): _renew_subs 2024-09-12T17:28:46.911 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T17:28:46.545+0000 7f6faab17800 10 monclient(hunting): authenticate will time out at 2537.895519s 2024-09-12T17:28:46.911 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T17:28:46.545+0000 7f6fa8601640 10 monclient(hunting): get_auth_request con 0x55ff9a946ad0 auth_method 0 2024-09-12T17:28:46.911 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T17:28:46.545+0000 7f6fa8601640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:46.911 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T17:28:46.545+0000 7f6fa8601640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:46.911 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T17:28:46.545+0000 7f6fa8601640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:46.911 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T17:28:46.545+0000 7f6fa7e00640 10 monclient(hunting): get_auth_request con 0x55ff9a9d68e0 auth_method 0 2024-09-12T17:28:46.911 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T17:28:46.545+0000 7f6fa7e00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:46.911 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T17:28:46.545+0000 7f6fa7e00640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:46.911 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T17:28:46.545+0000 7f6fa7e00640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:46.912 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T17:28:46.545+0000 7f6fa8601640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:46.912 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T17:28:46.545+0000 7f6fa8601640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:46.912 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T17:28:46.545+0000 7f6fa8601640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:46.912 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T17:28:46.545+0000 7f6fa8e02640 10 monclient(hunting): get_auth_request con 0x55ff9a9d7270 auth_method 0 2024-09-12T17:28:46.912 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T17:28:46.545+0000 7f6fa8e02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:46.912 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T17:28:46.545+0000 7f6fa8e02640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:46.912 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T17:28:46.545+0000 7f6fa8e02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:46.912 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T17:28:46.545+0000 7f6fa7e00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:46.913 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T17:28:46.545+0000 7f6fa7e00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:46.913 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T17:28:46.545+0000 7f6fa7e00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:46.913 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T17:28:46.545+0000 7f6fa8e02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:46.913 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T17:28:46.545+0000 7f6fa8e02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:46.913 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T17:28:46.545+0000 7f6fa8e02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:46.914 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T17:28:46.545+0000 7f6fa8601640 10 monclient(hunting): handle_auth_done global_id 7760 payload 824 2024-09-12T17:28:46.914 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T17:28:46.545+0000 7f6fa8601640 10 monclient: _finish_hunting 0 2024-09-12T17:28:46.914 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T17:28:46.545+0000 7f6fa8601640 1 monclient: found mon.noname-c 2024-09-12T17:28:46.914 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T17:28:46.545+0000 7f6fa8601640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:28:46.914 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T17:28:46.546+0000 7f6e94e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:46.914 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T17:28:46.546+0000 7f6e94e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:28:46.914 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T17:28:46.546+0000 7f6e94e09640 10 monclient: dump: 2024-09-12T17:28:46.915 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:46.915 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:46.915 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.915 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.915 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:46.915 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:46.915 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:46.915 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:46.915 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:46.915 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.915 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T17:28:46.546+0000 7f6e94e09640 10 monclient: _finish_auth 0 2024-09-12T17:28:46.915 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T17:28:46.546+0000 7f6e94e09640 10 monclient: _check_auth_tickets 2024-09-12T17:28:46.916 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T17:28:46.546+0000 7f6e94e09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:28:46.916 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T17:28:46.546+0000 7f6e94e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:46.916 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T17:28:46.546+0000 7f6e94e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:28:46.916 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T17:28:46.546+0000 7f6e94e09640 10 monclient: dump: 2024-09-12T17:28:46.916 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:46.916 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:46.916 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.916 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.916 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:46.916 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:46.916 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:46.916 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:46.917 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:46.917 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.917 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T17:28:46.546+0000 7f6faab17800 5 monclient: authenticate success, global_id 7760 2024-09-12T17:28:46.917 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T17:28:46.546+0000 7f6faab17800 10 monclient: _renew_subs 2024-09-12T17:28:46.917 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T17:28:46.546+0000 7f6faab17800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:28:46.917 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T17:28:46.546+0000 7f6e9660c640 4 set_mon_vals no callback set 2024-09-12T17:28:46.917 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T17:28:46.546+0000 7f6faab17800 10 monclient: _renew_subs 2024-09-12T17:28:46.917 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T17:28:46.546+0000 7f6faab17800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:28:46.918 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T17:28:46.546+0000 7f6faab17800 1 librados: init done 2024-09-12T17:28:46.918 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T17:28:46.548+0000 7f6e94e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:28:46.918 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T17:28:46.548+0000 7f6e94e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:28:46.918 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T17:28:46.548+0000 7f6e94e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:28:46.918 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T17:28:46.548+0000 7f6fa7e00640 10 monclient: get_auth_request con 0x7f6e900764c0 auth_method 0 2024-09-12T17:28:46.918 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T17:28:46.548+0000 7f6fa8e02640 10 monclient: get_auth_request con 0x55ff9aad6840 auth_method 0 2024-09-12T17:28:46.918 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T17:28:46.549+0000 7f6fa8601640 10 monclient: get_auth_request con 0x55ff9aad9a20 auth_method 0 2024-09-12T17:28:46.918 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T17:28:46.550+0000 7f6fa7e00640 10 monclient: get_auth_request con 0x55ff9aade0c0 auth_method 0 2024-09-12T17:28:46.918 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T17:28:46.551+0000 7f6faab17800 10 monclient: build_initial_monmap 2024-09-12T17:28:46.918 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T17:28:46.551+0000 7f6faab17800 1 build_initial for_mkfs: 0 2024-09-12T17:28:46.919 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T17:28:46.551+0000 7f6faab17800 10 monclient: monmap: 2024-09-12T17:28:46.919 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:28:46.919 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:28:46.919 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:28:46.919 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:28:46.919 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:28:46.919 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:46.919 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:28:46.919 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:28:46.919 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:28:46.919 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.920 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding auth protocol: cephx 2024-09-12T17:28:46.920 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding auth protocol: cephx 2024-09-12T17:28:46.920 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding auth protocol: cephx 2024-09-12T17:28:46.920 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding con mode: secure 2024-09-12T17:28:46.920 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding con mode: crc 2024-09-12T17:28:46.920 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding con mode: secure 2024-09-12T17:28:46.920 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding con mode: crc 2024-09-12T17:28:46.920 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding con mode: secure 2024-09-12T17:28:46.920 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding con mode: crc 2024-09-12T17:28:46.920 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding con mode: crc 2024-09-12T17:28:46.920 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding con mode: secure 2024-09-12T17:28:46.920 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding con mode: crc 2024-09-12T17:28:46.920 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding con mode: secure 2024-09-12T17:28:46.920 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding con mode: crc 2024-09-12T17:28:46.921 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae2cf0) adding con mode: secure 2024-09-12T17:28:46.921 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T17:28:46.551+0000 7f6faab17800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:46.921 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T17:28:46.551+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command objecter_requests cmddesc objecter_requests hook 0x55ff9aae6200 EEXIST 2024-09-12T17:28:46.921 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T17:28:46.552+0000 7f6faab17800 10 monclient: init 2024-09-12T17:28:46.921 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding auth protocol: cephx 2024-09-12T17:28:46.921 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding auth protocol: cephx 2024-09-12T17:28:46.921 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding auth protocol: cephx 2024-09-12T17:28:46.921 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding con mode: secure 2024-09-12T17:28:46.921 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding con mode: crc 2024-09-12T17:28:46.921 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding con mode: secure 2024-09-12T17:28:46.921 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding con mode: crc 2024-09-12T17:28:46.921 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding con mode: secure 2024-09-12T17:28:46.921 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding con mode: crc 2024-09-12T17:28:46.921 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding con mode: crc 2024-09-12T17:28:46.922 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding con mode: secure 2024-09-12T17:28:46.922 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding con mode: crc 2024-09-12T17:28:46.922 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding con mode: secure 2024-09-12T17:28:46.922 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding con mode: crc 2024-09-12T17:28:46.922 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 AuthRegistry(0x55ff9aae1468) adding con mode: secure 2024-09-12T17:28:46.922 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T17:28:46.552+0000 7f6faab17800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:46.922 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T17:28:46.552+0000 7f6faab17800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:46.922 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T17:28:46.552+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command rotate-key cmddesc rotate-key hook 0x55ff9aae15b0 EEXIST 2024-09-12T17:28:46.922 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T17:28:46.552+0000 7f6faab17800 10 monclient: _reopen_session rank -1 2024-09-12T17:28:46.922 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T17:28:46.552+0000 7f6faab17800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:28:46.922 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T17:28:46.552+0000 7f6faab17800 10 monclient(hunting): picked mon.noname-b con 0x55ff9ab0a520 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:28:46.922 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T17:28:46.552+0000 7f6faab17800 10 monclient(hunting): picked mon.noname-a con 0x55ff9ab0a900 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:28:46.922 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T17:28:46.552+0000 7f6faab17800 10 monclient(hunting): picked mon.noname-c con 0x55ff9ab09230 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:28:46.923 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T17:28:46.552+0000 7f6faab17800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:46.923 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T17:28:46.552+0000 7f6faab17800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:46.923 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T17:28:46.552+0000 7f6faab17800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:46.923 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T17:28:46.552+0000 7f6faab17800 10 monclient(hunting): _renew_subs 2024-09-12T17:28:46.923 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T17:28:46.552+0000 7f6faab17800 10 monclient(hunting): authenticate will time out at 2537.902784s 2024-09-12T17:28:46.923 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T17:28:46.552+0000 7f6fa8601640 10 monclient(hunting): get_auth_request con 0x55ff9ab0a520 auth_method 0 2024-09-12T17:28:46.923 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T17:28:46.552+0000 7f6fa8601640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:46.923 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T17:28:46.552+0000 7f6fa8601640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:46.923 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T17:28:46.552+0000 7f6fa8601640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:46.923 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T17:28:46.552+0000 7f6fa7e00640 10 monclient(hunting): get_auth_request con 0x55ff9ab0a900 auth_method 0 2024-09-12T17:28:46.923 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T17:28:46.552+0000 7f6fa7e00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:46.923 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T17:28:46.552+0000 7f6fa7e00640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:46.923 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T17:28:46.552+0000 7f6fa7e00640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:46.924 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T17:28:46.552+0000 7f6fa8e02640 10 monclient(hunting): get_auth_request con 0x55ff9ab09230 auth_method 0 2024-09-12T17:28:46.924 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T17:28:46.552+0000 7f6fa8e02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:46.924 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T17:28:46.552+0000 7f6fa8e02640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:46.924 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T17:28:46.552+0000 7f6fa8e02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:46.924 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T17:28:46.552+0000 7f6fa8601640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:46.924 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T17:28:46.552+0000 7f6fa8601640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:46.924 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T17:28:46.552+0000 7f6fa8601640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:46.924 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T17:28:46.552+0000 7f6fa7e00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:46.924 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T17:28:46.552+0000 7f6fa7e00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:46.924 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T17:28:46.552+0000 7f6fa7e00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:46.924 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T17:28:46.552+0000 7f6fa8e02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:46.925 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T17:28:46.552+0000 7f6fa8e02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:46.925 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T17:28:46.552+0000 7f6fa8e02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:46.925 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T17:28:46.553+0000 7f6fa8601640 10 monclient(hunting): handle_auth_done global_id 7588 payload 824 2024-09-12T17:28:46.925 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T17:28:46.553+0000 7f6fa8601640 10 monclient: _finish_hunting 0 2024-09-12T17:28:46.925 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T17:28:46.553+0000 7f6fa8601640 1 monclient: found mon.noname-b 2024-09-12T17:28:46.925 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T17:28:46.553+0000 7f6fa8601640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.118:3300/0 2024-09-12T17:28:46.925 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T17:28:46.553+0000 7f6e8dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:46.926 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T17:28:46.553+0000 7f6e8dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-12T17:28:46.926 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T17:28:46.553+0000 7f6e8dffb640 10 monclient: dump: 2024-09-12T17:28:46.926 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:46.926 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:46.926 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.926 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.926 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:46.926 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:46.926 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:46.926 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:46.926 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:46.926 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.927 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T17:28:46.553+0000 7f6e8dffb640 10 monclient: _finish_auth 0 2024-09-12T17:28:46.927 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T17:28:46.553+0000 7f6e8dffb640 10 monclient: _check_auth_tickets 2024-09-12T17:28:46.927 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T17:28:46.553+0000 7f6e8dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:28:46.927 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T17:28:46.553+0000 7f6faab17800 5 monclient: authenticate success, global_id 7588 2024-09-12T17:28:46.927 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T17:28:46.553+0000 7f6e8dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:46.927 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T17:28:46.553+0000 7f6e8dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-12T17:28:46.928 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T17:28:46.553+0000 7f6e8dffb640 10 monclient: dump: 2024-09-12T17:28:46.928 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:46.928 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:46.928 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.928 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.928 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:46.929 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:46.929 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:46.929 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:46.929 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:46.929 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.929 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T17:28:46.553+0000 7f6faab17800 10 monclient: _renew_subs 2024-09-12T17:28:46.929 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T17:28:46.553+0000 7f6fa9603640 4 set_mon_vals no callback set 2024-09-12T17:28:46.929 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T17:28:46.553+0000 7f6faab17800 10 monclient: _send_mon_message to mon.b at v2:172.21.15.118:3300/0 2024-09-12T17:28:46.929 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T17:28:46.553+0000 7f6faab17800 10 monclient: _renew_subs 2024-09-12T17:28:46.929 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T17:28:46.553+0000 7f6faab17800 10 monclient: _send_mon_message to mon.b at v2:172.21.15.118:3300/0 2024-09-12T17:28:46.929 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T17:28:46.555+0000 7f6e8dffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:28:46.929 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T17:28:46.555+0000 7f6e8dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:28:46.930 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T17:28:46.555+0000 7f6e8dffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:28:46.930 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T17:28:46.555+0000 7f6fa7e00640 10 monclient: get_auth_request con 0x7f6e80076380 auth_method 0 2024-09-12T17:28:46.930 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T17:28:46.555+0000 7f6faab17800 10 monclient: get_monmap_and_config 2024-09-12T17:28:46.930 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T17:28:46.555+0000 7f6faab17800 10 monclient: build_initial_monmap 2024-09-12T17:28:46.930 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T17:28:46.555+0000 7f6faab17800 1 build_initial for_mkfs: 0 2024-09-12T17:28:46.930 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T17:28:46.555+0000 7f6faab17800 10 monclient: monmap: 2024-09-12T17:28:46.930 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:28:46.930 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:28:46.930 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:28:46.930 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:28:46.930 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:28:46.930 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:46.930 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:28:46.930 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:28:46.931 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:28:46.931 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.931 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding auth protocol: cephx 2024-09-12T17:28:46.931 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding auth protocol: cephx 2024-09-12T17:28:46.931 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding auth protocol: cephx 2024-09-12T17:28:46.931 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding con mode: secure 2024-09-12T17:28:46.931 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding con mode: crc 2024-09-12T17:28:46.931 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding con mode: secure 2024-09-12T17:28:46.931 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding con mode: crc 2024-09-12T17:28:46.931 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding con mode: secure 2024-09-12T17:28:46.931 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding con mode: crc 2024-09-12T17:28:46.932 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding con mode: crc 2024-09-12T17:28:46.932 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding con mode: secure 2024-09-12T17:28:46.932 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding con mode: crc 2024-09-12T17:28:46.932 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding con mode: secure 2024-09-12T17:28:46.932 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding con mode: crc 2024-09-12T17:28:46.932 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T17:28:46.555+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab2a450) adding con mode: secure 2024-09-12T17:28:46.932 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T17:28:46.555+0000 7f6faab17800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:46.932 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T17:28:46.556+0000 7f6faab17800 10 monclient: init 2024-09-12T17:28:46.932 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding auth protocol: cephx 2024-09-12T17:28:46.932 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding auth protocol: cephx 2024-09-12T17:28:46.932 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding auth protocol: cephx 2024-09-12T17:28:46.932 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding con mode: secure 2024-09-12T17:28:46.933 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding con mode: crc 2024-09-12T17:28:46.933 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding con mode: secure 2024-09-12T17:28:46.933 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding con mode: crc 2024-09-12T17:28:46.933 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding con mode: secure 2024-09-12T17:28:46.933 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding con mode: crc 2024-09-12T17:28:46.933 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding con mode: crc 2024-09-12T17:28:46.933 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding con mode: secure 2024-09-12T17:28:46.933 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding con mode: crc 2024-09-12T17:28:46.933 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding con mode: secure 2024-09-12T17:28:46.933 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding con mode: crc 2024-09-12T17:28:46.933 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16f760) adding con mode: secure 2024-09-12T17:28:46.933 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T17:28:46.556+0000 7f6faab17800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:46.933 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T17:28:46.556+0000 7f6faab17800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:46.933 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T17:28:46.556+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command rotate-key cmddesc rotate-key hook 0x7ffe1b16f8a8 EEXIST 2024-09-12T17:28:46.934 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T17:28:46.556+0000 7f6faab17800 10 monclient: _reopen_session rank -1 2024-09-12T17:28:46.934 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T17:28:46.556+0000 7f6faab17800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:28:46.934 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T17:28:46.556+0000 7f6faab17800 10 monclient(hunting): picked mon.noname-b con 0x55ff9ab5eb10 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:28:46.934 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T17:28:46.556+0000 7f6faab17800 10 monclient(hunting): picked mon.noname-c con 0x55ff9ab2fa60 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:28:46.934 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T17:28:46.556+0000 7f6faab17800 10 monclient(hunting): picked mon.noname-a con 0x55ff9ab5a3b0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:28:46.934 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T17:28:46.556+0000 7f6faab17800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:46.934 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T17:28:46.556+0000 7f6faab17800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:46.934 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T17:28:46.556+0000 7f6faab17800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:46.934 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T17:28:46.556+0000 7f6faab17800 10 monclient(hunting): _renew_subs 2024-09-12T17:28:46.934 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T17:28:46.556+0000 7f6faab17800 10 monclient(hunting): authenticate will time out at 2537.906602s 2024-09-12T17:28:46.934 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T17:28:46.556+0000 7f6fa8e02640 10 monclient(hunting): get_auth_request con 0x55ff9ab5a3b0 auth_method 0 2024-09-12T17:28:46.935 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T17:28:46.556+0000 7f6fa8e02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:46.935 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T17:28:46.556+0000 7f6fa8e02640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:46.935 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T17:28:46.556+0000 7f6fa8e02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:46.936 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T17:28:46.556+0000 7f6fa7e00640 10 monclient(hunting): get_auth_request con 0x55ff9ab2fa60 auth_method 0 2024-09-12T17:28:46.936 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T17:28:46.556+0000 7f6fa7e00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:46.936 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T17:28:46.556+0000 7f6fa7e00640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:46.936 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T17:28:46.556+0000 7f6fa7e00640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:46.936 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T17:28:46.556+0000 7f6fa8601640 10 monclient(hunting): get_auth_request con 0x55ff9ab5eb10 auth_method 0 2024-09-12T17:28:46.936 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T17:28:46.556+0000 7f6fa8601640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:46.937 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T17:28:46.556+0000 7f6fa8601640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:46.937 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T17:28:46.556+0000 7f6fa8601640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:46.937 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T17:28:46.556+0000 7f6fa8e02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:46.937 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T17:28:46.556+0000 7f6fa8e02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:46.937 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T17:28:46.556+0000 7f6fa8e02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:46.937 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T17:28:46.556+0000 7f6fa7e00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:46.937 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T17:28:46.556+0000 7f6fa7e00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:46.937 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T17:28:46.556+0000 7f6fa7e00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:46.937 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T17:28:46.556+0000 7f6fa8601640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:46.937 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T17:28:46.556+0000 7f6fa8601640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:46.937 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T17:28:46.556+0000 7f6fa8601640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:46.937 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T17:28:46.556+0000 7f6fa8e02640 10 monclient(hunting): handle_auth_done global_id 8283 payload 274 2024-09-12T17:28:46.938 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T17:28:46.556+0000 7f6fa8e02640 10 monclient: _finish_hunting 0 2024-09-12T17:28:46.938 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T17:28:46.556+0000 7f6fa8e02640 1 monclient: found mon.noname-a 2024-09-12T17:28:46.938 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T17:28:46.556+0000 7f6fa8e02640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:28:46.938 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T17:28:46.557+0000 7f6e7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:46.938 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T17:28:46.557+0000 7f6e7f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:28:46.938 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T17:28:46.557+0000 7f6e7f7fe640 10 monclient: dump: 2024-09-12T17:28:46.938 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:46.938 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:46.938 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.938 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.938 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:46.938 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:46.938 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:46.938 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:46.939 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:46.939 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.939 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T17:28:46.557+0000 7f6e7f7fe640 10 monclient: _finish_auth 0 2024-09-12T17:28:46.939 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T17:28:46.557+0000 7f6e7f7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:28:46.939 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T17:28:46.557+0000 7f6e7f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:28:46.939 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 monclient: authenticate success, global_id 8283 2024-09-12T17:28:46.939 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T17:28:46.557+0000 7f6faab17800 10 monclient: get_monmap_and_config success 2024-09-12T17:28:46.940 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T17:28:46.557+0000 7f6faab17800 4 set_mon_vals no callback set 2024-09-12T17:28:46.940 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T17:28:46.557+0000 7f6e7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:46.940 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T17:28:46.557+0000 7f6e7f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:28:46.940 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T17:28:46.557+0000 7f6e7f7fe640 10 monclient: dump: 2024-09-12T17:28:46.940 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:46.940 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:46.940 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.940 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.940 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:46.940 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:46.940 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:46.940 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:46.941 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:46.941 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.941 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T17:28:46.557+0000 7f6faab17800 10 monclient: shutdown 2024-09-12T17:28:46.941 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T17:28:46.557+0000 7f6faab17800 10 monclient: build_initial_monmap 2024-09-12T17:28:46.941 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T17:28:46.557+0000 7f6faab17800 1 build_initial for_mkfs: 0 2024-09-12T17:28:46.941 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T17:28:46.557+0000 7f6faab17800 10 monclient: monmap: 2024-09-12T17:28:46.941 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:28:46.941 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:28:46.941 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:28:46.941 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:28:46.941 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:28:46.941 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:46.942 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:28:46.942 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:28:46.942 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:28:46.942 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.942 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding auth protocol: cephx 2024-09-12T17:28:46.942 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding auth protocol: cephx 2024-09-12T17:28:46.942 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding auth protocol: cephx 2024-09-12T17:28:46.942 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding con mode: secure 2024-09-12T17:28:46.942 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding con mode: crc 2024-09-12T17:28:46.942 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding con mode: secure 2024-09-12T17:28:46.943 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding con mode: crc 2024-09-12T17:28:46.943 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding con mode: secure 2024-09-12T17:28:46.943 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding con mode: crc 2024-09-12T17:28:46.943 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding con mode: crc 2024-09-12T17:28:46.943 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding con mode: secure 2024-09-12T17:28:46.943 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding con mode: crc 2024-09-12T17:28:46.943 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding con mode: secure 2024-09-12T17:28:46.943 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding con mode: crc 2024-09-12T17:28:46.943 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T17:28:46.557+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab5ace0) adding con mode: secure 2024-09-12T17:28:46.943 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T17:28:46.558+0000 7f6faab17800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:46.944 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T17:28:46.558+0000 7f6faab17800 1 librados: starting msgr at 2024-09-12T17:28:46.944 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T17:28:46.558+0000 7f6faab17800 1 librados: starting objecter 2024-09-12T17:28:46.944 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command objecter_requests cmddesc objecter_requests hook 0x55ff9ab0f680 EEXIST 2024-09-12T17:28:46.944 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T17:28:46.558+0000 7f6faab17800 1 librados: setting wanted keys 2024-09-12T17:28:46.944 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T17:28:46.558+0000 7f6faab17800 1 librados: calling monclient init 2024-09-12T17:28:46.944 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T17:28:46.558+0000 7f6faab17800 10 monclient: init 2024-09-12T17:28:46.944 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding auth protocol: cephx 2024-09-12T17:28:46.944 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding auth protocol: cephx 2024-09-12T17:28:46.944 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding auth protocol: cephx 2024-09-12T17:28:46.944 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding con mode: secure 2024-09-12T17:28:46.945 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding con mode: crc 2024-09-12T17:28:46.945 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding con mode: secure 2024-09-12T17:28:46.945 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding con mode: crc 2024-09-12T17:28:46.945 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding con mode: secure 2024-09-12T17:28:46.945 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding con mode: crc 2024-09-12T17:28:46.945 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding con mode: crc 2024-09-12T17:28:46.945 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding con mode: secure 2024-09-12T17:28:46.945 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding con mode: crc 2024-09-12T17:28:46.946 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding con mode: secure 2024-09-12T17:28:46.946 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding con mode: crc 2024-09-12T17:28:46.946 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 AuthRegistry(0x55ff9ab1ede0) adding con mode: secure 2024-09-12T17:28:46.946 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T17:28:46.558+0000 7f6faab17800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:46.946 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T17:28:46.558+0000 7f6faab17800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:46.946 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T17:28:46.558+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command rotate-key cmddesc rotate-key hook 0x55ff9ab1ef28 EEXIST 2024-09-12T17:28:46.946 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T17:28:46.558+0000 7f6faab17800 10 monclient: _reopen_session rank -1 2024-09-12T17:28:46.946 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T17:28:46.558+0000 7f6faab17800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:28:46.946 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T17:28:46.558+0000 7f6faab17800 10 monclient(hunting): picked mon.noname-a con 0x55ff9ab2fa60 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:28:46.947 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T17:28:46.558+0000 7f6faab17800 10 monclient(hunting): picked mon.noname-c con 0x55ff9ab5a3b0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:28:46.947 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T17:28:46.558+0000 7f6faab17800 10 monclient(hunting): picked mon.noname-b con 0x55ff9ab5eb10 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:28:46.947 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T17:28:46.558+0000 7f6faab17800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:46.947 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T17:28:46.558+0000 7f6faab17800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:46.947 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T17:28:46.558+0000 7f6faab17800 10 monclient(hunting): start opening mon connection 2024-09-12T17:28:46.947 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T17:28:46.558+0000 7f6faab17800 10 monclient(hunting): _renew_subs 2024-09-12T17:28:46.947 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T17:28:46.558+0000 7f6faab17800 10 monclient(hunting): authenticate will time out at 2537.908954s 2024-09-12T17:28:46.947 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T17:28:46.559+0000 7f6fa8601640 10 monclient(hunting): get_auth_request con 0x55ff9ab2fa60 auth_method 0 2024-09-12T17:28:46.947 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T17:28:46.559+0000 7f6fa8601640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:46.947 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T17:28:46.559+0000 7f6fa8601640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:46.947 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T17:28:46.559+0000 7f6fa8601640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:46.947 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T17:28:46.559+0000 7f6fa7e00640 10 monclient(hunting): get_auth_request con 0x55ff9ab5a3b0 auth_method 0 2024-09-12T17:28:46.947 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T17:28:46.559+0000 7f6fa7e00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:46.947 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T17:28:46.559+0000 7f6fa7e00640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:46.948 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T17:28:46.559+0000 7f6fa7e00640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:46.948 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T17:28:46.559+0000 7f6fa8601640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:46.948 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T17:28:46.559+0000 7f6fa8601640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:46.948 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T17:28:46.559+0000 7f6fa8601640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:46.948 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T17:28:46.559+0000 7f6fa8e02640 10 monclient(hunting): get_auth_request con 0x55ff9ab5eb10 auth_method 0 2024-09-12T17:28:46.948 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T17:28:46.559+0000 7f6fa8e02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:28:46.948 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T17:28:46.559+0000 7f6fa8e02640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:28:46.948 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T17:28:46.559+0000 7f6fa8e02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:28:46.948 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T17:28:46.559+0000 7f6fa7e00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:46.948 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T17:28:46.559+0000 7f6fa7e00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:46.949 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T17:28:46.559+0000 7f6fa7e00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:46.949 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T17:28:46.559+0000 7f6fa8e02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:28:46.949 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T17:28:46.559+0000 7f6fa8e02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:28:46.949 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T17:28:46.559+0000 7f6fa8e02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:28:46.949 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T17:28:46.559+0000 7f6fa8601640 10 monclient(hunting): handle_auth_done global_id 8286 payload 824 2024-09-12T17:28:46.949 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T17:28:46.559+0000 7f6fa8601640 10 monclient: _finish_hunting 0 2024-09-12T17:28:46.949 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T17:28:46.559+0000 7f6fa8601640 1 monclient: found mon.noname-a 2024-09-12T17:28:46.949 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T17:28:46.559+0000 7f6fa8601640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:28:46.949 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T17:28:46.559+0000 7f6e7dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:46.949 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T17:28:46.559+0000 7f6e7dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:28:46.949 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T17:28:46.559+0000 7f6e7dffb640 10 monclient: dump: 2024-09-12T17:28:46.950 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:46.950 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:46.950 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.950 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.950 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:46.950 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:46.950 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:46.950 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:46.950 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:46.950 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.950 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T17:28:46.559+0000 7f6e7dffb640 10 monclient: _finish_auth 0 2024-09-12T17:28:46.950 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T17:28:46.559+0000 7f6e7dffb640 10 monclient: _check_auth_tickets 2024-09-12T17:28:46.951 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T17:28:46.559+0000 7f6e7dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:28:46.951 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T17:28:46.559+0000 7f6e7dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:28:46.951 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T17:28:46.559+0000 7f6e7dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:28:46.951 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T17:28:46.559+0000 7f6e7dffb640 10 monclient: dump: 2024-09-12T17:28:46.951 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:28:46.951 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:28:46.951 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.951 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:28:46.951 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:28:46.951 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:28:46.951 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:28:46.951 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:28:46.951 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:28:46.951 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.952 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T17:28:46.559+0000 7f6faab17800 5 monclient: authenticate success, global_id 8286 2024-09-12T17:28:46.952 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T17:28:46.559+0000 7f6e7f7fe640 4 set_mon_vals no callback set 2024-09-12T17:28:46.952 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T17:28:46.559+0000 7f6faab17800 10 monclient: _renew_subs 2024-09-12T17:28:46.952 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T17:28:46.559+0000 7f6faab17800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:28:46.952 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T17:28:46.559+0000 7f6faab17800 10 monclient: _renew_subs 2024-09-12T17:28:46.952 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T17:28:46.559+0000 7f6faab17800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:28:46.952 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T17:28:46.559+0000 7f6faab17800 1 librados: init done 2024-09-12T17:28:46.952 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T17:28:46.559+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command cr dump hook 0x55ff9ab579a8 2024-09-12T17:28:46.952 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T17:28:46.561+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.952 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T17:28:46.561+0000 7f6e7dffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:28:46.952 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T17:28:46.561+0000 7f6e7dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:28:46.952 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T17:28:46.561+0000 7f6e7dffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:28:46.952 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T17:28:46.561+0000 7f6fa7e00640 10 monclient: get_auth_request con 0x7f6e70076470 auth_method 0 2024-09-12T17:28:46.953 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T17:28:46.561+0000 7f6fa8e02640 10 monclient: get_auth_request con 0x55ff9ab786f0 auth_method 0 2024-09-12T17:28:46.953 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T17:28:46.562+0000 7f6faab17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.953 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T17:28:46.562+0000 7f6faab17800 20 realm 2024-09-12T17:28:46.953 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T17:28:46.562+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.953 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T17:28:46.562+0000 7f6faab17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.953 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T17:28:46.562+0000 7f6faab17800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:46.953 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T17:28:46.562+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.953 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T17:28:46.562+0000 7f6faab17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.953 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T17:28:46.562+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.954 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T17:28:46.563+0000 7f6fa8601640 10 monclient: get_auth_request con 0x55ff9ab7c900 auth_method 0 2024-09-12T17:28:46.954 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T17:28:46.563+0000 7f6faab17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:46.954 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T17:28:46.563+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.954 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T17:28:46.563+0000 7f6fa7e00640 10 monclient: get_auth_request con 0x55ff9ab80160 auth_method 0 2024-09-12T17:28:46.954 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T17:28:46.564+0000 7f6faab17800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:28:46.954 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T17:28:46.564+0000 7f6faab17800 20 searching for the correct realm 2024-09-12T17:28:46.954 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T17:28:46.564+0000 7f6fa8e02640 10 monclient: get_auth_request con 0x55ff9ab84f00 auth_method 0 2024-09-12T17:28:46.954 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T17:28:46.565+0000 7f6fa8601640 10 monclient: get_auth_request con 0x7f6fa0033040 auth_method 0 2024-09-12T17:28:46.954 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T17:28:46.566+0000 7f6fa7e00640 10 monclient: get_auth_request con 0x7f6f98018070 auth_method 0 2024-09-12T17:28:46.954 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T17:28:46.566+0000 7f6fa7e00640 0 -- 172.21.15.67:0/2094100010 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f6f98018070 msgr2=0x7f6f9808c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:46.954 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T17:28:46.566+0000 7f6e7dffb640 1 client.8286.objecter ms_handle_reset 0x7f6f98018070 session 0x7f6f98084020 osd.2 2024-09-12T17:28:46.955 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T17:28:46.566+0000 7f6e7dffb640 10 monclient: _renew_subs 2024-09-12T17:28:46.955 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T17:28:46.566+0000 7f6e7dffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:28:46.955 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T17:28:46.566+0000 7f6fa7e00640 10 monclient: get_auth_request con 0x7f6e70086310 auth_method 0 2024-09-12T17:28:46.955 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T17:28:46.568+0000 7f6fa8e02640 10 monclient: get_auth_request con 0x7f6f9c06d070 auth_method 0 2024-09-12T17:28:46.955 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T17:28:46.570+0000 7f6fa8601640 0 -- 172.21.15.67:0/2094100010 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f6f9c0a0b10 msgr2=0x7f6f9c0ab920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:46.955 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T17:28:46.570+0000 7f6fa8601640 10 monclient: get_auth_request con 0x7f6f9c0a0b10 auth_method 0 2024-09-12T17:28:46.955 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T17:28:46.771+0000 7f6fa8601640 10 monclient: get_auth_request con 0x7f6f9c0a0b10 auth_method 0 2024-09-12T17:28:46.955 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T17:28:46.776+0000 7f6faab17800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:28:46.955 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T17:28:46.776+0000 7f6faab17800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:28:46.955 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T17:28:46.776+0000 7f6faab17800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:46.955 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T17:28:46.776+0000 7f6faab17800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:46.955 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T17:28:46.776+0000 7f6faab17800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:46.956 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T17:28:46.776+0000 7f6faab17800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:46.956 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T17:28:46.776+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.956 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T17:28:46.776+0000 7f6faab17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.956 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T17:28:46.776+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.956 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T17:28:46.776+0000 7f6faab17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:46.956 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T17:28:46.776+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.956 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T17:28:46.777+0000 7f6faab17800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:28:46.956 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T17:28:46.777+0000 7f6faab17800 20 zone default found 2024-09-12T17:28:46.956 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T17:28:46.777+0000 7f6faab17800 4 Realm: () 2024-09-12T17:28:46.956 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T17:28:46.777+0000 7f6faab17800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:28:46.956 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T17:28:46.777+0000 7f6faab17800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:28:46.956 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T17:28:46.777+0000 7f6faab17800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:46.957 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T17:28:46.777+0000 7f6faab17800 20 zonegroup default 2024-09-12T17:28:46.957 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T17:28:46.777+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.957 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T17:28:46.777+0000 7f6faab17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.957 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T17:28:46.777+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.957 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T17:28:46.777+0000 7f6faab17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.957 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T17:28:46.777+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.957 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T17:28:46.777+0000 7f6faab17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.957 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T17:28:46.777+0000 7f6faab17800 20 started sync module instance, tier type = 2024-09-12T17:28:46.957 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T17:28:46.777+0000 7f6faab17800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:28:46.957 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T17:28:46.787+0000 7f6faab17800 20 add_watcher() i=0 2024-09-12T17:28:46.957 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T17:28:46.787+0000 7f6faab17800 20 add_watcher() i=1 2024-09-12T17:28:46.957 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T17:28:46.787+0000 7f6faab17800 20 add_watcher() i=2 2024-09-12T17:28:46.957 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T17:28:46.787+0000 7f6faab17800 20 add_watcher() i=3 2024-09-12T17:28:46.958 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T17:28:46.787+0000 7f6faab17800 20 add_watcher() i=4 2024-09-12T17:28:46.958 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T17:28:46.787+0000 7f6faab17800 20 add_watcher() i=5 2024-09-12T17:28:46.958 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T17:28:46.787+0000 7f6faab17800 20 add_watcher() i=6 2024-09-12T17:28:46.958 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T17:28:46.788+0000 7f6faab17800 20 add_watcher() i=7 2024-09-12T17:28:46.958 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T17:28:46.788+0000 7f6faab17800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:46.958 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding auth protocol: cephx 2024-09-12T17:28:46.958 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding auth protocol: cephx 2024-09-12T17:28:46.958 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding auth protocol: cephx 2024-09-12T17:28:46.958 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding con mode: secure 2024-09-12T17:28:46.959 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding con mode: crc 2024-09-12T17:28:46.959 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding con mode: secure 2024-09-12T17:28:46.959 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding con mode: crc 2024-09-12T17:28:46.959 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding con mode: secure 2024-09-12T17:28:46.959 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding con mode: crc 2024-09-12T17:28:46.959 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding con mode: crc 2024-09-12T17:28:46.959 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding con mode: secure 2024-09-12T17:28:46.959 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding con mode: crc 2024-09-12T17:28:46.959 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding con mode: secure 2024-09-12T17:28:46.959 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding con mode: crc 2024-09-12T17:28:46.959 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 AuthRegistry(0x7ffe1b16fc30) adding con mode: secure 2024-09-12T17:28:46.960 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T17:28:46.790+0000 7f6e5efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:46.960 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T17:28:46.790+0000 7f6faab17800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:28:46.960 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T17:28:46.790+0000 7f6faab17800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:46.960 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T17:28:46.790+0000 7f6faab17800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:46.960 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command cache list hook 0x55ff9ab6c090 2024-09-12T17:28:46.960 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command cache inspect hook 0x55ff9ab6c090 2024-09-12T17:28:46.960 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command cache erase hook 0x55ff9ab6c090 2024-09-12T17:28:46.960 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command cache zap hook 0x55ff9ab6c090 2024-09-12T17:28:46.960 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 note: GC not initialized 2024-09-12T17:28:46.960 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T17:28:46.790+0000 7f6e5dfdb640 20 reqs_thread_entry: start 2024-09-12T17:28:46.961 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command sync trace show hook 0x7f6fa000cc20 2024-09-12T17:28:46.961 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command sync trace history hook 0x7f6fa000cc20 2024-09-12T17:28:46.961 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command sync trace active hook 0x7f6fa000cc20 2024-09-12T17:28:46.961 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T17:28:46.790+0000 7f6faab17800 5 asok(0x55ff9a86c730) register_command sync trace active_short hook 0x7f6fa000cc20 2024-09-12T17:28:46.961 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T17:28:46.790+0000 7f6faab17800 20 init_complete bucket index max shards: 1 2024-09-12T17:28:46.961 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T17:28:46.790+0000 7f6faab17800 20 Filter name: none 2024-09-12T17:28:46.961 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T17:28:46.791+0000 7f6dcf7fe640 20 reqs_thread_entry: start 2024-09-12T17:28:46.961 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T17:28:46.791+0000 7f6faab17800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:28:46.961 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T17:28:46.791+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.961 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T17:28:46.791+0000 7f6faab17800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:28:46.961 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T17:28:46.791+0000 7f6faab17800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:28:46.962 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T17:28:46.791+0000 7f6faab17800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:28:46.962 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T17:28:46.791+0000 7f6faab17800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : miss 2024-09-12T17:28:46.962 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T17:28:46.791+0000 7f6faab17800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.962 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T17:28:46.792+0000 7f6faab17800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:28:46.962 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T17:28:46.792+0000 7f6faab17800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:28:46.962 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T17:28:46.792+0000 7f6faab17800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:28:46.962 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T17:28:46.792+0000 7f6faab17800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:46.962 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T17:28:46.792+0000 7f6faab17800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:28:46.962 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T17:28:46.792+0000 7f6faab17800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:28:46.962 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T17:28:46.796+0000 7f6faab17800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:28:46.962 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T17:28:46.796+0000 7f6faab17800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:28:46.963 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T17:28:46.796+0000 7f6faab17800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:28:46.963 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T17:28:46.796+0000 7f6faab17800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18, ofs0, ns] 2024-09-12T17:28:46.963 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T17:28:46.796+0000 7f6e7f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464369 cookie 94556300812704 notifier 8286 bl.length()=911 2024-09-12T17:28:46.963 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T17:28:46.796+0000 7f6e7f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:28:46.963 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T17:28:46.796+0000 7f6e7f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:28:46.963 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T17:28:46.796+0000 7f6e7f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:28:46.963 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T17:28:46.798+0000 7f6faab17800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_sources= new_sources= 2024-09-12T17:28:46.963 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T17:28:46.798+0000 7f6faab17800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:28:46.963 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T17:28:46.798+0000 7f6faab17800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_dests= new_dests= 2024-09-12T17:28:46.963 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T17:28:46.798+0000 7f6faab17800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:28:46.963 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T17:28:46.801+0000 7f6faab17800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6faab17800 time 2024-09-12T17:28:46.801718+0000 2024-09-12T17:28:46.963 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:28:46.963 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.964 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:28:46.964 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6fadf8c71a] 2024-09-12T17:28:46.964 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6fadf8c8d8] 2024-09-12T17:28:46.964 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff98e04841] 2024-09-12T17:28:46.964 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ff98e1457a] 2024-09-12T17:28:46.964 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T17:28:46.964 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f6facc29590] 2024-09-12T17:28:46.964 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T17:28:46.964 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T17:28:46.964 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.964 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T17:28:46.802+0000 7f6faab17800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:28:46.964 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f6faab17800 thread_name:radosgw-admin 2024-09-12T17:28:46.965 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.965 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:28:46.965 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6facc3e6f0] 2024-09-12T17:28:46.965 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6facc8b99c] 2024-09-12T17:28:46.965 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:28:46.965 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:28:46.965 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6fadf8c774] 2024-09-12T17:28:46.965 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6fadf8c8d8] 2024-09-12T17:28:46.965 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff98e04841] 2024-09-12T17:28:46.966 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ff98e1457a] 2024-09-12T17:28:46.966 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T17:28:46.966 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f6facc29590] 2024-09-12T17:28:46.966 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T17:28:46.966 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T17:28:46.966 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:28:46.966 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:28:46.966 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T17:28:46.966 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T17:28:46.966 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T17:28:46.966 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T17:28:46.966 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T17:28:46.966 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T17:28:46.967 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T17:28:46.967 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T17:28:46.967 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T17:28:46.967 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T17:28:46.967 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T17:28:46.967 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T17:28:46.967 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T17:28:46.967 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T17:28:46.967 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T17:28:46.967 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T17:28:46.967 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T17:28:46.967 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T17:28:46.968 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T17:28:46.968 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T17:28:46.968 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T17:28:46.968 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T17:28:46.968 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T17:28:46.968 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T17:28:46.968 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:28:46.968 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T17:28:46.968 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T17:28:46.968 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T17:28:46.968 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T17:28:46.968 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T17:28:46.968 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T17:28:46.969 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T17:28:46.969 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T17:28:46.969 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T17:28:46.969 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T17:28:46.969 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T17:28:46.969 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T17:28:46.969 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T17:28:46.969 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T17:28:46.970 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T17:28:46.970 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T17:28:46.970 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T17:28:46.970 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T17:28:46.970 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T17:28:46.970 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T17:28:46.970 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T17:28:46.970 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:28:46.970 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T17:28:46.970 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:28:46.971 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T17:28:46.971 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T17:28:46.971 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T17:28:46.971 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T17:28:46.971 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T17:28:46.971 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T17:28:46.971 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T17:28:46.971 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T17:28:46.971 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T17:28:46.971 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T17:28:46.972 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T17:28:46.972 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T17:28:46.972 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T17:28:46.972 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T17:28:46.972 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T17:28:46.972 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T17:28:46.972 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T17:28:46.972 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T17:28:46.972 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:28:46.972 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T17:28:46.972 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:28:46.972 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T17:28:46.972 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T17:28:46.973 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T17:28:46.973 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T17:28:46.973 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T17:28:46.973 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T17:28:46.973 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:28:46.973 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T17:28:46.973 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T17:28:46.973 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:28:46.973 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T17:28:46.973 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T17:28:46.973 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T17:28:46.973 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T17:28:46.974 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T17:28:46.974 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T17:28:46.974 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T17:28:46.974 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T17:28:46.974 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T17:28:46.974 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T17:28:46.975 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T17:28:46.975 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T17:28:46.975 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T17:28:46.975 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:28:46.975 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6dcf7fe640 / http_manager 2024-09-12T17:28:46.975 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6e5dfdb640 / http_manager 2024-09-12T17:28:46.975 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6e5efdd640 / rgw_dt_lg_renew 2024-09-12T17:28:46.976 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6e7dffb640 / ms_dispatch 2024-09-12T17:28:46.976 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6e7f7fe640 / io_context_pool 2024-09-12T17:28:46.976 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6e8dffb640 / ms_dispatch 2024-09-12T17:28:46.976 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6e94e09640 / ms_dispatch 2024-09-12T17:28:46.976 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6e9660c640 / io_context_pool 2024-09-12T17:28:46.976 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6fa7e00640 / msgr-worker-2 2024-09-12T17:28:46.977 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6fa8601640 / msgr-worker-1 2024-09-12T17:28:46.977 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6fa8e02640 / msgr-worker-0 2024-09-12T17:28:46.977 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6fa9603640 / io_context_pool 2024-09-12T17:28:46.977 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6faab17800 / radosgw-admin 2024-09-12T17:28:46.977 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T17:28:46.977 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T17:28:46.978 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:28:46.803107Z_c6fb5265-1b26-4dd2-ab35-50d58fd36508/log 2024-09-12T17:28:46.978 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T17:28:46.978 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:28:46.981 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:46.981 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:46.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.879+0000 7f3ec9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.881+0000 7f3ec9b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.881+0000 7f3ec9b25800 20 realm 2024-09-12T17:28:46.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.881+0000 7f3ec9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.881+0000 7f3ec9b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.881+0000 7f3ec9b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:46.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.881+0000 7f3ec9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.882+0000 7f3ec9b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:46.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.882+0000 7f3ec9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.882+0000 7f3ec9b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:46.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.882+0000 7f3ec9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:28:46.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.883+0000 7f3ec9b25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:28:46.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.883+0000 7f3ec9b25800 20 searching for the correct realm 2024-09-12T17:28:46.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.885+0000 7f3ec4fb4640 0 -- 172.21.15.67:0/525401242 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f3eb8046040 msgr2=0x7f3eb8046930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:46.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:46.889+0000 7f3ec57b5640 0 -- 172.21.15.67:0/525401242 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f3ebc0d0090 msgr2=0x7f3ebc0d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:47.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.096+0000 7f3ec9b25800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:28:47.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.096+0000 7f3ec9b25800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:28:47.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.096+0000 7f3ec9b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:47.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.096+0000 7f3ec9b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:47.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.096+0000 7f3ec9b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:47.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.096+0000 7f3ec9b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:47.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.096+0000 7f3ec9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:28:47.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.096+0000 7f3ec9b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:47.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.096+0000 7f3ec9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:28:47.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.097+0000 7f3ec9b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:47.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.097+0000 7f3ec9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:28:47.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.097+0000 7f3ec9b25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:28:47.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.097+0000 7f3ec9b25800 20 zone default found 2024-09-12T17:28:47.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.097+0000 7f3ec9b25800 4 Realm: () 2024-09-12T17:28:47.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.097+0000 7f3ec9b25800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:28:47.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.097+0000 7f3ec9b25800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:28:47.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.097+0000 7f3ec9b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:47.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.097+0000 7f3ec9b25800 20 zonegroup default 2024-09-12T17:28:47.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.097+0000 7f3ec9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:28:47.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.097+0000 7f3ec9b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:47.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.097+0000 7f3ec9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:28:47.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.097+0000 7f3ec9b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:47.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.098+0000 7f3ec9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:28:47.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.098+0000 7f3ec9b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:47.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.098+0000 7f3ec9b25800 20 started sync module instance, tier type = 2024-09-12T17:28:47.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.098+0000 7f3ec9b25800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:28:47.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.107+0000 7f3ec9b25800 20 add_watcher() i=0 2024-09-12T17:28:47.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.107+0000 7f3ec9b25800 20 add_watcher() i=1 2024-09-12T17:28:47.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.107+0000 7f3ec9b25800 20 add_watcher() i=2 2024-09-12T17:28:47.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.107+0000 7f3ec9b25800 20 add_watcher() i=3 2024-09-12T17:28:47.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.107+0000 7f3ec9b25800 20 add_watcher() i=4 2024-09-12T17:28:47.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.107+0000 7f3ec9b25800 20 add_watcher() i=5 2024-09-12T17:28:47.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.107+0000 7f3ec9b25800 20 add_watcher() i=6 2024-09-12T17:28:47.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.108+0000 7f3ec9b25800 20 add_watcher() i=7 2024-09-12T17:28:47.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.108+0000 7f3ec9b25800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:47.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.110+0000 7f3d7b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:47.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.110+0000 7f3ec9b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:47.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.110+0000 7f3ec9b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:47.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.111+0000 7f3ec9b25800 5 note: GC not initialized 2024-09-12T17:28:47.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.111+0000 7f3d7a7e4640 20 reqs_thread_entry: start 2024-09-12T17:28:47.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.111+0000 7f3ec9b25800 20 init_complete bucket index max shards: 1 2024-09-12T17:28:47.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.111+0000 7f3ec9b25800 20 Filter name: none 2024-09-12T17:28:47.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.111+0000 7f3cebfff640 20 reqs_thread_entry: start 2024-09-12T17:28:47.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.111+0000 7f3ec9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:28:47.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.111+0000 7f3ec9b25800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:28:47.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.111+0000 7f3ec9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:28:47.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.112+0000 7f3ec9b25800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:28:47.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.112+0000 7f3ec9b25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:28:47.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.112+0000 7f3ec9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:28:47.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.113+0000 7f3ec9b25800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:28:47.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.113+0000 7f3ec9b25800 20 rados->read ofs=0 len=0 2024-09-12T17:28:47.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.113+0000 7f3ec9b25800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:28:47.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.113+0000 7f3ec9b25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:28:47.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.115+0000 7f3d7b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:47.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.117+0000 7f3ec9b25800 20 remove_watcher() i=0 2024-09-12T17:28:47.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.117+0000 7f3ec9b25800 2 removed watcher, disabling cache 2024-09-12T17:28:47.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.118+0000 7f3ec9b25800 20 remove_watcher() i=1 2024-09-12T17:28:47.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.120+0000 7f3ec9b25800 20 remove_watcher() i=2 2024-09-12T17:28:47.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.121+0000 7f3ec9b25800 20 remove_watcher() i=3 2024-09-12T17:28:47.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.122+0000 7f3ec9b25800 20 remove_watcher() i=4 2024-09-12T17:28:47.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.123+0000 7f3ec9b25800 20 remove_watcher() i=5 2024-09-12T17:28:47.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.124+0000 7f3ec9b25800 20 remove_watcher() i=6 2024-09-12T17:28:47.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.125+0000 7f3ec9b25800 20 remove_watcher() i=7 2024-09-12T17:28:47.139 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:28:47.139 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:28:47.177 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:28:47.206 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:47.206 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:47.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.244+0000 7f276fa14800 20 rados->read ofs=0 len=0 2024-09-12T17:28:47.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.245+0000 7f276fa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:47.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.245+0000 7f276fa14800 20 realm 2024-09-12T17:28:47.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.245+0000 7f276fa14800 20 rados->read ofs=0 len=0 2024-09-12T17:28:47.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.245+0000 7f276fa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:47.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.245+0000 7f276fa14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:47.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.245+0000 7f276fa14800 20 rados->read ofs=0 len=0 2024-09-12T17:28:47.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.245+0000 7f276fa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:47.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.245+0000 7f276fa14800 20 rados->read ofs=0 len=0 2024-09-12T17:28:47.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.246+0000 7f276fa14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:47.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.246+0000 7f276fa14800 20 rados->read ofs=0 len=0 2024-09-12T17:28:47.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.247+0000 7f276fa14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:28:47.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.247+0000 7f276fa14800 20 searching for the correct realm 2024-09-12T17:28:47.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.250+0000 7f276b0cb640 0 -- 172.21.15.67:0/1484806828 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f2764061040 msgr2=0x7f2764055920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:47.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.254+0000 7f276b0cb640 0 -- 172.21.15.67:0/1484806828 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f276001b040 msgr2=0x7f2760052460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:28:47.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.460+0000 7f276fa14800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:28:47.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.460+0000 7f276fa14800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:28:47.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.460+0000 7f276fa14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:47.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.460+0000 7f276fa14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:47.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.460+0000 7f276fa14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:47.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.460+0000 7f276fa14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:47.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.460+0000 7f276fa14800 20 rados->read ofs=0 len=0 2024-09-12T17:28:47.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.461+0000 7f276fa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:47.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.461+0000 7f276fa14800 20 rados->read ofs=0 len=0 2024-09-12T17:28:47.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.461+0000 7f276fa14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:47.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.461+0000 7f276fa14800 20 rados->read ofs=0 len=0 2024-09-12T17:28:47.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.461+0000 7f276fa14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:28:47.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.461+0000 7f276fa14800 20 zone default found 2024-09-12T17:28:47.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.461+0000 7f276fa14800 4 Realm: () 2024-09-12T17:28:47.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.461+0000 7f276fa14800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:28:47.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.461+0000 7f276fa14800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:28:47.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.461+0000 7f276fa14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:47.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.461+0000 7f276fa14800 20 zonegroup default 2024-09-12T17:28:47.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.461+0000 7f276fa14800 20 rados->read ofs=0 len=0 2024-09-12T17:28:47.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.462+0000 7f276fa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:47.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.462+0000 7f276fa14800 20 rados->read ofs=0 len=0 2024-09-12T17:28:47.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.462+0000 7f276fa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:47.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.462+0000 7f276fa14800 20 rados->read ofs=0 len=0 2024-09-12T17:28:47.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.463+0000 7f276fa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:47.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.463+0000 7f276fa14800 20 started sync module instance, tier type = 2024-09-12T17:28:47.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.463+0000 7f276fa14800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:28:47.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.472+0000 7f276fa14800 20 add_watcher() i=0 2024-09-12T17:28:47.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.472+0000 7f276fa14800 20 add_watcher() i=1 2024-09-12T17:28:47.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.472+0000 7f276fa14800 20 add_watcher() i=2 2024-09-12T17:28:47.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.472+0000 7f276fa14800 20 add_watcher() i=3 2024-09-12T17:28:47.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.472+0000 7f276fa14800 20 add_watcher() i=4 2024-09-12T17:28:47.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.472+0000 7f276fa14800 20 add_watcher() i=5 2024-09-12T17:28:47.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.473+0000 7f276fa14800 20 add_watcher() i=6 2024-09-12T17:28:47.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.474+0000 7f276fa14800 20 add_watcher() i=7 2024-09-12T17:28:47.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.474+0000 7f276fa14800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:47.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.475+0000 7f2621fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:47.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.476+0000 7f276fa14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:47.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.476+0000 7f276fa14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:47.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.476+0000 7f276fa14800 5 note: GC not initialized 2024-09-12T17:28:47.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.476+0000 7f2620fe1640 20 reqs_thread_entry: start 2024-09-12T17:28:47.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.476+0000 7f276fa14800 20 init_complete bucket index max shards: 1 2024-09-12T17:28:47.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.476+0000 7f276fa14800 20 Filter name: none 2024-09-12T17:28:47.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.476+0000 7f259a7fc640 20 reqs_thread_entry: start 2024-09-12T17:28:47.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.476+0000 7f276fa14800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:28:47.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.476+0000 7f276fa14800 20 rados->read ofs=0 len=0 2024-09-12T17:28:47.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.477+0000 7f276fa14800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:28:47.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.477+0000 7f276fa14800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:28:47.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.477+0000 7f276fa14800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:28:47.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.477+0000 7f276fa14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : miss 2024-09-12T17:28:47.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.477+0000 7f276fa14800 20 rados->read ofs=0 len=0 2024-09-12T17:28:47.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.477+0000 7f276fa14800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:28:47.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.477+0000 7f276fa14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:28:47.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.477+0000 7f276fa14800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:28:47.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.477+0000 7f276fa14800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:47.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.477+0000 7f276fa14800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:28:47.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.477+0000 7f276fa14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:28:47.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.477+0000 7f276fa14800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 2024-09-12T17:28:47.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.477+0000 7f276fa14800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 2024-09-12T17:28:47.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.477+0000 7f276fa14800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.1 2024-09-12T17:28:47.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.477+0000 7f276fa14800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.1 2024-09-12T17:28:47.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.478+0000 7f276fa14800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.2 2024-09-12T17:28:47.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.478+0000 7f276fa14800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.2 2024-09-12T17:28:47.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.479+0000 7f2621fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:47.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.482+0000 7f276fa14800 20 remove_watcher() i=0 2024-09-12T17:28:47.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.482+0000 7f276fa14800 2 removed watcher, disabling cache 2024-09-12T17:28:47.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.483+0000 7f276fa14800 20 remove_watcher() i=1 2024-09-12T17:28:47.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.484+0000 7f276fa14800 20 remove_watcher() i=2 2024-09-12T17:28:47.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.485+0000 7f276fa14800 20 remove_watcher() i=3 2024-09-12T17:28:47.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.486+0000 7f276fa14800 20 remove_watcher() i=4 2024-09-12T17:28:47.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.487+0000 7f276fa14800 20 remove_watcher() i=5 2024-09-12T17:28:47.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.488+0000 7f276fa14800 20 remove_watcher() i=6 2024-09-12T17:28:47.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:28:47.489+0000 7f276fa14800 20 remove_watcher() i=7 2024-09-12T17:29:17.534 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T17:29:17.573 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:17.573 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:17.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.617+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.618+0000 7f6090696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.618+0000 7f6090696800 20 realm 2024-09-12T17:29:17.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.618+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.618+0000 7f6090696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.618+0000 7f6090696800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:17.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.618+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.619+0000 7f6090696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.619+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.620+0000 7f6090696800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:17.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.620+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.621+0000 7f6090696800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:29:17.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.621+0000 7f6090696800 20 searching for the correct realm 2024-09-12T17:29:17.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.624+0000 7f608d97f640 0 -- 172.21.15.67:0/781528773 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x55699cc8f4b0 msgr2=0x55699cc91910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:29:17.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.628+0000 7f608d97f640 0 -- 172.21.15.67:0/781528773 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55699cc96f40 msgr2=0x55699cc99330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:29:17.634 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.633+0000 7f6090696800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:29:17.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.633+0000 7f6090696800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:29:17.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.633+0000 7f6090696800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:17.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.633+0000 7f6090696800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:17.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.633+0000 7f6090696800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:17.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.633+0000 7f6090696800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:17.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.633+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.633+0000 7f6090696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.633+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.634+0000 7f6090696800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:17.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.634+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.634+0000 7f6090696800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:29:17.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.634+0000 7f6090696800 20 zone default found 2024-09-12T17:29:17.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.634+0000 7f6090696800 4 Realm: () 2024-09-12T17:29:17.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.634+0000 7f6090696800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:29:17.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.634+0000 7f6090696800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:29:17.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.634+0000 7f6090696800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:17.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.634+0000 7f6090696800 20 zonegroup default 2024-09-12T17:29:17.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.634+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.634+0000 7f6090696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.634+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.635+0000 7f6090696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.635+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.635+0000 7f6090696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.635+0000 7f6090696800 20 started sync module instance, tier type = 2024-09-12T17:29:17.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.635+0000 7f6090696800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:29:17.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.645+0000 7f6090696800 20 add_watcher() i=0 2024-09-12T17:29:17.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.645+0000 7f6090696800 20 add_watcher() i=1 2024-09-12T17:29:17.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.645+0000 7f6090696800 20 add_watcher() i=2 2024-09-12T17:29:17.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.645+0000 7f6090696800 20 add_watcher() i=3 2024-09-12T17:29:17.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.645+0000 7f6090696800 20 add_watcher() i=4 2024-09-12T17:29:17.647 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.645+0000 7f6090696800 20 add_watcher() i=5 2024-09-12T17:29:17.647 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.645+0000 7f6090696800 20 add_watcher() i=6 2024-09-12T17:29:17.647 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.646+0000 7f6090696800 20 add_watcher() i=7 2024-09-12T17:29:17.647 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.646+0000 7f6090696800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:17.648 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.648+0000 7f5f44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:17.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.648+0000 7f6090696800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:17.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.648+0000 7f6090696800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:17.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.648+0000 7f6090696800 5 note: GC not initialized 2024-09-12T17:29:17.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.648+0000 7f5ebf7fe640 20 reqs_thread_entry: start 2024-09-12T17:29:17.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.648+0000 7f6090696800 20 init_complete bucket index max shards: 1 2024-09-12T17:29:17.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.648+0000 7f6090696800 20 Filter name: none 2024-09-12T17:29:17.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.649+0000 7f5ebd7fa640 20 reqs_thread_entry: start 2024-09-12T17:29:17.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.649+0000 7f6090696800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:29:17.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.649+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.649+0000 7f6090696800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:29:17.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.649+0000 7f6090696800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:29:17.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.649+0000 7f6090696800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:29:17.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.649+0000 7f6090696800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : miss 2024-09-12T17:29:17.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.649+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.650+0000 7f6090696800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:29:17.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.650+0000 7f6090696800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:29:17.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.650+0000 7f6090696800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:29:17.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.650+0000 7f6090696800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:17.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.650+0000 7f6090696800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:29:17.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.650+0000 7f6090696800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:29:17.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.651+0000 7f6090696800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:29:17.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.656+0000 7f6090696800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:29:17.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.656+0000 7f6090696800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:29:17.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.656+0000 7f6090696800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:29:17.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.656+0000 7f6090696800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18, ofs0, ns] 2024-09-12T17:29:17.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.657+0000 7f5f71ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464370 cookie 93912090345152 notifier 7820 bl.length()=911 2024-09-12T17:29:17.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.657+0000 7f5f71ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:29:17.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.657+0000 7f5f71ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:29:17.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.657+0000 7f5f71ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:29:17.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.658+0000 7f6090696800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_sources= new_sources= 2024-09-12T17:29:17.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.658+0000 7f6090696800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:29:17.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.658+0000 7f6090696800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_dests= new_dests= 2024-09-12T17:29:17.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.658+0000 7f6090696800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:29:17.662 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6090696800 time 2024-09-12T17:29:17.662349+0000 2024-09-12T17:29:17.662 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:29:17.663 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:29:17.663 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6093b8c71a] 2024-09-12T17:29:17.663 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6093b8c8d8] 2024-09-12T17:29:17.663 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55699a301841] 2024-09-12T17:29:17.663 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd7490c) [0x55699a80f90c] 2024-09-12T17:29:17.663 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55699a31150d] 2024-09-12T17:29:17.663 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:29:17.663 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6092829590] 2024-09-12T17:29:17.663 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:29:17.664 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:29:17.664 INFO:tasks.workunit.client.0.smithi067.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:29:17.664 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f6090696800 thread_name:radosgw-admin 2024-09-12T17:29:17.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.662+0000 7f6090696800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6090696800 time 2024-09-12T17:29:17.662349+0000 2024-09-12T17:29:17.664 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:29:17.664 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.664 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:29:17.664 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6093b8c71a] 2024-09-12T17:29:17.664 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6093b8c8d8] 2024-09-12T17:29:17.664 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55699a301841] 2024-09-12T17:29:17.664 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd7490c) [0x55699a80f90c] 2024-09-12T17:29:17.664 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55699a31150d] 2024-09-12T17:29:17.664 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:29:17.665 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6092829590] 2024-09-12T17:29:17.665 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:29:17.665 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:29:17.665 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.680 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:29:17.680 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f609283e6f0] 2024-09-12T17:29:17.680 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f609288b99c] 2024-09-12T17:29:17.680 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:29:17.680 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:29:17.680 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6093b8c774] 2024-09-12T17:29:17.680 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6093b8c8d8] 2024-09-12T17:29:17.680 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55699a301841] 2024-09-12T17:29:17.680 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd7490c) [0x55699a80f90c] 2024-09-12T17:29:17.680 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55699a31150d] 2024-09-12T17:29:17.681 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:29:17.681 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6092829590] 2024-09-12T17:29:17.681 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:29:17.681 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:29:17.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.663+0000 7f6090696800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:29:17.681 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f6090696800 thread_name:radosgw-admin 2024-09-12T17:29:17.681 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.681 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:29:17.681 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f609283e6f0] 2024-09-12T17:29:17.681 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f609288b99c] 2024-09-12T17:29:17.681 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:29:17.681 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:29:17.681 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6093b8c774] 2024-09-12T17:29:17.682 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6093b8c8d8] 2024-09-12T17:29:17.682 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55699a301841] 2024-09-12T17:29:17.682 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd7490c) [0x55699a80f90c] 2024-09-12T17:29:17.682 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55699a31150d] 2024-09-12T17:29:17.682 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:29:17.682 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6092829590] 2024-09-12T17:29:17.682 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:29:17.682 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:29:17.682 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:29:17.682 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.682 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T17:29:17.682 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T17:29:17.597+0000 7f5f7c608640 10 monclient: dump: 2024-09-12T17:29:17.682 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:17.683 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:17.683 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.683 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.683 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:17.683 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:17.683 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:17.683 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:17.683 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:17.683 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.683 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T17:29:17.597+0000 7f6090696800 10 monclient: get_monmap_and_config success 2024-09-12T17:29:17.683 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T17:29:17.597+0000 7f6090696800 4 set_mon_vals no callback set 2024-09-12T17:29:17.683 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T17:29:17.597+0000 7f6090696800 10 monclient: shutdown 2024-09-12T17:29:17.683 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T17:29:17.597+0000 7f6090696800 5 asok(0x55699c982730) unregister_commands rotate-key 2024-09-12T17:29:17.683 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T17:29:17.598+0000 7f6090696800 10 monclient: build_initial_monmap 2024-09-12T17:29:17.684 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T17:29:17.598+0000 7f6090696800 1 build_initial for_mkfs: 0 2024-09-12T17:29:17.684 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T17:29:17.598+0000 7f6090696800 10 monclient: monmap: 2024-09-12T17:29:17.684 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:29:17.684 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:29:17.684 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:29:17.684 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:29:17.684 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:29:17.684 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:17.684 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:29:17.684 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:29:17.684 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:29:17.684 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.685 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding auth protocol: cephx 2024-09-12T17:29:17.685 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding auth protocol: cephx 2024-09-12T17:29:17.685 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding auth protocol: cephx 2024-09-12T17:29:17.685 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding con mode: secure 2024-09-12T17:29:17.685 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding con mode: crc 2024-09-12T17:29:17.685 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding con mode: secure 2024-09-12T17:29:17.685 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding con mode: crc 2024-09-12T17:29:17.685 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding con mode: secure 2024-09-12T17:29:17.685 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding con mode: crc 2024-09-12T17:29:17.685 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding con mode: crc 2024-09-12T17:29:17.685 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding con mode: secure 2024-09-12T17:29:17.685 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding con mode: crc 2024-09-12T17:29:17.685 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding con mode: secure 2024-09-12T17:29:17.685 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding con mode: crc 2024-09-12T17:29:17.686 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding con mode: secure 2024-09-12T17:29:17.686 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T17:29:17.598+0000 7f6090696800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:17.686 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T17:29:17.598+0000 7f6090696800 1 librados: starting msgr at 2024-09-12T17:29:17.686 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T17:29:17.598+0000 7f6090696800 1 librados: starting objecter 2024-09-12T17:29:17.686 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T17:29:17.598+0000 7f6090696800 5 asok(0x55699c982730) register_command objecter_requests hook 0x55699cba9b80 2024-09-12T17:29:17.686 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T17:29:17.598+0000 7f6090696800 1 librados: setting wanted keys 2024-09-12T17:29:17.686 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T17:29:17.598+0000 7f6090696800 1 librados: calling monclient init 2024-09-12T17:29:17.686 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T17:29:17.598+0000 7f6090696800 10 monclient: init 2024-09-12T17:29:17.686 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding auth protocol: cephx 2024-09-12T17:29:17.687 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding auth protocol: cephx 2024-09-12T17:29:17.688 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding auth protocol: cephx 2024-09-12T17:29:17.688 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding con mode: secure 2024-09-12T17:29:17.688 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding con mode: crc 2024-09-12T17:29:17.688 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding con mode: secure 2024-09-12T17:29:17.688 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding con mode: crc 2024-09-12T17:29:17.688 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding con mode: secure 2024-09-12T17:29:17.688 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding con mode: crc 2024-09-12T17:29:17.688 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding con mode: crc 2024-09-12T17:29:17.688 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding con mode: secure 2024-09-12T17:29:17.689 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding con mode: crc 2024-09-12T17:29:17.689 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding con mode: secure 2024-09-12T17:29:17.689 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding con mode: crc 2024-09-12T17:29:17.689 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding con mode: secure 2024-09-12T17:29:17.689 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T17:29:17.598+0000 7f6090696800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:17.689 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T17:29:17.599+0000 7f6090696800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:17.689 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T17:29:17.599+0000 7f6090696800 5 asok(0x55699c982730) register_command rotate-key hook 0x55699cba4d28 2024-09-12T17:29:17.689 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T17:29:17.599+0000 7f6090696800 10 monclient: _reopen_session rank -1 2024-09-12T17:29:17.689 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T17:29:17.599+0000 7f6090696800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:29:17.689 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T17:29:17.599+0000 7f6090696800 10 monclient(hunting): picked mon.noname-b con 0x55699ca51ab0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:29:17.689 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T17:29:17.599+0000 7f6090696800 10 monclient(hunting): picked mon.noname-c con 0x55699caeda10 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:29:17.689 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T17:29:17.599+0000 7f6090696800 10 monclient(hunting): picked mon.noname-a con 0x55699caee3a0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:29:17.690 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T17:29:17.599+0000 7f6090696800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:17.690 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T17:29:17.599+0000 7f6090696800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:17.690 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T17:29:17.599+0000 7f6090696800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:17.690 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T17:29:17.599+0000 7f6090696800 10 monclient(hunting): _renew_subs 2024-09-12T17:29:17.690 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T17:29:17.599+0000 7f6090696800 10 monclient(hunting): authenticate will time out at 2568.949270s 2024-09-12T17:29:17.690 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T17:29:17.599+0000 7f608d97f640 10 monclient(hunting): get_auth_request con 0x55699caeda10 auth_method 0 2024-09-12T17:29:17.690 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T17:29:17.599+0000 7f608d97f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:17.690 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T17:29:17.599+0000 7f608d97f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:17.690 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T17:29:17.599+0000 7f608d97f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:17.690 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T17:29:17.599+0000 7f608e981640 10 monclient(hunting): get_auth_request con 0x55699caee3a0 auth_method 0 2024-09-12T17:29:17.690 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T17:29:17.599+0000 7f608e981640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:17.691 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T17:29:17.599+0000 7f608e981640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:17.691 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T17:29:17.599+0000 7f608e981640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:17.691 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T17:29:17.599+0000 7f608e981640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:17.691 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T17:29:17.599+0000 7f608e981640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:17.691 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T17:29:17.599+0000 7f608e981640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:17.691 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T17:29:17.599+0000 7f608d97f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:17.691 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T17:29:17.599+0000 7f608d97f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:17.691 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T17:29:17.599+0000 7f608d97f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:17.691 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T17:29:17.599+0000 7f608e180640 10 monclient(hunting): get_auth_request con 0x55699ca51ab0 auth_method 0 2024-09-12T17:29:17.692 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T17:29:17.599+0000 7f608e180640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:17.692 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T17:29:17.599+0000 7f608e180640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:17.692 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T17:29:17.599+0000 7f608e180640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:17.692 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T17:29:17.599+0000 7f608e981640 10 monclient(hunting): handle_auth_done global_id 8334 payload 824 2024-09-12T17:29:17.692 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T17:29:17.599+0000 7f608e981640 10 monclient: _finish_hunting 0 2024-09-12T17:29:17.692 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T17:29:17.599+0000 7f608e981640 1 monclient: found mon.noname-a 2024-09-12T17:29:17.692 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T17:29:17.599+0000 7f608e981640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:29:17.692 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T17:29:17.600+0000 7f5f7ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:17.692 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T17:29:17.600+0000 7f5f7ae05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:29:17.692 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T17:29:17.600+0000 7f5f7ae05640 10 monclient: dump: 2024-09-12T17:29:17.693 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:17.693 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:17.693 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.693 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.693 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:17.693 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:17.693 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:17.693 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:17.693 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:17.693 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.694 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T17:29:17.600+0000 7f5f7ae05640 10 monclient: _finish_auth 0 2024-09-12T17:29:17.694 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T17:29:17.600+0000 7f5f7ae05640 10 monclient: _check_auth_tickets 2024-09-12T17:29:17.694 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T17:29:17.600+0000 7f5f7ae05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:29:17.694 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T17:29:17.600+0000 7f5f7ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:17.694 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T17:29:17.600+0000 7f5f7ae05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:29:17.694 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T17:29:17.600+0000 7f5f7ae05640 10 monclient: dump: 2024-09-12T17:29:17.694 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:17.694 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:17.694 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.694 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.694 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:17.695 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:17.695 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:17.695 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:17.695 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:17.695 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.695 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T17:29:17.600+0000 7f6090696800 5 monclient: authenticate success, global_id 8334 2024-09-12T17:29:17.695 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T17:29:17.600+0000 7f6090696800 10 monclient: _renew_subs 2024-09-12T17:29:17.695 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T17:29:17.600+0000 7f5f7c608640 4 set_mon_vals no callback set 2024-09-12T17:29:17.695 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T17:29:17.600+0000 7f6090696800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:29:17.695 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T17:29:17.600+0000 7f6090696800 10 monclient: _renew_subs 2024-09-12T17:29:17.695 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T17:29:17.600+0000 7f6090696800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:29:17.696 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T17:29:17.600+0000 7f6090696800 1 librados: init done 2024-09-12T17:29:17.696 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T17:29:17.602+0000 7f5f7ae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:29:17.696 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T17:29:17.602+0000 7f5f7ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:29:17.696 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T17:29:17.602+0000 7f5f7ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:29:17.696 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T17:29:17.602+0000 7f608e180640 10 monclient: get_auth_request con 0x7f5f74076470 auth_method 0 2024-09-12T17:29:17.696 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T17:29:17.602+0000 7f608d97f640 10 monclient: get_auth_request con 0x55699cbcd290 auth_method 0 2024-09-12T17:29:17.696 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T17:29:17.603+0000 7f608e180640 10 monclient: get_auth_request con 0x55699cbefd10 auth_method 0 2024-09-12T17:29:17.696 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T17:29:17.604+0000 7f608d97f640 10 monclient: get_auth_request con 0x55699cbf41a0 auth_method 0 2024-09-12T17:29:17.696 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T17:29:17.606+0000 7f6090696800 10 monclient: build_initial_monmap 2024-09-12T17:29:17.696 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T17:29:17.606+0000 7f6090696800 1 build_initial for_mkfs: 0 2024-09-12T17:29:17.697 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T17:29:17.606+0000 7f6090696800 10 monclient: monmap: 2024-09-12T17:29:17.697 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:29:17.697 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:29:17.697 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:29:17.697 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:29:17.697 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:29:17.697 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:17.697 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:29:17.697 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:29:17.697 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:29:17.697 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.697 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding auth protocol: cephx 2024-09-12T17:29:17.697 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding auth protocol: cephx 2024-09-12T17:29:17.697 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding auth protocol: cephx 2024-09-12T17:29:17.698 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding con mode: secure 2024-09-12T17:29:17.698 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding con mode: crc 2024-09-12T17:29:17.698 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding con mode: secure 2024-09-12T17:29:17.698 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding con mode: crc 2024-09-12T17:29:17.698 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding con mode: secure 2024-09-12T17:29:17.698 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding con mode: crc 2024-09-12T17:29:17.698 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding con mode: crc 2024-09-12T17:29:17.698 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding con mode: secure 2024-09-12T17:29:17.698 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding con mode: crc 2024-09-12T17:29:17.698 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding con mode: secure 2024-09-12T17:29:17.698 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding con mode: crc 2024-09-12T17:29:17.698 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding con mode: secure 2024-09-12T17:29:17.699 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T17:29:17.606+0000 7f6090696800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:17.699 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T17:29:17.607+0000 7f6090696800 5 asok(0x55699c982730) register_command objecter_requests cmddesc objecter_requests hook 0x55699cbfc540 EEXIST 2024-09-12T17:29:17.699 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T17:29:17.607+0000 7f6090696800 10 monclient: init 2024-09-12T17:29:17.699 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding auth protocol: cephx 2024-09-12T17:29:17.699 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding auth protocol: cephx 2024-09-12T17:29:17.699 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding auth protocol: cephx 2024-09-12T17:29:17.699 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding con mode: secure 2024-09-12T17:29:17.699 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding con mode: crc 2024-09-12T17:29:17.699 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding con mode: secure 2024-09-12T17:29:17.699 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding con mode: crc 2024-09-12T17:29:17.699 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding con mode: secure 2024-09-12T17:29:17.699 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding con mode: crc 2024-09-12T17:29:17.699 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding con mode: crc 2024-09-12T17:29:17.700 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding con mode: secure 2024-09-12T17:29:17.700 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding con mode: crc 2024-09-12T17:29:17.700 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding con mode: secure 2024-09-12T17:29:17.700 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding con mode: crc 2024-09-12T17:29:17.700 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding con mode: secure 2024-09-12T17:29:17.700 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T17:29:17.607+0000 7f6090696800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:17.700 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T17:29:17.607+0000 7f6090696800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:17.700 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T17:29:17.607+0000 7f6090696800 5 asok(0x55699c982730) register_command rotate-key cmddesc rotate-key hook 0x55699cbf7820 EEXIST 2024-09-12T17:29:17.700 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T17:29:17.607+0000 7f6090696800 10 monclient: _reopen_session rank -1 2024-09-12T17:29:17.700 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T17:29:17.607+0000 7f6090696800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:29:17.700 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T17:29:17.607+0000 7f6090696800 10 monclient(hunting): picked mon.noname-c con 0x55699cc20860 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:29:17.700 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T17:29:17.607+0000 7f6090696800 10 monclient(hunting): picked mon.noname-b con 0x55699cc20c40 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:29:17.700 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T17:29:17.607+0000 7f6090696800 10 monclient(hunting): picked mon.noname-a con 0x55699cc1f570 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:29:17.701 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T17:29:17.607+0000 7f6090696800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:17.701 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T17:29:17.607+0000 7f6090696800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:17.701 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T17:29:17.607+0000 7f6090696800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:17.701 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T17:29:17.607+0000 7f6090696800 10 monclient(hunting): _renew_subs 2024-09-12T17:29:17.701 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T17:29:17.607+0000 7f6090696800 10 monclient(hunting): authenticate will time out at 2568.957806s 2024-09-12T17:29:17.701 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T17:29:17.607+0000 7f608e180640 10 monclient(hunting): get_auth_request con 0x55699cc20860 auth_method 0 2024-09-12T17:29:17.701 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T17:29:17.607+0000 7f608e180640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:17.701 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T17:29:17.607+0000 7f608e180640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:17.701 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T17:29:17.607+0000 7f608e180640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:17.701 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T17:29:17.607+0000 7f608e981640 10 monclient(hunting): get_auth_request con 0x55699cc1f570 auth_method 0 2024-09-12T17:29:17.701 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T17:29:17.607+0000 7f608e981640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:17.701 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T17:29:17.607+0000 7f608e981640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:17.701 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T17:29:17.607+0000 7f608e981640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:17.701 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T17:29:17.608+0000 7f608d97f640 10 monclient(hunting): get_auth_request con 0x55699cc20c40 auth_method 0 2024-09-12T17:29:17.702 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T17:29:17.608+0000 7f608d97f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:17.702 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T17:29:17.608+0000 7f608d97f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:17.702 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T17:29:17.608+0000 7f608d97f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:17.702 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T17:29:17.608+0000 7f608e981640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:17.702 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T17:29:17.608+0000 7f608e981640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:17.702 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T17:29:17.608+0000 7f608e981640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:17.702 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T17:29:17.608+0000 7f608e180640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:17.702 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T17:29:17.608+0000 7f608e180640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:17.702 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T17:29:17.608+0000 7f608e180640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:17.702 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T17:29:17.608+0000 7f608d97f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:17.702 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T17:29:17.608+0000 7f608d97f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:17.702 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T17:29:17.608+0000 7f608d97f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:17.702 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T17:29:17.608+0000 7f608e981640 10 monclient(hunting): handle_auth_done global_id 8337 payload 824 2024-09-12T17:29:17.702 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T17:29:17.608+0000 7f608e981640 10 monclient: _finish_hunting 0 2024-09-12T17:29:17.703 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T17:29:17.608+0000 7f608e981640 1 monclient: found mon.noname-a 2024-09-12T17:29:17.703 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T17:29:17.608+0000 7f608e981640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:29:17.703 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T17:29:17.608+0000 7f5f73fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:17.703 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T17:29:17.608+0000 7f5f73fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:29:17.703 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T17:29:17.608+0000 7f5f73fff640 10 monclient: dump: 2024-09-12T17:29:17.703 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:17.703 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:17.703 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.703 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.703 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:17.703 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:17.703 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:17.703 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:17.703 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:17.704 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.704 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T17:29:17.608+0000 7f5f73fff640 10 monclient: _finish_auth 0 2024-09-12T17:29:17.704 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T17:29:17.608+0000 7f5f73fff640 10 monclient: _check_auth_tickets 2024-09-12T17:29:17.704 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T17:29:17.608+0000 7f5f73fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:29:17.704 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T17:29:17.608+0000 7f5f73fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:17.705 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T17:29:17.608+0000 7f5f73fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:29:17.705 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T17:29:17.608+0000 7f5f73fff640 10 monclient: dump: 2024-09-12T17:29:17.705 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:17.705 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:17.705 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.705 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.705 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:17.705 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:17.705 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:17.705 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:17.705 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:17.705 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.705 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T17:29:17.608+0000 7f6090696800 5 monclient: authenticate success, global_id 8337 2024-09-12T17:29:17.706 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T17:29:17.608+0000 7f6090696800 10 monclient: _renew_subs 2024-09-12T17:29:17.706 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T17:29:17.608+0000 7f6090696800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:29:17.706 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T17:29:17.608+0000 7f608f182640 4 set_mon_vals no callback set 2024-09-12T17:29:17.706 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T17:29:17.608+0000 7f6090696800 10 monclient: _renew_subs 2024-09-12T17:29:17.706 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T17:29:17.608+0000 7f6090696800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:29:17.706 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T17:29:17.610+0000 7f5f73fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:29:17.706 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T17:29:17.610+0000 7f5f73fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:29:17.706 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T17:29:17.610+0000 7f5f73fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:29:17.706 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T17:29:17.610+0000 7f608e180640 10 monclient: get_auth_request con 0x7f5f68076380 auth_method 0 2024-09-12T17:29:17.706 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T17:29:17.610+0000 7f6090696800 10 monclient: get_monmap_and_config 2024-09-12T17:29:17.706 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T17:29:17.610+0000 7f6090696800 10 monclient: build_initial_monmap 2024-09-12T17:29:17.707 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T17:29:17.610+0000 7f6090696800 1 build_initial for_mkfs: 0 2024-09-12T17:29:17.707 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T17:29:17.610+0000 7f6090696800 10 monclient: monmap: 2024-09-12T17:29:17.707 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:29:17.707 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:29:17.707 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:29:17.707 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:29:17.707 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:29:17.707 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:17.707 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:29:17.707 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:29:17.707 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:29:17.707 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.708 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding auth protocol: cephx 2024-09-12T17:29:17.708 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding auth protocol: cephx 2024-09-12T17:29:17.708 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding auth protocol: cephx 2024-09-12T17:29:17.708 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding con mode: secure 2024-09-12T17:29:17.708 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding con mode: crc 2024-09-12T17:29:17.708 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding con mode: secure 2024-09-12T17:29:17.708 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding con mode: crc 2024-09-12T17:29:17.708 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding con mode: secure 2024-09-12T17:29:17.708 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding con mode: crc 2024-09-12T17:29:17.708 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding con mode: crc 2024-09-12T17:29:17.708 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding con mode: secure 2024-09-12T17:29:17.708 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding con mode: crc 2024-09-12T17:29:17.709 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding con mode: secure 2024-09-12T17:29:17.709 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding con mode: crc 2024-09-12T17:29:17.709 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding con mode: secure 2024-09-12T17:29:17.709 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T17:29:17.611+0000 7f6090696800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:17.709 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T17:29:17.611+0000 7f6090696800 10 monclient: init 2024-09-12T17:29:17.709 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding auth protocol: cephx 2024-09-12T17:29:17.709 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding auth protocol: cephx 2024-09-12T17:29:17.709 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding auth protocol: cephx 2024-09-12T17:29:17.709 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding con mode: secure 2024-09-12T17:29:17.709 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding con mode: crc 2024-09-12T17:29:17.709 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding con mode: secure 2024-09-12T17:29:17.710 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding con mode: crc 2024-09-12T17:29:17.710 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding con mode: secure 2024-09-12T17:29:17.710 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding con mode: crc 2024-09-12T17:29:17.710 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding con mode: crc 2024-09-12T17:29:17.710 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding con mode: secure 2024-09-12T17:29:17.710 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding con mode: crc 2024-09-12T17:29:17.710 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding con mode: secure 2024-09-12T17:29:17.710 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding con mode: crc 2024-09-12T17:29:17.710 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding con mode: secure 2024-09-12T17:29:17.710 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T17:29:17.611+0000 7f6090696800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:17.710 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T17:29:17.611+0000 7f6090696800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:17.710 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T17:29:17.611+0000 7f6090696800 5 asok(0x55699c982730) register_command rotate-key cmddesc rotate-key hook 0x7ffcf0cce888 EEXIST 2024-09-12T17:29:17.710 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T17:29:17.611+0000 7f6090696800 10 monclient: _reopen_session rank -1 2024-09-12T17:29:17.710 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T17:29:17.611+0000 7f6090696800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:29:17.711 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T17:29:17.611+0000 7f6090696800 10 monclient(hunting): picked mon.noname-c con 0x55699cc74b70 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:29:17.711 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T17:29:17.611+0000 7f6090696800 10 monclient(hunting): picked mon.noname-a con 0x55699cc74f50 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:29:17.711 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T17:29:17.611+0000 7f6090696800 10 monclient(hunting): picked mon.noname-b con 0x55699cc7a660 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:29:17.711 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T17:29:17.611+0000 7f6090696800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:17.711 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T17:29:17.611+0000 7f6090696800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:17.711 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T17:29:17.611+0000 7f6090696800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:17.711 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T17:29:17.611+0000 7f6090696800 10 monclient(hunting): _renew_subs 2024-09-12T17:29:17.711 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T17:29:17.611+0000 7f6090696800 10 monclient(hunting): authenticate will time out at 2568.961976s 2024-09-12T17:29:17.711 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T17:29:17.612+0000 7f608e180640 10 monclient(hunting): get_auth_request con 0x55699cc74b70 auth_method 0 2024-09-12T17:29:17.711 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T17:29:17.612+0000 7f608e180640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:17.711 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T17:29:17.612+0000 7f608e180640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:17.711 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T17:29:17.612+0000 7f608e180640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:17.711 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T17:29:17.612+0000 7f608d97f640 10 monclient(hunting): get_auth_request con 0x55699cc74f50 auth_method 0 2024-09-12T17:29:17.711 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T17:29:17.612+0000 7f608d97f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:17.712 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T17:29:17.612+0000 7f608d97f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:17.712 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T17:29:17.612+0000 7f608d97f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:17.712 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T17:29:17.612+0000 7f608e180640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:17.712 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T17:29:17.612+0000 7f608e180640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:17.712 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T17:29:17.612+0000 7f608e180640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:17.712 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T17:29:17.612+0000 7f608d97f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:17.712 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T17:29:17.612+0000 7f608d97f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:17.712 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T17:29:17.612+0000 7f608d97f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:17.712 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T17:29:17.612+0000 7f608e981640 10 monclient(hunting): get_auth_request con 0x55699cc7a660 auth_method 0 2024-09-12T17:29:17.712 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T17:29:17.612+0000 7f608e981640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:17.712 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T17:29:17.612+0000 7f608e981640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:17.712 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T17:29:17.612+0000 7f608e981640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:17.713 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T17:29:17.612+0000 7f608e180640 10 monclient(hunting): handle_auth_done global_id 7817 payload 274 2024-09-12T17:29:17.713 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T17:29:17.612+0000 7f608e180640 10 monclient: _finish_hunting 0 2024-09-12T17:29:17.713 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T17:29:17.612+0000 7f608e180640 1 monclient: found mon.noname-c 2024-09-12T17:29:17.713 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T17:29:17.612+0000 7f608e180640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:29:17.713 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T17:29:17.612+0000 7f5f71ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:17.713 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T17:29:17.612+0000 7f5f71ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:29:17.713 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T17:29:17.612+0000 7f5f71ffb640 10 monclient: dump: 2024-09-12T17:29:17.713 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:17.713 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:17.713 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.713 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.714 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:17.714 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:17.714 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:17.714 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:17.714 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:17.714 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.714 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T17:29:17.612+0000 7f5f71ffb640 10 monclient: _finish_auth 0 2024-09-12T17:29:17.714 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T17:29:17.612+0000 7f5f71ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:29:17.714 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T17:29:17.612+0000 7f5f71ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:29:17.714 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T17:29:17.612+0000 7f5f71ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:17.714 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T17:29:17.612+0000 7f5f71ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:29:17.714 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T17:29:17.612+0000 7f5f71ffb640 10 monclient: dump: 2024-09-12T17:29:17.715 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:17.715 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:17.715 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.715 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.715 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:17.715 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:17.715 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:17.715 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:17.715 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:17.715 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.715 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T17:29:17.612+0000 7f6090696800 5 monclient: authenticate success, global_id 7817 2024-09-12T17:29:17.715 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T17:29:17.612+0000 7f6090696800 10 monclient: get_monmap_and_config success 2024-09-12T17:29:17.715 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T17:29:17.612+0000 7f6090696800 4 set_mon_vals no callback set 2024-09-12T17:29:17.716 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T17:29:17.613+0000 7f6090696800 10 monclient: shutdown 2024-09-12T17:29:17.716 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T17:29:17.613+0000 7f6090696800 10 monclient: build_initial_monmap 2024-09-12T17:29:17.716 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T17:29:17.613+0000 7f6090696800 1 build_initial for_mkfs: 0 2024-09-12T17:29:17.716 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T17:29:17.613+0000 7f6090696800 10 monclient: monmap: 2024-09-12T17:29:17.716 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:29:17.716 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:29:17.716 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:29:17.716 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:29:17.716 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:29:17.716 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:17.716 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:29:17.716 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:29:17.716 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:29:17.717 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.717 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding auth protocol: cephx 2024-09-12T17:29:17.717 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding auth protocol: cephx 2024-09-12T17:29:17.717 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding auth protocol: cephx 2024-09-12T17:29:17.717 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding con mode: secure 2024-09-12T17:29:17.717 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding con mode: crc 2024-09-12T17:29:17.717 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding con mode: secure 2024-09-12T17:29:17.717 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding con mode: crc 2024-09-12T17:29:17.717 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding con mode: secure 2024-09-12T17:29:17.717 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding con mode: crc 2024-09-12T17:29:17.717 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding con mode: crc 2024-09-12T17:29:17.717 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding con mode: secure 2024-09-12T17:29:17.718 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding con mode: crc 2024-09-12T17:29:17.718 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding con mode: secure 2024-09-12T17:29:17.718 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding con mode: crc 2024-09-12T17:29:17.718 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding con mode: secure 2024-09-12T17:29:17.718 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T17:29:17.613+0000 7f6090696800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:17.718 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T17:29:17.613+0000 7f6090696800 1 librados: starting msgr at 2024-09-12T17:29:17.718 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T17:29:17.613+0000 7f6090696800 1 librados: starting objecter 2024-09-12T17:29:17.718 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T17:29:17.613+0000 7f6090696800 5 asok(0x55699c982730) register_command objecter_requests cmddesc objecter_requests hook 0x55699cc7aab0 EEXIST 2024-09-12T17:29:17.718 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T17:29:17.613+0000 7f6090696800 1 librados: setting wanted keys 2024-09-12T17:29:17.719 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T17:29:17.613+0000 7f6090696800 1 librados: calling monclient init 2024-09-12T17:29:17.719 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T17:29:17.613+0000 7f6090696800 10 monclient: init 2024-09-12T17:29:17.719 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding auth protocol: cephx 2024-09-12T17:29:17.719 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding auth protocol: cephx 2024-09-12T17:29:17.719 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding auth protocol: cephx 2024-09-12T17:29:17.719 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding con mode: secure 2024-09-12T17:29:17.719 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding con mode: crc 2024-09-12T17:29:17.719 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding con mode: secure 2024-09-12T17:29:17.719 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding con mode: crc 2024-09-12T17:29:17.719 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding con mode: secure 2024-09-12T17:29:17.719 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding con mode: crc 2024-09-12T17:29:17.719 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding con mode: crc 2024-09-12T17:29:17.720 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding con mode: secure 2024-09-12T17:29:17.720 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding con mode: crc 2024-09-12T17:29:17.720 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding con mode: secure 2024-09-12T17:29:17.720 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding con mode: crc 2024-09-12T17:29:17.720 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding con mode: secure 2024-09-12T17:29:17.720 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T17:29:17.614+0000 7f6090696800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:17.720 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T17:29:17.614+0000 7f6090696800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:17.720 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T17:29:17.614+0000 7f6090696800 5 asok(0x55699c982730) register_command rotate-key cmddesc rotate-key hook 0x55699cc35268 EEXIST 2024-09-12T17:29:17.720 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T17:29:17.614+0000 7f6090696800 10 monclient: _reopen_session rank -1 2024-09-12T17:29:17.720 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T17:29:17.614+0000 7f6090696800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:29:17.720 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T17:29:17.614+0000 7f6090696800 10 monclient(hunting): picked mon.noname-b con 0x55699cc74b70 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:29:17.720 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T17:29:17.614+0000 7f6090696800 10 monclient(hunting): picked mon.noname-a con 0x55699cc7a660 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:29:17.721 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T17:29:17.614+0000 7f6090696800 10 monclient(hunting): picked mon.noname-c con 0x55699cc7f950 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:29:17.721 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T17:29:17.614+0000 7f6090696800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:17.721 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T17:29:17.614+0000 7f6090696800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:17.721 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T17:29:17.614+0000 7f6090696800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:17.721 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T17:29:17.614+0000 7f6090696800 10 monclient(hunting): _renew_subs 2024-09-12T17:29:17.721 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T17:29:17.614+0000 7f6090696800 10 monclient(hunting): authenticate will time out at 2568.964461s 2024-09-12T17:29:17.721 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T17:29:17.614+0000 7f608d97f640 10 monclient(hunting): get_auth_request con 0x55699cc7a660 auth_method 0 2024-09-12T17:29:17.721 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T17:29:17.614+0000 7f608d97f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:17.721 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T17:29:17.614+0000 7f608d97f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:17.722 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T17:29:17.614+0000 7f608d97f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:17.722 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T17:29:17.614+0000 7f608e981640 10 monclient(hunting): get_auth_request con 0x55699cc7f950 auth_method 0 2024-09-12T17:29:17.722 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T17:29:17.614+0000 7f608e981640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:17.722 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T17:29:17.614+0000 7f608e981640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:17.722 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T17:29:17.614+0000 7f608e981640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:17.722 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T17:29:17.614+0000 7f608d97f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:17.722 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T17:29:17.614+0000 7f608d97f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:17.722 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T17:29:17.614+0000 7f608d97f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:17.723 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T17:29:17.614+0000 7f608e981640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:17.723 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T17:29:17.614+0000 7f608e981640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:17.723 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T17:29:17.614+0000 7f608e981640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:17.723 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T17:29:17.614+0000 7f608e180640 10 monclient(hunting): get_auth_request con 0x55699cc74b70 auth_method 0 2024-09-12T17:29:17.723 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T17:29:17.614+0000 7f608e180640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:17.723 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T17:29:17.614+0000 7f608e180640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:17.723 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T17:29:17.614+0000 7f608e180640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:17.723 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T17:29:17.614+0000 7f608e981640 10 monclient(hunting): handle_auth_done global_id 7820 payload 824 2024-09-12T17:29:17.724 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T17:29:17.614+0000 7f608e981640 10 monclient: _finish_hunting 0 2024-09-12T17:29:17.724 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T17:29:17.614+0000 7f608e981640 1 monclient: found mon.noname-c 2024-09-12T17:29:17.724 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T17:29:17.614+0000 7f608e981640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:29:17.724 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T17:29:17.615+0000 7f5f5ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:17.724 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T17:29:17.615+0000 7f5f5ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:29:17.724 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T17:29:17.615+0000 7f5f5ffff640 10 monclient: dump: 2024-09-12T17:29:17.724 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:17.724 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:17.724 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.724 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.724 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:17.724 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:17.724 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:17.725 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:17.725 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:17.725 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.725 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T17:29:17.615+0000 7f5f5ffff640 10 monclient: _finish_auth 0 2024-09-12T17:29:17.725 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T17:29:17.615+0000 7f5f5ffff640 10 monclient: _check_auth_tickets 2024-09-12T17:29:17.725 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T17:29:17.615+0000 7f5f5ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:29:17.725 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T17:29:17.615+0000 7f5f5ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:17.725 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T17:29:17.615+0000 7f5f5ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:29:17.726 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T17:29:17.615+0000 7f5f5ffff640 10 monclient: dump: 2024-09-12T17:29:17.726 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:17.726 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:17.726 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.726 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.726 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:17.726 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:17.726 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:17.726 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:17.726 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:17.726 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.726 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T17:29:17.615+0000 7f6090696800 5 monclient: authenticate success, global_id 7820 2024-09-12T17:29:17.726 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T17:29:17.615+0000 7f5f71ffb640 4 set_mon_vals no callback set 2024-09-12T17:29:17.727 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T17:29:17.615+0000 7f6090696800 10 monclient: _renew_subs 2024-09-12T17:29:17.727 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T17:29:17.615+0000 7f6090696800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:29:17.727 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T17:29:17.615+0000 7f6090696800 10 monclient: _renew_subs 2024-09-12T17:29:17.727 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T17:29:17.615+0000 7f6090696800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:29:17.727 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T17:29:17.615+0000 7f6090696800 1 librados: init done 2024-09-12T17:29:17.727 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T17:29:17.615+0000 7f6090696800 5 asok(0x55699c982730) register_command cr dump hook 0x7f6080001f58 2024-09-12T17:29:17.727 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T17:29:17.617+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.727 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T17:29:17.617+0000 7f5f5ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:29:17.727 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T17:29:17.617+0000 7f5f5ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:29:17.727 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T17:29:17.617+0000 7f5f5ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:29:17.727 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T17:29:17.617+0000 7f608e180640 10 monclient: get_auth_request con 0x7f5f58076470 auth_method 0 2024-09-12T17:29:17.727 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T17:29:17.618+0000 7f608d97f640 10 monclient: get_auth_request con 0x55699cc8f4b0 auth_method 0 2024-09-12T17:29:17.727 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T17:29:17.618+0000 7f6090696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.728 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T17:29:17.618+0000 7f6090696800 20 realm 2024-09-12T17:29:17.728 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T17:29:17.618+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.728 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T17:29:17.618+0000 7f6090696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.728 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T17:29:17.618+0000 7f6090696800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:17.728 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T17:29:17.618+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.728 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T17:29:17.619+0000 7f6090696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.728 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T17:29:17.619+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.728 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T17:29:17.619+0000 7f608e180640 10 monclient: get_auth_request con 0x55699cc936e0 auth_method 0 2024-09-12T17:29:17.728 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T17:29:17.620+0000 7f6090696800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:17.728 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T17:29:17.620+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.728 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T17:29:17.620+0000 7f608d97f640 10 monclient: get_auth_request con 0x55699cc96f40 auth_method 0 2024-09-12T17:29:17.728 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T17:29:17.621+0000 7f6090696800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:29:17.729 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T17:29:17.621+0000 7f6090696800 20 searching for the correct realm 2024-09-12T17:29:17.729 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T17:29:17.621+0000 7f608e981640 10 monclient: get_auth_request con 0x55699cc9b9f0 auth_method 0 2024-09-12T17:29:17.729 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T17:29:17.622+0000 7f608e180640 10 monclient: get_auth_request con 0x7f608804fc70 auth_method 0 2024-09-12T17:29:17.729 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T17:29:17.623+0000 7f608d97f640 10 monclient: get_auth_request con 0x7f608004e940 auth_method 0 2024-09-12T17:29:17.729 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T17:29:17.624+0000 7f608d97f640 0 -- 172.21.15.67:0/781528773 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x55699cc8f4b0 msgr2=0x55699cc91910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:29:17.729 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T17:29:17.624+0000 7f5f5ffff640 1 client.7820.objecter ms_handle_reset 0x55699cc8f4b0 session 0x55699cc8ede0 osd.1 2024-09-12T17:29:17.729 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T17:29:17.624+0000 7f5f5ffff640 10 monclient: _renew_subs 2024-09-12T17:29:17.729 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T17:29:17.624+0000 7f5f5ffff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:29:17.729 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T17:29:17.625+0000 7f608d97f640 10 monclient: get_auth_request con 0x7f5f58086310 auth_method 0 2024-09-12T17:29:17.729 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T17:29:17.625+0000 7f608e981640 10 monclient: get_auth_request con 0x7f608406d040 auth_method 0 2024-09-12T17:29:17.729 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T17:29:17.627+0000 7f608e180640 10 monclient: get_auth_request con 0x7f608409e920 auth_method 0 2024-09-12T17:29:17.729 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T17:29:17.628+0000 7f608d97f640 0 -- 172.21.15.67:0/781528773 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55699cc96f40 msgr2=0x55699cc99330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:29:17.730 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T17:29:17.628+0000 7f5f5ffff640 1 client.7820.objecter ms_handle_reset 0x55699cc96f40 session 0x55699cc92a30 osd.4 2024-09-12T17:29:17.730 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T17:29:17.628+0000 7f608d97f640 10 monclient: get_auth_request con 0x55699cc8f4b0 auth_method 0 2024-09-12T17:29:17.730 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T17:29:17.633+0000 7f6090696800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:29:17.730 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T17:29:17.633+0000 7f6090696800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:29:17.730 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T17:29:17.633+0000 7f6090696800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:17.730 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T17:29:17.633+0000 7f6090696800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:17.730 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T17:29:17.633+0000 7f6090696800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:17.730 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T17:29:17.633+0000 7f6090696800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:17.730 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T17:29:17.633+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.730 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T17:29:17.633+0000 7f6090696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.730 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T17:29:17.633+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.730 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T17:29:17.634+0000 7f6090696800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:17.730 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T17:29:17.634+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.731 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T17:29:17.634+0000 7f6090696800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:29:17.731 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T17:29:17.634+0000 7f6090696800 20 zone default found 2024-09-12T17:29:17.731 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T17:29:17.634+0000 7f6090696800 4 Realm: () 2024-09-12T17:29:17.731 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T17:29:17.634+0000 7f6090696800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:29:17.731 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T17:29:17.634+0000 7f6090696800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:29:17.731 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T17:29:17.634+0000 7f6090696800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:17.731 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T17:29:17.634+0000 7f6090696800 20 zonegroup default 2024-09-12T17:29:17.731 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T17:29:17.634+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.731 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T17:29:17.634+0000 7f6090696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.731 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T17:29:17.634+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.731 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T17:29:17.635+0000 7f6090696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.731 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T17:29:17.635+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.732 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T17:29:17.635+0000 7f6090696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.732 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T17:29:17.635+0000 7f6090696800 20 started sync module instance, tier type = 2024-09-12T17:29:17.732 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T17:29:17.635+0000 7f6090696800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:29:17.732 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T17:29:17.645+0000 7f6090696800 20 add_watcher() i=0 2024-09-12T17:29:17.732 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T17:29:17.645+0000 7f6090696800 20 add_watcher() i=1 2024-09-12T17:29:17.732 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T17:29:17.645+0000 7f6090696800 20 add_watcher() i=2 2024-09-12T17:29:17.732 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T17:29:17.645+0000 7f6090696800 20 add_watcher() i=3 2024-09-12T17:29:17.732 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T17:29:17.645+0000 7f6090696800 20 add_watcher() i=4 2024-09-12T17:29:17.732 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T17:29:17.645+0000 7f6090696800 20 add_watcher() i=5 2024-09-12T17:29:17.732 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T17:29:17.645+0000 7f6090696800 20 add_watcher() i=6 2024-09-12T17:29:17.732 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T17:29:17.646+0000 7f6090696800 20 add_watcher() i=7 2024-09-12T17:29:17.732 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T17:29:17.646+0000 7f6090696800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:17.732 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding auth protocol: cephx 2024-09-12T17:29:17.733 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding auth protocol: cephx 2024-09-12T17:29:17.733 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding auth protocol: cephx 2024-09-12T17:29:17.733 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding con mode: secure 2024-09-12T17:29:17.733 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding con mode: crc 2024-09-12T17:29:17.733 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding con mode: secure 2024-09-12T17:29:17.733 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding con mode: crc 2024-09-12T17:29:17.733 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding con mode: secure 2024-09-12T17:29:17.733 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding con mode: crc 2024-09-12T17:29:17.733 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding con mode: crc 2024-09-12T17:29:17.733 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T17:29:17.648+0000 7f5f44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:17.733 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding con mode: secure 2024-09-12T17:29:17.733 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding con mode: crc 2024-09-12T17:29:17.734 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding con mode: secure 2024-09-12T17:29:17.734 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding con mode: crc 2024-09-12T17:29:17.734 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding con mode: secure 2024-09-12T17:29:17.734 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T17:29:17.648+0000 7f6090696800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:17.734 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T17:29:17.648+0000 7f6090696800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:17.734 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T17:29:17.648+0000 7f6090696800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:17.734 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T17:29:17.648+0000 7f6090696800 5 asok(0x55699c982730) register_command cache list hook 0x55699cc68630 2024-09-12T17:29:17.734 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T17:29:17.648+0000 7f6090696800 5 asok(0x55699c982730) register_command cache inspect hook 0x55699cc68630 2024-09-12T17:29:17.734 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T17:29:17.648+0000 7f6090696800 5 asok(0x55699c982730) register_command cache erase hook 0x55699cc68630 2024-09-12T17:29:17.734 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T17:29:17.648+0000 7f6090696800 5 asok(0x55699c982730) register_command cache zap hook 0x55699cc68630 2024-09-12T17:29:17.734 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T17:29:17.648+0000 7f6090696800 5 note: GC not initialized 2024-09-12T17:29:17.734 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T17:29:17.648+0000 7f5ebf7fe640 20 reqs_thread_entry: start 2024-09-12T17:29:17.735 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T17:29:17.648+0000 7f6090696800 5 asok(0x55699c982730) register_command sync trace show hook 0x7f6080010b20 2024-09-12T17:29:17.735 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T17:29:17.648+0000 7f6090696800 5 asok(0x55699c982730) register_command sync trace history hook 0x7f6080010b20 2024-09-12T17:29:17.735 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T17:29:17.648+0000 7f6090696800 5 asok(0x55699c982730) register_command sync trace active hook 0x7f6080010b20 2024-09-12T17:29:17.735 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T17:29:17.648+0000 7f6090696800 5 asok(0x55699c982730) register_command sync trace active_short hook 0x7f6080010b20 2024-09-12T17:29:17.735 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T17:29:17.648+0000 7f6090696800 20 init_complete bucket index max shards: 1 2024-09-12T17:29:17.735 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T17:29:17.648+0000 7f6090696800 20 Filter name: none 2024-09-12T17:29:17.735 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T17:29:17.649+0000 7f5ebd7fa640 20 reqs_thread_entry: start 2024-09-12T17:29:17.735 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T17:29:17.649+0000 7f6090696800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:29:17.735 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T17:29:17.649+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.735 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T17:29:17.649+0000 7f6090696800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:29:17.735 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T17:29:17.649+0000 7f6090696800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:29:17.735 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T17:29:17.649+0000 7f6090696800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:29:17.735 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T17:29:17.649+0000 7f6090696800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : miss 2024-09-12T17:29:17.736 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T17:29:17.649+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.736 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T17:29:17.650+0000 7f6090696800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:29:17.736 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T17:29:17.650+0000 7f6090696800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:29:17.736 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T17:29:17.650+0000 7f6090696800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:29:17.736 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T17:29:17.650+0000 7f6090696800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:17.736 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T17:29:17.650+0000 7f6090696800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:29:17.736 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T17:29:17.650+0000 7f6090696800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:29:17.736 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T17:29:17.651+0000 7f6090696800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:29:17.736 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T17:29:17.656+0000 7f6090696800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:29:17.736 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T17:29:17.656+0000 7f6090696800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:29:17.736 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T17:29:17.656+0000 7f6090696800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:29:17.736 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T17:29:17.656+0000 7f6090696800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18, ofs0, ns] 2024-09-12T17:29:17.736 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T17:29:17.657+0000 7f5f71ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464370 cookie 93912090345152 notifier 7820 bl.length()=911 2024-09-12T17:29:17.737 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T17:29:17.657+0000 7f5f71ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:29:17.737 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T17:29:17.657+0000 7f5f71ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:29:17.737 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T17:29:17.657+0000 7f5f71ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:29:17.737 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T17:29:17.658+0000 7f6090696800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_sources= new_sources= 2024-09-12T17:29:17.737 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T17:29:17.658+0000 7f6090696800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:29:17.737 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T17:29:17.658+0000 7f6090696800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_dests= new_dests= 2024-09-12T17:29:17.737 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T17:29:17.658+0000 7f6090696800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:29:17.737 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T17:29:17.662+0000 7f6090696800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6090696800 time 2024-09-12T17:29:17.662349+0000 2024-09-12T17:29:17.737 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:29:17.737 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.737 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:29:17.737 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6093b8c71a] 2024-09-12T17:29:17.738 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6093b8c8d8] 2024-09-12T17:29:17.738 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55699a301841] 2024-09-12T17:29:17.738 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd7490c) [0x55699a80f90c] 2024-09-12T17:29:17.738 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55699a31150d] 2024-09-12T17:29:17.738 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:29:17.738 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6092829590] 2024-09-12T17:29:17.738 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:29:17.738 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:29:17.738 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.738 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T17:29:17.663+0000 7f6090696800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:29:17.738 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f6090696800 thread_name:radosgw-admin 2024-09-12T17:29:17.738 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.739 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:29:17.739 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f609283e6f0] 2024-09-12T17:29:17.739 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f609288b99c] 2024-09-12T17:29:17.739 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:29:17.739 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:29:17.739 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6093b8c774] 2024-09-12T17:29:17.739 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6093b8c8d8] 2024-09-12T17:29:17.739 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55699a301841] 2024-09-12T17:29:17.739 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd7490c) [0x55699a80f90c] 2024-09-12T17:29:17.739 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55699a31150d] 2024-09-12T17:29:17.739 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:29:17.739 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6092829590] 2024-09-12T17:29:17.739 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:29:17.740 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:29:17.740 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:29:17.740 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.740 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T17:29:17.740 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T17:29:17.740 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T17:29:17.740 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T17:29:17.740 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T17:29:17.740 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T17:29:17.740 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T17:29:17.740 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T17:29:17.740 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T17:29:17.740 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T17:29:17.741 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T17:29:17.741 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T17:29:17.741 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T17:29:17.741 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T17:29:17.741 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T17:29:17.741 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T17:29:17.741 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T17:29:17.741 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T17:29:17.741 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T17:29:17.741 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T17:29:17.741 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T17:29:17.741 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T17:29:17.741 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T17:29:17.741 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T17:29:17.742 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:29:17.742 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T17:29:17.742 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T17:29:17.742 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T17:29:17.742 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T17:29:17.742 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T17:29:17.742 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T17:29:17.742 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T17:29:17.742 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T17:29:17.742 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T17:29:17.742 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T17:29:17.742 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T17:29:17.742 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T17:29:17.742 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T17:29:17.743 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T17:29:17.743 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T17:29:17.743 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T17:29:17.743 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T17:29:17.743 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T17:29:17.743 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T17:29:17.743 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T17:29:17.743 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T17:29:17.743 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:29:17.743 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T17:29:17.743 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:29:17.743 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T17:29:17.743 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T17:29:17.744 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T17:29:17.744 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T17:29:17.744 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T17:29:17.744 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T17:29:17.744 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T17:29:17.744 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T17:29:17.744 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T17:29:17.744 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T17:29:17.744 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T17:29:17.744 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T17:29:17.744 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T17:29:17.744 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T17:29:17.744 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T17:29:17.745 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T17:29:17.745 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T17:29:17.745 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T17:29:17.745 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:29:17.745 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T17:29:17.745 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:29:17.745 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T17:29:17.745 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T17:29:17.745 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T17:29:17.745 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T17:29:17.745 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T17:29:17.745 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T17:29:17.745 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:29:17.746 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T17:29:17.746 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T17:29:17.746 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:29:17.746 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T17:29:17.746 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T17:29:17.746 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T17:29:17.746 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T17:29:17.746 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T17:29:17.746 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T17:29:17.746 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T17:29:17.746 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T17:29:17.747 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T17:29:17.747 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T17:29:17.747 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T17:29:17.747 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T17:29:17.747 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T17:29:17.747 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:29:17.747 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5ebd7fa640 / http_manager 2024-09-12T17:29:17.747 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5ebf7fe640 / http_manager 2024-09-12T17:29:17.747 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5f44fe1640 / rgw_dt_lg_renew 2024-09-12T17:29:17.748 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5f5ffff640 / ms_dispatch 2024-09-12T17:29:17.748 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5f71ffb640 / io_context_pool 2024-09-12T17:29:17.748 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5f73fff640 / ms_dispatch 2024-09-12T17:29:17.748 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5f7ae05640 / ms_dispatch 2024-09-12T17:29:17.748 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5f7c608640 / io_context_pool 2024-09-12T17:29:17.748 INFO:tasks.workunit.client.0.smithi067.stderr: 7f608d97f640 / msgr-worker-2 2024-09-12T17:29:17.748 INFO:tasks.workunit.client.0.smithi067.stderr: 7f608e180640 / msgr-worker-1 2024-09-12T17:29:17.748 INFO:tasks.workunit.client.0.smithi067.stderr: 7f608e981640 / msgr-worker-0 2024-09-12T17:29:17.748 INFO:tasks.workunit.client.0.smithi067.stderr: 7f608f182640 / io_context_pool 2024-09-12T17:29:17.748 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6090696800 / radosgw-admin 2024-09-12T17:29:17.748 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T17:29:17.748 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T17:29:17.748 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/log/ceph/ceph-client.admin.153978.log 2024-09-12T17:29:17.749 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T17:29:17.749 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T17:29:17.749 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T17:29:17.597+0000 7f5f7c608640 10 monclient: dump: 2024-09-12T17:29:17.749 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:17.749 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:17.749 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.749 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.749 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:17.749 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:17.749 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:17.749 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:17.749 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:17.750 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.750 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T17:29:17.597+0000 7f6090696800 10 monclient: get_monmap_and_config success 2024-09-12T17:29:17.750 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T17:29:17.597+0000 7f6090696800 4 set_mon_vals no callback set 2024-09-12T17:29:17.750 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T17:29:17.597+0000 7f6090696800 10 monclient: shutdown 2024-09-12T17:29:17.750 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T17:29:17.597+0000 7f6090696800 5 asok(0x55699c982730) unregister_commands rotate-key 2024-09-12T17:29:17.750 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T17:29:17.598+0000 7f6090696800 10 monclient: build_initial_monmap 2024-09-12T17:29:17.750 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T17:29:17.598+0000 7f6090696800 1 build_initial for_mkfs: 0 2024-09-12T17:29:17.750 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T17:29:17.598+0000 7f6090696800 10 monclient: monmap: 2024-09-12T17:29:17.750 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:29:17.750 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:29:17.750 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:29:17.750 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:29:17.750 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:29:17.751 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:17.751 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:29:17.751 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:29:17.751 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:29:17.751 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.751 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding auth protocol: cephx 2024-09-12T17:29:17.751 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding auth protocol: cephx 2024-09-12T17:29:17.751 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding auth protocol: cephx 2024-09-12T17:29:17.751 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding con mode: secure 2024-09-12T17:29:17.751 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding con mode: crc 2024-09-12T17:29:17.751 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding con mode: secure 2024-09-12T17:29:17.751 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding con mode: crc 2024-09-12T17:29:17.751 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding con mode: secure 2024-09-12T17:29:17.752 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding con mode: crc 2024-09-12T17:29:17.752 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding con mode: crc 2024-09-12T17:29:17.752 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding con mode: secure 2024-09-12T17:29:17.752 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding con mode: crc 2024-09-12T17:29:17.752 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding con mode: secure 2024-09-12T17:29:17.752 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding con mode: crc 2024-09-12T17:29:17.752 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cbaa2b0) adding con mode: secure 2024-09-12T17:29:17.752 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T17:29:17.598+0000 7f6090696800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:17.752 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T17:29:17.598+0000 7f6090696800 1 librados: starting msgr at 2024-09-12T17:29:17.752 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T17:29:17.598+0000 7f6090696800 1 librados: starting objecter 2024-09-12T17:29:17.752 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T17:29:17.598+0000 7f6090696800 5 asok(0x55699c982730) register_command objecter_requests hook 0x55699cba9b80 2024-09-12T17:29:17.752 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T17:29:17.598+0000 7f6090696800 1 librados: setting wanted keys 2024-09-12T17:29:17.752 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T17:29:17.598+0000 7f6090696800 1 librados: calling monclient init 2024-09-12T17:29:17.752 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T17:29:17.598+0000 7f6090696800 10 monclient: init 2024-09-12T17:29:17.753 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding auth protocol: cephx 2024-09-12T17:29:17.753 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding auth protocol: cephx 2024-09-12T17:29:17.753 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding auth protocol: cephx 2024-09-12T17:29:17.753 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding con mode: secure 2024-09-12T17:29:17.753 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding con mode: crc 2024-09-12T17:29:17.753 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding con mode: secure 2024-09-12T17:29:17.753 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding con mode: crc 2024-09-12T17:29:17.753 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding con mode: secure 2024-09-12T17:29:17.753 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding con mode: crc 2024-09-12T17:29:17.753 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding con mode: crc 2024-09-12T17:29:17.753 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding con mode: secure 2024-09-12T17:29:17.753 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding con mode: crc 2024-09-12T17:29:17.753 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding con mode: secure 2024-09-12T17:29:17.754 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding con mode: crc 2024-09-12T17:29:17.754 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T17:29:17.598+0000 7f6090696800 5 AuthRegistry(0x55699cba4be0) adding con mode: secure 2024-09-12T17:29:17.754 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T17:29:17.598+0000 7f6090696800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:17.754 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T17:29:17.599+0000 7f6090696800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:17.754 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T17:29:17.599+0000 7f6090696800 5 asok(0x55699c982730) register_command rotate-key hook 0x55699cba4d28 2024-09-12T17:29:17.754 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T17:29:17.599+0000 7f6090696800 10 monclient: _reopen_session rank -1 2024-09-12T17:29:17.754 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T17:29:17.599+0000 7f6090696800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:29:17.754 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T17:29:17.599+0000 7f6090696800 10 monclient(hunting): picked mon.noname-b con 0x55699ca51ab0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:29:17.754 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T17:29:17.599+0000 7f6090696800 10 monclient(hunting): picked mon.noname-c con 0x55699caeda10 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:29:17.754 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T17:29:17.599+0000 7f6090696800 10 monclient(hunting): picked mon.noname-a con 0x55699caee3a0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:29:17.754 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T17:29:17.599+0000 7f6090696800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:17.754 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T17:29:17.599+0000 7f6090696800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:17.754 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T17:29:17.599+0000 7f6090696800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:17.755 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T17:29:17.599+0000 7f6090696800 10 monclient(hunting): _renew_subs 2024-09-12T17:29:17.755 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T17:29:17.599+0000 7f6090696800 10 monclient(hunting): authenticate will time out at 2568.949270s 2024-09-12T17:29:17.755 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T17:29:17.599+0000 7f608d97f640 10 monclient(hunting): get_auth_request con 0x55699caeda10 auth_method 0 2024-09-12T17:29:17.755 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T17:29:17.599+0000 7f608d97f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:17.755 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T17:29:17.599+0000 7f608d97f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:17.755 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T17:29:17.599+0000 7f608d97f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:17.755 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T17:29:17.599+0000 7f608e981640 10 monclient(hunting): get_auth_request con 0x55699caee3a0 auth_method 0 2024-09-12T17:29:17.755 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T17:29:17.599+0000 7f608e981640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:17.755 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T17:29:17.599+0000 7f608e981640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:17.755 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T17:29:17.599+0000 7f608e981640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:17.755 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T17:29:17.599+0000 7f608e981640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:17.755 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T17:29:17.599+0000 7f608e981640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:17.756 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T17:29:17.599+0000 7f608e981640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:17.756 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T17:29:17.599+0000 7f608d97f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:17.756 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T17:29:17.599+0000 7f608d97f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:17.756 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T17:29:17.599+0000 7f608d97f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:17.756 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T17:29:17.599+0000 7f608e180640 10 monclient(hunting): get_auth_request con 0x55699ca51ab0 auth_method 0 2024-09-12T17:29:17.756 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T17:29:17.599+0000 7f608e180640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:17.756 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T17:29:17.599+0000 7f608e180640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:17.756 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T17:29:17.599+0000 7f608e180640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:17.756 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T17:29:17.599+0000 7f608e981640 10 monclient(hunting): handle_auth_done global_id 8334 payload 824 2024-09-12T17:29:17.756 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T17:29:17.599+0000 7f608e981640 10 monclient: _finish_hunting 0 2024-09-12T17:29:17.756 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T17:29:17.599+0000 7f608e981640 1 monclient: found mon.noname-a 2024-09-12T17:29:17.756 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T17:29:17.599+0000 7f608e981640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:29:17.757 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T17:29:17.600+0000 7f5f7ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:17.757 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T17:29:17.600+0000 7f5f7ae05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:29:17.757 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T17:29:17.600+0000 7f5f7ae05640 10 monclient: dump: 2024-09-12T17:29:17.757 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:17.757 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:17.757 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.757 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.757 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:17.757 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:17.757 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:17.757 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:17.757 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:17.757 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.758 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T17:29:17.600+0000 7f5f7ae05640 10 monclient: _finish_auth 0 2024-09-12T17:29:17.758 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T17:29:17.600+0000 7f5f7ae05640 10 monclient: _check_auth_tickets 2024-09-12T17:29:17.758 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T17:29:17.600+0000 7f5f7ae05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:29:17.758 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T17:29:17.600+0000 7f5f7ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:17.758 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T17:29:17.600+0000 7f5f7ae05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:29:17.758 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T17:29:17.600+0000 7f5f7ae05640 10 monclient: dump: 2024-09-12T17:29:17.758 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:17.758 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:17.758 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.758 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.758 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:17.758 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:17.758 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:17.758 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:17.759 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:17.759 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.759 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T17:29:17.600+0000 7f6090696800 5 monclient: authenticate success, global_id 8334 2024-09-12T17:29:17.759 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T17:29:17.600+0000 7f6090696800 10 monclient: _renew_subs 2024-09-12T17:29:17.759 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T17:29:17.600+0000 7f5f7c608640 4 set_mon_vals no callback set 2024-09-12T17:29:17.759 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T17:29:17.600+0000 7f6090696800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:29:17.759 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T17:29:17.600+0000 7f6090696800 10 monclient: _renew_subs 2024-09-12T17:29:17.759 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T17:29:17.600+0000 7f6090696800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:29:17.759 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T17:29:17.600+0000 7f6090696800 1 librados: init done 2024-09-12T17:29:17.759 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T17:29:17.602+0000 7f5f7ae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:29:17.759 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T17:29:17.602+0000 7f5f7ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:29:17.759 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T17:29:17.602+0000 7f5f7ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:29:17.759 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T17:29:17.602+0000 7f608e180640 10 monclient: get_auth_request con 0x7f5f74076470 auth_method 0 2024-09-12T17:29:17.759 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T17:29:17.602+0000 7f608d97f640 10 monclient: get_auth_request con 0x55699cbcd290 auth_method 0 2024-09-12T17:29:17.760 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T17:29:17.603+0000 7f608e180640 10 monclient: get_auth_request con 0x55699cbefd10 auth_method 0 2024-09-12T17:29:17.760 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T17:29:17.604+0000 7f608d97f640 10 monclient: get_auth_request con 0x55699cbf41a0 auth_method 0 2024-09-12T17:29:17.760 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T17:29:17.606+0000 7f6090696800 10 monclient: build_initial_monmap 2024-09-12T17:29:17.760 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T17:29:17.606+0000 7f6090696800 1 build_initial for_mkfs: 0 2024-09-12T17:29:17.760 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T17:29:17.606+0000 7f6090696800 10 monclient: monmap: 2024-09-12T17:29:17.760 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:29:17.760 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:29:17.760 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:29:17.760 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:29:17.760 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:29:17.760 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:17.760 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:29:17.760 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:29:17.761 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:29:17.761 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.761 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding auth protocol: cephx 2024-09-12T17:29:17.761 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding auth protocol: cephx 2024-09-12T17:29:17.761 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding auth protocol: cephx 2024-09-12T17:29:17.761 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding con mode: secure 2024-09-12T17:29:17.761 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding con mode: crc 2024-09-12T17:29:17.761 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding con mode: secure 2024-09-12T17:29:17.761 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding con mode: crc 2024-09-12T17:29:17.761 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding con mode: secure 2024-09-12T17:29:17.761 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding con mode: crc 2024-09-12T17:29:17.761 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding con mode: crc 2024-09-12T17:29:17.761 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding con mode: secure 2024-09-12T17:29:17.762 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding con mode: crc 2024-09-12T17:29:17.762 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding con mode: secure 2024-09-12T17:29:17.762 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding con mode: crc 2024-09-12T17:29:17.762 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T17:29:17.606+0000 7f6090696800 5 AuthRegistry(0x55699cbf9050) adding con mode: secure 2024-09-12T17:29:17.762 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T17:29:17.606+0000 7f6090696800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:17.762 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T17:29:17.607+0000 7f6090696800 5 asok(0x55699c982730) register_command objecter_requests cmddesc objecter_requests hook 0x55699cbfc540 EEXIST 2024-09-12T17:29:17.762 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T17:29:17.607+0000 7f6090696800 10 monclient: init 2024-09-12T17:29:17.762 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding auth protocol: cephx 2024-09-12T17:29:17.762 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding auth protocol: cephx 2024-09-12T17:29:17.762 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding auth protocol: cephx 2024-09-12T17:29:17.762 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding con mode: secure 2024-09-12T17:29:17.762 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding con mode: crc 2024-09-12T17:29:17.762 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding con mode: secure 2024-09-12T17:29:17.763 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding con mode: crc 2024-09-12T17:29:17.763 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding con mode: secure 2024-09-12T17:29:17.763 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding con mode: crc 2024-09-12T17:29:17.763 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding con mode: crc 2024-09-12T17:29:17.763 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding con mode: secure 2024-09-12T17:29:17.763 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding con mode: crc 2024-09-12T17:29:17.763 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding con mode: secure 2024-09-12T17:29:17.763 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding con mode: crc 2024-09-12T17:29:17.763 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T17:29:17.607+0000 7f6090696800 5 AuthRegistry(0x55699cbf76d8) adding con mode: secure 2024-09-12T17:29:17.764 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T17:29:17.607+0000 7f6090696800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:17.764 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T17:29:17.607+0000 7f6090696800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:17.764 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T17:29:17.607+0000 7f6090696800 5 asok(0x55699c982730) register_command rotate-key cmddesc rotate-key hook 0x55699cbf7820 EEXIST 2024-09-12T17:29:17.764 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T17:29:17.607+0000 7f6090696800 10 monclient: _reopen_session rank -1 2024-09-12T17:29:17.764 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T17:29:17.607+0000 7f6090696800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:29:17.764 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T17:29:17.607+0000 7f6090696800 10 monclient(hunting): picked mon.noname-c con 0x55699cc20860 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:29:17.764 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T17:29:17.607+0000 7f6090696800 10 monclient(hunting): picked mon.noname-b con 0x55699cc20c40 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:29:17.764 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T17:29:17.607+0000 7f6090696800 10 monclient(hunting): picked mon.noname-a con 0x55699cc1f570 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:29:17.764 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T17:29:17.607+0000 7f6090696800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:17.764 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T17:29:17.607+0000 7f6090696800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:17.764 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T17:29:17.607+0000 7f6090696800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:17.765 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T17:29:17.607+0000 7f6090696800 10 monclient(hunting): _renew_subs 2024-09-12T17:29:17.765 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T17:29:17.607+0000 7f6090696800 10 monclient(hunting): authenticate will time out at 2568.957806s 2024-09-12T17:29:17.765 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T17:29:17.607+0000 7f608e180640 10 monclient(hunting): get_auth_request con 0x55699cc20860 auth_method 0 2024-09-12T17:29:17.765 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T17:29:17.607+0000 7f608e180640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:17.765 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T17:29:17.607+0000 7f608e180640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:17.765 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T17:29:17.607+0000 7f608e180640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:17.765 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T17:29:17.607+0000 7f608e981640 10 monclient(hunting): get_auth_request con 0x55699cc1f570 auth_method 0 2024-09-12T17:29:17.765 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T17:29:17.607+0000 7f608e981640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:17.765 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T17:29:17.607+0000 7f608e981640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:17.765 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T17:29:17.607+0000 7f608e981640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:17.765 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T17:29:17.608+0000 7f608d97f640 10 monclient(hunting): get_auth_request con 0x55699cc20c40 auth_method 0 2024-09-12T17:29:17.765 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T17:29:17.608+0000 7f608d97f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:17.765 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T17:29:17.608+0000 7f608d97f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:17.765 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T17:29:17.608+0000 7f608d97f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:17.766 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T17:29:17.608+0000 7f608e981640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:17.766 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T17:29:17.608+0000 7f608e981640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:17.766 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T17:29:17.608+0000 7f608e981640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:17.766 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T17:29:17.608+0000 7f608e180640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:17.766 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T17:29:17.608+0000 7f608e180640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:17.766 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T17:29:17.608+0000 7f608e180640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:17.766 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T17:29:17.608+0000 7f608d97f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:17.766 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T17:29:17.608+0000 7f608d97f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:17.766 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T17:29:17.608+0000 7f608d97f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:17.766 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T17:29:17.608+0000 7f608e981640 10 monclient(hunting): handle_auth_done global_id 8337 payload 824 2024-09-12T17:29:17.766 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T17:29:17.608+0000 7f608e981640 10 monclient: _finish_hunting 0 2024-09-12T17:29:17.766 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T17:29:17.608+0000 7f608e981640 1 monclient: found mon.noname-a 2024-09-12T17:29:17.766 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T17:29:17.608+0000 7f608e981640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:29:17.767 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T17:29:17.608+0000 7f5f73fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:17.767 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T17:29:17.608+0000 7f5f73fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:29:17.767 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T17:29:17.608+0000 7f5f73fff640 10 monclient: dump: 2024-09-12T17:29:17.767 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:17.767 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:17.767 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.767 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.767 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:17.767 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:17.767 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:17.767 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:17.767 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:17.767 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.767 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T17:29:17.608+0000 7f5f73fff640 10 monclient: _finish_auth 0 2024-09-12T17:29:17.768 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T17:29:17.608+0000 7f5f73fff640 10 monclient: _check_auth_tickets 2024-09-12T17:29:17.768 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T17:29:17.608+0000 7f5f73fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:29:17.768 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T17:29:17.608+0000 7f5f73fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:17.768 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T17:29:17.608+0000 7f5f73fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:29:17.768 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T17:29:17.608+0000 7f5f73fff640 10 monclient: dump: 2024-09-12T17:29:17.768 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:17.768 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:17.768 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.768 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.768 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:17.768 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:17.768 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:17.768 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:17.769 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:17.769 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.769 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T17:29:17.608+0000 7f6090696800 5 monclient: authenticate success, global_id 8337 2024-09-12T17:29:17.769 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T17:29:17.608+0000 7f6090696800 10 monclient: _renew_subs 2024-09-12T17:29:17.769 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T17:29:17.608+0000 7f6090696800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:29:17.769 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T17:29:17.608+0000 7f608f182640 4 set_mon_vals no callback set 2024-09-12T17:29:17.769 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T17:29:17.608+0000 7f6090696800 10 monclient: _renew_subs 2024-09-12T17:29:17.769 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T17:29:17.608+0000 7f6090696800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:29:17.769 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T17:29:17.610+0000 7f5f73fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:29:17.769 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T17:29:17.610+0000 7f5f73fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:29:17.769 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T17:29:17.610+0000 7f5f73fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:29:17.769 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T17:29:17.610+0000 7f608e180640 10 monclient: get_auth_request con 0x7f5f68076380 auth_method 0 2024-09-12T17:29:17.769 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T17:29:17.610+0000 7f6090696800 10 monclient: get_monmap_and_config 2024-09-12T17:29:17.770 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T17:29:17.610+0000 7f6090696800 10 monclient: build_initial_monmap 2024-09-12T17:29:17.770 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T17:29:17.610+0000 7f6090696800 1 build_initial for_mkfs: 0 2024-09-12T17:29:17.770 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T17:29:17.610+0000 7f6090696800 10 monclient: monmap: 2024-09-12T17:29:17.770 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:29:17.770 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:29:17.770 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:29:17.770 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:29:17.770 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:29:17.770 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:17.770 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:29:17.770 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:29:17.770 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:29:17.770 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.771 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding auth protocol: cephx 2024-09-12T17:29:17.771 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding auth protocol: cephx 2024-09-12T17:29:17.771 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding auth protocol: cephx 2024-09-12T17:29:17.771 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding con mode: secure 2024-09-12T17:29:17.771 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding con mode: crc 2024-09-12T17:29:17.771 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding con mode: secure 2024-09-12T17:29:17.771 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding con mode: crc 2024-09-12T17:29:17.771 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding con mode: secure 2024-09-12T17:29:17.771 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding con mode: crc 2024-09-12T17:29:17.771 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding con mode: crc 2024-09-12T17:29:17.771 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding con mode: secure 2024-09-12T17:29:17.771 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding con mode: crc 2024-09-12T17:29:17.771 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding con mode: secure 2024-09-12T17:29:17.771 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding con mode: crc 2024-09-12T17:29:17.772 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T17:29:17.610+0000 7f6090696800 5 AuthRegistry(0x55699cc407c0) adding con mode: secure 2024-09-12T17:29:17.772 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T17:29:17.611+0000 7f6090696800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:17.772 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T17:29:17.611+0000 7f6090696800 10 monclient: init 2024-09-12T17:29:17.772 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding auth protocol: cephx 2024-09-12T17:29:17.772 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding auth protocol: cephx 2024-09-12T17:29:17.772 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding auth protocol: cephx 2024-09-12T17:29:17.772 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding con mode: secure 2024-09-12T17:29:17.772 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding con mode: crc 2024-09-12T17:29:17.772 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding con mode: secure 2024-09-12T17:29:17.772 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding con mode: crc 2024-09-12T17:29:17.772 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding con mode: secure 2024-09-12T17:29:17.772 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding con mode: crc 2024-09-12T17:29:17.772 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding con mode: crc 2024-09-12T17:29:17.773 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding con mode: secure 2024-09-12T17:29:17.773 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding con mode: crc 2024-09-12T17:29:17.773 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding con mode: secure 2024-09-12T17:29:17.773 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding con mode: crc 2024-09-12T17:29:17.773 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T17:29:17.611+0000 7f6090696800 5 AuthRegistry(0x7ffcf0cce740) adding con mode: secure 2024-09-12T17:29:17.773 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T17:29:17.611+0000 7f6090696800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:17.773 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T17:29:17.611+0000 7f6090696800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:17.773 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T17:29:17.611+0000 7f6090696800 5 asok(0x55699c982730) register_command rotate-key cmddesc rotate-key hook 0x7ffcf0cce888 EEXIST 2024-09-12T17:29:17.773 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T17:29:17.611+0000 7f6090696800 10 monclient: _reopen_session rank -1 2024-09-12T17:29:17.773 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T17:29:17.611+0000 7f6090696800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:29:17.773 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T17:29:17.611+0000 7f6090696800 10 monclient(hunting): picked mon.noname-c con 0x55699cc74b70 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:29:17.773 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T17:29:17.611+0000 7f6090696800 10 monclient(hunting): picked mon.noname-a con 0x55699cc74f50 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:29:17.773 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T17:29:17.611+0000 7f6090696800 10 monclient(hunting): picked mon.noname-b con 0x55699cc7a660 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:29:17.774 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T17:29:17.611+0000 7f6090696800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:17.774 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T17:29:17.611+0000 7f6090696800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:17.774 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T17:29:17.611+0000 7f6090696800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:17.774 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T17:29:17.611+0000 7f6090696800 10 monclient(hunting): _renew_subs 2024-09-12T17:29:17.774 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T17:29:17.611+0000 7f6090696800 10 monclient(hunting): authenticate will time out at 2568.961976s 2024-09-12T17:29:17.774 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T17:29:17.612+0000 7f608e180640 10 monclient(hunting): get_auth_request con 0x55699cc74b70 auth_method 0 2024-09-12T17:29:17.774 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T17:29:17.612+0000 7f608e180640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:17.774 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T17:29:17.612+0000 7f608e180640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:17.774 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T17:29:17.612+0000 7f608e180640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:17.774 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T17:29:17.612+0000 7f608d97f640 10 monclient(hunting): get_auth_request con 0x55699cc74f50 auth_method 0 2024-09-12T17:29:17.774 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T17:29:17.612+0000 7f608d97f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:17.774 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T17:29:17.612+0000 7f608d97f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:17.775 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T17:29:17.612+0000 7f608d97f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:17.775 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T17:29:17.612+0000 7f608e180640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:17.775 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T17:29:17.612+0000 7f608e180640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:17.775 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T17:29:17.612+0000 7f608e180640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:17.775 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T17:29:17.612+0000 7f608d97f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:17.775 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T17:29:17.612+0000 7f608d97f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:17.775 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T17:29:17.612+0000 7f608d97f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:17.775 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T17:29:17.612+0000 7f608e981640 10 monclient(hunting): get_auth_request con 0x55699cc7a660 auth_method 0 2024-09-12T17:29:17.775 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T17:29:17.612+0000 7f608e981640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:17.775 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T17:29:17.612+0000 7f608e981640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:17.775 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T17:29:17.612+0000 7f608e981640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:17.775 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T17:29:17.612+0000 7f608e180640 10 monclient(hunting): handle_auth_done global_id 7817 payload 274 2024-09-12T17:29:17.776 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T17:29:17.612+0000 7f608e180640 10 monclient: _finish_hunting 0 2024-09-12T17:29:17.776 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T17:29:17.612+0000 7f608e180640 1 monclient: found mon.noname-c 2024-09-12T17:29:17.776 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T17:29:17.612+0000 7f608e180640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:29:17.776 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T17:29:17.612+0000 7f5f71ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:17.776 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T17:29:17.612+0000 7f5f71ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:29:17.776 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T17:29:17.612+0000 7f5f71ffb640 10 monclient: dump: 2024-09-12T17:29:17.776 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:17.776 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:17.776 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.777 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.777 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:17.777 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:17.777 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:17.777 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:17.777 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:17.777 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.777 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T17:29:17.612+0000 7f5f71ffb640 10 monclient: _finish_auth 0 2024-09-12T17:29:17.777 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T17:29:17.612+0000 7f5f71ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:29:17.777 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T17:29:17.612+0000 7f5f71ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:29:17.777 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T17:29:17.612+0000 7f5f71ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:17.777 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T17:29:17.612+0000 7f5f71ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:29:17.778 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T17:29:17.612+0000 7f5f71ffb640 10 monclient: dump: 2024-09-12T17:29:17.778 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:17.778 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:17.778 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.778 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.779 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:17.779 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:17.779 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:17.779 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:17.779 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:17.779 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.779 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T17:29:17.612+0000 7f6090696800 5 monclient: authenticate success, global_id 7817 2024-09-12T17:29:17.779 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T17:29:17.612+0000 7f6090696800 10 monclient: get_monmap_and_config success 2024-09-12T17:29:17.779 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T17:29:17.612+0000 7f6090696800 4 set_mon_vals no callback set 2024-09-12T17:29:17.779 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T17:29:17.613+0000 7f6090696800 10 monclient: shutdown 2024-09-12T17:29:17.779 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T17:29:17.613+0000 7f6090696800 10 monclient: build_initial_monmap 2024-09-12T17:29:17.779 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T17:29:17.613+0000 7f6090696800 1 build_initial for_mkfs: 0 2024-09-12T17:29:17.780 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T17:29:17.613+0000 7f6090696800 10 monclient: monmap: 2024-09-12T17:29:17.780 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:29:17.780 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:29:17.780 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:29:17.780 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:29:17.780 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:29:17.780 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:17.780 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:29:17.780 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:29:17.780 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:29:17.780 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.780 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding auth protocol: cephx 2024-09-12T17:29:17.780 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding auth protocol: cephx 2024-09-12T17:29:17.781 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding auth protocol: cephx 2024-09-12T17:29:17.781 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding con mode: secure 2024-09-12T17:29:17.781 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding con mode: crc 2024-09-12T17:29:17.781 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding con mode: secure 2024-09-12T17:29:17.781 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding con mode: crc 2024-09-12T17:29:17.781 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding con mode: secure 2024-09-12T17:29:17.781 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding con mode: crc 2024-09-12T17:29:17.781 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding con mode: crc 2024-09-12T17:29:17.781 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding con mode: secure 2024-09-12T17:29:17.781 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding con mode: crc 2024-09-12T17:29:17.781 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding con mode: secure 2024-09-12T17:29:17.781 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding con mode: crc 2024-09-12T17:29:17.781 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc45530) adding con mode: secure 2024-09-12T17:29:17.782 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T17:29:17.613+0000 7f6090696800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:17.782 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T17:29:17.613+0000 7f6090696800 1 librados: starting msgr at 2024-09-12T17:29:17.782 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T17:29:17.613+0000 7f6090696800 1 librados: starting objecter 2024-09-12T17:29:17.782 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T17:29:17.613+0000 7f6090696800 5 asok(0x55699c982730) register_command objecter_requests cmddesc objecter_requests hook 0x55699cc7aab0 EEXIST 2024-09-12T17:29:17.782 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T17:29:17.613+0000 7f6090696800 1 librados: setting wanted keys 2024-09-12T17:29:17.782 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T17:29:17.613+0000 7f6090696800 1 librados: calling monclient init 2024-09-12T17:29:17.782 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T17:29:17.613+0000 7f6090696800 10 monclient: init 2024-09-12T17:29:17.782 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding auth protocol: cephx 2024-09-12T17:29:17.782 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding auth protocol: cephx 2024-09-12T17:29:17.782 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding auth protocol: cephx 2024-09-12T17:29:17.782 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding con mode: secure 2024-09-12T17:29:17.782 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding con mode: crc 2024-09-12T17:29:17.782 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding con mode: secure 2024-09-12T17:29:17.783 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding con mode: crc 2024-09-12T17:29:17.783 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding con mode: secure 2024-09-12T17:29:17.783 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding con mode: crc 2024-09-12T17:29:17.783 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding con mode: crc 2024-09-12T17:29:17.783 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding con mode: secure 2024-09-12T17:29:17.783 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding con mode: crc 2024-09-12T17:29:17.783 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding con mode: secure 2024-09-12T17:29:17.783 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding con mode: crc 2024-09-12T17:29:17.783 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T17:29:17.613+0000 7f6090696800 5 AuthRegistry(0x55699cc35120) adding con mode: secure 2024-09-12T17:29:17.783 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T17:29:17.614+0000 7f6090696800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:17.783 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T17:29:17.614+0000 7f6090696800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:17.783 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T17:29:17.614+0000 7f6090696800 5 asok(0x55699c982730) register_command rotate-key cmddesc rotate-key hook 0x55699cc35268 EEXIST 2024-09-12T17:29:17.783 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T17:29:17.614+0000 7f6090696800 10 monclient: _reopen_session rank -1 2024-09-12T17:29:17.783 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T17:29:17.614+0000 7f6090696800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:29:17.784 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T17:29:17.614+0000 7f6090696800 10 monclient(hunting): picked mon.noname-b con 0x55699cc74b70 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:29:17.784 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T17:29:17.614+0000 7f6090696800 10 monclient(hunting): picked mon.noname-a con 0x55699cc7a660 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:29:17.784 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T17:29:17.614+0000 7f6090696800 10 monclient(hunting): picked mon.noname-c con 0x55699cc7f950 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:29:17.784 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T17:29:17.614+0000 7f6090696800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:17.784 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T17:29:17.614+0000 7f6090696800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:17.784 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T17:29:17.614+0000 7f6090696800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:17.784 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T17:29:17.614+0000 7f6090696800 10 monclient(hunting): _renew_subs 2024-09-12T17:29:17.784 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T17:29:17.614+0000 7f6090696800 10 monclient(hunting): authenticate will time out at 2568.964461s 2024-09-12T17:29:17.784 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T17:29:17.614+0000 7f608d97f640 10 monclient(hunting): get_auth_request con 0x55699cc7a660 auth_method 0 2024-09-12T17:29:17.784 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T17:29:17.614+0000 7f608d97f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:17.784 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T17:29:17.614+0000 7f608d97f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:17.784 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T17:29:17.614+0000 7f608d97f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:17.784 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T17:29:17.614+0000 7f608e981640 10 monclient(hunting): get_auth_request con 0x55699cc7f950 auth_method 0 2024-09-12T17:29:17.785 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T17:29:17.614+0000 7f608e981640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:17.785 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T17:29:17.614+0000 7f608e981640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:17.785 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T17:29:17.614+0000 7f608e981640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:17.785 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T17:29:17.614+0000 7f608d97f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:17.785 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T17:29:17.614+0000 7f608d97f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:17.785 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T17:29:17.614+0000 7f608d97f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:17.785 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T17:29:17.614+0000 7f608e981640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:17.785 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T17:29:17.614+0000 7f608e981640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:17.785 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T17:29:17.614+0000 7f608e981640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:17.785 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T17:29:17.614+0000 7f608e180640 10 monclient(hunting): get_auth_request con 0x55699cc74b70 auth_method 0 2024-09-12T17:29:17.785 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T17:29:17.614+0000 7f608e180640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:17.785 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T17:29:17.614+0000 7f608e180640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:17.786 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T17:29:17.614+0000 7f608e180640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:17.786 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T17:29:17.614+0000 7f608e981640 10 monclient(hunting): handle_auth_done global_id 7820 payload 824 2024-09-12T17:29:17.786 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T17:29:17.614+0000 7f608e981640 10 monclient: _finish_hunting 0 2024-09-12T17:29:17.786 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T17:29:17.614+0000 7f608e981640 1 monclient: found mon.noname-c 2024-09-12T17:29:17.786 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T17:29:17.614+0000 7f608e981640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T17:29:17.786 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T17:29:17.615+0000 7f5f5ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:17.786 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T17:29:17.615+0000 7f5f5ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:29:17.786 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T17:29:17.615+0000 7f5f5ffff640 10 monclient: dump: 2024-09-12T17:29:17.786 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:17.786 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:17.786 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.786 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.786 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:17.786 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:17.786 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:17.787 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:17.787 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:17.787 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.787 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T17:29:17.615+0000 7f5f5ffff640 10 monclient: _finish_auth 0 2024-09-12T17:29:17.787 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T17:29:17.615+0000 7f5f5ffff640 10 monclient: _check_auth_tickets 2024-09-12T17:29:17.787 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T17:29:17.615+0000 7f5f5ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:29:17.787 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T17:29:17.615+0000 7f5f5ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:17.787 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T17:29:17.615+0000 7f5f5ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:29:17.787 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T17:29:17.615+0000 7f5f5ffff640 10 monclient: dump: 2024-09-12T17:29:17.787 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:17.787 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:17.787 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.787 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:17.788 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:17.788 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:17.788 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:17.788 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:17.788 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:17.788 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.788 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T17:29:17.615+0000 7f6090696800 5 monclient: authenticate success, global_id 7820 2024-09-12T17:29:17.788 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T17:29:17.615+0000 7f5f71ffb640 4 set_mon_vals no callback set 2024-09-12T17:29:17.788 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T17:29:17.615+0000 7f6090696800 10 monclient: _renew_subs 2024-09-12T17:29:17.788 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T17:29:17.615+0000 7f6090696800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:29:17.788 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T17:29:17.615+0000 7f6090696800 10 monclient: _renew_subs 2024-09-12T17:29:17.788 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T17:29:17.615+0000 7f6090696800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:29:17.788 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T17:29:17.615+0000 7f6090696800 1 librados: init done 2024-09-12T17:29:17.789 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T17:29:17.615+0000 7f6090696800 5 asok(0x55699c982730) register_command cr dump hook 0x7f6080001f58 2024-09-12T17:29:17.789 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T17:29:17.617+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.789 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T17:29:17.617+0000 7f5f5ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:29:17.789 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T17:29:17.617+0000 7f5f5ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:29:17.789 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T17:29:17.617+0000 7f5f5ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:29:17.789 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T17:29:17.617+0000 7f608e180640 10 monclient: get_auth_request con 0x7f5f58076470 auth_method 0 2024-09-12T17:29:17.789 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T17:29:17.618+0000 7f608d97f640 10 monclient: get_auth_request con 0x55699cc8f4b0 auth_method 0 2024-09-12T17:29:17.789 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T17:29:17.618+0000 7f6090696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.789 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T17:29:17.618+0000 7f6090696800 20 realm 2024-09-12T17:29:17.789 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T17:29:17.618+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.789 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T17:29:17.618+0000 7f6090696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.789 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T17:29:17.618+0000 7f6090696800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:17.789 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T17:29:17.618+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.790 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T17:29:17.619+0000 7f6090696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.790 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T17:29:17.619+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.790 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T17:29:17.619+0000 7f608e180640 10 monclient: get_auth_request con 0x55699cc936e0 auth_method 0 2024-09-12T17:29:17.790 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T17:29:17.620+0000 7f6090696800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:17.790 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T17:29:17.620+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.790 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T17:29:17.620+0000 7f608d97f640 10 monclient: get_auth_request con 0x55699cc96f40 auth_method 0 2024-09-12T17:29:17.790 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T17:29:17.621+0000 7f6090696800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:29:17.790 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T17:29:17.621+0000 7f6090696800 20 searching for the correct realm 2024-09-12T17:29:17.790 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T17:29:17.621+0000 7f608e981640 10 monclient: get_auth_request con 0x55699cc9b9f0 auth_method 0 2024-09-12T17:29:17.790 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T17:29:17.622+0000 7f608e180640 10 monclient: get_auth_request con 0x7f608804fc70 auth_method 0 2024-09-12T17:29:17.790 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T17:29:17.623+0000 7f608d97f640 10 monclient: get_auth_request con 0x7f608004e940 auth_method 0 2024-09-12T17:29:17.790 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T17:29:17.624+0000 7f608d97f640 0 -- 172.21.15.67:0/781528773 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x55699cc8f4b0 msgr2=0x55699cc91910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:29:17.790 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T17:29:17.624+0000 7f5f5ffff640 1 client.7820.objecter ms_handle_reset 0x55699cc8f4b0 session 0x55699cc8ede0 osd.1 2024-09-12T17:29:17.790 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T17:29:17.624+0000 7f5f5ffff640 10 monclient: _renew_subs 2024-09-12T17:29:17.791 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T17:29:17.624+0000 7f5f5ffff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T17:29:17.791 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T17:29:17.625+0000 7f608d97f640 10 monclient: get_auth_request con 0x7f5f58086310 auth_method 0 2024-09-12T17:29:17.791 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T17:29:17.625+0000 7f608e981640 10 monclient: get_auth_request con 0x7f608406d040 auth_method 0 2024-09-12T17:29:17.791 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T17:29:17.627+0000 7f608e180640 10 monclient: get_auth_request con 0x7f608409e920 auth_method 0 2024-09-12T17:29:17.791 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T17:29:17.628+0000 7f608d97f640 0 -- 172.21.15.67:0/781528773 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55699cc96f40 msgr2=0x55699cc99330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:29:17.791 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T17:29:17.628+0000 7f5f5ffff640 1 client.7820.objecter ms_handle_reset 0x55699cc96f40 session 0x55699cc92a30 osd.4 2024-09-12T17:29:17.791 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T17:29:17.628+0000 7f608d97f640 10 monclient: get_auth_request con 0x55699cc8f4b0 auth_method 0 2024-09-12T17:29:17.791 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T17:29:17.633+0000 7f6090696800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:29:17.791 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T17:29:17.633+0000 7f6090696800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:29:17.791 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T17:29:17.633+0000 7f6090696800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:17.791 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T17:29:17.633+0000 7f6090696800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:17.791 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T17:29:17.633+0000 7f6090696800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:17.791 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T17:29:17.633+0000 7f6090696800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:17.792 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T17:29:17.633+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.792 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T17:29:17.633+0000 7f6090696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.792 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T17:29:17.633+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.792 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T17:29:17.634+0000 7f6090696800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:17.792 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T17:29:17.634+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.792 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T17:29:17.634+0000 7f6090696800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:29:17.792 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T17:29:17.634+0000 7f6090696800 20 zone default found 2024-09-12T17:29:17.792 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T17:29:17.634+0000 7f6090696800 4 Realm: () 2024-09-12T17:29:17.792 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T17:29:17.634+0000 7f6090696800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:29:17.792 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T17:29:17.634+0000 7f6090696800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:29:17.792 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T17:29:17.634+0000 7f6090696800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:17.792 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T17:29:17.634+0000 7f6090696800 20 zonegroup default 2024-09-12T17:29:17.792 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T17:29:17.634+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.792 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T17:29:17.634+0000 7f6090696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.793 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T17:29:17.634+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.793 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T17:29:17.635+0000 7f6090696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.793 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T17:29:17.635+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.793 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T17:29:17.635+0000 7f6090696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.793 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T17:29:17.635+0000 7f6090696800 20 started sync module instance, tier type = 2024-09-12T17:29:17.793 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T17:29:17.635+0000 7f6090696800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:29:17.793 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T17:29:17.645+0000 7f6090696800 20 add_watcher() i=0 2024-09-12T17:29:17.793 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T17:29:17.645+0000 7f6090696800 20 add_watcher() i=1 2024-09-12T17:29:17.793 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T17:29:17.645+0000 7f6090696800 20 add_watcher() i=2 2024-09-12T17:29:17.793 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T17:29:17.645+0000 7f6090696800 20 add_watcher() i=3 2024-09-12T17:29:17.793 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T17:29:17.645+0000 7f6090696800 20 add_watcher() i=4 2024-09-12T17:29:17.793 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T17:29:17.645+0000 7f6090696800 20 add_watcher() i=5 2024-09-12T17:29:17.793 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T17:29:17.645+0000 7f6090696800 20 add_watcher() i=6 2024-09-12T17:29:17.794 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T17:29:17.646+0000 7f6090696800 20 add_watcher() i=7 2024-09-12T17:29:17.794 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T17:29:17.646+0000 7f6090696800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:17.794 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding auth protocol: cephx 2024-09-12T17:29:17.794 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding auth protocol: cephx 2024-09-12T17:29:17.794 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding auth protocol: cephx 2024-09-12T17:29:17.794 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding con mode: secure 2024-09-12T17:29:17.794 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding con mode: crc 2024-09-12T17:29:17.794 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding con mode: secure 2024-09-12T17:29:17.794 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding con mode: crc 2024-09-12T17:29:17.794 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding con mode: secure 2024-09-12T17:29:17.794 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding con mode: crc 2024-09-12T17:29:17.794 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding con mode: crc 2024-09-12T17:29:17.794 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T17:29:17.648+0000 7f5f44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:17.795 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding con mode: secure 2024-09-12T17:29:17.795 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding con mode: crc 2024-09-12T17:29:17.795 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding con mode: secure 2024-09-12T17:29:17.795 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding con mode: crc 2024-09-12T17:29:17.795 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T17:29:17.648+0000 7f6090696800 5 AuthRegistry(0x7ffcf0ccec10) adding con mode: secure 2024-09-12T17:29:17.795 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T17:29:17.648+0000 7f6090696800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:17.795 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T17:29:17.648+0000 7f6090696800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:17.795 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T17:29:17.648+0000 7f6090696800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:17.795 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T17:29:17.648+0000 7f6090696800 5 asok(0x55699c982730) register_command cache list hook 0x55699cc68630 2024-09-12T17:29:17.795 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T17:29:17.648+0000 7f6090696800 5 asok(0x55699c982730) register_command cache inspect hook 0x55699cc68630 2024-09-12T17:29:17.795 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T17:29:17.648+0000 7f6090696800 5 asok(0x55699c982730) register_command cache erase hook 0x55699cc68630 2024-09-12T17:29:17.795 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T17:29:17.648+0000 7f6090696800 5 asok(0x55699c982730) register_command cache zap hook 0x55699cc68630 2024-09-12T17:29:17.795 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T17:29:17.648+0000 7f6090696800 5 note: GC not initialized 2024-09-12T17:29:17.796 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T17:29:17.648+0000 7f5ebf7fe640 20 reqs_thread_entry: start 2024-09-12T17:29:17.796 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T17:29:17.648+0000 7f6090696800 5 asok(0x55699c982730) register_command sync trace show hook 0x7f6080010b20 2024-09-12T17:29:17.796 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T17:29:17.648+0000 7f6090696800 5 asok(0x55699c982730) register_command sync trace history hook 0x7f6080010b20 2024-09-12T17:29:17.796 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T17:29:17.648+0000 7f6090696800 5 asok(0x55699c982730) register_command sync trace active hook 0x7f6080010b20 2024-09-12T17:29:17.796 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T17:29:17.648+0000 7f6090696800 5 asok(0x55699c982730) register_command sync trace active_short hook 0x7f6080010b20 2024-09-12T17:29:17.796 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T17:29:17.648+0000 7f6090696800 20 init_complete bucket index max shards: 1 2024-09-12T17:29:17.796 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T17:29:17.648+0000 7f6090696800 20 Filter name: none 2024-09-12T17:29:17.796 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T17:29:17.649+0000 7f5ebd7fa640 20 reqs_thread_entry: start 2024-09-12T17:29:17.796 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T17:29:17.649+0000 7f6090696800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:29:17.796 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T17:29:17.649+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.796 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T17:29:17.649+0000 7f6090696800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:29:17.796 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T17:29:17.649+0000 7f6090696800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:29:17.796 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T17:29:17.649+0000 7f6090696800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:29:17.796 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T17:29:17.649+0000 7f6090696800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : miss 2024-09-12T17:29:17.797 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T17:29:17.649+0000 7f6090696800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.797 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T17:29:17.650+0000 7f6090696800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:29:17.797 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T17:29:17.650+0000 7f6090696800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:29:17.797 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T17:29:17.650+0000 7f6090696800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:29:17.797 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T17:29:17.650+0000 7f6090696800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:17.797 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T17:29:17.650+0000 7f6090696800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:29:17.797 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T17:29:17.650+0000 7f6090696800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:29:17.797 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T17:29:17.651+0000 7f6090696800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:29:17.797 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T17:29:17.656+0000 7f6090696800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:29:17.797 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T17:29:17.656+0000 7f6090696800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:29:17.797 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T17:29:17.656+0000 7f6090696800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:29:17.797 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T17:29:17.656+0000 7f6090696800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18, ofs0, ns] 2024-09-12T17:29:17.798 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T17:29:17.657+0000 7f5f71ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464370 cookie 93912090345152 notifier 7820 bl.length()=911 2024-09-12T17:29:17.798 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T17:29:17.657+0000 7f5f71ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:29:17.798 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T17:29:17.657+0000 7f5f71ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:29:17.798 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T17:29:17.657+0000 7f5f71ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:29:17.798 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T17:29:17.658+0000 7f6090696800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_sources= new_sources= 2024-09-12T17:29:17.798 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T17:29:17.658+0000 7f6090696800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:29:17.798 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T17:29:17.658+0000 7f6090696800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_dests= new_dests= 2024-09-12T17:29:17.798 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T17:29:17.658+0000 7f6090696800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:29:17.798 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T17:29:17.662+0000 7f6090696800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6090696800 time 2024-09-12T17:29:17.662349+0000 2024-09-12T17:29:17.798 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:29:17.798 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.798 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:29:17.798 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6093b8c71a] 2024-09-12T17:29:17.799 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6093b8c8d8] 2024-09-12T17:29:17.799 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55699a301841] 2024-09-12T17:29:17.799 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd7490c) [0x55699a80f90c] 2024-09-12T17:29:17.799 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55699a31150d] 2024-09-12T17:29:17.799 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T17:29:17.799 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6092829590] 2024-09-12T17:29:17.799 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T17:29:17.799 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T17:29:17.799 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.799 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T17:29:17.663+0000 7f6090696800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:29:17.799 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f6090696800 thread_name:radosgw-admin 2024-09-12T17:29:17.799 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.799 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:29:17.800 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f609283e6f0] 2024-09-12T17:29:17.800 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f609288b99c] 2024-09-12T17:29:17.800 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:29:17.800 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:29:17.800 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6093b8c774] 2024-09-12T17:29:17.800 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6093b8c8d8] 2024-09-12T17:29:17.800 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55699a301841] 2024-09-12T17:29:17.800 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd7490c) [0x55699a80f90c] 2024-09-12T17:29:17.800 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55699a31150d] 2024-09-12T17:29:17.800 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T17:29:17.800 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6092829590] 2024-09-12T17:29:17.800 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T17:29:17.800 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T17:29:17.800 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:29:17.801 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:17.801 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T17:29:17.801 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T17:29:17.801 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T17:29:17.801 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T17:29:17.801 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T17:29:17.801 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T17:29:17.801 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T17:29:17.801 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T17:29:17.801 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T17:29:17.801 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T17:29:17.801 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T17:29:17.801 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T17:29:17.801 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T17:29:17.802 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T17:29:17.802 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T17:29:17.802 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T17:29:17.802 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T17:29:17.802 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T17:29:17.802 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T17:29:17.802 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T17:29:17.802 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T17:29:17.802 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T17:29:17.802 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T17:29:17.802 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T17:29:17.802 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:29:17.803 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T17:29:17.803 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T17:29:17.803 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T17:29:17.803 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T17:29:17.803 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T17:29:17.803 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T17:29:17.803 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T17:29:17.803 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T17:29:17.803 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T17:29:17.803 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T17:29:17.803 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T17:29:17.803 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T17:29:17.803 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T17:29:17.803 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T17:29:17.804 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T17:29:17.804 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T17:29:17.804 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T17:29:17.804 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T17:29:17.804 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T17:29:17.804 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T17:29:17.804 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T17:29:17.804 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:29:17.804 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T17:29:17.804 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:29:17.804 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T17:29:17.804 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T17:29:17.805 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T17:29:17.805 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T17:29:17.805 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T17:29:17.805 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T17:29:17.805 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T17:29:17.805 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T17:29:17.805 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T17:29:17.805 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T17:29:17.805 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T17:29:17.805 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T17:29:17.806 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T17:29:17.806 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T17:29:17.806 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T17:29:17.806 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T17:29:17.806 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T17:29:17.806 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T17:29:17.806 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:29:17.806 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T17:29:17.806 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:29:17.806 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T17:29:17.806 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T17:29:17.806 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T17:29:17.806 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T17:29:17.807 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T17:29:17.807 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T17:29:17.807 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:29:17.807 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T17:29:17.807 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T17:29:17.807 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:29:17.807 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T17:29:17.807 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T17:29:17.807 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T17:29:17.807 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T17:29:17.807 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T17:29:17.807 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T17:29:17.808 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T17:29:17.808 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T17:29:17.808 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T17:29:17.808 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T17:29:17.808 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T17:29:17.808 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T17:29:17.808 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T17:29:17.808 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:29:17.808 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5ebd7fa640 / http_manager 2024-09-12T17:29:17.808 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5ebf7fe640 / http_manager 2024-09-12T17:29:17.808 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5f44fe1640 / rgw_dt_lg_renew 2024-09-12T17:29:17.808 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5f5ffff640 / ms_dispatch 2024-09-12T17:29:17.808 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5f71ffb640 / io_context_pool 2024-09-12T17:29:17.809 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5f73fff640 / ms_dispatch 2024-09-12T17:29:17.809 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5f7ae05640 / ms_dispatch 2024-09-12T17:29:17.809 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5f7c608640 / io_context_pool 2024-09-12T17:29:17.809 INFO:tasks.workunit.client.0.smithi067.stderr: 7f608d97f640 / msgr-worker-2 2024-09-12T17:29:17.809 INFO:tasks.workunit.client.0.smithi067.stderr: 7f608e180640 / msgr-worker-1 2024-09-12T17:29:17.809 INFO:tasks.workunit.client.0.smithi067.stderr: 7f608e981640 / msgr-worker-0 2024-09-12T17:29:17.809 INFO:tasks.workunit.client.0.smithi067.stderr: 7f608f182640 / io_context_pool 2024-09-12T17:29:17.809 INFO:tasks.workunit.client.0.smithi067.stderr: 7f6090696800 / radosgw-admin 2024-09-12T17:29:17.809 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T17:29:17.809 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T17:29:17.809 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:29:17.664174Z_79ae8a86-983e-40cc-824c-bbd3f38c8852/log 2024-09-12T17:29:17.809 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T17:29:17.810 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:29:17.815 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:17.815 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:17.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.743+0000 7f880471f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.744+0000 7f880471f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.744+0000 7f880471f800 20 realm 2024-09-12T17:29:17.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.744+0000 7f880471f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.744+0000 7f880471f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.744+0000 7f880471f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:17.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.744+0000 7f880471f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.745+0000 7f880471f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.745+0000 7f880471f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.745+0000 7f880471f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:17.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.745+0000 7f880471f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.746+0000 7f880471f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:29:17.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.746+0000 7f880471f800 20 searching for the correct realm 2024-09-12T17:29:17.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.750+0000 7f8800c0d640 0 -- 172.21.15.67:0/416532965 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x564dbe8b2650 msgr2=0x564dbe8b4b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:29:17.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.753+0000 7f880040c640 0 -- 172.21.15.67:0/416532965 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f87f407e020 msgr2=0x7f87f40b10e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:29:17.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.758+0000 7f880471f800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:29:17.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.758+0000 7f880471f800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:29:17.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.758+0000 7f880471f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:17.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.758+0000 7f880471f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:17.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.758+0000 7f880471f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:17.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.758+0000 7f880471f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:17.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.758+0000 7f880471f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.758+0000 7f880471f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.758+0000 7f880471f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.758+0000 7f880471f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:17.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.758+0000 7f880471f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.759+0000 7f880471f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:29:17.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.759+0000 7f880471f800 20 zone default found 2024-09-12T17:29:17.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.759+0000 7f880471f800 4 Realm: () 2024-09-12T17:29:17.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.759+0000 7f880471f800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:29:17.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.759+0000 7f880471f800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:29:17.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.759+0000 7f880471f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:17.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.759+0000 7f880471f800 20 zonegroup default 2024-09-12T17:29:17.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.759+0000 7f880471f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.759+0000 7f880471f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.759+0000 7f880471f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.759+0000 7f880471f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.759+0000 7f880471f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.759+0000 7f880471f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:17.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.759+0000 7f880471f800 20 started sync module instance, tier type = 2024-09-12T17:29:17.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.759+0000 7f880471f800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:29:17.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.768+0000 7f880471f800 20 add_watcher() i=0 2024-09-12T17:29:17.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.768+0000 7f880471f800 20 add_watcher() i=1 2024-09-12T17:29:17.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.768+0000 7f880471f800 20 add_watcher() i=2 2024-09-12T17:29:17.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.768+0000 7f880471f800 20 add_watcher() i=3 2024-09-12T17:29:17.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.769+0000 7f880471f800 20 add_watcher() i=4 2024-09-12T17:29:17.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.769+0000 7f880471f800 20 add_watcher() i=5 2024-09-12T17:29:17.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.769+0000 7f880471f800 20 add_watcher() i=6 2024-09-12T17:29:17.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.769+0000 7f880471f800 20 add_watcher() i=7 2024-09-12T17:29:17.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.769+0000 7f880471f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:17.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.771+0000 7f86b6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:17.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.771+0000 7f880471f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:17.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.771+0000 7f880471f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:17.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.771+0000 7f880471f800 5 note: GC not initialized 2024-09-12T17:29:17.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.771+0000 7f86b5fdb640 20 reqs_thread_entry: start 2024-09-12T17:29:17.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.772+0000 7f880471f800 20 init_complete bucket index max shards: 1 2024-09-12T17:29:17.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.772+0000 7f880471f800 20 Filter name: none 2024-09-12T17:29:17.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.772+0000 7f86277fe640 20 reqs_thread_entry: start 2024-09-12T17:29:17.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.772+0000 7f880471f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:29:17.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.772+0000 7f880471f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.772+0000 7f880471f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:29:17.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.773+0000 7f880471f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:29:17.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.773+0000 7f880471f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:29:17.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.773+0000 7f880471f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : miss 2024-09-12T17:29:17.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.773+0000 7f880471f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:17.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.773+0000 7f880471f800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:29:17.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.773+0000 7f880471f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:29:17.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.773+0000 7f880471f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:29:17.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.773+0000 7f880471f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:17.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.773+0000 7f880471f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:29:17.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.773+0000 7f880471f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:29:17.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.773+0000 7f880471f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 2024-09-12T17:29:17.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.773+0000 7f880471f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 2024-09-12T17:29:17.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.773+0000 7f880471f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.1 2024-09-12T17:29:17.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.773+0000 7f880471f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.1 2024-09-12T17:29:17.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.774+0000 7f880471f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.2 2024-09-12T17:29:17.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.774+0000 7f880471f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.2 2024-09-12T17:29:17.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.775+0000 7f86b6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:17.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.777+0000 7f880471f800 20 remove_watcher() i=0 2024-09-12T17:29:17.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.777+0000 7f880471f800 2 removed watcher, disabling cache 2024-09-12T17:29:17.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.778+0000 7f880471f800 20 remove_watcher() i=1 2024-09-12T17:29:17.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.779+0000 7f880471f800 20 remove_watcher() i=2 2024-09-12T17:29:17.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.781+0000 7f880471f800 20 remove_watcher() i=3 2024-09-12T17:29:17.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.782+0000 7f880471f800 20 remove_watcher() i=4 2024-09-12T17:29:17.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.783+0000 7f880471f800 20 remove_watcher() i=5 2024-09-12T17:29:17.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.783+0000 7f880471f800 20 remove_watcher() i=6 2024-09-12T17:29:17.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:17.785+0000 7f880471f800 20 remove_watcher() i=7 2024-09-12T17:29:17.823 INFO:tasks.workunit.client.0.smithi067.stderr: test: duplicated entries can be purged manually 2024-09-12T17:29:47.803 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:29:47.836 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:47.836 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:47.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:47.882+0000 7f795b52c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:47.884+0000 7f795b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:47.884+0000 7f795b52c800 20 realm 2024-09-12T17:29:47.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:47.884+0000 7f795b52c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:47.884+0000 7f795b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:47.884+0000 7f795b52c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:47.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:47.884+0000 7f795b52c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:47.884+0000 7f795b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:47.884+0000 7f795b52c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:47.885+0000 7f795b52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:47.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:47.885+0000 7f795b52c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:47.886+0000 7f795b52c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:29:47.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:47.886+0000 7f795b52c800 20 searching for the correct realm 2024-09-12T17:29:47.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:47.886+0000 7f7957a57640 0 -- 172.21.15.67:0/1789034209 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x5649a83ef500 msgr2=0x5649a83f19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:29:48.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.093+0000 7f7957a57640 0 -- 172.21.15.67:0/1789034209 >> [v2:172.21.15.118:6824/1070975205,v1:172.21.15.118:6825/1070975205] conn(0x7f794c0de000 msgr2=0x7f794c0de400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:29:48.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.304+0000 7f795b52c800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:29:48.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.304+0000 7f795b52c800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:29:48.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.304+0000 7f795b52c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:48.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.304+0000 7f795b52c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:48.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.304+0000 7f795b52c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:48.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.304+0000 7f795b52c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:48.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.304+0000 7f795b52c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.304+0000 7f795b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.304+0000 7f795b52c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.305+0000 7f795b52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:48.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.305+0000 7f795b52c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.305+0000 7f795b52c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:29:48.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.305+0000 7f795b52c800 20 zone default found 2024-09-12T17:29:48.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.305+0000 7f795b52c800 4 Realm: () 2024-09-12T17:29:48.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.305+0000 7f795b52c800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:29:48.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.305+0000 7f795b52c800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:29:48.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.305+0000 7f795b52c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:48.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.305+0000 7f795b52c800 20 zonegroup default 2024-09-12T17:29:48.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.305+0000 7f795b52c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.306+0000 7f795b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.306+0000 7f795b52c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.306+0000 7f795b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.306+0000 7f795b52c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.307+0000 7f795b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.307+0000 7f795b52c800 20 started sync module instance, tier type = 2024-09-12T17:29:48.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.307+0000 7f795b52c800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:29:48.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.318+0000 7f795b52c800 20 add_watcher() i=0 2024-09-12T17:29:48.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.318+0000 7f795b52c800 20 add_watcher() i=1 2024-09-12T17:29:48.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.318+0000 7f795b52c800 20 add_watcher() i=2 2024-09-12T17:29:48.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.318+0000 7f795b52c800 20 add_watcher() i=3 2024-09-12T17:29:48.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.318+0000 7f795b52c800 20 add_watcher() i=4 2024-09-12T17:29:48.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.318+0000 7f795b52c800 20 add_watcher() i=5 2024-09-12T17:29:48.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.318+0000 7f795b52c800 20 add_watcher() i=6 2024-09-12T17:29:48.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.319+0000 7f795b52c800 20 add_watcher() i=7 2024-09-12T17:29:48.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.319+0000 7f795b52c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:48.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.321+0000 7f780e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:48.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.322+0000 7f795b52c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:48.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.322+0000 7f795b52c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:48.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.322+0000 7f795b52c800 5 note: GC not initialized 2024-09-12T17:29:48.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.322+0000 7f780d7e2640 20 reqs_thread_entry: start 2024-09-12T17:29:48.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.322+0000 7f795b52c800 20 init_complete bucket index max shards: 1 2024-09-12T17:29:48.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.322+0000 7f795b52c800 20 Filter name: none 2024-09-12T17:29:48.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.322+0000 7f78067fc640 20 reqs_thread_entry: start 2024-09-12T17:29:48.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.322+0000 7f795b52c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.323+0000 7f795b52c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:29:48.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.323+0000 7f795b52c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.323+0000 7f795b52c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:29:48.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.323+0000 7f795b52c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:29:48.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.323+0000 7f795b52c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.324+0000 7f795b52c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:29:48.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.324+0000 7f795b52c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.325+0000 7f795b52c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:29:48.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.325+0000 7f795b52c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:29:48.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.326+0000 7f780e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:48.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.330+0000 7f795b52c800 20 remove_watcher() i=0 2024-09-12T17:29:48.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.330+0000 7f795b52c800 2 removed watcher, disabling cache 2024-09-12T17:29:48.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.332+0000 7f795b52c800 20 remove_watcher() i=1 2024-09-12T17:29:48.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.334+0000 7f795b52c800 20 remove_watcher() i=2 2024-09-12T17:29:48.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.335+0000 7f795b52c800 20 remove_watcher() i=3 2024-09-12T17:29:48.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.336+0000 7f795b52c800 20 remove_watcher() i=4 2024-09-12T17:29:48.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.337+0000 7f795b52c800 20 remove_watcher() i=5 2024-09-12T17:29:48.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.338+0000 7f795b52c800 20 remove_watcher() i=6 2024-09-12T17:29:48.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.340+0000 7f795b52c800 20 remove_watcher() i=7 2024-09-12T17:29:48.354 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.354 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:29:48.354 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: a-bucket id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 num_objects: 11 size_kb: 1 num_shards: 3 2024-09-12T17:29:48.354 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.356 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T17:29:48.393 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:48.393 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:48.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.434+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.435+0000 7f76dc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.435+0000 7f76dc015800 20 realm 2024-09-12T17:29:48.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.435+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.436+0000 7f76dc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.436+0000 7f76dc015800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:48.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.436+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.436+0000 7f76dc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.436+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.437+0000 7f76dc015800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:48.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.437+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.437+0000 7f76dc015800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:29:48.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.438+0000 7f76dc015800 20 searching for the correct realm 2024-09-12T17:29:48.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.440+0000 7f76d7792640 0 -- 172.21.15.67:0/4098300234 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f76d0061070 msgr2=0x7f76d00a3b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:29:48.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.444+0000 7f76d7792640 0 -- 172.21.15.67:0/4098300234 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f76cc02c400 msgr2=0x7f76cc02c880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:29:48.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.651+0000 7f76dc015800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:29:48.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.651+0000 7f76dc015800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:29:48.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.651+0000 7f76dc015800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:48.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.651+0000 7f76dc015800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:48.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.651+0000 7f76dc015800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:48.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.651+0000 7f76dc015800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:48.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.651+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.651+0000 7f76dc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.651+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.652+0000 7f76dc015800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:48.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.652+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.652+0000 7f76dc015800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:29:48.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.652+0000 7f76dc015800 20 zone default found 2024-09-12T17:29:48.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.652+0000 7f76dc015800 4 Realm: () 2024-09-12T17:29:48.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.652+0000 7f76dc015800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:29:48.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.652+0000 7f76dc015800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:29:48.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.652+0000 7f76dc015800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:48.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.652+0000 7f76dc015800 20 zonegroup default 2024-09-12T17:29:48.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.652+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.652+0000 7f76dc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.652+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.653+0000 7f76dc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.653+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.653+0000 7f76dc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.653+0000 7f76dc015800 20 started sync module instance, tier type = 2024-09-12T17:29:48.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.653+0000 7f76dc015800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:29:48.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.663+0000 7f76dc015800 20 add_watcher() i=0 2024-09-12T17:29:48.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.663+0000 7f76dc015800 20 add_watcher() i=1 2024-09-12T17:29:48.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.663+0000 7f76dc015800 20 add_watcher() i=2 2024-09-12T17:29:48.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.663+0000 7f76dc015800 20 add_watcher() i=3 2024-09-12T17:29:48.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.663+0000 7f76dc015800 20 add_watcher() i=4 2024-09-12T17:29:48.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.663+0000 7f76dc015800 20 add_watcher() i=5 2024-09-12T17:29:48.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.663+0000 7f76dc015800 20 add_watcher() i=6 2024-09-12T17:29:48.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.664+0000 7f76dc015800 20 add_watcher() i=7 2024-09-12T17:29:48.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.664+0000 7f76dc015800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:48.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.665+0000 7f758dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:48.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.666+0000 7f76dc015800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:48.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.666+0000 7f76dc015800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:48.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.666+0000 7f76dc015800 5 note: GC not initialized 2024-09-12T17:29:48.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.666+0000 7f758cfe1640 20 reqs_thread_entry: start 2024-09-12T17:29:48.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.666+0000 7f76dc015800 20 init_complete bucket index max shards: 1 2024-09-12T17:29:48.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.666+0000 7f76dc015800 20 Filter name: none 2024-09-12T17:29:48.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.666+0000 7f75067fc640 20 reqs_thread_entry: start 2024-09-12T17:29:48.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.667+0000 7f76dc015800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:29:48.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.667+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.667+0000 7f76dc015800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:29:48.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.667+0000 7f76dc015800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:29:48.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.667+0000 7f76dc015800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:29:48.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.667+0000 7f76dc015800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : miss 2024-09-12T17:29:48.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.667+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.667+0000 7f76dc015800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:29:48.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.667+0000 7f76dc015800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:29:48.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.667+0000 7f76dc015800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:29:48.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.667+0000 7f76dc015800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:48.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.667+0000 7f76dc015800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:29:48.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.668+0000 7f76dc015800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:29:48.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.669+0000 7f76dc015800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:29:48.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.673+0000 7f76dc015800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:29:48.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.673+0000 7f76dc015800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:29:48.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.673+0000 7f76dc015800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:29:48.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.673+0000 7f76dc015800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18, ofs0, ns] 2024-09-12T17:29:48.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.673+0000 7f75baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464371 cookie 93976704515648 notifier 8403 bl.length()=911 2024-09-12T17:29:48.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.673+0000 7f75baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:29:48.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.673+0000 7f75baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:29:48.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.673+0000 7f75baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:29:48.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.675+0000 7f76dc015800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_sources= new_sources= 2024-09-12T17:29:48.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.675+0000 7f76dc015800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:29:48.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.675+0000 7f76dc015800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_dests= new_dests= 2024-09-12T17:29:48.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.675+0000 7f76dc015800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:29:48.678 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f76dc015800 time 2024-09-12T17:29:48.678685+0000 2024-09-12T17:29:48.678 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:29:48.679 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:29:48.679 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f76dd18c71a] 2024-09-12T17:29:48.679 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f76dd18c8d8] 2024-09-12T17:29:48.679 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5578a5b03841] 2024-09-12T17:29:48.679 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5578a5b1357a] 2024-09-12T17:29:48.679 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T17:29:48.680 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f76dbe29590] 2024-09-12T17:29:48.680 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T17:29:48.680 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T17:29:48.680 INFO:tasks.workunit.client.0.smithi067.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:29:48.680 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f76dc015800 thread_name:radosgw-admin 2024-09-12T17:29:48.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.678+0000 7f76dc015800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f76dc015800 time 2024-09-12T17:29:48.678685+0000 2024-09-12T17:29:48.680 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:29:48.680 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.680 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:29:48.680 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f76dd18c71a] 2024-09-12T17:29:48.680 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f76dd18c8d8] 2024-09-12T17:29:48.680 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5578a5b03841] 2024-09-12T17:29:48.680 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5578a5b1357a] 2024-09-12T17:29:48.681 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T17:29:48.681 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f76dbe29590] 2024-09-12T17:29:48.681 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T17:29:48.681 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T17:29:48.681 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.701 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:29:48.702 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f76dbe3e6f0] 2024-09-12T17:29:48.702 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f76dbe8b99c] 2024-09-12T17:29:48.702 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:29:48.702 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:29:48.702 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f76dd18c774] 2024-09-12T17:29:48.702 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f76dd18c8d8] 2024-09-12T17:29:48.702 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5578a5b03841] 2024-09-12T17:29:48.702 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5578a5b1357a] 2024-09-12T17:29:48.702 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T17:29:48.702 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f76dbe29590] 2024-09-12T17:29:48.702 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T17:29:48.703 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T17:29:48.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.679+0000 7f76dc015800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:29:48.703 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f76dc015800 thread_name:radosgw-admin 2024-09-12T17:29:48.703 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.703 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:29:48.703 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f76dbe3e6f0] 2024-09-12T17:29:48.703 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f76dbe8b99c] 2024-09-12T17:29:48.703 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:29:48.703 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:29:48.703 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f76dd18c774] 2024-09-12T17:29:48.703 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f76dd18c8d8] 2024-09-12T17:29:48.703 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5578a5b03841] 2024-09-12T17:29:48.704 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5578a5b1357a] 2024-09-12T17:29:48.704 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T17:29:48.704 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f76dbe29590] 2024-09-12T17:29:48.704 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T17:29:48.704 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T17:29:48.704 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:29:48.704 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.704 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T17:29:48.704 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T17:29:48.416+0000 7f76dc015800 10 monclient: build_initial_monmap 2024-09-12T17:29:48.704 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T17:29:48.416+0000 7f76dc015800 1 build_initial for_mkfs: 0 2024-09-12T17:29:48.704 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T17:29:48.416+0000 7f76dc015800 10 monclient: monmap: 2024-09-12T17:29:48.704 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:29:48.705 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:29:48.705 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:29:48.705 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:29:48.705 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:29:48.705 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:48.705 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:29:48.705 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:29:48.705 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:29:48.705 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.705 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding auth protocol: cephx 2024-09-12T17:29:48.705 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding auth protocol: cephx 2024-09-12T17:29:48.705 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding auth protocol: cephx 2024-09-12T17:29:48.705 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding con mode: secure 2024-09-12T17:29:48.706 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding con mode: crc 2024-09-12T17:29:48.706 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding con mode: secure 2024-09-12T17:29:48.706 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding con mode: crc 2024-09-12T17:29:48.706 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding con mode: secure 2024-09-12T17:29:48.706 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding con mode: crc 2024-09-12T17:29:48.706 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding con mode: crc 2024-09-12T17:29:48.706 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding con mode: secure 2024-09-12T17:29:48.706 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding con mode: crc 2024-09-12T17:29:48.706 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding con mode: secure 2024-09-12T17:29:48.706 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding con mode: crc 2024-09-12T17:29:48.706 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding con mode: secure 2024-09-12T17:29:48.706 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T17:29:48.416+0000 7f76dc015800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:48.707 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T17:29:48.416+0000 7f76dc015800 1 librados: starting msgr at 2024-09-12T17:29:48.707 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T17:29:48.416+0000 7f76dc015800 1 librados: starting objecter 2024-09-12T17:29:48.707 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command objecter_requests hook 0x5578a8079de0 2024-09-12T17:29:48.707 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T17:29:48.417+0000 7f76dc015800 1 librados: setting wanted keys 2024-09-12T17:29:48.707 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T17:29:48.417+0000 7f76dc015800 1 librados: calling monclient init 2024-09-12T17:29:48.707 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T17:29:48.417+0000 7f76dc015800 10 monclient: init 2024-09-12T17:29:48.707 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding auth protocol: cephx 2024-09-12T17:29:48.707 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding auth protocol: cephx 2024-09-12T17:29:48.707 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding auth protocol: cephx 2024-09-12T17:29:48.707 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding con mode: secure 2024-09-12T17:29:48.707 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding con mode: crc 2024-09-12T17:29:48.707 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding con mode: secure 2024-09-12T17:29:48.707 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding con mode: crc 2024-09-12T17:29:48.708 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding con mode: secure 2024-09-12T17:29:48.708 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding con mode: crc 2024-09-12T17:29:48.708 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding con mode: crc 2024-09-12T17:29:48.708 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding con mode: secure 2024-09-12T17:29:48.708 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding con mode: crc 2024-09-12T17:29:48.708 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding con mode: secure 2024-09-12T17:29:48.708 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding con mode: crc 2024-09-12T17:29:48.708 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding con mode: secure 2024-09-12T17:29:48.708 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T17:29:48.417+0000 7f76dc015800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:48.708 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T17:29:48.417+0000 7f76dc015800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:48.708 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command rotate-key hook 0x5578a8074db8 2024-09-12T17:29:48.708 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T17:29:48.417+0000 7f76dc015800 10 monclient: _reopen_session rank -1 2024-09-12T17:29:48.708 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T17:29:48.417+0000 7f76dc015800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:29:48.709 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T17:29:48.417+0000 7f76dc015800 10 monclient(hunting): picked mon.noname-b con 0x5578a7f2aa90 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:29:48.709 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T17:29:48.417+0000 7f76dc015800 10 monclient(hunting): picked mon.noname-c con 0x5578a7f2e000 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:29:48.709 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T17:29:48.417+0000 7f76dc015800 10 monclient(hunting): picked mon.noname-a con 0x5578a7fbddf0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:29:48.709 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T17:29:48.417+0000 7f76dc015800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:48.709 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T17:29:48.417+0000 7f76dc015800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:48.709 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T17:29:48.417+0000 7f76dc015800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:48.709 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T17:29:48.417+0000 7f76dc015800 10 monclient(hunting): _renew_subs 2024-09-12T17:29:48.709 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T17:29:48.417+0000 7f76dc015800 10 monclient(hunting): authenticate will time out at 2599.767624s 2024-09-12T17:29:48.709 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T17:29:48.417+0000 7f76d7f93640 10 monclient(hunting): get_auth_request con 0x5578a7fbddf0 auth_method 0 2024-09-12T17:29:48.709 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T17:29:48.417+0000 7f76d7f93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:48.710 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T17:29:48.417+0000 7f76d7f93640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:48.710 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T17:29:48.417+0000 7f76d7f93640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:48.710 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T17:29:48.417+0000 7f76d6f91640 10 monclient(hunting): get_auth_request con 0x5578a7f2e000 auth_method 0 2024-09-12T17:29:48.710 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T17:29:48.417+0000 7f76d6f91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:48.710 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T17:29:48.417+0000 7f76d6f91640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:48.710 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T17:29:48.417+0000 7f76d6f91640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:48.710 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T17:29:48.417+0000 7f76d7f93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:48.710 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T17:29:48.417+0000 7f76d7f93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:48.710 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T17:29:48.417+0000 7f76d7f93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:48.710 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T17:29:48.417+0000 7f76d7792640 10 monclient(hunting): get_auth_request con 0x5578a7f2aa90 auth_method 0 2024-09-12T17:29:48.710 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T17:29:48.417+0000 7f76d7792640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:48.710 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T17:29:48.417+0000 7f76d7792640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:48.711 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T17:29:48.417+0000 7f76d7792640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:48.711 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T17:29:48.417+0000 7f76d6f91640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:48.711 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T17:29:48.417+0000 7f76d6f91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:48.711 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T17:29:48.417+0000 7f76d6f91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:48.711 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T17:29:48.417+0000 7f76d7792640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:48.711 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T17:29:48.417+0000 7f76d7792640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:48.711 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T17:29:48.417+0000 7f76d7792640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:48.711 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T17:29:48.418+0000 7f76d7f93640 10 monclient(hunting): handle_auth_done global_id 8394 payload 824 2024-09-12T17:29:48.711 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T17:29:48.418+0000 7f76d7f93640 10 monclient: _finish_hunting 0 2024-09-12T17:29:48.711 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T17:29:48.418+0000 7f76d7f93640 1 monclient: found mon.noname-a 2024-09-12T17:29:48.711 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T17:29:48.418+0000 7f76d7f93640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:29:48.711 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T17:29:48.418+0000 7f75c3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:48.711 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T17:29:48.418+0000 7f75c3e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:29:48.712 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T17:29:48.418+0000 7f75c3e07640 10 monclient: dump: 2024-09-12T17:29:48.712 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:48.712 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:48.712 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.712 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.712 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:48.712 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:48.712 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:48.712 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:48.712 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:48.712 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.712 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T17:29:48.418+0000 7f75c3e07640 10 monclient: _finish_auth 0 2024-09-12T17:29:48.713 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T17:29:48.418+0000 7f75c3e07640 10 monclient: _check_auth_tickets 2024-09-12T17:29:48.713 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T17:29:48.418+0000 7f76dc015800 5 monclient: authenticate success, global_id 8394 2024-09-12T17:29:48.713 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T17:29:48.418+0000 7f76dc015800 10 monclient: _renew_subs 2024-09-12T17:29:48.713 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T17:29:48.418+0000 7f76dc015800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:29:48.713 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T17:29:48.418+0000 7f75c3e07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:29:48.713 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T17:29:48.418+0000 7f75c3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:48.713 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T17:29:48.418+0000 7f75c3e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:29:48.713 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T17:29:48.418+0000 7f75c3e07640 10 monclient: dump: 2024-09-12T17:29:48.713 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:48.713 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:48.713 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.713 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.713 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:48.714 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:48.714 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:48.714 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:48.714 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:48.714 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.714 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T17:29:48.418+0000 7f75c560a640 4 set_mon_vals no callback set 2024-09-12T17:29:48.714 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T17:29:48.418+0000 7f76dc015800 10 monclient: _renew_subs 2024-09-12T17:29:48.714 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T17:29:48.418+0000 7f76dc015800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:29:48.714 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T17:29:48.418+0000 7f76dc015800 1 librados: init done 2024-09-12T17:29:48.714 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T17:29:48.420+0000 7f75c3e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:29:48.714 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T17:29:48.420+0000 7f75c3e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:29:48.714 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T17:29:48.420+0000 7f75c3e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:29:48.714 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T17:29:48.420+0000 7f76d7792640 10 monclient: get_auth_request con 0x7f75bc076470 auth_method 0 2024-09-12T17:29:48.715 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T17:29:48.421+0000 7f76d6f91640 10 monclient: get_auth_request con 0x5578a809d4f0 auth_method 0 2024-09-12T17:29:48.715 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T17:29:48.421+0000 7f76d7792640 10 monclient: get_auth_request con 0x5578a80bfee0 auth_method 0 2024-09-12T17:29:48.715 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T17:29:48.422+0000 7f76d6f91640 10 monclient: get_auth_request con 0x5578a80c4240 auth_method 0 2024-09-12T17:29:48.715 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T17:29:48.424+0000 7f76dc015800 10 monclient: build_initial_monmap 2024-09-12T17:29:48.715 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T17:29:48.424+0000 7f76dc015800 1 build_initial for_mkfs: 0 2024-09-12T17:29:48.715 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T17:29:48.424+0000 7f76dc015800 10 monclient: monmap: 2024-09-12T17:29:48.715 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:29:48.715 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:29:48.715 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:29:48.715 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:29:48.715 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:29:48.715 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:48.716 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:29:48.716 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:29:48.716 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:29:48.716 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.716 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding auth protocol: cephx 2024-09-12T17:29:48.716 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding auth protocol: cephx 2024-09-12T17:29:48.716 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding auth protocol: cephx 2024-09-12T17:29:48.716 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding con mode: secure 2024-09-12T17:29:48.716 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding con mode: crc 2024-09-12T17:29:48.716 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding con mode: secure 2024-09-12T17:29:48.716 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding con mode: crc 2024-09-12T17:29:48.716 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding con mode: secure 2024-09-12T17:29:48.716 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding con mode: crc 2024-09-12T17:29:48.717 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding con mode: crc 2024-09-12T17:29:48.717 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding con mode: secure 2024-09-12T17:29:48.717 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding con mode: crc 2024-09-12T17:29:48.717 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding con mode: secure 2024-09-12T17:29:48.717 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding con mode: crc 2024-09-12T17:29:48.717 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding con mode: secure 2024-09-12T17:29:48.717 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T17:29:48.424+0000 7f76dc015800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:48.717 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command objecter_requests cmddesc objecter_requests hook 0x5578a80ccaa0 EEXIST 2024-09-12T17:29:48.717 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T17:29:48.424+0000 7f76dc015800 10 monclient: init 2024-09-12T17:29:48.717 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding auth protocol: cephx 2024-09-12T17:29:48.717 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding auth protocol: cephx 2024-09-12T17:29:48.717 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding auth protocol: cephx 2024-09-12T17:29:48.717 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding con mode: secure 2024-09-12T17:29:48.718 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding con mode: crc 2024-09-12T17:29:48.718 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding con mode: secure 2024-09-12T17:29:48.718 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding con mode: crc 2024-09-12T17:29:48.718 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding con mode: secure 2024-09-12T17:29:48.718 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding con mode: crc 2024-09-12T17:29:48.718 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding con mode: crc 2024-09-12T17:29:48.718 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding con mode: secure 2024-09-12T17:29:48.718 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding con mode: crc 2024-09-12T17:29:48.718 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding con mode: secure 2024-09-12T17:29:48.718 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding con mode: crc 2024-09-12T17:29:48.718 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding con mode: secure 2024-09-12T17:29:48.718 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T17:29:48.424+0000 7f76dc015800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:48.718 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T17:29:48.425+0000 7f76dc015800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:48.719 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T17:29:48.425+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command rotate-key cmddesc rotate-key hook 0x5578a80c7850 EEXIST 2024-09-12T17:29:48.719 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T17:29:48.425+0000 7f76dc015800 10 monclient: _reopen_session rank -1 2024-09-12T17:29:48.719 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T17:29:48.425+0000 7f76dc015800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:29:48.719 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T17:29:48.425+0000 7f76dc015800 10 monclient(hunting): picked mon.noname-a con 0x5578a80f0790 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:29:48.719 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T17:29:48.425+0000 7f76dc015800 10 monclient(hunting): picked mon.noname-c con 0x5578a80f2a60 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:29:48.719 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T17:29:48.425+0000 7f76dc015800 10 monclient(hunting): picked mon.noname-b con 0x5578a80eef60 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:29:48.719 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T17:29:48.425+0000 7f76dc015800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:48.719 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T17:29:48.425+0000 7f76dc015800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:48.719 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T17:29:48.425+0000 7f76dc015800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:48.719 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T17:29:48.425+0000 7f76dc015800 10 monclient(hunting): _renew_subs 2024-09-12T17:29:48.719 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T17:29:48.425+0000 7f76dc015800 10 monclient(hunting): authenticate will time out at 2599.775279s 2024-09-12T17:29:48.719 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T17:29:48.425+0000 7f76d7792640 10 monclient(hunting): get_auth_request con 0x5578a80f0790 auth_method 0 2024-09-12T17:29:48.719 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T17:29:48.425+0000 7f76d7792640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:48.720 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T17:29:48.425+0000 7f76d7792640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:48.720 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T17:29:48.425+0000 7f76d7792640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:48.720 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T17:29:48.425+0000 7f76d6f91640 10 monclient(hunting): get_auth_request con 0x5578a80f2a60 auth_method 0 2024-09-12T17:29:48.720 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T17:29:48.425+0000 7f76d6f91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:48.720 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T17:29:48.425+0000 7f76d6f91640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:48.720 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T17:29:48.425+0000 7f76d6f91640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:48.720 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T17:29:48.425+0000 7f76d7f93640 10 monclient(hunting): get_auth_request con 0x5578a80eef60 auth_method 0 2024-09-12T17:29:48.720 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T17:29:48.425+0000 7f76d7f93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:48.720 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T17:29:48.425+0000 7f76d7f93640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:48.720 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T17:29:48.425+0000 7f76d7f93640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:48.720 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T17:29:48.425+0000 7f76d7792640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:48.720 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T17:29:48.425+0000 7f76d7792640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:48.720 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T17:29:48.425+0000 7f76d7792640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:48.721 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T17:29:48.425+0000 7f76d6f91640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:48.721 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T17:29:48.425+0000 7f76d6f91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:48.721 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T17:29:48.425+0000 7f76d6f91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:48.721 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T17:29:48.425+0000 7f76d7f93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:48.721 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T17:29:48.425+0000 7f76d7f93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:48.721 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T17:29:48.425+0000 7f76d7f93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:48.721 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T17:29:48.425+0000 7f76d7792640 10 monclient(hunting): handle_auth_done global_id 8397 payload 824 2024-09-12T17:29:48.721 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T17:29:48.425+0000 7f76d7792640 10 monclient: _finish_hunting 0 2024-09-12T17:29:48.721 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T17:29:48.425+0000 7f76d7792640 1 monclient: found mon.noname-a 2024-09-12T17:29:48.721 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T17:29:48.425+0000 7f76d7792640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:29:48.721 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T17:29:48.426+0000 7f75c1602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:48.721 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T17:29:48.426+0000 7f75c1602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:29:48.721 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T17:29:48.426+0000 7f75c1602640 10 monclient: dump: 2024-09-12T17:29:48.722 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:48.722 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:48.722 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.722 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.722 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:48.722 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:48.722 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:48.722 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:48.722 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:48.722 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.722 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T17:29:48.426+0000 7f75c1602640 10 monclient: _finish_auth 0 2024-09-12T17:29:48.722 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T17:29:48.426+0000 7f75c1602640 10 monclient: _check_auth_tickets 2024-09-12T17:29:48.722 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T17:29:48.426+0000 7f75c1602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:29:48.722 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T17:29:48.426+0000 7f75c1602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:48.723 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T17:29:48.426+0000 7f75c1602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:29:48.723 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T17:29:48.426+0000 7f75c1602640 10 monclient: dump: 2024-09-12T17:29:48.723 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:48.723 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:48.723 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.723 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.723 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:48.723 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:48.723 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:48.723 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:48.723 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:48.723 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.724 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T17:29:48.426+0000 7f76dc015800 5 monclient: authenticate success, global_id 8397 2024-09-12T17:29:48.724 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T17:29:48.426+0000 7f76dc015800 10 monclient: _renew_subs 2024-09-12T17:29:48.724 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T17:29:48.426+0000 7f76dc015800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:29:48.724 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T17:29:48.426+0000 7f76d8794640 4 set_mon_vals no callback set 2024-09-12T17:29:48.724 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T17:29:48.426+0000 7f76dc015800 10 monclient: _renew_subs 2024-09-12T17:29:48.724 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T17:29:48.426+0000 7f76dc015800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:29:48.724 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T17:29:48.428+0000 7f75c1602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:29:48.724 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T17:29:48.428+0000 7f75c1602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:29:48.724 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T17:29:48.428+0000 7f75c1602640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:29:48.724 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T17:29:48.428+0000 7f76d6f91640 10 monclient: get_auth_request con 0x7f75b0076380 auth_method 0 2024-09-12T17:29:48.724 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T17:29:48.428+0000 7f76dc015800 10 monclient: get_monmap_and_config 2024-09-12T17:29:48.724 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T17:29:48.428+0000 7f76dc015800 10 monclient: build_initial_monmap 2024-09-12T17:29:48.725 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T17:29:48.428+0000 7f76dc015800 1 build_initial for_mkfs: 0 2024-09-12T17:29:48.725 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T17:29:48.428+0000 7f76dc015800 10 monclient: monmap: 2024-09-12T17:29:48.725 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:29:48.725 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:29:48.725 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:29:48.725 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:29:48.725 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:29:48.725 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:48.725 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:29:48.725 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:29:48.725 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:29:48.725 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.725 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding auth protocol: cephx 2024-09-12T17:29:48.725 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding auth protocol: cephx 2024-09-12T17:29:48.726 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding auth protocol: cephx 2024-09-12T17:29:48.726 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding con mode: secure 2024-09-12T17:29:48.726 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding con mode: crc 2024-09-12T17:29:48.726 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding con mode: secure 2024-09-12T17:29:48.726 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding con mode: crc 2024-09-12T17:29:48.726 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding con mode: secure 2024-09-12T17:29:48.726 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding con mode: crc 2024-09-12T17:29:48.726 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding con mode: crc 2024-09-12T17:29:48.726 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding con mode: secure 2024-09-12T17:29:48.726 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding con mode: crc 2024-09-12T17:29:48.726 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding con mode: secure 2024-09-12T17:29:48.726 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding con mode: crc 2024-09-12T17:29:48.727 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding con mode: secure 2024-09-12T17:29:48.727 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T17:29:48.428+0000 7f76dc015800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:48.727 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T17:29:48.428+0000 7f76dc015800 10 monclient: init 2024-09-12T17:29:48.727 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding auth protocol: cephx 2024-09-12T17:29:48.727 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding auth protocol: cephx 2024-09-12T17:29:48.727 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding auth protocol: cephx 2024-09-12T17:29:48.727 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding con mode: secure 2024-09-12T17:29:48.727 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding con mode: crc 2024-09-12T17:29:48.727 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding con mode: secure 2024-09-12T17:29:48.727 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding con mode: crc 2024-09-12T17:29:48.727 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding con mode: secure 2024-09-12T17:29:48.727 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding con mode: crc 2024-09-12T17:29:48.727 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding con mode: crc 2024-09-12T17:29:48.727 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding con mode: secure 2024-09-12T17:29:48.728 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding con mode: crc 2024-09-12T17:29:48.728 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding con mode: secure 2024-09-12T17:29:48.728 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding con mode: crc 2024-09-12T17:29:48.728 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding con mode: secure 2024-09-12T17:29:48.728 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T17:29:48.429+0000 7f76dc015800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:48.728 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T17:29:48.429+0000 7f76dc015800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:48.728 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T17:29:48.429+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command rotate-key cmddesc rotate-key hook 0x7ffe55d22998 EEXIST 2024-09-12T17:29:48.728 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T17:29:48.429+0000 7f76dc015800 10 monclient: _reopen_session rank -1 2024-09-12T17:29:48.728 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T17:29:48.429+0000 7f76dc015800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:29:48.728 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T17:29:48.429+0000 7f76dc015800 10 monclient(hunting): picked mon.noname-c con 0x5578a8144c50 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:29:48.728 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T17:29:48.429+0000 7f76dc015800 10 monclient(hunting): picked mon.noname-a con 0x5578a8115ba0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:29:48.728 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T17:29:48.429+0000 7f76dc015800 10 monclient(hunting): picked mon.noname-b con 0x5578a81404f0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:29:48.728 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T17:29:48.429+0000 7f76dc015800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:48.729 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T17:29:48.429+0000 7f76dc015800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:48.729 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T17:29:48.429+0000 7f76dc015800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:48.729 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T17:29:48.429+0000 7f76dc015800 10 monclient(hunting): _renew_subs 2024-09-12T17:29:48.729 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T17:29:48.429+0000 7f76dc015800 10 monclient(hunting): authenticate will time out at 2599.779529s 2024-09-12T17:29:48.729 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T17:29:48.429+0000 7f76d6f91640 10 monclient(hunting): get_auth_request con 0x5578a8115ba0 auth_method 0 2024-09-12T17:29:48.729 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T17:29:48.429+0000 7f76d6f91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:48.729 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T17:29:48.429+0000 7f76d6f91640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:48.729 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T17:29:48.429+0000 7f76d6f91640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:48.729 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T17:29:48.429+0000 7f76d7792640 10 monclient(hunting): get_auth_request con 0x5578a8144c50 auth_method 0 2024-09-12T17:29:48.729 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T17:29:48.429+0000 7f76d7792640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:48.729 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T17:29:48.429+0000 7f76d7792640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:48.729 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T17:29:48.429+0000 7f76d7792640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:48.729 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T17:29:48.429+0000 7f76d6f91640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:48.730 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T17:29:48.429+0000 7f76d6f91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:48.730 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T17:29:48.429+0000 7f76d6f91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:48.730 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T17:29:48.429+0000 7f76d7792640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:48.730 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T17:29:48.429+0000 7f76d7792640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:48.730 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T17:29:48.429+0000 7f76d7792640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:48.730 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T17:29:48.429+0000 7f76d7f93640 10 monclient(hunting): get_auth_request con 0x5578a81404f0 auth_method 0 2024-09-12T17:29:48.730 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T17:29:48.429+0000 7f76d7f93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:48.730 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T17:29:48.429+0000 7f76d7f93640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:48.730 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T17:29:48.429+0000 7f76d7f93640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:48.730 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T17:29:48.429+0000 7f76d6f91640 10 monclient(hunting): handle_auth_done global_id 8400 payload 274 2024-09-12T17:29:48.730 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T17:29:48.429+0000 7f76d6f91640 10 monclient: _finish_hunting 0 2024-09-12T17:29:48.730 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T17:29:48.429+0000 7f76d6f91640 1 monclient: found mon.noname-a 2024-09-12T17:29:48.731 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T17:29:48.429+0000 7f76d6f91640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:29:48.731 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T17:29:48.430+0000 7f75baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:48.731 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T17:29:48.430+0000 7f75baffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:29:48.731 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T17:29:48.430+0000 7f75baffd640 10 monclient: dump: 2024-09-12T17:29:48.731 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:48.731 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:48.731 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.731 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.731 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:48.731 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:48.731 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:48.732 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:48.732 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:48.732 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.732 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T17:29:48.430+0000 7f75baffd640 10 monclient: _finish_auth 0 2024-09-12T17:29:48.732 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T17:29:48.430+0000 7f75baffd640 10 monclient: _check_auth_tickets 2024-09-12T17:29:48.732 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T17:29:48.430+0000 7f75baffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:29:48.732 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 monclient: authenticate success, global_id 8400 2024-09-12T17:29:48.732 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T17:29:48.430+0000 7f76dc015800 10 monclient: get_monmap_and_config success 2024-09-12T17:29:48.732 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T17:29:48.430+0000 7f76dc015800 4 set_mon_vals no callback set 2024-09-12T17:29:48.732 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T17:29:48.430+0000 7f75baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:48.732 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T17:29:48.430+0000 7f75baffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:29:48.732 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T17:29:48.430+0000 7f75baffd640 10 monclient: dump: 2024-09-12T17:29:48.732 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:48.733 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:48.733 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.733 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.733 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:48.733 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:48.733 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:48.733 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:48.733 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:48.733 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.733 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T17:29:48.430+0000 7f76dc015800 10 monclient: shutdown 2024-09-12T17:29:48.733 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T17:29:48.430+0000 7f76dc015800 10 monclient: build_initial_monmap 2024-09-12T17:29:48.733 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T17:29:48.430+0000 7f76dc015800 1 build_initial for_mkfs: 0 2024-09-12T17:29:48.733 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T17:29:48.430+0000 7f76dc015800 10 monclient: monmap: 2024-09-12T17:29:48.734 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:29:48.734 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:29:48.734 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:29:48.734 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:29:48.734 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:29:48.734 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:48.734 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:29:48.734 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:29:48.734 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:29:48.734 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.734 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding auth protocol: cephx 2024-09-12T17:29:48.734 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding auth protocol: cephx 2024-09-12T17:29:48.734 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding auth protocol: cephx 2024-09-12T17:29:48.734 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding con mode: secure 2024-09-12T17:29:48.735 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding con mode: crc 2024-09-12T17:29:48.735 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding con mode: secure 2024-09-12T17:29:48.735 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding con mode: crc 2024-09-12T17:29:48.735 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding con mode: secure 2024-09-12T17:29:48.735 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding con mode: crc 2024-09-12T17:29:48.735 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding con mode: crc 2024-09-12T17:29:48.735 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding con mode: secure 2024-09-12T17:29:48.735 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding con mode: crc 2024-09-12T17:29:48.735 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding con mode: secure 2024-09-12T17:29:48.735 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding con mode: crc 2024-09-12T17:29:48.735 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding con mode: secure 2024-09-12T17:29:48.735 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T17:29:48.431+0000 7f76dc015800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:48.735 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T17:29:48.431+0000 7f76dc015800 1 librados: starting msgr at 2024-09-12T17:29:48.736 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T17:29:48.431+0000 7f76dc015800 1 librados: starting objecter 2024-09-12T17:29:48.736 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command objecter_requests cmddesc objecter_requests hook 0x5578a8114930 EEXIST 2024-09-12T17:29:48.736 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T17:29:48.431+0000 7f76dc015800 1 librados: setting wanted keys 2024-09-12T17:29:48.736 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T17:29:48.431+0000 7f76dc015800 1 librados: calling monclient init 2024-09-12T17:29:48.736 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T17:29:48.431+0000 7f76dc015800 10 monclient: init 2024-09-12T17:29:48.736 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding auth protocol: cephx 2024-09-12T17:29:48.736 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding auth protocol: cephx 2024-09-12T17:29:48.736 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding auth protocol: cephx 2024-09-12T17:29:48.736 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding con mode: secure 2024-09-12T17:29:48.736 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding con mode: crc 2024-09-12T17:29:48.736 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding con mode: secure 2024-09-12T17:29:48.736 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding con mode: crc 2024-09-12T17:29:48.736 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding con mode: secure 2024-09-12T17:29:48.737 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding con mode: crc 2024-09-12T17:29:48.737 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding con mode: crc 2024-09-12T17:29:48.737 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding con mode: secure 2024-09-12T17:29:48.737 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding con mode: crc 2024-09-12T17:29:48.737 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding con mode: secure 2024-09-12T17:29:48.737 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding con mode: crc 2024-09-12T17:29:48.737 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding con mode: secure 2024-09-12T17:29:48.737 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T17:29:48.431+0000 7f76dc015800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:48.737 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T17:29:48.431+0000 7f76dc015800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:48.737 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command rotate-key cmddesc rotate-key hook 0x5578a8108688 EEXIST 2024-09-12T17:29:48.737 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T17:29:48.431+0000 7f76dc015800 10 monclient: _reopen_session rank -1 2024-09-12T17:29:48.737 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T17:29:48.431+0000 7f76dc015800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:29:48.737 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T17:29:48.431+0000 7f76dc015800 10 monclient(hunting): picked mon.noname-b con 0x5578a8115ba0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:29:48.738 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T17:29:48.431+0000 7f76dc015800 10 monclient(hunting): picked mon.noname-a con 0x5578a81404f0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:29:48.738 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T17:29:48.431+0000 7f76dc015800 10 monclient(hunting): picked mon.noname-c con 0x5578a8144c50 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:29:48.738 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T17:29:48.431+0000 7f76dc015800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:48.738 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T17:29:48.431+0000 7f76dc015800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:48.738 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T17:29:48.431+0000 7f76dc015800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:48.738 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T17:29:48.431+0000 7f76dc015800 10 monclient(hunting): _renew_subs 2024-09-12T17:29:48.738 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T17:29:48.431+0000 7f76dc015800 10 monclient(hunting): authenticate will time out at 2599.781900s 2024-09-12T17:29:48.738 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T17:29:48.431+0000 7f76d6f91640 10 monclient(hunting): get_auth_request con 0x5578a81404f0 auth_method 0 2024-09-12T17:29:48.738 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T17:29:48.432+0000 7f76d6f91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:48.738 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T17:29:48.432+0000 7f76d6f91640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:48.738 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T17:29:48.432+0000 7f76d6f91640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:48.739 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T17:29:48.432+0000 7f76d7f93640 10 monclient(hunting): get_auth_request con 0x5578a8144c50 auth_method 0 2024-09-12T17:29:48.739 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T17:29:48.432+0000 7f76d7f93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:48.739 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T17:29:48.432+0000 7f76d7f93640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:48.739 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T17:29:48.432+0000 7f76d7f93640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:48.739 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T17:29:48.432+0000 7f76d6f91640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:48.739 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T17:29:48.432+0000 7f76d6f91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:48.739 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T17:29:48.432+0000 7f76d6f91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:48.739 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T17:29:48.432+0000 7f76d7792640 10 monclient(hunting): get_auth_request con 0x5578a8115ba0 auth_method 0 2024-09-12T17:29:48.739 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T17:29:48.432+0000 7f76d7792640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:48.740 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T17:29:48.432+0000 7f76d7792640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:48.740 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T17:29:48.432+0000 7f76d7792640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:48.740 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T17:29:48.432+0000 7f76d7f93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:48.740 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T17:29:48.432+0000 7f76d7f93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:48.740 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T17:29:48.432+0000 7f76d7f93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:48.740 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T17:29:48.432+0000 7f76d7792640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:48.740 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T17:29:48.432+0000 7f76d7792640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:48.740 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T17:29:48.432+0000 7f76d7792640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:48.740 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T17:29:48.432+0000 7f76d6f91640 10 monclient(hunting): handle_auth_done global_id 8403 payload 824 2024-09-12T17:29:48.740 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T17:29:48.432+0000 7f76d6f91640 10 monclient: _finish_hunting 0 2024-09-12T17:29:48.741 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T17:29:48.432+0000 7f76d6f91640 1 monclient: found mon.noname-a 2024-09-12T17:29:48.741 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T17:29:48.432+0000 7f76d6f91640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:29:48.741 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T17:29:48.432+0000 7f75b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:48.741 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T17:29:48.432+0000 7f75b97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:29:48.741 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T17:29:48.432+0000 7f75b97fa640 10 monclient: dump: 2024-09-12T17:29:48.741 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:48.741 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:48.741 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.741 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.741 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:48.741 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:48.741 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:48.741 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:48.742 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:48.742 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.742 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T17:29:48.432+0000 7f75b97fa640 10 monclient: _finish_auth 0 2024-09-12T17:29:48.742 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T17:29:48.432+0000 7f75b97fa640 10 monclient: _check_auth_tickets 2024-09-12T17:29:48.742 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T17:29:48.432+0000 7f75b97fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:29:48.742 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T17:29:48.432+0000 7f75b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:48.742 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T17:29:48.432+0000 7f75b97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:29:48.742 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T17:29:48.432+0000 7f75b97fa640 10 monclient: dump: 2024-09-12T17:29:48.742 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:48.742 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:48.742 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.742 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.743 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:48.743 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:48.743 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:48.743 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:48.743 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:48.743 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.743 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T17:29:48.432+0000 7f76dc015800 5 monclient: authenticate success, global_id 8403 2024-09-12T17:29:48.743 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T17:29:48.432+0000 7f76dc015800 10 monclient: _renew_subs 2024-09-12T17:29:48.743 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T17:29:48.432+0000 7f76dc015800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:29:48.743 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T17:29:48.432+0000 7f75baffd640 4 set_mon_vals no callback set 2024-09-12T17:29:48.743 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T17:29:48.432+0000 7f76dc015800 10 monclient: _renew_subs 2024-09-12T17:29:48.743 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T17:29:48.432+0000 7f76dc015800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:29:48.743 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T17:29:48.432+0000 7f76dc015800 1 librados: init done 2024-09-12T17:29:48.743 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T17:29:48.432+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command cr dump hook 0x5578a813b7d8 2024-09-12T17:29:48.744 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T17:29:48.434+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.744 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T17:29:48.434+0000 7f75b97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:29:48.744 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T17:29:48.434+0000 7f75b97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:29:48.744 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T17:29:48.434+0000 7f75b97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:29:48.744 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T17:29:48.435+0000 7f76d7792640 10 monclient: get_auth_request con 0x7f75a0076470 auth_method 0 2024-09-12T17:29:48.744 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T17:29:48.435+0000 7f76d7f93640 10 monclient: get_auth_request con 0x5578a815f070 auth_method 0 2024-09-12T17:29:48.744 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T17:29:48.435+0000 7f76dc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.744 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T17:29:48.435+0000 7f76dc015800 20 realm 2024-09-12T17:29:48.744 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T17:29:48.435+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.744 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T17:29:48.436+0000 7f76dc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.744 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T17:29:48.436+0000 7f76dc015800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:48.744 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T17:29:48.436+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.745 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T17:29:48.436+0000 7f76dc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.745 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T17:29:48.436+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.745 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T17:29:48.436+0000 7f76d7792640 10 monclient: get_auth_request con 0x5578a81633a0 auth_method 0 2024-09-12T17:29:48.745 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T17:29:48.437+0000 7f76dc015800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:48.745 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T17:29:48.437+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.745 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T17:29:48.437+0000 7f76d6f91640 10 monclient: get_auth_request con 0x5578a8166ac0 auth_method 0 2024-09-12T17:29:48.745 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T17:29:48.437+0000 7f76dc015800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:29:48.745 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T17:29:48.438+0000 7f76dc015800 20 searching for the correct realm 2024-09-12T17:29:48.745 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T17:29:48.438+0000 7f76d7f93640 10 monclient: get_auth_request con 0x5578a816b840 auth_method 0 2024-09-12T17:29:48.745 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T17:29:48.438+0000 7f76d7792640 10 monclient: get_auth_request con 0x7f76d0061070 auth_method 0 2024-09-12T17:29:48.745 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T17:29:48.439+0000 7f76d6f91640 10 monclient: get_auth_request con 0x7f76c8040060 auth_method 0 2024-09-12T17:29:48.745 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T17:29:48.440+0000 7f76d7792640 0 -- 172.21.15.67:0/4098300234 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f76d0061070 msgr2=0x7f76d00a3b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:29:48.745 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T17:29:48.440+0000 7f75b97fa640 1 client.8403.objecter ms_handle_reset 0x7f76d0061070 session 0x7f76d00a4980 osd.7 2024-09-12T17:29:48.746 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T17:29:48.440+0000 7f75b97fa640 10 monclient: _renew_subs 2024-09-12T17:29:48.746 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T17:29:48.440+0000 7f75b97fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:29:48.746 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T17:29:48.440+0000 7f76d7792640 10 monclient: get_auth_request con 0x7f75a0086310 auth_method 0 2024-09-12T17:29:48.746 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T17:29:48.441+0000 7f76d7f93640 10 monclient: get_auth_request con 0x7f76cc04c060 auth_method 0 2024-09-12T17:29:48.746 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T17:29:48.443+0000 7f76d7792640 10 monclient: get_auth_request con 0x7f76cc02c400 auth_method 0 2024-09-12T17:29:48.746 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T17:29:48.444+0000 7f76d7792640 0 -- 172.21.15.67:0/4098300234 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f76cc02c400 msgr2=0x7f76cc02c880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:29:48.746 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T17:29:48.645+0000 7f76d7792640 10 monclient: get_auth_request con 0x7f76cc02c400 auth_method 0 2024-09-12T17:29:48.746 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T17:29:48.651+0000 7f76dc015800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:29:48.746 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T17:29:48.651+0000 7f76dc015800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:29:48.746 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T17:29:48.651+0000 7f76dc015800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:48.746 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T17:29:48.651+0000 7f76dc015800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:48.746 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T17:29:48.651+0000 7f76dc015800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:48.747 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T17:29:48.651+0000 7f76dc015800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:48.747 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T17:29:48.651+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.747 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T17:29:48.651+0000 7f76dc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.747 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T17:29:48.651+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.747 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T17:29:48.652+0000 7f76dc015800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:48.747 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T17:29:48.652+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.747 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T17:29:48.652+0000 7f76dc015800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:29:48.747 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T17:29:48.652+0000 7f76dc015800 20 zone default found 2024-09-12T17:29:48.747 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T17:29:48.652+0000 7f76dc015800 4 Realm: () 2024-09-12T17:29:48.747 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T17:29:48.652+0000 7f76dc015800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:29:48.747 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T17:29:48.652+0000 7f76dc015800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:29:48.747 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T17:29:48.652+0000 7f76dc015800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:48.747 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T17:29:48.652+0000 7f76dc015800 20 zonegroup default 2024-09-12T17:29:48.748 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T17:29:48.652+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.748 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T17:29:48.652+0000 7f76dc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.748 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T17:29:48.652+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.748 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T17:29:48.653+0000 7f76dc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.748 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T17:29:48.653+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.748 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T17:29:48.653+0000 7f76dc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.748 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T17:29:48.653+0000 7f76dc015800 20 started sync module instance, tier type = 2024-09-12T17:29:48.748 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T17:29:48.653+0000 7f76dc015800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:29:48.748 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T17:29:48.663+0000 7f76dc015800 20 add_watcher() i=0 2024-09-12T17:29:48.748 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T17:29:48.663+0000 7f76dc015800 20 add_watcher() i=1 2024-09-12T17:29:48.748 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T17:29:48.663+0000 7f76dc015800 20 add_watcher() i=2 2024-09-12T17:29:48.748 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T17:29:48.663+0000 7f76dc015800 20 add_watcher() i=3 2024-09-12T17:29:48.748 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T17:29:48.663+0000 7f76dc015800 20 add_watcher() i=4 2024-09-12T17:29:48.749 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T17:29:48.663+0000 7f76dc015800 20 add_watcher() i=5 2024-09-12T17:29:48.749 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T17:29:48.663+0000 7f76dc015800 20 add_watcher() i=6 2024-09-12T17:29:48.749 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T17:29:48.664+0000 7f76dc015800 20 add_watcher() i=7 2024-09-12T17:29:48.749 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T17:29:48.664+0000 7f76dc015800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:48.749 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding auth protocol: cephx 2024-09-12T17:29:48.749 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding auth protocol: cephx 2024-09-12T17:29:48.749 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding auth protocol: cephx 2024-09-12T17:29:48.749 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding con mode: secure 2024-09-12T17:29:48.749 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding con mode: crc 2024-09-12T17:29:48.749 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding con mode: secure 2024-09-12T17:29:48.749 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding con mode: crc 2024-09-12T17:29:48.749 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding con mode: secure 2024-09-12T17:29:48.750 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding con mode: crc 2024-09-12T17:29:48.750 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding con mode: crc 2024-09-12T17:29:48.750 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding con mode: secure 2024-09-12T17:29:48.750 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding con mode: crc 2024-09-12T17:29:48.750 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding con mode: secure 2024-09-12T17:29:48.750 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding con mode: crc 2024-09-12T17:29:48.750 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding con mode: secure 2024-09-12T17:29:48.750 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T17:29:48.665+0000 7f758dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:48.750 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T17:29:48.666+0000 7f76dc015800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:48.750 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T17:29:48.666+0000 7f76dc015800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:48.750 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T17:29:48.666+0000 7f76dc015800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:48.750 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T17:29:48.666+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command cache list hook 0x5578a8132090 2024-09-12T17:29:48.750 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T17:29:48.666+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command cache inspect hook 0x5578a8132090 2024-09-12T17:29:48.750 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T17:29:48.666+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command cache erase hook 0x5578a8132090 2024-09-12T17:29:48.751 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T17:29:48.666+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command cache zap hook 0x5578a8132090 2024-09-12T17:29:48.751 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T17:29:48.666+0000 7f76dc015800 5 note: GC not initialized 2024-09-12T17:29:48.751 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T17:29:48.666+0000 7f758cfe1640 20 reqs_thread_entry: start 2024-09-12T17:29:48.751 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T17:29:48.666+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command sync trace show hook 0x7f76cc001200 2024-09-12T17:29:48.751 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T17:29:48.666+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command sync trace history hook 0x7f76cc001200 2024-09-12T17:29:48.751 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T17:29:48.666+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command sync trace active hook 0x7f76cc001200 2024-09-12T17:29:48.751 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T17:29:48.666+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command sync trace active_short hook 0x7f76cc001200 2024-09-12T17:29:48.751 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T17:29:48.666+0000 7f76dc015800 20 init_complete bucket index max shards: 1 2024-09-12T17:29:48.751 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T17:29:48.666+0000 7f76dc015800 20 Filter name: none 2024-09-12T17:29:48.751 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T17:29:48.666+0000 7f75067fc640 20 reqs_thread_entry: start 2024-09-12T17:29:48.751 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T17:29:48.667+0000 7f76dc015800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:29:48.751 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T17:29:48.667+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.751 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T17:29:48.667+0000 7f76dc015800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:29:48.752 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T17:29:48.667+0000 7f76dc015800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:29:48.752 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T17:29:48.667+0000 7f76dc015800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:29:48.752 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T17:29:48.667+0000 7f76dc015800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : miss 2024-09-12T17:29:48.752 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T17:29:48.667+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.752 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T17:29:48.667+0000 7f76dc015800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:29:48.752 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T17:29:48.667+0000 7f76dc015800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:29:48.752 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T17:29:48.667+0000 7f76dc015800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:29:48.752 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T17:29:48.667+0000 7f76dc015800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:48.752 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T17:29:48.667+0000 7f76dc015800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:29:48.752 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T17:29:48.668+0000 7f76dc015800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:29:48.752 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T17:29:48.669+0000 7f76dc015800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:29:48.752 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T17:29:48.673+0000 7f76dc015800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:29:48.753 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T17:29:48.673+0000 7f76dc015800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:29:48.753 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T17:29:48.673+0000 7f76dc015800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:29:48.753 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T17:29:48.673+0000 7f76dc015800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18, ofs0, ns] 2024-09-12T17:29:48.753 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T17:29:48.673+0000 7f75baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464371 cookie 93976704515648 notifier 8403 bl.length()=911 2024-09-12T17:29:48.753 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T17:29:48.673+0000 7f75baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:29:48.753 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T17:29:48.673+0000 7f75baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:29:48.753 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T17:29:48.673+0000 7f75baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:29:48.753 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T17:29:48.675+0000 7f76dc015800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_sources= new_sources= 2024-09-12T17:29:48.753 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T17:29:48.675+0000 7f76dc015800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:29:48.753 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T17:29:48.675+0000 7f76dc015800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_dests= new_dests= 2024-09-12T17:29:48.753 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T17:29:48.675+0000 7f76dc015800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:29:48.753 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T17:29:48.678+0000 7f76dc015800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f76dc015800 time 2024-09-12T17:29:48.678685+0000 2024-09-12T17:29:48.753 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:29:48.754 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.754 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:29:48.754 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f76dd18c71a] 2024-09-12T17:29:48.754 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f76dd18c8d8] 2024-09-12T17:29:48.754 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5578a5b03841] 2024-09-12T17:29:48.754 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5578a5b1357a] 2024-09-12T17:29:48.754 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T17:29:48.754 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f76dbe29590] 2024-09-12T17:29:48.754 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T17:29:48.754 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T17:29:48.754 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.754 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T17:29:48.679+0000 7f76dc015800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:29:48.754 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f76dc015800 thread_name:radosgw-admin 2024-09-12T17:29:48.755 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.755 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:29:48.755 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f76dbe3e6f0] 2024-09-12T17:29:48.755 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f76dbe8b99c] 2024-09-12T17:29:48.755 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:29:48.755 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:29:48.755 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f76dd18c774] 2024-09-12T17:29:48.755 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f76dd18c8d8] 2024-09-12T17:29:48.755 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5578a5b03841] 2024-09-12T17:29:48.755 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5578a5b1357a] 2024-09-12T17:29:48.755 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T17:29:48.755 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f76dbe29590] 2024-09-12T17:29:48.755 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T17:29:48.756 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T17:29:48.756 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:29:48.756 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.756 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T17:29:48.756 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T17:29:48.756 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T17:29:48.756 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T17:29:48.756 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T17:29:48.756 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T17:29:48.756 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T17:29:48.756 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T17:29:48.756 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T17:29:48.757 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T17:29:48.757 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T17:29:48.757 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T17:29:48.757 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T17:29:48.757 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T17:29:48.757 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T17:29:48.757 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T17:29:48.757 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T17:29:48.757 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T17:29:48.757 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T17:29:48.757 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T17:29:48.757 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T17:29:48.757 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T17:29:48.758 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T17:29:48.758 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T17:29:48.758 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:29:48.758 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T17:29:48.758 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T17:29:48.758 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T17:29:48.758 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T17:29:48.758 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T17:29:48.758 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T17:29:48.758 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T17:29:48.758 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T17:29:48.758 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T17:29:48.758 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T17:29:48.758 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T17:29:48.759 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T17:29:48.759 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T17:29:48.759 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T17:29:48.759 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T17:29:48.759 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T17:29:48.759 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T17:29:48.759 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T17:29:48.759 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T17:29:48.759 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T17:29:48.759 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T17:29:48.759 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:29:48.759 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T17:29:48.759 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:29:48.760 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T17:29:48.760 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T17:29:48.760 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T17:29:48.760 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T17:29:48.760 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T17:29:48.760 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T17:29:48.760 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T17:29:48.760 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T17:29:48.760 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T17:29:48.760 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T17:29:48.760 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T17:29:48.760 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T17:29:48.760 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T17:29:48.760 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T17:29:48.761 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T17:29:48.761 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T17:29:48.761 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T17:29:48.761 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T17:29:48.761 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:29:48.761 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T17:29:48.761 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:29:48.761 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T17:29:48.761 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T17:29:48.761 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T17:29:48.761 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T17:29:48.761 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T17:29:48.761 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T17:29:48.762 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:29:48.762 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T17:29:48.762 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T17:29:48.762 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:29:48.762 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T17:29:48.762 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T17:29:48.762 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T17:29:48.762 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T17:29:48.762 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T17:29:48.762 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T17:29:48.762 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T17:29:48.762 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T17:29:48.763 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T17:29:48.763 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T17:29:48.763 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T17:29:48.763 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T17:29:48.763 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T17:29:48.763 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:29:48.763 INFO:tasks.workunit.client.0.smithi067.stderr: 7f75067fc640 / http_manager 2024-09-12T17:29:48.763 INFO:tasks.workunit.client.0.smithi067.stderr: 7f758cfe1640 / http_manager 2024-09-12T17:29:48.763 INFO:tasks.workunit.client.0.smithi067.stderr: 7f758dfe3640 / rgw_dt_lg_renew 2024-09-12T17:29:48.763 INFO:tasks.workunit.client.0.smithi067.stderr: 7f75b97fa640 / ms_dispatch 2024-09-12T17:29:48.763 INFO:tasks.workunit.client.0.smithi067.stderr: 7f75baffd640 / io_context_pool 2024-09-12T17:29:48.763 INFO:tasks.workunit.client.0.smithi067.stderr: 7f75c1602640 / ms_dispatch 2024-09-12T17:29:48.763 INFO:tasks.workunit.client.0.smithi067.stderr: 7f75c3e07640 / ms_dispatch 2024-09-12T17:29:48.764 INFO:tasks.workunit.client.0.smithi067.stderr: 7f75c560a640 / io_context_pool 2024-09-12T17:29:48.764 INFO:tasks.workunit.client.0.smithi067.stderr: 7f76d6f91640 / msgr-worker-2 2024-09-12T17:29:48.764 INFO:tasks.workunit.client.0.smithi067.stderr: 7f76d7792640 / msgr-worker-1 2024-09-12T17:29:48.764 INFO:tasks.workunit.client.0.smithi067.stderr: 7f76d7f93640 / msgr-worker-0 2024-09-12T17:29:48.764 INFO:tasks.workunit.client.0.smithi067.stderr: 7f76d8794640 / io_context_pool 2024-09-12T17:29:48.764 INFO:tasks.workunit.client.0.smithi067.stderr: 7f76dc015800 / radosgw-admin 2024-09-12T17:29:48.764 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T17:29:48.764 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T17:29:48.764 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/log/ceph/ceph-client.admin.155746.log 2024-09-12T17:29:48.764 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T17:29:48.764 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T17:29:48.764 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T17:29:48.416+0000 7f76dc015800 10 monclient: build_initial_monmap 2024-09-12T17:29:48.764 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T17:29:48.416+0000 7f76dc015800 1 build_initial for_mkfs: 0 2024-09-12T17:29:48.765 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T17:29:48.416+0000 7f76dc015800 10 monclient: monmap: 2024-09-12T17:29:48.765 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:29:48.765 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:29:48.765 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:29:48.765 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:29:48.765 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:29:48.765 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:48.765 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:29:48.765 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:29:48.765 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:29:48.765 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.765 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding auth protocol: cephx 2024-09-12T17:29:48.766 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding auth protocol: cephx 2024-09-12T17:29:48.766 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding auth protocol: cephx 2024-09-12T17:29:48.766 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding con mode: secure 2024-09-12T17:29:48.766 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding con mode: crc 2024-09-12T17:29:48.766 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding con mode: secure 2024-09-12T17:29:48.766 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding con mode: crc 2024-09-12T17:29:48.766 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding con mode: secure 2024-09-12T17:29:48.766 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding con mode: crc 2024-09-12T17:29:48.766 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding con mode: crc 2024-09-12T17:29:48.766 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding con mode: secure 2024-09-12T17:29:48.766 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding con mode: crc 2024-09-12T17:29:48.766 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding con mode: secure 2024-09-12T17:29:48.766 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding con mode: crc 2024-09-12T17:29:48.767 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 AuthRegistry(0x5578a807a370) adding con mode: secure 2024-09-12T17:29:48.767 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T17:29:48.416+0000 7f76dc015800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:48.767 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T17:29:48.416+0000 7f76dc015800 1 librados: starting msgr at 2024-09-12T17:29:48.767 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T17:29:48.416+0000 7f76dc015800 1 librados: starting objecter 2024-09-12T17:29:48.767 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T17:29:48.416+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command objecter_requests hook 0x5578a8079de0 2024-09-12T17:29:48.767 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T17:29:48.417+0000 7f76dc015800 1 librados: setting wanted keys 2024-09-12T17:29:48.767 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T17:29:48.417+0000 7f76dc015800 1 librados: calling monclient init 2024-09-12T17:29:48.767 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T17:29:48.417+0000 7f76dc015800 10 monclient: init 2024-09-12T17:29:48.767 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding auth protocol: cephx 2024-09-12T17:29:48.767 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding auth protocol: cephx 2024-09-12T17:29:48.767 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding auth protocol: cephx 2024-09-12T17:29:48.767 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding con mode: secure 2024-09-12T17:29:48.768 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding con mode: crc 2024-09-12T17:29:48.768 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding con mode: secure 2024-09-12T17:29:48.768 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding con mode: crc 2024-09-12T17:29:48.768 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding con mode: secure 2024-09-12T17:29:48.768 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding con mode: crc 2024-09-12T17:29:48.768 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding con mode: crc 2024-09-12T17:29:48.768 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding con mode: secure 2024-09-12T17:29:48.768 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding con mode: crc 2024-09-12T17:29:48.768 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding con mode: secure 2024-09-12T17:29:48.768 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding con mode: crc 2024-09-12T17:29:48.768 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 AuthRegistry(0x5578a8074c70) adding con mode: secure 2024-09-12T17:29:48.769 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T17:29:48.417+0000 7f76dc015800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:48.769 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T17:29:48.417+0000 7f76dc015800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:48.769 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T17:29:48.417+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command rotate-key hook 0x5578a8074db8 2024-09-12T17:29:48.769 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T17:29:48.417+0000 7f76dc015800 10 monclient: _reopen_session rank -1 2024-09-12T17:29:48.769 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T17:29:48.417+0000 7f76dc015800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:29:48.769 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T17:29:48.417+0000 7f76dc015800 10 monclient(hunting): picked mon.noname-b con 0x5578a7f2aa90 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:29:48.769 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T17:29:48.417+0000 7f76dc015800 10 monclient(hunting): picked mon.noname-c con 0x5578a7f2e000 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:29:48.769 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T17:29:48.417+0000 7f76dc015800 10 monclient(hunting): picked mon.noname-a con 0x5578a7fbddf0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:29:48.769 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T17:29:48.417+0000 7f76dc015800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:48.769 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T17:29:48.417+0000 7f76dc015800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:48.769 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T17:29:48.417+0000 7f76dc015800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:48.769 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T17:29:48.417+0000 7f76dc015800 10 monclient(hunting): _renew_subs 2024-09-12T17:29:48.769 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T17:29:48.417+0000 7f76dc015800 10 monclient(hunting): authenticate will time out at 2599.767624s 2024-09-12T17:29:48.770 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T17:29:48.417+0000 7f76d7f93640 10 monclient(hunting): get_auth_request con 0x5578a7fbddf0 auth_method 0 2024-09-12T17:29:48.770 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T17:29:48.417+0000 7f76d7f93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:48.770 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T17:29:48.417+0000 7f76d7f93640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:48.770 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T17:29:48.417+0000 7f76d7f93640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:48.770 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T17:29:48.417+0000 7f76d6f91640 10 monclient(hunting): get_auth_request con 0x5578a7f2e000 auth_method 0 2024-09-12T17:29:48.770 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T17:29:48.417+0000 7f76d6f91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:48.770 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T17:29:48.417+0000 7f76d6f91640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:48.770 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T17:29:48.417+0000 7f76d6f91640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:48.770 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T17:29:48.417+0000 7f76d7f93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:48.770 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T17:29:48.417+0000 7f76d7f93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:48.770 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T17:29:48.417+0000 7f76d7f93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:48.770 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T17:29:48.417+0000 7f76d7792640 10 monclient(hunting): get_auth_request con 0x5578a7f2aa90 auth_method 0 2024-09-12T17:29:48.771 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T17:29:48.417+0000 7f76d7792640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:48.771 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T17:29:48.417+0000 7f76d7792640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:48.771 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T17:29:48.417+0000 7f76d7792640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:48.771 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T17:29:48.417+0000 7f76d6f91640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:48.771 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T17:29:48.417+0000 7f76d6f91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:48.771 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T17:29:48.417+0000 7f76d6f91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:48.771 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T17:29:48.417+0000 7f76d7792640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:48.771 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T17:29:48.417+0000 7f76d7792640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:48.771 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T17:29:48.417+0000 7f76d7792640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:48.771 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T17:29:48.418+0000 7f76d7f93640 10 monclient(hunting): handle_auth_done global_id 8394 payload 824 2024-09-12T17:29:48.771 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T17:29:48.418+0000 7f76d7f93640 10 monclient: _finish_hunting 0 2024-09-12T17:29:48.771 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T17:29:48.418+0000 7f76d7f93640 1 monclient: found mon.noname-a 2024-09-12T17:29:48.771 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T17:29:48.418+0000 7f76d7f93640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:29:48.772 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T17:29:48.418+0000 7f75c3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:48.772 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T17:29:48.418+0000 7f75c3e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:29:48.772 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T17:29:48.418+0000 7f75c3e07640 10 monclient: dump: 2024-09-12T17:29:48.772 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:48.772 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:48.772 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.772 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.772 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:48.772 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:48.772 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:48.772 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:48.772 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:48.772 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.773 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T17:29:48.418+0000 7f75c3e07640 10 monclient: _finish_auth 0 2024-09-12T17:29:48.773 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T17:29:48.418+0000 7f75c3e07640 10 monclient: _check_auth_tickets 2024-09-12T17:29:48.773 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T17:29:48.418+0000 7f76dc015800 5 monclient: authenticate success, global_id 8394 2024-09-12T17:29:48.773 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T17:29:48.418+0000 7f76dc015800 10 monclient: _renew_subs 2024-09-12T17:29:48.773 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T17:29:48.418+0000 7f76dc015800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:29:48.773 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T17:29:48.418+0000 7f75c3e07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:29:48.773 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T17:29:48.418+0000 7f75c3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:48.773 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T17:29:48.418+0000 7f75c3e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:29:48.773 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T17:29:48.418+0000 7f75c3e07640 10 monclient: dump: 2024-09-12T17:29:48.773 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:48.773 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:48.773 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.774 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.774 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:48.774 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:48.774 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:48.774 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:48.774 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:48.774 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.774 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T17:29:48.418+0000 7f75c560a640 4 set_mon_vals no callback set 2024-09-12T17:29:48.774 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T17:29:48.418+0000 7f76dc015800 10 monclient: _renew_subs 2024-09-12T17:29:48.774 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T17:29:48.418+0000 7f76dc015800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:29:48.774 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T17:29:48.418+0000 7f76dc015800 1 librados: init done 2024-09-12T17:29:48.774 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T17:29:48.420+0000 7f75c3e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:29:48.774 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T17:29:48.420+0000 7f75c3e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:29:48.775 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T17:29:48.420+0000 7f75c3e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:29:48.775 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T17:29:48.420+0000 7f76d7792640 10 monclient: get_auth_request con 0x7f75bc076470 auth_method 0 2024-09-12T17:29:48.775 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T17:29:48.421+0000 7f76d6f91640 10 monclient: get_auth_request con 0x5578a809d4f0 auth_method 0 2024-09-12T17:29:48.775 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T17:29:48.421+0000 7f76d7792640 10 monclient: get_auth_request con 0x5578a80bfee0 auth_method 0 2024-09-12T17:29:48.775 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T17:29:48.422+0000 7f76d6f91640 10 monclient: get_auth_request con 0x5578a80c4240 auth_method 0 2024-09-12T17:29:48.775 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T17:29:48.424+0000 7f76dc015800 10 monclient: build_initial_monmap 2024-09-12T17:29:48.775 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T17:29:48.424+0000 7f76dc015800 1 build_initial for_mkfs: 0 2024-09-12T17:29:48.775 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T17:29:48.424+0000 7f76dc015800 10 monclient: monmap: 2024-09-12T17:29:48.775 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:29:48.775 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:29:48.775 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:29:48.775 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:29:48.775 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:29:48.776 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:48.776 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:29:48.776 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:29:48.776 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:29:48.776 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.776 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding auth protocol: cephx 2024-09-12T17:29:48.776 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding auth protocol: cephx 2024-09-12T17:29:48.776 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding auth protocol: cephx 2024-09-12T17:29:48.776 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding con mode: secure 2024-09-12T17:29:48.776 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding con mode: crc 2024-09-12T17:29:48.777 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding con mode: secure 2024-09-12T17:29:48.777 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding con mode: crc 2024-09-12T17:29:48.777 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding con mode: secure 2024-09-12T17:29:48.777 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding con mode: crc 2024-09-12T17:29:48.777 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding con mode: crc 2024-09-12T17:29:48.777 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding con mode: secure 2024-09-12T17:29:48.777 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding con mode: crc 2024-09-12T17:29:48.777 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding con mode: secure 2024-09-12T17:29:48.777 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding con mode: crc 2024-09-12T17:29:48.777 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c9050) adding con mode: secure 2024-09-12T17:29:48.777 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T17:29:48.424+0000 7f76dc015800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:48.777 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command objecter_requests cmddesc objecter_requests hook 0x5578a80ccaa0 EEXIST 2024-09-12T17:29:48.778 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T17:29:48.424+0000 7f76dc015800 10 monclient: init 2024-09-12T17:29:48.778 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding auth protocol: cephx 2024-09-12T17:29:48.778 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding auth protocol: cephx 2024-09-12T17:29:48.778 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding auth protocol: cephx 2024-09-12T17:29:48.778 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding con mode: secure 2024-09-12T17:29:48.778 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding con mode: crc 2024-09-12T17:29:48.778 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding con mode: secure 2024-09-12T17:29:48.778 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding con mode: crc 2024-09-12T17:29:48.778 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding con mode: secure 2024-09-12T17:29:48.778 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding con mode: crc 2024-09-12T17:29:48.779 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding con mode: crc 2024-09-12T17:29:48.779 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding con mode: secure 2024-09-12T17:29:48.779 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding con mode: crc 2024-09-12T17:29:48.779 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding con mode: secure 2024-09-12T17:29:48.779 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding con mode: crc 2024-09-12T17:29:48.779 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T17:29:48.424+0000 7f76dc015800 5 AuthRegistry(0x5578a80c7708) adding con mode: secure 2024-09-12T17:29:48.779 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T17:29:48.424+0000 7f76dc015800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:48.779 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T17:29:48.425+0000 7f76dc015800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:48.779 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T17:29:48.425+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command rotate-key cmddesc rotate-key hook 0x5578a80c7850 EEXIST 2024-09-12T17:29:48.779 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T17:29:48.425+0000 7f76dc015800 10 monclient: _reopen_session rank -1 2024-09-12T17:29:48.779 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T17:29:48.425+0000 7f76dc015800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:29:48.780 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T17:29:48.425+0000 7f76dc015800 10 monclient(hunting): picked mon.noname-a con 0x5578a80f0790 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:29:48.780 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T17:29:48.425+0000 7f76dc015800 10 monclient(hunting): picked mon.noname-c con 0x5578a80f2a60 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:29:48.780 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T17:29:48.425+0000 7f76dc015800 10 monclient(hunting): picked mon.noname-b con 0x5578a80eef60 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:29:48.780 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T17:29:48.425+0000 7f76dc015800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:48.780 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T17:29:48.425+0000 7f76dc015800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:48.780 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T17:29:48.425+0000 7f76dc015800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:48.780 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T17:29:48.425+0000 7f76dc015800 10 monclient(hunting): _renew_subs 2024-09-12T17:29:48.780 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T17:29:48.425+0000 7f76dc015800 10 monclient(hunting): authenticate will time out at 2599.775279s 2024-09-12T17:29:48.780 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T17:29:48.425+0000 7f76d7792640 10 monclient(hunting): get_auth_request con 0x5578a80f0790 auth_method 0 2024-09-12T17:29:48.780 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T17:29:48.425+0000 7f76d7792640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:48.780 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T17:29:48.425+0000 7f76d7792640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:48.780 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T17:29:48.425+0000 7f76d7792640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:48.781 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T17:29:48.425+0000 7f76d6f91640 10 monclient(hunting): get_auth_request con 0x5578a80f2a60 auth_method 0 2024-09-12T17:29:48.781 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T17:29:48.425+0000 7f76d6f91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:48.781 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T17:29:48.425+0000 7f76d6f91640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:48.781 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T17:29:48.425+0000 7f76d6f91640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:48.781 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T17:29:48.425+0000 7f76d7f93640 10 monclient(hunting): get_auth_request con 0x5578a80eef60 auth_method 0 2024-09-12T17:29:48.781 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T17:29:48.425+0000 7f76d7f93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:48.781 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T17:29:48.425+0000 7f76d7f93640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:48.781 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T17:29:48.425+0000 7f76d7f93640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:48.781 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T17:29:48.425+0000 7f76d7792640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:48.781 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T17:29:48.425+0000 7f76d7792640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:48.781 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T17:29:48.425+0000 7f76d7792640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:48.781 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T17:29:48.425+0000 7f76d6f91640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:48.781 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T17:29:48.425+0000 7f76d6f91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:48.782 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T17:29:48.425+0000 7f76d6f91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:48.782 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T17:29:48.425+0000 7f76d7f93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:48.782 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T17:29:48.425+0000 7f76d7f93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:48.782 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T17:29:48.425+0000 7f76d7f93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:48.782 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T17:29:48.425+0000 7f76d7792640 10 monclient(hunting): handle_auth_done global_id 8397 payload 824 2024-09-12T17:29:48.782 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T17:29:48.425+0000 7f76d7792640 10 monclient: _finish_hunting 0 2024-09-12T17:29:48.782 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T17:29:48.425+0000 7f76d7792640 1 monclient: found mon.noname-a 2024-09-12T17:29:48.782 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T17:29:48.425+0000 7f76d7792640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:29:48.782 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T17:29:48.426+0000 7f75c1602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:48.782 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T17:29:48.426+0000 7f75c1602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:29:48.782 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T17:29:48.426+0000 7f75c1602640 10 monclient: dump: 2024-09-12T17:29:48.782 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:48.782 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:48.783 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.783 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.783 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:48.783 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:48.783 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:48.783 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:48.783 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:48.783 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.783 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T17:29:48.426+0000 7f75c1602640 10 monclient: _finish_auth 0 2024-09-12T17:29:48.783 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T17:29:48.426+0000 7f75c1602640 10 monclient: _check_auth_tickets 2024-09-12T17:29:48.783 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T17:29:48.426+0000 7f75c1602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:29:48.783 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T17:29:48.426+0000 7f75c1602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:48.784 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T17:29:48.426+0000 7f75c1602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:29:48.784 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T17:29:48.426+0000 7f75c1602640 10 monclient: dump: 2024-09-12T17:29:48.784 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:48.784 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:48.784 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.784 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.784 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:48.784 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:48.784 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:48.784 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:48.785 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:48.785 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.785 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T17:29:48.426+0000 7f76dc015800 5 monclient: authenticate success, global_id 8397 2024-09-12T17:29:48.785 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T17:29:48.426+0000 7f76dc015800 10 monclient: _renew_subs 2024-09-12T17:29:48.785 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T17:29:48.426+0000 7f76dc015800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:29:48.785 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T17:29:48.426+0000 7f76d8794640 4 set_mon_vals no callback set 2024-09-12T17:29:48.788 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T17:29:48.426+0000 7f76dc015800 10 monclient: _renew_subs 2024-09-12T17:29:48.788 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T17:29:48.426+0000 7f76dc015800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:29:48.788 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T17:29:48.428+0000 7f75c1602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:29:48.788 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T17:29:48.428+0000 7f75c1602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:29:48.788 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T17:29:48.428+0000 7f75c1602640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:29:48.789 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T17:29:48.428+0000 7f76d6f91640 10 monclient: get_auth_request con 0x7f75b0076380 auth_method 0 2024-09-12T17:29:48.789 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T17:29:48.428+0000 7f76dc015800 10 monclient: get_monmap_and_config 2024-09-12T17:29:48.789 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T17:29:48.428+0000 7f76dc015800 10 monclient: build_initial_monmap 2024-09-12T17:29:48.789 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T17:29:48.428+0000 7f76dc015800 1 build_initial for_mkfs: 0 2024-09-12T17:29:48.789 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T17:29:48.428+0000 7f76dc015800 10 monclient: monmap: 2024-09-12T17:29:48.789 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:29:48.789 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:29:48.789 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:29:48.789 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:29:48.789 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:29:48.789 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:48.789 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:29:48.790 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:29:48.790 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:29:48.790 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.790 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding auth protocol: cephx 2024-09-12T17:29:48.790 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding auth protocol: cephx 2024-09-12T17:29:48.790 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding auth protocol: cephx 2024-09-12T17:29:48.790 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding con mode: secure 2024-09-12T17:29:48.790 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding con mode: crc 2024-09-12T17:29:48.790 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding con mode: secure 2024-09-12T17:29:48.790 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding con mode: crc 2024-09-12T17:29:48.790 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding con mode: secure 2024-09-12T17:29:48.790 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding con mode: crc 2024-09-12T17:29:48.790 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding con mode: crc 2024-09-12T17:29:48.791 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding con mode: secure 2024-09-12T17:29:48.791 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding con mode: crc 2024-09-12T17:29:48.791 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding con mode: secure 2024-09-12T17:29:48.791 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding con mode: crc 2024-09-12T17:29:48.791 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x5578a8110590) adding con mode: secure 2024-09-12T17:29:48.791 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T17:29:48.428+0000 7f76dc015800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:48.791 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T17:29:48.428+0000 7f76dc015800 10 monclient: init 2024-09-12T17:29:48.791 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding auth protocol: cephx 2024-09-12T17:29:48.791 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding auth protocol: cephx 2024-09-12T17:29:48.791 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding auth protocol: cephx 2024-09-12T17:29:48.791 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding con mode: secure 2024-09-12T17:29:48.791 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding con mode: crc 2024-09-12T17:29:48.792 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding con mode: secure 2024-09-12T17:29:48.792 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding con mode: crc 2024-09-12T17:29:48.792 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding con mode: secure 2024-09-12T17:29:48.792 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding con mode: crc 2024-09-12T17:29:48.792 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding con mode: crc 2024-09-12T17:29:48.792 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding con mode: secure 2024-09-12T17:29:48.792 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding con mode: crc 2024-09-12T17:29:48.792 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding con mode: secure 2024-09-12T17:29:48.792 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding con mode: crc 2024-09-12T17:29:48.792 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T17:29:48.428+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22850) adding con mode: secure 2024-09-12T17:29:48.792 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T17:29:48.429+0000 7f76dc015800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:48.792 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T17:29:48.429+0000 7f76dc015800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:48.793 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T17:29:48.429+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command rotate-key cmddesc rotate-key hook 0x7ffe55d22998 EEXIST 2024-09-12T17:29:48.793 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T17:29:48.429+0000 7f76dc015800 10 monclient: _reopen_session rank -1 2024-09-12T17:29:48.793 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T17:29:48.429+0000 7f76dc015800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:29:48.793 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T17:29:48.429+0000 7f76dc015800 10 monclient(hunting): picked mon.noname-c con 0x5578a8144c50 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:29:48.793 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T17:29:48.429+0000 7f76dc015800 10 monclient(hunting): picked mon.noname-a con 0x5578a8115ba0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:29:48.793 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T17:29:48.429+0000 7f76dc015800 10 monclient(hunting): picked mon.noname-b con 0x5578a81404f0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:29:48.793 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T17:29:48.429+0000 7f76dc015800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:48.793 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T17:29:48.429+0000 7f76dc015800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:48.793 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T17:29:48.429+0000 7f76dc015800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:48.793 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T17:29:48.429+0000 7f76dc015800 10 monclient(hunting): _renew_subs 2024-09-12T17:29:48.793 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T17:29:48.429+0000 7f76dc015800 10 monclient(hunting): authenticate will time out at 2599.779529s 2024-09-12T17:29:48.793 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T17:29:48.429+0000 7f76d6f91640 10 monclient(hunting): get_auth_request con 0x5578a8115ba0 auth_method 0 2024-09-12T17:29:48.793 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T17:29:48.429+0000 7f76d6f91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:48.794 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T17:29:48.429+0000 7f76d6f91640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:48.794 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T17:29:48.429+0000 7f76d6f91640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:48.794 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T17:29:48.429+0000 7f76d7792640 10 monclient(hunting): get_auth_request con 0x5578a8144c50 auth_method 0 2024-09-12T17:29:48.794 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T17:29:48.429+0000 7f76d7792640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:48.794 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T17:29:48.429+0000 7f76d7792640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:48.794 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T17:29:48.429+0000 7f76d7792640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:48.794 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T17:29:48.429+0000 7f76d6f91640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:48.794 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T17:29:48.429+0000 7f76d6f91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:48.794 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T17:29:48.429+0000 7f76d6f91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:48.794 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T17:29:48.429+0000 7f76d7792640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:48.794 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T17:29:48.429+0000 7f76d7792640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:48.794 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T17:29:48.429+0000 7f76d7792640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:48.794 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T17:29:48.429+0000 7f76d7f93640 10 monclient(hunting): get_auth_request con 0x5578a81404f0 auth_method 0 2024-09-12T17:29:48.795 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T17:29:48.429+0000 7f76d7f93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:48.795 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T17:29:48.429+0000 7f76d7f93640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:48.795 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T17:29:48.429+0000 7f76d7f93640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:48.795 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T17:29:48.429+0000 7f76d6f91640 10 monclient(hunting): handle_auth_done global_id 8400 payload 274 2024-09-12T17:29:48.795 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T17:29:48.429+0000 7f76d6f91640 10 monclient: _finish_hunting 0 2024-09-12T17:29:48.795 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T17:29:48.429+0000 7f76d6f91640 1 monclient: found mon.noname-a 2024-09-12T17:29:48.795 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T17:29:48.429+0000 7f76d6f91640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:29:48.795 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T17:29:48.430+0000 7f75baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:48.795 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T17:29:48.430+0000 7f75baffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:29:48.795 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T17:29:48.430+0000 7f75baffd640 10 monclient: dump: 2024-09-12T17:29:48.795 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:48.795 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:48.795 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.795 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.796 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:48.796 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:48.796 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:48.796 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:48.796 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:48.796 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.796 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T17:29:48.430+0000 7f75baffd640 10 monclient: _finish_auth 0 2024-09-12T17:29:48.796 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T17:29:48.430+0000 7f75baffd640 10 monclient: _check_auth_tickets 2024-09-12T17:29:48.796 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T17:29:48.430+0000 7f75baffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:29:48.796 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 monclient: authenticate success, global_id 8400 2024-09-12T17:29:48.796 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T17:29:48.430+0000 7f76dc015800 10 monclient: get_monmap_and_config success 2024-09-12T17:29:48.796 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T17:29:48.430+0000 7f76dc015800 4 set_mon_vals no callback set 2024-09-12T17:29:48.796 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T17:29:48.430+0000 7f75baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:48.797 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T17:29:48.430+0000 7f75baffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:29:48.797 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T17:29:48.430+0000 7f75baffd640 10 monclient: dump: 2024-09-12T17:29:48.797 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:48.797 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:48.797 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.797 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.797 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:48.797 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:48.797 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:48.797 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:48.797 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:48.797 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.798 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T17:29:48.430+0000 7f76dc015800 10 monclient: shutdown 2024-09-12T17:29:48.798 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T17:29:48.430+0000 7f76dc015800 10 monclient: build_initial_monmap 2024-09-12T17:29:48.798 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T17:29:48.430+0000 7f76dc015800 1 build_initial for_mkfs: 0 2024-09-12T17:29:48.798 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T17:29:48.430+0000 7f76dc015800 10 monclient: monmap: 2024-09-12T17:29:48.798 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T17:29:48.798 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:29:48.798 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T17:29:48.798 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T17:29:48.798 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T17:29:48.798 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:48.798 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T17:29:48.798 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-12T17:29:48.799 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T17:29:48.799 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.799 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding auth protocol: cephx 2024-09-12T17:29:48.799 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding auth protocol: cephx 2024-09-12T17:29:48.799 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding auth protocol: cephx 2024-09-12T17:29:48.799 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding con mode: secure 2024-09-12T17:29:48.799 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding con mode: crc 2024-09-12T17:29:48.799 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding con mode: secure 2024-09-12T17:29:48.799 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding con mode: crc 2024-09-12T17:29:48.799 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding con mode: secure 2024-09-12T17:29:48.799 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding con mode: crc 2024-09-12T17:29:48.800 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding con mode: crc 2024-09-12T17:29:48.800 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding con mode: secure 2024-09-12T17:29:48.800 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding con mode: crc 2024-09-12T17:29:48.800 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding con mode: secure 2024-09-12T17:29:48.800 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding con mode: crc 2024-09-12T17:29:48.800 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T17:29:48.430+0000 7f76dc015800 5 AuthRegistry(0x5578a8140e20) adding con mode: secure 2024-09-12T17:29:48.800 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T17:29:48.431+0000 7f76dc015800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:48.800 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T17:29:48.431+0000 7f76dc015800 1 librados: starting msgr at 2024-09-12T17:29:48.800 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T17:29:48.431+0000 7f76dc015800 1 librados: starting objecter 2024-09-12T17:29:48.800 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command objecter_requests cmddesc objecter_requests hook 0x5578a8114930 EEXIST 2024-09-12T17:29:48.800 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T17:29:48.431+0000 7f76dc015800 1 librados: setting wanted keys 2024-09-12T17:29:48.800 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T17:29:48.431+0000 7f76dc015800 1 librados: calling monclient init 2024-09-12T17:29:48.800 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T17:29:48.431+0000 7f76dc015800 10 monclient: init 2024-09-12T17:29:48.801 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding auth protocol: cephx 2024-09-12T17:29:48.801 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding auth protocol: cephx 2024-09-12T17:29:48.801 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding auth protocol: cephx 2024-09-12T17:29:48.801 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding con mode: secure 2024-09-12T17:29:48.801 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding con mode: crc 2024-09-12T17:29:48.801 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding con mode: secure 2024-09-12T17:29:48.801 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding con mode: crc 2024-09-12T17:29:48.801 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding con mode: secure 2024-09-12T17:29:48.801 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding con mode: crc 2024-09-12T17:29:48.801 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding con mode: crc 2024-09-12T17:29:48.801 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding con mode: secure 2024-09-12T17:29:48.801 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding con mode: crc 2024-09-12T17:29:48.802 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding con mode: secure 2024-09-12T17:29:48.802 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding con mode: crc 2024-09-12T17:29:48.802 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 AuthRegistry(0x5578a8108540) adding con mode: secure 2024-09-12T17:29:48.802 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T17:29:48.431+0000 7f76dc015800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:48.802 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T17:29:48.431+0000 7f76dc015800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:48.802 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T17:29:48.431+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command rotate-key cmddesc rotate-key hook 0x5578a8108688 EEXIST 2024-09-12T17:29:48.802 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T17:29:48.431+0000 7f76dc015800 10 monclient: _reopen_session rank -1 2024-09-12T17:29:48.802 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T17:29:48.431+0000 7f76dc015800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:29:48.802 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T17:29:48.431+0000 7f76dc015800 10 monclient(hunting): picked mon.noname-b con 0x5578a8115ba0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-12T17:29:48.802 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T17:29:48.431+0000 7f76dc015800 10 monclient(hunting): picked mon.noname-a con 0x5578a81404f0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T17:29:48.802 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T17:29:48.431+0000 7f76dc015800 10 monclient(hunting): picked mon.noname-c con 0x5578a8144c50 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T17:29:48.802 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T17:29:48.431+0000 7f76dc015800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:48.802 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T17:29:48.431+0000 7f76dc015800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:48.803 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T17:29:48.431+0000 7f76dc015800 10 monclient(hunting): start opening mon connection 2024-09-12T17:29:48.803 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T17:29:48.431+0000 7f76dc015800 10 monclient(hunting): _renew_subs 2024-09-12T17:29:48.803 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T17:29:48.431+0000 7f76dc015800 10 monclient(hunting): authenticate will time out at 2599.781900s 2024-09-12T17:29:48.803 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T17:29:48.431+0000 7f76d6f91640 10 monclient(hunting): get_auth_request con 0x5578a81404f0 auth_method 0 2024-09-12T17:29:48.803 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T17:29:48.432+0000 7f76d6f91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:48.803 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T17:29:48.432+0000 7f76d6f91640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:48.803 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T17:29:48.432+0000 7f76d6f91640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:48.803 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T17:29:48.432+0000 7f76d7f93640 10 monclient(hunting): get_auth_request con 0x5578a8144c50 auth_method 0 2024-09-12T17:29:48.803 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T17:29:48.432+0000 7f76d7f93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:48.803 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T17:29:48.432+0000 7f76d7f93640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:48.803 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T17:29:48.432+0000 7f76d7f93640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:48.804 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T17:29:48.432+0000 7f76d6f91640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:48.804 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T17:29:48.432+0000 7f76d6f91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:48.804 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T17:29:48.432+0000 7f76d6f91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:48.804 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T17:29:48.432+0000 7f76d7792640 10 monclient(hunting): get_auth_request con 0x5578a8115ba0 auth_method 0 2024-09-12T17:29:48.804 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T17:29:48.432+0000 7f76d7792640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:29:48.804 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T17:29:48.432+0000 7f76d7792640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:29:48.804 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T17:29:48.432+0000 7f76d7792640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:29:48.804 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T17:29:48.432+0000 7f76d7f93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:48.804 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T17:29:48.432+0000 7f76d7f93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:48.804 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T17:29:48.432+0000 7f76d7f93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:48.804 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T17:29:48.432+0000 7f76d7792640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:29:48.804 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T17:29:48.432+0000 7f76d7792640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:29:48.805 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T17:29:48.432+0000 7f76d7792640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:29:48.805 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T17:29:48.432+0000 7f76d6f91640 10 monclient(hunting): handle_auth_done global_id 8403 payload 824 2024-09-12T17:29:48.805 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T17:29:48.432+0000 7f76d6f91640 10 monclient: _finish_hunting 0 2024-09-12T17:29:48.805 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T17:29:48.432+0000 7f76d6f91640 1 monclient: found mon.noname-a 2024-09-12T17:29:48.805 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T17:29:48.432+0000 7f76d6f91640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T17:29:48.805 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T17:29:48.432+0000 7f75b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:48.805 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T17:29:48.432+0000 7f75b97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:29:48.805 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T17:29:48.432+0000 7f75b97fa640 10 monclient: dump: 2024-09-12T17:29:48.805 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:48.805 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:48.805 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.805 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.805 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:48.806 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:48.806 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:48.806 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:48.806 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:48.806 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.806 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T17:29:48.432+0000 7f75b97fa640 10 monclient: _finish_auth 0 2024-09-12T17:29:48.806 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T17:29:48.432+0000 7f75b97fa640 10 monclient: _check_auth_tickets 2024-09-12T17:29:48.806 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T17:29:48.432+0000 7f75b97fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:29:48.806 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T17:29:48.432+0000 7f75b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:29:48.806 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T17:29:48.432+0000 7f75b97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:29:48.806 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T17:29:48.432+0000 7f75b97fa640 10 monclient: dump: 2024-09-12T17:29:48.806 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T17:29:48.806 INFO:tasks.workunit.client.0.smithi067.stderr:fsid f8d042e3-46c6-4732-b8bf-7d74a00649d2 2024-09-12T17:29:48.806 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.806 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T16:59:01.898039+0000 2024-09-12T17:29:48.807 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T17:29:48.807 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T17:29:48.807 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T17:29:48.807 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-12T17:29:48.807 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T17:29:48.807 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.807 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T17:29:48.432+0000 7f76dc015800 5 monclient: authenticate success, global_id 8403 2024-09-12T17:29:48.807 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T17:29:48.432+0000 7f76dc015800 10 monclient: _renew_subs 2024-09-12T17:29:48.807 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T17:29:48.432+0000 7f76dc015800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:29:48.807 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T17:29:48.432+0000 7f75baffd640 4 set_mon_vals no callback set 2024-09-12T17:29:48.807 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T17:29:48.432+0000 7f76dc015800 10 monclient: _renew_subs 2024-09-12T17:29:48.807 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T17:29:48.432+0000 7f76dc015800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:29:48.808 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T17:29:48.432+0000 7f76dc015800 1 librados: init done 2024-09-12T17:29:48.808 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T17:29:48.432+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command cr dump hook 0x5578a813b7d8 2024-09-12T17:29:48.808 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T17:29:48.434+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.808 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T17:29:48.434+0000 7f75b97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:29:48.808 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T17:29:48.434+0000 7f75b97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:29:48.808 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T17:29:48.434+0000 7f75b97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6832/2189073638,v1:172.21.15.118:6833/2189073638] 2024-09-12T17:29:48.808 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T17:29:48.435+0000 7f76d7792640 10 monclient: get_auth_request con 0x7f75a0076470 auth_method 0 2024-09-12T17:29:48.808 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T17:29:48.435+0000 7f76d7f93640 10 monclient: get_auth_request con 0x5578a815f070 auth_method 0 2024-09-12T17:29:48.808 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T17:29:48.435+0000 7f76dc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.808 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T17:29:48.435+0000 7f76dc015800 20 realm 2024-09-12T17:29:48.808 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T17:29:48.435+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.808 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T17:29:48.436+0000 7f76dc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.808 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T17:29:48.436+0000 7f76dc015800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:48.809 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T17:29:48.436+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.809 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T17:29:48.436+0000 7f76dc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.809 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T17:29:48.436+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.809 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T17:29:48.436+0000 7f76d7792640 10 monclient: get_auth_request con 0x5578a81633a0 auth_method 0 2024-09-12T17:29:48.809 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T17:29:48.437+0000 7f76dc015800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:48.809 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T17:29:48.437+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.809 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T17:29:48.437+0000 7f76d6f91640 10 monclient: get_auth_request con 0x5578a8166ac0 auth_method 0 2024-09-12T17:29:48.809 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T17:29:48.437+0000 7f76dc015800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:29:48.809 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T17:29:48.438+0000 7f76dc015800 20 searching for the correct realm 2024-09-12T17:29:48.809 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T17:29:48.438+0000 7f76d7f93640 10 monclient: get_auth_request con 0x5578a816b840 auth_method 0 2024-09-12T17:29:48.809 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T17:29:48.438+0000 7f76d7792640 10 monclient: get_auth_request con 0x7f76d0061070 auth_method 0 2024-09-12T17:29:48.809 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T17:29:48.439+0000 7f76d6f91640 10 monclient: get_auth_request con 0x7f76c8040060 auth_method 0 2024-09-12T17:29:48.809 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T17:29:48.440+0000 7f76d7792640 0 -- 172.21.15.67:0/4098300234 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f76d0061070 msgr2=0x7f76d00a3b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:29:48.810 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T17:29:48.440+0000 7f75b97fa640 1 client.8403.objecter ms_handle_reset 0x7f76d0061070 session 0x7f76d00a4980 osd.7 2024-09-12T17:29:48.810 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T17:29:48.440+0000 7f75b97fa640 10 monclient: _renew_subs 2024-09-12T17:29:48.810 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T17:29:48.440+0000 7f75b97fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T17:29:48.810 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T17:29:48.440+0000 7f76d7792640 10 monclient: get_auth_request con 0x7f75a0086310 auth_method 0 2024-09-12T17:29:48.810 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T17:29:48.441+0000 7f76d7f93640 10 monclient: get_auth_request con 0x7f76cc04c060 auth_method 0 2024-09-12T17:29:48.810 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T17:29:48.443+0000 7f76d7792640 10 monclient: get_auth_request con 0x7f76cc02c400 auth_method 0 2024-09-12T17:29:48.810 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T17:29:48.444+0000 7f76d7792640 0 -- 172.21.15.67:0/4098300234 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f76cc02c400 msgr2=0x7f76cc02c880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:29:48.810 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T17:29:48.645+0000 7f76d7792640 10 monclient: get_auth_request con 0x7f76cc02c400 auth_method 0 2024-09-12T17:29:48.810 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T17:29:48.651+0000 7f76dc015800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:29:48.810 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T17:29:48.651+0000 7f76dc015800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:29:48.810 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T17:29:48.651+0000 7f76dc015800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:48.810 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T17:29:48.651+0000 7f76dc015800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:48.811 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T17:29:48.651+0000 7f76dc015800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:48.811 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T17:29:48.651+0000 7f76dc015800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:48.811 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T17:29:48.651+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.811 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T17:29:48.651+0000 7f76dc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.811 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T17:29:48.651+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.811 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T17:29:48.652+0000 7f76dc015800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:48.811 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T17:29:48.652+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.811 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T17:29:48.652+0000 7f76dc015800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:29:48.811 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T17:29:48.652+0000 7f76dc015800 20 zone default found 2024-09-12T17:29:48.811 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T17:29:48.652+0000 7f76dc015800 4 Realm: () 2024-09-12T17:29:48.811 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T17:29:48.652+0000 7f76dc015800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:29:48.811 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T17:29:48.652+0000 7f76dc015800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:29:48.811 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T17:29:48.652+0000 7f76dc015800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:48.812 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T17:29:48.652+0000 7f76dc015800 20 zonegroup default 2024-09-12T17:29:48.812 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T17:29:48.652+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.812 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T17:29:48.652+0000 7f76dc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.812 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T17:29:48.652+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.812 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T17:29:48.653+0000 7f76dc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.812 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T17:29:48.653+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.812 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T17:29:48.653+0000 7f76dc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.812 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T17:29:48.653+0000 7f76dc015800 20 started sync module instance, tier type = 2024-09-12T17:29:48.812 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T17:29:48.653+0000 7f76dc015800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:29:48.812 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T17:29:48.663+0000 7f76dc015800 20 add_watcher() i=0 2024-09-12T17:29:48.812 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T17:29:48.663+0000 7f76dc015800 20 add_watcher() i=1 2024-09-12T17:29:48.812 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T17:29:48.663+0000 7f76dc015800 20 add_watcher() i=2 2024-09-12T17:29:48.813 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T17:29:48.663+0000 7f76dc015800 20 add_watcher() i=3 2024-09-12T17:29:48.813 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T17:29:48.663+0000 7f76dc015800 20 add_watcher() i=4 2024-09-12T17:29:48.813 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T17:29:48.663+0000 7f76dc015800 20 add_watcher() i=5 2024-09-12T17:29:48.813 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T17:29:48.663+0000 7f76dc015800 20 add_watcher() i=6 2024-09-12T17:29:48.813 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T17:29:48.664+0000 7f76dc015800 20 add_watcher() i=7 2024-09-12T17:29:48.813 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T17:29:48.664+0000 7f76dc015800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:48.813 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding auth protocol: cephx 2024-09-12T17:29:48.813 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding auth protocol: cephx 2024-09-12T17:29:48.813 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding auth protocol: cephx 2024-09-12T17:29:48.813 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding con mode: secure 2024-09-12T17:29:48.813 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding con mode: crc 2024-09-12T17:29:48.813 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding con mode: secure 2024-09-12T17:29:48.813 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding con mode: crc 2024-09-12T17:29:48.814 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding con mode: secure 2024-09-12T17:29:48.814 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding con mode: crc 2024-09-12T17:29:48.814 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding con mode: crc 2024-09-12T17:29:48.814 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding con mode: secure 2024-09-12T17:29:48.814 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding con mode: crc 2024-09-12T17:29:48.814 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding con mode: secure 2024-09-12T17:29:48.814 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding con mode: crc 2024-09-12T17:29:48.814 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T17:29:48.665+0000 7f76dc015800 5 AuthRegistry(0x7ffe55d22d20) adding con mode: secure 2024-09-12T17:29:48.814 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T17:29:48.665+0000 7f758dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:48.814 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T17:29:48.666+0000 7f76dc015800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:29:48.814 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T17:29:48.666+0000 7f76dc015800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:48.814 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T17:29:48.666+0000 7f76dc015800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:48.814 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T17:29:48.666+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command cache list hook 0x5578a8132090 2024-09-12T17:29:48.815 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T17:29:48.666+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command cache inspect hook 0x5578a8132090 2024-09-12T17:29:48.815 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T17:29:48.666+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command cache erase hook 0x5578a8132090 2024-09-12T17:29:48.815 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T17:29:48.666+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command cache zap hook 0x5578a8132090 2024-09-12T17:29:48.815 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T17:29:48.666+0000 7f76dc015800 5 note: GC not initialized 2024-09-12T17:29:48.815 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T17:29:48.666+0000 7f758cfe1640 20 reqs_thread_entry: start 2024-09-12T17:29:48.815 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T17:29:48.666+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command sync trace show hook 0x7f76cc001200 2024-09-12T17:29:48.815 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T17:29:48.666+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command sync trace history hook 0x7f76cc001200 2024-09-12T17:29:48.815 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T17:29:48.666+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command sync trace active hook 0x7f76cc001200 2024-09-12T17:29:48.815 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T17:29:48.666+0000 7f76dc015800 5 asok(0x5578a7e50730) register_command sync trace active_short hook 0x7f76cc001200 2024-09-12T17:29:48.815 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T17:29:48.666+0000 7f76dc015800 20 init_complete bucket index max shards: 1 2024-09-12T17:29:48.815 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T17:29:48.666+0000 7f76dc015800 20 Filter name: none 2024-09-12T17:29:48.815 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T17:29:48.666+0000 7f75067fc640 20 reqs_thread_entry: start 2024-09-12T17:29:48.815 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T17:29:48.667+0000 7f76dc015800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:29:48.816 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T17:29:48.667+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.816 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T17:29:48.667+0000 7f76dc015800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:29:48.816 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T17:29:48.667+0000 7f76dc015800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:29:48.816 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T17:29:48.667+0000 7f76dc015800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:29:48.816 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T17:29:48.667+0000 7f76dc015800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : miss 2024-09-12T17:29:48.816 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T17:29:48.667+0000 7f76dc015800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.816 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T17:29:48.667+0000 7f76dc015800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:29:48.816 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T17:29:48.667+0000 7f76dc015800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:29:48.816 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T17:29:48.667+0000 7f76dc015800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:29:48.816 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T17:29:48.667+0000 7f76dc015800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:48.816 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T17:29:48.667+0000 7f76dc015800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:29:48.816 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T17:29:48.668+0000 7f76dc015800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:29:48.816 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T17:29:48.669+0000 7f76dc015800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:29:48.817 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T17:29:48.673+0000 7f76dc015800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:29:48.817 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T17:29:48.673+0000 7f76dc015800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:29:48.817 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T17:29:48.673+0000 7f76dc015800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:29:48.817 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T17:29:48.673+0000 7f76dc015800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18, ofs0, ns] 2024-09-12T17:29:48.817 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T17:29:48.673+0000 7f75baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464371 cookie 93976704515648 notifier 8403 bl.length()=911 2024-09-12T17:29:48.817 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T17:29:48.673+0000 7f75baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:29:48.817 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T17:29:48.673+0000 7f75baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:29:48.817 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T17:29:48.673+0000 7f75baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:29:48.817 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T17:29:48.675+0000 7f76dc015800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_sources= new_sources= 2024-09-12T17:29:48.817 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T17:29:48.675+0000 7f76dc015800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:29:48.817 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T17:29:48.675+0000 7f76dc015800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_dests= new_dests= 2024-09-12T17:29:48.817 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T17:29:48.675+0000 7f76dc015800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:29:48.817 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T17:29:48.678+0000 7f76dc015800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f76dc015800 time 2024-09-12T17:29:48.678685+0000 2024-09-12T17:29:48.818 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:29:48.818 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.818 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:29:48.818 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f76dd18c71a] 2024-09-12T17:29:48.818 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f76dd18c8d8] 2024-09-12T17:29:48.818 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5578a5b03841] 2024-09-12T17:29:48.818 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5578a5b1357a] 2024-09-12T17:29:48.818 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T17:29:48.818 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f76dbe29590] 2024-09-12T17:29:48.818 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T17:29:48.818 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T17:29:48.818 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.819 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T17:29:48.679+0000 7f76dc015800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:29:48.819 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f76dc015800 thread_name:radosgw-admin 2024-09-12T17:29:48.819 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.819 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:29:48.819 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f76dbe3e6f0] 2024-09-12T17:29:48.819 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f76dbe8b99c] 2024-09-12T17:29:48.819 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T17:29:48.819 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T17:29:48.819 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f76dd18c774] 2024-09-12T17:29:48.819 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f76dd18c8d8] 2024-09-12T17:29:48.819 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5578a5b03841] 2024-09-12T17:29:48.820 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5578a5b1357a] 2024-09-12T17:29:48.820 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T17:29:48.820 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f76dbe29590] 2024-09-12T17:29:48.820 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T17:29:48.820 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T17:29:48.820 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:29:48.820 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:29:48.820 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T17:29:48.820 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T17:29:48.820 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T17:29:48.820 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T17:29:48.820 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T17:29:48.820 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T17:29:48.821 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T17:29:48.821 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T17:29:48.821 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T17:29:48.821 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T17:29:48.821 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T17:29:48.821 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T17:29:48.821 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T17:29:48.821 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T17:29:48.821 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T17:29:48.821 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T17:29:48.821 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T17:29:48.821 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T17:29:48.821 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T17:29:48.822 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T17:29:48.822 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T17:29:48.822 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T17:29:48.822 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T17:29:48.822 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T17:29:48.822 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:29:48.822 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T17:29:48.822 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T17:29:48.822 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T17:29:48.822 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T17:29:48.822 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T17:29:48.822 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T17:29:48.822 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T17:29:48.822 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T17:29:48.823 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T17:29:48.823 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T17:29:48.823 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T17:29:48.823 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T17:29:48.823 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T17:29:48.823 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T17:29:48.823 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T17:29:48.823 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T17:29:48.823 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T17:29:48.823 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T17:29:48.823 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T17:29:48.823 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T17:29:48.823 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T17:29:48.824 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:29:48.824 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T17:29:48.824 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:29:48.824 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T17:29:48.824 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T17:29:48.824 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T17:29:48.824 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T17:29:48.824 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T17:29:48.824 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T17:29:48.824 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T17:29:48.824 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T17:29:48.824 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T17:29:48.825 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T17:29:48.825 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T17:29:48.825 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T17:29:48.825 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T17:29:48.825 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T17:29:48.825 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T17:29:48.825 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T17:29:48.825 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T17:29:48.825 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T17:29:48.825 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:29:48.825 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T17:29:48.825 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:29:48.826 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T17:29:48.826 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T17:29:48.826 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T17:29:48.826 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T17:29:48.826 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T17:29:48.826 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T17:29:48.826 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:29:48.826 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T17:29:48.826 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T17:29:48.826 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:29:48.826 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T17:29:48.826 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T17:29:48.826 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T17:29:48.827 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T17:29:48.827 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T17:29:48.827 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T17:29:48.827 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T17:29:48.827 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T17:29:48.827 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T17:29:48.827 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T17:29:48.827 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T17:29:48.827 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T17:29:48.827 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T17:29:48.827 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:29:48.827 INFO:tasks.workunit.client.0.smithi067.stderr: 7f75067fc640 / http_manager 2024-09-12T17:29:48.827 INFO:tasks.workunit.client.0.smithi067.stderr: 7f758cfe1640 / http_manager 2024-09-12T17:29:48.828 INFO:tasks.workunit.client.0.smithi067.stderr: 7f758dfe3640 / rgw_dt_lg_renew 2024-09-12T17:29:48.828 INFO:tasks.workunit.client.0.smithi067.stderr: 7f75b97fa640 / ms_dispatch 2024-09-12T17:29:48.828 INFO:tasks.workunit.client.0.smithi067.stderr: 7f75baffd640 / io_context_pool 2024-09-12T17:29:48.828 INFO:tasks.workunit.client.0.smithi067.stderr: 7f75c1602640 / ms_dispatch 2024-09-12T17:29:48.828 INFO:tasks.workunit.client.0.smithi067.stderr: 7f75c3e07640 / ms_dispatch 2024-09-12T17:29:48.828 INFO:tasks.workunit.client.0.smithi067.stderr: 7f75c560a640 / io_context_pool 2024-09-12T17:29:48.828 INFO:tasks.workunit.client.0.smithi067.stderr: 7f76d6f91640 / msgr-worker-2 2024-09-12T17:29:48.828 INFO:tasks.workunit.client.0.smithi067.stderr: 7f76d7792640 / msgr-worker-1 2024-09-12T17:29:48.828 INFO:tasks.workunit.client.0.smithi067.stderr: 7f76d7f93640 / msgr-worker-0 2024-09-12T17:29:48.828 INFO:tasks.workunit.client.0.smithi067.stderr: 7f76d8794640 / io_context_pool 2024-09-12T17:29:48.828 INFO:tasks.workunit.client.0.smithi067.stderr: 7f76dc015800 / radosgw-admin 2024-09-12T17:29:48.828 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T17:29:48.828 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T17:29:48.829 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:29:48.680096Z_4375400c-0eec-4578-9bf6-f93c46657328/log 2024-09-12T17:29:48.829 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T17:29:48.829 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:29:48.830 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:48.830 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:48.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.758+0000 7f1dd4687800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.760+0000 7f1dd4687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.760+0000 7f1dd4687800 20 realm 2024-09-12T17:29:48.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.760+0000 7f1dd4687800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.760+0000 7f1dd4687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.760+0000 7f1dd4687800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:48.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.760+0000 7f1dd4687800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.760+0000 7f1dd4687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.760+0000 7f1dd4687800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.761+0000 7f1dd4687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:48.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.761+0000 7f1dd4687800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.762+0000 7f1dd4687800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:29:48.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.762+0000 7f1dd4687800 20 searching for the correct realm 2024-09-12T17:29:48.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.764+0000 7f1dd1977640 0 -- 172.21.15.67:0/1909187688 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55f08d556b80 msgr2=0x55f08d558f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:29:48.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.768+0000 7f1dd2178640 0 -- 172.21.15.67:0/1909187688 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f1dc8060180 msgr2=0x7f1dc808fd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:29:48.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.975+0000 7f1dd4687800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:29:48.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.975+0000 7f1dd4687800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:29:48.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.975+0000 7f1dd4687800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:48.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.975+0000 7f1dd4687800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:48.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.975+0000 7f1dd4687800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:48.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.975+0000 7f1dd4687800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:48.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.975+0000 7f1dd4687800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.975+0000 7f1dd4687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.975+0000 7f1dd4687800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.976+0000 7f1dd4687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:48.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.976+0000 7f1dd4687800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.976+0000 7f1dd4687800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:29:48.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.976+0000 7f1dd4687800 20 zone default found 2024-09-12T17:29:48.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.976+0000 7f1dd4687800 4 Realm: () 2024-09-12T17:29:48.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.976+0000 7f1dd4687800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:29:48.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.976+0000 7f1dd4687800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:29:48.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.976+0000 7f1dd4687800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:48.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.976+0000 7f1dd4687800 20 zonegroup default 2024-09-12T17:29:48.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.976+0000 7f1dd4687800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.976+0000 7f1dd4687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.976+0000 7f1dd4687800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.977+0000 7f1dd4687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.977+0000 7f1dd4687800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.977+0000 7f1dd4687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.977+0000 7f1dd4687800 20 started sync module instance, tier type = 2024-09-12T17:29:48.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.977+0000 7f1dd4687800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:29:48.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.986+0000 7f1dd4687800 20 add_watcher() i=0 2024-09-12T17:29:48.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.986+0000 7f1dd4687800 20 add_watcher() i=1 2024-09-12T17:29:48.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.986+0000 7f1dd4687800 20 add_watcher() i=2 2024-09-12T17:29:48.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.986+0000 7f1dd4687800 20 add_watcher() i=3 2024-09-12T17:29:48.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.986+0000 7f1dd4687800 20 add_watcher() i=4 2024-09-12T17:29:48.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.986+0000 7f1dd4687800 20 add_watcher() i=5 2024-09-12T17:29:48.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.987+0000 7f1dd4687800 20 add_watcher() i=6 2024-09-12T17:29:48.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.987+0000 7f1dd4687800 20 add_watcher() i=7 2024-09-12T17:29:48.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.987+0000 7f1dd4687800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:48.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.989+0000 7f1c897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:48.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.989+0000 7f1dd4687800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:48.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.989+0000 7f1dd4687800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:48.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.989+0000 7f1dd4687800 5 note: GC not initialized 2024-09-12T17:29:48.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.990+0000 7f1c837fe640 20 reqs_thread_entry: start 2024-09-12T17:29:48.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.990+0000 7f1dd4687800 20 init_complete bucket index max shards: 1 2024-09-12T17:29:48.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.990+0000 7f1dd4687800 20 Filter name: none 2024-09-12T17:29:48.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.990+0000 7f1c817fa640 20 reqs_thread_entry: start 2024-09-12T17:29:48.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.990+0000 7f1dd4687800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.991+0000 7f1dd4687800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:29:48.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.991+0000 7f1dd4687800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.991+0000 7f1dd4687800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:29:48.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.991+0000 7f1dd4687800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:29:48.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.991+0000 7f1dd4687800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.991+0000 7f1dd4687800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:29:48.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.991+0000 7f1dd4687800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.992+0000 7f1dd4687800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:29:48.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.992+0000 7f1dd4687800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:29:48.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.993+0000 7f1c897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:48.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.995+0000 7f1dd4687800 20 remove_watcher() i=0 2024-09-12T17:29:48.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.995+0000 7f1dd4687800 2 removed watcher, disabling cache 2024-09-12T17:29:48.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.996+0000 7f1dd4687800 20 remove_watcher() i=1 2024-09-12T17:29:48.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.998+0000 7f1dd4687800 20 remove_watcher() i=2 2024-09-12T17:29:49.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:48.999+0000 7f1dd4687800 20 remove_watcher() i=3 2024-09-12T17:29:49.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.000+0000 7f1dd4687800 20 remove_watcher() i=4 2024-09-12T17:29:49.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.001+0000 7f1dd4687800 20 remove_watcher() i=5 2024-09-12T17:29:49.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.002+0000 7f1dd4687800 20 remove_watcher() i=6 2024-09-12T17:29:49.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.003+0000 7f1dd4687800 20 remove_watcher() i=7 2024-09-12T17:29:49.017 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:29:49.018 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:29:49.056 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:29:49.085 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:49.085 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:49.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.123+0000 7fb435526800 20 rados->read ofs=0 len=0 2024-09-12T17:29:49.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.124+0000 7fb435526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:49.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.124+0000 7fb435526800 20 realm 2024-09-12T17:29:49.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.124+0000 7fb435526800 20 rados->read ofs=0 len=0 2024-09-12T17:29:49.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.125+0000 7fb435526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:49.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.125+0000 7fb435526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:49.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.125+0000 7fb435526800 20 rados->read ofs=0 len=0 2024-09-12T17:29:49.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.125+0000 7fb435526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:49.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.125+0000 7fb435526800 20 rados->read ofs=0 len=0 2024-09-12T17:29:49.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.126+0000 7fb435526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:49.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.126+0000 7fb435526800 20 rados->read ofs=0 len=0 2024-09-12T17:29:49.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.127+0000 7fb435526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:29:49.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.127+0000 7fb435526800 20 searching for the correct realm 2024-09-12T17:29:49.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.129+0000 7fb431109640 0 -- 172.21.15.67:0/1271438356 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7fb42c064f10 msgr2=0x7fb42c063980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:29:49.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.133+0000 7fb431109640 0 -- 172.21.15.67:0/1271438356 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fb4280485e0 msgr2=0x7fb428056040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:29:49.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.339+0000 7fb435526800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:29:49.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.339+0000 7fb435526800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:29:49.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.339+0000 7fb435526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:49.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.339+0000 7fb435526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:49.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.339+0000 7fb435526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:49.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.339+0000 7fb435526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:49.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.339+0000 7fb435526800 20 rados->read ofs=0 len=0 2024-09-12T17:29:49.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.339+0000 7fb435526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:49.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.339+0000 7fb435526800 20 rados->read ofs=0 len=0 2024-09-12T17:29:49.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.340+0000 7fb435526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:49.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.340+0000 7fb435526800 20 rados->read ofs=0 len=0 2024-09-12T17:29:49.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.340+0000 7fb435526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:29:49.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.340+0000 7fb435526800 20 zone default found 2024-09-12T17:29:49.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.340+0000 7fb435526800 4 Realm: () 2024-09-12T17:29:49.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.340+0000 7fb435526800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:29:49.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.340+0000 7fb435526800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:29:49.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.340+0000 7fb435526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:49.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.340+0000 7fb435526800 20 zonegroup default 2024-09-12T17:29:49.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.340+0000 7fb435526800 20 rados->read ofs=0 len=0 2024-09-12T17:29:49.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.340+0000 7fb435526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:49.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.340+0000 7fb435526800 20 rados->read ofs=0 len=0 2024-09-12T17:29:49.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.341+0000 7fb435526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:49.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.341+0000 7fb435526800 20 rados->read ofs=0 len=0 2024-09-12T17:29:49.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.341+0000 7fb435526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:49.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.341+0000 7fb435526800 20 started sync module instance, tier type = 2024-09-12T17:29:49.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.341+0000 7fb435526800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:29:49.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.351+0000 7fb435526800 20 add_watcher() i=0 2024-09-12T17:29:49.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.351+0000 7fb435526800 20 add_watcher() i=1 2024-09-12T17:29:49.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.351+0000 7fb435526800 20 add_watcher() i=2 2024-09-12T17:29:49.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.351+0000 7fb435526800 20 add_watcher() i=3 2024-09-12T17:29:49.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.351+0000 7fb435526800 20 add_watcher() i=4 2024-09-12T17:29:49.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.351+0000 7fb435526800 20 add_watcher() i=5 2024-09-12T17:29:49.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.351+0000 7fb435526800 20 add_watcher() i=6 2024-09-12T17:29:49.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.352+0000 7fb435526800 20 add_watcher() i=7 2024-09-12T17:29:49.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.352+0000 7fb435526800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:49.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.354+0000 7fb2e7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:49.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.354+0000 7fb435526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:49.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.354+0000 7fb435526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:49.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.354+0000 7fb435526800 5 note: GC not initialized 2024-09-12T17:29:49.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.354+0000 7fb2e6fe5640 20 reqs_thread_entry: start 2024-09-12T17:29:49.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.354+0000 7fb435526800 20 init_complete bucket index max shards: 1 2024-09-12T17:29:49.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.354+0000 7fb435526800 20 Filter name: none 2024-09-12T17:29:49.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.354+0000 7fb2e4fe1640 20 reqs_thread_entry: start 2024-09-12T17:29:49.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.354+0000 7fb435526800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:29:49.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.354+0000 7fb435526800 20 rados->read ofs=0 len=0 2024-09-12T17:29:49.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.355+0000 7fb435526800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:29:49.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.355+0000 7fb435526800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:29:49.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.355+0000 7fb435526800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:29:49.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.355+0000 7fb435526800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : miss 2024-09-12T17:29:49.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.355+0000 7fb435526800 20 rados->read ofs=0 len=0 2024-09-12T17:29:49.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.355+0000 7fb435526800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:29:49.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.355+0000 7fb435526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:29:49.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.355+0000 7fb435526800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:29:49.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.355+0000 7fb435526800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:49.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.355+0000 7fb435526800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:29:49.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.355+0000 7fb435526800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:29:49.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.355+0000 7fb435526800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 2024-09-12T17:29:49.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.355+0000 7fb435526800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 2024-09-12T17:29:49.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.356+0000 7fb435526800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.1 2024-09-12T17:29:49.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.356+0000 7fb435526800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.1 2024-09-12T17:29:49.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.356+0000 7fb435526800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.2 2024-09-12T17:29:49.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.356+0000 7fb435526800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.2 2024-09-12T17:29:49.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.358+0000 7fb2e7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:49.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.360+0000 7fb435526800 20 remove_watcher() i=0 2024-09-12T17:29:49.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.360+0000 7fb435526800 2 removed watcher, disabling cache 2024-09-12T17:29:49.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.361+0000 7fb435526800 20 remove_watcher() i=1 2024-09-12T17:29:49.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.362+0000 7fb435526800 20 remove_watcher() i=2 2024-09-12T17:29:49.364 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.363+0000 7fb435526800 20 remove_watcher() i=3 2024-09-12T17:29:49.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.364+0000 7fb435526800 20 remove_watcher() i=4 2024-09-12T17:29:49.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.365+0000 7fb435526800 20 remove_watcher() i=5 2024-09-12T17:29:49.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.366+0000 7fb435526800 20 remove_watcher() i=6 2024-09-12T17:29:49.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:29:49.367+0000 7fb435526800 20 remove_watcher() i=7 2024-09-12T17:30:19.399 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-12T17:30:19.435 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:19.435 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:19.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.479+0000 7f34a580e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.481+0000 7f34a580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:19.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.481+0000 7f34a580e800 20 realm 2024-09-12T17:30:19.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.481+0000 7f34a580e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.481+0000 7f34a580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:19.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.481+0000 7f34a580e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:19.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.481+0000 7f34a580e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.481+0000 7f34a580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:19.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.481+0000 7f34a580e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.483+0000 7f34a580e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:19.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.483+0000 7f34a580e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.483+0000 7f34a580e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:30:19.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.484+0000 7f34a580e800 20 searching for the correct realm 2024-09-12T17:30:19.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.487+0000 7f34a176c640 0 -- 172.21.15.67:0/1447458553 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x5629ab069340 msgr2=0x5629ab06b7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:19.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.492+0000 7f349876a640 0 -- 172.21.15.67:0/1447458553 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x5629ab070df0 msgr2=0x5629ab0731e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:19.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.496+0000 7f34a580e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:30:19.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.496+0000 7f34a580e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:30:19.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.496+0000 7f34a580e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:19.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.496+0000 7f34a580e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:19.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.496+0000 7f34a580e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:19.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.496+0000 7f34a580e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:19.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.496+0000 7f34a580e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.496+0000 7f34a580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:19.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.496+0000 7f34a580e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.497+0000 7f34a580e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:19.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.497+0000 7f34a580e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.497+0000 7f34a580e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:30:19.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.497+0000 7f34a580e800 20 zone default found 2024-09-12T17:30:19.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.497+0000 7f34a580e800 4 Realm: () 2024-09-12T17:30:19.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.497+0000 7f34a580e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:30:19.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.497+0000 7f34a580e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:30:19.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.497+0000 7f34a580e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:19.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.497+0000 7f34a580e800 20 zonegroup default 2024-09-12T17:30:19.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.497+0000 7f34a580e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.498+0000 7f34a580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:19.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.498+0000 7f34a580e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.498+0000 7f34a580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:19.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.498+0000 7f34a580e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.498+0000 7f34a580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:19.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.498+0000 7f34a580e800 20 started sync module instance, tier type = 2024-09-12T17:30:19.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.498+0000 7f34a580e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:30:19.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.508+0000 7f34a580e800 20 add_watcher() i=0 2024-09-12T17:30:19.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.508+0000 7f34a580e800 20 add_watcher() i=1 2024-09-12T17:30:19.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.508+0000 7f34a580e800 20 add_watcher() i=2 2024-09-12T17:30:19.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.508+0000 7f34a580e800 20 add_watcher() i=3 2024-09-12T17:30:19.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.508+0000 7f34a580e800 20 add_watcher() i=4 2024-09-12T17:30:19.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.508+0000 7f34a580e800 20 add_watcher() i=5 2024-09-12T17:30:19.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.508+0000 7f34a580e800 20 add_watcher() i=6 2024-09-12T17:30:19.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.509+0000 7f34a580e800 20 add_watcher() i=7 2024-09-12T17:30:19.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.509+0000 7f34a580e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:19.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.511+0000 7f3356fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:19.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.511+0000 7f34a580e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:19.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.511+0000 7f34a580e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:19.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.511+0000 7f34a580e800 5 note: GC not initialized 2024-09-12T17:30:19.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.511+0000 7f3355fe3640 20 reqs_thread_entry: start 2024-09-12T17:30:19.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.511+0000 7f34a580e800 20 init_complete bucket index max shards: 1 2024-09-12T17:30:19.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.511+0000 7f34a580e800 20 Filter name: none 2024-09-12T17:30:19.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.512+0000 7f32c77fe640 20 reqs_thread_entry: start 2024-09-12T17:30:19.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.512+0000 7f34a580e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:30:19.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.512+0000 7f34a580e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.512+0000 7f34a580e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:30:19.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.512+0000 7f34a580e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:30:19.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.512+0000 7f34a580e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:30:19.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.512+0000 7f34a580e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : miss 2024-09-12T17:30:19.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.512+0000 7f34a580e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.512+0000 7f34a580e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:30:19.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.512+0000 7f34a580e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:30:19.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.512+0000 7f34a580e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:30:19.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.512+0000 7f34a580e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:30:19.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.512+0000 7f34a580e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:19.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.512+0000 7f34a580e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:30:19.517 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.516+0000 7f3356fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:19.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.518+0000 7f34a580e800 20 remove_watcher() i=0 2024-09-12T17:30:19.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.518+0000 7f34a580e800 2 removed watcher, disabling cache 2024-09-12T17:30:19.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.519+0000 7f34a580e800 20 remove_watcher() i=1 2024-09-12T17:30:19.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.520+0000 7f34a580e800 20 remove_watcher() i=2 2024-09-12T17:30:19.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.522+0000 7f34a580e800 20 remove_watcher() i=3 2024-09-12T17:30:19.523 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.523+0000 7f34a580e800 20 remove_watcher() i=4 2024-09-12T17:30:19.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.524+0000 7f34a580e800 20 remove_watcher() i=5 2024-09-12T17:30:19.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.525+0000 7f34a580e800 20 remove_watcher() i=6 2024-09-12T17:30:19.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.526+0000 7f34a580e800 20 remove_watcher() i=7 2024-09-12T17:30:19.539 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:30:19.569 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:19.569 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:19.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.608+0000 7fe00940f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.610+0000 7fe00940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:19.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.610+0000 7fe00940f800 20 realm 2024-09-12T17:30:19.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.610+0000 7fe00940f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.610+0000 7fe00940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:19.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.610+0000 7fe00940f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:19.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.610+0000 7fe00940f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.610+0000 7fe00940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:19.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.610+0000 7fe00940f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.611+0000 7fe00940f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:19.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.611+0000 7fe00940f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.612+0000 7fe00940f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:30:19.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.612+0000 7fe00940f800 20 searching for the correct realm 2024-09-12T17:30:19.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.613+0000 7fe006ef9640 0 -- 172.21.15.67:0/1632347648 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7fdff0003cb0 msgr2=0x7fe000063750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:19.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.819+0000 7fe0066f8640 0 -- 172.21.15.67:0/1632347648 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7fdff8084040 msgr2=0x7fdff8093940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:19.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.826+0000 7fe00940f800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:30:19.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.826+0000 7fe00940f800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:30:19.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.826+0000 7fe00940f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:19.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.826+0000 7fe00940f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:19.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.826+0000 7fe00940f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:19.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.826+0000 7fe00940f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:19.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.826+0000 7fe00940f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.826+0000 7fe00940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:19.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.826+0000 7fe00940f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.826+0000 7fe00940f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:19.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.826+0000 7fe00940f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.827+0000 7fe00940f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:30:19.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.827+0000 7fe00940f800 20 zone default found 2024-09-12T17:30:19.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.827+0000 7fe00940f800 4 Realm: () 2024-09-12T17:30:19.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.827+0000 7fe00940f800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:30:19.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.827+0000 7fe00940f800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:30:19.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.827+0000 7fe00940f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:19.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.827+0000 7fe00940f800 20 zonegroup default 2024-09-12T17:30:19.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.827+0000 7fe00940f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.827+0000 7fe00940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:19.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.827+0000 7fe00940f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.827+0000 7fe00940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:19.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.827+0000 7fe00940f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.827+0000 7fe00940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:19.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.827+0000 7fe00940f800 20 started sync module instance, tier type = 2024-09-12T17:30:19.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.827+0000 7fe00940f800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:30:19.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.837+0000 7fe00940f800 20 add_watcher() i=0 2024-09-12T17:30:19.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.837+0000 7fe00940f800 20 add_watcher() i=1 2024-09-12T17:30:19.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.837+0000 7fe00940f800 20 add_watcher() i=2 2024-09-12T17:30:19.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.837+0000 7fe00940f800 20 add_watcher() i=3 2024-09-12T17:30:19.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.837+0000 7fe00940f800 20 add_watcher() i=4 2024-09-12T17:30:19.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.837+0000 7fe00940f800 20 add_watcher() i=5 2024-09-12T17:30:19.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.837+0000 7fe00940f800 20 add_watcher() i=6 2024-09-12T17:30:19.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.838+0000 7fe00940f800 20 add_watcher() i=7 2024-09-12T17:30:19.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.838+0000 7fe00940f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:19.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.840+0000 7fdebd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:19.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.840+0000 7fe00940f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:19.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.840+0000 7fe00940f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:19.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.840+0000 7fe00940f800 5 note: GC not initialized 2024-09-12T17:30:19.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.840+0000 7fde37fff640 20 reqs_thread_entry: start 2024-09-12T17:30:19.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.840+0000 7fe00940f800 20 init_complete bucket index max shards: 1 2024-09-12T17:30:19.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.840+0000 7fe00940f800 20 Filter name: none 2024-09-12T17:30:19.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.840+0000 7fde35ffb640 20 reqs_thread_entry: start 2024-09-12T17:30:19.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.840+0000 7fe00940f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:30:19.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.840+0000 7fe00940f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.841+0000 7fe00940f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:30:19.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.841+0000 7fe00940f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:30:19.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.841+0000 7fe00940f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:30:19.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.841+0000 7fe00940f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : miss 2024-09-12T17:30:19.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.841+0000 7fe00940f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.842+0000 7fe00940f800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:30:19.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.842+0000 7fe00940f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:30:19.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.842+0000 7fe00940f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:30:19.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.842+0000 7fe00940f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:30:19.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.842+0000 7fe00940f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:19.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.842+0000 7fe00940f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:30:19.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.842+0000 7fe00940f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 2024-09-12T17:30:19.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.842+0000 7fe00940f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 2024-09-12T17:30:19.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.842+0000 7fe00940f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.1 2024-09-12T17:30:19.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.842+0000 7fe00940f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.1 2024-09-12T17:30:19.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.842+0000 7fe00940f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.2 2024-09-12T17:30:19.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.842+0000 7fe00940f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.2 2024-09-12T17:30:19.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.844+0000 7fdebd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:19.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.846+0000 7fe00940f800 20 remove_watcher() i=0 2024-09-12T17:30:19.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.846+0000 7fe00940f800 2 removed watcher, disabling cache 2024-09-12T17:30:19.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.847+0000 7fe00940f800 20 remove_watcher() i=1 2024-09-12T17:30:19.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.848+0000 7fe00940f800 20 remove_watcher() i=2 2024-09-12T17:30:19.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.849+0000 7fe00940f800 20 remove_watcher() i=3 2024-09-12T17:30:19.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.851+0000 7fe00940f800 20 remove_watcher() i=4 2024-09-12T17:30:19.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.852+0000 7fe00940f800 20 remove_watcher() i=5 2024-09-12T17:30:19.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.852+0000 7fe00940f800 20 remove_watcher() i=6 2024-09-12T17:30:19.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.853+0000 7fe00940f800 20 remove_watcher() i=7 2024-09-12T17:30:19.866 INFO:tasks.workunit.client.0.smithi067.stderr:check reshard logrecord successfully 2024-09-12T17:30:19.866 INFO:tasks.workunit.client.0.smithi067.stderr: test: reshard versioned bucket 2024-09-12T17:30:19.867 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:30:19.896 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:19.896 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:19.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.934+0000 7f238c240800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.936+0000 7f238c240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:19.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.936+0000 7f238c240800 20 realm 2024-09-12T17:30:19.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.936+0000 7f238c240800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.936+0000 7f238c240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:19.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.936+0000 7f238c240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:19.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.936+0000 7f238c240800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.936+0000 7f238c240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:19.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.936+0000 7f238c240800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.937+0000 7f238c240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:19.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.937+0000 7f238c240800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.938+0000 7f238c240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:30:19.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.938+0000 7f238c240800 20 searching for the correct realm 2024-09-12T17:30:19.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.941+0000 7f238a532640 0 -- 172.21.15.67:0/3913670513 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x559970e092f0 msgr2=0x559970e0b760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:19.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.945+0000 7f2389530640 0 -- 172.21.15.67:0/3913670513 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x559970e10d70 msgr2=0x559970e13160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:30:19.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.949+0000 7f238c240800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:30:19.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.949+0000 7f238c240800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:30:19.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.949+0000 7f238c240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:19.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.949+0000 7f238c240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:19.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.949+0000 7f238c240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:19.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.949+0000 7f238c240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:19.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.949+0000 7f238c240800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.949+0000 7f238c240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:19.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.949+0000 7f238c240800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.950+0000 7f238c240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:19.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.950+0000 7f238c240800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.950+0000 7f238c240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:30:19.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.950+0000 7f238c240800 20 zone default found 2024-09-12T17:30:19.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.950+0000 7f238c240800 4 Realm: () 2024-09-12T17:30:19.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.950+0000 7f238c240800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:30:19.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.950+0000 7f238c240800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:30:19.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.950+0000 7f238c240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:19.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.950+0000 7f238c240800 20 zonegroup default 2024-09-12T17:30:19.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.950+0000 7f238c240800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.950+0000 7f238c240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:19.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.950+0000 7f238c240800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.951+0000 7f238c240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:19.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.951+0000 7f238c240800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.951+0000 7f238c240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:19.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.951+0000 7f238c240800 20 started sync module instance, tier type = 2024-09-12T17:30:19.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.951+0000 7f238c240800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:30:19.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.960+0000 7f238c240800 20 add_watcher() i=0 2024-09-12T17:30:19.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.960+0000 7f238c240800 20 add_watcher() i=1 2024-09-12T17:30:19.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.960+0000 7f238c240800 20 add_watcher() i=2 2024-09-12T17:30:19.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.960+0000 7f238c240800 20 add_watcher() i=3 2024-09-12T17:30:19.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.960+0000 7f238c240800 20 add_watcher() i=4 2024-09-12T17:30:19.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.960+0000 7f238c240800 20 add_watcher() i=5 2024-09-12T17:30:19.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.960+0000 7f238c240800 20 add_watcher() i=6 2024-09-12T17:30:19.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.961+0000 7f238c240800 20 add_watcher() i=7 2024-09-12T17:30:19.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.961+0000 7f238c240800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:19.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.963+0000 7f223b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:19.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.963+0000 7f238c240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:19.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.963+0000 7f238c240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:19.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.963+0000 7f238c240800 5 note: GC not initialized 2024-09-12T17:30:19.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.963+0000 7f223a7fc640 20 reqs_thread_entry: start 2024-09-12T17:30:19.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.964+0000 7f238c240800 20 init_complete bucket index max shards: 1 2024-09-12T17:30:19.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.964+0000 7f238c240800 20 Filter name: none 2024-09-12T17:30:19.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.964+0000 7f21abfff640 20 reqs_thread_entry: start 2024-09-12T17:30:19.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.964+0000 7f238c240800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.964+0000 7f238c240800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:30:19.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.964+0000 7f238c240800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.965+0000 7f238c240800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:30:19.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.965+0000 7f238c240800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:30:19.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.965+0000 7f238c240800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.965+0000 7f238c240800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:30:19.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.965+0000 7f238c240800 20 rados->read ofs=0 len=0 2024-09-12T17:30:19.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.965+0000 7f238c240800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:30:19.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.965+0000 7f238c240800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:30:19.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.967+0000 7f223b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:19.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.969+0000 7f238c240800 20 remove_watcher() i=0 2024-09-12T17:30:19.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.969+0000 7f238c240800 2 removed watcher, disabling cache 2024-09-12T17:30:19.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.970+0000 7f238c240800 20 remove_watcher() i=1 2024-09-12T17:30:19.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.971+0000 7f238c240800 20 remove_watcher() i=2 2024-09-12T17:30:19.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.972+0000 7f238c240800 20 remove_watcher() i=3 2024-09-12T17:30:19.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.973+0000 7f238c240800 20 remove_watcher() i=4 2024-09-12T17:30:19.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.974+0000 7f238c240800 20 remove_watcher() i=5 2024-09-12T17:30:19.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.975+0000 7f238c240800 20 remove_watcher() i=6 2024-09-12T17:30:19.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:19.976+0000 7f238c240800 20 remove_watcher() i=7 2024-09-12T17:30:19.988 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:30:19.988 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:30:19.988 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: myver id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-12T17:30:19.988 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:30:19.989 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 2 2024-09-12T17:30:20.021 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:20.021 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:20.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.059+0000 7f5e9c126800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.060+0000 7f5e9c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:20.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.060+0000 7f5e9c126800 20 realm 2024-09-12T17:30:20.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.060+0000 7f5e9c126800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.061+0000 7f5e9c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:20.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.061+0000 7f5e9c126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:20.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.061+0000 7f5e9c126800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.061+0000 7f5e9c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:20.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.061+0000 7f5e9c126800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.062+0000 7f5e9c126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:20.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.062+0000 7f5e9c126800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.063+0000 7f5e9c126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:30:20.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.063+0000 7f5e9c126800 20 searching for the correct realm 2024-09-12T17:30:20.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.066+0000 7f5e8ffff640 0 -- 172.21.15.67:0/2132292233 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x56345a0043e0 msgr2=0x56345a006870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:20.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.069+0000 7f5e8ffff640 0 -- 172.21.15.67:0/2132292233 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x56345a00be30 msgr2=0x56345a00e220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:30:20.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.073+0000 7f5e9c126800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:30:20.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.073+0000 7f5e9c126800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:30:20.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.073+0000 7f5e9c126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:20.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.073+0000 7f5e9c126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:20.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.073+0000 7f5e9c126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:20.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.073+0000 7f5e9c126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:20.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.073+0000 7f5e9c126800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.074+0000 7f5e9c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:20.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.074+0000 7f5e9c126800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.074+0000 7f5e9c126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:20.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.074+0000 7f5e9c126800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.074+0000 7f5e9c126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:30:20.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.074+0000 7f5e9c126800 20 zone default found 2024-09-12T17:30:20.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.074+0000 7f5e9c126800 4 Realm: () 2024-09-12T17:30:20.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.074+0000 7f5e9c126800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:30:20.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.074+0000 7f5e9c126800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:30:20.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.074+0000 7f5e9c126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:20.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.074+0000 7f5e9c126800 20 zonegroup default 2024-09-12T17:30:20.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.074+0000 7f5e9c126800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.075+0000 7f5e9c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:20.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.075+0000 7f5e9c126800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.075+0000 7f5e9c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:20.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.075+0000 7f5e9c126800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.075+0000 7f5e9c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:20.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.075+0000 7f5e9c126800 20 started sync module instance, tier type = 2024-09-12T17:30:20.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.075+0000 7f5e9c126800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:30:20.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.084+0000 7f5e9c126800 20 add_watcher() i=0 2024-09-12T17:30:20.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.084+0000 7f5e9c126800 20 add_watcher() i=1 2024-09-12T17:30:20.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.084+0000 7f5e9c126800 20 add_watcher() i=2 2024-09-12T17:30:20.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.084+0000 7f5e9c126800 20 add_watcher() i=3 2024-09-12T17:30:20.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.084+0000 7f5e9c126800 20 add_watcher() i=4 2024-09-12T17:30:20.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.084+0000 7f5e9c126800 20 add_watcher() i=5 2024-09-12T17:30:20.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.084+0000 7f5e9c126800 20 add_watcher() i=6 2024-09-12T17:30:20.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.085+0000 7f5e9c126800 20 add_watcher() i=7 2024-09-12T17:30:20.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.085+0000 7f5e9c126800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:20.088 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.087+0000 7f5d4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:20.088 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.087+0000 7f5e9c126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:20.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.087+0000 7f5e9c126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:20.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.087+0000 7f5e9c126800 5 note: GC not initialized 2024-09-12T17:30:20.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.087+0000 7f5d4cfe1640 20 reqs_thread_entry: start 2024-09-12T17:30:20.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.087+0000 7f5e9c126800 20 init_complete bucket index max shards: 1 2024-09-12T17:30:20.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.088+0000 7f5e9c126800 20 Filter name: none 2024-09-12T17:30:20.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.088+0000 7f5cc67fc640 20 reqs_thread_entry: start 2024-09-12T17:30:20.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.088+0000 7f5e9c126800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:30:20.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.088+0000 7f5e9c126800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.088+0000 7f5e9c126800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:30:20.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.088+0000 7f5e9c126800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:30:20.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.088+0000 7f5e9c126800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:30:20.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.088+0000 7f5e9c126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 : miss 2024-09-12T17:30:20.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.088+0000 7f5e9c126800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.089+0000 7f5e9c126800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:30:20.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.089+0000 7f5e9c126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 info.flags=0x17 2024-09-12T17:30:20.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.089+0000 7f5e9c126800 10 adding default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 to cache LRU end 2024-09-12T17:30:20.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.089+0000 7f5e9c126800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:30:20.091 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.089+0000 7f5e9c126800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:20.091 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.089+0000 7f5e9c126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 2024-09-12T17:30:20.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.092+0000 7f5e9c126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 info.flags=0x17 2024-09-12T17:30:20.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.092+0000 7f5e9c126800 10 moving default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 to cache LRU end 2024-09-12T17:30:20.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.092+0000 7f5e9c126800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:20.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.092+0000 7f5e9c126800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19, ofs0, ns] 2024-09-12T17:30:20.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.093+0000 7f5d76ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464299 cookie 94782848262736 notifier 8514 bl.length()=905 2024-09-12T17:30:20.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.093+0000 7f5d76ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 info.flags=0x17 2024-09-12T17:30:20.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.093+0000 7f5d76ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 to cache LRU end 2024-09-12T17:30:20.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.093+0000 7f5d76ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:20.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.095+0000 7f5e9c126800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): orig_sources= new_sources= 2024-09-12T17:30:20.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.095+0000 7f5e9c126800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): potential sources added=[] removed=[] 2024-09-12T17:30:20.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.095+0000 7f5e9c126800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): orig_dests= new_dests= 2024-09-12T17:30:20.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.095+0000 7f5e9c126800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): potential dests added=[] removed=[] 2024-09-12T17:30:20.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.097+0000 7f5e9c126800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.1.0 2024-09-12T17:30:20.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.097+0000 7f5e9c126800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.1.0 2024-09-12T17:30:20.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.097+0000 7f5e9c126800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.1.1 2024-09-12T17:30:20.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.097+0000 7f5e9c126800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.1.1 2024-09-12T17:30:20.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.097+0000 7f5e9c126800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.0 2024-09-12T17:30:20.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.098+0000 7f5e9c126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:30:20.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.098+0000 7f5e9c126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 2024-09-12T17:30:20.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.099+0000 7f5e9c126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 info.flags=0x17 2024-09-12T17:30:20.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.099+0000 7f5e9c126800 10 moving default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 to cache LRU end 2024-09-12T17:30:20.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.099+0000 7f5e9c126800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:20.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.099+0000 7f5e9c126800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19, ofs0, ns] 2024-09-12T17:30:20.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.099+0000 7f5d76ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464300 cookie 94782848262736 notifier 8514 bl.length()=905 2024-09-12T17:30:20.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.099+0000 7f5d76ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 info.flags=0x17 2024-09-12T17:30:20.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.099+0000 7f5d76ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 to cache LRU end 2024-09-12T17:30:20.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.099+0000 7f5d76ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:20.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.100+0000 7f5e9c126800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): orig_sources= new_sources= 2024-09-12T17:30:20.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.100+0000 7f5e9c126800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): potential sources added=[] removed=[] 2024-09-12T17:30:20.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.100+0000 7f5e9c126800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): orig_dests= new_dests= 2024-09-12T17:30:20.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.100+0000 7f5e9c126800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): potential dests added=[] removed=[] 2024-09-12T17:30:20.103 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.102+0000 7f5e9c126800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.0 2024-09-12T17:30:20.103 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.102+0000 7f5e9c126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:30:20.103 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.102+0000 7f5e9c126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 2024-09-12T17:30:20.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.103+0000 7f5e9c126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 info.flags=0x17 2024-09-12T17:30:20.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.103+0000 7f5e9c126800 10 moving default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 to cache LRU end 2024-09-12T17:30:20.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.103+0000 7f5e9c126800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:20.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.103+0000 7f5e9c126800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19, ofs0, ns] 2024-09-12T17:30:20.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.104+0000 7f5d767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464301 cookie 94782848262736 notifier 8514 bl.length()=873 2024-09-12T17:30:20.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.104+0000 7f5d767fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 info.flags=0x17 2024-09-12T17:30:20.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.104+0000 7f5d767fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 to cache LRU end 2024-09-12T17:30:20.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.104+0000 7f5d767fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:20.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.105+0000 7f5e9c126800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): orig_sources= new_sources= 2024-09-12T17:30:20.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.105+0000 7f5e9c126800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): potential sources added=[] removed=[] 2024-09-12T17:30:20.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.105+0000 7f5e9c126800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): orig_dests= new_dests= 2024-09-12T17:30:20.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.105+0000 7f5e9c126800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): potential dests added=[] removed=[] 2024-09-12T17:30:20.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.107+0000 7f5e9c126800 1 execute INFO: reshard of bucket "myver" from 1 shards to 2 shards completed successfully 2024-09-12T17:30:20.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.109+0000 7f5d4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:20.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.111+0000 7f5e9c126800 20 remove_watcher() i=0 2024-09-12T17:30:20.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.111+0000 7f5e9c126800 2 removed watcher, disabling cache 2024-09-12T17:30:20.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.112+0000 7f5e9c126800 20 remove_watcher() i=1 2024-09-12T17:30:20.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.113+0000 7f5e9c126800 20 remove_watcher() i=2 2024-09-12T17:30:20.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.114+0000 7f5e9c126800 20 remove_watcher() i=3 2024-09-12T17:30:20.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.115+0000 7f5e9c126800 20 remove_watcher() i=4 2024-09-12T17:30:20.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.116+0000 7f5e9c126800 20 remove_watcher() i=5 2024-09-12T17:30:20.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.117+0000 7f5e9c126800 20 remove_watcher() i=6 2024-09-12T17:30:20.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.118+0000 7f5e9c126800 20 remove_watcher() i=7 2024-09-12T17:30:20.131 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:30:20.160 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:20.161 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:20.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.198+0000 7f1faa324800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.200+0000 7f1faa324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:20.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.200+0000 7f1faa324800 20 realm 2024-09-12T17:30:20.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.200+0000 7f1faa324800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.200+0000 7f1faa324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:20.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.200+0000 7f1faa324800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:20.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.200+0000 7f1faa324800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.201+0000 7f1faa324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:20.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.201+0000 7f1faa324800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.201+0000 7f1faa324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:20.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.201+0000 7f1faa324800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.202+0000 7f1faa324800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:30:20.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.202+0000 7f1faa324800 20 searching for the correct realm 2024-09-12T17:30:20.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.205+0000 7f1fa6068640 0 -- 172.21.15.67:0/833824683 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f1fa00793f0 msgr2=0x7f1fa0079870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:20.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.208+0000 7f1fa6068640 0 -- 172.21.15.67:0/833824683 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f1f9c025040 msgr2=0x7f1f9c06c6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:20.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.416+0000 7f1faa324800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:30:20.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.416+0000 7f1faa324800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:30:20.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.416+0000 7f1faa324800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:20.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.416+0000 7f1faa324800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:20.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.416+0000 7f1faa324800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:20.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.416+0000 7f1faa324800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:20.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.416+0000 7f1faa324800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.416+0000 7f1faa324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:20.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.416+0000 7f1faa324800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.416+0000 7f1faa324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:20.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.416+0000 7f1faa324800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.417+0000 7f1faa324800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:30:20.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.417+0000 7f1faa324800 20 zone default found 2024-09-12T17:30:20.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.417+0000 7f1faa324800 4 Realm: () 2024-09-12T17:30:20.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.417+0000 7f1faa324800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:30:20.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.417+0000 7f1faa324800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:30:20.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.417+0000 7f1faa324800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:20.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.417+0000 7f1faa324800 20 zonegroup default 2024-09-12T17:30:20.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.417+0000 7f1faa324800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.417+0000 7f1faa324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:20.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.417+0000 7f1faa324800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.417+0000 7f1faa324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:20.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.417+0000 7f1faa324800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.417+0000 7f1faa324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:20.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.417+0000 7f1faa324800 20 started sync module instance, tier type = 2024-09-12T17:30:20.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.417+0000 7f1faa324800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:30:20.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.427+0000 7f1faa324800 20 add_watcher() i=0 2024-09-12T17:30:20.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.427+0000 7f1faa324800 20 add_watcher() i=1 2024-09-12T17:30:20.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.427+0000 7f1faa324800 20 add_watcher() i=2 2024-09-12T17:30:20.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.427+0000 7f1faa324800 20 add_watcher() i=3 2024-09-12T17:30:20.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.427+0000 7f1faa324800 20 add_watcher() i=4 2024-09-12T17:30:20.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.427+0000 7f1faa324800 20 add_watcher() i=5 2024-09-12T17:30:20.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.427+0000 7f1faa324800 20 add_watcher() i=6 2024-09-12T17:30:20.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.428+0000 7f1faa324800 20 add_watcher() i=7 2024-09-12T17:30:20.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.428+0000 7f1faa324800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:20.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.429+0000 7f1e5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:20.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.430+0000 7f1faa324800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:20.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.430+0000 7f1faa324800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:20.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.430+0000 7f1faa324800 5 note: GC not initialized 2024-09-12T17:30:20.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.430+0000 7f1dd77fe640 20 reqs_thread_entry: start 2024-09-12T17:30:20.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.430+0000 7f1faa324800 20 init_complete bucket index max shards: 1 2024-09-12T17:30:20.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.430+0000 7f1faa324800 20 Filter name: none 2024-09-12T17:30:20.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.430+0000 7f1dd57fa640 20 reqs_thread_entry: start 2024-09-12T17:30:20.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.430+0000 7f1faa324800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.431+0000 7f1faa324800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:30:20.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.431+0000 7f1faa324800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.431+0000 7f1faa324800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:30:20.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.431+0000 7f1faa324800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:30:20.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.431+0000 7f1faa324800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.431+0000 7f1faa324800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:30:20.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.431+0000 7f1faa324800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.432+0000 7f1faa324800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:30:20.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.432+0000 7f1faa324800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:30:20.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.433+0000 7f1e5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:20.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.435+0000 7f1faa324800 20 remove_watcher() i=0 2024-09-12T17:30:20.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.435+0000 7f1faa324800 2 removed watcher, disabling cache 2024-09-12T17:30:20.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.436+0000 7f1faa324800 20 remove_watcher() i=1 2024-09-12T17:30:20.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.437+0000 7f1faa324800 20 remove_watcher() i=2 2024-09-12T17:30:20.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.439+0000 7f1faa324800 20 remove_watcher() i=3 2024-09-12T17:30:20.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.440+0000 7f1faa324800 20 remove_watcher() i=4 2024-09-12T17:30:20.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.441+0000 7f1faa324800 20 remove_watcher() i=5 2024-09-12T17:30:20.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.442+0000 7f1faa324800 20 remove_watcher() i=6 2024-09-12T17:30:20.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.443+0000 7f1faa324800 20 remove_watcher() i=7 2024-09-12T17:30:20.454 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:30:20.454 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:30:20.454 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: myver id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T17:30:20.454 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:30:20.457 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:30:20.457 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:30:20.477 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:30:20.478 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:30:20.533 INFO:tasks.workunit.client.0.smithi067.stderr: test: reshard removes olh entries with empty name 2024-09-12T17:30:20.535 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:30:20.535 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:30:20.609 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:30:20.609 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:30:20.834 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:30:20.863 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:20.863 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:20.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.901+0000 7f8ac4abb800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.902+0000 7f8ac4abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:20.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.902+0000 7f8ac4abb800 20 realm 2024-09-12T17:30:20.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.902+0000 7f8ac4abb800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.903+0000 7f8ac4abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:20.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.903+0000 7f8ac4abb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:20.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.903+0000 7f8ac4abb800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.903+0000 7f8ac4abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:20.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.903+0000 7f8ac4abb800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.904+0000 7f8ac4abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:20.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.904+0000 7f8ac4abb800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.904+0000 7f8ac4abb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:30:20.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.904+0000 7f8ac4abb800 20 searching for the correct realm 2024-09-12T17:30:20.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.907+0000 7f8ac25a5640 0 -- 172.21.15.67:0/256571147 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f8abc0124c0 msgr2=0x7f8abc012920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:20.911 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.910+0000 7f8ac25a5640 0 -- 172.21.15.67:0/256571147 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f8ab8098b60 msgr2=0x7f8ab806b040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:20.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.915+0000 7f8ac4abb800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:30:20.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.915+0000 7f8ac4abb800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:30:20.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.915+0000 7f8ac4abb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:20.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.915+0000 7f8ac4abb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:20.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.915+0000 7f8ac4abb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:20.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.915+0000 7f8ac4abb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:20.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.915+0000 7f8ac4abb800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.915+0000 7f8ac4abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:20.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.915+0000 7f8ac4abb800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.915+0000 7f8ac4abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:20.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.915+0000 7f8ac4abb800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.916+0000 7f8ac4abb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:30:20.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.916+0000 7f8ac4abb800 20 zone default found 2024-09-12T17:30:20.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.916+0000 7f8ac4abb800 4 Realm: () 2024-09-12T17:30:20.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.916+0000 7f8ac4abb800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:30:20.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.916+0000 7f8ac4abb800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:30:20.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.916+0000 7f8ac4abb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:20.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.916+0000 7f8ac4abb800 20 zonegroup default 2024-09-12T17:30:20.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.916+0000 7f8ac4abb800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.916+0000 7f8ac4abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:20.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.916+0000 7f8ac4abb800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.916+0000 7f8ac4abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:20.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.916+0000 7f8ac4abb800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.916+0000 7f8ac4abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:20.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.916+0000 7f8ac4abb800 20 started sync module instance, tier type = 2024-09-12T17:30:20.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.916+0000 7f8ac4abb800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:30:20.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.925+0000 7f8ac4abb800 20 add_watcher() i=0 2024-09-12T17:30:20.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.925+0000 7f8ac4abb800 20 add_watcher() i=1 2024-09-12T17:30:20.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.925+0000 7f8ac4abb800 20 add_watcher() i=2 2024-09-12T17:30:20.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.925+0000 7f8ac4abb800 20 add_watcher() i=3 2024-09-12T17:30:20.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.925+0000 7f8ac4abb800 20 add_watcher() i=4 2024-09-12T17:30:20.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.925+0000 7f8ac4abb800 20 add_watcher() i=5 2024-09-12T17:30:20.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.925+0000 7f8ac4abb800 20 add_watcher() i=6 2024-09-12T17:30:20.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.926+0000 7f8ac4abb800 20 add_watcher() i=7 2024-09-12T17:30:20.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.926+0000 7f8ac4abb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:20.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.928+0000 7f8978fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:20.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.928+0000 7f8ac4abb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:20.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.928+0000 7f8ac4abb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:20.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.928+0000 7f8ac4abb800 5 note: GC not initialized 2024-09-12T17:30:20.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.928+0000 7f88f37fe640 20 reqs_thread_entry: start 2024-09-12T17:30:20.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.928+0000 7f8ac4abb800 20 init_complete bucket index max shards: 1 2024-09-12T17:30:20.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.929+0000 7f8ac4abb800 20 Filter name: none 2024-09-12T17:30:20.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.929+0000 7f88f17fa640 20 reqs_thread_entry: start 2024-09-12T17:30:20.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.929+0000 7f8ac4abb800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.929+0000 7f8ac4abb800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:30:20.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.929+0000 7f8ac4abb800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.930+0000 7f8ac4abb800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:30:20.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.930+0000 7f8ac4abb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:30:20.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.930+0000 7f8ac4abb800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.930+0000 7f8ac4abb800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:30:20.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.930+0000 7f8ac4abb800 20 rados->read ofs=0 len=0 2024-09-12T17:30:20.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.930+0000 7f8ac4abb800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:30:20.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.930+0000 7f8ac4abb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:30:20.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.932+0000 7f8978fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:20.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.933+0000 7f8ac4abb800 20 remove_watcher() i=0 2024-09-12T17:30:20.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.933+0000 7f8ac4abb800 2 removed watcher, disabling cache 2024-09-12T17:30:20.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.934+0000 7f8ac4abb800 20 remove_watcher() i=1 2024-09-12T17:30:20.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.936+0000 7f8ac4abb800 20 remove_watcher() i=2 2024-09-12T17:30:20.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.936+0000 7f8ac4abb800 20 remove_watcher() i=3 2024-09-12T17:30:20.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.937+0000 7f8ac4abb800 20 remove_watcher() i=4 2024-09-12T17:30:20.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.938+0000 7f8ac4abb800 20 remove_watcher() i=5 2024-09-12T17:30:20.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.939+0000 7f8ac4abb800 20 remove_watcher() i=6 2024-09-12T17:30:20.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:20.940+0000 7f8ac4abb800 20 remove_watcher() i=7 2024-09-12T17:30:20.951 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:30:20.952 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:30:20.952 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: a-bucket id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 num_objects: 0 size_kb: 0 num_shards: 3 2024-09-12T17:30:20.952 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:30:20.953 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-12T17:30:20.983 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:20.983 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:21.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.021+0000 7f3056d40800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.022+0000 7f3056d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:21.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.022+0000 7f3056d40800 20 realm 2024-09-12T17:30:21.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.022+0000 7f3056d40800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.023+0000 7f3056d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:21.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.023+0000 7f3056d40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:21.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.023+0000 7f3056d40800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.023+0000 7f3056d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:21.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.023+0000 7f3056d40800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.024+0000 7f3056d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:21.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.024+0000 7f3056d40800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.025+0000 7f3056d40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:30:21.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.025+0000 7f3056d40800 20 searching for the correct realm 2024-09-12T17:30:21.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.027+0000 7f30522bf640 0 -- 172.21.15.67:0/1611298632 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x558f832740c0 msgr2=0x558f832764b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:21.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.030+0000 7f3052ac0640 0 -- 172.21.15.67:0/1611298632 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f303c06abc0 msgr2=0x7f303c07b9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:30:21.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.236+0000 7f3056d40800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:30:21.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.236+0000 7f3056d40800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:30:21.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.236+0000 7f3056d40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:21.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.236+0000 7f3056d40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:21.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.236+0000 7f3056d40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:21.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.236+0000 7f3056d40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:21.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.236+0000 7f3056d40800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.236+0000 7f3056d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:21.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.236+0000 7f3056d40800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.237+0000 7f3056d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:21.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.237+0000 7f3056d40800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.237+0000 7f3056d40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:30:21.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.237+0000 7f3056d40800 20 zone default found 2024-09-12T17:30:21.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.237+0000 7f3056d40800 4 Realm: () 2024-09-12T17:30:21.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.237+0000 7f3056d40800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:30:21.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.237+0000 7f3056d40800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:30:21.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.237+0000 7f3056d40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:21.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.237+0000 7f3056d40800 20 zonegroup default 2024-09-12T17:30:21.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.237+0000 7f3056d40800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.237+0000 7f3056d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:21.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.237+0000 7f3056d40800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.238+0000 7f3056d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:21.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.238+0000 7f3056d40800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.238+0000 7f3056d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:21.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.238+0000 7f3056d40800 20 started sync module instance, tier type = 2024-09-12T17:30:21.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.238+0000 7f3056d40800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:30:21.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.248+0000 7f3056d40800 20 add_watcher() i=0 2024-09-12T17:30:21.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.248+0000 7f3056d40800 20 add_watcher() i=1 2024-09-12T17:30:21.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.248+0000 7f3056d40800 20 add_watcher() i=2 2024-09-12T17:30:21.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.248+0000 7f3056d40800 20 add_watcher() i=3 2024-09-12T17:30:21.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.248+0000 7f3056d40800 20 add_watcher() i=4 2024-09-12T17:30:21.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.248+0000 7f3056d40800 20 add_watcher() i=5 2024-09-12T17:30:21.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.248+0000 7f3056d40800 20 add_watcher() i=6 2024-09-12T17:30:21.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.249+0000 7f3056d40800 20 add_watcher() i=7 2024-09-12T17:30:21.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.249+0000 7f3056d40800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:21.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.250+0000 7f2f097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:21.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.251+0000 7f3056d40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:21.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.251+0000 7f3056d40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:21.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.251+0000 7f3056d40800 5 note: GC not initialized 2024-09-12T17:30:21.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.251+0000 7f2e83fff640 20 reqs_thread_entry: start 2024-09-12T17:30:21.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.251+0000 7f3056d40800 20 init_complete bucket index max shards: 1 2024-09-12T17:30:21.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.251+0000 7f3056d40800 20 Filter name: none 2024-09-12T17:30:21.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.251+0000 7f2e81ffb640 20 reqs_thread_entry: start 2024-09-12T17:30:21.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.251+0000 7f3056d40800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.252+0000 7f3056d40800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:30:21.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.252+0000 7f3056d40800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.253+0000 7f3056d40800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:30:21.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.253+0000 7f3056d40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:30:21.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.254+0000 7f2f097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:21.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.256+0000 7f3056d40800 20 remove_watcher() i=0 2024-09-12T17:30:21.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.256+0000 7f3056d40800 2 removed watcher, disabling cache 2024-09-12T17:30:21.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.257+0000 7f3056d40800 20 remove_watcher() i=1 2024-09-12T17:30:21.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.258+0000 7f3056d40800 20 remove_watcher() i=2 2024-09-12T17:30:21.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.259+0000 7f3056d40800 20 remove_watcher() i=3 2024-09-12T17:30:21.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.260+0000 7f3056d40800 20 remove_watcher() i=4 2024-09-12T17:30:21.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.260+0000 7f3056d40800 20 remove_watcher() i=5 2024-09-12T17:30:21.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.261+0000 7f3056d40800 20 remove_watcher() i=6 2024-09-12T17:30:21.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.263+0000 7f3056d40800 20 remove_watcher() i=7 2024-09-12T17:30:21.276 INFO:tasks.workunit.client.0.smithi067.stderr:rados -p default.rgw.buckets.index setomapval .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-12T17:30:21.302 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:21.303 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:21.319 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T17:30:21.348 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:21.348 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:21.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.386+0000 7ff93f9ad800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.387+0000 7ff93f9ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:21.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.387+0000 7ff93f9ad800 20 realm 2024-09-12T17:30:21.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.387+0000 7ff93f9ad800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.388+0000 7ff93f9ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:21.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.388+0000 7ff93f9ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:21.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.388+0000 7ff93f9ad800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.388+0000 7ff93f9ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:21.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.388+0000 7ff93f9ad800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.388+0000 7ff93f9ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:21.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.388+0000 7ff93f9ad800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.389+0000 7ff93f9ad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:30:21.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.389+0000 7ff93f9ad800 20 searching for the correct realm 2024-09-12T17:30:21.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.592+0000 7ff93cc96640 0 -- 172.21.15.67:0/581462779 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7ff930090020 msgr2=0x7ff93004f3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:21.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.596+0000 7ff93d497640 0 -- 172.21.15.67:0/581462779 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7ff93408d970 msgr2=0x7ff934084410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:21.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.803+0000 7ff93f9ad800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:30:21.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.803+0000 7ff93f9ad800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:30:21.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.803+0000 7ff93f9ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:21.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.803+0000 7ff93f9ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:21.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.803+0000 7ff93f9ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:21.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.803+0000 7ff93f9ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:21.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.803+0000 7ff93f9ad800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.804+0000 7ff93f9ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:21.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.804+0000 7ff93f9ad800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.804+0000 7ff93f9ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:21.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.804+0000 7ff93f9ad800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.804+0000 7ff93f9ad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:30:21.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.804+0000 7ff93f9ad800 20 zone default found 2024-09-12T17:30:21.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.804+0000 7ff93f9ad800 4 Realm: () 2024-09-12T17:30:21.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.804+0000 7ff93f9ad800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:30:21.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.804+0000 7ff93f9ad800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:30:21.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.804+0000 7ff93f9ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:21.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.804+0000 7ff93f9ad800 20 zonegroup default 2024-09-12T17:30:21.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.804+0000 7ff93f9ad800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.805+0000 7ff93f9ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:21.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.805+0000 7ff93f9ad800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.805+0000 7ff93f9ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:21.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.805+0000 7ff93f9ad800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.805+0000 7ff93f9ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:21.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.805+0000 7ff93f9ad800 20 started sync module instance, tier type = 2024-09-12T17:30:21.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.805+0000 7ff93f9ad800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:30:21.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.815+0000 7ff93f9ad800 20 add_watcher() i=0 2024-09-12T17:30:21.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.815+0000 7ff93f9ad800 20 add_watcher() i=1 2024-09-12T17:30:21.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.815+0000 7ff93f9ad800 20 add_watcher() i=2 2024-09-12T17:30:21.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.815+0000 7ff93f9ad800 20 add_watcher() i=3 2024-09-12T17:30:21.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.815+0000 7ff93f9ad800 20 add_watcher() i=4 2024-09-12T17:30:21.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.815+0000 7ff93f9ad800 20 add_watcher() i=5 2024-09-12T17:30:21.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.815+0000 7ff93f9ad800 20 add_watcher() i=6 2024-09-12T17:30:21.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.816+0000 7ff93f9ad800 20 add_watcher() i=7 2024-09-12T17:30:21.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.816+0000 7ff93f9ad800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:21.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.817+0000 7ff7f3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:21.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.818+0000 7ff93f9ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:21.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.818+0000 7ff93f9ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:21.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.818+0000 7ff93f9ad800 5 note: GC not initialized 2024-09-12T17:30:21.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.818+0000 7ff7f2fe5640 20 reqs_thread_entry: start 2024-09-12T17:30:21.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.818+0000 7ff93f9ad800 20 init_complete bucket index max shards: 1 2024-09-12T17:30:21.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.818+0000 7ff93f9ad800 20 Filter name: none 2024-09-12T17:30:21.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.818+0000 7ff7f0fe1640 20 reqs_thread_entry: start 2024-09-12T17:30:21.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.818+0000 7ff93f9ad800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.819+0000 7ff93f9ad800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:30:21.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.819+0000 7ff93f9ad800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.819+0000 7ff93f9ad800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:30:21.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.819+0000 7ff93f9ad800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:30:21.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.819+0000 7ff93f9ad800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T17:30:21.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.819+0000 7ff93f9ad800 20 INFO: main: starting shard=0 2024-09-12T17:30:21.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.819+0000 7ff93f9ad800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 2024-09-12T17:30:21.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.819+0000 7ff93f9ad800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 2024-09-12T17:30:21.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.820+0000 7ff93f9ad800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:30:21.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.820+0000 7ff93f9ad800 20 INFO: main: starting shard=1 2024-09-12T17:30:21.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.820+0000 7ff93f9ad800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.1 2024-09-12T17:30:21.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.820+0000 7ff93f9ad800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.1 2024-09-12T17:30:21.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.820+0000 7ff93f9ad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:30:21.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.820+0000 7ff93f9ad800 20 INFO: main: starting shard=2 2024-09-12T17:30:21.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.820+0000 7ff93f9ad800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.2 2024-09-12T17:30:21.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.820+0000 7ff93f9ad800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.2 2024-09-12T17:30:21.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.821+0000 7ff93f9ad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:30:21.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.821+0000 7ff93f9ad800 20 INFO: main: done 2024-09-12T17:30:21.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.822+0000 7ff7f3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:21.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.824+0000 7ff93f9ad800 20 remove_watcher() i=0 2024-09-12T17:30:21.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.824+0000 7ff93f9ad800 2 removed watcher, disabling cache 2024-09-12T17:30:21.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.825+0000 7ff93f9ad800 20 remove_watcher() i=1 2024-09-12T17:30:21.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.826+0000 7ff93f9ad800 20 remove_watcher() i=2 2024-09-12T17:30:21.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.827+0000 7ff93f9ad800 20 remove_watcher() i=3 2024-09-12T17:30:21.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.828+0000 7ff93f9ad800 20 remove_watcher() i=4 2024-09-12T17:30:21.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.829+0000 7ff93f9ad800 20 remove_watcher() i=5 2024-09-12T17:30:21.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.830+0000 7ff93f9ad800 20 remove_watcher() i=6 2024-09-12T17:30:21.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.831+0000 7ff93f9ad800 20 remove_watcher() i=7 2024-09-12T17:30:21.845 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-12T17:30:21.878 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:21.879 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:21.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.917+0000 7f735320e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.918+0000 7f735320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:21.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.918+0000 7f735320e800 20 realm 2024-09-12T17:30:21.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.918+0000 7f735320e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.919+0000 7f735320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:21.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.919+0000 7f735320e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:21.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.919+0000 7f735320e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.919+0000 7f735320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:21.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.919+0000 7f735320e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.920+0000 7f735320e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:21.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.920+0000 7f735320e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:21.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.920+0000 7f735320e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:30:21.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.920+0000 7f735320e800 20 searching for the correct realm 2024-09-12T17:30:21.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.922+0000 7f734e16a640 0 -- 172.21.15.67:0/2963168602 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f7340047060 msgr2=0x7f7340073520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:21.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:21.926+0000 7f734e96b640 0 -- 172.21.15.67:0/2963168602 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f734406b070 msgr2=0x7f7344007cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:22.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.132+0000 7f735320e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:30:22.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.132+0000 7f735320e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:30:22.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.132+0000 7f735320e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:22.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.132+0000 7f735320e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:22.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.132+0000 7f735320e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:22.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.132+0000 7f735320e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:22.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.132+0000 7f735320e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.133+0000 7f735320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:22.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.133+0000 7f735320e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.133+0000 7f735320e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:22.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.133+0000 7f735320e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.133+0000 7f735320e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:30:22.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.133+0000 7f735320e800 20 zone default found 2024-09-12T17:30:22.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.133+0000 7f735320e800 4 Realm: () 2024-09-12T17:30:22.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.133+0000 7f735320e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:30:22.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.133+0000 7f735320e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:30:22.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.133+0000 7f735320e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:22.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.133+0000 7f735320e800 20 zonegroup default 2024-09-12T17:30:22.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.133+0000 7f735320e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.133+0000 7f735320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:22.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.134+0000 7f735320e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.134+0000 7f735320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:22.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.134+0000 7f735320e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.134+0000 7f735320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:22.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.134+0000 7f735320e800 20 started sync module instance, tier type = 2024-09-12T17:30:22.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.134+0000 7f735320e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:30:22.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.144+0000 7f735320e800 20 add_watcher() i=0 2024-09-12T17:30:22.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.144+0000 7f735320e800 20 add_watcher() i=1 2024-09-12T17:30:22.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.144+0000 7f735320e800 20 add_watcher() i=2 2024-09-12T17:30:22.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.144+0000 7f735320e800 20 add_watcher() i=3 2024-09-12T17:30:22.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.144+0000 7f735320e800 20 add_watcher() i=4 2024-09-12T17:30:22.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.144+0000 7f735320e800 20 add_watcher() i=5 2024-09-12T17:30:22.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.144+0000 7f735320e800 20 add_watcher() i=6 2024-09-12T17:30:22.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.145+0000 7f735320e800 20 add_watcher() i=7 2024-09-12T17:30:22.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.145+0000 7f735320e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:22.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.146+0000 7f72057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:22.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.147+0000 7f735320e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:22.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.147+0000 7f735320e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:22.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.147+0000 7f735320e800 5 note: GC not initialized 2024-09-12T17:30:22.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.147+0000 7f717ffff640 20 reqs_thread_entry: start 2024-09-12T17:30:22.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.147+0000 7f735320e800 20 init_complete bucket index max shards: 1 2024-09-12T17:30:22.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.147+0000 7f735320e800 20 Filter name: none 2024-09-12T17:30:22.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.147+0000 7f717dffb640 20 reqs_thread_entry: start 2024-09-12T17:30:22.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.147+0000 7f735320e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:30:22.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.147+0000 7f735320e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.148+0000 7f735320e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:30:22.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.148+0000 7f735320e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:30:22.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.148+0000 7f735320e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:30:22.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.148+0000 7f735320e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : miss 2024-09-12T17:30:22.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.148+0000 7f735320e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.148+0000 7f735320e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:30:22.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.148+0000 7f735320e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:30:22.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.148+0000 7f735320e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:30:22.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.148+0000 7f735320e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:30:22.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.148+0000 7f735320e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:22.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.148+0000 7f735320e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:30:22.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.152+0000 7f735320e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:30:22.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.152+0000 7f735320e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:30:22.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.152+0000 7f735320e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:22.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.152+0000 7f735320e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18, ofs0, ns] 2024-09-12T17:30:22.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.152+0000 7f7231ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464373 cookie 94291781506608 notifier 8619 bl.length()=911 2024-09-12T17:30:22.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.152+0000 7f7231ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:30:22.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.153+0000 7f7231ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:30:22.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.153+0000 7f7231ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:22.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.154+0000 7f735320e800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_sources= new_sources= 2024-09-12T17:30:22.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.154+0000 7f735320e800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:30:22.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.154+0000 7f735320e800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_dests= new_dests= 2024-09-12T17:30:22.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.154+0000 7f735320e800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:30:22.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.157+0000 7f735320e800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.0 2024-09-12T17:30:22.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.157+0000 7f735320e800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.0 2024-09-12T17:30:22.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.157+0000 7f735320e800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 2024-09-12T17:30:22.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.157+0000 7f735320e800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 2024-09-12T17:30:22.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.157+0000 7f735320e800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-12T17:30:22.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.157+0000 7f735320e800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.1 2024-09-12T17:30:22.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.157+0000 7f735320e800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.1 2024-09-12T17:30:22.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.158+0000 7f735320e800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.2 2024-09-12T17:30:22.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.158+0000 7f735320e800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.2 2024-09-12T17:30:22.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.158+0000 7f735320e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:30:22.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.158+0000 7f735320e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:30:22.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.160+0000 7f735320e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:30:22.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.160+0000 7f735320e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:30:22.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.160+0000 7f735320e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:22.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.160+0000 7f735320e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18, ofs0, ns] 2024-09-12T17:30:22.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.160+0000 7f7231ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464374 cookie 94291781506608 notifier 8619 bl.length()=911 2024-09-12T17:30:22.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.160+0000 7f7231ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:30:22.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.160+0000 7f7231ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:30:22.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.160+0000 7f7231ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:22.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.162+0000 7f735320e800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_sources= new_sources= 2024-09-12T17:30:22.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.162+0000 7f735320e800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:30:22.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.162+0000 7f735320e800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_dests= new_dests= 2024-09-12T17:30:22.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.162+0000 7f735320e800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:30:22.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.163+0000 7f735320e800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 2024-09-12T17:30:22.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.163+0000 7f735320e800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.0 2024-09-12T17:30:22.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.163+0000 7f735320e800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.1 2024-09-12T17:30:22.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.163+0000 7f735320e800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.1 2024-09-12T17:30:22.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.164+0000 7f735320e800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.2 2024-09-12T17:30:22.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.164+0000 7f735320e800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.2.2 2024-09-12T17:30:22.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.164+0000 7f735320e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:30:22.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.164+0000 7f735320e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 2024-09-12T17:30:22.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.165+0000 7f735320e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:30:22.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.165+0000 7f735320e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:30:22.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.165+0000 7f735320e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:22.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.165+0000 7f735320e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18, ofs0, ns] 2024-09-12T17:30:22.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.166+0000 7f72327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464375 cookie 94291781506608 notifier 8619 bl.length()=879 2024-09-12T17:30:22.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.166+0000 7f72327fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 info.flags=0x17 2024-09-12T17:30:22.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.166+0000 7f72327fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18 to cache LRU end 2024-09-12T17:30:22.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.166+0000 7f72327fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:22.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.167+0000 7f735320e800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_sources= new_sources= 2024-09-12T17:30:22.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.167+0000 7f735320e800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:30:22.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.167+0000 7f735320e800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): orig_dests= new_dests= 2024-09-12T17:30:22.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.167+0000 7f735320e800 20 handle_bi_update(): bucket=:a-bucket[06eb12d0-49d6-461d-9efe-05d212954deb.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:30:22.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.168+0000 7f735320e800 1 execute INFO: reshard of bucket "a-bucket" from 3 shards to 1 shards completed successfully 2024-09-12T17:30:22.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.170+0000 7f72057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:22.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.172+0000 7f735320e800 20 remove_watcher() i=0 2024-09-12T17:30:22.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.172+0000 7f735320e800 2 removed watcher, disabling cache 2024-09-12T17:30:22.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.173+0000 7f735320e800 20 remove_watcher() i=1 2024-09-12T17:30:22.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.174+0000 7f735320e800 20 remove_watcher() i=2 2024-09-12T17:30:22.176 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.175+0000 7f735320e800 20 remove_watcher() i=3 2024-09-12T17:30:22.177 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.176+0000 7f735320e800 20 remove_watcher() i=4 2024-09-12T17:30:22.178 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.177+0000 7f735320e800 20 remove_watcher() i=5 2024-09-12T17:30:22.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.178+0000 7f735320e800 20 remove_watcher() i=6 2024-09-12T17:30:22.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.179+0000 7f735320e800 20 remove_watcher() i=7 2024-09-12T17:30:22.192 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T17:30:22.222 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:22.222 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:22.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.261+0000 7f163fe1b800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.262+0000 7f163fe1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:22.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.262+0000 7f163fe1b800 20 realm 2024-09-12T17:30:22.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.262+0000 7f163fe1b800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.263+0000 7f163fe1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:22.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.263+0000 7f163fe1b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:22.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.263+0000 7f163fe1b800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.263+0000 7f163fe1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:22.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.263+0000 7f163fe1b800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.264+0000 7f163fe1b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:22.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.264+0000 7f163fe1b800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.264+0000 7f163fe1b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:30:22.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.264+0000 7f163fe1b800 20 searching for the correct realm 2024-09-12T17:30:22.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.266+0000 7f163adea640 0 -- 172.21.15.67:0/2265297064 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f162c027040 msgr2=0x7f162c08b740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:22.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.270+0000 7f163b5eb640 0 -- 172.21.15.67:0/2265297064 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f163008d040 msgr2=0x7f16300ab940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:30:22.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.477+0000 7f163fe1b800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:30:22.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.477+0000 7f163fe1b800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:30:22.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.477+0000 7f163fe1b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:22.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.477+0000 7f163fe1b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:22.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.477+0000 7f163fe1b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:22.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.477+0000 7f163fe1b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:22.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.477+0000 7f163fe1b800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.478+0000 7f163fe1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:22.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.478+0000 7f163fe1b800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.478+0000 7f163fe1b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:22.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.478+0000 7f163fe1b800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.478+0000 7f163fe1b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:30:22.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.478+0000 7f163fe1b800 20 zone default found 2024-09-12T17:30:22.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.478+0000 7f163fe1b800 4 Realm: () 2024-09-12T17:30:22.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.478+0000 7f163fe1b800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:30:22.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.478+0000 7f163fe1b800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:30:22.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.478+0000 7f163fe1b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:22.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.478+0000 7f163fe1b800 20 zonegroup default 2024-09-12T17:30:22.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.478+0000 7f163fe1b800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.479+0000 7f163fe1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:22.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.479+0000 7f163fe1b800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.479+0000 7f163fe1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:22.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.479+0000 7f163fe1b800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.479+0000 7f163fe1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:22.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.479+0000 7f163fe1b800 20 started sync module instance, tier type = 2024-09-12T17:30:22.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.479+0000 7f163fe1b800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:30:22.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.488+0000 7f163fe1b800 20 add_watcher() i=0 2024-09-12T17:30:22.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.488+0000 7f163fe1b800 20 add_watcher() i=1 2024-09-12T17:30:22.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.488+0000 7f163fe1b800 20 add_watcher() i=2 2024-09-12T17:30:22.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.488+0000 7f163fe1b800 20 add_watcher() i=3 2024-09-12T17:30:22.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.488+0000 7f163fe1b800 20 add_watcher() i=4 2024-09-12T17:30:22.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.488+0000 7f163fe1b800 20 add_watcher() i=5 2024-09-12T17:30:22.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.488+0000 7f163fe1b800 20 add_watcher() i=6 2024-09-12T17:30:22.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.489+0000 7f163fe1b800 20 add_watcher() i=7 2024-09-12T17:30:22.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.489+0000 7f163fe1b800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:22.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.491+0000 7f14f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:22.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.491+0000 7f163fe1b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:22.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.491+0000 7f163fe1b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:22.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.491+0000 7f163fe1b800 5 note: GC not initialized 2024-09-12T17:30:22.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.492+0000 7f14f0fe1640 20 reqs_thread_entry: start 2024-09-12T17:30:22.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.492+0000 7f163fe1b800 20 init_complete bucket index max shards: 1 2024-09-12T17:30:22.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.492+0000 7f163fe1b800 20 Filter name: none 2024-09-12T17:30:22.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.492+0000 7f146a7fc640 20 reqs_thread_entry: start 2024-09-12T17:30:22.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.492+0000 7f163fe1b800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.492+0000 7f163fe1b800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:30:22.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.492+0000 7f163fe1b800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.493+0000 7f163fe1b800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:30:22.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.493+0000 7f163fe1b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:30:22.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.493+0000 7f163fe1b800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-12T17:30:22.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.493+0000 7f163fe1b800 20 INFO: main: starting shard=0 2024-09-12T17:30:22.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.493+0000 7f163fe1b800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.0 2024-09-12T17:30:22.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.493+0000 7f163fe1b800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.18.3.0 2024-09-12T17:30:22.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.493+0000 7f163fe1b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:30:22.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.493+0000 7f163fe1b800 20 INFO: main: done 2024-09-12T17:30:22.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.494+0000 7f14f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:22.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.496+0000 7f163fe1b800 20 remove_watcher() i=0 2024-09-12T17:30:22.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.496+0000 7f163fe1b800 2 removed watcher, disabling cache 2024-09-12T17:30:22.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.498+0000 7f163fe1b800 20 remove_watcher() i=1 2024-09-12T17:30:22.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.499+0000 7f163fe1b800 20 remove_watcher() i=2 2024-09-12T17:30:22.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.500+0000 7f163fe1b800 20 remove_watcher() i=3 2024-09-12T17:30:22.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.501+0000 7f163fe1b800 20 remove_watcher() i=4 2024-09-12T17:30:22.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.502+0000 7f163fe1b800 20 remove_watcher() i=5 2024-09-12T17:30:22.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.503+0000 7f163fe1b800 20 remove_watcher() i=6 2024-09-12T17:30:22.504 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.504+0000 7f163fe1b800 20 remove_watcher() i=7 2024-09-12T17:30:22.516 INFO:tasks.workunit.client.0.smithi067.stderr: test: PUT succeeds during reshard 2024-09-12T17:30:22.517 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:30:22.548 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:22.548 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:22.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.585+0000 7ff507719800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.587+0000 7ff507719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:22.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.587+0000 7ff507719800 20 realm 2024-09-12T17:30:22.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.587+0000 7ff507719800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.587+0000 7ff507719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:22.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.587+0000 7ff507719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:22.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.587+0000 7ff507719800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.587+0000 7ff507719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:22.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.587+0000 7ff507719800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.588+0000 7ff507719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:22.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.588+0000 7ff507719800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.589+0000 7ff507719800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:30:22.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.589+0000 7ff507719800 20 searching for the correct realm 2024-09-12T17:30:22.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.591+0000 7ff504a02640 0 -- 172.21.15.67:0/2817859127 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7ff4f803f070 msgr2=0x7ff4f804d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:22.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.595+0000 7ff505203640 0 -- 172.21.15.67:0/2817859127 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7ff4fc099940 msgr2=0x7ff4fc08b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:22.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.801+0000 7ff507719800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:30:22.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.801+0000 7ff507719800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:30:22.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.801+0000 7ff507719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:22.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.801+0000 7ff507719800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:22.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.801+0000 7ff507719800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:22.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.801+0000 7ff507719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:22.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.801+0000 7ff507719800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.802+0000 7ff507719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:22.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.802+0000 7ff507719800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.802+0000 7ff507719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:22.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.802+0000 7ff507719800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.803+0000 7ff507719800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:30:22.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.803+0000 7ff507719800 20 zone default found 2024-09-12T17:30:22.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.803+0000 7ff507719800 4 Realm: () 2024-09-12T17:30:22.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.803+0000 7ff507719800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:30:22.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.803+0000 7ff507719800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:30:22.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.803+0000 7ff507719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:22.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.803+0000 7ff507719800 20 zonegroup default 2024-09-12T17:30:22.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.803+0000 7ff507719800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.803+0000 7ff507719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:22.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.803+0000 7ff507719800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.803+0000 7ff507719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:22.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.803+0000 7ff507719800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.804+0000 7ff507719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:22.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.804+0000 7ff507719800 20 started sync module instance, tier type = 2024-09-12T17:30:22.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.804+0000 7ff507719800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:30:22.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.812+0000 7ff507719800 20 add_watcher() i=0 2024-09-12T17:30:22.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.812+0000 7ff507719800 20 add_watcher() i=1 2024-09-12T17:30:22.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.812+0000 7ff507719800 20 add_watcher() i=2 2024-09-12T17:30:22.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.812+0000 7ff507719800 20 add_watcher() i=3 2024-09-12T17:30:22.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.812+0000 7ff507719800 20 add_watcher() i=4 2024-09-12T17:30:22.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.812+0000 7ff507719800 20 add_watcher() i=5 2024-09-12T17:30:22.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.812+0000 7ff507719800 20 add_watcher() i=6 2024-09-12T17:30:22.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.813+0000 7ff507719800 20 add_watcher() i=7 2024-09-12T17:30:22.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.813+0000 7ff507719800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:22.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.815+0000 7ff3bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:22.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.816+0000 7ff507719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:22.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.816+0000 7ff507719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:22.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.816+0000 7ff507719800 5 note: GC not initialized 2024-09-12T17:30:22.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.816+0000 7ff3ba7e4640 20 reqs_thread_entry: start 2024-09-12T17:30:22.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.816+0000 7ff507719800 20 init_complete bucket index max shards: 1 2024-09-12T17:30:22.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.816+0000 7ff507719800 20 Filter name: none 2024-09-12T17:30:22.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.816+0000 7ff32bfff640 20 reqs_thread_entry: start 2024-09-12T17:30:22.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.816+0000 7ff507719800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.817+0000 7ff507719800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:30:22.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.817+0000 7ff507719800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.817+0000 7ff507719800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:30:22.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.817+0000 7ff507719800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:30:22.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.817+0000 7ff507719800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.817+0000 7ff507719800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:30:22.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.817+0000 7ff507719800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.818+0000 7ff507719800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:30:22.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.818+0000 7ff507719800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:30:22.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.819+0000 7ff3bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:22.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.821+0000 7ff507719800 20 remove_watcher() i=0 2024-09-12T17:30:22.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.821+0000 7ff507719800 2 removed watcher, disabling cache 2024-09-12T17:30:22.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.822+0000 7ff507719800 20 remove_watcher() i=1 2024-09-12T17:30:22.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.823+0000 7ff507719800 20 remove_watcher() i=2 2024-09-12T17:30:22.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.824+0000 7ff507719800 20 remove_watcher() i=3 2024-09-12T17:30:22.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.825+0000 7ff507719800 20 remove_watcher() i=4 2024-09-12T17:30:22.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.826+0000 7ff507719800 20 remove_watcher() i=5 2024-09-12T17:30:22.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.827+0000 7ff507719800 20 remove_watcher() i=6 2024-09-12T17:30:22.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.828+0000 7ff507719800 20 remove_watcher() i=7 2024-09-12T17:30:22.840 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:30:22.841 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T17:30:22.841 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: myver id: 06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T17:30:22.841 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:30:22.842 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 3 2024-09-12T17:30:22.875 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:22.875 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:22.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.913+0000 7fed38b46800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.915+0000 7fed38b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:22.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.915+0000 7fed38b46800 20 realm 2024-09-12T17:30:22.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.915+0000 7fed38b46800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.915+0000 7fed38b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:22.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.915+0000 7fed38b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:22.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.915+0000 7fed38b46800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.915+0000 7fed38b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:22.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.915+0000 7fed38b46800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.916+0000 7fed38b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:22.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.916+0000 7fed38b46800 20 rados->read ofs=0 len=0 2024-09-12T17:30:22.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.916+0000 7fed38b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:30:22.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.916+0000 7fed38b46800 20 searching for the correct realm 2024-09-12T17:30:22.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.919+0000 7fed35e36640 0 -- 172.21.15.67:0/768538283 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x557fa3dd1020 msgr2=0x557fa3dd3430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:22.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:22.922+0000 7fed36637640 0 -- 172.21.15.67:0/768538283 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fed2c008070 msgr2=0x7fed2c063a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:23.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.127+0000 7fed38b46800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:30:23.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.127+0000 7fed38b46800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:30:23.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.127+0000 7fed38b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:23.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.127+0000 7fed38b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:23.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.127+0000 7fed38b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:23.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.127+0000 7fed38b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:23.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.127+0000 7fed38b46800 20 rados->read ofs=0 len=0 2024-09-12T17:30:23.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.128+0000 7fed38b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:23.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.128+0000 7fed38b46800 20 rados->read ofs=0 len=0 2024-09-12T17:30:23.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.128+0000 7fed38b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:23.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.128+0000 7fed38b46800 20 rados->read ofs=0 len=0 2024-09-12T17:30:23.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.128+0000 7fed38b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:30:23.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.128+0000 7fed38b46800 20 zone default found 2024-09-12T17:30:23.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.128+0000 7fed38b46800 4 Realm: () 2024-09-12T17:30:23.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.128+0000 7fed38b46800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:30:23.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.128+0000 7fed38b46800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:30:23.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.128+0000 7fed38b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:23.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.128+0000 7fed38b46800 20 zonegroup default 2024-09-12T17:30:23.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.128+0000 7fed38b46800 20 rados->read ofs=0 len=0 2024-09-12T17:30:23.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.128+0000 7fed38b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:23.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.128+0000 7fed38b46800 20 rados->read ofs=0 len=0 2024-09-12T17:30:23.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.129+0000 7fed38b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:23.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.129+0000 7fed38b46800 20 rados->read ofs=0 len=0 2024-09-12T17:30:23.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.129+0000 7fed38b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:23.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.129+0000 7fed38b46800 20 started sync module instance, tier type = 2024-09-12T17:30:23.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.129+0000 7fed38b46800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:30:23.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.138+0000 7fed38b46800 20 add_watcher() i=0 2024-09-12T17:30:23.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.138+0000 7fed38b46800 20 add_watcher() i=1 2024-09-12T17:30:23.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.138+0000 7fed38b46800 20 add_watcher() i=2 2024-09-12T17:30:23.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.138+0000 7fed38b46800 20 add_watcher() i=3 2024-09-12T17:30:23.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.138+0000 7fed38b46800 20 add_watcher() i=4 2024-09-12T17:30:23.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.138+0000 7fed38b46800 20 add_watcher() i=5 2024-09-12T17:30:23.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.138+0000 7fed38b46800 20 add_watcher() i=6 2024-09-12T17:30:23.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.139+0000 7fed38b46800 20 add_watcher() i=7 2024-09-12T17:30:23.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.139+0000 7fed38b46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:23.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.141+0000 7febecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:23.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.141+0000 7fed38b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:23.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.141+0000 7fed38b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:23.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.141+0000 7fed38b46800 5 note: GC not initialized 2024-09-12T17:30:23.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.141+0000 7feb677fe640 20 reqs_thread_entry: start 2024-09-12T17:30:23.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.141+0000 7fed38b46800 20 init_complete bucket index max shards: 1 2024-09-12T17:30:23.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.142+0000 7fed38b46800 20 Filter name: none 2024-09-12T17:30:23.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.142+0000 7feb657fa640 20 reqs_thread_entry: start 2024-09-12T17:30:23.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.142+0000 7fed38b46800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:30:23.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.142+0000 7fed38b46800 20 rados->read ofs=0 len=0 2024-09-12T17:30:23.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.142+0000 7fed38b46800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:30:23.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.142+0000 7fed38b46800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:30:23.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.142+0000 7fed38b46800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:30:23.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.142+0000 7fed38b46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 : miss 2024-09-12T17:30:23.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.142+0000 7fed38b46800 20 rados->read ofs=0 len=0 2024-09-12T17:30:23.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.142+0000 7fed38b46800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:30:23.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.142+0000 7fed38b46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 info.flags=0x17 2024-09-12T17:30:23.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.142+0000 7fed38b46800 10 adding default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 to cache LRU end 2024-09-12T17:30:23.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.142+0000 7fed38b46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:30:23.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.142+0000 7fed38b46800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:23.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.142+0000 7fed38b46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 2024-09-12T17:30:23.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.146+0000 7fed38b46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 info.flags=0x17 2024-09-12T17:30:23.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.146+0000 7fed38b46800 10 moving default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 to cache LRU end 2024-09-12T17:30:23.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.146+0000 7fed38b46800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:23.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.146+0000 7fed38b46800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19, ofs0, ns] 2024-09-12T17:30:23.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.146+0000 7fec197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464302 cookie 94006698418032 notifier 8120 bl.length()=905 2024-09-12T17:30:23.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.146+0000 7fec197fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 info.flags=0x17 2024-09-12T17:30:23.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.146+0000 7fec197fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 to cache LRU end 2024-09-12T17:30:23.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.146+0000 7fec197fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:23.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.148+0000 7fed38b46800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): orig_sources= new_sources= 2024-09-12T17:30:23.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.148+0000 7fed38b46800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): potential sources added=[] removed=[] 2024-09-12T17:30:23.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.148+0000 7fed38b46800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): orig_dests= new_dests= 2024-09-12T17:30:23.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.148+0000 7fed38b46800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): potential dests added=[] removed=[] 2024-09-12T17:30:23.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:23.150+0000 7fed38b46800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-12T17:30:23.846 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:30:23.846 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:30:23.907 INFO:tasks.workunit.client.0.smithi067.stderr:put object successful 2024-09-12T17:30:28.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.151+0000 7fed38b46800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.0 2024-09-12T17:30:28.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.151+0000 7fed38b46800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.0 2024-09-12T17:30:28.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.151+0000 7fed38b46800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.1 2024-09-12T17:30:28.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.151+0000 7fed38b46800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.1 2024-09-12T17:30:28.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.151+0000 7fed38b46800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.2 2024-09-12T17:30:28.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.151+0000 7fed38b46800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.2 2024-09-12T17:30:28.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.151+0000 7fed38b46800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.1.0 2024-09-12T17:30:28.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.151+0000 7fed38b46800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.1.0 2024-09-12T17:30:28.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.152+0000 7fed38b46800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.1.1 2024-09-12T17:30:28.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.152+0000 7fed38b46800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.1.1 2024-09-12T17:30:28.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.155+0000 7fed38b46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:30:28.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.155+0000 7fed38b46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 2024-09-12T17:30:28.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.156+0000 7fed38b46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 info.flags=0x17 2024-09-12T17:30:28.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.156+0000 7fed38b46800 10 moving default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 to cache LRU end 2024-09-12T17:30:28.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.156+0000 7fed38b46800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:28.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.156+0000 7fed38b46800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19, ofs0, ns] 2024-09-12T17:30:28.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.157+0000 7fec19ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464303 cookie 94006698418032 notifier 8120 bl.length()=905 2024-09-12T17:30:28.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.157+0000 7fec19ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 info.flags=0x17 2024-09-12T17:30:28.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.157+0000 7fec19ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 to cache LRU end 2024-09-12T17:30:28.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.157+0000 7fec19ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:28.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.159+0000 7fed38b46800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): orig_sources= new_sources= 2024-09-12T17:30:28.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.159+0000 7fed38b46800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): potential sources added=[] removed=[] 2024-09-12T17:30:28.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.159+0000 7fed38b46800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): orig_dests= new_dests= 2024-09-12T17:30:28.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.159+0000 7fed38b46800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): potential dests added=[] removed=[] 2024-09-12T17:30:28.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.161+0000 7fed38b46800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.1.0 2024-09-12T17:30:28.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.161+0000 7fed38b46800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.1.0 2024-09-12T17:30:28.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.161+0000 7fed38b46800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.1.1 2024-09-12T17:30:28.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.161+0000 7fed38b46800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.1.1 2024-09-12T17:30:28.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.164+0000 7fed38b46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:30:28.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.164+0000 7fed38b46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 2024-09-12T17:30:28.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.165+0000 7fed38b46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 info.flags=0x17 2024-09-12T17:30:28.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.165+0000 7fed38b46800 10 moving default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 to cache LRU end 2024-09-12T17:30:28.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.165+0000 7fed38b46800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:28.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.165+0000 7fed38b46800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19, ofs0, ns] 2024-09-12T17:30:28.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.166+0000 7fec19ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464304 cookie 94006698418032 notifier 8120 bl.length()=873 2024-09-12T17:30:28.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.166+0000 7fec19ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 info.flags=0x17 2024-09-12T17:30:28.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.166+0000 7fec19ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 to cache LRU end 2024-09-12T17:30:28.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.166+0000 7fec19ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:28.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.168+0000 7fed38b46800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): orig_sources= new_sources= 2024-09-12T17:30:28.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.168+0000 7fed38b46800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): potential sources added=[] removed=[] 2024-09-12T17:30:28.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.168+0000 7fed38b46800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): orig_dests= new_dests= 2024-09-12T17:30:28.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.168+0000 7fed38b46800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): potential dests added=[] removed=[] 2024-09-12T17:30:28.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.169+0000 7fed38b46800 1 execute INFO: reshard of bucket "myver" from 2 shards to 3 shards completed successfully 2024-09-12T17:30:28.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.172+0000 7febecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:28.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.174+0000 7fed38b46800 20 remove_watcher() i=0 2024-09-12T17:30:28.176 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.174+0000 7fed38b46800 2 removed watcher, disabling cache 2024-09-12T17:30:28.176 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.176+0000 7fed38b46800 20 remove_watcher() i=1 2024-09-12T17:30:28.178 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.177+0000 7fed38b46800 20 remove_watcher() i=2 2024-09-12T17:30:28.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.178+0000 7fed38b46800 20 remove_watcher() i=3 2024-09-12T17:30:28.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.180+0000 7fed38b46800 20 remove_watcher() i=4 2024-09-12T17:30:28.181 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.181+0000 7fed38b46800 20 remove_watcher() i=5 2024-09-12T17:30:28.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.182+0000 7fed38b46800 20 remove_watcher() i=6 2024-09-12T17:30:28.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:28.183+0000 7fed38b46800 20 remove_watcher() i=7 2024-09-12T17:30:28.912 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-12T17:30:28.913 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T17:30:28.917 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:30:28.918 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:30:28.950 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:30:28.950 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:30:29.017 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:30:29.017 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:30:29.072 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:30:29.072 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:30:29.098 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:30:29.098 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:30:29.151 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:30:29.152 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:30:29.177 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:30:29.177 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:30:29.228 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:30:29.228 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:30:29.254 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:30:29.674 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:30:31.085 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:30:31.085 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:30:31.176 INFO:tasks.workunit.client.0.smithi067.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:30:31.178 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-12T17:30:31.211 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:31.212 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:31.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.253+0000 7f5f3031f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:31.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.256+0000 7f5f3031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:31.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.256+0000 7f5f3031f800 20 realm 2024-09-12T17:30:31.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.256+0000 7f5f3031f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:31.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.256+0000 7f5f3031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:31.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.256+0000 7f5f3031f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:31.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.256+0000 7f5f3031f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:31.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.256+0000 7f5f3031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:31.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.256+0000 7f5f3031f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:31.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.257+0000 7f5f3031f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:31.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.257+0000 7f5f3031f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:31.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.258+0000 7f5f3031f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:30:31.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.258+0000 7f5f3031f800 20 searching for the correct realm 2024-09-12T17:30:31.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.261+0000 7f5f2c8aa640 0 -- 172.21.15.67:0/1127971023 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x55718bfabd90 msgr2=0x55718bfae230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:31.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.265+0000 7f5f2c0a9640 0 -- 172.21.15.67:0/1127971023 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f5f14056040 msgr2=0x7f5f14056930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:31.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.270+0000 7f5f3031f800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:30:31.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.270+0000 7f5f3031f800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:30:31.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.270+0000 7f5f3031f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:31.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.270+0000 7f5f3031f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:31.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.270+0000 7f5f3031f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:31.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.270+0000 7f5f3031f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:31.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.270+0000 7f5f3031f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:31.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.270+0000 7f5f3031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:31.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.270+0000 7f5f3031f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:31.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.270+0000 7f5f3031f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:31.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.270+0000 7f5f3031f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:31.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.271+0000 7f5f3031f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:30:31.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.271+0000 7f5f3031f800 20 zone default found 2024-09-12T17:30:31.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.271+0000 7f5f3031f800 4 Realm: () 2024-09-12T17:30:31.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.271+0000 7f5f3031f800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:30:31.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.271+0000 7f5f3031f800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:30:31.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.271+0000 7f5f3031f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:31.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.271+0000 7f5f3031f800 20 zonegroup default 2024-09-12T17:30:31.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.271+0000 7f5f3031f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:31.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.271+0000 7f5f3031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:31.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.271+0000 7f5f3031f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:31.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.271+0000 7f5f3031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:31.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.271+0000 7f5f3031f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:31.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.272+0000 7f5f3031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:31.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.272+0000 7f5f3031f800 20 started sync module instance, tier type = 2024-09-12T17:30:31.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.272+0000 7f5f3031f800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:30:31.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.281+0000 7f5f3031f800 20 add_watcher() i=0 2024-09-12T17:30:31.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.281+0000 7f5f3031f800 20 add_watcher() i=1 2024-09-12T17:30:31.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.281+0000 7f5f3031f800 20 add_watcher() i=2 2024-09-12T17:30:31.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.281+0000 7f5f3031f800 20 add_watcher() i=3 2024-09-12T17:30:31.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.281+0000 7f5f3031f800 20 add_watcher() i=4 2024-09-12T17:30:31.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.281+0000 7f5f3031f800 20 add_watcher() i=5 2024-09-12T17:30:31.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.281+0000 7f5f3031f800 20 add_watcher() i=6 2024-09-12T17:30:31.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.282+0000 7f5f3031f800 20 add_watcher() i=7 2024-09-12T17:30:31.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.282+0000 7f5f3031f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:31.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.284+0000 7f5de2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:31.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.284+0000 7f5f3031f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:31.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.284+0000 7f5f3031f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:31.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.284+0000 7f5f3031f800 5 note: GC not initialized 2024-09-12T17:30:31.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.284+0000 7f5de1fdb640 20 reqs_thread_entry: start 2024-09-12T17:30:31.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.284+0000 7f5f3031f800 20 init_complete bucket index max shards: 1 2024-09-12T17:30:31.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.284+0000 7f5f3031f800 20 Filter name: none 2024-09-12T17:30:31.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.285+0000 7f5d537fe640 20 reqs_thread_entry: start 2024-09-12T17:30:31.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.285+0000 7f5f3031f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:31.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.285+0000 7f5f3031f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:30:31.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.285+0000 7f5f3031f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:31.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.285+0000 7f5f3031f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:30:31.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.285+0000 7f5f3031f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:30:31.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.285+0000 7f5f3031f800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T17:30:31.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.285+0000 7f5f3031f800 20 INFO: main: starting shard=0 2024-09-12T17:30:31.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.285+0000 7f5f3031f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.0 2024-09-12T17:30:31.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.285+0000 7f5f3031f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.0 2024-09-12T17:30:31.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.286+0000 7f5f3031f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:30:31.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.286+0000 7f5f3031f800 20 INFO: main: starting shard=1 2024-09-12T17:30:31.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.286+0000 7f5f3031f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.1 2024-09-12T17:30:31.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.286+0000 7f5f3031f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.1 2024-09-12T17:30:31.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.287+0000 7f5f3031f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:30:31.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.287+0000 7f5f3031f800 20 INFO: main: starting shard=2 2024-09-12T17:30:31.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.287+0000 7f5f3031f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.2 2024-09-12T17:30:31.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.287+0000 7f5f3031f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.2 2024-09-12T17:30:31.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.287+0000 7f5f3031f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:30:31.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.287+0000 7f5f3031f800 20 INFO: main: done 2024-09-12T17:30:31.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.288+0000 7f5de2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:31.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.290+0000 7f5f3031f800 20 remove_watcher() i=0 2024-09-12T17:30:31.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.290+0000 7f5f3031f800 2 removed watcher, disabling cache 2024-09-12T17:30:31.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.292+0000 7f5f3031f800 20 remove_watcher() i=1 2024-09-12T17:30:31.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.293+0000 7f5f3031f800 20 remove_watcher() i=2 2024-09-12T17:30:31.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.294+0000 7f5f3031f800 20 remove_watcher() i=3 2024-09-12T17:30:31.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.295+0000 7f5f3031f800 20 remove_watcher() i=4 2024-09-12T17:30:31.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.296+0000 7f5f3031f800 20 remove_watcher() i=5 2024-09-12T17:30:31.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.297+0000 7f5f3031f800 20 remove_watcher() i=6 2024-09-12T17:30:31.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.298+0000 7f5f3031f800 20 remove_watcher() i=7 2024-09-12T17:30:31.312 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:30:31.312 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:30:31.336 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:30:31.337 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:30:31.420 INFO:tasks.workunit.client.0.smithi067.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:30:31.422 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-12T17:30:31.455 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:31.455 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:31.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.686+0000 7f21feaa3640 0 --2- 172.21.15.67:0/3722717486 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b3333fe40 0x564b333433c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:30:31.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.694+0000 7f220251f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:31.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.696+0000 7f220251f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:31.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.696+0000 7f220251f800 20 realm 2024-09-12T17:30:31.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.696+0000 7f220251f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:31.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.696+0000 7f220251f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:31.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.696+0000 7f220251f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:31.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.696+0000 7f220251f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:31.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.697+0000 7f220251f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:31.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.697+0000 7f220251f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:31.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.698+0000 7f220251f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:31.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.698+0000 7f220251f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:31.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.699+0000 7f220251f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:30:31.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.699+0000 7f220251f800 20 searching for the correct realm 2024-09-12T17:30:31.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.700+0000 7f21f7fff640 0 -- 172.21.15.67:0/3641183530 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f21f0095060 msgr2=0x7f21f00b69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:31.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:31.906+0000 7f21fe2a2640 0 -- 172.21.15.67:0/3641183530 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f21e8028b90 msgr2=0x7f21e8031410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:32.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.113+0000 7f220251f800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:30:32.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.113+0000 7f220251f800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:30:32.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.113+0000 7f220251f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:32.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.113+0000 7f220251f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:32.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.113+0000 7f220251f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:32.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.113+0000 7f220251f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:32.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.113+0000 7f220251f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:32.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.114+0000 7f220251f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:32.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.114+0000 7f220251f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:32.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.114+0000 7f220251f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:32.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.114+0000 7f220251f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:32.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.114+0000 7f220251f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:30:32.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.114+0000 7f220251f800 20 zone default found 2024-09-12T17:30:32.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.114+0000 7f220251f800 4 Realm: () 2024-09-12T17:30:32.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.115+0000 7f220251f800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:30:32.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.115+0000 7f220251f800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:30:32.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.115+0000 7f220251f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:32.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.115+0000 7f220251f800 20 zonegroup default 2024-09-12T17:30:32.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.115+0000 7f220251f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:32.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.115+0000 7f220251f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:32.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.115+0000 7f220251f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:32.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.115+0000 7f220251f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:32.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.115+0000 7f220251f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:32.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.115+0000 7f220251f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:32.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.115+0000 7f220251f800 20 started sync module instance, tier type = 2024-09-12T17:30:32.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.115+0000 7f220251f800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:30:32.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.126+0000 7f220251f800 20 add_watcher() i=0 2024-09-12T17:30:32.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.126+0000 7f220251f800 20 add_watcher() i=1 2024-09-12T17:30:32.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.126+0000 7f220251f800 20 add_watcher() i=2 2024-09-12T17:30:32.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.126+0000 7f220251f800 20 add_watcher() i=3 2024-09-12T17:30:32.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.126+0000 7f220251f800 20 add_watcher() i=4 2024-09-12T17:30:32.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.126+0000 7f220251f800 20 add_watcher() i=5 2024-09-12T17:30:32.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.126+0000 7f220251f800 20 add_watcher() i=6 2024-09-12T17:30:32.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.127+0000 7f220251f800 20 add_watcher() i=7 2024-09-12T17:30:32.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.127+0000 7f220251f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:32.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.129+0000 7f20b4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:32.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.129+0000 7f220251f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:32.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.129+0000 7f220251f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:32.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.129+0000 7f220251f800 5 note: GC not initialized 2024-09-12T17:30:32.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.129+0000 7f202f7fe640 20 reqs_thread_entry: start 2024-09-12T17:30:32.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.129+0000 7f220251f800 20 init_complete bucket index max shards: 1 2024-09-12T17:30:32.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.129+0000 7f220251f800 20 Filter name: none 2024-09-12T17:30:32.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.130+0000 7f202d7fa640 20 reqs_thread_entry: start 2024-09-12T17:30:32.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.130+0000 7f220251f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:32.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.130+0000 7f220251f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:30:32.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.130+0000 7f220251f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:32.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.130+0000 7f220251f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:30:32.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.130+0000 7f220251f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:30:32.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.130+0000 7f220251f800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T17:30:32.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.130+0000 7f220251f800 20 INFO: main: starting shard=0 2024-09-12T17:30:32.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.130+0000 7f220251f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.0 2024-09-12T17:30:32.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.130+0000 7f220251f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.0 2024-09-12T17:30:32.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.131+0000 7f220251f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:30:32.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.131+0000 7f220251f800 20 INFO: main: starting shard=1 2024-09-12T17:30:32.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.131+0000 7f220251f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.1 2024-09-12T17:30:32.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.131+0000 7f220251f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.1 2024-09-12T17:30:32.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.132+0000 7f220251f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:30:32.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.132+0000 7f220251f800 20 INFO: main: starting shard=2 2024-09-12T17:30:32.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.132+0000 7f220251f800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.2 2024-09-12T17:30:32.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.132+0000 7f220251f800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.2 2024-09-12T17:30:32.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.132+0000 7f220251f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:30:32.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.132+0000 7f220251f800 20 INFO: main: done 2024-09-12T17:30:32.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.133+0000 7f20b4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:32.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.136+0000 7f220251f800 20 remove_watcher() i=0 2024-09-12T17:30:32.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.136+0000 7f220251f800 2 removed watcher, disabling cache 2024-09-12T17:30:32.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.137+0000 7f220251f800 20 remove_watcher() i=1 2024-09-12T17:30:32.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.138+0000 7f220251f800 20 remove_watcher() i=2 2024-09-12T17:30:32.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.139+0000 7f220251f800 20 remove_watcher() i=3 2024-09-12T17:30:32.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.140+0000 7f220251f800 20 remove_watcher() i=4 2024-09-12T17:30:32.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.141+0000 7f220251f800 20 remove_watcher() i=5 2024-09-12T17:30:32.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.142+0000 7f220251f800 20 remove_watcher() i=6 2024-09-12T17:30:32.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.143+0000 7f220251f800 20 remove_watcher() i=7 2024-09-12T17:30:32.157 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:30:32.157 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:30:32.181 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:30:32.182 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:30:32.266 INFO:tasks.workunit.client.0.smithi067.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:30:32.267 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-12T17:30:32.299 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:32.299 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:32.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.337+0000 7f6156015800 20 rados->read ofs=0 len=0 2024-09-12T17:30:32.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.339+0000 7f6156015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:32.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.339+0000 7f6156015800 20 realm 2024-09-12T17:30:32.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.339+0000 7f6156015800 20 rados->read ofs=0 len=0 2024-09-12T17:30:32.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.339+0000 7f6156015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:32.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.339+0000 7f6156015800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:32.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.339+0000 7f6156015800 20 rados->read ofs=0 len=0 2024-09-12T17:30:32.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.339+0000 7f6156015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:32.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.339+0000 7f6156015800 20 rados->read ofs=0 len=0 2024-09-12T17:30:32.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.340+0000 7f6156015800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:32.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.340+0000 7f6156015800 20 rados->read ofs=0 len=0 2024-09-12T17:30:32.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.341+0000 7f6156015800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:30:32.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.341+0000 7f6156015800 20 searching for the correct realm 2024-09-12T17:30:32.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.344+0000 7f6151792640 0 -- 172.21.15.67:0/4217292858 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f614c027930 msgr2=0x7f614c0153f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:32.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.347+0000 7f6151792640 0 -- 172.21.15.67:0/4217292858 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f61480a6740 msgr2=0x7f61480ce730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:32.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.554+0000 7f6156015800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:30:32.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.554+0000 7f6156015800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:30:32.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.554+0000 7f6156015800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:32.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.554+0000 7f6156015800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:32.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.554+0000 7f6156015800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:32.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.554+0000 7f6156015800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:32.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.554+0000 7f6156015800 20 rados->read ofs=0 len=0 2024-09-12T17:30:32.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.554+0000 7f6156015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:32.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.554+0000 7f6156015800 20 rados->read ofs=0 len=0 2024-09-12T17:30:32.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.554+0000 7f6156015800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:32.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.554+0000 7f6156015800 20 rados->read ofs=0 len=0 2024-09-12T17:30:32.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.555+0000 7f6156015800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:30:32.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.555+0000 7f6156015800 20 zone default found 2024-09-12T17:30:32.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.555+0000 7f6156015800 4 Realm: () 2024-09-12T17:30:32.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.555+0000 7f6156015800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:30:32.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.555+0000 7f6156015800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:30:32.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.555+0000 7f6156015800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:32.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.555+0000 7f6156015800 20 zonegroup default 2024-09-12T17:30:32.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.555+0000 7f6156015800 20 rados->read ofs=0 len=0 2024-09-12T17:30:32.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.555+0000 7f6156015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:32.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.555+0000 7f6156015800 20 rados->read ofs=0 len=0 2024-09-12T17:30:32.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.556+0000 7f6156015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:32.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.556+0000 7f6156015800 20 rados->read ofs=0 len=0 2024-09-12T17:30:32.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.556+0000 7f6156015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:32.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.556+0000 7f6156015800 20 started sync module instance, tier type = 2024-09-12T17:30:32.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.556+0000 7f6156015800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:30:32.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.566+0000 7f6156015800 20 add_watcher() i=0 2024-09-12T17:30:32.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.566+0000 7f6156015800 20 add_watcher() i=1 2024-09-12T17:30:32.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.566+0000 7f6156015800 20 add_watcher() i=2 2024-09-12T17:30:32.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.566+0000 7f6156015800 20 add_watcher() i=3 2024-09-12T17:30:32.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.566+0000 7f6156015800 20 add_watcher() i=4 2024-09-12T17:30:32.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.566+0000 7f6156015800 20 add_watcher() i=5 2024-09-12T17:30:32.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.566+0000 7f6156015800 20 add_watcher() i=6 2024-09-12T17:30:32.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.567+0000 7f6156015800 20 add_watcher() i=7 2024-09-12T17:30:32.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.567+0000 7f6156015800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:32.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.569+0000 7f6007fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:32.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.569+0000 7f6156015800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:32.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.569+0000 7f6156015800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:32.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.569+0000 7f6156015800 5 note: GC not initialized 2024-09-12T17:30:32.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.570+0000 7f6006fe5640 20 reqs_thread_entry: start 2024-09-12T17:30:32.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.570+0000 7f6156015800 20 init_complete bucket index max shards: 1 2024-09-12T17:30:32.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.570+0000 7f6156015800 20 Filter name: none 2024-09-12T17:30:32.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.570+0000 7f6004fe1640 20 reqs_thread_entry: start 2024-09-12T17:30:32.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.570+0000 7f6156015800 20 rados->read ofs=0 len=0 2024-09-12T17:30:32.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.570+0000 7f6156015800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:30:32.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.570+0000 7f6156015800 20 rados->read ofs=0 len=0 2024-09-12T17:30:32.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.571+0000 7f6156015800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:30:32.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.571+0000 7f6156015800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:30:32.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.571+0000 7f6156015800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T17:30:32.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.571+0000 7f6156015800 20 INFO: main: starting shard=0 2024-09-12T17:30:32.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.571+0000 7f6156015800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.0 2024-09-12T17:30:32.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.571+0000 7f6156015800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.0 2024-09-12T17:30:32.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.571+0000 7f6156015800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:30:32.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.571+0000 7f6156015800 20 INFO: main: starting shard=1 2024-09-12T17:30:32.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.571+0000 7f6156015800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.1 2024-09-12T17:30:32.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.571+0000 7f6156015800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.1 2024-09-12T17:30:32.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.572+0000 7f6156015800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:30:32.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.572+0000 7f6156015800 20 INFO: main: starting shard=2 2024-09-12T17:30:32.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.572+0000 7f6156015800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.2 2024-09-12T17:30:32.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.572+0000 7f6156015800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.2 2024-09-12T17:30:32.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.572+0000 7f6156015800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:30:32.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.572+0000 7f6156015800 20 INFO: main: done 2024-09-12T17:30:32.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.573+0000 7f6007fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:32.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.576+0000 7f6156015800 20 remove_watcher() i=0 2024-09-12T17:30:32.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.576+0000 7f6156015800 2 removed watcher, disabling cache 2024-09-12T17:30:32.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.577+0000 7f6156015800 20 remove_watcher() i=1 2024-09-12T17:30:32.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.578+0000 7f6156015800 20 remove_watcher() i=2 2024-09-12T17:30:32.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.579+0000 7f6156015800 20 remove_watcher() i=3 2024-09-12T17:30:32.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.580+0000 7f6156015800 20 remove_watcher() i=4 2024-09-12T17:30:32.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.581+0000 7f6156015800 20 remove_watcher() i=5 2024-09-12T17:30:32.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.582+0000 7f6156015800 20 remove_watcher() i=6 2024-09-12T17:30:32.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:32.583+0000 7f6156015800 20 remove_watcher() i=7 2024-09-12T17:30:32.597 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:30:32.597 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:30:32.625 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:30:33.031 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:30:33.456 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-12T17:30:33.489 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:33.489 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:33.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.528+0000 7f0633338800 20 rados->read ofs=0 len=0 2024-09-12T17:30:33.531 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.529+0000 7f0633338800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:33.531 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.529+0000 7f0633338800 20 realm 2024-09-12T17:30:33.531 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.529+0000 7f0633338800 20 rados->read ofs=0 len=0 2024-09-12T17:30:33.531 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.530+0000 7f0633338800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:33.531 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.530+0000 7f0633338800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:33.531 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.530+0000 7f0633338800 20 rados->read ofs=0 len=0 2024-09-12T17:30:33.531 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.530+0000 7f0633338800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:33.531 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.530+0000 7f0633338800 20 rados->read ofs=0 len=0 2024-09-12T17:30:33.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.531+0000 7f0633338800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:33.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.531+0000 7f0633338800 20 rados->read ofs=0 len=0 2024-09-12T17:30:33.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.532+0000 7f0633338800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:30:33.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.532+0000 7f0633338800 20 searching for the correct realm 2024-09-12T17:30:33.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.533+0000 7f062f081640 0 -- 172.21.15.67:0/4034101008 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f0618003cb0 msgr2=0x7f062807a9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:33.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.739+0000 7f062e880640 0 -- 172.21.15.67:0/4034101008 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f062006f040 msgr2=0x7f062009b900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:33.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.746+0000 7f0633338800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:30:33.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.746+0000 7f0633338800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:30:33.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.746+0000 7f0633338800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:33.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.746+0000 7f0633338800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:33.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.746+0000 7f0633338800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:33.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.746+0000 7f0633338800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:33.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.746+0000 7f0633338800 20 rados->read ofs=0 len=0 2024-09-12T17:30:33.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.746+0000 7f0633338800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:33.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.746+0000 7f0633338800 20 rados->read ofs=0 len=0 2024-09-12T17:30:33.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.747+0000 7f0633338800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:33.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.747+0000 7f0633338800 20 rados->read ofs=0 len=0 2024-09-12T17:30:33.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.747+0000 7f0633338800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:30:33.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.747+0000 7f0633338800 20 zone default found 2024-09-12T17:30:33.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.747+0000 7f0633338800 4 Realm: () 2024-09-12T17:30:33.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.747+0000 7f0633338800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:30:33.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.747+0000 7f0633338800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:30:33.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.747+0000 7f0633338800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:33.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.747+0000 7f0633338800 20 zonegroup default 2024-09-12T17:30:33.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.747+0000 7f0633338800 20 rados->read ofs=0 len=0 2024-09-12T17:30:33.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.747+0000 7f0633338800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:33.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.747+0000 7f0633338800 20 rados->read ofs=0 len=0 2024-09-12T17:30:33.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.748+0000 7f0633338800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:33.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.748+0000 7f0633338800 20 rados->read ofs=0 len=0 2024-09-12T17:30:33.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.748+0000 7f0633338800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:33.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.748+0000 7f0633338800 20 started sync module instance, tier type = 2024-09-12T17:30:33.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.748+0000 7f0633338800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:30:33.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.758+0000 7f0633338800 20 add_watcher() i=0 2024-09-12T17:30:33.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.758+0000 7f0633338800 20 add_watcher() i=1 2024-09-12T17:30:33.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.758+0000 7f0633338800 20 add_watcher() i=2 2024-09-12T17:30:33.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.758+0000 7f0633338800 20 add_watcher() i=3 2024-09-12T17:30:33.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.758+0000 7f0633338800 20 add_watcher() i=4 2024-09-12T17:30:33.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.758+0000 7f0633338800 20 add_watcher() i=5 2024-09-12T17:30:33.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.758+0000 7f0633338800 20 add_watcher() i=6 2024-09-12T17:30:33.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.758+0000 7f0633338800 20 add_watcher() i=7 2024-09-12T17:30:33.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.758+0000 7f0633338800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:33.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.760+0000 7f04e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:33.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.760+0000 7f0633338800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:33.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.760+0000 7f0633338800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:33.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.760+0000 7f0633338800 5 note: GC not initialized 2024-09-12T17:30:33.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.761+0000 7f04e4fe1640 20 reqs_thread_entry: start 2024-09-12T17:30:33.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.761+0000 7f0633338800 20 init_complete bucket index max shards: 1 2024-09-12T17:30:33.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.761+0000 7f0633338800 20 Filter name: none 2024-09-12T17:30:33.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.761+0000 7f045e7fc640 20 reqs_thread_entry: start 2024-09-12T17:30:33.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.761+0000 7f0633338800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:30:33.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.761+0000 7f0633338800 20 rados->read ofs=0 len=0 2024-09-12T17:30:33.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.761+0000 7f0633338800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:30:33.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.761+0000 7f0633338800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:30:33.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.761+0000 7f0633338800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:30:33.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.761+0000 7f0633338800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 : miss 2024-09-12T17:30:33.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.761+0000 7f0633338800 20 rados->read ofs=0 len=0 2024-09-12T17:30:33.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.762+0000 7f0633338800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:30:33.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.762+0000 7f0633338800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 info.flags=0x17 2024-09-12T17:30:33.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.762+0000 7f0633338800 10 adding default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 to cache LRU end 2024-09-12T17:30:33.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.762+0000 7f0633338800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:30:33.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.762+0000 7f0633338800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:33.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.762+0000 7f0633338800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 2024-09-12T17:30:33.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.768+0000 7f0633338800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 info.flags=0x17 2024-09-12T17:30:33.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.768+0000 7f0633338800 10 moving default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 to cache LRU end 2024-09-12T17:30:33.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.768+0000 7f0633338800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:33.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.768+0000 7f0633338800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19, ofs0, ns] 2024-09-12T17:30:33.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.768+0000 7f05127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464305 cookie 94582930798720 notifier 8201 bl.length()=905 2024-09-12T17:30:33.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.768+0000 7f05127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 info.flags=0x17 2024-09-12T17:30:33.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.768+0000 7f05127fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 to cache LRU end 2024-09-12T17:30:33.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.768+0000 7f05127fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:33.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.770+0000 7f0633338800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): orig_sources= new_sources= 2024-09-12T17:30:33.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.770+0000 7f0633338800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): potential sources added=[] removed=[] 2024-09-12T17:30:33.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.770+0000 7f0633338800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): orig_dests= new_dests= 2024-09-12T17:30:33.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.770+0000 7f0633338800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): potential dests added=[] removed=[] 2024-09-12T17:30:33.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.0 2024-09-12T17:30:33.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.0 2024-09-12T17:30:33.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.1 2024-09-12T17:30:33.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.1 2024-09-12T17:30:33.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.2 2024-09-12T17:30:33.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.2 2024-09-12T17:30:33.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.3 2024-09-12T17:30:33.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.3 2024-09-12T17:30:33.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.4 2024-09-12T17:30:33.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.4 2024-09-12T17:30:33.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.5 2024-09-12T17:30:33.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.5 2024-09-12T17:30:33.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.6 2024-09-12T17:30:33.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.6 2024-09-12T17:30:33.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.7 2024-09-12T17:30:33.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.7 2024-09-12T17:30:33.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.8 2024-09-12T17:30:33.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.8 2024-09-12T17:30:33.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.9 2024-09-12T17:30:33.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.9 2024-09-12T17:30:33.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.10 2024-09-12T17:30:33.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.10 2024-09-12T17:30:33.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.11 2024-09-12T17:30:33.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.11 2024-09-12T17:30:33.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.12 2024-09-12T17:30:33.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.12 2024-09-12T17:30:33.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.13 2024-09-12T17:30:33.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.13 2024-09-12T17:30:33.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.14 2024-09-12T17:30:33.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.14 2024-09-12T17:30:33.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.15 2024-09-12T17:30:33.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.15 2024-09-12T17:30:33.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.16 2024-09-12T17:30:33.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.16 2024-09-12T17:30:33.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.0 2024-09-12T17:30:33.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.0 2024-09-12T17:30:33.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.1 2024-09-12T17:30:33.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.773+0000 7f0633338800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.1 2024-09-12T17:30:33.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.774+0000 7f0633338800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.2 2024-09-12T17:30:33.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.774+0000 7f0633338800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.2 2024-09-12T17:30:33.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.776+0000 7f0633338800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:30:33.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.776+0000 7f0633338800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 2024-09-12T17:30:33.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.778+0000 7f0633338800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 info.flags=0x17 2024-09-12T17:30:33.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.778+0000 7f0633338800 10 moving default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 to cache LRU end 2024-09-12T17:30:33.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.778+0000 7f0633338800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:33.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.778+0000 7f0633338800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19, ofs0, ns] 2024-09-12T17:30:33.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.778+0000 7f05127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464306 cookie 94582930798720 notifier 8201 bl.length()=905 2024-09-12T17:30:33.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.778+0000 7f05127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 info.flags=0x17 2024-09-12T17:30:33.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.778+0000 7f05127fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 to cache LRU end 2024-09-12T17:30:33.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.778+0000 7f05127fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:33.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.780+0000 7f0633338800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): orig_sources= new_sources= 2024-09-12T17:30:33.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.780+0000 7f0633338800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): potential sources added=[] removed=[] 2024-09-12T17:30:33.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.780+0000 7f0633338800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): orig_dests= new_dests= 2024-09-12T17:30:33.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.780+0000 7f0633338800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): potential dests added=[] removed=[] 2024-09-12T17:30:33.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.781+0000 7f0633338800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.0 2024-09-12T17:30:33.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.781+0000 7f0633338800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.0 2024-09-12T17:30:33.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.782+0000 7f0633338800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.1 2024-09-12T17:30:33.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.782+0000 7f0633338800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.1 2024-09-12T17:30:33.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.782+0000 7f0633338800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.2 2024-09-12T17:30:33.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.782+0000 7f0633338800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.2.2 2024-09-12T17:30:33.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.782+0000 7f0633338800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:30:33.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.782+0000 7f0633338800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 2024-09-12T17:30:33.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.784+0000 7f0633338800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 info.flags=0x17 2024-09-12T17:30:33.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.784+0000 7f0633338800 10 moving default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 to cache LRU end 2024-09-12T17:30:33.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.784+0000 7f0633338800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:33.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.784+0000 7f0633338800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19, ofs0, ns] 2024-09-12T17:30:33.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.784+0000 7f0512ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464307 cookie 94582930798720 notifier 8201 bl.length()=873 2024-09-12T17:30:33.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.784+0000 7f0512ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 info.flags=0x17 2024-09-12T17:30:33.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.784+0000 7f0512ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 to cache LRU end 2024-09-12T17:30:33.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.784+0000 7f0512ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:33.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.786+0000 7f0633338800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): orig_sources= new_sources= 2024-09-12T17:30:33.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.786+0000 7f0633338800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): potential sources added=[] removed=[] 2024-09-12T17:30:33.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.786+0000 7f0633338800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): orig_dests= new_dests= 2024-09-12T17:30:33.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.786+0000 7f0633338800 20 handle_bi_update(): bucket=:myver[06eb12d0-49d6-461d-9efe-05d212954deb.4538.19]): potential dests added=[] removed=[] 2024-09-12T17:30:33.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.787+0000 7f0633338800 1 execute INFO: reshard of bucket "myver" from 3 shards to 17 shards completed successfully 2024-09-12T17:30:33.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.789+0000 7f04e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:33.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.791+0000 7f0633338800 20 remove_watcher() i=0 2024-09-12T17:30:33.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.791+0000 7f0633338800 2 removed watcher, disabling cache 2024-09-12T17:30:33.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.793+0000 7f0633338800 20 remove_watcher() i=1 2024-09-12T17:30:33.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.794+0000 7f0633338800 20 remove_watcher() i=2 2024-09-12T17:30:33.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.795+0000 7f0633338800 20 remove_watcher() i=3 2024-09-12T17:30:33.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.796+0000 7f0633338800 20 remove_watcher() i=4 2024-09-12T17:30:33.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.797+0000 7f0633338800 20 remove_watcher() i=5 2024-09-12T17:30:33.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.798+0000 7f0633338800 20 remove_watcher() i=6 2024-09-12T17:30:33.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.799+0000 7f0633338800 20 remove_watcher() i=7 2024-09-12T17:30:33.812 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:30:33.848 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:33.848 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:33.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.886+0000 7f8ad4c40800 20 rados->read ofs=0 len=0 2024-09-12T17:30:33.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.887+0000 7f8ad4c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:33.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.887+0000 7f8ad4c40800 20 realm 2024-09-12T17:30:33.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.887+0000 7f8ad4c40800 20 rados->read ofs=0 len=0 2024-09-12T17:30:33.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.887+0000 7f8ad4c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:33.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.887+0000 7f8ad4c40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:33.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.887+0000 7f8ad4c40800 20 rados->read ofs=0 len=0 2024-09-12T17:30:33.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.888+0000 7f8ad4c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:33.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.888+0000 7f8ad4c40800 20 rados->read ofs=0 len=0 2024-09-12T17:30:33.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.888+0000 7f8ad4c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:33.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.888+0000 7f8ad4c40800 20 rados->read ofs=0 len=0 2024-09-12T17:30:33.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.889+0000 7f8ad4c40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:30:33.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.889+0000 7f8ad4c40800 20 searching for the correct realm 2024-09-12T17:30:33.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.892+0000 7f8ad272a640 0 -- 172.21.15.67:0/2482054251 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f8acc064f00 msgr2=0x7f8acc063970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:33.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:33.896+0000 7f8ad272a640 0 -- 172.21.15.67:0/2482054251 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f8ac8001c20 msgr2=0x7f8ac80a1150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:30:34.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.102+0000 7f8ad4c40800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:30:34.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.102+0000 7f8ad4c40800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:30:34.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.102+0000 7f8ad4c40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:34.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.102+0000 7f8ad4c40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:34.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.102+0000 7f8ad4c40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:34.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.102+0000 7f8ad4c40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:34.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.102+0000 7f8ad4c40800 20 rados->read ofs=0 len=0 2024-09-12T17:30:34.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.103+0000 7f8ad4c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:34.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.103+0000 7f8ad4c40800 20 rados->read ofs=0 len=0 2024-09-12T17:30:34.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.103+0000 7f8ad4c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:34.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.103+0000 7f8ad4c40800 20 rados->read ofs=0 len=0 2024-09-12T17:30:34.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.103+0000 7f8ad4c40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:30:34.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.103+0000 7f8ad4c40800 20 zone default found 2024-09-12T17:30:34.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.103+0000 7f8ad4c40800 4 Realm: () 2024-09-12T17:30:34.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.103+0000 7f8ad4c40800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:30:34.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.103+0000 7f8ad4c40800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:30:34.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.103+0000 7f8ad4c40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:34.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.103+0000 7f8ad4c40800 20 zonegroup default 2024-09-12T17:30:34.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.103+0000 7f8ad4c40800 20 rados->read ofs=0 len=0 2024-09-12T17:30:34.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.104+0000 7f8ad4c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:34.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.104+0000 7f8ad4c40800 20 rados->read ofs=0 len=0 2024-09-12T17:30:34.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.104+0000 7f8ad4c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:34.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.104+0000 7f8ad4c40800 20 rados->read ofs=0 len=0 2024-09-12T17:30:34.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.104+0000 7f8ad4c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:34.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.104+0000 7f8ad4c40800 20 started sync module instance, tier type = 2024-09-12T17:30:34.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.104+0000 7f8ad4c40800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:30:34.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.113+0000 7f8ad4c40800 20 add_watcher() i=0 2024-09-12T17:30:34.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.113+0000 7f8ad4c40800 20 add_watcher() i=1 2024-09-12T17:30:34.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.113+0000 7f8ad4c40800 20 add_watcher() i=2 2024-09-12T17:30:34.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.113+0000 7f8ad4c40800 20 add_watcher() i=3 2024-09-12T17:30:34.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.113+0000 7f8ad4c40800 20 add_watcher() i=4 2024-09-12T17:30:34.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.113+0000 7f8ad4c40800 20 add_watcher() i=5 2024-09-12T17:30:34.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.113+0000 7f8ad4c40800 20 add_watcher() i=6 2024-09-12T17:30:34.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.114+0000 7f8ad4c40800 20 add_watcher() i=7 2024-09-12T17:30:34.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.114+0000 7f8ad4c40800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:34.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.116+0000 7f8988fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:34.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.117+0000 7f8ad4c40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:34.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.117+0000 7f8ad4c40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:34.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.117+0000 7f8ad4c40800 5 note: GC not initialized 2024-09-12T17:30:34.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.117+0000 7f89037fe640 20 reqs_thread_entry: start 2024-09-12T17:30:34.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.117+0000 7f8ad4c40800 20 init_complete bucket index max shards: 1 2024-09-12T17:30:34.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.117+0000 7f8ad4c40800 20 Filter name: none 2024-09-12T17:30:34.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.117+0000 7f89017fa640 20 reqs_thread_entry: start 2024-09-12T17:30:34.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.117+0000 7f8ad4c40800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:30:34.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.117+0000 7f8ad4c40800 20 rados->read ofs=0 len=0 2024-09-12T17:30:34.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.118+0000 7f8ad4c40800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:30:34.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.118+0000 7f8ad4c40800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:30:34.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.118+0000 7f8ad4c40800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:30:34.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.118+0000 7f8ad4c40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 : miss 2024-09-12T17:30:34.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.118+0000 7f8ad4c40800 20 rados->read ofs=0 len=0 2024-09-12T17:30:34.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.118+0000 7f8ad4c40800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:30:34.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.118+0000 7f8ad4c40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 info.flags=0x17 2024-09-12T17:30:34.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.118+0000 7f8ad4c40800 10 adding default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 to cache LRU end 2024-09-12T17:30:34.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.118+0000 7f8ad4c40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:30:34.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.118+0000 7f8ad4c40800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:30:34.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.118+0000 7f8ad4c40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19 2024-09-12T17:30:34.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.118+0000 7f8ad4c40800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.0 2024-09-12T17:30:34.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.118+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.0 2024-09-12T17:30:34.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.119+0000 7f8ad4c40800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:30:34.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.119+0000 7f8ad4c40800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.1 2024-09-12T17:30:34.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.119+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.1 2024-09-12T17:30:34.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.119+0000 7f8ad4c40800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T17:30:34.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.119+0000 7f8ad4c40800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.2 2024-09-12T17:30:34.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.119+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.2 2024-09-12T17:30:34.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.120+0000 7f8ad4c40800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:30:34.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.120+0000 7f8ad4c40800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.3 2024-09-12T17:30:34.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.120+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.3 2024-09-12T17:30:34.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.121+0000 7f8ad4c40800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:30:34.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.121+0000 7f8ad4c40800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.4 2024-09-12T17:30:34.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.121+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.4 2024-09-12T17:30:34.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.121+0000 7f8ad4c40800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:30:34.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.121+0000 7f8ad4c40800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.5 2024-09-12T17:30:34.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.121+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.5 2024-09-12T17:30:34.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.122+0000 7f8ad4c40800 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-12T17:30:34.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.122+0000 7f8ad4c40800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.6 2024-09-12T17:30:34.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.122+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.6 2024-09-12T17:30:34.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.122+0000 7f8ad4c40800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:30:34.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.122+0000 7f8ad4c40800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.7 2024-09-12T17:30:34.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.122+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.7 2024-09-12T17:30:34.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.123+0000 7f8ad4c40800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:30:34.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.123+0000 7f8ad4c40800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.8 2024-09-12T17:30:34.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.123+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.8 2024-09-12T17:30:34.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.123+0000 7f8ad4c40800 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-12T17:30:34.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.123+0000 7f8ad4c40800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.9 2024-09-12T17:30:34.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.123+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.9 2024-09-12T17:30:34.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.124+0000 7f8ad4c40800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.10 2024-09-12T17:30:34.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.124+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.10 2024-09-12T17:30:34.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.124+0000 7f8ad4c40800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T17:30:34.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.124+0000 7f8ad4c40800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.11 2024-09-12T17:30:34.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.124+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.11 2024-09-12T17:30:34.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.125+0000 7f8ad4c40800 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-12T17:30:34.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.125+0000 7f8ad4c40800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.12 2024-09-12T17:30:34.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.125+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.12 2024-09-12T17:30:34.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.125+0000 7f8ad4c40800 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-12T17:30:34.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.125+0000 7f8ad4c40800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.13 2024-09-12T17:30:34.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.125+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.13 2024-09-12T17:30:34.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.126+0000 7f8ad4c40800 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-12T17:30:34.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.126+0000 7f8ad4c40800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.14 2024-09-12T17:30:34.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.126+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.14 2024-09-12T17:30:34.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.126+0000 7f8ad4c40800 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-12T17:30:34.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.126+0000 7f8ad4c40800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.15 2024-09-12T17:30:34.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.126+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.15 2024-09-12T17:30:34.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.127+0000 7f8ad4c40800 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-12T17:30:34.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.127+0000 7f8ad4c40800 10 bucket_obj is .dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.16 2024-09-12T17:30:34.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.127+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.16 2024-09-12T17:30:34.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.127+0000 7f8ad4c40800 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-12T17:30:34.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.127+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.9 2024-09-12T17:30:34.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.128+0000 7f8ad4c40800 20 get_obj_state: octx=0x55f7f3013190 obj=myver:x state=0x55f7f32e05b8 s->prefetch_data=0 2024-09-12T17:30:34.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.128+0000 7f8ad4c40800 20 get_obj_state: setting s->obj_tag to gf1y2hgey4ee6xd70yupqdlvdrsyx8sj 2024-09-12T17:30:34.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.128+0000 7f8ad4c40800 20 get_obj_state_impl: setting s->olh_tag to 5jb1u5jmktxpjyku0zo0v1392fqa1twy 2024-09-12T17:30:34.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.128+0000 7f8ad4c40800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=5jb1u5jmktxpjyku0zo0v1392fqa1twy 2024-09-12T17:30:34.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.129+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.9 2024-09-12T17:30:34.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.130+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.9 2024-09-12T17:30:34.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.131+0000 7f8ad4c40800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-12T17:30:34.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.131+0000 7f8ad4c40800 20 olh_log_entry: epoch=2 op=3 key=x[Gkp8GnC3dFsyvZbSozM5Lfnjnj.-odX] 2024-09-12T17:30:34.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.131+0000 7f8ad4c40800 20 get_obj_state: octx=0x55f7f3013190 obj=myver:_:Gkp8GnC3dFsyvZbSozM5Lfnjnj.-odX_x state=0x55f7f331cca8 s->prefetch_data=0 2024-09-12T17:30:34.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.132+0000 7f8ad4c40800 10 manifest: total_size = 22 2024-09-12T17:30:34.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.132+0000 7f8ad4c40800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.16041019344161884579 2024-09-12T17:30:34.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.132+0000 7f8ad4c40800 20 get_obj_state: octx=0x55f7f3013190 obj=myver:_:Gkp8GnC3dFsyvZbSozM5Lfnjnj.-odX_x state=0x55f7f331cca8 s->prefetch_data=0 2024-09-12T17:30:34.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.132+0000 7f8ad4c40800 20 prepare_atomic_modification: state is not atomic. state=0x55f7f331cca8 2024-09-12T17:30:34.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.132+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.9 2024-09-12T17:30:34.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.134+0000 7f8ad4c40800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:34.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.134+0000 7f8ad4c40800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:30:34.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.134+0000 7f8ad4c40800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:30:34.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.134+0000 7f8ad4c40800 5 delete_objs_inline: removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19__shadow:Gkp8GnC3dFsyvZbSozM5Lfnjnj.-odX_.zliooKFVGNFeHBmNrHuIA11jHUd-Tu8_0 2024-09-12T17:30:34.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.135+0000 7f89b5ffb640 20 handle_completion(): completion ok for obj=x[Gkp8GnC3dFsyvZbSozM5Lfnjnj.-odX] 2024-09-12T17:30:34.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.136+0000 7f8ad4c40800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:30:34.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.137+0000 7f8ad4c40800 20 get_obj_state: octx=0x55f7f3013190 obj=myver:x state=0x55f7f32e05b8 s->prefetch_data=0 2024-09-12T17:30:34.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.137+0000 7f8ad4c40800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=5jb1u5jmktxpjyku0zo0v1392fqa1twy 2024-09-12T17:30:34.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.138+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.9 2024-09-12T17:30:34.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.140+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.9 2024-09-12T17:30:34.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.140+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.9 2024-09-12T17:30:34.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.140+0000 7f8ad4c40800 20 get_obj_state: octx=0x55f7f3013190 obj=myver:y state=0x55f7f32e05b8 s->prefetch_data=0 2024-09-12T17:30:34.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.141+0000 7f8ad4c40800 20 get_obj_state: setting s->obj_tag to pxo53aynk1ch0v0e3qgij6lwszxi0uqc 2024-09-12T17:30:34.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.141+0000 7f8ad4c40800 20 get_obj_state_impl: setting s->olh_tag to yhc77ndcflxs6lzbwx3u7i8t1th03ws5 2024-09-12T17:30:34.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.141+0000 7f8ad4c40800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=yhc77ndcflxs6lzbwx3u7i8t1th03ws5 2024-09-12T17:30:34.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.142+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.9 2024-09-12T17:30:34.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.143+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.9 2024-09-12T17:30:34.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.143+0000 7f8ad4c40800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-12T17:30:34.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.143+0000 7f8ad4c40800 20 olh_log_entry: epoch=2 op=3 key=y[bn97Z15U63o6oaWOletwqRNvuCnhiLm] 2024-09-12T17:30:34.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.143+0000 7f8ad4c40800 20 get_obj_state: octx=0x55f7f3013190 obj=myver:_:bn97Z15U63o6oaWOletwqRNvuCnhiLm_y state=0x55f7f331bc98 s->prefetch_data=0 2024-09-12T17:30:34.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.144+0000 7f8ad4c40800 10 manifest: total_size = 11 2024-09-12T17:30:34.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.144+0000 7f8ad4c40800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.3130890084085846060 2024-09-12T17:30:34.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.144+0000 7f8ad4c40800 20 get_obj_state: octx=0x55f7f3013190 obj=myver:_:bn97Z15U63o6oaWOletwqRNvuCnhiLm_y state=0x55f7f331bc98 s->prefetch_data=0 2024-09-12T17:30:34.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.144+0000 7f8ad4c40800 20 prepare_atomic_modification: state is not atomic. state=0x55f7f331bc98 2024-09-12T17:30:34.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.144+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.9 2024-09-12T17:30:34.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.146+0000 7f8ad4c40800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:34.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.146+0000 7f8ad4c40800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T17:30:34.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.146+0000 7f8ad4c40800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:30:34.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.146+0000 7f8ad4c40800 5 delete_objs_inline: removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19__shadow:bn97Z15U63o6oaWOletwqRNvuCnhiLm_.5pzoXsmhlw-Df6IJzwZzcWeKJiUSWfN_0 2024-09-12T17:30:34.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.147+0000 7f8ad4c40800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:30:34.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.147+0000 7f89b57fa640 20 handle_completion(): completion ok for obj=y[bn97Z15U63o6oaWOletwqRNvuCnhiLm] 2024-09-12T17:30:34.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.148+0000 7f8ad4c40800 20 get_obj_state: octx=0x55f7f3013190 obj=myver:y state=0x55f7f32e05b8 s->prefetch_data=0 2024-09-12T17:30:34.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.148+0000 7f8ad4c40800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=yhc77ndcflxs6lzbwx3u7i8t1th03ws5 2024-09-12T17:30:34.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.150+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.9 2024-09-12T17:30:34.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.151+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.9 2024-09-12T17:30:34.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.152+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.9 2024-09-12T17:30:34.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.152+0000 7f8ad4c40800 20 get_obj_state: octx=0x55f7f3013190 obj=myver:z state=0x55f7f3324068 s->prefetch_data=0 2024-09-12T17:30:34.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.152+0000 7f8ad4c40800 20 get_obj_state: setting s->obj_tag to 3j89uaiaoje8dewv273d7uwt3ubfxof7 2024-09-12T17:30:34.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.152+0000 7f8ad4c40800 20 get_obj_state_impl: setting s->olh_tag to cu4jaoivsb16yr5lz4w9wvq91hpggghl 2024-09-12T17:30:34.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.152+0000 7f8ad4c40800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=cu4jaoivsb16yr5lz4w9wvq91hpggghl 2024-09-12T17:30:34.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.154+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.9 2024-09-12T17:30:34.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.155+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.9 2024-09-12T17:30:34.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.155+0000 7f8ad4c40800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-12T17:30:34.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.155+0000 7f8ad4c40800 20 olh_log_entry: epoch=2 op=3 key=z[PbJRZMM1CJN5GBv.nDoIhtMBJHqNtMn] 2024-09-12T17:30:34.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.155+0000 7f8ad4c40800 20 get_obj_state: octx=0x55f7f3013190 obj=myver:_:PbJRZMM1CJN5GBv.nDoIhtMBJHqNtMn_z state=0x55f7f331ac88 s->prefetch_data=0 2024-09-12T17:30:34.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.155+0000 7f8ad4c40800 10 manifest: total_size = 11 2024-09-12T17:30:34.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.155+0000 7f8ad4c40800 20 get_obj_state: setting s->obj_tag to 06eb12d0-49d6-461d-9efe-05d212954deb.4538.10637846508542409783 2024-09-12T17:30:34.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.155+0000 7f8ad4c40800 20 get_obj_state: octx=0x55f7f3013190 obj=myver:_:PbJRZMM1CJN5GBv.nDoIhtMBJHqNtMn_z state=0x55f7f331ac88 s->prefetch_data=0 2024-09-12T17:30:34.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.155+0000 7f8ad4c40800 20 prepare_atomic_modification: state is not atomic. state=0x55f7f331ac88 2024-09-12T17:30:34.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.155+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.9 2024-09-12T17:30:34.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.158+0000 7f8ad4c40800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:34.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.158+0000 7f8ad4c40800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T17:30:34.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.158+0000 7f8ad4c40800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:30:34.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.158+0000 7f8ad4c40800 5 delete_objs_inline: removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19__shadow:PbJRZMM1CJN5GBv.nDoIhtMBJHqNtMn_.27J2ATzDKfD-ZrKEzcu7gWpZ-ZT-yaL_0 2024-09-12T17:30:34.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.159+0000 7f8ad4c40800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:30:34.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.159+0000 7f89b57fa640 20 handle_completion(): completion ok for obj=z[PbJRZMM1CJN5GBv.nDoIhtMBJHqNtMn] 2024-09-12T17:30:34.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.160+0000 7f8ad4c40800 20 get_obj_state: octx=0x55f7f3013190 obj=myver:z state=0x55f7f3324068 s->prefetch_data=0 2024-09-12T17:30:34.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.160+0000 7f8ad4c40800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=cu4jaoivsb16yr5lz4w9wvq91hpggghl 2024-09-12T17:30:34.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.162+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.9 2024-09-12T17:30:34.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.163+0000 7f8ad4c40800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.19.3.9 2024-09-12T17:30:34.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.163+0000 7f8ad4c40800 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-12T17:30:34.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.163+0000 7f8ad4c40800 1 NOTICE: finished all shards (3 entries removed) 2024-09-12T17:30:34.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.164+0000 7f8988fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:34.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.166+0000 7f8ad4c40800 20 remove_watcher() i=0 2024-09-12T17:30:34.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.166+0000 7f8ad4c40800 2 removed watcher, disabling cache 2024-09-12T17:30:34.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.168+0000 7f8ad4c40800 20 remove_watcher() i=1 2024-09-12T17:30:34.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.169+0000 7f8ad4c40800 20 remove_watcher() i=2 2024-09-12T17:30:34.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.170+0000 7f8ad4c40800 20 remove_watcher() i=3 2024-09-12T17:30:34.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.171+0000 7f8ad4c40800 20 remove_watcher() i=4 2024-09-12T17:30:34.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.172+0000 7f8ad4c40800 20 remove_watcher() i=5 2024-09-12T17:30:34.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.173+0000 7f8ad4c40800 20 remove_watcher() i=6 2024-09-12T17:30:34.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.174+0000 7f8ad4c40800 20 remove_watcher() i=7 2024-09-12T17:30:34.188 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:30:34.188 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:30:34.229 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:30:34.229 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:30:34.331 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:30:34.360 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:34.361 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:34.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.399+0000 7fa92fb35800 20 rados->read ofs=0 len=0 2024-09-12T17:30:34.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.400+0000 7fa92fb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:34.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.400+0000 7fa92fb35800 20 realm 2024-09-12T17:30:34.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.400+0000 7fa92fb35800 20 rados->read ofs=0 len=0 2024-09-12T17:30:34.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.401+0000 7fa92fb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:34.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.401+0000 7fa92fb35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:34.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.401+0000 7fa92fb35800 20 rados->read ofs=0 len=0 2024-09-12T17:30:34.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.401+0000 7fa92fb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:34.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.401+0000 7fa92fb35800 20 rados->read ofs=0 len=0 2024-09-12T17:30:34.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.402+0000 7fa92fb35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:34.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.402+0000 7fa92fb35800 20 rados->read ofs=0 len=0 2024-09-12T17:30:34.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.402+0000 7fa92fb35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:30:34.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.402+0000 7fa92fb35800 20 searching for the correct realm 2024-09-12T17:30:34.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.405+0000 7fa9230e3640 0 -- 172.21.15.67:0/3136673503 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55cb96ce7fe0 msgr2=0x55cb96cea3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:34.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.408+0000 7fa92b8e4640 0 -- 172.21.15.67:0/3136673503 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fa91400e0b0 msgr2=0x7fa9140199b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:34.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.615+0000 7fa92fb35800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:30:34.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.615+0000 7fa92fb35800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:30:34.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.615+0000 7fa92fb35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:34.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.615+0000 7fa92fb35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:34.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.615+0000 7fa92fb35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:34.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.615+0000 7fa92fb35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:34.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.615+0000 7fa92fb35800 20 rados->read ofs=0 len=0 2024-09-12T17:30:34.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.615+0000 7fa92fb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:34.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.615+0000 7fa92fb35800 20 rados->read ofs=0 len=0 2024-09-12T17:30:34.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.615+0000 7fa92fb35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:34.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.616+0000 7fa92fb35800 20 rados->read ofs=0 len=0 2024-09-12T17:30:34.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.616+0000 7fa92fb35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:30:34.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.616+0000 7fa92fb35800 20 zone default found 2024-09-12T17:30:34.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.616+0000 7fa92fb35800 4 Realm: () 2024-09-12T17:30:34.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.616+0000 7fa92fb35800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:30:34.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.616+0000 7fa92fb35800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:30:34.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.616+0000 7fa92fb35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:34.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.616+0000 7fa92fb35800 20 zonegroup default 2024-09-12T17:30:34.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.616+0000 7fa92fb35800 20 rados->read ofs=0 len=0 2024-09-12T17:30:34.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.616+0000 7fa92fb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:34.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.616+0000 7fa92fb35800 20 rados->read ofs=0 len=0 2024-09-12T17:30:34.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.617+0000 7fa92fb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:34.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.617+0000 7fa92fb35800 20 rados->read ofs=0 len=0 2024-09-12T17:30:34.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.617+0000 7fa92fb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:34.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.617+0000 7fa92fb35800 20 started sync module instance, tier type = 2024-09-12T17:30:34.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.617+0000 7fa92fb35800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:30:34.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.626+0000 7fa92fb35800 20 add_watcher() i=0 2024-09-12T17:30:34.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.626+0000 7fa92fb35800 20 add_watcher() i=1 2024-09-12T17:30:34.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.626+0000 7fa92fb35800 20 add_watcher() i=2 2024-09-12T17:30:34.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.626+0000 7fa92fb35800 20 add_watcher() i=3 2024-09-12T17:30:34.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.626+0000 7fa92fb35800 20 add_watcher() i=4 2024-09-12T17:30:34.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.626+0000 7fa92fb35800 20 add_watcher() i=5 2024-09-12T17:30:34.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.626+0000 7fa92fb35800 20 add_watcher() i=6 2024-09-12T17:30:34.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.628+0000 7fa92fb35800 20 add_watcher() i=7 2024-09-12T17:30:34.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.628+0000 7fa92fb35800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:34.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.629+0000 7fa7e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:34.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.630+0000 7fa92fb35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:34.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.630+0000 7fa92fb35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:34.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.630+0000 7fa92fb35800 5 note: GC not initialized 2024-09-12T17:30:34.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.630+0000 7fa7e0fe1640 20 reqs_thread_entry: start 2024-09-12T17:30:34.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.630+0000 7fa92fb35800 20 init_complete bucket index max shards: 1 2024-09-12T17:30:34.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.630+0000 7fa92fb35800 20 Filter name: none 2024-09-12T17:30:34.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.630+0000 7fa75a7fc640 20 reqs_thread_entry: start 2024-09-12T17:30:34.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.630+0000 7fa92fb35800 20 rados->read ofs=0 len=0 2024-09-12T17:30:34.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.631+0000 7fa92fb35800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:30:34.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.631+0000 7fa92fb35800 20 rados->read ofs=0 len=0 2024-09-12T17:30:34.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.631+0000 7fa92fb35800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:30:34.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.631+0000 7fa92fb35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:30:34.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.631+0000 7fa92fb35800 20 rados->read ofs=0 len=0 2024-09-12T17:30:34.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.631+0000 7fa92fb35800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:30:34.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.631+0000 7fa92fb35800 20 rados->read ofs=0 len=0 2024-09-12T17:30:34.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.632+0000 7fa92fb35800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:30:34.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.632+0000 7fa92fb35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:30:34.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.633+0000 7fa7e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:34.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.635+0000 7fa92fb35800 20 remove_watcher() i=0 2024-09-12T17:30:34.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.635+0000 7fa92fb35800 2 removed watcher, disabling cache 2024-09-12T17:30:34.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.637+0000 7fa92fb35800 20 remove_watcher() i=1 2024-09-12T17:30:34.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.638+0000 7fa92fb35800 20 remove_watcher() i=2 2024-09-12T17:30:34.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.639+0000 7fa92fb35800 20 remove_watcher() i=3 2024-09-12T17:30:34.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.640+0000 7fa92fb35800 20 remove_watcher() i=4 2024-09-12T17:30:34.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.641+0000 7fa92fb35800 20 remove_watcher() i=5 2024-09-12T17:30:34.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.642+0000 7fa92fb35800 20 remove_watcher() i=6 2024-09-12T17:30:34.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T17:30:34.643+0000 7fa92fb35800 20 remove_watcher() i=7 2024-09-12T17:30:34.654 INFO:tasks.workunit.client.0.smithi067.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T17:30:34.655 INFO:tasks.workunit.client.0.smithi067.stderr:Deleting bucket a-bucket 2024-09-12T17:30:34.656 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:30:34.656 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:30:34.682 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:30:34.682 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:30:34.737 INFO:tasks.workunit.client.0.smithi067.stderr:Deleting bucket myver 2024-09-12T17:30:34.738 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:30:34.739 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:30:34.813 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T17:30:34.813 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T17:30:34.987 INFO:tasks.workunit.client.0.smithi067.stderr:Completed resharding tests 2024-09-12T17:30:34.988 INFO:tasks.workunit.client.0.smithi067.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T17:30:34.988 INFO:tasks.workunit.client.0.smithi067.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T17:30:34.988 INFO:tasks.workunit.client.0.smithi067.stdout:connected to https://localhost:443 2024-09-12T17:30:35.067 INFO:tasks.workunit.client.0.smithi067.stderr:+ deactivate 2024-09-12T17:30:35.068 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T17:30:35.068 INFO:tasks.workunit.client.0.smithi067.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:30:35.068 INFO:tasks.workunit.client.0.smithi067.stderr:+ export PATH 2024-09-12T17:30:35.068 INFO:tasks.workunit.client.0.smithi067.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T17:30:35.068 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n '' ']' 2024-09-12T17:30:35.068 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:30:35.068 INFO:tasks.workunit.client.0.smithi067.stderr:+ hash -r 2024-09-12T17:30:35.068 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n '' ']' 2024-09-12T17:30:35.068 INFO:tasks.workunit.client.0.smithi067.stderr:+ unset VIRTUAL_ENV 2024-09-12T17:30:35.068 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T17:30:35.069 INFO:tasks.workunit.client.0.smithi067.stderr:+ unset -f deactivate 2024-09-12T17:30:35.069 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo OK. 2024-09-12T17:30:35.070 INFO:tasks.workunit.client.0.smithi067.stdout:OK. 2024-09-12T17:30:35.070 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:30:35.071 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:30:35.150 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-12T17:30:35.150 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:30:35.577 DEBUG:teuthology.parallel:result is None 2024-09-12T17:30:35.578 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:30:35.618 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:30:35.618 DEBUG:teuthology.orchestra.run.smithi067:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:30:35.688 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:30:35.688 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-12T17:30:35.705 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-12T17:30:35.705 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-12T17:30:35.706 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-12T17:30:35.706 DEBUG:teuthology.orchestra.run.smithi067:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-12T17:30:35.757 INFO:teuthology.orchestra.run.smithi067.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-12T17:30:40.127 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-12T17:30:40.128 DEBUG:teuthology.orchestra.run.smithi067:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-12T17:30:42.257 INFO:teuthology.orchestra.run.smithi067.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-09-12T17:30:42.850 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:34:03 ago on Thu 12 Sep 2024 04:56:39 PM UTC. 2024-09-12T17:30:42.997 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-09-12T17:30:42.998 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-09-12T17:30:42.998 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2024-09-12T17:30:42.998 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-09-12T17:30:42.998 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-09-12T17:30:42.998 INFO:teuthology.orchestra.run.smithi067.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-09-12T17:30:42.998 INFO:teuthology.orchestra.run.smithi067.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-09-12T17:30:42.998 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2024-09-12T17:30:42.998 INFO:teuthology.orchestra.run.smithi067.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-09-12T17:30:42.998 INFO:teuthology.orchestra.run.smithi067.stdout:Installing weak dependencies: 2024-09-12T17:30:42.999 INFO:teuthology.orchestra.run.smithi067.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-09-12T17:30:42.999 INFO:teuthology.orchestra.run.smithi067.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-09-12T17:30:42.999 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:30:42.999 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-09-12T17:30:42.999 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-09-12T17:30:42.999 INFO:teuthology.orchestra.run.smithi067.stdout:Install 5 Packages 2024-09-12T17:30:42.999 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:30:42.999 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 46 M 2024-09-12T17:30:43.000 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 166 M 2024-09-12T17:30:43.000 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-09-12T17:30:43.437 INFO:teuthology.orchestra.run.smithi067.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 2.7 MB/s | 426 kB 00:00 2024-09-12T17:30:44.138 INFO:teuthology.orchestra.run.smithi067.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 4.1 MB/s | 3.5 MB 00:00 2024-09-12T17:30:44.179 INFO:teuthology.orchestra.run.smithi067.stdout:(3/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 627 kB/s | 26 kB 00:00 2024-09-12T17:30:44.663 INFO:teuthology.orchestra.run.smithi067.stdout:(4/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 6.8 MB/s | 9.3 MB 00:01 2024-09-12T17:30:45.655 INFO:teuthology.orchestra.run.smithi067.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 15 MB/s | 32 MB 00:02 2024-09-12T17:30:45.655 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:30:45.656 INFO:teuthology.orchestra.run.smithi067.stdout:Total 17 MB/s | 46 MB 00:02 2024-09-12T17:30:46.093 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-09-12T17:30:46.116 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-09-12T17:30:46.117 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-09-12T17:30:46.621 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-09-12T17:30:46.621 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-09-12T17:30:47.159 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-09-12T17:30:47.315 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-09-12T17:30:47.496 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-09-12T17:30:48.139 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-09-12T17:30:48.182 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-12T17:30:48.428 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-12T17:30:48.458 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-12T17:30:48.699 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-12T17:30:48.738 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T17:30:48.746 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T17:30:48.755 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-09-12T17:30:48.798 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-09-12T17:30:51.915 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T17:30:51.916 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-09-12T17:30:51.916 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-09-12T17:30:51.916 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-09-12T17:30:51.916 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-09-12T17:30:52.320 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-09-12T17:30:52.320 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:30:52.320 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-09-12T17:30:52.320 INFO:teuthology.orchestra.run.smithi067.stdout: gtk2-2.24.33-8.el9.x86_64 2024-09-12T17:30:52.320 INFO:teuthology.orchestra.run.smithi067.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T17:30:52.320 INFO:teuthology.orchestra.run.smithi067.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T17:30:52.320 INFO:teuthology.orchestra.run.smithi067.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T17:30:52.321 INFO:teuthology.orchestra.run.smithi067.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-09-12T17:30:52.321 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:30:52.321 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-09-12T17:30:52.715 INFO:teuthology.orchestra.run.smithi067.stdout: Gradle will be installed under /opt/gradle 2024-09-12T17:30:52.837 INFO:teuthology.orchestra.run.smithi067.stderr:--2024-09-12 17:30:52-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-12T17:30:52.985 INFO:teuthology.orchestra.run.smithi067.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.73.101, 104.16.72.101, 2606:4700::6810:4965, ... 2024-09-12T17:30:52.998 INFO:teuthology.orchestra.run.smithi067.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.73.101|:443... connected. 2024-09-12T17:30:53.273 INFO:teuthology.orchestra.run.smithi067.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-12T17:30:53.273 INFO:teuthology.orchestra.run.smithi067.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-12T17:30:53.273 INFO:teuthology.orchestra.run.smithi067.stderr:--2024-09-12 17:30:53-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-12T17:30:53.273 INFO:teuthology.orchestra.run.smithi067.stderr:Resolving github.com (github.com)... 140.82.113.3 2024-09-12T17:30:53.284 INFO:teuthology.orchestra.run.smithi067.stderr:Connecting to github.com (github.com)|140.82.113.3|:443... connected. 2024-09-12T17:30:53.454 INFO:teuthology.orchestra.run.smithi067.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-12T17:30:53.454 INFO:teuthology.orchestra.run.smithi067.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T173053Z&X-Amz-Expires=300&X-Amz-Signature=5b785662d6dc184348e8b6e0a70cf05cb6913bcb1bea99bb8c02428ddbbc3d57&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-12T17:30:53.454 INFO:teuthology.orchestra.run.smithi067.stderr:--2024-09-12 17:30:53-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T173053Z&X-Amz-Expires=300&X-Amz-Signature=5b785662d6dc184348e8b6e0a70cf05cb6913bcb1bea99bb8c02428ddbbc3d57&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-12T17:30:53.454 INFO:teuthology.orchestra.run.smithi067.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.108.133, 185.199.110.133, 185.199.111.133, ... 2024-09-12T17:30:53.466 INFO:teuthology.orchestra.run.smithi067.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.108.133|:443... connected. 2024-09-12T17:30:53.546 INFO:teuthology.orchestra.run.smithi067.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T17:30:53.547 INFO:teuthology.orchestra.run.smithi067.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-12T17:30:53.547 INFO:teuthology.orchestra.run.smithi067.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-09-12T17:30:53.547 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T17:30:53.560 INFO:teuthology.orchestra.run.smithi067.stderr: 0K .......... .......... .......... .......... .......... 0% 3.40M 27s 2024-09-12T17:30:53.573 INFO:teuthology.orchestra.run.smithi067.stderr: 50K .......... .......... .......... .......... .......... 0% 3.92M 25s 2024-09-12T17:30:53.581 INFO:teuthology.orchestra.run.smithi067.stderr: 100K .......... .......... .......... .......... .......... 0% 6.01M 22s 2024-09-12T17:30:53.588 INFO:teuthology.orchestra.run.smithi067.stderr: 150K .......... .......... .......... .......... .......... 0% 14.2M 18s 2024-09-12T17:30:53.588 INFO:teuthology.orchestra.run.smithi067.stderr: 200K .......... .......... .......... .......... .......... 0% 29.5M 15s 2024-09-12T17:30:53.592 INFO:teuthology.orchestra.run.smithi067.stderr: 250K .......... .......... .......... .......... .......... 0% 32.2M 13s 2024-09-12T17:30:55.123 INFO:teuthology.orchestra.run.smithi067.stderr: 300K .......... .......... .......... .......... .......... 0% 7.10M 13s 2024-09-12T17:30:55.123 INFO:teuthology.orchestra.run.smithi067.stderr: 350K .......... .......... .......... .......... .......... 0% 72.2M 11s 2024-09-12T17:30:55.123 INFO:teuthology.orchestra.run.smithi067.stderr: 400K .......... .......... .......... .......... .......... 0% 31.2M 10s 2024-09-12T17:30:55.123 INFO:teuthology.orchestra.run.smithi067.stderr: 450K .......... .......... .......... .......... .......... 0% 73.8M 9s 2024-09-12T17:30:55.123 INFO:teuthology.orchestra.run.smithi067.stderr: 500K .......... .......... .......... .......... .......... 0% 109M 9s 2024-09-12T17:30:55.123 INFO:teuthology.orchestra.run.smithi067.stderr: 550K .......... .......... .......... .......... .......... 0% 36.8M 8s 2024-09-12T17:30:55.123 INFO:teuthology.orchestra.run.smithi067.stderr: 600K .......... .......... .......... .......... .......... 0% 9.86M 8s 2024-09-12T17:30:55.123 INFO:teuthology.orchestra.run.smithi067.stderr: 650K .......... .......... .......... .......... .......... 0% 46.1M 8s 2024-09-12T17:30:55.123 INFO:teuthology.orchestra.run.smithi067.stderr: 700K .......... .......... .......... .......... .......... 0% 48.0M 7s 2024-09-12T17:30:55.124 INFO:teuthology.orchestra.run.smithi067.stderr: 750K .......... .......... .......... .......... .......... 0% 94.2M 7s 2024-09-12T17:30:55.124 INFO:teuthology.orchestra.run.smithi067.stderr: 800K .......... .......... .......... .......... .......... 0% 67.9M 7s 2024-09-12T17:30:55.124 INFO:teuthology.orchestra.run.smithi067.stderr: 850K .......... .......... .......... .......... .......... 0% 59.7M 6s 2024-09-12T17:30:55.124 INFO:teuthology.orchestra.run.smithi067.stderr: 900K .......... .......... .......... .......... .......... 1% 110M 6s 2024-09-12T17:30:55.124 INFO:teuthology.orchestra.run.smithi067.stderr: 950K .......... .......... .......... .......... .......... 1% 213M 6s 2024-09-12T17:30:55.124 INFO:teuthology.orchestra.run.smithi067.stderr: 1000K .......... .......... .......... .......... .......... 1% 79.7M 6s 2024-09-12T17:30:55.124 INFO:teuthology.orchestra.run.smithi067.stderr: 1050K .......... .......... .......... .......... .......... 1% 81.8M 5s 2024-09-12T17:30:55.124 INFO:teuthology.orchestra.run.smithi067.stderr: 1100K .......... .......... .......... .......... .......... 1% 86.7M 5s 2024-09-12T17:30:55.124 INFO:teuthology.orchestra.run.smithi067.stderr: 1150K .......... .......... .......... .......... .......... 1% 293M 5s 2024-09-12T17:30:55.124 INFO:teuthology.orchestra.run.smithi067.stderr: 1200K .......... .......... .......... .......... .......... 1% 95.4M 5s 2024-09-12T17:30:55.124 INFO:teuthology.orchestra.run.smithi067.stderr: 1250K .......... .......... .......... .......... .......... 1% 11.3M 5s 2024-09-12T17:30:55.124 INFO:teuthology.orchestra.run.smithi067.stderr: 1300K .......... .......... .......... .......... .......... 1% 55.5M 5s 2024-09-12T17:30:55.124 INFO:teuthology.orchestra.run.smithi067.stderr: 1350K .......... .......... .......... .......... .......... 1% 212M 5s 2024-09-12T17:30:55.125 INFO:teuthology.orchestra.run.smithi067.stderr: 1400K .......... .......... .......... .......... .......... 1% 37.9M 5s 2024-09-12T17:30:55.125 INFO:teuthology.orchestra.run.smithi067.stderr: 1450K .......... .......... .......... .......... .......... 1% 196M 4s 2024-09-12T17:30:55.125 INFO:teuthology.orchestra.run.smithi067.stderr: 1500K .......... .......... .......... .......... .......... 1% 225M 4s 2024-09-12T17:30:55.125 INFO:teuthology.orchestra.run.smithi067.stderr: 1550K .......... .......... .......... .......... .......... 1% 176M 4s 2024-09-12T17:30:55.125 INFO:teuthology.orchestra.run.smithi067.stderr: 1600K .......... .......... .......... .......... .......... 1% 231M 4s 2024-09-12T17:30:55.125 INFO:teuthology.orchestra.run.smithi067.stderr: 1650K .......... .......... .......... .......... .......... 1% 144M 4s 2024-09-12T17:30:55.125 INFO:teuthology.orchestra.run.smithi067.stderr: 1700K .......... .......... .......... .......... .......... 1% 125M 4s 2024-09-12T17:30:55.125 INFO:teuthology.orchestra.run.smithi067.stderr: 1750K .......... .......... .......... .......... .......... 1% 152M 4s 2024-09-12T17:30:55.125 INFO:teuthology.orchestra.run.smithi067.stderr: 1800K .......... .......... .......... .......... .......... 1% 300M 4s 2024-09-12T17:30:55.125 INFO:teuthology.orchestra.run.smithi067.stderr: 1850K .......... .......... .......... .......... .......... 2% 108M 4s 2024-09-12T17:30:55.125 INFO:teuthology.orchestra.run.smithi067.stderr: 1900K .......... .......... .......... .......... .......... 2% 175M 3s 2024-09-12T17:30:55.125 INFO:teuthology.orchestra.run.smithi067.stderr: 1950K .......... .......... .......... .......... .......... 2% 129M 3s 2024-09-12T17:30:55.125 INFO:teuthology.orchestra.run.smithi067.stderr: 2000K .......... .......... .......... .......... .......... 2% 256M 3s 2024-09-12T17:30:55.126 INFO:teuthology.orchestra.run.smithi067.stderr: 2050K .......... .......... .......... .......... .......... 2% 241M 3s 2024-09-12T17:30:55.126 INFO:teuthology.orchestra.run.smithi067.stderr: 2100K .......... .......... .......... .......... .......... 2% 193M 3s 2024-09-12T17:30:55.126 INFO:teuthology.orchestra.run.smithi067.stderr: 2150K .......... .......... .......... .......... .......... 2% 159M 3s 2024-09-12T17:30:55.126 INFO:teuthology.orchestra.run.smithi067.stderr: 2200K .......... .......... .......... .......... .......... 2% 189M 3s 2024-09-12T17:30:55.126 INFO:teuthology.orchestra.run.smithi067.stderr: 2250K .......... .......... .......... .......... .......... 2% 296M 3s 2024-09-12T17:30:55.126 INFO:teuthology.orchestra.run.smithi067.stderr: 2300K .......... .......... .......... .......... .......... 2% 110M 3s 2024-09-12T17:30:55.126 INFO:teuthology.orchestra.run.smithi067.stderr: 2350K .......... .......... .......... .......... .......... 2% 295M 3s 2024-09-12T17:30:55.126 INFO:teuthology.orchestra.run.smithi067.stderr: 2400K .......... .......... .......... .......... .......... 2% 220M 3s 2024-09-12T17:30:55.126 INFO:teuthology.orchestra.run.smithi067.stderr: 2450K .......... .......... .......... .......... .......... 2% 231M 3s 2024-09-12T17:30:55.126 INFO:teuthology.orchestra.run.smithi067.stderr: 2500K .......... .......... .......... .......... .......... 2% 14.8M 3s 2024-09-12T17:30:55.126 INFO:teuthology.orchestra.run.smithi067.stderr: 2550K .......... .......... .......... .......... .......... 2% 266M 3s 2024-09-12T17:30:55.126 INFO:teuthology.orchestra.run.smithi067.stderr: 2600K .......... .......... .......... .......... .......... 2% 287M 3s 2024-09-12T17:30:55.126 INFO:teuthology.orchestra.run.smithi067.stderr: 2650K .......... .......... .......... .......... .......... 2% 67.9M 3s 2024-09-12T17:30:55.126 INFO:teuthology.orchestra.run.smithi067.stderr: 2700K .......... .......... .......... .......... .......... 2% 255M 3s 2024-09-12T17:30:55.127 INFO:teuthology.orchestra.run.smithi067.stderr: 2750K .......... .......... .......... .......... .......... 3% 52.1M 3s 2024-09-12T17:30:55.127 INFO:teuthology.orchestra.run.smithi067.stderr: 2800K .......... .......... .......... .......... .......... 3% 239M 3s 2024-09-12T17:30:55.127 INFO:teuthology.orchestra.run.smithi067.stderr: 2850K .......... .......... .......... .......... .......... 3% 290M 3s 2024-09-12T17:30:55.127 INFO:teuthology.orchestra.run.smithi067.stderr: 2900K .......... .......... .......... .......... .......... 3% 270M 3s 2024-09-12T17:30:55.127 INFO:teuthology.orchestra.run.smithi067.stderr: 2950K .......... .......... .......... .......... .......... 3% 313M 3s 2024-09-12T17:30:55.127 INFO:teuthology.orchestra.run.smithi067.stderr: 3000K .......... .......... .......... .......... .......... 3% 289M 2s 2024-09-12T17:30:55.127 INFO:teuthology.orchestra.run.smithi067.stderr: 3050K .......... .......... .......... .......... .......... 3% 317M 2s 2024-09-12T17:30:55.127 INFO:teuthology.orchestra.run.smithi067.stderr: 3100K .......... .......... .......... .......... .......... 3% 259M 2s 2024-09-12T17:30:55.127 INFO:teuthology.orchestra.run.smithi067.stderr: 3150K .......... .......... .......... .......... .......... 3% 282M 2s 2024-09-12T17:30:55.127 INFO:teuthology.orchestra.run.smithi067.stderr: 3200K .......... .......... .......... .......... .......... 3% 321M 2s 2024-09-12T17:30:55.127 INFO:teuthology.orchestra.run.smithi067.stderr: 3250K .......... .......... .......... .......... .......... 3% 291M 2s 2024-09-12T17:30:55.127 INFO:teuthology.orchestra.run.smithi067.stderr: 3300K .......... .......... .......... .......... .......... 3% 246M 2s 2024-09-12T17:30:55.127 INFO:teuthology.orchestra.run.smithi067.stderr: 3350K .......... .......... .......... .......... .......... 3% 296M 2s 2024-09-12T17:30:55.128 INFO:teuthology.orchestra.run.smithi067.stderr: 3400K .......... .......... .......... .......... .......... 3% 331M 2s 2024-09-12T17:30:55.128 INFO:teuthology.orchestra.run.smithi067.stderr: 3450K .......... .......... .......... .......... .......... 3% 307M 2s 2024-09-12T17:30:55.128 INFO:teuthology.orchestra.run.smithi067.stderr: 3500K .......... .......... .......... .......... .......... 3% 187M 2s 2024-09-12T17:30:55.128 INFO:teuthology.orchestra.run.smithi067.stderr: 3550K .......... .......... .......... .......... .......... 3% 281M 2s 2024-09-12T17:30:55.128 INFO:teuthology.orchestra.run.smithi067.stderr: 3600K .......... .......... .......... .......... .......... 3% 290M 2s 2024-09-12T17:30:55.128 INFO:teuthology.orchestra.run.smithi067.stderr: 3650K .......... .......... .......... .......... .......... 3% 344M 2s 2024-09-12T17:30:55.128 INFO:teuthology.orchestra.run.smithi067.stderr: 3700K .......... .......... .......... .......... .......... 4% 272M 2s 2024-09-12T17:30:55.128 INFO:teuthology.orchestra.run.smithi067.stderr: 3750K .......... .......... .......... .......... .......... 4% 305M 2s 2024-09-12T17:30:55.128 INFO:teuthology.orchestra.run.smithi067.stderr: 3800K .......... .......... .......... .......... .......... 4% 347M 2s 2024-09-12T17:30:55.128 INFO:teuthology.orchestra.run.smithi067.stderr: 3850K .......... .......... .......... .......... .......... 4% 319M 2s 2024-09-12T17:30:55.128 INFO:teuthology.orchestra.run.smithi067.stderr: 3900K .......... .......... .......... .......... .......... 4% 256M 2s 2024-09-12T17:30:55.128 INFO:teuthology.orchestra.run.smithi067.stderr: 3950K .......... .......... .......... .......... .......... 4% 374M 2s 2024-09-12T17:30:55.128 INFO:teuthology.orchestra.run.smithi067.stderr: 4000K .......... .......... .......... .......... .......... 4% 323M 2s 2024-09-12T17:30:55.129 INFO:teuthology.orchestra.run.smithi067.stderr: 4050K .......... .......... .......... .......... .......... 4% 307M 2s 2024-09-12T17:30:55.129 INFO:teuthology.orchestra.run.smithi067.stderr: 4100K .......... .......... .......... .......... .......... 4% 257M 2s 2024-09-12T17:30:55.129 INFO:teuthology.orchestra.run.smithi067.stderr: 4150K .......... .......... .......... .......... .......... 4% 320M 2s 2024-09-12T17:30:55.129 INFO:teuthology.orchestra.run.smithi067.stderr: 4200K .......... .......... .......... .......... .......... 4% 287M 2s 2024-09-12T17:30:55.129 INFO:teuthology.orchestra.run.smithi067.stderr: 4250K .......... .......... .......... .......... .......... 4% 354M 2s 2024-09-12T17:30:55.129 INFO:teuthology.orchestra.run.smithi067.stderr: 4300K .......... .......... .......... .......... .......... 4% 254M 2s 2024-09-12T17:30:55.129 INFO:teuthology.orchestra.run.smithi067.stderr: 4350K .......... .......... .......... .......... .......... 4% 295M 2s 2024-09-12T17:30:55.129 INFO:teuthology.orchestra.run.smithi067.stderr: 4400K .......... .......... .......... .......... .......... 4% 294M 2s 2024-09-12T17:30:55.129 INFO:teuthology.orchestra.run.smithi067.stderr: 4450K .......... .......... .......... .......... .......... 4% 330M 2s 2024-09-12T17:30:55.129 INFO:teuthology.orchestra.run.smithi067.stderr: 4500K .......... .......... .......... .......... .......... 4% 316M 2s 2024-09-12T17:30:55.129 INFO:teuthology.orchestra.run.smithi067.stderr: 4550K .......... .......... .......... .......... .......... 4% 335M 2s 2024-09-12T17:30:55.129 INFO:teuthology.orchestra.run.smithi067.stderr: 4600K .......... .......... .......... .......... .......... 5% 316M 2s 2024-09-12T17:30:55.129 INFO:teuthology.orchestra.run.smithi067.stderr: 4650K .......... .......... .......... .......... .......... 5% 308M 2s 2024-09-12T17:30:55.130 INFO:teuthology.orchestra.run.smithi067.stderr: 4700K .......... .......... .......... .......... .......... 5% 238M 2s 2024-09-12T17:30:55.130 INFO:teuthology.orchestra.run.smithi067.stderr: 4750K .......... .......... .......... .......... .......... 5% 303M 2s 2024-09-12T17:30:55.130 INFO:teuthology.orchestra.run.smithi067.stderr: 4800K .......... .......... .......... .......... .......... 5% 342M 2s 2024-09-12T17:30:55.130 INFO:teuthology.orchestra.run.smithi067.stderr: 4850K .......... .......... .......... .......... .......... 5% 299M 2s 2024-09-12T17:30:55.130 INFO:teuthology.orchestra.run.smithi067.stderr: 4900K .......... .......... .......... .......... .......... 5% 250M 2s 2024-09-12T17:30:55.130 INFO:teuthology.orchestra.run.smithi067.stderr: 4950K .......... .......... .......... .......... .......... 5% 320M 2s 2024-09-12T17:30:55.130 INFO:teuthology.orchestra.run.smithi067.stderr: 5000K .......... .......... .......... .......... .......... 5% 301M 2s 2024-09-12T17:30:55.130 INFO:teuthology.orchestra.run.smithi067.stderr: 5050K .......... .......... .......... .......... .......... 5% 27.1M 2s 2024-09-12T17:30:55.130 INFO:teuthology.orchestra.run.smithi067.stderr: 5100K .......... .......... .......... .......... .......... 5% 227M 2s 2024-09-12T17:30:55.130 INFO:teuthology.orchestra.run.smithi067.stderr: 5150K .......... .......... .......... .......... .......... 5% 310M 2s 2024-09-12T17:30:55.130 INFO:teuthology.orchestra.run.smithi067.stderr: 5200K .......... .......... .......... .......... .......... 5% 290M 2s 2024-09-12T17:30:55.130 INFO:teuthology.orchestra.run.smithi067.stderr: 5250K .......... .......... .......... .......... .......... 5% 306M 2s 2024-09-12T17:30:55.130 INFO:teuthology.orchestra.run.smithi067.stderr: 5300K .......... .......... .......... .......... .......... 5% 131M 2s 2024-09-12T17:30:55.130 INFO:teuthology.orchestra.run.smithi067.stderr: 5350K .......... .......... .......... .......... .......... 5% 305M 2s 2024-09-12T17:30:55.131 INFO:teuthology.orchestra.run.smithi067.stderr: 5400K .......... .......... .......... .......... .......... 5% 249M 2s 2024-09-12T17:30:55.131 INFO:teuthology.orchestra.run.smithi067.stderr: 5450K .......... .......... .......... .......... .......... 5% 230M 1s 2024-09-12T17:30:55.131 INFO:teuthology.orchestra.run.smithi067.stderr: 5500K .......... .......... .......... .......... .......... 5% 253M 1s 2024-09-12T17:30:55.131 INFO:teuthology.orchestra.run.smithi067.stderr: 5550K .......... .......... .......... .......... .......... 6% 104M 1s 2024-09-12T17:30:55.131 INFO:teuthology.orchestra.run.smithi067.stderr: 5600K .......... .......... .......... .......... .......... 6% 304M 1s 2024-09-12T17:30:55.131 INFO:teuthology.orchestra.run.smithi067.stderr: 5650K .......... .......... .......... .......... .......... 6% 275M 1s 2024-09-12T17:30:55.131 INFO:teuthology.orchestra.run.smithi067.stderr: 5700K .......... .......... .......... .......... .......... 6% 258M 1s 2024-09-12T17:30:55.131 INFO:teuthology.orchestra.run.smithi067.stderr: 5750K .......... .......... .......... .......... .......... 6% 306M 1s 2024-09-12T17:30:55.131 INFO:teuthology.orchestra.run.smithi067.stderr: 5800K .......... .......... .......... .......... .......... 6% 290M 1s 2024-09-12T17:30:55.131 INFO:teuthology.orchestra.run.smithi067.stderr: 5850K .......... .......... .......... .......... .......... 6% 264M 1s 2024-09-12T17:30:55.131 INFO:teuthology.orchestra.run.smithi067.stderr: 5900K .......... .......... .......... .......... .......... 6% 262M 1s 2024-09-12T17:30:55.131 INFO:teuthology.orchestra.run.smithi067.stderr: 5950K .......... .......... .......... .......... .......... 6% 304M 1s 2024-09-12T17:30:55.131 INFO:teuthology.orchestra.run.smithi067.stderr: 6000K .......... .......... .......... .......... .......... 6% 332M 1s 2024-09-12T17:30:55.132 INFO:teuthology.orchestra.run.smithi067.stderr: 6050K .......... .......... .......... .......... .......... 6% 300M 1s 2024-09-12T17:30:55.132 INFO:teuthology.orchestra.run.smithi067.stderr: 6100K .......... .......... .......... .......... .......... 6% 261M 1s 2024-09-12T17:30:55.132 INFO:teuthology.orchestra.run.smithi067.stderr: 6150K .......... .......... .......... .......... .......... 6% 316M 1s 2024-09-12T17:30:55.132 INFO:teuthology.orchestra.run.smithi067.stderr: 6200K .......... .......... .......... .......... .......... 6% 312M 1s 2024-09-12T17:30:55.132 INFO:teuthology.orchestra.run.smithi067.stderr: 6250K .......... .......... .......... .......... .......... 6% 319M 1s 2024-09-12T17:30:55.132 INFO:teuthology.orchestra.run.smithi067.stderr: 6300K .......... .......... .......... .......... .......... 6% 247M 1s 2024-09-12T17:30:55.132 INFO:teuthology.orchestra.run.smithi067.stderr: 6350K .......... .......... .......... .......... .......... 6% 310M 1s 2024-09-12T17:30:55.132 INFO:teuthology.orchestra.run.smithi067.stderr: 6400K .......... .......... .......... .......... .......... 6% 290M 1s 2024-09-12T17:30:55.132 INFO:teuthology.orchestra.run.smithi067.stderr: 6450K .......... .......... .......... .......... .......... 6% 285M 1s 2024-09-12T17:30:55.132 INFO:teuthology.orchestra.run.smithi067.stderr: 6500K .......... .......... .......... .......... .......... 7% 276M 1s 2024-09-12T17:30:55.132 INFO:teuthology.orchestra.run.smithi067.stderr: 6550K .......... .......... .......... .......... .......... 7% 296M 1s 2024-09-12T17:30:55.132 INFO:teuthology.orchestra.run.smithi067.stderr: 6600K .......... .......... .......... .......... .......... 7% 314M 1s 2024-09-12T17:30:55.132 INFO:teuthology.orchestra.run.smithi067.stderr: 6650K .......... .......... .......... .......... .......... 7% 299M 1s 2024-09-12T17:30:55.133 INFO:teuthology.orchestra.run.smithi067.stderr: 6700K .......... .......... .......... .......... .......... 7% 237M 1s 2024-09-12T17:30:55.133 INFO:teuthology.orchestra.run.smithi067.stderr: 6750K .......... .......... .......... .......... .......... 7% 356M 1s 2024-09-12T17:30:55.133 INFO:teuthology.orchestra.run.smithi067.stderr: 6800K .......... .......... .......... .......... .......... 7% 343M 1s 2024-09-12T17:30:55.133 INFO:teuthology.orchestra.run.smithi067.stderr: 6850K .......... .......... .......... .......... .......... 7% 335M 1s 2024-09-12T17:30:55.133 INFO:teuthology.orchestra.run.smithi067.stderr: 6900K .......... .......... .......... .......... .......... 7% 258M 1s 2024-09-12T17:30:55.133 INFO:teuthology.orchestra.run.smithi067.stderr: 6950K .......... .......... .......... .......... .......... 7% 282M 1s 2024-09-12T17:30:55.133 INFO:teuthology.orchestra.run.smithi067.stderr: 7000K .......... .......... .......... .......... .......... 7% 314M 1s 2024-09-12T17:30:55.133 INFO:teuthology.orchestra.run.smithi067.stderr: 7050K .......... .......... .......... .......... .......... 7% 299M 1s 2024-09-12T17:30:55.133 INFO:teuthology.orchestra.run.smithi067.stderr: 7100K .......... .......... .......... .......... .......... 7% 243M 1s 2024-09-12T17:30:55.133 INFO:teuthology.orchestra.run.smithi067.stderr: 7150K .......... .......... .......... .......... .......... 7% 317M 1s 2024-09-12T17:30:55.133 INFO:teuthology.orchestra.run.smithi067.stderr: 7200K .......... .......... .......... .......... .......... 7% 315M 1s 2024-09-12T17:30:55.133 INFO:teuthology.orchestra.run.smithi067.stderr: 7250K .......... .......... .......... .......... .......... 7% 297M 1s 2024-09-12T17:30:55.133 INFO:teuthology.orchestra.run.smithi067.stderr: 7300K .......... .......... .......... .......... .......... 7% 265M 1s 2024-09-12T17:30:55.133 INFO:teuthology.orchestra.run.smithi067.stderr: 7350K .......... .......... .......... .......... .......... 7% 303M 1s 2024-09-12T17:30:55.134 INFO:teuthology.orchestra.run.smithi067.stderr: 7400K .......... .......... .......... .......... .......... 8% 283M 1s 2024-09-12T17:30:55.134 INFO:teuthology.orchestra.run.smithi067.stderr: 7450K .......... .......... .......... .......... .......... 8% 322M 1s 2024-09-12T17:30:55.134 INFO:teuthology.orchestra.run.smithi067.stderr: 7500K .......... .......... .......... .......... .......... 8% 255M 1s 2024-09-12T17:30:55.134 INFO:teuthology.orchestra.run.smithi067.stderr: 7550K .......... .......... .......... .......... .......... 8% 313M 1s 2024-09-12T17:30:55.134 INFO:teuthology.orchestra.run.smithi067.stderr: 7600K .......... .......... .......... .......... .......... 8% 288M 1s 2024-09-12T17:30:55.134 INFO:teuthology.orchestra.run.smithi067.stderr: 7650K .......... .......... .......... .......... .......... 8% 288M 1s 2024-09-12T17:30:55.134 INFO:teuthology.orchestra.run.smithi067.stderr: 7700K .......... .......... .......... .......... .......... 8% 289M 1s 2024-09-12T17:30:55.134 INFO:teuthology.orchestra.run.smithi067.stderr: 7750K .......... .......... .......... .......... .......... 8% 331M 1s 2024-09-12T17:30:55.134 INFO:teuthology.orchestra.run.smithi067.stderr: 7800K .......... .......... .......... .......... .......... 8% 326M 1s 2024-09-12T17:30:55.134 INFO:teuthology.orchestra.run.smithi067.stderr: 7850K .......... .......... .......... .......... .......... 8% 309M 1s 2024-09-12T17:30:55.134 INFO:teuthology.orchestra.run.smithi067.stderr: 7900K .......... .......... .......... .......... .......... 8% 30.1M 1s 2024-09-12T17:30:55.134 INFO:teuthology.orchestra.run.smithi067.stderr: 7950K .......... .......... .......... .......... .......... 8% 292M 1s 2024-09-12T17:30:55.134 INFO:teuthology.orchestra.run.smithi067.stderr: 8000K .......... .......... .......... .......... .......... 8% 298M 1s 2024-09-12T17:30:55.135 INFO:teuthology.orchestra.run.smithi067.stderr: 8050K .......... .......... .......... .......... .......... 8% 269M 1s 2024-09-12T17:30:55.135 INFO:teuthology.orchestra.run.smithi067.stderr: 8100K .......... .......... .......... .......... .......... 8% 225M 1s 2024-09-12T17:30:55.135 INFO:teuthology.orchestra.run.smithi067.stderr: 8150K .......... .......... .......... .......... .......... 8% 306M 1s 2024-09-12T17:30:55.135 INFO:teuthology.orchestra.run.smithi067.stderr: 8200K .......... .......... .......... .......... .......... 8% 294M 1s 2024-09-12T17:30:55.135 INFO:teuthology.orchestra.run.smithi067.stderr: 8250K .......... .......... .......... .......... .......... 8% 266M 1s 2024-09-12T17:30:55.135 INFO:teuthology.orchestra.run.smithi067.stderr: 8300K .......... .......... .......... .......... .......... 8% 250M 1s 2024-09-12T17:30:55.135 INFO:teuthology.orchestra.run.smithi067.stderr: 8350K .......... .......... .......... .......... .......... 9% 303M 1s 2024-09-12T17:30:55.135 INFO:teuthology.orchestra.run.smithi067.stderr: 8400K .......... .......... .......... .......... .......... 9% 305M 1s 2024-09-12T17:30:55.135 INFO:teuthology.orchestra.run.smithi067.stderr: 8450K .......... .......... .......... .......... .......... 9% 310M 1s 2024-09-12T17:30:55.135 INFO:teuthology.orchestra.run.smithi067.stderr: 8500K .......... .......... .......... .......... .......... 9% 277M 1s 2024-09-12T17:30:55.135 INFO:teuthology.orchestra.run.smithi067.stderr: 8550K .......... .......... .......... .......... .......... 9% 199M 1s 2024-09-12T17:30:55.135 INFO:teuthology.orchestra.run.smithi067.stderr: 8600K .......... .......... .......... .......... .......... 9% 260M 1s 2024-09-12T17:30:55.135 INFO:teuthology.orchestra.run.smithi067.stderr: 8650K .......... .......... .......... .......... .......... 9% 304M 1s 2024-09-12T17:30:55.136 INFO:teuthology.orchestra.run.smithi067.stderr: 8700K .......... .......... .......... .......... .......... 9% 262M 1s 2024-09-12T17:30:55.136 INFO:teuthology.orchestra.run.smithi067.stderr: 8750K .......... .......... .......... .......... .......... 9% 336M 1s 2024-09-12T17:30:55.136 INFO:teuthology.orchestra.run.smithi067.stderr: 8800K .......... .......... .......... .......... .......... 9% 315M 1s 2024-09-12T17:30:55.136 INFO:teuthology.orchestra.run.smithi067.stderr: 8850K .......... .......... .......... .......... .......... 9% 323M 1s 2024-09-12T17:30:55.136 INFO:teuthology.orchestra.run.smithi067.stderr: 8900K .......... .......... .......... .......... .......... 9% 272M 1s 2024-09-12T17:30:55.136 INFO:teuthology.orchestra.run.smithi067.stderr: 8950K .......... .......... .......... .......... .......... 9% 312M 1s 2024-09-12T17:30:55.136 INFO:teuthology.orchestra.run.smithi067.stderr: 9000K .......... .......... .......... .......... .......... 9% 340M 1s 2024-09-12T17:30:55.136 INFO:teuthology.orchestra.run.smithi067.stderr: 9050K .......... .......... .......... .......... .......... 9% 304M 1s 2024-09-12T17:30:55.136 INFO:teuthology.orchestra.run.smithi067.stderr: 9100K .......... .......... .......... .......... .......... 9% 267M 1s 2024-09-12T17:30:55.136 INFO:teuthology.orchestra.run.smithi067.stderr: 9150K .......... .......... .......... .......... .......... 9% 327M 1s 2024-09-12T17:30:55.136 INFO:teuthology.orchestra.run.smithi067.stderr: 9200K .......... .......... .......... .......... .......... 9% 314M 1s 2024-09-12T17:30:55.136 INFO:teuthology.orchestra.run.smithi067.stderr: 9250K .......... .......... .......... .......... .......... 10% 296M 1s 2024-09-12T17:30:55.136 INFO:teuthology.orchestra.run.smithi067.stderr: 9300K .......... .......... .......... .......... .......... 10% 328M 1s 2024-09-12T17:30:55.136 INFO:teuthology.orchestra.run.smithi067.stderr: 9350K .......... .......... .......... .......... .......... 10% 306M 1s 2024-09-12T17:30:55.137 INFO:teuthology.orchestra.run.smithi067.stderr: 9400K .......... .......... .......... .......... .......... 10% 312M 1s 2024-09-12T17:30:55.137 INFO:teuthology.orchestra.run.smithi067.stderr: 9450K .......... .......... .......... .......... .......... 10% 329M 1s 2024-09-12T17:30:55.137 INFO:teuthology.orchestra.run.smithi067.stderr: 9500K .......... .......... .......... .......... .......... 10% 258M 1s 2024-09-12T17:30:55.137 INFO:teuthology.orchestra.run.smithi067.stderr: 9550K .......... .......... .......... .......... .......... 10% 289M 1s 2024-09-12T17:30:55.137 INFO:teuthology.orchestra.run.smithi067.stderr: 9600K .......... .......... .......... .......... .......... 10% 279M 1s 2024-09-12T17:30:55.137 INFO:teuthology.orchestra.run.smithi067.stderr: 9650K .......... .......... .......... .......... .......... 10% 317M 1s 2024-09-12T17:30:55.137 INFO:teuthology.orchestra.run.smithi067.stderr: 9700K .......... .......... .......... .......... .......... 10% 286M 1s 2024-09-12T17:30:55.137 INFO:teuthology.orchestra.run.smithi067.stderr: 9750K .......... .......... .......... .......... .......... 10% 306M 1s 2024-09-12T17:30:55.137 INFO:teuthology.orchestra.run.smithi067.stderr: 9800K .......... .......... .......... .......... .......... 10% 282M 1s 2024-09-12T17:30:55.137 INFO:teuthology.orchestra.run.smithi067.stderr: 9850K .......... .......... .......... .......... .......... 10% 267M 1s 2024-09-12T17:30:55.137 INFO:teuthology.orchestra.run.smithi067.stderr: 9900K .......... .......... .......... .......... .......... 10% 253M 1s 2024-09-12T17:30:55.137 INFO:teuthology.orchestra.run.smithi067.stderr: 9950K .......... .......... .......... .......... .......... 10% 333M 1s 2024-09-12T17:30:55.137 INFO:teuthology.orchestra.run.smithi067.stderr: 10000K .......... .......... .......... .......... .......... 10% 309M 1s 2024-09-12T17:30:55.137 INFO:teuthology.orchestra.run.smithi067.stderr: 10050K .......... .......... .......... .......... .......... 10% 286M 1s 2024-09-12T17:30:55.138 INFO:teuthology.orchestra.run.smithi067.stderr: 10100K .......... .......... .......... .......... .......... 10% 295M 1s 2024-09-12T17:30:55.138 INFO:teuthology.orchestra.run.smithi067.stderr: 10150K .......... .......... .......... .......... .......... 10% 288M 1s 2024-09-12T17:30:55.138 INFO:teuthology.orchestra.run.smithi067.stderr: 10200K .......... .......... .......... .......... .......... 11% 279M 1s 2024-09-12T17:30:55.138 INFO:teuthology.orchestra.run.smithi067.stderr: 10250K .......... .......... .......... .......... .......... 11% 373M 1s 2024-09-12T17:30:55.138 INFO:teuthology.orchestra.run.smithi067.stderr: 10300K .......... .......... .......... .......... .......... 11% 375M 1s 2024-09-12T17:30:55.138 INFO:teuthology.orchestra.run.smithi067.stderr: 10350K .......... .......... .......... .......... .......... 11% 286M 1s 2024-09-12T17:30:55.138 INFO:teuthology.orchestra.run.smithi067.stderr: 10400K .......... .......... .......... .......... .......... 11% 356M 1s 2024-09-12T17:30:55.138 INFO:teuthology.orchestra.run.smithi067.stderr: 10450K .......... .......... .......... .......... .......... 11% 236M 1s 2024-09-12T17:30:55.138 INFO:teuthology.orchestra.run.smithi067.stderr: 10500K .......... .......... .......... .......... .......... 11% 292M 1s 2024-09-12T17:30:55.138 INFO:teuthology.orchestra.run.smithi067.stderr: 10550K .......... .......... .......... .......... .......... 11% 301M 1s 2024-09-12T17:30:55.138 INFO:teuthology.orchestra.run.smithi067.stderr: 10600K .......... .......... .......... .......... .......... 11% 368M 1s 2024-09-12T17:30:55.138 INFO:teuthology.orchestra.run.smithi067.stderr: 10650K .......... .......... .......... .......... .......... 11% 60.0M 1s 2024-09-12T17:30:55.138 INFO:teuthology.orchestra.run.smithi067.stderr: 10700K .......... .......... .......... .......... .......... 11% 273M 1s 2024-09-12T17:30:55.138 INFO:teuthology.orchestra.run.smithi067.stderr: 10750K .......... .......... .......... .......... .......... 11% 222M 1s 2024-09-12T17:30:55.139 INFO:teuthology.orchestra.run.smithi067.stderr: 10800K .......... .......... .......... .......... .......... 11% 379M 1s 2024-09-12T17:30:55.139 INFO:teuthology.orchestra.run.smithi067.stderr: 10850K .......... .......... .......... .......... .......... 11% 351M 1s 2024-09-12T17:30:55.139 INFO:teuthology.orchestra.run.smithi067.stderr: 10900K .......... .......... .......... .......... .......... 11% 89.4M 1s 2024-09-12T17:30:55.139 INFO:teuthology.orchestra.run.smithi067.stderr: 10950K .......... .......... .......... .......... .......... 11% 116M 1s 2024-09-12T17:30:55.139 INFO:teuthology.orchestra.run.smithi067.stderr: 11000K .......... .......... .......... .......... .......... 11% 116M 1s 2024-09-12T17:30:55.139 INFO:teuthology.orchestra.run.smithi067.stderr: 11050K .......... .......... .......... .......... .......... 11% 120M 1s 2024-09-12T17:30:55.139 INFO:teuthology.orchestra.run.smithi067.stderr: 11100K .......... .......... .......... .......... .......... 12% 282M 1s 2024-09-12T17:30:55.139 INFO:teuthology.orchestra.run.smithi067.stderr: 11150K .......... .......... .......... .......... .......... 12% 205M 1s 2024-09-12T17:30:55.139 INFO:teuthology.orchestra.run.smithi067.stderr: 11200K .......... .......... .......... .......... .......... 12% 297M 1s 2024-09-12T17:30:55.139 INFO:teuthology.orchestra.run.smithi067.stderr: 11250K .......... .......... .......... .......... .......... 12% 290M 1s 2024-09-12T17:30:55.139 INFO:teuthology.orchestra.run.smithi067.stderr: 11300K .......... .......... .......... .......... .......... 12% 300M 1s 2024-09-12T17:30:55.139 INFO:teuthology.orchestra.run.smithi067.stderr: 11350K .......... .......... .......... .......... .......... 12% 315M 1s 2024-09-12T17:30:55.139 INFO:teuthology.orchestra.run.smithi067.stderr: 11400K .......... .......... .......... .......... .......... 12% 310M 1s 2024-09-12T17:30:55.139 INFO:teuthology.orchestra.run.smithi067.stderr: 11450K .......... .......... .......... .......... .......... 12% 379M 1s 2024-09-12T17:30:55.140 INFO:teuthology.orchestra.run.smithi067.stderr: 11500K .......... .......... .......... .......... .......... 12% 180M 1s 2024-09-12T17:30:55.140 INFO:teuthology.orchestra.run.smithi067.stderr: 11550K .......... .......... .......... .......... .......... 12% 237M 1s 2024-09-12T17:30:55.140 INFO:teuthology.orchestra.run.smithi067.stderr: 11600K .......... .......... .......... .......... .......... 12% 322M 1s 2024-09-12T17:30:55.140 INFO:teuthology.orchestra.run.smithi067.stderr: 11650K .......... .......... .......... .......... .......... 12% 283M 1s 2024-09-12T17:30:55.140 INFO:teuthology.orchestra.run.smithi067.stderr: 11700K .......... .......... .......... .......... .......... 12% 261M 1s 2024-09-12T17:30:55.140 INFO:teuthology.orchestra.run.smithi067.stderr: 11750K .......... .......... .......... .......... .......... 12% 255M 1s 2024-09-12T17:30:55.140 INFO:teuthology.orchestra.run.smithi067.stderr: 11800K .......... .......... .......... .......... .......... 12% 271M 1s 2024-09-12T17:30:55.140 INFO:teuthology.orchestra.run.smithi067.stderr: 11850K .......... .......... .......... .......... .......... 12% 277M 1s 2024-09-12T17:30:55.140 INFO:teuthology.orchestra.run.smithi067.stderr: 11900K .......... .......... .......... .......... .......... 12% 309M 1s 2024-09-12T17:30:55.140 INFO:teuthology.orchestra.run.smithi067.stderr: 11950K .......... .......... .......... .......... .......... 12% 233M 1s 2024-09-12T17:30:55.140 INFO:teuthology.orchestra.run.smithi067.stderr: 12000K .......... .......... .......... .......... .......... 12% 265M 1s 2024-09-12T17:30:55.140 INFO:teuthology.orchestra.run.smithi067.stderr: 12050K .......... .......... .......... .......... .......... 13% 298M 1s 2024-09-12T17:30:55.140 INFO:teuthology.orchestra.run.smithi067.stderr: 12100K .......... .......... .......... .......... .......... 13% 357M 1s 2024-09-12T17:30:55.140 INFO:teuthology.orchestra.run.smithi067.stderr: 12150K .......... .......... .......... .......... .......... 13% 294M 1s 2024-09-12T17:30:55.141 INFO:teuthology.orchestra.run.smithi067.stderr: 12200K .......... .......... .......... .......... .......... 13% 294M 1s 2024-09-12T17:30:55.141 INFO:teuthology.orchestra.run.smithi067.stderr: 12250K .......... .......... .......... .......... .......... 13% 307M 1s 2024-09-12T17:30:55.141 INFO:teuthology.orchestra.run.smithi067.stderr: 12300K .......... .......... .......... .......... .......... 13% 338M 1s 2024-09-12T17:30:55.141 INFO:teuthology.orchestra.run.smithi067.stderr: 12350K .......... .......... .......... .......... .......... 13% 267M 1s 2024-09-12T17:30:55.141 INFO:teuthology.orchestra.run.smithi067.stderr: 12400K .......... .......... .......... .......... .......... 13% 272M 1s 2024-09-12T17:30:55.141 INFO:teuthology.orchestra.run.smithi067.stderr: 12450K .......... .......... .......... .......... .......... 13% 290M 1s 2024-09-12T17:30:55.141 INFO:teuthology.orchestra.run.smithi067.stderr: 12500K .......... .......... .......... .......... .......... 13% 337M 1s 2024-09-12T17:30:55.141 INFO:teuthology.orchestra.run.smithi067.stderr: 12550K .......... .......... .......... .......... .......... 13% 282M 1s 2024-09-12T17:30:55.141 INFO:teuthology.orchestra.run.smithi067.stderr: 12600K .......... .......... .......... .......... .......... 13% 357M 1s 2024-09-12T17:30:55.141 INFO:teuthology.orchestra.run.smithi067.stderr: 12650K .......... .......... .......... .......... .......... 13% 321M 1s 2024-09-12T17:30:55.141 INFO:teuthology.orchestra.run.smithi067.stderr: 12700K .......... .......... .......... .......... .......... 13% 358M 1s 2024-09-12T17:30:55.141 INFO:teuthology.orchestra.run.smithi067.stderr: 12750K .......... .......... .......... .......... .......... 13% 212M 1s 2024-09-12T17:30:55.141 INFO:teuthology.orchestra.run.smithi067.stderr: 12800K .......... .......... .......... .......... .......... 13% 315M 1s 2024-09-12T17:30:55.141 INFO:teuthology.orchestra.run.smithi067.stderr: 12850K .......... .......... .......... .......... .......... 13% 372M 1s 2024-09-12T17:30:55.142 INFO:teuthology.orchestra.run.smithi067.stderr: 12900K .......... .......... .......... .......... .......... 13% 295M 1s 2024-09-12T17:30:55.142 INFO:teuthology.orchestra.run.smithi067.stderr: 12950K .......... .......... .......... .......... .......... 13% 267M 1s 2024-09-12T17:30:55.142 INFO:teuthology.orchestra.run.smithi067.stderr: 13000K .......... .......... .......... .......... .......... 14% 314M 1s 2024-09-12T17:30:55.142 INFO:teuthology.orchestra.run.smithi067.stderr: 13050K .......... .......... .......... .......... .......... 14% 316M 1s 2024-09-12T17:30:55.142 INFO:teuthology.orchestra.run.smithi067.stderr: 13100K .......... .......... .......... .......... .......... 14% 341M 1s 2024-09-12T17:30:55.142 INFO:teuthology.orchestra.run.smithi067.stderr: 13150K .......... .......... .......... .......... .......... 14% 291M 1s 2024-09-12T17:30:55.142 INFO:teuthology.orchestra.run.smithi067.stderr: 13200K .......... .......... .......... .......... .......... 14% 291M 1s 2024-09-12T17:30:55.142 INFO:teuthology.orchestra.run.smithi067.stderr: 13250K .......... .......... .......... .......... .......... 14% 277M 1s 2024-09-12T17:30:55.142 INFO:teuthology.orchestra.run.smithi067.stderr: 13300K .......... .......... .......... .......... .......... 14% 268M 1s 2024-09-12T17:30:55.142 INFO:teuthology.orchestra.run.smithi067.stderr: 13350K .......... .......... .......... .......... .......... 14% 239M 1s 2024-09-12T17:30:55.142 INFO:teuthology.orchestra.run.smithi067.stderr: 13400K .......... .......... .......... .......... .......... 14% 320M 1s 2024-09-12T17:30:55.142 INFO:teuthology.orchestra.run.smithi067.stderr: 13450K .......... .......... .......... .......... .......... 14% 298M 1s 2024-09-12T17:30:55.142 INFO:teuthology.orchestra.run.smithi067.stderr: 13500K .......... .......... .......... .......... .......... 14% 387M 1s 2024-09-12T17:30:55.142 INFO:teuthology.orchestra.run.smithi067.stderr: 13550K .......... .......... .......... .......... .......... 14% 312M 1s 2024-09-12T17:30:55.143 INFO:teuthology.orchestra.run.smithi067.stderr: 13600K .......... .......... .......... .......... .......... 14% 349M 1s 2024-09-12T17:30:55.143 INFO:teuthology.orchestra.run.smithi067.stderr: 13650K .......... .......... .......... .......... .......... 14% 95.0M 1s 2024-09-12T17:30:55.143 INFO:teuthology.orchestra.run.smithi067.stderr: 13700K .......... .......... .......... .......... .......... 14% 282M 1s 2024-09-12T17:30:55.143 INFO:teuthology.orchestra.run.smithi067.stderr: 13750K .......... .......... .......... .......... .......... 14% 310M 1s 2024-09-12T17:30:55.143 INFO:teuthology.orchestra.run.smithi067.stderr: 13800K .......... .......... .......... .......... .......... 14% 312M 1s 2024-09-12T17:30:55.143 INFO:teuthology.orchestra.run.smithi067.stderr: 13850K .......... .......... .......... .......... .......... 14% 67.2M 1s 2024-09-12T17:30:55.143 INFO:teuthology.orchestra.run.smithi067.stderr: 13900K .......... .......... .......... .......... .......... 15% 296M 1s 2024-09-12T17:30:55.143 INFO:teuthology.orchestra.run.smithi067.stderr: 13950K .......... .......... .......... .......... .......... 15% 247M 1s 2024-09-12T17:30:55.143 INFO:teuthology.orchestra.run.smithi067.stderr: 14000K .......... .......... .......... .......... .......... 15% 380M 1s 2024-09-12T17:30:55.143 INFO:teuthology.orchestra.run.smithi067.stderr: 14050K .......... .......... .......... .......... .......... 15% 99.1M 1s 2024-09-12T17:30:55.143 INFO:teuthology.orchestra.run.smithi067.stderr: 14100K .......... .......... .......... .......... .......... 15% 148M 1s 2024-09-12T17:30:55.143 INFO:teuthology.orchestra.run.smithi067.stderr: 14150K .......... .......... .......... .......... .......... 15% 241M 1s 2024-09-12T17:30:55.143 INFO:teuthology.orchestra.run.smithi067.stderr: 14200K .......... .......... .......... .......... .......... 15% 318M 1s 2024-09-12T17:30:55.143 INFO:teuthology.orchestra.run.smithi067.stderr: 14250K .......... .......... .......... .......... .......... 15% 140M 1s 2024-09-12T17:30:55.144 INFO:teuthology.orchestra.run.smithi067.stderr: 14300K .......... .......... .......... .......... .......... 15% 290M 1s 2024-09-12T17:30:55.144 INFO:teuthology.orchestra.run.smithi067.stderr: 14350K .......... .......... .......... .......... .......... 15% 303M 1s 2024-09-12T17:30:55.144 INFO:teuthology.orchestra.run.smithi067.stderr: 14400K .......... .......... .......... .......... .......... 15% 110M 1s 2024-09-12T17:30:55.144 INFO:teuthology.orchestra.run.smithi067.stderr: 14450K .......... .......... .......... .......... .......... 15% 264M 1s 2024-09-12T17:30:55.144 INFO:teuthology.orchestra.run.smithi067.stderr: 14500K .......... .......... .......... .......... .......... 15% 294M 1s 2024-09-12T17:30:55.144 INFO:teuthology.orchestra.run.smithi067.stderr: 14550K .......... .......... .......... .......... .......... 15% 294M 1s 2024-09-12T17:30:55.144 INFO:teuthology.orchestra.run.smithi067.stderr: 14600K .......... .......... .......... .......... .......... 15% 292M 1s 2024-09-12T17:30:55.144 INFO:teuthology.orchestra.run.smithi067.stderr: 14650K .......... .......... .......... .......... .......... 15% 275M 1s 2024-09-12T17:30:55.144 INFO:teuthology.orchestra.run.smithi067.stderr: 14700K .......... .......... .......... .......... .......... 15% 329M 1s 2024-09-12T17:30:55.144 INFO:teuthology.orchestra.run.smithi067.stderr: 14750K .......... .......... .......... .......... .......... 15% 266M 1s 2024-09-12T17:30:55.144 INFO:teuthology.orchestra.run.smithi067.stderr: 14800K .......... .......... .......... .......... .......... 15% 318M 1s 2024-09-12T17:30:55.144 INFO:teuthology.orchestra.run.smithi067.stderr: 14850K .......... .......... .......... .......... .......... 16% 345M 1s 2024-09-12T17:30:55.144 INFO:teuthology.orchestra.run.smithi067.stderr: 14900K .......... .......... .......... .......... .......... 16% 350M 1s 2024-09-12T17:30:55.144 INFO:teuthology.orchestra.run.smithi067.stderr: 14950K .......... .......... .......... .......... .......... 16% 288M 1s 2024-09-12T17:30:55.145 INFO:teuthology.orchestra.run.smithi067.stderr: 15000K .......... .......... .......... .......... .......... 16% 347M 1s 2024-09-12T17:30:55.145 INFO:teuthology.orchestra.run.smithi067.stderr: 15050K .......... .......... .......... .......... .......... 16% 322M 1s 2024-09-12T17:30:55.145 INFO:teuthology.orchestra.run.smithi067.stderr: 15100K .......... .......... .......... .......... .......... 16% 306M 1s 2024-09-12T17:30:55.145 INFO:teuthology.orchestra.run.smithi067.stderr: 15150K .......... .......... .......... .......... .......... 16% 259M 1s 2024-09-12T17:30:55.145 INFO:teuthology.orchestra.run.smithi067.stderr: 15200K .......... .......... .......... .......... .......... 16% 319M 1s 2024-09-12T17:30:55.145 INFO:teuthology.orchestra.run.smithi067.stderr: 15250K .......... .......... .......... .......... .......... 16% 282M 1s 2024-09-12T17:30:55.145 INFO:teuthology.orchestra.run.smithi067.stderr: 15300K .......... .......... .......... .......... .......... 16% 294M 1s 2024-09-12T17:30:55.145 INFO:teuthology.orchestra.run.smithi067.stderr: 15350K .......... .......... .......... .......... .......... 16% 273M 1s 2024-09-12T17:30:55.145 INFO:teuthology.orchestra.run.smithi067.stderr: 15400K .......... .......... .......... .......... .......... 16% 304M 1s 2024-09-12T17:30:55.145 INFO:teuthology.orchestra.run.smithi067.stderr: 15450K .......... .......... .......... .......... .......... 16% 315M 1s 2024-09-12T17:30:55.145 INFO:teuthology.orchestra.run.smithi067.stderr: 15500K .......... .......... .......... .......... .......... 16% 275M 1s 2024-09-12T17:30:55.145 INFO:teuthology.orchestra.run.smithi067.stderr: 15550K .......... .......... .......... .......... .......... 16% 286M 1s 2024-09-12T17:30:55.145 INFO:teuthology.orchestra.run.smithi067.stderr: 15600K .......... .......... .......... .......... .......... 16% 361M 1s 2024-09-12T17:30:55.145 INFO:teuthology.orchestra.run.smithi067.stderr: 15650K .......... .......... .......... .......... .......... 16% 302M 1s 2024-09-12T17:30:55.146 INFO:teuthology.orchestra.run.smithi067.stderr: 15700K .......... .......... .......... .......... .......... 16% 330M 1s 2024-09-12T17:30:55.146 INFO:teuthology.orchestra.run.smithi067.stderr: 15750K .......... .......... .......... .......... .......... 17% 344M 1s 2024-09-12T17:30:55.146 INFO:teuthology.orchestra.run.smithi067.stderr: 15800K .......... .......... .......... .......... .......... 17% 311M 1s 2024-09-12T17:30:55.146 INFO:teuthology.orchestra.run.smithi067.stderr: 15850K .......... .......... .......... .......... .......... 17% 319M 1s 2024-09-12T17:30:55.146 INFO:teuthology.orchestra.run.smithi067.stderr: 15900K .......... .......... .......... .......... .......... 17% 340M 1s 2024-09-12T17:30:55.146 INFO:teuthology.orchestra.run.smithi067.stderr: 15950K .......... .......... .......... .......... .......... 17% 202M 1s 2024-09-12T17:30:55.146 INFO:teuthology.orchestra.run.smithi067.stderr: 16000K .......... .......... .......... .......... .......... 17% 301M 1s 2024-09-12T17:30:55.146 INFO:teuthology.orchestra.run.smithi067.stderr: 16050K .......... .......... .......... .......... .......... 17% 255M 1s 2024-09-12T17:30:55.146 INFO:teuthology.orchestra.run.smithi067.stderr: 16100K .......... .......... .......... .......... .......... 17% 363M 1s 2024-09-12T17:30:55.146 INFO:teuthology.orchestra.run.smithi067.stderr: 16150K .......... .......... .......... .......... .......... 17% 295M 1s 2024-09-12T17:30:55.146 INFO:teuthology.orchestra.run.smithi067.stderr: 16200K .......... .......... .......... .......... .......... 17% 314M 1s 2024-09-12T17:30:55.146 INFO:teuthology.orchestra.run.smithi067.stderr: 16250K .......... .......... .......... .......... .......... 17% 359M 1s 2024-09-12T17:30:55.146 INFO:teuthology.orchestra.run.smithi067.stderr: 16300K .......... .......... .......... .......... .......... 17% 309M 1s 2024-09-12T17:30:55.146 INFO:teuthology.orchestra.run.smithi067.stderr: 16350K .......... .......... .......... .......... .......... 17% 283M 1s 2024-09-12T17:30:55.146 INFO:teuthology.orchestra.run.smithi067.stderr: 16400K .......... .......... .......... .......... .......... 17% 352M 1s 2024-09-12T17:30:55.147 INFO:teuthology.orchestra.run.smithi067.stderr: 16450K .......... .......... .......... .......... .......... 17% 327M 1s 2024-09-12T17:30:55.147 INFO:teuthology.orchestra.run.smithi067.stderr: 16500K .......... .......... .......... .......... .......... 17% 345M 1s 2024-09-12T17:30:55.147 INFO:teuthology.orchestra.run.smithi067.stderr: 16550K .......... .......... .......... .......... .......... 17% 331M 1s 2024-09-12T17:30:55.147 INFO:teuthology.orchestra.run.smithi067.stderr: 16600K .......... .......... .......... .......... .......... 17% 67.8M 1s 2024-09-12T17:30:55.147 INFO:teuthology.orchestra.run.smithi067.stderr: 16650K .......... .......... .......... .......... .......... 17% 296M 1s 2024-09-12T17:30:55.147 INFO:teuthology.orchestra.run.smithi067.stderr: 16700K .......... .......... .......... .......... .......... 18% 338M 1s 2024-09-12T17:30:55.147 INFO:teuthology.orchestra.run.smithi067.stderr: 16750K .......... .......... .......... .......... .......... 18% 266M 1s 2024-09-12T17:30:55.147 INFO:teuthology.orchestra.run.smithi067.stderr: 16800K .......... .......... .......... .......... .......... 18% 374M 1s 2024-09-12T17:30:55.147 INFO:teuthology.orchestra.run.smithi067.stderr: 16850K .......... .......... .......... .......... .......... 18% 350M 1s 2024-09-12T17:30:55.147 INFO:teuthology.orchestra.run.smithi067.stderr: 16900K .......... .......... .......... .......... .......... 18% 111M 1s 2024-09-12T17:30:55.147 INFO:teuthology.orchestra.run.smithi067.stderr: 16950K .......... .......... .......... .......... .......... 18% 259M 1s 2024-09-12T17:30:55.147 INFO:teuthology.orchestra.run.smithi067.stderr: 17000K .......... .......... .......... .......... .......... 18% 84.4M 1s 2024-09-12T17:30:55.147 INFO:teuthology.orchestra.run.smithi067.stderr: 17050K .......... .......... .......... .......... .......... 18% 264M 1s 2024-09-12T17:30:55.148 INFO:teuthology.orchestra.run.smithi067.stderr: 17100K .......... .......... .......... .......... .......... 18% 358M 1s 2024-09-12T17:30:55.148 INFO:teuthology.orchestra.run.smithi067.stderr: 17150K .......... .......... .......... .......... .......... 18% 254M 1s 2024-09-12T17:30:55.148 INFO:teuthology.orchestra.run.smithi067.stderr: 17200K .......... .......... .......... .......... .......... 18% 222M 1s 2024-09-12T17:30:55.148 INFO:teuthology.orchestra.run.smithi067.stderr: 17250K .......... .......... .......... .......... .......... 18% 322M 1s 2024-09-12T17:30:55.148 INFO:teuthology.orchestra.run.smithi067.stderr: 17300K .......... .......... .......... .......... .......... 18% 118M 1s 2024-09-12T17:30:55.148 INFO:teuthology.orchestra.run.smithi067.stderr: 17350K .......... .......... .......... .......... .......... 18% 189M 1s 2024-09-12T17:30:55.148 INFO:teuthology.orchestra.run.smithi067.stderr: 17400K .......... .......... .......... .......... .......... 18% 111M 1s 2024-09-12T17:30:55.148 INFO:teuthology.orchestra.run.smithi067.stderr: 17450K .......... .......... .......... .......... .......... 18% 283M 1s 2024-09-12T17:30:55.148 INFO:teuthology.orchestra.run.smithi067.stderr: 17500K .......... .......... .......... .......... .......... 18% 391M 1s 2024-09-12T17:30:55.148 INFO:teuthology.orchestra.run.smithi067.stderr: 17550K .......... .......... .......... .......... .......... 18% 161M 1s 2024-09-12T17:30:55.148 INFO:teuthology.orchestra.run.smithi067.stderr: 17600K .......... .......... .......... .......... .......... 18% 297M 1s 2024-09-12T17:30:55.148 INFO:teuthology.orchestra.run.smithi067.stderr: 17650K .......... .......... .......... .......... .......... 19% 310M 1s 2024-09-12T17:30:55.148 INFO:teuthology.orchestra.run.smithi067.stderr: 17700K .......... .......... .......... .......... .......... 19% 328M 1s 2024-09-12T17:30:55.148 INFO:teuthology.orchestra.run.smithi067.stderr: 17750K .......... .......... .......... .......... .......... 19% 294M 1s 2024-09-12T17:30:55.149 INFO:teuthology.orchestra.run.smithi067.stderr: 17800K .......... .......... .......... .......... .......... 19% 291M 1s 2024-09-12T17:30:55.149 INFO:teuthology.orchestra.run.smithi067.stderr: 17850K .......... .......... .......... .......... .......... 19% 264M 1s 2024-09-12T17:30:55.149 INFO:teuthology.orchestra.run.smithi067.stderr: 17900K .......... .......... .......... .......... .......... 19% 294M 1s 2024-09-12T17:30:55.149 INFO:teuthology.orchestra.run.smithi067.stderr: 17950K .......... .......... .......... .......... .......... 19% 270M 1s 2024-09-12T17:30:55.149 INFO:teuthology.orchestra.run.smithi067.stderr: 18000K .......... .......... .......... .......... .......... 19% 369M 1s 2024-09-12T17:30:55.149 INFO:teuthology.orchestra.run.smithi067.stderr: 18050K .......... .......... .......... .......... .......... 19% 353M 1s 2024-09-12T17:30:55.149 INFO:teuthology.orchestra.run.smithi067.stderr: 18100K .......... .......... .......... .......... .......... 19% 291M 1s 2024-09-12T17:30:55.149 INFO:teuthology.orchestra.run.smithi067.stderr: 18150K .......... .......... .......... .......... .......... 19% 274M 1s 2024-09-12T17:30:55.149 INFO:teuthology.orchestra.run.smithi067.stderr: 18200K .......... .......... .......... .......... .......... 19% 331M 1s 2024-09-12T17:30:55.149 INFO:teuthology.orchestra.run.smithi067.stderr: 18250K .......... .......... .......... .......... .......... 19% 389M 1s 2024-09-12T17:30:55.149 INFO:teuthology.orchestra.run.smithi067.stderr: 18300K .......... .......... .......... .......... .......... 19% 230M 1s 2024-09-12T17:30:55.149 INFO:teuthology.orchestra.run.smithi067.stderr: 18350K .......... .......... .......... .......... .......... 19% 255M 1s 2024-09-12T17:30:55.149 INFO:teuthology.orchestra.run.smithi067.stderr: 18400K .......... .......... .......... .......... .......... 19% 367M 1s 2024-09-12T17:30:55.149 INFO:teuthology.orchestra.run.smithi067.stderr: 18450K .......... .......... .......... .......... .......... 19% 309M 1s 2024-09-12T17:30:55.150 INFO:teuthology.orchestra.run.smithi067.stderr: 18500K .......... .......... .......... .......... .......... 19% 304M 1s 2024-09-12T17:30:55.150 INFO:teuthology.orchestra.run.smithi067.stderr: 18550K .......... .......... .......... .......... .......... 20% 238M 1s 2024-09-12T17:30:55.150 INFO:teuthology.orchestra.run.smithi067.stderr: 18600K .......... .......... .......... .......... .......... 20% 298M 1s 2024-09-12T17:30:55.150 INFO:teuthology.orchestra.run.smithi067.stderr: 18650K .......... .......... .......... .......... .......... 20% 314M 1s 2024-09-12T17:30:55.150 INFO:teuthology.orchestra.run.smithi067.stderr: 18700K .......... .......... .......... .......... .......... 20% 372M 1s 2024-09-12T17:30:55.150 INFO:teuthology.orchestra.run.smithi067.stderr: 18750K .......... .......... .......... .......... .......... 20% 317M 1s 2024-09-12T17:30:55.150 INFO:teuthology.orchestra.run.smithi067.stderr: 18800K .......... .......... .......... .......... .......... 20% 193M 1s 2024-09-12T17:30:55.150 INFO:teuthology.orchestra.run.smithi067.stderr: 18850K .......... .......... .......... .......... .......... 20% 293M 1s 2024-09-12T17:30:55.150 INFO:teuthology.orchestra.run.smithi067.stderr: 18900K .......... .......... .......... .......... .......... 20% 340M 1s 2024-09-12T17:30:55.150 INFO:teuthology.orchestra.run.smithi067.stderr: 18950K .......... .......... .......... .......... .......... 20% 292M 1s 2024-09-12T17:30:55.150 INFO:teuthology.orchestra.run.smithi067.stderr: 19000K .......... .......... .......... .......... .......... 20% 276M 1s 2024-09-12T17:30:55.150 INFO:teuthology.orchestra.run.smithi067.stderr: 19050K .......... .......... .......... .......... .......... 20% 305M 1s 2024-09-12T17:30:55.150 INFO:teuthology.orchestra.run.smithi067.stderr: 19100K .......... .......... .......... .......... .......... 20% 304M 1s 2024-09-12T17:30:55.150 INFO:teuthology.orchestra.run.smithi067.stderr: 19150K .......... .......... .......... .......... .......... 20% 247M 1s 2024-09-12T17:30:55.151 INFO:teuthology.orchestra.run.smithi067.stderr: 19200K .......... .......... .......... .......... .......... 20% 357M 1s 2024-09-12T17:30:55.151 INFO:teuthology.orchestra.run.smithi067.stderr: 19250K .......... .......... .......... .......... .......... 20% 304M 1s 2024-09-12T17:30:55.151 INFO:teuthology.orchestra.run.smithi067.stderr: 19300K .......... .......... .......... .......... .......... 20% 294M 1s 2024-09-12T17:30:55.151 INFO:teuthology.orchestra.run.smithi067.stderr: 19350K .......... .......... .......... .......... .......... 20% 283M 1s 2024-09-12T17:30:55.151 INFO:teuthology.orchestra.run.smithi067.stderr: 19400K .......... .......... .......... .......... .......... 20% 272M 1s 2024-09-12T17:30:55.151 INFO:teuthology.orchestra.run.smithi067.stderr: 19450K .......... .......... .......... .......... .......... 20% 322M 1s 2024-09-12T17:30:55.151 INFO:teuthology.orchestra.run.smithi067.stderr: 19500K .......... .......... .......... .......... .......... 21% 389M 1s 2024-09-12T17:30:55.151 INFO:teuthology.orchestra.run.smithi067.stderr: 19550K .......... .......... .......... .......... .......... 21% 293M 1s 2024-09-12T17:30:55.151 INFO:teuthology.orchestra.run.smithi067.stderr: 19600K .......... .......... .......... .......... .......... 21% 382M 1s 2024-09-12T17:30:55.151 INFO:teuthology.orchestra.run.smithi067.stderr: 19650K .......... .......... .......... .......... .......... 21% 209M 1s 2024-09-12T17:30:55.151 INFO:teuthology.orchestra.run.smithi067.stderr: 19700K .......... .......... .......... .......... .......... 21% 148M 1s 2024-09-12T17:30:55.151 INFO:teuthology.orchestra.run.smithi067.stderr: 19750K .......... .......... .......... .......... .......... 21% 253M 1s 2024-09-12T17:30:55.151 INFO:teuthology.orchestra.run.smithi067.stderr: 19800K .......... .......... .......... .......... .......... 21% 371M 1s 2024-09-12T17:30:55.151 INFO:teuthology.orchestra.run.smithi067.stderr: 19850K .......... .......... .......... .......... .......... 21% 69.1M 1s 2024-09-12T17:30:55.152 INFO:teuthology.orchestra.run.smithi067.stderr: 19900K .......... .......... .......... .......... .......... 21% 312M 1s 2024-09-12T17:30:55.152 INFO:teuthology.orchestra.run.smithi067.stderr: 19950K .......... .......... .......... .......... .......... 21% 166M 1s 2024-09-12T17:30:55.152 INFO:teuthology.orchestra.run.smithi067.stderr: 20000K .......... .......... .......... .......... .......... 21% 393M 1s 2024-09-12T17:30:55.152 INFO:teuthology.orchestra.run.smithi067.stderr: 20050K .......... .......... .......... .......... .......... 21% 290M 1s 2024-09-12T17:30:55.152 INFO:teuthology.orchestra.run.smithi067.stderr: 20100K .......... .......... .......... .......... .......... 21% 352M 1s 2024-09-12T17:30:55.152 INFO:teuthology.orchestra.run.smithi067.stderr: 20150K .......... .......... .......... .......... .......... 21% 239M 1s 2024-09-12T17:30:55.152 INFO:teuthology.orchestra.run.smithi067.stderr: 20200K .......... .......... .......... .......... .......... 21% 326M 1s 2024-09-12T17:30:55.152 INFO:teuthology.orchestra.run.smithi067.stderr: 20250K .......... .......... .......... .......... .......... 21% 320M 1s 2024-09-12T17:30:55.152 INFO:teuthology.orchestra.run.smithi067.stderr: 20300K .......... .......... .......... .......... .......... 21% 339M 1s 2024-09-12T17:30:55.152 INFO:teuthology.orchestra.run.smithi067.stderr: 20350K .......... .......... .......... .......... .......... 21% 164M 1s 2024-09-12T17:30:55.152 INFO:teuthology.orchestra.run.smithi067.stderr: 20400K .......... .......... .......... .......... .......... 22% 155M 1s 2024-09-12T17:30:55.152 INFO:teuthology.orchestra.run.smithi067.stderr: 20450K .......... .......... .......... .......... .......... 22% 57.8M 1s 2024-09-12T17:30:55.152 INFO:teuthology.orchestra.run.smithi067.stderr: 20500K .......... .......... .......... .......... .......... 22% 164M 1s 2024-09-12T17:30:55.152 INFO:teuthology.orchestra.run.smithi067.stderr: 20550K .......... .......... .......... .......... .......... 22% 300M 1s 2024-09-12T17:30:55.152 INFO:teuthology.orchestra.run.smithi067.stderr: 20600K .......... .......... .......... .......... .......... 22% 370M 1s 2024-09-12T17:30:55.153 INFO:teuthology.orchestra.run.smithi067.stderr: 20650K .......... .......... .......... .......... .......... 22% 301M 1s 2024-09-12T17:30:55.153 INFO:teuthology.orchestra.run.smithi067.stderr: 20700K .......... .......... .......... .......... .......... 22% 222M 1s 2024-09-12T17:30:55.153 INFO:teuthology.orchestra.run.smithi067.stderr: 20750K .......... .......... .......... .......... .......... 22% 281M 1s 2024-09-12T17:30:55.153 INFO:teuthology.orchestra.run.smithi067.stderr: 20800K .......... .......... .......... .......... .......... 22% 309M 1s 2024-09-12T17:30:55.153 INFO:teuthology.orchestra.run.smithi067.stderr: 20850K .......... .......... .......... .......... .......... 22% 261M 1s 2024-09-12T17:30:55.153 INFO:teuthology.orchestra.run.smithi067.stderr: 20900K .......... .......... .......... .......... .......... 22% 279M 1s 2024-09-12T17:30:55.153 INFO:teuthology.orchestra.run.smithi067.stderr: 20950K .......... .......... .......... .......... .......... 22% 302M 1s 2024-09-12T17:30:55.153 INFO:teuthology.orchestra.run.smithi067.stderr: 21000K .......... .......... .......... .......... .......... 22% 292M 1s 2024-09-12T17:30:55.153 INFO:teuthology.orchestra.run.smithi067.stderr: 21050K .......... .......... .......... .......... .......... 22% 322M 1s 2024-09-12T17:30:55.153 INFO:teuthology.orchestra.run.smithi067.stderr: 21100K .......... .......... .......... .......... .......... 22% 238M 1s 2024-09-12T17:30:55.153 INFO:teuthology.orchestra.run.smithi067.stderr: 21150K .......... .......... .......... .......... .......... 22% 370M 1s 2024-09-12T17:30:55.153 INFO:teuthology.orchestra.run.smithi067.stderr: 21200K .......... .......... .......... .......... .......... 22% 285M 1s 2024-09-12T17:30:55.153 INFO:teuthology.orchestra.run.smithi067.stderr: 21250K .......... .......... .......... .......... .......... 22% 370M 1s 2024-09-12T17:30:55.154 INFO:teuthology.orchestra.run.smithi067.stderr: 21300K .......... .......... .......... .......... .......... 22% 309M 1s 2024-09-12T17:30:55.154 INFO:teuthology.orchestra.run.smithi067.stderr: 21350K .......... .......... .......... .......... .......... 23% 356M 1s 2024-09-12T17:30:55.154 INFO:teuthology.orchestra.run.smithi067.stderr: 21400K .......... .......... .......... .......... .......... 23% 282M 1s 2024-09-12T17:30:55.154 INFO:teuthology.orchestra.run.smithi067.stderr: 21450K .......... .......... .......... .......... .......... 23% 390M 1s 2024-09-12T17:30:55.154 INFO:teuthology.orchestra.run.smithi067.stderr: 21500K .......... .......... .......... .......... .......... 23% 283M 1s 2024-09-12T17:30:55.154 INFO:teuthology.orchestra.run.smithi067.stderr: 21550K .......... .......... .......... .......... .......... 23% 297M 1s 2024-09-12T17:30:55.154 INFO:teuthology.orchestra.run.smithi067.stderr: 21600K .......... .......... .......... .......... .......... 23% 353M 1s 2024-09-12T17:30:55.154 INFO:teuthology.orchestra.run.smithi067.stderr: 21650K .......... .......... .......... .......... .......... 23% 297M 1s 2024-09-12T17:30:55.154 INFO:teuthology.orchestra.run.smithi067.stderr: 21700K .......... .......... .......... .......... .......... 23% 269M 1s 2024-09-12T17:30:55.154 INFO:teuthology.orchestra.run.smithi067.stderr: 21750K .......... .......... .......... .......... .......... 23% 338M 1s 2024-09-12T17:30:55.154 INFO:teuthology.orchestra.run.smithi067.stderr: 21800K .......... .......... .......... .......... .......... 23% 327M 1s 2024-09-12T17:30:55.154 INFO:teuthology.orchestra.run.smithi067.stderr: 21850K .......... .......... .......... .......... .......... 23% 343M 1s 2024-09-12T17:30:55.154 INFO:teuthology.orchestra.run.smithi067.stderr: 21900K .......... .......... .......... .......... .......... 23% 290M 1s 2024-09-12T17:30:55.154 INFO:teuthology.orchestra.run.smithi067.stderr: 21950K .......... .......... .......... .......... .......... 23% 310M 1s 2024-09-12T17:30:55.155 INFO:teuthology.orchestra.run.smithi067.stderr: 22000K .......... .......... .......... .......... .......... 23% 320M 1s 2024-09-12T17:30:55.155 INFO:teuthology.orchestra.run.smithi067.stderr: 22050K .......... .......... .......... .......... .......... 23% 366M 1s 2024-09-12T17:30:55.155 INFO:teuthology.orchestra.run.smithi067.stderr: 22100K .......... .......... .......... .......... .......... 23% 302M 1s 2024-09-12T17:30:55.155 INFO:teuthology.orchestra.run.smithi067.stderr: 22150K .......... .......... .......... .......... .......... 23% 296M 1s 2024-09-12T17:30:55.155 INFO:teuthology.orchestra.run.smithi067.stderr: 22200K .......... .......... .......... .......... .......... 23% 289M 1s 2024-09-12T17:30:55.155 INFO:teuthology.orchestra.run.smithi067.stderr: 22250K .......... .......... .......... .......... .......... 24% 332M 1s 2024-09-12T17:30:55.155 INFO:teuthology.orchestra.run.smithi067.stderr: 22300K .......... .......... .......... .......... .......... 24% 283M 1s 2024-09-12T17:30:55.155 INFO:teuthology.orchestra.run.smithi067.stderr: 22350K .......... .......... .......... .......... .......... 24% 330M 1s 2024-09-12T17:30:55.155 INFO:teuthology.orchestra.run.smithi067.stderr: 22400K .......... .......... .......... .......... .......... 24% 305M 1s 2024-09-12T17:30:55.155 INFO:teuthology.orchestra.run.smithi067.stderr: 22450K .......... .......... .......... .......... .......... 24% 346M 0s 2024-09-12T17:30:55.155 INFO:teuthology.orchestra.run.smithi067.stderr: 22500K .......... .......... .......... .......... .......... 24% 288M 0s 2024-09-12T17:30:55.155 INFO:teuthology.orchestra.run.smithi067.stderr: 22550K .......... .......... .......... .......... .......... 24% 112M 0s 2024-09-12T17:30:55.155 INFO:teuthology.orchestra.run.smithi067.stderr: 22600K .......... .......... .......... .......... .......... 24% 300M 0s 2024-09-12T17:30:55.155 INFO:teuthology.orchestra.run.smithi067.stderr: 22650K .......... .......... .......... .......... .......... 24% 345M 0s 2024-09-12T17:30:55.156 INFO:teuthology.orchestra.run.smithi067.stderr: 22700K .......... .......... .......... .......... .......... 24% 268M 0s 2024-09-12T17:30:55.156 INFO:teuthology.orchestra.run.smithi067.stderr: 22750K .......... .......... .......... .......... .......... 24% 383M 0s 2024-09-12T17:30:55.156 INFO:teuthology.orchestra.run.smithi067.stderr: 22800K .......... .......... .......... .......... .......... 24% 69.4M 0s 2024-09-12T17:30:55.156 INFO:teuthology.orchestra.run.smithi067.stderr: 22850K .......... .......... .......... .......... .......... 24% 254M 0s 2024-09-12T17:30:55.156 INFO:teuthology.orchestra.run.smithi067.stderr: 22900K .......... .......... .......... .......... .......... 24% 303M 0s 2024-09-12T17:30:55.156 INFO:teuthology.orchestra.run.smithi067.stderr: 22950K .......... .......... .......... .......... .......... 24% 246M 0s 2024-09-12T17:30:55.156 INFO:teuthology.orchestra.run.smithi067.stderr: 23000K .......... .......... .......... .......... .......... 24% 303M 0s 2024-09-12T17:30:55.156 INFO:teuthology.orchestra.run.smithi067.stderr: 23050K .......... .......... .......... .......... .......... 24% 283M 0s 2024-09-12T17:30:55.156 INFO:teuthology.orchestra.run.smithi067.stderr: 23100K .......... .......... .......... .......... .......... 24% 328M 0s 2024-09-12T17:30:55.156 INFO:teuthology.orchestra.run.smithi067.stderr: 23150K .......... .......... .......... .......... .......... 24% 287M 0s 2024-09-12T17:30:55.156 INFO:teuthology.orchestra.run.smithi067.stderr: 23200K .......... .......... .......... .......... .......... 25% 324M 0s 2024-09-12T17:30:55.156 INFO:teuthology.orchestra.run.smithi067.stderr: 23250K .......... .......... .......... .......... .......... 25% 318M 0s 2024-09-12T17:30:55.156 INFO:teuthology.orchestra.run.smithi067.stderr: 23300K .......... .......... .......... .......... .......... 25% 202M 0s 2024-09-12T17:30:55.157 INFO:teuthology.orchestra.run.smithi067.stderr: 23350K .......... .......... .......... .......... .......... 25% 335M 0s 2024-09-12T17:30:55.157 INFO:teuthology.orchestra.run.smithi067.stderr: 23400K .......... .......... .......... .......... .......... 25% 318M 0s 2024-09-12T17:30:55.157 INFO:teuthology.orchestra.run.smithi067.stderr: 23450K .......... .......... .......... .......... .......... 25% 146M 0s 2024-09-12T17:30:55.157 INFO:teuthology.orchestra.run.smithi067.stderr: 23500K .......... .......... .......... .......... .......... 25% 103M 0s 2024-09-12T17:30:55.157 INFO:teuthology.orchestra.run.smithi067.stderr: 23550K .......... .......... .......... .......... .......... 25% 323M 0s 2024-09-12T17:30:55.157 INFO:teuthology.orchestra.run.smithi067.stderr: 23600K .......... .......... .......... .......... .......... 25% 75.3M 0s 2024-09-12T17:30:55.157 INFO:teuthology.orchestra.run.smithi067.stderr: 23650K .......... .......... .......... .......... .......... 25% 211M 0s 2024-09-12T17:30:55.157 INFO:teuthology.orchestra.run.smithi067.stderr: 23700K .......... .......... .......... .......... .......... 25% 93.3M 0s 2024-09-12T17:30:55.157 INFO:teuthology.orchestra.run.smithi067.stderr: 23750K .......... .......... .......... .......... .......... 25% 291M 0s 2024-09-12T17:30:55.157 INFO:teuthology.orchestra.run.smithi067.stderr: 23800K .......... .......... .......... .......... .......... 25% 336M 0s 2024-09-12T17:30:55.157 INFO:teuthology.orchestra.run.smithi067.stderr: 23850K .......... .......... .......... .......... .......... 25% 344M 0s 2024-09-12T17:30:55.157 INFO:teuthology.orchestra.run.smithi067.stderr: 23900K .......... .......... .......... .......... .......... 25% 330M 0s 2024-09-12T17:30:55.157 INFO:teuthology.orchestra.run.smithi067.stderr: 23950K .......... .......... .......... .......... .......... 25% 307M 0s 2024-09-12T17:30:55.157 INFO:teuthology.orchestra.run.smithi067.stderr: 24000K .......... .......... .......... .......... .......... 25% 306M 0s 2024-09-12T17:30:55.158 INFO:teuthology.orchestra.run.smithi067.stderr: 24050K .......... .......... .......... .......... .......... 25% 323M 0s 2024-09-12T17:30:55.158 INFO:teuthology.orchestra.run.smithi067.stderr: 24100K .......... .......... .......... .......... .......... 25% 258M 0s 2024-09-12T17:30:55.158 INFO:teuthology.orchestra.run.smithi067.stderr: 24150K .......... .......... .......... .......... .......... 26% 323M 0s 2024-09-12T17:30:55.158 INFO:teuthology.orchestra.run.smithi067.stderr: 24200K .......... .......... .......... .......... .......... 26% 293M 0s 2024-09-12T17:30:55.158 INFO:teuthology.orchestra.run.smithi067.stderr: 24250K .......... .......... .......... .......... .......... 26% 292M 0s 2024-09-12T17:30:55.158 INFO:teuthology.orchestra.run.smithi067.stderr: 24300K .......... .......... .......... .......... .......... 26% 300M 0s 2024-09-12T17:30:55.158 INFO:teuthology.orchestra.run.smithi067.stderr: 24350K .......... .......... .......... .......... .......... 26% 280M 0s 2024-09-12T17:30:55.158 INFO:teuthology.orchestra.run.smithi067.stderr: 24400K .......... .......... .......... .......... .......... 26% 363M 0s 2024-09-12T17:30:55.158 INFO:teuthology.orchestra.run.smithi067.stderr: 24450K .......... .......... .......... .......... .......... 26% 289M 0s 2024-09-12T17:30:55.158 INFO:teuthology.orchestra.run.smithi067.stderr: 24500K .......... .......... .......... .......... .......... 26% 246M 0s 2024-09-12T17:30:55.158 INFO:teuthology.orchestra.run.smithi067.stderr: 24550K .......... .......... .......... .......... .......... 26% 307M 0s 2024-09-12T17:30:55.158 INFO:teuthology.orchestra.run.smithi067.stderr: 24600K .......... .......... .......... .......... .......... 26% 269M 0s 2024-09-12T17:30:55.158 INFO:teuthology.orchestra.run.smithi067.stderr: 24650K .......... .......... .......... .......... .......... 26% 286M 0s 2024-09-12T17:30:55.159 INFO:teuthology.orchestra.run.smithi067.stderr: 24700K .......... .......... .......... .......... .......... 26% 251M 0s 2024-09-12T17:30:55.159 INFO:teuthology.orchestra.run.smithi067.stderr: 24750K .......... .......... .......... .......... .......... 26% 347M 0s 2024-09-12T17:30:55.159 INFO:teuthology.orchestra.run.smithi067.stderr: 24800K .......... .......... .......... .......... .......... 26% 277M 0s 2024-09-12T17:30:55.159 INFO:teuthology.orchestra.run.smithi067.stderr: 24850K .......... .......... .......... .......... .......... 26% 270M 0s 2024-09-12T17:30:55.159 INFO:teuthology.orchestra.run.smithi067.stderr: 24900K .......... .......... .......... .......... .......... 26% 266M 0s 2024-09-12T17:30:55.159 INFO:teuthology.orchestra.run.smithi067.stderr: 24950K .......... .......... .......... .......... .......... 26% 305M 0s 2024-09-12T17:30:55.159 INFO:teuthology.orchestra.run.smithi067.stderr: 25000K .......... .......... .......... .......... .......... 26% 353M 0s 2024-09-12T17:30:55.159 INFO:teuthology.orchestra.run.smithi067.stderr: 25050K .......... .......... .......... .......... .......... 27% 388M 0s 2024-09-12T17:30:55.159 INFO:teuthology.orchestra.run.smithi067.stderr: 25100K .......... .......... .......... .......... .......... 27% 330M 0s 2024-09-12T17:30:55.159 INFO:teuthology.orchestra.run.smithi067.stderr: 25150K .......... .......... .......... .......... .......... 27% 341M 0s 2024-09-12T17:30:55.159 INFO:teuthology.orchestra.run.smithi067.stderr: 25200K .......... .......... .......... .......... .......... 27% 244M 0s 2024-09-12T17:30:55.159 INFO:teuthology.orchestra.run.smithi067.stderr: 25250K .......... .......... .......... .......... .......... 27% 298M 0s 2024-09-12T17:30:55.159 INFO:teuthology.orchestra.run.smithi067.stderr: 25300K .......... .......... .......... .......... .......... 27% 273M 0s 2024-09-12T17:30:55.159 INFO:teuthology.orchestra.run.smithi067.stderr: 25350K .......... .......... .......... .......... .......... 27% 314M 0s 2024-09-12T17:30:55.160 INFO:teuthology.orchestra.run.smithi067.stderr: 25400K .......... .......... .......... .......... .......... 27% 347M 0s 2024-09-12T17:30:55.160 INFO:teuthology.orchestra.run.smithi067.stderr: 25450K .......... .......... .......... .......... .......... 27% 392M 0s 2024-09-12T17:30:55.160 INFO:teuthology.orchestra.run.smithi067.stderr: 25500K .......... .......... .......... .......... .......... 27% 339M 0s 2024-09-12T17:30:55.160 INFO:teuthology.orchestra.run.smithi067.stderr: 25550K .......... .......... .......... .......... .......... 27% 337M 0s 2024-09-12T17:30:55.160 INFO:teuthology.orchestra.run.smithi067.stderr: 25600K .......... .......... .......... .......... .......... 27% 337M 0s 2024-09-12T17:30:55.160 INFO:teuthology.orchestra.run.smithi067.stderr: 25650K .......... .......... .......... .......... .......... 27% 323M 0s 2024-09-12T17:30:55.160 INFO:teuthology.orchestra.run.smithi067.stderr: 25700K .......... .......... .......... .......... .......... 27% 290M 0s 2024-09-12T17:30:55.160 INFO:teuthology.orchestra.run.smithi067.stderr: 25750K .......... .......... .......... .......... .......... 27% 394M 0s 2024-09-12T17:30:55.160 INFO:teuthology.orchestra.run.smithi067.stderr: 25800K .......... .......... .......... .......... .......... 27% 73.9M 0s 2024-09-12T17:30:55.160 INFO:teuthology.orchestra.run.smithi067.stderr: 25850K .......... .......... .......... .......... .......... 27% 285M 0s 2024-09-12T17:30:55.160 INFO:teuthology.orchestra.run.smithi067.stderr: 25900K .......... .......... .......... .......... .......... 27% 297M 0s 2024-09-12T17:30:55.160 INFO:teuthology.orchestra.run.smithi067.stderr: 25950K .......... .......... .......... .......... .......... 27% 371M 0s 2024-09-12T17:30:55.160 INFO:teuthology.orchestra.run.smithi067.stderr: 26000K .......... .......... .......... .......... .......... 28% 315M 0s 2024-09-12T17:30:55.161 INFO:teuthology.orchestra.run.smithi067.stderr: 26050K .......... .......... .......... .......... .......... 28% 188M 0s 2024-09-12T17:30:55.161 INFO:teuthology.orchestra.run.smithi067.stderr: 26100K .......... .......... .......... .......... .......... 28% 226M 0s 2024-09-12T17:30:55.161 INFO:teuthology.orchestra.run.smithi067.stderr: 26150K .......... .......... .......... .......... .......... 28% 341M 0s 2024-09-12T17:30:55.161 INFO:teuthology.orchestra.run.smithi067.stderr: 26200K .......... .......... .......... .......... .......... 28% 161M 0s 2024-09-12T17:30:55.161 INFO:teuthology.orchestra.run.smithi067.stderr: 26250K .......... .......... .......... .......... .......... 28% 337M 0s 2024-09-12T17:30:55.161 INFO:teuthology.orchestra.run.smithi067.stderr: 26300K .......... .......... .......... .......... .......... 28% 297M 0s 2024-09-12T17:30:55.161 INFO:teuthology.orchestra.run.smithi067.stderr: 26350K .......... .......... .......... .......... .......... 28% 323M 0s 2024-09-12T17:30:55.161 INFO:teuthology.orchestra.run.smithi067.stderr: 26400K .......... .......... .......... .......... .......... 28% 353M 0s 2024-09-12T17:30:55.161 INFO:teuthology.orchestra.run.smithi067.stderr: 26450K .......... .......... .......... .......... .......... 28% 381M 0s 2024-09-12T17:30:55.161 INFO:teuthology.orchestra.run.smithi067.stderr: 26500K .......... .......... .......... .......... .......... 28% 155M 0s 2024-09-12T17:30:55.161 INFO:teuthology.orchestra.run.smithi067.stderr: 26550K .......... .......... .......... .......... .......... 28% 234M 0s 2024-09-12T17:30:55.161 INFO:teuthology.orchestra.run.smithi067.stderr: 26600K .......... .......... .......... .......... .......... 28% 345M 0s 2024-09-12T17:30:55.161 INFO:teuthology.orchestra.run.smithi067.stderr: 26650K .......... .......... .......... .......... .......... 28% 80.8M 0s 2024-09-12T17:30:55.161 INFO:teuthology.orchestra.run.smithi067.stderr: 26700K .......... .......... .......... .......... .......... 28% 187M 0s 2024-09-12T17:30:55.162 INFO:teuthology.orchestra.run.smithi067.stderr: 26750K .......... .......... .......... .......... .......... 28% 54.3M 0s 2024-09-12T17:30:55.162 INFO:teuthology.orchestra.run.smithi067.stderr: 26800K .......... .......... .......... .......... .......... 28% 317M 0s 2024-09-12T17:30:55.162 INFO:teuthology.orchestra.run.smithi067.stderr: 26850K .......... .......... .......... .......... .......... 28% 279M 0s 2024-09-12T17:30:55.162 INFO:teuthology.orchestra.run.smithi067.stderr: 26900K .......... .......... .......... .......... .......... 29% 307M 0s 2024-09-12T17:30:55.162 INFO:teuthology.orchestra.run.smithi067.stderr: 26950K .......... .......... .......... .......... .......... 29% 324M 0s 2024-09-12T17:30:55.162 INFO:teuthology.orchestra.run.smithi067.stderr: 27000K .......... .......... .......... .......... .......... 29% 332M 0s 2024-09-12T17:30:55.162 INFO:teuthology.orchestra.run.smithi067.stderr: 27050K .......... .......... .......... .......... .......... 29% 318M 0s 2024-09-12T17:30:55.162 INFO:teuthology.orchestra.run.smithi067.stderr: 27100K .......... .......... .......... .......... .......... 29% 315M 0s 2024-09-12T17:30:55.162 INFO:teuthology.orchestra.run.smithi067.stderr: 27150K .......... .......... .......... .......... .......... 29% 326M 0s 2024-09-12T17:30:55.162 INFO:teuthology.orchestra.run.smithi067.stderr: 27200K .......... .......... .......... .......... .......... 29% 361M 0s 2024-09-12T17:30:55.162 INFO:teuthology.orchestra.run.smithi067.stderr: 27250K .......... .......... .......... .......... .......... 29% 285M 0s 2024-09-12T17:30:55.162 INFO:teuthology.orchestra.run.smithi067.stderr: 27300K .......... .......... .......... .......... .......... 29% 251M 0s 2024-09-12T17:30:55.162 INFO:teuthology.orchestra.run.smithi067.stderr: 27350K .......... .......... .......... .......... .......... 29% 315M 0s 2024-09-12T17:30:55.163 INFO:teuthology.orchestra.run.smithi067.stderr: 27400K .......... .......... .......... .......... .......... 29% 329M 0s 2024-09-12T17:30:55.163 INFO:teuthology.orchestra.run.smithi067.stderr: 27450K .......... .......... .......... .......... .......... 29% 354M 0s 2024-09-12T17:30:55.163 INFO:teuthology.orchestra.run.smithi067.stderr: 27500K .......... .......... .......... .......... .......... 29% 308M 0s 2024-09-12T17:30:55.163 INFO:teuthology.orchestra.run.smithi067.stderr: 27550K .......... .......... .......... .......... .......... 29% 272M 0s 2024-09-12T17:30:55.163 INFO:teuthology.orchestra.run.smithi067.stderr: 27600K .......... .......... .......... .......... .......... 29% 211M 0s 2024-09-12T17:30:55.163 INFO:teuthology.orchestra.run.smithi067.stderr: 27650K .......... .......... .......... .......... .......... 29% 302M 0s 2024-09-12T17:30:55.163 INFO:teuthology.orchestra.run.smithi067.stderr: 27700K .......... .......... .......... .......... .......... 29% 226M 0s 2024-09-12T17:30:55.163 INFO:teuthology.orchestra.run.smithi067.stderr: 27750K .......... .......... .......... .......... .......... 29% 274M 0s 2024-09-12T17:30:55.163 INFO:teuthology.orchestra.run.smithi067.stderr: 27800K .......... .......... .......... .......... .......... 29% 326M 0s 2024-09-12T17:30:55.163 INFO:teuthology.orchestra.run.smithi067.stderr: 27850K .......... .......... .......... .......... .......... 30% 323M 0s 2024-09-12T17:30:55.163 INFO:teuthology.orchestra.run.smithi067.stderr: 27900K .......... .......... .......... .......... .......... 30% 327M 0s 2024-09-12T17:30:55.163 INFO:teuthology.orchestra.run.smithi067.stderr: 27950K .......... .......... .......... .......... .......... 30% 304M 0s 2024-09-12T17:30:55.163 INFO:teuthology.orchestra.run.smithi067.stderr: 28000K .......... .......... .......... .......... .......... 30% 332M 0s 2024-09-12T17:30:55.164 INFO:teuthology.orchestra.run.smithi067.stderr: 28050K .......... .......... .......... .......... .......... 30% 187M 0s 2024-09-12T17:30:55.164 INFO:teuthology.orchestra.run.smithi067.stderr: 28100K .......... .......... .......... .......... .......... 30% 253M 0s 2024-09-12T17:30:55.164 INFO:teuthology.orchestra.run.smithi067.stderr: 28150K .......... .......... .......... .......... .......... 30% 335M 0s 2024-09-12T17:30:55.164 INFO:teuthology.orchestra.run.smithi067.stderr: 28200K .......... .......... .......... .......... .......... 30% 387M 0s 2024-09-12T17:30:55.164 INFO:teuthology.orchestra.run.smithi067.stderr: 28250K .......... .......... .......... .......... .......... 30% 356M 0s 2024-09-12T17:30:55.164 INFO:teuthology.orchestra.run.smithi067.stderr: 28300K .......... .......... .......... .......... .......... 30% 275M 0s 2024-09-12T17:30:55.164 INFO:teuthology.orchestra.run.smithi067.stderr: 28350K .......... .......... .......... .......... .......... 30% 345M 0s 2024-09-12T17:30:55.164 INFO:teuthology.orchestra.run.smithi067.stderr: 28400K .......... .......... .......... .......... .......... 30% 296M 0s 2024-09-12T17:30:55.164 INFO:teuthology.orchestra.run.smithi067.stderr: 28450K .......... .......... .......... .......... .......... 30% 339M 0s 2024-09-12T17:30:55.164 INFO:teuthology.orchestra.run.smithi067.stderr: 28500K .......... .......... .......... .......... .......... 30% 288M 0s 2024-09-12T17:30:55.164 INFO:teuthology.orchestra.run.smithi067.stderr: 28550K .......... .......... .......... .......... .......... 30% 298M 0s 2024-09-12T17:30:55.164 INFO:teuthology.orchestra.run.smithi067.stderr: 28600K .......... .......... .......... .......... .......... 30% 331M 0s 2024-09-12T17:30:55.164 INFO:teuthology.orchestra.run.smithi067.stderr: 28650K .......... .......... .......... .......... .......... 30% 351M 0s 2024-09-12T17:30:55.164 INFO:teuthology.orchestra.run.smithi067.stderr: 28700K .......... .......... .......... .......... .......... 30% 350M 0s 2024-09-12T17:30:55.165 INFO:teuthology.orchestra.run.smithi067.stderr: 28750K .......... .......... .......... .......... .......... 31% 398M 0s 2024-09-12T17:30:55.165 INFO:teuthology.orchestra.run.smithi067.stderr: 28800K .......... .......... .......... .......... .......... 31% 100M 0s 2024-09-12T17:30:55.165 INFO:teuthology.orchestra.run.smithi067.stderr: 28850K .......... .......... .......... .......... .......... 31% 316M 0s 2024-09-12T17:30:55.165 INFO:teuthology.orchestra.run.smithi067.stderr: 28900K .......... .......... .......... .......... .......... 31% 276M 0s 2024-09-12T17:30:55.165 INFO:teuthology.orchestra.run.smithi067.stderr: 28950K .......... .......... .......... .......... .......... 31% 385M 0s 2024-09-12T17:30:55.165 INFO:teuthology.orchestra.run.smithi067.stderr: 29000K .......... .......... .......... .......... .......... 31% 189M 0s 2024-09-12T17:30:55.165 INFO:teuthology.orchestra.run.smithi067.stderr: 29050K .......... .......... .......... .......... .......... 31% 327M 0s 2024-09-12T17:30:55.165 INFO:teuthology.orchestra.run.smithi067.stderr: 29100K .......... .......... .......... .......... .......... 31% 250M 0s 2024-09-12T17:30:55.165 INFO:teuthology.orchestra.run.smithi067.stderr: 29150K .......... .......... .......... .......... .......... 31% 341M 0s 2024-09-12T17:30:55.165 INFO:teuthology.orchestra.run.smithi067.stderr: 29200K .......... .......... .......... .......... .......... 31% 328M 0s 2024-09-12T17:30:55.165 INFO:teuthology.orchestra.run.smithi067.stderr: 29250K .......... .......... .......... .......... .......... 31% 300M 0s 2024-09-12T17:30:55.165 INFO:teuthology.orchestra.run.smithi067.stderr: 29300K .......... .......... .......... .......... .......... 31% 247M 0s 2024-09-12T17:30:55.165 INFO:teuthology.orchestra.run.smithi067.stderr: 29350K .......... .......... .......... .......... .......... 31% 328M 0s 2024-09-12T17:30:55.165 INFO:teuthology.orchestra.run.smithi067.stderr: 29400K .......... .......... .......... .......... .......... 31% 326M 0s 2024-09-12T17:30:55.166 INFO:teuthology.orchestra.run.smithi067.stderr: 29450K .......... .......... .......... .......... .......... 31% 280M 0s 2024-09-12T17:30:55.166 INFO:teuthology.orchestra.run.smithi067.stderr: 29500K .......... .......... .......... .......... .......... 31% 250M 0s 2024-09-12T17:30:55.166 INFO:teuthology.orchestra.run.smithi067.stderr: 29550K .......... .......... .......... .......... .......... 31% 308M 0s 2024-09-12T17:30:55.166 INFO:teuthology.orchestra.run.smithi067.stderr: 29600K .......... .......... .......... .......... .......... 31% 390M 0s 2024-09-12T17:30:55.166 INFO:teuthology.orchestra.run.smithi067.stderr: 29650K .......... .......... .......... .......... .......... 31% 180M 0s 2024-09-12T17:30:55.166 INFO:teuthology.orchestra.run.smithi067.stderr: 29700K .......... .......... .......... .......... .......... 32% 66.2M 0s 2024-09-12T17:30:55.166 INFO:teuthology.orchestra.run.smithi067.stderr: 29750K .......... .......... .......... .......... .......... 32% 311M 0s 2024-09-12T17:30:55.166 INFO:teuthology.orchestra.run.smithi067.stderr: 29800K .......... .......... .......... .......... .......... 32% 60.1M 0s 2024-09-12T17:30:55.166 INFO:teuthology.orchestra.run.smithi067.stderr: 29850K .......... .......... .......... .......... .......... 32% 315M 0s 2024-09-12T17:30:55.166 INFO:teuthology.orchestra.run.smithi067.stderr: 29900K .......... .......... .......... .......... .......... 32% 153M 0s 2024-09-12T17:30:55.166 INFO:teuthology.orchestra.run.smithi067.stderr: 29950K .......... .......... .......... .......... .......... 32% 316M 0s 2024-09-12T17:30:55.166 INFO:teuthology.orchestra.run.smithi067.stderr: 30000K .......... .......... .......... .......... .......... 32% 316M 0s 2024-09-12T17:30:55.166 INFO:teuthology.orchestra.run.smithi067.stderr: 30050K .......... .......... .......... .......... .......... 32% 245M 0s 2024-09-12T17:30:55.166 INFO:teuthology.orchestra.run.smithi067.stderr: 30100K .......... .......... .......... .......... .......... 32% 295M 0s 2024-09-12T17:30:55.167 INFO:teuthology.orchestra.run.smithi067.stderr: 30150K .......... .......... .......... .......... .......... 32% 287M 0s 2024-09-12T17:30:55.167 INFO:teuthology.orchestra.run.smithi067.stderr: 30200K .......... .......... .......... .......... .......... 32% 328M 0s 2024-09-12T17:30:55.167 INFO:teuthology.orchestra.run.smithi067.stderr: 30250K .......... .......... .......... .......... .......... 32% 345M 0s 2024-09-12T17:30:55.167 INFO:teuthology.orchestra.run.smithi067.stderr: 30300K .......... .......... .......... .......... .......... 32% 220M 0s 2024-09-12T17:30:55.167 INFO:teuthology.orchestra.run.smithi067.stderr: 30350K .......... .......... .......... .......... .......... 32% 320M 0s 2024-09-12T17:30:55.167 INFO:teuthology.orchestra.run.smithi067.stderr: 30400K .......... .......... .......... .......... .......... 32% 347M 0s 2024-09-12T17:30:55.167 INFO:teuthology.orchestra.run.smithi067.stderr: 30450K .......... .......... .......... .......... .......... 32% 311M 0s 2024-09-12T17:30:55.167 INFO:teuthology.orchestra.run.smithi067.stderr: 30500K .......... .......... .......... .......... .......... 32% 291M 0s 2024-09-12T17:30:55.167 INFO:teuthology.orchestra.run.smithi067.stderr: 30550K .......... .......... .......... .......... .......... 32% 356M 0s 2024-09-12T17:30:55.167 INFO:teuthology.orchestra.run.smithi067.stderr: 30600K .......... .......... .......... .......... .......... 32% 382M 0s 2024-09-12T17:30:55.167 INFO:teuthology.orchestra.run.smithi067.stderr: 30650K .......... .......... .......... .......... .......... 33% 343M 0s 2024-09-12T17:30:55.167 INFO:teuthology.orchestra.run.smithi067.stderr: 30700K .......... .......... .......... .......... .......... 33% 115M 0s 2024-09-12T17:30:55.167 INFO:teuthology.orchestra.run.smithi067.stderr: 30750K .......... .......... .......... .......... .......... 33% 383M 0s 2024-09-12T17:30:55.167 INFO:teuthology.orchestra.run.smithi067.stderr: 30800K .......... .......... .......... .......... .......... 33% 294M 0s 2024-09-12T17:30:55.168 INFO:teuthology.orchestra.run.smithi067.stderr: 30850K .......... .......... .......... .......... .......... 33% 357M 0s 2024-09-12T17:30:55.168 INFO:teuthology.orchestra.run.smithi067.stderr: 30900K .......... .......... .......... .......... .......... 33% 333M 0s 2024-09-12T17:30:55.168 INFO:teuthology.orchestra.run.smithi067.stderr: 30950K .......... .......... .......... .......... .......... 33% 308M 0s 2024-09-12T17:30:55.168 INFO:teuthology.orchestra.run.smithi067.stderr: 31000K .......... .......... .......... .......... .......... 33% 323M 0s 2024-09-12T17:30:55.168 INFO:teuthology.orchestra.run.smithi067.stderr: 31050K .......... .......... .......... .......... .......... 33% 381M 0s 2024-09-12T17:30:55.168 INFO:teuthology.orchestra.run.smithi067.stderr: 31100K .......... .......... .......... .......... .......... 33% 406M 0s 2024-09-12T17:30:55.168 INFO:teuthology.orchestra.run.smithi067.stderr: 31150K .......... .......... .......... .......... .......... 33% 135M 0s 2024-09-12T17:30:55.168 INFO:teuthology.orchestra.run.smithi067.stderr: 31200K .......... .......... .......... .......... .......... 33% 288M 0s 2024-09-12T17:30:55.168 INFO:teuthology.orchestra.run.smithi067.stderr: 31250K .......... .......... .......... .......... .......... 33% 311M 0s 2024-09-12T17:30:55.168 INFO:teuthology.orchestra.run.smithi067.stderr: 31300K .......... .......... .......... .......... .......... 33% 328M 0s 2024-09-12T17:30:55.168 INFO:teuthology.orchestra.run.smithi067.stderr: 31350K .......... .......... .......... .......... .......... 33% 352M 0s 2024-09-12T17:30:55.168 INFO:teuthology.orchestra.run.smithi067.stderr: 31400K .......... .......... .......... .......... .......... 33% 324M 0s 2024-09-12T17:30:55.168 INFO:teuthology.orchestra.run.smithi067.stderr: 31450K .......... .......... .......... .......... .......... 33% 327M 0s 2024-09-12T17:30:55.168 INFO:teuthology.orchestra.run.smithi067.stderr: 31500K .......... .......... .......... .......... .......... 33% 333M 0s 2024-09-12T17:30:55.169 INFO:teuthology.orchestra.run.smithi067.stderr: 31550K .......... .......... .......... .......... .......... 34% 243M 0s 2024-09-12T17:30:55.169 INFO:teuthology.orchestra.run.smithi067.stderr: 31600K .......... .......... .......... .......... .......... 34% 340M 0s 2024-09-12T17:30:55.169 INFO:teuthology.orchestra.run.smithi067.stderr: 31650K .......... .......... .......... .......... .......... 34% 381M 0s 2024-09-12T17:30:55.169 INFO:teuthology.orchestra.run.smithi067.stderr: 31700K .......... .......... .......... .......... .......... 34% 94.9M 0s 2024-09-12T17:30:55.169 INFO:teuthology.orchestra.run.smithi067.stderr: 31750K .......... .......... .......... .......... .......... 34% 253M 0s 2024-09-12T17:30:55.169 INFO:teuthology.orchestra.run.smithi067.stderr: 31800K .......... .......... .......... .......... .......... 34% 290M 0s 2024-09-12T17:30:55.169 INFO:teuthology.orchestra.run.smithi067.stderr: 31850K .......... .......... .......... .......... .......... 34% 293M 0s 2024-09-12T17:30:55.169 INFO:teuthology.orchestra.run.smithi067.stderr: 31900K .......... .......... .......... .......... .......... 34% 361M 0s 2024-09-12T17:30:55.169 INFO:teuthology.orchestra.run.smithi067.stderr: 31950K .......... .......... .......... .......... .......... 34% 330M 0s 2024-09-12T17:30:55.169 INFO:teuthology.orchestra.run.smithi067.stderr: 32000K .......... .......... .......... .......... .......... 34% 350M 0s 2024-09-12T17:30:55.169 INFO:teuthology.orchestra.run.smithi067.stderr: 32050K .......... .......... .......... .......... .......... 34% 360M 0s 2024-09-12T17:30:55.169 INFO:teuthology.orchestra.run.smithi067.stderr: 32100K .......... .......... .......... .......... .......... 34% 110M 0s 2024-09-12T17:30:55.169 INFO:teuthology.orchestra.run.smithi067.stderr: 32150K .......... .......... .......... .......... .......... 34% 257M 0s 2024-09-12T17:30:55.169 INFO:teuthology.orchestra.run.smithi067.stderr: 32200K .......... .......... .......... .......... .......... 34% 354M 0s 2024-09-12T17:30:55.170 INFO:teuthology.orchestra.run.smithi067.stderr: 32250K .......... .......... .......... .......... .......... 34% 307M 0s 2024-09-12T17:30:55.170 INFO:teuthology.orchestra.run.smithi067.stderr: 32300K .......... .......... .......... .......... .......... 34% 329M 0s 2024-09-12T17:30:55.170 INFO:teuthology.orchestra.run.smithi067.stderr: 32350K .......... .......... .......... .......... .......... 34% 291M 0s 2024-09-12T17:30:55.170 INFO:teuthology.orchestra.run.smithi067.stderr: 32400K .......... .......... .......... .......... .......... 34% 369M 0s 2024-09-12T17:30:55.170 INFO:teuthology.orchestra.run.smithi067.stderr: 32450K .......... .......... .......... .......... .......... 34% 338M 0s 2024-09-12T17:30:55.170 INFO:teuthology.orchestra.run.smithi067.stderr: 32500K .......... .......... .......... .......... .......... 35% 303M 0s 2024-09-12T17:30:55.170 INFO:teuthology.orchestra.run.smithi067.stderr: 32550K .......... .......... .......... .......... .......... 35% 312M 0s 2024-09-12T17:30:55.170 INFO:teuthology.orchestra.run.smithi067.stderr: 32600K .......... .......... .......... .......... .......... 35% 331M 0s 2024-09-12T17:30:55.170 INFO:teuthology.orchestra.run.smithi067.stderr: 32650K .......... .......... .......... .......... .......... 35% 386M 0s 2024-09-12T17:30:55.170 INFO:teuthology.orchestra.run.smithi067.stderr: 32700K .......... .......... .......... .......... .......... 35% 402M 0s 2024-09-12T17:30:55.170 INFO:teuthology.orchestra.run.smithi067.stderr: 32750K .......... .......... .......... .......... .......... 35% 59.1M 0s 2024-09-12T17:30:55.170 INFO:teuthology.orchestra.run.smithi067.stderr: 32800K .......... .......... .......... .......... .......... 35% 85.5M 0s 2024-09-12T17:30:55.170 INFO:teuthology.orchestra.run.smithi067.stderr: 32850K .......... .......... .......... .......... .......... 35% 293M 0s 2024-09-12T17:30:55.171 INFO:teuthology.orchestra.run.smithi067.stderr: 32900K .......... .......... .......... .......... .......... 35% 378M 0s 2024-09-12T17:30:55.171 INFO:teuthology.orchestra.run.smithi067.stderr: 32950K .......... .......... .......... .......... .......... 35% 145M 0s 2024-09-12T17:30:55.171 INFO:teuthology.orchestra.run.smithi067.stderr: 33000K .......... .......... .......... .......... .......... 35% 127M 0s 2024-09-12T17:30:55.171 INFO:teuthology.orchestra.run.smithi067.stderr: 33050K .......... .......... .......... .......... .......... 35% 304M 0s 2024-09-12T17:30:55.171 INFO:teuthology.orchestra.run.smithi067.stderr: 33100K .......... .......... .......... .......... .......... 35% 342M 0s 2024-09-12T17:30:55.171 INFO:teuthology.orchestra.run.smithi067.stderr: 33150K .......... .......... .......... .......... .......... 35% 311M 0s 2024-09-12T17:30:55.171 INFO:teuthology.orchestra.run.smithi067.stderr: 33200K .......... .......... .......... .......... .......... 35% 220M 0s 2024-09-12T17:30:55.171 INFO:teuthology.orchestra.run.smithi067.stderr: 33250K .......... .......... .......... .......... .......... 35% 315M 0s 2024-09-12T17:30:55.171 INFO:teuthology.orchestra.run.smithi067.stderr: 33300K .......... .......... .......... .......... .......... 35% 344M 0s 2024-09-12T17:30:55.171 INFO:teuthology.orchestra.run.smithi067.stderr: 33350K .......... .......... .......... .......... .......... 35% 276M 0s 2024-09-12T17:30:55.171 INFO:teuthology.orchestra.run.smithi067.stderr: 33400K .......... .......... .......... .......... .......... 36% 359M 0s 2024-09-12T17:30:55.171 INFO:teuthology.orchestra.run.smithi067.stderr: 33450K .......... .......... .......... .......... .......... 36% 354M 0s 2024-09-12T17:30:55.171 INFO:teuthology.orchestra.run.smithi067.stderr: 33500K .......... .......... .......... .......... .......... 36% 323M 0s 2024-09-12T17:30:55.171 INFO:teuthology.orchestra.run.smithi067.stderr: 33550K .......... .......... .......... .......... .......... 36% 283M 0s 2024-09-12T17:30:55.172 INFO:teuthology.orchestra.run.smithi067.stderr: 33600K .......... .......... .......... .......... .......... 36% 342M 0s 2024-09-12T17:30:55.172 INFO:teuthology.orchestra.run.smithi067.stderr: 33650K .......... .......... .......... .......... .......... 36% 347M 0s 2024-09-12T17:30:55.172 INFO:teuthology.orchestra.run.smithi067.stderr: 33700K .......... .......... .......... .......... .......... 36% 396M 0s 2024-09-12T17:30:55.172 INFO:teuthology.orchestra.run.smithi067.stderr: 33750K .......... .......... .......... .......... .......... 36% 299M 0s 2024-09-12T17:30:55.172 INFO:teuthology.orchestra.run.smithi067.stderr: 33800K .......... .......... .......... .......... .......... 36% 389M 0s 2024-09-12T17:30:55.172 INFO:teuthology.orchestra.run.smithi067.stderr: 33850K .......... .......... .......... .......... .......... 36% 196M 0s 2024-09-12T17:30:55.172 INFO:teuthology.orchestra.run.smithi067.stderr: 33900K .......... .......... .......... .......... .......... 36% 339M 0s 2024-09-12T17:30:55.172 INFO:teuthology.orchestra.run.smithi067.stderr: 33950K .......... .......... .......... .......... .......... 36% 301M 0s 2024-09-12T17:30:55.172 INFO:teuthology.orchestra.run.smithi067.stderr: 34000K .......... .......... .......... .......... .......... 36% 261M 0s 2024-09-12T17:30:55.172 INFO:teuthology.orchestra.run.smithi067.stderr: 34050K .......... .......... .......... .......... .......... 36% 110M 0s 2024-09-12T17:30:55.172 INFO:teuthology.orchestra.run.smithi067.stderr: 34100K .......... .......... .......... .......... .......... 36% 218M 0s 2024-09-12T17:30:55.172 INFO:teuthology.orchestra.run.smithi067.stderr: 34150K .......... .......... .......... .......... .......... 36% 300M 0s 2024-09-12T17:30:55.172 INFO:teuthology.orchestra.run.smithi067.stderr: 34200K .......... .......... .......... .......... .......... 36% 322M 0s 2024-09-12T17:30:55.173 INFO:teuthology.orchestra.run.smithi067.stderr: 34250K .......... .......... .......... .......... .......... 36% 357M 0s 2024-09-12T17:30:55.173 INFO:teuthology.orchestra.run.smithi067.stderr: 34300K .......... .......... .......... .......... .......... 36% 382M 0s 2024-09-12T17:30:55.173 INFO:teuthology.orchestra.run.smithi067.stderr: 34350K .......... .......... .......... .......... .......... 37% 279M 0s 2024-09-12T17:30:55.173 INFO:teuthology.orchestra.run.smithi067.stderr: 34400K .......... .......... .......... .......... .......... 37% 318M 0s 2024-09-12T17:30:55.173 INFO:teuthology.orchestra.run.smithi067.stderr: 34450K .......... .......... .......... .......... .......... 37% 374M 0s 2024-09-12T17:30:55.173 INFO:teuthology.orchestra.run.smithi067.stderr: 34500K .......... .......... .......... .......... .......... 37% 399M 0s 2024-09-12T17:30:55.173 INFO:teuthology.orchestra.run.smithi067.stderr: 34550K .......... .......... .......... .......... .......... 37% 280M 0s 2024-09-12T17:30:55.173 INFO:teuthology.orchestra.run.smithi067.stderr: 34600K .......... .......... .......... .......... .......... 37% 279M 0s 2024-09-12T17:30:55.173 INFO:teuthology.orchestra.run.smithi067.stderr: 34650K .......... .......... .......... .......... .......... 37% 362M 0s 2024-09-12T17:30:55.173 INFO:teuthology.orchestra.run.smithi067.stderr: 34700K .......... .......... .......... .......... .......... 37% 158M 0s 2024-09-12T17:30:55.173 INFO:teuthology.orchestra.run.smithi067.stderr: 34750K .......... .......... .......... .......... .......... 37% 200M 0s 2024-09-12T17:30:55.173 INFO:teuthology.orchestra.run.smithi067.stderr: 34800K .......... .......... .......... .......... .......... 37% 384M 0s 2024-09-12T17:30:55.173 INFO:teuthology.orchestra.run.smithi067.stderr: 34850K .......... .......... .......... .......... .......... 37% 125M 0s 2024-09-12T17:30:55.173 INFO:teuthology.orchestra.run.smithi067.stderr: 34900K .......... .......... .......... .......... .......... 37% 335M 0s 2024-09-12T17:30:55.174 INFO:teuthology.orchestra.run.smithi067.stderr: 34950K .......... .......... .......... .......... .......... 37% 314M 0s 2024-09-12T17:30:55.174 INFO:teuthology.orchestra.run.smithi067.stderr: 35000K .......... .......... .......... .......... .......... 37% 363M 0s 2024-09-12T17:30:55.174 INFO:teuthology.orchestra.run.smithi067.stderr: 35050K .......... .......... .......... .......... .......... 37% 343M 0s 2024-09-12T17:30:55.174 INFO:teuthology.orchestra.run.smithi067.stderr: 35100K .......... .......... .......... .......... .......... 37% 353M 0s 2024-09-12T17:30:55.174 INFO:teuthology.orchestra.run.smithi067.stderr: 35150K .......... .......... .......... .......... .......... 37% 295M 0s 2024-09-12T17:30:55.174 INFO:teuthology.orchestra.run.smithi067.stderr: 35200K .......... .......... .......... .......... .......... 37% 357M 0s 2024-09-12T17:30:55.174 INFO:teuthology.orchestra.run.smithi067.stderr: 35250K .......... .......... .......... .......... .......... 37% 351M 0s 2024-09-12T17:30:55.174 INFO:teuthology.orchestra.run.smithi067.stderr: 35300K .......... .......... .......... .......... .......... 38% 168M 0s 2024-09-12T17:30:55.174 INFO:teuthology.orchestra.run.smithi067.stderr: 35350K .......... .......... .......... .......... .......... 38% 282M 0s 2024-09-12T17:30:55.174 INFO:teuthology.orchestra.run.smithi067.stderr: 35400K .......... .......... .......... .......... .......... 38% 345M 0s 2024-09-12T17:30:55.174 INFO:teuthology.orchestra.run.smithi067.stderr: 35450K .......... .......... .......... .......... .......... 38% 349M 0s 2024-09-12T17:30:55.174 INFO:teuthology.orchestra.run.smithi067.stderr: 35500K .......... .......... .......... .......... .......... 38% 371M 0s 2024-09-12T17:30:55.174 INFO:teuthology.orchestra.run.smithi067.stderr: 35550K .......... .......... .......... .......... .......... 38% 209M 0s 2024-09-12T17:30:55.174 INFO:teuthology.orchestra.run.smithi067.stderr: 35600K .......... .......... .......... .......... .......... 38% 305M 0s 2024-09-12T17:30:55.175 INFO:teuthology.orchestra.run.smithi067.stderr: 35650K .......... .......... .......... .......... .......... 38% 394M 0s 2024-09-12T17:30:55.175 INFO:teuthology.orchestra.run.smithi067.stderr: 35700K .......... .......... .......... .......... .......... 38% 397M 0s 2024-09-12T17:30:55.175 INFO:teuthology.orchestra.run.smithi067.stderr: 35750K .......... .......... .......... .......... .......... 38% 86.0M 0s 2024-09-12T17:30:55.175 INFO:teuthology.orchestra.run.smithi067.stderr: 35800K .......... .......... .......... .......... .......... 38% 322M 0s 2024-09-12T17:30:55.175 INFO:teuthology.orchestra.run.smithi067.stderr: 35850K .......... .......... .......... .......... .......... 38% 90.8M 0s 2024-09-12T17:30:55.175 INFO:teuthology.orchestra.run.smithi067.stderr: 35900K .......... .......... .......... .......... .......... 38% 283M 0s 2024-09-12T17:30:55.175 INFO:teuthology.orchestra.run.smithi067.stderr: 35950K .......... .......... .......... .......... .......... 38% 236M 0s 2024-09-12T17:30:55.175 INFO:teuthology.orchestra.run.smithi067.stderr: 36000K .......... .......... .......... .......... .......... 38% 250M 0s 2024-09-12T17:30:55.175 INFO:teuthology.orchestra.run.smithi067.stderr: 36050K .......... .......... .......... .......... .......... 38% 99.5M 0s 2024-09-12T17:30:55.175 INFO:teuthology.orchestra.run.smithi067.stderr: 36100K .......... .......... .......... .......... .......... 38% 159M 0s 2024-09-12T17:30:55.175 INFO:teuthology.orchestra.run.smithi067.stderr: 36150K .......... .......... .......... .......... .......... 38% 242M 0s 2024-09-12T17:30:55.175 INFO:teuthology.orchestra.run.smithi067.stderr: 36200K .......... .......... .......... .......... .......... 39% 327M 0s 2024-09-12T17:30:55.175 INFO:teuthology.orchestra.run.smithi067.stderr: 36250K .......... .......... .......... .......... .......... 39% 294M 0s 2024-09-12T17:30:55.175 INFO:teuthology.orchestra.run.smithi067.stderr: 36300K .......... .......... .......... .......... .......... 39% 370M 0s 2024-09-12T17:30:55.175 INFO:teuthology.orchestra.run.smithi067.stderr: 36350K .......... .......... .......... .......... .......... 39% 247M 0s 2024-09-12T17:30:55.176 INFO:teuthology.orchestra.run.smithi067.stderr: 36400K .......... .......... .......... .......... .......... 39% 323M 0s 2024-09-12T17:30:55.176 INFO:teuthology.orchestra.run.smithi067.stderr: 36450K .......... .......... .......... .......... .......... 39% 324M 0s 2024-09-12T17:30:55.176 INFO:teuthology.orchestra.run.smithi067.stderr: 36500K .......... .......... .......... .......... .......... 39% 329M 0s 2024-09-12T17:30:55.176 INFO:teuthology.orchestra.run.smithi067.stderr: 36550K .......... .......... .......... .......... .......... 39% 340M 0s 2024-09-12T17:30:55.176 INFO:teuthology.orchestra.run.smithi067.stderr: 36600K .......... .......... .......... .......... .......... 39% 331M 0s 2024-09-12T17:30:55.176 INFO:teuthology.orchestra.run.smithi067.stderr: 36650K .......... .......... .......... .......... .......... 39% 385M 0s 2024-09-12T17:30:55.176 INFO:teuthology.orchestra.run.smithi067.stderr: 36700K .......... .......... .......... .......... .......... 39% 125M 0s 2024-09-12T17:30:55.176 INFO:teuthology.orchestra.run.smithi067.stderr: 36750K .......... .......... .......... .......... .......... 39% 245M 0s 2024-09-12T17:30:55.176 INFO:teuthology.orchestra.run.smithi067.stderr: 36800K .......... .......... .......... .......... .......... 39% 315M 0s 2024-09-12T17:30:55.176 INFO:teuthology.orchestra.run.smithi067.stderr: 36850K .......... .......... .......... .......... .......... 39% 322M 0s 2024-09-12T17:30:55.176 INFO:teuthology.orchestra.run.smithi067.stderr: 36900K .......... .......... .......... .......... .......... 39% 368M 0s 2024-09-12T17:30:55.176 INFO:teuthology.orchestra.run.smithi067.stderr: 36950K .......... .......... .......... .......... .......... 39% 278M 0s 2024-09-12T17:30:55.176 INFO:teuthology.orchestra.run.smithi067.stderr: 37000K .......... .......... .......... .......... .......... 39% 352M 0s 2024-09-12T17:30:55.176 INFO:teuthology.orchestra.run.smithi067.stderr: 37050K .......... .......... .......... .......... .......... 39% 400M 0s 2024-09-12T17:30:55.177 INFO:teuthology.orchestra.run.smithi067.stderr: 37100K .......... .......... .......... .......... .......... 39% 400M 0s 2024-09-12T17:30:55.177 INFO:teuthology.orchestra.run.smithi067.stderr: 37150K .......... .......... .......... .......... .......... 40% 129M 0s 2024-09-12T17:30:55.177 INFO:teuthology.orchestra.run.smithi067.stderr: 37200K .......... .......... .......... .......... .......... 40% 272M 0s 2024-09-12T17:30:55.177 INFO:teuthology.orchestra.run.smithi067.stderr: 37250K .......... .......... .......... .......... .......... 40% 234M 0s 2024-09-12T17:30:55.177 INFO:teuthology.orchestra.run.smithi067.stderr: 37300K .......... .......... .......... .......... .......... 40% 356M 0s 2024-09-12T17:30:55.177 INFO:teuthology.orchestra.run.smithi067.stderr: 37350K .......... .......... .......... .......... .......... 40% 311M 0s 2024-09-12T17:30:55.177 INFO:teuthology.orchestra.run.smithi067.stderr: 37400K .......... .......... .......... .......... .......... 40% 337M 0s 2024-09-12T17:30:55.177 INFO:teuthology.orchestra.run.smithi067.stderr: 37450K .......... .......... .......... .......... .......... 40% 228M 0s 2024-09-12T17:30:55.177 INFO:teuthology.orchestra.run.smithi067.stderr: 37500K .......... .......... .......... .......... .......... 40% 210M 0s 2024-09-12T17:30:55.177 INFO:teuthology.orchestra.run.smithi067.stderr: 37550K .......... .......... .......... .......... .......... 40% 219M 0s 2024-09-12T17:30:55.177 INFO:teuthology.orchestra.run.smithi067.stderr: 37600K .......... .......... .......... .......... .......... 40% 313M 0s 2024-09-12T17:30:55.177 INFO:teuthology.orchestra.run.smithi067.stderr: 37650K .......... .......... .......... .......... .......... 40% 383M 0s 2024-09-12T17:30:55.177 INFO:teuthology.orchestra.run.smithi067.stderr: 37700K .......... .......... .......... .......... .......... 40% 370M 0s 2024-09-12T17:30:55.177 INFO:teuthology.orchestra.run.smithi067.stderr: 37750K .......... .......... .......... .......... .......... 40% 318M 0s 2024-09-12T17:30:55.178 INFO:teuthology.orchestra.run.smithi067.stderr: 37800K .......... .......... .......... .......... .......... 40% 377M 0s 2024-09-12T17:30:55.178 INFO:teuthology.orchestra.run.smithi067.stderr: 37850K .......... .......... .......... .......... .......... 40% 111M 0s 2024-09-12T17:30:55.178 INFO:teuthology.orchestra.run.smithi067.stderr: 37900K .......... .......... .......... .......... .......... 40% 390M 0s 2024-09-12T17:30:55.178 INFO:teuthology.orchestra.run.smithi067.stderr: 37950K .......... .......... .......... .......... .......... 40% 229M 0s 2024-09-12T17:30:55.178 INFO:teuthology.orchestra.run.smithi067.stderr: 38000K .......... .......... .......... .......... .......... 40% 324M 0s 2024-09-12T17:30:55.178 INFO:teuthology.orchestra.run.smithi067.stderr: 38050K .......... .......... .......... .......... .......... 41% 340M 0s 2024-09-12T17:30:55.178 INFO:teuthology.orchestra.run.smithi067.stderr: 38100K .......... .......... .......... .......... .......... 41% 327M 0s 2024-09-12T17:30:55.178 INFO:teuthology.orchestra.run.smithi067.stderr: 38150K .......... .......... .......... .......... .......... 41% 294M 0s 2024-09-12T17:30:55.178 INFO:teuthology.orchestra.run.smithi067.stderr: 38200K .......... .......... .......... .......... .......... 41% 327M 0s 2024-09-12T17:30:55.178 INFO:teuthology.orchestra.run.smithi067.stderr: 38250K .......... .......... .......... .......... .......... 41% 401M 0s 2024-09-12T17:30:55.178 INFO:teuthology.orchestra.run.smithi067.stderr: 38300K .......... .......... .......... .......... .......... 41% 372M 0s 2024-09-12T17:30:55.178 INFO:teuthology.orchestra.run.smithi067.stderr: 38350K .......... .......... .......... .......... .......... 41% 272M 0s 2024-09-12T17:30:55.178 INFO:teuthology.orchestra.run.smithi067.stderr: 38400K .......... .......... .......... .......... .......... 41% 313M 0s 2024-09-12T17:30:55.178 INFO:teuthology.orchestra.run.smithi067.stderr: 38450K .......... .......... .......... .......... .......... 41% 321M 0s 2024-09-12T17:30:55.179 INFO:teuthology.orchestra.run.smithi067.stderr: 38500K .......... .......... .......... .......... .......... 41% 313M 0s 2024-09-12T17:30:55.179 INFO:teuthology.orchestra.run.smithi067.stderr: 38550K .......... .......... .......... .......... .......... 41% 284M 0s 2024-09-12T17:30:55.179 INFO:teuthology.orchestra.run.smithi067.stderr: 38600K .......... .......... .......... .......... .......... 41% 363M 0s 2024-09-12T17:30:55.179 INFO:teuthology.orchestra.run.smithi067.stderr: 38650K .......... .......... .......... .......... .......... 41% 334M 0s 2024-09-12T17:30:55.179 INFO:teuthology.orchestra.run.smithi067.stderr: 38700K .......... .......... .......... .......... .......... 41% 339M 0s 2024-09-12T17:30:55.179 INFO:teuthology.orchestra.run.smithi067.stderr: 38750K .......... .......... .......... .......... .......... 41% 80.6M 0s 2024-09-12T17:30:55.179 INFO:teuthology.orchestra.run.smithi067.stderr: 38800K .......... .......... .......... .......... .......... 41% 277M 0s 2024-09-12T17:30:55.179 INFO:teuthology.orchestra.run.smithi067.stderr: 38850K .......... .......... .......... .......... .......... 41% 370M 0s 2024-09-12T17:30:55.179 INFO:teuthology.orchestra.run.smithi067.stderr: 38900K .......... .......... .......... .......... .......... 41% 134M 0s 2024-09-12T17:30:55.179 INFO:teuthology.orchestra.run.smithi067.stderr: 38950K .......... .......... .......... .......... .......... 41% 310M 0s 2024-09-12T17:30:55.179 INFO:teuthology.orchestra.run.smithi067.stderr: 39000K .......... .......... .......... .......... .......... 42% 233M 0s 2024-09-12T17:30:55.179 INFO:teuthology.orchestra.run.smithi067.stderr: 39050K .......... .......... .......... .......... .......... 42% 152M 0s 2024-09-12T17:30:55.179 INFO:teuthology.orchestra.run.smithi067.stderr: 39100K .......... .......... .......... .......... .......... 42% 183M 0s 2024-09-12T17:30:55.179 INFO:teuthology.orchestra.run.smithi067.stderr: 39150K .......... .......... .......... .......... .......... 42% 106M 0s 2024-09-12T17:30:55.180 INFO:teuthology.orchestra.run.smithi067.stderr: 39200K .......... .......... .......... .......... .......... 42% 348M 0s 2024-09-12T17:30:55.180 INFO:teuthology.orchestra.run.smithi067.stderr: 39250K .......... .......... .......... .......... .......... 42% 156M 0s 2024-09-12T17:30:55.180 INFO:teuthology.orchestra.run.smithi067.stderr: 39300K .......... .......... .......... .......... .......... 42% 335M 0s 2024-09-12T17:30:55.180 INFO:teuthology.orchestra.run.smithi067.stderr: 39350K .......... .......... .......... .......... .......... 42% 235M 0s 2024-09-12T17:30:55.180 INFO:teuthology.orchestra.run.smithi067.stderr: 39400K .......... .......... .......... .......... .......... 42% 324M 0s 2024-09-12T17:30:55.180 INFO:teuthology.orchestra.run.smithi067.stderr: 39450K .......... .......... .......... .......... .......... 42% 333M 0s 2024-09-12T17:30:55.180 INFO:teuthology.orchestra.run.smithi067.stderr: 39500K .......... .......... .......... .......... .......... 42% 314M 0s 2024-09-12T17:30:55.180 INFO:teuthology.orchestra.run.smithi067.stderr: 39550K .......... .......... .......... .......... .......... 42% 308M 0s 2024-09-12T17:30:55.180 INFO:teuthology.orchestra.run.smithi067.stderr: 39600K .......... .......... .......... .......... .......... 42% 349M 0s 2024-09-12T17:30:55.180 INFO:teuthology.orchestra.run.smithi067.stderr: 39650K .......... .......... .......... .......... .......... 42% 121M 0s 2024-09-12T17:30:55.180 INFO:teuthology.orchestra.run.smithi067.stderr: 39700K .......... .......... .......... .......... .......... 42% 232M 0s 2024-09-12T17:30:55.180 INFO:teuthology.orchestra.run.smithi067.stderr: 39750K .......... .......... .......... .......... .......... 42% 255M 0s 2024-09-12T17:30:55.180 INFO:teuthology.orchestra.run.smithi067.stderr: 39800K .......... .......... .......... .......... .......... 42% 340M 0s 2024-09-12T17:30:55.180 INFO:teuthology.orchestra.run.smithi067.stderr: 39850K .......... .......... .......... .......... .......... 42% 297M 0s 2024-09-12T17:30:55.181 INFO:teuthology.orchestra.run.smithi067.stderr: 39900K .......... .......... .......... .......... .......... 43% 338M 0s 2024-09-12T17:30:55.181 INFO:teuthology.orchestra.run.smithi067.stderr: 39950K .......... .......... .......... .......... .......... 43% 288M 0s 2024-09-12T17:30:55.181 INFO:teuthology.orchestra.run.smithi067.stderr: 40000K .......... .......... .......... .......... .......... 43% 315M 0s 2024-09-12T17:30:55.181 INFO:teuthology.orchestra.run.smithi067.stderr: 40050K .......... .......... .......... .......... .......... 43% 321M 0s 2024-09-12T17:30:55.181 INFO:teuthology.orchestra.run.smithi067.stderr: 40100K .......... .......... .......... .......... .......... 43% 289M 0s 2024-09-12T17:30:55.181 INFO:teuthology.orchestra.run.smithi067.stderr: 40150K .......... .......... .......... .......... .......... 43% 273M 0s 2024-09-12T17:30:55.181 INFO:teuthology.orchestra.run.smithi067.stderr: 40200K .......... .......... .......... .......... .......... 43% 299M 0s 2024-09-12T17:30:55.181 INFO:teuthology.orchestra.run.smithi067.stderr: 40250K .......... .......... .......... .......... .......... 43% 307M 0s 2024-09-12T17:30:55.181 INFO:teuthology.orchestra.run.smithi067.stderr: 40300K .......... .......... .......... .......... .......... 43% 314M 0s 2024-09-12T17:30:55.181 INFO:teuthology.orchestra.run.smithi067.stderr: 40350K .......... .......... .......... .......... .......... 43% 272M 0s 2024-09-12T17:30:55.181 INFO:teuthology.orchestra.run.smithi067.stderr: 40400K .......... .......... .......... .......... .......... 43% 300M 0s 2024-09-12T17:30:55.181 INFO:teuthology.orchestra.run.smithi067.stderr: 40450K .......... .......... .......... .......... .......... 43% 332M 0s 2024-09-12T17:30:55.181 INFO:teuthology.orchestra.run.smithi067.stderr: 40500K .......... .......... .......... .......... .......... 43% 331M 0s 2024-09-12T17:30:55.181 INFO:teuthology.orchestra.run.smithi067.stderr: 40550K .......... .......... .......... .......... .......... 43% 235M 0s 2024-09-12T17:30:55.182 INFO:teuthology.orchestra.run.smithi067.stderr: 40600K .......... .......... .......... .......... .......... 43% 302M 0s 2024-09-12T17:30:55.182 INFO:teuthology.orchestra.run.smithi067.stderr: 40650K .......... .......... .......... .......... .......... 43% 294M 0s 2024-09-12T17:30:55.182 INFO:teuthology.orchestra.run.smithi067.stderr: 40700K .......... .......... .......... .......... .......... 43% 204M 0s 2024-09-12T17:30:55.182 INFO:teuthology.orchestra.run.smithi067.stderr: 40750K .......... .......... .......... .......... .......... 43% 267M 0s 2024-09-12T17:30:55.182 INFO:teuthology.orchestra.run.smithi067.stderr: 40800K .......... .......... .......... .......... .......... 43% 156M 0s 2024-09-12T17:30:55.182 INFO:teuthology.orchestra.run.smithi067.stderr: 40850K .......... .......... .......... .......... .......... 44% 345M 0s 2024-09-12T17:30:55.182 INFO:teuthology.orchestra.run.smithi067.stderr: 40900K .......... .......... .......... .......... .......... 44% 203M 0s 2024-09-12T17:30:55.182 INFO:teuthology.orchestra.run.smithi067.stderr: 40950K .......... .......... .......... .......... .......... 44% 316M 0s 2024-09-12T17:30:55.182 INFO:teuthology.orchestra.run.smithi067.stderr: 41000K .......... .......... .......... .......... .......... 44% 332M 0s 2024-09-12T17:30:55.182 INFO:teuthology.orchestra.run.smithi067.stderr: 41050K .......... .......... .......... .......... .......... 44% 351M 0s 2024-09-12T17:30:55.182 INFO:teuthology.orchestra.run.smithi067.stderr: 41100K .......... .......... .......... .......... .......... 44% 297M 0s 2024-09-12T17:30:55.182 INFO:teuthology.orchestra.run.smithi067.stderr: 41150K .......... .......... .......... .......... .......... 44% 118M 0s 2024-09-12T17:30:55.182 INFO:teuthology.orchestra.run.smithi067.stderr: 41200K .......... .......... .......... .......... .......... 44% 324M 0s 2024-09-12T17:30:55.182 INFO:teuthology.orchestra.run.smithi067.stderr: 41250K .......... .......... .......... .......... .......... 44% 342M 0s 2024-09-12T17:30:55.183 INFO:teuthology.orchestra.run.smithi067.stderr: 41300K .......... .......... .......... .......... .......... 44% 347M 0s 2024-09-12T17:30:55.183 INFO:teuthology.orchestra.run.smithi067.stderr: 41350K .......... .......... .......... .......... .......... 44% 315M 0s 2024-09-12T17:30:55.183 INFO:teuthology.orchestra.run.smithi067.stderr: 41400K .......... .......... .......... .......... .......... 44% 333M 0s 2024-09-12T17:30:55.183 INFO:teuthology.orchestra.run.smithi067.stderr: 41450K .......... .......... .......... .......... .......... 44% 354M 0s 2024-09-12T17:30:55.183 INFO:teuthology.orchestra.run.smithi067.stderr: 41500K .......... .......... .......... .......... .......... 44% 353M 0s 2024-09-12T17:30:55.183 INFO:teuthology.orchestra.run.smithi067.stderr: 41550K .......... .......... .......... .......... .......... 44% 274M 0s 2024-09-12T17:30:55.183 INFO:teuthology.orchestra.run.smithi067.stderr: 41600K .......... .......... .......... .......... .......... 44% 344M 0s 2024-09-12T17:30:55.183 INFO:teuthology.orchestra.run.smithi067.stderr: 41650K .......... .......... .......... .......... .......... 44% 374M 0s 2024-09-12T17:30:55.183 INFO:teuthology.orchestra.run.smithi067.stderr: 41700K .......... .......... .......... .......... .......... 44% 350M 0s 2024-09-12T17:30:55.183 INFO:teuthology.orchestra.run.smithi067.stderr: 41750K .......... .......... .......... .......... .......... 44% 315M 0s 2024-09-12T17:30:55.183 INFO:teuthology.orchestra.run.smithi067.stderr: 41800K .......... .......... .......... .......... .......... 45% 118M 0s 2024-09-12T17:30:55.183 INFO:teuthology.orchestra.run.smithi067.stderr: 41850K .......... .......... .......... .......... .......... 45% 294M 0s 2024-09-12T17:30:55.183 INFO:teuthology.orchestra.run.smithi067.stderr: 41900K .......... .......... .......... .......... .......... 45% 199M 0s 2024-09-12T17:30:55.183 INFO:teuthology.orchestra.run.smithi067.stderr: 41950K .......... .......... .......... .......... .......... 45% 328M 0s 2024-09-12T17:30:55.184 INFO:teuthology.orchestra.run.smithi067.stderr: 42000K .......... .......... .......... .......... .......... 45% 271M 0s 2024-09-12T17:30:55.184 INFO:teuthology.orchestra.run.smithi067.stderr: 42050K .......... .......... .......... .......... .......... 45% 354M 0s 2024-09-12T17:30:55.184 INFO:teuthology.orchestra.run.smithi067.stderr: 42100K .......... .......... .......... .......... .......... 45% 89.4M 0s 2024-09-12T17:30:55.184 INFO:teuthology.orchestra.run.smithi067.stderr: 42150K .......... .......... .......... .......... .......... 45% 230M 0s 2024-09-12T17:30:55.184 INFO:teuthology.orchestra.run.smithi067.stderr: 42200K .......... .......... .......... .......... .......... 45% 325M 0s 2024-09-12T17:30:55.184 INFO:teuthology.orchestra.run.smithi067.stderr: 42250K .......... .......... .......... .......... .......... 45% 125M 0s 2024-09-12T17:30:55.184 INFO:teuthology.orchestra.run.smithi067.stderr: 42300K .......... .......... .......... .......... .......... 45% 106M 0s 2024-09-12T17:30:55.184 INFO:teuthology.orchestra.run.smithi067.stderr: 42350K .......... .......... .......... .......... .......... 45% 259M 0s 2024-09-12T17:30:55.184 INFO:teuthology.orchestra.run.smithi067.stderr: 42400K .......... .......... .......... .......... .......... 45% 345M 0s 2024-09-12T17:30:55.184 INFO:teuthology.orchestra.run.smithi067.stderr: 42450K .......... .......... .......... .......... .......... 45% 235M 0s 2024-09-12T17:30:55.184 INFO:teuthology.orchestra.run.smithi067.stderr: 42500K .......... .......... .......... .......... .......... 45% 308M 0s 2024-09-12T17:30:55.184 INFO:teuthology.orchestra.run.smithi067.stderr: 42550K .......... .......... .......... .......... .......... 45% 305M 0s 2024-09-12T17:30:55.184 INFO:teuthology.orchestra.run.smithi067.stderr: 42600K .......... .......... .......... .......... .......... 45% 325M 0s 2024-09-12T17:30:55.184 INFO:teuthology.orchestra.run.smithi067.stderr: 42650K .......... .......... .......... .......... .......... 45% 318M 0s 2024-09-12T17:30:55.185 INFO:teuthology.orchestra.run.smithi067.stderr: 42700K .......... .......... .......... .......... .......... 46% 343M 0s 2024-09-12T17:30:55.185 INFO:teuthology.orchestra.run.smithi067.stderr: 42750K .......... .......... .......... .......... .......... 46% 227M 0s 2024-09-12T17:30:55.185 INFO:teuthology.orchestra.run.smithi067.stderr: 42800K .......... .......... .......... .......... .......... 46% 161M 0s 2024-09-12T17:30:55.185 INFO:teuthology.orchestra.run.smithi067.stderr: 42850K .......... .......... .......... .......... .......... 46% 307M 0s 2024-09-12T17:30:55.185 INFO:teuthology.orchestra.run.smithi067.stderr: 42900K .......... .......... .......... .......... .......... 46% 313M 0s 2024-09-12T17:30:55.185 INFO:teuthology.orchestra.run.smithi067.stderr: 42950K .......... .......... .......... .......... .......... 46% 298M 0s 2024-09-12T17:30:55.185 INFO:teuthology.orchestra.run.smithi067.stderr: 43000K .......... .......... .......... .......... .......... 46% 363M 0s 2024-09-12T17:30:55.185 INFO:teuthology.orchestra.run.smithi067.stderr: 43050K .......... .......... .......... .......... .......... 46% 312M 0s 2024-09-12T17:30:55.185 INFO:teuthology.orchestra.run.smithi067.stderr: 43100K .......... .......... .......... .......... .......... 46% 221M 0s 2024-09-12T17:30:55.185 INFO:teuthology.orchestra.run.smithi067.stderr: 43150K .......... .......... .......... .......... .......... 46% 203M 0s 2024-09-12T17:30:55.185 INFO:teuthology.orchestra.run.smithi067.stderr: 43200K .......... .......... .......... .......... .......... 46% 335M 0s 2024-09-12T17:30:55.185 INFO:teuthology.orchestra.run.smithi067.stderr: 43250K .......... .......... .......... .......... .......... 46% 338M 0s 2024-09-12T17:30:55.185 INFO:teuthology.orchestra.run.smithi067.stderr: 43300K .......... .......... .......... .......... .......... 46% 323M 0s 2024-09-12T17:30:55.185 INFO:teuthology.orchestra.run.smithi067.stderr: 43350K .......... .......... .......... .......... .......... 46% 275M 0s 2024-09-12T17:30:55.186 INFO:teuthology.orchestra.run.smithi067.stderr: 43400K .......... .......... .......... .......... .......... 46% 334M 0s 2024-09-12T17:30:55.186 INFO:teuthology.orchestra.run.smithi067.stderr: 43450K .......... .......... .......... .......... .......... 46% 297M 0s 2024-09-12T17:30:55.186 INFO:teuthology.orchestra.run.smithi067.stderr: 43500K .......... .......... .......... .......... .......... 46% 336M 0s 2024-09-12T17:30:55.186 INFO:teuthology.orchestra.run.smithi067.stderr: 43550K .......... .......... .......... .......... .......... 46% 256M 0s 2024-09-12T17:30:55.186 INFO:teuthology.orchestra.run.smithi067.stderr: 43600K .......... .......... .......... .......... .......... 46% 340M 0s 2024-09-12T17:30:55.186 INFO:teuthology.orchestra.run.smithi067.stderr: 43650K .......... .......... .......... .......... .......... 47% 337M 0s 2024-09-12T17:30:55.186 INFO:teuthology.orchestra.run.smithi067.stderr: 43700K .......... .......... .......... .......... .......... 47% 333M 0s 2024-09-12T17:30:55.186 INFO:teuthology.orchestra.run.smithi067.stderr: 43750K .......... .......... .......... .......... .......... 47% 311M 0s 2024-09-12T17:30:55.186 INFO:teuthology.orchestra.run.smithi067.stderr: 43800K .......... .......... .......... .......... .......... 47% 126M 0s 2024-09-12T17:30:55.186 INFO:teuthology.orchestra.run.smithi067.stderr: 43850K .......... .......... .......... .......... .......... 47% 320M 0s 2024-09-12T17:30:55.186 INFO:teuthology.orchestra.run.smithi067.stderr: 43900K .......... .......... .......... .......... .......... 47% 387M 0s 2024-09-12T17:30:55.186 INFO:teuthology.orchestra.run.smithi067.stderr: 43950K .......... .......... .......... .......... .......... 47% 171M 0s 2024-09-12T17:30:55.186 INFO:teuthology.orchestra.run.smithi067.stderr: 44000K .......... .......... .......... .......... .......... 47% 336M 0s 2024-09-12T17:30:55.186 INFO:teuthology.orchestra.run.smithi067.stderr: 44050K .......... .......... .......... .......... .......... 47% 355M 0s 2024-09-12T17:30:55.187 INFO:teuthology.orchestra.run.smithi067.stderr: 44100K .......... .......... .......... .......... .......... 47% 349M 0s 2024-09-12T17:30:55.187 INFO:teuthology.orchestra.run.smithi067.stderr: 44150K .......... .......... .......... .......... .......... 47% 260M 0s 2024-09-12T17:30:55.187 INFO:teuthology.orchestra.run.smithi067.stderr: 44200K .......... .......... .......... .......... .......... 47% 129M 0s 2024-09-12T17:30:55.187 INFO:teuthology.orchestra.run.smithi067.stderr: 44250K .......... .......... .......... .......... .......... 47% 89.4M 0s 2024-09-12T17:30:55.187 INFO:teuthology.orchestra.run.smithi067.stderr: 44300K .......... .......... .......... .......... .......... 47% 274M 0s 2024-09-12T17:30:55.187 INFO:teuthology.orchestra.run.smithi067.stderr: 44350K .......... .......... .......... .......... .......... 47% 249M 0s 2024-09-12T17:30:55.187 INFO:teuthology.orchestra.run.smithi067.stderr: 44400K .......... .......... .......... .......... .......... 47% 339M 0s 2024-09-12T17:30:55.187 INFO:teuthology.orchestra.run.smithi067.stderr: 44450K .......... .......... .......... .......... .......... 47% 290M 0s 2024-09-12T17:30:55.187 INFO:teuthology.orchestra.run.smithi067.stderr: 44500K .......... .......... .......... .......... .......... 47% 305M 0s 2024-09-12T17:30:55.187 INFO:teuthology.orchestra.run.smithi067.stderr: 44550K .......... .......... .......... .......... .......... 48% 312M 0s 2024-09-12T17:30:55.187 INFO:teuthology.orchestra.run.smithi067.stderr: 44600K .......... .......... .......... .......... .......... 48% 338M 0s 2024-09-12T17:30:55.187 INFO:teuthology.orchestra.run.smithi067.stderr: 44650K .......... .......... .......... .......... .......... 48% 363M 0s 2024-09-12T17:30:55.187 INFO:teuthology.orchestra.run.smithi067.stderr: 44700K .......... .......... .......... .......... .......... 48% 326M 0s 2024-09-12T17:30:55.187 INFO:teuthology.orchestra.run.smithi067.stderr: 44750K .......... .......... .......... .......... .......... 48% 264M 0s 2024-09-12T17:30:55.188 INFO:teuthology.orchestra.run.smithi067.stderr: 44800K .......... .......... .......... .......... .......... 48% 336M 0s 2024-09-12T17:30:55.188 INFO:teuthology.orchestra.run.smithi067.stderr: 44850K .......... .......... .......... .......... .......... 48% 282M 0s 2024-09-12T17:30:55.188 INFO:teuthology.orchestra.run.smithi067.stderr: 44900K .......... .......... .......... .......... .......... 48% 354M 0s 2024-09-12T17:30:55.188 INFO:teuthology.orchestra.run.smithi067.stderr: 44950K .......... .......... .......... .......... .......... 48% 271M 0s 2024-09-12T17:30:55.188 INFO:teuthology.orchestra.run.smithi067.stderr: 45000K .......... .......... .......... .......... .......... 48% 313M 0s 2024-09-12T17:30:55.188 INFO:teuthology.orchestra.run.smithi067.stderr: 45050K .......... .......... .......... .......... .......... 48% 355M 0s 2024-09-12T17:30:55.188 INFO:teuthology.orchestra.run.smithi067.stderr: 45100K .......... .......... .......... .......... .......... 48% 296M 0s 2024-09-12T17:30:55.188 INFO:teuthology.orchestra.run.smithi067.stderr: 45150K .......... .......... .......... .......... .......... 48% 219M 0s 2024-09-12T17:30:55.188 INFO:teuthology.orchestra.run.smithi067.stderr: 45200K .......... .......... .......... .......... .......... 48% 162M 0s 2024-09-12T17:30:55.188 INFO:teuthology.orchestra.run.smithi067.stderr: 45250K .......... .......... .......... .......... .......... 48% 228M 0s 2024-09-12T17:30:55.188 INFO:teuthology.orchestra.run.smithi067.stderr: 45300K .......... .......... .......... .......... .......... 48% 257M 0s 2024-09-12T17:30:55.188 INFO:teuthology.orchestra.run.smithi067.stderr: 45350K .......... .......... .......... .......... .......... 48% 85.9M 0s 2024-09-12T17:30:55.188 INFO:teuthology.orchestra.run.smithi067.stderr: 45400K .......... .......... .......... .......... .......... 48% 149M 0s 2024-09-12T17:30:55.189 INFO:teuthology.orchestra.run.smithi067.stderr: 45450K .......... .......... .......... .......... .......... 48% 290M 0s 2024-09-12T17:30:55.189 INFO:teuthology.orchestra.run.smithi067.stderr: 45500K .......... .......... .......... .......... .......... 49% 338M 0s 2024-09-12T17:30:55.189 INFO:teuthology.orchestra.run.smithi067.stderr: 45550K .......... .......... .......... .......... .......... 49% 278M 0s 2024-09-12T17:30:55.189 INFO:teuthology.orchestra.run.smithi067.stderr: 45600K .......... .......... .......... .......... .......... 49% 180M 0s 2024-09-12T17:30:55.189 INFO:teuthology.orchestra.run.smithi067.stderr: 45650K .......... .......... .......... .......... .......... 49% 311M 0s 2024-09-12T17:30:55.189 INFO:teuthology.orchestra.run.smithi067.stderr: 45700K .......... .......... .......... .......... .......... 49% 298M 0s 2024-09-12T17:30:55.189 INFO:teuthology.orchestra.run.smithi067.stderr: 45750K .......... .......... .......... .......... .......... 49% 299M 0s 2024-09-12T17:30:55.189 INFO:teuthology.orchestra.run.smithi067.stderr: 45800K .......... .......... .......... .......... .......... 49% 321M 0s 2024-09-12T17:30:55.189 INFO:teuthology.orchestra.run.smithi067.stderr: 45850K .......... .......... .......... .......... .......... 49% 335M 0s 2024-09-12T17:30:55.189 INFO:teuthology.orchestra.run.smithi067.stderr: 45900K .......... .......... .......... .......... .......... 49% 305M 0s 2024-09-12T17:30:55.189 INFO:teuthology.orchestra.run.smithi067.stderr: 45950K .......... .......... .......... .......... .......... 49% 273M 0s 2024-09-12T17:30:55.189 INFO:teuthology.orchestra.run.smithi067.stderr: 46000K .......... .......... .......... .......... .......... 49% 362M 0s 2024-09-12T17:30:55.189 INFO:teuthology.orchestra.run.smithi067.stderr: 46050K .......... .......... .......... .......... .......... 49% 373M 0s 2024-09-12T17:30:55.190 INFO:teuthology.orchestra.run.smithi067.stderr: 46100K .......... .......... .......... .......... .......... 49% 128M 0s 2024-09-12T17:30:55.190 INFO:teuthology.orchestra.run.smithi067.stderr: 46150K .......... .......... .......... .......... .......... 49% 289M 0s 2024-09-12T17:30:55.190 INFO:teuthology.orchestra.run.smithi067.stderr: 46200K .......... .......... .......... .......... .......... 49% 322M 0s 2024-09-12T17:30:55.190 INFO:teuthology.orchestra.run.smithi067.stderr: 46250K .......... .......... .......... .......... .......... 49% 322M 0s 2024-09-12T17:30:55.190 INFO:teuthology.orchestra.run.smithi067.stderr: 46300K .......... .......... .......... .......... .......... 49% 312M 0s 2024-09-12T17:30:55.190 INFO:teuthology.orchestra.run.smithi067.stderr: 46350K .......... .......... .......... .......... .......... 49% 273M 0s 2024-09-12T17:30:55.190 INFO:teuthology.orchestra.run.smithi067.stderr: 46400K .......... .......... .......... .......... .......... 49% 351M 0s 2024-09-12T17:30:55.190 INFO:teuthology.orchestra.run.smithi067.stderr: 46450K .......... .......... .......... .......... .......... 50% 362M 0s 2024-09-12T17:30:55.190 INFO:teuthology.orchestra.run.smithi067.stderr: 46500K .......... .......... .......... .......... .......... 50% 322M 0s 2024-09-12T17:30:55.190 INFO:teuthology.orchestra.run.smithi067.stderr: 46550K .......... .......... .......... .......... .......... 50% 295M 0s 2024-09-12T17:30:55.190 INFO:teuthology.orchestra.run.smithi067.stderr: 46600K .......... .......... .......... .......... .......... 50% 288M 0s 2024-09-12T17:30:55.190 INFO:teuthology.orchestra.run.smithi067.stderr: 46650K .......... .......... .......... .......... .......... 50% 344M 0s 2024-09-12T17:30:55.190 INFO:teuthology.orchestra.run.smithi067.stderr: 46700K .......... .......... .......... .......... .......... 50% 247M 0s 2024-09-12T17:30:55.190 INFO:teuthology.orchestra.run.smithi067.stderr: 46750K .......... .......... .......... .......... .......... 50% 289M 0s 2024-09-12T17:30:55.191 INFO:teuthology.orchestra.run.smithi067.stderr: 46800K .......... .......... .......... .......... .......... 50% 352M 0s 2024-09-12T17:30:55.191 INFO:teuthology.orchestra.run.smithi067.stderr: 46850K .......... .......... .......... .......... .......... 50% 263M 0s 2024-09-12T17:30:55.191 INFO:teuthology.orchestra.run.smithi067.stderr: 46900K .......... .......... .......... .......... .......... 50% 322M 0s 2024-09-12T17:30:55.191 INFO:teuthology.orchestra.run.smithi067.stderr: 46950K .......... .......... .......... .......... .......... 50% 267M 0s 2024-09-12T17:30:55.191 INFO:teuthology.orchestra.run.smithi067.stderr: 47000K .......... .......... .......... .......... .......... 50% 293M 0s 2024-09-12T17:30:55.191 INFO:teuthology.orchestra.run.smithi067.stderr: 47050K .......... .......... .......... .......... .......... 50% 136M 0s 2024-09-12T17:30:55.191 INFO:teuthology.orchestra.run.smithi067.stderr: 47100K .......... .......... .......... .......... .......... 50% 311M 0s 2024-09-12T17:30:55.191 INFO:teuthology.orchestra.run.smithi067.stderr: 47150K .......... .......... .......... .......... .......... 50% 246M 0s 2024-09-12T17:30:55.191 INFO:teuthology.orchestra.run.smithi067.stderr: 47200K .......... .......... .......... .......... .......... 50% 326M 0s 2024-09-12T17:30:55.191 INFO:teuthology.orchestra.run.smithi067.stderr: 47250K .......... .......... .......... .......... .......... 50% 290M 0s 2024-09-12T17:30:55.191 INFO:teuthology.orchestra.run.smithi067.stderr: 47300K .......... .......... .......... .......... .......... 50% 82.4M 0s 2024-09-12T17:30:55.191 INFO:teuthology.orchestra.run.smithi067.stderr: 47350K .......... .......... .......... .......... .......... 51% 291M 0s 2024-09-12T17:30:55.191 INFO:teuthology.orchestra.run.smithi067.stderr: 47400K .......... .......... .......... .......... .......... 51% 55.8M 0s 2024-09-12T17:30:55.191 INFO:teuthology.orchestra.run.smithi067.stderr: 47450K .......... .......... .......... .......... .......... 51% 345M 0s 2024-09-12T17:30:55.192 INFO:teuthology.orchestra.run.smithi067.stderr: 47500K .......... .......... .......... .......... .......... 51% 316M 0s 2024-09-12T17:30:55.192 INFO:teuthology.orchestra.run.smithi067.stderr: 47550K .......... .......... .......... .......... .......... 51% 270M 0s 2024-09-12T17:30:55.192 INFO:teuthology.orchestra.run.smithi067.stderr: 47600K .......... .......... .......... .......... .......... 51% 341M 0s 2024-09-12T17:30:55.192 INFO:teuthology.orchestra.run.smithi067.stderr: 47650K .......... .......... .......... .......... .......... 51% 351M 0s 2024-09-12T17:30:55.192 INFO:teuthology.orchestra.run.smithi067.stderr: 47700K .......... .......... .......... .......... .......... 51% 313M 0s 2024-09-12T17:30:55.192 INFO:teuthology.orchestra.run.smithi067.stderr: 47750K .......... .......... .......... .......... .......... 51% 294M 0s 2024-09-12T17:30:55.192 INFO:teuthology.orchestra.run.smithi067.stderr: 47800K .......... .......... .......... .......... .......... 51% 359M 0s 2024-09-12T17:30:55.192 INFO:teuthology.orchestra.run.smithi067.stderr: 47850K .......... .......... .......... .......... .......... 51% 329M 0s 2024-09-12T17:30:55.192 INFO:teuthology.orchestra.run.smithi067.stderr: 47900K .......... .......... .......... .......... .......... 51% 324M 0s 2024-09-12T17:30:55.192 INFO:teuthology.orchestra.run.smithi067.stderr: 47950K .......... .......... .......... .......... .......... 51% 274M 0s 2024-09-12T17:30:55.192 INFO:teuthology.orchestra.run.smithi067.stderr: 48000K .......... .......... .......... .......... .......... 51% 311M 0s 2024-09-12T17:30:55.192 INFO:teuthology.orchestra.run.smithi067.stderr: 48050K .......... .......... .......... .......... .......... 51% 312M 0s 2024-09-12T17:30:55.192 INFO:teuthology.orchestra.run.smithi067.stderr: 48100K .......... .......... .......... .......... .......... 51% 299M 0s 2024-09-12T17:30:55.193 INFO:teuthology.orchestra.run.smithi067.stderr: 48150K .......... .......... .......... .......... .......... 51% 307M 0s 2024-09-12T17:30:55.193 INFO:teuthology.orchestra.run.smithi067.stderr: 48200K .......... .......... .......... .......... .......... 51% 335M 0s 2024-09-12T17:30:55.193 INFO:teuthology.orchestra.run.smithi067.stderr: 48250K .......... .......... .......... .......... .......... 51% 325M 0s 2024-09-12T17:30:55.193 INFO:teuthology.orchestra.run.smithi067.stderr: 48300K .......... .......... .......... .......... .......... 52% 343M 0s 2024-09-12T17:30:55.193 INFO:teuthology.orchestra.run.smithi067.stderr: 48350K .......... .......... .......... .......... .......... 52% 261M 0s 2024-09-12T17:30:55.193 INFO:teuthology.orchestra.run.smithi067.stderr: 48400K .......... .......... .......... .......... .......... 52% 332M 0s 2024-09-12T17:30:55.193 INFO:teuthology.orchestra.run.smithi067.stderr: 48450K .......... .......... .......... .......... .......... 52% 142M 0s 2024-09-12T17:30:55.193 INFO:teuthology.orchestra.run.smithi067.stderr: 48500K .......... .......... .......... .......... .......... 52% 170M 0s 2024-09-12T17:30:55.193 INFO:teuthology.orchestra.run.smithi067.stderr: 48550K .......... .......... .......... .......... .......... 52% 285M 0s 2024-09-12T17:30:55.193 INFO:teuthology.orchestra.run.smithi067.stderr: 48600K .......... .......... .......... .......... .......... 52% 149M 0s 2024-09-12T17:30:55.193 INFO:teuthology.orchestra.run.smithi067.stderr: 48650K .......... .......... .......... .......... .......... 52% 343M 0s 2024-09-12T17:30:55.193 INFO:teuthology.orchestra.run.smithi067.stderr: 48700K .......... .......... .......... .......... .......... 52% 351M 0s 2024-09-12T17:30:55.193 INFO:teuthology.orchestra.run.smithi067.stderr: 48750K .......... .......... .......... .......... .......... 52% 277M 0s 2024-09-12T17:30:55.193 INFO:teuthology.orchestra.run.smithi067.stderr: 48800K .......... .......... .......... .......... .......... 52% 354M 0s 2024-09-12T17:30:55.194 INFO:teuthology.orchestra.run.smithi067.stderr: 48850K .......... .......... .......... .......... .......... 52% 331M 0s 2024-09-12T17:30:55.194 INFO:teuthology.orchestra.run.smithi067.stderr: 48900K .......... .......... .......... .......... .......... 52% 333M 0s 2024-09-12T17:30:55.194 INFO:teuthology.orchestra.run.smithi067.stderr: 48950K .......... .......... .......... .......... .......... 52% 310M 0s 2024-09-12T17:30:55.194 INFO:teuthology.orchestra.run.smithi067.stderr: 49000K .......... .......... .......... .......... .......... 52% 354M 0s 2024-09-12T17:30:55.194 INFO:teuthology.orchestra.run.smithi067.stderr: 49050K .......... .......... .......... .......... .......... 52% 344M 0s 2024-09-12T17:30:55.194 INFO:teuthology.orchestra.run.smithi067.stderr: 49100K .......... .......... .......... .......... .......... 52% 134M 0s 2024-09-12T17:30:55.194 INFO:teuthology.orchestra.run.smithi067.stderr: 49150K .......... .......... .......... .......... .......... 52% 276M 0s 2024-09-12T17:30:55.194 INFO:teuthology.orchestra.run.smithi067.stderr: 49200K .......... .......... .......... .......... .......... 53% 84.4M 0s 2024-09-12T17:30:55.194 INFO:teuthology.orchestra.run.smithi067.stderr: 49250K .......... .......... .......... .......... .......... 53% 339M 0s 2024-09-12T17:30:55.194 INFO:teuthology.orchestra.run.smithi067.stderr: 49300K .......... .......... .......... .......... .......... 53% 337M 0s 2024-09-12T17:30:55.194 INFO:teuthology.orchestra.run.smithi067.stderr: 49350K .......... .......... .......... .......... .......... 53% 313M 0s 2024-09-12T17:30:55.194 INFO:teuthology.orchestra.run.smithi067.stderr: 49400K .......... .......... .......... .......... .......... 53% 350M 0s 2024-09-12T17:30:55.194 INFO:teuthology.orchestra.run.smithi067.stderr: 49450K .......... .......... .......... .......... .......... 53% 366M 0s 2024-09-12T17:30:55.194 INFO:teuthology.orchestra.run.smithi067.stderr: 49500K .......... .......... .......... .......... .......... 53% 319M 0s 2024-09-12T17:30:55.195 INFO:teuthology.orchestra.run.smithi067.stderr: 49550K .......... .......... .......... .......... .......... 53% 291M 0s 2024-09-12T17:30:55.195 INFO:teuthology.orchestra.run.smithi067.stderr: 49600K .......... .......... .......... .......... .......... 53% 370M 0s 2024-09-12T17:30:55.195 INFO:teuthology.orchestra.run.smithi067.stderr: 49650K .......... .......... .......... .......... .......... 53% 356M 0s 2024-09-12T17:30:55.195 INFO:teuthology.orchestra.run.smithi067.stderr: 49700K .......... .......... .......... .......... .......... 53% 307M 0s 2024-09-12T17:30:55.195 INFO:teuthology.orchestra.run.smithi067.stderr: 49750K .......... .......... .......... .......... .......... 53% 292M 0s 2024-09-12T17:30:55.195 INFO:teuthology.orchestra.run.smithi067.stderr: 49800K .......... .......... .......... .......... .......... 53% 334M 0s 2024-09-12T17:30:55.195 INFO:teuthology.orchestra.run.smithi067.stderr: 49850K .......... .......... .......... .......... .......... 53% 337M 0s 2024-09-12T17:30:55.195 INFO:teuthology.orchestra.run.smithi067.stderr: 49900K .......... .......... .......... .......... .......... 53% 332M 0s 2024-09-12T17:30:55.195 INFO:teuthology.orchestra.run.smithi067.stderr: 49950K .......... .......... .......... .......... .......... 53% 275M 0s 2024-09-12T17:30:55.195 INFO:teuthology.orchestra.run.smithi067.stderr: 50000K .......... .......... .......... .......... .......... 53% 310M 0s 2024-09-12T17:30:55.195 INFO:teuthology.orchestra.run.smithi067.stderr: 50050K .......... .......... .......... .......... .......... 53% 262M 0s 2024-09-12T17:30:55.195 INFO:teuthology.orchestra.run.smithi067.stderr: 50100K .......... .......... .......... .......... .......... 53% 338M 0s 2024-09-12T17:30:55.195 INFO:teuthology.orchestra.run.smithi067.stderr: 50150K .......... .......... .......... .......... .......... 54% 279M 0s 2024-09-12T17:30:55.195 INFO:teuthology.orchestra.run.smithi067.stderr: 50200K .......... .......... .......... .......... .......... 54% 382M 0s 2024-09-12T17:30:55.196 INFO:teuthology.orchestra.run.smithi067.stderr: 50250K .......... .......... .......... .......... .......... 54% 351M 0s 2024-09-12T17:30:55.196 INFO:teuthology.orchestra.run.smithi067.stderr: 50300K .......... .......... .......... .......... .......... 54% 304M 0s 2024-09-12T17:30:55.196 INFO:teuthology.orchestra.run.smithi067.stderr: 50350K .......... .......... .......... .......... .......... 54% 113M 0s 2024-09-12T17:30:55.196 INFO:teuthology.orchestra.run.smithi067.stderr: 50400K .......... .......... .......... .......... .......... 54% 46.7M 0s 2024-09-12T17:30:55.196 INFO:teuthology.orchestra.run.smithi067.stderr: 50450K .......... .......... .......... .......... .......... 54% 330M 0s 2024-09-12T17:30:55.196 INFO:teuthology.orchestra.run.smithi067.stderr: 50500K .......... .......... .......... .......... .......... 54% 145M 0s 2024-09-12T17:30:55.196 INFO:teuthology.orchestra.run.smithi067.stderr: 50550K .......... .......... .......... .......... .......... 54% 293M 0s 2024-09-12T17:30:55.196 INFO:teuthology.orchestra.run.smithi067.stderr: 50600K .......... .......... .......... .......... .......... 54% 337M 0s 2024-09-12T17:30:55.196 INFO:teuthology.orchestra.run.smithi067.stderr: 50650K .......... .......... .......... .......... .......... 54% 378M 0s 2024-09-12T17:30:55.196 INFO:teuthology.orchestra.run.smithi067.stderr: 50700K .......... .......... .......... .......... .......... 54% 354M 0s 2024-09-12T17:30:55.196 INFO:teuthology.orchestra.run.smithi067.stderr: 50750K .......... .......... .......... .......... .......... 54% 275M 0s 2024-09-12T17:30:55.196 INFO:teuthology.orchestra.run.smithi067.stderr: 50800K .......... .......... .......... .......... .......... 54% 338M 0s 2024-09-12T17:30:55.196 INFO:teuthology.orchestra.run.smithi067.stderr: 50850K .......... .......... .......... .......... .......... 54% 347M 0s 2024-09-12T17:30:55.196 INFO:teuthology.orchestra.run.smithi067.stderr: 50900K .......... .......... .......... .......... .......... 54% 212M 0s 2024-09-12T17:30:55.197 INFO:teuthology.orchestra.run.smithi067.stderr: 50950K .......... .......... .......... .......... .......... 54% 284M 0s 2024-09-12T17:30:55.197 INFO:teuthology.orchestra.run.smithi067.stderr: 51000K .......... .......... .......... .......... .......... 54% 336M 0s 2024-09-12T17:30:55.197 INFO:teuthology.orchestra.run.smithi067.stderr: 51050K .......... .......... .......... .......... .......... 55% 354M 0s 2024-09-12T17:30:55.197 INFO:teuthology.orchestra.run.smithi067.stderr: 51100K .......... .......... .......... .......... .......... 55% 306M 0s 2024-09-12T17:30:55.197 INFO:teuthology.orchestra.run.smithi067.stderr: 51150K .......... .......... .......... .......... .......... 55% 271M 0s 2024-09-12T17:30:55.197 INFO:teuthology.orchestra.run.smithi067.stderr: 51200K .......... .......... .......... .......... .......... 55% 320M 0s 2024-09-12T17:30:55.197 INFO:teuthology.orchestra.run.smithi067.stderr: 51250K .......... .......... .......... .......... .......... 55% 346M 0s 2024-09-12T17:30:55.197 INFO:teuthology.orchestra.run.smithi067.stderr: 51300K .......... .......... .......... .......... .......... 55% 303M 0s 2024-09-12T17:30:55.197 INFO:teuthology.orchestra.run.smithi067.stderr: 51350K .......... .......... .......... .......... .......... 55% 346M 0s 2024-09-12T17:30:55.197 INFO:teuthology.orchestra.run.smithi067.stderr: 51400K .......... .......... .......... .......... .......... 55% 351M 0s 2024-09-12T17:30:55.197 INFO:teuthology.orchestra.run.smithi067.stderr: 51450K .......... .......... .......... .......... .......... 55% 280M 0s 2024-09-12T17:30:55.197 INFO:teuthology.orchestra.run.smithi067.stderr: 51500K .......... .......... .......... .......... .......... 55% 201M 0s 2024-09-12T17:30:55.197 INFO:teuthology.orchestra.run.smithi067.stderr: 51550K .......... .......... .......... .......... .......... 55% 221M 0s 2024-09-12T17:30:55.197 INFO:teuthology.orchestra.run.smithi067.stderr: 51600K .......... .......... .......... .......... .......... 55% 287M 0s 2024-09-12T17:30:55.198 INFO:teuthology.orchestra.run.smithi067.stderr: 51650K .......... .......... .......... .......... .......... 55% 152M 0s 2024-09-12T17:30:55.198 INFO:teuthology.orchestra.run.smithi067.stderr: 51700K .......... .......... .......... .......... .......... 55% 279M 0s 2024-09-12T17:30:55.198 INFO:teuthology.orchestra.run.smithi067.stderr: 51750K .......... .......... .......... .......... .......... 55% 352M 0s 2024-09-12T17:30:55.198 INFO:teuthology.orchestra.run.smithi067.stderr: 51800K .......... .......... .......... .......... .......... 55% 354M 0s 2024-09-12T17:30:55.198 INFO:teuthology.orchestra.run.smithi067.stderr: 51850K .......... .......... .......... .......... .......... 55% 316M 0s 2024-09-12T17:30:55.198 INFO:teuthology.orchestra.run.smithi067.stderr: 51900K .......... .......... .......... .......... .......... 55% 291M 0s 2024-09-12T17:30:55.198 INFO:teuthology.orchestra.run.smithi067.stderr: 51950K .......... .......... .......... .......... .......... 55% 310M 0s 2024-09-12T17:30:55.198 INFO:teuthology.orchestra.run.smithi067.stderr: 52000K .......... .......... .......... .......... .......... 56% 305M 0s 2024-09-12T17:30:55.198 INFO:teuthology.orchestra.run.smithi067.stderr: 52050K .......... .......... .......... .......... .......... 56% 340M 0s 2024-09-12T17:30:55.198 INFO:teuthology.orchestra.run.smithi067.stderr: 52100K .......... .......... .......... .......... .......... 56% 155M 0s 2024-09-12T17:30:55.198 INFO:teuthology.orchestra.run.smithi067.stderr: 52150K .......... .......... .......... .......... .......... 56% 338M 0s 2024-09-12T17:30:55.198 INFO:teuthology.orchestra.run.smithi067.stderr: 52200K .......... .......... .......... .......... .......... 56% 88.5M 0s 2024-09-12T17:30:55.198 INFO:teuthology.orchestra.run.smithi067.stderr: 52250K .......... .......... .......... .......... .......... 56% 326M 0s 2024-09-12T17:30:55.198 INFO:teuthology.orchestra.run.smithi067.stderr: 52300K .......... .......... .......... .......... .......... 56% 246M 0s 2024-09-12T17:30:55.199 INFO:teuthology.orchestra.run.smithi067.stderr: 52350K .......... .......... .......... .......... .......... 56% 362M 0s 2024-09-12T17:30:55.199 INFO:teuthology.orchestra.run.smithi067.stderr: 52400K .......... .......... .......... .......... .......... 56% 378M 0s 2024-09-12T17:30:55.199 INFO:teuthology.orchestra.run.smithi067.stderr: 52450K .......... .......... .......... .......... .......... 56% 286M 0s 2024-09-12T17:30:55.199 INFO:teuthology.orchestra.run.smithi067.stderr: 52500K .......... .......... .......... .......... .......... 56% 297M 0s 2024-09-12T17:30:55.199 INFO:teuthology.orchestra.run.smithi067.stderr: 52550K .......... .......... .......... .......... .......... 56% 352M 0s 2024-09-12T17:30:55.199 INFO:teuthology.orchestra.run.smithi067.stderr: 52600K .......... .......... .......... .......... .......... 56% 333M 0s 2024-09-12T17:30:55.199 INFO:teuthology.orchestra.run.smithi067.stderr: 52650K .......... .......... .......... .......... .......... 56% 343M 0s 2024-09-12T17:30:55.199 INFO:teuthology.orchestra.run.smithi067.stderr: 52700K .......... .......... .......... .......... .......... 56% 277M 0s 2024-09-12T17:30:55.199 INFO:teuthology.orchestra.run.smithi067.stderr: 52750K .......... .......... .......... .......... .......... 56% 336M 0s 2024-09-12T17:30:55.199 INFO:teuthology.orchestra.run.smithi067.stderr: 52800K .......... .......... .......... .......... .......... 56% 283M 0s 2024-09-12T17:30:55.199 INFO:teuthology.orchestra.run.smithi067.stderr: 52850K .......... .......... .......... .......... .......... 56% 327M 0s 2024-09-12T17:30:55.199 INFO:teuthology.orchestra.run.smithi067.stderr: 52900K .......... .......... .......... .......... .......... 56% 342M 0s 2024-09-12T17:30:55.199 INFO:teuthology.orchestra.run.smithi067.stderr: 52950K .......... .......... .......... .......... .......... 57% 309M 0s 2024-09-12T17:30:55.199 INFO:teuthology.orchestra.run.smithi067.stderr: 53000K .......... .......... .......... .......... .......... 57% 290M 0s 2024-09-12T17:30:55.200 INFO:teuthology.orchestra.run.smithi067.stderr: 53050K .......... .......... .......... .......... .......... 57% 214M 0s 2024-09-12T17:30:55.200 INFO:teuthology.orchestra.run.smithi067.stderr: 53100K .......... .......... .......... .......... .......... 57% 316M 0s 2024-09-12T17:30:55.200 INFO:teuthology.orchestra.run.smithi067.stderr: 53150K .......... .......... .......... .......... .......... 57% 337M 0s 2024-09-12T17:30:55.200 INFO:teuthology.orchestra.run.smithi067.stderr: 53200K .......... .......... .......... .......... .......... 57% 266M 0s 2024-09-12T17:30:55.200 INFO:teuthology.orchestra.run.smithi067.stderr: 53250K .......... .......... .......... .......... .......... 57% 341M 0s 2024-09-12T17:30:55.200 INFO:teuthology.orchestra.run.smithi067.stderr: 53300K .......... .......... .......... .......... .......... 57% 328M 0s 2024-09-12T17:30:55.200 INFO:teuthology.orchestra.run.smithi067.stderr: 53350K .......... .......... .......... .......... .......... 57% 148M 0s 2024-09-12T17:30:55.200 INFO:teuthology.orchestra.run.smithi067.stderr: 53400K .......... .......... .......... .......... .......... 57% 226M 0s 2024-09-12T17:30:55.200 INFO:teuthology.orchestra.run.smithi067.stderr: 53450K .......... .......... .......... .......... .......... 57% 317M 0s 2024-09-12T17:30:55.200 INFO:teuthology.orchestra.run.smithi067.stderr: 53500K .......... .......... .......... .......... .......... 57% 55.4M 0s 2024-09-12T17:30:55.200 INFO:teuthology.orchestra.run.smithi067.stderr: 53550K .......... .......... .......... .......... .......... 57% 106M 0s 2024-09-12T17:30:55.200 INFO:teuthology.orchestra.run.smithi067.stderr: 53600K .......... .......... .......... .......... .......... 57% 295M 0s 2024-09-12T17:30:55.200 INFO:teuthology.orchestra.run.smithi067.stderr: 53650K .......... .......... .......... .......... .......... 57% 327M 0s 2024-09-12T17:30:55.200 INFO:teuthology.orchestra.run.smithi067.stderr: 53700K .......... .......... .......... .......... .......... 57% 229M 0s 2024-09-12T17:30:55.200 INFO:teuthology.orchestra.run.smithi067.stderr: 53750K .......... .......... .......... .......... .......... 57% 335M 0s 2024-09-12T17:30:55.201 INFO:teuthology.orchestra.run.smithi067.stderr: 53800K .......... .......... .......... .......... .......... 57% 247M 0s 2024-09-12T17:30:55.201 INFO:teuthology.orchestra.run.smithi067.stderr: 53850K .......... .......... .......... .......... .......... 58% 334M 0s 2024-09-12T17:30:55.201 INFO:teuthology.orchestra.run.smithi067.stderr: 53900K .......... .......... .......... .......... .......... 58% 332M 0s 2024-09-12T17:30:55.201 INFO:teuthology.orchestra.run.smithi067.stderr: 53950K .......... .......... .......... .......... .......... 58% 305M 0s 2024-09-12T17:30:55.201 INFO:teuthology.orchestra.run.smithi067.stderr: 54000K .......... .......... .......... .......... .......... 58% 296M 0s 2024-09-12T17:30:55.201 INFO:teuthology.orchestra.run.smithi067.stderr: 54050K .......... .......... .......... .......... .......... 58% 331M 0s 2024-09-12T17:30:55.201 INFO:teuthology.orchestra.run.smithi067.stderr: 54100K .......... .......... .......... .......... .......... 58% 306M 0s 2024-09-12T17:30:55.201 INFO:teuthology.orchestra.run.smithi067.stderr: 54150K .......... .......... .......... .......... .......... 58% 343M 0s 2024-09-12T17:30:55.201 INFO:teuthology.orchestra.run.smithi067.stderr: 54200K .......... .......... .......... .......... .......... 58% 288M 0s 2024-09-12T17:30:55.201 INFO:teuthology.orchestra.run.smithi067.stderr: 54250K .......... .......... .......... .......... .......... 58% 157M 0s 2024-09-12T17:30:55.201 INFO:teuthology.orchestra.run.smithi067.stderr: 54300K .......... .......... .......... .......... .......... 58% 316M 0s 2024-09-12T17:30:55.201 INFO:teuthology.orchestra.run.smithi067.stderr: 54350K .......... .......... .......... .......... .......... 58% 345M 0s 2024-09-12T17:30:55.201 INFO:teuthology.orchestra.run.smithi067.stderr: 54400K .......... .......... .......... .......... .......... 58% 338M 0s 2024-09-12T17:30:55.202 INFO:teuthology.orchestra.run.smithi067.stderr: 54450K .......... .......... .......... .......... .......... 58% 301M 0s 2024-09-12T17:30:55.202 INFO:teuthology.orchestra.run.smithi067.stderr: 54500K .......... .......... .......... .......... .......... 58% 333M 0s 2024-09-12T17:30:55.202 INFO:teuthology.orchestra.run.smithi067.stderr: 54550K .......... .......... .......... .......... .......... 58% 316M 0s 2024-09-12T17:30:55.202 INFO:teuthology.orchestra.run.smithi067.stderr: 54600K .......... .......... .......... .......... .......... 58% 288M 0s 2024-09-12T17:30:55.202 INFO:teuthology.orchestra.run.smithi067.stderr: 54650K .......... .......... .......... .......... .......... 58% 336M 0s 2024-09-12T17:30:55.202 INFO:teuthology.orchestra.run.smithi067.stderr: 54700K .......... .......... .......... .......... .......... 58% 163M 0s 2024-09-12T17:30:55.202 INFO:teuthology.orchestra.run.smithi067.stderr: 54750K .......... .......... .......... .......... .......... 58% 329M 0s 2024-09-12T17:30:55.202 INFO:teuthology.orchestra.run.smithi067.stderr: 54800K .......... .......... .......... .......... .......... 59% 275M 0s 2024-09-12T17:30:55.202 INFO:teuthology.orchestra.run.smithi067.stderr: 54850K .......... .......... .......... .......... .......... 59% 337M 0s 2024-09-12T17:30:55.202 INFO:teuthology.orchestra.run.smithi067.stderr: 54900K .......... .......... .......... .......... .......... 59% 345M 0s 2024-09-12T17:30:55.202 INFO:teuthology.orchestra.run.smithi067.stderr: 54950K .......... .......... .......... .......... .......... 59% 352M 0s 2024-09-12T17:30:55.202 INFO:teuthology.orchestra.run.smithi067.stderr: 55000K .......... .......... .......... .......... .......... 59% 219M 0s 2024-09-12T17:30:55.202 INFO:teuthology.orchestra.run.smithi067.stderr: 55050K .......... .......... .......... .......... .......... 59% 153M 0s 2024-09-12T17:30:55.202 INFO:teuthology.orchestra.run.smithi067.stderr: 55100K .......... .......... .......... .......... .......... 59% 276M 0s 2024-09-12T17:30:55.203 INFO:teuthology.orchestra.run.smithi067.stderr: 55150K .......... .......... .......... .......... .......... 59% 301M 0s 2024-09-12T17:30:55.203 INFO:teuthology.orchestra.run.smithi067.stderr: 55200K .......... .......... .......... .......... .......... 59% 310M 0s 2024-09-12T17:30:55.203 INFO:teuthology.orchestra.run.smithi067.stderr: 55250K .......... .......... .......... .......... .......... 59% 177M 0s 2024-09-12T17:30:55.203 INFO:teuthology.orchestra.run.smithi067.stderr: 55300K .......... .......... .......... .......... .......... 59% 256M 0s 2024-09-12T17:30:55.203 INFO:teuthology.orchestra.run.smithi067.stderr: 55350K .......... .......... .......... .......... .......... 59% 248M 0s 2024-09-12T17:30:55.203 INFO:teuthology.orchestra.run.smithi067.stderr: 55400K .......... .......... .......... .......... .......... 59% 260M 0s 2024-09-12T17:30:55.203 INFO:teuthology.orchestra.run.smithi067.stderr: 55450K .......... .......... .......... .......... .......... 59% 349M 0s 2024-09-12T17:30:55.203 INFO:teuthology.orchestra.run.smithi067.stderr: 55500K .......... .......... .......... .......... .......... 59% 300M 0s 2024-09-12T17:30:55.203 INFO:teuthology.orchestra.run.smithi067.stderr: 55550K .......... .......... .......... .......... .......... 59% 326M 0s 2024-09-12T17:30:55.203 INFO:teuthology.orchestra.run.smithi067.stderr: 55600K .......... .......... .......... .......... .......... 59% 163M 0s 2024-09-12T17:30:55.203 INFO:teuthology.orchestra.run.smithi067.stderr: 55650K .......... .......... .......... .......... .......... 59% 309M 0s 2024-09-12T17:30:55.203 INFO:teuthology.orchestra.run.smithi067.stderr: 55700K .......... .......... .......... .......... .......... 60% 341M 0s 2024-09-12T17:30:55.203 INFO:teuthology.orchestra.run.smithi067.stderr: 55750K .......... .......... .......... .......... .......... 60% 349M 0s 2024-09-12T17:30:55.203 INFO:teuthology.orchestra.run.smithi067.stderr: 55800K .......... .......... .......... .......... .......... 60% 327M 0s 2024-09-12T17:30:55.204 INFO:teuthology.orchestra.run.smithi067.stderr: 55850K .......... .......... .......... .......... .......... 60% 169M 0s 2024-09-12T17:30:55.204 INFO:teuthology.orchestra.run.smithi067.stderr: 55900K .......... .......... .......... .......... .......... 60% 203M 0s 2024-09-12T17:30:55.204 INFO:teuthology.orchestra.run.smithi067.stderr: 55950K .......... .......... .......... .......... .......... 60% 332M 0s 2024-09-12T17:30:55.204 INFO:teuthology.orchestra.run.smithi067.stderr: 56000K .......... .......... .......... .......... .......... 60% 351M 0s 2024-09-12T17:30:55.204 INFO:teuthology.orchestra.run.smithi067.stderr: 56050K .......... .......... .......... .......... .......... 60% 324M 0s 2024-09-12T17:30:55.204 INFO:teuthology.orchestra.run.smithi067.stderr: 56100K .......... .......... .......... .......... .......... 60% 260M 0s 2024-09-12T17:30:55.204 INFO:teuthology.orchestra.run.smithi067.stderr: 56150K .......... .......... .......... .......... .......... 60% 364M 0s 2024-09-12T17:30:55.204 INFO:teuthology.orchestra.run.smithi067.stderr: 56200K .......... .......... .......... .......... .......... 60% 297M 0s 2024-09-12T17:30:55.204 INFO:teuthology.orchestra.run.smithi067.stderr: 56250K .......... .......... .......... .......... .......... 60% 344M 0s 2024-09-12T17:30:55.204 INFO:teuthology.orchestra.run.smithi067.stderr: 56300K .......... .......... .......... .......... .......... 60% 310M 0s 2024-09-12T17:30:55.204 INFO:teuthology.orchestra.run.smithi067.stderr: 56350K .......... .......... .......... .......... .......... 60% 101M 0s 2024-09-12T17:30:55.204 INFO:teuthology.orchestra.run.smithi067.stderr: 56400K .......... .......... .......... .......... .......... 60% 285M 0s 2024-09-12T17:30:55.204 INFO:teuthology.orchestra.run.smithi067.stderr: 56450K .......... .......... .......... .......... .......... 60% 99.7M 0s 2024-09-12T17:30:55.205 INFO:teuthology.orchestra.run.smithi067.stderr: 56500K .......... .......... .......... .......... .......... 60% 268M 0s 2024-09-12T17:30:55.205 INFO:teuthology.orchestra.run.smithi067.stderr: 56550K .......... .......... .......... .......... .......... 60% 304M 0s 2024-09-12T17:30:55.205 INFO:teuthology.orchestra.run.smithi067.stderr: 56600K .......... .......... .......... .......... .......... 60% 106M 0s 2024-09-12T17:30:55.205 INFO:teuthology.orchestra.run.smithi067.stderr: 56650K .......... .......... .......... .......... .......... 61% 156M 0s 2024-09-12T17:30:55.205 INFO:teuthology.orchestra.run.smithi067.stderr: 56700K .......... .......... .......... .......... .......... 61% 186M 0s 2024-09-12T17:30:55.205 INFO:teuthology.orchestra.run.smithi067.stderr: 56750K .......... .......... .......... .......... .......... 61% 294M 0s 2024-09-12T17:30:55.205 INFO:teuthology.orchestra.run.smithi067.stderr: 56800K .......... .......... .......... .......... .......... 61% 318M 0s 2024-09-12T17:30:55.205 INFO:teuthology.orchestra.run.smithi067.stderr: 56850K .......... .......... .......... .......... .......... 61% 333M 0s 2024-09-12T17:30:55.205 INFO:teuthology.orchestra.run.smithi067.stderr: 56900K .......... .......... .......... .......... .......... 61% 292M 0s 2024-09-12T17:30:55.205 INFO:teuthology.orchestra.run.smithi067.stderr: 56950K .......... .......... .......... .......... .......... 61% 334M 0s 2024-09-12T17:30:55.205 INFO:teuthology.orchestra.run.smithi067.stderr: 57000K .......... .......... .......... .......... .......... 61% 330M 0s 2024-09-12T17:30:55.205 INFO:teuthology.orchestra.run.smithi067.stderr: 57050K .......... .......... .......... .......... .......... 61% 320M 0s 2024-09-12T17:30:55.205 INFO:teuthology.orchestra.run.smithi067.stderr: 57100K .......... .......... .......... .......... .......... 61% 254M 0s 2024-09-12T17:30:55.205 INFO:teuthology.orchestra.run.smithi067.stderr: 57150K .......... .......... .......... .......... .......... 61% 340M 0s 2024-09-12T17:30:55.206 INFO:teuthology.orchestra.run.smithi067.stderr: 57200K .......... .......... .......... .......... .......... 61% 332M 0s 2024-09-12T17:30:55.206 INFO:teuthology.orchestra.run.smithi067.stderr: 57250K .......... .......... .......... .......... .......... 61% 334M 0s 2024-09-12T17:30:55.206 INFO:teuthology.orchestra.run.smithi067.stderr: 57300K .......... .......... .......... .......... .......... 61% 275M 0s 2024-09-12T17:30:55.206 INFO:teuthology.orchestra.run.smithi067.stderr: 57350K .......... .......... .......... .......... .......... 61% 163M 0s 2024-09-12T17:30:55.206 INFO:teuthology.orchestra.run.smithi067.stderr: 57400K .......... .......... .......... .......... .......... 61% 320M 0s 2024-09-12T17:30:55.206 INFO:teuthology.orchestra.run.smithi067.stderr: 57450K .......... .......... .......... .......... .......... 61% 309M 0s 2024-09-12T17:30:55.206 INFO:teuthology.orchestra.run.smithi067.stderr: 57500K .......... .......... .......... .......... .......... 61% 276M 0s 2024-09-12T17:30:55.206 INFO:teuthology.orchestra.run.smithi067.stderr: 57550K .......... .......... .......... .......... .......... 62% 304M 0s 2024-09-12T17:30:55.206 INFO:teuthology.orchestra.run.smithi067.stderr: 57600K .......... .......... .......... .......... .......... 62% 328M 0s 2024-09-12T17:30:55.206 INFO:teuthology.orchestra.run.smithi067.stderr: 57650K .......... .......... .......... .......... .......... 62% 322M 0s 2024-09-12T17:30:55.206 INFO:teuthology.orchestra.run.smithi067.stderr: 57700K .......... .......... .......... .......... .......... 62% 279M 0s 2024-09-12T17:30:55.206 INFO:teuthology.orchestra.run.smithi067.stderr: 57750K .......... .......... .......... .......... .......... 62% 353M 0s 2024-09-12T17:30:55.206 INFO:teuthology.orchestra.run.smithi067.stderr: 57800K .......... .......... .......... .......... .......... 62% 341M 0s 2024-09-12T17:30:55.206 INFO:teuthology.orchestra.run.smithi067.stderr: 57850K .......... .......... .......... .......... .......... 62% 346M 0s 2024-09-12T17:30:55.207 INFO:teuthology.orchestra.run.smithi067.stderr: 57900K .......... .......... .......... .......... .......... 62% 259M 0s 2024-09-12T17:30:55.207 INFO:teuthology.orchestra.run.smithi067.stderr: 57950K .......... .......... .......... .......... .......... 62% 243M 0s 2024-09-12T17:30:55.207 INFO:teuthology.orchestra.run.smithi067.stderr: 58000K .......... .......... .......... .......... .......... 62% 336M 0s 2024-09-12T17:30:55.207 INFO:teuthology.orchestra.run.smithi067.stderr: 58050K .......... .......... .......... .......... .......... 62% 353M 0s 2024-09-12T17:30:55.207 INFO:teuthology.orchestra.run.smithi067.stderr: 58100K .......... .......... .......... .......... .......... 62% 277M 0s 2024-09-12T17:30:55.207 INFO:teuthology.orchestra.run.smithi067.stderr: 58150K .......... .......... .......... .......... .......... 62% 334M 0s 2024-09-12T17:30:55.207 INFO:teuthology.orchestra.run.smithi067.stderr: 58200K .......... .......... .......... .......... .......... 62% 273M 0s 2024-09-12T17:30:55.207 INFO:teuthology.orchestra.run.smithi067.stderr: 58250K .......... .......... .......... .......... .......... 62% 337M 0s 2024-09-12T17:30:55.207 INFO:teuthology.orchestra.run.smithi067.stderr: 58300K .......... .......... .......... .......... .......... 62% 111M 0s 2024-09-12T17:30:55.207 INFO:teuthology.orchestra.run.smithi067.stderr: 58350K .......... .......... .......... .......... .......... 62% 301M 0s 2024-09-12T17:30:55.207 INFO:teuthology.orchestra.run.smithi067.stderr: 58400K .......... .......... .......... .......... .......... 62% 335M 0s 2024-09-12T17:30:55.207 INFO:teuthology.orchestra.run.smithi067.stderr: 58450K .......... .......... .......... .......... .......... 62% 236M 0s 2024-09-12T17:30:55.207 INFO:teuthology.orchestra.run.smithi067.stderr: 58500K .......... .......... .......... .......... .......... 63% 244M 0s 2024-09-12T17:30:55.207 INFO:teuthology.orchestra.run.smithi067.stderr: 58550K .......... .......... .......... .......... .......... 63% 322M 0s 2024-09-12T17:30:55.208 INFO:teuthology.orchestra.run.smithi067.stderr: 58600K .......... .......... .......... .......... .......... 63% 323M 0s 2024-09-12T17:30:55.208 INFO:teuthology.orchestra.run.smithi067.stderr: 58650K .......... .......... .......... .......... .......... 63% 102M 0s 2024-09-12T17:30:55.208 INFO:teuthology.orchestra.run.smithi067.stderr: 58700K .......... .......... .......... .......... .......... 63% 247M 0s 2024-09-12T17:30:55.208 INFO:teuthology.orchestra.run.smithi067.stderr: 58750K .......... .......... .......... .......... .......... 63% 290M 0s 2024-09-12T17:30:55.208 INFO:teuthology.orchestra.run.smithi067.stderr: 58800K .......... .......... .......... .......... .......... 63% 314M 0s 2024-09-12T17:30:55.208 INFO:teuthology.orchestra.run.smithi067.stderr: 58850K .......... .......... .......... .......... .......... 63% 334M 0s 2024-09-12T17:30:55.208 INFO:teuthology.orchestra.run.smithi067.stderr: 58900K .......... .......... .......... .......... .......... 63% 309M 0s 2024-09-12T17:30:55.208 INFO:teuthology.orchestra.run.smithi067.stderr: 58950K .......... .......... .......... .......... .......... 63% 297M 0s 2024-09-12T17:30:55.208 INFO:teuthology.orchestra.run.smithi067.stderr: 59000K .......... .......... .......... .......... .......... 63% 325M 0s 2024-09-12T17:30:55.208 INFO:teuthology.orchestra.run.smithi067.stderr: 59050K .......... .......... .......... .......... .......... 63% 313M 0s 2024-09-12T17:30:55.208 INFO:teuthology.orchestra.run.smithi067.stderr: 59100K .......... .......... .......... .......... .......... 63% 284M 0s 2024-09-12T17:30:55.208 INFO:teuthology.orchestra.run.smithi067.stderr: 59150K .......... .......... .......... .......... .......... 63% 368M 0s 2024-09-12T17:30:55.208 INFO:teuthology.orchestra.run.smithi067.stderr: 59200K .......... .......... .......... .......... .......... 63% 313M 0s 2024-09-12T17:30:55.208 INFO:teuthology.orchestra.run.smithi067.stderr: 59250K .......... .......... .......... .......... .......... 63% 206M 0s 2024-09-12T17:30:55.209 INFO:teuthology.orchestra.run.smithi067.stderr: 59300K .......... .......... .......... .......... .......... 63% 264M 0s 2024-09-12T17:30:55.209 INFO:teuthology.orchestra.run.smithi067.stderr: 59350K .......... .......... .......... .......... .......... 63% 346M 0s 2024-09-12T17:30:55.209 INFO:teuthology.orchestra.run.smithi067.stderr: 59400K .......... .......... .......... .......... .......... 63% 183M 0s 2024-09-12T17:30:55.209 INFO:teuthology.orchestra.run.smithi067.stderr: 59450K .......... .......... .......... .......... .......... 64% 278M 0s 2024-09-12T17:30:55.209 INFO:teuthology.orchestra.run.smithi067.stderr: 59500K .......... .......... .......... .......... .......... 64% 87.3M 0s 2024-09-12T17:30:55.209 INFO:teuthology.orchestra.run.smithi067.stderr: 59550K .......... .......... .......... .......... .......... 64% 297M 0s 2024-09-12T17:30:55.209 INFO:teuthology.orchestra.run.smithi067.stderr: 59600K .......... .......... .......... .......... .......... 64% 285M 0s 2024-09-12T17:30:55.209 INFO:teuthology.orchestra.run.smithi067.stderr: 59650K .......... .......... .......... .......... .......... 64% 120M 0s 2024-09-12T17:30:55.209 INFO:teuthology.orchestra.run.smithi067.stderr: 59700K .......... .......... .......... .......... .......... 64% 97.3M 0s 2024-09-12T17:30:55.209 INFO:teuthology.orchestra.run.smithi067.stderr: 59750K .......... .......... .......... .......... .......... 64% 286M 0s 2024-09-12T17:30:55.209 INFO:teuthology.orchestra.run.smithi067.stderr: 59800K .......... .......... .......... .......... .......... 64% 347M 0s 2024-09-12T17:30:55.209 INFO:teuthology.orchestra.run.smithi067.stderr: 59850K .......... .......... .......... .......... .......... 64% 336M 0s 2024-09-12T17:30:55.209 INFO:teuthology.orchestra.run.smithi067.stderr: 59900K .......... .......... .......... .......... .......... 64% 99.7M 0s 2024-09-12T17:30:55.209 INFO:teuthology.orchestra.run.smithi067.stderr: 59950K .......... .......... .......... .......... .......... 64% 286M 0s 2024-09-12T17:30:55.210 INFO:teuthology.orchestra.run.smithi067.stderr: 60000K .......... .......... .......... .......... .......... 64% 323M 0s 2024-09-12T17:30:55.210 INFO:teuthology.orchestra.run.smithi067.stderr: 60050K .......... .......... .......... .......... .......... 64% 317M 0s 2024-09-12T17:30:55.210 INFO:teuthology.orchestra.run.smithi067.stderr: 60100K .......... .......... .......... .......... .......... 64% 278M 0s 2024-09-12T17:30:55.210 INFO:teuthology.orchestra.run.smithi067.stderr: 60150K .......... .......... .......... .......... .......... 64% 325M 0s 2024-09-12T17:30:55.210 INFO:teuthology.orchestra.run.smithi067.stderr: 60200K .......... .......... .......... .......... .......... 64% 306M 0s 2024-09-12T17:30:55.210 INFO:teuthology.orchestra.run.smithi067.stderr: 60250K .......... .......... .......... .......... .......... 64% 331M 0s 2024-09-12T17:30:55.210 INFO:teuthology.orchestra.run.smithi067.stderr: 60300K .......... .......... .......... .......... .......... 64% 271M 0s 2024-09-12T17:30:55.210 INFO:teuthology.orchestra.run.smithi067.stderr: 60350K .......... .......... .......... .......... .......... 65% 337M 0s 2024-09-12T17:30:55.210 INFO:teuthology.orchestra.run.smithi067.stderr: 60400K .......... .......... .......... .......... .......... 65% 296M 0s 2024-09-12T17:30:55.210 INFO:teuthology.orchestra.run.smithi067.stderr: 60450K .......... .......... .......... .......... .......... 65% 285M 0s 2024-09-12T17:30:55.210 INFO:teuthology.orchestra.run.smithi067.stderr: 60500K .......... .......... .......... .......... .......... 65% 305M 0s 2024-09-12T17:30:55.210 INFO:teuthology.orchestra.run.smithi067.stderr: 60550K .......... .......... .......... .......... .......... 65% 326M 0s 2024-09-12T17:30:55.210 INFO:teuthology.orchestra.run.smithi067.stderr: 60600K .......... .......... .......... .......... .......... 65% 305M 0s 2024-09-12T17:30:55.210 INFO:teuthology.orchestra.run.smithi067.stderr: 60650K .......... .......... .......... .......... .......... 65% 308M 0s 2024-09-12T17:30:55.211 INFO:teuthology.orchestra.run.smithi067.stderr: 60700K .......... .......... .......... .......... .......... 65% 284M 0s 2024-09-12T17:30:55.211 INFO:teuthology.orchestra.run.smithi067.stderr: 60750K .......... .......... .......... .......... .......... 65% 338M 0s 2024-09-12T17:30:55.211 INFO:teuthology.orchestra.run.smithi067.stderr: 60800K .......... .......... .......... .......... .......... 65% 323M 0s 2024-09-12T17:30:55.211 INFO:teuthology.orchestra.run.smithi067.stderr: 60850K .......... .......... .......... .......... .......... 65% 335M 0s 2024-09-12T17:30:55.211 INFO:teuthology.orchestra.run.smithi067.stderr: 60900K .......... .......... .......... .......... .......... 65% 293M 0s 2024-09-12T17:30:55.211 INFO:teuthology.orchestra.run.smithi067.stderr: 60950K .......... .......... .......... .......... .......... 65% 352M 0s 2024-09-12T17:30:55.211 INFO:teuthology.orchestra.run.smithi067.stderr: 61000K .......... .......... .......... .......... .......... 65% 324M 0s 2024-09-12T17:30:55.211 INFO:teuthology.orchestra.run.smithi067.stderr: 61050K .......... .......... .......... .......... .......... 65% 329M 0s 2024-09-12T17:30:55.211 INFO:teuthology.orchestra.run.smithi067.stderr: 61100K .......... .......... .......... .......... .......... 65% 287M 0s 2024-09-12T17:30:55.211 INFO:teuthology.orchestra.run.smithi067.stderr: 61150K .......... .......... .......... .......... .......... 65% 312M 0s 2024-09-12T17:30:55.211 INFO:teuthology.orchestra.run.smithi067.stderr: 61200K .......... .......... .......... .......... .......... 65% 345M 0s 2024-09-12T17:30:55.211 INFO:teuthology.orchestra.run.smithi067.stderr: 61250K .......... .......... .......... .......... .......... 65% 338M 0s 2024-09-12T17:30:55.211 INFO:teuthology.orchestra.run.smithi067.stderr: 61300K .......... .......... .......... .......... .......... 66% 317M 0s 2024-09-12T17:30:55.211 INFO:teuthology.orchestra.run.smithi067.stderr: 61350K .......... .......... .......... .......... .......... 66% 240M 0s 2024-09-12T17:30:55.212 INFO:teuthology.orchestra.run.smithi067.stderr: 61400K .......... .......... .......... .......... .......... 66% 312M 0s 2024-09-12T17:30:55.212 INFO:teuthology.orchestra.run.smithi067.stderr: 61450K .......... .......... .......... .......... .......... 66% 247M 0s 2024-09-12T17:30:55.212 INFO:teuthology.orchestra.run.smithi067.stderr: 61500K .......... .......... .......... .......... .......... 66% 346M 0s 2024-09-12T17:30:55.212 INFO:teuthology.orchestra.run.smithi067.stderr: 61550K .......... .......... .......... .......... .......... 66% 286M 0s 2024-09-12T17:30:55.212 INFO:teuthology.orchestra.run.smithi067.stderr: 61600K .......... .......... .......... .......... .......... 66% 70.0M 0s 2024-09-12T17:30:55.212 INFO:teuthology.orchestra.run.smithi067.stderr: 61650K .......... .......... .......... .......... .......... 66% 294M 0s 2024-09-12T17:30:55.212 INFO:teuthology.orchestra.run.smithi067.stderr: 61700K .......... .......... .......... .......... .......... 66% 335M 0s 2024-09-12T17:30:55.212 INFO:teuthology.orchestra.run.smithi067.stderr: 61750K .......... .......... .......... .......... .......... 66% 275M 0s 2024-09-12T17:30:55.212 INFO:teuthology.orchestra.run.smithi067.stderr: 61800K .......... .......... .......... .......... .......... 66% 113M 0s 2024-09-12T17:30:55.212 INFO:teuthology.orchestra.run.smithi067.stderr: 61850K .......... .......... .......... .......... .......... 66% 315M 0s 2024-09-12T17:30:55.212 INFO:teuthology.orchestra.run.smithi067.stderr: 61900K .......... .......... .......... .......... .......... 66% 331M 0s 2024-09-12T17:30:55.212 INFO:teuthology.orchestra.run.smithi067.stderr: 61950K .......... .......... .......... .......... .......... 66% 236M 0s 2024-09-12T17:30:55.212 INFO:teuthology.orchestra.run.smithi067.stderr: 62000K .......... .......... .......... .......... .......... 66% 314M 0s 2024-09-12T17:30:55.213 INFO:teuthology.orchestra.run.smithi067.stderr: 62050K .......... .......... .......... .......... .......... 66% 339M 0s 2024-09-12T17:30:55.213 INFO:teuthology.orchestra.run.smithi067.stderr: 62100K .......... .......... .......... .......... .......... 66% 347M 0s 2024-09-12T17:30:55.213 INFO:teuthology.orchestra.run.smithi067.stderr: 62150K .......... .......... .......... .......... .......... 66% 238M 0s 2024-09-12T17:30:55.213 INFO:teuthology.orchestra.run.smithi067.stderr: 62200K .......... .......... .......... .......... .......... 67% 325M 0s 2024-09-12T17:30:55.213 INFO:teuthology.orchestra.run.smithi067.stderr: 62250K .......... .......... .......... .......... .......... 67% 297M 0s 2024-09-12T17:30:55.213 INFO:teuthology.orchestra.run.smithi067.stderr: 62300K .......... .......... .......... .......... .......... 67% 346M 0s 2024-09-12T17:30:55.213 INFO:teuthology.orchestra.run.smithi067.stderr: 62350K .......... .......... .......... .......... .......... 67% 281M 0s 2024-09-12T17:30:55.213 INFO:teuthology.orchestra.run.smithi067.stderr: 62400K .......... .......... .......... .......... .......... 67% 345M 0s 2024-09-12T17:30:55.213 INFO:teuthology.orchestra.run.smithi067.stderr: 62450K .......... .......... .......... .......... .......... 67% 337M 0s 2024-09-12T17:30:55.213 INFO:teuthology.orchestra.run.smithi067.stderr: 62500K .......... .......... .......... .......... .......... 67% 199M 0s 2024-09-12T17:30:55.213 INFO:teuthology.orchestra.run.smithi067.stderr: 62550K .......... .......... .......... .......... .......... 67% 330M 0s 2024-09-12T17:30:55.213 INFO:teuthology.orchestra.run.smithi067.stderr: 62600K .......... .......... .......... .......... .......... 67% 319M 0s 2024-09-12T17:30:55.213 INFO:teuthology.orchestra.run.smithi067.stderr: 62650K .......... .......... .......... .......... .......... 67% 285M 0s 2024-09-12T17:30:55.213 INFO:teuthology.orchestra.run.smithi067.stderr: 62700K .......... .......... .......... .......... .......... 67% 79.8M 0s 2024-09-12T17:30:55.214 INFO:teuthology.orchestra.run.smithi067.stderr: 62750K .......... .......... .......... .......... .......... 67% 92.5M 0s 2024-09-12T17:30:55.214 INFO:teuthology.orchestra.run.smithi067.stderr: 62800K .......... .......... .......... .......... .......... 67% 321M 0s 2024-09-12T17:30:55.214 INFO:teuthology.orchestra.run.smithi067.stderr: 62850K .......... .......... .......... .......... .......... 67% 326M 0s 2024-09-12T17:30:55.214 INFO:teuthology.orchestra.run.smithi067.stderr: 62900K .......... .......... .......... .......... .......... 67% 318M 0s 2024-09-12T17:30:55.214 INFO:teuthology.orchestra.run.smithi067.stderr: 62950K .......... .......... .......... .......... .......... 67% 158M 0s 2024-09-12T17:30:55.214 INFO:teuthology.orchestra.run.smithi067.stderr: 63000K .......... .......... .......... .......... .......... 67% 305M 0s 2024-09-12T17:30:55.214 INFO:teuthology.orchestra.run.smithi067.stderr: 63050K .......... .......... .......... .......... .......... 67% 130M 0s 2024-09-12T17:30:55.214 INFO:teuthology.orchestra.run.smithi067.stderr: 63100K .......... .......... .......... .......... .......... 67% 334M 0s 2024-09-12T17:30:55.214 INFO:teuthology.orchestra.run.smithi067.stderr: 63150K .......... .......... .......... .......... .......... 68% 291M 0s 2024-09-12T17:30:55.214 INFO:teuthology.orchestra.run.smithi067.stderr: 63200K .......... .......... .......... .......... .......... 68% 282M 0s 2024-09-12T17:30:55.214 INFO:teuthology.orchestra.run.smithi067.stderr: 63250K .......... .......... .......... .......... .......... 68% 381M 0s 2024-09-12T17:30:55.214 INFO:teuthology.orchestra.run.smithi067.stderr: 63300K .......... .......... .......... .......... .......... 68% 159M 0s 2024-09-12T17:30:55.214 INFO:teuthology.orchestra.run.smithi067.stderr: 63350K .......... .......... .......... .......... .......... 68% 307M 0s 2024-09-12T17:30:55.214 INFO:teuthology.orchestra.run.smithi067.stderr: 63400K .......... .......... .......... .......... .......... 68% 309M 0s 2024-09-12T17:30:55.215 INFO:teuthology.orchestra.run.smithi067.stderr: 63450K .......... .......... .......... .......... .......... 68% 317M 0s 2024-09-12T17:30:55.215 INFO:teuthology.orchestra.run.smithi067.stderr: 63500K .......... .......... .......... .......... .......... 68% 346M 0s 2024-09-12T17:30:55.215 INFO:teuthology.orchestra.run.smithi067.stderr: 63550K .......... .......... .......... .......... .......... 68% 263M 0s 2024-09-12T17:30:55.215 INFO:teuthology.orchestra.run.smithi067.stderr: 63600K .......... .......... .......... .......... .......... 68% 165M 0s 2024-09-12T17:30:55.215 INFO:teuthology.orchestra.run.smithi067.stderr: 63650K .......... .......... .......... .......... .......... 68% 116M 0s 2024-09-12T17:30:55.215 INFO:teuthology.orchestra.run.smithi067.stderr: 63700K .......... .......... .......... .......... .......... 68% 320M 0s 2024-09-12T17:30:55.215 INFO:teuthology.orchestra.run.smithi067.stderr: 63750K .......... .......... .......... .......... .......... 68% 308M 0s 2024-09-12T17:30:55.215 INFO:teuthology.orchestra.run.smithi067.stderr: 63800K .......... .......... .......... .......... .......... 68% 313M 0s 2024-09-12T17:30:55.215 INFO:teuthology.orchestra.run.smithi067.stderr: 63850K .......... .......... .......... .......... .......... 68% 335M 0s 2024-09-12T17:30:55.215 INFO:teuthology.orchestra.run.smithi067.stderr: 63900K .......... .......... .......... .......... .......... 68% 320M 0s 2024-09-12T17:30:55.215 INFO:teuthology.orchestra.run.smithi067.stderr: 63950K .......... .......... .......... .......... .......... 68% 282M 0s 2024-09-12T17:30:55.215 INFO:teuthology.orchestra.run.smithi067.stderr: 64000K .......... .......... .......... .......... .......... 68% 286M 0s 2024-09-12T17:30:55.215 INFO:teuthology.orchestra.run.smithi067.stderr: 64050K .......... .......... .......... .......... .......... 68% 360M 0s 2024-09-12T17:30:55.215 INFO:teuthology.orchestra.run.smithi067.stderr: 64100K .......... .......... .......... .......... .......... 69% 338M 0s 2024-09-12T17:30:55.215 INFO:teuthology.orchestra.run.smithi067.stderr: 64150K .......... .......... .......... .......... .......... 69% 305M 0s 2024-09-12T17:30:55.216 INFO:teuthology.orchestra.run.smithi067.stderr: 64200K .......... .......... .......... .......... .......... 69% 326M 0s 2024-09-12T17:30:55.216 INFO:teuthology.orchestra.run.smithi067.stderr: 64250K .......... .......... .......... .......... .......... 69% 342M 0s 2024-09-12T17:30:55.216 INFO:teuthology.orchestra.run.smithi067.stderr: 64300K .......... .......... .......... .......... .......... 69% 317M 0s 2024-09-12T17:30:55.216 INFO:teuthology.orchestra.run.smithi067.stderr: 64350K .......... .......... .......... .......... .......... 69% 275M 0s 2024-09-12T17:30:55.216 INFO:teuthology.orchestra.run.smithi067.stderr: 64400K .......... .......... .......... .......... .......... 69% 312M 0s 2024-09-12T17:30:55.216 INFO:teuthology.orchestra.run.smithi067.stderr: 64450K .......... .......... .......... .......... .......... 69% 325M 0s 2024-09-12T17:30:55.216 INFO:teuthology.orchestra.run.smithi067.stderr: 64500K .......... .......... .......... .......... .......... 69% 321M 0s 2024-09-12T17:30:55.216 INFO:teuthology.orchestra.run.smithi067.stderr: 64550K .......... .......... .......... .......... .......... 69% 307M 0s 2024-09-12T17:30:55.216 INFO:teuthology.orchestra.run.smithi067.stderr: 64600K .......... .......... .......... .......... .......... 69% 323M 0s 2024-09-12T17:30:55.216 INFO:teuthology.orchestra.run.smithi067.stderr: 64650K .......... .......... .......... .......... .......... 69% 326M 0s 2024-09-12T17:30:55.216 INFO:teuthology.orchestra.run.smithi067.stderr: 64700K .......... .......... .......... .......... .......... 69% 315M 0s 2024-09-12T17:30:55.216 INFO:teuthology.orchestra.run.smithi067.stderr: 64750K .......... .......... .......... .......... .......... 69% 197M 0s 2024-09-12T17:30:55.216 INFO:teuthology.orchestra.run.smithi067.stderr: 64800K .......... .......... .......... .......... .......... 69% 338M 0s 2024-09-12T17:30:55.217 INFO:teuthology.orchestra.run.smithi067.stderr: 64850K .......... .......... .......... .......... .......... 69% 169M 0s 2024-09-12T17:30:55.217 INFO:teuthology.orchestra.run.smithi067.stderr: 64900K .......... .......... .......... .......... .......... 69% 319M 0s 2024-09-12T17:30:55.217 INFO:teuthology.orchestra.run.smithi067.stderr: 64950K .......... .......... .......... .......... .......... 69% 152M 0s 2024-09-12T17:30:55.217 INFO:teuthology.orchestra.run.smithi067.stderr: 65000K .......... .......... .......... .......... .......... 70% 347M 0s 2024-09-12T17:30:55.217 INFO:teuthology.orchestra.run.smithi067.stderr: 65050K .......... .......... .......... .......... .......... 70% 167M 0s 2024-09-12T17:30:55.217 INFO:teuthology.orchestra.run.smithi067.stderr: 65100K .......... .......... .......... .......... .......... 70% 337M 0s 2024-09-12T17:30:55.217 INFO:teuthology.orchestra.run.smithi067.stderr: 65150K .......... .......... .......... .......... .......... 70% 241M 0s 2024-09-12T17:30:55.217 INFO:teuthology.orchestra.run.smithi067.stderr: 65200K .......... .......... .......... .......... .......... 70% 337M 0s 2024-09-12T17:30:55.217 INFO:teuthology.orchestra.run.smithi067.stderr: 65250K .......... .......... .......... .......... .......... 70% 347M 0s 2024-09-12T17:30:55.217 INFO:teuthology.orchestra.run.smithi067.stderr: 65300K .......... .......... .......... .......... .......... 70% 325M 0s 2024-09-12T17:30:55.217 INFO:teuthology.orchestra.run.smithi067.stderr: 65350K .......... .......... .......... .......... .......... 70% 308M 0s 2024-09-12T17:30:55.217 INFO:teuthology.orchestra.run.smithi067.stderr: 65400K .......... .......... .......... .......... .......... 70% 341M 0s 2024-09-12T17:30:55.217 INFO:teuthology.orchestra.run.smithi067.stderr: 65450K .......... .......... .......... .......... .......... 70% 320M 0s 2024-09-12T17:30:55.218 INFO:teuthology.orchestra.run.smithi067.stderr: 65500K .......... .......... .......... .......... .......... 70% 217M 0s 2024-09-12T17:30:55.218 INFO:teuthology.orchestra.run.smithi067.stderr: 65550K .......... .......... .......... .......... .......... 70% 245M 0s 2024-09-12T17:30:55.218 INFO:teuthology.orchestra.run.smithi067.stderr: 65600K .......... .......... .......... .......... .......... 70% 302M 0s 2024-09-12T17:30:55.218 INFO:teuthology.orchestra.run.smithi067.stderr: 65650K .......... .......... .......... .......... .......... 70% 368M 0s 2024-09-12T17:30:55.218 INFO:teuthology.orchestra.run.smithi067.stderr: 65700K .......... .......... .......... .......... .......... 70% 296M 0s 2024-09-12T17:30:55.218 INFO:teuthology.orchestra.run.smithi067.stderr: 65750K .......... .......... .......... .......... .......... 70% 167M 0s 2024-09-12T17:30:55.218 INFO:teuthology.orchestra.run.smithi067.stderr: 65800K .......... .......... .......... .......... .......... 70% 330M 0s 2024-09-12T17:30:55.218 INFO:teuthology.orchestra.run.smithi067.stderr: 65850K .......... .......... .......... .......... .......... 70% 125M 0s 2024-09-12T17:30:55.218 INFO:teuthology.orchestra.run.smithi067.stderr: 65900K .......... .......... .......... .......... .......... 70% 129M 0s 2024-09-12T17:30:55.218 INFO:teuthology.orchestra.run.smithi067.stderr: 65950K .......... .......... .......... .......... .......... 71% 81.7M 0s 2024-09-12T17:30:55.218 INFO:teuthology.orchestra.run.smithi067.stderr: 66000K .......... .......... .......... .......... .......... 71% 355M 0s 2024-09-12T17:30:55.218 INFO:teuthology.orchestra.run.smithi067.stderr: 66050K .......... .......... .......... .......... .......... 71% 300M 0s 2024-09-12T17:30:55.218 INFO:teuthology.orchestra.run.smithi067.stderr: 66100K .......... .......... .......... .......... .......... 71% 324M 0s 2024-09-12T17:30:55.218 INFO:teuthology.orchestra.run.smithi067.stderr: 66150K .......... .......... .......... .......... .......... 71% 328M 0s 2024-09-12T17:30:55.219 INFO:teuthology.orchestra.run.smithi067.stderr: 66200K .......... .......... .......... .......... .......... 71% 160M 0s 2024-09-12T17:30:55.219 INFO:teuthology.orchestra.run.smithi067.stderr: 66250K .......... .......... .......... .......... .......... 71% 332M 0s 2024-09-12T17:30:55.219 INFO:teuthology.orchestra.run.smithi067.stderr: 66300K .......... .......... .......... .......... .......... 71% 365M 0s 2024-09-12T17:30:55.219 INFO:teuthology.orchestra.run.smithi067.stderr: 66350K .......... .......... .......... .......... .......... 71% 149M 0s 2024-09-12T17:30:55.219 INFO:teuthology.orchestra.run.smithi067.stderr: 66400K .......... .......... .......... .......... .......... 71% 289M 0s 2024-09-12T17:30:55.219 INFO:teuthology.orchestra.run.smithi067.stderr: 66450K .......... .......... .......... .......... .......... 71% 330M 0s 2024-09-12T17:30:55.219 INFO:teuthology.orchestra.run.smithi067.stderr: 66500K .......... .......... .......... .......... .......... 71% 177M 0s 2024-09-12T17:30:55.219 INFO:teuthology.orchestra.run.smithi067.stderr: 66550K .......... .......... .......... .......... .......... 71% 230M 0s 2024-09-12T17:30:55.219 INFO:teuthology.orchestra.run.smithi067.stderr: 66600K .......... .......... .......... .......... .......... 71% 96.6M 0s 2024-09-12T17:30:55.219 INFO:teuthology.orchestra.run.smithi067.stderr: 66650K .......... .......... .......... .......... .......... 71% 349M 0s 2024-09-12T17:30:55.219 INFO:teuthology.orchestra.run.smithi067.stderr: 66700K .......... .......... .......... .......... .......... 71% 130M 0s 2024-09-12T17:30:55.219 INFO:teuthology.orchestra.run.smithi067.stderr: 66750K .......... .......... .......... .......... .......... 71% 79.4M 0s 2024-09-12T17:30:55.219 INFO:teuthology.orchestra.run.smithi067.stderr: 66800K .......... .......... .......... .......... .......... 71% 338M 0s 2024-09-12T17:30:55.220 INFO:teuthology.orchestra.run.smithi067.stderr: 66850K .......... .......... .......... .......... .......... 72% 298M 0s 2024-09-12T17:30:55.220 INFO:teuthology.orchestra.run.smithi067.stderr: 66900K .......... .......... .......... .......... .......... 72% 332M 0s 2024-09-12T17:30:55.220 INFO:teuthology.orchestra.run.smithi067.stderr: 66950K .......... .......... .......... .......... .......... 72% 325M 0s 2024-09-12T17:30:55.220 INFO:teuthology.orchestra.run.smithi067.stderr: 67000K .......... .......... .......... .......... .......... 72% 329M 0s 2024-09-12T17:30:55.220 INFO:teuthology.orchestra.run.smithi067.stderr: 67050K .......... .......... .......... .......... .......... 72% 358M 0s 2024-09-12T17:30:55.220 INFO:teuthology.orchestra.run.smithi067.stderr: 67100K .......... .......... .......... .......... .......... 72% 345M 0s 2024-09-12T17:30:55.220 INFO:teuthology.orchestra.run.smithi067.stderr: 67150K .......... .......... .......... .......... .......... 72% 311M 0s 2024-09-12T17:30:55.220 INFO:teuthology.orchestra.run.smithi067.stderr: 67200K .......... .......... .......... .......... .......... 72% 345M 0s 2024-09-12T17:30:55.220 INFO:teuthology.orchestra.run.smithi067.stderr: 67250K .......... .......... .......... .......... .......... 72% 337M 0s 2024-09-12T17:30:55.220 INFO:teuthology.orchestra.run.smithi067.stderr: 67300K .......... .......... .......... .......... .......... 72% 351M 0s 2024-09-12T17:30:55.220 INFO:teuthology.orchestra.run.smithi067.stderr: 67350K .......... .......... .......... .......... .......... 72% 322M 0s 2024-09-12T17:30:55.220 INFO:teuthology.orchestra.run.smithi067.stderr: 67400K .......... .......... .......... .......... .......... 72% 319M 0s 2024-09-12T17:30:55.220 INFO:teuthology.orchestra.run.smithi067.stderr: 67450K .......... .......... .......... .......... .......... 72% 325M 0s 2024-09-12T17:30:55.221 INFO:teuthology.orchestra.run.smithi067.stderr: 67500K .......... .......... .......... .......... .......... 72% 337M 0s 2024-09-12T17:30:55.221 INFO:teuthology.orchestra.run.smithi067.stderr: 67550K .......... .......... .......... .......... .......... 72% 273M 0s 2024-09-12T17:30:55.221 INFO:teuthology.orchestra.run.smithi067.stderr: 67600K .......... .......... .......... .......... .......... 72% 345M 0s 2024-09-12T17:30:55.221 INFO:teuthology.orchestra.run.smithi067.stderr: 67650K .......... .......... .......... .......... .......... 72% 337M 0s 2024-09-12T17:30:55.221 INFO:teuthology.orchestra.run.smithi067.stderr: 67700K .......... .......... .......... .......... .......... 72% 333M 0s 2024-09-12T17:30:55.221 INFO:teuthology.orchestra.run.smithi067.stderr: 67750K .......... .......... .......... .......... .......... 72% 290M 0s 2024-09-12T17:30:55.221 INFO:teuthology.orchestra.run.smithi067.stderr: 67800K .......... .......... .......... .......... .......... 73% 363M 0s 2024-09-12T17:30:55.221 INFO:teuthology.orchestra.run.smithi067.stderr: 67850K .......... .......... .......... .......... .......... 73% 354M 0s 2024-09-12T17:30:55.221 INFO:teuthology.orchestra.run.smithi067.stderr: 67900K .......... .......... .......... .......... .......... 73% 344M 0s 2024-09-12T17:30:55.221 INFO:teuthology.orchestra.run.smithi067.stderr: 67950K .......... .......... .......... .......... .......... 73% 286M 0s 2024-09-12T17:30:55.221 INFO:teuthology.orchestra.run.smithi067.stderr: 68000K .......... .......... .......... .......... .......... 73% 363M 0s 2024-09-12T17:30:55.221 INFO:teuthology.orchestra.run.smithi067.stderr: 68050K .......... .......... .......... .......... .......... 73% 373M 0s 2024-09-12T17:30:55.221 INFO:teuthology.orchestra.run.smithi067.stderr: 68100K .......... .......... .......... .......... .......... 73% 292M 0s 2024-09-12T17:30:55.221 INFO:teuthology.orchestra.run.smithi067.stderr: 68150K .......... .......... .......... .......... .......... 73% 301M 0s 2024-09-12T17:30:55.222 INFO:teuthology.orchestra.run.smithi067.stderr: 68200K .......... .......... .......... .......... .......... 73% 329M 0s 2024-09-12T17:30:55.222 INFO:teuthology.orchestra.run.smithi067.stderr: 68250K .......... .......... .......... .......... .......... 73% 321M 0s 2024-09-12T17:30:55.222 INFO:teuthology.orchestra.run.smithi067.stderr: 68300K .......... .......... .......... .......... .......... 73% 298M 0s 2024-09-12T17:30:55.222 INFO:teuthology.orchestra.run.smithi067.stderr: 68350K .......... .......... .......... .......... .......... 73% 285M 0s 2024-09-12T17:30:55.222 INFO:teuthology.orchestra.run.smithi067.stderr: 68400K .......... .......... .......... .......... .......... 73% 343M 0s 2024-09-12T17:30:55.222 INFO:teuthology.orchestra.run.smithi067.stderr: 68450K .......... .......... .......... .......... .......... 73% 312M 0s 2024-09-12T17:30:55.222 INFO:teuthology.orchestra.run.smithi067.stderr: 68500K .......... .......... .......... .......... .......... 73% 222M 0s 2024-09-12T17:30:55.222 INFO:teuthology.orchestra.run.smithi067.stderr: 68550K .......... .......... .......... .......... .......... 73% 301M 0s 2024-09-12T17:30:55.222 INFO:teuthology.orchestra.run.smithi067.stderr: 68600K .......... .......... .......... .......... .......... 73% 315M 0s 2024-09-12T17:30:55.222 INFO:teuthology.orchestra.run.smithi067.stderr: 68650K .......... .......... .......... .......... .......... 73% 349M 0s 2024-09-12T17:30:55.222 INFO:teuthology.orchestra.run.smithi067.stderr: 68700K .......... .......... .......... .......... .......... 74% 342M 0s 2024-09-12T17:30:55.222 INFO:teuthology.orchestra.run.smithi067.stderr: 68750K .......... .......... .......... .......... .......... 74% 220M 0s 2024-09-12T17:30:55.222 INFO:teuthology.orchestra.run.smithi067.stderr: 68800K .......... .......... .......... .......... .......... 74% 332M 0s 2024-09-12T17:30:55.222 INFO:teuthology.orchestra.run.smithi067.stderr: 68850K .......... .......... .......... .......... .......... 74% 363M 0s 2024-09-12T17:30:55.223 INFO:teuthology.orchestra.run.smithi067.stderr: 68900K .......... .......... .......... .......... .......... 74% 316M 0s 2024-09-12T17:30:55.223 INFO:teuthology.orchestra.run.smithi067.stderr: 68950K .......... .......... .......... .......... .......... 74% 96.8M 0s 2024-09-12T17:30:55.223 INFO:teuthology.orchestra.run.smithi067.stderr: 69000K .......... .......... .......... .......... .......... 74% 94.1M 0s 2024-09-12T17:30:55.223 INFO:teuthology.orchestra.run.smithi067.stderr: 69050K .......... .......... .......... .......... .......... 74% 339M 0s 2024-09-12T17:30:55.223 INFO:teuthology.orchestra.run.smithi067.stderr: 69100K .......... .......... .......... .......... .......... 74% 324M 0s 2024-09-12T17:30:55.223 INFO:teuthology.orchestra.run.smithi067.stderr: 69150K .......... .......... .......... .......... .......... 74% 177M 0s 2024-09-12T17:30:55.223 INFO:teuthology.orchestra.run.smithi067.stderr: 69200K .......... .......... .......... .......... .......... 74% 263M 0s 2024-09-12T17:30:55.223 INFO:teuthology.orchestra.run.smithi067.stderr: 69250K .......... .......... .......... .......... .......... 74% 184M 0s 2024-09-12T17:30:55.223 INFO:teuthology.orchestra.run.smithi067.stderr: 69300K .......... .......... .......... .......... .......... 74% 332M 0s 2024-09-12T17:30:55.223 INFO:teuthology.orchestra.run.smithi067.stderr: 69350K .......... .......... .......... .......... .......... 74% 331M 0s 2024-09-12T17:30:55.223 INFO:teuthology.orchestra.run.smithi067.stderr: 69400K .......... .......... .......... .......... .......... 74% 253M 0s 2024-09-12T17:30:55.223 INFO:teuthology.orchestra.run.smithi067.stderr: 69450K .......... .......... .......... .......... .......... 74% 257M 0s 2024-09-12T17:30:55.223 INFO:teuthology.orchestra.run.smithi067.stderr: 69500K .......... .......... .......... .......... .......... 74% 346M 0s 2024-09-12T17:30:55.223 INFO:teuthology.orchestra.run.smithi067.stderr: 69550K .......... .......... .......... .......... .......... 74% 134M 0s 2024-09-12T17:30:55.224 INFO:teuthology.orchestra.run.smithi067.stderr: 69600K .......... .......... .......... .......... .......... 74% 296M 0s 2024-09-12T17:30:55.224 INFO:teuthology.orchestra.run.smithi067.stderr: 69650K .......... .......... .......... .......... .......... 75% 107M 0s 2024-09-12T17:30:55.224 INFO:teuthology.orchestra.run.smithi067.stderr: 69700K .......... .......... .......... .......... .......... 75% 320M 0s 2024-09-12T17:30:55.224 INFO:teuthology.orchestra.run.smithi067.stderr: 69750K .......... .......... .......... .......... .......... 75% 118M 0s 2024-09-12T17:30:55.224 INFO:teuthology.orchestra.run.smithi067.stderr: 69800K .......... .......... .......... .......... .......... 75% 349M 0s 2024-09-12T17:30:55.224 INFO:teuthology.orchestra.run.smithi067.stderr: 69850K .......... .......... .......... .......... .......... 75% 84.1M 0s 2024-09-12T17:30:55.224 INFO:teuthology.orchestra.run.smithi067.stderr: 69900K .......... .......... .......... .......... .......... 75% 130M 0s 2024-09-12T17:30:55.224 INFO:teuthology.orchestra.run.smithi067.stderr: 69950K .......... .......... .......... .......... .......... 75% 286M 0s 2024-09-12T17:30:55.224 INFO:teuthology.orchestra.run.smithi067.stderr: 70000K .......... .......... .......... .......... .......... 75% 300M 0s 2024-09-12T17:30:55.224 INFO:teuthology.orchestra.run.smithi067.stderr: 70050K .......... .......... .......... .......... .......... 75% 339M 0s 2024-09-12T17:30:55.224 INFO:teuthology.orchestra.run.smithi067.stderr: 70100K .......... .......... .......... .......... .......... 75% 173M 0s 2024-09-12T17:30:55.224 INFO:teuthology.orchestra.run.smithi067.stderr: 70150K .......... .......... .......... .......... .......... 75% 285M 0s 2024-09-12T17:30:55.224 INFO:teuthology.orchestra.run.smithi067.stderr: 70200K .......... .......... .......... .......... .......... 75% 333M 0s 2024-09-12T17:30:55.224 INFO:teuthology.orchestra.run.smithi067.stderr: 70250K .......... .......... .......... .......... .......... 75% 323M 0s 2024-09-12T17:30:55.225 INFO:teuthology.orchestra.run.smithi067.stderr: 70300K .......... .......... .......... .......... .......... 75% 342M 0s 2024-09-12T17:30:55.225 INFO:teuthology.orchestra.run.smithi067.stderr: 70350K .......... .......... .......... .......... .......... 75% 274M 0s 2024-09-12T17:30:55.225 INFO:teuthology.orchestra.run.smithi067.stderr: 70400K .......... .......... .......... .......... .......... 75% 352M 0s 2024-09-12T17:30:55.225 INFO:teuthology.orchestra.run.smithi067.stderr: 70450K .......... .......... .......... .......... .......... 75% 337M 0s 2024-09-12T17:30:55.225 INFO:teuthology.orchestra.run.smithi067.stderr: 70500K .......... .......... .......... .......... .......... 75% 314M 0s 2024-09-12T17:30:55.225 INFO:teuthology.orchestra.run.smithi067.stderr: 70550K .......... .......... .......... .......... .......... 75% 183M 0s 2024-09-12T17:30:55.225 INFO:teuthology.orchestra.run.smithi067.stderr: 70600K .......... .......... .......... .......... .......... 76% 347M 0s 2024-09-12T17:30:55.225 INFO:teuthology.orchestra.run.smithi067.stderr: 70650K .......... .......... .......... .......... .......... 76% 366M 0s 2024-09-12T17:30:55.225 INFO:teuthology.orchestra.run.smithi067.stderr: 70700K .......... .......... .......... .......... .......... 76% 340M 0s 2024-09-12T17:30:55.225 INFO:teuthology.orchestra.run.smithi067.stderr: 70750K .......... .......... .......... .......... .......... 76% 277M 0s 2024-09-12T17:30:55.225 INFO:teuthology.orchestra.run.smithi067.stderr: 70800K .......... .......... .......... .......... .......... 76% 341M 0s 2024-09-12T17:30:55.225 INFO:teuthology.orchestra.run.smithi067.stderr: 70850K .......... .......... .......... .......... .......... 76% 325M 0s 2024-09-12T17:30:55.225 INFO:teuthology.orchestra.run.smithi067.stderr: 70900K .......... .......... .......... .......... .......... 76% 318M 0s 2024-09-12T17:30:55.225 INFO:teuthology.orchestra.run.smithi067.stderr: 70950K .......... .......... .......... .......... .......... 76% 301M 0s 2024-09-12T17:30:55.226 INFO:teuthology.orchestra.run.smithi067.stderr: 71000K .......... .......... .......... .......... .......... 76% 327M 0s 2024-09-12T17:30:55.226 INFO:teuthology.orchestra.run.smithi067.stderr: 71050K .......... .......... .......... .......... .......... 76% 318M 0s 2024-09-12T17:30:55.226 INFO:teuthology.orchestra.run.smithi067.stderr: 71100K .......... .......... .......... .......... .......... 76% 355M 0s 2024-09-12T17:30:55.226 INFO:teuthology.orchestra.run.smithi067.stderr: 71150K .......... .......... .......... .......... .......... 76% 276M 0s 2024-09-12T17:30:55.226 INFO:teuthology.orchestra.run.smithi067.stderr: 71200K .......... .......... .......... .......... .......... 76% 335M 0s 2024-09-12T17:30:55.226 INFO:teuthology.orchestra.run.smithi067.stderr: 71250K .......... .......... .......... .......... .......... 76% 369M 0s 2024-09-12T17:30:55.226 INFO:teuthology.orchestra.run.smithi067.stderr: 71300K .......... .......... .......... .......... .......... 76% 328M 0s 2024-09-12T17:30:55.226 INFO:teuthology.orchestra.run.smithi067.stderr: 71350K .......... .......... .......... .......... .......... 76% 304M 0s 2024-09-12T17:30:55.226 INFO:teuthology.orchestra.run.smithi067.stderr: 71400K .......... .......... .......... .......... .......... 76% 347M 0s 2024-09-12T17:30:55.226 INFO:teuthology.orchestra.run.smithi067.stderr: 71450K .......... .......... .......... .......... .......... 76% 322M 0s 2024-09-12T17:30:55.226 INFO:teuthology.orchestra.run.smithi067.stderr: 71500K .......... .......... .......... .......... .......... 77% 311M 0s 2024-09-12T17:30:55.226 INFO:teuthology.orchestra.run.smithi067.stderr: 71550K .......... .......... .......... .......... .......... 77% 198M 0s 2024-09-12T17:30:55.226 INFO:teuthology.orchestra.run.smithi067.stderr: 71600K .......... .......... .......... .......... .......... 77% 271M 0s 2024-09-12T17:30:55.226 INFO:teuthology.orchestra.run.smithi067.stderr: 71650K .......... .......... .......... .......... .......... 77% 315M 0s 2024-09-12T17:30:55.227 INFO:teuthology.orchestra.run.smithi067.stderr: 71700K .......... .......... .......... .......... .......... 77% 346M 0s 2024-09-12T17:30:55.227 INFO:teuthology.orchestra.run.smithi067.stderr: 71750K .......... .......... .......... .......... .......... 77% 335M 0s 2024-09-12T17:30:55.227 INFO:teuthology.orchestra.run.smithi067.stderr: 71800K .......... .......... .......... .......... .......... 77% 334M 0s 2024-09-12T17:30:55.227 INFO:teuthology.orchestra.run.smithi067.stderr: 71850K .......... .......... .......... .......... .......... 77% 335M 0s 2024-09-12T17:30:55.227 INFO:teuthology.orchestra.run.smithi067.stderr: 71900K .......... .......... .......... .......... .......... 77% 286M 0s 2024-09-12T17:30:55.227 INFO:teuthology.orchestra.run.smithi067.stderr: 71950K .......... .......... .......... .......... .......... 77% 310M 0s 2024-09-12T17:30:55.227 INFO:teuthology.orchestra.run.smithi067.stderr: 72000K .......... .......... .......... .......... .......... 77% 339M 0s 2024-09-12T17:30:55.227 INFO:teuthology.orchestra.run.smithi067.stderr: 72050K .......... .......... .......... .......... .......... 77% 137M 0s 2024-09-12T17:30:55.227 INFO:teuthology.orchestra.run.smithi067.stderr: 72100K .......... .......... .......... .......... .......... 77% 283M 0s 2024-09-12T17:30:55.227 INFO:teuthology.orchestra.run.smithi067.stderr: 72150K .......... .......... .......... .......... .......... 77% 268M 0s 2024-09-12T17:30:55.227 INFO:teuthology.orchestra.run.smithi067.stderr: 72200K .......... .......... .......... .......... .......... 77% 229M 0s 2024-09-12T17:30:55.227 INFO:teuthology.orchestra.run.smithi067.stderr: 72250K .......... .......... .......... .......... .......... 77% 321M 0s 2024-09-12T17:30:55.227 INFO:teuthology.orchestra.run.smithi067.stderr: 72300K .......... .......... .......... .......... .......... 77% 124M 0s 2024-09-12T17:30:55.227 INFO:teuthology.orchestra.run.smithi067.stderr: 72350K .......... .......... .......... .......... .......... 77% 237M 0s 2024-09-12T17:30:55.228 INFO:teuthology.orchestra.run.smithi067.stderr: 72400K .......... .......... .......... .......... .......... 77% 352M 0s 2024-09-12T17:30:55.228 INFO:teuthology.orchestra.run.smithi067.stderr: 72450K .......... .......... .......... .......... .......... 78% 328M 0s 2024-09-12T17:30:55.228 INFO:teuthology.orchestra.run.smithi067.stderr: 72500K .......... .......... .......... .......... .......... 78% 294M 0s 2024-09-12T17:30:55.228 INFO:teuthology.orchestra.run.smithi067.stderr: 72550K .......... .......... .......... .......... .......... 78% 328M 0s 2024-09-12T17:30:55.228 INFO:teuthology.orchestra.run.smithi067.stderr: 72600K .......... .......... .......... .......... .......... 78% 297M 0s 2024-09-12T17:30:55.228 INFO:teuthology.orchestra.run.smithi067.stderr: 72650K .......... .......... .......... .......... .......... 78% 337M 0s 2024-09-12T17:30:55.228 INFO:teuthology.orchestra.run.smithi067.stderr: 72700K .......... .......... .......... .......... .......... 78% 98.3M 0s 2024-09-12T17:30:55.228 INFO:teuthology.orchestra.run.smithi067.stderr: 72750K .......... .......... .......... .......... .......... 78% 129M 0s 2024-09-12T17:30:55.228 INFO:teuthology.orchestra.run.smithi067.stderr: 72800K .......... .......... .......... .......... .......... 78% 126M 0s 2024-09-12T17:30:55.228 INFO:teuthology.orchestra.run.smithi067.stderr: 72850K .......... .......... .......... .......... .......... 78% 298M 0s 2024-09-12T17:30:55.228 INFO:teuthology.orchestra.run.smithi067.stderr: 72900K .......... .......... .......... .......... .......... 78% 98.2M 0s 2024-09-12T17:30:55.228 INFO:teuthology.orchestra.run.smithi067.stderr: 72950K .......... .......... .......... .......... .......... 78% 144M 0s 2024-09-12T17:30:55.228 INFO:teuthology.orchestra.run.smithi067.stderr: 73000K .......... .......... .......... .......... .......... 78% 110M 0s 2024-09-12T17:30:55.229 INFO:teuthology.orchestra.run.smithi067.stderr: 73050K .......... .......... .......... .......... .......... 78% 298M 0s 2024-09-12T17:30:55.229 INFO:teuthology.orchestra.run.smithi067.stderr: 73100K .......... .......... .......... .......... .......... 78% 284M 0s 2024-09-12T17:30:55.229 INFO:teuthology.orchestra.run.smithi067.stderr: 73150K .......... .......... .......... .......... .......... 78% 364M 0s 2024-09-12T17:30:55.229 INFO:teuthology.orchestra.run.smithi067.stderr: 73200K .......... .......... .......... .......... .......... 78% 278M 0s 2024-09-12T17:30:55.229 INFO:teuthology.orchestra.run.smithi067.stderr: 73250K .......... .......... .......... .......... .......... 78% 336M 0s 2024-09-12T17:30:55.229 INFO:teuthology.orchestra.run.smithi067.stderr: 73300K .......... .......... .......... .......... .......... 78% 303M 0s 2024-09-12T17:30:55.229 INFO:teuthology.orchestra.run.smithi067.stderr: 73350K .......... .......... .......... .......... .......... 79% 348M 0s 2024-09-12T17:30:55.229 INFO:teuthology.orchestra.run.smithi067.stderr: 73400K .......... .......... .......... .......... .......... 79% 258M 0s 2024-09-12T17:30:55.229 INFO:teuthology.orchestra.run.smithi067.stderr: 73450K .......... .......... .......... .......... .......... 79% 319M 0s 2024-09-12T17:30:55.229 INFO:teuthology.orchestra.run.smithi067.stderr: 73500K .......... .......... .......... .......... .......... 79% 280M 0s 2024-09-12T17:30:55.229 INFO:teuthology.orchestra.run.smithi067.stderr: 73550K .......... .......... .......... .......... .......... 79% 325M 0s 2024-09-12T17:30:55.229 INFO:teuthology.orchestra.run.smithi067.stderr: 73600K .......... .......... .......... .......... .......... 79% 345M 0s 2024-09-12T17:30:55.229 INFO:teuthology.orchestra.run.smithi067.stderr: 73650K .......... .......... .......... .......... .......... 79% 326M 0s 2024-09-12T17:30:55.229 INFO:teuthology.orchestra.run.smithi067.stderr: 73700K .......... .......... .......... .......... .......... 79% 270M 0s 2024-09-12T17:30:55.230 INFO:teuthology.orchestra.run.smithi067.stderr: 73750K .......... .......... .......... .......... .......... 79% 345M 0s 2024-09-12T17:30:55.230 INFO:teuthology.orchestra.run.smithi067.stderr: 73800K .......... .......... .......... .......... .......... 79% 190M 0s 2024-09-12T17:30:55.230 INFO:teuthology.orchestra.run.smithi067.stderr: 73850K .......... .......... .......... .......... .......... 79% 312M 0s 2024-09-12T17:30:55.230 INFO:teuthology.orchestra.run.smithi067.stderr: 73900K .......... .......... .......... .......... .......... 79% 323M 0s 2024-09-12T17:30:55.230 INFO:teuthology.orchestra.run.smithi067.stderr: 73950K .......... .......... .......... .......... .......... 79% 317M 0s 2024-09-12T17:30:55.230 INFO:teuthology.orchestra.run.smithi067.stderr: 74000K .......... .......... .......... .......... .......... 79% 314M 0s 2024-09-12T17:30:55.230 INFO:teuthology.orchestra.run.smithi067.stderr: 74050K .......... .......... .......... .......... .......... 79% 364M 0s 2024-09-12T17:30:55.230 INFO:teuthology.orchestra.run.smithi067.stderr: 74100K .......... .......... .......... .......... .......... 79% 314M 0s 2024-09-12T17:30:55.230 INFO:teuthology.orchestra.run.smithi067.stderr: 74150K .......... .......... .......... .......... .......... 79% 353M 0s 2024-09-12T17:30:55.230 INFO:teuthology.orchestra.run.smithi067.stderr: 74200K .......... .......... .......... .......... .......... 79% 348M 0s 2024-09-12T17:30:55.230 INFO:teuthology.orchestra.run.smithi067.stderr: 74250K .......... .......... .......... .......... .......... 79% 327M 0s 2024-09-12T17:30:55.230 INFO:teuthology.orchestra.run.smithi067.stderr: 74300K .......... .......... .......... .......... .......... 80% 254M 0s 2024-09-12T17:30:55.230 INFO:teuthology.orchestra.run.smithi067.stderr: 74350K .......... .......... .......... .......... .......... 80% 320M 0s 2024-09-12T17:30:55.230 INFO:teuthology.orchestra.run.smithi067.stderr: 74400K .......... .......... .......... .......... .......... 80% 326M 0s 2024-09-12T17:30:55.231 INFO:teuthology.orchestra.run.smithi067.stderr: 74450K .......... .......... .......... .......... .......... 80% 326M 0s 2024-09-12T17:30:55.231 INFO:teuthology.orchestra.run.smithi067.stderr: 74500K .......... .......... .......... .......... .......... 80% 121M 0s 2024-09-12T17:30:55.231 INFO:teuthology.orchestra.run.smithi067.stderr: 74550K .......... .......... .......... .......... .......... 80% 303M 0s 2024-09-12T17:30:55.231 INFO:teuthology.orchestra.run.smithi067.stderr: 74600K .......... .......... .......... .......... .......... 80% 316M 0s 2024-09-12T17:30:55.231 INFO:teuthology.orchestra.run.smithi067.stderr: 74650K .......... .......... .......... .......... .......... 80% 323M 0s 2024-09-12T17:30:55.231 INFO:teuthology.orchestra.run.smithi067.stderr: 74700K .......... .......... .......... .......... .......... 80% 263M 0s 2024-09-12T17:30:55.231 INFO:teuthology.orchestra.run.smithi067.stderr: 74750K .......... .......... .......... .......... .......... 80% 328M 0s 2024-09-12T17:30:55.231 INFO:teuthology.orchestra.run.smithi067.stderr: 74800K .......... .......... .......... .......... .......... 80% 312M 0s 2024-09-12T17:30:55.231 INFO:teuthology.orchestra.run.smithi067.stderr: 74850K .......... .......... .......... .......... .......... 80% 350M 0s 2024-09-12T17:30:55.231 INFO:teuthology.orchestra.run.smithi067.stderr: 74900K .......... .......... .......... .......... .......... 80% 317M 0s 2024-09-12T17:30:55.231 INFO:teuthology.orchestra.run.smithi067.stderr: 74950K .......... .......... .......... .......... .......... 80% 307M 0s 2024-09-12T17:30:55.231 INFO:teuthology.orchestra.run.smithi067.stderr: 75000K .......... .......... .......... .......... .......... 80% 349M 0s 2024-09-12T17:30:55.231 INFO:teuthology.orchestra.run.smithi067.stderr: 75050K .......... .......... .......... .......... .......... 80% 386M 0s 2024-09-12T17:30:55.231 INFO:teuthology.orchestra.run.smithi067.stderr: 75100K .......... .......... .......... .......... .......... 80% 284M 0s 2024-09-12T17:30:55.231 INFO:teuthology.orchestra.run.smithi067.stderr: 75150K .......... .......... .......... .......... .......... 80% 321M 0s 2024-09-12T17:30:55.232 INFO:teuthology.orchestra.run.smithi067.stderr: 75200K .......... .......... .......... .......... .......... 81% 340M 0s 2024-09-12T17:30:55.232 INFO:teuthology.orchestra.run.smithi067.stderr: 75250K .......... .......... .......... .......... .......... 81% 358M 0s 2024-09-12T17:30:55.232 INFO:teuthology.orchestra.run.smithi067.stderr: 75300K .......... .......... .......... .......... .......... 81% 316M 0s 2024-09-12T17:30:55.232 INFO:teuthology.orchestra.run.smithi067.stderr: 75350K .......... .......... .......... .......... .......... 81% 168M 0s 2024-09-12T17:30:55.232 INFO:teuthology.orchestra.run.smithi067.stderr: 75400K .......... .......... .......... .......... .......... 81% 261M 0s 2024-09-12T17:30:55.232 INFO:teuthology.orchestra.run.smithi067.stderr: 75450K .......... .......... .......... .......... .......... 81% 162M 0s 2024-09-12T17:30:55.232 INFO:teuthology.orchestra.run.smithi067.stderr: 75500K .......... .......... .......... .......... .......... 81% 178M 0s 2024-09-12T17:30:55.232 INFO:teuthology.orchestra.run.smithi067.stderr: 75550K .......... .......... .......... .......... .......... 81% 282M 0s 2024-09-12T17:30:55.232 INFO:teuthology.orchestra.run.smithi067.stderr: 75600K .......... .......... .......... .......... .......... 81% 238M 0s 2024-09-12T17:30:55.232 INFO:teuthology.orchestra.run.smithi067.stderr: 75650K .......... .......... .......... .......... .......... 81% 380M 0s 2024-09-12T17:30:55.232 INFO:teuthology.orchestra.run.smithi067.stderr: 75700K .......... .......... .......... .......... .......... 81% 286M 0s 2024-09-12T17:30:55.232 INFO:teuthology.orchestra.run.smithi067.stderr: 75750K .......... .......... .......... .......... .......... 81% 303M 0s 2024-09-12T17:30:55.232 INFO:teuthology.orchestra.run.smithi067.stderr: 75800K .......... .......... .......... .......... .......... 81% 118M 0s 2024-09-12T17:30:55.233 INFO:teuthology.orchestra.run.smithi067.stderr: 75850K .......... .......... .......... .......... .......... 81% 336M 0s 2024-09-12T17:30:55.233 INFO:teuthology.orchestra.run.smithi067.stderr: 75900K .......... .......... .......... .......... .......... 81% 121M 0s 2024-09-12T17:30:55.233 INFO:teuthology.orchestra.run.smithi067.stderr: 75950K .......... .......... .......... .......... .......... 81% 77.2M 0s 2024-09-12T17:30:55.233 INFO:teuthology.orchestra.run.smithi067.stderr: 76000K .......... .......... .......... .......... .......... 81% 270M 0s 2024-09-12T17:30:55.233 INFO:teuthology.orchestra.run.smithi067.stderr: 76050K .......... .......... .......... .......... .......... 81% 72.2M 0s 2024-09-12T17:30:55.233 INFO:teuthology.orchestra.run.smithi067.stderr: 76100K .......... .......... .......... .......... .......... 81% 288M 0s 2024-09-12T17:30:55.233 INFO:teuthology.orchestra.run.smithi067.stderr: 76150K .......... .......... .......... .......... .......... 82% 253M 0s 2024-09-12T17:30:55.233 INFO:teuthology.orchestra.run.smithi067.stderr: 76200K .......... .......... .......... .......... .......... 82% 297M 0s 2024-09-12T17:30:55.233 INFO:teuthology.orchestra.run.smithi067.stderr: 76250K .......... .......... .......... .......... .......... 82% 334M 0s 2024-09-12T17:30:55.233 INFO:teuthology.orchestra.run.smithi067.stderr: 76300K .......... .......... .......... .......... .......... 82% 273M 0s 2024-09-12T17:30:55.233 INFO:teuthology.orchestra.run.smithi067.stderr: 76350K .......... .......... .......... .......... .......... 82% 344M 0s 2024-09-12T17:30:55.233 INFO:teuthology.orchestra.run.smithi067.stderr: 76400K .......... .......... .......... .......... .......... 82% 353M 0s 2024-09-12T17:30:55.233 INFO:teuthology.orchestra.run.smithi067.stderr: 76450K .......... .......... .......... .......... .......... 82% 380M 0s 2024-09-12T17:30:55.233 INFO:teuthology.orchestra.run.smithi067.stderr: 76500K .......... .......... .......... .......... .......... 82% 321M 0s 2024-09-12T17:30:55.234 INFO:teuthology.orchestra.run.smithi067.stderr: 76550K .......... .......... .......... .......... .......... 82% 358M 0s 2024-09-12T17:30:55.234 INFO:teuthology.orchestra.run.smithi067.stderr: 76600K .......... .......... .......... .......... .......... 82% 188M 0s 2024-09-12T17:30:55.234 INFO:teuthology.orchestra.run.smithi067.stderr: 76650K .......... .......... .......... .......... .......... 82% 278M 0s 2024-09-12T17:30:55.234 INFO:teuthology.orchestra.run.smithi067.stderr: 76700K .......... .......... .......... .......... .......... 82% 275M 0s 2024-09-12T17:30:55.234 INFO:teuthology.orchestra.run.smithi067.stderr: 76750K .......... .......... .......... .......... .......... 82% 347M 0s 2024-09-12T17:30:55.234 INFO:teuthology.orchestra.run.smithi067.stderr: 76800K .......... .......... .......... .......... .......... 82% 309M 0s 2024-09-12T17:30:55.234 INFO:teuthology.orchestra.run.smithi067.stderr: 76850K .......... .......... .......... .......... .......... 82% 321M 0s 2024-09-12T17:30:55.234 INFO:teuthology.orchestra.run.smithi067.stderr: 76900K .......... .......... .......... .......... .......... 82% 285M 0s 2024-09-12T17:30:55.234 INFO:teuthology.orchestra.run.smithi067.stderr: 76950K .......... .......... .......... .......... .......... 82% 324M 0s 2024-09-12T17:30:55.234 INFO:teuthology.orchestra.run.smithi067.stderr: 77000K .......... .......... .......... .......... .......... 82% 339M 0s 2024-09-12T17:30:55.234 INFO:teuthology.orchestra.run.smithi067.stderr: 77050K .......... .......... .......... .......... .......... 82% 337M 0s 2024-09-12T17:30:55.234 INFO:teuthology.orchestra.run.smithi067.stderr: 77100K .......... .......... .......... .......... .......... 83% 258M 0s 2024-09-12T17:30:55.234 INFO:teuthology.orchestra.run.smithi067.stderr: 77150K .......... .......... .......... .......... .......... 83% 346M 0s 2024-09-12T17:30:55.234 INFO:teuthology.orchestra.run.smithi067.stderr: 77200K .......... .......... .......... .......... .......... 83% 324M 0s 2024-09-12T17:30:55.235 INFO:teuthology.orchestra.run.smithi067.stderr: 77250K .......... .......... .......... .......... .......... 83% 335M 0s 2024-09-12T17:30:55.235 INFO:teuthology.orchestra.run.smithi067.stderr: 77300K .......... .......... .......... .......... .......... 83% 303M 0s 2024-09-12T17:30:55.235 INFO:teuthology.orchestra.run.smithi067.stderr: 77350K .......... .......... .......... .......... .......... 83% 318M 0s 2024-09-12T17:30:55.235 INFO:teuthology.orchestra.run.smithi067.stderr: 77400K .......... .......... .......... .......... .......... 83% 359M 0s 2024-09-12T17:30:55.235 INFO:teuthology.orchestra.run.smithi067.stderr: 77450K .......... .......... .......... .......... .......... 83% 154M 0s 2024-09-12T17:30:55.235 INFO:teuthology.orchestra.run.smithi067.stderr: 77500K .......... .......... .......... .......... .......... 83% 270M 0s 2024-09-12T17:30:55.235 INFO:teuthology.orchestra.run.smithi067.stderr: 77550K .......... .......... .......... .......... .......... 83% 334M 0s 2024-09-12T17:30:55.235 INFO:teuthology.orchestra.run.smithi067.stderr: 77600K .......... .......... .......... .......... .......... 83% 289M 0s 2024-09-12T17:30:55.235 INFO:teuthology.orchestra.run.smithi067.stderr: 77650K .......... .......... .......... .......... .......... 83% 327M 0s 2024-09-12T17:30:55.235 INFO:teuthology.orchestra.run.smithi067.stderr: 77700K .......... .......... .......... .......... .......... 83% 281M 0s 2024-09-12T17:30:55.235 INFO:teuthology.orchestra.run.smithi067.stderr: 77750K .......... .......... .......... .......... .......... 83% 287M 0s 2024-09-12T17:30:55.235 INFO:teuthology.orchestra.run.smithi067.stderr: 77800K .......... .......... .......... .......... .......... 83% 313M 0s 2024-09-12T17:30:55.235 INFO:teuthology.orchestra.run.smithi067.stderr: 77850K .......... .......... .......... .......... .......... 83% 356M 0s 2024-09-12T17:30:55.236 INFO:teuthology.orchestra.run.smithi067.stderr: 77900K .......... .......... .......... .......... .......... 83% 268M 0s 2024-09-12T17:30:55.236 INFO:teuthology.orchestra.run.smithi067.stderr: 77950K .......... .......... .......... .......... .......... 83% 287M 0s 2024-09-12T17:30:55.236 INFO:teuthology.orchestra.run.smithi067.stderr: 78000K .......... .......... .......... .......... .......... 84% 321M 0s 2024-09-12T17:30:55.236 INFO:teuthology.orchestra.run.smithi067.stderr: 78050K .......... .......... .......... .......... .......... 84% 325M 0s 2024-09-12T17:30:55.236 INFO:teuthology.orchestra.run.smithi067.stderr: 78100K .......... .......... .......... .......... .......... 84% 292M 0s 2024-09-12T17:30:55.236 INFO:teuthology.orchestra.run.smithi067.stderr: 78150K .......... .......... .......... .......... .......... 84% 359M 0s 2024-09-12T17:30:55.236 INFO:teuthology.orchestra.run.smithi067.stderr: 78200K .......... .......... .......... .......... .......... 84% 301M 0s 2024-09-12T17:30:55.236 INFO:teuthology.orchestra.run.smithi067.stderr: 78250K .......... .......... .......... .......... .......... 84% 339M 0s 2024-09-12T17:30:55.236 INFO:teuthology.orchestra.run.smithi067.stderr: 78300K .......... .......... .......... .......... .......... 84% 248M 0s 2024-09-12T17:30:55.236 INFO:teuthology.orchestra.run.smithi067.stderr: 78350K .......... .......... .......... .......... .......... 84% 310M 0s 2024-09-12T17:30:55.236 INFO:teuthology.orchestra.run.smithi067.stderr: 78400K .......... .......... .......... .......... .......... 84% 339M 0s 2024-09-12T17:30:55.236 INFO:teuthology.orchestra.run.smithi067.stderr: 78450K .......... .......... .......... .......... .......... 84% 336M 0s 2024-09-12T17:30:55.236 INFO:teuthology.orchestra.run.smithi067.stderr: 78500K .......... .......... .......... .......... .......... 84% 268M 0s 2024-09-12T17:30:55.236 INFO:teuthology.orchestra.run.smithi067.stderr: 78550K .......... .......... .......... .......... .......... 84% 319M 0s 2024-09-12T17:30:55.237 INFO:teuthology.orchestra.run.smithi067.stderr: 78600K .......... .......... .......... .......... .......... 84% 132M 0s 2024-09-12T17:30:55.237 INFO:teuthology.orchestra.run.smithi067.stderr: 78650K .......... .......... .......... .......... .......... 84% 310M 0s 2024-09-12T17:30:55.237 INFO:teuthology.orchestra.run.smithi067.stderr: 78700K .......... .......... .......... .......... .......... 84% 180M 0s 2024-09-12T17:30:55.237 INFO:teuthology.orchestra.run.smithi067.stderr: 78750K .......... .......... .......... .......... .......... 84% 337M 0s 2024-09-12T17:30:55.237 INFO:teuthology.orchestra.run.smithi067.stderr: 78800K .......... .......... .......... .......... .......... 84% 330M 0s 2024-09-12T17:30:55.237 INFO:teuthology.orchestra.run.smithi067.stderr: 78850K .......... .......... .......... .......... .......... 84% 231M 0s 2024-09-12T17:30:55.237 INFO:teuthology.orchestra.run.smithi067.stderr: 78900K .......... .......... .......... .......... .......... 84% 191M 0s 2024-09-12T17:30:55.237 INFO:teuthology.orchestra.run.smithi067.stderr: 78950K .......... .......... .......... .......... .......... 85% 166M 0s 2024-09-12T17:30:55.237 INFO:teuthology.orchestra.run.smithi067.stderr: 79000K .......... .......... .......... .......... .......... 85% 78.1M 0s 2024-09-12T17:30:55.237 INFO:teuthology.orchestra.run.smithi067.stderr: 79050K .......... .......... .......... .......... .......... 85% 173M 0s 2024-09-12T17:30:55.237 INFO:teuthology.orchestra.run.smithi067.stderr: 79100K .......... .......... .......... .......... .......... 85% 81.8M 0s 2024-09-12T17:30:55.237 INFO:teuthology.orchestra.run.smithi067.stderr: 79150K .......... .......... .......... .......... .......... 85% 317M 0s 2024-09-12T17:30:55.237 INFO:teuthology.orchestra.run.smithi067.stderr: 79200K .......... .......... .......... .......... .......... 85% 160M 0s 2024-09-12T17:30:55.237 INFO:teuthology.orchestra.run.smithi067.stderr: 79250K .......... .......... .......... .......... .......... 85% 334M 0s 2024-09-12T17:30:55.238 INFO:teuthology.orchestra.run.smithi067.stderr: 79300K .......... .......... .......... .......... .......... 85% 261M 0s 2024-09-12T17:30:55.238 INFO:teuthology.orchestra.run.smithi067.stderr: 79350K .......... .......... .......... .......... .......... 85% 317M 0s 2024-09-12T17:30:55.238 INFO:teuthology.orchestra.run.smithi067.stderr: 79400K .......... .......... .......... .......... .......... 85% 304M 0s 2024-09-12T17:30:55.238 INFO:teuthology.orchestra.run.smithi067.stderr: 79450K .......... .......... .......... .......... .......... 85% 339M 0s 2024-09-12T17:30:55.238 INFO:teuthology.orchestra.run.smithi067.stderr: 79500K .......... .......... .......... .......... .......... 85% 279M 0s 2024-09-12T17:30:55.238 INFO:teuthology.orchestra.run.smithi067.stderr: 79550K .......... .......... .......... .......... .......... 85% 158M 0s 2024-09-12T17:30:55.238 INFO:teuthology.orchestra.run.smithi067.stderr: 79600K .......... .......... .......... .......... .......... 85% 296M 0s 2024-09-12T17:30:55.238 INFO:teuthology.orchestra.run.smithi067.stderr: 79650K .......... .......... .......... .......... .......... 85% 287M 0s 2024-09-12T17:30:55.238 INFO:teuthology.orchestra.run.smithi067.stderr: 79700K .......... .......... .......... .......... .......... 85% 300M 0s 2024-09-12T17:30:55.238 INFO:teuthology.orchestra.run.smithi067.stderr: 79750K .......... .......... .......... .......... .......... 85% 350M 0s 2024-09-12T17:30:55.238 INFO:teuthology.orchestra.run.smithi067.stderr: 79800K .......... .......... .......... .......... .......... 85% 361M 0s 2024-09-12T17:30:55.238 INFO:teuthology.orchestra.run.smithi067.stderr: 79850K .......... .......... .......... .......... .......... 86% 329M 0s 2024-09-12T17:30:55.238 INFO:teuthology.orchestra.run.smithi067.stderr: 79900K .......... .......... .......... .......... .......... 86% 294M 0s 2024-09-12T17:30:55.238 INFO:teuthology.orchestra.run.smithi067.stderr: 79950K .......... .......... .......... .......... .......... 86% 314M 0s 2024-09-12T17:30:55.239 INFO:teuthology.orchestra.run.smithi067.stderr: 80000K .......... .......... .......... .......... .......... 86% 340M 0s 2024-09-12T17:30:55.239 INFO:teuthology.orchestra.run.smithi067.stderr: 80050K .......... .......... .......... .......... .......... 86% 338M 0s 2024-09-12T17:30:55.239 INFO:teuthology.orchestra.run.smithi067.stderr: 80100K .......... .......... .......... .......... .......... 86% 297M 0s 2024-09-12T17:30:55.239 INFO:teuthology.orchestra.run.smithi067.stderr: 80150K .......... .......... .......... .......... .......... 86% 189M 0s 2024-09-12T17:30:55.239 INFO:teuthology.orchestra.run.smithi067.stderr: 80200K .......... .......... .......... .......... .......... 86% 255M 0s 2024-09-12T17:30:55.239 INFO:teuthology.orchestra.run.smithi067.stderr: 80250K .......... .......... .......... .......... .......... 86% 285M 0s 2024-09-12T17:30:55.239 INFO:teuthology.orchestra.run.smithi067.stderr: 80300K .......... .......... .......... .......... .......... 86% 270M 0s 2024-09-12T17:30:55.239 INFO:teuthology.orchestra.run.smithi067.stderr: 80350K .......... .......... .......... .......... .......... 86% 342M 0s 2024-09-12T17:30:55.239 INFO:teuthology.orchestra.run.smithi067.stderr: 80400K .......... .......... .......... .......... .......... 86% 360M 0s 2024-09-12T17:30:55.239 INFO:teuthology.orchestra.run.smithi067.stderr: 80450K .......... .......... .......... .......... .......... 86% 253M 0s 2024-09-12T17:30:55.239 INFO:teuthology.orchestra.run.smithi067.stderr: 80500K .......... .......... .......... .......... .......... 86% 275M 0s 2024-09-12T17:30:55.239 INFO:teuthology.orchestra.run.smithi067.stderr: 80550K .......... .......... .......... .......... .......... 86% 342M 0s 2024-09-12T17:30:55.239 INFO:teuthology.orchestra.run.smithi067.stderr: 80600K .......... .......... .......... .......... .......... 86% 352M 0s 2024-09-12T17:30:55.239 INFO:teuthology.orchestra.run.smithi067.stderr: 80650K .......... .......... .......... .......... .......... 86% 294M 0s 2024-09-12T17:30:55.240 INFO:teuthology.orchestra.run.smithi067.stderr: 80700K .......... .......... .......... .......... .......... 86% 289M 0s 2024-09-12T17:30:55.240 INFO:teuthology.orchestra.run.smithi067.stderr: 80750K .......... .......... .......... .......... .......... 86% 367M 0s 2024-09-12T17:30:55.240 INFO:teuthology.orchestra.run.smithi067.stderr: 80800K .......... .......... .......... .......... .......... 87% 308M 0s 2024-09-12T17:30:55.240 INFO:teuthology.orchestra.run.smithi067.stderr: 80850K .......... .......... .......... .......... .......... 87% 298M 0s 2024-09-12T17:30:55.240 INFO:teuthology.orchestra.run.smithi067.stderr: 80900K .......... .......... .......... .......... .......... 87% 301M 0s 2024-09-12T17:30:55.240 INFO:teuthology.orchestra.run.smithi067.stderr: 80950K .......... .......... .......... .......... .......... 87% 325M 0s 2024-09-12T17:30:55.240 INFO:teuthology.orchestra.run.smithi067.stderr: 81000K .......... .......... .......... .......... .......... 87% 327M 0s 2024-09-12T17:30:55.240 INFO:teuthology.orchestra.run.smithi067.stderr: 81050K .......... .......... .......... .......... .......... 87% 314M 0s 2024-09-12T17:30:55.240 INFO:teuthology.orchestra.run.smithi067.stderr: 81100K .......... .......... .......... .......... .......... 87% 283M 0s 2024-09-12T17:30:55.240 INFO:teuthology.orchestra.run.smithi067.stderr: 81150K .......... .......... .......... .......... .......... 87% 337M 0s 2024-09-12T17:30:55.240 INFO:teuthology.orchestra.run.smithi067.stderr: 81200K .......... .......... .......... .......... .......... 87% 200M 0s 2024-09-12T17:30:55.240 INFO:teuthology.orchestra.run.smithi067.stderr: 81250K .......... .......... .......... .......... .......... 87% 324M 0s 2024-09-12T17:30:55.240 INFO:teuthology.orchestra.run.smithi067.stderr: 81300K .......... .......... .......... .......... .......... 87% 299M 0s 2024-09-12T17:30:55.241 INFO:teuthology.orchestra.run.smithi067.stderr: 81350K .......... .......... .......... .......... .......... 87% 321M 0s 2024-09-12T17:30:55.241 INFO:teuthology.orchestra.run.smithi067.stderr: 81400K .......... .......... .......... .......... .......... 87% 326M 0s 2024-09-12T17:30:55.241 INFO:teuthology.orchestra.run.smithi067.stderr: 81450K .......... .......... .......... .......... .......... 87% 310M 0s 2024-09-12T17:30:55.241 INFO:teuthology.orchestra.run.smithi067.stderr: 81500K .......... .......... .......... .......... .......... 87% 282M 0s 2024-09-12T17:30:55.241 INFO:teuthology.orchestra.run.smithi067.stderr: 81550K .......... .......... .......... .......... .......... 87% 330M 0s 2024-09-12T17:30:55.241 INFO:teuthology.orchestra.run.smithi067.stderr: 81600K .......... .......... .......... .......... .......... 87% 323M 0s 2024-09-12T17:30:55.241 INFO:teuthology.orchestra.run.smithi067.stderr: 81650K .......... .......... .......... .......... .......... 87% 275M 0s 2024-09-12T17:30:55.241 INFO:teuthology.orchestra.run.smithi067.stderr: 81700K .......... .......... .......... .......... .......... 87% 283M 0s 2024-09-12T17:30:55.241 INFO:teuthology.orchestra.run.smithi067.stderr: 81750K .......... .......... .......... .......... .......... 88% 196M 0s 2024-09-12T17:30:55.241 INFO:teuthology.orchestra.run.smithi067.stderr: 81800K .......... .......... .......... .......... .......... 88% 279M 0s 2024-09-12T17:30:55.241 INFO:teuthology.orchestra.run.smithi067.stderr: 81850K .......... .......... .......... .......... .......... 88% 338M 0s 2024-09-12T17:30:55.241 INFO:teuthology.orchestra.run.smithi067.stderr: 81900K .......... .......... .......... .......... .......... 88% 310M 0s 2024-09-12T17:30:55.241 INFO:teuthology.orchestra.run.smithi067.stderr: 81950K .......... .......... .......... .......... .......... 88% 296M 0s 2024-09-12T17:30:55.241 INFO:teuthology.orchestra.run.smithi067.stderr: 82000K .......... .......... .......... .......... .......... 88% 115M 0s 2024-09-12T17:30:55.242 INFO:teuthology.orchestra.run.smithi067.stderr: 82050K .......... .......... .......... .......... .......... 88% 79.7M 0s 2024-09-12T17:30:55.242 INFO:teuthology.orchestra.run.smithi067.stderr: 82100K .......... .......... .......... .......... .......... 88% 202M 0s 2024-09-12T17:30:55.242 INFO:teuthology.orchestra.run.smithi067.stderr: 82150K .......... .......... .......... .......... .......... 88% 309M 0s 2024-09-12T17:30:55.242 INFO:teuthology.orchestra.run.smithi067.stderr: 82200K .......... .......... .......... .......... .......... 88% 81.8M 0s 2024-09-12T17:30:55.242 INFO:teuthology.orchestra.run.smithi067.stderr: 82250K .......... .......... .......... .......... .......... 88% 127M 0s 2024-09-12T17:30:55.242 INFO:teuthology.orchestra.run.smithi067.stderr: 82300K .......... .......... .......... .......... .......... 88% 287M 0s 2024-09-12T17:30:55.242 INFO:teuthology.orchestra.run.smithi067.stderr: 82350K .......... .......... .......... .......... .......... 88% 233M 0s 2024-09-12T17:30:55.242 INFO:teuthology.orchestra.run.smithi067.stderr: 82400K .......... .......... .......... .......... .......... 88% 238M 0s 2024-09-12T17:30:55.242 INFO:teuthology.orchestra.run.smithi067.stderr: 82450K .......... .......... .......... .......... .......... 88% 327M 0s 2024-09-12T17:30:55.242 INFO:teuthology.orchestra.run.smithi067.stderr: 82500K .......... .......... .......... .......... .......... 88% 329M 0s 2024-09-12T17:30:55.242 INFO:teuthology.orchestra.run.smithi067.stderr: 82550K .......... .......... .......... .......... .......... 88% 326M 0s 2024-09-12T17:30:55.242 INFO:teuthology.orchestra.run.smithi067.stderr: 82600K .......... .......... .......... .......... .......... 88% 111M 0s 2024-09-12T17:30:55.242 INFO:teuthology.orchestra.run.smithi067.stderr: 82650K .......... .......... .......... .......... .......... 89% 345M 0s 2024-09-12T17:30:55.242 INFO:teuthology.orchestra.run.smithi067.stderr: 82700K .......... .......... .......... .......... .......... 89% 353M 0s 2024-09-12T17:30:55.243 INFO:teuthology.orchestra.run.smithi067.stderr: 82750K .......... .......... .......... .......... .......... 89% 264M 0s 2024-09-12T17:30:55.243 INFO:teuthology.orchestra.run.smithi067.stderr: 82800K .......... .......... .......... .......... .......... 89% 328M 0s 2024-09-12T17:30:55.243 INFO:teuthology.orchestra.run.smithi067.stderr: 82850K .......... .......... .......... .......... .......... 89% 300M 0s 2024-09-12T17:30:55.243 INFO:teuthology.orchestra.run.smithi067.stderr: 82900K .......... .......... .......... .......... .......... 89% 362M 0s 2024-09-12T17:30:55.243 INFO:teuthology.orchestra.run.smithi067.stderr: 82950K .......... .......... .......... .......... .......... 89% 321M 0s 2024-09-12T17:30:55.243 INFO:teuthology.orchestra.run.smithi067.stderr: 83000K .......... .......... .......... .......... .......... 89% 342M 0s 2024-09-12T17:30:55.243 INFO:teuthology.orchestra.run.smithi067.stderr: 83050K .......... .......... .......... .......... .......... 89% 314M 0s 2024-09-12T17:30:55.243 INFO:teuthology.orchestra.run.smithi067.stderr: 83100K .......... .......... .......... .......... .......... 89% 348M 0s 2024-09-12T17:30:55.243 INFO:teuthology.orchestra.run.smithi067.stderr: 83150K .......... .......... .......... .......... .......... 89% 290M 0s 2024-09-12T17:30:55.243 INFO:teuthology.orchestra.run.smithi067.stderr: 83200K .......... .......... .......... .......... .......... 89% 273M 0s 2024-09-12T17:30:55.243 INFO:teuthology.orchestra.run.smithi067.stderr: 83250K .......... .......... .......... .......... .......... 89% 343M 0s 2024-09-12T17:30:55.243 INFO:teuthology.orchestra.run.smithi067.stderr: 83300K .......... .......... .......... .......... .......... 89% 195M 0s 2024-09-12T17:30:55.243 INFO:teuthology.orchestra.run.smithi067.stderr: 83350K .......... .......... .......... .......... .......... 89% 285M 0s 2024-09-12T17:30:55.244 INFO:teuthology.orchestra.run.smithi067.stderr: 83400K .......... .......... .......... .......... .......... 89% 341M 0s 2024-09-12T17:30:55.244 INFO:teuthology.orchestra.run.smithi067.stderr: 83450K .......... .......... .......... .......... .......... 89% 212M 0s 2024-09-12T17:30:55.244 INFO:teuthology.orchestra.run.smithi067.stderr: 83500K .......... .......... .......... .......... .......... 89% 286M 0s 2024-09-12T17:30:55.244 INFO:teuthology.orchestra.run.smithi067.stderr: 83550K .......... .......... .......... .......... .......... 89% 264M 0s 2024-09-12T17:30:55.244 INFO:teuthology.orchestra.run.smithi067.stderr: 83600K .......... .......... .......... .......... .......... 90% 340M 0s 2024-09-12T17:30:55.244 INFO:teuthology.orchestra.run.smithi067.stderr: 83650K .......... .......... .......... .......... .......... 90% 326M 0s 2024-09-12T17:30:55.244 INFO:teuthology.orchestra.run.smithi067.stderr: 83700K .......... .......... .......... .......... .......... 90% 288M 0s 2024-09-12T17:30:55.244 INFO:teuthology.orchestra.run.smithi067.stderr: 83750K .......... .......... .......... .......... .......... 90% 300M 0s 2024-09-12T17:30:55.244 INFO:teuthology.orchestra.run.smithi067.stderr: 83800K .......... .......... .......... .......... .......... 90% 356M 0s 2024-09-12T17:30:55.244 INFO:teuthology.orchestra.run.smithi067.stderr: 83850K .......... .......... .......... .......... .......... 90% 337M 0s 2024-09-12T17:30:55.244 INFO:teuthology.orchestra.run.smithi067.stderr: 83900K .......... .......... .......... .......... .......... 90% 346M 0s 2024-09-12T17:30:55.244 INFO:teuthology.orchestra.run.smithi067.stderr: 83950K .......... .......... .......... .......... .......... 90% 274M 0s 2024-09-12T17:30:55.244 INFO:teuthology.orchestra.run.smithi067.stderr: 84000K .......... .......... .......... .......... .......... 90% 357M 0s 2024-09-12T17:30:55.244 INFO:teuthology.orchestra.run.smithi067.stderr: 84050K .......... .......... .......... .......... .......... 90% 347M 0s 2024-09-12T17:30:55.245 INFO:teuthology.orchestra.run.smithi067.stderr: 84100K .......... .......... .......... .......... .......... 90% 280M 0s 2024-09-12T17:30:55.245 INFO:teuthology.orchestra.run.smithi067.stderr: 84150K .......... .......... .......... .......... .......... 90% 281M 0s 2024-09-12T17:30:55.245 INFO:teuthology.orchestra.run.smithi067.stderr: 84200K .......... .......... .......... .......... .......... 90% 258M 0s 2024-09-12T17:30:55.245 INFO:teuthology.orchestra.run.smithi067.stderr: 84250K .......... .......... .......... .......... .......... 90% 229M 0s 2024-09-12T17:30:55.245 INFO:teuthology.orchestra.run.smithi067.stderr: 84300K .......... .......... .......... .......... .......... 90% 319M 0s 2024-09-12T17:30:55.245 INFO:teuthology.orchestra.run.smithi067.stderr: 84350K .......... .......... .......... .......... .......... 90% 157M 0s 2024-09-12T17:30:55.245 INFO:teuthology.orchestra.run.smithi067.stderr: 84400K .......... .......... .......... .......... .......... 90% 316M 0s 2024-09-12T17:30:55.245 INFO:teuthology.orchestra.run.smithi067.stderr: 84450K .......... .......... .......... .......... .......... 90% 341M 0s 2024-09-12T17:30:55.245 INFO:teuthology.orchestra.run.smithi067.stderr: 84500K .......... .......... .......... .......... .......... 91% 341M 0s 2024-09-12T17:30:55.245 INFO:teuthology.orchestra.run.smithi067.stderr: 84550K .......... .......... .......... .......... .......... 91% 301M 0s 2024-09-12T17:30:55.245 INFO:teuthology.orchestra.run.smithi067.stderr: 84600K .......... .......... .......... .......... .......... 91% 350M 0s 2024-09-12T17:30:55.245 INFO:teuthology.orchestra.run.smithi067.stderr: 84650K .......... .......... .......... .......... .......... 91% 328M 0s 2024-09-12T17:30:55.245 INFO:teuthology.orchestra.run.smithi067.stderr: 84700K .......... .......... .......... .......... .......... 91% 341M 0s 2024-09-12T17:30:55.245 INFO:teuthology.orchestra.run.smithi067.stderr: 84750K .......... .......... .......... .......... .......... 91% 273M 0s 2024-09-12T17:30:55.246 INFO:teuthology.orchestra.run.smithi067.stderr: 84800K .......... .......... .......... .......... .......... 91% 334M 0s 2024-09-12T17:30:55.246 INFO:teuthology.orchestra.run.smithi067.stderr: 84850K .......... .......... .......... .......... .......... 91% 375M 0s 2024-09-12T17:30:55.246 INFO:teuthology.orchestra.run.smithi067.stderr: 84900K .......... .......... .......... .......... .......... 91% 346M 0s 2024-09-12T17:30:55.246 INFO:teuthology.orchestra.run.smithi067.stderr: 84950K .......... .......... .......... .......... .......... 91% 305M 0s 2024-09-12T17:30:55.246 INFO:teuthology.orchestra.run.smithi067.stderr: 85000K .......... .......... .......... .......... .......... 91% 284M 0s 2024-09-12T17:30:55.246 INFO:teuthology.orchestra.run.smithi067.stderr: 85050K .......... .......... .......... .......... .......... 91% 289M 0s 2024-09-12T17:30:55.246 INFO:teuthology.orchestra.run.smithi067.stderr: 85100K .......... .......... .......... .......... .......... 91% 68.8M 0s 2024-09-12T17:30:55.246 INFO:teuthology.orchestra.run.smithi067.stderr: 85150K .......... .......... .......... .......... .......... 91% 121M 0s 2024-09-12T17:30:55.246 INFO:teuthology.orchestra.run.smithi067.stderr: 85200K .......... .......... .......... .......... .......... 91% 137M 0s 2024-09-12T17:30:55.246 INFO:teuthology.orchestra.run.smithi067.stderr: 85250K .......... .......... .......... .......... .......... 91% 280M 0s 2024-09-12T17:30:55.246 INFO:teuthology.orchestra.run.smithi067.stderr: 85300K .......... .......... .......... .......... .......... 91% 126M 0s 2024-09-12T17:30:55.246 INFO:teuthology.orchestra.run.smithi067.stderr: 85350K .......... .......... .......... .......... .......... 91% 235M 0s 2024-09-12T17:30:55.246 INFO:teuthology.orchestra.run.smithi067.stderr: 85400K .......... .......... .......... .......... .......... 91% 223M 0s 2024-09-12T17:30:55.247 INFO:teuthology.orchestra.run.smithi067.stderr: 85450K .......... .......... .......... .......... .......... 92% 336M 0s 2024-09-12T17:30:55.247 INFO:teuthology.orchestra.run.smithi067.stderr: 85500K .......... .......... .......... .......... .......... 92% 122M 0s 2024-09-12T17:30:55.247 INFO:teuthology.orchestra.run.smithi067.stderr: 85550K .......... .......... .......... .......... .......... 92% 206M 0s 2024-09-12T17:30:55.247 INFO:teuthology.orchestra.run.smithi067.stderr: 85600K .......... .......... .......... .......... .......... 92% 257M 0s 2024-09-12T17:30:55.247 INFO:teuthology.orchestra.run.smithi067.stderr: 85650K .......... .......... .......... .......... .......... 92% 326M 0s 2024-09-12T17:30:55.247 INFO:teuthology.orchestra.run.smithi067.stderr: 85700K .......... .......... .......... .......... .......... 92% 336M 0s 2024-09-12T17:30:55.247 INFO:teuthology.orchestra.run.smithi067.stderr: 85750K .......... .......... .......... .......... .......... 92% 276M 0s 2024-09-12T17:30:55.247 INFO:teuthology.orchestra.run.smithi067.stderr: 85800K .......... .......... .......... .......... .......... 92% 140M 0s 2024-09-12T17:30:55.247 INFO:teuthology.orchestra.run.smithi067.stderr: 85850K .......... .......... .......... .......... .......... 92% 306M 0s 2024-09-12T17:30:55.247 INFO:teuthology.orchestra.run.smithi067.stderr: 85900K .......... .......... .......... .......... .......... 92% 331M 0s 2024-09-12T17:30:55.247 INFO:teuthology.orchestra.run.smithi067.stderr: 85950K .......... .......... .......... .......... .......... 92% 274M 0s 2024-09-12T17:30:55.247 INFO:teuthology.orchestra.run.smithi067.stderr: 86000K .......... .......... .......... .......... .......... 92% 306M 0s 2024-09-12T17:30:55.247 INFO:teuthology.orchestra.run.smithi067.stderr: 86050K .......... .......... .......... .......... .......... 92% 344M 0s 2024-09-12T17:30:55.247 INFO:teuthology.orchestra.run.smithi067.stderr: 86100K .......... .......... .......... .......... .......... 92% 338M 0s 2024-09-12T17:30:55.248 INFO:teuthology.orchestra.run.smithi067.stderr: 86150K .......... .......... .......... .......... .......... 92% 261M 0s 2024-09-12T17:30:55.248 INFO:teuthology.orchestra.run.smithi067.stderr: 86200K .......... .......... .......... .......... .......... 92% 333M 0s 2024-09-12T17:30:55.248 INFO:teuthology.orchestra.run.smithi067.stderr: 86250K .......... .......... .......... .......... .......... 92% 307M 0s 2024-09-12T17:30:55.248 INFO:teuthology.orchestra.run.smithi067.stderr: 86300K .......... .......... .......... .......... .......... 92% 349M 0s 2024-09-12T17:30:55.248 INFO:teuthology.orchestra.run.smithi067.stderr: 86350K .......... .......... .......... .......... .......... 93% 292M 0s 2024-09-12T17:30:55.248 INFO:teuthology.orchestra.run.smithi067.stderr: 86400K .......... .......... .......... .......... .......... 93% 361M 0s 2024-09-12T17:30:55.248 INFO:teuthology.orchestra.run.smithi067.stderr: 86450K .......... .......... .......... .......... .......... 93% 149M 0s 2024-09-12T17:30:55.248 INFO:teuthology.orchestra.run.smithi067.stderr: 86500K .......... .......... .......... .......... .......... 93% 367M 0s 2024-09-12T17:30:55.248 INFO:teuthology.orchestra.run.smithi067.stderr: 86550K .......... .......... .......... .......... .......... 93% 325M 0s 2024-09-12T17:30:55.248 INFO:teuthology.orchestra.run.smithi067.stderr: 86600K .......... .......... .......... .......... .......... 93% 380M 0s 2024-09-12T17:30:55.248 INFO:teuthology.orchestra.run.smithi067.stderr: 86650K .......... .......... .......... .......... .......... 93% 215M 0s 2024-09-12T17:30:55.248 INFO:teuthology.orchestra.run.smithi067.stderr: 86700K .......... .......... .......... .......... .......... 93% 351M 0s 2024-09-12T17:30:55.248 INFO:teuthology.orchestra.run.smithi067.stderr: 86750K .......... .......... .......... .......... .......... 93% 307M 0s 2024-09-12T17:30:55.249 INFO:teuthology.orchestra.run.smithi067.stderr: 86800K .......... .......... .......... .......... .......... 93% 359M 0s 2024-09-12T17:30:55.249 INFO:teuthology.orchestra.run.smithi067.stderr: 86850K .......... .......... .......... .......... .......... 93% 363M 0s 2024-09-12T17:30:55.249 INFO:teuthology.orchestra.run.smithi067.stderr: 86900K .......... .......... .......... .......... .......... 93% 322M 0s 2024-09-12T17:30:55.249 INFO:teuthology.orchestra.run.smithi067.stderr: 86950K .......... .......... .......... .......... .......... 93% 319M 0s 2024-09-12T17:30:55.249 INFO:teuthology.orchestra.run.smithi067.stderr: 87000K .......... .......... .......... .......... .......... 93% 368M 0s 2024-09-12T17:30:55.249 INFO:teuthology.orchestra.run.smithi067.stderr: 87050K .......... .......... .......... .......... .......... 93% 385M 0s 2024-09-12T17:30:55.249 INFO:teuthology.orchestra.run.smithi067.stderr: 87100K .......... .......... .......... .......... .......... 93% 240M 0s 2024-09-12T17:30:55.249 INFO:teuthology.orchestra.run.smithi067.stderr: 87150K .......... .......... .......... .......... .......... 93% 304M 0s 2024-09-12T17:30:55.249 INFO:teuthology.orchestra.run.smithi067.stderr: 87200K .......... .......... .......... .......... .......... 93% 187M 0s 2024-09-12T17:30:55.249 INFO:teuthology.orchestra.run.smithi067.stderr: 87250K .......... .......... .......... .......... .......... 93% 352M 0s 2024-09-12T17:30:55.249 INFO:teuthology.orchestra.run.smithi067.stderr: 87300K .......... .......... .......... .......... .......... 94% 377M 0s 2024-09-12T17:30:55.249 INFO:teuthology.orchestra.run.smithi067.stderr: 87350K .......... .......... .......... .......... .......... 94% 127M 0s 2024-09-12T17:30:55.249 INFO:teuthology.orchestra.run.smithi067.stderr: 87400K .......... .......... .......... .......... .......... 94% 338M 0s 2024-09-12T17:30:55.249 INFO:teuthology.orchestra.run.smithi067.stderr: 87450K .......... .......... .......... .......... .......... 94% 365M 0s 2024-09-12T17:30:55.250 INFO:teuthology.orchestra.run.smithi067.stderr: 87500K .......... .......... .......... .......... .......... 94% 364M 0s 2024-09-12T17:30:55.250 INFO:teuthology.orchestra.run.smithi067.stderr: 87550K .......... .......... .......... .......... .......... 94% 306M 0s 2024-09-12T17:30:55.250 INFO:teuthology.orchestra.run.smithi067.stderr: 87600K .......... .......... .......... .......... .......... 94% 363M 0s 2024-09-12T17:30:55.250 INFO:teuthology.orchestra.run.smithi067.stderr: 87650K .......... .......... .......... .......... .......... 94% 355M 0s 2024-09-12T17:30:55.250 INFO:teuthology.orchestra.run.smithi067.stderr: 87700K .......... .......... .......... .......... .......... 94% 375M 0s 2024-09-12T17:30:55.250 INFO:teuthology.orchestra.run.smithi067.stderr: 87750K .......... .......... .......... .......... .......... 94% 326M 0s 2024-09-12T17:30:55.250 INFO:teuthology.orchestra.run.smithi067.stderr: 87800K .......... .......... .......... .......... .......... 94% 341M 0s 2024-09-12T17:30:55.250 INFO:teuthology.orchestra.run.smithi067.stderr: 87850K .......... .......... .......... .......... .......... 94% 376M 0s 2024-09-12T17:30:55.250 INFO:teuthology.orchestra.run.smithi067.stderr: 87900K .......... .......... .......... .......... .......... 94% 372M 0s 2024-09-12T17:30:55.250 INFO:teuthology.orchestra.run.smithi067.stderr: 87950K .......... .......... .......... .......... .......... 94% 312M 0s 2024-09-12T17:30:55.250 INFO:teuthology.orchestra.run.smithi067.stderr: 88000K .......... .......... .......... .......... .......... 94% 227M 0s 2024-09-12T17:30:55.250 INFO:teuthology.orchestra.run.smithi067.stderr: 88050K .......... .......... .......... .......... .......... 94% 286M 0s 2024-09-12T17:30:55.250 INFO:teuthology.orchestra.run.smithi067.stderr: 88100K .......... .......... .......... .......... .......... 94% 366M 0s 2024-09-12T17:30:55.251 INFO:teuthology.orchestra.run.smithi067.stderr: 88150K .......... .......... .......... .......... .......... 94% 86.2M 0s 2024-09-12T17:30:55.251 INFO:teuthology.orchestra.run.smithi067.stderr: 88200K .......... .......... .......... .......... .......... 94% 148M 0s 2024-09-12T17:30:55.251 INFO:teuthology.orchestra.run.smithi067.stderr: 88250K .......... .......... .......... .......... .......... 95% 274M 0s 2024-09-12T17:30:55.251 INFO:teuthology.orchestra.run.smithi067.stderr: 88300K .......... .......... .......... .......... .......... 95% 121M 0s 2024-09-12T17:30:55.251 INFO:teuthology.orchestra.run.smithi067.stderr: 88350K .......... .......... .......... .......... .......... 95% 107M 0s 2024-09-12T17:30:55.251 INFO:teuthology.orchestra.run.smithi067.stderr: 88400K .......... .......... .......... .......... .......... 95% 183M 0s 2024-09-12T17:30:55.251 INFO:teuthology.orchestra.run.smithi067.stderr: 88450K .......... .......... .......... .......... .......... 95% 293M 0s 2024-09-12T17:30:55.251 INFO:teuthology.orchestra.run.smithi067.stderr: 88500K .......... .......... .......... .......... .......... 95% 344M 0s 2024-09-12T17:30:55.251 INFO:teuthology.orchestra.run.smithi067.stderr: 88550K .......... .......... .......... .......... .......... 95% 98.7M 0s 2024-09-12T17:30:55.251 INFO:teuthology.orchestra.run.smithi067.stderr: 88600K .......... .......... .......... .......... .......... 95% 368M 0s 2024-09-12T17:30:55.251 INFO:teuthology.orchestra.run.smithi067.stderr: 88650K .......... .......... .......... .......... .......... 95% 284M 0s 2024-09-12T17:30:55.251 INFO:teuthology.orchestra.run.smithi067.stderr: 88700K .......... .......... .......... .......... .......... 95% 371M 0s 2024-09-12T17:30:55.251 INFO:teuthology.orchestra.run.smithi067.stderr: 88750K .......... .......... .......... .......... .......... 95% 312M 0s 2024-09-12T17:30:55.251 INFO:teuthology.orchestra.run.smithi067.stderr: 88800K .......... .......... .......... .......... .......... 95% 189M 0s 2024-09-12T17:30:55.252 INFO:teuthology.orchestra.run.smithi067.stderr: 88850K .......... .......... .......... .......... .......... 95% 161M 0s 2024-09-12T17:30:55.252 INFO:teuthology.orchestra.run.smithi067.stderr: 88900K .......... .......... .......... .......... .......... 95% 115M 0s 2024-09-12T17:30:55.252 INFO:teuthology.orchestra.run.smithi067.stderr: 88950K .......... .......... .......... .......... .......... 95% 313M 0s 2024-09-12T17:30:55.252 INFO:teuthology.orchestra.run.smithi067.stderr: 89000K .......... .......... .......... .......... .......... 95% 363M 0s 2024-09-12T17:30:55.252 INFO:teuthology.orchestra.run.smithi067.stderr: 89050K .......... .......... .......... .......... .......... 95% 349M 0s 2024-09-12T17:30:55.252 INFO:teuthology.orchestra.run.smithi067.stderr: 89100K .......... .......... .......... .......... .......... 95% 375M 0s 2024-09-12T17:30:55.252 INFO:teuthology.orchestra.run.smithi067.stderr: 89150K .......... .......... .......... .......... .......... 96% 290M 0s 2024-09-12T17:30:55.252 INFO:teuthology.orchestra.run.smithi067.stderr: 89200K .......... .......... .......... .......... .......... 96% 360M 0s 2024-09-12T17:30:55.252 INFO:teuthology.orchestra.run.smithi067.stderr: 89250K .......... .......... .......... .......... .......... 96% 350M 0s 2024-09-12T17:30:55.252 INFO:teuthology.orchestra.run.smithi067.stderr: 89300K .......... .......... .......... .......... .......... 96% 358M 0s 2024-09-12T17:30:55.252 INFO:teuthology.orchestra.run.smithi067.stderr: 89350K .......... .......... .......... .......... .......... 96% 300M 0s 2024-09-12T17:30:55.252 INFO:teuthology.orchestra.run.smithi067.stderr: 89400K .......... .......... .......... .......... .......... 96% 380M 0s 2024-09-12T17:30:55.252 INFO:teuthology.orchestra.run.smithi067.stderr: 89450K .......... .......... .......... .......... .......... 96% 186M 0s 2024-09-12T17:30:55.252 INFO:teuthology.orchestra.run.smithi067.stderr: 89500K .......... .......... .......... .......... .......... 96% 365M 0s 2024-09-12T17:30:55.253 INFO:teuthology.orchestra.run.smithi067.stderr: 89550K .......... .......... .......... .......... .......... 96% 310M 0s 2024-09-12T17:30:55.253 INFO:teuthology.orchestra.run.smithi067.stderr: 89600K .......... .......... .......... .......... .......... 96% 208M 0s 2024-09-12T17:30:55.253 INFO:teuthology.orchestra.run.smithi067.stderr: 89650K .......... .......... .......... .......... .......... 96% 371M 0s 2024-09-12T17:30:55.253 INFO:teuthology.orchestra.run.smithi067.stderr: 89700K .......... .......... .......... .......... .......... 96% 331M 0s 2024-09-12T17:30:55.253 INFO:teuthology.orchestra.run.smithi067.stderr: 89750K .......... .......... .......... .......... .......... 96% 330M 0s 2024-09-12T17:30:55.253 INFO:teuthology.orchestra.run.smithi067.stderr: 89800K .......... .......... .......... .......... .......... 96% 369M 0s 2024-09-12T17:30:55.253 INFO:teuthology.orchestra.run.smithi067.stderr: 89850K .......... .......... .......... .......... .......... 96% 366M 0s 2024-09-12T17:30:55.253 INFO:teuthology.orchestra.run.smithi067.stderr: 89900K .......... .......... .......... .......... .......... 96% 343M 0s 2024-09-12T17:30:55.253 INFO:teuthology.orchestra.run.smithi067.stderr: 89950K .......... .......... .......... .......... .......... 96% 321M 0s 2024-09-12T17:30:55.253 INFO:teuthology.orchestra.run.smithi067.stderr: 90000K .......... .......... .......... .......... .......... 96% 185M 0s 2024-09-12T17:30:55.253 INFO:teuthology.orchestra.run.smithi067.stderr: 90050K .......... .......... .......... .......... .......... 96% 283M 0s 2024-09-12T17:30:55.253 INFO:teuthology.orchestra.run.smithi067.stderr: 90100K .......... .......... .......... .......... .......... 97% 357M 0s 2024-09-12T17:30:55.253 INFO:teuthology.orchestra.run.smithi067.stderr: 90150K .......... .......... .......... .......... .......... 97% 271M 0s 2024-09-12T17:30:55.253 INFO:teuthology.orchestra.run.smithi067.stderr: 90200K .......... .......... .......... .......... .......... 97% 239M 0s 2024-09-12T17:30:55.254 INFO:teuthology.orchestra.run.smithi067.stderr: 90250K .......... .......... .......... .......... .......... 97% 355M 0s 2024-09-12T17:30:55.254 INFO:teuthology.orchestra.run.smithi067.stderr: 90300K .......... .......... .......... .......... .......... 97% 377M 0s 2024-09-12T17:30:55.254 INFO:teuthology.orchestra.run.smithi067.stderr: 90350K .......... .......... .......... .......... .......... 97% 309M 0s 2024-09-12T17:30:55.254 INFO:teuthology.orchestra.run.smithi067.stderr: 90400K .......... .......... .......... .......... .......... 97% 211M 0s 2024-09-12T17:30:55.254 INFO:teuthology.orchestra.run.smithi067.stderr: 90450K .......... .......... .......... .......... .......... 97% 133M 0s 2024-09-12T17:30:55.254 INFO:teuthology.orchestra.run.smithi067.stderr: 90500K .......... .......... .......... .......... .......... 97% 327M 0s 2024-09-12T17:30:55.254 INFO:teuthology.orchestra.run.smithi067.stderr: 90550K .......... .......... .......... .......... .......... 97% 318M 0s 2024-09-12T17:30:55.254 INFO:teuthology.orchestra.run.smithi067.stderr: 90600K .......... .......... .......... .......... .......... 97% 364M 0s 2024-09-12T17:30:55.254 INFO:teuthology.orchestra.run.smithi067.stderr: 90650K .......... .......... .......... .......... .......... 97% 379M 0s 2024-09-12T17:30:55.254 INFO:teuthology.orchestra.run.smithi067.stderr: 90700K .......... .......... .......... .......... .......... 97% 384M 0s 2024-09-12T17:30:55.254 INFO:teuthology.orchestra.run.smithi067.stderr: 90750K .......... .......... .......... .......... .......... 97% 303M 0s 2024-09-12T17:30:55.254 INFO:teuthology.orchestra.run.smithi067.stderr: 90800K .......... .......... .......... .......... .......... 97% 364M 0s 2024-09-12T17:30:55.254 INFO:teuthology.orchestra.run.smithi067.stderr: 90850K .......... .......... .......... .......... .......... 97% 377M 0s 2024-09-12T17:30:55.254 INFO:teuthology.orchestra.run.smithi067.stderr: 90900K .......... .......... .......... .......... .......... 97% 374M 0s 2024-09-12T17:30:55.255 INFO:teuthology.orchestra.run.smithi067.stderr: 90950K .......... .......... .......... .......... .......... 97% 348M 0s 2024-09-12T17:30:55.255 INFO:teuthology.orchestra.run.smithi067.stderr: 91000K .......... .......... .......... .......... .......... 98% 375M 0s 2024-09-12T17:30:55.255 INFO:teuthology.orchestra.run.smithi067.stderr: 91050K .......... .......... .......... .......... .......... 98% 376M 0s 2024-09-12T17:30:55.255 INFO:teuthology.orchestra.run.smithi067.stderr: 91100K .......... .......... .......... .......... .......... 98% 376M 0s 2024-09-12T17:30:55.255 INFO:teuthology.orchestra.run.smithi067.stderr: 91150K .......... .......... .......... .......... .......... 98% 280M 0s 2024-09-12T17:30:55.255 INFO:teuthology.orchestra.run.smithi067.stderr: 91200K .......... .......... .......... .......... .......... 98% 142M 0s 2024-09-12T17:30:55.255 INFO:teuthology.orchestra.run.smithi067.stderr: 91250K .......... .......... .......... .......... .......... 98% 175M 0s 2024-09-12T17:30:55.255 INFO:teuthology.orchestra.run.smithi067.stderr: 91300K .......... .......... .......... .......... .......... 98% 304M 0s 2024-09-12T17:30:55.255 INFO:teuthology.orchestra.run.smithi067.stderr: 91350K .......... .......... .......... .......... .......... 98% 88.9M 0s 2024-09-12T17:30:55.255 INFO:teuthology.orchestra.run.smithi067.stderr: 91400K .......... .......... .......... .......... .......... 98% 135M 0s 2024-09-12T17:30:55.255 INFO:teuthology.orchestra.run.smithi067.stderr: 91450K .......... .......... .......... .......... .......... 98% 136M 0s 2024-09-12T17:30:55.255 INFO:teuthology.orchestra.run.smithi067.stderr: 91500K .......... .......... .......... .......... .......... 98% 360M 0s 2024-09-12T17:30:55.255 INFO:teuthology.orchestra.run.smithi067.stderr: 91550K .......... .......... .......... .......... .......... 98% 315M 0s 2024-09-12T17:30:55.255 INFO:teuthology.orchestra.run.smithi067.stderr: 91600K .......... .......... .......... .......... .......... 98% 88.7M 0s 2024-09-12T17:30:55.256 INFO:teuthology.orchestra.run.smithi067.stderr: 91650K .......... .......... .......... .......... .......... 98% 340M 0s 2024-09-12T17:30:55.256 INFO:teuthology.orchestra.run.smithi067.stderr: 91700K .......... .......... .......... .......... .......... 98% 305M 0s 2024-09-12T17:30:55.256 INFO:teuthology.orchestra.run.smithi067.stderr: 91750K .......... .......... .......... .......... .......... 98% 324M 0s 2024-09-12T17:30:55.256 INFO:teuthology.orchestra.run.smithi067.stderr: 91800K .......... .......... .......... .......... .......... 98% 374M 0s 2024-09-12T17:30:55.256 INFO:teuthology.orchestra.run.smithi067.stderr: 91850K .......... .......... .......... .......... .......... 98% 372M 0s 2024-09-12T17:30:55.256 INFO:teuthology.orchestra.run.smithi067.stderr: 91900K .......... .......... .......... .......... .......... 98% 150M 0s 2024-09-12T17:30:55.256 INFO:teuthology.orchestra.run.smithi067.stderr: 91950K .......... .......... .......... .......... .......... 99% 101M 0s 2024-09-12T17:30:55.256 INFO:teuthology.orchestra.run.smithi067.stderr: 92000K .......... .......... .......... .......... .......... 99% 364M 0s 2024-09-12T17:30:55.256 INFO:teuthology.orchestra.run.smithi067.stderr: 92050K .......... .......... .......... .......... .......... 99% 200M 0s 2024-09-12T17:30:55.256 INFO:teuthology.orchestra.run.smithi067.stderr: 92100K .......... .......... .......... .......... .......... 99% 338M 0s 2024-09-12T17:30:55.256 INFO:teuthology.orchestra.run.smithi067.stderr: 92150K .......... .......... .......... .......... .......... 99% 369M 0s 2024-09-12T17:30:55.256 INFO:teuthology.orchestra.run.smithi067.stderr: 92200K .......... .......... .......... .......... .......... 99% 337M 0s 2024-09-12T17:30:55.256 INFO:teuthology.orchestra.run.smithi067.stderr: 92250K .......... .......... .......... .......... .......... 99% 329M 0s 2024-09-12T17:30:55.257 INFO:teuthology.orchestra.run.smithi067.stderr: 92300K .......... .......... .......... .......... .......... 99% 367M 0s 2024-09-12T17:30:55.257 INFO:teuthology.orchestra.run.smithi067.stderr: 92350K .......... .......... .......... .......... .......... 99% 296M 0s 2024-09-12T17:30:55.257 INFO:teuthology.orchestra.run.smithi067.stderr: 92400K .......... .......... .......... .......... .......... 99% 184M 0s 2024-09-12T17:30:55.257 INFO:teuthology.orchestra.run.smithi067.stderr: 92450K .......... .......... .......... .......... .......... 99% 278M 0s 2024-09-12T17:30:55.257 INFO:teuthology.orchestra.run.smithi067.stderr: 92500K .......... .......... .......... .......... .......... 99% 177M 0s 2024-09-12T17:30:55.257 INFO:teuthology.orchestra.run.smithi067.stderr: 92550K .......... .......... .......... .......... .......... 99% 313M 0s 2024-09-12T17:30:55.257 INFO:teuthology.orchestra.run.smithi067.stderr: 92600K .......... .......... .......... .......... .......... 99% 320M 0s 2024-09-12T17:30:55.257 INFO:teuthology.orchestra.run.smithi067.stderr: 92650K .......... .......... .......... .......... .......... 99% 332M 0s 2024-09-12T17:30:55.257 INFO:teuthology.orchestra.run.smithi067.stderr: 92700K .......... .......... .......... .......... .......... 99% 351M 0s 2024-09-12T17:30:55.257 INFO:teuthology.orchestra.run.smithi067.stderr: 92750K .......... .......... .......... .......... .......... 99% 306M 0s 2024-09-12T17:30:55.257 INFO:teuthology.orchestra.run.smithi067.stderr: 92800K .......... .......... .......... .......... .......... 99% 351M 0s 2024-09-12T17:30:55.257 INFO:teuthology.orchestra.run.smithi067.stderr: 92850K .......... .......... .......... .......... .......... 99% 366M 0s 2024-09-12T17:30:55.257 INFO:teuthology.orchestra.run.smithi067.stderr: 92900K 100% 134G=0.4s 2024-09-12T17:30:55.257 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T17:30:55.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12 17:30:53 (209 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-09-12T17:30:55.258 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T17:30:55.300 INFO:teuthology.orchestra.run.smithi067.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-12T17:30:55.301 INFO:teuthology.orchestra.run.smithi067.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-12T17:30:55.301 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-12T17:30:55.301 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-12T17:30:55.301 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-12T17:30:55.301 INFO:teuthology.orchestra.run.smithi067.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-12T17:30:55.301 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-12T17:30:55.301 INFO:teuthology.orchestra.run.smithi067.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-12T17:30:55.301 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-12T17:30:55.301 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-12T17:30:55.301 INFO:teuthology.orchestra.run.smithi067.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-12T17:30:55.301 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-12T17:30:55.301 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-12T17:30:55.302 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-12T17:30:55.302 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-12T17:30:55.302 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-12T17:30:55.302 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-12T17:30:55.302 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-12T17:30:55.302 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-12T17:30:55.302 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-12T17:30:55.302 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-12T17:30:55.302 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-12T17:30:55.302 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-12T17:30:55.302 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-12T17:30:55.302 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-12T17:30:55.302 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-12T17:30:55.302 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-12T17:30:55.303 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-12T17:30:55.303 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-12T17:30:55.303 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-12T17:30:55.303 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-12T17:30:55.303 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-12T17:30:55.303 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-12T17:30:55.303 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-12T17:30:55.303 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-12T17:30:55.303 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-12T17:30:55.303 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-12T17:30:55.303 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-12T17:30:55.303 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-12T17:30:55.303 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-12T17:30:55.304 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-12T17:30:55.304 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-12T17:30:55.304 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-12T17:30:55.304 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-12T17:30:55.304 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-12T17:30:55.304 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-12T17:30:55.304 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-12T17:30:55.304 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-12T17:30:55.304 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-12T17:30:55.304 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-12T17:30:55.304 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-12T17:30:55.304 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-12T17:30:55.304 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-12T17:30:55.305 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-12T17:30:55.305 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-12T17:30:55.305 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-12T17:30:55.305 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-12T17:30:55.305 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-12T17:30:55.305 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-12T17:30:55.305 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-12T17:30:55.305 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-12T17:30:55.305 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-12T17:30:55.305 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-12T17:30:55.305 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-12T17:30:55.305 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-12T17:30:55.305 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-12T17:30:55.306 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-12T17:30:55.306 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-12T17:30:55.306 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-12T17:30:55.306 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-12T17:30:55.306 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-12T17:30:55.306 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-12T17:30:55.306 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-12T17:30:55.306 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-12T17:30:55.306 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-12T17:30:55.306 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-12T17:30:55.306 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-12T17:30:55.306 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-12T17:30:55.306 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-12T17:30:55.307 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-12T17:30:55.307 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-12T17:30:55.307 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-12T17:30:55.307 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-12T17:30:55.307 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-12T17:30:55.307 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-12T17:30:55.307 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-12T17:30:55.307 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-12T17:30:55.307 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-12T17:30:55.307 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-12T17:30:55.307 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-12T17:30:55.307 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-12T17:30:55.307 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-12T17:30:55.307 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-12T17:30:55.308 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-12T17:30:55.308 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-12T17:30:55.308 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-12T17:30:55.308 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-12T17:30:55.308 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-12T17:30:55.308 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-12T17:30:55.308 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-12T17:30:55.308 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-12T17:30:55.308 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-12T17:30:55.308 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-12T17:30:55.308 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-12T17:30:55.308 INFO:teuthology.orchestra.run.smithi067.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-12T17:30:55.308 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-12T17:30:55.309 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-12T17:30:55.309 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-12T17:30:55.309 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-12T17:30:55.309 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-12T17:30:55.309 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-12T17:30:55.309 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-12T17:30:55.309 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-12T17:30:55.309 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-12T17:30:55.309 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-12T17:30:55.309 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-12T17:30:55.309 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-12T17:30:55.309 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-12T17:30:55.310 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-12T17:30:55.310 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-12T17:30:55.310 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-12T17:30:55.310 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-12T17:30:55.310 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-12T17:30:55.310 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-12T17:30:55.310 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-12T17:30:55.310 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-12T17:30:55.310 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-12T17:30:55.310 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-12T17:30:55.310 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-12T17:30:55.310 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-12T17:30:55.310 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-12T17:30:55.310 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-12T17:30:55.311 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-12T17:30:55.311 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-12T17:30:55.311 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-12T17:30:55.311 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-12T17:30:55.311 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-12T17:30:55.311 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-12T17:30:55.311 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-12T17:30:55.311 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-12T17:30:55.311 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-12T17:30:55.311 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-12T17:30:55.311 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-12T17:30:55.311 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-12T17:30:55.311 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-12T17:30:55.312 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-12T17:30:55.312 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-12T17:30:55.312 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-12T17:30:55.312 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-12T17:30:55.312 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-12T17:30:55.312 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-12T17:30:55.312 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-12T17:30:55.312 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-12T17:30:55.312 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-12T17:30:55.312 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-12T17:30:55.312 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-12T17:30:55.312 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-12T17:30:55.312 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-12T17:30:55.313 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-12T17:30:55.313 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-12T17:30:55.313 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-12T17:30:55.313 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-12T17:30:55.313 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-12T17:30:55.313 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-12T17:30:55.313 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-12T17:30:55.313 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-12T17:30:55.313 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-12T17:30:55.313 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-12T17:30:55.313 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-12T17:30:55.313 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-12T17:30:55.313 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-12T17:30:55.314 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-12T17:30:55.314 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-12T17:30:55.314 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-12T17:30:55.314 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-12T17:30:55.314 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-12T17:30:55.314 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-12T17:30:55.314 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-12T17:30:55.314 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-12T17:30:55.314 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-12T17:30:55.314 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-12T17:30:55.314 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-12T17:30:55.314 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-12T17:30:55.314 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-12T17:30:55.314 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-12T17:30:55.315 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-12T17:30:55.315 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-12T17:30:55.315 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-12T17:30:55.315 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-12T17:30:55.315 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-12T17:30:55.315 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-12T17:30:55.315 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-12T17:30:55.315 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-12T17:30:55.315 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-12T17:30:55.315 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-12T17:30:55.315 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-12T17:30:55.315 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-12T17:30:55.315 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-12T17:30:55.315 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-12T17:30:55.316 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-12T17:30:55.316 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-12T17:30:55.316 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-12T17:30:55.316 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-12T17:30:55.316 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-12T17:30:55.316 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-12T17:30:55.316 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-12T17:30:55.316 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-12T17:30:55.316 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-12T17:30:55.316 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-12T17:30:55.316 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-12T17:30:55.316 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-12T17:30:55.316 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-12T17:30:55.317 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-12T17:30:55.317 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-12T17:30:55.317 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-12T17:30:55.317 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-12T17:30:55.317 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-12T17:30:55.317 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-12T17:30:55.317 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-12T17:30:55.317 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-12T17:30:55.317 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-12T17:30:55.317 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-12T17:30:55.317 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-12T17:30:55.317 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-12T17:30:55.317 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-12T17:30:55.318 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-12T17:30:55.318 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-12T17:30:55.318 INFO:teuthology.orchestra.run.smithi067.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-09-12T17:30:55.318 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:30:55.318 INFO:teuthology.orchestra.run.smithi067.stdout:Welcome to Gradle 6.0.1! 2024-09-12T17:30:55.318 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:30:55.318 INFO:teuthology.orchestra.run.smithi067.stdout:Here are the highlights of this release: 2024-09-12T17:30:55.318 INFO:teuthology.orchestra.run.smithi067.stdout: - Substantial improvements in dependency management, including 2024-09-12T17:30:55.318 INFO:teuthology.orchestra.run.smithi067.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-12T17:30:55.318 INFO:teuthology.orchestra.run.smithi067.stdout: - Advanced control of transitive versions 2024-09-12T17:30:55.318 INFO:teuthology.orchestra.run.smithi067.stdout: - Support for optional features and dependencies 2024-09-12T17:30:55.318 INFO:teuthology.orchestra.run.smithi067.stdout: - Rules to tweak published metadata 2024-09-12T17:30:55.318 INFO:teuthology.orchestra.run.smithi067.stdout: - Support for Java 13 2024-09-12T17:30:55.318 INFO:teuthology.orchestra.run.smithi067.stdout: - Faster incremental Java and Groovy compilation 2024-09-12T17:30:55.319 INFO:teuthology.orchestra.run.smithi067.stdout: - New Zinc compiler for Scala 2024-09-12T17:30:55.319 INFO:teuthology.orchestra.run.smithi067.stdout: - VS2019 support 2024-09-12T17:30:55.319 INFO:teuthology.orchestra.run.smithi067.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-12T17:30:55.319 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:30:55.319 INFO:teuthology.orchestra.run.smithi067.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-12T17:30:55.319 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:30:55.319 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:30:55.319 INFO:teuthology.orchestra.run.smithi067.stdout:------------------------------------------------------------ 2024-09-12T17:30:55.319 INFO:teuthology.orchestra.run.smithi067.stdout:Gradle 6.0.1 2024-09-12T17:30:55.319 INFO:teuthology.orchestra.run.smithi067.stdout:------------------------------------------------------------ 2024-09-12T17:30:55.319 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:30:55.319 INFO:teuthology.orchestra.run.smithi067.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-12T17:30:55.319 INFO:teuthology.orchestra.run.smithi067.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-12T17:30:55.319 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:30:55.320 INFO:teuthology.orchestra.run.smithi067.stdout:Kotlin: 1.3.50 2024-09-12T17:30:55.320 INFO:teuthology.orchestra.run.smithi067.stdout:Groovy: 2.5.8 2024-09-12T17:30:55.320 INFO:teuthology.orchestra.run.smithi067.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-12T17:30:55.320 INFO:teuthology.orchestra.run.smithi067.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-09-12T17:30:55.320 INFO:teuthology.orchestra.run.smithi067.stdout:OS: Linux 5.14.0-505.el9.x86_64 amd64 2024-09-12T17:30:55.320 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:30:55.320 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-12T17:30:55.320 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T17:30:55.320 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi067.front.sepia.ceph.com 2024-09-12T17:30:55.320 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T17:30:55.321 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi118.front.sepia.ceph.com 2024-09-12T17:30:55.321 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-12T17:30:55.526 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-12T17:30:55.526 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-12T17:30:55.526 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'RKFKGUDNYNZVQRRENVMV', 'access_secret': 'NDMwoLR7tq5F+VnVxxYpT8IsDxs5ubDYHAHy1yJoEiT8PTQuOAs6yg==', 'region': 'mexico', 'endpoint': 'smithi067.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi067.front.sepia.ceph.com'} 2024-09-12T17:30:55.526 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-12T17:30:55.527 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'RKFKGUDNYNZVQRRENVMV', '--secret', 'NDMwoLR7tq5F+VnVxxYpT8IsDxs5ubDYHAHy1yJoEiT8PTQuOAs6yg==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-12T17:30:55.527 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key RKFKGUDNYNZVQRRENVMV --secret NDMwoLR7tq5F+VnVxxYpT8IsDxs5ubDYHAHy1yJoEiT8PTQuOAs6yg== --email tester.client.0_test@test.test --cluster ceph 2024-09-12T17:30:55.595 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:55.596 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:55.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:55.824+0000 7fc8b7092640 0 --2- 172.21.15.67:0/2344508537 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5598ec9b9aa0 0x5598ec9b9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:30:55.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:55.831+0000 7fc8c1da9800 20 rados->read ofs=0 len=0 2024-09-12T17:30:55.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:55.833+0000 7fc8c1da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:55.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:55.833+0000 7fc8c1da9800 20 realm 2024-09-12T17:30:55.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:55.833+0000 7fc8c1da9800 20 rados->read ofs=0 len=0 2024-09-12T17:30:55.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:55.833+0000 7fc8c1da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:55.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:55.833+0000 7fc8c1da9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:55.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:55.833+0000 7fc8c1da9800 20 rados->read ofs=0 len=0 2024-09-12T17:30:55.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:55.833+0000 7fc8c1da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:55.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:55.833+0000 7fc8c1da9800 20 rados->read ofs=0 len=0 2024-09-12T17:30:55.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:55.834+0000 7fc8c1da9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:55.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:55.834+0000 7fc8c1da9800 20 rados->read ofs=0 len=0 2024-09-12T17:30:55.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:55.835+0000 7fc8c1da9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:30:55.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:55.835+0000 7fc8c1da9800 20 searching for the correct realm 2024-09-12T17:30:55.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:55.837+0000 7fc8b7092640 0 -- 172.21.15.67:0/2826933976 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7fc8b00ad000 msgr2=0x7fc8b00cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:56.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.042+0000 7fc8bf893640 0 -- 172.21.15.67:0/2826933976 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fc8a8082310 msgr2=0x7fc8a80487c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:30:56.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.249+0000 7fc8c1da9800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:30:56.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.249+0000 7fc8c1da9800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:30:56.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.249+0000 7fc8c1da9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:56.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.249+0000 7fc8c1da9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:56.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.249+0000 7fc8c1da9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:56.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.249+0000 7fc8c1da9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:56.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.249+0000 7fc8c1da9800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.249+0000 7fc8c1da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:56.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.249+0000 7fc8c1da9800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.249+0000 7fc8c1da9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:56.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.249+0000 7fc8c1da9800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.250+0000 7fc8c1da9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:30:56.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.250+0000 7fc8c1da9800 20 zone default found 2024-09-12T17:30:56.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.250+0000 7fc8c1da9800 4 Realm: () 2024-09-12T17:30:56.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.250+0000 7fc8c1da9800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:30:56.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.250+0000 7fc8c1da9800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:30:56.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.250+0000 7fc8c1da9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:56.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.250+0000 7fc8c1da9800 20 zonegroup default 2024-09-12T17:30:56.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.250+0000 7fc8c1da9800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.250+0000 7fc8c1da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:56.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.250+0000 7fc8c1da9800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.251+0000 7fc8c1da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:56.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.251+0000 7fc8c1da9800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.251+0000 7fc8c1da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:56.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.251+0000 7fc8c1da9800 20 started sync module instance, tier type = 2024-09-12T17:30:56.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.251+0000 7fc8c1da9800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:30:56.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.264+0000 7fc8c1da9800 20 add_watcher() i=0 2024-09-12T17:30:56.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.264+0000 7fc8c1da9800 20 add_watcher() i=1 2024-09-12T17:30:56.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.264+0000 7fc8c1da9800 20 add_watcher() i=2 2024-09-12T17:30:56.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.264+0000 7fc8c1da9800 20 add_watcher() i=3 2024-09-12T17:30:56.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.264+0000 7fc8c1da9800 20 add_watcher() i=4 2024-09-12T17:30:56.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.264+0000 7fc8c1da9800 20 add_watcher() i=5 2024-09-12T17:30:56.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.264+0000 7fc8c1da9800 20 add_watcher() i=6 2024-09-12T17:30:56.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.265+0000 7fc8c1da9800 20 add_watcher() i=7 2024-09-12T17:30:56.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.265+0000 7fc8c1da9800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:56.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.266+0000 7fc775fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:56.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.267+0000 7fc8c1da9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:56.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.267+0000 7fc8c1da9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:56.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.267+0000 7fc8c1da9800 5 note: GC not initialized 2024-09-12T17:30:56.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.267+0000 7fc774fe1640 20 reqs_thread_entry: start 2024-09-12T17:30:56.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.267+0000 7fc8c1da9800 20 init_complete bucket index max shards: 1 2024-09-12T17:30:56.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.267+0000 7fc8c1da9800 20 Filter name: none 2024-09-12T17:30:56.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.267+0000 7fc6ee7fc640 20 reqs_thread_entry: start 2024-09-12T17:30:56.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.267+0000 7fc8c1da9800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T17:30:56.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.267+0000 7fc8c1da9800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.268+0000 7fc8c1da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:56.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.268+0000 7fc8c1da9800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-12T17:30:56.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.268+0000 7fc8c1da9800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T17:30:56.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.268+0000 7fc8c1da9800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-12T17:30:56.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.268+0000 7fc8c1da9800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.268+0000 7fc8c1da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:56.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.268+0000 7fc8c1da9800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-12T17:30:56.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.268+0000 7fc8c1da9800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T17:30:56.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.268+0000 7fc8c1da9800 10 cache get: name=default.rgw.meta+users.keys+RKFKGUDNYNZVQRRENVMV : miss 2024-09-12T17:30:56.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.268+0000 7fc8c1da9800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.269+0000 7fc8c1da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:56.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.269+0000 7fc8c1da9800 10 cache put: name=default.rgw.meta+users.keys+RKFKGUDNYNZVQRRENVMV info.flags=0x0 2024-09-12T17:30:56.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.269+0000 7fc8c1da9800 10 adding default.rgw.meta+users.keys+RKFKGUDNYNZVQRRENVMV to cache LRU end 2024-09-12T17:30:56.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.269+0000 7fc8c1da9800 10 cache get: name=default.rgw.meta+users.keys+RKFKGUDNYNZVQRRENVMV : hit (negative entry) 2024-09-12T17:30:56.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.269+0000 7fc8c1da9800 10 cache get: name=default.rgw.meta+users.keys+RKFKGUDNYNZVQRRENVMV : hit (negative entry) 2024-09-12T17:30:56.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.270+0000 7fc8c1da9800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T17:30:56.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.270+0000 7fc8c1da9800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T17:30:56.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.270+0000 7fc8c1da9800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T17:30:56.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.271+0000 7fc79effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464364 cookie 94115293245424 notifier 8829 bl.length()=670 2024-09-12T17:30:56.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.271+0000 7fc79effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T17:30:56.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.271+0000 7fc79effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T17:30:56.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.273+0000 7fc8c1da9800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T17:30:56.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.273+0000 7fc8c1da9800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T17:30:56.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.273+0000 7fc8c1da9800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T17:30:56.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.274+0000 7fc79effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464302 cookie 94115293222832 notifier 8829 bl.length()=200 2024-09-12T17:30:56.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.274+0000 7fc79effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T17:30:56.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.274+0000 7fc79effd640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T17:30:56.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.276+0000 7fc8c1da9800 10 cache put: name=default.rgw.meta+users.keys+RKFKGUDNYNZVQRRENVMV info.flags=0x7 2024-09-12T17:30:56.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.276+0000 7fc8c1da9800 10 moving default.rgw.meta+users.keys+RKFKGUDNYNZVQRRENVMV to cache LRU end 2024-09-12T17:30:56.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.276+0000 7fc8c1da9800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:RKFKGUDNYNZVQRRENVMV, ofs0, ns] 2024-09-12T17:30:56.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.277+0000 7fc79e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464377 cookie 94115293228896 notifier 8829 bl.length()=189 2024-09-12T17:30:56.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.277+0000 7fc79e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+RKFKGUDNYNZVQRRENVMV info.flags=0x7 2024-09-12T17:30:56.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.277+0000 7fc79e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+RKFKGUDNYNZVQRRENVMV to cache LRU end 2024-09-12T17:30:56.280 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T17:30:56.280 INFO:teuthology.orchestra.run.smithi067.stdout: "user_id": "tester.client.0", 2024-09-12T17:30:56.281 INFO:teuthology.orchestra.run.smithi067.stdout: "display_name": "Ms. tester.client.0", 2024-09-12T17:30:56.281 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "tester.client.0_test@test.test", 2024-09-12T17:30:56.281 INFO:teuthology.orchestra.run.smithi067.stdout: "suspended": 0, 2024-09-12T17:30:56.281 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T17:30:56.281 INFO:teuthology.orchestra.run.smithi067.stdout: "subusers": [], 2024-09-12T17:30:56.281 INFO:teuthology.orchestra.run.smithi067.stdout: "keys": [ 2024-09-12T17:30:56.281 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-12T17:30:56.281 INFO:teuthology.orchestra.run.smithi067.stdout: "user": "tester.client.0", 2024-09-12T17:30:56.281 INFO:teuthology.orchestra.run.smithi067.stdout: "access_key": "RKFKGUDNYNZVQRRENVMV", 2024-09-12T17:30:56.281 INFO:teuthology.orchestra.run.smithi067.stdout: "secret_key": "NDMwoLR7tq5F+VnVxxYpT8IsDxs5ubDYHAHy1yJoEiT8PTQuOAs6yg==", 2024-09-12T17:30:56.281 INFO:teuthology.orchestra.run.smithi067.stdout: "active": true, 2024-09-12T17:30:56.281 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T17:30:56.270966Z" 2024-09-12T17:30:56.281 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-12T17:30:56.282 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-12T17:30:56.282 INFO:teuthology.orchestra.run.smithi067.stdout: "swift_keys": [], 2024-09-12T17:30:56.282 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": [], 2024-09-12T17:30:56.282 INFO:teuthology.orchestra.run.smithi067.stdout: "op_mask": "read, write, delete", 2024-09-12T17:30:56.282 INFO:teuthology.orchestra.run.smithi067.stdout: "default_placement": "", 2024-09-12T17:30:56.282 INFO:teuthology.orchestra.run.smithi067.stdout: "default_storage_class": "", 2024-09-12T17:30:56.282 INFO:teuthology.orchestra.run.smithi067.stdout: "placement_tags": [], 2024-09-12T17:30:56.282 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T17:30:56.282 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:30:56.283 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:30:56.283 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:30:56.283 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:30:56.283 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:30:56.283 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:30:56.283 INFO:teuthology.orchestra.run.smithi067.stdout: "user_quota": { 2024-09-12T17:30:56.283 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:30:56.283 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:30:56.283 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:30:56.283 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:30:56.283 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:30:56.283 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:30:56.283 INFO:teuthology.orchestra.run.smithi067.stdout: "temp_url_keys": [], 2024-09-12T17:30:56.283 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "rgw", 2024-09-12T17:30:56.284 INFO:teuthology.orchestra.run.smithi067.stdout: "mfa_ids": [], 2024-09-12T17:30:56.284 INFO:teuthology.orchestra.run.smithi067.stdout: "account_id": "", 2024-09-12T17:30:56.284 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-12T17:30:56.284 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T17:30:56.270953Z", 2024-09-12T17:30:56.285 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-12T17:30:56.285 INFO:teuthology.orchestra.run.smithi067.stdout: "group_ids": [] 2024-09-12T17:30:56.285 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T17:30:56.285 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:30:56.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.280+0000 7fc775fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:56.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.282+0000 7fc8c1da9800 20 remove_watcher() i=0 2024-09-12T17:30:56.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.282+0000 7fc8c1da9800 2 removed watcher, disabling cache 2024-09-12T17:30:56.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.283+0000 7fc8c1da9800 20 remove_watcher() i=1 2024-09-12T17:30:56.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.284+0000 7fc8c1da9800 20 remove_watcher() i=2 2024-09-12T17:30:56.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.286+0000 7fc8c1da9800 20 remove_watcher() i=3 2024-09-12T17:30:56.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.287+0000 7fc8c1da9800 20 remove_watcher() i=4 2024-09-12T17:30:56.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.288+0000 7fc8c1da9800 20 remove_watcher() i=5 2024-09-12T17:30:56.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.289+0000 7fc8c1da9800 20 remove_watcher() i=6 2024-09-12T17:30:56.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.290+0000 7fc8c1da9800 20 remove_watcher() i=7 2024-09-12T17:30:56.306 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T17:30:56.306 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-12T17:30:56.340 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-12T17:30:56.340 DEBUG:teuthology.orchestra.run.smithi067:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-12T17:30:56.409 DEBUG:teuthology.orchestra.run.smithi067:> radosgw-admin gc process --include-all 2024-09-12T17:30:56.503 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:56.503 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:56.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.540+0000 7fc92ab2e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.542+0000 7fc92ab2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:56.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.542+0000 7fc92ab2e800 20 realm 2024-09-12T17:30:56.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.542+0000 7fc92ab2e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.542+0000 7fc92ab2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:56.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.542+0000 7fc92ab2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:56.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.542+0000 7fc92ab2e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.542+0000 7fc92ab2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:56.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.542+0000 7fc92ab2e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.543+0000 7fc92ab2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:56.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.543+0000 7fc92ab2e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.544+0000 7fc92ab2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:30:56.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.544+0000 7fc92ab2e800 20 searching for the correct realm 2024-09-12T17:30:56.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.547+0000 7fc9268dd640 0 -- 172.21.15.67:0/4255859896 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7fc92006cf30 msgr2=0x7fc920062eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:30:56.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.551+0000 7fc9268dd640 0 -- 172.21.15.67:0/4255859896 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fc91c08cb10 msgr2=0x7fc91c064910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:56.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.758+0000 7fc92ab2e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:30:56.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.758+0000 7fc92ab2e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:30:56.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.758+0000 7fc92ab2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:56.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.758+0000 7fc92ab2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:56.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.758+0000 7fc92ab2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:56.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.758+0000 7fc92ab2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:56.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.758+0000 7fc92ab2e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.759+0000 7fc92ab2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:56.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.759+0000 7fc92ab2e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.759+0000 7fc92ab2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:56.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.759+0000 7fc92ab2e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.759+0000 7fc92ab2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:30:56.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.759+0000 7fc92ab2e800 20 zone default found 2024-09-12T17:30:56.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.759+0000 7fc92ab2e800 4 Realm: () 2024-09-12T17:30:56.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.759+0000 7fc92ab2e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:30:56.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.759+0000 7fc92ab2e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:30:56.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.759+0000 7fc92ab2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:56.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.759+0000 7fc92ab2e800 20 zonegroup default 2024-09-12T17:30:56.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.759+0000 7fc92ab2e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.760+0000 7fc92ab2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:56.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.760+0000 7fc92ab2e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.760+0000 7fc92ab2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:56.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.760+0000 7fc92ab2e800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.760+0000 7fc92ab2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:56.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.760+0000 7fc92ab2e800 20 started sync module instance, tier type = 2024-09-12T17:30:56.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.760+0000 7fc92ab2e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:30:56.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.770+0000 7fc92ab2e800 20 add_watcher() i=0 2024-09-12T17:30:56.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.770+0000 7fc92ab2e800 20 add_watcher() i=1 2024-09-12T17:30:56.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.770+0000 7fc92ab2e800 20 add_watcher() i=2 2024-09-12T17:30:56.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.770+0000 7fc92ab2e800 20 add_watcher() i=3 2024-09-12T17:30:56.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.770+0000 7fc92ab2e800 20 add_watcher() i=4 2024-09-12T17:30:56.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.770+0000 7fc92ab2e800 20 add_watcher() i=5 2024-09-12T17:30:56.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.770+0000 7fc92ab2e800 20 add_watcher() i=6 2024-09-12T17:30:56.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.771+0000 7fc92ab2e800 20 add_watcher() i=7 2024-09-12T17:30:56.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.771+0000 7fc92ab2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:56.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.772+0000 7fc7dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:56.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.773+0000 7fc92ab2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:56.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.773+0000 7fc92ab2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:56.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.810+0000 7fc757fff640 20 reqs_thread_entry: start 2024-09-12T17:30:56.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.810+0000 7fc92ab2e800 20 init_complete bucket index max shards: 1 2024-09-12T17:30:56.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.811+0000 7fc92ab2e800 20 Filter name: none 2024-09-12T17:30:56.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.811+0000 7fc755ffb640 20 reqs_thread_entry: start 2024-09-12T17:30:56.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.811+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:30:56.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.812+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.813+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.813+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T17:30:56.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.813+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3513701217035585720', time=2024-09-12T19:21:38.946384+0000, chain.objs.size()=4 2024-09-12T17:30:56.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.813+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.13__multipart_foo.2~3uT7PR6jja9bETIaYdYkUy0lP8VEyhp.1 2024-09-12T17:30:56.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.813+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.13__multipart_foo.2~3uT7PR6jja9bETIaYdYkUy0lP8VEyhp.2 2024-09-12T17:30:56.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.813+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.13__multipart_foo.2~3uT7PR6jja9bETIaYdYkUy0lP8VEyhp.3 2024-09-12T17:30:56.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.813+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.13__multipart_foo.2~3uT7PR6jja9bETIaYdYkUy0lP8VEyhp.4 2024-09-12T17:30:56.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.813+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='_zTEKvEkJn3zdlPjTcZwK7UcUvPj1X-Y', time=2024-09-12T19:21:39.080235+0000, chain.objs.size()=3 2024-09-12T17:30:56.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.813+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.Q1WCE_J6kPVGFCa4WxbJ_Q-5e66GLzR_0 2024-09-12T17:30:56.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.813+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.Q1WCE_J6kPVGFCa4WxbJ_Q-5e66GLzR_1 2024-09-12T17:30:56.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.814+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.Q1WCE_J6kPVGFCa4WxbJ_Q-5e66GLzR_2 2024-09-12T17:30:56.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.814+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7213221400524759875', time=2024-09-12T19:23:16.594619+0000, chain.objs.size()=1 2024-09-12T17:30:56.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.814+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20__shadow_.j3NBX-ZOoyuLf-ZpZbHdfrP0-sAHGvC_0 2024-09-12T17:30:56.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.814+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15693536612316588713', time=2024-09-12T19:24:31.104933+0000, chain.objs.size()=1 2024-09-12T17:30:56.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.814+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25__shadow_.KtgDeQiyUjq-P6jakPyCKo5qAjuqKA-_0 2024-09-12T17:30:56.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.814+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1289617736624709468', time=2024-09-12T19:25:45.769227+0000, chain.objs.size()=1 2024-09-12T17:30:56.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.814+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30__shadow_.glBIklw8UuKTH5x1kIQbPio2wqC3P-m_0 2024-09-12T17:30:56.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.815+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.34826019143436268', time=2024-09-12T19:25:45.850348+0000, chain.objs.size()=1 2024-09-12T17:30:56.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.815+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30__shadow_.CkyU0dlyvk2VqTTRCvA5Bszv8vBuMFA_0 2024-09-12T17:30:56.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.815+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4468561787657640319', time=2024-09-12T19:27:02.752296+0000, chain.objs.size()=1 2024-09-12T17:30:56.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.815+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36__shadow_.pORU072W5DcQ8pZrjEe92gCCLKwbhsj_0 2024-09-12T17:30:56.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.816+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11924232802450284447', time=2024-09-12T19:27:35.825013+0000, chain.objs.size()=1 2024-09-12T17:30:56.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.816+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37__shadow_.svYecNDUf09xVoLVxxchdeSG40PeARc_0 2024-09-12T17:30:56.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.816+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7555026536312054167', time=2024-09-12T19:28:13.708758+0000, chain.objs.size()=1 2024-09-12T17:30:56.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.816+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40__shadow_.TrBdF8NnSJOW7Kpp-8bypEWuaVK8D81_0 2024-09-12T17:30:56.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.817+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:56.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.819+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:30:56.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.821+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.821+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.821+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T17:30:56.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.821+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1630404027329535193', time=2024-09-12T19:21:39.153658+0000, chain.objs.size()=1 2024-09-12T17:30:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.821+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.14__shadow_.TSOX58cp_gy3rHgmVPXzG8FuO33Z102_0 2024-09-12T17:30:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.821+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13785760687720410015', time=2024-09-12T19:21:39.204406+0000, chain.objs.size()=1 2024-09-12T17:30:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.821+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.8__shadow_.OphHW-OcFZs94kNuVWHKfOqSfBtw72Z_0 2024-09-12T17:30:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.821+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12060121623153387021', time=2024-09-12T19:23:16.544438+0000, chain.objs.size()=1 2024-09-12T17:30:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.821+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20__shadow_.sKbD3fmeAVE8v0SQBdDrTo_O5vOkZQg_0 2024-09-12T17:30:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.821+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11488248802360844967', time=2024-09-12T19:23:18.781557+0000, chain.objs.size()=1 2024-09-12T17:30:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.821+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21__shadow_.CqPZTokJRhd3DJhHhSwclAmhiiSywze_0 2024-09-12T17:30:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.822+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2699996611413019767', time=2024-09-12T19:23:20.684209+0000, chain.objs.size()=1 2024-09-12T17:30:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.822+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22__shadow_.W0XOwP2LEOFuxrWTY4B47P_dOQujHbX_0 2024-09-12T17:30:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.822+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5773442308222867020', time=2024-09-12T19:23:51.614527+0000, chain.objs.size()=1 2024-09-12T17:30:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.822+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22__shadow_.YczOLlsbQieP6QYbHMewY-GgtlB9b5N_0 2024-09-12T17:30:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.822+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4868889169115900845', time=2024-09-12T19:23:56.862464+0000, chain.objs.size()=1 2024-09-12T17:30:56.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.822+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24__shadow_.cVmSSTkh2P6jCo-aR8TRp2KY-XSwJDy_0 2024-09-12T17:30:56.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.822+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9883969343531198909', time=2024-09-12T19:24:31.102634+0000, chain.objs.size()=1 2024-09-12T17:30:56.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.822+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25__shadow_.foEpR1pAsW1Amtd8n7OnIdZJpkO_41A_0 2024-09-12T17:30:56.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.822+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9637913644354918126', time=2024-09-12T19:25:09.186735+0000, chain.objs.size()=1 2024-09-12T17:30:56.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.822+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28__shadow_.ISmJB2MKAYJSjk5T0CcZh9WIb4oazRF_0 2024-09-12T17:30:56.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.822+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13423367016261332790', time=2024-09-12T19:25:09.251759+0000, chain.objs.size()=1 2024-09-12T17:30:56.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.822+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28__shadow_.Y6ekUBYrFHo4MPv7O7QveLT50MGqfIy_0 2024-09-12T17:30:56.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.822+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11122636094295033113', time=2024-09-12T19:25:45.772019+0000, chain.objs.size()=1 2024-09-12T17:30:56.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.822+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30__shadow_.1RwlAa14NSDwG7RV7tnJQCIf5zwA9fR_0 2024-09-12T17:30:56.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.822+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11463012272543331716', time=2024-09-12T19:25:50.249876+0000, chain.objs.size()=1 2024-09-12T17:30:56.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.822+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32__shadow_.zGmxA7isixUYlnDWLwbfzzrxniKe92W_0 2024-09-12T17:30:56.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.823+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12832257715344815174', time=2024-09-12T19:26:27.038943+0000, chain.objs.size()=1 2024-09-12T17:30:56.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.823+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34__shadow_.FPtLYEyHbzEVHU-iO-Vbf_8Ek2ht1JS_0 2024-09-12T17:30:56.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.824+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16091781781630470090', time=2024-09-12T19:27:02.757222+0000, chain.objs.size()=1 2024-09-12T17:30:56.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.824+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36__shadow_.E6sCK44S_AjfwgecyohOCgy3-u9UyT9_0 2024-09-12T17:30:56.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.824+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5474826608471216693', time=2024-09-12T19:27:02.795026+0000, chain.objs.size()=1 2024-09-12T17:30:56.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.824+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36__shadow_.KIv4M5Vq9wB-vULuf-1SXpESQ7UdXFm_0 2024-09-12T17:30:56.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.824+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6575373644193722526', time=2024-09-12T19:27:35.862374+0000, chain.objs.size()=1 2024-09-12T17:30:56.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.824+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37__shadow_.bDJaoJzWoWFbC7y_1cGxEQaMvHrWNG5_0 2024-09-12T17:30:56.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.824+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8641959482174440741', time=2024-09-12T19:27:40.426634+0000, chain.objs.size()=1 2024-09-12T17:30:56.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.824+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39__shadow_.gtneBgfo5zqZvLctrJLa1QdsvYTIvmv_0 2024-09-12T17:30:56.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.824+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12565737964655544121', time=2024-09-12T19:27:40.427352+0000, chain.objs.size()=1 2024-09-12T17:30:56.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.824+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39__shadow_.BacKqkEYDzBX0sALo5Ysv-ubEAQjwRp_0 2024-09-12T17:30:56.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.825+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:56.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.828+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:30:56.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.830+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.830+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.830+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T17:30:56.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.830+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14078759340189364716', time=2024-09-12T19:21:38.880665+0000, chain.objs.size()=1 2024-09-12T17:30:56.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.830+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.5__shadow_.hp_8d2_BQaDMUJMh2p-FelBwk5dgV9Q_0 2024-09-12T17:30:56.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.830+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9995812663938111498', time=2024-09-12T19:21:39.076540+0000, chain.objs.size()=5 2024-09-12T17:30:56.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.830+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-LUKEWARM.2~9omk0vlP-uGSsfapRNknN8q4WBMrZOv.1 2024-09-12T17:30:56.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.830+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_foo-LUKEWARM.2~9omk0vlP-uGSsfapRNknN8q4WBMrZOv.1_1 2024-09-12T17:30:56.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.831+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-LUKEWARM.2~9omk0vlP-uGSsfapRNknN8q4WBMrZOv.2 2024-09-12T17:30:56.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.831+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_foo-LUKEWARM.2~9omk0vlP-uGSsfapRNknN8q4WBMrZOv.2_1 2024-09-12T17:30:56.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.831+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-LUKEWARM.2~9omk0vlP-uGSsfapRNknN8q4WBMrZOv.3 2024-09-12T17:30:56.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.831+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1824544250946438028', time=2024-09-12T19:23:16.547658+0000, chain.objs.size()=1 2024-09-12T17:30:56.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.831+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20__shadow_.LemFk8-WzsRPo_oiyracvc2fcrUy2tB_0 2024-09-12T17:30:56.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.831+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8688807266837005898', time=2024-09-12T19:23:51.590080+0000, chain.objs.size()=1 2024-09-12T17:30:56.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.831+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22__shadow_.QJL3eKgwqr2jmstaTQ-uHBXiDMSU7O5_0 2024-09-12T17:30:56.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.831+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12555482423769071830', time=2024-09-12T19:24:31.093732+0000, chain.objs.size()=1 2024-09-12T17:30:56.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.831+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25__shadow_.K10lN-wbe1JVKdmobKAuM1u2K4-tIu__0 2024-09-12T17:30:56.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.831+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.710007843217116215', time=2024-09-12T19:25:11.943600+0000, chain.objs.size()=1 2024-09-12T17:30:56.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.831+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29__shadow_.wJ_eoEHiOolVl-AAVEU58He40nlHaHY_0 2024-09-12T17:30:56.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.831+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.249065060281269045', time=2024-09-12T19:25:11.944824+0000, chain.objs.size()=1 2024-09-12T17:30:56.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.831+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29__shadow_.UAlRvEibfsgEEZ3awiapY1Xg7mseE4s_0 2024-09-12T17:30:56.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.831+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10572046074595757974', time=2024-09-12T19:25:11.946536+0000, chain.objs.size()=1 2024-09-12T17:30:56.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.831+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29__shadow_.KP8zO6ZgZ6mN0GQVHW0SVad-UdGXAkR_0 2024-09-12T17:30:56.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.832+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3029907105118017764', time=2024-09-12T19:25:50.246172+0000, chain.objs.size()=1 2024-09-12T17:30:56.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.832+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32__shadow_.h2Z7hbLw3YFdncvrJKhWXZZoowDwNcF_0 2024-09-12T17:30:56.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.833+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14969411786173237899', time=2024-09-12T19:26:22.873036+0000, chain.objs.size()=1 2024-09-12T17:30:56.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.833+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33__shadow_.gWOYPVr4wblgRpNKDdk2FY6JNdP3hso_0 2024-09-12T17:30:56.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.833+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8026018440243314009', time=2024-09-12T19:27:00.265011+0000, chain.objs.size()=1 2024-09-12T17:30:56.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.833+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35__shadow_.QocJ81p9J1BJfYCVHQF_AjGrK6Nui7A_0 2024-09-12T17:30:56.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.833+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5602695943069678138', time=2024-09-12T19:27:00.335792+0000, chain.objs.size()=1 2024-09-12T17:30:56.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.833+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35__shadow_.Z6C3q8mECs9-xFwNPTbUdX3L1-E8-uc_0 2024-09-12T17:30:56.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.833+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17884412457842999416', time=2024-09-12T19:27:00.350811+0000, chain.objs.size()=1 2024-09-12T17:30:56.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.833+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35__shadow_.lmXbXHmxZD9cKSHWrp9RrIuu6MfTiDw_0 2024-09-12T17:30:56.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.833+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11903051535178435372', time=2024-09-12T19:27:02.790849+0000, chain.objs.size()=1 2024-09-12T17:30:56.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.833+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36__shadow_.Y7tzHzCeZrsVVLkKsElFQRZhXMfRqsv_0 2024-09-12T17:30:56.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.833+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14693343209079104578', time=2024-09-12T19:27:40.421128+0000, chain.objs.size()=1 2024-09-12T17:30:56.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.833+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39__shadow_.7suDlJ0hgNNbUo_4GKayMEZYVJ14jMY_0 2024-09-12T17:30:56.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.833+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9086754210615478712', time=2024-09-12T19:27:40.480166+0000, chain.objs.size()=1 2024-09-12T17:30:56.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.833+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39__shadow_.gCsPtd4kpw7osQSTmIjEwRaOWzwcOMs_0 2024-09-12T17:30:56.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.835+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:56.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.837+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:30:56.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.838+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.839+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.839+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T17:30:56.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.839+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14087454728439116224', time=2024-09-12T19:21:39.064796+0000, chain.objs.size()=5 2024-09-12T17:30:56.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.839+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-FROZEN.2~jcci9n22BHmTremR87DVrKfYQXLHZlC.1 2024-09-12T17:30:56.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.839+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_foo-FROZEN.2~jcci9n22BHmTremR87DVrKfYQXLHZlC.1_1 2024-09-12T17:30:56.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.839+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-FROZEN.2~jcci9n22BHmTremR87DVrKfYQXLHZlC.2 2024-09-12T17:30:56.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.839+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_foo-FROZEN.2~jcci9n22BHmTremR87DVrKfYQXLHZlC.2_1 2024-09-12T17:30:56.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.839+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-FROZEN.2~jcci9n22BHmTremR87DVrKfYQXLHZlC.3 2024-09-12T17:30:56.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.839+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='_qeQfEFvWvHjjl-itqLWYbXg4kKnL1FV', time=2024-09-12T19:21:39.098168+0000, chain.objs.size()=1 2024-09-12T17:30:56.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.839+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.4NRnQJ0A6QrhfR9OS5h2CJJ4sYOs9mz_0 2024-09-12T17:30:56.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.839+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17846390101172633535', time=2024-09-12T19:23:51.558300+0000, chain.objs.size()=1 2024-09-12T17:30:56.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.839+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22__shadow_.2IRO1X819Gqd8fLvsdX-NEQF49U3e6R_0 2024-09-12T17:30:56.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.839+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5157189051938380883', time=2024-09-12T19:23:56.791400+0000, chain.objs.size()=1 2024-09-12T17:30:56.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.839+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24__shadow_.zr5TAP8QRfB4mkTSkiVFRS0cQ8L5lt8_0 2024-09-12T17:30:56.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.839+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16715544737477044692', time=2024-09-12T19:25:09.230585+0000, chain.objs.size()=1 2024-09-12T17:30:56.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.839+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28__shadow_.DGirxtpRZGtww-NtHSGPs1T8q4-Qqe-_0 2024-09-12T17:30:56.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.839+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1481277921490814452', time=2024-09-12T19:25:48.290551+0000, chain.objs.size()=1 2024-09-12T17:30:56.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.839+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31__shadow_.jtYn8hH73bOhuc3D7iJFU86jUhNbsqK_0 2024-09-12T17:30:56.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.839+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5558103950865590860', time=2024-09-12T19:25:48.339137+0000, chain.objs.size()=1 2024-09-12T17:30:56.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.839+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31__shadow_.iODQpY_1GOdlGogDILPPk2XfFie8qRE_0 2024-09-12T17:30:56.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.839+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7163693423626642296', time=2024-09-12T19:26:22.849887+0000, chain.objs.size()=1 2024-09-12T17:30:56.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.839+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33__shadow_.zRyXjdRU7SKivqMh50bBpAGbQ_a5X6P_0 2024-09-12T17:30:56.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.841+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6500056385893975861', time=2024-09-12T19:26:22.881209+0000, chain.objs.size()=1 2024-09-12T17:30:56.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.841+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33__shadow_.f-N92Mw5WZGX_rWHRSU--HEFOg69v3-_0 2024-09-12T17:30:56.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.841+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8281357279215861935', time=2024-09-12T19:26:22.915708+0000, chain.objs.size()=1 2024-09-12T17:30:56.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.841+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33__shadow_.Ypq2r_0n_THJbxbHS_DoxEV7cnAIj_q_0 2024-09-12T17:30:56.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.841+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.646625340160644238', time=2024-09-12T19:26:22.922192+0000, chain.objs.size()=1 2024-09-12T17:30:56.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.841+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33__shadow_.iBbhU4sEEbaIGkehP8lAGWgzWhvXFVl_0 2024-09-12T17:30:56.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.841+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13177773628835107006', time=2024-09-12T19:27:00.310482+0000, chain.objs.size()=1 2024-09-12T17:30:56.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.841+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35__shadow_.6tBqtI0ozOw8d19MGXMCph5YYehQg6d_0 2024-09-12T17:30:56.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.842+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2608543023970937283', time=2024-09-12T19:27:35.819404+0000, chain.objs.size()=1 2024-09-12T17:30:56.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.842+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37__shadow_.T2NqzFK8F5gbgi8VFul0J6itse3fldI_0 2024-09-12T17:30:56.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.843+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:56.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.845+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:30:56.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.846+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.847+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.847+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T17:30:56.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.847+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5652683790009818849', time=2024-09-12T19:23:53.728747+0000, chain.objs.size()=1 2024-09-12T17:30:56.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.847+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23__shadow_.Rd_QCTsXQbChGe-YyvX7PTXM_Sqd628_0 2024-09-12T17:30:56.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.847+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2389291158425382218', time=2024-09-12T19:23:56.805369+0000, chain.objs.size()=1 2024-09-12T17:30:56.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.847+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24__shadow_.IZEB0SNhlUTOKnyRfE6lgtGfmjhrnIE_0 2024-09-12T17:30:56.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.847+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10484007498209249540', time=2024-09-12T19:24:31.095201+0000, chain.objs.size()=1 2024-09-12T17:30:56.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.847+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25__shadow_.ycZrX49XTM3OI2rBzv_v14wR1YS0SVE_0 2024-09-12T17:30:56.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.847+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4027004218579659844', time=2024-09-12T19:24:36.161361+0000, chain.objs.size()=1 2024-09-12T17:30:56.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.847+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27__shadow_.xuKJ5MgrCKbThfQ3922eFRepjSiU_vi_0 2024-09-12T17:30:56.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.847+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1893147033396910258', time=2024-09-12T19:25:50.246558+0000, chain.objs.size()=1 2024-09-12T17:30:56.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.847+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32__shadow_.3EygmHiGMIoBdZDcV1Vwck0k8tfhNQW_0 2024-09-12T17:30:56.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.847+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6249491133336151052', time=2024-09-12T19:26:22.871589+0000, chain.objs.size()=1 2024-09-12T17:30:56.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.847+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33__shadow_.7oKwnsUT922moTFoR2DOLvfgxEzMszL_0 2024-09-12T17:30:56.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.847+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12287375502739897607', time=2024-09-12T19:26:27.021801+0000, chain.objs.size()=1 2024-09-12T17:30:56.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.847+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34__shadow_.afSRz1pztK-kA9DaXVpShhiBmH7-u_J_0 2024-09-12T17:30:56.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.847+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13140727841553291934', time=2024-09-12T19:30:20.804674+0000, chain.objs.size()=1 2024-09-12T17:30:56.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.847+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18__shadow_.GN3RMWhRgoJR9THcnta0uBUM4L5ysUU_0 2024-09-12T17:30:56.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.849+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:56.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.851+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:30:56.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.853+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.853+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.854+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T17:30:56.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.854+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2299060705636378544', time=2024-09-12T19:21:39.033342+0000, chain.objs.size()=1 2024-09-12T17:30:56.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.854+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.4oZkQhZf5VHqMdHbl0KkU9B9T2uTiuv_0 2024-09-12T17:30:56.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.854+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6185749009853802889', time=2024-09-12T19:21:39.101722+0000, chain.objs.size()=3 2024-09-12T17:30:56.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.854+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-STANDARD.2~wryHCHt-Fgh1VcKvrGO7SlxzddO7SzP.1 2024-09-12T17:30:56.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.854+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-STANDARD.2~wryHCHt-Fgh1VcKvrGO7SlxzddO7SzP.2 2024-09-12T17:30:56.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.854+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-STANDARD.2~wryHCHt-Fgh1VcKvrGO7SlxzddO7SzP.3 2024-09-12T17:30:56.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.854+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10335877123905621727', time=2024-09-12T19:21:39.128970+0000, chain.objs.size()=3 2024-09-12T17:30:56.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.854+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.15__multipart_foo-STANDARD.2~pyvvfLpD-a8XTCzdMt4QqfPCJCzTSYf.1 2024-09-12T17:30:56.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.854+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.15__multipart_foo-STANDARD.2~pyvvfLpD-a8XTCzdMt4QqfPCJCzTSYf.2 2024-09-12T17:30:56.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.854+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.15__multipart_foo-STANDARD.2~pyvvfLpD-a8XTCzdMt4QqfPCJCzTSYf.3 2024-09-12T17:30:56.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.854+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1468243804930553256', time=2024-09-12T19:21:39.200811+0000, chain.objs.size()=1 2024-09-12T17:30:56.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.854+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.8__shadow_.MA7NbW5vPp5jCVthwtcxIWNl1TP0EYv_0 2024-09-12T17:30:56.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.854+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6688935684375787706', time=2024-09-12T19:21:39.207984+0000, chain.objs.size()=1 2024-09-12T17:30:56.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.854+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.8__shadow_.J-mhakxg1ga6A76iPINmaTctTpLUB8V_0 2024-09-12T17:30:56.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.854+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11345237951024963553', time=2024-09-12T19:23:51.557186+0000, chain.objs.size()=1 2024-09-12T17:30:56.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.854+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22__shadow_.GkoBKJYmfWbXOETP4xnd3RKGL4ze7v__0 2024-09-12T17:30:56.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.854+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1181708725095463542', time=2024-09-12T19:23:54.697185+0000, chain.objs.size()=1 2024-09-12T17:30:56.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.854+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23__shadow_.10wKSEdDVuL21EfLAxVtdixw1u0hC8r_0 2024-09-12T17:30:56.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.854+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2248994726187256334', time=2024-09-12T19:24:33.841315+0000, chain.objs.size()=1 2024-09-12T17:30:56.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.854+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26__shadow_.9n-62wM56EKUHtPbevknEnvdi5LWlLF_0 2024-09-12T17:30:56.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.855+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1399632632195811155', time=2024-09-12T19:24:36.116090+0000, chain.objs.size()=1 2024-09-12T17:30:56.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.855+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27__shadow_.FLOFiRpZZDiBzBYSPgMiK-Sl_xjBDQU_0 2024-09-12T17:30:56.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.856+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10122586298707875606', time=2024-09-12T19:24:36.160790+0000, chain.objs.size()=1 2024-09-12T17:30:56.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.856+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27__shadow_.VOcpYeCdhdr3pTx6BlhE8n19RjRYpx3_0 2024-09-12T17:30:56.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.856+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2286709732592772049', time=2024-09-12T19:25:09.273401+0000, chain.objs.size()=1 2024-09-12T17:30:56.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.856+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28__shadow_.n8Wwx85XKg9AnM-2v3KiviXW075QYxl_0 2024-09-12T17:30:56.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.856+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3692034142939576390', time=2024-09-12T19:25:11.994573+0000, chain.objs.size()=1 2024-09-12T17:30:56.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.856+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29__shadow_.Mh0wEU3uHzYRLz7Yb0pAmpDA8PoXbSt_0 2024-09-12T17:30:56.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.856+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12579084918344296092', time=2024-09-12T19:25:45.794842+0000, chain.objs.size()=1 2024-09-12T17:30:56.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.856+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30__shadow_.1HMkd4ODSLkIuRVpdyEI88DurtOxHbp_0 2024-09-12T17:30:56.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.856+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17427393342920074294', time=2024-09-12T19:27:35.772796+0000, chain.objs.size()=1 2024-09-12T17:30:56.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.856+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37__shadow_.qKVjgBv3foGUqH6XDt8Hmt1TzB43wgK_0 2024-09-12T17:30:56.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.856+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16755435735224221612', time=2024-09-12T19:27:38.493019+0000, chain.objs.size()=1 2024-09-12T17:30:56.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.856+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38__shadow_.-pbGi-gYe4I8BwrwfeYXCScOW_nCDy2_0 2024-09-12T17:30:56.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.856+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9737427460280252861', time=2024-09-12T19:27:40.469418+0000, chain.objs.size()=1 2024-09-12T17:30:56.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.856+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39__shadow_.hv7ZhIceqEuhmEdO4YraZ_qdAcRFlZ7_0 2024-09-12T17:30:56.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.856+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12590921266526812508', time=2024-09-12T19:27:40.518578+0000, chain.objs.size()=1 2024-09-12T17:30:56.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.856+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39__shadow_.oAt6pQsmEjbl7skXyYX8bj5wA5-wSgo_0 2024-09-12T17:30:56.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.856+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9263029004297703336', time=2024-09-12T19:30:20.817124+0000, chain.objs.size()=1 2024-09-12T17:30:56.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.856+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18__shadow_.HNDzG3-TEB5SDqrrZ5MT60Im6dSrMXh_0 2024-09-12T17:30:56.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.858+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:56.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.860+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:30:56.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.862+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.862+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.863+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T17:30:56.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.863+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1146327100339792596', time=2024-09-12T19:21:38.896261+0000, chain.objs.size()=1 2024-09-12T17:30:56.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.863+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.5__shadow_.o2TDqNbg4lKcUtIh9RinIdFju8slNOY_0 2024-09-12T17:30:56.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.863+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14217596378364557736', time=2024-09-12T19:23:16.590263+0000, chain.objs.size()=1 2024-09-12T17:30:56.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.863+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20__shadow_.1cy7dUzbPJiALr6zxF4ADb2aIbr6c7y_0 2024-09-12T17:30:56.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.863+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5831651078957674325', time=2024-09-12T19:23:16.591020+0000, chain.objs.size()=1 2024-09-12T17:30:56.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.863+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20__shadow_.Gn0t_0qsF2nMfp5wpnLv2CE2gQtLspl_0 2024-09-12T17:30:56.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.863+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4768519610767502893', time=2024-09-12T19:23:51.558143+0000, chain.objs.size()=1 2024-09-12T17:30:56.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.863+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22__shadow_.F0O2QbM8bwpVEF2j6eQPhbFTv4799Lx_0 2024-09-12T17:30:56.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.863+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15616748397811453426', time=2024-09-12T19:24:36.111357+0000, chain.objs.size()=1 2024-09-12T17:30:56.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.863+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27__shadow_.EO6l5r0U7DEpCZItDWTKUGyQoriJJ4v_0 2024-09-12T17:30:56.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.863+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6516172159161958758', time=2024-09-12T19:24:36.132832+0000, chain.objs.size()=1 2024-09-12T17:30:56.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.863+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27__shadow_.WA0kU_ABrU-IzstWXBQRFgTDjrKMKCQ_0 2024-09-12T17:30:56.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.863+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4815050761520776371', time=2024-09-12T19:25:09.203389+0000, chain.objs.size()=1 2024-09-12T17:30:56.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.863+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28__shadow_.m-eibrS7NPK3auVONg3NGVW_dpMyNKw_0 2024-09-12T17:30:56.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.863+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2661647070163619812', time=2024-09-12T19:25:09.220853+0000, chain.objs.size()=1 2024-09-12T17:30:56.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.863+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28__shadow_.krP53nUlY5y2g0U91lssz7v69Lhihm5_0 2024-09-12T17:30:56.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.863+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1446335935175415731', time=2024-09-12T19:25:09.221685+0000, chain.objs.size()=1 2024-09-12T17:30:56.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.863+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28__shadow_.kCLXrRrV7Y9HL8QnXTFiErMW9OF2K3k_0 2024-09-12T17:30:56.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.863+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6816542259408805077', time=2024-09-12T19:27:00.316619+0000, chain.objs.size()=1 2024-09-12T17:30:56.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.863+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35__shadow_.KNv8PINWLI8uEyKbi5fLHC6NAYjJSH2_0 2024-09-12T17:30:56.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.863+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2750166504114078547', time=2024-09-12T19:27:40.483084+0000, chain.objs.size()=1 2024-09-12T17:30:56.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.863+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39__shadow_.6YH_UMhWI5NT1vC0AvrY99jFYUcK50a_0 2024-09-12T17:30:56.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.863+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5457923726894648459', time=2024-09-12T19:28:13.741333+0000, chain.objs.size()=1 2024-09-12T17:30:56.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.863+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40__shadow_.-oKkoOCd4Wmz0B3hJfq8V3h495m75K0_0 2024-09-12T17:30:56.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.866+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:56.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.868+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:30:56.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.869+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.870+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.870+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T17:30:56.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.870+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7571368694782825030', time=2024-09-12T19:21:38.884646+0000, chain.objs.size()=1 2024-09-12T17:30:56.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.870+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.5__shadow_.SwLyaE3YTbAJNwdkPU-7qpvH1qq5MiI_0 2024-09-12T17:30:56.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.870+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18260169930131899203', time=2024-09-12T19:21:38.911625+0000, chain.objs.size()=1 2024-09-12T17:30:56.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.870+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.5__shadow_.q8HUnbilUsAvKTSpo7eFDUZiXDxY2YY_0 2024-09-12T17:30:56.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.870+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17049872180049035643', time=2024-09-12T19:21:39.060900+0000, chain.objs.size()=5 2024-09-12T17:30:56.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.870+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-FROZEN.2~jcci9n22BHmTremR87DVrKfYQXLHZlC.1 2024-09-12T17:30:56.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.870+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_foo-FROZEN.2~jcci9n22BHmTremR87DVrKfYQXLHZlC.1_1 2024-09-12T17:30:56.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.870+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-FROZEN.2~jcci9n22BHmTremR87DVrKfYQXLHZlC.2 2024-09-12T17:30:56.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.870+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_foo-FROZEN.2~jcci9n22BHmTremR87DVrKfYQXLHZlC.2_1 2024-09-12T17:30:56.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.870+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-FROZEN.2~jcci9n22BHmTremR87DVrKfYQXLHZlC.3 2024-09-12T17:30:56.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.870+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5184212680092970698', time=2024-09-12T19:23:16.544325+0000, chain.objs.size()=1 2024-09-12T17:30:56.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.870+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20__shadow_.gZkzjMtldPLtuJUDcE6dPEz8TtRtfUv_0 2024-09-12T17:30:56.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.870+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11818795604745084576', time=2024-09-12T19:23:16.618609+0000, chain.objs.size()=1 2024-09-12T17:30:56.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.870+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20__shadow_.4XVxTkSLgWzAeUtFNL27Ny8GJdj5QOa_0 2024-09-12T17:30:56.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.870+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7625082777134223975', time=2024-09-12T19:23:18.723663+0000, chain.objs.size()=1 2024-09-12T17:30:56.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.870+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21__shadow_.PDOZxzdE19saoPW8bTnvpAH39AYQLxU_0 2024-09-12T17:30:56.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.870+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13083525095323282398', time=2024-09-12T19:23:54.636848+0000, chain.objs.size()=1 2024-09-12T17:30:56.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.870+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23__shadow_.8OvcPEc_xWWKwyfzGEBekmZcZXMoTIZ_0 2024-09-12T17:30:56.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.870+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6205817156773263085', time=2024-09-12T19:23:54.638412+0000, chain.objs.size()=1 2024-09-12T17:30:56.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.870+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23__shadow_.mmQVnAYeewzNvJOGR7s8lGzOn13Q5Hs_0 2024-09-12T17:30:56.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.872+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17202955933800346251', time=2024-09-12T19:24:31.106134+0000, chain.objs.size()=1 2024-09-12T17:30:56.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.872+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25__shadow_.2AEIBPLAoakgpAU4KsEfItugewE5xFX_0 2024-09-12T17:30:56.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.872+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2793169178477826461', time=2024-09-12T19:24:32.894824+0000, chain.objs.size()=1 2024-09-12T17:30:56.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.872+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26__shadow_.tlJ8m9-eghdSMmGK1gKFYKfaxU2y8q3_0 2024-09-12T17:30:56.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.872+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6119592511742008256', time=2024-09-12T19:24:33.813975+0000, chain.objs.size()=1 2024-09-12T17:30:56.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.872+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26__shadow_.krT3I_j_tH4bgjE-XZ8wuswSaWJrdjq_0 2024-09-12T17:30:56.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.873+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8790522292201804611', time=2024-09-12T19:25:11.950496+0000, chain.objs.size()=1 2024-09-12T17:30:56.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.873+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29__shadow_.erUOy64XGXpr97l_ZbbPfrrx3FoDge-_0 2024-09-12T17:30:56.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.873+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3830429777429124819', time=2024-09-12T19:25:48.294526+0000, chain.objs.size()=1 2024-09-12T17:30:56.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.873+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31__shadow_.8V3sHWoZedUYwTKArJ5SigYH_O47wGC_0 2024-09-12T17:30:56.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.873+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8737115652457775311', time=2024-09-12T19:25:48.336663+0000, chain.objs.size()=1 2024-09-12T17:30:56.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.873+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31__shadow_.w75xe-o5pfws13tb-XEYen_36iCMEXn_0 2024-09-12T17:30:56.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.873+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6181954788873203581', time=2024-09-12T19:25:50.271392+0000, chain.objs.size()=1 2024-09-12T17:30:56.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.873+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32__shadow_.8y1UKNavw0humQjrd0Riuz-3WV1A3lA_0 2024-09-12T17:30:56.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.873+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15506994616820448815', time=2024-09-12T19:26:22.904439+0000, chain.objs.size()=1 2024-09-12T17:30:56.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.873+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33__shadow_.twpydURW02x0itTdqykfSxM27iS7OSY_0 2024-09-12T17:30:56.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.873+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2850363963923656726', time=2024-09-12T19:26:27.022008+0000, chain.objs.size()=1 2024-09-12T17:30:56.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.873+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34__shadow_.AkTR9OJ3nCF3saWrUL4H9GJ7av8TNpT_0 2024-09-12T17:30:56.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.873+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2200934157823779021', time=2024-09-12T19:27:38.530833+0000, chain.objs.size()=1 2024-09-12T17:30:56.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.873+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38__shadow_.BW43th8tlc-JqzFYOvXlMm5_CWweyk1_0 2024-09-12T17:30:56.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.873+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10041319317387690501', time=2024-09-12T19:27:40.449683+0000, chain.objs.size()=1 2024-09-12T17:30:56.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.873+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39__shadow_.jzbuJrlYvSnjrBMSRibIQHwpQ1cffXo_0 2024-09-12T17:30:56.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.875+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:56.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.877+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:30:56.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.878+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.879+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.879+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T17:30:56.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.879+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10568266353538217322', time=2024-09-12T19:21:38.900285+0000, chain.objs.size()=1 2024-09-12T17:30:56.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.879+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.5__shadow_.frRcT0P0WU5W5u3GERP34ZsLMk6afn4_0 2024-09-12T17:30:56.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.879+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7460012008716098118', time=2024-09-12T19:21:39.044709+0000, chain.objs.size()=1 2024-09-12T17:30:56.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.879+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.4oZkQhZf5VHqMdHbl0KkU9B9T2uTiuv_0 2024-09-12T17:30:56.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.879+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2108792315813963696', time=2024-09-12T19:23:16.590268+0000, chain.objs.size()=1 2024-09-12T17:30:56.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.879+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20__shadow_.epRhmsPgSY5pznctuLALnD4hKjNl3Pr_0 2024-09-12T17:30:56.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.879+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10104138805955364950', time=2024-09-12T19:23:16.624156+0000, chain.objs.size()=1 2024-09-12T17:30:56.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.879+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20__shadow_.tnACNFdiMUC8m9duYRPzeeptMFe501L_0 2024-09-12T17:30:56.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.879+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8157385312192274647', time=2024-09-12T19:23:18.671774+0000, chain.objs.size()=1 2024-09-12T17:30:56.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.879+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21__shadow_.Mie2vyiXr526kPpjVeifF02f3zo21qM_0 2024-09-12T17:30:56.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.879+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8070915532131776709', time=2024-09-12T19:23:54.667102+0000, chain.objs.size()=1 2024-09-12T17:30:56.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.879+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23__shadow_.gzBB33uJlpR8hM6rilm509S6qXugYpd_0 2024-09-12T17:30:56.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.879+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12288706944430839825', time=2024-09-12T19:23:56.834441+0000, chain.objs.size()=1 2024-09-12T17:30:56.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.879+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24__shadow_.Yka10ID3DN6qGZ1t-P5emuvATAM5z30_0 2024-09-12T17:30:56.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.879+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14321009827477727737', time=2024-09-12T19:24:33.780241+0000, chain.objs.size()=1 2024-09-12T17:30:56.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.879+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26__shadow_.IDfMQKEH-lNweqKtSxGvgIuDfGh69sK_0 2024-09-12T17:30:56.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.879+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16373929964719906132', time=2024-09-12T19:24:33.841979+0000, chain.objs.size()=1 2024-09-12T17:30:56.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.879+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26__shadow_.90hh4GrMjhDBjxNirARAPDpHbeGSGoJ_0 2024-09-12T17:30:56.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.879+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15251081662929244998', time=2024-09-12T19:25:09.182926+0000, chain.objs.size()=1 2024-09-12T17:30:56.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.879+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28__shadow_.-WN7yLWtIA7jNdPjVlWu0T7OWWmd3U9_0 2024-09-12T17:30:56.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.879+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.29091520765948359', time=2024-09-12T19:25:14.718848+0000, chain.objs.size()=1 2024-09-12T17:30:56.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.879+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30__shadow_.nhNOBaDreNF_7OQXpsUSGOZjiDyftLH_0 2024-09-12T17:30:56.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.879+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5312733542706400972', time=2024-09-12T19:26:22.873498+0000, chain.objs.size()=1 2024-09-12T17:30:56.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.879+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33__shadow_.-4ULT6gq82qsUHptASGO3mzHkhS43LS_0 2024-09-12T17:30:56.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.881+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5029781949632440870', time=2024-09-12T19:26:27.070754+0000, chain.objs.size()=1 2024-09-12T17:30:56.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.881+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34__shadow_.zH52xTvKTZ1UPtNFhzQ8wz9V8ZmxZRU_0 2024-09-12T17:30:56.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.881+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15744884170643634934', time=2024-09-12T19:27:02.744522+0000, chain.objs.size()=1 2024-09-12T17:30:56.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.881+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36__shadow_.uLuYh_VCmJ1jkpItAXbpvuDIruyDQtQ_0 2024-09-12T17:30:56.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.882+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:56.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.884+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:30:56.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.885+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.886+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.886+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T17:30:56.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.886+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6469624487687717157', time=2024-09-12T19:21:38.966351+0000, chain.objs.size()=4 2024-09-12T17:30:56.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.886+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.11__multipart_foo.2~0q9CtjnYQ9FGhYAolgUkwrKYzY3VLL6.1 2024-09-12T17:30:56.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.886+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.11__multipart_foo.2~0q9CtjnYQ9FGhYAolgUkwrKYzY3VLL6.2 2024-09-12T17:30:56.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.886+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.11__multipart_foo.2~0q9CtjnYQ9FGhYAolgUkwrKYzY3VLL6.3 2024-09-12T17:30:56.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.886+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.11__multipart_foo.2~0q9CtjnYQ9FGhYAolgUkwrKYzY3VLL6.4 2024-09-12T17:30:56.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.886+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='_uoNvnUIwZFfiI8hwZ2bRReFlHCMR-vF', time=2024-09-12T19:21:39.036904+0000, chain.objs.size()=1 2024-09-12T17:30:56.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.886+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.Iewpu2PPZx-qpH1xQW1tXRAgV3r8DGj_0 2024-09-12T17:30:56.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.886+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16344864417971953614', time=2024-09-12T19:21:39.149569+0000, chain.objs.size()=3 2024-09-12T17:30:56.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.886+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.14__shadow_.HNNvGe91DxxdX8mcMurXRUMtFHClHoF_0 2024-09-12T17:30:56.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.886+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.14__shadow_.HNNvGe91DxxdX8mcMurXRUMtFHClHoF_1 2024-09-12T17:30:56.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.886+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.14__shadow_.HNNvGe91DxxdX8mcMurXRUMtFHClHoF_2 2024-09-12T17:30:56.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.886+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15647105425561901932', time=2024-09-12T19:23:18.709503+0000, chain.objs.size()=1 2024-09-12T17:30:56.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.886+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21__shadow_.LS2fE2-42JG8sCaijmd2W14eJnL_BXH_0 2024-09-12T17:30:56.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.886+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17700128277750780929', time=2024-09-12T19:23:18.781573+0000, chain.objs.size()=1 2024-09-12T17:30:56.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.886+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21__shadow_.LsqvQddOA_8wIeQvwDGRg9RGgavrs1A_0 2024-09-12T17:30:56.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.886+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17021858571365549228', time=2024-09-12T19:24:33.777218+0000, chain.objs.size()=1 2024-09-12T17:30:56.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.886+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26__shadow_.FCUXo_lEAj7lJ3xTrU4qftZsf4icDev_0 2024-09-12T17:30:56.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.886+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15200796303423829314', time=2024-09-12T19:24:33.797634+0000, chain.objs.size()=1 2024-09-12T17:30:56.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.886+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26__shadow_.OIO5djS5mKiGX-sWANJzZGV-ftKc9-E_0 2024-09-12T17:30:56.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.888+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8043485216783865501', time=2024-09-12T19:25:45.830141+0000, chain.objs.size()=1 2024-09-12T17:30:56.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.888+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30__shadow_.4bHLN_6t39MkIsXMrzEivz3jjyAkFOV_0 2024-09-12T17:30:56.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.889+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11387581246112069664', time=2024-09-12T19:25:45.830798+0000, chain.objs.size()=1 2024-09-12T17:30:56.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.889+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30__shadow_.pIXBXzPzfazvN8AK-WEDN3sLAMZb1MT_0 2024-09-12T17:30:56.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.889+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13581662364914811719', time=2024-09-12T19:25:50.324928+0000, chain.objs.size()=1 2024-09-12T17:30:56.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.889+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32__shadow_.jXwFiyjehsm3c6GrZiIoQNT5YA9AXTg_0 2024-09-12T17:30:56.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.889+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9846783006639719087', time=2024-09-12T19:26:22.927480+0000, chain.objs.size()=1 2024-09-12T17:30:56.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.889+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33__shadow_.ht5gkArbyEND-50fiM_SMI7NsSEj34l_0 2024-09-12T17:30:56.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.889+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7180916194723222569', time=2024-09-12T19:27:00.282299+0000, chain.objs.size()=1 2024-09-12T17:30:56.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.889+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35__shadow_.A0KILcYK50sJK-YxVbFp5X99ifm4E1n_0 2024-09-12T17:30:56.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.889+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8604379697429949077', time=2024-09-12T19:28:13.683851+0000, chain.objs.size()=1 2024-09-12T17:30:56.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.889+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40__shadow_.NMzR4vvsWzq21EQs7CmhinheNVyoIGu_0 2024-09-12T17:30:56.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.891+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:56.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.894+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:30:56.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.895+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.896+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.896+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T17:30:56.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.896+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4106400518697603560', time=2024-09-12T19:23:18.723590+0000, chain.objs.size()=1 2024-09-12T17:30:56.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.896+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21__shadow_.iQ1D3lfUzIFEKlMJHMTBIkgiQZVowiP_0 2024-09-12T17:30:56.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.896+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15278126351620794190', time=2024-09-12T19:24:36.111350+0000, chain.objs.size()=1 2024-09-12T17:30:56.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.896+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27__shadow_.SLiQdZLlkMUdwguO604aJVWPCpqIvvk_0 2024-09-12T17:30:56.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.896+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6481812239959376581', time=2024-09-12T19:25:11.960056+0000, chain.objs.size()=1 2024-09-12T17:30:56.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.896+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29__shadow_.N3UwAhTEmdsD-opYONL1CnH4MZ_1QyC_0 2024-09-12T17:30:56.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.896+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16998551239990104357', time=2024-09-12T19:25:11.993623+0000, chain.objs.size()=1 2024-09-12T17:30:56.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.896+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29__shadow_.DHENAnypesQfGTh6NFlRO7Ng063tfGQ_0 2024-09-12T17:30:56.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.896+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9891287183255299095', time=2024-09-12T19:25:45.773754+0000, chain.objs.size()=1 2024-09-12T17:30:56.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.896+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30__shadow_.r74_SgMlKFbKVx1dMdBh22b-gM1Q5Ul_0 2024-09-12T17:30:56.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.896+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3173814909410655465', time=2024-09-12T19:25:45.886802+0000, chain.objs.size()=1 2024-09-12T17:30:56.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.896+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30__shadow_.44QmhgG0goAvnS6hTuzG2Mb0ORYxa_A_0 2024-09-12T17:30:56.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.896+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.250309667791394208', time=2024-09-12T19:26:27.017866+0000, chain.objs.size()=1 2024-09-12T17:30:56.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.896+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34__shadow_.AqEpc9rdQUz3YczENJmy7SvKs2uSRqr_0 2024-09-12T17:30:56.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.896+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18118730168652512089', time=2024-09-12T19:26:27.084585+0000, chain.objs.size()=1 2024-09-12T17:30:56.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.896+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34__shadow_.gHo2N6XcnzISiL5-UVq2Da00eUWKOJU_0 2024-09-12T17:30:56.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.896+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12961788096446263442', time=2024-09-12T19:27:35.833638+0000, chain.objs.size()=1 2024-09-12T17:30:56.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.896+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37__shadow_.2bXkexi1a8ZZ_Sg_8MvtbMmWeObFXFh_0 2024-09-12T17:30:56.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.896+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2664447245396964991', time=2024-09-12T19:27:37.592797+0000, chain.objs.size()=1 2024-09-12T17:30:56.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.896+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38__shadow_.ij31Pmtzcs5IYkgZKNdegwaFpSwYdgJ_0 2024-09-12T17:30:56.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.896+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11514253817362998333', time=2024-09-12T19:27:38.476266+0000, chain.objs.size()=1 2024-09-12T17:30:56.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.896+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38__shadow_.gP98c5l0zNcpmXjle1dIsx5_htV6mx1_0 2024-09-12T17:30:56.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.896+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15842794022775524039', time=2024-09-12T19:27:40.510899+0000, chain.objs.size()=1 2024-09-12T17:30:56.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.896+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39__shadow_.ICx1xcNlWMTz9RznT9IImUAz6Gaza5B_0 2024-09-12T17:30:56.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.899+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:56.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.901+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:30:56.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.903+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.903+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.903+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T17:30:56.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.903+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5769946377202723477', time=2024-09-12T19:23:16.542342+0000, chain.objs.size()=1 2024-09-12T17:30:56.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.903+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20__shadow_.0jbduNO4TNXumKd_Z8CWHQuHXSmbbCC_0 2024-09-12T17:30:56.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.903+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14808215104277558420', time=2024-09-12T19:23:16.571084+0000, chain.objs.size()=1 2024-09-12T17:30:56.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.903+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20__shadow_.Ns0PdVs3sTvN9HJ18kgiCpcIR7tTzxo_0 2024-09-12T17:30:56.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.903+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12048076018231712573', time=2024-09-12T19:23:56.805357+0000, chain.objs.size()=1 2024-09-12T17:30:56.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.903+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24__shadow_.2PkHa-zXuKLuBrwkrnm8gO7gTD9WSmv_0 2024-09-12T17:30:56.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.903+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18409826580252568112', time=2024-09-12T19:24:33.840748+0000, chain.objs.size()=1 2024-09-12T17:30:56.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.903+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26__shadow_.Nbnmw74b9r-63RnMJqE0rVy6QgU8FKe_0 2024-09-12T17:30:56.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.903+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4247628841577372394', time=2024-09-12T19:24:36.137401+0000, chain.objs.size()=1 2024-09-12T17:30:56.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.903+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27__shadow_.FvbJBIVSqLp6X0VYqIpYMjXgZE-O-nP_0 2024-09-12T17:30:56.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.903+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17514558550199784481', time=2024-09-12T19:24:36.204153+0000, chain.objs.size()=1 2024-09-12T17:30:56.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.903+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27__shadow_.f2gEMGTVdJnu1S3LGIq8hWjwXwHn1nS_0 2024-09-12T17:30:56.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.903+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.104739953700570772', time=2024-09-12T19:24:38.121379+0000, chain.objs.size()=1 2024-09-12T17:30:56.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.903+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28__shadow_.003TSHVypmWSG2Iq9NoAW71aU93vzzq_0 2024-09-12T17:30:56.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.903+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7076827137672504250', time=2024-09-12T19:25:48.293804+0000, chain.objs.size()=1 2024-09-12T17:30:56.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.903+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31__shadow_.zRopLhBcvQ3qBoOiuF0XSRV3wYAjO5C_0 2024-09-12T17:30:56.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.904+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7489797840001039972', time=2024-09-12T19:26:22.836688+0000, chain.objs.size()=1 2024-09-12T17:30:56.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.904+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33__shadow_.4PlyudIg8Y6txhsCUuw6XU4Y9EsXAn9_0 2024-09-12T17:30:56.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.904+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2738664309149566190', time=2024-09-12T19:26:27.012028+0000, chain.objs.size()=1 2024-09-12T17:30:56.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.904+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34__shadow_.smqZX-lHHwNko3u4KiYQL_8cj1ZFD4H_0 2024-09-12T17:30:56.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.904+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8233258953499419976', time=2024-09-12T19:27:00.261603+0000, chain.objs.size()=1 2024-09-12T17:30:56.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.904+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35__shadow_.FFlovEk3UvtGzemGPAotY5TDkMAqPel_0 2024-09-12T17:30:56.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.904+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16515355176883724171', time=2024-09-12T19:27:00.354144+0000, chain.objs.size()=1 2024-09-12T17:30:56.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.904+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35__shadow_.LwKN_JcW7r3ku27yxX-XiTuK06Jszj2_0 2024-09-12T17:30:56.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.905+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15525491121975781484', time=2024-09-12T19:27:02.780612+0000, chain.objs.size()=1 2024-09-12T17:30:56.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.905+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36__shadow_.hB-r07_f_rK0P7Fc75NaNG9CaGqWT_t_0 2024-09-12T17:30:56.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.905+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1517491648984561991', time=2024-09-12T19:27:35.795596+0000, chain.objs.size()=1 2024-09-12T17:30:56.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.905+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37__shadow_.PonCWdyBBzztvCmxZgmiPmAZCD1TvKn_0 2024-09-12T17:30:56.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.905+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6725988485394082276', time=2024-09-12T19:27:35.832427+0000, chain.objs.size()=1 2024-09-12T17:30:56.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.905+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37__shadow_.bAiY7XxPI3znCTY1Sm8cJdX6XjTc7aN_0 2024-09-12T17:30:56.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.905+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9149424952564259310', time=2024-09-12T19:27:40.427511+0000, chain.objs.size()=1 2024-09-12T17:30:56.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.905+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39__shadow_.sWJOdLZYMZQOAOhR94XvKzgnKCRZXat_0 2024-09-12T17:30:56.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.905+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16015033332391223004', time=2024-09-12T19:28:13.705243+0000, chain.objs.size()=1 2024-09-12T17:30:56.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.905+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40__shadow_.N9dOl3P8RgWkvGgbz8JUX1DfkFLUhjN_0 2024-09-12T17:30:56.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.906+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9223983060863851858', time=2024-09-12T19:30:20.777711+0000, chain.objs.size()=1 2024-09-12T17:30:56.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.906+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18__shadow_.Y6a8qp_DAWBCTS7WaAv2ZHI-7rSg37g_0 2024-09-12T17:30:56.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.907+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:56.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.910+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:30:56.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.911+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.911+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.912+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T17:30:56.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.912+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5112877020778349403', time=2024-09-12T19:23:16.586157+0000, chain.objs.size()=1 2024-09-12T17:30:56.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.912+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20__shadow_.LCj0szjG3CUpKuwkBpLOQYa8YirmfOb_0 2024-09-12T17:30:56.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.912+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1194522482339224696', time=2024-09-12T19:23:18.725779+0000, chain.objs.size()=1 2024-09-12T17:30:56.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.912+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21__shadow_.Kd5mQ4ay8_BkNKIAKFEtGuoFrvTk8H7_0 2024-09-12T17:30:56.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.912+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3425417572192365026', time=2024-09-12T19:23:51.559054+0000, chain.objs.size()=1 2024-09-12T17:30:56.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.912+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22__shadow_.PIUrhIi1Cb1wOreiML0sbA7ggh0nUtL_0 2024-09-12T17:30:56.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.912+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9172304164691861848', time=2024-09-12T19:23:54.633141+0000, chain.objs.size()=1 2024-09-12T17:30:56.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.912+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23__shadow_.-JuXsxODDqtPH8xhFywWucNX43MLIPI_0 2024-09-12T17:30:56.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.912+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5109032344274606860', time=2024-09-12T19:23:54.700228+0000, chain.objs.size()=1 2024-09-12T17:30:56.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.912+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23__shadow_.E54EkiOadf6sYPcmyoMl9mjutlFHsrL_0 2024-09-12T17:30:56.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.912+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2099737627115886693', time=2024-09-12T19:23:56.791388+0000, chain.objs.size()=1 2024-09-12T17:30:56.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.912+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24__shadow_.6pog3bN9cSGtSCftID8Tj-MHYtPKb2d_0 2024-09-12T17:30:56.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.912+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14090279481815162794', time=2024-09-12T19:24:31.139513+0000, chain.objs.size()=1 2024-09-12T17:30:56.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.912+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25__shadow_.XA_SGiHAvRacxxVbnfia5pYF5mflxX9_0 2024-09-12T17:30:56.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.912+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6529235692183425148', time=2024-09-12T19:24:33.818031+0000, chain.objs.size()=1 2024-09-12T17:30:56.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.912+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26__shadow_.VCJx8_CRRLuK9msFL3mLJ0YHmMNMXQo_0 2024-09-12T17:30:56.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.912+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.486829043310466895', time=2024-09-12T19:24:36.137490+0000, chain.objs.size()=1 2024-09-12T17:30:56.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.912+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27__shadow_.XqhNITsgGDvDTp7f0jo3dPBm_ltsN4U_0 2024-09-12T17:30:56.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.912+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8966682825974910110', time=2024-09-12T19:25:11.946559+0000, chain.objs.size()=1 2024-09-12T17:30:56.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.912+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29__shadow_.onEeHbL1R-Bw9mgfWFTF6Ag8BGqUYAO_0 2024-09-12T17:30:56.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.912+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5505687280912955895', time=2024-09-12T19:25:48.338186+0000, chain.objs.size()=1 2024-09-12T17:30:56.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.912+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31__shadow_.DIysimiumtJCmYfse_FEbOPNFbTAPOJ_0 2024-09-12T17:30:56.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.912+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7282060307092557620', time=2024-09-12T19:25:50.262516+0000, chain.objs.size()=1 2024-09-12T17:30:56.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.912+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32__shadow_.IUe3wzJreYlbYQKwJwDdfXzp9zsLnPO_0 2024-09-12T17:30:56.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.914+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11378566322679880862', time=2024-09-12T19:27:38.501391+0000, chain.objs.size()=1 2024-09-12T17:30:56.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.914+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38__shadow_.kr9qUY-dQv9xBg9oZIb_X0yN3Prz4t5_0 2024-09-12T17:30:56.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.914+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1980701294743722255', time=2024-09-12T19:27:38.541706+0000, chain.objs.size()=1 2024-09-12T17:30:56.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.914+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38__shadow_.6YkKhqTuKB4Um2lC0x1DuHnVn7dZBhL_0 2024-09-12T17:30:56.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.914+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13366315076103134726', time=2024-09-12T19:30:20.825617+0000, chain.objs.size()=1 2024-09-12T17:30:56.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.914+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18__shadow_.JDG9m-Rpezu-GnJFJHw5-jud38Gp-YL_0 2024-09-12T17:30:56.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.914+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4049308881993531791', time=2024-09-12T19:30:20.826380+0000, chain.objs.size()=1 2024-09-12T17:30:56.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.914+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18__shadow_.jfdG44qHpl48df4DMRjNk0f8o8aVgXz_0 2024-09-12T17:30:56.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.916+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:56.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.918+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:30:56.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.919+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.920+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.920+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T17:30:56.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.920+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7107984525956833556', time=2024-09-12T19:21:39.002848+0000, chain.objs.size()=2 2024-09-12T17:30:56.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.920+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.YjmrgmKyJ-l4TIFUplGbZ7H4PQr4xZH_0 2024-09-12T17:30:56.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.920+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.YjmrgmKyJ-l4TIFUplGbZ7H4PQr4xZH_1 2024-09-12T17:30:56.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.920+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17604950578775388228', time=2024-09-12T19:21:39.007223+0000, chain.objs.size()=2 2024-09-12T17:30:56.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.920+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.YjmrgmKyJ-l4TIFUplGbZ7H4PQr4xZH_0 2024-09-12T17:30:56.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.920+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.YjmrgmKyJ-l4TIFUplGbZ7H4PQr4xZH_1 2024-09-12T17:30:56.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.920+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='_K8zwDCw08lRbqDJXDEYdyVSwzpEHgBN', time=2024-09-12T19:21:39.015239+0000, chain.objs.size()=2 2024-09-12T17:30:56.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.920+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.qqj_mE8rjLGYSL-yQJ181NoEpokW8CB_0 2024-09-12T17:30:56.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.920+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.qqj_mE8rjLGYSL-yQJ181NoEpokW8CB_1 2024-09-12T17:30:56.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.920+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6772287774818429444', time=2024-09-12T19:21:39.236133+0000, chain.objs.size()=1 2024-09-12T17:30:56.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.920+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.9__shadow_.RA2kZMqk3TknVgKysl9LAZLxPHwH7g2_0 2024-09-12T17:30:56.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.920+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2388357627093409982', time=2024-09-12T19:23:16.548387+0000, chain.objs.size()=1 2024-09-12T17:30:56.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.920+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20__shadow_.EHtaHlAbNjPjgX2jB5K8ayMxIEGrC9x_0 2024-09-12T17:30:56.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.920+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.795649549250370582', time=2024-09-12T19:23:16.571460+0000, chain.objs.size()=1 2024-09-12T17:30:56.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.920+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20__shadow_.U2lrzK0S1_kWrGIFOqA6oPeCQ_2EV1__0 2024-09-12T17:30:56.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.920+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14751314272988752507', time=2024-09-12T19:23:18.671338+0000, chain.objs.size()=1 2024-09-12T17:30:56.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.920+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21__shadow_.UkBeKAjLfYBMOT2gfJtKWrP5R2tfGeI_0 2024-09-12T17:30:56.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.920+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5695579269740954815', time=2024-09-12T19:23:18.715106+0000, chain.objs.size()=1 2024-09-12T17:30:56.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.920+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21__shadow_.4MNwEq5dsK_LJOGmt72DMzvUws7zfyn_0 2024-09-12T17:30:56.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.920+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2544818952377397038', time=2024-09-12T19:24:31.095990+0000, chain.objs.size()=1 2024-09-12T17:30:56.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.920+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25__shadow_.JeEKYEHz_YnCmo8OoVmcOh-GrvlVLaL_0 2024-09-12T17:30:56.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.923+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9199738787925681774', time=2024-09-12T19:24:33.823310+0000, chain.objs.size()=1 2024-09-12T17:30:56.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.923+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26__shadow_.H8waHhMUdQaaSZsYIfgy37XekgeswOv_0 2024-09-12T17:30:56.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.923+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13208299437236175400', time=2024-09-12T19:24:33.875130+0000, chain.objs.size()=1 2024-09-12T17:30:56.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.923+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26__shadow_.GRcyg9q-080lFPBsLfHmRWZ58ACQHtk_0 2024-09-12T17:30:56.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.923+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7865301686043905488', time=2024-09-12T19:24:36.159270+0000, chain.objs.size()=1 2024-09-12T17:30:56.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.923+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27__shadow_.MNP9S2_G_cDbSyFn6XFno02fPXzF8hL_0 2024-09-12T17:30:56.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.923+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13446303800728596611', time=2024-09-12T19:25:09.203679+0000, chain.objs.size()=1 2024-09-12T17:30:56.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.923+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28__shadow_.SuBzGD1-13Ysr4SS8ARLAWnf3aksiDZ_0 2024-09-12T17:30:56.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.923+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2453084003720946594', time=2024-09-12T19:25:09.227267+0000, chain.objs.size()=1 2024-09-12T17:30:56.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.923+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28__shadow_.bHurLpcKQLrWTvWFdOQC3H7O2juBgg5_0 2024-09-12T17:30:56.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.923+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8297554599518563407', time=2024-09-12T19:25:50.286815+0000, chain.objs.size()=1 2024-09-12T17:30:56.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.923+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32__shadow_.57JZsrGk5ey3EIQjFcFl_ZrjW928mxN_0 2024-09-12T17:30:56.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.923+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15309168154988241677', time=2024-09-12T19:26:22.846537+0000, chain.objs.size()=1 2024-09-12T17:30:56.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.923+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33__shadow_.Zn8qwOqs6WPsgZ0TuklOAZLVXSHkChF_0 2024-09-12T17:30:56.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.923+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13509811483733974411', time=2024-09-12T19:27:00.314335+0000, chain.objs.size()=1 2024-09-12T17:30:56.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.923+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35__shadow_.UG7hWAE0Lhnbwzo9P-d7i5C2OyhTpXn_0 2024-09-12T17:30:56.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.923+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17198858333283234374', time=2024-09-12T19:27:38.493108+0000, chain.objs.size()=1 2024-09-12T17:30:56.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.923+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38__shadow_.Cb5dJ4iE8zAs1arD76vLA5gODwsI49k_0 2024-09-12T17:30:56.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.923+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.739389605111788883', time=2024-09-12T19:28:13.687834+0000, chain.objs.size()=1 2024-09-12T17:30:56.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.923+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40__shadow_.88QzE2e990xDq03hGLj5wddhQMqO6rP_0 2024-09-12T17:30:56.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.923+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10273285156568458075', time=2024-09-12T19:30:20.805397+0000, chain.objs.size()=1 2024-09-12T17:30:56.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.923+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18__shadow_.GGZ85GDqsbOleh4NNqdCpd2F2w78yy6_0 2024-09-12T17:30:56.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.926+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:56.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.928+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:30:56.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.929+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.929+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.930+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T17:30:56.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.930+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16787151913863957395', time=2024-09-12T19:21:39.025956+0000, chain.objs.size()=2 2024-09-12T17:30:56.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.930+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.UsyASbPO1CdwWRiOW5shozzYAdXZy15_0 2024-09-12T17:30:56.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.930+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.UsyASbPO1CdwWRiOW5shozzYAdXZy15_1 2024-09-12T17:30:56.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.930+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='_vl5dAMVVd17hsAdlcWwMPmutRQ7TebP', time=2024-09-12T19:21:39.040667+0000, chain.objs.size()=1 2024-09-12T17:30:56.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.930+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.4Gx3HqTmQyKi8XjdME0BDVf0S8DT23d_0 2024-09-12T17:30:56.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.930+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17185116623913677878', time=2024-09-12T19:23:16.614777+0000, chain.objs.size()=1 2024-09-12T17:30:56.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.930+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20__shadow_.YXI7_G12fCRZTb69A3h9n_Zu8e5msK__0 2024-09-12T17:30:56.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.930+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3450704694973050504', time=2024-09-12T19:23:18.709510+0000, chain.objs.size()=1 2024-09-12T17:30:56.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.930+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21__shadow_.TuEpox3HzDrEpKSaPt65oxt3FymtBHA_0 2024-09-12T17:30:56.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.930+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5203102021063702910', time=2024-09-12T19:23:18.710329+0000, chain.objs.size()=1 2024-09-12T17:30:56.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.930+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21__shadow_._G3OIuel90Y1dSl_qbIEOCme4a82vj5_0 2024-09-12T17:30:56.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.930+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2913989087286324543', time=2024-09-12T19:23:18.781686+0000, chain.objs.size()=1 2024-09-12T17:30:56.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.930+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21__shadow_.L4MORP4y7IqyoHJI0GMNbU8adPKywXA_0 2024-09-12T17:30:56.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.930+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.951817332697420262', time=2024-09-12T19:23:54.635828+0000, chain.objs.size()=1 2024-09-12T17:30:56.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.930+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23__shadow_.NPRkws9yIsPbz-PO92vCP5zHQ-PiYzP_0 2024-09-12T17:30:56.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.930+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6472512963844688790', time=2024-09-12T19:23:54.637475+0000, chain.objs.size()=1 2024-09-12T17:30:56.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.930+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23__shadow_.V26K47trJ4cV7EoJ79r3QUd2RnktZUG_0 2024-09-12T17:30:56.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.930+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15311562800531026436', time=2024-09-12T19:23:56.803484+0000, chain.objs.size()=1 2024-09-12T17:30:56.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.930+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24__shadow_.bkESOj56RNSnTs_QG0NxWAcDo_PPlAg_0 2024-09-12T17:30:56.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.930+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8431512162326679980', time=2024-09-12T19:24:31.102666+0000, chain.objs.size()=1 2024-09-12T17:30:56.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.930+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25__shadow_.JSwll_520tcETBVnuoOafcMPpVGriNX_0 2024-09-12T17:30:56.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.930+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8546667435242410343', time=2024-09-12T19:24:31.103641+0000, chain.objs.size()=1 2024-09-12T17:30:56.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.930+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25__shadow_.s9cFjG0vBOepDZ-ZEZGpHSnWahK9Z66_0 2024-09-12T17:30:56.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.932+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.614551570482943548', time=2024-09-12T19:24:36.175914+0000, chain.objs.size()=1 2024-09-12T17:30:56.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.932+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27__shadow_.4PPGMToxGBolyUWe_HQag30JGpbbJyg_0 2024-09-12T17:30:56.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.932+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13819252061102228189', time=2024-09-12T19:25:09.251737+0000, chain.objs.size()=1 2024-09-12T17:30:56.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.932+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28__shadow_.KHcBcrNdxP_0l9Nq5LFEid8MvGKdeR3_0 2024-09-12T17:30:56.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.932+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6287804310960397164', time=2024-09-12T19:25:11.955779+0000, chain.objs.size()=1 2024-09-12T17:30:56.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.932+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29__shadow_.ZaANEl1usXtpYzk0_IT4rnARjSdbxho_0 2024-09-12T17:30:56.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.932+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2674501857551035984', time=2024-09-12T19:26:27.038776+0000, chain.objs.size()=1 2024-09-12T17:30:56.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.932+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34__shadow_.dk-pJ-xiFv-Za5fKHLpodVgxsDxYdBH_0 2024-09-12T17:30:56.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.932+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5603622054787602065', time=2024-09-12T19:26:27.039635+0000, chain.objs.size()=1 2024-09-12T17:30:56.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.932+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34__shadow_.hksJjO9DV9eU8XPcMK6INrTJHL-vK-v_0 2024-09-12T17:30:56.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.932+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8239644417246774834', time=2024-09-12T19:26:27.040438+0000, chain.objs.size()=1 2024-09-12T17:30:56.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.932+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34__shadow_.HOqRtz2xayWCFIXiWZDLcXp43C6HyNR_0 2024-09-12T17:30:56.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.932+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6348444501035729594', time=2024-09-12T19:27:00.282220+0000, chain.objs.size()=1 2024-09-12T17:30:56.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.932+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35__shadow_.2f1gy3VWNI3rLS9B40eEgaxP5uWIVJE_0 2024-09-12T17:30:56.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.932+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12417841238401219514', time=2024-09-12T19:27:35.821549+0000, chain.objs.size()=1 2024-09-12T17:30:56.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.932+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37__shadow_.0jk8UhfHCIkyV8JqvYkSGAL1ixrLy57_0 2024-09-12T17:30:56.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.932+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8641308113074488628', time=2024-09-12T19:27:40.426653+0000, chain.objs.size()=1 2024-09-12T17:30:56.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.932+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39__shadow_.AdXs4Zp4qCJfPtr2RR4v6yhYBs4lLLJ_0 2024-09-12T17:30:56.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.932+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2329743363175549958', time=2024-09-12T19:28:13.653676+0000, chain.objs.size()=1 2024-09-12T17:30:56.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.932+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40__shadow_.4JRM3S5tGuvXrtbHZFzRzTZjK-W2BBF_0 2024-09-12T17:30:56.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.932+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4855448412607345028', time=2024-09-12T19:30:20.798493+0000, chain.objs.size()=1 2024-09-12T17:30:56.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.932+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18__shadow_.R6cJwSvTjH4sBhTv3nC32uoeP5us_pb_0 2024-09-12T17:30:56.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.935+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:56.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.937+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:30:56.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.939+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.939+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.940+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T17:30:56.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.940+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12353947726874420310', time=2024-09-12T19:21:38.888614+0000, chain.objs.size()=1 2024-09-12T17:30:56.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.940+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.5__shadow_.zAi345jSM3l3ZRonTiATIImaaq5aWDB_0 2024-09-12T17:30:56.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.940+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='_zdrnRoXNdykKgP96W0PQ6L3wdpu0sMv', time=2024-09-12T19:21:39.022491+0000, chain.objs.size()=2 2024-09-12T17:30:56.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.940+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.thPNTUUqsKuaj6O9bTebRZ_qtyeir0t_0 2024-09-12T17:30:56.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.940+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.thPNTUUqsKuaj6O9bTebRZ_qtyeir0t_1 2024-09-12T17:30:56.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.940+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10368544623771099204', time=2024-09-12T19:21:39.146098+0000, chain.objs.size()=3 2024-09-12T17:30:56.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.940+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.14__shadow_.z8ddYkTxhJD7gCTdpddP1NTgpT9-qlS_0 2024-09-12T17:30:56.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.940+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.14__shadow_.z8ddYkTxhJD7gCTdpddP1NTgpT9-qlS_1 2024-09-12T17:30:56.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.940+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.14__shadow_.z8ddYkTxhJD7gCTdpddP1NTgpT9-qlS_2 2024-09-12T17:30:56.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.940+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7432816726555282301', time=2024-09-12T19:24:31.134083+0000, chain.objs.size()=1 2024-09-12T17:30:56.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.940+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25__shadow_.GKvykfT4Ae-6M3RzxlnrqXgw4ma63qn_0 2024-09-12T17:30:56.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.940+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5764306613660202404', time=2024-09-12T19:24:33.793249+0000, chain.objs.size()=1 2024-09-12T17:30:56.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.940+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26__shadow_.X-luvYzsip4dKxjrgOlxxivhMLZjeFy_0 2024-09-12T17:30:56.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.940+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2799777812619774338', time=2024-09-12T19:25:09.230181+0000, chain.objs.size()=1 2024-09-12T17:30:56.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.940+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28__shadow_.hhOVGGWA98utftzJ8TM6-9mJo_tJftM_0 2024-09-12T17:30:56.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.940+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1782866747572309572', time=2024-09-12T19:25:48.319434+0000, chain.objs.size()=1 2024-09-12T17:30:56.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.940+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31__shadow_.B2WlaRu5PfY0Gus5E_xJKQrcMU1JK22_0 2024-09-12T17:30:56.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.940+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1711408410146810199', time=2024-09-12T19:25:50.266420+0000, chain.objs.size()=1 2024-09-12T17:30:56.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.940+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32__shadow_.Whf1znlxFZzQNNzj3cjvdHO9Q37EiUC_0 2024-09-12T17:30:56.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.940+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13187033801114046120', time=2024-09-12T19:26:21.936856+0000, chain.objs.size()=1 2024-09-12T17:30:56.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.940+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33__shadow_.MIMtNt5zvZcbJqmJtRm8MuYJs9b61C4_0 2024-09-12T17:30:56.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.942+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17627552544299490754', time=2024-09-12T19:27:35.811844+0000, chain.objs.size()=1 2024-09-12T17:30:56.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.942+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37__shadow_.-HTbLAkx4OcTfH8Ph4xXx7NVnN8aJ-w_0 2024-09-12T17:30:56.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.942+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9468442020438210903', time=2024-09-12T19:27:40.469957+0000, chain.objs.size()=1 2024-09-12T17:30:56.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.942+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39__shadow_.5FWJ6iV0BnbW6KxwSS6Mcae3ZrWRf37_0 2024-09-12T17:30:56.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.944+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:56.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.946+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:30:56.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.947+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.948+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.948+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T17:30:56.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.948+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8358822059443764384', time=2024-09-12T19:21:38.892613+0000, chain.objs.size()=1 2024-09-12T17:30:56.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.948+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.5__shadow_.bl94px17WIxwxJG6jQO7lIhyylxMmUn_0 2024-09-12T17:30:56.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.948+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3593657522994192311', time=2024-09-12T19:23:16.518281+0000, chain.objs.size()=1 2024-09-12T17:30:56.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.948+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20__shadow_.B4_Welh4IMWfwvswR9vfJtDZKfZXG8S_0 2024-09-12T17:30:56.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.948+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1395439251010995025', time=2024-09-12T19:23:18.715093+0000, chain.objs.size()=1 2024-09-12T17:30:56.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.948+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21__shadow_.78Rm6X4_XIxmZ29Pnf2hGs9VvFVZzvi_0 2024-09-12T17:30:56.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.948+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18076191618529201506', time=2024-09-12T19:23:51.551769+0000, chain.objs.size()=1 2024-09-12T17:30:56.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.948+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22__shadow_.67jLNQKhDI6hVHSQ4AEtkD0AlJIZTWZ_0 2024-09-12T17:30:56.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.948+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13853016633049209277', time=2024-09-12T19:24:31.095861+0000, chain.objs.size()=1 2024-09-12T17:30:56.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.948+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25__shadow_.XQrH6gXenRMH4St9CsXuMCN7bHe0qUm_0 2024-09-12T17:30:56.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.948+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8525382070033619352', time=2024-09-12T19:24:31.096564+0000, chain.objs.size()=1 2024-09-12T17:30:56.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.948+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25__shadow_.qt55mFgBiK5SWCeVflCdtUZ-3MqJqfI_0 2024-09-12T17:30:56.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.948+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8643004198194866599', time=2024-09-12T19:25:45.794846+0000, chain.objs.size()=1 2024-09-12T17:30:56.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.948+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30__shadow_.6I7j-iyvtATHtsAuVkLugsNJGK5qS_m_0 2024-09-12T17:30:56.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.948+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2887732988678690064', time=2024-09-12T19:27:35.832074+0000, chain.objs.size()=1 2024-09-12T17:30:56.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.948+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37__shadow_.0ixbr7CN5La5YjTG6TUUM089jTKB04A_0 2024-09-12T17:30:56.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.950+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:56.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.952+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:30:56.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.953+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.954+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.954+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T17:30:56.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.954+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14298556348724947443', time=2024-09-12T19:21:38.985622+0000, chain.objs.size()=4 2024-09-12T17:30:56.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.954+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.10__multipart_foo.2~QJbCa73kDKfBikYhGIAFNfZnDyG_sR_.1 2024-09-12T17:30:56.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.954+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.10__multipart_foo.2~QJbCa73kDKfBikYhGIAFNfZnDyG_sR_.2 2024-09-12T17:30:56.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.954+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.10__multipart_foo.2~QJbCa73kDKfBikYhGIAFNfZnDyG_sR_.3 2024-09-12T17:30:56.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.954+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.10__multipart_foo.2~QJbCa73kDKfBikYhGIAFNfZnDyG_sR_.4 2024-09-12T17:30:56.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.954+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8370166874837561830', time=2024-09-12T19:23:18.710272+0000, chain.objs.size()=1 2024-09-12T17:30:56.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.954+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21__shadow_.iO8VO1n45NHNEt2VvxpGH1-00EXBcb8_0 2024-09-12T17:30:56.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.954+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5368596029608625078', time=2024-09-12T19:23:18.756889+0000, chain.objs.size()=1 2024-09-12T17:30:56.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.954+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21__shadow_.SUoXIapQaq_aB7cs7wm3LV9J1Y-Jl01_0 2024-09-12T17:30:56.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.954+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9235037755388933557', time=2024-09-12T19:23:54.636603+0000, chain.objs.size()=1 2024-09-12T17:30:56.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.954+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23__shadow_.7AXPzLAhdmKWRX59AIVB41cwDEeE43s_0 2024-09-12T17:30:56.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.954+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15814193474300676417', time=2024-09-12T19:23:56.773979+0000, chain.objs.size()=1 2024-09-12T17:30:56.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.954+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24__shadow_.9xYg0_MbW765I29AJ33NC6D5K5iL70Q_0 2024-09-12T17:30:56.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.954+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7963696308485587066', time=2024-09-12T19:24:31.102623+0000, chain.objs.size()=1 2024-09-12T17:30:56.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.954+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25__shadow_.sD9FDFcxgOU16qsv-oXgbuN5W_mhfKw_0 2024-09-12T17:30:56.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.954+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5277530791853479014', time=2024-09-12T19:24:31.103567+0000, chain.objs.size()=1 2024-09-12T17:30:56.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.954+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25__shadow_.SacvN1yeGNO-eJDiz76WwaK25mdFSMX_0 2024-09-12T17:30:56.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.954+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1771937555121201646', time=2024-09-12T19:24:36.143553+0000, chain.objs.size()=1 2024-09-12T17:30:56.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.954+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27__shadow_.WsbweKa5tY3Y4Yfi1WrxKh9ueydmwkE_0 2024-09-12T17:30:56.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.954+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16326039686699867166', time=2024-09-12T19:25:45.875441+0000, chain.objs.size()=1 2024-09-12T17:30:56.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.954+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30__shadow_.Jdu2DSCOOKhrOrZyQz6wl5OEWdGspt8_0 2024-09-12T17:30:56.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.956+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8595591066858011956', time=2024-09-12T19:26:22.882550+0000, chain.objs.size()=1 2024-09-12T17:30:56.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.956+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33__shadow_.6RSvHqlTl35-YdI_e6x5Fp7GZ5wntq5_0 2024-09-12T17:30:56.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.956+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5481122407632157442', time=2024-09-12T19:26:27.081160+0000, chain.objs.size()=1 2024-09-12T17:30:56.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.956+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34__shadow_.1fnalhB5xd0Q1reI4Mhtl5_GDNDxlQh_0 2024-09-12T17:30:56.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.956+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5033178320384099686', time=2024-09-12T19:27:02.745586+0000, chain.objs.size()=1 2024-09-12T17:30:56.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.956+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36__shadow_.FvweDeY6_uZfKR1_acWoj1BEs41a3Hk_0 2024-09-12T17:30:56.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.956+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6035461591605027496', time=2024-09-12T19:27:02.795092+0000, chain.objs.size()=1 2024-09-12T17:30:56.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.956+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36__shadow_.7lRBrE3bj4e3M-DMs45DOj6cltDaZSS_0 2024-09-12T17:30:56.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.956+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15786210310731112183', time=2024-09-12T19:27:35.821493+0000, chain.objs.size()=1 2024-09-12T17:30:56.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.956+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37__shadow_.P1VLo61RQK-hnVeD3KBNRFOFrGwbp7b_0 2024-09-12T17:30:56.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.956+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17839241243964179013', time=2024-09-12T19:27:38.569336+0000, chain.objs.size()=1 2024-09-12T17:30:56.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.956+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38__shadow_.axcxZjVXQ5YysIAL72HsDCsbUasnIEt_0 2024-09-12T17:30:56.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.956+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12161632230097548311', time=2024-09-12T19:27:40.469529+0000, chain.objs.size()=1 2024-09-12T17:30:56.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.956+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39__shadow_.o7eGFhD5UZByWl9dCJT0FDdqRCFVvV2_0 2024-09-12T17:30:56.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.956+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2434711355654240700', time=2024-09-12T19:28:13.711760+0000, chain.objs.size()=1 2024-09-12T17:30:56.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.956+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40__shadow_.YBnyGgkhrRlhGxgsQCFCAQavShsQT-C_0 2024-09-12T17:30:56.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.958+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:56.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.960+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:30:56.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T17:30:56.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14785070800399019850', time=2024-09-12T19:23:54.619176+0000, chain.objs.size()=1 2024-09-12T17:30:56.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23__shadow_.yGy3S0c--e1WbmopHJuYMVNxW6RlEmg_0 2024-09-12T17:30:56.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17573103376837997203', time=2024-09-12T19:23:56.742019+0000, chain.objs.size()=1 2024-09-12T17:30:56.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24__shadow_.Vnxq1h2IjQIiplqXH9walqYNjOhtzQq_0 2024-09-12T17:30:56.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11627603096085182991', time=2024-09-12T19:23:56.870278+0000, chain.objs.size()=1 2024-09-12T17:30:56.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24__shadow_.tbovJ5mUr8HVJnVAFAU24GmeL9qraxs_0 2024-09-12T17:30:56.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1002475481101506734', time=2024-09-12T19:24:31.057749+0000, chain.objs.size()=1 2024-09-12T17:30:56.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25__shadow_.CtavCRRJB0QwTWTPTju1ZVMOvqIixo-_0 2024-09-12T17:30:56.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13832367982397245514', time=2024-09-12T19:24:36.211856+0000, chain.objs.size()=1 2024-09-12T17:30:56.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27__shadow_.iV7SK5K7pSqqcqXHbLx4o0zjXO6gue8_0 2024-09-12T17:30:56.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1334167425217389905', time=2024-09-12T19:25:11.022907+0000, chain.objs.size()=1 2024-09-12T17:30:56.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29__shadow_.9OMGwb3rQKGWHg8bzQDDHLwERdX1MU1_0 2024-09-12T17:30:56.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7890304436814587900', time=2024-09-12T19:25:11.912174+0000, chain.objs.size()=1 2024-09-12T17:30:56.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29__shadow_.RAnF2KEl1sL-GxrsZz5r_066brh99B9_0 2024-09-12T17:30:56.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7344461531291968553', time=2024-09-12T19:25:45.854407+0000, chain.objs.size()=1 2024-09-12T17:30:56.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30__shadow_.Y6wav5PpK2jSmCjlXduAcW0WmCSDBFS_0 2024-09-12T17:30:56.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2734031630977066668', time=2024-09-12T19:27:38.476351+0000, chain.objs.size()=1 2024-09-12T17:30:56.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38__shadow_.qJjWieW1Ctxxo2V3piVtHSYLXIiRMAH_0 2024-09-12T17:30:56.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6606289870324680385', time=2024-09-12T19:27:38.550766+0000, chain.objs.size()=1 2024-09-12T17:30:56.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38__shadow_.Hgs82kzz_s7lGOSh1bT9gJPycetAaoq_0 2024-09-12T17:30:56.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16572920004575129031', time=2024-09-12T19:28:13.677276+0000, chain.objs.size()=1 2024-09-12T17:30:56.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40__shadow_.uXA_DhN37sNRUv0u69azgYj1iylyfNG_0 2024-09-12T17:30:56.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17951849680127537766', time=2024-09-12T19:28:13.677964+0000, chain.objs.size()=1 2024-09-12T17:30:56.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.962+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40__shadow_.h2MBYtBarpLgr0zlJYOXs25bcZO2Pua_0 2024-09-12T17:30:56.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.964+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7534498856508141960', time=2024-09-12T19:28:13.687217+0000, chain.objs.size()=1 2024-09-12T17:30:56.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.964+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40__shadow_.vJ49XVGwuK5HCFEUzaYSo0d9jKFo1Cb_0 2024-09-12T17:30:56.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.965+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:56.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.967+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:30:56.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.968+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.969+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.969+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T17:30:56.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.969+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='_gHO_LTdFuUQ3WXvtmI_rjUGQh00vELf', time=2024-09-12T19:21:39.068383+0000, chain.objs.size()=3 2024-09-12T17:30:56.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.969+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.v5gpMrhQttEp-LtCq4ALk-mrdiDR6kb_0 2024-09-12T17:30:56.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.969+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.v5gpMrhQttEp-LtCq4ALk-mrdiDR6kb_1 2024-09-12T17:30:56.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.969+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.v5gpMrhQttEp-LtCq4ALk-mrdiDR6kb_2 2024-09-12T17:30:56.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.969+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4815901023522683532', time=2024-09-12T19:21:39.125166+0000, chain.objs.size()=5 2024-09-12T17:30:56.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.969+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.15__multipart_foo-LUKEWARM.2~xC66n6FqYJKMJqVVQS1vw7NtDS06PpN.1 2024-09-12T17:30:56.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.969+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.15__shadow_foo-LUKEWARM.2~xC66n6FqYJKMJqVVQS1vw7NtDS06PpN.1_1 2024-09-12T17:30:56.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.969+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.15__multipart_foo-LUKEWARM.2~xC66n6FqYJKMJqVVQS1vw7NtDS06PpN.2 2024-09-12T17:30:56.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.969+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.15__shadow_foo-LUKEWARM.2~xC66n6FqYJKMJqVVQS1vw7NtDS06PpN.2_1 2024-09-12T17:30:56.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.969+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.15__multipart_foo-LUKEWARM.2~xC66n6FqYJKMJqVVQS1vw7NtDS06PpN.3 2024-09-12T17:30:56.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.969+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4436882627630696544', time=2024-09-12T19:23:54.633132+0000, chain.objs.size()=1 2024-09-12T17:30:56.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.969+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23__shadow_.VJQhzHUa2UnNVq4tgzuYdO7re_yFGQ4_0 2024-09-12T17:30:56.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.969+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2954189672993823655', time=2024-09-12T19:24:36.204223+0000, chain.objs.size()=1 2024-09-12T17:30:56.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.969+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27__shadow_.whq3Xy5sY-QqAkQgqweT_LxbJ2VSnBs_0 2024-09-12T17:30:56.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.969+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10910990750516990471', time=2024-09-12T19:25:11.944574+0000, chain.objs.size()=1 2024-09-12T17:30:56.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.969+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29__shadow_.V7lLrykeo6tLbA9VQR6s2ypY3b4giWA_0 2024-09-12T17:30:56.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.969+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8062911467227888573', time=2024-09-12T19:25:48.337292+0000, chain.objs.size()=1 2024-09-12T17:30:56.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.969+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31__shadow_.fgoFCXJ9gfVVHbCxDVzO4-1ucPxdSHG_0 2024-09-12T17:30:56.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.972+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2607604841152983849', time=2024-09-12T19:25:48.338111+0000, chain.objs.size()=1 2024-09-12T17:30:56.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.972+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31__shadow_.n0fj9nzfjD1iTjoyrBzpQzNSrnn79y6_0 2024-09-12T17:30:56.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.972+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4327724649165422671', time=2024-09-12T19:27:02.829412+0000, chain.objs.size()=1 2024-09-12T17:30:56.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.972+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36__shadow_.4MaNwIffumJqjciVktvTwWBFyJL6v4g_0 2024-09-12T17:30:56.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.972+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15032661620946707636', time=2024-09-12T19:27:38.541706+0000, chain.objs.size()=1 2024-09-12T17:30:56.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.972+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38__shadow_.NNqd9LaalZw5HmtnK0K8c7OSPJ9q_t2_0 2024-09-12T17:30:56.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.972+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.849693485523866680', time=2024-09-12T19:30:34.305453+0000, chain.objs.size()=1 2024-09-12T17:30:56.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.972+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19__shadow:jhSn3gu7WLI7nJP8kHjkgD8Fsd7rfOS_.wi7t5UVWVqrLTW38k8Ezf1bVMDJDaRU_0 2024-09-12T17:30:56.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.974+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:56.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.976+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:30:56.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.977+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.977+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.978+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T17:30:56.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.978+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16180116736702014313', time=2024-09-12T19:21:38.904113+0000, chain.objs.size()=1 2024-09-12T17:30:56.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.978+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.5__shadow_.w58Fl_fUOh-bK7y3PtxzceHsNI6Rrly_0 2024-09-12T17:30:56.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.978+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12710931449551971063', time=2024-09-12T19:21:38.907893+0000, chain.objs.size()=1 2024-09-12T17:30:56.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.978+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.5__shadow_.9D63AGlBQsvRkuzg4Ps3jyfg-OJ_orP_0 2024-09-12T17:30:56.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.978+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2754811242649138923', time=2024-09-12T19:23:15.639117+0000, chain.objs.size()=1 2024-09-12T17:30:56.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.978+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20__shadow_.QVYX68o1qiLR8I4quskM0LDk7SI3_gm_0 2024-09-12T17:30:56.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.978+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2550763766211783114', time=2024-09-12T19:23:18.723722+0000, chain.objs.size()=1 2024-09-12T17:30:56.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.978+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21__shadow_.Qby87iyfnnQO7Lcqtx9AkHnJh7ZjEWp_0 2024-09-12T17:30:56.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.978+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15890710700018631734', time=2024-09-12T19:23:51.584101+0000, chain.objs.size()=1 2024-09-12T17:30:56.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.978+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22__shadow_.9S-7TCnXq14QKlb1Hcz_8Tr5KXkaGNd_0 2024-09-12T17:30:56.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.978+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10765330173534500152', time=2024-09-12T19:23:54.639506+0000, chain.objs.size()=1 2024-09-12T17:30:56.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.978+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23__shadow_.aL3ghx1rOFT4Bc017AYkAXTtbzJThHn_0 2024-09-12T17:30:56.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.978+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4378540372562748471', time=2024-09-12T19:23:56.791672+0000, chain.objs.size()=1 2024-09-12T17:30:56.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.978+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24__shadow_.waWMc9FAJhetSwXFeLnEb2YgT9tfCKp_0 2024-09-12T17:30:56.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.978+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9606070793253444879', time=2024-09-12T19:23:56.793353+0000, chain.objs.size()=1 2024-09-12T17:30:56.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.978+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24__shadow_.O7kCCwBwQ0ee25f6BptC3no-8lXq91O_0 2024-09-12T17:30:56.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.978+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3451966587714321864', time=2024-09-12T19:24:33.814002+0000, chain.objs.size()=1 2024-09-12T17:30:56.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.978+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26__shadow_.Ffx_g3yowPPbyEVcWYSolyr9dDpIdSm_0 2024-09-12T17:30:56.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.978+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12372308585163639234', time=2024-09-12T19:24:36.165403+0000, chain.objs.size()=1 2024-09-12T17:30:56.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.978+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27__shadow_.Fd5tRUMNGYdrYYwHLmXrEo3WDXpl0ih_0 2024-09-12T17:30:56.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.978+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6077821763898210540', time=2024-09-12T19:25:09.202231+0000, chain.objs.size()=1 2024-09-12T17:30:56.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.978+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28__shadow_._RNt9L8LLj8eXHvYvdAJ0Ar3RHQOMHn_0 2024-09-12T17:30:56.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.978+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16879362127993195334', time=2024-09-12T19:25:09.203008+0000, chain.objs.size()=1 2024-09-12T17:30:56.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.978+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28__shadow_.b_TxrBxutJxMrBGEY94LVb6lo18ueVR_0 2024-09-12T17:30:56.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.979+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1320807451233374589', time=2024-09-12T19:25:09.278083+0000, chain.objs.size()=1 2024-09-12T17:30:56.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.979+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28__shadow_.9zmno8v8zjMq7INGH_QniuN5A2mtgGv_0 2024-09-12T17:30:56.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.980+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9950804477556197396', time=2024-09-12T19:25:45.850919+0000, chain.objs.size()=1 2024-09-12T17:30:56.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.980+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30__shadow_.OWIdFtg-DPkb2DQartKQVAXC6N3o45a_0 2024-09-12T17:30:56.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.980+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15993211276754187359', time=2024-09-12T19:25:45.851406+0000, chain.objs.size()=1 2024-09-12T17:30:56.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.980+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30__shadow_.qXZNtuIkry8SdGz4LH3cQfc66Nrnm9L_0 2024-09-12T17:30:56.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.980+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4550657059902581136', time=2024-09-12T19:25:48.381894+0000, chain.objs.size()=1 2024-09-12T17:30:56.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.980+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31__shadow_.-6CJJ1pnKklsfF_k3PiAah9TLLTcl11_0 2024-09-12T17:30:56.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.980+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3754571533700227500', time=2024-09-12T19:25:50.267588+0000, chain.objs.size()=1 2024-09-12T17:30:56.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.980+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32__shadow_.rgvfiBJ3XjMPneEnTTooKElgQfNCUOH_0 2024-09-12T17:30:56.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.980+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3641408739622397262', time=2024-09-12T19:27:02.796934+0000, chain.objs.size()=1 2024-09-12T17:30:56.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.980+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36__shadow_.XdtM2H5eSd0TLPWKAvSq-pZNlFFfMIe_0 2024-09-12T17:30:56.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.980+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12738695407012778516', time=2024-09-12T19:27:35.867516+0000, chain.objs.size()=1 2024-09-12T17:30:56.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.980+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37__shadow_.oPFpw62LSUHvLclPK7nuEKJcCZtt_6a_0 2024-09-12T17:30:56.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.980+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17688783421554458070', time=2024-09-12T19:28:13.747815+0000, chain.objs.size()=1 2024-09-12T17:30:56.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.980+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40__shadow_.Z0h7mZfv5f15djdquVvFQuZYwagWkQt_0 2024-09-12T17:30:56.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.982+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:56.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.984+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:30:56.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.985+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.985+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.986+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T17:30:56.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.986+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11512523228352842011', time=2024-09-12T19:21:39.197189+0000, chain.objs.size()=1 2024-09-12T17:30:56.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.986+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.8__shadow_.Z2-nJd9Us8GQSIN_pLOUCW1bSz74xem_0 2024-09-12T17:30:56.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.986+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4728901942583016519', time=2024-09-12T19:23:51.584917+0000, chain.objs.size()=1 2024-09-12T17:30:56.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.986+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22__shadow_.8aIR2DnINjUGuwHT4GPLVrhNE9KNC3F_0 2024-09-12T17:30:56.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.986+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11046619878285295855', time=2024-09-12T19:24:31.143166+0000, chain.objs.size()=1 2024-09-12T17:30:56.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.986+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25__shadow_.CR-a0WC5CbFMAQeQVLIFBw-YaBdLq_2_0 2024-09-12T17:30:56.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.986+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.894812953231771595', time=2024-09-12T19:25:09.268709+0000, chain.objs.size()=1 2024-09-12T17:30:56.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.986+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28__shadow_.MFr-O5oHEV98T56Q8gHGwDJ2mTBz1Ke_0 2024-09-12T17:30:56.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.986+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8962422155010882872', time=2024-09-12T19:25:48.289574+0000, chain.objs.size()=1 2024-09-12T17:30:56.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.986+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31__shadow_.fxPvWPb_VbWTid2BA1iUuSfEKgldhhi_0 2024-09-12T17:30:56.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.986+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7268022463853000171', time=2024-09-12T19:25:48.308543+0000, chain.objs.size()=1 2024-09-12T17:30:56.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.986+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31__shadow_.8SB0kK_jbi91l02_U52W2TgOfbHavl8_0 2024-09-12T17:30:56.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.986+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15400950836137260952', time=2024-09-12T19:25:50.250053+0000, chain.objs.size()=1 2024-09-12T17:30:56.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.986+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32__shadow_.jHkkAtfnmR_gyEaexdpjbavBs4W690E_0 2024-09-12T17:30:56.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.986+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8241603298440121386', time=2024-09-12T19:26:22.882557+0000, chain.objs.size()=1 2024-09-12T17:30:56.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.986+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33__shadow_.ssoYxVYnsKW8GHk7zH535hVF5-bVbgN_0 2024-09-12T17:30:56.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.986+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12927469911767484867', time=2024-09-12T19:26:27.081173+0000, chain.objs.size()=1 2024-09-12T17:30:56.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.986+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34__shadow_.2gy9ilSX-Er5Iwf6ALzYwXDylR8ILJO_0 2024-09-12T17:30:56.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.986+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16503038177297284136', time=2024-09-12T19:27:35.821494+0000, chain.objs.size()=1 2024-09-12T17:30:56.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.986+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37__shadow_.Kmc102R-GXwu-UXb2DFLGEtM7NJpaSJ_0 2024-09-12T17:30:56.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.986+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12513048255052796571', time=2024-09-12T19:28:13.711678+0000, chain.objs.size()=1 2024-09-12T17:30:56.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.986+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40__shadow_.1fZsD14MrKH1TlvdWInTNLb9Bk-jyUw_0 2024-09-12T17:30:56.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.986+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14857235577426088068', time=2024-09-12T19:30:20.798547+0000, chain.objs.size()=1 2024-09-12T17:30:56.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.986+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18__shadow_.FUBNgoO4pLOqLCF0rr4EfQnJdd-CpdE_0 2024-09-12T17:30:56.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.988+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:56.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.990+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:30:56.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.992+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.992+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.993+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T17:30:56.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.993+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='_BgJo4LNQHhb_2ELkYfZHCObrmnyYXJu', time=2024-09-12T19:21:39.011193+0000, chain.objs.size()=2 2024-09-12T17:30:56.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.993+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.7VxhQF1NmY6tqBcvY-xLPNCkpR6Gqhd_0 2024-09-12T17:30:56.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.993+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.7VxhQF1NmY6tqBcvY-xLPNCkpR6Gqhd_1 2024-09-12T17:30:56.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.993+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='_K9nDrhI7gW7YDNmQUV-aKXd8h3VEOrk', time=2024-09-12T19:21:39.087543+0000, chain.objs.size()=3 2024-09-12T17:30:56.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.993+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.FLX60aLUxF1stFHVehA3ZbG1YLkveUj_0 2024-09-12T17:30:56.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.993+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.FLX60aLUxF1stFHVehA3ZbG1YLkveUj_1 2024-09-12T17:30:56.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.993+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.FLX60aLUxF1stFHVehA3ZbG1YLkveUj_2 2024-09-12T17:30:56.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.993+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9776505931903465930', time=2024-09-12T19:21:39.228552+0000, chain.objs.size()=1 2024-09-12T17:30:56.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.993+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.9__shadow_.bUSCPVw8Dshqtlo35DB0UpYY3jtCQkH_0 2024-09-12T17:30:56.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.993+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.227970240640172291', time=2024-09-12T19:23:18.670949+0000, chain.objs.size()=1 2024-09-12T17:30:56.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.993+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21__shadow_.VAjTarqQjPXK9kE7ogx0b0OYpIkRUCU_0 2024-09-12T17:30:56.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.993+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6916451737260118697', time=2024-09-12T19:23:51.547057+0000, chain.objs.size()=1 2024-09-12T17:30:56.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.993+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22__shadow_.jjB7ghUckco499op3F9-LllvBtk-BDE_0 2024-09-12T17:30:56.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.993+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13375832785226416218', time=2024-09-12T19:23:54.626724+0000, chain.objs.size()=1 2024-09-12T17:30:56.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.993+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23__shadow_.cwRnfithzGTUvwu1sFyWIKXIdvFVeBK_0 2024-09-12T17:30:56.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.993+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.345870674122659685', time=2024-09-12T19:24:31.051505+0000, chain.objs.size()=1 2024-09-12T17:30:56.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.993+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25__shadow_.xHNpRWexKhnzcp_dYs2486KecYmN4oN_0 2024-09-12T17:30:56.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.993+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15768489594409477088', time=2024-09-12T19:24:33.840741+0000, chain.objs.size()=1 2024-09-12T17:30:56.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.993+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26__shadow_.8qfBBBXWCBnQvswY1uDiTllzduwG8Wy_0 2024-09-12T17:30:56.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.993+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7863236181453084292', time=2024-09-12T19:24:36.116555+0000, chain.objs.size()=1 2024-09-12T17:30:56.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.993+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27__shadow_.CCReqrArSTuA9o8dV5Y51yjhBQfPdtx_0 2024-09-12T17:30:56.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.997+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10467005659811790260', time=2024-09-12T19:24:36.126425+0000, chain.objs.size()=1 2024-09-12T17:30:56.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.997+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27__shadow_.n6TxjYx0rbtg7MC-tSJkl-NOOzmejDO_0 2024-09-12T17:30:56.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.997+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16601284340885132565', time=2024-09-12T19:25:09.226823+0000, chain.objs.size()=1 2024-09-12T17:30:56.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.997+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28__shadow_.KSiMMIaXqQiEaRETjV_FFeuON7mhIv8_0 2024-09-12T17:30:56.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.997+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1323776426444843733', time=2024-09-12T19:25:11.931466+0000, chain.objs.size()=1 2024-09-12T17:30:56.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.997+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29__shadow_.rq6aRlQ0OaC0g_nYj2mGiO4RgwtVic1_0 2024-09-12T17:30:56.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.997+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.807835566341680788', time=2024-09-12T19:25:48.331189+0000, chain.objs.size()=1 2024-09-12T17:30:56.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.997+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31__shadow_.ly17HK4F7c5P_o8ywPa9xNyCRMy5ptL_0 2024-09-12T17:30:56.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.997+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3238889608464185030', time=2024-09-12T19:26:22.825950+0000, chain.objs.size()=1 2024-09-12T17:30:56.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.997+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33__shadow_.rlZdsdTOsW_wXOV-VesX2jiZXAaHkM0_0 2024-09-12T17:30:56.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.997+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1009157785246494776', time=2024-09-12T19:27:00.254983+0000, chain.objs.size()=1 2024-09-12T17:30:56.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.997+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35__shadow_.rx9q7ZE8sIpIMi1gfxf3-LZDD8qbPss_0 2024-09-12T17:30:56.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.997+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17335490285780645751', time=2024-09-12T19:27:38.500645+0000, chain.objs.size()=1 2024-09-12T17:30:57.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.997+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38__shadow_.HJiqcMn3gymXKBk6ZAGsi6Tt_5apqEo_0 2024-09-12T17:30:57.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.997+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13070873345513695564', time=2024-09-12T19:27:40.447573+0000, chain.objs.size()=1 2024-09-12T17:30:57.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.997+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39__shadow_.idCL-nRUPUlGQv06rVtTSnc0gdnh_NO_0 2024-09-12T17:30:57.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.997+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1476654956462847043', time=2024-09-12T19:27:40.517413+0000, chain.objs.size()=1 2024-09-12T17:30:57.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.997+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39__shadow_.OsFwsNne3LHraGooSL3j-rKzC2_CjRe_0 2024-09-12T17:30:57.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.997+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.894848112109188111', time=2024-09-12T19:28:13.662545+0000, chain.objs.size()=1 2024-09-12T17:30:57.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.997+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40__shadow_.c5vSUCkVoooIcHB4DiFqK0N4JDrY8y2_0 2024-09-12T17:30:57.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.997+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11491727484657350014', time=2024-09-12T19:30:20.796247+0000, chain.objs.size()=1 2024-09-12T17:30:57.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:56.997+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18__shadow_.pcCWHdBG-o2qeObjYO7-LYxk2KcMwmU_0 2024-09-12T17:30:57.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.000+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:57.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.002+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:30:57.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.003+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.004+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.004+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T17:30:57.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.004+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='_hoVxSPkMnHUSjMgha04k0uTVw3RBJq7', time=2024-09-12T19:21:39.072208+0000, chain.objs.size()=3 2024-09-12T17:30:57.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.004+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.Lt2-Cd5mWgAo4WHO_hTVsgOrwPsJBb6_0 2024-09-12T17:30:57.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.004+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.Lt2-Cd5mWgAo4WHO_hTVsgOrwPsJBb6_1 2024-09-12T17:30:57.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.004+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.Lt2-Cd5mWgAo4WHO_hTVsgOrwPsJBb6_2 2024-09-12T17:30:57.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.004+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3686401049533462335', time=2024-09-12T19:23:51.557507+0000, chain.objs.size()=1 2024-09-12T17:30:57.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.004+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22__shadow_.oCoaZxG1dMjAfar8M0PK9h-nrtkyZi6_0 2024-09-12T17:30:57.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.004+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12760619445298843484', time=2024-09-12T19:23:51.558166+0000, chain.objs.size()=1 2024-09-12T17:30:57.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.004+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22__shadow_.8JouAt6Rr45qrGOjiubTeBoPdUDu1k6_0 2024-09-12T17:30:57.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.004+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17676861802571454383', time=2024-09-12T19:23:51.559824+0000, chain.objs.size()=1 2024-09-12T17:30:57.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.004+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22__shadow_.y4ATSJhNEBOkEo3jXmhI9M_waGAb_uM_0 2024-09-12T17:30:57.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.004+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12739796011732510505', time=2024-09-12T19:23:51.582615+0000, chain.objs.size()=1 2024-09-12T17:30:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.004+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22__shadow_.FfZEcMTWzLCOofzArnlo1xWZTB_LelS_0 2024-09-12T17:30:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.004+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9824602640552083586', time=2024-09-12T19:23:56.825359+0000, chain.objs.size()=1 2024-09-12T17:30:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.004+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24__shadow_.w0d0C2hGjqnpOVGzQkSQ73yBDV0aY2w_0 2024-09-12T17:30:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.004+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18004214724169282611', time=2024-09-12T19:23:56.841042+0000, chain.objs.size()=1 2024-09-12T17:30:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.004+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24__shadow_.l0pvwur7eFpde4BMu07h3g_yxg7QP3r_0 2024-09-12T17:30:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.004+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3919413677072609718', time=2024-09-12T19:24:33.776454+0000, chain.objs.size()=1 2024-09-12T17:30:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.004+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26__shadow_.Ei_l4P8VmLdWBxGml8Dg9AGAyxAvwDf_0 2024-09-12T17:30:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.004+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16447778079304663313', time=2024-09-12T19:25:09.192562+0000, chain.objs.size()=1 2024-09-12T17:30:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.004+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28__shadow_.30H19GNDmQBoiiCUwCcG2iH2iBNWTnX_0 2024-09-12T17:30:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.005+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4387446701192013163', time=2024-09-12T19:25:11.944567+0000, chain.objs.size()=1 2024-09-12T17:30:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.005+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29__shadow_.QitiWmdK3FtmIumtWTj85WxIc0hXPZ4_0 2024-09-12T17:30:57.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.008+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5699016885386297143', time=2024-09-12T19:25:11.945177+0000, chain.objs.size()=1 2024-09-12T17:30:57.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.008+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29__shadow_.1hVLJ6EEA2eoNiTvdWCyytWvSAXbtpL_0 2024-09-12T17:30:57.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.008+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1042571481389427487', time=2024-09-12T19:25:11.945774+0000, chain.objs.size()=1 2024-09-12T17:30:57.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.008+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29__shadow_.0AIbT1-wdmv9oX-kmkktKpvomIk2QNI_0 2024-09-12T17:30:57.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.008+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6974789302187094224', time=2024-09-12T19:25:45.883145+0000, chain.objs.size()=1 2024-09-12T17:30:57.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.008+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30__shadow_.Apb9IxVV_RHA0mBuVetzeA_rYD7Jgf4_0 2024-09-12T17:30:57.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.008+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9920549067379667591', time=2024-09-12T19:25:47.612531+0000, chain.objs.size()=1 2024-09-12T17:30:57.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.008+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31__shadow_.nMplievHgw3AVk9_iR5fRtRV_4wmJnF_0 2024-09-12T17:30:57.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.008+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8943278966601603342', time=2024-09-12T19:25:48.337266+0000, chain.objs.size()=1 2024-09-12T17:30:57.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.008+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31__shadow_.h1GoaPtnRSl0Wyj1Pf4789tarQpB-V2_0 2024-09-12T17:30:57.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.008+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.244119038170138228', time=2024-09-12T19:26:27.015110+0000, chain.objs.size()=1 2024-09-12T17:30:57.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.008+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34__shadow_.Ma_n61YE4XcNt0bHDcbK6I9iwhgFcj7_0 2024-09-12T17:30:57.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.008+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8979644247497319997', time=2024-09-12T19:26:27.071725+0000, chain.objs.size()=1 2024-09-12T17:30:57.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.008+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34__shadow_.-rVeAue2ukJYyMgQI7YwPuOc-LpeSx9_0 2024-09-12T17:30:57.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.008+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8429628420026700251', time=2024-09-12T19:27:00.338534+0000, chain.objs.size()=1 2024-09-12T17:30:57.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.008+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35__shadow_.H7BTXg8WA2D1WRbFFIyDXJ-3yVw9lPg_0 2024-09-12T17:30:57.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.008+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12906522372002472565', time=2024-09-12T19:27:02.757926+0000, chain.objs.size()=1 2024-09-12T17:30:57.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.008+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36__shadow_.mUt2RNYCPR7m5juTrAFJ7dlYgahd1lB_0 2024-09-12T17:30:57.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.008+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6483496893934843233', time=2024-09-12T19:27:02.769191+0000, chain.objs.size()=1 2024-09-12T17:30:57.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.008+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36__shadow_.aREuCmKfAeUEbJ_ToHWtjEaoRkPdh1U_0 2024-09-12T17:30:57.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.008+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8805479828280415164', time=2024-09-12T19:27:02.833080+0000, chain.objs.size()=1 2024-09-12T17:30:57.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.008+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36__shadow_.nmWnEz6nKiCW-TZ60JDqZiDF-HN-8b7_0 2024-09-12T17:30:57.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.009+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11575545638533338142', time=2024-09-12T19:30:29.001497+0000, chain.objs.size()=1 2024-09-12T17:30:57.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.009+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19__shadow:km8p.ya6j1fkjizF78F42I5LrqAhcir_.e_qICAPTWyTKaurO0vHdqzxAq5pZOX0_0 2024-09-12T17:30:57.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.010+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:57.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.012+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:30:57.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.013+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.014+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.014+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T17:30:57.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.014+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14265406155182615544', time=2024-09-12T19:21:38.929032+0000, chain.objs.size()=4 2024-09-12T17:30:57.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.014+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.12__multipart_foo.2~COH-AgqMNLSpxCems3bIXdRTLeIhuTf.1 2024-09-12T17:30:57.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.014+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.12__multipart_foo.2~COH-AgqMNLSpxCems3bIXdRTLeIhuTf.2 2024-09-12T17:30:57.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.014+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.12__multipart_foo.2~COH-AgqMNLSpxCems3bIXdRTLeIhuTf.3 2024-09-12T17:30:57.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.014+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.12__multipart_foo.2~COH-AgqMNLSpxCems3bIXdRTLeIhuTf.4 2024-09-12T17:30:57.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.014+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='_15Spzy-zolW4V3bqGZ5jByjs1Ov3Xsj', time=2024-09-12T19:21:39.029727+0000, chain.objs.size()=2 2024-09-12T17:30:57.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.014+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.VyfktXTy_nDgI1zg3GqQpry0v4qkP7W_0 2024-09-12T17:30:57.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.014+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.VyfktXTy_nDgI1zg3GqQpry0v4qkP7W_1 2024-09-12T17:30:57.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.014+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7975806626185912216', time=2024-09-12T19:23:16.594508+0000, chain.objs.size()=1 2024-09-12T17:30:57.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.014+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20__shadow_.j0DMvf4lqrOsXwwSbyePXBgz0UmPkv2_0 2024-09-12T17:30:57.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.014+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14212243099972485481', time=2024-09-12T19:23:51.606009+0000, chain.objs.size()=1 2024-09-12T17:30:57.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.014+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22__shadow_.u9eisTv8IG4T14QibuPfGNY8zQbCnqC_0 2024-09-12T17:30:57.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.014+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15678306760295518236', time=2024-09-12T19:23:54.638469+0000, chain.objs.size()=1 2024-09-12T17:30:57.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.014+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23__shadow_.vk3mko09v0TIB-kx5fZvuqd0EaZOQUD_0 2024-09-12T17:30:57.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.014+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.918381339057284052', time=2024-09-12T19:25:11.902862+0000, chain.objs.size()=1 2024-09-12T17:30:57.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.014+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29__shadow_.2AjHlBAbv-D43sI92m-gIq7dEhMyyys_0 2024-09-12T17:30:57.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.014+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5501546861384311651', time=2024-09-12T19:25:11.950509+0000, chain.objs.size()=1 2024-09-12T17:30:57.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.014+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29__shadow_.Uz4C2NRFLD3QTX-2KajQEgAMUpxmb2I_0 2024-09-12T17:30:57.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.014+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1098109614118197767', time=2024-09-12T19:25:48.337699+0000, chain.objs.size()=1 2024-09-12T17:30:57.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.014+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31__shadow_.7tJ6Moa0BnN6x4CFBPg3UDnkb9LKQoA_0 2024-09-12T17:30:57.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.016+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9488696018489375078', time=2024-09-12T19:25:50.265409+0000, chain.objs.size()=1 2024-09-12T17:30:57.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.016+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32__shadow_.G002Rox3vZbf1hPSj4-YMFdyaFKfN8N_0 2024-09-12T17:30:57.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.017+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14706424128264238456', time=2024-09-12T19:25:50.266550+0000, chain.objs.size()=1 2024-09-12T17:30:57.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.017+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32__shadow_.u9E2mrhC6XbWLgrEHjoXmRc2Lx41phX_0 2024-09-12T17:30:57.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.017+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6746479595412797152', time=2024-09-12T19:26:26.992033+0000, chain.objs.size()=1 2024-09-12T17:30:57.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.017+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34__shadow_.VZgIALmiHCq5gIt-ZUIRFKuyDi-yCDf_0 2024-09-12T17:30:57.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.017+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4650685421231505996', time=2024-09-12T19:27:02.752276+0000, chain.objs.size()=1 2024-09-12T17:30:57.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.017+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36__shadow_.5Fq-RzM8OSXKp6JHRcvVJk_M0BXoQgM_0 2024-09-12T17:30:57.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.018+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:57.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.020+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:30:57.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.021+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.022+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.022+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T17:30:57.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.022+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15126186676588386103', time=2024-09-12T19:23:18.666626+0000, chain.objs.size()=1 2024-09-12T17:30:57.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.022+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21__shadow_.H0aXvu1Hevy75mkLJrH0YwMpzXTYIO__0 2024-09-12T17:30:57.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.022+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11908285545690332107', time=2024-09-12T19:23:51.583480+0000, chain.objs.size()=1 2024-09-12T17:30:57.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.022+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22__shadow_.WoguVJW5qgcJ4J9y7qCBPNQCODsqmXA_0 2024-09-12T17:30:57.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.022+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3541611135807199483', time=2024-09-12T19:23:56.778421+0000, chain.objs.size()=1 2024-09-12T17:30:57.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.022+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24__shadow_.imYI6neHWSFSORhDvfkbbp4Bm52fqJH_0 2024-09-12T17:30:57.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.022+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4000140504046302674', time=2024-09-12T19:23:56.785143+0000, chain.objs.size()=1 2024-09-12T17:30:57.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.022+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24__shadow_.ibRr-RnKGqofvBXzkvq6wGjrZaaZvhx_0 2024-09-12T17:30:57.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.022+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9066868042884405736', time=2024-09-12T19:23:56.834210+0000, chain.objs.size()=1 2024-09-12T17:30:57.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.022+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24__shadow_.ZnEXOBCgX3aZbb_zq86No5PaWo1X-hQ_0 2024-09-12T17:30:57.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.022+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5922737886207370321', time=2024-09-12T19:24:33.872183+0000, chain.objs.size()=1 2024-09-12T17:30:57.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.022+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26__shadow_.yiP20QjZhmR7schKyUsFbCMQ6O26LuV_0 2024-09-12T17:30:57.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.022+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6547303807505875212', time=2024-09-12T19:25:45.829823+0000, chain.objs.size()=1 2024-09-12T17:30:57.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.022+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30__shadow_.4zi_Oh4IGoQquf96bfTuJnjXFXhwhsQ_0 2024-09-12T17:30:57.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.022+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6465401967069237464', time=2024-09-12T19:25:50.266593+0000, chain.objs.size()=1 2024-09-12T17:30:57.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.022+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32__shadow_.1EIxRVyHbTNriEEr_SE0aTOsDymA4pd_0 2024-09-12T17:30:57.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.022+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.353489767357823970', time=2024-09-12T19:27:00.337231+0000, chain.objs.size()=1 2024-09-12T17:30:57.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.022+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35__shadow_.CFIn0DJtPweQfWeqe9UPuT9Fe0lb5ub_0 2024-09-12T17:30:57.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.022+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4926309903821910311', time=2024-09-12T19:27:02.752324+0000, chain.objs.size()=1 2024-09-12T17:30:57.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.022+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36__shadow_.sljaRPr25kWgfRdA3jYm0LheIOEb_J0_0 2024-09-12T17:30:57.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.022+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5132891085046401247', time=2024-09-12T19:27:02.796921+0000, chain.objs.size()=1 2024-09-12T17:30:57.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.022+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36__shadow_.0rqNV4jK6k0Nxcu714RRzuzcWfc8McR_0 2024-09-12T17:30:57.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.022+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11433014137216089023', time=2024-09-12T19:27:38.572890+0000, chain.objs.size()=1 2024-09-12T17:30:57.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.022+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38__shadow_.BsPcBZDSjnrt0TQx0MPVCSt6JSU-qBd_0 2024-09-12T17:30:57.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.024+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16008066538123706981', time=2024-09-12T19:27:40.449342+0000, chain.objs.size()=1 2024-09-12T17:30:57.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.024+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39__shadow_.cU5AtN3TFjEc-omIC0U2twpLI2cKOPU_0 2024-09-12T17:30:57.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.025+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:57.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.027+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:30:57.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.029+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.029+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.030+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T17:30:57.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.030+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5673311322142327809', time=2024-09-12T19:21:39.090987+0000, chain.objs.size()=3 2024-09-12T17:30:57.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.030+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-STANDARD.2~wryHCHt-Fgh1VcKvrGO7SlxzddO7SzP.1 2024-09-12T17:30:57.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.030+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-STANDARD.2~wryHCHt-Fgh1VcKvrGO7SlxzddO7SzP.2 2024-09-12T17:30:57.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.030+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-STANDARD.2~wryHCHt-Fgh1VcKvrGO7SlxzddO7SzP.3 2024-09-12T17:30:57.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.030+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12077025477547660464', time=2024-09-12T19:23:16.594007+0000, chain.objs.size()=1 2024-09-12T17:30:57.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.030+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20__shadow_.RAbfvGj1WFBOBgykWyoQCxvb9gCEUAU_0 2024-09-12T17:30:57.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.030+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3188133349354402800', time=2024-09-12T19:24:31.057049+0000, chain.objs.size()=1 2024-09-12T17:30:57.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.030+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25__shadow_.G3_so0rxtVzzlxwS1vdNuS2C3-uZ2sg_0 2024-09-12T17:30:57.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.030+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8739054475996874037', time=2024-09-12T19:24:33.865339+0000, chain.objs.size()=1 2024-09-12T17:30:57.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.030+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26__shadow_._yaXXx7ck5LLuO4ygmqY81qoeCVp-kF_0 2024-09-12T17:30:57.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.030+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.927699740811006261', time=2024-09-12T19:25:48.337643+0000, chain.objs.size()=1 2024-09-12T17:30:57.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.030+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31__shadow_.7etaz8AJRyryBB-mXjE0EW3i14OcCe8_0 2024-09-12T17:30:57.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.030+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12989404041733348776', time=2024-09-12T19:25:50.270463+0000, chain.objs.size()=1 2024-09-12T17:30:57.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.030+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32__shadow_.J_oCVf8cqCJriS6aPLA2oWTluPgAV0O_0 2024-09-12T17:30:57.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.030+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5237540403490336348', time=2024-09-12T19:25:50.331980+0000, chain.objs.size()=1 2024-09-12T17:30:57.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.030+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32__shadow_.5QFpFgJNnfIr5I2XRO3y5IeXJXRQZoZ_0 2024-09-12T17:30:57.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.030+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12219882737503642865', time=2024-09-12T19:27:00.309281+0000, chain.objs.size()=1 2024-09-12T17:30:57.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.030+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35__shadow_.IlL8CQoBhd4FB08WQijyHMg6zWB1kZ3_0 2024-09-12T17:30:57.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.030+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9603363263337142573', time=2024-09-12T19:27:02.819605+0000, chain.objs.size()=1 2024-09-12T17:30:57.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.030+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36__shadow_.E9b2rKeEjqCG-Tz5KcxPCPajaF-uRgO_0 2024-09-12T17:30:57.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.030+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8019222030809239459', time=2024-09-12T19:27:35.831770+0000, chain.objs.size()=1 2024-09-12T17:30:57.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.030+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37__shadow_.x0ZZkF_gI_ckFrwyWHyfvoCc_tJboR-_0 2024-09-12T17:30:57.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.031+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16217854895309913821', time=2024-09-12T19:27:35.863849+0000, chain.objs.size()=1 2024-09-12T17:30:57.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.031+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37__shadow_.PX3HOr8-5U-I31s_lxuNUESW884zKeI_0 2024-09-12T17:30:57.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.031+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15303548339577428521', time=2024-09-12T19:27:38.480135+0000, chain.objs.size()=1 2024-09-12T17:30:57.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.031+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38__shadow_.x6WM9SPAmXnv4Hj54qkoQYL5YN6_NY__0 2024-09-12T17:30:57.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.031+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6215162344300135563', time=2024-09-12T19:27:38.563614+0000, chain.objs.size()=1 2024-09-12T17:30:57.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.032+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38__shadow_.4aEEAt_OhF6VOIfGy6M1Tefrot8lUXB_0 2024-09-12T17:30:57.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.032+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3273494420028459127', time=2024-09-12T19:28:13.709587+0000, chain.objs.size()=1 2024-09-12T17:30:57.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.032+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40__shadow_.LdENLMdUyUboa6XHCGeC6RYM5j1xFlf_0 2024-09-12T17:30:57.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.032+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12065888254580169975', time=2024-09-12T19:28:13.710087+0000, chain.objs.size()=1 2024-09-12T17:30:57.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.032+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40__shadow_.wTyrw3kw2OvVJHMfKaoNgvofqlkJfQD_0 2024-09-12T17:30:57.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.032+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3436333879640754952', time=2024-09-12T19:28:13.752940+0000, chain.objs.size()=1 2024-09-12T17:30:57.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.032+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40__shadow_.O7-GcFea8KMNeDBjskg-PJGszgK_Tcu_0 2024-09-12T17:30:57.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.034+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:57.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.036+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:30:57.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.037+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.038+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.038+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T17:30:57.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.038+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8795845743960068343', time=2024-09-12T19:23:16.549538+0000, chain.objs.size()=1 2024-09-12T17:30:57.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.038+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.20__shadow_.I30cIFcnVOJDIACZLPwd0fd1oAaBm-f_0 2024-09-12T17:30:57.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.038+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6362753403929965156', time=2024-09-12T19:23:18.671721+0000, chain.objs.size()=1 2024-09-12T17:30:57.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.038+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21__shadow_.5kB44p8n6Znn-A7bsuIH4uyLfavsduF_0 2024-09-12T17:30:57.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.038+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.325349073892513115', time=2024-09-12T19:23:18.723543+0000, chain.objs.size()=1 2024-09-12T17:30:57.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.038+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.21__shadow_.Wv7vDavOonVVJlfMb3bwqd45rZ3zqUp_0 2024-09-12T17:30:57.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.038+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7816378507550916264', time=2024-09-12T19:23:56.834891+0000, chain.objs.size()=1 2024-09-12T17:30:57.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.038+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24__shadow_.75OoWYB1EwGftutuuKKlSTFqfwaPdiR_0 2024-09-12T17:30:57.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.038+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13076255224316800873', time=2024-09-12T19:23:56.855374+0000, chain.objs.size()=1 2024-09-12T17:30:57.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.038+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24__shadow_.WjNPjQuw9qSMmVC66Hf_QWcAQVc_d5g_0 2024-09-12T17:30:57.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.038+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7054559958879022612', time=2024-09-12T19:23:58.984722+0000, chain.objs.size()=1 2024-09-12T17:30:57.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.038+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25__shadow_.33ZwpF22hl_p3UE5bSZC3EU2VbmmbVR_0 2024-09-12T17:30:57.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.038+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8805941654695350979', time=2024-09-12T19:24:33.817169+0000, chain.objs.size()=1 2024-09-12T17:30:57.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.038+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26__shadow_.KkWrmU4tjux--R11bmMD9FlD-mwabd__0 2024-09-12T17:30:57.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.038+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13432994370315243103', time=2024-09-12T19:24:36.211856+0000, chain.objs.size()=1 2024-09-12T17:30:57.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.038+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27__shadow_.vpKrjrtmquUs6nfjCzF6DknU6wTqslz_0 2024-09-12T17:30:57.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.038+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5761536634430726858', time=2024-09-12T19:25:48.371252+0000, chain.objs.size()=1 2024-09-12T17:30:57.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.038+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31__shadow_.wFpe6jsnzyjgFDV0z4kjsS6dZGVKH0o_0 2024-09-12T17:30:57.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.038+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3605837774046786212', time=2024-09-12T19:26:27.017764+0000, chain.objs.size()=1 2024-09-12T17:30:57.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.038+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34__shadow_.UkQ_vCsSTwFMqy-QxQwyXJSMmXVMTjh_0 2024-09-12T17:30:57.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.038+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13942818494140270958', time=2024-09-12T19:26:27.018599+0000, chain.objs.size()=1 2024-09-12T17:30:57.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.038+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34__shadow_.fnWK_XW3rzLHAD9gDy93z2z1zRiU9Fn_0 2024-09-12T17:30:57.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.038+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14878067543011720816', time=2024-09-12T19:27:00.291477+0000, chain.objs.size()=1 2024-09-12T17:30:57.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.038+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35__shadow_.PD9RqJ27_sQNB-VAD6NPEvFSMUi6M6C_0 2024-09-12T17:30:57.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.040+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8868644192535855501', time=2024-09-12T19:27:00.316567+0000, chain.objs.size()=1 2024-09-12T17:30:57.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.040+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35__shadow_.DrsGPZt07858fhBNE2sLM0h65lmOOzE_0 2024-09-12T17:30:57.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.040+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5924171598312385758', time=2024-09-12T19:27:00.351286+0000, chain.objs.size()=1 2024-09-12T17:30:57.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.040+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35__shadow_.U3832wZxkYd2qHDlfykYxTzEiU46smH_0 2024-09-12T17:30:57.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.040+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6504243794880032198', time=2024-09-12T19:27:40.483115+0000, chain.objs.size()=1 2024-09-12T17:30:57.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.040+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39__shadow_.Xb8scZEnyzir1v-t1wFyCzeQLJAvdAN_0 2024-09-12T17:30:57.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.040+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10034545609180921420', time=2024-09-12T19:28:13.677292+0000, chain.objs.size()=1 2024-09-12T17:30:57.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.040+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40__shadow_.UAuh1jztaVeKEacxa_Qt0Cbu8u8w9d3_0 2024-09-12T17:30:57.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.040+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15639537509410049896', time=2024-09-12T19:30:34.304187+0000, chain.objs.size()=1 2024-09-12T17:30:57.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.040+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19__shadow:mCZhleRGkpMsK0Poc3YnkBt-sdsWKAl_.PgqrOyfnPlTV2pPfnhb1RglNO5ooyD6_0 2024-09-12T17:30:57.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.042+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:57.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.044+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:30:57.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.045+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.046+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.046+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T17:30:57.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.046+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='_qnjvLymJY_x5Uy33VL_9ehibLD5Ouna', time=2024-09-12T19:21:39.094535+0000, chain.objs.size()=1 2024-09-12T17:30:57.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.046+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_.sHYeDyCoMHhmph3H9Uxq57V1RNuAoxD_0 2024-09-12T17:30:57.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.046+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2471972560853996655', time=2024-09-12T19:21:39.121168+0000, chain.objs.size()=5 2024-09-12T17:30:57.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.046+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.15__multipart_foo-FROZEN.2~SL4L9qalYx-L6CiZnYL1nKbfNe4YGEr.1 2024-09-12T17:30:57.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.046+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.15__shadow_foo-FROZEN.2~SL4L9qalYx-L6CiZnYL1nKbfNe4YGEr.1_1 2024-09-12T17:30:57.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.046+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.15__multipart_foo-FROZEN.2~SL4L9qalYx-L6CiZnYL1nKbfNe4YGEr.2 2024-09-12T17:30:57.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.046+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.15__shadow_foo-FROZEN.2~SL4L9qalYx-L6CiZnYL1nKbfNe4YGEr.2_1 2024-09-12T17:30:57.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.046+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.15__multipart_foo-FROZEN.2~SL4L9qalYx-L6CiZnYL1nKbfNe4YGEr.3 2024-09-12T17:30:57.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.046+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15694438184546819403', time=2024-09-12T19:21:39.239850+0000, chain.objs.size()=1 2024-09-12T17:30:57.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.046+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.9__shadow_.mHZca3aHkFxPEnwfbkkN2w5FDSZcDbv_0 2024-09-12T17:30:57.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.046+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15589698840736377283', time=2024-09-12T19:23:51.619540+0000, chain.objs.size()=1 2024-09-12T17:30:57.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.046+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22__shadow_.zPeAb9iOMLrm3_E8g5c5QNEqQINr3VD_0 2024-09-12T17:30:57.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.046+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14507511286755300001', time=2024-09-12T19:23:54.649902+0000, chain.objs.size()=1 2024-09-12T17:30:57.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.046+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23__shadow_.IDi_cybL8Ka7bOnjmuyLnn9-L4PuJXl_0 2024-09-12T17:30:57.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.047+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8249367917043483216', time=2024-09-12T19:23:54.650495+0000, chain.objs.size()=1 2024-09-12T17:30:57.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.047+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23__shadow_.7mYMEBO2mFYZAO55if2X15odgAvgyFk_0 2024-09-12T17:30:57.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.047+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10286696496615808698', time=2024-09-12T19:23:54.672230+0000, chain.objs.size()=1 2024-09-12T17:30:57.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.047+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23__shadow_.4Xp4U1BkkCNTysDxQopUjFQ3hSSg8Vc_0 2024-09-12T17:30:57.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.047+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9344447401579828565', time=2024-09-12T19:23:54.685016+0000, chain.objs.size()=1 2024-09-12T17:30:57.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.047+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23__shadow_.IOGSNZKC_5VnrqUQjy41IK_7OYrDE45_0 2024-09-12T17:30:57.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.048+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6091032712088273115', time=2024-09-12T19:24:31.107093+0000, chain.objs.size()=1 2024-09-12T17:30:57.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.048+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.25__shadow_.7sWMHhz3ubbcbOdFyANTVi4lg34nFll_0 2024-09-12T17:30:57.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.049+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3357445222859911806', time=2024-09-12T19:25:45.769313+0000, chain.objs.size()=1 2024-09-12T17:30:57.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.049+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30__shadow_.ur1VulQeIGFFtKFJbre-x8VFG07fM9c_0 2024-09-12T17:30:57.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.049+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13182884430803513772', time=2024-09-12T19:25:45.771553+0000, chain.objs.size()=1 2024-09-12T17:30:57.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.049+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30__shadow_.eYXnywOuZIxImY9mT-C1ePoMQXNeJBU_0 2024-09-12T17:30:57.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.049+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17483316584757597417', time=2024-09-12T19:25:50.327047+0000, chain.objs.size()=1 2024-09-12T17:30:57.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.049+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32__shadow_.sxForhPV7wGt1P5PGW2rjqakb1FOxI4_0 2024-09-12T17:30:57.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.049+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7712465408097314953', time=2024-09-12T19:26:25.489876+0000, chain.objs.size()=1 2024-09-12T17:30:57.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.049+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34__shadow_.FMM9pbtmU1TsLioybvIbHFkETtkSLv-_0 2024-09-12T17:30:57.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.049+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2771923591419926389', time=2024-09-12T19:26:28.795076+0000, chain.objs.size()=1 2024-09-12T17:30:57.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.049+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35__shadow_.3IwBfETNB5ldXKy449FKA33EMzUoNCi_0 2024-09-12T17:30:57.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.049+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4166765493704864516', time=2024-09-12T19:27:04.539849+0000, chain.objs.size()=1 2024-09-12T17:30:57.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.049+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37__shadow_.6xaIGnSZp012JfNLjKlG29FQJd-oZcx_0 2024-09-12T17:30:57.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.049+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11526344433894184467', time=2024-09-12T19:27:35.826260+0000, chain.objs.size()=1 2024-09-12T17:30:57.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.049+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37__shadow_.MjysRte3tw9hTWv8bv7687areCrGNxH_0 2024-09-12T17:30:57.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.050+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.243118169813961724', time=2024-09-12T19:27:38.480127+0000, chain.objs.size()=1 2024-09-12T17:30:57.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.050+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38__shadow_.89yEqXHvRrGv-f6xU3I714n9wW0rNzi_0 2024-09-12T17:30:57.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.050+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10888279541644827029', time=2024-09-12T19:27:38.506205+0000, chain.objs.size()=1 2024-09-12T17:30:57.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.050+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38__shadow_.soy1FcAAtnuoC_N9GMAo7q4BgS6m5QK_0 2024-09-12T17:30:57.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.050+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12144087303867994890', time=2024-09-12T19:27:40.420157+0000, chain.objs.size()=1 2024-09-12T17:30:57.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.050+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39__shadow_.WxgMAIzK-FDF56Kud5ppBGX7U1xGT4e_0 2024-09-12T17:30:57.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.050+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14359735922194092589', time=2024-09-12T19:27:40.506575+0000, chain.objs.size()=1 2024-09-12T17:30:57.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.050+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39__shadow_.OrkGs5xSte8ZAJ_5tbjKwJX85jHznT6_0 2024-09-12T17:30:57.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.052+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:57.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.055+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:30:57.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.056+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.056+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.057+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T17:30:57.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.057+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11878370248045580242', time=2024-09-12T19:23:51.585006+0000, chain.objs.size()=1 2024-09-12T17:30:57.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.057+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22__shadow_.Z54PVACmARiLYOfkMMDNe7tY3czhcKV_0 2024-09-12T17:30:57.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.057+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3874908516901822236', time=2024-09-12T19:23:54.636612+0000, chain.objs.size()=1 2024-09-12T17:30:57.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.057+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.23__shadow_.wO6sOANPYE-S_jaarVt8D7QYZjkUI0w_0 2024-09-12T17:30:57.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.057+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4954346621757771459', time=2024-09-12T19:24:33.797785+0000, chain.objs.size()=1 2024-09-12T17:30:57.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.057+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26__shadow_.oeqzYDTHmTE0KBDLJLBthEn5kXjjZbO_0 2024-09-12T17:30:57.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.057+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.117375541421731522', time=2024-09-12T19:24:36.143661+0000, chain.objs.size()=1 2024-09-12T17:30:57.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.057+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27__shadow_.A267EWOuq3HRS1EAae7hHUiFtX13b3H_0 2024-09-12T17:30:57.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.057+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6482477114689660805', time=2024-09-12T19:25:45.830200+0000, chain.objs.size()=1 2024-09-12T17:30:57.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.057+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30__shadow_.5BAi9gqFfZY8EapBKtbKkJZpmiwvkmt_0 2024-09-12T17:30:57.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.057+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8872991274623110553', time=2024-09-12T19:25:48.343538+0000, chain.objs.size()=1 2024-09-12T17:30:57.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.057+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31__shadow_.sTT-_Z_fQRQasP_zGT1js7zYpwPvby7_0 2024-09-12T17:30:57.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.057+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13970603716150564017', time=2024-09-12T19:25:50.262041+0000, chain.objs.size()=1 2024-09-12T17:30:57.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.057+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32__shadow_.tW142A0OdHWxZ-6xZ6wzNfIwJjH1Sbg_0 2024-09-12T17:30:57.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.057+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.263579118188797409', time=2024-09-12T19:25:50.324857+0000, chain.objs.size()=1 2024-09-12T17:30:57.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.057+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32__shadow_.O1-78N2Wlv68DystpiwtRDgPpbSOe6D_0 2024-09-12T17:30:57.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.057+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14401448964553217742', time=2024-09-12T19:27:00.286093+0000, chain.objs.size()=1 2024-09-12T17:30:57.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.057+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35__shadow_.RmPwEX-Ax0QlyXFtwHQm9i1R9fwNxMo_0 2024-09-12T17:30:57.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.057+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16573820389237626018', time=2024-09-12T19:28:13.711776+0000, chain.objs.size()=1 2024-09-12T17:30:57.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.057+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40__shadow_.-G-PYJug2qrwPkPUjq4I6kxM0qAl5O1_0 2024-09-12T17:30:57.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.057+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13244630985194793137', time=2024-09-12T19:30:20.799402+0000, chain.objs.size()=1 2024-09-12T17:30:57.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.057+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18__shadow_.-SUs76zh4eDdHNWyG0d1_me8RD6JGFr_0 2024-09-12T17:30:57.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.059+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:57.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.061+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:30:57.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.062+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.063+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.063+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T17:30:57.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.063+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16146921142852605541', time=2024-09-12T19:21:39.018827+0000, chain.objs.size()=2 2024-09-12T17:30:57.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.063+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.UsyASbPO1CdwWRiOW5shozzYAdXZy15_0 2024-09-12T17:30:57.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.063+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.16__shadow_.UsyASbPO1CdwWRiOW5shozzYAdXZy15_1 2024-09-12T17:30:57.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.063+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10024466635781711595', time=2024-09-12T19:21:39.083795+0000, chain.objs.size()=5 2024-09-12T17:30:57.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.063+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-LUKEWARM.2~9omk0vlP-uGSsfapRNknN8q4WBMrZOv.1 2024-09-12T17:30:57.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.063+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_foo-LUKEWARM.2~9omk0vlP-uGSsfapRNknN8q4WBMrZOv.1_1 2024-09-12T17:30:57.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.063+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-LUKEWARM.2~9omk0vlP-uGSsfapRNknN8q4WBMrZOv.2 2024-09-12T17:30:57.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.063+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__shadow_foo-LUKEWARM.2~9omk0vlP-uGSsfapRNknN8q4WBMrZOv.2_1 2024-09-12T17:30:57.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.063+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.17__multipart_foo-LUKEWARM.2~9omk0vlP-uGSsfapRNknN8q4WBMrZOv.3 2024-09-12T17:30:57.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.063+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7054605069273555136', time=2024-09-12T19:21:39.232274+0000, chain.objs.size()=1 2024-09-12T17:30:57.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.063+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.9__shadow_.Uzt2cq06NXazJ1Htd-DVG09vRjkfOnH_0 2024-09-12T17:30:57.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.063+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9317756011072821927', time=2024-09-12T19:23:51.557604+0000, chain.objs.size()=1 2024-09-12T17:30:57.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.063+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.22__shadow_.ASbl2_TEVQVJBTlgZuXyxKSVMBw-X-U_0 2024-09-12T17:30:57.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.063+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7599230309826732658', time=2024-09-12T19:23:56.865528+0000, chain.objs.size()=1 2024-09-12T17:30:57.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.063+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.24__shadow_.484QiyBPJ8yOTNU5C3u4DZu53FJbQQm_0 2024-09-12T17:30:57.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.063+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17244714999241679647', time=2024-09-12T19:24:33.792024+0000, chain.objs.size()=1 2024-09-12T17:30:57.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.063+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.26__shadow_.9NREUqXPKrVePF3GT1Lts-ny_0Vk0Xz_0 2024-09-12T17:30:57.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.063+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18176678481942344130', time=2024-09-12T19:25:09.231324+0000, chain.objs.size()=1 2024-09-12T17:30:57.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.063+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.28__shadow_.wnDE9xKQmAT6LSjIWrpCyjoQMorx3Xq_0 2024-09-12T17:30:57.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.066+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16673898233271955291', time=2024-09-12T19:25:11.945316+0000, chain.objs.size()=1 2024-09-12T17:30:57.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.066+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29__shadow_.ggIicPkYYcRPuJ8pfly2xLypLf3nanX_0 2024-09-12T17:30:57.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.066+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6065536021180863920', time=2024-09-12T19:25:11.988835+0000, chain.objs.size()=1 2024-09-12T17:30:57.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.066+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.29__shadow_.b9583gNlWboyXCinsmQ5zyPlpV7dHTD_0 2024-09-12T17:30:57.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.066+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17259915162068970593', time=2024-09-12T19:25:45.831501+0000, chain.objs.size()=1 2024-09-12T17:30:57.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.066+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.30__shadow_.ZG5cs9NObuRHUCg9-TjBbZHvnH1n5-c_0 2024-09-12T17:30:57.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.066+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5509877045707009173', time=2024-09-12T19:25:50.230055+0000, chain.objs.size()=1 2024-09-12T17:30:57.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.066+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32__shadow_.sQX_RQiEgahUJxpb5AeyJkdIbmBHx3T_0 2024-09-12T17:30:57.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.066+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11330051684673087164', time=2024-09-12T19:25:50.249613+0000, chain.objs.size()=1 2024-09-12T17:30:57.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.066+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.32__shadow_.Teq1SEahC_aH4NgMcWDI3i2V52H-I3Z_0 2024-09-12T17:30:57.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.067+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2099341692457333471', time=2024-09-12T19:26:22.850424+0000, chain.objs.size()=1 2024-09-12T17:30:57.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.067+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33__shadow_.71p_egkXTYNGCX1gIlG3Qyxcy6F4Jcf_0 2024-09-12T17:30:57.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.067+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1734819925359231912', time=2024-09-12T19:26:22.880693+0000, chain.objs.size()=1 2024-09-12T17:30:57.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.067+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33__shadow_.depFpLXa4-iNdKDyQvDFh2SG7YGGuJJ_0 2024-09-12T17:30:57.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.067+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4951513413672458234', time=2024-09-12T19:26:22.881879+0000, chain.objs.size()=1 2024-09-12T17:30:57.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.067+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33__shadow_.iz3PhT3csJ_fTPh_sdMOkOpXWf2jKy2_0 2024-09-12T17:30:57.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.067+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5331497847610757712', time=2024-09-12T19:27:00.268161+0000, chain.objs.size()=1 2024-09-12T17:30:57.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.067+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.35__shadow_.77GwN4O1d2U-QR95A9AcNZZ7AbO3qSK_0 2024-09-12T17:30:57.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.067+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10003585155278134026', time=2024-09-12T19:27:02.779028+0000, chain.objs.size()=1 2024-09-12T17:30:57.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.067+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36__shadow_.YIL9KuK5E08CD9N5N4_bI_cN5TiT8GQ_0 2024-09-12T17:30:57.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.067+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4288528052132275078', time=2024-09-12T19:27:35.818626+0000, chain.objs.size()=1 2024-09-12T17:30:57.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.067+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37__shadow_.wpDcy107Is3qgvlqXqWWAhT-oYN8tJp_0 2024-09-12T17:30:57.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.067+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12545266757671027649', time=2024-09-12T19:27:38.501361+0000, chain.objs.size()=1 2024-09-12T17:30:57.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.067+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38__shadow_.8YF_mhaYNJXhEfJ0GAQs48GLmA_zYnl_0 2024-09-12T17:30:57.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.068+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.744005831283334778', time=2024-09-12T19:27:38.502112+0000, chain.objs.size()=1 2024-09-12T17:30:57.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.068+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38__shadow_.UvPyH9RQ1c4jOD4957AIp7ee_Q8Yqv-_0 2024-09-12T17:30:57.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.068+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12348909671483858919', time=2024-09-12T19:27:38.542589+0000, chain.objs.size()=1 2024-09-12T17:30:57.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.068+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.38__shadow_.rkujnrpVeIEuwz-0up9w2bzwu7pD6na_0 2024-09-12T17:30:57.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.068+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15955567228058639670', time=2024-09-12T19:27:40.430277+0000, chain.objs.size()=1 2024-09-12T17:30:57.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.068+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.39__shadow_.u6NJYnYiww0EermuLleRTm9hvRH20z0_0 2024-09-12T17:30:57.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.068+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6265607913781863212', time=2024-09-12T19:27:42.217089+0000, chain.objs.size()=1 2024-09-12T17:30:57.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.068+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40__shadow_.UhJWj-y14mhcAR3AFPEuVtlHXbDvcx-_0 2024-09-12T17:30:57.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.069+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4243885531390012357', time=2024-09-12T19:30:20.807408+0000, chain.objs.size()=1 2024-09-12T17:30:57.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.069+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18__shadow_.qPKb1xO53TvvZkAcO4C3YQ_OvwvEMCe_0 2024-09-12T17:30:57.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.069+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14612057712010030513', time=2024-09-12T19:30:20.825573+0000, chain.objs.size()=1 2024-09-12T17:30:57.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.069+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.18__shadow_.PC4cATZBtW4zkarUJDD6557QR11iTFd_0 2024-09-12T17:30:57.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.070+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:57.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.073+0000 7fc92ab2e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:30:57.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.074+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.075+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.075+0000 7fc92ab2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T17:30:57.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.075+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4811040358112058106', time=2024-09-12T19:24:36.160731+0000, chain.objs.size()=1 2024-09-12T17:30:57.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.075+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.27__shadow_.3zBwxfxJQkw3ktYE8F_y1mKNsSHwxAb_0 2024-09-12T17:30:57.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.075+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13523620654682761449', time=2024-09-12T19:25:48.376245+0000, chain.objs.size()=1 2024-09-12T17:30:57.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.075+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.31__shadow_.X6BWsFugW1MBX-5skwFkOcrAW2P2Xwk_0 2024-09-12T17:30:57.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.075+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6697788553128775416', time=2024-09-12T19:26:22.873779+0000, chain.objs.size()=1 2024-09-12T17:30:57.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.075+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33__shadow_.KXIE7LE0tYWiDnsIQhGtoGyhnVCJRut_0 2024-09-12T17:30:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.075+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.599553644215829777', time=2024-09-12T19:26:22.881246+0000, chain.objs.size()=1 2024-09-12T17:30:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.075+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.33__shadow_.gzXt3SDOuvuRRTAWlWSrei4hNEe5XhL_0 2024-09-12T17:30:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.075+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2867817810363997511', time=2024-09-12T19:26:27.016341+0000, chain.objs.size()=1 2024-09-12T17:30:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.075+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34__shadow_.76Yp18g4v1o22ZT9CHIaBmjyT2LkOFB_0 2024-09-12T17:30:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.075+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5671849915871453678', time=2024-09-12T19:26:27.069554+0000, chain.objs.size()=1 2024-09-12T17:30:57.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.075+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.34__shadow_._e9O8MWxadtEhgv9L4Eaomzahj84Kod_0 2024-09-12T17:30:57.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.075+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4684326297152360671', time=2024-09-12T19:27:02.070270+0000, chain.objs.size()=1 2024-09-12T17:30:57.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.075+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36__shadow_.os6qHpHK4uJds0qqDVx5-B5M-FlT49m_0 2024-09-12T17:30:57.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.075+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5096444886333598746', time=2024-09-12T19:27:02.783108+0000, chain.objs.size()=1 2024-09-12T17:30:57.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.075+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.36__shadow_.Mpi9_k0R-6sOOxKiVexZWict4zpaTKE_0 2024-09-12T17:30:57.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.075+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18203986984622059819', time=2024-09-12T19:27:35.775202+0000, chain.objs.size()=1 2024-09-12T17:30:57.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.076+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37__shadow_.nO4zTXqIkdlCF1E97C6sVfN6T_W4bso_0 2024-09-12T17:30:57.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.076+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7664513698679300663', time=2024-09-12T19:27:35.796104+0000, chain.objs.size()=1 2024-09-12T17:30:57.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.076+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.37__shadow_.EdIqKfE3dYf3mulPB6Kw4_GkPcz1SWa_0 2024-09-12T17:30:57.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.076+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3200138939900136499', time=2024-09-12T19:28:13.688494+0000, chain.objs.size()=1 2024-09-12T17:30:57.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.076+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.40__shadow_.eqrggslxY4n8rYZ74c5nGQx2UskZ-ab_0 2024-09-12T17:30:57.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.076+0000 7fc92ab2e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15202747419255521012', time=2024-09-12T19:30:34.305925+0000, chain.objs.size()=1 2024-09-12T17:30:57.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.076+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.19__shadow:ZNn9ljKm7yqOglOUNLlHW-wuUjbvl2b_.Xk-JQ-RvJy0sEjohbl3FAuL3J5iEcCj_0 2024-09-12T17:30:57.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.078+0000 7fc92ab2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:57.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.081+0000 7fc7dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:57.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.083+0000 7fc92ab2e800 20 remove_watcher() i=0 2024-09-12T17:30:57.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.083+0000 7fc92ab2e800 2 removed watcher, disabling cache 2024-09-12T17:30:57.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.084+0000 7fc92ab2e800 20 remove_watcher() i=1 2024-09-12T17:30:57.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.085+0000 7fc92ab2e800 20 remove_watcher() i=2 2024-09-12T17:30:57.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.087+0000 7fc92ab2e800 20 remove_watcher() i=3 2024-09-12T17:30:57.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.087+0000 7fc92ab2e800 20 remove_watcher() i=4 2024-09-12T17:30:57.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.088+0000 7fc92ab2e800 20 remove_watcher() i=5 2024-09-12T17:30:57.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.089+0000 7fc92ab2e800 20 remove_watcher() i=6 2024-09-12T17:30:57.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.090+0000 7fc92ab2e800 20 remove_watcher() i=7 2024-09-12T17:30:57.103 DEBUG:teuthology.orchestra.run.smithi067:> radosgw-admin gc process --include-all 2024-09-12T17:30:57.197 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:57.197 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:57.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.234+0000 7f2b8733d800 20 rados->read ofs=0 len=0 2024-09-12T17:30:57.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.236+0000 7f2b8733d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:57.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.236+0000 7f2b8733d800 20 realm 2024-09-12T17:30:57.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.236+0000 7f2b8733d800 20 rados->read ofs=0 len=0 2024-09-12T17:30:57.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.236+0000 7f2b8733d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:57.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.236+0000 7f2b8733d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:57.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.236+0000 7f2b8733d800 20 rados->read ofs=0 len=0 2024-09-12T17:30:57.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.237+0000 7f2b8733d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:57.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.237+0000 7f2b8733d800 20 rados->read ofs=0 len=0 2024-09-12T17:30:57.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.237+0000 7f2b8733d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:57.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.237+0000 7f2b8733d800 20 rados->read ofs=0 len=0 2024-09-12T17:30:57.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.238+0000 7f2b8733d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:30:57.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.238+0000 7f2b8733d800 20 searching for the correct realm 2024-09-12T17:30:57.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.241+0000 7f2b82829640 0 -- 172.21.15.67:0/1280699965 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x559696747640 msgr2=0x559696749a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:57.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.244+0000 7f2b8302a640 0 -- 172.21.15.67:0/1280699965 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f2b78085940 msgr2=0x7f2b78084420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:57.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.451+0000 7f2b8733d800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:30:57.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.451+0000 7f2b8733d800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:30:57.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.451+0000 7f2b8733d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:57.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.451+0000 7f2b8733d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:57.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.451+0000 7f2b8733d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.451+0000 7f2b8733d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.451+0000 7f2b8733d800 20 rados->read ofs=0 len=0 2024-09-12T17:30:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.451+0000 7f2b8733d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.451+0000 7f2b8733d800 20 rados->read ofs=0 len=0 2024-09-12T17:30:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.451+0000 7f2b8733d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.451+0000 7f2b8733d800 20 rados->read ofs=0 len=0 2024-09-12T17:30:57.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.452+0000 7f2b8733d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:30:57.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.452+0000 7f2b8733d800 20 zone default found 2024-09-12T17:30:57.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.452+0000 7f2b8733d800 4 Realm: () 2024-09-12T17:30:57.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.452+0000 7f2b8733d800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:30:57.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.452+0000 7f2b8733d800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:30:57.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.452+0000 7f2b8733d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.452+0000 7f2b8733d800 20 zonegroup default 2024-09-12T17:30:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.452+0000 7f2b8733d800 20 rados->read ofs=0 len=0 2024-09-12T17:30:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.452+0000 7f2b8733d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.452+0000 7f2b8733d800 20 rados->read ofs=0 len=0 2024-09-12T17:30:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.452+0000 7f2b8733d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.452+0000 7f2b8733d800 20 rados->read ofs=0 len=0 2024-09-12T17:30:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.452+0000 7f2b8733d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.452+0000 7f2b8733d800 20 started sync module instance, tier type = 2024-09-12T17:30:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.452+0000 7f2b8733d800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:30:57.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.461+0000 7f2b8733d800 20 add_watcher() i=0 2024-09-12T17:30:57.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.461+0000 7f2b8733d800 20 add_watcher() i=1 2024-09-12T17:30:57.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.461+0000 7f2b8733d800 20 add_watcher() i=2 2024-09-12T17:30:57.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.461+0000 7f2b8733d800 20 add_watcher() i=3 2024-09-12T17:30:57.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.461+0000 7f2b8733d800 20 add_watcher() i=4 2024-09-12T17:30:57.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.461+0000 7f2b8733d800 20 add_watcher() i=5 2024-09-12T17:30:57.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.461+0000 7f2b8733d800 20 add_watcher() i=6 2024-09-12T17:30:57.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.462+0000 7f2b8733d800 20 add_watcher() i=7 2024-09-12T17:30:57.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.462+0000 7f2b8733d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:57.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.464+0000 7f2a39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:57.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.464+0000 7f2b8733d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:57.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.464+0000 7f2b8733d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:57.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.498+0000 7f2a38fe1640 20 reqs_thread_entry: start 2024-09-12T17:30:57.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.498+0000 7f2b8733d800 20 init_complete bucket index max shards: 1 2024-09-12T17:30:57.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.498+0000 7f2b8733d800 20 Filter name: none 2024-09-12T17:30:57.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.498+0000 7f29b27fc640 20 reqs_thread_entry: start 2024-09-12T17:30:57.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.498+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:30:57.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.500+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.500+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.501+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.502+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:30:57.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.503+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.504+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.504+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.505+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:30:57.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.506+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.506+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.507+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.508+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:30:57.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.509+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.509+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.509+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.510+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:30:57.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.512+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.512+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.513+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.514+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:30:57.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.515+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.515+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.516+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.516+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:30:57.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.518+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.518+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.518+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.519+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:30:57.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.521+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.521+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.521+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.522+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:30:57.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.523+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.524+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.524+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.525+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:30:57.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.527+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.527+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.528+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.529+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:30:57.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.530+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.530+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.530+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.531+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:30:57.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.533+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.533+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.534+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.535+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:30:57.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.536+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.536+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.537+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.538+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:30:57.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.539+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.539+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.540+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.541+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:30:57.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.542+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.542+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.543+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.543+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:30:57.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.545+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.545+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.546+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.547+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:30:57.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.548+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.549+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.549+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.550+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:30:57.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.552+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.552+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.552+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.553+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:30:57.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.554+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.555+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.555+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.556+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:30:57.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.558+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.558+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.558+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.559+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:30:57.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.561+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.562+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.562+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.563+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:30:57.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.564+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.565+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.565+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.566+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:30:57.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.567+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.568+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.568+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.569+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:30:57.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.570+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.571+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.571+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.573+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:30:57.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.574+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.575+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.575+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.576+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:30:57.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.577+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.578+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.578+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.579+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:30:57.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.580+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.581+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.581+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.582+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:30:57.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.583+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.584+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.584+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.585+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:30:57.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.586+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.587+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.587+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.588+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:30:57.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.589+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.590+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.590+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.591+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:30:57.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.592+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.593+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.593+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.594+0000 7f2b8733d800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:30:57.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.595+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.596+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:57.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.596+0000 7f2b8733d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:57.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.598+0000 7f2a39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:57.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.600+0000 7f2b8733d800 20 remove_watcher() i=0 2024-09-12T17:30:57.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.600+0000 7f2b8733d800 2 removed watcher, disabling cache 2024-09-12T17:30:57.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.601+0000 7f2b8733d800 20 remove_watcher() i=1 2024-09-12T17:30:57.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.602+0000 7f2b8733d800 20 remove_watcher() i=2 2024-09-12T17:30:57.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.603+0000 7f2b8733d800 20 remove_watcher() i=3 2024-09-12T17:30:57.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.604+0000 7f2b8733d800 20 remove_watcher() i=4 2024-09-12T17:30:57.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.604+0000 7f2b8733d800 20 remove_watcher() i=5 2024-09-12T17:30:57.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.605+0000 7f2b8733d800 20 remove_watcher() i=6 2024-09-12T17:30:57.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:30:57.606+0000 7f2b8733d800 20 remove_watcher() i=7 2024-09-12T17:30:57.620 DEBUG:teuthology.orchestra.run.smithi067:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-12T17:30:58.128 INFO:teuthology.orchestra.run.smithi067.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-12T17:31:01.728 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :clean UP-TO-DATE 2024-09-12T17:31:20.028 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :compileJava 2024-09-12T17:31:20.028 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :processResources 2024-09-12T17:31:20.028 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :classes 2024-09-12T17:31:20.729 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:31:20.729 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :compileTestJava 2024-09-12T17:31:20.730 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:31:20.730 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T17:31:20.730 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :testClasses 2024-09-12T17:31:20.730 INFO:teuthology.orchestra.run.smithi067.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T17:31:20.730 INFO:teuthology.orchestra.run.smithi067.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T17:31:27.027 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:31:27.028 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :test 2024-09-12T17:31:27.028 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:31:27.028 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-12T17:31:32.229 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:31:32.229 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-12T17:31:32.527 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:31:32.527 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-12T17:31:32.727 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:31:32.727 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-12T17:31:33.027 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:31:33.027 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-12T17:31:42.327 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:31:42.327 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-12T17:31:42.732 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:31:42.732 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T17:31:42.732 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:31:42.732 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T17:31:42.827 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:31:42.828 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-12T17:31:42.927 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:31:42.927 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-12T17:31:43.227 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:31:43.227 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-12T17:31:49.227 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:31:49.227 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-12T17:31:49.827 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:31:49.827 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-12T17:31:50.027 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:31:50.027 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-12T17:31:50.027 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12 17:31:49,971 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T17:32:33.227 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:32:33.228 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-12T17:32:33.727 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:32:33.727 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-12T17:32:33.827 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:32:33.827 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-12T17:32:34.127 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:32:34.127 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-12T17:32:34.227 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:32:34.227 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-12T17:32:34.735 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:32:34.735 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-12T17:32:49.227 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:32:49.227 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-12T17:32:49.627 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:32:49.627 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T17:32:49.627 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:32:49.627 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T17:32:49.827 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:32:49.827 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-12T17:32:57.827 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:32:57.828 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-12T17:32:59.227 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:32:59.227 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests STANDARD_OUT 2024-09-12T17:32:59.227 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12 17:32:59,161 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T17:32:59.427 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:32:59.427 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T17:33:09.827 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:33:09.828 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T17:33:10.327 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:33:10.327 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-12T17:33:12.827 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:33:12.827 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-12T17:33:13.227 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:33:13.227 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-12T17:34:40.928 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:34:40.928 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-12T17:34:41.327 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:34:41.327 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-12T17:34:58.928 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:34:58.928 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-12T17:34:59.227 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:34:59.227 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-12T17:35:04.527 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:04.527 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-12T17:35:04.927 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:04.927 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-12T17:35:06.827 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:06.827 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-12T17:35:11.927 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:11.927 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-12T17:35:12.027 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:12.027 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-12T17:35:12.427 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:12.427 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-12T17:35:12.427 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:12.427 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-12T17:35:12.827 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:12.827 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-12T17:35:12.927 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:12.927 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-12T17:35:13.227 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:13.227 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-12T17:35:13.327 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:13.327 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-12T17:35:13.727 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:13.727 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-12T17:35:13.827 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:13.827 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-12T17:35:14.127 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:14.127 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-12T17:35:14.227 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:14.227 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-12T17:35:14.527 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:14.527 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-12T17:35:14.727 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:14.727 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-12T17:35:15.027 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:15.027 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-12T17:35:28.127 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:28.127 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-12T17:35:28.528 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:28.528 INFO:teuthology.orchestra.run.smithi067.stdout:---------------------------------------------------------------------- 2024-09-12T17:35:28.528 INFO:teuthology.orchestra.run.smithi067.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-12T17:35:28.529 INFO:teuthology.orchestra.run.smithi067.stdout:---------------------------------------------------------------------- 2024-09-12T17:35:28.529 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:28.529 INFO:teuthology.orchestra.run.smithi067.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T17:35:28.529 INFO:teuthology.orchestra.run.smithi067.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T17:35:28.529 INFO:teuthology.orchestra.run.smithi067.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T17:35:28.529 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:28.529 INFO:teuthology.orchestra.run.smithi067.stdout:BUILD SUCCESSFUL in 4m 30s 2024-09-12T17:35:28.529 INFO:teuthology.orchestra.run.smithi067.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-12T17:35:28.846 DEBUG:teuthology.orchestra.run.smithi067:> radosgw-admin gc process --include-all 2024-09-12T17:35:28.900 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:28.901 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:28.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:28.940+0000 7f72d5b26800 20 rados->read ofs=0 len=0 2024-09-12T17:35:28.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:28.943+0000 7f72d5b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:28.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:28.943+0000 7f72d5b26800 20 realm 2024-09-12T17:35:28.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:28.943+0000 7f72d5b26800 20 rados->read ofs=0 len=0 2024-09-12T17:35:28.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:28.943+0000 7f72d5b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:28.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:28.943+0000 7f72d5b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:28.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:28.943+0000 7f72d5b26800 20 rados->read ofs=0 len=0 2024-09-12T17:35:28.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:28.943+0000 7f72d5b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:28.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:28.943+0000 7f72d5b26800 20 rados->read ofs=0 len=0 2024-09-12T17:35:28.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:28.944+0000 7f72d5b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:28.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:28.944+0000 7f72d5b26800 20 rados->read ofs=0 len=0 2024-09-12T17:35:28.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:28.944+0000 7f72d0f08640 0 -- 172.21.15.67:0/995914503 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x561384aa04a0 msgr2=0x561384aa2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:29.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.146+0000 7f72d5b26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:29.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.146+0000 7f72d5b26800 20 searching for the correct realm 2024-09-12T17:35:29.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.149+0000 7f72d1709640 0 -- 172.21.15.67:0/995914503 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f72cc01d060 msgr2=0x7f72cc04b1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:29.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.158+0000 7f72d5b26800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:35:29.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.158+0000 7f72d5b26800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:35:29.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.158+0000 7f72d5b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:29.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.158+0000 7f72d5b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:29.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.158+0000 7f72d5b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:29.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.158+0000 7f72d5b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:29.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.158+0000 7f72d5b26800 20 rados->read ofs=0 len=0 2024-09-12T17:35:29.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.158+0000 7f72d5b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:29.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.158+0000 7f72d5b26800 20 rados->read ofs=0 len=0 2024-09-12T17:35:29.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.158+0000 7f72d5b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:29.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.158+0000 7f72d5b26800 20 rados->read ofs=0 len=0 2024-09-12T17:35:29.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.159+0000 7f72d5b26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:29.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.159+0000 7f72d5b26800 20 zone default found 2024-09-12T17:35:29.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.159+0000 7f72d5b26800 4 Realm: () 2024-09-12T17:35:29.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.159+0000 7f72d5b26800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:35:29.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.159+0000 7f72d5b26800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:35:29.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.159+0000 7f72d5b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:29.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.159+0000 7f72d5b26800 20 zonegroup default 2024-09-12T17:35:29.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.159+0000 7f72d5b26800 20 rados->read ofs=0 len=0 2024-09-12T17:35:29.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.159+0000 7f72d5b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:29.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.159+0000 7f72d5b26800 20 rados->read ofs=0 len=0 2024-09-12T17:35:29.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.159+0000 7f72d5b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:29.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.159+0000 7f72d5b26800 20 rados->read ofs=0 len=0 2024-09-12T17:35:29.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.160+0000 7f72d5b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:29.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.160+0000 7f72d5b26800 20 started sync module instance, tier type = 2024-09-12T17:35:29.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.160+0000 7f72d5b26800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:35:29.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.170+0000 7f72d5b26800 20 add_watcher() i=0 2024-09-12T17:35:29.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.170+0000 7f72d5b26800 20 add_watcher() i=1 2024-09-12T17:35:29.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.170+0000 7f72d5b26800 20 add_watcher() i=2 2024-09-12T17:35:29.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.170+0000 7f72d5b26800 20 add_watcher() i=3 2024-09-12T17:35:29.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.170+0000 7f72d5b26800 20 add_watcher() i=4 2024-09-12T17:35:29.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.170+0000 7f72d5b26800 20 add_watcher() i=5 2024-09-12T17:35:29.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.170+0000 7f72d5b26800 20 add_watcher() i=6 2024-09-12T17:35:29.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.171+0000 7f72d5b26800 20 add_watcher() i=7 2024-09-12T17:35:29.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.171+0000 7f72d5b26800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:29.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.172+0000 7f7182ff5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:29.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.173+0000 7f72d5b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:29.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.173+0000 7f72d5b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:29.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.210+0000 7f7181ff3640 20 reqs_thread_entry: start 2024-09-12T17:35:29.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.210+0000 7f72d5b26800 20 init_complete bucket index max shards: 1 2024-09-12T17:35:29.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.210+0000 7f72d5b26800 20 Filter name: none 2024-09-12T17:35:29.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.210+0000 7f70f37fe640 20 reqs_thread_entry: start 2024-09-12T17:35:29.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.210+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:35:29.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.212+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.212+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.213+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.213+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:35:29.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.215+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.215+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.216+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.217+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:35:29.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.218+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.219+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.219+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:35:29.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.219+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2017983672150461143', time=2024-09-12T19:33:10.046597+0000, chain.objs.size()=5 2024-09-12T17:35:29.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.219+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.54__multipart_file2.mpg.2~ry9QAjWX5kJM7dWjA7Waq2jSXCjFJNP.1 2024-09-12T17:35:29.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.219+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.54__multipart_file2.mpg.2~ry9QAjWX5kJM7dWjA7Waq2jSXCjFJNP.2 2024-09-12T17:35:29.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.219+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.54__multipart_file2.mpg.2~ry9QAjWX5kJM7dWjA7Waq2jSXCjFJNP.3 2024-09-12T17:35:29.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.219+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.54__multipart_file2.mpg.2~ry9QAjWX5kJM7dWjA7Waq2jSXCjFJNP.4 2024-09-12T17:35:29.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.219+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.54__multipart_file2.mpg.2~ry9QAjWX5kJM7dWjA7Waq2jSXCjFJNP.5 2024-09-12T17:35:29.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.219+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2232214129728983279', time=2024-09-12T19:35:13.002710+0000, chain.objs.size()=1 2024-09-12T17:35:29.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.219+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.62__shadow_.2_Ejf-tRT0qXmKRVYxtxI6NsjUGyHIE_0 2024-09-12T17:35:29.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.221+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:35:29.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.223+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:35:29.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.225+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.225+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.226+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.227+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:35:29.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.228+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.229+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.229+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:35:29.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.229+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.76107044541413699', time=2024-09-12T19:32:09.043071+0000, chain.objs.size()=9 2024-09-12T17:35:29.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.229+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__multipart_key1.2~3uY3cMMknMsPWhXuj2SD7GD6zeoznE6.1 2024-09-12T17:35:29.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.229+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__shadow_key1.2~3uY3cMMknMsPWhXuj2SD7GD6zeoznE6.1_1 2024-09-12T17:35:29.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.229+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__multipart_key1.2~3uY3cMMknMsPWhXuj2SD7GD6zeoznE6.2 2024-09-12T17:35:29.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.229+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__shadow_key1.2~3uY3cMMknMsPWhXuj2SD7GD6zeoznE6.2_1 2024-09-12T17:35:29.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.229+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__multipart_key1.2~3uY3cMMknMsPWhXuj2SD7GD6zeoznE6.3 2024-09-12T17:35:29.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.229+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__shadow_key1.2~3uY3cMMknMsPWhXuj2SD7GD6zeoznE6.3_1 2024-09-12T17:35:29.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.229+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__multipart_key1.2~3uY3cMMknMsPWhXuj2SD7GD6zeoznE6.4 2024-09-12T17:35:29.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.229+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__shadow_key1.2~3uY3cMMknMsPWhXuj2SD7GD6zeoznE6.4_1 2024-09-12T17:35:29.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.229+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__multipart_key1.2~3uY3cMMknMsPWhXuj2SD7GD6zeoznE6.5 2024-09-12T17:35:29.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.232+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:35:29.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.235+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:35:29.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.236+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.237+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.237+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.239+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:35:29.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.240+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.241+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.241+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:35:29.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.241+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15315018992055287214', time=2024-09-12T19:32:59.133515+0000, chain.objs.size()=9 2024-09-12T17:35:29.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.241+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.53__multipart_key1.2~FXXMVq9zFjhMfStmpXiD1jB2TIZ3agV.1 2024-09-12T17:35:29.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.241+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.53__shadow_key1.2~FXXMVq9zFjhMfStmpXiD1jB2TIZ3agV.1_1 2024-09-12T17:35:29.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.241+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.53__multipart_key1.2~FXXMVq9zFjhMfStmpXiD1jB2TIZ3agV.2 2024-09-12T17:35:29.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.241+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.53__shadow_key1.2~FXXMVq9zFjhMfStmpXiD1jB2TIZ3agV.2_1 2024-09-12T17:35:29.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.241+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.53__multipart_key1.2~FXXMVq9zFjhMfStmpXiD1jB2TIZ3agV.3 2024-09-12T17:35:29.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.241+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.53__shadow_key1.2~FXXMVq9zFjhMfStmpXiD1jB2TIZ3agV.3_1 2024-09-12T17:35:29.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.241+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.53__multipart_key1.2~FXXMVq9zFjhMfStmpXiD1jB2TIZ3agV.4 2024-09-12T17:35:29.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.241+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.53__shadow_key1.2~FXXMVq9zFjhMfStmpXiD1jB2TIZ3agV.4_1 2024-09-12T17:35:29.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.241+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.53__multipart_key1.2~FXXMVq9zFjhMfStmpXiD1jB2TIZ3agV.5 2024-09-12T17:35:29.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.241+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14040368234068680140', time=2024-09-12T19:33:10.008699+0000, chain.objs.size()=1 2024-09-12T17:35:29.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.241+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.54__shadow_.37Y1EybsO5OJGaIihE7Dt-FiGwQ5gSQ_0 2024-09-12T17:35:29.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.244+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:35:29.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.246+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:35:29.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.248+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.248+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.249+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:35:29.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.249+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16531848800708945577', time=2024-09-12T19:35:12.570435+0000, chain.objs.size()=1 2024-09-12T17:35:29.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.249+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.61__shadow_.hOFQnsfaY1_FO2HMCqlv26frgNhv5IH_0 2024-09-12T17:35:29.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.250+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:35:29.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.252+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:35:29.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.253+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.254+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.254+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.255+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:35:29.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.257+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.258+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.258+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:35:29.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.258+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5884334088359008515', time=2024-09-12T19:34:40.828516+0000, chain.objs.size()=16 2024-09-12T17:35:29.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.258+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~_VkC_ErOIbO4tW2b49T4KkEWszEeJ12.1 2024-09-12T17:35:29.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.258+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~_VkC_ErOIbO4tW2b49T4KkEWszEeJ12.1_1 2024-09-12T17:35:29.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.258+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~_VkC_ErOIbO4tW2b49T4KkEWszEeJ12.1_2 2024-09-12T17:35:29.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.258+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~_VkC_ErOIbO4tW2b49T4KkEWszEeJ12.2 2024-09-12T17:35:29.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.258+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~_VkC_ErOIbO4tW2b49T4KkEWszEeJ12.2_1 2024-09-12T17:35:29.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.258+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~_VkC_ErOIbO4tW2b49T4KkEWszEeJ12.2_2 2024-09-12T17:35:29.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.258+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~_VkC_ErOIbO4tW2b49T4KkEWszEeJ12.3 2024-09-12T17:35:29.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.258+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~_VkC_ErOIbO4tW2b49T4KkEWszEeJ12.3_1 2024-09-12T17:35:29.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.259+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~_VkC_ErOIbO4tW2b49T4KkEWszEeJ12.3_2 2024-09-12T17:35:29.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.259+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~_VkC_ErOIbO4tW2b49T4KkEWszEeJ12.4 2024-09-12T17:35:29.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.259+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~_VkC_ErOIbO4tW2b49T4KkEWszEeJ12.4_1 2024-09-12T17:35:29.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.259+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~_VkC_ErOIbO4tW2b49T4KkEWszEeJ12.4_2 2024-09-12T17:35:29.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.262+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~_VkC_ErOIbO4tW2b49T4KkEWszEeJ12.5 2024-09-12T17:35:29.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.262+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~_VkC_ErOIbO4tW2b49T4KkEWszEeJ12.5_1 2024-09-12T17:35:29.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.262+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~_VkC_ErOIbO4tW2b49T4KkEWszEeJ12.5_2 2024-09-12T17:35:29.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.262+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~_VkC_ErOIbO4tW2b49T4KkEWszEeJ12.6 2024-09-12T17:35:29.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.264+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:35:29.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.266+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:35:29.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.268+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.268+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.268+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.269+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:35:29.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.271+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.271+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.271+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:35:29.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.271+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13188481053209417722', time=2024-09-12T19:32:33.066713+0000, chain.objs.size()=7 2024-09-12T17:35:29.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.272+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__multipart_key1.2~58fAn72Olk3ogMJ12AaeLJiZyD7nRq3.1 2024-09-12T17:35:29.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.272+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__shadow_key1.2~58fAn72Olk3ogMJ12AaeLJiZyD7nRq3.1_1 2024-09-12T17:35:29.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.272+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__shadow_key1.2~58fAn72Olk3ogMJ12AaeLJiZyD7nRq3.1_2 2024-09-12T17:35:29.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.272+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__multipart_key1.2~58fAn72Olk3ogMJ12AaeLJiZyD7nRq3.2 2024-09-12T17:35:29.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.272+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__shadow_key1.2~58fAn72Olk3ogMJ12AaeLJiZyD7nRq3.2_1 2024-09-12T17:35:29.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.272+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__shadow_key1.2~58fAn72Olk3ogMJ12AaeLJiZyD7nRq3.2_2 2024-09-12T17:35:29.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.272+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__multipart_key1.2~58fAn72Olk3ogMJ12AaeLJiZyD7nRq3.3 2024-09-12T17:35:29.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.272+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3061879572904332732', time=2024-09-12T19:32:33.515655+0000, chain.objs.size()=7 2024-09-12T17:35:29.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.272+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__multipart_key1.2~kRSHcX_YXZc2RLPlS8xZ8x81hrHjR6_.1 2024-09-12T17:35:29.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.272+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__shadow_key1.2~kRSHcX_YXZc2RLPlS8xZ8x81hrHjR6_.1_1 2024-09-12T17:35:29.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.272+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__shadow_key1.2~kRSHcX_YXZc2RLPlS8xZ8x81hrHjR6_.1_2 2024-09-12T17:35:29.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.272+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__multipart_key1.2~kRSHcX_YXZc2RLPlS8xZ8x81hrHjR6_.2 2024-09-12T17:35:29.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.272+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__shadow_key1.2~kRSHcX_YXZc2RLPlS8xZ8x81hrHjR6_.2_1 2024-09-12T17:35:29.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.274+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__shadow_key1.2~kRSHcX_YXZc2RLPlS8xZ8x81hrHjR6_.2_2 2024-09-12T17:35:29.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.274+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__multipart_key1.2~kRSHcX_YXZc2RLPlS8xZ8x81hrHjR6_.3 2024-09-12T17:35:29.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.276+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:35:29.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.278+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:35:29.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.280+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.280+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.280+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:35:29.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.280+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17871011846707911981', time=2024-09-12T19:34:59.028322+0000, chain.objs.size()=9 2024-09-12T17:35:29.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.281+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.57__multipart_key1.2~G5x300rBqYGZi_hyMomRXdycIVmfxsj.1 2024-09-12T17:35:29.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.281+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.57__shadow_key1.2~G5x300rBqYGZi_hyMomRXdycIVmfxsj.1_1 2024-09-12T17:35:29.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.281+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.57__multipart_key1.2~G5x300rBqYGZi_hyMomRXdycIVmfxsj.2 2024-09-12T17:35:29.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.281+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.57__shadow_key1.2~G5x300rBqYGZi_hyMomRXdycIVmfxsj.2_1 2024-09-12T17:35:29.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.281+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.57__multipart_key1.2~G5x300rBqYGZi_hyMomRXdycIVmfxsj.3 2024-09-12T17:35:29.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.281+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.57__shadow_key1.2~G5x300rBqYGZi_hyMomRXdycIVmfxsj.3_1 2024-09-12T17:35:29.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.281+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.57__multipart_key1.2~G5x300rBqYGZi_hyMomRXdycIVmfxsj.4 2024-09-12T17:35:29.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.281+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.57__shadow_key1.2~G5x300rBqYGZi_hyMomRXdycIVmfxsj.4_1 2024-09-12T17:35:29.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.281+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.57__multipart_key1.2~G5x300rBqYGZi_hyMomRXdycIVmfxsj.5 2024-09-12T17:35:29.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.284+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:35:29.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.286+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:35:29.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.288+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.288+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.288+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:35:29.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.288+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13773116409064915974', time=2024-09-12T19:35:13.440155+0000, chain.objs.size()=1 2024-09-12T17:35:29.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.288+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.63__shadow_.UTQGdR0tfQ4WJ1xu-tQpGtql2SNj46z_0 2024-09-12T17:35:29.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.290+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:35:29.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.292+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:35:29.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.293+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.293+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.294+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:35:29.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.294+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1273393555386341872', time=2024-09-12T19:35:12.137146+0000, chain.objs.size()=1 2024-09-12T17:35:29.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.294+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.60__shadow_.RuSAmiB_yz9j4SlDXQnVyXsFWfKFpas_0 2024-09-12T17:35:29.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.295+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:35:29.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.297+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:35:29.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.298+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.299+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.299+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:35:29.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.299+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~2OhQDkQVx0py3a5Ts-Js4Wa1IiNQSqv', time=2024-09-12T19:33:13.068965+0000, chain.objs.size()=5 2024-09-12T17:35:29.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.299+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.55__multipart_key1.2~2OhQDkQVx0py3a5Ts-Js4Wa1IiNQSqv.7 2024-09-12T17:35:29.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.299+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.55__shadow_key1.2~2OhQDkQVx0py3a5Ts-Js4Wa1IiNQSqv.7_1 2024-09-12T17:35:29.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.299+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.55__multipart_key1.2~2OhQDkQVx0py3a5Ts-Js4Wa1IiNQSqv.10 2024-09-12T17:35:29.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.299+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.55__shadow_key1.2~2OhQDkQVx0py3a5Ts-Js4Wa1IiNQSqv.10_1 2024-09-12T17:35:29.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.299+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.55__multipart_key1.2~2OhQDkQVx0py3a5Ts-Js4Wa1IiNQSqv.13 2024-09-12T17:35:29.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.299+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13011418904256072473', time=2024-09-12T19:34:29.639067+0000, chain.objs.size()=16 2024-09-12T17:35:29.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.299+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~sYnFmfnSlb5Oxd9RnuHtccU15j_GiBa.1 2024-09-12T17:35:29.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.299+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~sYnFmfnSlb5Oxd9RnuHtccU15j_GiBa.1_1 2024-09-12T17:35:29.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.299+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~sYnFmfnSlb5Oxd9RnuHtccU15j_GiBa.1_2 2024-09-12T17:35:29.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.299+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~sYnFmfnSlb5Oxd9RnuHtccU15j_GiBa.2 2024-09-12T17:35:29.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.299+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~sYnFmfnSlb5Oxd9RnuHtccU15j_GiBa.2_1 2024-09-12T17:35:29.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.299+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~sYnFmfnSlb5Oxd9RnuHtccU15j_GiBa.2_2 2024-09-12T17:35:29.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.299+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~sYnFmfnSlb5Oxd9RnuHtccU15j_GiBa.3 2024-09-12T17:35:29.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.303+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~sYnFmfnSlb5Oxd9RnuHtccU15j_GiBa.3_1 2024-09-12T17:35:29.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.303+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~sYnFmfnSlb5Oxd9RnuHtccU15j_GiBa.3_2 2024-09-12T17:35:29.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.303+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~sYnFmfnSlb5Oxd9RnuHtccU15j_GiBa.4 2024-09-12T17:35:29.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.303+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~sYnFmfnSlb5Oxd9RnuHtccU15j_GiBa.4_1 2024-09-12T17:35:29.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.303+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~sYnFmfnSlb5Oxd9RnuHtccU15j_GiBa.4_2 2024-09-12T17:35:29.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.303+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~sYnFmfnSlb5Oxd9RnuHtccU15j_GiBa.5 2024-09-12T17:35:29.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.303+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~sYnFmfnSlb5Oxd9RnuHtccU15j_GiBa.5_1 2024-09-12T17:35:29.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.303+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~sYnFmfnSlb5Oxd9RnuHtccU15j_GiBa.5_2 2024-09-12T17:35:29.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.303+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~sYnFmfnSlb5Oxd9RnuHtccU15j_GiBa.6 2024-09-12T17:35:29.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.307+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:35:29.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.309+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:35:29.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.311+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.311+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.312+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:35:29.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.312+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11344614563855914030', time=2024-09-12T19:31:49.548438+0000, chain.objs.size()=9 2024-09-12T17:35:29.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.312+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.45__multipart_key1.2~fnRINRJiWxoW4Jg7Utq-KytnbNlwTEF.1 2024-09-12T17:35:29.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.312+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.45__shadow_key1.2~fnRINRJiWxoW4Jg7Utq-KytnbNlwTEF.1_1 2024-09-12T17:35:29.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.312+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.45__multipart_key1.2~fnRINRJiWxoW4Jg7Utq-KytnbNlwTEF.2 2024-09-12T17:35:29.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.312+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.45__shadow_key1.2~fnRINRJiWxoW4Jg7Utq-KytnbNlwTEF.2_1 2024-09-12T17:35:29.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.312+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.45__multipart_key1.2~fnRINRJiWxoW4Jg7Utq-KytnbNlwTEF.3 2024-09-12T17:35:29.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.312+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.45__shadow_key1.2~fnRINRJiWxoW4Jg7Utq-KytnbNlwTEF.3_1 2024-09-12T17:35:29.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.312+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.45__multipart_key1.2~fnRINRJiWxoW4Jg7Utq-KytnbNlwTEF.4 2024-09-12T17:35:29.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.312+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.45__shadow_key1.2~fnRINRJiWxoW4Jg7Utq-KytnbNlwTEF.4_1 2024-09-12T17:35:29.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.312+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.45__multipart_key1.2~fnRINRJiWxoW4Jg7Utq-KytnbNlwTEF.5 2024-09-12T17:35:29.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.312+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13598357190204991954', time=2024-09-12T19:34:55.418119+0000, chain.objs.size()=1 2024-09-12T17:35:29.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.312+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.57__shadow_.6QE0K311hd-eWbX5xdS_bvP6uPN_JRR_0 2024-09-12T17:35:29.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.314+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:35:29.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.316+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:35:29.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.317+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.318+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.318+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.319+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:35:29.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.320+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.321+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.321+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:35:29.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.321+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3390640518206757611', time=2024-09-12T19:32:49.353015+0000, chain.objs.size()=9 2024-09-12T17:35:29.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.321+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.52__multipart_key1.2~koJ3trgEXYD1Wjzz9-xQT1HVcxYOTNK.1 2024-09-12T17:35:29.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.321+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.52__shadow_key1.2~koJ3trgEXYD1Wjzz9-xQT1HVcxYOTNK.1_1 2024-09-12T17:35:29.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.321+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.52__multipart_key1.2~koJ3trgEXYD1Wjzz9-xQT1HVcxYOTNK.2 2024-09-12T17:35:29.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.321+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.52__shadow_key1.2~koJ3trgEXYD1Wjzz9-xQT1HVcxYOTNK.2_1 2024-09-12T17:35:29.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.321+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.52__multipart_key1.2~koJ3trgEXYD1Wjzz9-xQT1HVcxYOTNK.3 2024-09-12T17:35:29.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.321+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.52__shadow_key1.2~koJ3trgEXYD1Wjzz9-xQT1HVcxYOTNK.3_1 2024-09-12T17:35:29.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.321+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.52__multipart_key1.2~koJ3trgEXYD1Wjzz9-xQT1HVcxYOTNK.4 2024-09-12T17:35:29.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.321+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.52__shadow_key1.2~koJ3trgEXYD1Wjzz9-xQT1HVcxYOTNK.4_1 2024-09-12T17:35:29.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.321+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.52__multipart_key1.2~koJ3trgEXYD1Wjzz9-xQT1HVcxYOTNK.5 2024-09-12T17:35:29.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.325+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:35:29.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.327+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:35:29.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.328+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.328+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.329+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:35:29.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.329+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~j1qhvvLMOOYprERCDvA5MuDVfVtWwNG', time=2024-09-12T19:31:32.173374+0000, chain.objs.size()=9 2024-09-12T17:35:29.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.329+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.41__multipart_key1.2~j1qhvvLMOOYprERCDvA5MuDVfVtWwNG.1 2024-09-12T17:35:29.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.329+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.41__shadow_key1.2~j1qhvvLMOOYprERCDvA5MuDVfVtWwNG.1_1 2024-09-12T17:35:29.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.329+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.41__multipart_key1.2~j1qhvvLMOOYprERCDvA5MuDVfVtWwNG.2 2024-09-12T17:35:29.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.329+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.41__shadow_key1.2~j1qhvvLMOOYprERCDvA5MuDVfVtWwNG.2_1 2024-09-12T17:35:29.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.329+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.41__multipart_key1.2~j1qhvvLMOOYprERCDvA5MuDVfVtWwNG.3 2024-09-12T17:35:29.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.329+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.41__shadow_key1.2~j1qhvvLMOOYprERCDvA5MuDVfVtWwNG.3_1 2024-09-12T17:35:29.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.329+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.41__multipart_key1.2~j1qhvvLMOOYprERCDvA5MuDVfVtWwNG.4 2024-09-12T17:35:29.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.329+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.41__shadow_key1.2~j1qhvvLMOOYprERCDvA5MuDVfVtWwNG.4_1 2024-09-12T17:35:29.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.329+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.41__multipart_key1.2~j1qhvvLMOOYprERCDvA5MuDVfVtWwNG.5 2024-09-12T17:35:29.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.329+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17017591423540155742', time=2024-09-12T19:33:10.120381+0000, chain.objs.size()=1 2024-09-12T17:35:29.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.329+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.54__shadow_.OhRrw6kKhmPKFQLtyxtV91-2LKFI8iQ_0 2024-09-12T17:35:29.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.332+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:35:29.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.334+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:35:29.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.335+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.335+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.335+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:35:29.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.335+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2031572198165187890', time=2024-09-12T19:32:21.081281+0000, chain.objs.size()=7 2024-09-12T17:35:29.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.335+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__multipart_key1.2~JO4HPoH5WQWuQJ7KjTaqI5udLbqFSM7.1 2024-09-12T17:35:29.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.335+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__shadow_key1.2~JO4HPoH5WQWuQJ7KjTaqI5udLbqFSM7.1_1 2024-09-12T17:35:29.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.335+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__shadow_key1.2~JO4HPoH5WQWuQJ7KjTaqI5udLbqFSM7.1_2 2024-09-12T17:35:29.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.336+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__multipart_key1.2~JO4HPoH5WQWuQJ7KjTaqI5udLbqFSM7.2 2024-09-12T17:35:29.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.336+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__shadow_key1.2~JO4HPoH5WQWuQJ7KjTaqI5udLbqFSM7.2_1 2024-09-12T17:35:29.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.336+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__shadow_key1.2~JO4HPoH5WQWuQJ7KjTaqI5udLbqFSM7.2_2 2024-09-12T17:35:29.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.336+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__multipart_key1.2~JO4HPoH5WQWuQJ7KjTaqI5udLbqFSM7.3 2024-09-12T17:35:29.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.336+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10471120607837561471', time=2024-09-12T19:32:33.280656+0000, chain.objs.size()=6 2024-09-12T17:35:29.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.336+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.47__shadow_.N2HANhz-uhy6sCHybxCvbtMlyPuXFtn_0 2024-09-12T17:35:29.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.336+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.47__shadow_.N2HANhz-uhy6sCHybxCvbtMlyPuXFtn_1 2024-09-12T17:35:29.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.336+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.47__shadow_.N2HANhz-uhy6sCHybxCvbtMlyPuXFtn_2 2024-09-12T17:35:29.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.336+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.47__shadow_.N2HANhz-uhy6sCHybxCvbtMlyPuXFtn_3 2024-09-12T17:35:29.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.336+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.47__shadow_.N2HANhz-uhy6sCHybxCvbtMlyPuXFtn_4 2024-09-12T17:35:29.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.338+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.47__shadow_.N2HANhz-uhy6sCHybxCvbtMlyPuXFtn_5 2024-09-12T17:35:29.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.341+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:35:29.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.343+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:35:29.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.344+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.344+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.345+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:35:29.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.345+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7698931370611582175', time=2024-09-12T19:33:09.972653+0000, chain.objs.size()=9 2024-09-12T17:35:29.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.345+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.54__multipart_file.mpg.2~gh26SV_1-dkVIycJcDGc9znP3cC_nHO.1 2024-09-12T17:35:29.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.345+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.54__shadow_file.mpg.2~gh26SV_1-dkVIycJcDGc9znP3cC_nHO.1_1 2024-09-12T17:35:29.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.345+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.54__multipart_file.mpg.2~gh26SV_1-dkVIycJcDGc9znP3cC_nHO.2 2024-09-12T17:35:29.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.345+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.54__shadow_file.mpg.2~gh26SV_1-dkVIycJcDGc9znP3cC_nHO.2_1 2024-09-12T17:35:29.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.345+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.54__multipart_file.mpg.2~gh26SV_1-dkVIycJcDGc9znP3cC_nHO.3 2024-09-12T17:35:29.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.345+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.54__shadow_file.mpg.2~gh26SV_1-dkVIycJcDGc9znP3cC_nHO.3_1 2024-09-12T17:35:29.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.345+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.54__multipart_file.mpg.2~gh26SV_1-dkVIycJcDGc9znP3cC_nHO.4 2024-09-12T17:35:29.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.345+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.54__shadow_file.mpg.2~gh26SV_1-dkVIycJcDGc9znP3cC_nHO.4_1 2024-09-12T17:35:29.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.345+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.54__multipart_file.mpg.2~gh26SV_1-dkVIycJcDGc9znP3cC_nHO.5 2024-09-12T17:35:29.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.348+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:35:29.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.349+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:35:29.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.351+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.351+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.352+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:35:29.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.352+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12175893937374328292', time=2024-09-12T19:35:04.628905+0000, chain.objs.size()=9 2024-09-12T17:35:29.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.352+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.58__multipart_key1.2~hev4f9g_3KaKjLcQ2oNtuERWM1l_WG9.1 2024-09-12T17:35:29.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.352+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.58__shadow_key1.2~hev4f9g_3KaKjLcQ2oNtuERWM1l_WG9.1_1 2024-09-12T17:35:29.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.352+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.58__multipart_key1.2~hev4f9g_3KaKjLcQ2oNtuERWM1l_WG9.2 2024-09-12T17:35:29.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.352+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.58__shadow_key1.2~hev4f9g_3KaKjLcQ2oNtuERWM1l_WG9.2_1 2024-09-12T17:35:29.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.352+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.58__multipart_key1.2~hev4f9g_3KaKjLcQ2oNtuERWM1l_WG9.3 2024-09-12T17:35:29.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.352+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.58__shadow_key1.2~hev4f9g_3KaKjLcQ2oNtuERWM1l_WG9.3_1 2024-09-12T17:35:29.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.352+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.58__multipart_key1.2~hev4f9g_3KaKjLcQ2oNtuERWM1l_WG9.4 2024-09-12T17:35:29.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.352+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.58__shadow_key1.2~hev4f9g_3KaKjLcQ2oNtuERWM1l_WG9.4_1 2024-09-12T17:35:29.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.352+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.58__multipart_key1.2~hev4f9g_3KaKjLcQ2oNtuERWM1l_WG9.5 2024-09-12T17:35:29.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.355+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:35:29.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.357+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:35:29.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.358+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.359+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.359+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T17:35:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.359+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN', time=2024-09-12T19:35:09.193959+0000, chain.objs.size()=1 2024-09-12T17:35:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.359+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN.13 2024-09-12T17:35:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.359+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN', time=2024-09-12T19:35:09.244435+0000, chain.objs.size()=1 2024-09-12T17:35:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.359+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN.14 2024-09-12T17:35:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.359+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN', time=2024-09-12T19:35:09.342530+0000, chain.objs.size()=1 2024-09-12T17:35:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.359+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN.15 2024-09-12T17:35:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.359+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN', time=2024-09-12T19:35:09.449845+0000, chain.objs.size()=1 2024-09-12T17:35:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.359+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN.16 2024-09-12T17:35:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.359+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN', time=2024-09-12T19:35:09.477163+0000, chain.objs.size()=1 2024-09-12T17:35:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.359+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN.17 2024-09-12T17:35:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.359+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN', time=2024-09-12T19:35:09.570182+0000, chain.objs.size()=1 2024-09-12T17:35:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.359+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN.18 2024-09-12T17:35:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.359+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN', time=2024-09-12T19:35:09.600000+0000, chain.objs.size()=1 2024-09-12T17:35:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.359+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN.19 2024-09-12T17:35:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.360+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN', time=2024-09-12T19:35:09.705738+0000, chain.objs.size()=1 2024-09-12T17:35:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.360+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN.20 2024-09-12T17:35:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.360+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN', time=2024-09-12T19:35:09.859724+0000, chain.objs.size()=22 2024-09-12T17:35:29.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.360+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN.1 2024-09-12T17:35:29.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.360+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN.2 2024-09-12T17:35:29.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.360+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN.3 2024-09-12T17:35:29.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.360+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN.4 2024-09-12T17:35:29.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.362+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN.5 2024-09-12T17:35:29.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.362+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN.6 2024-09-12T17:35:29.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.362+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN.7 2024-09-12T17:35:29.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.362+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN.8 2024-09-12T17:35:29.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.362+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN.9 2024-09-12T17:35:29.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.362+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN.10 2024-09-12T17:35:29.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.362+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN.11 2024-09-12T17:35:29.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.362+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN.12 2024-09-12T17:35:29.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.362+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.2WjhAFB46_HDq6tWaOl-miAMsSNLZ41C.13 2024-09-12T17:35:29.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.362+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.OtV5bg28WSTKsNdRho2wWWWKR8dsTXQD.14 2024-09-12T17:35:29.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.362+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.glyjoLStpF-tVghfhyYxinNW8bViMCFq.15 2024-09-12T17:35:29.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.364+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.t-Mz-00j3KEGaBeeV9DhWmyja17hqWkN.16 2024-09-12T17:35:29.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.364+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.KGEz2yxehxlOFUxluN44WWt0EiI-egCp.17 2024-09-12T17:35:29.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.364+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.d0M_EUAYWutSbHvIk6LMvdNERzHYzvhq.18 2024-09-12T17:35:29.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.364+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.N_KrPRprcmM-5urseHFcy1fvY7ULmrKw.19 2024-09-12T17:35:29.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.364+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.FleAyXiKY2EyG5DOlnXaT5FS69VIDK9e.20 2024-09-12T17:35:29.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.364+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN.21 2024-09-12T17:35:29.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.364+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.59__multipart_key1.2~uVGYc50WLmT2b3wPcNFXEzJSV2n-_dN.22 2024-09-12T17:35:29.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.364+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2267995986291597094', time=2024-09-12T19:35:14.323693+0000, chain.objs.size()=1 2024-09-12T17:35:29.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.364+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.65__shadow_.TB7NPU5Us2_GdOARqvBB9N8FuCFrfVB_0 2024-09-12T17:35:29.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.366+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:35:29.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.369+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:35:29.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.370+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.370+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.371+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:35:29.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.371+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6782395380841179118', time=2024-09-12T19:31:42.444593+0000, chain.objs.size()=9 2024-09-12T17:35:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.371+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.43__multipart_key1.2~TIetYphiZ7mdfhe8mTk2Z7Bwl9b-DLn.1 2024-09-12T17:35:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.371+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.43__shadow_key1.2~TIetYphiZ7mdfhe8mTk2Z7Bwl9b-DLn.1_1 2024-09-12T17:35:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.371+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.43__multipart_key1.2~TIetYphiZ7mdfhe8mTk2Z7Bwl9b-DLn.2 2024-09-12T17:35:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.371+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.43__shadow_key1.2~TIetYphiZ7mdfhe8mTk2Z7Bwl9b-DLn.2_1 2024-09-12T17:35:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.371+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.43__multipart_key1.2~TIetYphiZ7mdfhe8mTk2Z7Bwl9b-DLn.3 2024-09-12T17:35:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.371+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.43__shadow_key1.2~TIetYphiZ7mdfhe8mTk2Z7Bwl9b-DLn.3_1 2024-09-12T17:35:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.371+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.43__multipart_key1.2~TIetYphiZ7mdfhe8mTk2Z7Bwl9b-DLn.4 2024-09-12T17:35:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.371+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.43__shadow_key1.2~TIetYphiZ7mdfhe8mTk2Z7Bwl9b-DLn.4_1 2024-09-12T17:35:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.371+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.43__multipart_key1.2~TIetYphiZ7mdfhe8mTk2Z7Bwl9b-DLn.5 2024-09-12T17:35:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.371+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12567621633940491642', time=2024-09-12T19:31:49.317771+0000, chain.objs.size()=9 2024-09-12T17:35:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.371+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.45__multipart_key1.2~fnRINRJiWxoW4Jg7Utq-KytnbNlwTEF.1 2024-09-12T17:35:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.371+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.45__shadow_key1.2~fnRINRJiWxoW4Jg7Utq-KytnbNlwTEF.1_1 2024-09-12T17:35:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.371+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.45__multipart_key1.2~fnRINRJiWxoW4Jg7Utq-KytnbNlwTEF.2 2024-09-12T17:35:29.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.374+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.45__shadow_key1.2~fnRINRJiWxoW4Jg7Utq-KytnbNlwTEF.2_1 2024-09-12T17:35:29.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.374+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.45__multipart_key1.2~fnRINRJiWxoW4Jg7Utq-KytnbNlwTEF.3 2024-09-12T17:35:29.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.375+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.45__shadow_key1.2~fnRINRJiWxoW4Jg7Utq-KytnbNlwTEF.3_1 2024-09-12T17:35:29.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.375+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.45__multipart_key1.2~fnRINRJiWxoW4Jg7Utq-KytnbNlwTEF.4 2024-09-12T17:35:29.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.375+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.45__shadow_key1.2~fnRINRJiWxoW4Jg7Utq-KytnbNlwTEF.4_1 2024-09-12T17:35:29.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.375+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.45__multipart_key1.2~fnRINRJiWxoW4Jg7Utq-KytnbNlwTEF.5 2024-09-12T17:35:29.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.375+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8152600672592686327', time=2024-09-12T19:34:07.515830+0000, chain.objs.size()=21 2024-09-12T17:35:29.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.375+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~2pIlHaU_i9MD6bBV2CEzHjuedTyEMC5.1 2024-09-12T17:35:29.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.375+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~2pIlHaU_i9MD6bBV2CEzHjuedTyEMC5.1_1 2024-09-12T17:35:29.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.375+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~2pIlHaU_i9MD6bBV2CEzHjuedTyEMC5.2 2024-09-12T17:35:29.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.375+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~2pIlHaU_i9MD6bBV2CEzHjuedTyEMC5.2_1 2024-09-12T17:35:29.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.375+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~2pIlHaU_i9MD6bBV2CEzHjuedTyEMC5.3 2024-09-12T17:35:29.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.377+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~2pIlHaU_i9MD6bBV2CEzHjuedTyEMC5.3_1 2024-09-12T17:35:29.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.377+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~2pIlHaU_i9MD6bBV2CEzHjuedTyEMC5.4 2024-09-12T17:35:29.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.378+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~2pIlHaU_i9MD6bBV2CEzHjuedTyEMC5.4_1 2024-09-12T17:35:29.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.378+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~2pIlHaU_i9MD6bBV2CEzHjuedTyEMC5.5 2024-09-12T17:35:29.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.378+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~2pIlHaU_i9MD6bBV2CEzHjuedTyEMC5.5_1 2024-09-12T17:35:29.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.378+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~2pIlHaU_i9MD6bBV2CEzHjuedTyEMC5.6 2024-09-12T17:35:29.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.378+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~2pIlHaU_i9MD6bBV2CEzHjuedTyEMC5.6_1 2024-09-12T17:35:29.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.378+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~2pIlHaU_i9MD6bBV2CEzHjuedTyEMC5.7 2024-09-12T17:35:29.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.378+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~2pIlHaU_i9MD6bBV2CEzHjuedTyEMC5.7_1 2024-09-12T17:35:29.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.378+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~2pIlHaU_i9MD6bBV2CEzHjuedTyEMC5.8 2024-09-12T17:35:29.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.378+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~2pIlHaU_i9MD6bBV2CEzHjuedTyEMC5.8_1 2024-09-12T17:35:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.380+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~2pIlHaU_i9MD6bBV2CEzHjuedTyEMC5.9 2024-09-12T17:35:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.380+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~2pIlHaU_i9MD6bBV2CEzHjuedTyEMC5.9_1 2024-09-12T17:35:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.380+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~2pIlHaU_i9MD6bBV2CEzHjuedTyEMC5.10 2024-09-12T17:35:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.381+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~2pIlHaU_i9MD6bBV2CEzHjuedTyEMC5.10_1 2024-09-12T17:35:29.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.382+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~2pIlHaU_i9MD6bBV2CEzHjuedTyEMC5.11 2024-09-12T17:35:29.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.384+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:35:29.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.386+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:35:29.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.387+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.387+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.388+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:35:29.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.388+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16941656793220128407', time=2024-09-12T19:32:02.095982+0000, chain.objs.size()=9 2024-09-12T17:35:29.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.388+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__multipart_key1.2~d_M4nK1x94FGs9lZ1E2-RuzTQlXY48d.1 2024-09-12T17:35:29.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.388+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__shadow_key1.2~d_M4nK1x94FGs9lZ1E2-RuzTQlXY48d.1_1 2024-09-12T17:35:29.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.388+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__multipart_key1.2~d_M4nK1x94FGs9lZ1E2-RuzTQlXY48d.2 2024-09-12T17:35:29.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.388+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__shadow_key1.2~d_M4nK1x94FGs9lZ1E2-RuzTQlXY48d.2_1 2024-09-12T17:35:29.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.388+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__multipart_key1.2~d_M4nK1x94FGs9lZ1E2-RuzTQlXY48d.3 2024-09-12T17:35:29.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.388+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__shadow_key1.2~d_M4nK1x94FGs9lZ1E2-RuzTQlXY48d.3_1 2024-09-12T17:35:29.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.388+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__multipart_key1.2~d_M4nK1x94FGs9lZ1E2-RuzTQlXY48d.4 2024-09-12T17:35:29.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.388+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__shadow_key1.2~d_M4nK1x94FGs9lZ1E2-RuzTQlXY48d.4_1 2024-09-12T17:35:29.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.388+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__multipart_key1.2~d_M4nK1x94FGs9lZ1E2-RuzTQlXY48d.5 2024-09-12T17:35:29.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.391+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:35:29.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.393+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:35:29.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.395+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.395+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.396+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:35:29.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.396+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11365024300787463830', time=2024-09-12T19:34:41.047298+0000, chain.objs.size()=16 2024-09-12T17:35:29.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.396+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~qoGE3e0P2YwOAjXcjaazjeCx3oVEzna.1 2024-09-12T17:35:29.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.396+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~qoGE3e0P2YwOAjXcjaazjeCx3oVEzna.1_1 2024-09-12T17:35:29.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.396+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~qoGE3e0P2YwOAjXcjaazjeCx3oVEzna.1_2 2024-09-12T17:35:29.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.396+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~qoGE3e0P2YwOAjXcjaazjeCx3oVEzna.2 2024-09-12T17:35:29.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.396+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~qoGE3e0P2YwOAjXcjaazjeCx3oVEzna.2_1 2024-09-12T17:35:29.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.396+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~qoGE3e0P2YwOAjXcjaazjeCx3oVEzna.2_2 2024-09-12T17:35:29.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.396+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~qoGE3e0P2YwOAjXcjaazjeCx3oVEzna.3 2024-09-12T17:35:29.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.396+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~qoGE3e0P2YwOAjXcjaazjeCx3oVEzna.3_1 2024-09-12T17:35:29.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.396+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~qoGE3e0P2YwOAjXcjaazjeCx3oVEzna.3_2 2024-09-12T17:35:29.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.396+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~qoGE3e0P2YwOAjXcjaazjeCx3oVEzna.4 2024-09-12T17:35:29.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.396+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~qoGE3e0P2YwOAjXcjaazjeCx3oVEzna.4_1 2024-09-12T17:35:29.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.396+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~qoGE3e0P2YwOAjXcjaazjeCx3oVEzna.4_2 2024-09-12T17:35:29.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.399+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~qoGE3e0P2YwOAjXcjaazjeCx3oVEzna.5 2024-09-12T17:35:29.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.399+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~qoGE3e0P2YwOAjXcjaazjeCx3oVEzna.5_1 2024-09-12T17:35:29.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.399+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~qoGE3e0P2YwOAjXcjaazjeCx3oVEzna.5_2 2024-09-12T17:35:29.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.399+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~qoGE3e0P2YwOAjXcjaazjeCx3oVEzna.6 2024-09-12T17:35:29.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.402+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:35:29.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.404+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:35:29.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.405+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.405+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.406+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:35:29.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.406+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6969954986607027108', time=2024-09-12T19:35:13.882105+0000, chain.objs.size()=1 2024-09-12T17:35:29.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.406+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.64__shadow_.ecpKt7hY5nDezdogdxzWF55X6lbyndP_0 2024-09-12T17:35:29.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.407+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:35:29.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.409+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:35:29.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.410+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.410+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.411+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:35:29.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.411+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16450276786276915899', time=2024-09-12T19:33:10.085172+0000, chain.objs.size()=1 2024-09-12T17:35:29.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.411+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.54__shadow_.1PBMod5wUP3iK5LArMvoLmmsotKRMDM_0 2024-09-12T17:35:29.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.412+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:35:29.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.413+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:35:29.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.415+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.415+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.416+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.417+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:35:29.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.418+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.418+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.419+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:35:29.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.419+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16692537018922317828', time=2024-09-12T19:33:35.476845+0000, chain.objs.size()=21 2024-09-12T17:35:29.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.419+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~eNfxuZpB3IjA69-0n6MhmVmHqK0zhci.1 2024-09-12T17:35:29.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.419+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~eNfxuZpB3IjA69-0n6MhmVmHqK0zhci.1_1 2024-09-12T17:35:29.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.419+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~eNfxuZpB3IjA69-0n6MhmVmHqK0zhci.2 2024-09-12T17:35:29.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.419+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~eNfxuZpB3IjA69-0n6MhmVmHqK0zhci.2_1 2024-09-12T17:35:29.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.419+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~eNfxuZpB3IjA69-0n6MhmVmHqK0zhci.3 2024-09-12T17:35:29.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.419+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~eNfxuZpB3IjA69-0n6MhmVmHqK0zhci.3_1 2024-09-12T17:35:29.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.419+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~eNfxuZpB3IjA69-0n6MhmVmHqK0zhci.4 2024-09-12T17:35:29.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.419+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~eNfxuZpB3IjA69-0n6MhmVmHqK0zhci.4_1 2024-09-12T17:35:29.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.419+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~eNfxuZpB3IjA69-0n6MhmVmHqK0zhci.5 2024-09-12T17:35:29.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.419+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~eNfxuZpB3IjA69-0n6MhmVmHqK0zhci.5_1 2024-09-12T17:35:29.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.419+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~eNfxuZpB3IjA69-0n6MhmVmHqK0zhci.6 2024-09-12T17:35:29.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.419+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~eNfxuZpB3IjA69-0n6MhmVmHqK0zhci.6_1 2024-09-12T17:35:29.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.422+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~eNfxuZpB3IjA69-0n6MhmVmHqK0zhci.7 2024-09-12T17:35:29.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.422+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~eNfxuZpB3IjA69-0n6MhmVmHqK0zhci.7_1 2024-09-12T17:35:29.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.422+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~eNfxuZpB3IjA69-0n6MhmVmHqK0zhci.8 2024-09-12T17:35:29.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.422+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~eNfxuZpB3IjA69-0n6MhmVmHqK0zhci.8_1 2024-09-12T17:35:29.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.422+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~eNfxuZpB3IjA69-0n6MhmVmHqK0zhci.9 2024-09-12T17:35:29.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.422+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~eNfxuZpB3IjA69-0n6MhmVmHqK0zhci.9_1 2024-09-12T17:35:29.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.422+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~eNfxuZpB3IjA69-0n6MhmVmHqK0zhci.10 2024-09-12T17:35:29.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.422+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~eNfxuZpB3IjA69-0n6MhmVmHqK0zhci.10_1 2024-09-12T17:35:29.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.423+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~eNfxuZpB3IjA69-0n6MhmVmHqK0zhci.11 2024-09-12T17:35:29.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.423+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15138906394787293581', time=2024-09-12T19:34:18.327936+0000, chain.objs.size()=19 2024-09-12T17:35:29.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.423+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~Jk2cc-66RQujNVUjhQ60Dt1Hs-GIY5y.1 2024-09-12T17:35:29.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.423+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~Jk2cc-66RQujNVUjhQ60Dt1Hs-GIY5y.1_1 2024-09-12T17:35:29.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.425+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~Jk2cc-66RQujNVUjhQ60Dt1Hs-GIY5y.2 2024-09-12T17:35:29.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.425+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~Jk2cc-66RQujNVUjhQ60Dt1Hs-GIY5y.2_1 2024-09-12T17:35:29.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.425+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~Jk2cc-66RQujNVUjhQ60Dt1Hs-GIY5y.3 2024-09-12T17:35:29.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.425+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~Jk2cc-66RQujNVUjhQ60Dt1Hs-GIY5y.3_1 2024-09-12T17:35:29.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.425+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~Jk2cc-66RQujNVUjhQ60Dt1Hs-GIY5y.4 2024-09-12T17:35:29.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.425+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~Jk2cc-66RQujNVUjhQ60Dt1Hs-GIY5y.4_1 2024-09-12T17:35:29.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.425+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~Jk2cc-66RQujNVUjhQ60Dt1Hs-GIY5y.5 2024-09-12T17:35:29.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.425+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~Jk2cc-66RQujNVUjhQ60Dt1Hs-GIY5y.5_1 2024-09-12T17:35:29.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.425+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~Jk2cc-66RQujNVUjhQ60Dt1Hs-GIY5y.6 2024-09-12T17:35:29.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.425+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~Jk2cc-66RQujNVUjhQ60Dt1Hs-GIY5y.6_1 2024-09-12T17:35:29.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.425+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~Jk2cc-66RQujNVUjhQ60Dt1Hs-GIY5y.7 2024-09-12T17:35:29.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.428+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~Jk2cc-66RQujNVUjhQ60Dt1Hs-GIY5y.7_1 2024-09-12T17:35:29.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.428+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~Jk2cc-66RQujNVUjhQ60Dt1Hs-GIY5y.8 2024-09-12T17:35:29.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.428+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~Jk2cc-66RQujNVUjhQ60Dt1Hs-GIY5y.8_1 2024-09-12T17:35:29.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.428+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~Jk2cc-66RQujNVUjhQ60Dt1Hs-GIY5y.9 2024-09-12T17:35:29.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.428+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__shadow_key1.2~Jk2cc-66RQujNVUjhQ60Dt1Hs-GIY5y.9_1 2024-09-12T17:35:29.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.428+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.56__multipart_key1.2~Jk2cc-66RQujNVUjhQ60Dt1Hs-GIY5y.10 2024-09-12T17:35:29.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.431+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:35:29.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.433+0000 7f72d5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:35:29.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.434+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.434+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.435+0000 7f72d5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:35:29.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.435+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2248597893873513758', time=2024-09-12T19:32:05.992688+0000, chain.objs.size()=9 2024-09-12T17:35:29.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.435+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__multipart_key1.2~XKM3WLggIw47tkLxvvEnLJd4hnT-MzU.1 2024-09-12T17:35:29.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.435+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__shadow_key1.2~XKM3WLggIw47tkLxvvEnLJd4hnT-MzU.1_1 2024-09-12T17:35:29.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.435+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__multipart_key1.2~XKM3WLggIw47tkLxvvEnLJd4hnT-MzU.2 2024-09-12T17:35:29.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.435+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__shadow_key1.2~XKM3WLggIw47tkLxvvEnLJd4hnT-MzU.2_1 2024-09-12T17:35:29.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.435+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__multipart_key1.2~XKM3WLggIw47tkLxvvEnLJd4hnT-MzU.3 2024-09-12T17:35:29.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.435+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__shadow_key1.2~XKM3WLggIw47tkLxvvEnLJd4hnT-MzU.3_1 2024-09-12T17:35:29.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.435+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__multipart_key1.2~XKM3WLggIw47tkLxvvEnLJd4hnT-MzU.4 2024-09-12T17:35:29.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.435+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__shadow_key1.2~XKM3WLggIw47tkLxvvEnLJd4hnT-MzU.4_1 2024-09-12T17:35:29.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.435+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.48__multipart_key1.2~XKM3WLggIw47tkLxvvEnLJd4hnT-MzU.5 2024-09-12T17:35:29.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.435+0000 7f72d5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11480977434546547701', time=2024-09-12T19:35:28.221837+0000, chain.objs.size()=21 2024-09-12T17:35:29.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.435+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.67__multipart_key1.2~RQfqxIZLa2_snXgEC4bK_HXUJS9W3pp.1 2024-09-12T17:35:29.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.435+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.67__shadow_key1.2~RQfqxIZLa2_snXgEC4bK_HXUJS9W3pp.1_1 2024-09-12T17:35:29.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.435+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.67__multipart_key1.2~RQfqxIZLa2_snXgEC4bK_HXUJS9W3pp.2 2024-09-12T17:35:29.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.438+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.67__shadow_key1.2~RQfqxIZLa2_snXgEC4bK_HXUJS9W3pp.2_1 2024-09-12T17:35:29.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.438+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.67__multipart_key1.2~RQfqxIZLa2_snXgEC4bK_HXUJS9W3pp.3 2024-09-12T17:35:29.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.438+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.67__shadow_key1.2~RQfqxIZLa2_snXgEC4bK_HXUJS9W3pp.3_1 2024-09-12T17:35:29.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.438+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.67__multipart_key1.2~RQfqxIZLa2_snXgEC4bK_HXUJS9W3pp.4 2024-09-12T17:35:29.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.438+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.67__shadow_key1.2~RQfqxIZLa2_snXgEC4bK_HXUJS9W3pp.4_1 2024-09-12T17:35:29.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.438+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.67__multipart_key1.2~RQfqxIZLa2_snXgEC4bK_HXUJS9W3pp.5 2024-09-12T17:35:29.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.438+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.67__shadow_key1.2~RQfqxIZLa2_snXgEC4bK_HXUJS9W3pp.5_1 2024-09-12T17:35:29.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.438+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.67__multipart_key1.2~RQfqxIZLa2_snXgEC4bK_HXUJS9W3pp.6 2024-09-12T17:35:29.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.438+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.67__shadow_key1.2~RQfqxIZLa2_snXgEC4bK_HXUJS9W3pp.6_1 2024-09-12T17:35:29.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.438+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.67__multipart_key1.2~RQfqxIZLa2_snXgEC4bK_HXUJS9W3pp.7 2024-09-12T17:35:29.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.438+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.67__shadow_key1.2~RQfqxIZLa2_snXgEC4bK_HXUJS9W3pp.7_1 2024-09-12T17:35:29.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.442+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.67__multipart_key1.2~RQfqxIZLa2_snXgEC4bK_HXUJS9W3pp.8 2024-09-12T17:35:29.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.442+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.67__shadow_key1.2~RQfqxIZLa2_snXgEC4bK_HXUJS9W3pp.8_1 2024-09-12T17:35:29.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.442+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.67__multipart_key1.2~RQfqxIZLa2_snXgEC4bK_HXUJS9W3pp.9 2024-09-12T17:35:29.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.442+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.67__shadow_key1.2~RQfqxIZLa2_snXgEC4bK_HXUJS9W3pp.9_1 2024-09-12T17:35:29.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.442+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.67__multipart_key1.2~RQfqxIZLa2_snXgEC4bK_HXUJS9W3pp.10 2024-09-12T17:35:29.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.442+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.67__shadow_key1.2~RQfqxIZLa2_snXgEC4bK_HXUJS9W3pp.10_1 2024-09-12T17:35:29.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.442+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.67__multipart_key1.2~RQfqxIZLa2_snXgEC4bK_HXUJS9W3pp.11 2024-09-12T17:35:29.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.444+0000 7f72d5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:35:29.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.448+0000 7f7182ff5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:29.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.450+0000 7f72d5b26800 20 remove_watcher() i=0 2024-09-12T17:35:29.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.450+0000 7f72d5b26800 2 removed watcher, disabling cache 2024-09-12T17:35:29.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.450+0000 7f72d5b26800 20 remove_watcher() i=1 2024-09-12T17:35:29.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.452+0000 7f72d5b26800 20 remove_watcher() i=2 2024-09-12T17:35:29.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.452+0000 7f72d5b26800 20 remove_watcher() i=3 2024-09-12T17:35:29.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.453+0000 7f72d5b26800 20 remove_watcher() i=4 2024-09-12T17:35:29.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.454+0000 7f72d5b26800 20 remove_watcher() i=5 2024-09-12T17:35:29.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.455+0000 7f72d5b26800 20 remove_watcher() i=6 2024-09-12T17:35:29.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.456+0000 7f72d5b26800 20 remove_watcher() i=7 2024-09-12T17:35:29.468 DEBUG:teuthology.orchestra.run.smithi067:> radosgw-admin gc process --include-all 2024-09-12T17:35:29.522 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:29.522 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:29.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.560+0000 7f9f7a213800 20 rados->read ofs=0 len=0 2024-09-12T17:35:29.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.561+0000 7f9f7a213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:29.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.561+0000 7f9f7a213800 20 realm 2024-09-12T17:35:29.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.561+0000 7f9f7a213800 20 rados->read ofs=0 len=0 2024-09-12T17:35:29.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.562+0000 7f9f7a213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:29.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.562+0000 7f9f7a213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:29.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.562+0000 7f9f7a213800 20 rados->read ofs=0 len=0 2024-09-12T17:35:29.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.562+0000 7f9f7a213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:29.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.562+0000 7f9f7a213800 20 rados->read ofs=0 len=0 2024-09-12T17:35:29.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.562+0000 7f9f7a213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:29.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.563+0000 7f9f7a213800 20 rados->read ofs=0 len=0 2024-09-12T17:35:29.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.563+0000 7f9f7a213800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:29.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.563+0000 7f9f7a213800 20 searching for the correct realm 2024-09-12T17:35:29.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.565+0000 7f9f75147640 0 -- 172.21.15.67:0/3261698657 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f9f6806e5c0 msgr2=0x7f9f68086b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:35:29.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.569+0000 7f9f75948640 0 -- 172.21.15.67:0/3261698657 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f9f6008e930 msgr2=0x7f9f60080400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:35:29.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.775+0000 7f9f7a213800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:35:29.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.775+0000 7f9f7a213800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:35:29.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.775+0000 7f9f7a213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:29.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.775+0000 7f9f7a213800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:29.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.775+0000 7f9f7a213800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:29.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.775+0000 7f9f7a213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:29.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.775+0000 7f9f7a213800 20 rados->read ofs=0 len=0 2024-09-12T17:35:29.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.775+0000 7f9f7a213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:29.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.775+0000 7f9f7a213800 20 rados->read ofs=0 len=0 2024-09-12T17:35:29.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.776+0000 7f9f7a213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:29.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.776+0000 7f9f7a213800 20 rados->read ofs=0 len=0 2024-09-12T17:35:29.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.776+0000 7f9f7a213800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:29.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.776+0000 7f9f7a213800 20 zone default found 2024-09-12T17:35:29.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.776+0000 7f9f7a213800 4 Realm: () 2024-09-12T17:35:29.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.776+0000 7f9f7a213800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:35:29.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.776+0000 7f9f7a213800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:35:29.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.776+0000 7f9f7a213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:29.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.776+0000 7f9f7a213800 20 zonegroup default 2024-09-12T17:35:29.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.776+0000 7f9f7a213800 20 rados->read ofs=0 len=0 2024-09-12T17:35:29.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.776+0000 7f9f7a213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:29.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.777+0000 7f9f7a213800 20 rados->read ofs=0 len=0 2024-09-12T17:35:29.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.777+0000 7f9f7a213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:29.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.777+0000 7f9f7a213800 20 rados->read ofs=0 len=0 2024-09-12T17:35:29.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.777+0000 7f9f7a213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:29.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.777+0000 7f9f7a213800 20 started sync module instance, tier type = 2024-09-12T17:35:29.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.777+0000 7f9f7a213800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:35:29.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.786+0000 7f9f7a213800 20 add_watcher() i=0 2024-09-12T17:35:29.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.786+0000 7f9f7a213800 20 add_watcher() i=1 2024-09-12T17:35:29.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.786+0000 7f9f7a213800 20 add_watcher() i=2 2024-09-12T17:35:29.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.786+0000 7f9f7a213800 20 add_watcher() i=3 2024-09-12T17:35:29.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.786+0000 7f9f7a213800 20 add_watcher() i=4 2024-09-12T17:35:29.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.786+0000 7f9f7a213800 20 add_watcher() i=5 2024-09-12T17:35:29.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.786+0000 7f9f7a213800 20 add_watcher() i=6 2024-09-12T17:35:29.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.787+0000 7f9f7a213800 20 add_watcher() i=7 2024-09-12T17:35:29.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.787+0000 7f9f7a213800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:29.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.788+0000 7f9e277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:29.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.788+0000 7f9f7a213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:29.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.788+0000 7f9f7a213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:29.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.821+0000 7f9e267fc640 20 reqs_thread_entry: start 2024-09-12T17:35:29.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.822+0000 7f9f7a213800 20 init_complete bucket index max shards: 1 2024-09-12T17:35:29.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.822+0000 7f9f7a213800 20 Filter name: none 2024-09-12T17:35:29.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.822+0000 7f9d97fff640 20 reqs_thread_entry: start 2024-09-12T17:35:29.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.822+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:35:29.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.824+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.824+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.825+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.826+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:35:29.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.827+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.828+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.828+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.829+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:35:29.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.831+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.831+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.831+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.832+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:35:29.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.834+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.834+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.835+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.835+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:35:29.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.837+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.837+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.837+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.839+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:35:29.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.840+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.840+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.840+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.841+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:35:29.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.843+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.844+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.844+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.845+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:35:29.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.847+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.847+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.848+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.849+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:35:29.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.850+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.851+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.851+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.852+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:35:29.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.853+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.854+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.854+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.855+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:35:29.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.856+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.857+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.857+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.858+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:35:29.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.859+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.860+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.860+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.861+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:35:29.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.862+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.863+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.863+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.864+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:35:29.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.866+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.866+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.866+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.867+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:35:29.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.869+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.869+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.870+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.871+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:35:29.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.872+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.873+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.873+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.874+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:35:29.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.875+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.876+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.876+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.877+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:35:29.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.879+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.879+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.879+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.880+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:35:29.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.881+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.882+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.882+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.883+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:35:29.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.884+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.884+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.885+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.885+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:35:29.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.887+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.887+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.887+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.888+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:35:29.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.890+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.890+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.890+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.891+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:35:29.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.893+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.893+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.894+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.894+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:35:29.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.896+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.896+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.897+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.898+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:35:29.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.899+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.899+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.899+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.900+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:35:29.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.902+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.902+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.902+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.903+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:35:29.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.905+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.905+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.905+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.906+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:35:29.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.907+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.908+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.908+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.909+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:35:29.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.910+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.911+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.911+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.912+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:35:29.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.913+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.914+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.914+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.916+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:35:29.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.917+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.917+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.918+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.918+0000 7f9f7a213800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:35:29.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.920+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.920+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:29.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.920+0000 7f9f7a213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:29.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.922+0000 7f9e277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:29.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.924+0000 7f9f7a213800 20 remove_watcher() i=0 2024-09-12T17:35:29.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.924+0000 7f9f7a213800 2 removed watcher, disabling cache 2024-09-12T17:35:29.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.926+0000 7f9f7a213800 20 remove_watcher() i=1 2024-09-12T17:35:29.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.927+0000 7f9f7a213800 20 remove_watcher() i=2 2024-09-12T17:35:29.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.928+0000 7f9f7a213800 20 remove_watcher() i=3 2024-09-12T17:35:29.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.929+0000 7f9f7a213800 20 remove_watcher() i=4 2024-09-12T17:35:29.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.930+0000 7f9f7a213800 20 remove_watcher() i=5 2024-09-12T17:35:29.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.931+0000 7f9f7a213800 20 remove_watcher() i=6 2024-09-12T17:35:29.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:29.932+0000 7f9f7a213800 20 remove_watcher() i=7 2024-09-12T17:35:29.945 DEBUG:teuthology.orchestra.run.smithi067:> radosgw-admin gc process --include-all 2024-09-12T17:35:29.997 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:29.997 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:30.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.036+0000 7fc380640800 20 rados->read ofs=0 len=0 2024-09-12T17:35:30.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.038+0000 7fc380640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:30.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.038+0000 7fc380640800 20 realm 2024-09-12T17:35:30.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.038+0000 7fc380640800 20 rados->read ofs=0 len=0 2024-09-12T17:35:30.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.038+0000 7fc380640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:30.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.038+0000 7fc380640800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:30.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.038+0000 7fc380640800 20 rados->read ofs=0 len=0 2024-09-12T17:35:30.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.038+0000 7fc380640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:30.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.038+0000 7fc380640800 20 rados->read ofs=0 len=0 2024-09-12T17:35:30.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.039+0000 7fc380640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:30.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.039+0000 7fc380640800 20 rados->read ofs=0 len=0 2024-09-12T17:35:30.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.040+0000 7fc380640800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:30.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.040+0000 7fc380640800 20 searching for the correct realm 2024-09-12T17:35:30.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.041+0000 7fc37e131640 0 -- 172.21.15.67:0/567625274 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7fc368003bd0 msgr2=0x7fc3780628d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:30.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.246+0000 7fc37d930640 0 -- 172.21.15.67:0/567625274 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7fc3700a6910 msgr2=0x7fc3700673f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:30.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.253+0000 7fc380640800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:35:30.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.253+0000 7fc380640800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:35:30.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.253+0000 7fc380640800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:30.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.253+0000 7fc380640800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:30.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.253+0000 7fc380640800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:30.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.253+0000 7fc380640800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:30.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.253+0000 7fc380640800 20 rados->read ofs=0 len=0 2024-09-12T17:35:30.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.253+0000 7fc380640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:30.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.253+0000 7fc380640800 20 rados->read ofs=0 len=0 2024-09-12T17:35:30.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.253+0000 7fc380640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:30.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.253+0000 7fc380640800 20 rados->read ofs=0 len=0 2024-09-12T17:35:30.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.253+0000 7fc380640800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:30.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.253+0000 7fc380640800 20 zone default found 2024-09-12T17:35:30.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.253+0000 7fc380640800 4 Realm: () 2024-09-12T17:35:30.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.253+0000 7fc380640800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:35:30.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.253+0000 7fc380640800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:35:30.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.253+0000 7fc380640800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:30.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.253+0000 7fc380640800 20 zonegroup default 2024-09-12T17:35:30.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.253+0000 7fc380640800 20 rados->read ofs=0 len=0 2024-09-12T17:35:30.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.254+0000 7fc380640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:30.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.254+0000 7fc380640800 20 rados->read ofs=0 len=0 2024-09-12T17:35:30.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.254+0000 7fc380640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:30.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.254+0000 7fc380640800 20 rados->read ofs=0 len=0 2024-09-12T17:35:30.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.254+0000 7fc380640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:30.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.254+0000 7fc380640800 20 started sync module instance, tier type = 2024-09-12T17:35:30.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.254+0000 7fc380640800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:35:30.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.263+0000 7fc380640800 20 add_watcher() i=0 2024-09-12T17:35:30.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.263+0000 7fc380640800 20 add_watcher() i=1 2024-09-12T17:35:30.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.263+0000 7fc380640800 20 add_watcher() i=2 2024-09-12T17:35:30.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.263+0000 7fc380640800 20 add_watcher() i=3 2024-09-12T17:35:30.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.263+0000 7fc380640800 20 add_watcher() i=4 2024-09-12T17:35:30.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.263+0000 7fc380640800 20 add_watcher() i=5 2024-09-12T17:35:30.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.263+0000 7fc380640800 20 add_watcher() i=6 2024-09-12T17:35:30.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.264+0000 7fc380640800 20 add_watcher() i=7 2024-09-12T17:35:30.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.264+0000 7fc380640800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:30.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.266+0000 7fc234fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:30.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.266+0000 7fc380640800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:30.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.266+0000 7fc380640800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:30.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.300+0000 7fc1af7fe640 20 reqs_thread_entry: start 2024-09-12T17:35:30.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.300+0000 7fc380640800 20 init_complete bucket index max shards: 1 2024-09-12T17:35:30.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.300+0000 7fc380640800 20 Filter name: none 2024-09-12T17:35:30.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.300+0000 7fc1ad7fa640 20 reqs_thread_entry: start 2024-09-12T17:35:30.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.300+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:35:30.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.302+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.302+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.302+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.304+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:35:30.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.305+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.306+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.306+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.307+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:35:30.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.308+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.309+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.309+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.310+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:35:30.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.311+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.312+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.312+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.313+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:35:30.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.314+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.314+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.315+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.316+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:35:30.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.317+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.317+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.317+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.318+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:35:30.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.319+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.320+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.320+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.321+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:35:30.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.322+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.322+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.323+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.324+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:35:30.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.326+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.326+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.327+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.328+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:35:30.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.329+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.330+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.330+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.331+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:35:30.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.332+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.333+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.333+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.334+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:35:30.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.335+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.336+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.336+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.337+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:35:30.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.338+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.338+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.339+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.339+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:35:30.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.342+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.342+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.342+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.343+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:35:30.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.344+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.345+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.345+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.346+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:35:30.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.347+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.348+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.348+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.350+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:35:30.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.351+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.351+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.351+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.353+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:35:30.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.354+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.354+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.355+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.356+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:35:30.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.357+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.358+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.358+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.359+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:35:30.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.360+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.361+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.361+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.362+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:35:30.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.363+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.364+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.364+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.365+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:35:30.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.366+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.367+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.367+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.368+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:35:30.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.369+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.370+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.370+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.371+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:35:30.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.372+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.372+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.373+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.373+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:35:30.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.375+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.375+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.375+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.376+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:35:30.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.378+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.378+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.378+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.379+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:35:30.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.380+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.381+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.381+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.382+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:35:30.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.383+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.384+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.384+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.385+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:35:30.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.386+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.386+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.387+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.388+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:35:30.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.389+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.389+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.390+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.391+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:35:30.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.392+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.392+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.393+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.393+0000 7fc380640800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:35:30.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.395+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.395+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.395+0000 7fc380640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.397+0000 7fc234fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:30.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.399+0000 7fc380640800 20 remove_watcher() i=0 2024-09-12T17:35:30.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.399+0000 7fc380640800 2 removed watcher, disabling cache 2024-09-12T17:35:30.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.400+0000 7fc380640800 20 remove_watcher() i=1 2024-09-12T17:35:30.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.401+0000 7fc380640800 20 remove_watcher() i=2 2024-09-12T17:35:30.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.402+0000 7fc380640800 20 remove_watcher() i=3 2024-09-12T17:35:30.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.403+0000 7fc380640800 20 remove_watcher() i=4 2024-09-12T17:35:30.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.404+0000 7fc380640800 20 remove_watcher() i=5 2024-09-12T17:35:30.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.405+0000 7fc380640800 20 remove_watcher() i=6 2024-09-12T17:35:30.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.406+0000 7fc380640800 20 remove_watcher() i=7 2024-09-12T17:35:30.418 DEBUG:teuthology.orchestra.run.smithi067:> radosgw-admin gc process --include-all 2024-09-12T17:35:30.472 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:30.472 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:30.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.513+0000 7fe345c87800 20 rados->read ofs=0 len=0 2024-09-12T17:35:30.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.515+0000 7fe345c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:30.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.515+0000 7fe345c87800 20 realm 2024-09-12T17:35:30.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.515+0000 7fe345c87800 20 rados->read ofs=0 len=0 2024-09-12T17:35:30.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.515+0000 7fe345c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:30.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.515+0000 7fe345c87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:30.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.515+0000 7fe345c87800 20 rados->read ofs=0 len=0 2024-09-12T17:35:30.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.515+0000 7fe345c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:30.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.515+0000 7fe345c87800 20 rados->read ofs=0 len=0 2024-09-12T17:35:30.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.516+0000 7fe345c87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:30.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.516+0000 7fe345c87800 20 rados->read ofs=0 len=0 2024-09-12T17:35:30.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.517+0000 7fe345c87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:30.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.517+0000 7fe345c87800 20 searching for the correct realm 2024-09-12T17:35:30.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.518+0000 7fe343771640 0 -- 172.21.15.67:0/1395416450 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7fe33c01e400 msgr2=0x7fe33c01e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:30.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.724+0000 7fe342f70640 0 -- 172.21.15.67:0/1395416450 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7fe334088060 msgr2=0x7fe3340ad850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:30.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.730+0000 7fe345c87800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:35:30.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.730+0000 7fe345c87800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:35:30.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.730+0000 7fe345c87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:30.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.730+0000 7fe345c87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:30.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.730+0000 7fe345c87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:30.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.730+0000 7fe345c87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:30.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.730+0000 7fe345c87800 20 rados->read ofs=0 len=0 2024-09-12T17:35:30.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.730+0000 7fe345c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:30.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.730+0000 7fe345c87800 20 rados->read ofs=0 len=0 2024-09-12T17:35:30.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.730+0000 7fe345c87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:30.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.731+0000 7fe345c87800 20 rados->read ofs=0 len=0 2024-09-12T17:35:30.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.731+0000 7fe345c87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:30.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.731+0000 7fe345c87800 20 zone default found 2024-09-12T17:35:30.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.731+0000 7fe345c87800 4 Realm: () 2024-09-12T17:35:30.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.731+0000 7fe345c87800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:35:30.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.731+0000 7fe345c87800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:35:30.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.731+0000 7fe345c87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:30.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.731+0000 7fe345c87800 20 zonegroup default 2024-09-12T17:35:30.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.731+0000 7fe345c87800 20 rados->read ofs=0 len=0 2024-09-12T17:35:30.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.731+0000 7fe345c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:30.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.731+0000 7fe345c87800 20 rados->read ofs=0 len=0 2024-09-12T17:35:30.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.731+0000 7fe345c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:30.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.731+0000 7fe345c87800 20 rados->read ofs=0 len=0 2024-09-12T17:35:30.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.732+0000 7fe345c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:30.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.732+0000 7fe345c87800 20 started sync module instance, tier type = 2024-09-12T17:35:30.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.732+0000 7fe345c87800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:35:30.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.741+0000 7fe345c87800 20 add_watcher() i=0 2024-09-12T17:35:30.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.741+0000 7fe345c87800 20 add_watcher() i=1 2024-09-12T17:35:30.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.741+0000 7fe345c87800 20 add_watcher() i=2 2024-09-12T17:35:30.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.741+0000 7fe345c87800 20 add_watcher() i=3 2024-09-12T17:35:30.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.741+0000 7fe345c87800 20 add_watcher() i=4 2024-09-12T17:35:30.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.741+0000 7fe345c87800 20 add_watcher() i=5 2024-09-12T17:35:30.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.741+0000 7fe345c87800 20 add_watcher() i=6 2024-09-12T17:35:30.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.742+0000 7fe345c87800 20 add_watcher() i=7 2024-09-12T17:35:30.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.742+0000 7fe345c87800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:30.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.743+0000 7fe1f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:30.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.743+0000 7fe345c87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:30.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.743+0000 7fe345c87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:30.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.777+0000 7fe1f4fe1640 20 reqs_thread_entry: start 2024-09-12T17:35:30.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.777+0000 7fe345c87800 20 init_complete bucket index max shards: 1 2024-09-12T17:35:30.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.777+0000 7fe345c87800 20 Filter name: none 2024-09-12T17:35:30.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.777+0000 7fe16e7fc640 20 reqs_thread_entry: start 2024-09-12T17:35:30.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.777+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:35:30.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.778+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.779+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.779+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.780+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:35:30.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.781+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.782+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.782+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.783+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:35:30.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.784+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.784+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.785+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.786+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:35:30.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.787+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.787+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.788+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.789+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:35:30.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.790+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.790+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.791+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.792+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:35:30.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.793+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.793+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.793+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.794+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:35:30.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.796+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.796+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.797+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.798+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:35:30.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.800+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.800+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.801+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.802+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:35:30.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.803+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.804+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.804+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.805+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:35:30.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.806+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.807+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.807+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.808+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:35:30.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.809+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.810+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.810+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.811+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:35:30.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.812+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.813+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.813+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.814+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:35:30.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.815+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.816+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.816+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.817+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:35:30.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.818+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.818+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.819+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.820+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:35:30.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.821+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.821+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.821+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.822+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:35:30.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.823+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.824+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.824+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.825+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:35:30.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.826+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.827+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.827+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.828+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:35:30.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.829+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.829+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.830+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.830+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:35:30.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.832+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.832+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.832+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.833+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:35:30.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.834+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.836+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.836+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.837+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:35:30.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.839+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.840+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.840+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.841+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:35:30.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.842+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.842+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.843+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.843+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:35:30.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.845+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.845+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.845+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.846+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:35:30.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.848+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.848+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.848+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.849+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:35:30.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.850+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.851+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.851+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.852+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:35:30.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.853+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.854+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.854+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.855+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:35:30.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.856+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.856+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.857+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.858+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:35:30.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.859+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.860+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.860+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.861+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:35:30.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.862+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.863+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.863+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.864+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:35:30.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.866+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.866+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.866+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.867+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:35:30.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.869+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.869+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.869+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.871+0000 7fe345c87800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:35:30.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.872+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.872+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:30.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.872+0000 7fe345c87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:30.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.875+0000 7fe1f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:30.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.877+0000 7fe345c87800 20 remove_watcher() i=0 2024-09-12T17:35:30.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.877+0000 7fe345c87800 2 removed watcher, disabling cache 2024-09-12T17:35:30.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.881+0000 7fe345c87800 20 remove_watcher() i=1 2024-09-12T17:35:30.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.882+0000 7fe345c87800 20 remove_watcher() i=2 2024-09-12T17:35:30.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.883+0000 7fe345c87800 20 remove_watcher() i=3 2024-09-12T17:35:30.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.884+0000 7fe345c87800 20 remove_watcher() i=4 2024-09-12T17:35:30.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.884+0000 7fe345c87800 20 remove_watcher() i=5 2024-09-12T17:35:30.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.885+0000 7fe345c87800 20 remove_watcher() i=6 2024-09-12T17:35:30.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:30.886+0000 7fe345c87800 20 remove_watcher() i=7 2024-09-12T17:35:30.899 DEBUG:teuthology.orchestra.run.smithi067:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-12T17:35:31.403 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :clean 2024-09-12T17:35:32.199 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :compileJava 2024-09-12T17:35:32.200 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :processResources 2024-09-12T17:35:32.200 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :classes 2024-09-12T17:35:32.699 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:32.700 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :compileTestJava 2024-09-12T17:35:32.701 INFO:teuthology.orchestra.run.smithi067.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T17:35:32.701 INFO:teuthology.orchestra.run.smithi067.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T17:35:32.701 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:32.702 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T17:35:32.702 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :testClasses 2024-09-12T17:35:34.701 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:34.701 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :test 2024-09-12T17:35:34.701 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:34.701 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests STANDARD_OUT 2024-09-12T17:35:34.701 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12 17:35:33,945 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T17:35:34.701 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:34.701 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-12T17:35:34.701 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:34.701 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-12T17:35:34.702 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:34.702 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-12T17:35:34.702 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:34.702 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-12T17:35:34.899 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:34.899 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-12T17:35:34.999 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:34.999 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-12T17:35:35.299 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:35.299 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-12T17:35:35.399 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:35.399 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-12T17:35:35.499 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:35.499 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-12T17:35:35.599 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:35.599 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-12T17:35:35.899 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:35.899 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-12T17:35:35.999 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:35.999 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-12T17:35:36.099 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:36.099 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-12T17:35:36.199 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:36.199 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-12T17:35:36.699 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:36.699 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-12T17:35:36.799 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:36.799 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-12T17:35:37.099 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:37.100 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-12T17:35:37.100 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:37.100 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-12T17:35:37.232 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:37.232 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------- 2024-09-12T17:35:37.232 INFO:teuthology.orchestra.run.smithi067.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-12T17:35:37.233 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------- 2024-09-12T17:35:37.233 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:37.233 INFO:teuthology.orchestra.run.smithi067.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T17:35:37.233 INFO:teuthology.orchestra.run.smithi067.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T17:35:37.233 INFO:teuthology.orchestra.run.smithi067.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T17:35:37.233 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:37.233 INFO:teuthology.orchestra.run.smithi067.stdout:BUILD SUCCESSFUL in 6s 2024-09-12T17:35:37.233 INFO:teuthology.orchestra.run.smithi067.stdout:5 actionable tasks: 5 executed 2024-09-12T17:35:37.236 DEBUG:teuthology.orchestra.run.smithi067:> radosgw-admin gc process --include-all 2024-09-12T17:35:37.290 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:37.290 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:37.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.328+0000 7fa54cf28800 20 rados->read ofs=0 len=0 2024-09-12T17:35:37.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.329+0000 7fa54cf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:37.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.329+0000 7fa54cf28800 20 realm 2024-09-12T17:35:37.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.329+0000 7fa54cf28800 20 rados->read ofs=0 len=0 2024-09-12T17:35:37.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.329+0000 7fa54cf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:37.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.329+0000 7fa54cf28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:37.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.329+0000 7fa54cf28800 20 rados->read ofs=0 len=0 2024-09-12T17:35:37.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.330+0000 7fa54cf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:37.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.330+0000 7fa54cf28800 20 rados->read ofs=0 len=0 2024-09-12T17:35:37.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.330+0000 7fa54cf28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:37.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.331+0000 7fa54cf28800 20 rados->read ofs=0 len=0 2024-09-12T17:35:37.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.331+0000 7fa54cf28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:37.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.331+0000 7fa54cf28800 20 searching for the correct realm 2024-09-12T17:35:37.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.334+0000 7fa54935e640 0 -- 172.21.15.67:0/4040424291 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x55c29fa1ae70 msgr2=0x55c29fa1d330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:37.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.338+0000 7fa548b5d640 0 -- 172.21.15.67:0/4040424291 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fa53408e380 msgr2=0x7fa5340824f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:37.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.343+0000 7fa54cf28800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:35:37.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.343+0000 7fa54cf28800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:35:37.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.343+0000 7fa54cf28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:37.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.343+0000 7fa54cf28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:37.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.343+0000 7fa54cf28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:37.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.343+0000 7fa54cf28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:37.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.343+0000 7fa54cf28800 20 rados->read ofs=0 len=0 2024-09-12T17:35:37.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.343+0000 7fa54cf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:37.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.343+0000 7fa54cf28800 20 rados->read ofs=0 len=0 2024-09-12T17:35:37.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.343+0000 7fa54cf28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:37.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.343+0000 7fa54cf28800 20 rados->read ofs=0 len=0 2024-09-12T17:35:37.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.344+0000 7fa54cf28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:37.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.344+0000 7fa54cf28800 20 zone default found 2024-09-12T17:35:37.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.344+0000 7fa54cf28800 4 Realm: () 2024-09-12T17:35:37.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.344+0000 7fa54cf28800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:35:37.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.344+0000 7fa54cf28800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:35:37.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.344+0000 7fa54cf28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:37.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.344+0000 7fa54cf28800 20 zonegroup default 2024-09-12T17:35:37.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.344+0000 7fa54cf28800 20 rados->read ofs=0 len=0 2024-09-12T17:35:37.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.344+0000 7fa54cf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:37.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.344+0000 7fa54cf28800 20 rados->read ofs=0 len=0 2024-09-12T17:35:37.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.344+0000 7fa54cf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:37.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.344+0000 7fa54cf28800 20 rados->read ofs=0 len=0 2024-09-12T17:35:37.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.344+0000 7fa54cf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:37.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.344+0000 7fa54cf28800 20 started sync module instance, tier type = 2024-09-12T17:35:37.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.344+0000 7fa54cf28800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:35:37.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.353+0000 7fa54cf28800 20 add_watcher() i=0 2024-09-12T17:35:37.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.353+0000 7fa54cf28800 20 add_watcher() i=1 2024-09-12T17:35:37.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.353+0000 7fa54cf28800 20 add_watcher() i=2 2024-09-12T17:35:37.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.353+0000 7fa54cf28800 20 add_watcher() i=3 2024-09-12T17:35:37.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.353+0000 7fa54cf28800 20 add_watcher() i=4 2024-09-12T17:35:37.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.353+0000 7fa54cf28800 20 add_watcher() i=5 2024-09-12T17:35:37.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.353+0000 7fa54cf28800 20 add_watcher() i=6 2024-09-12T17:35:37.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.354+0000 7fa54cf28800 20 add_watcher() i=7 2024-09-12T17:35:37.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.354+0000 7fa54cf28800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:37.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.356+0000 7fa3fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:37.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.356+0000 7fa54cf28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:37.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.356+0000 7fa54cf28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:37.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.396+0000 7fa3fdfe3640 20 reqs_thread_entry: start 2024-09-12T17:35:37.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.397+0000 7fa54cf28800 20 init_complete bucket index max shards: 1 2024-09-12T17:35:37.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.397+0000 7fa54cf28800 20 Filter name: none 2024-09-12T17:35:37.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.397+0000 7fa36f7fe640 20 reqs_thread_entry: start 2024-09-12T17:35:37.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.397+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:35:37.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.398+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.399+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.399+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.400+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:35:37.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.402+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.403+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.403+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.404+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:35:37.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.406+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.406+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.406+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.407+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:35:37.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.409+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.409+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.410+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.411+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:35:37.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.412+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.413+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.413+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.414+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:35:37.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.415+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.416+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.416+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:35:37.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.416+0000 7fa54cf28800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.664521232389248255', time=2024-09-12T19:35:36.324531+0000, chain.objs.size()=1 2024-09-12T17:35:37.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.416+0000 7fa54cf28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.73__shadow_.qESKGzV6ILGtZ3yKWp-LdWqEJyKJdOJ_0 2024-09-12T17:35:37.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.417+0000 7fa54cf28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:35:37.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.419+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:35:37.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.421+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.421+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.421+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.422+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:35:37.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.424+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.424+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.424+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:35:37.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.424+0000 7fa54cf28800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16099094765856046043', time=2024-09-12T19:35:35.693577+0000, chain.objs.size()=1 2024-09-12T17:35:37.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.424+0000 7fa54cf28800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.72__shadow_.CsXRTc_odRxVbBv5V3ugdTGXpJ2dRfW_0 2024-09-12T17:35:37.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.426+0000 7fa54cf28800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:35:37.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.428+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:35:37.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.429+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.430+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.430+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.431+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:35:37.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.432+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.433+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.433+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.434+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:35:37.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.435+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.436+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.436+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.437+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:35:37.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.438+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.439+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.439+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.440+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:35:37.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.441+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.442+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.442+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.443+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:35:37.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.444+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.445+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.445+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.446+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:35:37.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.448+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.448+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.449+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.449+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:35:37.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.451+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.451+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.452+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.453+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:35:37.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.454+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.455+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.455+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.456+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:35:37.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.457+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.458+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.458+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.459+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:35:37.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.460+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.461+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.461+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.462+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:35:37.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.463+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.464+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.464+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.465+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:35:37.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.466+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.467+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.467+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.468+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:35:37.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.469+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.470+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.470+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.471+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:35:37.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.472+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.473+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.473+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.474+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:35:37.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.475+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.476+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.476+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.477+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:35:37.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.479+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.479+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.479+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.480+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:35:37.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.482+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.483+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.483+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.484+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:35:37.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.485+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.486+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.486+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.487+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:35:37.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.488+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.489+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.489+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.490+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:35:37.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.491+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.492+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.492+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.493+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:35:37.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.494+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.495+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.495+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.496+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:35:37.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.498+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.498+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.498+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.499+0000 7fa54cf28800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:35:37.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.501+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.501+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.501+0000 7fa54cf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.503+0000 7fa3fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:37.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.505+0000 7fa54cf28800 20 remove_watcher() i=0 2024-09-12T17:35:37.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.505+0000 7fa54cf28800 2 removed watcher, disabling cache 2024-09-12T17:35:37.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.506+0000 7fa54cf28800 20 remove_watcher() i=1 2024-09-12T17:35:37.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.507+0000 7fa54cf28800 20 remove_watcher() i=2 2024-09-12T17:35:37.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.508+0000 7fa54cf28800 20 remove_watcher() i=3 2024-09-12T17:35:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.509+0000 7fa54cf28800 20 remove_watcher() i=4 2024-09-12T17:35:37.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.510+0000 7fa54cf28800 20 remove_watcher() i=5 2024-09-12T17:35:37.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.511+0000 7fa54cf28800 20 remove_watcher() i=6 2024-09-12T17:35:37.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.512+0000 7fa54cf28800 20 remove_watcher() i=7 2024-09-12T17:35:37.524 DEBUG:teuthology.orchestra.run.smithi067:> radosgw-admin gc process --include-all 2024-09-12T17:35:37.578 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:37.578 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:37.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.616+0000 7f4a40d26800 20 rados->read ofs=0 len=0 2024-09-12T17:35:37.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.618+0000 7f4a40d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:37.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.618+0000 7f4a40d26800 20 realm 2024-09-12T17:35:37.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.618+0000 7f4a40d26800 20 rados->read ofs=0 len=0 2024-09-12T17:35:37.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.618+0000 7f4a40d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:37.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.618+0000 7f4a40d26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:37.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.618+0000 7f4a40d26800 20 rados->read ofs=0 len=0 2024-09-12T17:35:37.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.618+0000 7f4a40d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:37.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.618+0000 7f4a40d26800 20 rados->read ofs=0 len=0 2024-09-12T17:35:37.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.619+0000 7f4a40d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:37.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.619+0000 7f4a40d26800 20 rados->read ofs=0 len=0 2024-09-12T17:35:37.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.620+0000 7f4a40d26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:37.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.620+0000 7f4a40d26800 20 searching for the correct realm 2024-09-12T17:35:37.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.622+0000 7f4a3c95d640 0 -- 172.21.15.67:0/1313478565 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f4a34098030 msgr2=0x7f4a3404e660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:37.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.625+0000 7f4a3c95d640 0 -- 172.21.15.67:0/1313478565 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f4a300a2470 msgr2=0x7f4a300a28d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:37.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.833+0000 7f4a40d26800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:35:37.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.833+0000 7f4a40d26800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:35:37.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.833+0000 7f4a40d26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:37.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.833+0000 7f4a40d26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:37.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.833+0000 7f4a40d26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.833+0000 7f4a40d26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.833+0000 7f4a40d26800 20 rados->read ofs=0 len=0 2024-09-12T17:35:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.833+0000 7f4a40d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.833+0000 7f4a40d26800 20 rados->read ofs=0 len=0 2024-09-12T17:35:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.833+0000 7f4a40d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.833+0000 7f4a40d26800 20 rados->read ofs=0 len=0 2024-09-12T17:35:37.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.833+0000 7f4a40d26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:37.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.834+0000 7f4a40d26800 20 zone default found 2024-09-12T17:35:37.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.834+0000 7f4a40d26800 4 Realm: () 2024-09-12T17:35:37.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.834+0000 7f4a40d26800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:35:37.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.834+0000 7f4a40d26800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:35:37.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.834+0000 7f4a40d26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:37.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.834+0000 7f4a40d26800 20 zonegroup default 2024-09-12T17:35:37.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.834+0000 7f4a40d26800 20 rados->read ofs=0 len=0 2024-09-12T17:35:37.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.834+0000 7f4a40d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:37.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.834+0000 7f4a40d26800 20 rados->read ofs=0 len=0 2024-09-12T17:35:37.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.834+0000 7f4a40d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:37.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.834+0000 7f4a40d26800 20 rados->read ofs=0 len=0 2024-09-12T17:35:37.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.834+0000 7f4a40d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:37.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.834+0000 7f4a40d26800 20 started sync module instance, tier type = 2024-09-12T17:35:37.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.834+0000 7f4a40d26800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:35:37.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.843+0000 7f4a40d26800 20 add_watcher() i=0 2024-09-12T17:35:37.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.843+0000 7f4a40d26800 20 add_watcher() i=1 2024-09-12T17:35:37.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.843+0000 7f4a40d26800 20 add_watcher() i=2 2024-09-12T17:35:37.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.843+0000 7f4a40d26800 20 add_watcher() i=3 2024-09-12T17:35:37.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.843+0000 7f4a40d26800 20 add_watcher() i=4 2024-09-12T17:35:37.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.843+0000 7f4a40d26800 20 add_watcher() i=5 2024-09-12T17:35:37.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.843+0000 7f4a40d26800 20 add_watcher() i=6 2024-09-12T17:35:37.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.844+0000 7f4a40d26800 20 add_watcher() i=7 2024-09-12T17:35:37.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.844+0000 7f4a40d26800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:37.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.845+0000 7f48f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:37.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.846+0000 7f4a40d26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:37.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.846+0000 7f4a40d26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:37.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.879+0000 7f48f27e4640 20 reqs_thread_entry: start 2024-09-12T17:35:37.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.879+0000 7f4a40d26800 20 init_complete bucket index max shards: 1 2024-09-12T17:35:37.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.879+0000 7f4a40d26800 20 Filter name: none 2024-09-12T17:35:37.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.879+0000 7f48ebfff640 20 reqs_thread_entry: start 2024-09-12T17:35:37.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.879+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:35:37.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.881+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.881+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.882+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.883+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:35:37.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.884+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.885+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.885+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.886+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:35:37.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.887+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.888+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.888+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.889+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:35:37.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.890+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.891+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.891+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.892+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:35:37.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.893+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.893+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.894+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.894+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:35:37.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.896+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.896+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.897+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.898+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:35:37.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.899+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.899+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.899+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.900+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:35:37.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.901+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.902+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.902+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.903+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:35:37.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.904+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.905+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.905+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.906+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:35:37.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.907+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.908+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.908+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.909+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:35:37.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.910+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.911+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.911+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.912+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:35:37.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.913+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.914+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.914+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.915+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:35:37.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.916+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.916+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.917+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.917+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:35:37.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.919+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.919+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.919+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.920+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:35:37.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.921+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.922+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.922+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.923+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:35:37.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.924+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.925+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.925+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.926+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:35:37.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.928+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.929+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.929+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.930+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:35:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.931+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.932+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.932+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.933+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:35:37.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.934+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.935+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.935+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.936+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:35:37.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.937+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.938+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.938+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.939+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:35:37.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.940+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.941+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.941+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.942+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:35:37.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.943+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.944+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.944+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.945+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:35:37.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.947+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.947+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.947+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.948+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:35:37.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.950+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.950+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.950+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.952+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:35:37.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.953+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.954+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.954+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.955+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:35:37.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.956+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.956+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.957+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.958+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:35:37.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.959+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.960+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.960+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.961+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:35:37.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.963+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.963+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.963+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.964+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:35:37.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.965+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.966+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.966+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.967+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:35:37.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.969+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.969+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.970+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.971+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:35:37.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.972+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.973+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.973+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.974+0000 7f4a40d26800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:35:37.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.975+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.976+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:37.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.976+0000 7f4a40d26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:37.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.978+0000 7f48f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:37.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.980+0000 7f4a40d26800 20 remove_watcher() i=0 2024-09-12T17:35:37.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.980+0000 7f4a40d26800 2 removed watcher, disabling cache 2024-09-12T17:35:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.981+0000 7f4a40d26800 20 remove_watcher() i=1 2024-09-12T17:35:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.982+0000 7f4a40d26800 20 remove_watcher() i=2 2024-09-12T17:35:37.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.983+0000 7f4a40d26800 20 remove_watcher() i=3 2024-09-12T17:35:37.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.984+0000 7f4a40d26800 20 remove_watcher() i=4 2024-09-12T17:35:37.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.985+0000 7f4a40d26800 20 remove_watcher() i=5 2024-09-12T17:35:37.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.986+0000 7f4a40d26800 20 remove_watcher() i=6 2024-09-12T17:35:37.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:37.987+0000 7f4a40d26800 20 remove_watcher() i=7 2024-09-12T17:35:37.999 DEBUG:teuthology.orchestra.run.smithi067:> radosgw-admin gc process --include-all 2024-09-12T17:35:38.053 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:38.053 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:38.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.091+0000 7f9b88f24800 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.093+0000 7f9b88f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.093+0000 7f9b88f24800 20 realm 2024-09-12T17:35:38.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.093+0000 7f9b88f24800 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.093+0000 7f9b88f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.093+0000 7f9b88f24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:38.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.093+0000 7f9b88f24800 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.093+0000 7f9b88f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.093+0000 7f9b88f24800 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.094+0000 7f9b88f24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:38.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.094+0000 7f9b88f24800 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.095+0000 7f9b88f24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:38.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.095+0000 7f9b88f24800 20 searching for the correct realm 2024-09-12T17:35:38.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.098+0000 7f9b85357640 0 -- 172.21.15.67:0/2329648677 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x55bf873be6d0 msgr2=0x55bf873c0ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:38.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.101+0000 7f9b84b56640 0 -- 172.21.15.67:0/2329648677 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f9b70075400 msgr2=0x7f9b70075880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:38.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.105+0000 7f9b88f24800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:35:38.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.105+0000 7f9b88f24800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:35:38.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.105+0000 7f9b88f24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:38.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.105+0000 7f9b88f24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:38.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.105+0000 7f9b88f24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:38.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.105+0000 7f9b88f24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:38.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.105+0000 7f9b88f24800 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.105+0000 7f9b88f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.105+0000 7f9b88f24800 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.105+0000 7f9b88f24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:38.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.105+0000 7f9b88f24800 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.106+0000 7f9b88f24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:38.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.106+0000 7f9b88f24800 20 zone default found 2024-09-12T17:35:38.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.106+0000 7f9b88f24800 4 Realm: () 2024-09-12T17:35:38.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.106+0000 7f9b88f24800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:35:38.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.106+0000 7f9b88f24800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:35:38.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.106+0000 7f9b88f24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:38.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.106+0000 7f9b88f24800 20 zonegroup default 2024-09-12T17:35:38.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.106+0000 7f9b88f24800 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.106+0000 7f9b88f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.106+0000 7f9b88f24800 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.106+0000 7f9b88f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.106+0000 7f9b88f24800 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.106+0000 7f9b88f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.106+0000 7f9b88f24800 20 started sync module instance, tier type = 2024-09-12T17:35:38.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.106+0000 7f9b88f24800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:35:38.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.115+0000 7f9b88f24800 20 add_watcher() i=0 2024-09-12T17:35:38.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.115+0000 7f9b88f24800 20 add_watcher() i=1 2024-09-12T17:35:38.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.115+0000 7f9b88f24800 20 add_watcher() i=2 2024-09-12T17:35:38.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.115+0000 7f9b88f24800 20 add_watcher() i=3 2024-09-12T17:35:38.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.115+0000 7f9b88f24800 20 add_watcher() i=4 2024-09-12T17:35:38.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.115+0000 7f9b88f24800 20 add_watcher() i=5 2024-09-12T17:35:38.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.115+0000 7f9b88f24800 20 add_watcher() i=6 2024-09-12T17:35:38.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.116+0000 7f9b88f24800 20 add_watcher() i=7 2024-09-12T17:35:38.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.116+0000 7f9b88f24800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:38.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.117+0000 7f9a3afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:38.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.118+0000 7f9b88f24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:38.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.118+0000 7f9b88f24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:38.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.151+0000 7f9a39fe3640 20 reqs_thread_entry: start 2024-09-12T17:35:38.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.151+0000 7f9b88f24800 20 init_complete bucket index max shards: 1 2024-09-12T17:35:38.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.151+0000 7f9b88f24800 20 Filter name: none 2024-09-12T17:35:38.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.151+0000 7f99ab7fe640 20 reqs_thread_entry: start 2024-09-12T17:35:38.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.151+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:35:38.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.152+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.153+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.153+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.154+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:35:38.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.155+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.156+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.156+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.157+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:35:38.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.158+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.159+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.159+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.160+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:35:38.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.162+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.162+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.162+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.163+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:35:38.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.164+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.165+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.165+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.166+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:35:38.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.168+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.168+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.169+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.170+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:35:38.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.171+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.172+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.172+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.173+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:35:38.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.174+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.175+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.175+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.176+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:35:38.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.177+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.178+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.178+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.179+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:35:38.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.180+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.181+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.181+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.182+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:35:38.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.183+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.184+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.184+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.185+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:35:38.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.186+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.187+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.187+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.188+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:35:38.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.189+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.189+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.190+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.191+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:35:38.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.192+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.192+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.192+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.193+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:35:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.195+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.195+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.195+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.196+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:35:38.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.197+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.198+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.198+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.199+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:35:38.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.200+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.201+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.201+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.202+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:35:38.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.204+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.204+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.204+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.205+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:35:38.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.207+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.207+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.207+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.208+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:35:38.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.210+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.210+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.210+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.211+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:35:38.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.213+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.213+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.213+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.214+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:35:38.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.216+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.216+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.216+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.217+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:35:38.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.218+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.219+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.219+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.220+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:35:38.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.221+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.222+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.222+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.223+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:35:38.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.224+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.225+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.225+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.226+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:35:38.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.227+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.227+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.228+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.228+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:35:38.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.230+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.230+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.230+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.231+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:35:38.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.233+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.233+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.233+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.234+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:35:38.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.236+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.236+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.237+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.238+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:35:38.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.239+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.240+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.240+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.241+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:35:38.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.242+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.243+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.243+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.244+0000 7f9b88f24800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:35:38.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.245+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.246+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.246+0000 7f9b88f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.249+0000 7f9a3afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:38.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.251+0000 7f9b88f24800 20 remove_watcher() i=0 2024-09-12T17:35:38.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.251+0000 7f9b88f24800 2 removed watcher, disabling cache 2024-09-12T17:35:38.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.252+0000 7f9b88f24800 20 remove_watcher() i=1 2024-09-12T17:35:38.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.253+0000 7f9b88f24800 20 remove_watcher() i=2 2024-09-12T17:35:38.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.254+0000 7f9b88f24800 20 remove_watcher() i=3 2024-09-12T17:35:38.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.255+0000 7f9b88f24800 20 remove_watcher() i=4 2024-09-12T17:35:38.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.256+0000 7f9b88f24800 20 remove_watcher() i=5 2024-09-12T17:35:38.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.256+0000 7f9b88f24800 20 remove_watcher() i=6 2024-09-12T17:35:38.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.257+0000 7f9b88f24800 20 remove_watcher() i=7 2024-09-12T17:35:38.270 DEBUG:teuthology.orchestra.run.smithi067:> radosgw-admin gc process --include-all 2024-09-12T17:35:38.323 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:38.323 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:38.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.362+0000 7fe852b40800 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.363+0000 7fe852b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.363+0000 7fe852b40800 20 realm 2024-09-12T17:35:38.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.363+0000 7fe852b40800 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.363+0000 7fe852b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.363+0000 7fe852b40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:38.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.363+0000 7fe852b40800 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.363+0000 7fe852b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.363+0000 7fe852b40800 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.364+0000 7fe852b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:38.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.364+0000 7fe852b40800 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.365+0000 7fe852b40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:38.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.365+0000 7fe852b40800 20 searching for the correct realm 2024-09-12T17:35:38.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.367+0000 7fe84e8c0640 0 -- 172.21.15.67:0/3065349972 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7fe848061040 msgr2=0x7fe848055920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:38.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.371+0000 7fe84e8c0640 0 -- 172.21.15.67:0/3065349972 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fe844052c00 msgr2=0x7fe84405f970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:38.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.577+0000 7fe852b40800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:35:38.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.577+0000 7fe852b40800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:35:38.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.577+0000 7fe852b40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:38.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.577+0000 7fe852b40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:38.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.577+0000 7fe852b40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:38.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.577+0000 7fe852b40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:38.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.577+0000 7fe852b40800 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.577+0000 7fe852b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.577+0000 7fe852b40800 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.578+0000 7fe852b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:38.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.578+0000 7fe852b40800 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.578+0000 7fe852b40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:38.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.578+0000 7fe852b40800 20 zone default found 2024-09-12T17:35:38.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.578+0000 7fe852b40800 4 Realm: () 2024-09-12T17:35:38.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.578+0000 7fe852b40800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:35:38.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.578+0000 7fe852b40800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:35:38.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.578+0000 7fe852b40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:38.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.578+0000 7fe852b40800 20 zonegroup default 2024-09-12T17:35:38.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.578+0000 7fe852b40800 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.578+0000 7fe852b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.578+0000 7fe852b40800 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.579+0000 7fe852b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.579+0000 7fe852b40800 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.579+0000 7fe852b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.579+0000 7fe852b40800 20 started sync module instance, tier type = 2024-09-12T17:35:38.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.579+0000 7fe852b40800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:35:38.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.588+0000 7fe852b40800 20 add_watcher() i=0 2024-09-12T17:35:38.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.588+0000 7fe852b40800 20 add_watcher() i=1 2024-09-12T17:35:38.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.588+0000 7fe852b40800 20 add_watcher() i=2 2024-09-12T17:35:38.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.588+0000 7fe852b40800 20 add_watcher() i=3 2024-09-12T17:35:38.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.588+0000 7fe852b40800 20 add_watcher() i=4 2024-09-12T17:35:38.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.588+0000 7fe852b40800 20 add_watcher() i=5 2024-09-12T17:35:38.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.588+0000 7fe852b40800 20 add_watcher() i=6 2024-09-12T17:35:38.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.589+0000 7fe852b40800 20 add_watcher() i=7 2024-09-12T17:35:38.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.589+0000 7fe852b40800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:38.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.591+0000 7fe7057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:38.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.591+0000 7fe852b40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:38.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.591+0000 7fe852b40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:38.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.626+0000 7fe67ffff640 20 reqs_thread_entry: start 2024-09-12T17:35:38.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.626+0000 7fe852b40800 20 init_complete bucket index max shards: 1 2024-09-12T17:35:38.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.626+0000 7fe852b40800 20 Filter name: none 2024-09-12T17:35:38.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.626+0000 7fe67dffb640 20 reqs_thread_entry: start 2024-09-12T17:35:38.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.626+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:35:38.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.627+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.628+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.628+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.629+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:35:38.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.631+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.631+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.631+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.632+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:35:38.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.633+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.634+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.634+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.635+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:35:38.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.636+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.637+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.637+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.638+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:35:38.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.639+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.640+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.640+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.641+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:35:38.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.643+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.643+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.644+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.645+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:35:38.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.646+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.646+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.647+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.648+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:35:38.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.649+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.649+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.650+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.651+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:35:38.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.652+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.652+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.653+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.654+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:35:38.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.655+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.656+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.656+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.657+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:35:38.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.658+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.659+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.659+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.660+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:35:38.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.662+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.662+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.662+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.663+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:35:38.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.665+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.665+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.665+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.666+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:35:38.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.668+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.668+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.668+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.669+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:35:38.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.671+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.671+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.671+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.672+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:35:38.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.673+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.674+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.674+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.675+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:35:38.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.676+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.677+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.677+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.678+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:35:38.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.679+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.680+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.680+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.681+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:35:38.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.682+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.683+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.683+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.684+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:35:38.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.685+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.686+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.686+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.687+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:35:38.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.688+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.689+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.689+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.690+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:35:38.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.691+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.691+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.692+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.693+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:35:38.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.694+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.694+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.695+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.696+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:35:38.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.697+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.697+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.698+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.699+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:35:38.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.700+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.700+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.701+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.702+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:35:38.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.703+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.703+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.704+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.704+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:35:38.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.706+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.706+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.706+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.707+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:35:38.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.709+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.709+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.710+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.711+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:35:38.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.712+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.712+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.713+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.714+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:35:38.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.715+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.716+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.716+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.717+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:35:38.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.718+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.719+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.719+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.720+0000 7fe852b40800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:35:38.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.722+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.722+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:35:38.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.722+0000 7fe852b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:35:38.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.724+0000 7fe7057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:38.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.726+0000 7fe852b40800 20 remove_watcher() i=0 2024-09-12T17:35:38.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.726+0000 7fe852b40800 2 removed watcher, disabling cache 2024-09-12T17:35:38.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.727+0000 7fe852b40800 20 remove_watcher() i=1 2024-09-12T17:35:38.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.728+0000 7fe852b40800 20 remove_watcher() i=2 2024-09-12T17:35:38.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.729+0000 7fe852b40800 20 remove_watcher() i=3 2024-09-12T17:35:38.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.730+0000 7fe852b40800 20 remove_watcher() i=4 2024-09-12T17:35:38.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.731+0000 7fe852b40800 20 remove_watcher() i=5 2024-09-12T17:35:38.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.732+0000 7fe852b40800 20 remove_watcher() i=6 2024-09-12T17:35:38.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:35:38.733+0000 7fe852b40800 20 remove_watcher() i=7 2024-09-12T17:35:38.745 DEBUG:teuthology.orchestra.run.smithi067:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-12T17:35:39.250 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :clean 2024-09-12T17:35:40.146 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :compileJava 2024-09-12T17:35:40.146 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :processResources 2024-09-12T17:35:40.146 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :classes 2024-09-12T17:35:40.645 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:40.646 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :compileTestJava 2024-09-12T17:35:40.646 INFO:teuthology.orchestra.run.smithi067.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T17:35:40.646 INFO:teuthology.orchestra.run.smithi067.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T17:35:40.647 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:40.647 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T17:35:40.647 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :testClasses 2024-09-12T17:35:42.646 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:42.647 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :test 2024-09-12T17:35:42.647 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:42.647 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests STANDARD_OUT 2024-09-12T17:35:42.647 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12 17:35:41,910 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T17:35:42.647 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:42.647 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-12T17:35:42.647 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:42.647 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-12T17:35:42.846 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:42.846 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-12T17:35:42.945 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:42.945 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-12T17:35:43.245 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:43.347 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-12T17:35:43.348 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:43.348 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-12T17:35:43.645 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:43.645 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-12T17:35:48.646 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:48.646 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-12T17:35:48.845 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:48.846 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-12T17:35:48.946 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:48.947 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-12T17:35:49.246 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:49.246 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-12T17:35:49.446 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:49.446 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-12T17:35:49.749 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:49.749 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-12T17:35:49.749 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:49.749 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-12T17:35:49.845 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:49.845 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-12T17:35:49.945 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:49.946 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-12T17:35:50.145 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:50.145 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-12T17:35:55.646 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:55.646 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-12T17:35:55.945 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:55.945 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-12T17:35:56.045 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:56.045 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-12T17:35:56.445 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:56.446 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-12T17:35:56.545 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:56.545 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-12T17:35:56.845 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:56.845 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-12T17:35:56.945 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:56.946 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-12T17:35:57.145 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:57.145 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-12T17:35:57.245 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:57.245 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-12T17:35:57.545 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:57.545 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-12T17:35:57.645 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:57.645 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-12T17:35:57.946 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:57.946 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-12T17:35:58.046 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:58.046 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-12T17:35:58.246 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:58.246 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-12T17:35:58.445 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:58.446 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-12T17:35:58.745 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:35:58.746 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-12T17:36:13.246 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:36:13.246 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-12T17:36:13.745 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:36:13.745 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-12T17:36:48.746 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:36:48.746 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-12T17:36:49.246 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:36:49.246 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-12T17:36:49.246 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:36:49.246 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-12T17:36:49.545 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:36:49.545 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-12T17:36:49.645 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:36:49.646 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-12T17:36:50.045 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:36:50.045 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-12T17:37:04.447 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:37:04.447 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-12T17:37:04.745 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:37:04.746 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-12T17:37:04.846 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:37:04.846 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-12T17:37:04.945 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:37:04.945 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-12T17:37:12.645 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:37:12.646 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-12T17:37:14.045 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:37:14.046 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests STANDARD_OUT 2024-09-12T17:37:14.046 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12 17:37:14,020 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T17:37:14.445 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:37:14.445 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T17:37:24.846 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:37:24.846 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T17:37:25.245 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:37:25.245 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-12T17:37:30.045 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:37:30.046 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-12T17:37:30.345 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:37:30.345 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-12T17:38:00.846 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:00.847 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-12T17:38:01.146 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:01.146 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-12T17:38:09.446 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:09.446 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-12T17:38:09.745 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:09.746 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-12T17:38:15.245 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:15.246 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-12T17:38:15.549 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:15.549 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-12T17:38:17.445 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:17.446 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-12T17:38:22.045 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:22.046 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-12T17:38:22.245 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:22.245 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-12T17:38:22.745 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:22.745 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-12T17:38:22.846 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:22.846 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-12T17:38:23.145 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:23.145 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-12T17:38:23.245 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:23.246 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-12T17:38:23.545 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:23.546 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-12T17:38:23.645 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:23.646 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-12T17:38:23.945 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:23.946 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-12T17:38:23.946 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:23.946 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-12T17:38:24.245 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:24.245 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-12T17:38:24.345 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:24.345 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-12T17:38:24.645 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:24.645 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-12T17:38:24.745 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:24.746 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-12T17:38:25.045 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:25.046 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-12T17:38:25.245 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:25.245 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-12T17:38:25.645 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:25.645 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-12T17:38:25.845 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:25.845 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-12T17:38:26.245 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:26.245 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-12T17:38:26.445 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:26.445 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-12T17:38:26.845 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:26.845 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-12T17:38:27.045 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:27.045 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-12T17:38:27.445 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:27.446 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-12T17:38:27.645 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:27.645 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-12T17:38:28.048 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:28.048 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-12T17:38:28.245 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:28.246 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-12T17:38:28.645 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:28.645 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-12T17:38:28.845 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:28.845 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-12T17:38:29.245 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:29.245 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-12T17:38:29.445 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:29.445 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-12T17:38:29.845 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:29.845 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-12T17:38:30.045 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:30.046 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-12T17:38:30.445 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:30.446 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-12T17:38:30.645 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:30.645 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-12T17:38:30.945 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:30.945 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-12T17:38:31.245 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:31.246 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-12T17:38:31.545 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:31.545 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-12T17:38:31.745 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:31.746 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-12T17:38:32.145 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:32.145 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-12T17:38:32.345 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:32.346 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-12T17:38:32.645 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:32.645 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-12T17:38:32.845 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:32.845 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-12T17:38:33.245 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:33.245 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-12T17:38:33.445 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:33.445 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-12T17:38:33.845 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:33.845 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-12T17:38:34.045 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:34.045 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-12T17:38:34.445 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:34.445 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-12T17:38:34.645 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:34.645 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-12T17:38:35.045 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:35.045 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-12T17:38:35.245 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:35.246 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-12T17:38:35.645 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:35.646 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-12T17:38:35.845 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:35.845 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-12T17:38:36.145 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:36.145 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-12T17:38:36.345 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:36.345 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-12T17:38:36.745 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:36.745 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-12T17:38:36.945 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:36.945 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-12T17:38:37.245 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:37.245 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-12T17:38:37.445 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:37.445 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-12T17:38:37.745 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:37.745 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-12T17:38:37.845 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:37.845 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-12T17:38:38.145 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:38.145 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-12T17:38:38.245 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:38.246 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-12T17:38:38.545 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:38.546 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-12T17:38:38.645 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:38.645 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-12T17:38:38.945 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:38.946 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-12T17:38:39.045 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:39.046 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-12T17:38:39.345 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:39.345 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-12T17:38:39.645 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:39.645 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-12T17:38:39.945 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:39.946 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-12T17:38:39.946 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:39.946 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-12T17:38:40.045 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:40.045 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-12T17:38:40.145 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:40.145 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-12T17:38:40.445 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:40.445 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-12T17:38:40.645 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:40.645 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-12T17:38:40.945 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:40.945 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-12T17:38:41.045 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:41.045 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-12T17:38:41.345 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:41.346 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-12T17:38:41.445 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:41.445 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-12T17:38:41.745 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:41.746 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-12T17:38:46.946 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:46.946 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-12T17:38:47.245 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:38:47.301 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-12T17:39:01.645 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:39:01.646 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-12T17:39:02.030 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:39:02.030 INFO:teuthology.orchestra.run.smithi067.stdout:---------------------------------------------------------------------- 2024-09-12T17:39:02.030 INFO:teuthology.orchestra.run.smithi067.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-12T17:39:02.030 INFO:teuthology.orchestra.run.smithi067.stdout:---------------------------------------------------------------------- 2024-09-12T17:39:02.030 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:39:02.030 INFO:teuthology.orchestra.run.smithi067.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T17:39:02.030 INFO:teuthology.orchestra.run.smithi067.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T17:39:02.030 INFO:teuthology.orchestra.run.smithi067.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T17:39:02.031 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:39:02.031 INFO:teuthology.orchestra.run.smithi067.stdout:BUILD SUCCESSFUL in 3m 23s 2024-09-12T17:39:02.031 INFO:teuthology.orchestra.run.smithi067.stdout:5 actionable tasks: 5 executed 2024-09-12T17:39:02.045 DEBUG:teuthology.orchestra.run.smithi067:> radosgw-admin gc process --include-all 2024-09-12T17:39:02.099 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:02.099 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:02.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.137+0000 7f0c4872e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:02.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.138+0000 7f0c4872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:02.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.138+0000 7f0c4872e800 20 realm 2024-09-12T17:39:02.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.138+0000 7f0c4872e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:02.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.138+0000 7f0c4872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:02.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.138+0000 7f0c4872e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:02.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.139+0000 7f0c4872e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:02.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.139+0000 7f0c4872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:02.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.139+0000 7f0c4872e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:02.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.140+0000 7f0c4872e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:02.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.140+0000 7f0c4872e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:02.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.140+0000 7f0c4872e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:02.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.140+0000 7f0c4872e800 20 searching for the correct realm 2024-09-12T17:39:02.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.143+0000 7f0c444dd640 0 -- 172.21.15.67:0/1948254915 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f0c3c0861d0 msgr2=0x7f0c3c05f610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:02.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.147+0000 7f0c444dd640 0 -- 172.21.15.67:0/1948254915 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f0c38025070 msgr2=0x7f0c3804f990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.152+0000 7f0c4872e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:39:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.152+0000 7f0c4872e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:39:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.152+0000 7f0c4872e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.152+0000 7f0c4872e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.152+0000 7f0c4872e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.152+0000 7f0c4872e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.152+0000 7f0c4872e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.152+0000 7f0c4872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.152+0000 7f0c4872e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:02.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.152+0000 7f0c4872e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:02.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.152+0000 7f0c4872e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:02.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.152+0000 7f0c4872e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.153+0000 7f0c4872e800 20 zone default found 2024-09-12T17:39:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.153+0000 7f0c4872e800 4 Realm: () 2024-09-12T17:39:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.153+0000 7f0c4872e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:39:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.153+0000 7f0c4872e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:39:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.153+0000 7f0c4872e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.153+0000 7f0c4872e800 20 zonegroup default 2024-09-12T17:39:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.153+0000 7f0c4872e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.153+0000 7f0c4872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.153+0000 7f0c4872e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.153+0000 7f0c4872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.153+0000 7f0c4872e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.153+0000 7f0c4872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:02.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.153+0000 7f0c4872e800 20 started sync module instance, tier type = 2024-09-12T17:39:02.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.153+0000 7f0c4872e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:39:02.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.163+0000 7f0c4872e800 20 add_watcher() i=0 2024-09-12T17:39:02.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.163+0000 7f0c4872e800 20 add_watcher() i=1 2024-09-12T17:39:02.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.163+0000 7f0c4872e800 20 add_watcher() i=2 2024-09-12T17:39:02.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.163+0000 7f0c4872e800 20 add_watcher() i=3 2024-09-12T17:39:02.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.163+0000 7f0c4872e800 20 add_watcher() i=4 2024-09-12T17:39:02.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.163+0000 7f0c4872e800 20 add_watcher() i=5 2024-09-12T17:39:02.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.163+0000 7f0c4872e800 20 add_watcher() i=6 2024-09-12T17:39:02.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.164+0000 7f0c4872e800 20 add_watcher() i=7 2024-09-12T17:39:02.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.164+0000 7f0c4872e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:02.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.165+0000 7f0afafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:02.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.166+0000 7f0c4872e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:02.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.166+0000 7f0c4872e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:02.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.205+0000 7f0af9fdb640 20 reqs_thread_entry: start 2024-09-12T17:39:02.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.205+0000 7f0c4872e800 20 init_complete bucket index max shards: 1 2024-09-12T17:39:02.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.205+0000 7f0c4872e800 20 Filter name: none 2024-09-12T17:39:02.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.205+0000 7f0a6b7fe640 20 reqs_thread_entry: start 2024-09-12T17:39:02.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.205+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:39:02.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.207+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.208+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.208+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T17:39:02.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.208+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1949950071810087457', time=2024-09-12T19:35:56.167086+0000, chain.objs.size()=1 2024-09-12T17:39:02.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.208+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.85__shadow_._bvr8p6YZMBwjwRutQo17SpxuKbtASJ_0 2024-09-12T17:39:02.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.208+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='2~JqhqZ8faICDvubjQCe3KXsOZ-0aNsuM', time=2024-09-12T19:37:30.182332+0000, chain.objs.size()=9 2024-09-12T17:39:02.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.208+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.102__multipart_key1.2~JqhqZ8faICDvubjQCe3KXsOZ-0aNsuM.7 2024-09-12T17:39:02.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.208+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.102__shadow_key1.2~JqhqZ8faICDvubjQCe3KXsOZ-0aNsuM.7_1 2024-09-12T17:39:02.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.208+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.102__multipart_key1.2~JqhqZ8faICDvubjQCe3KXsOZ-0aNsuM.8 2024-09-12T17:39:02.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.208+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.102__shadow_key1.2~JqhqZ8faICDvubjQCe3KXsOZ-0aNsuM.8_1 2024-09-12T17:39:02.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.208+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.102__multipart_key1.2~JqhqZ8faICDvubjQCe3KXsOZ-0aNsuM.9 2024-09-12T17:39:02.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.208+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.102__shadow_key1.2~JqhqZ8faICDvubjQCe3KXsOZ-0aNsuM.9_1 2024-09-12T17:39:02.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.208+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.102__multipart_key1.2~JqhqZ8faICDvubjQCe3KXsOZ-0aNsuM.10 2024-09-12T17:39:02.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.208+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.102__shadow_key1.2~JqhqZ8faICDvubjQCe3KXsOZ-0aNsuM.10_1 2024-09-12T17:39:02.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.208+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.102__multipart_key1.2~JqhqZ8faICDvubjQCe3KXsOZ-0aNsuM.11 2024-09-12T17:39:02.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.208+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7450771041533710183', time=2024-09-12T19:37:50.632536+0000, chain.objs.size()=9 2024-09-12T17:39:02.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.208+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__multipart_key1.2~3Q9VppLPT6AGk_XEbzJ-2yp6Ou6gBlM.1 2024-09-12T17:39:02.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.209+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__shadow_key1.2~3Q9VppLPT6AGk_XEbzJ-2yp6Ou6gBlM.1_1 2024-09-12T17:39:02.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.211+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__multipart_key1.2~3Q9VppLPT6AGk_XEbzJ-2yp6Ou6gBlM.2 2024-09-12T17:39:02.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.211+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__shadow_key1.2~3Q9VppLPT6AGk_XEbzJ-2yp6Ou6gBlM.2_1 2024-09-12T17:39:02.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.211+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__multipart_key1.2~3Q9VppLPT6AGk_XEbzJ-2yp6Ou6gBlM.3 2024-09-12T17:39:02.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.211+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__shadow_key1.2~3Q9VppLPT6AGk_XEbzJ-2yp6Ou6gBlM.3_1 2024-09-12T17:39:02.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.211+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__multipart_key1.2~3Q9VppLPT6AGk_XEbzJ-2yp6Ou6gBlM.4 2024-09-12T17:39:02.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.211+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__shadow_key1.2~3Q9VppLPT6AGk_XEbzJ-2yp6Ou6gBlM.4_1 2024-09-12T17:39:02.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.212+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__multipart_key1.2~3Q9VppLPT6AGk_XEbzJ-2yp6Ou6gBlM.5 2024-09-12T17:39:02.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.212+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9936014051372854297', time=2024-09-12T19:38:00.688157+0000, chain.objs.size()=7 2024-09-12T17:39:02.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.212+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__multipart_key1.2~3xxBQA3TZfg5C39405GM92RTyk34UFG.1 2024-09-12T17:39:02.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.212+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__shadow_key1.2~3xxBQA3TZfg5C39405GM92RTyk34UFG.1_1 2024-09-12T17:39:02.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.212+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__shadow_key1.2~3xxBQA3TZfg5C39405GM92RTyk34UFG.1_2 2024-09-12T17:39:02.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.212+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__multipart_key1.2~3xxBQA3TZfg5C39405GM92RTyk34UFG.2 2024-09-12T17:39:02.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.213+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__shadow_key1.2~3xxBQA3TZfg5C39405GM92RTyk34UFG.2_1 2024-09-12T17:39:02.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.215+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__shadow_key1.2~3xxBQA3TZfg5C39405GM92RTyk34UFG.2_2 2024-09-12T17:39:02.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.215+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__multipart_key1.2~3xxBQA3TZfg5C39405GM92RTyk34UFG.3 2024-09-12T17:39:02.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.215+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6776198933641195961', time=2024-09-12T19:38:33.625006+0000, chain.objs.size()=1 2024-09-12T17:39:02.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.215+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.127__shadow_.oEWLMz_hz8sp1M28-HweSf60M2idiPs_0 2024-09-12T17:39:02.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.218+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.220+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:39:02.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.222+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.222+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.222+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:39:02.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.222+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15848206149122493047', time=2024-09-12T19:38:27.189372+0000, chain.objs.size()=1 2024-09-12T17:39:02.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.222+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.116__shadow_.DyxUUoF2AYbiB6-KNqZVxmCzsKXAtch_0 2024-09-12T17:39:02.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.222+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1969377338021824798', time=2024-09-12T19:38:27.788658+0000, chain.objs.size()=1 2024-09-12T17:39:02.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.222+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.117__shadow_.y2IEt16lb33-WMFdCdxKm-WV1FtbeFp_0 2024-09-12T17:39:02.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.222+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9572985976067420465', time=2024-09-12T19:38:32.990836+0000, chain.objs.size()=1 2024-09-12T17:39:02.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.222+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.126__shadow_.bkZ4rjzWT1qu9fjceHvQJnLYNRmG-Ku_0 2024-09-12T17:39:02.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.224+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.226+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:39:02.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.227+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.228+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.228+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:39:02.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.228+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13679820352134059968', time=2024-09-12T19:35:55.723025+0000, chain.objs.size()=3 2024-09-12T17:39:02.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.228+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.84__shadow_.fOFS_W6w0Q4c9DTxZiVOMMZjv3kclSV_0 2024-09-12T17:39:02.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.228+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.84__shadow_.fOFS_W6w0Q4c9DTxZiVOMMZjv3kclSV_1 2024-09-12T17:39:02.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.228+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.84__shadow_.fOFS_W6w0Q4c9DTxZiVOMMZjv3kclSV_2 2024-09-12T17:39:02.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.228+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18328493271233408455', time=2024-09-12T19:38:29.556786+0000, chain.objs.size()=1 2024-09-12T17:39:02.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.228+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.120__shadow_.eUylAktBdMN8t4kz7CkxqTQU-wb4y3L_0 2024-09-12T17:39:02.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.230+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.232+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:39:02.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.234+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.234+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.235+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:39:02.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.235+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12919928564491220541', time=2024-09-12T19:37:25.004639+0000, chain.objs.size()=1 2024-09-12T17:39:02.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.235+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.101__shadow_.gIlfySKi02rE7BJXN6F7FK-iR0jBcx8_0 2024-09-12T17:39:02.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.235+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10472279665372123667', time=2024-09-12T19:38:30.122611+0000, chain.objs.size()=1 2024-09-12T17:39:02.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.235+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.121__shadow_.HvTfuGDeiFRszdrWIhRAIXhews6GgCC_0 2024-09-12T17:39:02.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.235+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7125373051875878634', time=2024-09-12T19:38:46.978168+0000, chain.objs.size()=9 2024-09-12T17:39:02.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.235+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.144__multipart_key1.2~PcgySdJRkNqEzD2_Fut4exKSQVGAOHK.1 2024-09-12T17:39:02.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.235+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.144__shadow_key1.2~PcgySdJRkNqEzD2_Fut4exKSQVGAOHK.1_1 2024-09-12T17:39:02.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.235+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.144__multipart_key1.2~PcgySdJRkNqEzD2_Fut4exKSQVGAOHK.2 2024-09-12T17:39:02.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.235+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.144__shadow_key1.2~PcgySdJRkNqEzD2_Fut4exKSQVGAOHK.2_1 2024-09-12T17:39:02.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.235+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.144__multipart_key1.2~PcgySdJRkNqEzD2_Fut4exKSQVGAOHK.3 2024-09-12T17:39:02.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.235+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.144__shadow_key1.2~PcgySdJRkNqEzD2_Fut4exKSQVGAOHK.3_1 2024-09-12T17:39:02.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.235+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.144__multipart_key1.2~PcgySdJRkNqEzD2_Fut4exKSQVGAOHK.4 2024-09-12T17:39:02.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.235+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.144__shadow_key1.2~PcgySdJRkNqEzD2_Fut4exKSQVGAOHK.4_1 2024-09-12T17:39:02.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.235+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.144__multipart_key1.2~PcgySdJRkNqEzD2_Fut4exKSQVGAOHK.5 2024-09-12T17:39:02.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.235+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9269617054647809208', time=2024-09-12T19:39:01.800652+0000, chain.objs.size()=1 2024-09-12T17:39:02.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.235+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.145__shadow_.iKXN-cO5e4lRL-oZZaqUI9CnIM_1tQV_0 2024-09-12T17:39:02.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.238+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.241+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:39:02.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.242+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.242+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.243+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T17:39:02.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.243+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5896371580023954723', time=2024-09-12T19:36:48.590411+0000, chain.objs.size()=7 2024-09-12T17:39:02.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.243+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__multipart_key1.2~PgnvRdiWHRLKO4PDfjPb41VJi5vHB3x.1 2024-09-12T17:39:02.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.243+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__shadow_key1.2~PgnvRdiWHRLKO4PDfjPb41VJi5vHB3x.1_1 2024-09-12T17:39:02.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.243+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__shadow_key1.2~PgnvRdiWHRLKO4PDfjPb41VJi5vHB3x.1_2 2024-09-12T17:39:02.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.243+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__multipart_key1.2~PgnvRdiWHRLKO4PDfjPb41VJi5vHB3x.2 2024-09-12T17:39:02.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.243+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__shadow_key1.2~PgnvRdiWHRLKO4PDfjPb41VJi5vHB3x.2_1 2024-09-12T17:39:02.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.243+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__shadow_key1.2~PgnvRdiWHRLKO4PDfjPb41VJi5vHB3x.2_2 2024-09-12T17:39:02.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.243+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__multipart_key1.2~PgnvRdiWHRLKO4PDfjPb41VJi5vHB3x.3 2024-09-12T17:39:02.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.243+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8779998865666323741', time=2024-09-12T19:37:24.977129+0000, chain.objs.size()=1 2024-09-12T17:39:02.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.243+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.101__shadow_.p6zRPnAltSev3lI8OIDUHAxcnyxQ9fE_0 2024-09-12T17:39:02.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.243+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6380833188769876822', time=2024-09-12T19:38:28.305697+0000, chain.objs.size()=1 2024-09-12T17:39:02.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.243+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.118__shadow_.lsi7nDPk0bIui0s8psPipWnhBxUlN_y_0 2024-09-12T17:39:02.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.243+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6161481522435769488', time=2024-09-12T19:38:33.597443+0000, chain.objs.size()=1 2024-09-12T17:39:02.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.243+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.127__shadow_.O7ZrTpAXxgNze2cEuq2WY2XgP7R7mnC_0 2024-09-12T17:39:02.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.243+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2642117078267713216', time=2024-09-12T19:38:35.402260+0000, chain.objs.size()=1 2024-09-12T17:39:02.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.243+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.130__shadow_.ZNXb9JeO2eZBa5-N54-HTxgxnvqEB2l_0 2024-09-12T17:39:02.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.243+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15362774074184307565', time=2024-09-12T19:38:35.936357+0000, chain.objs.size()=1 2024-09-12T17:39:02.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.243+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.131__shadow_.DiBvBvf6LSpjoMlK0noGxVg91PYoV4P_0 2024-09-12T17:39:02.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.246+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.249+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:39:02.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.250+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.250+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.250+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:39:02.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.250+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1709549353364537705', time=2024-09-12T19:38:09.467051+0000, chain.objs.size()=9 2024-09-12T17:39:02.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.250+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.104__multipart_key1.2~FGrMcM1MCsP73uXN4o7vG5N-8v6Jesj.1 2024-09-12T17:39:02.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.251+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.104__shadow_key1.2~FGrMcM1MCsP73uXN4o7vG5N-8v6Jesj.1_1 2024-09-12T17:39:02.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.251+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.104__multipart_key1.2~FGrMcM1MCsP73uXN4o7vG5N-8v6Jesj.2 2024-09-12T17:39:02.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.251+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.104__shadow_key1.2~FGrMcM1MCsP73uXN4o7vG5N-8v6Jesj.2_1 2024-09-12T17:39:02.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.251+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.104__multipart_key1.2~FGrMcM1MCsP73uXN4o7vG5N-8v6Jesj.3 2024-09-12T17:39:02.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.251+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.104__shadow_key1.2~FGrMcM1MCsP73uXN4o7vG5N-8v6Jesj.3_1 2024-09-12T17:39:02.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.251+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.104__multipart_key1.2~FGrMcM1MCsP73uXN4o7vG5N-8v6Jesj.4 2024-09-12T17:39:02.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.251+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.104__shadow_key1.2~FGrMcM1MCsP73uXN4o7vG5N-8v6Jesj.4_1 2024-09-12T17:39:02.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.251+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.104__multipart_key1.2~FGrMcM1MCsP73uXN4o7vG5N-8v6Jesj.5 2024-09-12T17:39:02.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.251+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12030909436484485045', time=2024-09-12T19:38:28.388759+0000, chain.objs.size()=1 2024-09-12T17:39:02.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.251+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.118__shadow_.mc6fYgJfm_zxp_ZrlSqJgGR5skK01Id_0 2024-09-12T17:39:02.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.254+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.255+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:39:02.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.257+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.257+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.258+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T17:39:02.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.258+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13644620191166667522', time=2024-09-12T19:38:22.935696+0000, chain.objs.size()=1 2024-09-12T17:39:02.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.258+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.107__shadow_.IHifADUPJarHu6ktVcJlppi70sAdOXT_0 2024-09-12T17:39:02.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.258+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4665998289177571288', time=2024-09-12T19:38:25.318485+0000, chain.objs.size()=1 2024-09-12T17:39:02.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.258+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.113__shadow_.pfB0r8iH-SlnhCXvWfpahxA_nmqidxW_0 2024-09-12T17:39:02.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.258+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14852197957978118636', time=2024-09-12T19:38:27.700495+0000, chain.objs.size()=1 2024-09-12T17:39:02.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.258+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.117__shadow_.b-4th5pawEIrhNj0xAQ8bQqoRs_lhb7_0 2024-09-12T17:39:02.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.258+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2821789340074294526', time=2024-09-12T19:38:28.361183+0000, chain.objs.size()=1 2024-09-12T17:39:02.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.258+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.118__shadow_.-X1CMldXZSEwzex0QWNvM7It_HaQAHz_0 2024-09-12T17:39:02.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.258+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4908843591141439861', time=2024-09-12T19:38:29.528907+0000, chain.objs.size()=1 2024-09-12T17:39:02.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.258+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.120__shadow_.dvPU5AtWaBlxJyI07OiikBc-yzjzLef_0 2024-09-12T17:39:02.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.258+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17349906138492441619', time=2024-09-12T19:38:34.789441+0000, chain.objs.size()=1 2024-09-12T17:39:02.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.258+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.129__shadow_.9YiypGuXQWTW507RgENa3_EK4Nvq4kJ_0 2024-09-12T17:39:02.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.259+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.261+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:39:02.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.262+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.263+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.263+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:39:02.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.263+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2831969404909828873', time=2024-09-12T19:37:14.018177+0000, chain.objs.size()=9 2024-09-12T17:39:02.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.263+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.100__multipart_key1.2~ILK6ha56kqneIAD-fwNZYpp5tCLSuOk.1 2024-09-12T17:39:02.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.263+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.100__shadow_key1.2~ILK6ha56kqneIAD-fwNZYpp5tCLSuOk.1_1 2024-09-12T17:39:02.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.263+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.100__multipart_key1.2~ILK6ha56kqneIAD-fwNZYpp5tCLSuOk.2 2024-09-12T17:39:02.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.263+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.100__shadow_key1.2~ILK6ha56kqneIAD-fwNZYpp5tCLSuOk.2_1 2024-09-12T17:39:02.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.263+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.100__multipart_key1.2~ILK6ha56kqneIAD-fwNZYpp5tCLSuOk.3 2024-09-12T17:39:02.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.263+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.100__shadow_key1.2~ILK6ha56kqneIAD-fwNZYpp5tCLSuOk.3_1 2024-09-12T17:39:02.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.263+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.100__multipart_key1.2~ILK6ha56kqneIAD-fwNZYpp5tCLSuOk.4 2024-09-12T17:39:02.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.263+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.100__shadow_key1.2~ILK6ha56kqneIAD-fwNZYpp5tCLSuOk.4_1 2024-09-12T17:39:02.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.263+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.100__multipart_key1.2~ILK6ha56kqneIAD-fwNZYpp5tCLSuOk.5 2024-09-12T17:39:02.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.263+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17416181105614243256', time=2024-09-12T19:38:38.707950+0000, chain.objs.size()=1 2024-09-12T17:39:02.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.263+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.137__shadow_.WPIg1tMtVypPVAy3hMs5MOtKFdEH-Ft_0 2024-09-12T17:39:02.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.266+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.268+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:39:02.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.269+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.270+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.270+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T17:39:02.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.270+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16288055744517587743', time=2024-09-12T19:36:48.986081+0000, chain.objs.size()=7 2024-09-12T17:39:02.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.270+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__multipart_key1.2~im4B1lWgF-JJW3VA2BOQg-RIapELlSA.1 2024-09-12T17:39:02.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.270+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__shadow_key1.2~im4B1lWgF-JJW3VA2BOQg-RIapELlSA.1_1 2024-09-12T17:39:02.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.270+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__shadow_key1.2~im4B1lWgF-JJW3VA2BOQg-RIapELlSA.1_2 2024-09-12T17:39:02.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.270+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__multipart_key1.2~im4B1lWgF-JJW3VA2BOQg-RIapELlSA.2 2024-09-12T17:39:02.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.271+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__shadow_key1.2~im4B1lWgF-JJW3VA2BOQg-RIapELlSA.2_1 2024-09-12T17:39:02.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.271+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__shadow_key1.2~im4B1lWgF-JJW3VA2BOQg-RIapELlSA.2_2 2024-09-12T17:39:02.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.271+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__multipart_key1.2~im4B1lWgF-JJW3VA2BOQg-RIapELlSA.3 2024-09-12T17:39:02.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.271+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14202676301136348862', time=2024-09-12T19:38:00.877500+0000, chain.objs.size()=7 2024-09-12T17:39:02.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.271+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__multipart_key1.2~CPwz5-CDhRAaEGcsMI3kBFIdgcPkU-S.1 2024-09-12T17:39:02.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.271+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__shadow_key1.2~CPwz5-CDhRAaEGcsMI3kBFIdgcPkU-S.1_1 2024-09-12T17:39:02.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.271+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__shadow_key1.2~CPwz5-CDhRAaEGcsMI3kBFIdgcPkU-S.1_2 2024-09-12T17:39:02.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.271+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__multipart_key1.2~CPwz5-CDhRAaEGcsMI3kBFIdgcPkU-S.2 2024-09-12T17:39:02.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.271+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__shadow_key1.2~CPwz5-CDhRAaEGcsMI3kBFIdgcPkU-S.2_1 2024-09-12T17:39:02.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.274+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__shadow_key1.2~CPwz5-CDhRAaEGcsMI3kBFIdgcPkU-S.2_2 2024-09-12T17:39:02.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.274+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__multipart_key1.2~CPwz5-CDhRAaEGcsMI3kBFIdgcPkU-S.3 2024-09-12T17:39:02.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.274+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8248425542304628720', time=2024-09-12T19:38:27.162731+0000, chain.objs.size()=1 2024-09-12T17:39:02.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.274+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.116__shadow_.Ft20zNCVHjcAu1YcTO4JaJaiWSuTfq4_0 2024-09-12T17:39:02.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.274+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11819925170655925723', time=2024-09-12T19:38:27.761621+0000, chain.objs.size()=1 2024-09-12T17:39:02.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.274+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.117__shadow_.PtfkXTDpbP9-eYPBBiAEk4aynTRwXv6_0 2024-09-12T17:39:02.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.274+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2823187214691750299', time=2024-09-12T19:38:31.867131+0000, chain.objs.size()=1 2024-09-12T17:39:02.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.274+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.124__shadow_.YljyPSRYVEza38o-H3_aLYh6NBMWve2_0 2024-09-12T17:39:02.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.275+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5034626519527171061', time=2024-09-12T19:38:36.468164+0000, chain.objs.size()=1 2024-09-12T17:39:02.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.275+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.132__shadow_.GEdo1znIl2V8fKlIpjdB0-t-5SDaoqw_0 2024-09-12T17:39:02.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.277+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.279+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:39:02.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.280+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.280+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.281+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:39:02.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.281+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13877342626969601016', time=2024-09-12T19:38:30.742747+0000, chain.objs.size()=1 2024-09-12T17:39:02.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.281+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.122__shadow_.eeyUl6_mhibzae2jznms8Bh78N-Cm3u_0 2024-09-12T17:39:02.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.281+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14171004101158390066', time=2024-09-12T19:38:39.429108+0000, chain.objs.size()=1 2024-09-12T17:39:02.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.281+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.139__shadow_.OvJ5el0bfT1xKQ5CnphGDm1U_ujaB4C_0 2024-09-12T17:39:02.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.282+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.284+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:39:02.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.285+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.286+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.286+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T17:39:02.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.286+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8922877907719384115', time=2024-09-12T19:37:24.948739+0000, chain.objs.size()=5 2024-09-12T17:39:02.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.286+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.101__multipart_file2.mpg.2~w-aMhPr8NU8ZpL8rbgL8CZLs9FYyRU4.1 2024-09-12T17:39:02.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.286+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.101__multipart_file2.mpg.2~w-aMhPr8NU8ZpL8rbgL8CZLs9FYyRU4.2 2024-09-12T17:39:02.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.286+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.101__multipart_file2.mpg.2~w-aMhPr8NU8ZpL8rbgL8CZLs9FYyRU4.3 2024-09-12T17:39:02.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.286+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.101__multipart_file2.mpg.2~w-aMhPr8NU8ZpL8rbgL8CZLs9FYyRU4.4 2024-09-12T17:39:02.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.286+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.101__multipart_file2.mpg.2~w-aMhPr8NU8ZpL8rbgL8CZLs9FYyRU4.5 2024-09-12T17:39:02.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.286+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6086243509050222170', time=2024-09-12T19:37:55.656213+0000, chain.objs.size()=7 2024-09-12T17:39:02.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.286+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__multipart_key1.2~r0E9HX8ZJsS8Rz8MrHo2unNXMD1nxmW.1 2024-09-12T17:39:02.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.286+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__shadow_key1.2~r0E9HX8ZJsS8Rz8MrHo2unNXMD1nxmW.1_1 2024-09-12T17:39:02.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.286+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__shadow_key1.2~r0E9HX8ZJsS8Rz8MrHo2unNXMD1nxmW.1_2 2024-09-12T17:39:02.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.286+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__multipart_key1.2~r0E9HX8ZJsS8Rz8MrHo2unNXMD1nxmW.2 2024-09-12T17:39:02.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.286+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__shadow_key1.2~r0E9HX8ZJsS8Rz8MrHo2unNXMD1nxmW.2_1 2024-09-12T17:39:02.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.286+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__shadow_key1.2~r0E9HX8ZJsS8Rz8MrHo2unNXMD1nxmW.2_2 2024-09-12T17:39:02.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.286+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__multipart_key1.2~r0E9HX8ZJsS8Rz8MrHo2unNXMD1nxmW.3 2024-09-12T17:39:02.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.288+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7626064408181342505', time=2024-09-12T19:38:15.338268+0000, chain.objs.size()=9 2024-09-12T17:39:02.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.288+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.105__multipart_key1.2~Gl0OrmqFyLur_SkpfZLr0jMiOSl9j45.1 2024-09-12T17:39:02.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.288+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.105__shadow_key1.2~Gl0OrmqFyLur_SkpfZLr0jMiOSl9j45.1_1 2024-09-12T17:39:02.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.289+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.105__multipart_key1.2~Gl0OrmqFyLur_SkpfZLr0jMiOSl9j45.2 2024-09-12T17:39:02.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.289+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.105__shadow_key1.2~Gl0OrmqFyLur_SkpfZLr0jMiOSl9j45.2_1 2024-09-12T17:39:02.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.289+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.105__multipart_key1.2~Gl0OrmqFyLur_SkpfZLr0jMiOSl9j45.3 2024-09-12T17:39:02.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.290+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.105__shadow_key1.2~Gl0OrmqFyLur_SkpfZLr0jMiOSl9j45.3_1 2024-09-12T17:39:02.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.290+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.105__multipart_key1.2~Gl0OrmqFyLur_SkpfZLr0jMiOSl9j45.4 2024-09-12T17:39:02.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.290+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.105__shadow_key1.2~Gl0OrmqFyLur_SkpfZLr0jMiOSl9j45.4_1 2024-09-12T17:39:02.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.290+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.105__multipart_key1.2~Gl0OrmqFyLur_SkpfZLr0jMiOSl9j45.5 2024-09-12T17:39:02.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.290+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7343773850106856663', time=2024-09-12T19:38:25.401012+0000, chain.objs.size()=1 2024-09-12T17:39:02.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.290+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.113__shadow_.Ip9DQBf7eOazavH6cRh2WPBQoqbG2OI_0 2024-09-12T17:39:02.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.290+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.106727592072466641', time=2024-09-12T19:38:28.333848+0000, chain.objs.size()=1 2024-09-12T17:39:02.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.290+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.118__shadow_.luY2J1Y1NunS-Y831MB4x4pVOmoxJM8_0 2024-09-12T17:39:02.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.291+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4112037277886990886', time=2024-09-12T19:38:30.688144+0000, chain.objs.size()=1 2024-09-12T17:39:02.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.291+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.122__shadow_.Y6L4eMb57FbExCkDjd3aDV1d8-tsOyB_0 2024-09-12T17:39:02.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.291+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.157109889748347551', time=2024-09-12T19:38:35.428859+0000, chain.objs.size()=1 2024-09-12T17:39:02.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.291+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.130__shadow_.TYpgiGGT9_PRlJgZV4J8mVie7MEiBjL_0 2024-09-12T17:39:02.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.292+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8321664466845847967', time=2024-09-12T19:38:37.003559+0000, chain.objs.size()=1 2024-09-12T17:39:02.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.292+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.133__shadow_.pM5FcYWKyvuT6yYpzuvydmOuoPAb300_0 2024-09-12T17:39:02.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.292+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16628943012841230787', time=2024-09-12T19:38:39.105035+0000, chain.objs.size()=1 2024-09-12T17:39:02.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.292+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.138__shadow_.exHJ0pxBYu-KUlSUrod_s9pSOYDdOuK_0 2024-09-12T17:39:02.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.294+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.297+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:39:02.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.299+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.299+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.299+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:39:02.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.299+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12405280510398349891', time=2024-09-12T19:38:26.597087+0000, chain.objs.size()=1 2024-09-12T17:39:02.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.299+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.115__shadow_.t_PYYH0Ml-Zz9r0zhnkwV4Pb7UiChzy_0 2024-09-12T17:39:02.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.299+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7617410915517928574', time=2024-09-12T19:38:31.359752+0000, chain.objs.size()=1 2024-09-12T17:39:02.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.299+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.123__shadow_.MOrln1xvxKR3vCU9wl5CyqU9ICyWpxM_0 2024-09-12T17:39:02.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.301+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.303+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:39:02.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.304+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.304+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.305+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:39:02.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.305+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11819919404617209418', time=2024-09-12T19:38:32.382839+0000, chain.objs.size()=1 2024-09-12T17:39:02.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.305+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.125__shadow_.e2WphhdC6Kt5HTAR1LQHaNHx7O8tfWC_0 2024-09-12T17:39:02.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.305+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17331511205813534944', time=2024-09-12T19:38:37.567129+0000, chain.objs.size()=1 2024-09-12T17:39:02.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.305+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.134__shadow_.9-dwHh8VTotuoZF2cDaqxhv-rPpXmaE_0 2024-09-12T17:39:02.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.306+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.307+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:39:02.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.309+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.309+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.309+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T17:39:02.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.309+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16840271626072444559', time=2024-09-12T19:38:27.136109+0000, chain.objs.size()=1 2024-09-12T17:39:02.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.309+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.116__shadow_.8NdW7adveLMXNsXGavkpkHGwQk29ecW_0 2024-09-12T17:39:02.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.309+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8385120440187834786', time=2024-09-12T19:38:32.963593+0000, chain.objs.size()=1 2024-09-12T17:39:02.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.309+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.126__shadow_.0XUJ9QgjSm3LFpnrZQdogeYN5Y-lAor_0 2024-09-12T17:39:02.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.309+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11391885440467777853', time=2024-09-12T19:38:33.017722+0000, chain.objs.size()=1 2024-09-12T17:39:02.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.309+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.126__shadow_.cWGJIqgxZEaOANSNChF3irs6Gd9rrvu_0 2024-09-12T17:39:02.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.309+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10250147791263883148', time=2024-09-12T19:38:37.030754+0000, chain.objs.size()=1 2024-09-12T17:39:02.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.309+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.133__shadow_.FAgfzyI7WFhPrWb684V8bGJNAzI6iDw_0 2024-09-12T17:39:02.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.309+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13039752243544520599', time=2024-09-12T19:38:37.513229+0000, chain.objs.size()=1 2024-09-12T17:39:02.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.309+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.134__shadow_.HUHmWPBSftHp3swB6Ox8FTIRReriXi2_0 2024-09-12T17:39:02.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.309+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17693689480829659010', time=2024-09-12T19:38:40.696986+0000, chain.objs.size()=1 2024-09-12T17:39:02.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.309+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.141__shadow_.4od3ot4HAf66CsnK9detETo0f_axP6S_0 2024-09-12T17:39:02.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.311+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.313+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:39:02.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.315+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.315+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.316+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:39:02.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.316+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='2~ywhGRRLUhfgP4BZQWk7JVQ8q2TODPNJ', time=2024-09-12T19:35:48.542561+0000, chain.objs.size()=9 2024-09-12T17:39:02.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.316+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.80__multipart_key1.2~ywhGRRLUhfgP4BZQWk7JVQ8q2TODPNJ.1 2024-09-12T17:39:02.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.316+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.80__shadow_key1.2~ywhGRRLUhfgP4BZQWk7JVQ8q2TODPNJ.1_1 2024-09-12T17:39:02.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.316+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.80__multipart_key1.2~ywhGRRLUhfgP4BZQWk7JVQ8q2TODPNJ.2 2024-09-12T17:39:02.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.316+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.80__shadow_key1.2~ywhGRRLUhfgP4BZQWk7JVQ8q2TODPNJ.2_1 2024-09-12T17:39:02.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.316+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.80__multipart_key1.2~ywhGRRLUhfgP4BZQWk7JVQ8q2TODPNJ.3 2024-09-12T17:39:02.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.316+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.80__shadow_key1.2~ywhGRRLUhfgP4BZQWk7JVQ8q2TODPNJ.3_1 2024-09-12T17:39:02.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.316+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.80__multipart_key1.2~ywhGRRLUhfgP4BZQWk7JVQ8q2TODPNJ.4 2024-09-12T17:39:02.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.316+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.80__shadow_key1.2~ywhGRRLUhfgP4BZQWk7JVQ8q2TODPNJ.4_1 2024-09-12T17:39:02.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.316+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.80__multipart_key1.2~ywhGRRLUhfgP4BZQWk7JVQ8q2TODPNJ.5 2024-09-12T17:39:02.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.316+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10681339620469645637', time=2024-09-12T19:38:35.374818+0000, chain.objs.size()=1 2024-09-12T17:39:02.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.316+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.130__shadow_.xF-nHdx0J4r4WBr-pK4Yl5hxP54ETO1_0 2024-09-12T17:39:02.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.319+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.321+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:39:02.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.322+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.323+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.323+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:39:02.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.323+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9048857377494074328', time=2024-09-12T19:38:34.168974+0000, chain.objs.size()=1 2024-09-12T17:39:02.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.323+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.128__shadow_.TJB9Z-hJWGLaNE4VomDdwzlN7dRpw95_0 2024-09-12T17:39:02.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.323+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15669573509465263079', time=2024-09-12T19:39:01.773548+0000, chain.objs.size()=9 2024-09-12T17:39:02.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.323+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.145__multipart_key1/data/file.mpg.2~KE9Xl8CjaOOf_jLyfCARHsqPUKfywd0.1 2024-09-12T17:39:02.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.323+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.145__shadow_key1/data/file.mpg.2~KE9Xl8CjaOOf_jLyfCARHsqPUKfywd0.1_1 2024-09-12T17:39:02.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.323+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.145__multipart_key1/data/file.mpg.2~KE9Xl8CjaOOf_jLyfCARHsqPUKfywd0.2 2024-09-12T17:39:02.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.323+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.145__shadow_key1/data/file.mpg.2~KE9Xl8CjaOOf_jLyfCARHsqPUKfywd0.2_1 2024-09-12T17:39:02.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.323+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.145__multipart_key1/data/file.mpg.2~KE9Xl8CjaOOf_jLyfCARHsqPUKfywd0.3 2024-09-12T17:39:02.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.323+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.145__shadow_key1/data/file.mpg.2~KE9Xl8CjaOOf_jLyfCARHsqPUKfywd0.3_1 2024-09-12T17:39:02.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.323+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.145__multipart_key1/data/file.mpg.2~KE9Xl8CjaOOf_jLyfCARHsqPUKfywd0.4 2024-09-12T17:39:02.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.323+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.145__shadow_key1/data/file.mpg.2~KE9Xl8CjaOOf_jLyfCARHsqPUKfywd0.4_1 2024-09-12T17:39:02.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.323+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.145__multipart_key1/data/file.mpg.2~KE9Xl8CjaOOf_jLyfCARHsqPUKfywd0.5 2024-09-12T17:39:02.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.326+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.328+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:39:02.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.330+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.330+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.330+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:39:02.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.330+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15871696224196503212', time=2024-09-12T19:37:45.610527+0000, chain.objs.size()=9 2024-09-12T17:39:02.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.330+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__multipart_key1.2~HVQbTuFNLtZvPJ6mIlOh_N2frQJoBLE.1 2024-09-12T17:39:02.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.330+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__shadow_key1.2~HVQbTuFNLtZvPJ6mIlOh_N2frQJoBLE.1_1 2024-09-12T17:39:02.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.330+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__multipart_key1.2~HVQbTuFNLtZvPJ6mIlOh_N2frQJoBLE.2 2024-09-12T17:39:02.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.330+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__shadow_key1.2~HVQbTuFNLtZvPJ6mIlOh_N2frQJoBLE.2_1 2024-09-12T17:39:02.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.330+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__multipart_key1.2~HVQbTuFNLtZvPJ6mIlOh_N2frQJoBLE.3 2024-09-12T17:39:02.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.331+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__shadow_key1.2~HVQbTuFNLtZvPJ6mIlOh_N2frQJoBLE.3_1 2024-09-12T17:39:02.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.331+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__multipart_key1.2~HVQbTuFNLtZvPJ6mIlOh_N2frQJoBLE.4 2024-09-12T17:39:02.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.331+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__shadow_key1.2~HVQbTuFNLtZvPJ6mIlOh_N2frQJoBLE.4_1 2024-09-12T17:39:02.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.331+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__multipart_key1.2~HVQbTuFNLtZvPJ6mIlOh_N2frQJoBLE.5 2024-09-12T17:39:02.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.331+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14216906115883901340', time=2024-09-12T19:38:28.960414+0000, chain.objs.size()=1 2024-09-12T17:39:02.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.331+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.119__shadow_.lwB2PrFm8FGmoAxFTGCz7GwjZ2dDqda_0 2024-09-12T17:39:02.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.334+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.336+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:39:02.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.338+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.338+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.338+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:39:02.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.338+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6723336640164526260', time=2024-09-12T19:36:13.365030+0000, chain.objs.size()=9 2024-09-12T17:39:02.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.338+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.92__multipart_key1.2~OK1B_hH3uCAZPoSP_YBu2DOqEMIUb7E.1 2024-09-12T17:39:02.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.338+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.92__shadow_key1.2~OK1B_hH3uCAZPoSP_YBu2DOqEMIUb7E.1_1 2024-09-12T17:39:02.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.338+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.92__multipart_key1.2~OK1B_hH3uCAZPoSP_YBu2DOqEMIUb7E.2 2024-09-12T17:39:02.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.338+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.92__shadow_key1.2~OK1B_hH3uCAZPoSP_YBu2DOqEMIUb7E.2_1 2024-09-12T17:39:02.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.338+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.92__multipart_key1.2~OK1B_hH3uCAZPoSP_YBu2DOqEMIUb7E.3 2024-09-12T17:39:02.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.338+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.92__shadow_key1.2~OK1B_hH3uCAZPoSP_YBu2DOqEMIUb7E.3_1 2024-09-12T17:39:02.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.338+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.92__multipart_key1.2~OK1B_hH3uCAZPoSP_YBu2DOqEMIUb7E.4 2024-09-12T17:39:02.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.338+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.92__shadow_key1.2~OK1B_hH3uCAZPoSP_YBu2DOqEMIUb7E.4_1 2024-09-12T17:39:02.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.338+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.92__multipart_key1.2~OK1B_hH3uCAZPoSP_YBu2DOqEMIUb7E.5 2024-09-12T17:39:02.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.338+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15913583308582358103', time=2024-09-12T19:38:26.543163+0000, chain.objs.size()=1 2024-09-12T17:39:02.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.338+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.115__shadow_.8KG02gdHdZ_ncxM7nes2aOKspI9qITZ_0 2024-09-12T17:39:02.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.338+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2335058811199625359', time=2024-09-12T19:38:36.976974+0000, chain.objs.size()=1 2024-09-12T17:39:02.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.339+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.133__shadow_.ndu1xcrPu9tgm8bQMzCqz2zdsS6Ofk1_0 2024-09-12T17:39:02.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.341+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.343+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:39:02.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.344+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.344+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.345+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T17:39:02.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.345+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1306744759266092283', time=2024-09-12T19:37:24.893495+0000, chain.objs.size()=9 2024-09-12T17:39:02.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.345+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.101__multipart_file.mpg.2~hQbXIl1ys5dk1f7wGEARoABWF_yKtb_.1 2024-09-12T17:39:02.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.345+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.101__shadow_file.mpg.2~hQbXIl1ys5dk1f7wGEARoABWF_yKtb_.1_1 2024-09-12T17:39:02.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.345+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.101__multipart_file.mpg.2~hQbXIl1ys5dk1f7wGEARoABWF_yKtb_.2 2024-09-12T17:39:02.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.345+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.101__shadow_file.mpg.2~hQbXIl1ys5dk1f7wGEARoABWF_yKtb_.2_1 2024-09-12T17:39:02.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.345+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.101__multipart_file.mpg.2~hQbXIl1ys5dk1f7wGEARoABWF_yKtb_.3 2024-09-12T17:39:02.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.345+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.101__shadow_file.mpg.2~hQbXIl1ys5dk1f7wGEARoABWF_yKtb_.3_1 2024-09-12T17:39:02.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.345+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.101__multipart_file.mpg.2~hQbXIl1ys5dk1f7wGEARoABWF_yKtb_.4 2024-09-12T17:39:02.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.345+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.101__shadow_file.mpg.2~hQbXIl1ys5dk1f7wGEARoABWF_yKtb_.4_1 2024-09-12T17:39:02.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.345+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.101__multipart_file.mpg.2~hQbXIl1ys5dk1f7wGEARoABWF_yKtb_.5 2024-09-12T17:39:02.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.345+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5176378121694838758', time=2024-09-12T19:38:30.148866+0000, chain.objs.size()=1 2024-09-12T17:39:02.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.345+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.121__shadow_.UvVcMFA501fbttQRe2qq32IK_XOZsDn_0 2024-09-12T17:39:02.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.345+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17997371119117752480', time=2024-09-12T19:38:30.769072+0000, chain.objs.size()=1 2024-09-12T17:39:02.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.345+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.122__shadow_.9p6ZaspL4KtFygqTkhPpBNKe80X18Pk_0 2024-09-12T17:39:02.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.345+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2541428813672069634', time=2024-09-12T19:38:31.304035+0000, chain.objs.size()=1 2024-09-12T17:39:02.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.345+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.123__shadow_.Dew0LItTMDxyGjduqmucOFW8iTsLLqr_0 2024-09-12T17:39:02.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.347+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15791509530094281069', time=2024-09-12T19:38:31.332587+0000, chain.objs.size()=1 2024-09-12T17:39:02.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.347+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.123__shadow_.mhM2ouYa4bzz2PH8IMqdU0j_TnI7RTs_0 2024-09-12T17:39:02.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.347+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15487542360145939913', time=2024-09-12T19:38:33.569396+0000, chain.objs.size()=1 2024-09-12T17:39:02.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.347+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.127__shadow_.wMfM7rMqhqFiV6L42P4TkiY8msGFekC_0 2024-09-12T17:39:02.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.348+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7960007437434710579', time=2024-09-12T19:38:37.540164+0000, chain.objs.size()=1 2024-09-12T17:39:02.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.348+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.134__shadow_.hOSREcyjVPQsBMYqA46Qg9SfwL4v1oN_0 2024-09-12T17:39:02.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.349+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.351+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:39:02.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.352+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.353+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.354+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T17:39:02.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.354+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5835693819428197058', time=2024-09-12T19:36:48.782109+0000, chain.objs.size()=6 2024-09-12T17:39:02.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.354+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.94__shadow_.e3am8BnoFH5xUUnttfuYWG33s7rU758_0 2024-09-12T17:39:02.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.354+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.94__shadow_.e3am8BnoFH5xUUnttfuYWG33s7rU758_1 2024-09-12T17:39:02.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.354+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.94__shadow_.e3am8BnoFH5xUUnttfuYWG33s7rU758_2 2024-09-12T17:39:02.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.354+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.94__shadow_.e3am8BnoFH5xUUnttfuYWG33s7rU758_3 2024-09-12T17:39:02.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.354+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.94__shadow_.e3am8BnoFH5xUUnttfuYWG33s7rU758_4 2024-09-12T17:39:02.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.354+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.94__shadow_.e3am8BnoFH5xUUnttfuYWG33s7rU758_5 2024-09-12T17:39:02.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.354+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5635129425515774493', time=2024-09-12T19:38:28.906912+0000, chain.objs.size()=1 2024-09-12T17:39:02.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.354+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.119__shadow_.MvEn-2P7gQLXVl7JOuOe82l5qasVMH4_0 2024-09-12T17:39:02.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.354+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6162323456430919915', time=2024-09-12T19:38:29.583767+0000, chain.objs.size()=1 2024-09-12T17:39:02.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.354+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.120__shadow_.VeGsyzOmK28QisZBU20apn7uCkDcapD_0 2024-09-12T17:39:02.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.354+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2439650939559013423', time=2024-09-12T19:38:33.651864+0000, chain.objs.size()=1 2024-09-12T17:39:02.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.354+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.127__shadow_.adyqh8FnSMAsyt5En5dWpZ8vP6qayI-_0 2024-09-12T17:39:02.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.354+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18439166725735962093', time=2024-09-12T19:38:35.908838+0000, chain.objs.size()=1 2024-09-12T17:39:02.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.354+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.131__shadow_.6KkkHMhhYeGB2adt-JqB19DvqtnSHcE_0 2024-09-12T17:39:02.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.356+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.359+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:39:02.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.360+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.360+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.361+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T17:39:02.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.361+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10257401620441963957', time=2024-09-12T19:35:56.611465+0000, chain.objs.size()=1 2024-09-12T17:39:02.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.361+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.86__shadow_.dZzzYJbxG6eS3LOGbNwy3GcmcX7DONB_0 2024-09-12T17:39:02.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.361+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15047933518879147400', time=2024-09-12T19:38:26.001135+0000, chain.objs.size()=1 2024-09-12T17:39:02.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.361+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.114__shadow_.teTPdrHYylulEXi4PJgxAyFWJumLfur_0 2024-09-12T17:39:02.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.361+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6288075286862574416', time=2024-09-12T19:38:30.715340+0000, chain.objs.size()=1 2024-09-12T17:39:02.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.361+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.122__shadow_.zffkNKx3RuRRYkFM-Fqw3Kf-L63svZY_0 2024-09-12T17:39:02.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.361+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11041312777595481265', time=2024-09-12T19:38:31.894068+0000, chain.objs.size()=1 2024-09-12T17:39:02.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.361+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.124__shadow_.Cbo6gcqxEt3goBxF2DHB3N6e8UulWG3_0 2024-09-12T17:39:02.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.361+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10066068899329968743', time=2024-09-12T19:38:34.843546+0000, chain.objs.size()=1 2024-09-12T17:39:02.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.361+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.129__shadow_.pgOoygwFGYJ-PaoeUtwssIrwj8vwTwW_0 2024-09-12T17:39:02.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.362+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.364+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:39:02.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.365+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.366+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.366+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T17:39:02.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.366+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9080997689620828482', time=2024-09-12T19:35:58.331031+0000, chain.objs.size()=1 2024-09-12T17:39:02.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.366+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.91__shadow_.cIfXFa-WOP1Idkmo8H__f_EV1kxxWJ3_0 2024-09-12T17:39:02.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.366+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5329397349500038075', time=2024-09-12T19:36:45.594298+0000, chain.objs.size()=7 2024-09-12T17:39:02.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.366+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__multipart_key1.2~ORcnehwv19GqsR-4gsIzBuflaxItBe9.1 2024-09-12T17:39:02.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.366+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__shadow_key1.2~ORcnehwv19GqsR-4gsIzBuflaxItBe9.1_1 2024-09-12T17:39:02.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.366+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__shadow_key1.2~ORcnehwv19GqsR-4gsIzBuflaxItBe9.1_2 2024-09-12T17:39:02.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.366+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__multipart_key1.2~ORcnehwv19GqsR-4gsIzBuflaxItBe9.2 2024-09-12T17:39:02.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.366+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__shadow_key1.2~ORcnehwv19GqsR-4gsIzBuflaxItBe9.2_1 2024-09-12T17:39:02.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.366+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__shadow_key1.2~ORcnehwv19GqsR-4gsIzBuflaxItBe9.2_2 2024-09-12T17:39:02.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.366+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__multipart_key1.2~ORcnehwv19GqsR-4gsIzBuflaxItBe9.3 2024-09-12T17:39:02.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.366+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.129262549139951014', time=2024-09-12T19:37:40.508565+0000, chain.objs.size()=9 2024-09-12T17:39:02.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.366+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__multipart_key1.2~GdPWtkJgSRJC0rTHmFXYYsQ_-DbZ7gw.1 2024-09-12T17:39:02.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.366+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__shadow_key1.2~GdPWtkJgSRJC0rTHmFXYYsQ_-DbZ7gw.1_1 2024-09-12T17:39:02.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.366+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__multipart_key1.2~GdPWtkJgSRJC0rTHmFXYYsQ_-DbZ7gw.2 2024-09-12T17:39:02.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.366+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__shadow_key1.2~GdPWtkJgSRJC0rTHmFXYYsQ_-DbZ7gw.2_1 2024-09-12T17:39:02.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.368+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__multipart_key1.2~GdPWtkJgSRJC0rTHmFXYYsQ_-DbZ7gw.3 2024-09-12T17:39:02.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.368+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__shadow_key1.2~GdPWtkJgSRJC0rTHmFXYYsQ_-DbZ7gw.3_1 2024-09-12T17:39:02.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.369+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__multipart_key1.2~GdPWtkJgSRJC0rTHmFXYYsQ_-DbZ7gw.4 2024-09-12T17:39:02.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.369+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__shadow_key1.2~GdPWtkJgSRJC0rTHmFXYYsQ_-DbZ7gw.4_1 2024-09-12T17:39:02.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.371+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.103__multipart_key1.2~GdPWtkJgSRJC0rTHmFXYYsQ_-DbZ7gw.5 2024-09-12T17:39:02.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.371+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17780764312700305145', time=2024-09-12T19:38:06.090636+0000, chain.objs.size()=1 2024-09-12T17:39:02.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.371+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.104__shadow_.iOM5fJb-oR1r28-vMj2P1LXEER0upZi_0 2024-09-12T17:39:02.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.371+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15688504398127259482', time=2024-09-12T19:38:32.435993+0000, chain.objs.size()=1 2024-09-12T17:39:02.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.371+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.125__shadow_.9h3RIZ_GmLYkx1A0pN-EqRfNIuxlkgp_0 2024-09-12T17:39:02.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.371+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12921691735378266585', time=2024-09-12T19:38:36.440257+0000, chain.objs.size()=1 2024-09-12T17:39:02.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.371+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.132__shadow_.f0iuJVF0sz6AUDR3pvkfXiy8pEHjd6h_0 2024-09-12T17:39:02.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.373+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.375+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:39:02.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.377+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.377+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.378+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:39:02.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.378+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14006570214802160384', time=2024-09-12T19:38:27.733361+0000, chain.objs.size()=1 2024-09-12T17:39:02.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.378+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.117__shadow_.fHlzhr-6y_8RsJ1LxpAcYO_mZX-l4Kw_0 2024-09-12T17:39:02.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.378+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6934481990002081918', time=2024-09-12T19:38:36.496881+0000, chain.objs.size()=1 2024-09-12T17:39:02.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.378+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.132__shadow_.o38cVo7H-xrgYmOskfr3VplmYrczDdD_0 2024-09-12T17:39:02.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.379+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.381+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:39:02.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.382+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.382+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.382+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:39:02.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.382+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4191386856985079134', time=2024-09-12T19:38:25.346395+0000, chain.objs.size()=1 2024-09-12T17:39:02.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.382+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.113__shadow_.byOqbCvExHvGnVCVZoUAYgfoxc3C5ek_0 2024-09-12T17:39:02.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.383+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9188628544006382324', time=2024-09-12T19:38:25.373895+0000, chain.objs.size()=1 2024-09-12T17:39:02.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.383+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.113__shadow_.Jr-jZlOhtgaWtzfC8vgjX9Nl5mP6EXn_0 2024-09-12T17:39:02.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.383+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1652376736565866953', time=2024-09-12T19:38:30.096216+0000, chain.objs.size()=1 2024-09-12T17:39:02.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.383+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.121__shadow_.iLBjQn-iXE6kvlDxqd0rPG1DQjpH-Ri_0 2024-09-12T17:39:02.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.384+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.386+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:39:02.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.387+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.388+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.388+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T17:39:02.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.388+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7795687415847499863', time=2024-09-12T19:35:49.527035+0000, chain.objs.size()=1 2024-09-12T17:39:02.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.388+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.82__shadow_.yT5OOsrtPH_xKzvJLMEucieUTSX_LEf_0 2024-09-12T17:39:02.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.388+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4429806437542604248', time=2024-09-12T19:36:26.424779+0000, chain.objs.size()=9 2024-09-12T17:39:02.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.388+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__multipart_key1.2~eySwIkMCt6k9cFgl2Y4Kc2aLgp0NVQs.1 2024-09-12T17:39:02.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.388+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__shadow_key1.2~eySwIkMCt6k9cFgl2Y4Kc2aLgp0NVQs.1_1 2024-09-12T17:39:02.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.388+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__multipart_key1.2~eySwIkMCt6k9cFgl2Y4Kc2aLgp0NVQs.2 2024-09-12T17:39:02.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.388+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__shadow_key1.2~eySwIkMCt6k9cFgl2Y4Kc2aLgp0NVQs.2_1 2024-09-12T17:39:02.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.388+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__multipart_key1.2~eySwIkMCt6k9cFgl2Y4Kc2aLgp0NVQs.3 2024-09-12T17:39:02.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.388+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__shadow_key1.2~eySwIkMCt6k9cFgl2Y4Kc2aLgp0NVQs.3_1 2024-09-12T17:39:02.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.388+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__multipart_key1.2~eySwIkMCt6k9cFgl2Y4Kc2aLgp0NVQs.4 2024-09-12T17:39:02.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.388+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__shadow_key1.2~eySwIkMCt6k9cFgl2Y4Kc2aLgp0NVQs.4_1 2024-09-12T17:39:02.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.388+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__multipart_key1.2~eySwIkMCt6k9cFgl2Y4Kc2aLgp0NVQs.5 2024-09-12T17:39:02.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.388+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag', time=2024-09-12T19:38:19.170692+0000, chain.objs.size()=1 2024-09-12T17:39:02.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.388+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag.12 2024-09-12T17:39:02.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.388+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag', time=2024-09-12T19:38:19.245457+0000, chain.objs.size()=1 2024-09-12T17:39:02.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.388+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag.13 2024-09-12T17:39:02.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.390+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag', time=2024-09-12T19:38:19.277036+0000, chain.objs.size()=1 2024-09-12T17:39:02.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.390+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag.14 2024-09-12T17:39:02.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.391+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag', time=2024-09-12T19:38:19.389361+0000, chain.objs.size()=1 2024-09-12T17:39:02.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.391+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag.15 2024-09-12T17:39:02.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.391+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag', time=2024-09-12T19:38:19.521849+0000, chain.objs.size()=1 2024-09-12T17:39:02.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.391+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag.16 2024-09-12T17:39:02.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.391+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag', time=2024-09-12T19:38:19.572519+0000, chain.objs.size()=1 2024-09-12T17:39:02.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.391+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag.17 2024-09-12T17:39:02.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.391+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag', time=2024-09-12T19:38:19.603819+0000, chain.objs.size()=1 2024-09-12T17:39:02.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.391+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag.18 2024-09-12T17:39:02.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.392+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag', time=2024-09-12T19:38:19.643606+0000, chain.objs.size()=1 2024-09-12T17:39:02.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.392+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag.19 2024-09-12T17:39:02.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.392+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag', time=2024-09-12T19:38:19.669987+0000, chain.objs.size()=1 2024-09-12T17:39:02.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.392+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag.20 2024-09-12T17:39:02.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.393+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag', time=2024-09-12T19:38:19.737526+0000, chain.objs.size()=21 2024-09-12T17:39:02.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.393+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag.1 2024-09-12T17:39:02.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.393+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag.2 2024-09-12T17:39:02.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.393+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag.3 2024-09-12T17:39:02.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.393+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag.4 2024-09-12T17:39:02.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.393+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag.5 2024-09-12T17:39:02.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.393+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag.6 2024-09-12T17:39:02.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.393+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag.7 2024-09-12T17:39:02.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.393+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag.8 2024-09-12T17:39:02.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.393+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag.9 2024-09-12T17:39:02.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.394+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag.10 2024-09-12T17:39:02.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.394+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag.11 2024-09-12T17:39:02.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.394+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.Q3-vA8bCnYhz1A2JWxqBHxFJ-QUSX1t0.12 2024-09-12T17:39:02.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.395+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.ozMDPSg2lxaJURTzDSkutJLphsVYvyTS.13 2024-09-12T17:39:02.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.395+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.7D-rNrTBUmCAYXLBXezyHmv56oAIBkQ1.14 2024-09-12T17:39:02.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.395+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.m-ip7zGf3Rj0xL3ZwTvRZJ9ysGDkcfDt.15 2024-09-12T17:39:02.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.395+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.OA39SRAM8MROOd52mCX-nPLP27v_uiLJ.16 2024-09-12T17:39:02.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.395+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.cKc1k8KDVxc-JYHOVdOgKURDwp6Gt6jM.17 2024-09-12T17:39:02.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.395+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.xBbx5Yop8VxQA0oqcSDbJqJrryeP9SO-.18 2024-09-12T17:39:02.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.395+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.rE65n5tqrLleYrkfrv_c3h9cNncYcZbn.19 2024-09-12T17:39:02.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.396+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.kXa-2wNxp8dZU-AEVQdY8csQdPWwS_Jm.20 2024-09-12T17:39:02.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.396+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.106__multipart_key1.2~a5rkxPLqy8lIpB53o6kEPztG92UQ1ag.21 2024-09-12T17:39:02.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.396+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.409358844938921527', time=2024-09-12T19:38:27.107990+0000, chain.objs.size()=1 2024-09-12T17:39:02.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.396+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.116__shadow_.txMrUp6ICjG8gzC2UPVmNsS3Ux2KPVr_0 2024-09-12T17:39:02.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.396+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9361535883030564583', time=2024-09-12T19:38:34.250987+0000, chain.objs.size()=1 2024-09-12T17:39:02.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.396+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.128__shadow_.74r9k3OL3YkwuCtSKBxXAl3-hD9C6CB_0 2024-09-12T17:39:02.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.397+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7601643574198444927', time=2024-09-12T19:38:34.816513+0000, chain.objs.size()=1 2024-09-12T17:39:02.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.397+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.129__shadow_.cshOe0dATktwJTeebTUiPIi6ZDPd3FX_0 2024-09-12T17:39:02.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.399+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.401+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:39:02.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.402+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.402+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.403+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:39:02.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.403+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9521220454022174148', time=2024-09-12T19:38:28.987906+0000, chain.objs.size()=1 2024-09-12T17:39:02.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.403+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.119__shadow_.4k40v6Zrqtl5cywGe6PUWl2AvRZ8an9_0 2024-09-12T17:39:02.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.403+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.660704333803865267', time=2024-09-12T19:38:31.277661+0000, chain.objs.size()=1 2024-09-12T17:39:02.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.403+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.123__shadow_.MY2T6l2J2eeOy58QiIblsEoCAvkbs8w_0 2024-09-12T17:39:02.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.403+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6391753647336642397', time=2024-09-12T19:38:34.196347+0000, chain.objs.size()=1 2024-09-12T17:39:02.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.403+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.128__shadow_.7DqnQbkmSMHj2cFC-Ke08nCUUYmfaIc_0 2024-09-12T17:39:02.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.403+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3750998973421402752', time=2024-09-12T19:38:40.270359+0000, chain.objs.size()=1 2024-09-12T17:39:02.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.403+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.140__shadow_.-YUk3BRtFQZos_VK1Jq-Y1eIpnlrK3r_0 2024-09-12T17:39:02.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.404+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.406+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:39:02.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.407+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.408+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.408+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:39:02.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.408+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3885510846898964038', time=2024-09-12T19:38:35.348499+0000, chain.objs.size()=1 2024-09-12T17:39:02.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.408+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.130__shadow_.KCS9AarKVPJFWNruB43QMOQX8B2cPof_0 2024-09-12T17:39:02.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.409+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.411+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:39:02.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.413+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.413+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.413+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T17:39:02.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.413+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.212654922396090126', time=2024-09-12T19:36:38.907730+0000, chain.objs.size()=9 2024-09-12T17:39:02.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.413+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__multipart_key1.2~FbW93xGyH0i7-6JB4QLcm4OMUNPDLP-.1 2024-09-12T17:39:02.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.413+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__shadow_key1.2~FbW93xGyH0i7-6JB4QLcm4OMUNPDLP-.1_1 2024-09-12T17:39:02.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.413+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__multipart_key1.2~FbW93xGyH0i7-6JB4QLcm4OMUNPDLP-.2 2024-09-12T17:39:02.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.413+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__shadow_key1.2~FbW93xGyH0i7-6JB4QLcm4OMUNPDLP-.2_1 2024-09-12T17:39:02.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.413+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__multipart_key1.2~FbW93xGyH0i7-6JB4QLcm4OMUNPDLP-.3 2024-09-12T17:39:02.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.413+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__shadow_key1.2~FbW93xGyH0i7-6JB4QLcm4OMUNPDLP-.3_1 2024-09-12T17:39:02.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.413+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__multipart_key1.2~FbW93xGyH0i7-6JB4QLcm4OMUNPDLP-.4 2024-09-12T17:39:02.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.413+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__shadow_key1.2~FbW93xGyH0i7-6JB4QLcm4OMUNPDLP-.4_1 2024-09-12T17:39:02.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.413+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__multipart_key1.2~FbW93xGyH0i7-6JB4QLcm4OMUNPDLP-.5 2024-09-12T17:39:02.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.413+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14788937806612472687', time=2024-09-12T19:36:41.985041+0000, chain.objs.size()=9 2024-09-12T17:39:02.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.413+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__multipart_key1.2~fnq_t9wtZrmQHHyLJGEWczXDJAkPOyq.1 2024-09-12T17:39:02.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.413+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__shadow_key1.2~fnq_t9wtZrmQHHyLJGEWczXDJAkPOyq.1_1 2024-09-12T17:39:02.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.413+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__multipart_key1.2~fnq_t9wtZrmQHHyLJGEWczXDJAkPOyq.2 2024-09-12T17:39:02.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.417+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__shadow_key1.2~fnq_t9wtZrmQHHyLJGEWczXDJAkPOyq.2_1 2024-09-12T17:39:02.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.417+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__multipart_key1.2~fnq_t9wtZrmQHHyLJGEWczXDJAkPOyq.3 2024-09-12T17:39:02.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.417+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__shadow_key1.2~fnq_t9wtZrmQHHyLJGEWczXDJAkPOyq.3_1 2024-09-12T17:39:02.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.417+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__multipart_key1.2~fnq_t9wtZrmQHHyLJGEWczXDJAkPOyq.4 2024-09-12T17:39:02.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.417+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__shadow_key1.2~fnq_t9wtZrmQHHyLJGEWczXDJAkPOyq.4_1 2024-09-12T17:39:02.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.417+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.95__multipart_key1.2~fnq_t9wtZrmQHHyLJGEWczXDJAkPOyq.5 2024-09-12T17:39:02.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.417+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2645903871044228791', time=2024-09-12T19:38:26.516390+0000, chain.objs.size()=1 2024-09-12T17:39:02.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.417+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.115__shadow_.qDRzMV0HEiLD2rfKfpT6DsCYqL79o1w_0 2024-09-12T17:39:02.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.417+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12205849973102673567', time=2024-09-12T19:38:32.409711+0000, chain.objs.size()=1 2024-09-12T17:39:02.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.417+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.125__shadow_.Zb8BWIehSfaK4TTCgR8JBqmcHOW7WIn_0 2024-09-12T17:39:02.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.417+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12715513367256263024', time=2024-09-12T19:38:33.047599+0000, chain.objs.size()=1 2024-09-12T17:39:02.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.417+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.126__shadow_.6cnNJpOVN1dEFAv3rYBgKt4ffLgEoGJ_0 2024-09-12T17:39:02.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.420+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.421+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:39:02.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.423+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.423+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.423+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:39:02.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.423+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13838925471668421550', time=2024-09-12T19:37:24.919831+0000, chain.objs.size()=1 2024-09-12T17:39:02.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.423+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.101__shadow_.kLQcrc559rJKHpeoLrIh3Df_rgcft8j_0 2024-09-12T17:39:02.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.423+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13576578080281998597', time=2024-09-12T19:38:26.570841+0000, chain.objs.size()=1 2024-09-12T17:39:02.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.423+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.115__shadow_.GpBtj6CJ-wE_A5BozB5QyjC4-PmwrhU_0 2024-09-12T17:39:02.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.423+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3793466391887208616', time=2024-09-12T19:38:30.176147+0000, chain.objs.size()=1 2024-09-12T17:39:02.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.423+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.121__shadow_.aouS3zHdrhjeLLIyYUAg07yURNKp6-H_0 2024-09-12T17:39:02.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.423+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17477910056944309380', time=2024-09-12T19:38:35.963118+0000, chain.objs.size()=1 2024-09-12T17:39:02.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.423+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.131__shadow_.Tcv-zmhN6KQOKlDt4ZB6F0OaaMPDJjT_0 2024-09-12T17:39:02.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.425+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.428+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:39:02.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.429+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.429+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.430+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:39:02.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.430+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14387376692586397797', time=2024-09-12T19:36:13.565035+0000, chain.objs.size()=9 2024-09-12T17:39:02.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.430+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.92__multipart_key1.2~OK1B_hH3uCAZPoSP_YBu2DOqEMIUb7E.1 2024-09-12T17:39:02.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.430+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.92__shadow_key1.2~OK1B_hH3uCAZPoSP_YBu2DOqEMIUb7E.1_1 2024-09-12T17:39:02.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.430+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.92__multipart_key1.2~OK1B_hH3uCAZPoSP_YBu2DOqEMIUb7E.2 2024-09-12T17:39:02.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.430+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.92__shadow_key1.2~OK1B_hH3uCAZPoSP_YBu2DOqEMIUb7E.2_1 2024-09-12T17:39:02.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.430+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.92__multipart_key1.2~OK1B_hH3uCAZPoSP_YBu2DOqEMIUb7E.3 2024-09-12T17:39:02.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.430+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.92__shadow_key1.2~OK1B_hH3uCAZPoSP_YBu2DOqEMIUb7E.3_1 2024-09-12T17:39:02.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.430+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.92__multipart_key1.2~OK1B_hH3uCAZPoSP_YBu2DOqEMIUb7E.4 2024-09-12T17:39:02.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.430+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.92__shadow_key1.2~OK1B_hH3uCAZPoSP_YBu2DOqEMIUb7E.4_1 2024-09-12T17:39:02.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.430+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.92__multipart_key1.2~OK1B_hH3uCAZPoSP_YBu2DOqEMIUb7E.5 2024-09-12T17:39:02.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.430+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8214720926422828552', time=2024-09-12T19:38:25.919904+0000, chain.objs.size()=1 2024-09-12T17:39:02.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.430+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.114__shadow_.K1tFniKr4HA5Ds03ts31l6JHqzZO0Wg_0 2024-09-12T17:39:02.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.430+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7067703157724793943', time=2024-09-12T19:38:29.501230+0000, chain.objs.size()=1 2024-09-12T17:39:02.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.430+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.120__shadow_.L8z5F5ZukZqTR1Hi5Gyj1n-OeLt4_JG_0 2024-09-12T17:39:02.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.433+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.435+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:39:02.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.437+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.437+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.437+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:39:02.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.437+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18104649965966536021', time=2024-09-12T19:38:25.947527+0000, chain.objs.size()=1 2024-09-12T17:39:02.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.437+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.114__shadow_.IdG02mt6dNME41-I-U89SaUlTalANbt_0 2024-09-12T17:39:02.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.437+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14658629156314303630', time=2024-09-12T19:38:31.840388+0000, chain.objs.size()=1 2024-09-12T17:39:02.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.437+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.124__shadow_.ioZxww1qJfNRyTxuXW58DRAohEqBk7t_0 2024-09-12T17:39:02.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.437+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3019126259850719431', time=2024-09-12T19:38:39.520229+0000, chain.objs.size()=1 2024-09-12T17:39:02.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.437+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.139__shadow_.TTomaNBjfakEgNLaCmwYv6UyDvFw-Ot_0 2024-09-12T17:39:02.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.438+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.440+0000 7f0c4872e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:39:02.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.442+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.442+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.442+0000 7f0c4872e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T17:39:02.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.442+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11361136283429562035', time=2024-09-12T19:35:43.005860+0000, chain.objs.size()=1 2024-09-12T17:39:02.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.442+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.78__shadow_.KJKRjj6kCaFhnPaf6JfCgHhAf0Hr6oD_0 2024-09-12T17:39:02.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.442+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17820137795050782248', time=2024-09-12T19:37:04.551318+0000, chain.objs.size()=9 2024-09-12T17:39:02.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.442+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.99__multipart_key1.2~vg-H1KLeqBVFAEUmU9rIxjADpJw97Py.1 2024-09-12T17:39:02.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.442+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.99__shadow_key1.2~vg-H1KLeqBVFAEUmU9rIxjADpJw97Py.1_1 2024-09-12T17:39:02.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.442+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.99__multipart_key1.2~vg-H1KLeqBVFAEUmU9rIxjADpJw97Py.2 2024-09-12T17:39:02.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.442+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.99__shadow_key1.2~vg-H1KLeqBVFAEUmU9rIxjADpJw97Py.2_1 2024-09-12T17:39:02.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.442+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.99__multipart_key1.2~vg-H1KLeqBVFAEUmU9rIxjADpJw97Py.3 2024-09-12T17:39:02.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.442+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.99__shadow_key1.2~vg-H1KLeqBVFAEUmU9rIxjADpJw97Py.3_1 2024-09-12T17:39:02.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.442+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.99__multipart_key1.2~vg-H1KLeqBVFAEUmU9rIxjADpJw97Py.4 2024-09-12T17:39:02.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.442+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.99__shadow_key1.2~vg-H1KLeqBVFAEUmU9rIxjADpJw97Py.4_1 2024-09-12T17:39:02.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.442+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.99__multipart_key1.2~vg-H1KLeqBVFAEUmU9rIxjADpJw97Py.5 2024-09-12T17:39:02.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.442+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1625662934744149613', time=2024-09-12T19:38:25.973827+0000, chain.objs.size()=1 2024-09-12T17:39:02.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.442+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.114__shadow_.A9nh8e7RuwnSNrrYGTvzc8jNXpXJ6Oc_0 2024-09-12T17:39:02.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.442+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6932482632720197222', time=2024-09-12T19:38:28.933572+0000, chain.objs.size()=1 2024-09-12T17:39:02.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.442+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.119__shadow_.zifcu1tglqIcStijdB84bof5LqqOh9z_0 2024-09-12T17:39:02.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.444+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12648471330152619799', time=2024-09-12T19:38:34.223283+0000, chain.objs.size()=1 2024-09-12T17:39:02.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.444+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.128__shadow_.y0kuzhkSP2jwTx_uCsXaff_v23COEme_0 2024-09-12T17:39:02.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.445+0000 7f0c4872e800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14651322462117554514', time=2024-09-12T19:38:34.762870+0000, chain.objs.size()=1 2024-09-12T17:39:02.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.445+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.129__shadow_.lR2PRnyjaehhx-EE_E8LNXBfAk2XCX-_0 2024-09-12T17:39:02.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.446+0000 7f0c4872e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:02.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.449+0000 7f0afafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:02.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.451+0000 7f0c4872e800 20 remove_watcher() i=0 2024-09-12T17:39:02.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.451+0000 7f0c4872e800 2 removed watcher, disabling cache 2024-09-12T17:39:02.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.452+0000 7f0c4872e800 20 remove_watcher() i=1 2024-09-12T17:39:02.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.454+0000 7f0c4872e800 20 remove_watcher() i=2 2024-09-12T17:39:02.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.454+0000 7f0c4872e800 20 remove_watcher() i=3 2024-09-12T17:39:02.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.456+0000 7f0c4872e800 20 remove_watcher() i=4 2024-09-12T17:39:02.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.457+0000 7f0c4872e800 20 remove_watcher() i=5 2024-09-12T17:39:02.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.458+0000 7f0c4872e800 20 remove_watcher() i=6 2024-09-12T17:39:02.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.459+0000 7f0c4872e800 20 remove_watcher() i=7 2024-09-12T17:39:02.474 DEBUG:teuthology.orchestra.run.smithi067:> radosgw-admin gc process --include-all 2024-09-12T17:39:02.527 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:02.527 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:02.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.564+0000 7fe906c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:02.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.565+0000 7fe906c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:02.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.565+0000 7fe906c0e800 20 realm 2024-09-12T17:39:02.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.565+0000 7fe906c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:02.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.566+0000 7fe906c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:02.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.566+0000 7fe906c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:02.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.566+0000 7fe906c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:02.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.566+0000 7fe906c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:02.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.566+0000 7fe906c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:02.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.567+0000 7fe906c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:02.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.567+0000 7fe906c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:02.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.567+0000 7fe906c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:02.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.567+0000 7fe906c0e800 20 searching for the correct realm 2024-09-12T17:39:02.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.570+0000 7fe902259640 0 -- 172.21.15.67:0/2636728197 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7fe8fc027060 msgr2=0x7fe8fc062f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:02.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.573+0000 7fe902259640 0 -- 172.21.15.67:0/2636728197 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fe8ec027040 msgr2=0x7fe8ec05a480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:39:02.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.780+0000 7fe906c0e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:39:02.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.780+0000 7fe906c0e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:39:02.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.780+0000 7fe906c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:02.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.780+0000 7fe906c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:02.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.780+0000 7fe906c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:02.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.780+0000 7fe906c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:02.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.780+0000 7fe906c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:02.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.780+0000 7fe906c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:02.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.780+0000 7fe906c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:02.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.780+0000 7fe906c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:02.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.781+0000 7fe906c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:02.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.781+0000 7fe906c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:02.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.781+0000 7fe906c0e800 20 zone default found 2024-09-12T17:39:02.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.781+0000 7fe906c0e800 4 Realm: () 2024-09-12T17:39:02.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.781+0000 7fe906c0e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:39:02.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.781+0000 7fe906c0e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:39:02.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.781+0000 7fe906c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:02.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.781+0000 7fe906c0e800 20 zonegroup default 2024-09-12T17:39:02.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.781+0000 7fe906c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:02.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.781+0000 7fe906c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:02.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.781+0000 7fe906c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:02.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.781+0000 7fe906c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:02.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.781+0000 7fe906c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:02.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.782+0000 7fe906c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:02.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.782+0000 7fe906c0e800 20 started sync module instance, tier type = 2024-09-12T17:39:02.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.782+0000 7fe906c0e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:39:02.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.791+0000 7fe906c0e800 20 add_watcher() i=0 2024-09-12T17:39:02.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.791+0000 7fe906c0e800 20 add_watcher() i=1 2024-09-12T17:39:02.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.791+0000 7fe906c0e800 20 add_watcher() i=2 2024-09-12T17:39:02.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.791+0000 7fe906c0e800 20 add_watcher() i=3 2024-09-12T17:39:02.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.791+0000 7fe906c0e800 20 add_watcher() i=4 2024-09-12T17:39:02.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.791+0000 7fe906c0e800 20 add_watcher() i=5 2024-09-12T17:39:02.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.791+0000 7fe906c0e800 20 add_watcher() i=6 2024-09-12T17:39:02.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.792+0000 7fe906c0e800 20 add_watcher() i=7 2024-09-12T17:39:02.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.792+0000 7fe906c0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:02.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.794+0000 7fe7b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:02.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.794+0000 7fe906c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:02.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.794+0000 7fe906c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:02.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.828+0000 7fe7337fe640 20 reqs_thread_entry: start 2024-09-12T17:39:02.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.828+0000 7fe906c0e800 20 init_complete bucket index max shards: 1 2024-09-12T17:39:02.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.828+0000 7fe906c0e800 20 Filter name: none 2024-09-12T17:39:02.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.828+0000 7fe7317fa640 20 reqs_thread_entry: start 2024-09-12T17:39:02.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.828+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:39:02.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.829+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.830+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.830+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.831+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:39:02.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.832+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.833+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.833+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.834+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:39:02.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.835+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.836+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.836+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.837+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:39:02.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.838+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.839+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.839+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.840+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:39:02.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.841+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.842+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.842+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.843+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:39:02.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.844+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.845+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.845+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.846+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:39:02.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.847+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.848+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.848+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.849+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:39:02.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.851+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.851+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.851+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.852+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:39:02.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.853+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.854+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.854+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.856+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:39:02.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.858+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.858+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.858+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.859+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:39:02.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.860+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.861+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.861+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.862+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:39:02.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.863+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.864+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.864+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.865+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:39:02.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.866+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.867+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.867+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.868+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:39:02.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.869+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.870+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.870+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.871+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:39:02.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.872+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.873+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.873+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.874+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:39:02.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.875+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.876+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.876+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.877+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:39:02.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.878+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.879+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.879+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.880+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:39:02.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.881+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.882+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.882+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.883+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:39:02.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.884+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.885+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.885+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.886+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:39:02.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.887+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.888+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.888+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.889+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:39:02.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.890+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.890+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.891+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.892+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:39:02.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.893+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.893+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.894+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.895+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:39:02.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.896+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.896+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.896+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.897+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:39:02.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.901+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.901+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.902+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.903+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:39:02.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.904+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.905+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.905+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.906+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:39:02.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.907+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.907+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.908+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.909+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:39:02.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.910+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.911+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.911+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.912+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:39:02.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.913+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.913+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.914+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.915+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:39:02.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.916+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.916+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.917+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.918+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:39:02.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.919+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.919+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.920+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.921+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:39:02.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.922+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.922+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.923+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.924+0000 7fe906c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:39:02.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.925+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.925+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:02.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.925+0000 7fe906c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:02.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.927+0000 7fe7b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:02.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.929+0000 7fe906c0e800 20 remove_watcher() i=0 2024-09-12T17:39:02.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.929+0000 7fe906c0e800 2 removed watcher, disabling cache 2024-09-12T17:39:02.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.930+0000 7fe906c0e800 20 remove_watcher() i=1 2024-09-12T17:39:02.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.931+0000 7fe906c0e800 20 remove_watcher() i=2 2024-09-12T17:39:02.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.932+0000 7fe906c0e800 20 remove_watcher() i=3 2024-09-12T17:39:02.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.933+0000 7fe906c0e800 20 remove_watcher() i=4 2024-09-12T17:39:02.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.934+0000 7fe906c0e800 20 remove_watcher() i=5 2024-09-12T17:39:02.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.935+0000 7fe906c0e800 20 remove_watcher() i=6 2024-09-12T17:39:02.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:02.936+0000 7fe906c0e800 20 remove_watcher() i=7 2024-09-12T17:39:02.950 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-12T17:39:02.968 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-12T17:39:02.969 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-12T17:39:02.969 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-12T17:39:02.969 DEBUG:teuthology.orchestra.run.smithi067:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T17:39:02.999 INFO:teuthology.orchestra.run.smithi067.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-12T17:39:03.835 INFO:tasks.s3tests:Creating rgw users... 2024-09-12T17:39:03.836 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name Mr.RGW11111111111111111 --email RGW11111111111111111+test@test.test 2024-09-12T17:39:03.938 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:03.938 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:03.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.972+0000 7fcddad0c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:03.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.974+0000 7fcddad0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:03.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.974+0000 7fcddad0c800 20 realm 2024-09-12T17:39:03.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.974+0000 7fcddad0c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:03.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.974+0000 7fcddad0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:03.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.974+0000 7fcddad0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:03.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.974+0000 7fcddad0c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:03.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.975+0000 7fcddad0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:03.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.975+0000 7fcddad0c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:03.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.976+0000 7fcddad0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:03.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.976+0000 7fcddad0c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:03.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.976+0000 7fcddad0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:03.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.976+0000 7fcddad0c800 20 searching for the correct realm 2024-09-12T17:39:03.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.979+0000 7fcdd8ff7640 0 -- 172.21.15.67:0/3211790645 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x56277a57e880 msgr2=0x56277a580cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:03.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.983+0000 7fcdd87f6640 0 -- 172.21.15.67:0/3211790645 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fcdcc08d950 msgr2=0x7fcdcc09c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:03.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.987+0000 7fcddad0c800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:39:03.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.987+0000 7fcddad0c800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:39:03.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.987+0000 7fcddad0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:03.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.987+0000 7fcddad0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:03.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.987+0000 7fcddad0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:03.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.987+0000 7fcddad0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:03.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.987+0000 7fcddad0c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:03.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.988+0000 7fcddad0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:03.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.988+0000 7fcddad0c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:03.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.988+0000 7fcddad0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:03.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.988+0000 7fcddad0c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:03.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.988+0000 7fcddad0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:03.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.988+0000 7fcddad0c800 20 zone default found 2024-09-12T17:39:03.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.988+0000 7fcddad0c800 4 Realm: () 2024-09-12T17:39:03.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.988+0000 7fcddad0c800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:39:03.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.988+0000 7fcddad0c800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:39:03.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.988+0000 7fcddad0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:03.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.988+0000 7fcddad0c800 20 zonegroup default 2024-09-12T17:39:03.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.988+0000 7fcddad0c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:03.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.989+0000 7fcddad0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:03.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.989+0000 7fcddad0c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:03.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.989+0000 7fcddad0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:03.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.989+0000 7fcddad0c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:03.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.989+0000 7fcddad0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:03.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.989+0000 7fcddad0c800 20 started sync module instance, tier type = 2024-09-12T17:39:03.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.989+0000 7fcddad0c800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:39:04.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.999+0000 7fcddad0c800 20 add_watcher() i=0 2024-09-12T17:39:04.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.999+0000 7fcddad0c800 20 add_watcher() i=1 2024-09-12T17:39:04.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.999+0000 7fcddad0c800 20 add_watcher() i=2 2024-09-12T17:39:04.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.999+0000 7fcddad0c800 20 add_watcher() i=3 2024-09-12T17:39:04.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.999+0000 7fcddad0c800 20 add_watcher() i=4 2024-09-12T17:39:04.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.999+0000 7fcddad0c800 20 add_watcher() i=5 2024-09-12T17:39:04.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:03.999+0000 7fcddad0c800 20 add_watcher() i=6 2024-09-12T17:39:04.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.000+0000 7fcddad0c800 20 add_watcher() i=7 2024-09-12T17:39:04.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.000+0000 7fcddad0c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:04.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.001+0000 7fcc8efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:04.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.001+0000 7fcddad0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:04.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.001+0000 7fcddad0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:04.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.001+0000 7fcddad0c800 5 note: GC not initialized 2024-09-12T17:39:04.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.001+0000 7fcc8dfdb640 20 reqs_thread_entry: start 2024-09-12T17:39:04.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.002+0000 7fcddad0c800 20 init_complete bucket index max shards: 1 2024-09-12T17:39:04.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.002+0000 7fcddad0c800 20 Filter name: none 2024-09-12T17:39:04.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.002+0000 7fcbff7fe640 20 reqs_thread_entry: start 2024-09-12T17:39:04.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.002+0000 7fcddad0c800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 : miss 2024-09-12T17:39:04.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.002+0000 7fcddad0c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.002+0000 7fcddad0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:04.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.002+0000 7fcddad0c800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x0 2024-09-12T17:39:04.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.002+0000 7fcddad0c800 10 adding default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T17:39:04.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.002+0000 7fcddad0c800 20 failed to read name.$Mr.RGW11111111111111111 with: (2) No such file or directory 2024-09-12T17:39:04.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.002+0000 7fcddad0c800 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-09-12T17:39:04.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.002+0000 7fcddad0c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.003+0000 7fcddad0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:04.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.003+0000 7fcddad0c800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-09-12T17:39:04.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.003+0000 7fcddad0c800 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T17:39:04.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.003+0000 7fcddad0c800 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-09-12T17:39:04.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.004+0000 7fcddad0c800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T17:39:04.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.004+0000 7fcddad0c800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T17:39:04.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.004+0000 7fcddad0c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-09-12T17:39:04.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.004+0000 7fccaf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464439 cookie 94727556306864 notifier 9078 bl.length()=384 2024-09-12T17:39:04.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.004+0000 7fccaf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T17:39:04.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.004+0000 7fccaf7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T17:39:04.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.007+0000 7fcddad0c800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T17:39:04.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.007+0000 7fcddad0c800 10 moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T17:39:04.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.007+0000 7fcddad0c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW11111111111111111, ofs0, ns] 2024-09-12T17:39:04.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.007+0000 7fccaf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464420 cookie 94727556317168 notifier 9078 bl.length()=225 2024-09-12T17:39:04.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.007+0000 7fccaf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T17:39:04.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.007+0000 7fccaf7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T17:39:04.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.010+0000 7fcddad0c800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T17:39:04.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.010+0000 7fcddad0c800 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T17:39:04.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.010+0000 7fcddad0c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-09-12T17:39:04.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.010+0000 7fccaf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464359 cookie 94727556314432 notifier 9078 bl.length()=234 2024-09-12T17:39:04.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.010+0000 7fccaf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T17:39:04.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.010+0000 7fccaf7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T17:39:04.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.013+0000 7fcc8efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:04.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.015+0000 7fcddad0c800 20 remove_watcher() i=0 2024-09-12T17:39:04.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.015+0000 7fcddad0c800 2 removed watcher, disabling cache 2024-09-12T17:39:04.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.016+0000 7fcddad0c800 20 remove_watcher() i=1 2024-09-12T17:39:04.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.017+0000 7fcddad0c800 20 remove_watcher() i=2 2024-09-12T17:39:04.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.018+0000 7fcddad0c800 20 remove_watcher() i=3 2024-09-12T17:39:04.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.019+0000 7fcddad0c800 20 remove_watcher() i=4 2024-09-12T17:39:04.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.020+0000 7fcddad0c800 20 remove_watcher() i=5 2024-09-12T17:39:04.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.021+0000 7fcddad0c800 20 remove_watcher() i=6 2024-09-12T17:39:04.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.022+0000 7fcddad0c800 20 remove_watcher() i=7 2024-09-12T17:39:04.033 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T17:39:04.033 INFO:teuthology.orchestra.run.smithi067.stdout: "id": "RGW11111111111111111", 2024-09-12T17:39:04.033 INFO:teuthology.orchestra.run.smithi067.stdout: "tenant": "", 2024-09-12T17:39:04.033 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "Mr.RGW11111111111111111", 2024-09-12T17:39:04.034 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "RGW11111111111111111+test@test.test", 2024-09-12T17:39:04.034 INFO:teuthology.orchestra.run.smithi067.stdout: "quota": { 2024-09-12T17:39:04.034 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:39:04.034 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:39:04.034 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:39:04.034 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:39:04.034 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:39:04.034 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:39:04.034 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T17:39:04.034 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:39:04.034 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:39:04.034 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:39:04.034 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:39:04.035 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:39:04.035 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:39:04.035 INFO:teuthology.orchestra.run.smithi067.stdout: "max_users": 1000, 2024-09-12T17:39:04.035 INFO:teuthology.orchestra.run.smithi067.stdout: "max_roles": 1000, 2024-09-12T17:39:04.035 INFO:teuthology.orchestra.run.smithi067.stdout: "max_groups": 1000, 2024-09-12T17:39:04.035 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T17:39:04.035 INFO:teuthology.orchestra.run.smithi067.stdout: "max_access_keys": 4 2024-09-12T17:39:04.035 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T17:39:04.036 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-09-12T17:39:04.037 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key QJGBERHKVRJLCDMABGSN --secret mZ8ACN89pojePr7gbCYt+GXSfcEbks3h0S5gJAOcvvO5RqzC1HCWNA== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-09-12T17:39:04.110 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:04.110 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:04.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.144+0000 7f2778abb800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.145+0000 7f2778abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:04.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.145+0000 7f2778abb800 20 realm 2024-09-12T17:39:04.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.145+0000 7f2778abb800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.145+0000 7f2778abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:04.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.145+0000 7f2778abb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:04.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.145+0000 7f2778abb800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.146+0000 7f2778abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:04.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.146+0000 7f2778abb800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.147+0000 7f2778abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:04.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.147+0000 7f2778abb800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.148+0000 7f2778abb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:04.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.148+0000 7f2778abb800 20 searching for the correct realm 2024-09-12T17:39:04.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.151+0000 7f2776da6640 0 -- 172.21.15.67:0/462182865 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x55a6a0ce9e10 msgr2=0x55a6a0cec2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:04.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.154+0000 7f27765a5640 0 -- 172.21.15.67:0/462182865 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f276001a040 msgr2=0x7f276002e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:04.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.159+0000 7f2778abb800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:39:04.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.159+0000 7f2778abb800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:39:04.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.159+0000 7f2778abb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:04.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.159+0000 7f2778abb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:04.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.159+0000 7f2778abb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:04.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.159+0000 7f2778abb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:04.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.159+0000 7f2778abb800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.159+0000 7f2778abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:04.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.159+0000 7f2778abb800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.159+0000 7f2778abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:04.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.159+0000 7f2778abb800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.160+0000 7f2778abb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:04.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.160+0000 7f2778abb800 20 zone default found 2024-09-12T17:39:04.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.160+0000 7f2778abb800 4 Realm: () 2024-09-12T17:39:04.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.160+0000 7f2778abb800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:39:04.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.160+0000 7f2778abb800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:39:04.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.160+0000 7f2778abb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:04.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.160+0000 7f2778abb800 20 zonegroup default 2024-09-12T17:39:04.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.160+0000 7f2778abb800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.160+0000 7f2778abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:04.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.160+0000 7f2778abb800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.160+0000 7f2778abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:04.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.160+0000 7f2778abb800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.161+0000 7f2778abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:04.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.161+0000 7f2778abb800 20 started sync module instance, tier type = 2024-09-12T17:39:04.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.161+0000 7f2778abb800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:39:04.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.170+0000 7f2778abb800 20 add_watcher() i=0 2024-09-12T17:39:04.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.170+0000 7f2778abb800 20 add_watcher() i=1 2024-09-12T17:39:04.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.170+0000 7f2778abb800 20 add_watcher() i=2 2024-09-12T17:39:04.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.170+0000 7f2778abb800 20 add_watcher() i=3 2024-09-12T17:39:04.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.170+0000 7f2778abb800 20 add_watcher() i=4 2024-09-12T17:39:04.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.170+0000 7f2778abb800 20 add_watcher() i=5 2024-09-12T17:39:04.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.170+0000 7f2778abb800 20 add_watcher() i=6 2024-09-12T17:39:04.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.171+0000 7f2778abb800 20 add_watcher() i=7 2024-09-12T17:39:04.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.171+0000 7f2778abb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:04.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.173+0000 7f262cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:04.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.173+0000 7f2778abb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:04.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.173+0000 7f2778abb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:04.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.173+0000 7f2778abb800 5 note: GC not initialized 2024-09-12T17:39:04.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.173+0000 7f25a77fe640 20 reqs_thread_entry: start 2024-09-12T17:39:04.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.173+0000 7f2778abb800 20 init_complete bucket index max shards: 1 2024-09-12T17:39:04.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.173+0000 7f2778abb800 20 Filter name: none 2024-09-12T17:39:04.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.173+0000 7f25a57fa640 20 reqs_thread_entry: start 2024-09-12T17:39:04.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.173+0000 7f2778abb800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T17:39:04.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.173+0000 7f2778abb800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.174+0000 7f2778abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:04.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.174+0000 7f2778abb800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-12T17:39:04.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.174+0000 7f2778abb800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:39:04.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.174+0000 7f2778abb800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-12T17:39:04.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.174+0000 7f2778abb800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.174+0000 7f2778abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:04.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.174+0000 7f2778abb800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-12T17:39:04.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.174+0000 7f2778abb800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T17:39:04.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.174+0000 7f2778abb800 10 cache get: name=default.rgw.meta+users.keys+QJGBERHKVRJLCDMABGSN : miss 2024-09-12T17:39:04.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.174+0000 7f2778abb800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.174+0000 7f2778abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:04.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.174+0000 7f2778abb800 10 cache put: name=default.rgw.meta+users.keys+QJGBERHKVRJLCDMABGSN info.flags=0x0 2024-09-12T17:39:04.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.174+0000 7f2778abb800 10 adding default.rgw.meta+users.keys+QJGBERHKVRJLCDMABGSN to cache LRU end 2024-09-12T17:39:04.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.174+0000 7f2778abb800 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-09-12T17:39:04.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.174+0000 7f2778abb800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.174+0000 7f2778abb800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T17:39:04.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.174+0000 7f2778abb800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T17:39:04.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.174+0000 7f2778abb800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T17:39:04.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.174+0000 7f2778abb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:04.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.175+0000 7f2778abb800 10 cache get: name=default.rgw.meta+users.keys+QJGBERHKVRJLCDMABGSN : hit (negative entry) 2024-09-12T17:39:04.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.175+0000 7f2778abb800 10 cache get: name=default.rgw.meta+users.keys+QJGBERHKVRJLCDMABGSN : hit (negative entry) 2024-09-12T17:39:04.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.176+0000 7f2778abb800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:39:04.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.176+0000 7f2778abb800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:39:04.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.176+0000 7f2778abb800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T17:39:04.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.177+0000 7f2659ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464421 cookie 94174150836784 notifier 8498 bl.length()=673 2024-09-12T17:39:04.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.177+0000 7f2659ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:39:04.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.177+0000 7f2659ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:39:04.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.179+0000 7f2778abb800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T17:39:04.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.179+0000 7f2778abb800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T17:39:04.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.179+0000 7f2778abb800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-12T17:39:04.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.180+0000 7f2659ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464422 cookie 94174150849504 notifier 8498 bl.length()=185 2024-09-12T17:39:04.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.180+0000 7f2659ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T17:39:04.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.180+0000 7f2659ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T17:39:04.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.182+0000 7f2778abb800 10 cache put: name=default.rgw.meta+users.keys+QJGBERHKVRJLCDMABGSN info.flags=0x7 2024-09-12T17:39:04.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.182+0000 7f2778abb800 10 moving default.rgw.meta+users.keys+QJGBERHKVRJLCDMABGSN to cache LRU end 2024-09-12T17:39:04.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.182+0000 7f2778abb800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:QJGBERHKVRJLCDMABGSN, ofs0, ns] 2024-09-12T17:39:04.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.182+0000 7f2659ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464469 cookie 94174150857216 notifier 8498 bl.length()=186 2024-09-12T17:39:04.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.182+0000 7f2659ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+QJGBERHKVRJLCDMABGSN info.flags=0x7 2024-09-12T17:39:04.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.182+0000 7f2659ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+QJGBERHKVRJLCDMABGSN to cache LRU end 2024-09-12T17:39:04.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.184+0000 7f2778abb800 20 linked user foo.client.0 to account RGW11111111111111111 2024-09-12T17:39:04.186 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T17:39:04.186 INFO:teuthology.orchestra.run.smithi067.stdout: "user_id": "foo.client.0", 2024-09-12T17:39:04.187 INFO:teuthology.orchestra.run.smithi067.stdout: "display_name": "Mr.RGW11111111111111111", 2024-09-12T17:39:04.187 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "foo+test@test.test", 2024-09-12T17:39:04.187 INFO:teuthology.orchestra.run.smithi067.stdout: "suspended": 0, 2024-09-12T17:39:04.187 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T17:39:04.187 INFO:teuthology.orchestra.run.smithi067.stdout: "subusers": [], 2024-09-12T17:39:04.187 INFO:teuthology.orchestra.run.smithi067.stdout: "keys": [ 2024-09-12T17:39:04.187 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-12T17:39:04.187 INFO:teuthology.orchestra.run.smithi067.stdout: "user": "foo.client.0", 2024-09-12T17:39:04.187 INFO:teuthology.orchestra.run.smithi067.stdout: "access_key": "QJGBERHKVRJLCDMABGSN", 2024-09-12T17:39:04.187 INFO:teuthology.orchestra.run.smithi067.stdout: "secret_key": "mZ8ACN89pojePr7gbCYt+GXSfcEbks3h0S5gJAOcvvO5RqzC1HCWNA==", 2024-09-12T17:39:04.187 INFO:teuthology.orchestra.run.smithi067.stdout: "active": true, 2024-09-12T17:39:04.187 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T17:39:04.176886Z" 2024-09-12T17:39:04.187 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-12T17:39:04.187 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-12T17:39:04.188 INFO:teuthology.orchestra.run.smithi067.stdout: "swift_keys": [], 2024-09-12T17:39:04.188 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": [], 2024-09-12T17:39:04.188 INFO:teuthology.orchestra.run.smithi067.stdout: "op_mask": "read, write, delete", 2024-09-12T17:39:04.188 INFO:teuthology.orchestra.run.smithi067.stdout: "default_placement": "", 2024-09-12T17:39:04.188 INFO:teuthology.orchestra.run.smithi067.stdout: "default_storage_class": "", 2024-09-12T17:39:04.188 INFO:teuthology.orchestra.run.smithi067.stdout: "placement_tags": [], 2024-09-12T17:39:04.188 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T17:39:04.188 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:39:04.188 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:39:04.188 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:39:04.188 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:39:04.188 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:39:04.188 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:39:04.188 INFO:teuthology.orchestra.run.smithi067.stdout: "user_quota": { 2024-09-12T17:39:04.189 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:39:04.189 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:39:04.189 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:39:04.189 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:39:04.189 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:39:04.189 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:39:04.189 INFO:teuthology.orchestra.run.smithi067.stdout: "temp_url_keys": [], 2024-09-12T17:39:04.189 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "root", 2024-09-12T17:39:04.189 INFO:teuthology.orchestra.run.smithi067.stdout: "mfa_ids": [], 2024-09-12T17:39:04.189 INFO:teuthology.orchestra.run.smithi067.stdout: "account_id": "RGW11111111111111111", 2024-09-12T17:39:04.189 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-12T17:39:04.189 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T17:39:04.176874Z", 2024-09-12T17:39:04.189 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-12T17:39:04.190 INFO:teuthology.orchestra.run.smithi067.stdout: "group_ids": [] 2024-09-12T17:39:04.190 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T17:39:04.190 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:39:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.185+0000 7f262cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.188+0000 7f2778abb800 20 remove_watcher() i=0 2024-09-12T17:39:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.188+0000 7f2778abb800 2 removed watcher, disabling cache 2024-09-12T17:39:04.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.189+0000 7f2778abb800 20 remove_watcher() i=1 2024-09-12T17:39:04.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.190+0000 7f2778abb800 20 remove_watcher() i=2 2024-09-12T17:39:04.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.191+0000 7f2778abb800 20 remove_watcher() i=3 2024-09-12T17:39:04.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.192+0000 7f2778abb800 20 remove_watcher() i=4 2024-09-12T17:39:04.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.193+0000 7f2778abb800 20 remove_watcher() i=5 2024-09-12T17:39:04.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.194+0000 7f2778abb800 20 remove_watcher() i=6 2024-09-12T17:39:04.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.195+0000 7f2778abb800 20 remove_watcher() i=7 2024-09-12T17:39:04.208 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 3527743492 --totp-seed QMD57FJCUZWXGUIDCSPT5ZA7S3U2BKQDK6GYPOWYONFIQ5EG3QOJNHGUYGK2L6JK --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:39:04.277 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:04.277 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:04.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.311+0000 7fcf0e70c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.312+0000 7fcf0e70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:04.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.312+0000 7fcf0e70c800 20 realm 2024-09-12T17:39:04.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.312+0000 7fcf0e70c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.312+0000 7fcf0e70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:04.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.312+0000 7fcf0e70c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:04.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.312+0000 7fcf0e70c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.313+0000 7fcf0e70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:04.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.313+0000 7fcf0e70c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.313+0000 7fcf0e70c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:04.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.313+0000 7fcf0e70c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.314+0000 7fcf0e70c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:04.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.314+0000 7fcf0e70c800 20 searching for the correct realm 2024-09-12T17:39:04.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.318+0000 7fcf0b9f5640 0 -- 172.21.15.67:0/4249030947 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x55f7240d56e0 msgr2=0x55f7240d7ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:04.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.321+0000 7fcf0b9f5640 0 -- 172.21.15.67:0/4249030947 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x7fcdd4086310 msgr2=0x7fcdd4088740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:04.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.325+0000 7fcf0e70c800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:39:04.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.325+0000 7fcf0e70c800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:39:04.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.325+0000 7fcf0e70c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:04.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.325+0000 7fcf0e70c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:04.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.325+0000 7fcf0e70c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:04.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.325+0000 7fcf0e70c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:04.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.325+0000 7fcf0e70c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.326+0000 7fcf0e70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:04.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.326+0000 7fcf0e70c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.326+0000 7fcf0e70c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:04.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.326+0000 7fcf0e70c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.326+0000 7fcf0e70c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:04.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.326+0000 7fcf0e70c800 20 zone default found 2024-09-12T17:39:04.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.326+0000 7fcf0e70c800 4 Realm: () 2024-09-12T17:39:04.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.326+0000 7fcf0e70c800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:39:04.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.326+0000 7fcf0e70c800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:39:04.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.326+0000 7fcf0e70c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:04.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.326+0000 7fcf0e70c800 20 zonegroup default 2024-09-12T17:39:04.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.326+0000 7fcf0e70c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.326+0000 7fcf0e70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:04.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.326+0000 7fcf0e70c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.327+0000 7fcf0e70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:04.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.327+0000 7fcf0e70c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.327+0000 7fcf0e70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:04.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.327+0000 7fcf0e70c800 20 started sync module instance, tier type = 2024-09-12T17:39:04.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.327+0000 7fcf0e70c800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:39:04.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.336+0000 7fcf0e70c800 20 add_watcher() i=0 2024-09-12T17:39:04.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.336+0000 7fcf0e70c800 20 add_watcher() i=1 2024-09-12T17:39:04.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.336+0000 7fcf0e70c800 20 add_watcher() i=2 2024-09-12T17:39:04.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.336+0000 7fcf0e70c800 20 add_watcher() i=3 2024-09-12T17:39:04.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.336+0000 7fcf0e70c800 20 add_watcher() i=4 2024-09-12T17:39:04.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.336+0000 7fcf0e70c800 20 add_watcher() i=5 2024-09-12T17:39:04.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.336+0000 7fcf0e70c800 20 add_watcher() i=6 2024-09-12T17:39:04.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.337+0000 7fcf0e70c800 20 add_watcher() i=7 2024-09-12T17:39:04.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.337+0000 7fcf0e70c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:04.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.339+0000 7fcdc2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:04.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.339+0000 7fcf0e70c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:04.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.339+0000 7fcf0e70c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:04.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.339+0000 7fcf0e70c800 5 note: GC not initialized 2024-09-12T17:39:04.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.339+0000 7fcdc1fdb640 20 reqs_thread_entry: start 2024-09-12T17:39:04.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.340+0000 7fcf0e70c800 20 init_complete bucket index max shards: 1 2024-09-12T17:39:04.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.340+0000 7fcf0e70c800 20 Filter name: none 2024-09-12T17:39:04.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.340+0000 7fcd337fe640 20 reqs_thread_entry: start 2024-09-12T17:39:04.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.340+0000 7fcf0e70c800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T17:39:04.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.340+0000 7fcf0e70c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:04.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.340+0000 7fcf0e70c800 20 rados_obj.operate() r=0 bl.length=488 2024-09-12T17:39:04.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.340+0000 7fcf0e70c800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-12T17:39:04.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.340+0000 7fcf0e70c800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:39:04.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:04.340+0000 7fcf0e70c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:05.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:05.932+0000 7fcf0e70c800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:39:05.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:05.932+0000 7fcf0e70c800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:39:05.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:05.932+0000 7fcf0e70c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T17:39:05.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:05.933+0000 7fcde2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399015 cookie 94519950146512 notifier 8513 bl.length()=687 2024-09-12T17:39:05.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:05.933+0000 7fcde2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:39:05.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:05.933+0000 7fcde2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:39:05.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:05.936+0000 7fcdc2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:05.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:05.939+0000 7fcf0e70c800 20 remove_watcher() i=0 2024-09-12T17:39:05.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:05.939+0000 7fcf0e70c800 2 removed watcher, disabling cache 2024-09-12T17:39:05.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:05.941+0000 7fcf0e70c800 20 remove_watcher() i=1 2024-09-12T17:39:05.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:05.942+0000 7fcf0e70c800 20 remove_watcher() i=2 2024-09-12T17:39:05.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:05.943+0000 7fcf0e70c800 20 remove_watcher() i=3 2024-09-12T17:39:05.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:05.945+0000 7fcf0e70c800 20 remove_watcher() i=4 2024-09-12T17:39:05.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:05.946+0000 7fcf0e70c800 20 remove_watcher() i=5 2024-09-12T17:39:05.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:05.947+0000 7fcf0e70c800 20 remove_watcher() i=6 2024-09-12T17:39:05.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:05.948+0000 7fcf0e70c800 20 remove_watcher() i=7 2024-09-12T17:39:05.964 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-12T17:39:05.964 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key FUBRXFTOIPTDPJHFJXTE --secret fK23l2FVRqDaSqzXNXlEGhyj3Jf8AJh2H2tm8gLr9k1xzAhhX2PtgQ== --cluster ceph 2024-09-12T17:39:06.034 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:06.034 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:06.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.070+0000 7fa77111f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.071+0000 7fa77111f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.071+0000 7fa77111f800 20 realm 2024-09-12T17:39:06.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.071+0000 7fa77111f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.071+0000 7fa77111f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.071+0000 7fa77111f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:06.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.071+0000 7fa77111f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.072+0000 7fa77111f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.072+0000 7fa77111f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.072+0000 7fa77111f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:06.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.072+0000 7fa77111f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.073+0000 7fa77111f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:06.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.073+0000 7fa77111f800 20 searching for the correct realm 2024-09-12T17:39:06.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.075+0000 7fa76c6a1640 0 -- 172.21.15.67:0/1285807299 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7fa75c017070 msgr2=0x7fa75c0879d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:06.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.079+0000 7fa76c6a1640 0 -- 172.21.15.67:0/1285807299 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7fa75c017070 msgr2=0x7fa63808bd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:06.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.084+0000 7fa77111f800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:39:06.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.084+0000 7fa77111f800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:39:06.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.084+0000 7fa77111f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:06.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.084+0000 7fa77111f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:06.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.084+0000 7fa77111f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:06.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.084+0000 7fa77111f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:06.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.084+0000 7fa77111f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.084+0000 7fa77111f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.084+0000 7fa77111f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.085+0000 7fa77111f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:06.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.085+0000 7fa77111f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.085+0000 7fa77111f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:06.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.085+0000 7fa77111f800 20 zone default found 2024-09-12T17:39:06.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.085+0000 7fa77111f800 4 Realm: () 2024-09-12T17:39:06.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.085+0000 7fa77111f800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:39:06.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.085+0000 7fa77111f800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:39:06.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.085+0000 7fa77111f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:06.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.085+0000 7fa77111f800 20 zonegroup default 2024-09-12T17:39:06.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.085+0000 7fa77111f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.085+0000 7fa77111f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.085+0000 7fa77111f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.085+0000 7fa77111f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.085+0000 7fa77111f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.086+0000 7fa77111f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.086+0000 7fa77111f800 20 started sync module instance, tier type = 2024-09-12T17:39:06.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.086+0000 7fa77111f800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:39:06.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.095+0000 7fa77111f800 20 add_watcher() i=0 2024-09-12T17:39:06.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.095+0000 7fa77111f800 20 add_watcher() i=1 2024-09-12T17:39:06.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.095+0000 7fa77111f800 20 add_watcher() i=2 2024-09-12T17:39:06.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.095+0000 7fa77111f800 20 add_watcher() i=3 2024-09-12T17:39:06.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.095+0000 7fa77111f800 20 add_watcher() i=4 2024-09-12T17:39:06.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.095+0000 7fa77111f800 20 add_watcher() i=5 2024-09-12T17:39:06.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.095+0000 7fa77111f800 20 add_watcher() i=6 2024-09-12T17:39:06.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.096+0000 7fa77111f800 20 add_watcher() i=7 2024-09-12T17:39:06.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.096+0000 7fa77111f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:06.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.097+0000 7fa622fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:06.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.097+0000 7fa77111f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:06.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.097+0000 7fa77111f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:06.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.097+0000 7fa77111f800 5 note: GC not initialized 2024-09-12T17:39:06.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.098+0000 7fa621fe3640 20 reqs_thread_entry: start 2024-09-12T17:39:06.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.098+0000 7fa77111f800 20 init_complete bucket index max shards: 1 2024-09-12T17:39:06.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.098+0000 7fa77111f800 20 Filter name: none 2024-09-12T17:39:06.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.098+0000 7fa5937fe640 20 reqs_thread_entry: start 2024-09-12T17:39:06.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.098+0000 7fa77111f800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T17:39:06.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.098+0000 7fa77111f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.098+0000 7fa77111f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.098+0000 7fa77111f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-12T17:39:06.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.098+0000 7fa77111f800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:39:06.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.098+0000 7fa77111f800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-12T17:39:06.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.098+0000 7fa77111f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.099+0000 7fa77111f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.099+0000 7fa77111f800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-12T17:39:06.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.099+0000 7fa77111f800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T17:39:06.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.099+0000 7fa77111f800 10 cache get: name=default.rgw.meta+users.keys+FUBRXFTOIPTDPJHFJXTE : miss 2024-09-12T17:39:06.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.099+0000 7fa77111f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.099+0000 7fa77111f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.099+0000 7fa77111f800 10 cache put: name=default.rgw.meta+users.keys+FUBRXFTOIPTDPJHFJXTE info.flags=0x0 2024-09-12T17:39:06.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.099+0000 7fa77111f800 10 adding default.rgw.meta+users.keys+FUBRXFTOIPTDPJHFJXTE to cache LRU end 2024-09-12T17:39:06.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.099+0000 7fa77111f800 10 cache get: name=default.rgw.meta+users.keys+FUBRXFTOIPTDPJHFJXTE : hit (negative entry) 2024-09-12T17:39:06.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.099+0000 7fa77111f800 10 cache get: name=default.rgw.meta+users.keys+FUBRXFTOIPTDPJHFJXTE : hit (negative entry) 2024-09-12T17:39:06.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.100+0000 7fa77111f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:39:06.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.100+0000 7fa77111f800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:39:06.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.100+0000 7fa77111f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T17:39:06.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.101+0000 7fa643fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399032 cookie 94650170771552 notifier 9132 bl.length()=645 2024-09-12T17:39:06.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.101+0000 7fa643fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:39:06.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.101+0000 7fa643fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:39:06.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.104+0000 7fa77111f800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T17:39:06.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.104+0000 7fa77111f800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T17:39:06.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.104+0000 7fa77111f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-12T17:39:06.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.104+0000 7fa643fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399062 cookie 94650170788640 notifier 9132 bl.length()=185 2024-09-12T17:39:06.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.104+0000 7fa643fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T17:39:06.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.104+0000 7fa643fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T17:39:06.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.106+0000 7fa77111f800 10 cache put: name=default.rgw.meta+users.keys+FUBRXFTOIPTDPJHFJXTE info.flags=0x7 2024-09-12T17:39:06.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.106+0000 7fa77111f800 10 moving default.rgw.meta+users.keys+FUBRXFTOIPTDPJHFJXTE to cache LRU end 2024-09-12T17:39:06.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.106+0000 7fa77111f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:FUBRXFTOIPTDPJHFJXTE, ofs0, ns] 2024-09-12T17:39:06.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.106+0000 7fa643fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399063 cookie 94650170792624 notifier 9132 bl.length()=186 2024-09-12T17:39:06.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.106+0000 7fa643fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+FUBRXFTOIPTDPJHFJXTE info.flags=0x7 2024-09-12T17:39:06.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.106+0000 7fa643fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+FUBRXFTOIPTDPJHFJXTE to cache LRU end 2024-09-12T17:39:06.110 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T17:39:06.110 INFO:teuthology.orchestra.run.smithi067.stdout: "user_id": "bar.client.0", 2024-09-12T17:39:06.110 INFO:teuthology.orchestra.run.smithi067.stdout: "display_name": "Mr.bar.client.0", 2024-09-12T17:39:06.110 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "bar+test@test.test", 2024-09-12T17:39:06.110 INFO:teuthology.orchestra.run.smithi067.stdout: "suspended": 0, 2024-09-12T17:39:06.110 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T17:39:06.110 INFO:teuthology.orchestra.run.smithi067.stdout: "subusers": [], 2024-09-12T17:39:06.110 INFO:teuthology.orchestra.run.smithi067.stdout: "keys": [ 2024-09-12T17:39:06.110 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-12T17:39:06.110 INFO:teuthology.orchestra.run.smithi067.stdout: "user": "bar.client.0", 2024-09-12T17:39:06.110 INFO:teuthology.orchestra.run.smithi067.stdout: "access_key": "FUBRXFTOIPTDPJHFJXTE", 2024-09-12T17:39:06.111 INFO:teuthology.orchestra.run.smithi067.stdout: "secret_key": "fK23l2FVRqDaSqzXNXlEGhyj3Jf8AJh2H2tm8gLr9k1xzAhhX2PtgQ==", 2024-09-12T17:39:06.111 INFO:teuthology.orchestra.run.smithi067.stdout: "active": true, 2024-09-12T17:39:06.111 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T17:39:06.101248Z" 2024-09-12T17:39:06.111 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-12T17:39:06.111 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-12T17:39:06.111 INFO:teuthology.orchestra.run.smithi067.stdout: "swift_keys": [], 2024-09-12T17:39:06.111 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": [], 2024-09-12T17:39:06.111 INFO:teuthology.orchestra.run.smithi067.stdout: "op_mask": "read, write, delete", 2024-09-12T17:39:06.111 INFO:teuthology.orchestra.run.smithi067.stdout: "default_placement": "", 2024-09-12T17:39:06.111 INFO:teuthology.orchestra.run.smithi067.stdout: "default_storage_class": "", 2024-09-12T17:39:06.111 INFO:teuthology.orchestra.run.smithi067.stdout: "placement_tags": [], 2024-09-12T17:39:06.111 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T17:39:06.111 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:39:06.111 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:39:06.112 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:39:06.112 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:39:06.112 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:39:06.112 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:39:06.112 INFO:teuthology.orchestra.run.smithi067.stdout: "user_quota": { 2024-09-12T17:39:06.112 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:39:06.112 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:39:06.112 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:39:06.112 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:39:06.112 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:39:06.112 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:39:06.112 INFO:teuthology.orchestra.run.smithi067.stdout: "temp_url_keys": [], 2024-09-12T17:39:06.112 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "rgw", 2024-09-12T17:39:06.113 INFO:teuthology.orchestra.run.smithi067.stdout: "mfa_ids": [], 2024-09-12T17:39:06.113 INFO:teuthology.orchestra.run.smithi067.stdout: "account_id": "", 2024-09-12T17:39:06.113 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-12T17:39:06.113 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T17:39:06.101236Z", 2024-09-12T17:39:06.113 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-12T17:39:06.113 INFO:teuthology.orchestra.run.smithi067.stdout: "group_ids": [] 2024-09-12T17:39:06.113 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T17:39:06.113 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:39:06.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.109+0000 7fa622fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:06.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.111+0000 7fa77111f800 20 remove_watcher() i=0 2024-09-12T17:39:06.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.111+0000 7fa77111f800 2 removed watcher, disabling cache 2024-09-12T17:39:06.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.112+0000 7fa77111f800 20 remove_watcher() i=1 2024-09-12T17:39:06.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.113+0000 7fa77111f800 20 remove_watcher() i=2 2024-09-12T17:39:06.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.114+0000 7fa77111f800 20 remove_watcher() i=3 2024-09-12T17:39:06.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.115+0000 7fa77111f800 20 remove_watcher() i=4 2024-09-12T17:39:06.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.116+0000 7fa77111f800 20 remove_watcher() i=5 2024-09-12T17:39:06.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.117+0000 7fa77111f800 20 remove_watcher() i=6 2024-09-12T17:39:06.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.118+0000 7fa77111f800 20 remove_watcher() i=7 2024-09-12T17:39:06.132 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 1997921444 --totp-seed WUWYP4DJ3XVWVVTR4WCTOK5TBGXC2QM7QAJLYIBN725UZZIYV5NJGEV3DPFY5YRZ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:39:06.200 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:06.200 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:06.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.234+0000 7fa4b1539800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.236+0000 7fa4b1539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.236+0000 7fa4b1539800 20 realm 2024-09-12T17:39:06.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.236+0000 7fa4b1539800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.236+0000 7fa4b1539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.236+0000 7fa4b1539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:06.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.236+0000 7fa4b1539800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.236+0000 7fa4b1539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.236+0000 7fa4b1539800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.237+0000 7fa4b1539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:06.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.237+0000 7fa4b1539800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.237+0000 7fa4b1539800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:06.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.237+0000 7fa4b1539800 20 searching for the correct realm 2024-09-12T17:39:06.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.240+0000 7fa4ad9c8640 0 -- 172.21.15.67:0/2981712640 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x55b2d4d30f40 msgr2=0x55b2d4d33400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:39:06.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.244+0000 7fa4ad1c7640 0 -- 172.21.15.67:0/2981712640 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fa4a40d6b70 msgr2=0x7fa4a40bb940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:06.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.248+0000 7fa4b1539800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:39:06.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.248+0000 7fa4b1539800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:39:06.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.248+0000 7fa4b1539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:06.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.248+0000 7fa4b1539800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:06.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.248+0000 7fa4b1539800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:06.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.248+0000 7fa4b1539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:06.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.248+0000 7fa4b1539800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.248+0000 7fa4b1539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.248+0000 7fa4b1539800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.249+0000 7fa4b1539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:06.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.249+0000 7fa4b1539800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.249+0000 7fa4b1539800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:06.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.249+0000 7fa4b1539800 20 zone default found 2024-09-12T17:39:06.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.249+0000 7fa4b1539800 4 Realm: () 2024-09-12T17:39:06.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.249+0000 7fa4b1539800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:39:06.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.249+0000 7fa4b1539800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:39:06.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.249+0000 7fa4b1539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:06.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.249+0000 7fa4b1539800 20 zonegroup default 2024-09-12T17:39:06.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.249+0000 7fa4b1539800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.249+0000 7fa4b1539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.249+0000 7fa4b1539800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.250+0000 7fa4b1539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.250+0000 7fa4b1539800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.250+0000 7fa4b1539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.250+0000 7fa4b1539800 20 started sync module instance, tier type = 2024-09-12T17:39:06.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.250+0000 7fa4b1539800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:39:06.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.259+0000 7fa4b1539800 20 add_watcher() i=0 2024-09-12T17:39:06.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.259+0000 7fa4b1539800 20 add_watcher() i=1 2024-09-12T17:39:06.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.259+0000 7fa4b1539800 20 add_watcher() i=2 2024-09-12T17:39:06.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.259+0000 7fa4b1539800 20 add_watcher() i=3 2024-09-12T17:39:06.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.259+0000 7fa4b1539800 20 add_watcher() i=4 2024-09-12T17:39:06.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.259+0000 7fa4b1539800 20 add_watcher() i=5 2024-09-12T17:39:06.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.259+0000 7fa4b1539800 20 add_watcher() i=6 2024-09-12T17:39:06.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.260+0000 7fa4b1539800 20 add_watcher() i=7 2024-09-12T17:39:06.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.260+0000 7fa4b1539800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:06.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.261+0000 7fa363fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:06.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.261+0000 7fa4b1539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:06.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.261+0000 7fa4b1539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:06.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.261+0000 7fa4b1539800 5 note: GC not initialized 2024-09-12T17:39:06.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.262+0000 7fa362fe5640 20 reqs_thread_entry: start 2024-09-12T17:39:06.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.262+0000 7fa4b1539800 20 init_complete bucket index max shards: 1 2024-09-12T17:39:06.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.262+0000 7fa4b1539800 20 Filter name: none 2024-09-12T17:39:06.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.262+0000 7fa360fe1640 20 reqs_thread_entry: start 2024-09-12T17:39:06.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.262+0000 7fa4b1539800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T17:39:06.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.262+0000 7fa4b1539800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.263+0000 7fa4b1539800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T17:39:06.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.263+0000 7fa4b1539800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-12T17:39:06.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.263+0000 7fa4b1539800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:39:06.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.263+0000 7fa4b1539800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:06.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.265+0000 7fa4b1539800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:39:06.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.265+0000 7fa4b1539800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:39:06.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.265+0000 7fa4b1539800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T17:39:06.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.266+0000 7fa390ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399033 cookie 94226563147408 notifier 8546 bl.length()=659 2024-09-12T17:39:06.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.266+0000 7fa390ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:39:06.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.266+0000 7fa390ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:39:06.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.268+0000 7fa363fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:06.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.270+0000 7fa4b1539800 20 remove_watcher() i=0 2024-09-12T17:39:06.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.270+0000 7fa4b1539800 2 removed watcher, disabling cache 2024-09-12T17:39:06.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.272+0000 7fa4b1539800 20 remove_watcher() i=1 2024-09-12T17:39:06.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.273+0000 7fa4b1539800 20 remove_watcher() i=2 2024-09-12T17:39:06.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.274+0000 7fa4b1539800 20 remove_watcher() i=3 2024-09-12T17:39:06.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.275+0000 7fa4b1539800 20 remove_watcher() i=4 2024-09-12T17:39:06.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.276+0000 7fa4b1539800 20 remove_watcher() i=5 2024-09-12T17:39:06.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.277+0000 7fa4b1539800 20 remove_watcher() i=6 2024-09-12T17:39:06.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.278+0000 7fa4b1539800 20 remove_watcher() i=7 2024-09-12T17:39:06.291 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-09-12T17:39:06.355 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:06.355 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:06.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.389+0000 7fd79020e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.391+0000 7fd79020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.391+0000 7fd79020e800 20 realm 2024-09-12T17:39:06.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.391+0000 7fd79020e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.391+0000 7fd79020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.391+0000 7fd79020e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:06.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.391+0000 7fd79020e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.391+0000 7fd79020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.391+0000 7fd79020e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.392+0000 7fd79020e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:06.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.392+0000 7fd79020e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.393+0000 7fd79020e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:06.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.393+0000 7fd79020e800 20 searching for the correct realm 2024-09-12T17:39:06.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.395+0000 7fd78b96b640 0 -- 172.21.15.67:0/3967940723 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7fd784025040 msgr2=0x7fd784064f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:06.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.399+0000 7fd78b96b640 0 -- 172.21.15.67:0/3967940723 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fd7800a91d0 msgr2=0x7fd7800ab830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:06.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.604+0000 7fd79020e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:39:06.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.604+0000 7fd79020e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:39:06.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.604+0000 7fd79020e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:06.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.604+0000 7fd79020e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:06.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.604+0000 7fd79020e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:06.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.604+0000 7fd79020e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:06.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.604+0000 7fd79020e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.605+0000 7fd79020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.605+0000 7fd79020e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.605+0000 7fd79020e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:06.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.605+0000 7fd79020e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.605+0000 7fd79020e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:06.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.605+0000 7fd79020e800 20 zone default found 2024-09-12T17:39:06.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.605+0000 7fd79020e800 4 Realm: () 2024-09-12T17:39:06.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.605+0000 7fd79020e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:39:06.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.605+0000 7fd79020e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:39:06.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.605+0000 7fd79020e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:06.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.605+0000 7fd79020e800 20 zonegroup default 2024-09-12T17:39:06.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.605+0000 7fd79020e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.606+0000 7fd79020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.606+0000 7fd79020e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.606+0000 7fd79020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.606+0000 7fd79020e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.606+0000 7fd79020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.606+0000 7fd79020e800 20 started sync module instance, tier type = 2024-09-12T17:39:06.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.606+0000 7fd79020e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:39:06.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.616+0000 7fd79020e800 20 add_watcher() i=0 2024-09-12T17:39:06.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.616+0000 7fd79020e800 20 add_watcher() i=1 2024-09-12T17:39:06.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.616+0000 7fd79020e800 20 add_watcher() i=2 2024-09-12T17:39:06.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.616+0000 7fd79020e800 20 add_watcher() i=3 2024-09-12T17:39:06.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.616+0000 7fd79020e800 20 add_watcher() i=4 2024-09-12T17:39:06.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.616+0000 7fd79020e800 20 add_watcher() i=5 2024-09-12T17:39:06.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.616+0000 7fd79020e800 20 add_watcher() i=6 2024-09-12T17:39:06.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.616+0000 7fd79020e800 20 add_watcher() i=7 2024-09-12T17:39:06.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.616+0000 7fd79020e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:06.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.618+0000 7fd641fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:06.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.618+0000 7fd79020e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:06.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.618+0000 7fd79020e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:06.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.618+0000 7fd79020e800 5 note: GC not initialized 2024-09-12T17:39:06.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.618+0000 7fd640fe1640 20 reqs_thread_entry: start 2024-09-12T17:39:06.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.619+0000 7fd79020e800 20 init_complete bucket index max shards: 1 2024-09-12T17:39:06.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.619+0000 7fd79020e800 20 Filter name: none 2024-09-12T17:39:06.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.619+0000 7fd5ba7fc640 20 reqs_thread_entry: start 2024-09-12T17:39:06.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.619+0000 7fd79020e800 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-09-12T17:39:06.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.619+0000 7fd79020e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.619+0000 7fd79020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.619+0000 7fd79020e800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-09-12T17:39:06.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.619+0000 7fd79020e800 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T17:39:06.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.619+0000 7fd79020e800 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-09-12T17:39:06.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.619+0000 7fd79020e800 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-09-12T17:39:06.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.619+0000 7fd79020e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.620+0000 7fd79020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.620+0000 7fd79020e800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-09-12T17:39:06.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.620+0000 7fd79020e800 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T17:39:06.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.620+0000 7fd79020e800 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-09-12T17:39:06.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.621+0000 7fd79020e800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T17:39:06.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.621+0000 7fd79020e800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T17:39:06.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.621+0000 7fd79020e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-09-12T17:39:06.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.621+0000 7fd66affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399034 cookie 93848646412896 notifier 8564 bl.length()=389 2024-09-12T17:39:06.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.621+0000 7fd66affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T17:39:06.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.621+0000 7fd66affd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T17:39:06.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.624+0000 7fd79020e800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T17:39:06.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.624+0000 7fd79020e800 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T17:39:06.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.624+0000 7fd79020e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-09-12T17:39:06.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.625+0000 7fd66affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399016 cookie 93848646420752 notifier 8564 bl.length()=230 2024-09-12T17:39:06.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.625+0000 7fd66affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T17:39:06.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.625+0000 7fd66affd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T17:39:06.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.628+0000 7fd79020e800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T17:39:06.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.628+0000 7fd79020e800 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T17:39:06.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.628+0000 7fd79020e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-09-12T17:39:06.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.628+0000 7fd66affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398952 cookie 93848646427024 notifier 8564 bl.length()=234 2024-09-12T17:39:06.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.628+0000 7fd66affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T17:39:06.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.628+0000 7fd66affd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T17:39:06.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.631+0000 7fd641fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:06.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.633+0000 7fd79020e800 20 remove_watcher() i=0 2024-09-12T17:39:06.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.633+0000 7fd79020e800 2 removed watcher, disabling cache 2024-09-12T17:39:06.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.634+0000 7fd79020e800 20 remove_watcher() i=1 2024-09-12T17:39:06.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.635+0000 7fd79020e800 20 remove_watcher() i=2 2024-09-12T17:39:06.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.636+0000 7fd79020e800 20 remove_watcher() i=3 2024-09-12T17:39:06.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.637+0000 7fd79020e800 20 remove_watcher() i=4 2024-09-12T17:39:06.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.638+0000 7fd79020e800 20 remove_watcher() i=5 2024-09-12T17:39:06.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.639+0000 7fd79020e800 20 remove_watcher() i=6 2024-09-12T17:39:06.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.640+0000 7fd79020e800 20 remove_watcher() i=7 2024-09-12T17:39:06.652 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T17:39:06.652 INFO:teuthology.orchestra.run.smithi067.stdout: "id": "RGW33333333333333333", 2024-09-12T17:39:06.652 INFO:teuthology.orchestra.run.smithi067.stdout: "tenant": "testx", 2024-09-12T17:39:06.652 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "Mr.RGW33333333333333333", 2024-09-12T17:39:06.653 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "RGW33333333333333333+test@test.test", 2024-09-12T17:39:06.653 INFO:teuthology.orchestra.run.smithi067.stdout: "quota": { 2024-09-12T17:39:06.653 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:39:06.653 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:39:06.653 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:39:06.653 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:39:06.653 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:39:06.654 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:39:06.654 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T17:39:06.654 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:39:06.654 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:39:06.654 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:39:06.654 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:39:06.654 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:39:06.655 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:39:06.655 INFO:teuthology.orchestra.run.smithi067.stdout: "max_users": 1000, 2024-09-12T17:39:06.655 INFO:teuthology.orchestra.run.smithi067.stdout: "max_roles": 1000, 2024-09-12T17:39:06.655 INFO:teuthology.orchestra.run.smithi067.stdout: "max_groups": 1000, 2024-09-12T17:39:06.655 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T17:39:06.655 INFO:teuthology.orchestra.run.smithi067.stdout: "max_access_keys": 4 2024-09-12T17:39:06.656 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T17:39:06.657 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-09-12T17:39:06.658 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key QBSMVUEZUASJUXZYFSYH --secret CNj11FoJiE427eerAupnvtz/4GdSlzXp/n2yb5d/6w5yo85fm4Onwg== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-09-12T17:39:06.728 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:06.729 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:06.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.762+0000 7f2d8d935800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.764+0000 7f2d8d935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.764+0000 7f2d8d935800 20 realm 2024-09-12T17:39:06.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.764+0000 7f2d8d935800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.764+0000 7f2d8d935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.764+0000 7f2d8d935800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:06.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.764+0000 7f2d8d935800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.764+0000 7f2d8d935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.764+0000 7f2d8d935800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.765+0000 7f2d8d935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:06.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.765+0000 7f2d8d935800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.766+0000 7f2d8d935800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:06.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.766+0000 7f2d8d935800 20 searching for the correct realm 2024-09-12T17:39:06.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.768+0000 7f2d88ee3640 0 -- 172.21.15.67:0/1310412731 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x555be6092810 msgr2=0x555be6094c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:06.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.772+0000 7f2d896e4640 0 -- 172.21.15.67:0/1310412731 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f2d8005fa30 msgr2=0x7f2d80086a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:39:06.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.991+0000 7f2d8d935800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:39:06.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.991+0000 7f2d8d935800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:39:06.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.991+0000 7f2d8d935800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.991+0000 7f2d8d935800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.991+0000 7f2d8d935800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.991+0000 7f2d8d935800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.991+0000 7f2d8d935800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.991+0000 7f2d8d935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.991+0000 7f2d8d935800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.991+0000 7f2d8d935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.991+0000 7f2d8d935800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.992+0000 7f2d8d935800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:06.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.992+0000 7f2d8d935800 20 zone default found 2024-09-12T17:39:06.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.992+0000 7f2d8d935800 4 Realm: () 2024-09-12T17:39:06.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.992+0000 7f2d8d935800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:39:06.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.992+0000 7f2d8d935800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:39:06.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.992+0000 7f2d8d935800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:06.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.992+0000 7f2d8d935800 20 zonegroup default 2024-09-12T17:39:06.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.992+0000 7f2d8d935800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.992+0000 7f2d8d935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.992+0000 7f2d8d935800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.992+0000 7f2d8d935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.992+0000 7f2d8d935800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.992+0000 7f2d8d935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.992+0000 7f2d8d935800 20 started sync module instance, tier type = 2024-09-12T17:39:06.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:06.992+0000 7f2d8d935800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:39:07.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.002+0000 7f2d8d935800 20 add_watcher() i=0 2024-09-12T17:39:07.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.002+0000 7f2d8d935800 20 add_watcher() i=1 2024-09-12T17:39:07.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.002+0000 7f2d8d935800 20 add_watcher() i=2 2024-09-12T17:39:07.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.002+0000 7f2d8d935800 20 add_watcher() i=3 2024-09-12T17:39:07.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.002+0000 7f2d8d935800 20 add_watcher() i=4 2024-09-12T17:39:07.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.002+0000 7f2d8d935800 20 add_watcher() i=5 2024-09-12T17:39:07.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.002+0000 7f2d8d935800 20 add_watcher() i=6 2024-09-12T17:39:07.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.003+0000 7f2d8d935800 20 add_watcher() i=7 2024-09-12T17:39:07.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.003+0000 7f2d8d935800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:07.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.004+0000 7f2c3f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:07.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.004+0000 7f2d8d935800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:07.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.004+0000 7f2d8d935800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:07.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.005+0000 7f2d8d935800 5 note: GC not initialized 2024-09-12T17:39:07.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.005+0000 7f2c3e7e4640 20 reqs_thread_entry: start 2024-09-12T17:39:07.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.005+0000 7f2d8d935800 20 init_complete bucket index max shards: 1 2024-09-12T17:39:07.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.005+0000 7f2d8d935800 20 Filter name: none 2024-09-12T17:39:07.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.005+0000 7f2baffff640 20 reqs_thread_entry: start 2024-09-12T17:39:07.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.005+0000 7f2d8d935800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T17:39:07.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.005+0000 7f2d8d935800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.005+0000 7f2d8d935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.005+0000 7f2d8d935800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-12T17:39:07.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.005+0000 7f2d8d935800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:39:07.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.005+0000 7f2d8d935800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-12T17:39:07.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.005+0000 7f2d8d935800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.006+0000 7f2d8d935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.006+0000 7f2d8d935800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-12T17:39:07.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.006+0000 7f2d8d935800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T17:39:07.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.006+0000 7f2d8d935800 10 cache get: name=default.rgw.meta+users.keys+QBSMVUEZUASJUXZYFSYH : miss 2024-09-12T17:39:07.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.006+0000 7f2d8d935800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.006+0000 7f2d8d935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.006+0000 7f2d8d935800 10 cache put: name=default.rgw.meta+users.keys+QBSMVUEZUASJUXZYFSYH info.flags=0x0 2024-09-12T17:39:07.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.006+0000 7f2d8d935800 10 adding default.rgw.meta+users.keys+QBSMVUEZUASJUXZYFSYH to cache LRU end 2024-09-12T17:39:07.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.006+0000 7f2d8d935800 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-09-12T17:39:07.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.006+0000 7f2d8d935800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.007+0000 7f2d8d935800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:39:07.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.007+0000 7f2d8d935800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T17:39:07.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.007+0000 7f2d8d935800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T17:39:07.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.007+0000 7f2d8d935800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:07.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.007+0000 7f2d8d935800 10 cache get: name=default.rgw.meta+users.keys+QBSMVUEZUASJUXZYFSYH : hit (negative entry) 2024-09-12T17:39:07.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.007+0000 7f2d8d935800 10 cache get: name=default.rgw.meta+users.keys+QBSMVUEZUASJUXZYFSYH : hit (negative entry) 2024-09-12T17:39:07.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.008+0000 7f2d8d935800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:39:07.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.008+0000 7f2d8d935800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:39:07.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.008+0000 7f2d8d935800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T17:39:07.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.008+0000 7f2c6cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366360 cookie 93853189788912 notifier 9186 bl.length()=732 2024-09-12T17:39:07.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.008+0000 7f2c6cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:39:07.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.008+0000 7f2c6cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:39:07.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.012+0000 7f2d8d935800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T17:39:07.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.012+0000 7f2d8d935800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T17:39:07.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.012+0000 7f2d8d935800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-12T17:39:07.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.012+0000 7f2c6cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366226 cookie 93853189794080 notifier 9186 bl.length()=215 2024-09-12T17:39:07.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.012+0000 7f2c6cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T17:39:07.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.012+0000 7f2c6cff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T17:39:07.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.014+0000 7f2d8d935800 10 cache put: name=default.rgw.meta+users.keys+QBSMVUEZUASJUXZYFSYH info.flags=0x7 2024-09-12T17:39:07.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.014+0000 7f2d8d935800 10 moving default.rgw.meta+users.keys+QBSMVUEZUASJUXZYFSYH to cache LRU end 2024-09-12T17:39:07.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.014+0000 7f2d8d935800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:QBSMVUEZUASJUXZYFSYH, ofs0, ns] 2024-09-12T17:39:07.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.015+0000 7f2c5bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366313 cookie 93853189785280 notifier 9186 bl.length()=201 2024-09-12T17:39:07.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.015+0000 7f2c5bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+QBSMVUEZUASJUXZYFSYH info.flags=0x7 2024-09-12T17:39:07.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.015+0000 7f2c5bfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+QBSMVUEZUASJUXZYFSYH to cache LRU end 2024-09-12T17:39:07.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.017+0000 7f2d8d935800 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-09-12T17:39:07.020 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T17:39:07.020 INFO:teuthology.orchestra.run.smithi067.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-12T17:39:07.020 INFO:teuthology.orchestra.run.smithi067.stdout: "display_name": "Mr.RGW33333333333333333", 2024-09-12T17:39:07.020 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-12T17:39:07.020 INFO:teuthology.orchestra.run.smithi067.stdout: "suspended": 0, 2024-09-12T17:39:07.020 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T17:39:07.020 INFO:teuthology.orchestra.run.smithi067.stdout: "subusers": [], 2024-09-12T17:39:07.020 INFO:teuthology.orchestra.run.smithi067.stdout: "keys": [ 2024-09-12T17:39:07.020 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-12T17:39:07.020 INFO:teuthology.orchestra.run.smithi067.stdout: "user": "testx$tenanteduser.client.0", 2024-09-12T17:39:07.021 INFO:teuthology.orchestra.run.smithi067.stdout: "access_key": "QBSMVUEZUASJUXZYFSYH", 2024-09-12T17:39:07.021 INFO:teuthology.orchestra.run.smithi067.stdout: "secret_key": "CNj11FoJiE427eerAupnvtz/4GdSlzXp/n2yb5d/6w5yo85fm4Onwg==", 2024-09-12T17:39:07.021 INFO:teuthology.orchestra.run.smithi067.stdout: "active": true, 2024-09-12T17:39:07.021 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T17:39:07.009085Z" 2024-09-12T17:39:07.021 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-12T17:39:07.021 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-12T17:39:07.021 INFO:teuthology.orchestra.run.smithi067.stdout: "swift_keys": [], 2024-09-12T17:39:07.021 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": [], 2024-09-12T17:39:07.021 INFO:teuthology.orchestra.run.smithi067.stdout: "op_mask": "read, write, delete", 2024-09-12T17:39:07.021 INFO:teuthology.orchestra.run.smithi067.stdout: "default_placement": "", 2024-09-12T17:39:07.021 INFO:teuthology.orchestra.run.smithi067.stdout: "default_storage_class": "", 2024-09-12T17:39:07.021 INFO:teuthology.orchestra.run.smithi067.stdout: "placement_tags": [], 2024-09-12T17:39:07.021 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T17:39:07.022 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:39:07.022 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:39:07.022 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:39:07.022 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:39:07.022 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:39:07.022 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:39:07.022 INFO:teuthology.orchestra.run.smithi067.stdout: "user_quota": { 2024-09-12T17:39:07.022 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:39:07.022 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:39:07.023 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:39:07.023 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:39:07.023 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:39:07.023 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:39:07.023 INFO:teuthology.orchestra.run.smithi067.stdout: "temp_url_keys": [], 2024-09-12T17:39:07.023 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "root", 2024-09-12T17:39:07.023 INFO:teuthology.orchestra.run.smithi067.stdout: "mfa_ids": [], 2024-09-12T17:39:07.023 INFO:teuthology.orchestra.run.smithi067.stdout: "account_id": "RGW33333333333333333", 2024-09-12T17:39:07.023 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-12T17:39:07.023 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T17:39:07.009074Z", 2024-09-12T17:39:07.023 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-12T17:39:07.023 INFO:teuthology.orchestra.run.smithi067.stdout: "group_ids": [] 2024-09-12T17:39:07.023 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T17:39:07.023 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:39:07.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.018+0000 7f2c3f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:07.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.021+0000 7f2d8d935800 20 remove_watcher() i=0 2024-09-12T17:39:07.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.021+0000 7f2d8d935800 2 removed watcher, disabling cache 2024-09-12T17:39:07.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.022+0000 7f2d8d935800 20 remove_watcher() i=1 2024-09-12T17:39:07.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.024+0000 7f2d8d935800 20 remove_watcher() i=2 2024-09-12T17:39:07.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.025+0000 7f2d8d935800 20 remove_watcher() i=3 2024-09-12T17:39:07.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.026+0000 7f2d8d935800 20 remove_watcher() i=4 2024-09-12T17:39:07.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.027+0000 7f2d8d935800 20 remove_watcher() i=5 2024-09-12T17:39:07.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.028+0000 7f2d8d935800 20 remove_watcher() i=6 2024-09-12T17:39:07.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.029+0000 7f2d8d935800 20 remove_watcher() i=7 2024-09-12T17:39:07.043 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 7269177878 --totp-seed BTSF7L5CGJIVAC3JDW3FYJN4EMZ6AL6LCWCCQ3BMH7USJLOXXBYD6GPXXFY3VBFW --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:39:07.111 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:07.111 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:07.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.146+0000 7f037bd42800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.148+0000 7f037bd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.148+0000 7f037bd42800 20 realm 2024-09-12T17:39:07.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.148+0000 7f037bd42800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.148+0000 7f037bd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.148+0000 7f037bd42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:07.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.148+0000 7f037bd42800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.148+0000 7f037bd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.148+0000 7f037bd42800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.149+0000 7f037bd42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:07.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.149+0000 7f037bd42800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.150+0000 7f037bd42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:07.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.150+0000 7f037bd42800 20 searching for the correct realm 2024-09-12T17:39:07.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.153+0000 7f0378287640 0 -- 172.21.15.67:0/3472572691 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x55e5108682b0 msgr2=0x55e51086a770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:07.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.157+0000 7f0377a86640 0 -- 172.21.15.67:0/3472572691 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f036c0669d0 msgr2=0x7f036c04c1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:07.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.161+0000 7f037bd42800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:39:07.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.161+0000 7f037bd42800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:39:07.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.161+0000 7f037bd42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:07.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.161+0000 7f037bd42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:07.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.161+0000 7f037bd42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:07.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.161+0000 7f037bd42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:07.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.161+0000 7f037bd42800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.161+0000 7f037bd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.161+0000 7f037bd42800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.161+0000 7f037bd42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:07.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.161+0000 7f037bd42800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.162+0000 7f037bd42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:07.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.162+0000 7f037bd42800 20 zone default found 2024-09-12T17:39:07.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.162+0000 7f037bd42800 4 Realm: () 2024-09-12T17:39:07.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.162+0000 7f037bd42800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:39:07.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.162+0000 7f037bd42800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:39:07.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.162+0000 7f037bd42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:07.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.162+0000 7f037bd42800 20 zonegroup default 2024-09-12T17:39:07.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.162+0000 7f037bd42800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.162+0000 7f037bd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.162+0000 7f037bd42800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.162+0000 7f037bd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.162+0000 7f037bd42800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.163+0000 7f037bd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.163+0000 7f037bd42800 20 started sync module instance, tier type = 2024-09-12T17:39:07.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.163+0000 7f037bd42800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:39:07.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.172+0000 7f037bd42800 20 add_watcher() i=0 2024-09-12T17:39:07.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.172+0000 7f037bd42800 20 add_watcher() i=1 2024-09-12T17:39:07.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.172+0000 7f037bd42800 20 add_watcher() i=2 2024-09-12T17:39:07.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.172+0000 7f037bd42800 20 add_watcher() i=3 2024-09-12T17:39:07.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.172+0000 7f037bd42800 20 add_watcher() i=4 2024-09-12T17:39:07.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.172+0000 7f037bd42800 20 add_watcher() i=5 2024-09-12T17:39:07.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.172+0000 7f037bd42800 20 add_watcher() i=6 2024-09-12T17:39:07.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.173+0000 7f037bd42800 20 add_watcher() i=7 2024-09-12T17:39:07.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.173+0000 7f037bd42800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:07.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.175+0000 7f022dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:07.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.175+0000 7f037bd42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:07.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.175+0000 7f037bd42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:07.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.175+0000 7f037bd42800 5 note: GC not initialized 2024-09-12T17:39:07.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.175+0000 7f022cfe1640 20 reqs_thread_entry: start 2024-09-12T17:39:07.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.175+0000 7f037bd42800 20 init_complete bucket index max shards: 1 2024-09-12T17:39:07.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.175+0000 7f037bd42800 20 Filter name: none 2024-09-12T17:39:07.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.175+0000 7f01a67fc640 20 reqs_thread_entry: start 2024-09-12T17:39:07.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.175+0000 7f037bd42800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T17:39:07.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.175+0000 7f037bd42800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.176+0000 7f037bd42800 20 rados_obj.operate() r=0 bl.length=532 2024-09-12T17:39:07.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.176+0000 7f037bd42800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-12T17:39:07.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.176+0000 7f037bd42800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:39:07.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.176+0000 7f037bd42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:07.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.178+0000 7f037bd42800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:39:07.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.178+0000 7f037bd42800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:39:07.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.178+0000 7f037bd42800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T17:39:07.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.179+0000 7f0256ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366361 cookie 94442313150272 notifier 9204 bl.length()=746 2024-09-12T17:39:07.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.179+0000 7f0256ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:39:07.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.179+0000 7f0256ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:39:07.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.181+0000 7f022dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:07.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.183+0000 7f037bd42800 20 remove_watcher() i=0 2024-09-12T17:39:07.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.183+0000 7f037bd42800 2 removed watcher, disabling cache 2024-09-12T17:39:07.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.185+0000 7f037bd42800 20 remove_watcher() i=1 2024-09-12T17:39:07.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.186+0000 7f037bd42800 20 remove_watcher() i=2 2024-09-12T17:39:07.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.187+0000 7f037bd42800 20 remove_watcher() i=3 2024-09-12T17:39:07.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.189+0000 7f037bd42800 20 remove_watcher() i=4 2024-09-12T17:39:07.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.189+0000 7f037bd42800 20 remove_watcher() i=5 2024-09-12T17:39:07.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.190+0000 7f037bd42800 20 remove_watcher() i=6 2024-09-12T17:39:07.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.191+0000 7f037bd42800 20 remove_watcher() i=7 2024-09-12T17:39:07.204 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-12T17:39:07.205 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key NZFOQCICEKCVYSNSUXXV --secret jH5hEaZStDuONcAUmuNEPCqrcLAOYV9E51+WRXvC66JyrdybfJF5aQ== --cluster ceph 2024-09-12T17:39:07.271 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:07.271 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:07.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.306+0000 7fd3e132c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.307+0000 7fd3e132c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.307+0000 7fd3e132c800 20 realm 2024-09-12T17:39:07.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.307+0000 7fd3e132c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.307+0000 7fd3e132c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.307+0000 7fd3e132c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:07.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.307+0000 7fd3e132c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.308+0000 7fd3e132c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.308+0000 7fd3e132c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.308+0000 7fd3e132c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:07.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.308+0000 7fd3e132c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.309+0000 7fd3e132c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:07.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.309+0000 7fd3e132c800 20 searching for the correct realm 2024-09-12T17:39:07.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.312+0000 7fd3dc744640 0 -- 172.21.15.67:0/414935066 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x5567c80279e0 msgr2=0x5567c8029df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:07.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.315+0000 7fd3dcf45640 0 -- 172.21.15.67:0/414935066 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fd3d0063070 msgr2=0x7fd3d00813f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:07.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.523+0000 7fd3e132c800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:39:07.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.523+0000 7fd3e132c800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:39:07.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.523+0000 7fd3e132c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:07.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.523+0000 7fd3e132c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:07.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.523+0000 7fd3e132c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:07.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.523+0000 7fd3e132c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:07.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.523+0000 7fd3e132c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.523+0000 7fd3e132c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.523+0000 7fd3e132c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.523+0000 7fd3e132c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:07.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.523+0000 7fd3e132c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.524+0000 7fd3e132c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:07.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.524+0000 7fd3e132c800 20 zone default found 2024-09-12T17:39:07.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.524+0000 7fd3e132c800 4 Realm: () 2024-09-12T17:39:07.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.524+0000 7fd3e132c800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:39:07.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.524+0000 7fd3e132c800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:39:07.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.524+0000 7fd3e132c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:07.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.524+0000 7fd3e132c800 20 zonegroup default 2024-09-12T17:39:07.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.524+0000 7fd3e132c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.524+0000 7fd3e132c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.524+0000 7fd3e132c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.524+0000 7fd3e132c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.524+0000 7fd3e132c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.525+0000 7fd3e132c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.525+0000 7fd3e132c800 20 started sync module instance, tier type = 2024-09-12T17:39:07.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.525+0000 7fd3e132c800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:39:07.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.535+0000 7fd3e132c800 20 add_watcher() i=0 2024-09-12T17:39:07.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.535+0000 7fd3e132c800 20 add_watcher() i=1 2024-09-12T17:39:07.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.535+0000 7fd3e132c800 20 add_watcher() i=2 2024-09-12T17:39:07.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.535+0000 7fd3e132c800 20 add_watcher() i=3 2024-09-12T17:39:07.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.535+0000 7fd3e132c800 20 add_watcher() i=4 2024-09-12T17:39:07.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.535+0000 7fd3e132c800 20 add_watcher() i=5 2024-09-12T17:39:07.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.535+0000 7fd3e132c800 20 add_watcher() i=6 2024-09-12T17:39:07.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.536+0000 7fd3e132c800 20 add_watcher() i=7 2024-09-12T17:39:07.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.536+0000 7fd3e132c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:07.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.537+0000 7fd292fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:07.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.537+0000 7fd3e132c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:07.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.537+0000 7fd3e132c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:07.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.538+0000 7fd3e132c800 5 note: GC not initialized 2024-09-12T17:39:07.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.538+0000 7fd291fe3640 20 reqs_thread_entry: start 2024-09-12T17:39:07.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.538+0000 7fd3e132c800 20 init_complete bucket index max shards: 1 2024-09-12T17:39:07.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.538+0000 7fd3e132c800 20 Filter name: none 2024-09-12T17:39:07.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.538+0000 7fd2037fe640 20 reqs_thread_entry: start 2024-09-12T17:39:07.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.538+0000 7fd3e132c800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T17:39:07.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.538+0000 7fd3e132c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.538+0000 7fd3e132c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.538+0000 7fd3e132c800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-12T17:39:07.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.538+0000 7fd3e132c800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:39:07.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.538+0000 7fd3e132c800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-12T17:39:07.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.538+0000 7fd3e132c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.539+0000 7fd3e132c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.539+0000 7fd3e132c800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-12T17:39:07.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.539+0000 7fd3e132c800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T17:39:07.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.539+0000 7fd3e132c800 10 cache get: name=default.rgw.meta+users.keys+NZFOQCICEKCVYSNSUXXV : miss 2024-09-12T17:39:07.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.539+0000 7fd3e132c800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.539+0000 7fd3e132c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.539+0000 7fd3e132c800 10 cache put: name=default.rgw.meta+users.keys+NZFOQCICEKCVYSNSUXXV info.flags=0x0 2024-09-12T17:39:07.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.539+0000 7fd3e132c800 10 adding default.rgw.meta+users.keys+NZFOQCICEKCVYSNSUXXV to cache LRU end 2024-09-12T17:39:07.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.539+0000 7fd3e132c800 10 cache get: name=default.rgw.meta+users.keys+NZFOQCICEKCVYSNSUXXV : hit (negative entry) 2024-09-12T17:39:07.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.539+0000 7fd3e132c800 10 cache get: name=default.rgw.meta+users.keys+NZFOQCICEKCVYSNSUXXV : hit (negative entry) 2024-09-12T17:39:07.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.540+0000 7fd3e132c800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:39:07.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.540+0000 7fd3e132c800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:39:07.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.540+0000 7fd3e132c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T17:39:07.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.541+0000 7fd2b3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366227 cookie 93904225639392 notifier 9225 bl.length()=660 2024-09-12T17:39:07.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.541+0000 7fd2b3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:39:07.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.541+0000 7fd2b3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:39:07.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.544+0000 7fd3e132c800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T17:39:07.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.544+0000 7fd3e132c800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T17:39:07.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.544+0000 7fd3e132c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-12T17:39:07.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.544+0000 7fd2b3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366331 cookie 93904225633568 notifier 9225 bl.length()=191 2024-09-12T17:39:07.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.544+0000 7fd2b3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T17:39:07.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.544+0000 7fd2b3fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T17:39:07.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.547+0000 7fd3e132c800 10 cache put: name=default.rgw.meta+users.keys+NZFOQCICEKCVYSNSUXXV info.flags=0x7 2024-09-12T17:39:07.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.547+0000 7fd3e132c800 10 moving default.rgw.meta+users.keys+NZFOQCICEKCVYSNSUXXV to cache LRU end 2024-09-12T17:39:07.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.547+0000 7fd3e132c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:NZFOQCICEKCVYSNSUXXV, ofs0, ns] 2024-09-12T17:39:07.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.547+0000 7fd2b3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366249 cookie 93904225637120 notifier 9225 bl.length()=189 2024-09-12T17:39:07.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.547+0000 7fd2b3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NZFOQCICEKCVYSNSUXXV info.flags=0x7 2024-09-12T17:39:07.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.547+0000 7fd2b3fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NZFOQCICEKCVYSNSUXXV to cache LRU end 2024-09-12T17:39:07.549 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T17:39:07.549 INFO:teuthology.orchestra.run.smithi067.stdout: "user_id": "foobar.client.0", 2024-09-12T17:39:07.549 INFO:teuthology.orchestra.run.smithi067.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T17:39:07.549 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "foobar+test@test.test", 2024-09-12T17:39:07.549 INFO:teuthology.orchestra.run.smithi067.stdout: "suspended": 0, 2024-09-12T17:39:07.549 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T17:39:07.549 INFO:teuthology.orchestra.run.smithi067.stdout: "subusers": [], 2024-09-12T17:39:07.550 INFO:teuthology.orchestra.run.smithi067.stdout: "keys": [ 2024-09-12T17:39:07.550 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-12T17:39:07.550 INFO:teuthology.orchestra.run.smithi067.stdout: "user": "foobar.client.0", 2024-09-12T17:39:07.550 INFO:teuthology.orchestra.run.smithi067.stdout: "access_key": "NZFOQCICEKCVYSNSUXXV", 2024-09-12T17:39:07.550 INFO:teuthology.orchestra.run.smithi067.stdout: "secret_key": "jH5hEaZStDuONcAUmuNEPCqrcLAOYV9E51+WRXvC66JyrdybfJF5aQ==", 2024-09-12T17:39:07.550 INFO:teuthology.orchestra.run.smithi067.stdout: "active": true, 2024-09-12T17:39:07.550 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T17:39:07.540513Z" 2024-09-12T17:39:07.550 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-12T17:39:07.550 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-12T17:39:07.550 INFO:teuthology.orchestra.run.smithi067.stdout: "swift_keys": [], 2024-09-12T17:39:07.550 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": [], 2024-09-12T17:39:07.550 INFO:teuthology.orchestra.run.smithi067.stdout: "op_mask": "read, write, delete", 2024-09-12T17:39:07.550 INFO:teuthology.orchestra.run.smithi067.stdout: "default_placement": "", 2024-09-12T17:39:07.550 INFO:teuthology.orchestra.run.smithi067.stdout: "default_storage_class": "", 2024-09-12T17:39:07.551 INFO:teuthology.orchestra.run.smithi067.stdout: "placement_tags": [], 2024-09-12T17:39:07.551 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T17:39:07.551 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:39:07.551 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:39:07.551 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:39:07.551 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:39:07.551 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:39:07.551 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:39:07.551 INFO:teuthology.orchestra.run.smithi067.stdout: "user_quota": { 2024-09-12T17:39:07.551 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:39:07.551 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:39:07.551 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:39:07.551 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:39:07.551 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:39:07.552 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:39:07.552 INFO:teuthology.orchestra.run.smithi067.stdout: "temp_url_keys": [], 2024-09-12T17:39:07.552 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "rgw", 2024-09-12T17:39:07.552 INFO:teuthology.orchestra.run.smithi067.stdout: "mfa_ids": [], 2024-09-12T17:39:07.552 INFO:teuthology.orchestra.run.smithi067.stdout: "account_id": "", 2024-09-12T17:39:07.552 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-12T17:39:07.552 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T17:39:07.540495Z", 2024-09-12T17:39:07.552 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-12T17:39:07.552 INFO:teuthology.orchestra.run.smithi067.stdout: "group_ids": [] 2024-09-12T17:39:07.552 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T17:39:07.552 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:39:07.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.549+0000 7fd292fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:07.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.552+0000 7fd3e132c800 20 remove_watcher() i=0 2024-09-12T17:39:07.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.552+0000 7fd3e132c800 2 removed watcher, disabling cache 2024-09-12T17:39:07.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.553+0000 7fd3e132c800 20 remove_watcher() i=1 2024-09-12T17:39:07.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.554+0000 7fd3e132c800 20 remove_watcher() i=2 2024-09-12T17:39:07.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.555+0000 7fd3e132c800 20 remove_watcher() i=3 2024-09-12T17:39:07.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.556+0000 7fd3e132c800 20 remove_watcher() i=4 2024-09-12T17:39:07.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.557+0000 7fd3e132c800 20 remove_watcher() i=5 2024-09-12T17:39:07.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.558+0000 7fd3e132c800 20 remove_watcher() i=6 2024-09-12T17:39:07.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.559+0000 7fd3e132c800 20 remove_watcher() i=7 2024-09-12T17:39:07.572 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 6982307940 --totp-seed 3AJCPFWHDZ7IMQBAGAA24YVKF3TRSCEF4RI3SD4UAX7VGBOJVJVWPQRWKUD7M65H --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:39:07.639 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:07.639 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:07.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.674+0000 7fc0dd5af800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.676+0000 7fc0dd5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.676+0000 7fc0dd5af800 20 realm 2024-09-12T17:39:07.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.676+0000 7fc0dd5af800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.676+0000 7fc0dd5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.676+0000 7fc0dd5af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:07.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.676+0000 7fc0dd5af800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.676+0000 7fc0dd5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.676+0000 7fc0dd5af800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.677+0000 7fc0dd5af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:07.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.677+0000 7fc0dd5af800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.678+0000 7fc0dd5af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:07.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.678+0000 7fc0dd5af800 20 searching for the correct realm 2024-09-12T17:39:07.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.682+0000 7fc0da898640 0 -- 172.21.15.67:0/1944111632 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x561c4cccb280 msgr2=0x561c4cccd690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:07.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.685+0000 7fc0db89a640 0 -- 172.21.15.67:0/1944111632 >> [v2:172.21.15.118:6824/1070975205,v1:172.21.15.118:6825/1070975205] conn(0x7fc0c4013030 msgr2=0x7fc0c408c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:07.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.689+0000 7fc0dd5af800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:39:07.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.689+0000 7fc0dd5af800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:39:07.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.689+0000 7fc0dd5af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:07.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.689+0000 7fc0dd5af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:07.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.689+0000 7fc0dd5af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:07.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.689+0000 7fc0dd5af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:07.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.689+0000 7fc0dd5af800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.689+0000 7fc0dd5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.689+0000 7fc0dd5af800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.689+0000 7fc0dd5af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:07.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.689+0000 7fc0dd5af800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.690+0000 7fc0dd5af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:07.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.690+0000 7fc0dd5af800 20 zone default found 2024-09-12T17:39:07.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.690+0000 7fc0dd5af800 4 Realm: () 2024-09-12T17:39:07.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.690+0000 7fc0dd5af800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:39:07.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.690+0000 7fc0dd5af800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:39:07.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.690+0000 7fc0dd5af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:07.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.690+0000 7fc0dd5af800 20 zonegroup default 2024-09-12T17:39:07.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.690+0000 7fc0dd5af800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.690+0000 7fc0dd5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.690+0000 7fc0dd5af800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.690+0000 7fc0dd5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.690+0000 7fc0dd5af800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.690+0000 7fc0dd5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.690+0000 7fc0dd5af800 20 started sync module instance, tier type = 2024-09-12T17:39:07.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.690+0000 7fc0dd5af800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:39:07.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.700+0000 7fc0dd5af800 20 add_watcher() i=0 2024-09-12T17:39:07.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.700+0000 7fc0dd5af800 20 add_watcher() i=1 2024-09-12T17:39:07.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.700+0000 7fc0dd5af800 20 add_watcher() i=2 2024-09-12T17:39:07.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.700+0000 7fc0dd5af800 20 add_watcher() i=3 2024-09-12T17:39:07.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.700+0000 7fc0dd5af800 20 add_watcher() i=4 2024-09-12T17:39:07.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.700+0000 7fc0dd5af800 20 add_watcher() i=5 2024-09-12T17:39:07.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.700+0000 7fc0dd5af800 20 add_watcher() i=6 2024-09-12T17:39:07.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.701+0000 7fc0dd5af800 20 add_watcher() i=7 2024-09-12T17:39:07.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.701+0000 7fc0dd5af800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:07.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.702+0000 7fbf91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:07.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.702+0000 7fc0dd5af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:07.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.702+0000 7fc0dd5af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:07.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.702+0000 7fc0dd5af800 5 note: GC not initialized 2024-09-12T17:39:07.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.703+0000 7fbf90fe1640 20 reqs_thread_entry: start 2024-09-12T17:39:07.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.703+0000 7fc0dd5af800 20 init_complete bucket index max shards: 1 2024-09-12T17:39:07.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.703+0000 7fc0dd5af800 20 Filter name: none 2024-09-12T17:39:07.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.703+0000 7fbf0a7fc640 20 reqs_thread_entry: start 2024-09-12T17:39:07.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.703+0000 7fc0dd5af800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T17:39:07.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.703+0000 7fc0dd5af800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.704+0000 7fc0dd5af800 20 rados_obj.operate() r=0 bl.length=472 2024-09-12T17:39:07.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.704+0000 7fc0dd5af800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T17:39:07.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.704+0000 7fc0dd5af800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:39:07.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.704+0000 7fc0dd5af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:07.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.706+0000 7fc0dd5af800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:39:07.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.706+0000 7fc0dd5af800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:39:07.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.706+0000 7fc0dd5af800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T17:39:07.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.706+0000 7fbfbeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366228 cookie 94679547610240 notifier 8633 bl.length()=674 2024-09-12T17:39:07.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.706+0000 7fbfbeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:39:07.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.706+0000 7fbfbeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:39:07.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.709+0000 7fbf91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:07.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.711+0000 7fc0dd5af800 20 remove_watcher() i=0 2024-09-12T17:39:07.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.711+0000 7fc0dd5af800 2 removed watcher, disabling cache 2024-09-12T17:39:07.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.712+0000 7fc0dd5af800 20 remove_watcher() i=1 2024-09-12T17:39:07.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.713+0000 7fc0dd5af800 20 remove_watcher() i=2 2024-09-12T17:39:07.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.714+0000 7fc0dd5af800 20 remove_watcher() i=3 2024-09-12T17:39:07.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.715+0000 7fc0dd5af800 20 remove_watcher() i=4 2024-09-12T17:39:07.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.716+0000 7fc0dd5af800 20 remove_watcher() i=5 2024-09-12T17:39:07.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.717+0000 7fc0dd5af800 20 remove_watcher() i=6 2024-09-12T17:39:07.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.718+0000 7fc0dd5af800 20 remove_watcher() i=7 2024-09-12T17:39:07.731 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-12T17:39:07.791 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:07.792 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:07.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.826+0000 7fbc52b39800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.828+0000 7fbc52b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.828+0000 7fbc52b39800 20 realm 2024-09-12T17:39:07.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.828+0000 7fbc52b39800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.828+0000 7fbc52b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.828+0000 7fbc52b39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:07.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.828+0000 7fbc52b39800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.828+0000 7fbc52b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.828+0000 7fbc52b39800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.829+0000 7fbc52b39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:07.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.829+0000 7fbc52b39800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.830+0000 7fbc52b39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:07.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.830+0000 7fbc52b39800 20 searching for the correct realm 2024-09-12T17:39:07.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.832+0000 7fbc4e7c7640 0 -- 172.21.15.67:0/65779480 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7fbc48061040 msgr2=0x7fbc480b20d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:07.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:07.836+0000 7fbc4e7c7640 0 -- 172.21.15.67:0/65779480 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fbc44045ba0 msgr2=0x7fbc4403d930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:08.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.043+0000 7fbc52b39800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:39:08.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.043+0000 7fbc52b39800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:39:08.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.043+0000 7fbc52b39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:08.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.043+0000 7fbc52b39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:08.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.043+0000 7fbc52b39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:08.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.043+0000 7fbc52b39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:08.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.043+0000 7fbc52b39800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.044+0000 7fbc52b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.044+0000 7fbc52b39800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.044+0000 7fbc52b39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:08.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.044+0000 7fbc52b39800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.044+0000 7fbc52b39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:08.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.044+0000 7fbc52b39800 20 zone default found 2024-09-12T17:39:08.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.044+0000 7fbc52b39800 4 Realm: () 2024-09-12T17:39:08.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.044+0000 7fbc52b39800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:39:08.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.044+0000 7fbc52b39800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:39:08.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.044+0000 7fbc52b39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:08.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.044+0000 7fbc52b39800 20 zonegroup default 2024-09-12T17:39:08.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.044+0000 7fbc52b39800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.045+0000 7fbc52b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.045+0000 7fbc52b39800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.045+0000 7fbc52b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.045+0000 7fbc52b39800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.045+0000 7fbc52b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.045+0000 7fbc52b39800 20 started sync module instance, tier type = 2024-09-12T17:39:08.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.045+0000 7fbc52b39800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:39:08.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.055+0000 7fbc52b39800 20 add_watcher() i=0 2024-09-12T17:39:08.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.055+0000 7fbc52b39800 20 add_watcher() i=1 2024-09-12T17:39:08.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.055+0000 7fbc52b39800 20 add_watcher() i=2 2024-09-12T17:39:08.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.055+0000 7fbc52b39800 20 add_watcher() i=3 2024-09-12T17:39:08.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.055+0000 7fbc52b39800 20 add_watcher() i=4 2024-09-12T17:39:08.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.055+0000 7fbc52b39800 20 add_watcher() i=5 2024-09-12T17:39:08.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.055+0000 7fbc52b39800 20 add_watcher() i=6 2024-09-12T17:39:08.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.056+0000 7fbc52b39800 20 add_watcher() i=7 2024-09-12T17:39:08.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.056+0000 7fbc52b39800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:08.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.058+0000 7fbb04fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:08.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.058+0000 7fbc52b39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:08.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.058+0000 7fbc52b39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:08.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.058+0000 7fbc52b39800 5 note: GC not initialized 2024-09-12T17:39:08.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.058+0000 7fba7f7fe640 20 reqs_thread_entry: start 2024-09-12T17:39:08.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.058+0000 7fbc52b39800 20 init_complete bucket index max shards: 1 2024-09-12T17:39:08.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.058+0000 7fbc52b39800 20 Filter name: none 2024-09-12T17:39:08.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.058+0000 7fba7d7fa640 20 reqs_thread_entry: start 2024-09-12T17:39:08.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.058+0000 7fbc52b39800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T17:39:08.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.058+0000 7fbc52b39800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.059+0000 7fbc52b39800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T17:39:08.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.059+0000 7fbc52b39800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T17:39:08.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.059+0000 7fbc52b39800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:39:08.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.059+0000 7fbc52b39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:08.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.060+0000 7fbc52b39800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:39:08.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.060+0000 7fbc52b39800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:39:08.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.060+0000 7fbc52b39800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T17:39:08.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.060+0000 7fbb31ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366229 cookie 93999563730768 notifier 8651 bl.length()=727 2024-09-12T17:39:08.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.060+0000 7fbb31ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:39:08.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.060+0000 7fbb31ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:39:08.063 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T17:39:08.063 INFO:teuthology.orchestra.run.smithi067.stdout: "user_id": "foobar.client.0", 2024-09-12T17:39:08.063 INFO:teuthology.orchestra.run.smithi067.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T17:39:08.063 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "foobar+test@test.test", 2024-09-12T17:39:08.063 INFO:teuthology.orchestra.run.smithi067.stdout: "suspended": 0, 2024-09-12T17:39:08.063 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T17:39:08.063 INFO:teuthology.orchestra.run.smithi067.stdout: "subusers": [], 2024-09-12T17:39:08.063 INFO:teuthology.orchestra.run.smithi067.stdout: "keys": [ 2024-09-12T17:39:08.063 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-12T17:39:08.064 INFO:teuthology.orchestra.run.smithi067.stdout: "user": "foobar.client.0", 2024-09-12T17:39:08.064 INFO:teuthology.orchestra.run.smithi067.stdout: "access_key": "NZFOQCICEKCVYSNSUXXV", 2024-09-12T17:39:08.064 INFO:teuthology.orchestra.run.smithi067.stdout: "secret_key": "jH5hEaZStDuONcAUmuNEPCqrcLAOYV9E51+WRXvC66JyrdybfJF5aQ==", 2024-09-12T17:39:08.064 INFO:teuthology.orchestra.run.smithi067.stdout: "active": true, 2024-09-12T17:39:08.064 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T17:39:07.540513Z" 2024-09-12T17:39:08.064 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-12T17:39:08.064 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-12T17:39:08.064 INFO:teuthology.orchestra.run.smithi067.stdout: "swift_keys": [], 2024-09-12T17:39:08.064 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": [ 2024-09-12T17:39:08.064 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-12T17:39:08.064 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "oidc-provider", 2024-09-12T17:39:08.064 INFO:teuthology.orchestra.run.smithi067.stdout: "perm": "*" 2024-09-12T17:39:08.064 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:39:08.064 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-12T17:39:08.065 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "roles", 2024-09-12T17:39:08.065 INFO:teuthology.orchestra.run.smithi067.stdout: "perm": "*" 2024-09-12T17:39:08.065 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:39:08.065 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-12T17:39:08.065 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "user-policy", 2024-09-12T17:39:08.065 INFO:teuthology.orchestra.run.smithi067.stdout: "perm": "*" 2024-09-12T17:39:08.065 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-12T17:39:08.065 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-12T17:39:08.065 INFO:teuthology.orchestra.run.smithi067.stdout: "op_mask": "read, write, delete", 2024-09-12T17:39:08.065 INFO:teuthology.orchestra.run.smithi067.stdout: "default_placement": "", 2024-09-12T17:39:08.065 INFO:teuthology.orchestra.run.smithi067.stdout: "default_storage_class": "", 2024-09-12T17:39:08.065 INFO:teuthology.orchestra.run.smithi067.stdout: "placement_tags": [], 2024-09-12T17:39:08.065 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T17:39:08.066 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:39:08.066 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:39:08.066 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:39:08.066 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:39:08.066 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:39:08.066 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:39:08.066 INFO:teuthology.orchestra.run.smithi067.stdout: "user_quota": { 2024-09-12T17:39:08.066 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:39:08.066 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:39:08.067 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:39:08.067 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:39:08.067 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:39:08.067 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:39:08.067 INFO:teuthology.orchestra.run.smithi067.stdout: "temp_url_keys": [], 2024-09-12T17:39:08.067 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "rgw", 2024-09-12T17:39:08.067 INFO:teuthology.orchestra.run.smithi067.stdout: "mfa_ids": [ 2024-09-12T17:39:08.067 INFO:teuthology.orchestra.run.smithi067.stdout: "6982307940" 2024-09-12T17:39:08.067 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-12T17:39:08.067 INFO:teuthology.orchestra.run.smithi067.stdout: "account_id": "", 2024-09-12T17:39:08.067 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-12T17:39:08.067 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T17:39:07.540495Z", 2024-09-12T17:39:08.067 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-12T17:39:08.068 INFO:teuthology.orchestra.run.smithi067.stdout: "group_ids": [] 2024-09-12T17:39:08.068 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T17:39:08.068 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:39:08.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.063+0000 7fbb04fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:08.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.065+0000 7fbc52b39800 20 remove_watcher() i=0 2024-09-12T17:39:08.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.065+0000 7fbc52b39800 2 removed watcher, disabling cache 2024-09-12T17:39:08.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.066+0000 7fbc52b39800 20 remove_watcher() i=1 2024-09-12T17:39:08.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.067+0000 7fbc52b39800 20 remove_watcher() i=2 2024-09-12T17:39:08.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.068+0000 7fbc52b39800 20 remove_watcher() i=3 2024-09-12T17:39:08.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.069+0000 7fbc52b39800 20 remove_watcher() i=4 2024-09-12T17:39:08.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.070+0000 7fbc52b39800 20 remove_watcher() i=5 2024-09-12T17:39:08.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.071+0000 7fbc52b39800 20 remove_watcher() i=6 2024-09-12T17:39:08.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.072+0000 7fbc52b39800 20 remove_watcher() i=7 2024-09-12T17:39:08.084 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-12T17:39:08.145 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:08.145 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:08.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.180+0000 7fa1b7820800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.182+0000 7fa1b7820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.182+0000 7fa1b7820800 20 realm 2024-09-12T17:39:08.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.182+0000 7fa1b7820800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.182+0000 7fa1b7820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.182+0000 7fa1b7820800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:08.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.182+0000 7fa1b7820800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.182+0000 7fa1b7820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.182+0000 7fa1b7820800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.183+0000 7fa1b7820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:08.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.183+0000 7fa1b7820800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.184+0000 7fa1b7820800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:08.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.184+0000 7fa1b7820800 20 searching for the correct realm 2024-09-12T17:39:08.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.187+0000 7fa1b5b0b640 0 -- 172.21.15.67:0/1489340602 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x555fb09426c0 msgr2=0x555fb0944b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:08.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.190+0000 7fa1b530a640 0 -- 172.21.15.67:0/1489340602 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fa1ac099b10 msgr2=0x7fa1ac0a0220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:08.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.194+0000 7fa1b7820800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:39:08.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.194+0000 7fa1b7820800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:39:08.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.194+0000 7fa1b7820800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:08.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.194+0000 7fa1b7820800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:08.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.194+0000 7fa1b7820800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:08.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.194+0000 7fa1b7820800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:08.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.194+0000 7fa1b7820800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.194+0000 7fa1b7820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.194+0000 7fa1b7820800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.195+0000 7fa1b7820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:08.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.195+0000 7fa1b7820800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.195+0000 7fa1b7820800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:08.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.195+0000 7fa1b7820800 20 zone default found 2024-09-12T17:39:08.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.195+0000 7fa1b7820800 4 Realm: () 2024-09-12T17:39:08.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.195+0000 7fa1b7820800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:39:08.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.195+0000 7fa1b7820800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:39:08.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.195+0000 7fa1b7820800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:08.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.195+0000 7fa1b7820800 20 zonegroup default 2024-09-12T17:39:08.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.195+0000 7fa1b7820800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.195+0000 7fa1b7820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.195+0000 7fa1b7820800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.195+0000 7fa1b7820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.195+0000 7fa1b7820800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.196+0000 7fa1b7820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.196+0000 7fa1b7820800 20 started sync module instance, tier type = 2024-09-12T17:39:08.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.196+0000 7fa1b7820800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:39:08.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.205+0000 7fa1b7820800 20 add_watcher() i=0 2024-09-12T17:39:08.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.205+0000 7fa1b7820800 20 add_watcher() i=1 2024-09-12T17:39:08.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.205+0000 7fa1b7820800 20 add_watcher() i=2 2024-09-12T17:39:08.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.205+0000 7fa1b7820800 20 add_watcher() i=3 2024-09-12T17:39:08.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.205+0000 7fa1b7820800 20 add_watcher() i=4 2024-09-12T17:39:08.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.205+0000 7fa1b7820800 20 add_watcher() i=5 2024-09-12T17:39:08.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.205+0000 7fa1b7820800 20 add_watcher() i=6 2024-09-12T17:39:08.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.206+0000 7fa1b7820800 20 add_watcher() i=7 2024-09-12T17:39:08.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.206+0000 7fa1b7820800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:08.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.208+0000 7fa06bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:08.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.208+0000 7fa1b7820800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:08.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.208+0000 7fa1b7820800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:08.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.208+0000 7fa1b7820800 5 note: GC not initialized 2024-09-12T17:39:08.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.208+0000 7fa06afe5640 20 reqs_thread_entry: start 2024-09-12T17:39:08.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.208+0000 7fa1b7820800 20 init_complete bucket index max shards: 1 2024-09-12T17:39:08.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.208+0000 7fa1b7820800 20 Filter name: none 2024-09-12T17:39:08.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.208+0000 7fa068fe1640 20 reqs_thread_entry: start 2024-09-12T17:39:08.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.209+0000 7fa1b7820800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-12T17:39:08.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.209+0000 7fa1b7820800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.209+0000 7fa1b7820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.209+0000 7fa1b7820800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-12T17:39:08.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.209+0000 7fa1b7820800 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T17:39:08.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.209+0000 7fa1b7820800 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-12T17:39:08.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.209+0000 7fa1b7820800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-12T17:39:08.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.209+0000 7fa1b7820800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.209+0000 7fa1b7820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.209+0000 7fa1b7820800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-12T17:39:08.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.209+0000 7fa1b7820800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T17:39:08.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.209+0000 7fa1b7820800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-12T17:39:08.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.210+0000 7fa1b7820800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T17:39:08.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.210+0000 7fa1b7820800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T17:39:08.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.210+0000 7fa1b7820800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-12T17:39:08.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.211+0000 7fa098ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366332 cookie 93869472766432 notifier 8666 bl.length()=384 2024-09-12T17:39:08.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.211+0000 7fa098ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T17:39:08.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.211+0000 7fa098ff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T17:39:08.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.214+0000 7fa1b7820800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T17:39:08.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.214+0000 7fa1b7820800 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T17:39:08.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.214+0000 7fa1b7820800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-12T17:39:08.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.214+0000 7fa087fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366314 cookie 93869472767488 notifier 8666 bl.length()=225 2024-09-12T17:39:08.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.214+0000 7fa087fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T17:39:08.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.214+0000 7fa087fff640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T17:39:08.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.217+0000 7fa1b7820800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T17:39:08.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.217+0000 7fa1b7820800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T17:39:08.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.217+0000 7fa1b7820800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-12T17:39:08.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.218+0000 7fa087fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366250 cookie 93869472773392 notifier 8666 bl.length()=234 2024-09-12T17:39:08.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.218+0000 7fa087fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T17:39:08.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.218+0000 7fa087fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T17:39:08.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.220+0000 7fa06bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:08.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.222+0000 7fa1b7820800 20 remove_watcher() i=0 2024-09-12T17:39:08.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.222+0000 7fa1b7820800 2 removed watcher, disabling cache 2024-09-12T17:39:08.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.223+0000 7fa1b7820800 20 remove_watcher() i=1 2024-09-12T17:39:08.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.224+0000 7fa1b7820800 20 remove_watcher() i=2 2024-09-12T17:39:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.225+0000 7fa1b7820800 20 remove_watcher() i=3 2024-09-12T17:39:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.226+0000 7fa1b7820800 20 remove_watcher() i=4 2024-09-12T17:39:08.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.227+0000 7fa1b7820800 20 remove_watcher() i=5 2024-09-12T17:39:08.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.228+0000 7fa1b7820800 20 remove_watcher() i=6 2024-09-12T17:39:08.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.229+0000 7fa1b7820800 20 remove_watcher() i=7 2024-09-12T17:39:08.239 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T17:39:08.239 INFO:teuthology.orchestra.run.smithi067.stdout: "id": "RGW88888888888888888", 2024-09-12T17:39:08.239 INFO:teuthology.orchestra.run.smithi067.stdout: "tenant": "", 2024-09-12T17:39:08.240 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "Mr.RGW88888888888888888", 2024-09-12T17:39:08.240 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-12T17:39:08.240 INFO:teuthology.orchestra.run.smithi067.stdout: "quota": { 2024-09-12T17:39:08.240 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:39:08.240 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:39:08.240 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:39:08.240 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:39:08.240 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:39:08.240 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:39:08.240 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T17:39:08.240 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:39:08.240 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:39:08.240 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:39:08.241 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:39:08.241 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:39:08.241 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:39:08.241 INFO:teuthology.orchestra.run.smithi067.stdout: "max_users": 1000, 2024-09-12T17:39:08.241 INFO:teuthology.orchestra.run.smithi067.stdout: "max_roles": 1000, 2024-09-12T17:39:08.241 INFO:teuthology.orchestra.run.smithi067.stdout: "max_groups": 1000, 2024-09-12T17:39:08.241 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T17:39:08.241 INFO:teuthology.orchestra.run.smithi067.stdout: "max_access_keys": 4 2024-09-12T17:39:08.241 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T17:39:08.242 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-12T17:39:08.242 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key QGVUDRFLJUDUJEWGEMVH --secret FCDj0CTNjZfuewQpEH4IIy/IwWXDJw8pbfppqEAnMNb51ZwkzMQLJg== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-12T17:39:08.311 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:08.312 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:08.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.348+0000 7f911162f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.350+0000 7f911162f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.350+0000 7f911162f800 20 realm 2024-09-12T17:39:08.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.350+0000 7f911162f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.350+0000 7f911162f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.350+0000 7f911162f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:08.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.350+0000 7f911162f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.350+0000 7f911162f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.350+0000 7f911162f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.351+0000 7f911162f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:08.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.351+0000 7f911162f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.352+0000 7f911162f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:08.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.352+0000 7f911162f800 20 searching for the correct realm 2024-09-12T17:39:08.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.354+0000 7f910c18a640 0 -- 172.21.15.67:0/1325491107 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f90fc09fc20 msgr2=0x7f90fc08c840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:39:08.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.358+0000 7f910c98b640 0 -- 172.21.15.67:0/1325491107 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f91000d39b0 msgr2=0x7f9100059030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:08.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.564+0000 7f911162f800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:39:08.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.564+0000 7f911162f800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:39:08.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.564+0000 7f911162f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:08.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.564+0000 7f911162f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:08.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.564+0000 7f911162f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:08.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.564+0000 7f911162f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:08.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.564+0000 7f911162f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.565+0000 7f911162f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.565+0000 7f911162f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.565+0000 7f911162f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:08.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.565+0000 7f911162f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.565+0000 7f911162f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:08.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.566+0000 7f911162f800 20 zone default found 2024-09-12T17:39:08.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.566+0000 7f911162f800 4 Realm: () 2024-09-12T17:39:08.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.566+0000 7f911162f800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:39:08.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.566+0000 7f911162f800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:39:08.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.566+0000 7f911162f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:08.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.566+0000 7f911162f800 20 zonegroup default 2024-09-12T17:39:08.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.566+0000 7f911162f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.566+0000 7f911162f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.566+0000 7f911162f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.566+0000 7f911162f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.566+0000 7f911162f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.567+0000 7f911162f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.567+0000 7f911162f800 20 started sync module instance, tier type = 2024-09-12T17:39:08.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.567+0000 7f911162f800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:39:08.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.576+0000 7f911162f800 20 add_watcher() i=0 2024-09-12T17:39:08.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.576+0000 7f911162f800 20 add_watcher() i=1 2024-09-12T17:39:08.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.576+0000 7f911162f800 20 add_watcher() i=2 2024-09-12T17:39:08.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.576+0000 7f911162f800 20 add_watcher() i=3 2024-09-12T17:39:08.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.576+0000 7f911162f800 20 add_watcher() i=4 2024-09-12T17:39:08.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.576+0000 7f911162f800 20 add_watcher() i=5 2024-09-12T17:39:08.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.576+0000 7f911162f800 20 add_watcher() i=6 2024-09-12T17:39:08.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.577+0000 7f911162f800 20 add_watcher() i=7 2024-09-12T17:39:08.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.577+0000 7f911162f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:08.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.579+0000 7f8fc2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:08.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.579+0000 7f911162f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:08.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.579+0000 7f911162f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:08.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.579+0000 7f911162f800 5 note: GC not initialized 2024-09-12T17:39:08.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.579+0000 7f8fc1fe3640 20 reqs_thread_entry: start 2024-09-12T17:39:08.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.579+0000 7f911162f800 20 init_complete bucket index max shards: 1 2024-09-12T17:39:08.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.579+0000 7f911162f800 20 Filter name: none 2024-09-12T17:39:08.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.579+0000 7f8f337fe640 20 reqs_thread_entry: start 2024-09-12T17:39:08.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.579+0000 7f911162f800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T17:39:08.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.579+0000 7f911162f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.580+0000 7f911162f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.580+0000 7f911162f800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-12T17:39:08.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.580+0000 7f911162f800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:39:08.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.580+0000 7f911162f800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-12T17:39:08.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.580+0000 7f911162f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.580+0000 7f911162f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.580+0000 7f911162f800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-12T17:39:08.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.580+0000 7f911162f800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T17:39:08.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.580+0000 7f911162f800 10 cache get: name=default.rgw.meta+users.keys+QGVUDRFLJUDUJEWGEMVH : miss 2024-09-12T17:39:08.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.580+0000 7f911162f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.580+0000 7f911162f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.580+0000 7f911162f800 10 cache put: name=default.rgw.meta+users.keys+QGVUDRFLJUDUJEWGEMVH info.flags=0x0 2024-09-12T17:39:08.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.580+0000 7f911162f800 10 adding default.rgw.meta+users.keys+QGVUDRFLJUDUJEWGEMVH to cache LRU end 2024-09-12T17:39:08.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.580+0000 7f911162f800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-12T17:39:08.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.580+0000 7f911162f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.581+0000 7f911162f800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T17:39:08.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.581+0000 7f911162f800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T17:39:08.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.581+0000 7f911162f800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T17:39:08.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.581+0000 7f911162f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:08.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.581+0000 7f911162f800 10 cache get: name=default.rgw.meta+users.keys+QGVUDRFLJUDUJEWGEMVH : hit (negative entry) 2024-09-12T17:39:08.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.581+0000 7f911162f800 10 cache get: name=default.rgw.meta+users.keys+QGVUDRFLJUDUJEWGEMVH : hit (negative entry) 2024-09-12T17:39:08.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.583+0000 7f911162f800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:39:08.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.583+0000 7f911162f800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:39:08.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.583+0000 7f911162f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T17:39:08.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.583+0000 7f8fe3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366333 cookie 93983403500976 notifier 8684 bl.length()=681 2024-09-12T17:39:08.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.583+0000 7f8fe3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:39:08.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.583+0000 7f8fe3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:39:08.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.586+0000 7f911162f800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T17:39:08.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.586+0000 7f911162f800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T17:39:08.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.586+0000 7f911162f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-12T17:39:08.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.586+0000 7f8fe3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366362 cookie 93983403515200 notifier 8684 bl.length()=189 2024-09-12T17:39:08.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.586+0000 7f8fe3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T17:39:08.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.586+0000 7f8fe3fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T17:39:08.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.589+0000 7f911162f800 10 cache put: name=default.rgw.meta+users.keys+QGVUDRFLJUDUJEWGEMVH info.flags=0x7 2024-09-12T17:39:08.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.589+0000 7f911162f800 10 moving default.rgw.meta+users.keys+QGVUDRFLJUDUJEWGEMVH to cache LRU end 2024-09-12T17:39:08.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.589+0000 7f911162f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:QGVUDRFLJUDUJEWGEMVH, ofs0, ns] 2024-09-12T17:39:08.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.589+0000 7f8fe3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366363 cookie 93983403515200 notifier 8684 bl.length()=188 2024-09-12T17:39:08.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.589+0000 7f8fe3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+QGVUDRFLJUDUJEWGEMVH info.flags=0x7 2024-09-12T17:39:08.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.589+0000 7f8fe3fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+QGVUDRFLJUDUJEWGEMVH to cache LRU end 2024-09-12T17:39:08.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.592+0000 7f911162f800 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-12T17:39:08.593 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T17:39:08.593 INFO:teuthology.orchestra.run.smithi067.stdout: "user_id": "root1.client.0", 2024-09-12T17:39:08.593 INFO:teuthology.orchestra.run.smithi067.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-12T17:39:08.593 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "root1+test@test.test", 2024-09-12T17:39:08.593 INFO:teuthology.orchestra.run.smithi067.stdout: "suspended": 0, 2024-09-12T17:39:08.593 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T17:39:08.593 INFO:teuthology.orchestra.run.smithi067.stdout: "subusers": [], 2024-09-12T17:39:08.594 INFO:teuthology.orchestra.run.smithi067.stdout: "keys": [ 2024-09-12T17:39:08.594 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-12T17:39:08.594 INFO:teuthology.orchestra.run.smithi067.stdout: "user": "root1.client.0", 2024-09-12T17:39:08.594 INFO:teuthology.orchestra.run.smithi067.stdout: "access_key": "QGVUDRFLJUDUJEWGEMVH", 2024-09-12T17:39:08.594 INFO:teuthology.orchestra.run.smithi067.stdout: "secret_key": "FCDj0CTNjZfuewQpEH4IIy/IwWXDJw8pbfppqEAnMNb51ZwkzMQLJg==", 2024-09-12T17:39:08.594 INFO:teuthology.orchestra.run.smithi067.stdout: "active": true, 2024-09-12T17:39:08.594 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T17:39:08.582099Z" 2024-09-12T17:39:08.594 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-12T17:39:08.594 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-12T17:39:08.594 INFO:teuthology.orchestra.run.smithi067.stdout: "swift_keys": [], 2024-09-12T17:39:08.594 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": [], 2024-09-12T17:39:08.594 INFO:teuthology.orchestra.run.smithi067.stdout: "op_mask": "read, write, delete", 2024-09-12T17:39:08.594 INFO:teuthology.orchestra.run.smithi067.stdout: "default_placement": "", 2024-09-12T17:39:08.594 INFO:teuthology.orchestra.run.smithi067.stdout: "default_storage_class": "", 2024-09-12T17:39:08.595 INFO:teuthology.orchestra.run.smithi067.stdout: "placement_tags": [], 2024-09-12T17:39:08.595 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T17:39:08.595 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:39:08.595 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:39:08.595 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:39:08.595 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:39:08.595 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:39:08.595 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:39:08.595 INFO:teuthology.orchestra.run.smithi067.stdout: "user_quota": { 2024-09-12T17:39:08.595 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:39:08.595 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:39:08.595 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:39:08.595 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:39:08.595 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:39:08.596 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:39:08.596 INFO:teuthology.orchestra.run.smithi067.stdout: "temp_url_keys": [], 2024-09-12T17:39:08.596 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "root", 2024-09-12T17:39:08.596 INFO:teuthology.orchestra.run.smithi067.stdout: "mfa_ids": [], 2024-09-12T17:39:08.596 INFO:teuthology.orchestra.run.smithi067.stdout: "account_id": "RGW88888888888888888", 2024-09-12T17:39:08.596 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-12T17:39:08.596 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T17:39:08.582087Z", 2024-09-12T17:39:08.596 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-12T17:39:08.596 INFO:teuthology.orchestra.run.smithi067.stdout: "group_ids": [] 2024-09-12T17:39:08.596 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T17:39:08.596 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:39:08.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.593+0000 7f8fc2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:08.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.596+0000 7f911162f800 20 remove_watcher() i=0 2024-09-12T17:39:08.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.596+0000 7f911162f800 2 removed watcher, disabling cache 2024-09-12T17:39:08.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.597+0000 7f911162f800 20 remove_watcher() i=1 2024-09-12T17:39:08.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.598+0000 7f911162f800 20 remove_watcher() i=2 2024-09-12T17:39:08.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.599+0000 7f911162f800 20 remove_watcher() i=3 2024-09-12T17:39:08.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.600+0000 7f911162f800 20 remove_watcher() i=4 2024-09-12T17:39:08.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.602+0000 7f911162f800 20 remove_watcher() i=5 2024-09-12T17:39:08.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.603+0000 7f911162f800 20 remove_watcher() i=6 2024-09-12T17:39:08.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.604+0000 7f911162f800 20 remove_watcher() i=7 2024-09-12T17:39:08.616 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 1173076499 --totp-seed F6O5ZVCESS23SCC7ENSBWF2ZL5BKAMHFLQCSMS3ANRJWIDKXPXW65Z3TENO25WG7 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:39:08.684 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:08.684 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:08.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.718+0000 7ff013d46800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.719+0000 7ff013d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.719+0000 7ff013d46800 20 realm 2024-09-12T17:39:08.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.719+0000 7ff013d46800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.720+0000 7ff013d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.720+0000 7ff013d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:08.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.720+0000 7ff013d46800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.720+0000 7ff013d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.720+0000 7ff013d46800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.722+0000 7ff013d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:08.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.722+0000 7ff013d46800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.723+0000 7ff013d46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:08.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.723+0000 7ff013d46800 20 searching for the correct realm 2024-09-12T17:39:08.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.725+0000 7ff011036640 0 -- 172.21.15.67:0/3467672667 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7feedc087070 msgr2=0x7feedc0894a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:08.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:08.932+0000 7ff011837640 0 -- 172.21.15.67:0/3467672667 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7ff00803c740 msgr2=0x7ff008016020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.139+0000 7ff013d46800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:39:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.139+0000 7ff013d46800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:39:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.139+0000 7ff013d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.139+0000 7ff013d46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.139+0000 7ff013d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.139+0000 7ff013d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.140+0000 7ff013d46800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.140+0000 7ff013d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.140+0000 7ff013d46800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.140+0000 7ff013d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.140+0000 7ff013d46800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.141+0000 7ff013d46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.141+0000 7ff013d46800 20 zone default found 2024-09-12T17:39:09.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.141+0000 7ff013d46800 4 Realm: () 2024-09-12T17:39:09.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.141+0000 7ff013d46800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:39:09.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.141+0000 7ff013d46800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:39:09.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.141+0000 7ff013d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:09.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.141+0000 7ff013d46800 20 zonegroup default 2024-09-12T17:39:09.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.141+0000 7ff013d46800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.141+0000 7ff013d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.141+0000 7ff013d46800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.141+0000 7ff013d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.141+0000 7ff013d46800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.142+0000 7ff013d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.142+0000 7ff013d46800 20 started sync module instance, tier type = 2024-09-12T17:39:09.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.142+0000 7ff013d46800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:39:09.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.152+0000 7ff013d46800 20 add_watcher() i=0 2024-09-12T17:39:09.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.152+0000 7ff013d46800 20 add_watcher() i=1 2024-09-12T17:39:09.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.152+0000 7ff013d46800 20 add_watcher() i=2 2024-09-12T17:39:09.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.152+0000 7ff013d46800 20 add_watcher() i=3 2024-09-12T17:39:09.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.152+0000 7ff013d46800 20 add_watcher() i=4 2024-09-12T17:39:09.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.152+0000 7ff013d46800 20 add_watcher() i=5 2024-09-12T17:39:09.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.153+0000 7ff013d46800 20 add_watcher() i=6 2024-09-12T17:39:09.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.153+0000 7ff013d46800 20 add_watcher() i=7 2024-09-12T17:39:09.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.153+0000 7ff013d46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:09.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.155+0000 7feec7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:09.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.155+0000 7ff013d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:09.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.155+0000 7ff013d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:09.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.155+0000 7ff013d46800 5 note: GC not initialized 2024-09-12T17:39:09.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.155+0000 7feec6fe5640 20 reqs_thread_entry: start 2024-09-12T17:39:09.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.155+0000 7ff013d46800 20 init_complete bucket index max shards: 1 2024-09-12T17:39:09.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.155+0000 7ff013d46800 20 Filter name: none 2024-09-12T17:39:09.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.156+0000 7feec4fe1640 20 reqs_thread_entry: start 2024-09-12T17:39:09.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.156+0000 7ff013d46800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T17:39:09.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.156+0000 7ff013d46800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.156+0000 7ff013d46800 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T17:39:09.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.156+0000 7ff013d46800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-12T17:39:09.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.156+0000 7ff013d46800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:39:09.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.156+0000 7ff013d46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:09.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.159+0000 7ff013d46800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:39:09.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.159+0000 7ff013d46800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:39:09.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.159+0000 7ff013d46800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T17:39:09.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.159+0000 7feef57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366334 cookie 94023552676304 notifier 8702 bl.length()=695 2024-09-12T17:39:09.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.159+0000 7feef57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:39:09.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.159+0000 7feef57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:39:09.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.162+0000 7feec7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:09.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.164+0000 7ff013d46800 20 remove_watcher() i=0 2024-09-12T17:39:09.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.164+0000 7ff013d46800 2 removed watcher, disabling cache 2024-09-12T17:39:09.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.165+0000 7ff013d46800 20 remove_watcher() i=1 2024-09-12T17:39:09.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.167+0000 7ff013d46800 20 remove_watcher() i=2 2024-09-12T17:39:09.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.168+0000 7ff013d46800 20 remove_watcher() i=3 2024-09-12T17:39:09.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.169+0000 7ff013d46800 20 remove_watcher() i=4 2024-09-12T17:39:09.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.170+0000 7ff013d46800 20 remove_watcher() i=5 2024-09-12T17:39:09.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.171+0000 7ff013d46800 20 remove_watcher() i=6 2024-09-12T17:39:09.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.172+0000 7ff013d46800 20 remove_watcher() i=7 2024-09-12T17:39:09.184 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-12T17:39:09.246 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:09.246 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:09.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.281+0000 7fa66f40e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.282+0000 7fa66f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.282+0000 7fa66f40e800 20 realm 2024-09-12T17:39:09.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.282+0000 7fa66f40e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.283+0000 7fa66f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.283+0000 7fa66f40e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:09.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.283+0000 7fa66f40e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.283+0000 7fa66f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.283+0000 7fa66f40e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.284+0000 7fa66f40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:09.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.284+0000 7fa66f40e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.285+0000 7fa66f40e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:09.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.285+0000 7fa66f40e800 20 searching for the correct realm 2024-09-12T17:39:09.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.288+0000 7fa66b36c640 0 -- 172.21.15.67:0/3735987743 >> [v2:172.21.15.67:6824/3249659332,v1:172.21.15.67:6825/3249659332] conn(0x562b2e4ecd20 msgr2=0x562b2e4ef1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:09.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.292+0000 7fa66a36a640 0 -- 172.21.15.67:0/3735987743 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x562b2e4f4910 msgr2=0x562b2e4f6d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:39:09.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.296+0000 7fa66f40e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:39:09.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.296+0000 7fa66f40e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:39:09.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.296+0000 7fa66f40e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:09.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.296+0000 7fa66f40e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:09.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.296+0000 7fa66f40e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:09.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.296+0000 7fa66f40e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:09.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.296+0000 7fa66f40e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.296+0000 7fa66f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.296+0000 7fa66f40e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.297+0000 7fa66f40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:09.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.297+0000 7fa66f40e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.297+0000 7fa66f40e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:09.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.297+0000 7fa66f40e800 20 zone default found 2024-09-12T17:39:09.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.297+0000 7fa66f40e800 4 Realm: () 2024-09-12T17:39:09.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.297+0000 7fa66f40e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:39:09.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.297+0000 7fa66f40e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:39:09.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.297+0000 7fa66f40e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:09.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.297+0000 7fa66f40e800 20 zonegroup default 2024-09-12T17:39:09.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.297+0000 7fa66f40e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.297+0000 7fa66f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.297+0000 7fa66f40e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.298+0000 7fa66f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.298+0000 7fa66f40e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.298+0000 7fa66f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.298+0000 7fa66f40e800 20 started sync module instance, tier type = 2024-09-12T17:39:09.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.298+0000 7fa66f40e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:39:09.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.307+0000 7fa66f40e800 20 add_watcher() i=0 2024-09-12T17:39:09.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.307+0000 7fa66f40e800 20 add_watcher() i=1 2024-09-12T17:39:09.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.307+0000 7fa66f40e800 20 add_watcher() i=2 2024-09-12T17:39:09.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.307+0000 7fa66f40e800 20 add_watcher() i=3 2024-09-12T17:39:09.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.307+0000 7fa66f40e800 20 add_watcher() i=4 2024-09-12T17:39:09.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.307+0000 7fa66f40e800 20 add_watcher() i=5 2024-09-12T17:39:09.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.307+0000 7fa66f40e800 20 add_watcher() i=6 2024-09-12T17:39:09.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.308+0000 7fa66f40e800 20 add_watcher() i=7 2024-09-12T17:39:09.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.308+0000 7fa66f40e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:09.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.310+0000 7fa5217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:09.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.310+0000 7fa66f40e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:09.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.310+0000 7fa66f40e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:09.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.310+0000 7fa66f40e800 5 note: GC not initialized 2024-09-12T17:39:09.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.310+0000 7fa49bfff640 20 reqs_thread_entry: start 2024-09-12T17:39:09.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.310+0000 7fa66f40e800 20 init_complete bucket index max shards: 1 2024-09-12T17:39:09.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.310+0000 7fa66f40e800 20 Filter name: none 2024-09-12T17:39:09.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.310+0000 7fa499ffb640 20 reqs_thread_entry: start 2024-09-12T17:39:09.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.311+0000 7fa66f40e800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-12T17:39:09.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.311+0000 7fa66f40e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.311+0000 7fa66f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.311+0000 7fa66f40e800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-12T17:39:09.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.311+0000 7fa66f40e800 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T17:39:09.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.311+0000 7fa66f40e800 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-12T17:39:09.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.311+0000 7fa66f40e800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-12T17:39:09.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.311+0000 7fa66f40e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.311+0000 7fa66f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.311+0000 7fa66f40e800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-12T17:39:09.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.311+0000 7fa66f40e800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T17:39:09.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.311+0000 7fa66f40e800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-12T17:39:09.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.313+0000 7fa66f40e800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T17:39:09.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.313+0000 7fa66f40e800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T17:39:09.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.313+0000 7fa66f40e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-12T17:39:09.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.313+0000 7fa54e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366335 cookie 94743460534400 notifier 8720 bl.length()=384 2024-09-12T17:39:09.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.313+0000 7fa54e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T17:39:09.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.313+0000 7fa54e7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T17:39:09.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.316+0000 7fa66f40e800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T17:39:09.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.316+0000 7fa66f40e800 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T17:39:09.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.316+0000 7fa66f40e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-12T17:39:09.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.316+0000 7fa54e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366315 cookie 94743460565328 notifier 8720 bl.length()=225 2024-09-12T17:39:09.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.316+0000 7fa54e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T17:39:09.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.316+0000 7fa54e7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T17:39:09.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.319+0000 7fa66f40e800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T17:39:09.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.319+0000 7fa66f40e800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T17:39:09.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.319+0000 7fa66f40e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-12T17:39:09.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.319+0000 7fa54dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366251 cookie 94743460505120 notifier 8720 bl.length()=234 2024-09-12T17:39:09.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.319+0000 7fa54dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T17:39:09.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.319+0000 7fa54dffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T17:39:09.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.321+0000 7fa5217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:09.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.323+0000 7fa66f40e800 20 remove_watcher() i=0 2024-09-12T17:39:09.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.323+0000 7fa66f40e800 2 removed watcher, disabling cache 2024-09-12T17:39:09.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.324+0000 7fa66f40e800 20 remove_watcher() i=1 2024-09-12T17:39:09.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.325+0000 7fa66f40e800 20 remove_watcher() i=2 2024-09-12T17:39:09.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.327+0000 7fa66f40e800 20 remove_watcher() i=3 2024-09-12T17:39:09.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.328+0000 7fa66f40e800 20 remove_watcher() i=4 2024-09-12T17:39:09.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.328+0000 7fa66f40e800 20 remove_watcher() i=5 2024-09-12T17:39:09.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.330+0000 7fa66f40e800 20 remove_watcher() i=6 2024-09-12T17:39:09.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.331+0000 7fa66f40e800 20 remove_watcher() i=7 2024-09-12T17:39:09.341 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T17:39:09.341 INFO:teuthology.orchestra.run.smithi067.stdout: "id": "RGW99999999999999999", 2024-09-12T17:39:09.341 INFO:teuthology.orchestra.run.smithi067.stdout: "tenant": "", 2024-09-12T17:39:09.341 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "Mr.RGW99999999999999999", 2024-09-12T17:39:09.341 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-12T17:39:09.341 INFO:teuthology.orchestra.run.smithi067.stdout: "quota": { 2024-09-12T17:39:09.342 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:39:09.342 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:39:09.342 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:39:09.342 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:39:09.342 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:39:09.342 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:39:09.342 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T17:39:09.342 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:39:09.342 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:39:09.343 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:39:09.343 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:39:09.343 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:39:09.343 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:39:09.343 INFO:teuthology.orchestra.run.smithi067.stdout: "max_users": 1000, 2024-09-12T17:39:09.343 INFO:teuthology.orchestra.run.smithi067.stdout: "max_roles": 1000, 2024-09-12T17:39:09.343 INFO:teuthology.orchestra.run.smithi067.stdout: "max_groups": 1000, 2024-09-12T17:39:09.343 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T17:39:09.343 INFO:teuthology.orchestra.run.smithi067.stdout: "max_access_keys": 4 2024-09-12T17:39:09.343 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T17:39:09.345 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-12T17:39:09.345 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key XSYPXRNIGGENIOTXKBBJ --secret xX8BOrFZUyFn62g2lJAnCQehbWwBzfPj1MlKof1sJGG6PVm3e0CZHw== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-12T17:39:09.415 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:09.415 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:09.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.451+0000 7f272bd24800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.452+0000 7f272bd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.452+0000 7f272bd24800 20 realm 2024-09-12T17:39:09.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.452+0000 7f272bd24800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.453+0000 7f272bd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.453+0000 7f272bd24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:09.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.453+0000 7f272bd24800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.453+0000 7f272bd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.453+0000 7f272bd24800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.454+0000 7f272bd24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:09.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.454+0000 7f272bd24800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.454+0000 7f272bd24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:09.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.454+0000 7f272bd24800 20 searching for the correct realm 2024-09-12T17:39:09.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.456+0000 7f27271d1640 0 -- 172.21.15.67:0/2617309512 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x5583475189c0 msgr2=0x55834751adb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:39:09.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.461+0000 7f27279d2640 0 -- 172.21.15.67:0/2617309512 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f27100d5060 msgr2=0x7f27100e9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:09.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.668+0000 7f272bd24800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:39:09.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.668+0000 7f272bd24800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:39:09.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.668+0000 7f272bd24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:09.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.668+0000 7f272bd24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:09.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.668+0000 7f272bd24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:09.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.668+0000 7f272bd24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:09.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.668+0000 7f272bd24800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.668+0000 7f272bd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.668+0000 7f272bd24800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.668+0000 7f272bd24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:09.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.668+0000 7f272bd24800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.669+0000 7f272bd24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:09.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.669+0000 7f272bd24800 20 zone default found 2024-09-12T17:39:09.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.669+0000 7f272bd24800 4 Realm: () 2024-09-12T17:39:09.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.669+0000 7f272bd24800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:39:09.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.669+0000 7f272bd24800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:39:09.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.669+0000 7f272bd24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:09.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.669+0000 7f272bd24800 20 zonegroup default 2024-09-12T17:39:09.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.669+0000 7f272bd24800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.669+0000 7f272bd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.669+0000 7f272bd24800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.669+0000 7f272bd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.669+0000 7f272bd24800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.670+0000 7f272bd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.670+0000 7f272bd24800 20 started sync module instance, tier type = 2024-09-12T17:39:09.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.670+0000 7f272bd24800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:39:09.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.679+0000 7f272bd24800 20 add_watcher() i=0 2024-09-12T17:39:09.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.679+0000 7f272bd24800 20 add_watcher() i=1 2024-09-12T17:39:09.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.679+0000 7f272bd24800 20 add_watcher() i=2 2024-09-12T17:39:09.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.679+0000 7f272bd24800 20 add_watcher() i=3 2024-09-12T17:39:09.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.679+0000 7f272bd24800 20 add_watcher() i=4 2024-09-12T17:39:09.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.679+0000 7f272bd24800 20 add_watcher() i=5 2024-09-12T17:39:09.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.679+0000 7f272bd24800 20 add_watcher() i=6 2024-09-12T17:39:09.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.680+0000 7f272bd24800 20 add_watcher() i=7 2024-09-12T17:39:09.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.680+0000 7f272bd24800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:09.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.682+0000 7f25de7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:09.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.682+0000 7f272bd24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:09.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.682+0000 7f272bd24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:09.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.682+0000 7f272bd24800 5 note: GC not initialized 2024-09-12T17:39:09.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.682+0000 7f25dd7e2640 20 reqs_thread_entry: start 2024-09-12T17:39:09.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.682+0000 7f272bd24800 20 init_complete bucket index max shards: 1 2024-09-12T17:39:09.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.682+0000 7f272bd24800 20 Filter name: none 2024-09-12T17:39:09.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.682+0000 7f25d67fc640 20 reqs_thread_entry: start 2024-09-12T17:39:09.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.682+0000 7f272bd24800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T17:39:09.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.682+0000 7f272bd24800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.683+0000 7f272bd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.683+0000 7f272bd24800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-12T17:39:09.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.683+0000 7f272bd24800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:39:09.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.683+0000 7f272bd24800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-12T17:39:09.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.683+0000 7f272bd24800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.683+0000 7f272bd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.683+0000 7f272bd24800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-12T17:39:09.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.683+0000 7f272bd24800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T17:39:09.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.683+0000 7f272bd24800 10 cache get: name=default.rgw.meta+users.keys+XSYPXRNIGGENIOTXKBBJ : miss 2024-09-12T17:39:09.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.683+0000 7f272bd24800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.683+0000 7f272bd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.683+0000 7f272bd24800 10 cache put: name=default.rgw.meta+users.keys+XSYPXRNIGGENIOTXKBBJ info.flags=0x0 2024-09-12T17:39:09.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.683+0000 7f272bd24800 10 adding default.rgw.meta+users.keys+XSYPXRNIGGENIOTXKBBJ to cache LRU end 2024-09-12T17:39:09.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.683+0000 7f272bd24800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-12T17:39:09.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.683+0000 7f272bd24800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.684+0000 7f272bd24800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T17:39:09.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.684+0000 7f272bd24800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T17:39:09.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.684+0000 7f272bd24800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T17:39:09.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.684+0000 7f272bd24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:09.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.684+0000 7f272bd24800 10 cache get: name=default.rgw.meta+users.keys+XSYPXRNIGGENIOTXKBBJ : hit (negative entry) 2024-09-12T17:39:09.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.684+0000 7f272bd24800 10 cache get: name=default.rgw.meta+users.keys+XSYPXRNIGGENIOTXKBBJ : hit (negative entry) 2024-09-12T17:39:09.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.686+0000 7f272bd24800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:39:09.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.686+0000 7f272bd24800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:39:09.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.686+0000 7f272bd24800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T17:39:09.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.686+0000 7f2606ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366336 cookie 94022325635040 notifier 9354 bl.length()=681 2024-09-12T17:39:09.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.686+0000 7f2606ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:39:09.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.686+0000 7f2606ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:39:09.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.689+0000 7f272bd24800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T17:39:09.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.689+0000 7f272bd24800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T17:39:09.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.689+0000 7f272bd24800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-12T17:39:09.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.689+0000 7f2606ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366364 cookie 94022325647088 notifier 9354 bl.length()=189 2024-09-12T17:39:09.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.689+0000 7f2606ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T17:39:09.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.689+0000 7f2606ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T17:39:09.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.692+0000 7f272bd24800 10 cache put: name=default.rgw.meta+users.keys+XSYPXRNIGGENIOTXKBBJ info.flags=0x7 2024-09-12T17:39:09.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.692+0000 7f272bd24800 10 moving default.rgw.meta+users.keys+XSYPXRNIGGENIOTXKBBJ to cache LRU end 2024-09-12T17:39:09.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.692+0000 7f272bd24800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:XSYPXRNIGGENIOTXKBBJ, ofs0, ns] 2024-09-12T17:39:09.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.692+0000 7f2606ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366365 cookie 94022325647088 notifier 9354 bl.length()=188 2024-09-12T17:39:09.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.692+0000 7f2606ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+XSYPXRNIGGENIOTXKBBJ info.flags=0x7 2024-09-12T17:39:09.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.692+0000 7f2606ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+XSYPXRNIGGENIOTXKBBJ to cache LRU end 2024-09-12T17:39:09.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.695+0000 7f272bd24800 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-12T17:39:09.696 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T17:39:09.696 INFO:teuthology.orchestra.run.smithi067.stdout: "user_id": "root2.client.0", 2024-09-12T17:39:09.696 INFO:teuthology.orchestra.run.smithi067.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-12T17:39:09.696 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "root2+test@test.test", 2024-09-12T17:39:09.697 INFO:teuthology.orchestra.run.smithi067.stdout: "suspended": 0, 2024-09-12T17:39:09.697 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T17:39:09.697 INFO:teuthology.orchestra.run.smithi067.stdout: "subusers": [], 2024-09-12T17:39:09.697 INFO:teuthology.orchestra.run.smithi067.stdout: "keys": [ 2024-09-12T17:39:09.697 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-12T17:39:09.697 INFO:teuthology.orchestra.run.smithi067.stdout: "user": "root2.client.0", 2024-09-12T17:39:09.697 INFO:teuthology.orchestra.run.smithi067.stdout: "access_key": "XSYPXRNIGGENIOTXKBBJ", 2024-09-12T17:39:09.697 INFO:teuthology.orchestra.run.smithi067.stdout: "secret_key": "xX8BOrFZUyFn62g2lJAnCQehbWwBzfPj1MlKof1sJGG6PVm3e0CZHw==", 2024-09-12T17:39:09.697 INFO:teuthology.orchestra.run.smithi067.stdout: "active": true, 2024-09-12T17:39:09.698 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T17:39:09.685094Z" 2024-09-12T17:39:09.698 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-12T17:39:09.698 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-12T17:39:09.698 INFO:teuthology.orchestra.run.smithi067.stdout: "swift_keys": [], 2024-09-12T17:39:09.698 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": [], 2024-09-12T17:39:09.698 INFO:teuthology.orchestra.run.smithi067.stdout: "op_mask": "read, write, delete", 2024-09-12T17:39:09.698 INFO:teuthology.orchestra.run.smithi067.stdout: "default_placement": "", 2024-09-12T17:39:09.698 INFO:teuthology.orchestra.run.smithi067.stdout: "default_storage_class": "", 2024-09-12T17:39:09.698 INFO:teuthology.orchestra.run.smithi067.stdout: "placement_tags": [], 2024-09-12T17:39:09.698 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T17:39:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:39:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:39:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:39:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:39:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:39:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:39:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: "user_quota": { 2024-09-12T17:39:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T17:39:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T17:39:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T17:39:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T17:39:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T17:39:09.700 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T17:39:09.700 INFO:teuthology.orchestra.run.smithi067.stdout: "temp_url_keys": [], 2024-09-12T17:39:09.700 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "root", 2024-09-12T17:39:09.700 INFO:teuthology.orchestra.run.smithi067.stdout: "mfa_ids": [], 2024-09-12T17:39:09.700 INFO:teuthology.orchestra.run.smithi067.stdout: "account_id": "RGW99999999999999999", 2024-09-12T17:39:09.700 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-12T17:39:09.700 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T17:39:09.685083Z", 2024-09-12T17:39:09.700 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-12T17:39:09.700 INFO:teuthology.orchestra.run.smithi067.stdout: "group_ids": [] 2024-09-12T17:39:09.700 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T17:39:09.700 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:39:09.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.696+0000 7f25de7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:09.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.698+0000 7f272bd24800 20 remove_watcher() i=0 2024-09-12T17:39:09.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.698+0000 7f272bd24800 2 removed watcher, disabling cache 2024-09-12T17:39:09.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.699+0000 7f272bd24800 20 remove_watcher() i=1 2024-09-12T17:39:09.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.700+0000 7f272bd24800 20 remove_watcher() i=2 2024-09-12T17:39:09.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.702+0000 7f272bd24800 20 remove_watcher() i=3 2024-09-12T17:39:09.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.703+0000 7f272bd24800 20 remove_watcher() i=4 2024-09-12T17:39:09.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.704+0000 7f272bd24800 20 remove_watcher() i=5 2024-09-12T17:39:09.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.705+0000 7f272bd24800 20 remove_watcher() i=6 2024-09-12T17:39:09.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.706+0000 7f272bd24800 20 remove_watcher() i=7 2024-09-12T17:39:09.718 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 1248698106 --totp-seed ADHJGRAWZ5YA5E2CIF7WLYQ3FIQTEFRRXKUFKRH42AQXOKBFY6HAPRC6RGCRJOIN --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:39:09.786 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:09.787 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:09.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.821+0000 7f1918e15800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.823+0000 7f1918e15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.823+0000 7f1918e15800 20 realm 2024-09-12T17:39:09.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.823+0000 7f1918e15800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.823+0000 7f1918e15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.823+0000 7f1918e15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:09.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.823+0000 7f1918e15800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.823+0000 7f1918e15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.823+0000 7f1918e15800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.824+0000 7f1918e15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:09.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.824+0000 7f1918e15800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.825+0000 7f1918e15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:09.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.825+0000 7f1918e15800 20 searching for the correct realm 2024-09-12T17:39:09.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.827+0000 7f1913d91640 0 -- 172.21.15.67:0/2418169570 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f19040b5310 msgr2=0x7f19040ab1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:09.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:09.831+0000 7f1914592640 0 -- 172.21.15.67:0/2418169570 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f19080676d0 msgr2=0x7f1908082ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:10.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.038+0000 7f1918e15800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T17:39:10.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.038+0000 7f1918e15800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T17:39:10.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.038+0000 7f1918e15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:10.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.038+0000 7f1918e15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:10.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.038+0000 7f1918e15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:10.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.038+0000 7f1918e15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:10.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.038+0000 7f1918e15800 20 rados->read ofs=0 len=0 2024-09-12T17:39:10.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.038+0000 7f1918e15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:10.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.038+0000 7f1918e15800 20 rados->read ofs=0 len=0 2024-09-12T17:39:10.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.039+0000 7f1918e15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:10.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.039+0000 7f1918e15800 20 rados->read ofs=0 len=0 2024-09-12T17:39:10.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.039+0000 7f1918e15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:10.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.039+0000 7f1918e15800 20 zone default found 2024-09-12T17:39:10.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.039+0000 7f1918e15800 4 Realm: () 2024-09-12T17:39:10.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.039+0000 7f1918e15800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T17:39:10.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.039+0000 7f1918e15800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T17:39:10.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.039+0000 7f1918e15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:10.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.039+0000 7f1918e15800 20 zonegroup default 2024-09-12T17:39:10.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.039+0000 7f1918e15800 20 rados->read ofs=0 len=0 2024-09-12T17:39:10.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.039+0000 7f1918e15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:10.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.040+0000 7f1918e15800 20 rados->read ofs=0 len=0 2024-09-12T17:39:10.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.040+0000 7f1918e15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:10.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.040+0000 7f1918e15800 20 rados->read ofs=0 len=0 2024-09-12T17:39:10.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.040+0000 7f1918e15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:10.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.040+0000 7f1918e15800 20 started sync module instance, tier type = 2024-09-12T17:39:10.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.040+0000 7f1918e15800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T17:39:10.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.049+0000 7f1918e15800 20 add_watcher() i=0 2024-09-12T17:39:10.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.049+0000 7f1918e15800 20 add_watcher() i=1 2024-09-12T17:39:10.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.049+0000 7f1918e15800 20 add_watcher() i=2 2024-09-12T17:39:10.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.049+0000 7f1918e15800 20 add_watcher() i=3 2024-09-12T17:39:10.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.049+0000 7f1918e15800 20 add_watcher() i=4 2024-09-12T17:39:10.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.049+0000 7f1918e15800 20 add_watcher() i=5 2024-09-12T17:39:10.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.049+0000 7f1918e15800 20 add_watcher() i=6 2024-09-12T17:39:10.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.050+0000 7f1918e15800 20 add_watcher() i=7 2024-09-12T17:39:10.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.050+0000 7f1918e15800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:10.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.052+0000 7f17cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:10.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.052+0000 7f1918e15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:10.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.052+0000 7f1918e15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:10.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.052+0000 7f1918e15800 5 note: GC not initialized 2024-09-12T17:39:10.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.052+0000 7f17c9fdb640 20 reqs_thread_entry: start 2024-09-12T17:39:10.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.052+0000 7f1918e15800 20 init_complete bucket index max shards: 1 2024-09-12T17:39:10.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.052+0000 7f1918e15800 20 Filter name: none 2024-09-12T17:39:10.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.053+0000 7f173b7fe640 20 reqs_thread_entry: start 2024-09-12T17:39:10.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.053+0000 7f1918e15800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T17:39:10.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.053+0000 7f1918e15800 20 rados->read ofs=0 len=0 2024-09-12T17:39:10.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.053+0000 7f1918e15800 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T17:39:10.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.053+0000 7f1918e15800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-12T17:39:10.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.053+0000 7f1918e15800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:39:10.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.053+0000 7f1918e15800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:10.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.056+0000 7f1918e15800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:39:10.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.056+0000 7f1918e15800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:39:10.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.056+0000 7f1918e15800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T17:39:10.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.056+0000 7f17eb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366337 cookie 94526226090160 notifier 8756 bl.length()=695 2024-09-12T17:39:10.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.056+0000 7f17eb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:39:10.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.056+0000 7f17eb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:39:10.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.059+0000 7f17cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:10.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.061+0000 7f1918e15800 20 remove_watcher() i=0 2024-09-12T17:39:10.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.061+0000 7f1918e15800 2 removed watcher, disabling cache 2024-09-12T17:39:10.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.063+0000 7f1918e15800 20 remove_watcher() i=1 2024-09-12T17:39:10.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.064+0000 7f1918e15800 20 remove_watcher() i=2 2024-09-12T17:39:10.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.065+0000 7f1918e15800 20 remove_watcher() i=3 2024-09-12T17:39:10.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.066+0000 7f1918e15800 20 remove_watcher() i=4 2024-09-12T17:39:10.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.068+0000 7f1918e15800 20 remove_watcher() i=5 2024-09-12T17:39:10.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.069+0000 7f1918e15800 20 remove_watcher() i=6 2024-09-12T17:39:10.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T17:39:10.070+0000 7f1918e15800 20 remove_watcher() i=7 2024-09-12T17:39:10.082 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-12T17:39:10.083 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T17:39:10.083 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-12T17:39:10.113 INFO:tasks.s3tests:Configuring boto... 2024-09-12T17:39:10.113 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T17:39:10.113 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T17:39:10.183 DEBUG:teuthology.orchestra.run.smithi067:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T17:39:10.370 INFO:teuthology.orchestra.run.smithi067.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-12T17:39:10.559 INFO:teuthology.orchestra.run.smithi067.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-12T17:39:10.836 INFO:teuthology.orchestra.run.smithi067.stdout:py installdeps: -rrequirements.txt 2024-09-12T17:41:03.240 INFO:teuthology.orchestra.run.smithi067.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-12T17:41:04.684 INFO:teuthology.orchestra.run.smithi067.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=cba888d705694fd346c596f5394bb1141f04a0664a7d4a33d90bdd9621290b55,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-12T17:41:04.684 INFO:teuthology.orchestra.run.smithi067.stdout:py run-test-pre: PYTHONHASHSEED='1336383690' 2024-09-12T17:41:04.684 INFO:teuthology.orchestra.run.smithi067.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T17:41:04.823 INFO:teuthology.orchestra.run.smithi067.stdout:============================= test session starts ============================== 2024-09-12T17:41:04.824 INFO:teuthology.orchestra.run.smithi067.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-12T17:41:04.824 INFO:teuthology.orchestra.run.smithi067.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T17:41:04.824 INFO:teuthology.orchestra.run.smithi067.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T17:41:04.824 INFO:teuthology.orchestra.run.smithi067.stdout:configfile: pytest.ini 2024-09-12T17:41:06.635 INFO:teuthology.orchestra.run.smithi067.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-12T17:41:06.636 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T17:41:07.265 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-12T17:41:07.584 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-12T17:41:07.888 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-12T17:41:08.191 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-12T17:41:08.520 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-12T17:41:08.747 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-12T17:41:09.102 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-12T17:41:09.332 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-12T17:41:09.461 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-12T17:41:09.589 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-12T17:41:09.903 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-12T17:41:10.227 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-12T17:41:10.542 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-12T17:41:10.864 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-12T17:41:10.995 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-12T17:41:11.123 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-12T17:41:11.205 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-12T17:41:11.285 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-12T17:41:11.367 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-12T17:41:11.451 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-12T17:41:11.532 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-12T17:41:11.614 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-12T17:41:11.695 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T17:41:11.780 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T17:41:11.859 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T17:41:11.943 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T17:41:12.025 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-12T17:41:12.107 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-12T17:41:12.189 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-12T17:41:12.271 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-12T17:41:12.352 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T17:41:12.432 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T17:41:12.513 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T17:41:12.595 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T17:41:12.678 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T17:41:12.759 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T17:41:12.840 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-12T17:41:12.923 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-12T17:41:13.005 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-12T17:41:13.087 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-12T17:41:13.169 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-12T17:41:13.249 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T17:41:13.331 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T17:41:13.413 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-12T17:41:13.496 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-12T17:41:13.576 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-12T17:41:13.657 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-12T17:41:13.738 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T17:41:13.819 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T17:41:13.901 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T17:41:13.983 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T17:41:14.067 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-12T17:41:14.150 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-12T17:41:14.908 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-12T17:41:24.601 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-12T17:41:32.401 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-12T17:41:49.440 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-12T17:42:10.839 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-12T17:42:17.296 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-12T17:42:23.234 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-12T17:42:24.804 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-12T17:42:25.134 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-12T17:42:25.992 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-12T17:42:26.932 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-12T17:42:27.928 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-12T17:42:28.375 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-12T17:42:28.818 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-12T17:42:28.819 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T17:42:28.820 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T17:42:28.821 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-12T17:42:28.821 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-12T17:42:28.822 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T17:42:28.823 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T17:42:28.824 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-12T17:42:28.825 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-12T17:42:28.825 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T17:42:28.826 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T17:42:28.827 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:42:28.828 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-12T17:42:28.829 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:42:28.830 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:42:28.830 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:42:28.831 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:42:28.832 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:42:28.833 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:42:28.834 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:42:28.834 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-12T17:42:28.835 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-12T17:42:28.836 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-12T17:42:28.837 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-12T17:42:28.838 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-12T17:42:28.839 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-12T17:42:28.839 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-12T17:42:28.840 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-12T17:42:28.928 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-12T17:42:28.941 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-12T17:42:30.019 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-12T17:42:39.314 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-12T17:42:40.005 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-12T17:42:40.880 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-12T17:42:41.754 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-12T17:42:42.625 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-12T17:42:43.492 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-12T17:42:44.188 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-12T17:42:45.102 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-12T17:42:45.868 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-12T17:42:46.637 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-12T17:42:47.328 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-12T17:42:47.925 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-12T17:42:48.520 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-12T17:42:49.004 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-12T17:42:49.714 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-12T17:42:50.748 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-12T17:42:51.316 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-12T17:42:52.005 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-12T17:42:52.712 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-12T17:42:53.397 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-12T17:42:54.086 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-12T17:42:54.775 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-12T17:42:55.373 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-12T17:42:55.969 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-12T17:42:56.461 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-12T17:42:56.974 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-12T17:42:57.443 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-12T17:42:57.915 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-12T17:42:58.389 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-12T17:42:59.269 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-12T17:42:59.767 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-12T17:43:00.258 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-12T17:43:00.900 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-12T17:43:01.518 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-12T17:43:02.023 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-12T17:43:02.646 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-12T17:43:03.272 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-12T17:43:04.050 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T17:43:04.617 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-12T17:43:05.239 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-12T17:43:05.858 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-12T17:43:06.802 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T17:43:07.678 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T17:43:08.462 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T17:43:09.376 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:43:10.380 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:43:12.225 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:43:14.153 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:43:15.191 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:43:16.195 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:43:17.033 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-12T17:43:17.998 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-12T17:43:18.740 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-12T17:43:20.317 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-12T17:43:21.381 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-12T17:43:22.655 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-12T17:43:25.120 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-12T17:43:28.328 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-12T17:43:30.210 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-12T17:43:31.941 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-12T17:43:33.245 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-12T17:43:34.140 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-12T17:43:35.680 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-12T17:43:36.795 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-12T17:43:38.262 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-12T17:43:39.329 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-12T17:43:41.238 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-12T17:43:42.785 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-12T17:43:44.835 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-12T17:43:46.861 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-12T17:43:48.330 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-12T17:43:49.660 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-12T17:43:50.739 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-12T17:43:53.175 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-12T17:43:55.014 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-12T17:43:57.092 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-12T17:43:59.039 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-12T17:44:00.915 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-12T17:44:02.792 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-12T17:44:04.332 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-12T17:44:05.446 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-12T17:44:06.697 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-12T17:44:08.940 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-12T17:44:11.844 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-12T17:44:13.116 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-12T17:44:15.011 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-12T17:44:16.905 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-12T17:44:18.752 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-12T17:44:20.830 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-12T17:44:22.986 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-12T17:44:25.034 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-12T17:44:26.986 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-12T17:44:28.254 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-12T17:44:29.316 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-12T17:44:30.361 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-12T17:44:31.446 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-12T17:44:33.225 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-12T17:44:35.094 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-12T17:44:36.973 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-12T17:44:38.774 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-12T17:44:40.625 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-12T17:44:42.458 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-12T17:44:44.259 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-12T17:44:46.115 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-12T17:44:47.899 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-12T17:44:49.744 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T17:44:51.598 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-12T17:44:53.446 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-12T17:44:54.722 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-12T17:44:56.005 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-12T17:44:57.233 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T17:44:58.487 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-12T17:44:59.435 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-12T17:45:00.368 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-12T17:45:01.304 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-12T17:45:02.229 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-12T17:45:03.121 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-12T17:45:04.022 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-12T17:45:04.966 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-12T17:45:05.878 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-12T17:45:06.798 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-12T17:45:08.404 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-12T17:45:10.018 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-12T17:45:10.828 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T17:45:11.653 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T17:45:12.562 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-12T17:45:13.458 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-12T17:45:15.071 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T17:45:16.684 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T17:45:17.634 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-12T17:45:18.545 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-12T17:45:19.464 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-12T17:45:20.366 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-12T17:45:21.275 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-12T17:45:22.176 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-12T17:45:23.081 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-12T17:45:24.029 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-12T17:45:24.926 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-12T17:45:25.839 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-12T17:45:26.737 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-12T17:45:27.642 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-12T17:45:28.502 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-12T17:45:29.374 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-12T17:45:30.278 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-12T17:45:31.208 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-12T17:45:32.164 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-12T17:46:19.977 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-12T17:46:20.851 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-12T17:46:21.711 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-12T17:46:22.581 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-12T17:46:23.444 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-12T17:46:24.347 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-12T17:46:25.219 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-12T17:46:26.099 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-12T17:46:26.958 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-12T17:46:27.821 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-12T17:46:28.689 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-12T17:46:29.543 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-12T17:46:30.467 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-12T17:46:31.375 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T17:46:32.276 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T17:46:33.182 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T17:46:34.085 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T17:46:34.996 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-12T17:46:35.905 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-12T17:46:36.852 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T17:46:37.758 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T17:46:38.664 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T17:46:39.568 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T17:46:40.545 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-12T17:46:41.502 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-12T17:46:42.444 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-12T17:46:43.342 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-12T17:46:44.244 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-12T17:46:45.161 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-12T17:46:45.645 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-12T17:46:46.435 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-12T17:46:48.633 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-12T17:46:50.795 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-12T17:46:51.720 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-12T17:46:52.636 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-12T17:46:53.540 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-12T17:46:54.449 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-12T17:46:55.453 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-12T17:46:56.434 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-12T17:46:57.355 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-12T17:46:58.259 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-12T17:46:59.162 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-12T17:47:00.072 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-12T17:47:00.986 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-12T17:47:01.947 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-12T17:47:03.100 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-12T17:47:04.605 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-12T17:47:05.387 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-12T17:47:06.178 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-12T17:47:06.880 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-12T17:47:07.571 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-12T17:47:08.076 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-12T17:47:08.550 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-12T17:47:09.025 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-12T17:47:09.819 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-12T17:47:14.058 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-12T17:47:14.532 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-12T17:47:15.309 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-12T17:47:15.967 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-12T17:47:16.694 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-12T17:47:17.392 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-12T17:47:19.784 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-12T17:47:20.847 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-12T17:47:22.012 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-12T17:48:10.444 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-12T17:48:58.411 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-12T17:48:59.188 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-12T17:49:00.006 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-12T17:49:00.802 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-12T17:49:01.605 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-12T17:49:02.508 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-12T17:49:03.308 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-12T17:49:04.123 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-12T17:49:05.068 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-12T17:49:05.911 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-12T17:49:06.793 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-12T17:49:07.630 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-12T17:49:08.594 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-12T17:49:09.377 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-12T17:49:10.074 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-12T17:49:10.829 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-12T17:49:11.588 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-12T17:49:13.311 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-12T17:49:14.170 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-12T17:49:14.921 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-12T17:49:15.681 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-12T17:49:16.564 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-12T17:49:17.410 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-12T17:49:18.115 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-12T17:49:18.813 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-12T17:49:19.507 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-12T17:49:20.204 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-12T17:49:20.908 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-12T17:49:21.633 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-12T17:49:22.477 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-12T17:49:23.214 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-12T17:49:23.907 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-12T17:49:24.600 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-12T17:49:25.309 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-12T17:49:26.241 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-12T17:49:26.935 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-12T17:49:27.638 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-12T17:49:28.332 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-12T17:49:29.044 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-12T17:49:29.782 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-12T17:49:30.482 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-12T17:49:31.179 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-12T17:49:33.018 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-12T17:49:33.704 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-12T17:49:34.557 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-12T17:49:35.386 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-12T17:49:36.178 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-12T17:49:37.062 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-12T17:49:37.892 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-12T17:49:39.804 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-12T17:49:40.641 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-12T17:49:41.476 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-12T17:49:42.415 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-12T17:49:43.390 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-12T17:49:44.339 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-12T17:49:45.145 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-12T17:49:46.088 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-12T17:49:47.091 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-12T17:49:47.934 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-12T17:49:48.920 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-12T17:49:49.701 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-12T17:49:50.462 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-12T17:49:51.221 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-12T17:49:52.064 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-12T17:49:52.813 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-12T17:49:53.287 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-12T17:49:54.263 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-12T17:49:55.050 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-12T17:49:55.833 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-12T17:49:59.140 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-12T17:49:59.930 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-12T17:50:00.711 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-12T17:50:01.551 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-12T17:50:02.333 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-12T17:50:03.059 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-12T17:50:03.853 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-12T17:50:04.742 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-12T17:50:05.639 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-12T17:50:06.452 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-12T17:50:07.242 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-12T17:50:08.049 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-12T17:50:08.945 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-12T17:50:09.809 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-12T17:50:10.573 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-12T17:50:11.417 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-12T17:50:12.307 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-12T17:50:13.162 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-12T17:50:13.640 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-12T17:50:14.122 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-12T17:50:14.600 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-12T17:50:15.205 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-12T17:50:15.806 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-12T17:50:16.396 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-12T17:50:17.049 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-12T17:50:17.702 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-12T17:50:18.177 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-12T17:50:18.653 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-12T17:50:19.259 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-12T17:50:19.731 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-12T17:50:20.213 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-12T17:50:20.696 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-12T17:50:21.174 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-12T17:50:21.814 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-12T17:50:22.485 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-12T17:50:23.215 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-12T17:50:23.874 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-12T17:50:24.533 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-12T17:50:25.221 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-12T17:50:25.876 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-12T17:50:26.633 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-12T17:50:27.288 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T17:50:27.940 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T17:50:28.771 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-12T17:50:29.634 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-12T17:50:30.555 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-12T17:50:31.400 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T17:50:32.245 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T17:50:33.137 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-12T17:50:34.032 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-12T17:50:34.937 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-12T17:50:35.885 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-12T17:50:36.635 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-12T17:50:37.555 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-12T17:50:38.478 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-12T17:50:39.404 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-12T17:50:40.338 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-12T17:50:41.274 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-12T17:50:42.663 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-12T17:50:43.914 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-12T17:50:45.142 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-12T17:50:46.440 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-12T17:50:47.646 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-12T17:50:48.451 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-12T17:50:49.287 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-12T17:50:50.182 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-12T17:50:51.036 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-12T17:50:51.861 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-12T17:50:52.851 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-12T17:50:54.171 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-12T17:50:55.485 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-12T17:50:56.858 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-12T17:50:58.182 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-12T17:50:59.506 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-12T17:51:00.817 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-12T17:51:02.162 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-12T17:51:03.524 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-12T17:51:04.835 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-12T17:51:06.045 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-12T17:51:07.289 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-12T17:51:08.491 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-12T17:51:09.884 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-12T17:51:11.183 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-12T17:51:11.656 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-12T17:51:12.134 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-12T17:51:12.618 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-12T17:51:13.443 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-12T17:51:14.223 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-12T17:51:14.819 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-12T17:51:15.416 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-12T17:51:16.447 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-12T17:51:18.945 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-12T17:51:19.979 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-12T17:51:20.931 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-12T17:51:25.895 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-12T17:51:26.847 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-12T17:51:27.792 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-12T17:51:28.642 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-12T17:51:29.523 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-12T17:51:30.729 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-12T17:51:31.678 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-12T17:51:32.942 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-12T17:51:34.033 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-12T17:51:35.682 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-12T17:51:37.244 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-12T17:51:37.930 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-12T17:51:38.622 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-12T17:51:41.096 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-12T17:51:42.133 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-12T17:52:11.574 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-12T17:52:12.368 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-12T17:52:13.387 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-12T17:52:16.639 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-12T17:52:17.638 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-12T17:52:19.263 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-12T17:52:31.208 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-12T17:52:53.203 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-12T17:53:22.663 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-12T17:55:10.827 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-12T17:55:23.924 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-12T17:55:48.480 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-12T17:55:49.787 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-12T17:55:56.682 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-12T17:56:01.776 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-12T17:56:04.628 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-12T17:56:05.473 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-12T17:56:10.273 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-12T17:56:11.294 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-12T17:56:12.133 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-12T17:56:12.983 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-12T17:56:32.194 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-12T17:56:36.080 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-12T17:56:37.012 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-12T17:56:37.807 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-12T17:56:38.699 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-12T17:56:45.621 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-12T17:56:49.548 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-12T17:56:53.369 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-12T17:56:54.287 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-12T17:56:55.198 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-12T17:56:56.156 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-12T17:56:57.117 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-12T17:56:58.022 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-12T17:56:58.937 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-12T17:56:59.807 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-12T17:57:01.507 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-12T17:57:05.042 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-12T17:57:11.669 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-12T17:57:13.888 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-12T17:57:18.505 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-12T17:57:26.745 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-12T17:57:28.476 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-12T17:57:32.640 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-12T17:57:39.325 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-12T17:57:41.213 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-12T17:57:42.239 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-12T17:57:43.637 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-12T17:57:44.474 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-12T17:57:51.828 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-12T17:57:52.659 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-12T17:57:53.534 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-12T17:57:54.371 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-12T17:57:55.181 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-12T17:57:56.474 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-12T17:58:08.001 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-12T17:58:09.358 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-12T17:58:10.502 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-12T17:58:11.910 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-12T17:58:13.355 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-12T17:58:18.565 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-12T17:58:19.982 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-12T17:58:26.038 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-12T17:58:47.936 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-12T17:59:27.861 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-12T17:59:30.424 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-12T17:59:32.959 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-12T17:59:34.158 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-12T17:59:35.419 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-12T17:59:36.395 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-12T17:59:37.863 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-12T17:59:39.245 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-12T17:59:41.769 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-12T17:59:42.560 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-12T17:59:43.322 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-12T17:59:44.072 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-12T17:59:44.755 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-12T17:59:45.454 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-12T17:59:46.260 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-12T17:59:46.953 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-12T17:59:47.693 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-12T17:59:48.525 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-12T17:59:49.228 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-12T17:59:49.925 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-12T17:59:50.620 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-12T17:59:51.314 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-12T17:59:52.006 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-12T17:59:52.863 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-12T17:59:53.748 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-12T17:59:55.063 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-12T17:59:55.902 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-12T17:59:56.737 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-12T17:59:57.596 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-12T17:59:58.440 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-12T17:59:59.132 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-12T17:59:59.828 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-12T18:00:00.519 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-12T18:00:01.261 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-12T18:00:51.886 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-12T18:01:42.793 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-12T18:01:52.930 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-12T18:01:53.783 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-12T18:02:55.763 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-12T18:03:56.831 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-12T18:03:57.688 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-12T18:03:58.562 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-12T18:03:59.253 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-12T18:03:59.943 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-12T18:04:32.531 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-12T18:04:41.672 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-12T18:04:50.784 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-12T18:04:51.625 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-12T18:04:52.479 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-12T18:04:53.370 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-12T18:04:54.638 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-12T18:04:55.471 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-12T18:04:56.303 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-12T18:04:57.238 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-12T18:04:58.155 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-12T18:04:59.143 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-12T18:05:00.124 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-12T18:05:01.039 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-12T18:05:01.864 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-12T18:05:03.316 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-12T18:05:04.710 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-12T18:05:06.982 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-12T18:05:09.301 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-12T18:05:11.624 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-12T18:05:13.944 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-12T18:05:16.727 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-12T18:05:19.148 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-12T18:05:21.928 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-12T18:05:24.327 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-12T18:05:26.681 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-12T18:05:27.554 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-12T18:05:28.396 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-12T18:05:29.313 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-12T18:05:31.779 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-12T18:05:34.225 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-12T18:05:36.669 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-12T18:05:38.437 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-12T18:06:00.808 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-12T18:06:02.040 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-12T18:06:03.379 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T18:06:04.608 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T18:06:06.187 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-12T18:06:07.569 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-12T18:06:08.535 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-12T18:06:09.890 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-12T18:06:10.617 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-12T18:06:11.310 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-12T18:06:11.999 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-12T18:06:12.684 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-12T18:06:13.570 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-12T18:06:14.341 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-12T18:06:15.618 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-12T18:06:16.351 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-12T18:06:17.045 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-12T18:06:17.707 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-12T18:06:18.390 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-12T18:06:19.043 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-12T18:06:19.762 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-12T18:06:20.428 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-12T18:06:21.084 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-12T18:06:21.763 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-12T18:06:22.417 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-12T18:06:23.257 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-12T18:06:24.052 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-12T18:06:24.941 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-12T18:06:25.751 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-12T18:06:26.520 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-12T18:06:27.284 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-12T18:06:28.203 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-12T18:06:29.087 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-12T18:06:29.928 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-12T18:06:30.752 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-12T18:06:31.605 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-12T18:06:32.452 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-12T18:06:33.395 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-12T18:06:34.388 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-12T18:06:35.256 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-12T18:06:36.050 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-12T18:06:36.812 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-12T18:06:37.600 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-12T18:06:38.556 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-12T18:06:39.329 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-12T18:06:40.498 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T18:06:41.477 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T18:06:42.216 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-12T18:06:43.059 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-12T18:06:43.843 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-12T18:06:54.392 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-12T18:06:55.177 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-12T18:07:05.448 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-12T18:07:06.373 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-12T18:07:07.334 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-12T18:07:08.025 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-12T18:07:08.813 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T18:07:09.559 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T18:07:10.340 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T18:07:11.129 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-12T18:07:11.875 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-12T18:07:12.578 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-12T18:07:13.326 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-12T18:07:14.198 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-12T18:07:14.986 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-12T18:07:15.898 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-12T18:07:16.750 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-12T18:07:17.518 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-12T18:07:18.235 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-12T18:07:19.284 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-12T18:07:30.901 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-12T18:07:31.584 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-12T18:07:32.376 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-12T18:07:33.223 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-12T18:07:34.104 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-12T18:07:36.239 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-12T18:07:37.116 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-12T18:07:38.489 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-12T18:07:44.118 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-12T18:07:45.913 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-12T18:07:56.517 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-12T18:08:06.689 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-12T18:08:07.452 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-12T18:08:08.603 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-12T18:08:24.443 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-12T18:08:49.203 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-12T18:08:52.808 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-12T18:08:55.106 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-12T18:08:59.009 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-12T18:09:02.046 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-12T18:09:02.882 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-12T18:09:07.125 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-12T18:09:12.253 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-12T18:09:31.503 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-12T18:09:35.070 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-12T18:09:37.265 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-12T18:09:39.212 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-12T18:09:40.173 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-12T18:09:46.702 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-12T18:09:50.240 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-12T18:09:51.500 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-12T18:09:52.937 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-12T18:09:58.861 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-12T18:10:02.450 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-12T18:10:07.285 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-12T18:10:09.303 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-12T18:10:09.682 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-12T18:10:13.930 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-12T18:10:18.283 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-12T18:10:20.867 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-12T18:10:24.807 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-12T18:10:26.376 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-12T18:11:58.692 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-12T18:11:59.071 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-12T18:12:00.362 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-12T18:12:01.381 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-12T18:12:02.253 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-12T18:12:03.386 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-12T18:12:03.408 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-12T18:12:03.408 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:12:03.408 INFO:teuthology.orchestra.run.smithi067.stdout:=============================== warnings summary =============================== 2024-09-12T18:12:03.408 INFO:teuthology.orchestra.run.smithi067.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-12T18:12:03.408 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-12T18:12:03.408 INFO:teuthology.orchestra.run.smithi067.stdout: import imp 2024-09-12T18:12:03.409 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:12:03.409 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py:120 2024-09-12T18:12:03.409 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T18:12:03.409 INFO:teuthology.orchestra.run.smithi067.stdout: if boto_type is 'S3Connection': 2024-09-12T18:12:03.409 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:12:03.409 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py:124 2024-09-12T18:12:03.409 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T18:12:03.409 INFO:teuthology.orchestra.run.smithi067.stdout: elif boto_type is 'HTTPRequest': 2024-09-12T18:12:03.409 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:12:03.409 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py:359 2024-09-12T18:12:03.409 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-09-12T18:12:03.410 INFO:teuthology.orchestra.run.smithi067.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-12T18:12:03.410 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:12:03.410 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py:176 2024-09-12T18:12:03.410 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T18:12:03.410 INFO:teuthology.orchestra.run.smithi067.stdout: if k is 'BucketName': 2024-09-12T18:12:03.410 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:12:03.410 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py:253 2024-09-12T18:12:03.410 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-12T18:12:03.410 INFO:teuthology.orchestra.run.smithi067.stdout: @pytest.mark.timeout(10) 2024-09-12T18:12:03.410 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:12:03.410 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-12T18:12:03.411 INFO:teuthology.orchestra.run.smithi067.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-12T18:12:03.411 INFO:teuthology.orchestra.run.smithi067.stdout: @pytest.mark.s3website_routing_rules 2024-09-12T18:12:03.411 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:12:03.411 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-12T18:12:03.411 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:12:03.411 INFO:teuthology.orchestra.run.smithi067.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:12:03.411 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:12:03.411 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-12T18:12:03.411 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:12:03.411 INFO:teuthology.orchestra.run.smithi067.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T18:12:03.411 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:12:03.411 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-12T18:12:03.411 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:12:03.412 INFO:teuthology.orchestra.run.smithi067.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-12T18:12:03.412 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:12:03.412 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-12T18:12:03.412 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:12:03.412 INFO:teuthology.orchestra.run.smithi067.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:12:03.412 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:12:03.412 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-12T18:12:03.412 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:12:03.412 INFO:teuthology.orchestra.run.smithi067.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T18:12:03.412 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:12:03.412 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-12T18:12:03.412 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:12:03.412 INFO:teuthology.orchestra.run.smithi067.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:12:03.413 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:12:03.413 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-12T18:12:03.413 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:12:03.413 INFO:teuthology.orchestra.run.smithi067.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-12T18:12:03.413 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:12:03.413 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-12T18:12:03.413 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:12:03.413 INFO:teuthology.orchestra.run.smithi067.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:12:03.413 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:12:03.413 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-12T18:12:03.413 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:12:03.414 INFO:teuthology.orchestra.run.smithi067.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T18:12:03.414 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:12:03.414 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-12T18:12:03.414 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:12:03.414 INFO:teuthology.orchestra.run.smithi067.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:12:03.414 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:12:03.414 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-12T18:12:03.414 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:12:03.414 INFO:teuthology.orchestra.run.smithi067.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:12:03.414 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:12:03.414 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-09-12T18:12:03.414 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py: 82 warnings 2024-09-12T18:12:03.414 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py: 497 warnings 2024-09-12T18:12:03.414 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-09-12T18:12:03.415 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_sns.py: 3 warnings 2024-09-12T18:12:03.415 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi067.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T18:12:03.415 INFO:teuthology.orchestra.run.smithi067.stdout: warnings.warn( 2024-09-12T18:12:03.415 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:12:03.415 INFO:teuthology.orchestra.run.smithi067.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T18:12:03.415 INFO:teuthology.orchestra.run.smithi067.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 662 warnings in 1858.58s (0:30:58) = 2024-09-12T18:12:03.541 INFO:teuthology.orchestra.run.smithi067.stdout:___________________________________ summary ____________________________________ 2024-09-12T18:12:03.541 INFO:teuthology.orchestra.run.smithi067.stdout: py: commands succeeded 2024-09-12T18:12:03.541 INFO:teuthology.orchestra.run.smithi067.stdout: congratulations :) 2024-09-12T18:12:03.560 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-12T18:12:03.560 DEBUG:teuthology.orchestra.run.smithi067:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T18:12:03.665 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:12:03.665 INFO:tasks.s3tests:Cleaning up boto... 2024-09-12T18:12:03.666 DEBUG:teuthology.orchestra.run.smithi067:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T18:12:03.695 INFO:tasks.s3tests:Removing s3-tests... 2024-09-12T18:12:03.696 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T18:12:03.900 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T18:12:03.912 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T18:12:03.912 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T18:12:03.913 DEBUG:teuthology.orchestra.run.smithi067:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:12:03.942 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:12:03.943 INFO:teuthology.orchestra.run.smithi067.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T18:12:03.943 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:12:04.012 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T18:12:04.012 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T18:12:04.082 INFO:tasks.workunit:timeout=3h 2024-09-12T18:12:04.083 INFO:tasks.workunit:cleanup=True 2024-09-12T18:12:04.083 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T18:12:04.154 INFO:tasks.workunit.client.0.smithi067.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T18:13:03.987 INFO:tasks.workunit.client.0.smithi067.stderr:Updating files: 92% (11719/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T18:13:04.310 INFO:tasks.workunit.client.0.smithi067.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T18:13:04.310 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T18:13:04.310 INFO:tasks.workunit.client.0.smithi067.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T18:13:04.310 INFO:tasks.workunit.client.0.smithi067.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T18:13:04.310 INFO:tasks.workunit.client.0.smithi067.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T18:13:04.310 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T18:13:04.310 INFO:tasks.workunit.client.0.smithi067.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T18:13:04.310 INFO:tasks.workunit.client.0.smithi067.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T18:13:04.310 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T18:13:04.311 INFO:tasks.workunit.client.0.smithi067.stderr: git switch -c 2024-09-12T18:13:04.311 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T18:13:04.311 INFO:tasks.workunit.client.0.smithi067.stderr:Or undo this operation with: 2024-09-12T18:13:04.311 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T18:13:04.311 INFO:tasks.workunit.client.0.smithi067.stderr: git switch - 2024-09-12T18:13:04.311 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T18:13:04.311 INFO:tasks.workunit.client.0.smithi067.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T18:13:04.311 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T18:13:04.311 INFO:tasks.workunit.client.0.smithi067.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T18:13:04.315 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T18:13:04.386 INFO:tasks.workunit.client.0.smithi067.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T18:13:04.389 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:13:04.389 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T18:13:04.440 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T18:13:04.490 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T18:13:04.530 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:13:04.532 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:13:04.532 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T18:13:04.571 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:13:04.575 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T18:13:04.575 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T18:13:04.646 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-12T18:13:04.647 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-12T18:13:04.647 DEBUG:teuthology.orchestra.run.smithi067:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T18:13:04.720 INFO:tasks.workunit.client.0.smithi067.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T18:13:04.721 INFO:tasks.workunit.client.0.smithi067.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:13:04.721 INFO:tasks.workunit.client.0.smithi067.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:13:07.091 INFO:tasks.workunit.client.0.smithi067.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T18:13:07.091 INFO:tasks.workunit.client.0.smithi067.stderr:++ deactivate nondestructive 2024-09-12T18:13:07.092 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T18:13:07.092 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T18:13:07.092 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:13:07.092 INFO:tasks.workunit.client.0.smithi067.stderr:++ hash -r 2024-09-12T18:13:07.092 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T18:13:07.092 INFO:tasks.workunit.client.0.smithi067.stderr:++ unset VIRTUAL_ENV 2024-09-12T18:13:07.092 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T18:13:07.092 INFO:tasks.workunit.client.0.smithi067.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:13:07.093 INFO:tasks.workunit.client.0.smithi067.stderr:++ export VIRTUAL_ENV 2024-09-12T18:13:07.093 INFO:tasks.workunit.client.0.smithi067.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T18:13:07.094 INFO:tasks.workunit.client.0.smithi067.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T18:13:07.094 INFO:tasks.workunit.client.0.smithi067.stderr:++ export PATH 2024-09-12T18:13:07.094 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T18:13:07.094 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -z '' ']' 2024-09-12T18:13:07.094 INFO:tasks.workunit.client.0.smithi067.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T18:13:07.094 INFO:tasks.workunit.client.0.smithi067.stderr:++ PS1='(rgw) ' 2024-09-12T18:13:07.094 INFO:tasks.workunit.client.0.smithi067.stderr:++ export PS1 2024-09-12T18:13:07.094 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:13:07.094 INFO:tasks.workunit.client.0.smithi067.stderr:++ hash -r 2024-09-12T18:13:07.094 INFO:tasks.workunit.client.0.smithi067.stderr:+ pip install pip --upgrade 2024-09-12T18:13:07.331 INFO:tasks.workunit.client.0.smithi067.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T18:13:07.523 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting pip 2024-09-12T18:13:07.528 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T18:13:07.575 INFO:tasks.workunit.client.0.smithi067.stdout:Installing collected packages: pip 2024-09-12T18:13:07.575 INFO:tasks.workunit.client.0.smithi067.stdout: Attempting uninstall: pip 2024-09-12T18:13:07.575 INFO:tasks.workunit.client.0.smithi067.stdout: Found existing installation: pip 21.3.1 2024-09-12T18:13:07.737 INFO:tasks.workunit.client.0.smithi067.stdout: Uninstalling pip-21.3.1: 2024-09-12T18:13:07.743 INFO:tasks.workunit.client.0.smithi067.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T18:13:08.526 INFO:tasks.workunit.client.0.smithi067.stdout:Successfully installed pip-24.2 2024-09-12T18:13:08.575 INFO:tasks.workunit.client.0.smithi067.stderr:+ pip install boto3 2024-09-12T18:13:09.390 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting boto3 2024-09-12T18:13:09.391 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T18:13:10.001 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T18:13:10.002 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T18:13:10.062 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T18:13:10.063 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T18:13:10.118 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T18:13:10.119 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T18:13:10.168 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:13:10.169 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T18:13:10.246 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:13:10.247 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T18:13:10.407 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:13:10.408 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T18:13:10.413 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T18:13:10.414 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T18:13:10.424 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T18:13:10.425 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T18:13:10.426 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T18:13:10.428 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T18:13:10.429 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T18:13:10.507 INFO:tasks.workunit.client.0.smithi067.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T18:13:11.594 INFO:tasks.workunit.client.0.smithi067.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T18:13:11.715 INFO:tasks.workunit.client.0.smithi067.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-12T18:13:11.841 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-12T18:13:11.877 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:13:11.877 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:13:11.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:11.915+0000 7fab6de87800 20 rados->read ofs=0 len=0 2024-09-12T18:13:11.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:11.917+0000 7fab6de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:11.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:11.917+0000 7fab6de87800 20 realm 2024-09-12T18:13:11.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:11.917+0000 7fab6de87800 20 rados->read ofs=0 len=0 2024-09-12T18:13:11.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:11.917+0000 7fab6de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:11.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:11.917+0000 7fab6de87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:13:11.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:11.917+0000 7fab6de87800 20 rados->read ofs=0 len=0 2024-09-12T18:13:11.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:11.917+0000 7fab6de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:11.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:11.917+0000 7fab6de87800 20 rados->read ofs=0 len=0 2024-09-12T18:13:11.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:11.918+0000 7fab6de87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:13:11.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:11.918+0000 7fab6de87800 20 rados->read ofs=0 len=0 2024-09-12T18:13:11.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:11.919+0000 7fab6de87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:13:11.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:11.919+0000 7fab6de87800 20 searching for the correct realm 2024-09-12T18:13:11.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:11.922+0000 7fab6b971640 0 -- 172.21.15.67:0/1977706633 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7fab64083ab0 msgr2=0x7fab6406b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:13:11.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:11.926+0000 7fab6b971640 0 -- 172.21.15.67:0/1977706633 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fab540732a0 msgr2=0x7fab540760c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:13:12.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.132+0000 7fab6de87800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T18:13:12.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.132+0000 7fab6de87800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T18:13:12.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.132+0000 7fab6de87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:13:12.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.132+0000 7fab6de87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:13:12.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.132+0000 7fab6de87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:13:12.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.132+0000 7fab6de87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:13:12.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.132+0000 7fab6de87800 20 rados->read ofs=0 len=0 2024-09-12T18:13:12.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.133+0000 7fab6de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:12.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.133+0000 7fab6de87800 20 rados->read ofs=0 len=0 2024-09-12T18:13:12.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.133+0000 7fab6de87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:13:12.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.133+0000 7fab6de87800 20 rados->read ofs=0 len=0 2024-09-12T18:13:12.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.133+0000 7fab6de87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:13:12.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.134+0000 7fab6de87800 20 zone default found 2024-09-12T18:13:12.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.134+0000 7fab6de87800 4 Realm: () 2024-09-12T18:13:12.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.134+0000 7fab6de87800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T18:13:12.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.134+0000 7fab6de87800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T18:13:12.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.134+0000 7fab6de87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:13:12.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.134+0000 7fab6de87800 20 zonegroup default 2024-09-12T18:13:12.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.134+0000 7fab6de87800 20 rados->read ofs=0 len=0 2024-09-12T18:13:12.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.134+0000 7fab6de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:12.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.134+0000 7fab6de87800 20 rados->read ofs=0 len=0 2024-09-12T18:13:12.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.134+0000 7fab6de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:12.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.134+0000 7fab6de87800 20 rados->read ofs=0 len=0 2024-09-12T18:13:12.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.134+0000 7fab6de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:12.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.134+0000 7fab6de87800 20 started sync module instance, tier type = 2024-09-12T18:13:12.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.134+0000 7fab6de87800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T18:13:12.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.146+0000 7fab6de87800 20 add_watcher() i=0 2024-09-12T18:13:12.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.146+0000 7fab6de87800 20 add_watcher() i=1 2024-09-12T18:13:12.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.146+0000 7fab6de87800 20 add_watcher() i=2 2024-09-12T18:13:12.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.146+0000 7fab6de87800 20 add_watcher() i=3 2024-09-12T18:13:12.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.146+0000 7fab6de87800 20 add_watcher() i=4 2024-09-12T18:13:12.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.146+0000 7fab6de87800 20 add_watcher() i=5 2024-09-12T18:13:12.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.149+0000 7fab6de87800 20 add_watcher() i=6 2024-09-12T18:13:12.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.149+0000 7fab6de87800 20 add_watcher() i=7 2024-09-12T18:13:12.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.149+0000 7fab6de87800 2 all 8 watchers are set, enabling cache 2024-09-12T18:13:12.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.151+0000 7faa21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:13:12.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.151+0000 7fab6de87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:13:12.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.151+0000 7fab6de87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:13:12.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.151+0000 7fab6de87800 5 note: GC not initialized 2024-09-12T18:13:12.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.152+0000 7faa20fe1640 20 reqs_thread_entry: start 2024-09-12T18:13:12.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.152+0000 7fab6de87800 20 init_complete bucket index max shards: 1 2024-09-12T18:13:12.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.152+0000 7fab6de87800 20 Filter name: none 2024-09-12T18:13:12.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.152+0000 7fa99a7fc640 20 reqs_thread_entry: start 2024-09-12T18:13:12.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.152+0000 7fab6de87800 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-12T18:13:12.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.152+0000 7fab6de87800 20 rados->read ofs=0 len=0 2024-09-12T18:13:12.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.153+0000 7fab6de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:12.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.153+0000 7fab6de87800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-12T18:13:12.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.153+0000 7fab6de87800 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T18:13:12.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.153+0000 7fab6de87800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-12T18:13:12.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.153+0000 7fab6de87800 20 rados->read ofs=0 len=0 2024-09-12T18:13:12.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.153+0000 7fab6de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:12.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.153+0000 7fab6de87800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-12T18:13:12.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.153+0000 7fab6de87800 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T18:13:12.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.153+0000 7fab6de87800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T18:13:12.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.153+0000 7fab6de87800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T18:13:12.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.154+0000 7fab6de87800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T18:13:12.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.154+0000 7fab6de87800 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T18:13:12.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.154+0000 7fab6de87800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-12T18:13:12.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.155+0000 7faa4affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366425 cookie 94388569458816 notifier 8774 bl.length()=613 2024-09-12T18:13:12.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.155+0000 7faa4affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T18:13:12.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.155+0000 7faa4affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T18:13:12.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.158+0000 7fab6de87800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T18:13:12.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.158+0000 7fab6de87800 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T18:13:12.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.158+0000 7fab6de87800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-12T18:13:12.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.158+0000 7faa4affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366813 cookie 94388569490368 notifier 8774 bl.length()=191 2024-09-12T18:13:12.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.158+0000 7faa4affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T18:13:12.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.158+0000 7faa4affd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T18:13:12.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.160+0000 7faa21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:13:12.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.163+0000 7fab6de87800 20 remove_watcher() i=0 2024-09-12T18:13:12.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.163+0000 7fab6de87800 2 removed watcher, disabling cache 2024-09-12T18:13:12.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.164+0000 7fab6de87800 20 remove_watcher() i=1 2024-09-12T18:13:12.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.165+0000 7fab6de87800 20 remove_watcher() i=2 2024-09-12T18:13:12.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.166+0000 7fab6de87800 20 remove_watcher() i=3 2024-09-12T18:13:12.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.167+0000 7fab6de87800 20 remove_watcher() i=4 2024-09-12T18:13:12.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.168+0000 7fab6de87800 20 remove_watcher() i=5 2024-09-12T18:13:12.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.169+0000 7fab6de87800 20 remove_watcher() i=6 2024-09-12T18:13:12.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.170+0000 7fab6de87800 20 remove_watcher() i=7 2024-09-12T18:13:12.362 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T18:13:12.362 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T18:13:12.410 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T18:13:12.410 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T18:13:12.470 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T18:13:12.471 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T18:13:12.512 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T18:13:12.512 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T18:13:12.540 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-12T18:13:12.540 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T18:13:12.543 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T18:13:12.543 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T18:13:12.582 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T18:13:12.582 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T18:13:12.619 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T18:13:12.619 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T18:13:12.661 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T18:13:12.693 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:13:12.693 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:13:12.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.730+0000 7f26d8528800 20 rados->read ofs=0 len=0 2024-09-12T18:13:12.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.732+0000 7f26d8528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:12.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.732+0000 7f26d8528800 20 realm 2024-09-12T18:13:12.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.732+0000 7f26d8528800 20 rados->read ofs=0 len=0 2024-09-12T18:13:12.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.732+0000 7f26d8528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:12.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.732+0000 7f26d8528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:13:12.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.732+0000 7f26d8528800 20 rados->read ofs=0 len=0 2024-09-12T18:13:12.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.732+0000 7f26d8528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:12.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.732+0000 7f26d8528800 20 rados->read ofs=0 len=0 2024-09-12T18:13:12.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.733+0000 7f26d8528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:13:12.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.733+0000 7f26d8528800 20 rados->read ofs=0 len=0 2024-09-12T18:13:12.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.734+0000 7f26d8528800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:13:12.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.734+0000 7f26d8528800 20 searching for the correct realm 2024-09-12T18:13:12.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.738+0000 7f26d3a4a640 0 -- 172.21.15.67:0/3888602424 >> [v2:172.21.15.118:6800/2751121967,v1:172.21.15.118:6801/2751121967] conn(0x56064c3316f0 msgr2=0x56064c333ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:13:12.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.741+0000 7f26d4a4c640 0 -- 172.21.15.67:0/3888602424 >> [v2:172.21.15.118:6824/1070975205,v1:172.21.15.118:6825/1070975205] conn(0x7f26c8041040 msgr2=0x7f26c8042430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:13:12.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.745+0000 7f26d8528800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T18:13:12.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.745+0000 7f26d8528800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T18:13:12.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.745+0000 7f26d8528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:13:12.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.745+0000 7f26d8528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:13:12.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.745+0000 7f26d8528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:13:12.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.745+0000 7f26d8528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:13:12.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.745+0000 7f26d8528800 20 rados->read ofs=0 len=0 2024-09-12T18:13:12.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.745+0000 7f26d8528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:12.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.745+0000 7f26d8528800 20 rados->read ofs=0 len=0 2024-09-12T18:13:12.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.746+0000 7f26d8528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:13:12.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.746+0000 7f26d8528800 20 rados->read ofs=0 len=0 2024-09-12T18:13:12.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.746+0000 7f26d8528800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:13:12.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.746+0000 7f26d8528800 20 zone default found 2024-09-12T18:13:12.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.746+0000 7f26d8528800 4 Realm: () 2024-09-12T18:13:12.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.746+0000 7f26d8528800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T18:13:12.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.746+0000 7f26d8528800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T18:13:12.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.746+0000 7f26d8528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:13:12.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.746+0000 7f26d8528800 20 zonegroup default 2024-09-12T18:13:12.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.746+0000 7f26d8528800 20 rados->read ofs=0 len=0 2024-09-12T18:13:12.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.746+0000 7f26d8528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:12.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.746+0000 7f26d8528800 20 rados->read ofs=0 len=0 2024-09-12T18:13:12.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.746+0000 7f26d8528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:12.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.746+0000 7f26d8528800 20 rados->read ofs=0 len=0 2024-09-12T18:13:12.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.747+0000 7f26d8528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:12.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.747+0000 7f26d8528800 20 started sync module instance, tier type = 2024-09-12T18:13:12.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.747+0000 7f26d8528800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T18:13:12.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.756+0000 7f26d8528800 20 add_watcher() i=0 2024-09-12T18:13:12.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.756+0000 7f26d8528800 20 add_watcher() i=1 2024-09-12T18:13:12.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.756+0000 7f26d8528800 20 add_watcher() i=2 2024-09-12T18:13:12.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.756+0000 7f26d8528800 20 add_watcher() i=3 2024-09-12T18:13:12.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.756+0000 7f26d8528800 20 add_watcher() i=4 2024-09-12T18:13:12.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.756+0000 7f26d8528800 20 add_watcher() i=5 2024-09-12T18:13:12.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.756+0000 7f26d8528800 20 add_watcher() i=6 2024-09-12T18:13:12.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.757+0000 7f26d8528800 20 add_watcher() i=7 2024-09-12T18:13:12.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.757+0000 7f26d8528800 2 all 8 watchers are set, enabling cache 2024-09-12T18:13:12.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.759+0000 7f258afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:13:12.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.759+0000 7f26d8528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:13:12.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.759+0000 7f26d8528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:13:12.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.760+0000 7f26d8528800 5 note: GC not initialized 2024-09-12T18:13:12.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.760+0000 7f2589fdb640 20 reqs_thread_entry: start 2024-09-12T18:13:12.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.760+0000 7f26d8528800 20 init_complete bucket index max shards: 1 2024-09-12T18:13:12.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.760+0000 7f26d8528800 20 Filter name: none 2024-09-12T18:13:12.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.760+0000 7f24fb7fe640 20 reqs_thread_entry: start 2024-09-12T18:13:12.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.760+0000 7f26d8528800 20 rados->read ofs=0 len=0 2024-09-12T18:13:12.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.760+0000 7f26d8528800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T18:13:12.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.760+0000 7f26d8528800 20 rados->read ofs=0 len=0 2024-09-12T18:13:12.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.761+0000 7f26d8528800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T18:13:12.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.761+0000 7f26d8528800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:13:12.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.761+0000 7f26d8528800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T18:13:12.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.761+0000 7f26d8528800 20 INFO: main: starting shard=0 2024-09-12T18:13:12.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.761+0000 7f26d8528800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.783.0 2024-09-12T18:13:12.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.762+0000 7f26d8528800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:13:12.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.762+0000 7f26d8528800 20 INFO: main: done 2024-09-12T18:13:12.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.763+0000 7f258afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:13:12.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.765+0000 7f26d8528800 20 remove_watcher() i=0 2024-09-12T18:13:12.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.765+0000 7f26d8528800 2 removed watcher, disabling cache 2024-09-12T18:13:12.767 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.766+0000 7f26d8528800 20 remove_watcher() i=1 2024-09-12T18:13:12.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.767+0000 7f26d8528800 20 remove_watcher() i=2 2024-09-12T18:13:12.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.769+0000 7f26d8528800 20 remove_watcher() i=3 2024-09-12T18:13:12.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.770+0000 7f26d8528800 20 remove_watcher() i=4 2024-09-12T18:13:12.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.770+0000 7f26d8528800 20 remove_watcher() i=5 2024-09-12T18:13:12.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.771+0000 7f26d8528800 20 remove_watcher() i=6 2024-09-12T18:13:12.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.772+0000 7f26d8528800 20 remove_watcher() i=7 2024-09-12T18:13:12.786 INFO:tasks.workunit.client.0.smithi067.stderr:rados -p default.rgw.buckets.data ls | grep f5dd3191-7631-4630-b3a5-566da02c012b 2024-09-12T18:13:12.808 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:13:12.808 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:13:12.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:12.882+0000 7f53d7bbd640 0 -- 172.21.15.67:0/2217550332 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x7f53cc01a040 msgr2=0x7f53cc00c990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:13:12.894 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-12T18:13:12.894 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T18:13:12.896 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T18:13:14.307 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T18:13:14.308 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T18:13:14.346 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T18:13:14.772 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T18:13:14.801 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:13:14.801 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:13:14.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:14.840+0000 7f5b7a80e800 20 rados->read ofs=0 len=0 2024-09-12T18:13:14.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:14.842+0000 7f5b7a80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:14.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:14.842+0000 7f5b7a80e800 20 realm 2024-09-12T18:13:14.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:14.842+0000 7f5b7a80e800 20 rados->read ofs=0 len=0 2024-09-12T18:13:14.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:14.842+0000 7f5b7a80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:14.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:14.842+0000 7f5b7a80e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:13:14.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:14.842+0000 7f5b7a80e800 20 rados->read ofs=0 len=0 2024-09-12T18:13:14.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:14.842+0000 7f5b7a80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:14.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:14.842+0000 7f5b7a80e800 20 rados->read ofs=0 len=0 2024-09-12T18:13:14.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:14.843+0000 7f5b7a80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:13:14.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:14.843+0000 7f5b7a80e800 20 rados->read ofs=0 len=0 2024-09-12T18:13:14.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:14.844+0000 7f5b7a80e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:13:14.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:14.844+0000 7f5b7a80e800 20 searching for the correct realm 2024-09-12T18:13:14.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:14.847+0000 7f5b75ecb640 0 -- 172.21.15.67:0/1533595846 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f5b7006a040 msgr2=0x7f5b7006a930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:13:14.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:14.851+0000 7f5b75ecb640 0 -- 172.21.15.67:0/1533595846 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f5b6c027040 msgr2=0x7f5b6c084890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:13:15.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.058+0000 7f5b7a80e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T18:13:15.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.058+0000 7f5b7a80e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T18:13:15.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.058+0000 7f5b7a80e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:13:15.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.058+0000 7f5b7a80e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:13:15.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.058+0000 7f5b7a80e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:13:15.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.058+0000 7f5b7a80e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:13:15.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.058+0000 7f5b7a80e800 20 rados->read ofs=0 len=0 2024-09-12T18:13:15.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.059+0000 7f5b7a80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:15.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.059+0000 7f5b7a80e800 20 rados->read ofs=0 len=0 2024-09-12T18:13:15.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.059+0000 7f5b7a80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:13:15.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.059+0000 7f5b7a80e800 20 rados->read ofs=0 len=0 2024-09-12T18:13:15.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.060+0000 7f5b7a80e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:13:15.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.060+0000 7f5b7a80e800 20 zone default found 2024-09-12T18:13:15.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.060+0000 7f5b7a80e800 4 Realm: () 2024-09-12T18:13:15.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.060+0000 7f5b7a80e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T18:13:15.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.060+0000 7f5b7a80e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T18:13:15.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.060+0000 7f5b7a80e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:13:15.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.060+0000 7f5b7a80e800 20 zonegroup default 2024-09-12T18:13:15.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.060+0000 7f5b7a80e800 20 rados->read ofs=0 len=0 2024-09-12T18:13:15.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.060+0000 7f5b7a80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:15.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.060+0000 7f5b7a80e800 20 rados->read ofs=0 len=0 2024-09-12T18:13:15.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.060+0000 7f5b7a80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:15.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.060+0000 7f5b7a80e800 20 rados->read ofs=0 len=0 2024-09-12T18:13:15.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.060+0000 7f5b7a80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:15.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.060+0000 7f5b7a80e800 20 started sync module instance, tier type = 2024-09-12T18:13:15.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.060+0000 7f5b7a80e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T18:13:15.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.073+0000 7f5b7a80e800 20 add_watcher() i=0 2024-09-12T18:13:15.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.073+0000 7f5b7a80e800 20 add_watcher() i=1 2024-09-12T18:13:15.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.073+0000 7f5b7a80e800 20 add_watcher() i=2 2024-09-12T18:13:15.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.073+0000 7f5b7a80e800 20 add_watcher() i=3 2024-09-12T18:13:15.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.073+0000 7f5b7a80e800 20 add_watcher() i=4 2024-09-12T18:13:15.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.073+0000 7f5b7a80e800 20 add_watcher() i=5 2024-09-12T18:13:15.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.073+0000 7f5b7a80e800 20 add_watcher() i=6 2024-09-12T18:13:15.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.074+0000 7f5b7a80e800 20 add_watcher() i=7 2024-09-12T18:13:15.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.074+0000 7f5b7a80e800 2 all 8 watchers are set, enabling cache 2024-09-12T18:13:15.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.076+0000 7f5a277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:13:15.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.076+0000 7f5b7a80e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:13:15.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.076+0000 7f5b7a80e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:13:15.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.076+0000 7f5b7a80e800 5 note: GC not initialized 2024-09-12T18:13:15.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.076+0000 7f5a267fc640 20 reqs_thread_entry: start 2024-09-12T18:13:15.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.076+0000 7f5b7a80e800 20 init_complete bucket index max shards: 1 2024-09-12T18:13:15.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.077+0000 7f5b7a80e800 20 Filter name: none 2024-09-12T18:13:15.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.077+0000 7f599bfff640 20 reqs_thread_entry: start 2024-09-12T18:13:15.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.077+0000 7f5b7a80e800 20 rados->read ofs=0 len=0 2024-09-12T18:13:15.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.077+0000 7f5b7a80e800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T18:13:15.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.077+0000 7f5b7a80e800 20 rados->read ofs=0 len=0 2024-09-12T18:13:15.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.078+0000 7f5b7a80e800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T18:13:15.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.078+0000 7f5b7a80e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:13:15.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.078+0000 7f5b7a80e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T18:13:15.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.078+0000 7f5b7a80e800 20 INFO: main: starting shard=0 2024-09-12T18:13:15.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.078+0000 7f5b7a80e800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.783.0 2024-09-12T18:13:15.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.078+0000 7f5b7a80e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:13:15.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.078+0000 7f5b7a80e800 20 INFO: main: done 2024-09-12T18:13:15.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.079+0000 7f5a277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:13:15.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.081+0000 7f5b7a80e800 20 remove_watcher() i=0 2024-09-12T18:13:15.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.081+0000 7f5b7a80e800 2 removed watcher, disabling cache 2024-09-12T18:13:15.083 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.082+0000 7f5b7a80e800 20 remove_watcher() i=1 2024-09-12T18:13:15.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.083+0000 7f5b7a80e800 20 remove_watcher() i=2 2024-09-12T18:13:15.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.084+0000 7f5b7a80e800 20 remove_watcher() i=3 2024-09-12T18:13:15.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.086+0000 7f5b7a80e800 20 remove_watcher() i=4 2024-09-12T18:13:15.087 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.087+0000 7f5b7a80e800 20 remove_watcher() i=5 2024-09-12T18:13:15.088 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.088+0000 7f5b7a80e800 20 remove_watcher() i=6 2024-09-12T18:13:15.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.089+0000 7f5b7a80e800 20 remove_watcher() i=7 2024-09-12T18:13:15.102 INFO:tasks.workunit.client.0.smithi067.stderr:rados -p default.rgw.buckets.data ls | grep 771ee0cd-506d-49ce-afae-81d6e9be3fbf 2024-09-12T18:13:15.125 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:13:15.125 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:13:15.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:15.201+0000 7fa959068640 0 -- 172.21.15.67:0/2371597362 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fa94002cfc0 msgr2=0x7fa9400112d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:13:16.358 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-12T18:13:16.358 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T18:13:16.358 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T18:13:16.359 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T18:13:16.359 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T18:13:16.359 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T18:13:16.359 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T18:13:16.360 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T18:13:16.360 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T18:13:16.729 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T18:13:16.729 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T18:13:16.829 INFO:tasks.workunit.client.0.smithi067.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:13:16.831 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T18:13:17.260 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T18:13:17.261 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T18:13:17.336 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T18:13:17.336 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T18:13:17.382 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-12T18:13:17.382 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T18:13:17.383 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T18:13:17.383 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T18:13:17.448 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T18:13:17.448 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T18:13:17.511 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T18:13:17.512 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T18:13:17.549 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-12T18:13:18.969 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T18:13:18.970 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T18:13:19.029 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T18:13:19.029 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T18:13:21.102 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-12T18:13:21.521 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-12T18:13:21.552 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:13:21.552 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:13:21.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.589+0000 7f43baf26800 20 rados->read ofs=0 len=0 2024-09-12T18:13:21.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.591+0000 7f43baf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:21.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.591+0000 7f43baf26800 20 realm 2024-09-12T18:13:21.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.591+0000 7f43baf26800 20 rados->read ofs=0 len=0 2024-09-12T18:13:21.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.591+0000 7f43baf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:21.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.591+0000 7f43baf26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:13:21.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.591+0000 7f43baf26800 20 rados->read ofs=0 len=0 2024-09-12T18:13:21.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.591+0000 7f43baf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:21.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.591+0000 7f43baf26800 20 rados->read ofs=0 len=0 2024-09-12T18:13:21.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.592+0000 7f43baf26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:13:21.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.592+0000 7f43baf26800 20 rados->read ofs=0 len=0 2024-09-12T18:13:21.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.593+0000 7f43baf26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:13:21.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.593+0000 7f43baf26800 20 searching for the correct realm 2024-09-12T18:13:21.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.596+0000 7f43b73b6640 0 -- 172.21.15.67:0/701560031 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x56362aa1e8b0 msgr2=0x56362aa20d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:13:21.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.600+0000 7f43b6bb5640 0 -- 172.21.15.67:0/701560031 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f43ac0b7bb0 msgr2=0x7f43ac0c4630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:13:21.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.806+0000 7f43baf26800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T18:13:21.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.806+0000 7f43baf26800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T18:13:21.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.806+0000 7f43baf26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:13:21.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.806+0000 7f43baf26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:13:21.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.806+0000 7f43baf26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:13:21.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.806+0000 7f43baf26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:13:21.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.806+0000 7f43baf26800 20 rados->read ofs=0 len=0 2024-09-12T18:13:21.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.806+0000 7f43baf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:21.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.806+0000 7f43baf26800 20 rados->read ofs=0 len=0 2024-09-12T18:13:21.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.807+0000 7f43baf26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:13:21.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.807+0000 7f43baf26800 20 rados->read ofs=0 len=0 2024-09-12T18:13:21.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.807+0000 7f43baf26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:13:21.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.807+0000 7f43baf26800 20 zone default found 2024-09-12T18:13:21.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.807+0000 7f43baf26800 4 Realm: () 2024-09-12T18:13:21.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.807+0000 7f43baf26800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T18:13:21.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.807+0000 7f43baf26800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T18:13:21.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.807+0000 7f43baf26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:13:21.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.807+0000 7f43baf26800 20 zonegroup default 2024-09-12T18:13:21.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.807+0000 7f43baf26800 20 rados->read ofs=0 len=0 2024-09-12T18:13:21.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.808+0000 7f43baf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:21.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.808+0000 7f43baf26800 20 rados->read ofs=0 len=0 2024-09-12T18:13:21.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.808+0000 7f43baf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:21.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.808+0000 7f43baf26800 20 rados->read ofs=0 len=0 2024-09-12T18:13:21.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.808+0000 7f43baf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:21.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.808+0000 7f43baf26800 20 started sync module instance, tier type = 2024-09-12T18:13:21.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.808+0000 7f43baf26800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T18:13:21.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.819+0000 7f43baf26800 20 add_watcher() i=0 2024-09-12T18:13:21.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.819+0000 7f43baf26800 20 add_watcher() i=1 2024-09-12T18:13:21.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.819+0000 7f43baf26800 20 add_watcher() i=2 2024-09-12T18:13:21.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.819+0000 7f43baf26800 20 add_watcher() i=3 2024-09-12T18:13:21.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.819+0000 7f43baf26800 20 add_watcher() i=4 2024-09-12T18:13:21.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.819+0000 7f43baf26800 20 add_watcher() i=5 2024-09-12T18:13:21.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.819+0000 7f43baf26800 20 add_watcher() i=6 2024-09-12T18:13:21.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.819+0000 7f43baf26800 20 add_watcher() i=7 2024-09-12T18:13:21.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.819+0000 7f43baf26800 2 all 8 watchers are set, enabling cache 2024-09-12T18:13:21.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.821+0000 7f426d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:13:21.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.822+0000 7f43baf26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:13:21.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.822+0000 7f43baf26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:13:21.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.822+0000 7f43baf26800 5 note: GC not initialized 2024-09-12T18:13:21.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.822+0000 7f41e7fff640 20 reqs_thread_entry: start 2024-09-12T18:13:21.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.822+0000 7f43baf26800 20 init_complete bucket index max shards: 1 2024-09-12T18:13:21.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.822+0000 7f43baf26800 20 Filter name: none 2024-09-12T18:13:21.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.822+0000 7f41e5ffb640 20 reqs_thread_entry: start 2024-09-12T18:13:21.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.822+0000 7f43baf26800 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-12T18:13:21.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.822+0000 7f43baf26800 20 rados->read ofs=0 len=0 2024-09-12T18:13:21.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.823+0000 7f43baf26800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T18:13:21.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.823+0000 7f43baf26800 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-12T18:13:21.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.823+0000 7f43baf26800 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-12T18:13:21.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.823+0000 7f43baf26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.783 : miss 2024-09-12T18:13:21.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.823+0000 7f43baf26800 20 rados->read ofs=0 len=0 2024-09-12T18:13:21.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.823+0000 7f43baf26800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T18:13:21.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.823+0000 7f43baf26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.783 info.flags=0x17 2024-09-12T18:13:21.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.823+0000 7f43baf26800 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.783 to cache LRU end 2024-09-12T18:13:21.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.823+0000 7f43baf26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:13:21.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.823+0000 7f43baf26800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:13:21.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.823+0000 7f43baf26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:06eb12d0-49d6-461d-9efe-05d212954deb.4538.783 2024-09-12T18:13:21.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.823+0000 7f43baf26800 20 bucket index object: :.dir.06eb12d0-49d6-461d-9efe-05d212954deb.4538.783.0 2024-09-12T18:13:21.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.824+0000 7f43baf26800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T18:13:21.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.824+0000 7f43baf26800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T18:13:21.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.825+0000 7f426d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:13:21.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.827+0000 7f43baf26800 20 remove_watcher() i=0 2024-09-12T18:13:21.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.827+0000 7f43baf26800 2 removed watcher, disabling cache 2024-09-12T18:13:21.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.828+0000 7f43baf26800 20 remove_watcher() i=1 2024-09-12T18:13:21.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.830+0000 7f43baf26800 20 remove_watcher() i=2 2024-09-12T18:13:21.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.831+0000 7f43baf26800 20 remove_watcher() i=3 2024-09-12T18:13:21.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.832+0000 7f43baf26800 20 remove_watcher() i=4 2024-09-12T18:13:21.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.833+0000 7f43baf26800 20 remove_watcher() i=5 2024-09-12T18:13:21.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.834+0000 7f43baf26800 20 remove_watcher() i=6 2024-09-12T18:13:21.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T18:13:21.835+0000 7f43baf26800 20 remove_watcher() i=7 2024-09-12T18:13:21.848 INFO:tasks.workunit.client.0.smithi067.stderr:Deleting bucket versioning-bucket 2024-09-12T18:13:21.851 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T18:13:21.851 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T18:13:21.876 INFO:tasks.workunit.client.0.smithi067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T18:13:21.876 INFO:tasks.workunit.client.0.smithi067.stderr: warnings.warn( 2024-09-12T18:13:21.932 INFO:tasks.workunit.client.0.smithi067.stderr:Completed bucket versioning tests 2024-09-12T18:13:21.933 INFO:tasks.workunit.client.0.smithi067.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T18:13:21.933 INFO:tasks.workunit.client.0.smithi067.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T18:13:21.933 INFO:tasks.workunit.client.0.smithi067.stdout:connected to https://localhost:443 2024-09-12T18:13:21.997 INFO:tasks.workunit.client.0.smithi067.stderr:+ deactivate 2024-09-12T18:13:21.997 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T18:13:21.997 INFO:tasks.workunit.client.0.smithi067.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T18:13:21.997 INFO:tasks.workunit.client.0.smithi067.stderr:+ export PATH 2024-09-12T18:13:21.997 INFO:tasks.workunit.client.0.smithi067.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T18:13:21.997 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n '' ']' 2024-09-12T18:13:21.997 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:13:21.997 INFO:tasks.workunit.client.0.smithi067.stderr:+ hash -r 2024-09-12T18:13:21.997 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n '' ']' 2024-09-12T18:13:21.998 INFO:tasks.workunit.client.0.smithi067.stderr:+ unset VIRTUAL_ENV 2024-09-12T18:13:21.998 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T18:13:21.998 INFO:tasks.workunit.client.0.smithi067.stderr:+ unset -f deactivate 2024-09-12T18:13:21.998 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo OK. 2024-09-12T18:13:21.999 INFO:tasks.workunit.client.0.smithi067.stdout:OK. 2024-09-12T18:13:21.999 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:13:21.999 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:13:22.081 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-12T18:13:22.082 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T18:13:22.463 DEBUG:teuthology.parallel:result is None 2024-09-12T18:13:22.464 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:13:22.504 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:13:22.505 DEBUG:teuthology.orchestra.run.smithi067:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:13:22.574 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:13:22.574 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-12T18:13:22.584 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-12T18:13:22.800 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-12T18:13:22.801 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-12T18:13:22.801 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-12T18:13:22.864 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-12T18:13:22.865 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-12T18:13:22.923 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:13:22.923 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:13:22.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.958+0000 7fad2872e800 20 rados->read ofs=0 len=0 2024-09-12T18:13:22.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.959+0000 7fad2872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:22.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.959+0000 7fad2872e800 20 realm 2024-09-12T18:13:22.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.959+0000 7fad2872e800 20 rados->read ofs=0 len=0 2024-09-12T18:13:22.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.960+0000 7fad2872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:22.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.960+0000 7fad2872e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:13:22.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.960+0000 7fad2872e800 20 rados->read ofs=0 len=0 2024-09-12T18:13:22.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.960+0000 7fad2872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:22.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.960+0000 7fad2872e800 20 rados->read ofs=0 len=0 2024-09-12T18:13:22.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.961+0000 7fad2872e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:13:22.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.961+0000 7fad2872e800 20 rados->read ofs=0 len=0 2024-09-12T18:13:22.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.962+0000 7fad2872e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:13:22.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.962+0000 7fad2872e800 20 searching for the correct realm 2024-09-12T18:13:22.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.964+0000 7fad24cde640 0 -- 172.21.15.67:0/2895507037 >> [v2:172.21.15.67:6816/2780246260,v1:172.21.15.67:6817/2780246260] conn(0x55c5bbd6b320 msgr2=0x55c5bbd6d7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:13:22.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.968+0000 7fad244dd640 0 -- 172.21.15.67:0/2895507037 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7fad18040230 msgr2=0x7fad18069980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:13:22.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.972+0000 7fad2872e800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T18:13:22.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.972+0000 7fad2872e800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T18:13:22.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.972+0000 7fad2872e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:13:22.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.972+0000 7fad2872e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:13:22.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.972+0000 7fad2872e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:13:22.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.972+0000 7fad2872e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:13:22.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.972+0000 7fad2872e800 20 rados->read ofs=0 len=0 2024-09-12T18:13:22.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.972+0000 7fad2872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:22.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.972+0000 7fad2872e800 20 rados->read ofs=0 len=0 2024-09-12T18:13:22.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.973+0000 7fad2872e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:13:22.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.973+0000 7fad2872e800 20 rados->read ofs=0 len=0 2024-09-12T18:13:22.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.973+0000 7fad2872e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:13:22.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.973+0000 7fad2872e800 20 zone default found 2024-09-12T18:13:22.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.973+0000 7fad2872e800 4 Realm: () 2024-09-12T18:13:22.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.973+0000 7fad2872e800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T18:13:22.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.973+0000 7fad2872e800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T18:13:22.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.973+0000 7fad2872e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:13:22.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.973+0000 7fad2872e800 20 zonegroup default 2024-09-12T18:13:22.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.973+0000 7fad2872e800 20 rados->read ofs=0 len=0 2024-09-12T18:13:22.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.974+0000 7fad2872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:22.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.974+0000 7fad2872e800 20 rados->read ofs=0 len=0 2024-09-12T18:13:22.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.974+0000 7fad2872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:22.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.974+0000 7fad2872e800 20 rados->read ofs=0 len=0 2024-09-12T18:13:22.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.974+0000 7fad2872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:22.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.974+0000 7fad2872e800 20 started sync module instance, tier type = 2024-09-12T18:13:22.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.974+0000 7fad2872e800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T18:13:22.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.984+0000 7fad2872e800 20 add_watcher() i=0 2024-09-12T18:13:22.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.984+0000 7fad2872e800 20 add_watcher() i=1 2024-09-12T18:13:22.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.984+0000 7fad2872e800 20 add_watcher() i=2 2024-09-12T18:13:22.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.984+0000 7fad2872e800 20 add_watcher() i=3 2024-09-12T18:13:22.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.984+0000 7fad2872e800 20 add_watcher() i=4 2024-09-12T18:13:22.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.984+0000 7fad2872e800 20 add_watcher() i=5 2024-09-12T18:13:22.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.984+0000 7fad2872e800 20 add_watcher() i=6 2024-09-12T18:13:22.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.984+0000 7fad2872e800 20 add_watcher() i=7 2024-09-12T18:13:22.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.984+0000 7fad2872e800 2 all 8 watchers are set, enabling cache 2024-09-12T18:13:22.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.986+0000 7fabda7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:13:22.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.986+0000 7fad2872e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:13:22.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:22.986+0000 7fad2872e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:13:23.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.022+0000 7fabd97e2640 20 reqs_thread_entry: start 2024-09-12T18:13:23.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.022+0000 7fad2872e800 20 init_complete bucket index max shards: 1 2024-09-12T18:13:23.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.023+0000 7fad2872e800 20 Filter name: none 2024-09-12T18:13:23.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.023+0000 7fab4affd640 20 reqs_thread_entry: start 2024-09-12T18:13:23.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.023+0000 7fad2872e800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T18:13:23.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.023+0000 7fad2872e800 20 rados->read ofs=0 len=0 2024-09-12T18:13:23.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.024+0000 7fad2872e800 20 rados_obj.operate() r=0 bl.length=482 2024-09-12T18:13:23.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.024+0000 7fad2872e800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-12T18:13:23.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.024+0000 7fad2872e800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T18:13:23.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.024+0000 7fad2872e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:13:23.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.024+0000 7fad2872e800 10 removing key index: RKFKGUDNYNZVQRRENVMV 2024-09-12T18:13:23.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.026+0000 7fad2872e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:RKFKGUDNYNZVQRRENVMV, ofs0, ns] 2024-09-12T18:13:23.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.026+0000 7fac037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366519 cookie 94307748341312 notifier 8888 bl.length()=170 2024-09-12T18:13:23.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.028+0000 7fad2872e800 10 removing email index: tester.client.0_test@test.test 2024-09-12T18:13:23.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.030+0000 7fad2872e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T18:13:23.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.030+0000 7fac02ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871367431 cookie 94307748347136 notifier 8888 bl.length()=181 2024-09-12T18:13:23.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.031+0000 7fad2872e800 10 removing user buckets index 2024-09-12T18:13:23.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.033+0000 7fad2872e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-12T18:13:23.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.033+0000 7fac02ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366426 cookie 94307748359936 notifier 8888 bl.length()=172 2024-09-12T18:13:23.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.034+0000 7fad2872e800 10 removing user index: tester.client.0 2024-09-12T18:13:23.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.035+0000 7fad2872e800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-12T18:13:23.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.035+0000 7fad2872e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T18:13:23.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.036+0000 7fac037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366816 cookie 94307748358304 notifier 8888 bl.length()=164 2024-09-12T18:13:23.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.038+0000 7fabda7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:13:23.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.040+0000 7fad2872e800 20 remove_watcher() i=0 2024-09-12T18:13:23.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.040+0000 7fad2872e800 2 removed watcher, disabling cache 2024-09-12T18:13:23.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.041+0000 7fad2872e800 20 remove_watcher() i=1 2024-09-12T18:13:23.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.043+0000 7fad2872e800 20 remove_watcher() i=2 2024-09-12T18:13:23.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.044+0000 7fad2872e800 20 remove_watcher() i=3 2024-09-12T18:13:23.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.045+0000 7fad2872e800 20 remove_watcher() i=4 2024-09-12T18:13:23.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.046+0000 7fad2872e800 20 remove_watcher() i=5 2024-09-12T18:13:23.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.047+0000 7fad2872e800 20 remove_watcher() i=6 2024-09-12T18:13:23.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:23.048+0000 7fad2872e800 20 remove_watcher() i=7 2024-09-12T18:13:23.061 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-12T18:13:23.071 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-12T18:13:23.113 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-12T18:13:23.172 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T18:13:23.182 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T18:13:23.183 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:13:23.191 INFO:tasks.rgw.client.0.smithi067.stdout:2024-09-12T18:13:23.185+0000 f874640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 45805) UID: 0 2024-09-12T18:13:23.192 INFO:tasks.rgw.client.0.smithi067.stdout:2024-09-12T18:13:23.188+0000 a1be240 -1 shutting down 2024-09-12T18:13:42.334 INFO:tasks.rgw.client.0.smithi067.stderr:==00:01:13:17.139 45807== could not unlink /tmp/vgdb-pipe-from-vgdb-to-45807-by-root-on-??? 2024-09-12T18:13:42.335 INFO:tasks.rgw.client.0.smithi067.stderr:==00:01:13:17.139 45807== could not unlink /tmp/vgdb-pipe-to-vgdb-from-45807-by-root-on-??? 2024-09-12T18:13:42.335 INFO:tasks.rgw.client.0.smithi067.stderr:==00:01:13:17.139 45807== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-45807-by-root-on-??? 2024-09-12T18:13:42.597 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-12T18:13:47.590 INFO:tasks.rgw.client.0:Stopped 2024-09-12T18:13:47.590 DEBUG:teuthology.orchestra.run.smithi067:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T18:13:47.642 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T18:13:47.741 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T18:13:47.824 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T18:13:47.824 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T18:13:47.824 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T18:13:47.926 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:13:47.926 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:13:47.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:47.962+0000 7f35f5b26800 20 rados->read ofs=0 len=0 2024-09-12T18:13:47.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:47.964+0000 7f35f5b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:47.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:47.964+0000 7f35f5b26800 20 realm 2024-09-12T18:13:47.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:47.964+0000 7f35f5b26800 20 rados->read ofs=0 len=0 2024-09-12T18:13:47.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:47.964+0000 7f35f5b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:47.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:47.964+0000 7f35f5b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:13:47.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:47.964+0000 7f35f5b26800 20 rados->read ofs=0 len=0 2024-09-12T18:13:47.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:47.964+0000 7f35f5b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:47.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:47.964+0000 7f35f5b26800 20 rados->read ofs=0 len=0 2024-09-12T18:13:47.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:47.965+0000 7f35f5b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:13:47.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:47.965+0000 7f35f5b26800 20 rados->read ofs=0 len=0 2024-09-12T18:13:47.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:47.966+0000 7f35f5b26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:13:47.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:47.966+0000 7f35f5b26800 20 searching for the correct realm 2024-09-12T18:13:47.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:47.969+0000 7f35f175d640 0 -- 172.21.15.67:0/1761719668 >> [v2:172.21.15.118:6816/1969396610,v1:172.21.15.118:6817/1969396610] conn(0x7f35ec079040 msgr2=0x7f35ec079930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:13:47.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:47.972+0000 7f35f175d640 0 -- 172.21.15.67:0/1761719668 >> [v2:172.21.15.67:6808/1841182576,v1:172.21.15.67:6809/1841182576] conn(0x7f35dc043420 msgr2=0x7f35dc0438a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:13:48.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.179+0000 7f35f5b26800 20 RGWRados::pool_iterate: got zone_info.06eb12d0-49d6-461d-9efe-05d212954deb 2024-09-12T18:13:48.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.179+0000 7f35f5b26800 20 RGWRados::pool_iterate: got zonegroup_info.18101c76-8aff-4273-ac0e-5dcde3f604e4 2024-09-12T18:13:48.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.179+0000 7f35f5b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:13:48.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.179+0000 7f35f5b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:13:48.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.179+0000 7f35f5b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:13:48.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.179+0000 7f35f5b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:13:48.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.179+0000 7f35f5b26800 20 rados->read ofs=0 len=0 2024-09-12T18:13:48.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.180+0000 7f35f5b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:48.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.180+0000 7f35f5b26800 20 rados->read ofs=0 len=0 2024-09-12T18:13:48.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.180+0000 7f35f5b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:13:48.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.180+0000 7f35f5b26800 20 rados->read ofs=0 len=0 2024-09-12T18:13:48.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.180+0000 7f35f5b26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:13:48.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.180+0000 7f35f5b26800 20 zone default found 2024-09-12T18:13:48.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.180+0000 7f35f5b26800 4 Realm: () 2024-09-12T18:13:48.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.180+0000 7f35f5b26800 4 ZoneGroup: default (18101c76-8aff-4273-ac0e-5dcde3f604e4) 2024-09-12T18:13:48.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.180+0000 7f35f5b26800 4 Zone: default (06eb12d0-49d6-461d-9efe-05d212954deb) 2024-09-12T18:13:48.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.180+0000 7f35f5b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:13:48.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.180+0000 7f35f5b26800 20 zonegroup default 2024-09-12T18:13:48.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.180+0000 7f35f5b26800 20 rados->read ofs=0 len=0 2024-09-12T18:13:48.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.181+0000 7f35f5b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:48.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.181+0000 7f35f5b26800 20 rados->read ofs=0 len=0 2024-09-12T18:13:48.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.181+0000 7f35f5b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:48.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.181+0000 7f35f5b26800 20 rados->read ofs=0 len=0 2024-09-12T18:13:48.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.181+0000 7f35f5b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:13:48.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.181+0000 7f35f5b26800 20 started sync module instance, tier type = 2024-09-12T18:13:48.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.181+0000 7f35f5b26800 20 started zone id=06eb12d0-49d6-461d-9efe-05d212954deb (name=default) with tier type = 2024-09-12T18:13:48.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.193+0000 7f35f5b26800 20 add_watcher() i=0 2024-09-12T18:13:48.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.193+0000 7f35f5b26800 20 add_watcher() i=1 2024-09-12T18:13:48.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.193+0000 7f35f5b26800 20 add_watcher() i=2 2024-09-12T18:13:48.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.193+0000 7f35f5b26800 20 add_watcher() i=3 2024-09-12T18:13:48.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.193+0000 7f35f5b26800 20 add_watcher() i=4 2024-09-12T18:13:48.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.193+0000 7f35f5b26800 20 add_watcher() i=5 2024-09-12T18:13:48.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.193+0000 7f35f5b26800 20 add_watcher() i=6 2024-09-12T18:13:48.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.196+0000 7f35f5b26800 20 add_watcher() i=7 2024-09-12T18:13:48.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.196+0000 7f35f5b26800 2 all 8 watchers are set, enabling cache 2024-09-12T18:13:48.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.198+0000 7f34a7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:13:48.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.198+0000 7f35f5b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:13:48.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.198+0000 7f35f5b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:13:48.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.236+0000 7f34a6fe5640 20 reqs_thread_entry: start 2024-09-12T18:13:48.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.236+0000 7f35f5b26800 20 init_complete bucket index max shards: 1 2024-09-12T18:13:48.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.236+0000 7f35f5b26800 20 Filter name: none 2024-09-12T18:13:48.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.236+0000 7f34a4fe1640 20 reqs_thread_entry: start 2024-09-12T18:13:48.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.236+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:13:48.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.238+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:48.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.238+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:48.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.239+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43471' 2024-09-12T18:13:48.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.239+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16723784209233107041', time=2024-09-12T19:41:32.317860+0000, chain.objs.size()=5 2024-09-12T18:13:48.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.239+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.160__multipart_mymultipart-STANDARD.2~8k1S5A6_rRzrgpt07RvbY96UT4XeTcF.1 2024-09-12T18:13:48.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.239+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.160__shadow_mymultipart-STANDARD.2~8k1S5A6_rRzrgpt07RvbY96UT4XeTcF.1_1 2024-09-12T18:13:48.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.239+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.160__multipart_mymultipart-STANDARD.2~8k1S5A6_rRzrgpt07RvbY96UT4XeTcF.2 2024-09-12T18:13:48.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.240+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.160__shadow_mymultipart-STANDARD.2~8k1S5A6_rRzrgpt07RvbY96UT4XeTcF.2_1 2024-09-12T18:13:48.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.240+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.160__multipart_mymultipart-STANDARD.2~8k1S5A6_rRzrgpt07RvbY96UT4XeTcF.3 2024-09-12T18:13:48.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.240+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13079165882005968349', time=2024-09-12T19:42:24.720429+0000, chain.objs.size()=1 2024-09-12T18:13:48.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.240+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.167__shadow_.J7E0Ikfe2jwzDeNyLgXhhSAoO1KwR_s_0 2024-09-12T18:13:48.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.240+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14496534462744144535', time=2024-09-12T19:43:15.693623+0000, chain.objs.size()=1 2024-09-12T18:13:48.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.240+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.205__shadow_.f3TYP2CGMhZFZUYaDj5VqQp79OFHD99_0 2024-09-12T18:13:48.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.240+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7417592771570455762', time=2024-09-12T19:45:11.289384+0000, chain.objs.size()=1 2024-09-12T18:13:48.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.240+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.241__shadow_.G3h38hJZE4nEWHEdb27zBS-c-nQM9hf_0 2024-09-12T18:13:48.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.240+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10325312974319033812', time=2024-09-12T19:46:08.778788+0000, chain.objs.size()=1 2024-09-12T18:13:48.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.240+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.tkCoZ70zIPhV9oeS1gKz9ABH6YiGkI5_0 2024-09-12T18:13:48.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.240+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4812258716724129444', time=2024-09-12T19:46:09.052489+0000, chain.objs.size()=1 2024-09-12T18:13:48.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.240+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.nxp19eI2Wozo6MvAYxsLqvUGfW_hpWt_0 2024-09-12T18:13:48.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.240+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17133249106334416326', time=2024-09-12T19:46:09.273864+0000, chain.objs.size()=1 2024-09-12T18:13:48.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.240+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.sVv7X_Qmwz36Ovor1Ct9fVs3pp_LTcR_0 2024-09-12T18:13:48.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.240+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15510039100295345892', time=2024-09-12T19:46:09.594850+0000, chain.objs.size()=1 2024-09-12T18:13:48.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.240+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.pneq4VC4I_Ko0opclxDtmc12xJTg8w9_0 2024-09-12T18:13:48.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.244+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3966871233751352378', time=2024-09-12T19:46:09.676945+0000, chain.objs.size()=1 2024-09-12T18:13:48.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.244+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.B7DgNiW6sCUZBzTUutL6l64WRvsRedw_0 2024-09-12T18:13:48.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.244+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.159441100275251143', time=2024-09-12T19:46:09.799284+0000, chain.objs.size()=1 2024-09-12T18:13:48.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.244+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.kRnkq7vD6Wvm5voVNs_rKOPbIxvKrLu_0 2024-09-12T18:13:48.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.244+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13844756665548823496', time=2024-09-12T19:46:10.617750+0000, chain.objs.size()=1 2024-09-12T18:13:48.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.244+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Ex7ZgjqTYh2MSxwXh2w-FFrGB56-FLZ_0 2024-09-12T18:13:48.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.244+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10406287747400062854', time=2024-09-12T19:46:10.662496+0000, chain.objs.size()=1 2024-09-12T18:13:48.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.244+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.fInIXIt98Aq5-6LK_BsLfOjKpRiYka8_0 2024-09-12T18:13:48.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.244+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11079155367002926516', time=2024-09-12T19:46:10.691632+0000, chain.objs.size()=1 2024-09-12T18:13:48.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.244+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.8R2umF6vcmevWsEPAzNEbHFi70aX9R0_0 2024-09-12T18:13:48.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.244+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8880579289231702216', time=2024-09-12T19:46:11.342222+0000, chain.objs.size()=1 2024-09-12T18:13:48.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.244+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.TrR1dEQG6j-PuvZUr5CUgE0ZB1GGLDF_0 2024-09-12T18:13:48.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.244+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13203997304480918897', time=2024-09-12T19:46:12.012013+0000, chain.objs.size()=1 2024-09-12T18:13:48.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.244+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.tJzv1cr4Lf_ks-TO_ZxTIwULvpijFOL_0 2024-09-12T18:13:48.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.247+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14693483919751303303', time=2024-09-12T19:46:12.030071+0000, chain.objs.size()=1 2024-09-12T18:13:48.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.247+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.PGWkH_6GUxiYdMTqk5Dr6fU1Sq7YA62_0 2024-09-12T18:13:48.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.247+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14194775097209158520', time=2024-09-12T19:46:12.132784+0000, chain.objs.size()=1 2024-09-12T18:13:48.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.247+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.d7yuwdvCYWzhFgyT-n6q_O0GHYJUsZN_0 2024-09-12T18:13:48.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.247+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13323466302359367863', time=2024-09-12T19:46:12.229891+0000, chain.objs.size()=1 2024-09-12T18:13:48.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.247+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ucC88dbFOJe3ncBj2ERxfm789lI-RZf_0 2024-09-12T18:13:48.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.247+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3651431966057347660', time=2024-09-12T19:46:12.871354+0000, chain.objs.size()=1 2024-09-12T18:13:48.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.247+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.PqVShGmZduvAqcksQMpaRfvchOBRjTg_0 2024-09-12T18:13:48.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.247+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2507067337531642226', time=2024-09-12T19:46:13.335197+0000, chain.objs.size()=1 2024-09-12T18:13:48.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.247+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.chRabV5Jlz2zrxoHo05GykxAQZGw3hl_0 2024-09-12T18:13:48.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.248+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17757595952521692069', time=2024-09-12T19:46:13.548852+0000, chain.objs.size()=1 2024-09-12T18:13:48.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.248+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.HVc_SgyonLGCDQgaD8AtZxUvTC4l3Jh_0 2024-09-12T18:13:48.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.248+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8696975810948106563', time=2024-09-12T19:46:14.035085+0000, chain.objs.size()=1 2024-09-12T18:13:48.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.248+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ju7BAvYtZaCVRB4p55WmoGz76eDJSKS_0 2024-09-12T18:13:48.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.248+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12694827528338971467', time=2024-09-12T19:46:14.035684+0000, chain.objs.size()=1 2024-09-12T18:13:48.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.248+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.n90a1CpIWAyotKsXffBlc6wOIrU3Bd4_0 2024-09-12T18:13:48.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.248+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7503089469783121757', time=2024-09-12T19:46:14.252517+0000, chain.objs.size()=1 2024-09-12T18:13:48.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.248+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.mpROH7f7Lfq-UKZyWu7il2C5Ul0zgbL_0 2024-09-12T18:13:48.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.248+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14356418356119073867', time=2024-09-12T19:46:14.320701+0000, chain.objs.size()=1 2024-09-12T18:13:48.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.248+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.pNEXSxgIC-cMDIyb802zFKJQK3Nyzye_0 2024-09-12T18:13:48.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.248+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6954392856135848041', time=2024-09-12T19:46:15.014970+0000, chain.objs.size()=1 2024-09-12T18:13:48.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.248+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.95xHnJylMoL1hXqP6Kc6Ylj9pThaTQH_0 2024-09-12T18:13:48.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.249+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17675319426943500340', time=2024-09-12T19:46:15.428300+0000, chain.objs.size()=1 2024-09-12T18:13:48.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.249+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.j6nURMYeD30FXjr_WljQQVoZYYWk5BY_0 2024-09-12T18:13:48.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.249+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8497948544172530909', time=2024-09-12T19:46:15.538895+0000, chain.objs.size()=1 2024-09-12T18:13:48.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.249+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.obVzdI7beFot9DIHmAhbk48wq9OAm9A_0 2024-09-12T18:13:48.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.250+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1559840241955285653', time=2024-09-12T19:46:16.248521+0000, chain.objs.size()=1 2024-09-12T18:13:48.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.250+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.yn3zt2Ur5qxZ4LMgl6qr8SAnG9CgT-i_0 2024-09-12T18:13:48.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.250+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12665071186530267015', time=2024-09-12T19:46:16.738869+0000, chain.objs.size()=1 2024-09-12T18:13:48.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.250+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.2Mz4FCa7XaJ1sen2lbux-zCJQO-NRvh_0 2024-09-12T18:13:48.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.250+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.421317478239749928', time=2024-09-12T19:46:17.927452+0000, chain.objs.size()=1 2024-09-12T18:13:48.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.250+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.UmOVC4P-vtBvbpOv2WdZ4HItr0TaDtC_0 2024-09-12T18:13:48.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.250+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18433994503107099074', time=2024-09-12T19:46:18.055021+0000, chain.objs.size()=1 2024-09-12T18:13:48.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.250+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.28Lag9ByNnh0hRlnUyxNSlpUZkklGss_0 2024-09-12T18:13:48.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.250+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11793990290871066884', time=2024-09-12T19:46:19.009864+0000, chain.objs.size()=1 2024-09-12T18:13:48.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.250+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.rqZ-4_0GC91o-Ulq68PfjYE32Q_GLUd_0 2024-09-12T18:13:48.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.250+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2260966302473298160', time=2024-09-12T19:46:19.376598+0000, chain.objs.size()=1 2024-09-12T18:13:48.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.250+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.nTMzgblVszv3sjbxEmo06c9awNx133r_0 2024-09-12T18:13:48.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.250+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10055698303959226524', time=2024-09-12T19:46:22.223093+0000, chain.objs.size()=1 2024-09-12T18:13:48.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.250+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.266__shadow_.ZYXIP-9VSyyoX60oa2YNQj6iEGXc5dn_0 2024-09-12T18:13:48.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.251+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4776597543244489676', time=2024-09-12T19:46:23.986983+0000, chain.objs.size()=1 2024-09-12T18:13:48.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.251+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.268__shadow_.EjnhcrhS9UC9OnTFt8rEGK39dOg4TET_0 2024-09-12T18:13:48.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.251+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2949943937895447032', time=2024-09-12T19:46:38.307209+0000, chain.objs.size()=1 2024-09-12T18:13:48.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.251+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.284__shadow_.7iHurHpjnWVOxIYVxqfFj3FzI-lL07W_0 2024-09-12T18:13:48.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.252+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2512743449666830777', time=2024-09-12T19:46:40.197992+0000, chain.objs.size()=1 2024-09-12T18:13:48.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.252+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.286__shadow_.ehjiefGEBX4TsoEdIXK_LFwXKyCIY_y_0 2024-09-12T18:13:48.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.252+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16533199063093857887', time=2024-09-12T19:46:42.090878+0000, chain.objs.size()=1 2024-09-12T18:13:48.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.252+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.288__shadow_.nvmk0QIyPORDxa0MmZC04oFGMMbWbSj_0 2024-09-12T18:13:48.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.252+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11045293616365446273', time=2024-09-12T19:46:43.890112+0000, chain.objs.size()=1 2024-09-12T18:13:48.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.252+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.290__shadow_.L5ljrduheJKY-eErvYkzBysC9APZLGJ_0 2024-09-12T18:13:48.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.252+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9992944468775401191', time=2024-09-12T19:46:55.104994+0000, chain.objs.size()=1 2024-09-12T18:13:48.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.252+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.299__shadow_.GvZGUzndCu6-y4_CltLz5V5QbRP28L4_0 2024-09-12T18:13:48.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.252+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9758723421256295760', time=2024-09-12T19:46:56.086143+0000, chain.objs.size()=1 2024-09-12T18:13:48.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.252+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.300__shadow_.KsAet-RHmQFGPjmLxU0pJxUwRtfiHV4_0 2024-09-12T18:13:48.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.253+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7353392008563827230', time=2024-09-12T19:47:59.598235+0000, chain.objs.size()=1 2024-09-12T18:13:48.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.253+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.-FA9D8R68kmkjEV_E6iceOamxG_WDyh_0 2024-09-12T18:13:48.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.254+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14462273921272525386', time=2024-09-12T19:47:59.695655+0000, chain.objs.size()=1 2024-09-12T18:13:48.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.254+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.DVwvGX_yEI71myBlobdkQPefgt3SumE_0 2024-09-12T18:13:48.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.254+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13281697618263505480', time=2024-09-12T19:48:00.206852+0000, chain.objs.size()=1 2024-09-12T18:13:48.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.254+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.wPC2iHZ0oR8KJfN1wuqk3brmtZH2iqb_0 2024-09-12T18:13:48.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.254+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11561334586497243525', time=2024-09-12T19:48:00.330400+0000, chain.objs.size()=1 2024-09-12T18:13:48.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.254+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.zzDvDDrxoVC7YKEQAwJl-Vs4BgCrlQ4_0 2024-09-12T18:13:48.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.254+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16650028690572882314', time=2024-09-12T19:48:01.024329+0000, chain.objs.size()=1 2024-09-12T18:13:48.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.254+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ovshAhLPzSP2bbQQ0FC7hdFpcrL70h0_0 2024-09-12T18:13:48.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.254+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.36947929981172768', time=2024-09-12T19:48:01.057668+0000, chain.objs.size()=1 2024-09-12T18:13:48.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.254+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.GeWBNgOErd3XIWxlSnFYFGa_SvxtqYm_0 2024-09-12T18:13:48.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.254+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.669829585071843750', time=2024-09-12T19:48:01.152939+0000, chain.objs.size()=1 2024-09-12T18:13:48.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.254+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.84viX3HImfL_mD50DrtkMbSjL0z2r_z_0 2024-09-12T18:13:48.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.254+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4643316271279082281', time=2024-09-12T19:48:01.153564+0000, chain.objs.size()=1 2024-09-12T18:13:48.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.254+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Fh3GF3OUsp9suk_Nhy2ZB91vv-_qMg2_0 2024-09-12T18:13:48.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.254+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7791478220469347841', time=2024-09-12T19:48:01.309519+0000, chain.objs.size()=1 2024-09-12T18:13:48.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.254+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.hMEoQylrLORmp5CmHn3FaM7pA7wUv4t_0 2024-09-12T18:13:48.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.254+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12926048423235047906', time=2024-09-12T19:48:01.543985+0000, chain.objs.size()=1 2024-09-12T18:13:48.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.254+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.r3E8Y3mMZ1qPaGXrCjSCON6GuP_iZGT_0 2024-09-12T18:13:48.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.254+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1758314770031748190', time=2024-09-12T19:48:01.637757+0000, chain.objs.size()=1 2024-09-12T18:13:48.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.254+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.JgBhc3HcbFLzPjw0rfABlXdooUqcTMe_0 2024-09-12T18:13:48.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.254+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16891197067415414582', time=2024-09-12T19:48:02.647189+0000, chain.objs.size()=1 2024-09-12T18:13:48.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.254+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ht0ZlPKgXSk0b5iqRp3BH0PzulZnoPw_0 2024-09-12T18:13:48.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.256+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15390658109132961319', time=2024-09-12T19:48:02.741391+0000, chain.objs.size()=1 2024-09-12T18:13:48.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.256+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.XGmY4y0QlLIHuSOYJdMlLtxdBRnrj2e_0 2024-09-12T18:13:48.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.256+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.266384486078237942', time=2024-09-12T19:48:02.742120+0000, chain.objs.size()=1 2024-09-12T18:13:48.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.256+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.V2FdUu1b54wwLHdji2w1ay81Qg_gXtc_0 2024-09-12T18:13:48.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.256+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10163676215893006502', time=2024-09-12T19:48:03.057896+0000, chain.objs.size()=1 2024-09-12T18:13:48.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.256+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.EAOQJ7S-Nu28En44t04NEXgd_fyNaAz_0 2024-09-12T18:13:48.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.257+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14501300139914732865', time=2024-09-12T19:48:03.193887+0000, chain.objs.size()=1 2024-09-12T18:13:48.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.257+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.p6t8ByQVETVomgG62r5i_1u1FUyjbQe_0 2024-09-12T18:13:48.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.257+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3655696678617210638', time=2024-09-12T19:48:03.380891+0000, chain.objs.size()=1 2024-09-12T18:13:48.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.257+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.cuh6cmC6fhZAB6xTyajYQRB7Mioyxlr_0 2024-09-12T18:13:48.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.257+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6551359385734122785', time=2024-09-12T19:48:03.938826+0000, chain.objs.size()=1 2024-09-12T18:13:48.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.257+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.KxNMKkDaQfWVGKS-N72S_cL2RJSXJau_0 2024-09-12T18:13:48.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.257+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4378969896275870260', time=2024-09-12T19:48:04.075121+0000, chain.objs.size()=1 2024-09-12T18:13:48.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.257+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.VIFI24C0TnEbumWzcigtSJLNkftdSLW_0 2024-09-12T18:13:48.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.257+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17023336393129869285', time=2024-09-12T19:48:04.710662+0000, chain.objs.size()=1 2024-09-12T18:13:48.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.257+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.r-aBB3PcYyUNgtfMqE74XZOuBLkeyZe_0 2024-09-12T18:13:48.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.257+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15257279280516975040', time=2024-09-12T19:48:04.756214+0000, chain.objs.size()=1 2024-09-12T18:13:48.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.257+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.E0QhBdJjBXrbWY3ZKE3nHqhyPQaSp4t_0 2024-09-12T18:13:48.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.257+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12805838277852708709', time=2024-09-12T19:48:04.861296+0000, chain.objs.size()=1 2024-09-12T18:13:48.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.257+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.pdhGFiLas_4L9x_pcyBb2oIaKgE1Q0m_0 2024-09-12T18:13:48.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.257+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16554428960513448341', time=2024-09-12T19:48:05.462105+0000, chain.objs.size()=1 2024-09-12T18:13:48.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.257+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.iMjVPFauNcxYLnxj6EUBeEMAg3nygCF_0 2024-09-12T18:13:48.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.257+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16987814635379638277', time=2024-09-12T19:48:05.462558+0000, chain.objs.size()=1 2024-09-12T18:13:48.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.257+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.B9xaJBY8FaqIDQz_sSB-_EdtEXhlwo1_0 2024-09-12T18:13:48.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.259+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.436360396788871308', time=2024-09-12T19:48:05.857301+0000, chain.objs.size()=1 2024-09-12T18:13:48.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.259+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.b1P33OQCWF4UNsujgpupFF6BTb29xKa_0 2024-09-12T18:13:48.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.259+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3449780507415549271', time=2024-09-12T19:48:06.035923+0000, chain.objs.size()=1 2024-09-12T18:13:48.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.259+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.0LZkHSy5-ksfVSBLjI2LWacfMV9OgbC_0 2024-09-12T18:13:48.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.259+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16780873700584226263', time=2024-09-12T19:48:06.187818+0000, chain.objs.size()=1 2024-09-12T18:13:48.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.259+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.I9lviniG7qw8MmHTs6nwJ6Pjeq2G0Mi_0 2024-09-12T18:13:48.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.260+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7940488472953630138', time=2024-09-12T19:48:06.279027+0000, chain.objs.size()=1 2024-09-12T18:13:48.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.260+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.dk9wgrrFZIJYn2t9oOvB3bXZs3GB2Un_0 2024-09-12T18:13:48.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.260+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11877609536812579987', time=2024-09-12T19:48:06.684620+0000, chain.objs.size()=1 2024-09-12T18:13:48.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.260+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.XaiY5PsDA3bKCVx3S1f8ItAf6TMS5Qq_0 2024-09-12T18:13:48.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.260+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4557844007326553713', time=2024-09-12T19:48:06.823403+0000, chain.objs.size()=1 2024-09-12T18:13:48.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.260+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.8xx31BgV64oqBpWTcZagQgkPwAa2uyx_0 2024-09-12T18:13:48.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.260+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1491082845914698782', time=2024-09-12T19:48:07.102211+0000, chain.objs.size()=1 2024-09-12T18:13:48.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.260+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ONUZMtEfJesXdIJW0Z59HsRuENFb3bB_0 2024-09-12T18:13:48.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.260+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5295009871424142549', time=2024-09-12T19:48:07.102906+0000, chain.objs.size()=1 2024-09-12T18:13:48.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.260+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ieEA0k_clw1WZga8cXbdkPUPcDkKR7n_0 2024-09-12T18:13:48.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.260+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7722105876936491737', time=2024-09-12T19:48:07.216745+0000, chain.objs.size()=1 2024-09-12T18:13:48.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.260+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.MvQX4E5nbziW6qUR640tYhygV_JpWzH_0 2024-09-12T18:13:48.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.260+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18416943598619289650', time=2024-09-12T19:48:07.458020+0000, chain.objs.size()=1 2024-09-12T18:13:48.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.260+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.odoZ6UEUBv4he1rcJbwZ-XvAjlNSvL1_0 2024-09-12T18:13:48.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.260+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5840406180605021951', time=2024-09-12T19:48:07.590569+0000, chain.objs.size()=1 2024-09-12T18:13:48.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.260+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_._P_Fpk_dBqQ5TllUD9AStSXzQNbICJF_0 2024-09-12T18:13:48.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.261+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6535408134623327865', time=2024-09-12T19:48:08.277679+0000, chain.objs.size()=1 2024-09-12T18:13:48.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.261+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.RwOyJVEiO1oedau5BjlK9DVRbRocPAN_0 2024-09-12T18:13:48.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.262+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9742622261728878722', time=2024-09-12T19:48:08.807750+0000, chain.objs.size()=1 2024-09-12T18:13:48.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.262+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.GnvgplAucFwnAy9-K4yHDs47msOM-MH_0 2024-09-12T18:13:48.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.262+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4158901718563069511', time=2024-09-12T19:48:08.994041+0000, chain.objs.size()=1 2024-09-12T18:13:48.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.262+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.BXqkZw6md3zrzlHgB5pnELwJrxXuDoi_0 2024-09-12T18:13:48.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.262+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18150216324223726136', time=2024-09-12T19:48:09.692506+0000, chain.objs.size()=1 2024-09-12T18:13:48.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.262+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.op0A4mapSDy8zktPOkBpfW6ecP1M8VI_0 2024-09-12T18:13:48.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.263+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2309091186327859176', time=2024-09-12T19:48:10.082714+0000, chain.objs.size()=1 2024-09-12T18:13:48.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.263+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.xYDibIim6ChFjtZbUlT1QBUIiKa6t7p_0 2024-09-12T18:13:48.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.263+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1714930815552538326', time=2024-09-12T19:48:48.466588+0000, chain.objs.size()=1 2024-09-12T18:13:48.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.263+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.W-TSq-IIEJ12fcrmec2mIEgwXDWkQRd_0 2024-09-12T18:13:48.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.263+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15721803076293429966', time=2024-09-12T19:48:49.294704+0000, chain.objs.size()=1 2024-09-12T18:13:48.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.263+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.1W-nsSCu0hbvb6kE6l7DBfYIDlLSNOo_0 2024-09-12T18:13:48.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.263+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6704014839847553008', time=2024-09-12T19:48:49.630790+0000, chain.objs.size()=1 2024-09-12T18:13:48.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.263+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ZFT9XO-RhBHJUfwu4aqS8iAkeAwX0_9_0 2024-09-12T18:13:48.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.263+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17758656014580371871', time=2024-09-12T19:48:51.916100+0000, chain.objs.size()=1 2024-09-12T18:13:48.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.263+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.wWbuWf8cqBNP1KOeJ6tuGEJbh0vdNJY_0 2024-09-12T18:13:48.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.263+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4635610049655538880', time=2024-09-12T19:48:52.087937+0000, chain.objs.size()=1 2024-09-12T18:13:48.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.263+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.xZAeoPle6AuNKSCNwuzJlhLb0QKFCHL_0 2024-09-12T18:13:48.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.263+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16509155246438006248', time=2024-09-12T19:48:53.806734+0000, chain.objs.size()=1 2024-09-12T18:13:48.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.263+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.UaSTUNirJKLHdnx97V4D50PjP-3HWi5_0 2024-09-12T18:13:48.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.263+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10818425692002883818', time=2024-09-12T19:48:53.958677+0000, chain.objs.size()=1 2024-09-12T18:13:48.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.263+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.H5HcVSNGHSgAqk-uSkUm82pqimZc02N_0 2024-09-12T18:13:48.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.265+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11222255970972740612', time=2024-09-12T19:48:54.634678+0000, chain.objs.size()=1 2024-09-12T18:13:48.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.265+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.WOJqVamqRHWvL6UefgqGGutBftDem9S_0 2024-09-12T18:13:48.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.265+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8054144592983040795', time=2024-09-12T19:48:54.735003+0000, chain.objs.size()=1 2024-09-12T18:13:48.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.265+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Xi_8hrkHW6z7zNAq5KeBikaRxA9ro_5_0 2024-09-12T18:13:48.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.265+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4465047289348563332', time=2024-09-12T19:48:55.003276+0000, chain.objs.size()=1 2024-09-12T18:13:48.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.265+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.WqbR0usdIkfIZRPfiH71hszm0F7Tb5v_0 2024-09-12T18:13:48.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.265+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5942701346774730867', time=2024-09-12T19:48:55.345865+0000, chain.objs.size()=1 2024-09-12T18:13:48.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.265+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.i1qDOA5OKOgo_RR4TdVEX3Ofos8oJKx_0 2024-09-12T18:13:48.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.265+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5819594109463602601', time=2024-09-12T19:48:56.086246+0000, chain.objs.size()=1 2024-09-12T18:13:48.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.265+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.rbyLvqgQ0GGUjhV1d68N3W_YdmoU_Ta_0 2024-09-12T18:13:48.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.265+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.124842978174888141', time=2024-09-12T19:48:56.296007+0000, chain.objs.size()=1 2024-09-12T18:13:48.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.265+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Q6Hu6m7RYkXvCkC5UTckwiUx3Pm6hBO_0 2024-09-12T18:13:48.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.265+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5890139898784056001', time=2024-09-12T19:48:56.699230+0000, chain.objs.size()=1 2024-09-12T18:13:48.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.265+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.c-znh7_owNs43p0XKaNM-C4ZDmD86jb_0 2024-09-12T18:13:48.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.266+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13356897945163586295', time=2024-09-12T19:48:57.376273+0000, chain.objs.size()=1 2024-09-12T18:13:48.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.266+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.tJ6vXEIFHV_M6NTvpJ4dc3ECB6Soems_0 2024-09-12T18:13:48.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.266+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17579818737457458274', time=2024-09-12T19:48:57.503381+0000, chain.objs.size()=1 2024-09-12T18:13:48.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.266+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Txrgo5SNKl7foHWQtOkTw32klffCt3O_0 2024-09-12T18:13:48.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.266+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18268134180377388719', time=2024-09-12T19:48:57.887474+0000, chain.objs.size()=1 2024-09-12T18:13:48.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.266+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.wGPawdczXx1hCxZsEO9CBJLry7YRuLG_0 2024-09-12T18:13:48.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.266+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8990387653241720728', time=2024-09-12T19:49:00.432858+0000, chain.objs.size()=1 2024-09-12T18:13:48.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.266+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.328__shadow_.cRHxINWAG4fmwDorGwP7DBTbX_Cuz2H_0 2024-09-12T18:13:48.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.271+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/43471 2024-09-12T18:13:48.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.274+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T18:13:48.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.274+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10039590579522924665', time=2024-09-12T19:50:12.118454+0000, chain.objs.size()=1 2024-09-12T18:13:48.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.274+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.411__shadow_.6QcP8YoDcK_Obkxb599owg3KD5bT95J_0 2024-09-12T18:13:48.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.274+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6727112210103691263', time=2024-09-12T19:50:46.074978+0000, chain.objs.size()=1 2024-09-12T18:13:48.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.274+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.448__shadow_.LQJz2C-_Rcdn5n2dNAwrxzzswPLMYyN_0 2024-09-12T18:13:48.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.274+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14227372560642362308', time=2024-09-12T19:51:18.572451+0000, chain.objs.size()=1 2024-09-12T18:13:48.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.274+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.484__shadow_.dwBv9Mtj_nE9rRCtj0-njxo1tWqwLHV_0 2024-09-12T18:13:48.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.274+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3473030008751295305', time=2024-09-12T19:51:18.592019+0000, chain.objs.size()=1 2024-09-12T18:13:48.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.274+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.484__shadow_.i9ng3mCWfSGgqW5nagjoCV6BdKPmIDq_0 2024-09-12T18:13:48.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.274+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4602680574062265867', time=2024-09-12T19:51:25.533509+0000, chain.objs.size()=1 2024-09-12T18:13:48.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.274+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.487__shadow_.hP5HwTv6Zhl2BsUbWbJ_skSl-fKML2W_0 2024-09-12T18:13:48.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.274+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6288701906019788898', time=2024-09-12T19:55:47.937724+0000, chain.objs.size()=1 2024-09-12T18:13:48.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.274+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.525__shadow_.wLg51Po7yvcvxA8pCMHqRPVT4jAvG7P_0 2024-09-12T18:13:48.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.274+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8626370840810169389', time=2024-09-12T19:57:11.303365+0000, chain.objs.size()=1 2024-09-12T18:13:48.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.274+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.553__shadow_.PK21Y5rRx_P7-89pJB4-lnlMseS8O2__0 2024-09-12T18:13:48.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.274+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12691803540608397822', time=2024-09-12T19:57:57.055772+0000, chain.objs.size()=1 2024-09-12T18:13:48.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.274+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:OvZyze6bvDMbzSFbUzolLSS-G1KeAxR_.PsIilEgCh_oa5d0zubbLYAz7eRuB6CO_0 2024-09-12T18:13:48.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.274+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7621375416104447158', time=2024-09-12T20:01:42.431626+0000, chain.objs.size()=12 2024-09-12T18:13:48.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.274+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.615__multipart_multipart_enc.2~71gpaOFq4eAscr5m3U8dbA0_u0jX6dw.1 2024-09-12T18:13:48.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.274+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.615__shadow_multipart_enc.2~71gpaOFq4eAscr5m3U8dbA0_u0jX6dw.1_1 2024-09-12T18:13:48.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.274+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.615__multipart_multipart_enc.2~71gpaOFq4eAscr5m3U8dbA0_u0jX6dw.2 2024-09-12T18:13:48.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.274+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.615__shadow_multipart_enc.2~71gpaOFq4eAscr5m3U8dbA0_u0jX6dw.2_1 2024-09-12T18:13:48.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.275+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.615__multipart_multipart_enc.2~71gpaOFq4eAscr5m3U8dbA0_u0jX6dw.3 2024-09-12T18:13:48.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.276+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.615__shadow_multipart_enc.2~71gpaOFq4eAscr5m3U8dbA0_u0jX6dw.3_1 2024-09-12T18:13:48.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.276+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.615__multipart_multipart_enc.2~71gpaOFq4eAscr5m3U8dbA0_u0jX6dw.4 2024-09-12T18:13:48.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.276+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.615__shadow_multipart_enc.2~71gpaOFq4eAscr5m3U8dbA0_u0jX6dw.4_1 2024-09-12T18:13:48.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.276+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.615__multipart_multipart_enc.2~71gpaOFq4eAscr5m3U8dbA0_u0jX6dw.5 2024-09-12T18:13:48.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.277+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.615__shadow_multipart_enc.2~71gpaOFq4eAscr5m3U8dbA0_u0jX6dw.5_1 2024-09-12T18:13:48.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.277+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.615__multipart_multipart_enc.2~71gpaOFq4eAscr5m3U8dbA0_u0jX6dw.6 2024-09-12T18:13:48.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.277+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.615__shadow_multipart_enc.2~71gpaOFq4eAscr5m3U8dbA0_u0jX6dw.6_1 2024-09-12T18:13:48.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.277+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5518719958647896775', time=2024-09-12T20:04:54.274354+0000, chain.objs.size()=1 2024-09-12T18:13:48.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.277+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.630__shadow_.kJPKijaOIBC62I-74xPtPMMqh_fGVvZ_0 2024-09-12T18:13:48.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.277+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13865269070182030320', time=2024-09-12T20:06:32.878027+0000, chain.objs.size()=1 2024-09-12T18:13:48.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.277+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.703__multipart_file1.2~7FhAMojcE9kQD7yIXO59xT-rGtmgwKH.1 2024-09-12T18:13:48.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.282+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:48.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.284+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:13:48.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.285+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:48.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.286+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:48.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.287+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50190' 2024-09-12T18:13:48.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.287+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11288387820074335711', time=2024-09-12T19:45:08.049369+0000, chain.objs.size()=1 2024-09-12T18:13:48.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.287+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.238__shadow_.hsX6ZgCZwfQLBS6xInUPhk_GhF4XYrU_0 2024-09-12T18:13:48.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.287+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12063628454885846798', time=2024-09-12T19:45:16.330052+0000, chain.objs.size()=1 2024-09-12T18:13:48.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.287+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.245__shadow_.t6ddUu-wHB-G6867i4kPVgQ_Jl-Zs4j_0 2024-09-12T18:13:48.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.287+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2778389768971807252', time=2024-09-12T19:45:20.016904+0000, chain.objs.size()=1 2024-09-12T18:13:48.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.287+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.249__shadow_.byYUNShsmQGdoawi9xFyyn_j1hlAVgF_0 2024-09-12T18:13:48.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.287+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13391697184976373653', time=2024-09-12T19:45:20.927281+0000, chain.objs.size()=1 2024-09-12T18:13:48.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.287+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.250__shadow_.HzxCGl8b5QzI9X3gLgQgEWGtluUYpZO_0 2024-09-12T18:13:48.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.287+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15895462051213698101', time=2024-09-12T19:46:09.141650+0000, chain.objs.size()=1 2024-09-12T18:13:48.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.287+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ACPGEIud8WX0sETxUP_j-qkTd_fq_RA_0 2024-09-12T18:13:48.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.287+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5067927974411410468', time=2024-09-12T19:46:09.305352+0000, chain.objs.size()=1 2024-09-12T18:13:48.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.287+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.gkKOD1lZDfEs2iMiWv8Dd_Iglmyc11s_0 2024-09-12T18:13:48.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.287+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1746926190726202251', time=2024-09-12T19:46:09.432262+0000, chain.objs.size()=1 2024-09-12T18:13:48.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.287+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.2IqogHxIfTs8nsLscl8qw91JDxTBHu-_0 2024-09-12T18:13:48.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.287+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18363313726203154194', time=2024-09-12T19:46:09.476956+0000, chain.objs.size()=1 2024-09-12T18:13:48.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.287+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.XCI-ByA42Pvdp72t4DTSzsRyDjQE85k_0 2024-09-12T18:13:48.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.287+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10681096465435837000', time=2024-09-12T19:46:09.477849+0000, chain.objs.size()=1 2024-09-12T18:13:48.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.287+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.DCC169y80rmZGW8xVttd3LedYxVksER_0 2024-09-12T18:13:48.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.287+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5027606074255820933', time=2024-09-12T19:46:09.866474+0000, chain.objs.size()=1 2024-09-12T18:13:48.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.287+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.kh617HvxqSvmY5CWOOfyweQWcUfiJXd_0 2024-09-12T18:13:48.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.287+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10450018899015011493', time=2024-09-12T19:46:10.892679+0000, chain.objs.size()=1 2024-09-12T18:13:48.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.287+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.20yCKBAOIsXMcmwblDRADCWJOiFHdVz_0 2024-09-12T18:13:48.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.287+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7426199328463985731', time=2024-09-12T19:46:11.011429+0000, chain.objs.size()=1 2024-09-12T18:13:48.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.287+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ooPcEm0Lrm3xM6VRrkEProGY8EmDCNs_0 2024-09-12T18:13:48.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.289+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17995818764055193346', time=2024-09-12T19:46:11.173578+0000, chain.objs.size()=1 2024-09-12T18:13:48.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.289+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.d088aMjnUInvNZpWhHCkKZX6JE9XvJX_0 2024-09-12T18:13:48.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.289+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8098798233482649150', time=2024-09-12T19:46:11.399128+0000, chain.objs.size()=1 2024-09-12T18:13:48.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.289+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.EOiEaWoq_u0LdK4weeMyzJJzxy13ysU_0 2024-09-12T18:13:48.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.289+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3986099536193602916', time=2024-09-12T19:46:11.880177+0000, chain.objs.size()=1 2024-09-12T18:13:48.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.289+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.4lMNdz66xW-D5kGCFA4fjORmXq2W7T8_0 2024-09-12T18:13:48.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.289+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2141235528584612594', time=2024-09-12T19:46:12.235194+0000, chain.objs.size()=1 2024-09-12T18:13:48.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.289+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.vSlHtHd1qq-z38f2JCKcuvAoMy6r2zl_0 2024-09-12T18:13:48.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.289+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11808518118551499884', time=2024-09-12T19:46:12.235877+0000, chain.objs.size()=1 2024-09-12T18:13:48.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.289+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.tQcVAWC12EjLyVXI_QU8Sr2kh3t0oC6_0 2024-09-12T18:13:48.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.289+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10388999342247137542', time=2024-09-12T19:46:12.311434+0000, chain.objs.size()=1 2024-09-12T18:13:48.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.289+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.jCKsfIYE-VOEu8LMaOqdWENrUW7Hxw8_0 2024-09-12T18:13:48.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.289+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4379222483131668473', time=2024-09-12T19:46:12.389235+0000, chain.objs.size()=1 2024-09-12T18:13:48.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.289+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.vwnTmdGuiZWpZCF1g7QwCK12zf35UQg_0 2024-09-12T18:13:48.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.289+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1690957282291529277', time=2024-09-12T19:46:13.540877+0000, chain.objs.size()=1 2024-09-12T18:13:48.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.289+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.SCZBawm8VJ48nK0GCTjbQZ0pAJqETKx_0 2024-09-12T18:13:48.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.289+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12024409603305504766', time=2024-09-12T19:46:14.940854+0000, chain.objs.size()=1 2024-09-12T18:13:48.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.289+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.n3G_PBhM4ZhkvfjjZUtoqb6_ZltZkwm_0 2024-09-12T18:13:48.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.289+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1873669973092169206', time=2024-09-12T19:46:14.986793+0000, chain.objs.size()=1 2024-09-12T18:13:48.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.289+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.uNRSrrlpQn1hVZ4RL1HunktiPRlWjhj_0 2024-09-12T18:13:48.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.289+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7404712660857714620', time=2024-09-12T19:46:15.132920+0000, chain.objs.size()=1 2024-09-12T18:13:48.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.289+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.l5jNGhXkJWUL2nb5Z0fVl0v99wcsu-V_0 2024-09-12T18:13:48.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.291+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14212499981829189694', time=2024-09-12T19:46:16.090581+0000, chain.objs.size()=1 2024-09-12T18:13:48.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.291+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.94ZzT44ZW_ElImO1i20qjsenYQxlb4l_0 2024-09-12T18:13:48.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.293+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6107367377929946655', time=2024-09-12T19:46:16.687756+0000, chain.objs.size()=1 2024-09-12T18:13:48.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.293+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.FVKdHkO-weQmFmYckkD5v-8fQ_z3EBS_0 2024-09-12T18:13:48.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.293+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9215840875173294508', time=2024-09-12T19:46:17.596965+0000, chain.objs.size()=1 2024-09-12T18:13:48.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.293+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.gliosuwluh-TyDerhQV-tWeM6g3jcpv_0 2024-09-12T18:13:48.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.293+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13254360839445325140', time=2024-09-12T19:46:18.135576+0000, chain.objs.size()=1 2024-09-12T18:13:48.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.293+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.0nyrmnjuVnyVC36FbRk9S1reM1ZZQUu_0 2024-09-12T18:13:48.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.293+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3526919949914790420', time=2024-09-12T19:46:18.419941+0000, chain.objs.size()=1 2024-09-12T18:13:48.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.293+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.DwkybSkJ16DN9OM79lC5m75EBuhOVJY_0 2024-09-12T18:13:48.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.293+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12781376428758642478', time=2024-09-12T19:46:18.474612+0000, chain.objs.size()=1 2024-09-12T18:13:48.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.293+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.QECl2Wkx_1ia_hNMgmSj0oDiMhhCdna_0 2024-09-12T18:13:48.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.293+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6321679011025592191', time=2024-09-12T19:46:18.975151+0000, chain.objs.size()=1 2024-09-12T18:13:48.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.293+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.vMyGicSFZR-nomGAsMBKEONowossmFN_0 2024-09-12T18:13:48.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.293+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14365589233181659982', time=2024-09-12T19:46:19.002920+0000, chain.objs.size()=1 2024-09-12T18:13:48.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.293+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Yq40T6-VAEDibGITGcn9JenmRSnzqT5_0 2024-09-12T18:13:48.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.293+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17035785771086733599', time=2024-09-12T19:46:19.526345+0000, chain.objs.size()=1 2024-09-12T18:13:48.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.293+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.99lvxX7TmEP-i6AIzVsJThakoAmL-_T_0 2024-09-12T18:13:48.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.293+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17555440237150990685', time=2024-09-12T19:46:19.591365+0000, chain.objs.size()=1 2024-09-12T18:13:48.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.293+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.FRDcUiAIPKxUnL-Y_2dE-akF3bJMpx3_0 2024-09-12T18:13:48.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.293+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2747240358651660841', time=2024-09-12T19:46:26.608261+0000, chain.objs.size()=1 2024-09-12T18:13:48.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.293+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.271__shadow_.qWZoYCgeZ2h2pbimHy7A59wUtPmBHZb_0 2024-09-12T18:13:48.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.293+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16728656118956104375', time=2024-09-12T19:46:32.833095+0000, chain.objs.size()=1 2024-09-12T18:13:48.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.293+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.278__shadow_.9pIASYfQ-qpA_5v1thE4yJdefBeFJzR_0 2024-09-12T18:13:48.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.294+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9105954473144314429', time=2024-09-12T19:46:35.545940+0000, chain.objs.size()=1 2024-09-12T18:13:48.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.295+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.281__shadow_.jMUZLtn0QlpyKCFC3U6YEy2dFSvkWy6_0 2024-09-12T18:13:48.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.295+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1429974197943014867', time=2024-09-12T19:46:39.217633+0000, chain.objs.size()=1 2024-09-12T18:13:48.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.295+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.285__shadow_.cxTrjjhmN3iQjT9Q1nXwzYO5UmtV_fS_0 2024-09-12T18:13:48.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.295+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.690972940370678757', time=2024-09-12T19:46:43.891131+0000, chain.objs.size()=1 2024-09-12T18:13:48.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.295+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.290__shadow_.P59whB2XaTKRgqS8TbK5_Xlwg6b22WW_0 2024-09-12T18:13:48.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.295+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6147014660145696705', time=2024-09-12T19:46:44.809265+0000, chain.objs.size()=1 2024-09-12T18:13:48.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.295+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.291__shadow_.EipMrcwOZVP-8h1-1aJPWwwf4bq8t7v_0 2024-09-12T18:13:48.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.295+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11323895848854187496', time=2024-09-12T19:46:50.333277+0000, chain.objs.size()=1 2024-09-12T18:13:48.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.295+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.294__shadow_.qE022jjwDR9e2-cgAQdkAwhRqbpr5i7_0 2024-09-12T18:13:48.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.296+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13455775570522170721', time=2024-09-12T19:46:50.334036+0000, chain.objs.size()=1 2024-09-12T18:13:48.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.296+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.294__shadow_.M4KUyA6jlK670gzouQ6-B48x0uukrtx_0 2024-09-12T18:13:48.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.296+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18430103361136054970', time=2024-09-12T19:47:59.597331+0000, chain.objs.size()=1 2024-09-12T18:13:48.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.296+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ScV2OSf7CiS4OldEpmuiF4uy-MzHS-f_0 2024-09-12T18:13:48.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.296+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5286668262399018261', time=2024-09-12T19:48:00.050428+0000, chain.objs.size()=1 2024-09-12T18:13:48.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.296+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Mhp73kz180Z5fevPCm9Ne3RVSH14kla_0 2024-09-12T18:13:48.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.296+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14558013651181508141', time=2024-09-12T19:48:00.190789+0000, chain.objs.size()=1 2024-09-12T18:13:48.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.296+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.X4fpkXjkOpLUkKMNRQlDHO5Q2pmKFXt_0 2024-09-12T18:13:48.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.296+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2197786059599508341', time=2024-09-12T19:48:00.457962+0000, chain.objs.size()=1 2024-09-12T18:13:48.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.296+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.98zsSZYNeSHIiUU8LJMGD6Xh3TGyRAZ_0 2024-09-12T18:13:48.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.297+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7049639612283307863', time=2024-09-12T19:48:01.211904+0000, chain.objs.size()=1 2024-09-12T18:13:48.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.297+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.EgogLEvdMgAe5GPPdLf5eyul0-1_FFj_0 2024-09-12T18:13:48.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.297+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.623429932213825627', time=2024-09-12T19:48:01.586861+0000, chain.objs.size()=1 2024-09-12T18:13:48.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.297+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.MVdlvaHkX_Y-rn6hPB6rex1abfY6QeS_0 2024-09-12T18:13:48.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.297+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.613521599200611182', time=2024-09-12T19:48:01.820162+0000, chain.objs.size()=1 2024-09-12T18:13:48.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.297+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.VIK4eIYFAQ8rsRE-4WQpgosUkmtTFzk_0 2024-09-12T18:13:48.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.297+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2174801774569724613', time=2024-09-12T19:48:02.651905+0000, chain.objs.size()=1 2024-09-12T18:13:48.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.297+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.kOMGGb8tzONC9zFr7fkYkmyovTpmdei_0 2024-09-12T18:13:48.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.297+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.137786051453444402', time=2024-09-12T19:48:03.035716+0000, chain.objs.size()=1 2024-09-12T18:13:48.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.297+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.WBP_UYUycQkfkCZhhWzwsIkVrZz2zLz_0 2024-09-12T18:13:48.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.297+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8142408289694553572', time=2024-09-12T19:48:03.229518+0000, chain.objs.size()=1 2024-09-12T18:13:48.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.297+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.oglhFc15g-klgnx0wTrO7-aPYzCebk0_0 2024-09-12T18:13:48.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.297+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9151449551566451762', time=2024-09-12T19:48:04.048484+0000, chain.objs.size()=1 2024-09-12T18:13:48.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.297+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Zwoj1QPxLOwpM53ELrghf1-Ed4BS3ER_0 2024-09-12T18:13:48.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.298+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18234938979520562846', time=2024-09-12T19:48:04.183204+0000, chain.objs.size()=1 2024-09-12T18:13:48.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.298+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.vrurjrfH2VwEBbRq5c-AjVT-IFX1X-2_0 2024-09-12T18:13:48.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.298+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17900552154266045539', time=2024-09-12T19:48:04.248186+0000, chain.objs.size()=1 2024-09-12T18:13:48.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.298+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.5Hk38hGy7m1qXVQPVIG6i2i6svdyjsU_0 2024-09-12T18:13:48.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.298+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14441682735585200257', time=2024-09-12T19:48:04.548033+0000, chain.objs.size()=1 2024-09-12T18:13:48.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.298+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ZVXS78GlefFV-hEEXEnklzBMU1b_chs_0 2024-09-12T18:13:48.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.298+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8046532279406823437', time=2024-09-12T19:48:04.907193+0000, chain.objs.size()=1 2024-09-12T18:13:48.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.298+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.9X8lWy666fC6ZIcFkLaeOLHQyRKgXpx_0 2024-09-12T18:13:48.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.299+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14663878534339442033', time=2024-09-12T19:48:05.474517+0000, chain.objs.size()=1 2024-09-12T18:13:48.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.299+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.xO14VxNsaQ4TWDRO2DDwFHth_D8RqN-_0 2024-09-12T18:13:48.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.300+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18144026753320193485', time=2024-09-12T19:48:05.607552+0000, chain.objs.size()=1 2024-09-12T18:13:48.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.300+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.aKYF2vtLya1yhAMX5cJOo21nWmNA8xR_0 2024-09-12T18:13:48.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.300+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16354687394284645862', time=2024-09-12T19:48:06.186417+0000, chain.objs.size()=1 2024-09-12T18:13:48.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.300+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.j5Uc2dcvSuxjv2ZySfRpP77ymfLyS6z_0 2024-09-12T18:13:48.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.300+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11901906103534247461', time=2024-09-12T19:48:07.099954+0000, chain.objs.size()=1 2024-09-12T18:13:48.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.300+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.IZhjqK2qrfSa7-9vdPd6HaTCqIONOX1_0 2024-09-12T18:13:48.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.300+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14016473252079240925', time=2024-09-12T19:48:08.141904+0000, chain.objs.size()=1 2024-09-12T18:13:48.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.300+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.OO6apdU5N8P4V53P3sBPy9YTC_cqE6d_0 2024-09-12T18:13:48.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.300+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1254655641115068855', time=2024-09-12T19:48:09.303460+0000, chain.objs.size()=1 2024-09-12T18:13:48.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.300+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.xlyleZtX7suIIg7ennu641bC7z7xWpS_0 2024-09-12T18:13:48.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.300+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13613385192215966796', time=2024-09-12T19:48:09.304303+0000, chain.objs.size()=1 2024-09-12T18:13:48.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.300+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.R7k91gKyhKvueu8yxOweeeTx-7gfWvF_0 2024-09-12T18:13:48.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.301+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13364897191076457899', time=2024-09-12T19:48:09.622856+0000, chain.objs.size()=1 2024-09-12T18:13:48.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.301+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.duetj4uGGfoq3mufejFP40yxzb7jd0a_0 2024-09-12T18:13:48.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.301+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1793162558387276519', time=2024-09-12T19:48:09.967298+0000, chain.objs.size()=1 2024-09-12T18:13:48.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.301+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.6d7XnkVeXGEMs9evbwNyT5Ah9D5PZf-_0 2024-09-12T18:13:48.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.301+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13708608003733375668', time=2024-09-12T19:48:47.687910+0000, chain.objs.size()=1 2024-09-12T18:13:48.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.301+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.3HNRzmNHitpmjESizXFZJBfr7UzbuP1_0 2024-09-12T18:13:48.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.301+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8548356427168792055', time=2024-09-12T19:48:48.186610+0000, chain.objs.size()=1 2024-09-12T18:13:48.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.301+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.GGmFce42uXkb_Pdce9QlLMc_Ws82B6S_0 2024-09-12T18:13:48.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.301+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15697201493639887931', time=2024-09-12T19:48:48.447039+0000, chain.objs.size()=1 2024-09-12T18:13:48.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.301+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.pg4PSANjHt0j3nF4eVINbHMDsjHx3o0_0 2024-09-12T18:13:48.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.303+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14695745010093398733', time=2024-09-12T19:48:49.501085+0000, chain.objs.size()=1 2024-09-12T18:13:48.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.303+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.cIj0qo0_ZckqjOOQP1GSU1dRldH-hTU_0 2024-09-12T18:13:48.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.303+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2352385091818057038', time=2024-09-12T19:48:49.946191+0000, chain.objs.size()=1 2024-09-12T18:13:48.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.303+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.EM34PS-SMhtk7aUpiCsYDpUh6yfsHGD_0 2024-09-12T18:13:48.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.303+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13158898830737442510', time=2024-09-12T19:48:50.809670+0000, chain.objs.size()=1 2024-09-12T18:13:48.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.303+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.pCR_O6xUNc-PQ8olzbF_YRushs6nMVr_0 2024-09-12T18:13:48.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.303+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12368691520085409708', time=2024-09-12T19:48:52.053698+0000, chain.objs.size()=1 2024-09-12T18:13:48.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.303+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.dWRFTPeBiajkk8ohvxCuTenypUp1yKN_0 2024-09-12T18:13:48.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.303+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2796782831177819364', time=2024-09-12T19:48:52.177843+0000, chain.objs.size()=1 2024-09-12T18:13:48.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.303+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.gzTlhn1TAgzfmvqpRlcLws6QM9OiVLe_0 2024-09-12T18:13:48.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.303+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4893678417539029644', time=2024-09-12T19:48:52.551006+0000, chain.objs.size()=1 2024-09-12T18:13:48.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.303+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.58JSTApw7yivYmwtFJngmQF2JTp1T1K_0 2024-09-12T18:13:48.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.303+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17754341452092476598', time=2024-09-12T19:48:52.689630+0000, chain.objs.size()=1 2024-09-12T18:13:48.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.303+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.QU0Qq9m1iSujwFsTuXRF5AjKBMOmt0J_0 2024-09-12T18:13:48.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.303+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1492995094135691633', time=2024-09-12T19:48:53.447069+0000, chain.objs.size()=1 2024-09-12T18:13:48.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.303+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.H60BJ_urYU48RzuLvqob-bOp9PjCj8n_0 2024-09-12T18:13:48.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.303+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13279587520825760933', time=2024-09-12T19:48:53.608529+0000, chain.objs.size()=1 2024-09-12T18:13:48.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.303+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ipDgHWqTzY0fRGTMLem7CYGGd_-BsQJ_0 2024-09-12T18:13:48.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.303+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11445824421951617676', time=2024-09-12T19:48:54.116827+0000, chain.objs.size()=1 2024-09-12T18:13:48.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.303+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.jwPwCmiO8nTGCggq4lKYbKkCDR1nnrS_0 2024-09-12T18:13:48.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.303+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13641025818725741653', time=2024-09-12T19:48:54.148976+0000, chain.objs.size()=1 2024-09-12T18:13:48.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.303+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.xzjcZtHY-llF_69KkaDvO5hCkiNeK5m_0 2024-09-12T18:13:48.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.303+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11874995530541005831', time=2024-09-12T19:48:54.987768+0000, chain.objs.size()=1 2024-09-12T18:13:48.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.303+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.y0siGcRd-aWixUPdzCvOkz1ABDODk9O_0 2024-09-12T18:13:48.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.305+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11901318371315235903', time=2024-09-12T19:48:55.520117+0000, chain.objs.size()=1 2024-09-12T18:13:48.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.305+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.vRYfO-LO73553zd7aXIVoI22ihrPMCk_0 2024-09-12T18:13:48.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.305+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16061239035893328885', time=2024-09-12T19:48:56.428885+0000, chain.objs.size()=1 2024-09-12T18:13:48.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.305+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.vcaGouW5baV30Ta6gqe4Cj3hE9UCPJ__0 2024-09-12T18:13:48.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.305+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14068903305254698986', time=2024-09-12T19:48:56.804209+0000, chain.objs.size()=1 2024-09-12T18:13:48.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.305+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.HSS2kTzrbCbPLqNFt-suZl0Wzv4vjgI_0 2024-09-12T18:13:48.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.305+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10285217517348727668', time=2024-09-12T19:48:56.805020+0000, chain.objs.size()=1 2024-09-12T18:13:48.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.305+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.tjliONk4qdSBQXnWFyctklzYhPeZL6b_0 2024-09-12T18:13:48.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.305+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5152132289671373409', time=2024-09-12T19:48:57.516723+0000, chain.objs.size()=1 2024-09-12T18:13:48.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.305+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.rzWsPKcXSlpWjOPOMDbhRAemW9gMwTV_0 2024-09-12T18:13:48.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.305+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14989903035779465414', time=2024-09-12T19:48:57.586109+0000, chain.objs.size()=1 2024-09-12T18:13:48.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.305+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.3mOdM4x6SxBKpJ2RawlfkcDrNcfSHlD_0 2024-09-12T18:13:48.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.305+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.44482849788581265', time=2024-09-12T19:48:57.618153+0000, chain.objs.size()=1 2024-09-12T18:13:48.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.305+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.l7tVxbM10cCL5fUQGInk3_CPgM_dgrz_0 2024-09-12T18:13:48.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.305+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4022530189150609344', time=2024-09-12T19:48:57.745043+0000, chain.objs.size()=1 2024-09-12T18:13:48.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.305+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Ed0lcago--T8lSCdq5W4aLXi-ZaB7o5_0 2024-09-12T18:13:48.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.305+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7953336671809656506', time=2024-09-12T19:48:57.862423+0000, chain.objs.size()=1 2024-09-12T18:13:48.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.305+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.dz8wbOrYoeVBVOM__1WeC-usBDy84ME_0 2024-09-12T18:13:48.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.305+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11730648936070774840', time=2024-09-12T19:50:48.918784+0000, chain.objs.size()=1 2024-09-12T18:13:48.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.305+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.451__shadow_.34B1ulVQmAyOS9wz52u_w4PPqe7NZ_S_0 2024-09-12T18:13:48.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.306+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11236151157904688918', time=2024-09-12T19:50:55.128029+0000, chain.objs.size()=1 2024-09-12T18:13:48.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.306+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.457__shadow_.jSrSBgipEAnATebfm3vBkQ6ZbTAVbHJ_0 2024-09-12T18:13:48.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.309+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14435958841564932456', time=2024-09-12T19:51:32.582142+0000, chain.objs.size()=1 2024-09-12T18:13:48.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.309+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.496__shadow_.STdmWA-iiuEQP-Xwf9fynizpduUnKkP_0 2024-09-12T18:13:48.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.309+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6069689368662235224', time=2024-09-12T19:51:35.147899+0000, chain.objs.size()=1 2024-09-12T18:13:48.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.309+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.498__shadow_.gEW-hUnPNiAzlPo7t7akSlihTVqlwpY_0 2024-09-12T18:13:48.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.309+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10594475954466043445', time=2024-09-12T19:51:40.373566+0000, chain.objs.size()=1 2024-09-12T18:13:48.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.309+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.504__shadow:-V-p6OxZtM7hRMUzkyItZ02ZaGvL5CT_.X0PQumandVzjwgbUSUv4JkorH1YhtZM_0 2024-09-12T18:13:48.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.310+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11841233217764518106', time=2024-09-12T19:52:16.095674+0000, chain.objs.size()=1 2024-09-12T18:13:48.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.310+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.513__shadow_.w2elt-6GFuGGQEm0WL4_KVxREMpQbUH_0 2024-09-12T18:13:48.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.310+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5140573787244983392', time=2024-09-12T19:57:37.651103+0000, chain.objs.size()=1 2024-09-12T18:13:48.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.310+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.559__shadow_.C-nRCGmjKnV1mj_7GC2T9iCkO7l11CN_0 2024-09-12T18:13:48.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.310+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2160559577334576943', time=2024-09-12T19:58:03.832680+0000, chain.objs.size()=1 2024-09-12T18:13:48.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.310+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:Yoc.v7qidkhhLPEUrYZY8.KmJLeQKy0_.8oipVaFAIOU4uteVEUNGc4rVGMm_Eik_0 2024-09-12T18:13:48.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.310+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16710153355984451664', time=2024-09-12T19:58:04.264672+0000, chain.objs.size()=1 2024-09-12T18:13:48.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.310+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:R0JHGi4d3brWie6aN1CetN48OSTQVDG_.OqhQDUfDHq6T84CjFJR2_tqovvA8brF_0 2024-09-12T18:13:48.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.310+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4308966720189910888', time=2024-09-12T19:58:05.389778+0000, chain.objs.size()=1 2024-09-12T18:13:48.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.310+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:6h-y8t-qBw6pEu4-O50B.C6YeiB4oiI_.fk0KuWTFCVw1wi7mOoVPkFiFo3wPuA3_0 2024-09-12T18:13:48.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.310+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6060160776006657928', time=2024-09-12T19:58:17.044789+0000, chain.objs.size()=1 2024-09-12T18:13:48.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.310+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.575__shadow:nwbK5pTyN5YEQ6kZgD-rdtAWAaGKUlP_.TrV6v9DAJSa-knvArf6h1YK6CEfs0Nz_0 2024-09-12T18:13:48.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.312+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/50190 2024-09-12T18:13:48.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.314+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:13:48.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.314+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16056781321025219826', time=2024-09-12T19:59:32.607503+0000, chain.objs.size()=1 2024-09-12T18:13:48.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.314+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.581__shadow:PxtTY6zDjyBHKb9UO7QqAfd0p1ZH1zl_.3hOil_IKSSU_ejz9wFrHDZtfEplNEsw_0 2024-09-12T18:13:48.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.314+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18295807902016644759', time=2024-09-12T19:59:55.537049+0000, chain.objs.size()=1 2024-09-12T18:13:48.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.314+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.606__shadow_.GOr40rBzQojwTuxoNVSA-_xhy7MVCpX_0 2024-09-12T18:13:48.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.314+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12484722472818425746', time=2024-09-12T20:04:58.776185+0000, chain.objs.size()=1 2024-09-12T18:13:48.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.315+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.635__shadow_.sVZW7Vdx1aRw92hDEWqNal6v48q6Gx__0 2024-09-12T18:13:48.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.315+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1356732455881201284', time=2024-09-12T20:06:05.828767+0000, chain.objs.size()=1 2024-09-12T18:13:48.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.315+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.667__shadow_.UKAAQkU94aE4tFs0qTqscCTZAwkYK7Q_0 2024-09-12T18:13:48.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.316+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:48.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.318+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:13:48.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.320+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:48.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.320+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:48.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.321+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43451' 2024-09-12T18:13:48.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.321+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7628773870848052511', time=2024-09-12T19:45:06.441211+0000, chain.objs.size()=1 2024-09-12T18:13:48.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.321+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.237__shadow_._R5-ktXJTD1JosONh7tuMnBuGBUCAsI_0 2024-09-12T18:13:48.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.321+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9254432476231305683', time=2024-09-12T19:45:26.382961+0000, chain.objs.size()=1 2024-09-12T18:13:48.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.321+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.256__shadow_.jlbmQBYwji9IC_FfxLY-xaFR2iYVSI0_0 2024-09-12T18:13:48.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.321+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12616403607836194757', time=2024-09-12T19:46:08.808929+0000, chain.objs.size()=1 2024-09-12T18:13:48.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.321+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Is6eNCizbQlnSAQGJ_QPbuxokfkRquy_0 2024-09-12T18:13:48.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.321+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13532181087561561884', time=2024-09-12T19:46:09.390085+0000, chain.objs.size()=1 2024-09-12T18:13:48.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.321+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.d07ebHmdTNx5evXw3wxUeU_DnBU1wqX_0 2024-09-12T18:13:48.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.321+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4154423379115063', time=2024-09-12T19:46:09.396249+0000, chain.objs.size()=1 2024-09-12T18:13:48.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.321+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ZEWvo6E9vyW6J0MuKs5WmRQbpbV2D6c_0 2024-09-12T18:13:48.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.321+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13699805367163484081', time=2024-09-12T19:46:09.525417+0000, chain.objs.size()=1 2024-09-12T18:13:48.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.321+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.esN06eFWnWIiEn0gwMSY7lMgE7xPace_0 2024-09-12T18:13:48.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.321+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9602527481930789991', time=2024-09-12T19:46:09.864033+0000, chain.objs.size()=1 2024-09-12T18:13:48.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.321+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.DX870P9qUl106u7UDm-vUn_-xR5wR-m_0 2024-09-12T18:13:48.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.321+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16961597138092629667', time=2024-09-12T19:46:10.534576+0000, chain.objs.size()=1 2024-09-12T18:13:48.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.321+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.XlF27CSVvTlGTyqx16MACc-XMCRHXwl_0 2024-09-12T18:13:48.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.321+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17293202329632696191', time=2024-09-12T19:46:10.535460+0000, chain.objs.size()=1 2024-09-12T18:13:48.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.321+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.XumAiIR704pHiyTD6sYNMMba21Cs6mM_0 2024-09-12T18:13:48.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.321+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8801518802349612728', time=2024-09-12T19:46:10.894446+0000, chain.objs.size()=1 2024-09-12T18:13:48.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.321+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.tkVzkPJ7zczAum29Aaztl_CmoufujT__0 2024-09-12T18:13:48.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.321+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13365184580324597430', time=2024-09-12T19:46:11.224205+0000, chain.objs.size()=1 2024-09-12T18:13:48.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.321+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.H1Y3__oq5cizMztyubooxxWADW5RvlF_0 2024-09-12T18:13:48.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.321+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16794796485044496072', time=2024-09-12T19:46:11.297679+0000, chain.objs.size()=1 2024-09-12T18:13:48.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.321+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.f4v8EABJHsV7UmgJmwJkhikPS5zXTWK_0 2024-09-12T18:13:48.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.324+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3126498842946775969', time=2024-09-12T19:46:12.019977+0000, chain.objs.size()=1 2024-09-12T18:13:48.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.324+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.EgXKePDClfES0NVZG5xYkGF0hj74RZo_0 2024-09-12T18:13:48.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.324+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10363307507973547431', time=2024-09-12T19:46:12.371121+0000, chain.objs.size()=1 2024-09-12T18:13:48.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.324+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.jwcg5Q-Ie_x0wSuXCrUFd2QZSyFnxpl_0 2024-09-12T18:13:48.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.324+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14631579468241699854', time=2024-09-12T19:46:12.574889+0000, chain.objs.size()=1 2024-09-12T18:13:48.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.324+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.SbmOnGjX-gjjAfFdmZpTBBFXwTxjApY_0 2024-09-12T18:13:48.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.324+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6611418135766754141', time=2024-09-12T19:46:13.476308+0000, chain.objs.size()=1 2024-09-12T18:13:48.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.324+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.S5ZsswrEin7k8qkwJ-dlVwDGMDfxoQz_0 2024-09-12T18:13:48.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.324+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2140544428578796334', time=2024-09-12T19:46:13.614997+0000, chain.objs.size()=1 2024-09-12T18:13:48.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.324+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.iyZS4wVDmh1aWWEU8wlMwQBoEqSHV2m_0 2024-09-12T18:13:48.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.324+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10332772634973066924', time=2024-09-12T19:46:14.175331+0000, chain.objs.size()=1 2024-09-12T18:13:48.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.324+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.pkUz3cqmEH39CHPCoJ0jWCm9NFWbhds_0 2024-09-12T18:13:48.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.324+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14930726315722942448', time=2024-09-12T19:46:14.175910+0000, chain.objs.size()=1 2024-09-12T18:13:48.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.324+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.BF0egmWdXjf037vkdTRc9x_ctKTO2q3_0 2024-09-12T18:13:48.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.324+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16055906304785590934', time=2024-09-12T19:46:14.735659+0000, chain.objs.size()=1 2024-09-12T18:13:48.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.324+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.6MTn6YnvrNYfxwEYx7oYeKv1jbhz5iH_0 2024-09-12T18:13:48.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.324+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12422571460339312008', time=2024-09-12T19:46:15.065955+0000, chain.objs.size()=1 2024-09-12T18:13:48.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.324+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.0Snqd4IVuNHqTnB65rG6tmb02gISHj7_0 2024-09-12T18:13:48.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.324+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15255130253191018509', time=2024-09-12T19:46:15.236357+0000, chain.objs.size()=1 2024-09-12T18:13:48.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.324+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.R17fiYo5RpcrgBElFA4d5GYPsbdBH9l_0 2024-09-12T18:13:48.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.324+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10234474248469185635', time=2024-09-12T19:46:15.548191+0000, chain.objs.size()=1 2024-09-12T18:13:48.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.324+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.TyYV-g93Dj5ywTzVhVY4BgBBByASWIZ_0 2024-09-12T18:13:48.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.325+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8426658517095035411', time=2024-09-12T19:46:16.090835+0000, chain.objs.size()=1 2024-09-12T18:13:48.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.325+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.1JQgdvPK8BkXxyx0PC-xUyn2wmF82ap_0 2024-09-12T18:13:48.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.325+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2119999727686276843', time=2024-09-12T19:46:16.530275+0000, chain.objs.size()=1 2024-09-12T18:13:48.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.325+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.mcVmZscTMP-pje7tni_UMpw2RvIASim_0 2024-09-12T18:13:48.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.326+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9839052174660984306', time=2024-09-12T19:46:16.951324+0000, chain.objs.size()=1 2024-09-12T18:13:48.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.326+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.kolJzxa15-jF4uKPCYd4il3CUV9GUQN_0 2024-09-12T18:13:48.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.326+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16279877431426926381', time=2024-09-12T19:46:17.460802+0000, chain.objs.size()=1 2024-09-12T18:13:48.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.326+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.a-1ml0KHXs2lcJT8Og8WKGSTmZT-mKZ_0 2024-09-12T18:13:48.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.326+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12894198846162155863', time=2024-09-12T19:46:18.264342+0000, chain.objs.size()=1 2024-09-12T18:13:48.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.326+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.cSABnveZNFhq2p1XSpuM6pugZqFAnht_0 2024-09-12T18:13:48.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.326+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11451299126461803910', time=2024-09-12T19:46:18.802261+0000, chain.objs.size()=1 2024-09-12T18:13:48.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.326+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.u-zj4Ylvkp80WK3CdbWe6mZIzeYZa5i_0 2024-09-12T18:13:48.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.326+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2334702109226864800', time=2024-09-12T19:46:27.472005+0000, chain.objs.size()=1 2024-09-12T18:13:48.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.326+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.272__shadow_._4HDSZG-Gg6-SYvX6vuHzCK0nOvFN0b_0 2024-09-12T18:13:48.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.326+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10295680901919043111', time=2024-09-12T19:46:48.156135+0000, chain.objs.size()=1 2024-09-12T18:13:48.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.326+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.293__shadow_.fyd5xRmmMRx8oYCdJWL9Oi2l7Omh7qh_0 2024-09-12T18:13:48.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.326+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15816613496856314277', time=2024-09-12T19:46:58.810828+0000, chain.objs.size()=1 2024-09-12T18:13:48.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.326+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.303__shadow_.o0K89fxKk0nXmZwf-Huuzz1wv18t5p8_0 2024-09-12T18:13:48.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.326+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9010313141706088134', time=2024-09-12T19:47:00.631389+0000, chain.objs.size()=1 2024-09-12T18:13:48.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.326+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.305__shadow_.hxV-mct55NatsHnhHAYnbcE-jRyfdcK_0 2024-09-12T18:13:48.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.326+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6282468085869438988', time=2024-09-12T19:47:59.961288+0000, chain.objs.size()=1 2024-09-12T18:13:48.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.326+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.EbRL7tr4FgOKSogKKT2eKGXi7UWSdx0_0 2024-09-12T18:13:48.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.327+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9981633184453676887', time=2024-09-12T19:47:59.974138+0000, chain.objs.size()=1 2024-09-12T18:13:48.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.327+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.-N4s6ulvI7Dog8JHrVptvigAPuBu8r1_0 2024-09-12T18:13:48.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.327+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16419907642328894761', time=2024-09-12T19:47:59.990305+0000, chain.objs.size()=1 2024-09-12T18:13:48.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.327+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.K_2zYCJLtiMkJOOi7nD1M8KZK_kd1Xd_0 2024-09-12T18:13:48.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.328+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12388097092247570843', time=2024-09-12T19:48:00.157280+0000, chain.objs.size()=1 2024-09-12T18:13:48.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.328+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.pvH3_3b2fV-k87yYLcdkS1AFz5Czt6f_0 2024-09-12T18:13:48.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.328+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14517003700470745606', time=2024-09-12T19:48:01.288236+0000, chain.objs.size()=1 2024-09-12T18:13:48.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.328+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ReS98MAI0yDciHbFgwz3_cEOrGBdygH_0 2024-09-12T18:13:48.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.328+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16269191754789720002', time=2024-09-12T19:48:01.411984+0000, chain.objs.size()=1 2024-09-12T18:13:48.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.328+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.c-dC9guGOSiG-STtzv3NnrZU5YsT6K8_0 2024-09-12T18:13:48.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.329+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10013219851636093146', time=2024-09-12T19:48:01.672935+0000, chain.objs.size()=1 2024-09-12T18:13:48.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.329+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.iMAcJZ-5JKKyO3tNViaSnDD4Lex1zWO_0 2024-09-12T18:13:48.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.329+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12308446360570939787', time=2024-09-12T19:48:01.820928+0000, chain.objs.size()=1 2024-09-12T18:13:48.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.329+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.XFW2GkTBFVFikuFXq1m0Gxn9n_DYvfh_0 2024-09-12T18:13:48.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.329+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.467053347297713951', time=2024-09-12T19:48:02.609282+0000, chain.objs.size()=1 2024-09-12T18:13:48.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.329+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.B1n3br9MBSxDf2y7iolKNTA-L18dwB__0 2024-09-12T18:13:48.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.329+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15773713550324252877', time=2024-09-12T19:48:04.171632+0000, chain.objs.size()=1 2024-09-12T18:13:48.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.329+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.vU3eLQy0A34kYFhEtV2rUZRet-aYuLG_0 2024-09-12T18:13:48.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.329+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6929477706203661211', time=2024-09-12T19:48:04.586451+0000, chain.objs.size()=1 2024-09-12T18:13:48.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.329+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.RqeGpS1jaiWieC0yOvcoMbFYHmrVEhY_0 2024-09-12T18:13:48.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.329+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11707929736349425785', time=2024-09-12T19:48:04.658582+0000, chain.objs.size()=1 2024-09-12T18:13:48.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.329+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.15Ab5iOeM_XM7SH9cwPP_nXN1BuSfzQ_0 2024-09-12T18:13:48.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.329+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13215405022310485166', time=2024-09-12T19:48:04.675830+0000, chain.objs.size()=1 2024-09-12T18:13:48.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.329+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.PY2k_Gn3fxnt9dOo4GSczL1-n0vph00_0 2024-09-12T18:13:48.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.329+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7092621191750105958', time=2024-09-12T19:48:04.676396+0000, chain.objs.size()=1 2024-09-12T18:13:48.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.329+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.b3nRZ1z2x0tZOYprhmtNZh2FwAHfxsg_0 2024-09-12T18:13:48.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.330+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3405983816234258719', time=2024-09-12T19:48:05.306014+0000, chain.objs.size()=1 2024-09-12T18:13:48.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.330+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ChyGnNpiFmLrp6vcT6T_5E-sKNGNyak_0 2024-09-12T18:13:48.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.330+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7671769894402897484', time=2024-09-12T19:48:06.702558+0000, chain.objs.size()=1 2024-09-12T18:13:48.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.330+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.b__BfeQl5jQ1Mz6XbQj2Ps6msJqY2z4_0 2024-09-12T18:13:48.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.330+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10216080793270590624', time=2024-09-12T19:48:07.098067+0000, chain.objs.size()=1 2024-09-12T18:13:48.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.330+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.WR9G_i-xhMIHTZyspYqdecYAHJ3-HVx_0 2024-09-12T18:13:48.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.331+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13054184015677191362', time=2024-09-12T19:48:07.535654+0000, chain.objs.size()=1 2024-09-12T18:13:48.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.331+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.KP6D6GSh3N2nmnBpGmFNtYj007CmC8D_0 2024-09-12T18:13:48.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.331+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17928679440886011509', time=2024-09-12T19:48:07.619489+0000, chain.objs.size()=1 2024-09-12T18:13:48.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.331+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.UiL8M3etgXa3PAbnFNH8mHe0V2peYAD_0 2024-09-12T18:13:48.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.331+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18027872723041215111', time=2024-09-12T19:48:07.995576+0000, chain.objs.size()=1 2024-09-12T18:13:48.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.331+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.0UO8iSl0tJpA8k-iWa95uNSLq4aBzni_0 2024-09-12T18:13:48.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.333+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15341872875331570550', time=2024-09-12T19:48:08.157879+0000, chain.objs.size()=1 2024-09-12T18:13:48.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.333+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.DiygUWuTEi7-jB-DSLqf-3HLVJ5fd1V_0 2024-09-12T18:13:48.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.333+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11992350464548390365', time=2024-09-12T19:48:08.556058+0000, chain.objs.size()=1 2024-09-12T18:13:48.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.333+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.2gS0fyadpcKUDFUHfrBM78KZqA5A06u_0 2024-09-12T18:13:48.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.333+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2129308049072872670', time=2024-09-12T19:48:08.735301+0000, chain.objs.size()=1 2024-09-12T18:13:48.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.333+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.sfDL85sG3bEHOJup97VXmTA4LyjuPAv_0 2024-09-12T18:13:48.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.333+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14746926216592854215', time=2024-09-12T19:48:08.862453+0000, chain.objs.size()=1 2024-09-12T18:13:48.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.333+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.LHXL3gt9NZU0frsV3MhmbIw6M3TQMqp_0 2024-09-12T18:13:48.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.333+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3855804737273355709', time=2024-09-12T19:48:09.403665+0000, chain.objs.size()=1 2024-09-12T18:13:48.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.333+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_._84A23SUDPcC8tP6RpWH3eE1Nn_KvLS_0 2024-09-12T18:13:48.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.336+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17983114368272018023', time=2024-09-12T19:48:09.555210+0000, chain.objs.size()=1 2024-09-12T18:13:48.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.336+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.3xB34tjMICOvAd6sD4xEb9iWcVCPHFC_0 2024-09-12T18:13:48.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.336+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5449037342102073972', time=2024-09-12T19:48:09.835560+0000, chain.objs.size()=1 2024-09-12T18:13:48.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.336+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.zsAgRfHowO3Tad__FMpAi9JNhiOFem3_0 2024-09-12T18:13:48.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.336+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9079162345538558014', time=2024-09-12T19:48:47.461927+0000, chain.objs.size()=1 2024-09-12T18:13:48.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.336+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ZGgmx0ItS-xjAJlsocP807empnzay5e_0 2024-09-12T18:13:48.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.336+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12263114659688265788', time=2024-09-12T19:48:47.669390+0000, chain.objs.size()=1 2024-09-12T18:13:48.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.336+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.cvo-S8_jPCmSGIawJQnmitauj1GQYsM_0 2024-09-12T18:13:48.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.336+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10912188525337219804', time=2024-09-12T19:48:47.670269+0000, chain.objs.size()=1 2024-09-12T18:13:48.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.336+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.L0hh86MN2LCnhqohFCHOVYMglexg5Xg_0 2024-09-12T18:13:48.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.336+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6828605761599254827', time=2024-09-12T19:48:47.828905+0000, chain.objs.size()=1 2024-09-12T18:13:48.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.336+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.-ODxWNuoKKEWUdt5fiY5PDazNwGwQJQ_0 2024-09-12T18:13:48.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.336+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14752858645792111034', time=2024-09-12T19:48:48.090340+0000, chain.objs.size()=1 2024-09-12T18:13:48.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.336+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.43HoK_IP8hF14Q8QB_txAlBBJ-TGBaM_0 2024-09-12T18:13:48.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.336+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9584156493881934266', time=2024-09-12T19:48:48.277887+0000, chain.objs.size()=1 2024-09-12T18:13:48.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.336+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.RZ_sCA8szJxfJIWbNZFlysCQCUY4Hcw_0 2024-09-12T18:13:48.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.336+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8109831154500637882', time=2024-09-12T19:48:48.406680+0000, chain.objs.size()=1 2024-09-12T18:13:48.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.336+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.595xPYnooR7pXpk_08cIWGw-2n2wIaI_0 2024-09-12T18:13:48.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.336+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2500702607901161083', time=2024-09-12T19:48:48.958770+0000, chain.objs.size()=1 2024-09-12T18:13:48.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.336+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.m58dVMnWAyHqNTuXwVkcRev-Wnk1YPq_0 2024-09-12T18:13:48.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.336+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3443867255395320936', time=2024-09-12T19:48:49.076341+0000, chain.objs.size()=1 2024-09-12T18:13:48.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.336+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.QKp8ugHG5K1BPKJO3NG6dJ12nPKzDGF_0 2024-09-12T18:13:48.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.339+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11444056966801184703', time=2024-09-12T19:48:49.175000+0000, chain.objs.size()=1 2024-09-12T18:13:48.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.339+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.s4vxowCqxqG1_H6bSMVCRXEcfWLUTQn_0 2024-09-12T18:13:48.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.339+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1527057618885523752', time=2024-09-12T19:48:49.258685+0000, chain.objs.size()=1 2024-09-12T18:13:48.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.339+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.MA2b3h2yuNbLGy_op0X32qc2WEKpIzd_0 2024-09-12T18:13:48.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.339+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17905548146565217213', time=2024-09-12T19:48:49.921131+0000, chain.objs.size()=1 2024-09-12T18:13:48.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.339+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ifUvG3BhlU0TygM_jR233HxvIKWRefF_0 2024-09-12T18:13:48.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.339+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2438109012758654057', time=2024-09-12T19:48:50.843655+0000, chain.objs.size()=1 2024-09-12T18:13:48.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.339+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.nyCsdeC_N-6uYg1lhRCe9TzxYR6YtKE_0 2024-09-12T18:13:48.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.339+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4122837491460874826', time=2024-09-12T19:48:51.922611+0000, chain.objs.size()=1 2024-09-12T18:13:48.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.339+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.DLoov0_SpApJEITTZCa7fp3vf4ifq0R_0 2024-09-12T18:13:48.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.339+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12111033438605982759', time=2024-09-12T19:48:52.414240+0000, chain.objs.size()=1 2024-09-12T18:13:48.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.339+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Gt609dsehDKw_nLvd7qa4CCUg1cLE4i_0 2024-09-12T18:13:48.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.339+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6395475111001877259', time=2024-09-12T19:48:52.414998+0000, chain.objs.size()=1 2024-09-12T18:13:48.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.339+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.w841Ar53aFBTpmBMfAdzfYxw0MbWNEh_0 2024-09-12T18:13:48.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.339+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6045114694189386085', time=2024-09-12T19:48:52.749778+0000, chain.objs.size()=1 2024-09-12T18:13:48.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.339+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.FoDKkP5t9IhdYG2HVkBio-YcdE_ghjB_0 2024-09-12T18:13:48.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.339+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14769156207120974446', time=2024-09-12T19:48:52.750578+0000, chain.objs.size()=1 2024-09-12T18:13:48.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.339+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.3T_qx8o_fKR5glLv9zAnVbFEyBOoKJo_0 2024-09-12T18:13:48.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.340+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14125946687623591845', time=2024-09-12T19:48:52.800084+0000, chain.objs.size()=1 2024-09-12T18:13:48.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.340+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.HhkcMqzEyWyynViR5ZoVowK1iPy2KxH_0 2024-09-12T18:13:48.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.340+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1208944146187246382', time=2024-09-12T19:48:52.853998+0000, chain.objs.size()=1 2024-09-12T18:13:48.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.340+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.liDdxoxHTc-qdJsm9aj-IzB_8-nK7FW_0 2024-09-12T18:13:48.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.342+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3364623709132116369', time=2024-09-12T19:48:53.826370+0000, chain.objs.size()=1 2024-09-12T18:13:48.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.342+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.4eG_-zFOoPsncCx6R0WEv8EyoI7DzPV_0 2024-09-12T18:13:48.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.342+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17973534272113076428', time=2024-09-12T19:48:53.898223+0000, chain.objs.size()=1 2024-09-12T18:13:48.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.342+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.7qkKzfS8mcqngXOEh7d82dCp-ZDs4wm_0 2024-09-12T18:13:48.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.342+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11606367638786902914', time=2024-09-12T19:48:55.100327+0000, chain.objs.size()=1 2024-09-12T18:13:48.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.342+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.r2duuGlqSB-HcanpTTUOXoOOWYd9z2-_0 2024-09-12T18:13:48.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.342+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2287929435540143771', time=2024-09-12T19:48:55.619227+0000, chain.objs.size()=1 2024-09-12T18:13:48.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.342+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.M7pCBE5i6j9j6WS4MsWfLH6fw0dNd7v_0 2024-09-12T18:13:48.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.342+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.187935749060226364', time=2024-09-12T19:48:56.181192+0000, chain.objs.size()=1 2024-09-12T18:13:48.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.342+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.kCEF08FboB8XyZuqy6urT7LbL83OUYk_0 2024-09-12T18:13:48.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.342+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1928023366328459863', time=2024-09-12T19:48:56.241572+0000, chain.objs.size()=1 2024-09-12T18:13:48.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.342+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.kCThy1WyCar3aRa0l6cmKOM4CqWD9AK_0 2024-09-12T18:13:48.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.342+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14584203203045121862', time=2024-09-12T19:48:56.242475+0000, chain.objs.size()=1 2024-09-12T18:13:48.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.342+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.jdI-rBqfa3w9_NoNRNoV1uKEXayQukl_0 2024-09-12T18:13:48.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.342+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12994208406124581095', time=2024-09-12T19:48:56.526884+0000, chain.objs.size()=1 2024-09-12T18:13:48.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.342+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_._i6HVNZHSFbanQwppwcx8iK9nzkGa0w_0 2024-09-12T18:13:48.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.342+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2613761443629545238', time=2024-09-12T19:48:56.660810+0000, chain.objs.size()=1 2024-09-12T18:13:48.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.342+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.eV8LsBYcDwN3lLvLnLUPHjgp3ekKzBK_0 2024-09-12T18:13:48.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.342+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9441557659835498591', time=2024-09-12T19:48:56.910155+0000, chain.objs.size()=1 2024-09-12T18:13:48.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.342+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.n2t33B_OyLgkXRmW_iLQtST9wGLxcfm_0 2024-09-12T18:13:48.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.342+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6539712846526645227', time=2024-09-12T19:48:56.924340+0000, chain.objs.size()=1 2024-09-12T18:13:48.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.342+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.2RAwWwg7cwhqn9dGshhH3IBxtkNo8Y4_0 2024-09-12T18:13:48.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.344+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3952380727481292065', time=2024-09-12T19:48:57.863535+0000, chain.objs.size()=1 2024-09-12T18:13:48.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.344+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.mMzABoR3Aq4DBP-LTDgDGIn4Kh_XwB9_0 2024-09-12T18:13:48.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.345+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7482952720961690476', time=2024-09-12T19:48:57.898267+0000, chain.objs.size()=1 2024-09-12T18:13:48.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.345+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.EJNvw-AuOlQmf1VQBJbe-RbPxKivW0d_0 2024-09-12T18:13:48.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.345+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12835984234226116398', time=2024-09-12T19:49:45.451956+0000, chain.objs.size()=1 2024-09-12T18:13:48.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.345+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.382__shadow_.tUZf3oGLBG7yJrAwV2KkuM4RucVguU3_0 2024-09-12T18:13:48.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.345+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4165590720761987266', time=2024-09-12T19:49:53.912122+0000, chain.objs.size()=1 2024-09-12T18:13:48.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.345+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.391__shadow_.gyb4ykRWtfLUeGYeErFrAndtFFOB_Ud_0 2024-09-12T18:13:48.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.345+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11878097090282942742', time=2024-09-12T19:50:32.508194+0000, chain.objs.size()=1 2024-09-12T18:13:48.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.345+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.435__shadow_.NlVo-oRbmJ_NyxrRAxyf-w4b5ONavXN_0 2024-09-12T18:13:48.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.345+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7318090354577542357', time=2024-09-12T19:55:35.780207+0000, chain.objs.size()=2 2024-09-12T18:13:48.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.345+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.526__multipart_mymultipart.2~lvYOEMqrtT-TK8uwhfnFo5FoKgduKgi.1 2024-09-12T18:13:48.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.345+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.526__multipart_mymultipart.2~lvYOEMqrtT-TK8uwhfnFo5FoKgduKgi.2 2024-09-12T18:13:48.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.345+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12832859835816861832', time=2024-09-12T19:57:13.071319+0000, chain.objs.size()=1 2024-09-12T18:13:48.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.345+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.554__shadow_.2B1p7L_NAoxGMgA1hklnDc0IzqpCpHL_0 2024-09-12T18:13:48.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.345+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4326632441172461912', time=2024-09-12T19:58:44.294766+0000, chain.objs.size()=1 2024-09-12T18:13:48.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.345+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:75yVZPuWD7-UQ2adnzNRJ16smFCXsHU_.bBsDIo77qe58nYdusHreDoi8pK9HL9m_0 2024-09-12T18:13:48.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.346+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17119473013335090041', time=2024-09-12T19:59:29.941710+0000, chain.objs.size()=1 2024-09-12T18:13:48.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.346+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.580__shadow:9QKW7MN84ofOco5LJebUxHcYb6KcU3U_.mT0ZjeA9ZdVbR7tDy_mUDA4JzsHArtS_0 2024-09-12T18:13:48.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.348+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/43451 2024-09-12T18:13:48.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.349+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:13:48.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.349+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1294313894910633282', time=2024-09-12T20:06:01.686898+0000, chain.objs.size()=1 2024-09-12T18:13:48.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.349+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.664__shadow_.zVb7Oz6w639Dop6IaZ_tpx9EPCb-3Zn_0 2024-09-12T18:13:48.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.349+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16559269615514852713', time=2024-09-12T20:06:07.204219+0000, chain.objs.size()=1 2024-09-12T18:13:48.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.349+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.669__shadow_.mkNXFXnPVDBQSV7TAAuCi0DvvaPurAA_0 2024-09-12T18:13:48.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.349+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12842782838405653914', time=2024-09-12T20:06:40.099476+0000, chain.objs.size()=1 2024-09-12T18:13:48.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.349+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.711__shadow:fbv7P1dxRiYycF2SYtr86s25x3HB8HB_.8KfeMOEvrvrSeYl-n175_PGR1XTwbd-_0 2024-09-12T18:13:48.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.350+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:48.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.354+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:13:48.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.355+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:48.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.356+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:48.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.357+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54184' 2024-09-12T18:13:48.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.357+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9892353221807739596', time=2024-09-12T19:41:46.605025+0000, chain.objs.size()=3 2024-09-12T18:13:48.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.357+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.161__shadow_.trXHZYTjkuAzERWQwFVJrx1Oe8iL3H7_0 2024-09-12T18:13:48.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.357+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.161__shadow_.trXHZYTjkuAzERWQwFVJrx1Oe8iL3H7_1 2024-09-12T18:13:48.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.357+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.161__shadow_.trXHZYTjkuAzERWQwFVJrx1Oe8iL3H7_2 2024-09-12T18:13:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.357+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14696826596549118954', time=2024-09-12T19:42:17.056758+0000, chain.objs.size()=1 2024-09-12T18:13:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.357+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.163__shadow_.C4vouqz3YevQVUx-Hr0YABIa_OTF4Us_0 2024-09-12T18:13:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.357+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13838510155818280003', time=2024-09-12T19:42:46.267050+0000, chain.objs.size()=1 2024-09-12T18:13:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.357+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.184__shadow_.-t0eutkIwjRGozHUK-j6FiaCj9gs9rX_0 2024-09-12T18:13:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.357+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12298353903016385575', time=2024-09-12T19:43:08.865587+0000, chain.objs.size()=1 2024-09-12T18:13:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.357+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.200__shadow_._al4Hpz8gejx0ytlZ3EXhYHp-dX3Ag__0 2024-09-12T18:13:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.357+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15128738229251769307', time=2024-09-12T19:45:04.605605+0000, chain.objs.size()=1 2024-09-12T18:13:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.357+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.235__shadow_.VvLNC1Afg5VF0dfyHIu-CGu_cibL9t2_0 2024-09-12T18:13:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.357+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15369804131667685321', time=2024-09-12T19:45:13.106085+0000, chain.objs.size()=1 2024-09-12T18:13:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.357+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.243__shadow_._NqIQbPJEJj0brSNJxa2UEENgbNWKKm_0 2024-09-12T18:13:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.357+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10559347721878840587', time=2024-09-12T19:45:20.008853+0000, chain.objs.size()=1 2024-09-12T18:13:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.357+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.249__shadow_.Wz9tXPzFsSaMB-dsksmaDZHDwYlTUiw_0 2024-09-12T18:13:48.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.357+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2950213910914912733', time=2024-09-12T19:45:26.393061+0000, chain.objs.size()=1 2024-09-12T18:13:48.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.357+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.256__shadow_.uR6FQoWoeY5OgT2QY2-trEKQxivoT1a_0 2024-09-12T18:13:48.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.357+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11698208023273111105', time=2024-09-12T19:46:08.986920+0000, chain.objs.size()=1 2024-09-12T18:13:48.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.357+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.KvzLvnsoXQFKuhUf08U_fEKr2mhzSVp_0 2024-09-12T18:13:48.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.357+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16794343431168893956', time=2024-09-12T19:46:09.020425+0000, chain.objs.size()=1 2024-09-12T18:13:48.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.357+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ZSqfnu9Kbrlb7CbL-AEh13M9nTcayMz_0 2024-09-12T18:13:48.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.359+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6558224092125104094', time=2024-09-12T19:46:09.302189+0000, chain.objs.size()=1 2024-09-12T18:13:48.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.359+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.uHEuO3XY4HE2vrKiNfqPcUuoPe7b8Ss_0 2024-09-12T18:13:48.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.361+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15410599353808135580', time=2024-09-12T19:46:09.610750+0000, chain.objs.size()=1 2024-09-12T18:13:48.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.361+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.vN3CO5sNAzLtXf74XKPyALu9KvmSWch_0 2024-09-12T18:13:48.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.361+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6051510867521500054', time=2024-09-12T19:46:10.531283+0000, chain.objs.size()=1 2024-09-12T18:13:48.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.361+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.1QDhwnSTDjyBzlM-_haQVifqDzvycH2_0 2024-09-12T18:13:48.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.361+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6227062174743559918', time=2024-09-12T19:46:10.903414+0000, chain.objs.size()=1 2024-09-12T18:13:48.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.361+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.coBJB5cR3NQg4J1Gnp4ichxZ96XkKtB_0 2024-09-12T18:13:48.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.361+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1669122502714309607', time=2024-09-12T19:46:11.354950+0000, chain.objs.size()=1 2024-09-12T18:13:48.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.361+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.YiSPfACflSeWm1VvL8se_ULmLi6qe_-_0 2024-09-12T18:13:48.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.361+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7787543716169156761', time=2024-09-12T19:46:12.527263+0000, chain.objs.size()=1 2024-09-12T18:13:48.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.361+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.UJPMPKHOLIzegk981zoWR4ulLVABRrp_0 2024-09-12T18:13:48.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.361+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8179504264061955254', time=2024-09-12T19:46:12.719503+0000, chain.objs.size()=1 2024-09-12T18:13:48.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.361+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.bHokaMmrimWZZ7IIpkc7uEoth5VT2Ql_0 2024-09-12T18:13:48.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.361+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4646760600010840687', time=2024-09-12T19:46:12.777019+0000, chain.objs.size()=1 2024-09-12T18:13:48.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.361+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.rcSr_yMxt7DCcLK92xxe7DWgfu85WCa_0 2024-09-12T18:13:48.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.361+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3929734611495359506', time=2024-09-12T19:46:12.840580+0000, chain.objs.size()=1 2024-09-12T18:13:48.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.361+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_._vxeWqOtZMMGE5YR8ElV6N3tnCwjupu_0 2024-09-12T18:13:48.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.361+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1540747296466604511', time=2024-09-12T19:46:13.368336+0000, chain.objs.size()=1 2024-09-12T18:13:48.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.361+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.qyOLv97rruoslfh85LCqh9mrhIR0--6_0 2024-09-12T18:13:48.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.361+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4432333766400877612', time=2024-09-12T19:46:13.734455+0000, chain.objs.size()=1 2024-09-12T18:13:48.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.361+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.4Q8LnhS4Dwsh6TZhSDh3WpUJ34yz2Hr_0 2024-09-12T18:13:48.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.361+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8742040811602005233', time=2024-09-12T19:46:13.735584+0000, chain.objs.size()=1 2024-09-12T18:13:48.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.361+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.eIRlL4EmFX6uAOCFeVNABWL56IvIS8X_0 2024-09-12T18:13:48.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.363+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13285076955041554294', time=2024-09-12T19:46:13.800808+0000, chain.objs.size()=1 2024-09-12T18:13:48.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.363+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.0hK4ejgAN2X6BMNgzgqsCk5iGvSZTMd_0 2024-09-12T18:13:48.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.363+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10146054808582319939', time=2024-09-12T19:46:13.950546+0000, chain.objs.size()=1 2024-09-12T18:13:48.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.363+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.oZaWvvNgS2-32iwrdwYIPEKk2HO5E9o_0 2024-09-12T18:13:48.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.364+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5147402293220828480', time=2024-09-12T19:46:14.157367+0000, chain.objs.size()=1 2024-09-12T18:13:48.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.364+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.GB8aRXrnO2wWVyUFfaxWV1KLl-LUAgy_0 2024-09-12T18:13:48.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.364+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5109931341651794403', time=2024-09-12T19:46:14.735924+0000, chain.objs.size()=1 2024-09-12T18:13:48.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.364+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.EZ3mfQAYCqBcy0BuRS0ouTIqCwepnCe_0 2024-09-12T18:13:48.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.364+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1816594045353911132', time=2024-09-12T19:46:14.779050+0000, chain.objs.size()=1 2024-09-12T18:13:48.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.364+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.r1VmMVEyDOMHIkaCT09eAjDXMTA_Jh9_0 2024-09-12T18:13:48.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.364+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15530659934373925139', time=2024-09-12T19:46:15.193206+0000, chain.objs.size()=1 2024-09-12T18:13:48.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.364+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.zEsPg4KaseiEi9tL-3wkHV7QCq5Z_Ur_0 2024-09-12T18:13:48.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.364+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14118596693375208890', time=2024-09-12T19:46:15.750737+0000, chain.objs.size()=1 2024-09-12T18:13:48.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.364+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.K9ZFsuuBuqsbJ35udlb6O4oHP2z4FIo_0 2024-09-12T18:13:48.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.364+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7791952231801870784', time=2024-09-12T19:46:16.149427+0000, chain.objs.size()=1 2024-09-12T18:13:48.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.364+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.S73iHmzslVoVnw6XUqpv1A4iA2EHwQs_0 2024-09-12T18:13:48.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.364+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5237316857283180860', time=2024-09-12T19:46:16.150338+0000, chain.objs.size()=1 2024-09-12T18:13:48.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.364+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.LO12IcPKYC6Ccp4H969Z_k5G2n85TuN_0 2024-09-12T18:13:48.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.364+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7183764214119160135', time=2024-09-12T19:46:16.323522+0000, chain.objs.size()=1 2024-09-12T18:13:48.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.364+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.tV4Ib1uxBJhTDttUo_uotncK3Y57suv_0 2024-09-12T18:13:48.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.364+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10476080107661535316', time=2024-09-12T19:46:16.487012+0000, chain.objs.size()=1 2024-09-12T18:13:48.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.364+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.c_g5WJwg2ZxL5m9xCQJyAxUIL0fu5BW_0 2024-09-12T18:13:48.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.365+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3814862383434352255', time=2024-09-12T19:46:16.527919+0000, chain.objs.size()=1 2024-09-12T18:13:48.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.365+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.yF8Md3_J6PaFrG-Xp3WgddWT6-HthDE_0 2024-09-12T18:13:48.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.366+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3154637504876641480', time=2024-09-12T19:46:16.671225+0000, chain.objs.size()=1 2024-09-12T18:13:48.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.366+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ez68mBcIELuhO25CUdFH6BuQ_zS6xbq_0 2024-09-12T18:13:48.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.366+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2705274997874294100', time=2024-09-12T19:46:16.671883+0000, chain.objs.size()=1 2024-09-12T18:13:48.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.366+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Qqo8Uql-lC3NB-l1E2zdBTXBv7uwMVh_0 2024-09-12T18:13:48.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.366+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3528775703841366200', time=2024-09-12T19:46:17.475175+0000, chain.objs.size()=1 2024-09-12T18:13:48.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.366+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.rr7iQU9-X3UoudgbAR7XHQh19QlgACY_0 2024-09-12T18:13:48.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.366+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17007464081988242998', time=2024-09-12T19:46:17.649221+0000, chain.objs.size()=1 2024-09-12T18:13:48.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.366+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.C9Mp6XV8Yj6FSgRb4qoL9a6DS1vm9av_0 2024-09-12T18:13:48.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.368+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13695480196023350988', time=2024-09-12T19:46:17.928450+0000, chain.objs.size()=1 2024-09-12T18:13:48.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.368+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.oQtS1txGlMtTt3To_V1QQXf561ffenn_0 2024-09-12T18:13:48.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.368+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.629968089685890144', time=2024-09-12T19:46:18.081627+0000, chain.objs.size()=1 2024-09-12T18:13:48.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.368+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.T3JamsYENmKCQt5juHAQH-AK7D1jP-u_0 2024-09-12T18:13:48.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.368+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14791974204748164219', time=2024-09-12T19:46:18.135211+0000, chain.objs.size()=1 2024-09-12T18:13:48.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.368+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.GWjXBJf07G08OT2zQNC-nhA1yH9zi0b_0 2024-09-12T18:13:48.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.368+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10509350357216692180', time=2024-09-12T19:46:18.334554+0000, chain.objs.size()=1 2024-09-12T18:13:48.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.368+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.MKtxcxGkWOr4zh5lxN0OIHfWQaO5uN1_0 2024-09-12T18:13:48.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.368+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.729390832264513602', time=2024-09-12T19:46:18.864343+0000, chain.objs.size()=1 2024-09-12T18:13:48.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.368+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.8ViqmAJeDNYS8C-3uxSA6TqtK7jOymg_0 2024-09-12T18:13:48.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.368+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15689715006410212749', time=2024-09-12T19:46:18.933132+0000, chain.objs.size()=1 2024-09-12T18:13:48.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.368+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.clSq-nFZ_KCMCGFYsVt6BLAs6O0ewua_0 2024-09-12T18:13:48.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.368+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2364300352052219392', time=2024-09-12T19:46:19.608391+0000, chain.objs.size()=1 2024-09-12T18:13:48.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.368+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.EKOBCV4Vas1dXstYiD0Wh5mkPj3pt0n_0 2024-09-12T18:13:48.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.369+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9189003461077985229', time=2024-09-12T19:46:21.359965+0000, chain.objs.size()=1 2024-09-12T18:13:48.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.369+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.265__shadow_.JrgsDmfW22qkKrtXtp-KBPSjS0aRzVt_0 2024-09-12T18:13:48.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.369+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10715323501605388443', time=2024-09-12T19:46:31.927643+0000, chain.objs.size()=1 2024-09-12T18:13:48.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.369+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.277__shadow_.CllgPK8bX27PrawP9bTwIFQVaov0_hs_0 2024-09-12T18:13:48.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.370+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4189320519164065368', time=2024-09-12T19:46:42.997950+0000, chain.objs.size()=1 2024-09-12T18:13:48.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.370+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.289__shadow_.ZR5S1iISgvC4OFQyUyyUqnj6ZpdMff-_0 2024-09-12T18:13:48.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.370+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7545830780456720047', time=2024-09-12T19:46:48.124686+0000, chain.objs.size()=1 2024-09-12T18:13:48.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.371+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.293__shadow_.V2e4T2g69mQfRrrVrcMAwEtQQ2mHmUO_0 2024-09-12T18:13:48.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.371+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4467584217533861606', time=2024-09-12T19:46:53.187265+0000, chain.objs.size()=1 2024-09-12T18:13:48.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.371+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.297__shadow_.vf5h9GHhYy531X4_dDExRUAukYkYoez_0 2024-09-12T18:13:48.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.371+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13027614802913474059', time=2024-09-12T19:48:00.079669+0000, chain.objs.size()=1 2024-09-12T18:13:48.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.371+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.pG8thxb9wjIhafp2KbQYyRokqTUun45_0 2024-09-12T18:13:48.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.371+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14835621575927939969', time=2024-09-12T19:48:00.241893+0000, chain.objs.size()=1 2024-09-12T18:13:48.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.371+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Q66H_gjU-rqcu49hmfMXMsu8xHjgi0H_0 2024-09-12T18:13:48.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.371+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16885127163827141709', time=2024-09-12T19:48:00.282184+0000, chain.objs.size()=1 2024-09-12T18:13:48.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.371+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ptIBF4doqPWlT0D7r67Fj4xneN32aqD_0 2024-09-12T18:13:48.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.371+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10332710917957531351', time=2024-09-12T19:48:00.458854+0000, chain.objs.size()=1 2024-09-12T18:13:48.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.371+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.GRxLdBBXphuLW3iJOlA08F5PGvjvpym_0 2024-09-12T18:13:48.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.371+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6179691267560595355', time=2024-09-12T19:48:00.484378+0000, chain.objs.size()=1 2024-09-12T18:13:48.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.371+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.0oikyKS-jwHsrwhcZENp0Bq8Yz3c0rG_0 2024-09-12T18:13:48.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.371+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16209266882082812313', time=2024-09-12T19:48:01.016707+0000, chain.objs.size()=1 2024-09-12T18:13:48.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.371+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.NtM6tvLezyJd3HMXeqJs4BZ0xFS6xpy_0 2024-09-12T18:13:48.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.371+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15990064761237750540', time=2024-09-12T19:48:01.111339+0000, chain.objs.size()=1 2024-09-12T18:13:48.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.371+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.iLtGtmrN7Euzd5rM8bMl76NOUNFovEW_0 2024-09-12T18:13:48.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.372+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5923509019260068985', time=2024-09-12T19:48:01.271590+0000, chain.objs.size()=1 2024-09-12T18:13:48.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.372+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.4yO1euOIYojh7VK98Isj5MatltsoZXi_0 2024-09-12T18:13:48.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.372+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3272918434636908673', time=2024-09-12T19:48:01.356479+0000, chain.objs.size()=1 2024-09-12T18:13:48.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.372+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.61-B3O4zT0S51FpA_SnwEicTg19d-i6_0 2024-09-12T18:13:48.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.372+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1839432807162980962', time=2024-09-12T19:48:01.523621+0000, chain.objs.size()=1 2024-09-12T18:13:48.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.372+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.JjiB-AlYGF6WYa-fNabCANJ6sLF1IbN_0 2024-09-12T18:13:48.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.373+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14762441546586644247', time=2024-09-12T19:48:01.821573+0000, chain.objs.size()=1 2024-09-12T18:13:48.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.373+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.mKHfOEzKlT-QK-RNbn2YdoSMK_NEJFt_0 2024-09-12T18:13:48.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.373+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1021343465180233861', time=2024-09-12T19:48:02.831377+0000, chain.objs.size()=1 2024-09-12T18:13:48.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.373+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.9qc13RBFSrqhYTeUwP0HYTvhhe8ZOit_0 2024-09-12T18:13:48.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.373+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8487311978723167381', time=2024-09-12T19:48:02.974820+0000, chain.objs.size()=1 2024-09-12T18:13:48.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.373+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.DcxDsRw-z7mNSjTqRCxXmAnMrn5rljO_0 2024-09-12T18:13:48.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.373+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10278820839354007244', time=2024-09-12T19:48:03.458596+0000, chain.objs.size()=1 2024-09-12T18:13:48.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.373+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Lt1VeNsNm_DwJdTDFE2f7OMeqsDRcZZ_0 2024-09-12T18:13:48.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.374+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10561361802423831051', time=2024-09-12T19:48:04.176988+0000, chain.objs.size()=1 2024-09-12T18:13:48.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.374+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.hP_zCVfw9O25UeOFbJ2745CupCWJ52__0 2024-09-12T18:13:48.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.374+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6568720707117429259', time=2024-09-12T19:48:04.312316+0000, chain.objs.size()=1 2024-09-12T18:13:48.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.374+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.9IbwA22IPPksCzporxL5405GQPOKTjn_0 2024-09-12T18:13:48.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.374+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4666831665383416510', time=2024-09-12T19:48:04.312992+0000, chain.objs.size()=1 2024-09-12T18:13:48.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.374+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.e7uzKsPpQ5-GNh6Rsf8EQUrAEs0mUIN_0 2024-09-12T18:13:48.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.374+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2710323932502133583', time=2024-09-12T19:48:04.677511+0000, chain.objs.size()=1 2024-09-12T18:13:48.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.374+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.avxwuCsoR27qQRB3SMKeKdaTvLzkgPe_0 2024-09-12T18:13:48.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.374+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.355843657636994889', time=2024-09-12T19:48:04.750287+0000, chain.objs.size()=1 2024-09-12T18:13:48.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.374+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.JMxydo_rQ53iOk4hCv94sVKdAYITtig_0 2024-09-12T18:13:48.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.375+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9178714829357049467', time=2024-09-12T19:48:05.770782+0000, chain.objs.size()=1 2024-09-12T18:13:48.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.375+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.wkk8yZ17sX2Y_bwhnxu1N8dIbjJOQEs_0 2024-09-12T18:13:48.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.375+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10526325920946109005', time=2024-09-12T19:48:06.075941+0000, chain.objs.size()=1 2024-09-12T18:13:48.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.375+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.dSjVWRpguTEq59gSkHBcErcEeNZ3xMZ_0 2024-09-12T18:13:48.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.376+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8574863583611919017', time=2024-09-12T19:48:06.682218+0000, chain.objs.size()=1 2024-09-12T18:13:48.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.376+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.7dMvnn6a6vhpxJHAL0ntklmfTf1T_Bu_0 2024-09-12T18:13:48.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.376+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3469394528856681304', time=2024-09-12T19:48:06.825712+0000, chain.objs.size()=1 2024-09-12T18:13:48.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.376+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.V1moCKljRL2C903l6iMF2Zs5bUpEvk3_0 2024-09-12T18:13:48.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.376+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11770072749389368904', time=2024-09-12T19:48:06.948098+0000, chain.objs.size()=1 2024-09-12T18:13:48.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.376+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.dB9B2MiWY4FQl_cdoN3m8CYU439Bn0g_0 2024-09-12T18:13:48.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.376+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1712203154967006404', time=2024-09-12T19:48:07.232447+0000, chain.objs.size()=1 2024-09-12T18:13:48.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.376+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.QdnNbswotQzh82-3-YSGXEOJC0qz8nK_0 2024-09-12T18:13:48.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.376+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1786323529659211731', time=2024-09-12T19:48:07.394615+0000, chain.objs.size()=1 2024-09-12T18:13:48.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.376+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.JFsMy1vep3KNO6e34mXkJxlYAXOUIxK_0 2024-09-12T18:13:48.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.376+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4647350546302819288', time=2024-09-12T19:48:07.995747+0000, chain.objs.size()=1 2024-09-12T18:13:48.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.376+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.oxePcnaga-fjs9rwIoanE55LaH30DhX_0 2024-09-12T18:13:48.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.377+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15976247917269844933', time=2024-09-12T19:48:08.279721+0000, chain.objs.size()=1 2024-09-12T18:13:48.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.377+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ZkvsT0Ioda6URaOuFP2hUjZ3MNR0o0X_0 2024-09-12T18:13:48.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.377+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5903203339462986106', time=2024-09-12T19:48:08.482363+0000, chain.objs.size()=1 2024-09-12T18:13:48.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.377+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.rQvH7_hDRXVtZY_MySx6Wi7uECUlTtZ_0 2024-09-12T18:13:48.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.377+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8180723936944320634', time=2024-09-12T19:48:08.723764+0000, chain.objs.size()=1 2024-09-12T18:13:48.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.377+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.4OD_Sj4y8WqiIhHGn6hBUvHHheKD6md_0 2024-09-12T18:13:48.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.377+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9890614001993245861', time=2024-09-12T19:48:08.950503+0000, chain.objs.size()=1 2024-09-12T18:13:48.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.377+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.7S_CFmHAbzBsXPyONgUfz_kQ1icM74f_0 2024-09-12T18:13:48.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.378+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6681404935014258935', time=2024-09-12T19:48:08.976637+0000, chain.objs.size()=1 2024-09-12T18:13:48.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.378+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.MhxvjrWH920WiSE-koQEhOqBUxzwOWp_0 2024-09-12T18:13:48.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.378+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13166169326666555858', time=2024-09-12T19:48:08.977286+0000, chain.objs.size()=1 2024-09-12T18:13:48.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.378+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.vRN4KNsc5CLXPbENlaa7C4v8mfA7D7h_0 2024-09-12T18:13:48.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.378+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4255049681865699819', time=2024-09-12T19:48:09.299143+0000, chain.objs.size()=1 2024-09-12T18:13:48.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.378+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.I84605se2Y22id5fMgFzHM1bllW1xVG_0 2024-09-12T18:13:48.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.378+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12334120349115748662', time=2024-09-12T19:48:09.397243+0000, chain.objs.size()=1 2024-09-12T18:13:48.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.378+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.kjXuHVXEwsuhGWvgPwzNXLMqJU5hPit_0 2024-09-12T18:13:48.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.378+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7751777521327329869', time=2024-09-12T19:48:09.717112+0000, chain.objs.size()=1 2024-09-12T18:13:48.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.378+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.2_EIH6iXHahCZdWD2zxpOHpVr72nuG9_0 2024-09-12T18:13:48.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.378+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2486837638448103746', time=2024-09-12T19:48:09.747342+0000, chain.objs.size()=1 2024-09-12T18:13:48.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.378+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.htZpvrLvqWFBJblReEY9Vdhoi9w_q9p_0 2024-09-12T18:13:48.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.378+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8468214540663521757', time=2024-09-12T19:48:10.073577+0000, chain.objs.size()=1 2024-09-12T18:13:48.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.378+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.sN0LydPseYAQOvsXVrKcwe_FBcBQ-Uo_0 2024-09-12T18:13:48.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.379+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6255492467234959635', time=2024-09-12T19:48:47.567147+0000, chain.objs.size()=1 2024-09-12T18:13:48.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.379+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.xC6DrFnEW33AWEwxNj4jCnIH4XAdgRA_0 2024-09-12T18:13:48.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.379+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.252346634248695487', time=2024-09-12T19:48:47.669890+0000, chain.objs.size()=1 2024-09-12T18:13:48.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.379+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.EBw-kTLGFnexqtli1ERS1NmV4B0JDE7_0 2024-09-12T18:13:48.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.379+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6171124883958056463', time=2024-09-12T19:48:47.702321+0000, chain.objs.size()=1 2024-09-12T18:13:48.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.379+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.2sb25H70lTwTllisAf5_ELCQ20f-v-3_0 2024-09-12T18:13:48.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.379+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5085502690767247905', time=2024-09-12T19:48:47.986075+0000, chain.objs.size()=1 2024-09-12T18:13:48.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.379+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.SOKsGFf5QShXiMHilYRYKRWDhoonI7J_0 2024-09-12T18:13:48.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.380+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5929289626619800063', time=2024-09-12T19:48:48.045463+0000, chain.objs.size()=1 2024-09-12T18:13:48.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.380+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.4a61z-6r26vxaV8YYzF3U_MaS11NGy5_0 2024-09-12T18:13:48.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.380+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11801620486683573179', time=2024-09-12T19:48:48.132079+0000, chain.objs.size()=1 2024-09-12T18:13:48.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.380+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.HWmg6jtFRqEoJXSPatvX5kC9GYDFGX3_0 2024-09-12T18:13:48.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.380+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5867677810701959630', time=2024-09-12T19:48:48.415629+0000, chain.objs.size()=1 2024-09-12T18:13:48.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.380+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.zBOfdnfHUpfCkKQiDl6It1U9fZN0zZu_0 2024-09-12T18:13:48.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.380+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4397853713875437356', time=2024-09-12T19:48:48.448973+0000, chain.objs.size()=1 2024-09-12T18:13:48.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.380+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.9n5JEvMAxgUiBnj5chj6fivsaOIqJG4_0 2024-09-12T18:13:48.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.381+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8995839291449541289', time=2024-09-12T19:48:48.977614+0000, chain.objs.size()=1 2024-09-12T18:13:48.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.381+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ehEstvDzbtrhUHqH-KOmmjAd9jLynCO_0 2024-09-12T18:13:48.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.381+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8783294701184258556', time=2024-09-12T19:48:49.019502+0000, chain.objs.size()=1 2024-09-12T18:13:48.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.381+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.GpenvDm0mt48scNN2c0Xzg2gpE-UwM6_0 2024-09-12T18:13:48.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.381+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7058482061364114423', time=2024-09-12T19:48:49.097295+0000, chain.objs.size()=1 2024-09-12T18:13:48.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.381+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.GHmfoqJUD8n75nS9tElwRSFWS7MtgVF_0 2024-09-12T18:13:48.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.381+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14475780895957566264', time=2024-09-12T19:48:49.217339+0000, chain.objs.size()=1 2024-09-12T18:13:48.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.381+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_._Yp0w-ZwwKOksBjMW-m7J_Ff8upMY1q_0 2024-09-12T18:13:48.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.383+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/54184 2024-09-12T18:13:48.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.385+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-09-12T18:13:48.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.385+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10471350360321042935', time=2024-09-12T19:48:49.743968+0000, chain.objs.size()=1 2024-09-12T18:13:48.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.385+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.qzygm_AnhTqCK0EulpFLfbbFjRAADUO_0 2024-09-12T18:13:48.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.385+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15017946623569275709', time=2024-09-12T19:48:51.047519+0000, chain.objs.size()=1 2024-09-12T18:13:48.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.385+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.UaVtiT06C6Q-ZAElrt64RpEYwcbeJ13_0 2024-09-12T18:13:48.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.385+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3330582934266872234', time=2024-09-12T19:48:51.198048+0000, chain.objs.size()=1 2024-09-12T18:13:48.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.385+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.xhXUtosaePAveZdVIK8f82VdRzP6Jmd_0 2024-09-12T18:13:48.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.385+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14281944118449690041', time=2024-09-12T19:48:51.287255+0000, chain.objs.size()=1 2024-09-12T18:13:48.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.385+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.lya220dkmO6ft_JmHEHztc9WWfvKk_z_0 2024-09-12T18:13:48.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.385+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3088404433341194226', time=2024-09-12T19:48:51.943403+0000, chain.objs.size()=1 2024-09-12T18:13:48.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.385+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.wSAA5pfBiOjVqc3w6pAhP9zZlGypI4b_0 2024-09-12T18:13:48.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.385+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1371090553715814170', time=2024-09-12T19:48:51.945571+0000, chain.objs.size()=1 2024-09-12T18:13:48.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.385+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.h0B5chCbFLeOI8wH0bTAFOvk7HNJOh7_0 2024-09-12T18:13:48.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.385+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.53563800269698005', time=2024-09-12T19:48:51.946336+0000, chain.objs.size()=1 2024-09-12T18:13:48.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.385+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.94Vy0R1EXor-L5G23wwfpsn0ejUG6wd_0 2024-09-12T18:13:48.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.385+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10403991221152975665', time=2024-09-12T19:48:52.527141+0000, chain.objs.size()=1 2024-09-12T18:13:48.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.385+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.TxyoujhEayGhGYVU6XZPYWX7mGfpHKJ_0 2024-09-12T18:13:48.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.385+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.650471874252278626', time=2024-09-12T19:48:52.527750+0000, chain.objs.size()=1 2024-09-12T18:13:48.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.385+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.qxn_Y1m2ibvk3NsHwGzQT0GVyv3m-tA_0 2024-09-12T18:13:48.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.385+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17956810309536749889', time=2024-09-12T19:48:52.749196+0000, chain.objs.size()=1 2024-09-12T18:13:48.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.385+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.zdbzs7jUk249-IXFdExdB-Jl6ozATXn_0 2024-09-12T18:13:48.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.385+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16149967857580473285', time=2024-09-12T19:48:52.855578+0000, chain.objs.size()=1 2024-09-12T18:13:48.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.385+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ShEzXjOYl-m9MmeSluF3yPmhcnn3UVA_0 2024-09-12T18:13:48.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.385+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3403980206901493889', time=2024-09-12T19:48:53.445555+0000, chain.objs.size()=1 2024-09-12T18:13:48.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.385+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.E_YGZKnzpTD_iBHUZj528VpOHGD_2Tb_0 2024-09-12T18:13:48.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.387+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5522564012376507948', time=2024-09-12T19:48:53.446517+0000, chain.objs.size()=1 2024-09-12T18:13:48.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.387+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_._ta8KfujBpVzBmDUgB4_e4_9BP3VUob_0 2024-09-12T18:13:48.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.387+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14602779436302272609', time=2024-09-12T19:48:54.288045+0000, chain.objs.size()=1 2024-09-12T18:13:48.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.387+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.qxHHg02bpkZgEBWzF5VaV3Z5sgH5B5P_0 2024-09-12T18:13:48.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.388+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17314371459231984910', time=2024-09-12T19:48:55.323762+0000, chain.objs.size()=1 2024-09-12T18:13:48.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.388+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.RUUDS8vDt60J7kGNcroM1qykTp65TXk_0 2024-09-12T18:13:48.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.388+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6442048468729053999', time=2024-09-12T19:48:55.989764+0000, chain.objs.size()=1 2024-09-12T18:13:48.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.388+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.yqwU8zUjs3LDJOxKDJYemcreEf0Conc_0 2024-09-12T18:13:48.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.388+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9223456661257777980', time=2024-09-12T19:48:56.503970+0000, chain.objs.size()=1 2024-09-12T18:13:48.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.388+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.YlMP1r3hvVb6nUfUn4o6IOc-Q82EOis_0 2024-09-12T18:13:48.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.388+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4608163393976663988', time=2024-09-12T19:48:56.590134+0000, chain.objs.size()=1 2024-09-12T18:13:48.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.388+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.yW3MeE_Ac_jM8hGwafTDLHZJN8U9i8J_0 2024-09-12T18:13:48.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.388+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11527749751748210338', time=2024-09-12T19:48:56.748897+0000, chain.objs.size()=1 2024-09-12T18:13:48.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.388+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.RXt_wJZYXhkMX-V3GRgQUuzwPtdI70u_0 2024-09-12T18:13:48.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.388+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10175459696909370964', time=2024-09-12T19:48:57.288623+0000, chain.objs.size()=1 2024-09-12T18:13:48.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.388+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.KLV5uXA5IupeNm7vywmMNm-V340f-T2_0 2024-09-12T18:13:48.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.388+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16745909131154063794', time=2024-09-12T19:48:57.700711+0000, chain.objs.size()=1 2024-09-12T18:13:48.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.388+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.g1hvRC7KoHBTzyM6TkC88v5lKD9B17N_0 2024-09-12T18:13:48.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.388+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12987568946761130856', time=2024-09-12T19:48:57.780330+0000, chain.objs.size()=1 2024-09-12T18:13:48.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.388+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.8cXQ2O9E46tUl-FQl3rKFJUALKKztth_0 2024-09-12T18:13:48.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.388+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8308326826866560657', time=2024-09-12T19:49:43.026795+0000, chain.objs.size()=1 2024-09-12T18:13:48.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.388+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.379__shadow_.ILOgdJ7361JPn3HQpCqRME-SKfJz9ah_0 2024-09-12T18:13:48.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.388+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7096597814976698533', time=2024-09-12T19:49:46.729010+0000, chain.objs.size()=1 2024-09-12T18:13:48.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.388+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.383__shadow_.GcqHf1IVeIUO2vTO-K5hVVBcdUFnaeU_0 2024-09-12T18:13:48.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.388+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1380286408356185934', time=2024-09-12T19:51:06.938223+0000, chain.objs.size()=1 2024-09-12T18:13:48.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.388+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.466__shadow_.FjF898Y-9gCk5K0HMenoO1Oowvfcei5_0 2024-09-12T18:13:48.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.390+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12684465241647481905', time=2024-09-12T19:57:38.956850+0000, chain.objs.size()=1 2024-09-12T18:13:48.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.390+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.559__shadow_.DRWWdOfwjDzU4AqB7OP42fUwIqK-5f5_0 2024-09-12T18:13:48.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.390+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8485250210783117599', time=2024-09-12T19:58:08.770604+0000, chain.objs.size()=1 2024-09-12T18:13:48.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.390+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.571__shadow:ylQOAI5CYEmr6wa6RW9SCj8n3u-pKz5_.BR1P7UgAHaarOsiyT2SaJdR0NpzPQeb_0 2024-09-12T18:13:48.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.390+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2513893887134574631', time=2024-09-12T19:58:12.718538+0000, chain.objs.size()=1 2024-09-12T18:13:48.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.390+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.574__shadow_.o6G4V5peXX3NQztSXI_EcgT3nngtSOj_0 2024-09-12T18:13:48.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.390+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5305034184494305359', time=2024-09-12T19:58:30.237158+0000, chain.objs.size()=1 2024-09-12T18:13:48.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.390+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:jiaYvaKuqv2Ycy9FQ4ha8nL9ydU4o92_.Ewu1HJ4w3pQnQVKmumzQUo3kLYexvOD_0 2024-09-12T18:13:48.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.390+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15748620265229456085', time=2024-09-12T19:59:29.774282+0000, chain.objs.size()=1 2024-09-12T18:13:48.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.390+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.580__shadow:sZ4TnpaO4c9eKS2MDPqskKmhdmeCq2E_.rytFgHfEjpbw48HCDD-npW-HvPdKIUL_0 2024-09-12T18:13:48.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.390+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7686584132071263447', time=2024-09-12T19:59:32.360835+0000, chain.objs.size()=1 2024-09-12T18:13:48.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.390+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.581__shadow:UeQ-5Ra3l.edmsxZ-H.QeS6oe4gASyZ_.GnJpbme5dvyNcuhCSDq4-c2PWjamwiP_0 2024-09-12T18:13:48.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.390+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7279138508171039980', time=2024-09-12T20:05:01.675843+0000, chain.objs.size()=1 2024-09-12T18:13:48.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.390+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.638__shadow_.DoszrK4MwFv89xvMQDWwMVxALSMZffG_0 2024-09-12T18:13:48.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.390+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15972890137101343333', time=2024-09-12T20:05:02.950382+0000, chain.objs.size()=1 2024-09-12T18:13:48.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.390+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.640__shadow_.3j7BxU8SQyBZhIKgMuZ1wEghVph7-0X_0 2024-09-12T18:13:48.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.390+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1490380913916580784', time=2024-09-12T20:06:03.013433+0000, chain.objs.size()=1 2024-09-12T18:13:48.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.390+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.665__shadow_.8kGlx5el511kQwb3r9YBTZ0mxN8Q_pm_0 2024-09-12T18:13:48.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.390+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5043934243908640954', time=2024-09-12T20:06:15.267480+0000, chain.objs.size()=1 2024-09-12T18:13:48.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.390+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.680__shadow_.zjPdpN_daNwcDgnJDIWwLtDlWcvwqfS_0 2024-09-12T18:13:48.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.393+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:48.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.395+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:13:48.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.396+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:48.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.396+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:48.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.397+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/70550' 2024-09-12T18:13:48.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.397+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='_ZtCYyi1X7YOrAvkfOl1IMkN2U1D9MbP', time=2024-09-12T19:41:49.349327+0000, chain.objs.size()=1 2024-09-12T18:13:48.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.397+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.161__shadow_.xHBQIB7rMRVW1E6Y78W8T2nMDvp3zNR_0 2024-09-12T18:13:48.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.397+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~TA7xWnsn4o3uyWgU4NmoqFBuOExFnRR', time=2024-09-12T19:43:11.734307+0000, chain.objs.size()=1 2024-09-12T18:13:48.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.397+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.202__multipart_mymultipart.2~TA7xWnsn4o3uyWgU4NmoqFBuOExFnRR.1 2024-09-12T18:13:48.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.397+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14223019768351402729', time=2024-09-12T19:45:01.877779+0000, chain.objs.size()=1 2024-09-12T18:13:48.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.397+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.232__shadow_.EUDYmoGlA1aMPT14zIgl22dcfFZxSwH_0 2024-09-12T18:13:48.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.397+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5442229924580677344', time=2024-09-12T19:45:14.718211+0000, chain.objs.size()=1 2024-09-12T18:13:48.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.397+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.244__shadow_.mnP9xTgyKn__BrhOE8wQuSSRY0IxKdE_0 2024-09-12T18:13:48.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.397+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15520306375124276569', time=2024-09-12T19:46:08.756150+0000, chain.objs.size()=1 2024-09-12T18:13:48.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.397+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.qHzl2DSKhpwHgSIMZmnkO6Nfn-CZRId_0 2024-09-12T18:13:48.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.397+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1627521012266215539', time=2024-09-12T19:46:09.751231+0000, chain.objs.size()=1 2024-09-12T18:13:48.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.397+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.8NOXxbg3TZhBcTCQC7NtpE26zRd50o1_0 2024-09-12T18:13:48.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.397+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8567061768153210774', time=2024-09-12T19:46:10.511686+0000, chain.objs.size()=1 2024-09-12T18:13:48.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.397+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.3LPHw5ocyXvGXvRnYb5pfmWs-ZK2jHX_0 2024-09-12T18:13:48.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.397+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.262084870193512355', time=2024-09-12T19:46:10.805885+0000, chain.objs.size()=1 2024-09-12T18:13:48.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.397+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Lyei64Avq6wtRIHk_rEUKsCKRB7PJQK_0 2024-09-12T18:13:48.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.397+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3753551262677441335', time=2024-09-12T19:46:10.814172+0000, chain.objs.size()=1 2024-09-12T18:13:48.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.397+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.vs-aKJ7i4aF6ymvEWRv_7SsGqK28S3x_0 2024-09-12T18:13:48.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.397+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13205521179392453539', time=2024-09-12T19:46:10.901833+0000, chain.objs.size()=1 2024-09-12T18:13:48.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.397+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ojEf0npTUUgY27T4AkJ1lwHrv6xkiS-_0 2024-09-12T18:13:48.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.397+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5815853505126813344', time=2024-09-12T19:46:11.033162+0000, chain.objs.size()=1 2024-09-12T18:13:48.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.397+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.2wTIQoGNiylSsNCQl4zN0Z1cDdkj5ky_0 2024-09-12T18:13:48.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.397+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7334209080658664935', time=2024-09-12T19:46:11.280113+0000, chain.objs.size()=1 2024-09-12T18:13:48.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.397+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.HfkYmmpvR7nfxfa2-iqwpYy2jvrNLJG_0 2024-09-12T18:13:48.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.399+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13969623805251308340', time=2024-09-12T19:46:11.369964+0000, chain.objs.size()=1 2024-09-12T18:13:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.399+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.SW-J4ZBH-5eYIycFWCm79n5qvSmCnWn_0 2024-09-12T18:13:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.399+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9744695153721258238', time=2024-09-12T19:46:12.017561+0000, chain.objs.size()=1 2024-09-12T18:13:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.399+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.srz0ZzWbmMU1tzL-Kv44OuVXqG43WsE_0 2024-09-12T18:13:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.399+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3035519835924819667', time=2024-09-12T19:46:13.471141+0000, chain.objs.size()=1 2024-09-12T18:13:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.399+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.J14df6ggo-2FH1EGdonYjVjBtAAuGls_0 2024-09-12T18:13:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.399+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3092650114752042718', time=2024-09-12T19:46:14.314033+0000, chain.objs.size()=1 2024-09-12T18:13:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.399+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.wBuHDXqW0vG2UYFO4dELj7OWfED8e8o_0 2024-09-12T18:13:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.399+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1786853163400967827', time=2024-09-12T19:46:15.405111+0000, chain.objs.size()=1 2024-09-12T18:13:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.399+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.aSwbJ1fMImYccli8dmk6UWT3N0Tu09z_0 2024-09-12T18:13:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.399+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7827754603436312108', time=2024-09-12T19:46:15.405656+0000, chain.objs.size()=1 2024-09-12T18:13:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.399+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.E4OJHSEwGdbWnVRUK3bb2PaZN9Vifg5_0 2024-09-12T18:13:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.399+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7592742781825348069', time=2024-09-12T19:46:15.558121+0000, chain.objs.size()=1 2024-09-12T18:13:48.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.399+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_._mfdM-kGyRrMBYLUkblpQCAEQIh56h-_0 2024-09-12T18:13:48.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.400+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17407817323646941743', time=2024-09-12T19:46:15.706778+0000, chain.objs.size()=1 2024-09-12T18:13:48.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.400+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.vWcuSG4KD_cwUvz_IT-IXvhTbt3Re85_0 2024-09-12T18:13:48.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.400+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15704285515662149124', time=2024-09-12T19:46:15.707605+0000, chain.objs.size()=1 2024-09-12T18:13:48.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.400+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.yI3MKjgg3u4ZAABja6CpSdl8v4mdeOg_0 2024-09-12T18:13:48.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.402+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4126021538842728726', time=2024-09-12T19:46:15.708306+0000, chain.objs.size()=1 2024-09-12T18:13:48.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.402+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.dbD3aezVWT9L9a09janOB8K4nJ53Brh_0 2024-09-12T18:13:48.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.402+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13072799427932606641', time=2024-09-12T19:46:16.303995+0000, chain.objs.size()=1 2024-09-12T18:13:48.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.402+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.zViuNzB3yIsmD7DC45cgbHzZhvZLdi7_0 2024-09-12T18:13:48.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.402+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15279939119030785463', time=2024-09-12T19:46:16.304502+0000, chain.objs.size()=1 2024-09-12T18:13:48.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.402+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.hpZXPcRr_Y9vY_GZlu-DE9R1PoLSLOq_0 2024-09-12T18:13:48.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.402+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8989653341231789202', time=2024-09-12T19:46:16.486866+0000, chain.objs.size()=1 2024-09-12T18:13:48.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.402+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.5Cux3wLCa_oeo5_cldg8ncwAPD-VNdm_0 2024-09-12T18:13:48.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.402+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9244483437347004623', time=2024-09-12T19:46:17.121288+0000, chain.objs.size()=1 2024-09-12T18:13:48.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.402+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.U_FhnVE2miu_ifpIzZt3KY7FKEABxYj_0 2024-09-12T18:13:48.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.402+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2580787536251916462', time=2024-09-12T19:46:17.440163+0000, chain.objs.size()=1 2024-09-12T18:13:48.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.402+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Igv7ucIqbUP-OmeXmH0vNPlCa4xsqA8_0 2024-09-12T18:13:48.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.402+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7730792200586847938', time=2024-09-12T19:46:17.552470+0000, chain.objs.size()=1 2024-09-12T18:13:48.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.402+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.fti0pJJZ9OWc4E40TCRxAe7-pwoM9e3_0 2024-09-12T18:13:48.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.402+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4415270095022875103', time=2024-09-12T19:46:18.083285+0000, chain.objs.size()=1 2024-09-12T18:13:48.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.402+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.qDajEigQ_UP38_Bs8LQxeUUAZehH--7_0 2024-09-12T18:13:48.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.402+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4262866557745084951', time=2024-09-12T19:46:18.753459+0000, chain.objs.size()=1 2024-09-12T18:13:48.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.402+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.HHFgf75sOAEXEjZB6QwthgrAgOSjn2c_0 2024-09-12T18:13:48.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.402+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18211806222751943251', time=2024-09-12T19:46:18.788136+0000, chain.objs.size()=1 2024-09-12T18:13:48.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.402+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.5R5qs1x5tkpSVYHHqsuqLma1R0GsuRd_0 2024-09-12T18:13:48.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.402+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3075766369552011167', time=2024-09-12T19:46:19.038119+0000, chain.objs.size()=1 2024-09-12T18:13:48.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.402+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.7ta-eaIcwE2QIr4_ijIiNwhG06Hpabj_0 2024-09-12T18:13:48.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.404+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14632826300562294325', time=2024-09-12T19:46:19.223549+0000, chain.objs.size()=1 2024-09-12T18:13:48.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.404+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.23eHk8dm0tfN_Hj3lBenCP0zhXORgRL_0 2024-09-12T18:13:48.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.404+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2317272785094213628', time=2024-09-12T19:46:19.379472+0000, chain.objs.size()=1 2024-09-12T18:13:48.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.404+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.VhDPig4IiYzsySJ1VhMu068wu-2LaYG_0 2024-09-12T18:13:48.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.405+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18075321994663210097', time=2024-09-12T19:46:19.380044+0000, chain.objs.size()=1 2024-09-12T18:13:48.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.405+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.byVNcpI-QF2ebvrBxGmg4V92fp9XGi__0 2024-09-12T18:13:48.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.406+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6637496137866820424', time=2024-09-12T19:46:19.448471+0000, chain.objs.size()=1 2024-09-12T18:13:48.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.406+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.E1eamSjrQV3y9zFCoTldYAJ5gjgmdUr_0 2024-09-12T18:13:48.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.406+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3280722528593614355', time=2024-09-12T19:46:31.025725+0000, chain.objs.size()=1 2024-09-12T18:13:48.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.406+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.276__shadow_.15vOq_p5ydGZjaGLZ4YWjxxc61CuDLu_0 2024-09-12T18:13:48.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.406+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15498270456359611207', time=2024-09-12T19:46:33.732631+0000, chain.objs.size()=1 2024-09-12T18:13:48.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.406+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.279__shadow_.LCVtGFJF_9iCUsbB5y_V8weGQhrzswu_0 2024-09-12T18:13:48.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.406+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14868768378567056581', time=2024-09-12T19:46:39.216464+0000, chain.objs.size()=1 2024-09-12T18:13:48.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.406+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.285__shadow_.UzKAmfcayXE9-WdCG7NtuAgKYL7qJcl_0 2024-09-12T18:13:48.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.406+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15772742905889435089', time=2024-09-12T19:46:40.194083+0000, chain.objs.size()=1 2024-09-12T18:13:48.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.406+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.286__shadow_.th6WU1gyxwfubiyCHXSYuUhV94zEHQj_0 2024-09-12T18:13:48.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.406+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12049027702385014018', time=2024-09-12T19:46:44.809149+0000, chain.objs.size()=1 2024-09-12T18:13:48.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.406+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.291__shadow_.9X6bQB7u4GW74Q8JQi0yRv4XIgf4lfw_0 2024-09-12T18:13:48.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.406+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1634715770149335677', time=2024-09-12T19:46:48.233927+0000, chain.objs.size()=1 2024-09-12T18:13:48.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.406+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.293__shadow_.-Tva4tIZYy2GkLvaSyBudBqn4N_alIQ_0 2024-09-12T18:13:48.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.406+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10480255336025022237', time=2024-09-12T19:46:50.297574+0000, chain.objs.size()=1 2024-09-12T18:13:48.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.406+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.294__shadow_.KvzWn6UsNORyltaTgoZdfiot_psifCQ_0 2024-09-12T18:13:48.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.406+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16689554147235434127', time=2024-09-12T19:46:50.302789+0000, chain.objs.size()=1 2024-09-12T18:13:48.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.406+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.294__shadow_.8yRUxCyPlzjZD37O_scYFTFtdffj_Mu_0 2024-09-12T18:13:48.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.408+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12990353599861201751', time=2024-09-12T19:46:52.281426+0000, chain.objs.size()=1 2024-09-12T18:13:48.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.408+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.296__shadow_.SHMJy2LiJDlbAw2Pek5newXeDURZx76_0 2024-09-12T18:13:48.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.408+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9175884486037323738', time=2024-09-12T19:46:59.716949+0000, chain.objs.size()=1 2024-09-12T18:13:48.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.408+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.304__shadow_.fXE2h-r0ViT_y36RFfSHI48LsoPyvUc_0 2024-09-12T18:13:48.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.408+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.374399648554892464', time=2024-09-12T19:47:18.759109+0000, chain.objs.size()=1 2024-09-12T18:13:48.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.408+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.320__shadow:.NR9RdLJ3SaCeE1xJr.s-p10WYyw.y-_.pHPuliE9A_elZ7wH4xKEifsdnrMBHDO_0 2024-09-12T18:13:48.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.408+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17418627546720453922', time=2024-09-12T19:47:59.957547+0000, chain.objs.size()=1 2024-09-12T18:13:48.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.408+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.zs69txgKo-dzwziDHHUQrrL-TM3VET2_0 2024-09-12T18:13:48.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.408+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16551065669858784343', time=2024-09-12T19:48:00.155452+0000, chain.objs.size()=1 2024-09-12T18:13:48.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.408+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.93UgD_jfW3LQT3eVN_aPiD0qiLMSKIc_0 2024-09-12T18:13:48.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.408+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3518098574255945955', time=2024-09-12T19:48:00.294857+0000, chain.objs.size()=1 2024-09-12T18:13:48.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.408+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.nWO615YWUpBJklaBvNjO_1m-_51nt2M_0 2024-09-12T18:13:48.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.408+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3001350614762480696', time=2024-09-12T19:48:00.463238+0000, chain.objs.size()=1 2024-09-12T18:13:48.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.408+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.VaLn_wj5qrNuPsjF__xo89FOlkFCnvr_0 2024-09-12T18:13:48.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.408+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10714908067642721981', time=2024-09-12T19:48:01.182320+0000, chain.objs.size()=1 2024-09-12T18:13:48.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.408+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.-7Acb1kxCkccjflII-uLyeCK1CADT8J_0 2024-09-12T18:13:48.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.408+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14103393171857192646', time=2024-09-12T19:48:01.307514+0000, chain.objs.size()=1 2024-09-12T18:13:48.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.408+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.uqJ_YwTrd9erH7teFXvmUIAZol5SBQL_0 2024-09-12T18:13:48.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.408+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15962970581250778316', time=2024-09-12T19:48:01.720978+0000, chain.objs.size()=1 2024-09-12T18:13:48.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.408+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.T702G8-ocVsO6_R6R2hor2gGbqU42hT_0 2024-09-12T18:13:48.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.408+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8465254877014033627', time=2024-09-12T19:48:02.000180+0000, chain.objs.size()=1 2024-09-12T18:13:48.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.408+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.kPnBOlLG9AQAKee6vDHIKU3vL1YK2kf_0 2024-09-12T18:13:48.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.410+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8886122438876326466', time=2024-09-12T19:48:02.506130+0000, chain.objs.size()=1 2024-09-12T18:13:48.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.410+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.L3leN9_-4f-ydBTq6HTLtecA_mEA5-m_0 2024-09-12T18:13:48.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.411+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11935978944876255792', time=2024-09-12T19:48:02.744320+0000, chain.objs.size()=1 2024-09-12T18:13:48.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.411+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.sEpOKWGH3bdyMX-LkoWFnbZ_nTNYiM5_0 2024-09-12T18:13:48.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.411+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3713666333766561399', time=2024-09-12T19:48:02.762687+0000, chain.objs.size()=1 2024-09-12T18:13:48.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.411+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.kBVxHCy60e_04eqNphLpFVxpwNwEQNp_0 2024-09-12T18:13:48.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.411+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6378546964082479480', time=2024-09-12T19:48:02.763405+0000, chain.objs.size()=1 2024-09-12T18:13:48.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.411+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.YYoUSw3S4GNQ6vITWQy-zjtl4Bw8zAD_0 2024-09-12T18:13:48.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.411+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15140874896782652767', time=2024-09-12T19:48:02.872091+0000, chain.objs.size()=1 2024-09-12T18:13:48.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.411+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.QgR16sNhlO8eAxsHFXp_foHmd3kYJES_0 2024-09-12T18:13:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.411+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16942354374382328627', time=2024-09-12T19:48:03.018345+0000, chain.objs.size()=1 2024-09-12T18:13:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.411+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.OaOkGWqhy4hxWCDz41hmc1sBKQlTa_4_0 2024-09-12T18:13:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.411+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17289393999574137479', time=2024-09-12T19:48:03.365641+0000, chain.objs.size()=1 2024-09-12T18:13:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.411+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.kmGt4es_xaQoHOuIY9EQkYl3E-UksfQ_0 2024-09-12T18:13:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.411+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13031674564472604076', time=2024-09-12T19:48:05.617104+0000, chain.objs.size()=1 2024-09-12T18:13:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.411+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.vlNRkCYxN_6NFCGIt5p9h3hujz9KL7l_0 2024-09-12T18:13:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.412+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9450702504897593440', time=2024-09-12T19:48:06.027077+0000, chain.objs.size()=1 2024-09-12T18:13:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.412+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.1av0WcVfbSia7c0RX6FjSQbM264Zd-Q_0 2024-09-12T18:13:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.412+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11763836768853546470', time=2024-09-12T19:48:06.274660+0000, chain.objs.size()=1 2024-09-12T18:13:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.412+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.MHHUYCGUpcFMSbt0ktPWnRkIPvc-uU9_0 2024-09-12T18:13:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.412+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4272477547845543404', time=2024-09-12T19:48:06.299882+0000, chain.objs.size()=1 2024-09-12T18:13:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.412+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Lt1kekiGWW0vHseFvDQj5C9g1XbR5Bq_0 2024-09-12T18:13:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.412+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14941998663713953409', time=2024-09-12T19:48:06.943350+0000, chain.objs.size()=1 2024-09-12T18:13:48.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.412+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.PPzp5qiMiP_k0tGauCLfRUpSITJj0Cb_0 2024-09-12T18:13:48.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.415+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12185290628404565069', time=2024-09-12T19:48:07.245540+0000, chain.objs.size()=1 2024-09-12T18:13:48.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.415+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.YXmGSfqm46vmWikcQEbEEHIp26Gojw8_0 2024-09-12T18:13:48.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.415+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4690032618176421573', time=2024-09-12T19:48:07.545457+0000, chain.objs.size()=1 2024-09-12T18:13:48.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.415+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.hxgaW3Z_IN8uaYLVNx4odedCPFZtZxl_0 2024-09-12T18:13:48.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.415+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12463772203580337681', time=2024-09-12T19:48:08.617478+0000, chain.objs.size()=1 2024-09-12T18:13:48.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.415+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.4SmeQDj63oE1dTY69V811nLvKWSGas__0 2024-09-12T18:13:48.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.415+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7417862070274779221', time=2024-09-12T19:48:09.573332+0000, chain.objs.size()=1 2024-09-12T18:13:48.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.415+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.AJ9bPMQTPZehZk63dyauQIPa9Uch2yH_0 2024-09-12T18:13:48.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.415+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1997659796582039995', time=2024-09-12T19:48:09.577074+0000, chain.objs.size()=1 2024-09-12T18:13:48.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.415+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.1TRtCTW0d1TwMe-9yTEZOTX3CmlmkWg_0 2024-09-12T18:13:48.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.415+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10150005442758430308', time=2024-09-12T19:48:09.627026+0000, chain.objs.size()=1 2024-09-12T18:13:48.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.415+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.T3N3uovDzwDdytqd0MERpDNLBp1LI7-_0 2024-09-12T18:13:48.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.415+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8202787440352304781', time=2024-09-12T19:48:09.956479+0000, chain.objs.size()=1 2024-09-12T18:13:48.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.415+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.NM0mZL0aE9GoMCt7QLdtCVIE1kG35hI_0 2024-09-12T18:13:48.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.415+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10753623255204286046', time=2024-09-12T19:48:10.043073+0000, chain.objs.size()=1 2024-09-12T18:13:48.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.415+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.SlWctKgT9vVORbf5awvUmW50McskIxn_0 2024-09-12T18:13:48.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.415+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13010881172290108114', time=2024-09-12T19:48:47.687426+0000, chain.objs.size()=1 2024-09-12T18:13:48.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.415+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Izd5E8EaV0SLAyOQZG_O2YdnfQwGWNA_0 2024-09-12T18:13:48.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.415+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18262171127821655314', time=2024-09-12T19:48:47.742997+0000, chain.objs.size()=1 2024-09-12T18:13:48.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.415+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.qNgFDdrgGFJDly9Qr1loLBlMOAjMRmQ_0 2024-09-12T18:13:48.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.415+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18197245188272005512', time=2024-09-12T19:48:47.814967+0000, chain.objs.size()=1 2024-09-12T18:13:48.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.415+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.D4g7lvLHGDf6F-evyxZ8KCspyIE9o4d_0 2024-09-12T18:13:48.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.416+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12899461669687630499', time=2024-09-12T19:48:47.907984+0000, chain.objs.size()=1 2024-09-12T18:13:48.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.416+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.VBw_YQKx60070Jb9h51fyreJWNI_hF9_0 2024-09-12T18:13:48.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.416+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3410635611455807653', time=2024-09-12T19:48:47.931508+0000, chain.objs.size()=1 2024-09-12T18:13:48.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.416+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.GORnEsenxO5XDB8k_f86hesQaRqapZq_0 2024-09-12T18:13:48.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.418+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14175186727660937572', time=2024-09-12T19:48:48.267081+0000, chain.objs.size()=1 2024-09-12T18:13:48.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.418+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.e4MSqX-dTW0kjZJciApJXUrZ7xPt-5X_0 2024-09-12T18:13:48.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.418+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.224074217400598518', time=2024-09-12T19:48:48.445188+0000, chain.objs.size()=1 2024-09-12T18:13:48.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.418+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.urzF3-sov9jPt0_vsxFpqQrRUAcA_DL_0 2024-09-12T18:13:48.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.418+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14381422640205079721', time=2024-09-12T19:48:49.040299+0000, chain.objs.size()=1 2024-09-12T18:13:48.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.418+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.HgT6BgaUrUADuOWYxsD7JbabccxxgOj_0 2024-09-12T18:13:48.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.418+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12246913050827159675', time=2024-09-12T19:48:49.518087+0000, chain.objs.size()=1 2024-09-12T18:13:48.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.418+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.geA6uo3dVPaoa5fTrsuaQ4J4ZIwKoaI_0 2024-09-12T18:13:48.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.418+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4974687477612274478', time=2024-09-12T19:48:49.773044+0000, chain.objs.size()=1 2024-09-12T18:13:48.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.418+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.BAx2bB1JGItMu9VOK-XQgpOy_0mB5h6_0 2024-09-12T18:13:48.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.418+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16700156455757554593', time=2024-09-12T19:48:49.794331+0000, chain.objs.size()=1 2024-09-12T18:13:48.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.418+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.OW6p0f6zqSonxloY6ScbwR47n8_rRGK_0 2024-09-12T18:13:48.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.418+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2219565476615066477', time=2024-09-12T19:48:50.629874+0000, chain.objs.size()=1 2024-09-12T18:13:48.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.418+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.igGyqUJyRwifr6-okadXByO81Nni8OP_0 2024-09-12T18:13:48.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.418+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8105760883074290883', time=2024-09-12T19:48:50.682066+0000, chain.objs.size()=1 2024-09-12T18:13:48.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.418+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.1TcUlZNM1i3-q0O9503anuQRtWqaNii_0 2024-09-12T18:13:48.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.418+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12627918936913477662', time=2024-09-12T19:48:50.861436+0000, chain.objs.size()=1 2024-09-12T18:13:48.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.418+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.laIJWG3tee7-lVPtVSDwsPU00W75L5T_0 2024-09-12T18:13:48.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.418+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16608703029378006084', time=2024-09-12T19:48:51.250686+0000, chain.objs.size()=1 2024-09-12T18:13:48.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.418+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.gzUxul_n5ZmMgc2sJh8-z48W6MmnW-G_0 2024-09-12T18:13:48.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.418+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8243692535058448685', time=2024-09-12T19:48:51.333780+0000, chain.objs.size()=1 2024-09-12T18:13:48.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.418+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ms5Ti_e789_sTz7id8ujlKvyzcS_tgs_0 2024-09-12T18:13:48.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.419+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13457517414582218022', time=2024-09-12T19:48:51.358931+0000, chain.objs.size()=1 2024-09-12T18:13:48.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.419+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.OxudlGj_QdIUHpdNXqGfAH-FqrS4R1M_0 2024-09-12T18:13:48.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.420+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3882723140053248977', time=2024-09-12T19:48:51.466889+0000, chain.objs.size()=1 2024-09-12T18:13:48.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.420+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.s4erfhbdSX6bzgjhG78cJRbfbTJXOoi_0 2024-09-12T18:13:48.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.420+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.246882570603253868', time=2024-09-12T19:48:52.074880+0000, chain.objs.size()=1 2024-09-12T18:13:48.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.420+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.O0UJzsYQxSc46LxVzczpaETTj1CPU3A_0 2024-09-12T18:13:48.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.420+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16087811845720304963', time=2024-09-12T19:48:52.099977+0000, chain.objs.size()=1 2024-09-12T18:13:48.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.420+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.A78L4zTSJj82zn6oUSLkUl0_MsSkT2g_0 2024-09-12T18:13:48.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.420+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11599387759799126762', time=2024-09-12T19:48:52.103572+0000, chain.objs.size()=1 2024-09-12T18:13:48.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.420+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.5R-ytMdqC0zfS27Y77LER2PLn_gjQYp_0 2024-09-12T18:13:48.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.420+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.707285121882609387', time=2024-09-12T19:48:52.175374+0000, chain.objs.size()=1 2024-09-12T18:13:48.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.420+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.qxN_3UAYmmq2e8TfNX1-8sWi52fM-gD_0 2024-09-12T18:13:48.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.420+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10459652031992640829', time=2024-09-12T19:48:52.604231+0000, chain.objs.size()=1 2024-09-12T18:13:48.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.420+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.hfZEcz7F-sRaJlwV21SJkbQYi34xWET_0 2024-09-12T18:13:48.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.420+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16720549955438162454', time=2024-09-12T19:48:52.605090+0000, chain.objs.size()=1 2024-09-12T18:13:48.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.420+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.HgaTnvty7knwh1VnJxP9hOa185spwOJ_0 2024-09-12T18:13:48.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.420+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12788146331594625649', time=2024-09-12T19:48:52.719720+0000, chain.objs.size()=1 2024-09-12T18:13:48.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.420+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.BRkQTsXdNj_ek1EKfLhH3xYYTgwTHfh_0 2024-09-12T18:13:48.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.422+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/70550 2024-09-12T18:13:48.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.424+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-09-12T18:13:48.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.424+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9180953927147005724', time=2024-09-12T19:48:52.721500+0000, chain.objs.size()=1 2024-09-12T18:13:48.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.424+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Xx1geG_XoY3UxuvAJagSL_1agre474a_0 2024-09-12T18:13:48.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.424+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7366263035349668988', time=2024-09-12T19:48:53.515868+0000, chain.objs.size()=1 2024-09-12T18:13:48.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.424+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.9Dmt1ywIWT-93COm_ht1Hji4fhsrVRs_0 2024-09-12T18:13:48.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.424+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14325840279704463100', time=2024-09-12T19:48:53.804945+0000, chain.objs.size()=1 2024-09-12T18:13:48.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.424+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.e3XhkkK2ikWj21WqnZ5k7EG2ZrqbNXx_0 2024-09-12T18:13:48.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.424+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11961365954345528465', time=2024-09-12T19:48:53.828571+0000, chain.objs.size()=1 2024-09-12T18:13:48.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.424+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.H4frH6waaNdt-z9u02toMWcuEZK0FYt_0 2024-09-12T18:13:48.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.424+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.901904023350502728', time=2024-09-12T19:48:54.235133+0000, chain.objs.size()=1 2024-09-12T18:13:48.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.424+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.L9MzJuzCZEahyl0ht2G12VygheWn6wI_0 2024-09-12T18:13:48.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.424+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13994933985744357679', time=2024-09-12T19:48:54.744954+0000, chain.objs.size()=1 2024-09-12T18:13:48.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.424+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Bl5XJ1RSsyws972HvtKSfF4og6BTBix_0 2024-09-12T18:13:48.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.425+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2611408070897983492', time=2024-09-12T19:48:54.973521+0000, chain.objs.size()=1 2024-09-12T18:13:48.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.425+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.BgzqrryFcZGVlqHayNybDc31Bxua7mj_0 2024-09-12T18:13:48.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.425+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13757669240735487356', time=2024-09-12T19:48:55.966905+0000, chain.objs.size()=1 2024-09-12T18:13:48.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.425+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.R-mWGTOVrYjXKK_ODLy1nrus_PBqZeu_0 2024-09-12T18:13:48.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.425+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4623802400669076356', time=2024-09-12T19:48:55.967489+0000, chain.objs.size()=1 2024-09-12T18:13:48.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.425+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.8-blB-dx6lvgdWh6HVoeX1qcPHSp1Iy_0 2024-09-12T18:13:48.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.425+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6086677518891807082', time=2024-09-12T19:48:56.512597+0000, chain.objs.size()=1 2024-09-12T18:13:48.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.425+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.dgyrcabVdIHIeaxdqGZS7wKFbQTxcou_0 2024-09-12T18:13:48.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.425+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6927954325217213953', time=2024-09-12T19:48:56.573862+0000, chain.objs.size()=1 2024-09-12T18:13:48.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.425+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.BsGFtNTckoxUxjb11KLlLvob_iKOmW2_0 2024-09-12T18:13:48.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.425+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1234305664826141945', time=2024-09-12T19:48:56.670215+0000, chain.objs.size()=1 2024-09-12T18:13:48.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.425+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ruskafNz33fOBQXp8-OxS4w2i-3md_j_0 2024-09-12T18:13:48.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.427+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5237073682921868146', time=2024-09-12T19:48:56.886382+0000, chain.objs.size()=1 2024-09-12T18:13:48.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.427+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.nZtMf9uZacC9IVBR8Y_s0s1VNNYRibE_0 2024-09-12T18:13:48.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.427+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18182287699438421731', time=2024-09-12T19:48:57.431635+0000, chain.objs.size()=1 2024-09-12T18:13:48.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.427+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.LZ9L6Mbm1X9Ek82onQubiUmSxN90xM__0 2024-09-12T18:13:48.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.427+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4094235551405750466', time=2024-09-12T19:48:57.540567+0000, chain.objs.size()=1 2024-09-12T18:13:48.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.427+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.o9VNp2tfZRr2GE2eJRmDuGCsrsqMBGM_0 2024-09-12T18:13:48.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.427+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10921678213874590552', time=2024-09-12T19:48:57.838797+0000, chain.objs.size()=1 2024-09-12T18:13:48.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.427+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.L9sHNYUUBiGuK6zCfW54T0fs_e7Gr_L_0 2024-09-12T18:13:48.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.427+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2824254694216994763', time=2024-09-12T19:48:57.860362+0000, chain.objs.size()=1 2024-09-12T18:13:48.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.427+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Sqy-H-AWX6BEEA9ZgssocXhrMHcikHI_0 2024-09-12T18:13:48.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.427+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2479238991564752474', time=2024-09-12T19:48:59.640298+0000, chain.objs.size()=1 2024-09-12T18:13:48.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.427+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.327__shadow_.YDckol407JNIx1Jd2XwOphvBSj_5EOb_0 2024-09-12T18:13:48.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.427+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4210595765350738629', time=2024-09-12T19:50:28.408506+0000, chain.objs.size()=1 2024-09-12T18:13:48.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.427+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.430__shadow_.2RZS_uYRcojAL0IeoLnCEGKj1exLBMY_0 2024-09-12T18:13:48.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.427+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12585453657358122986', time=2024-09-12T19:50:55.124558+0000, chain.objs.size()=1 2024-09-12T18:13:48.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.427+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.457__shadow_.Ltsz9lhaYJ8_JGXK038GkP8BM2lEfRH_0 2024-09-12T18:13:48.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.427+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8836959577857761106', time=2024-09-12T19:51:06.585128+0000, chain.objs.size()=1 2024-09-12T18:13:48.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.427+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.466__shadow_.OuzutCMxRBhxpo3oM69leW3LBTlMoJf_0 2024-09-12T18:13:48.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.427+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~kHYjdQZeybJvEN2vnYnywGJ8NJOFn21', time=2024-09-12T19:56:11.804730+0000, chain.objs.size()=1 2024-09-12T18:13:48.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.427+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.534__multipart_mymultipart.2~kHYjdQZeybJvEN2vnYnywGJ8NJOFn21.1 2024-09-12T18:13:48.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.427+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~7Oeh6pUWAkepB1BVov6ZVBWMFvtZnt-', time=2024-09-12T19:56:12.650452+0000, chain.objs.size()=1 2024-09-12T18:13:48.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.427+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.535__multipart_mymultipart.2~7Oeh6pUWAkepB1BVov6ZVBWMFvtZnt-.1 2024-09-12T18:13:48.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.428+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13567037603358931205', time=2024-09-12T19:57:04.677706+0000, chain.objs.size()=1 2024-09-12T18:13:48.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.428+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.552__shadow_.Z1T_7aV1voOwU3xj3RsWJIilJBjXDtR_0 2024-09-12T18:13:48.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.428+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5559693386818455139', time=2024-09-12T19:57:58.189804+0000, chain.objs.size()=1 2024-09-12T18:13:48.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.428+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:vjZypJRBcjTGwT-zfarzFHKTyR17BfB_.s3GpxlnnY3cnaQKAgq3V4v7efJJPMcG_0 2024-09-12T18:13:48.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.428+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.267178782070839470', time=2024-09-12T19:58:16.056966+0000, chain.objs.size()=1 2024-09-12T18:13:48.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.428+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.575__shadow:oYBRRk1CJy-B1NrNzuEk-8DlvxU1bDU_.ZUx1tMEaImmt3DRJC_5SEKCezn3IQGl_0 2024-09-12T18:13:48.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.429+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8449476826109790869', time=2024-09-12T19:58:23.635942+0000, chain.objs.size()=1 2024-09-12T18:13:48.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.429+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.577__shadow:2Tm9Dqrenfzu5hwNr7Ut4x1N0QTW.5Z_.j2oLhpzZwUXsYEzFkhzcT1tFaGbB426_0 2024-09-12T18:13:48.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.429+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9307153734763208256', time=2024-09-12T19:58:31.374172+0000, chain.objs.size()=1 2024-09-12T18:13:48.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.429+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:84EZ91.E6NIgDqQLyRjh2bGTD0TgWFd_.R9XEuAaZyxsBkZ38pZ9TsggaAMOdAk4_0 2024-09-12T18:13:48.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.429+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5057205801003988548', time=2024-09-12T19:59:56.374535+0000, chain.objs.size()=1 2024-09-12T18:13:48.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.429+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.607__shadow_.dAOEvVAK3X8X-RhGMcAT0PjStimOCxK_0 2024-09-12T18:13:48.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.429+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.479596379896834048', time=2024-09-12T20:07:06.006267+0000, chain.objs.size()=1 2024-09-12T18:13:48.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.429+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.719__shadow_.pRUr_5ev1EJKmODU3H1q5rW5qBLLlqm_0 2024-09-12T18:13:48.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.431+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:48.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.433+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:13:48.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.434+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:48.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.435+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:48.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.436+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=95, truncated=0, next_marker='' 2024-09-12T18:13:48.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.436+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5241555469122538076', time=2024-09-12T19:41:32.261310+0000, chain.objs.size()=5 2024-09-12T18:13:48.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.436+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.160__multipart_mymultipart-FROZEN.2~er8RglO8p20_YjfJbVMY02jJGHIUoIy.1 2024-09-12T18:13:48.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.436+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.160__shadow_mymultipart-FROZEN.2~er8RglO8p20_YjfJbVMY02jJGHIUoIy.1_1 2024-09-12T18:13:48.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.436+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.160__multipart_mymultipart-FROZEN.2~er8RglO8p20_YjfJbVMY02jJGHIUoIy.2 2024-09-12T18:13:48.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.436+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.160__shadow_mymultipart-FROZEN.2~er8RglO8p20_YjfJbVMY02jJGHIUoIy.2_1 2024-09-12T18:13:48.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.436+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.160__multipart_mymultipart-FROZEN.2~er8RglO8p20_YjfJbVMY02jJGHIUoIy.3 2024-09-12T18:13:48.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.436+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14531483278111000602', time=2024-09-12T19:46:09.023840+0000, chain.objs.size()=1 2024-09-12T18:13:48.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.436+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.1bI65bgD_7c3p2NAwgCT-4ImZMNear6_0 2024-09-12T18:13:48.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.436+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14811640723985387096', time=2024-09-12T19:46:09.548786+0000, chain.objs.size()=1 2024-09-12T18:13:48.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.436+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.lquvTIDjUo6wQIKP9AVgrNks3aYzTgm_0 2024-09-12T18:13:48.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.436+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17361648608692655140', time=2024-09-12T19:46:09.651552+0000, chain.objs.size()=1 2024-09-12T18:13:48.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.436+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.5P-OAVetF7Y04a0P2f6vwLK6n0koHUE_0 2024-09-12T18:13:48.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.436+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3849395730478517806', time=2024-09-12T19:46:10.383216+0000, chain.objs.size()=1 2024-09-12T18:13:48.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.436+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.JAgkNt-FAWA_64R6FA2M1-KyyDUQaRE_0 2024-09-12T18:13:48.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.436+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11036903950575201557', time=2024-09-12T19:46:11.377581+0000, chain.objs.size()=1 2024-09-12T18:13:48.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.436+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.1HdMKsOBp5FVOOalEIkzpwtcO_-FPK1_0 2024-09-12T18:13:48.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.436+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13358324594139611815', time=2024-09-12T19:46:11.879596+0000, chain.objs.size()=1 2024-09-12T18:13:48.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.436+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.sY5_xLjn959JANwJvn1t5PrsvU9MBha_0 2024-09-12T18:13:48.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.436+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15986167846785488772', time=2024-09-12T19:46:11.995190+0000, chain.objs.size()=1 2024-09-12T18:13:48.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.436+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.a2CC58dpfbzYI8qwtlAeqKUpfskkIIE_0 2024-09-12T18:13:48.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.438+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10003207564568467136', time=2024-09-12T19:46:12.115037+0000, chain.objs.size()=1 2024-09-12T18:13:48.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.438+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.2-YubPZwLczPRdh4kU-9ZfoHqUUf_Ad_0 2024-09-12T18:13:48.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.438+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14828682795803833331', time=2024-09-12T19:46:12.723574+0000, chain.objs.size()=1 2024-09-12T18:13:48.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.438+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.4scxSmMADbZuQirbozE8CkuoMCf-XQB_0 2024-09-12T18:13:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.439+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2654106571150034421', time=2024-09-12T19:46:13.886404+0000, chain.objs.size()=1 2024-09-12T18:13:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.439+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.2r5-H0L5YipuHzY9fJHHVuj4UAsHi0I_0 2024-09-12T18:13:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.439+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16671994989520378675', time=2024-09-12T19:46:14.003970+0000, chain.objs.size()=1 2024-09-12T18:13:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.439+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.eZJxlSeteoCOcsqJgnv90HUOpqcateN_0 2024-09-12T18:13:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.439+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14781847393628863366', time=2024-09-12T19:46:14.158931+0000, chain.objs.size()=1 2024-09-12T18:13:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.439+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.tj37e-78-fmshJSiR-DdAK69tpU1ESm_0 2024-09-12T18:13:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.439+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3076444840107663334', time=2024-09-12T19:46:14.783780+0000, chain.objs.size()=1 2024-09-12T18:13:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.439+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.F5NcLZbALCuibyIOXZDYXxqTWOdzY0v_0 2024-09-12T18:13:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.439+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14647009413617495412', time=2024-09-12T19:46:14.785488+0000, chain.objs.size()=1 2024-09-12T18:13:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.439+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.B5pnVeSndEVtmB5koP0RF8Geqj-E6QJ_0 2024-09-12T18:13:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.439+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10244540772808269419', time=2024-09-12T19:46:14.940809+0000, chain.objs.size()=1 2024-09-12T18:13:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.439+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Vt8lc9-FRTSdV0B63W6mymL_SOWoXUW_0 2024-09-12T18:13:48.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.439+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9638319826885633064', time=2024-09-12T19:46:15.166500+0000, chain.objs.size()=1 2024-09-12T18:13:48.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.439+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Dr6Ar3afU5daR0WsUME6YmjF_VJoE3L_0 2024-09-12T18:13:48.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.439+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4930504887042064379', time=2024-09-12T19:46:15.235615+0000, chain.objs.size()=1 2024-09-12T18:13:48.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.439+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.y3QJ08lddGlnoD5vkhvoOf1ll-PWbFB_0 2024-09-12T18:13:48.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.439+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9756870504177818393', time=2024-09-12T19:46:15.769844+0000, chain.objs.size()=1 2024-09-12T18:13:48.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.439+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.OOLEJahPFqtzJ1wEpPnAr90y1GbkzDx_0 2024-09-12T18:13:48.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.439+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4416789215368406803', time=2024-09-12T19:46:16.151517+0000, chain.objs.size()=1 2024-09-12T18:13:48.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.439+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ADwYrgvK1qQBQtfHz1tguG07DA7Y3U4_0 2024-09-12T18:13:48.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.440+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5181066712189166200', time=2024-09-12T19:46:16.152278+0000, chain.objs.size()=1 2024-09-12T18:13:48.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.440+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.uKiVz9WzNjcKbDTBuDFSPjsgoCjf5p__0 2024-09-12T18:13:48.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.441+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14846978552616802754', time=2024-09-12T19:46:16.922244+0000, chain.objs.size()=1 2024-09-12T18:13:48.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.441+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Cr4F2aMPhwj38mO62XUP-trWuaAV1mn_0 2024-09-12T18:13:48.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.441+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13036475980345714426', time=2024-09-12T19:46:16.950377+0000, chain.objs.size()=1 2024-09-12T18:13:48.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.441+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.DiiAO_ktvoHeJytsgFF79MVFUexGJ15_0 2024-09-12T18:13:48.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.441+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2788075867900609380', time=2024-09-12T19:46:17.130623+0000, chain.objs.size()=1 2024-09-12T18:13:48.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.441+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.JCeu5cqaIpor4OvMFi0DP4GBW8ohMpH_0 2024-09-12T18:13:48.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.441+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18439508573448089251', time=2024-09-12T19:46:17.596952+0000, chain.objs.size()=1 2024-09-12T18:13:48.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.441+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.YpEmEIT225T7O4Dj0aOLQ-bTGpAJoJr_0 2024-09-12T18:13:48.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.441+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16450070042113287877', time=2024-09-12T19:46:17.842001+0000, chain.objs.size()=1 2024-09-12T18:13:48.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.441+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.yRZhiCF8BbF5u2STpWYVOrNCflHd2s6_0 2024-09-12T18:13:48.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.442+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11792583347359198092', time=2024-09-12T19:46:18.837742+0000, chain.objs.size()=1 2024-09-12T18:13:48.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.442+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Cc7wAXHGrADlpM778FiwMuAVpwXyRal_0 2024-09-12T18:13:48.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.442+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1344513219105383621', time=2024-09-12T19:46:19.002711+0000, chain.objs.size()=1 2024-09-12T18:13:48.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.442+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.QzruwUz4uuWZJp3dQY0wI46eBRcYQjL_0 2024-09-12T18:13:48.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.442+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14972027265630106007', time=2024-09-12T19:46:19.561026+0000, chain.objs.size()=1 2024-09-12T18:13:48.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.442+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Iu0YzLcsWImAZpKcONCNKnF2C1rX4___0 2024-09-12T18:13:48.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.442+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7320965028749102559', time=2024-09-12T19:46:26.603651+0000, chain.objs.size()=1 2024-09-12T18:13:48.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.442+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.271__shadow_.ZYu2_QkTK2A-E7FGnDTNQlgLkteOsso_0 2024-09-12T18:13:48.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.442+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16149519773020919411', time=2024-09-12T19:46:31.021803+0000, chain.objs.size()=1 2024-09-12T18:13:48.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.442+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.276__shadow_.kvNbaM5vouB1MaXNyXKN5y7mTj-mcSj_0 2024-09-12T18:13:48.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.442+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17566366481083976642', time=2024-09-12T19:46:39.221167+0000, chain.objs.size()=1 2024-09-12T18:13:48.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.442+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.285__shadow_.ibeHoIM3TeT4PlH1_nZ2Z9PyB_HYFDF_0 2024-09-12T18:13:48.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.443+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8027332845813162578', time=2024-09-12T19:46:41.155645+0000, chain.objs.size()=1 2024-09-12T18:13:48.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.443+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.287__shadow_.FgaR-eufV0J_5h2X4xgmrX4qimlUM7m_0 2024-09-12T18:13:48.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.443+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15664699770071896595', time=2024-09-12T19:46:54.082568+0000, chain.objs.size()=1 2024-09-12T18:13:48.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.443+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.298__shadow_.EGjPPq9YDue8QpbgeJIFhSgUx-N3odQ_0 2024-09-12T18:13:48.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.443+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12609398326065560068', time=2024-09-12T19:46:58.811295+0000, chain.objs.size()=1 2024-09-12T18:13:48.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.443+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.303__shadow_.RguJ9yKWXfUJkVcO_qtxNf_N6ujQrxK_0 2024-09-12T18:13:48.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.444+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12274820914440823111', time=2024-09-12T19:47:59.450923+0000, chain.objs.size()=1 2024-09-12T18:13:48.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.444+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.PjG3A08RJi1mgic--I0tiLJqRyBYO-U_0 2024-09-12T18:13:48.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.444+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11757985963999007728', time=2024-09-12T19:48:00.997370+0000, chain.objs.size()=1 2024-09-12T18:13:48.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.444+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.qdJkbr0s09Nt3Rh2Wgw_I1wc8lH5Mi4_0 2024-09-12T18:13:48.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.444+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7618988750673345747', time=2024-09-12T19:48:01.820182+0000, chain.objs.size()=1 2024-09-12T18:13:48.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.444+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.YslUPNLqqeWgQd8HISmEFxD2oz6_JGf_0 2024-09-12T18:13:48.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.444+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11339155226858969464', time=2024-09-12T19:48:02.446484+0000, chain.objs.size()=1 2024-09-12T18:13:48.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.444+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.HJwWOAZ6YbJjFaZxaJJbXEzR6FPQRuh_0 2024-09-12T18:13:48.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.444+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.574816498448674858', time=2024-09-12T19:48:02.489811+0000, chain.objs.size()=1 2024-09-12T18:13:48.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.444+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ZMMmwtfxdJvioF8MaE-C-2XyCj6ubcI_0 2024-09-12T18:13:48.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.444+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9874156969428243122', time=2024-09-12T19:48:03.301851+0000, chain.objs.size()=1 2024-09-12T18:13:48.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.444+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.cmcwuQ3zbzfLaN-S8yfx149aHFwm0AA_0 2024-09-12T18:13:48.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.444+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15424890000801036995', time=2024-09-12T19:48:03.338005+0000, chain.objs.size()=1 2024-09-12T18:13:48.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.444+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.wZvKrx8A_tC6V509aRaNRNgQxwIXu7o_0 2024-09-12T18:13:48.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.444+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11337198892601176976', time=2024-09-12T19:48:04.209872+0000, chain.objs.size()=1 2024-09-12T18:13:48.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.444+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.oRpPkMXCNQSkORUpr6REJDOQDXNF8lc_0 2024-09-12T18:13:48.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.444+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9469338049969772400', time=2024-09-12T19:48:04.817805+0000, chain.objs.size()=1 2024-09-12T18:13:48.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.444+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.MVK1z-KxOecTNwaOHR9Gt3AGScUXF08_0 2024-09-12T18:13:48.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.445+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16091804989667865661', time=2024-09-12T19:48:05.370099+0000, chain.objs.size()=1 2024-09-12T18:13:48.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.445+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ZjXnw2YnIUrAc4gp8jpQTtdOqrNYVrw_0 2024-09-12T18:13:48.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.446+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9329704596219030741', time=2024-09-12T19:48:06.004736+0000, chain.objs.size()=1 2024-09-12T18:13:48.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.446+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.kGu8fSy3aV-uR2dH0hbYahL_jApx14a_0 2024-09-12T18:13:48.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.446+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5506426648138953783', time=2024-09-12T19:48:06.202170+0000, chain.objs.size()=1 2024-09-12T18:13:48.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.446+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.9ncTHwHKy_oybNVscL4jgOHirm3og4w_0 2024-09-12T18:13:48.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.447+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7570086922629860249', time=2024-09-12T19:48:06.687416+0000, chain.objs.size()=1 2024-09-12T18:13:48.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.447+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.xzgCBNQYIIPqnotKRzX6sM7sQWby6_D_0 2024-09-12T18:13:48.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.447+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11231889782560513096', time=2024-09-12T19:48:06.940444+0000, chain.objs.size()=1 2024-09-12T18:13:48.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.447+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.dMMftFK-cbmI-NhTf73FzXv3l7NmQD4_0 2024-09-12T18:13:48.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.448+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16825100093721193009', time=2024-09-12T19:48:08.094425+0000, chain.objs.size()=1 2024-09-12T18:13:48.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.448+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.nK2YDLLcoQwxjJy8cgFyNXrDIgogIIQ_0 2024-09-12T18:13:48.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.448+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9836006563748349404', time=2024-09-12T19:48:08.187929+0000, chain.objs.size()=1 2024-09-12T18:13:48.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.448+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.GV4YfZ_vh6zseBZdTgmbJA3TLgqR8s7_0 2024-09-12T18:13:48.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.448+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8199409774329608401', time=2024-09-12T19:48:09.303447+0000, chain.objs.size()=1 2024-09-12T18:13:48.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.448+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.hfupQniWAsMua315m8jgrNDv5UnbjVB_0 2024-09-12T18:13:48.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.448+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11652371423558898664', time=2024-09-12T19:48:47.632289+0000, chain.objs.size()=1 2024-09-12T18:13:48.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.448+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.XVpzoWdkW0Ka3Se-VPhx9rfNub3DVdZ_0 2024-09-12T18:13:48.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.448+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9978250980762523318', time=2024-09-12T19:48:47.752275+0000, chain.objs.size()=1 2024-09-12T18:13:48.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.448+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.e7iK8zMYiLQhFWXOKMA9G5LhKQ_R8aV_0 2024-09-12T18:13:48.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.448+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10447316450084780985', time=2024-09-12T19:48:48.240569+0000, chain.objs.size()=1 2024-09-12T18:13:48.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.448+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.DNQafQzqZh6aVvPkkuyxeIRJwFExqTX_0 2024-09-12T18:13:48.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.448+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14071553481876386215', time=2024-09-12T19:48:48.328937+0000, chain.objs.size()=1 2024-09-12T18:13:48.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.448+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.vgJTtcUhuoTb7Kbjit9sMv-xSdANdKw_0 2024-09-12T18:13:48.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.448+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17125968854310744999', time=2024-09-12T19:48:49.020016+0000, chain.objs.size()=1 2024-09-12T18:13:48.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.448+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.8LRK-hMHiLj82HTe933VuVjuhM-vHQd_0 2024-09-12T18:13:48.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.448+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12771695795218493235', time=2024-09-12T19:48:49.095378+0000, chain.objs.size()=1 2024-09-12T18:13:48.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.448+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.BmaZeRhwZukr9wLgAy2cg89cPuzhvk9_0 2024-09-12T18:13:48.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.448+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10557118311463427813', time=2024-09-12T19:48:49.096245+0000, chain.objs.size()=1 2024-09-12T18:13:48.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.448+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.v2OLI6T2TytUqi9yxVA_-DtIe8U3EGs_0 2024-09-12T18:13:48.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.448+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15736607901467310430', time=2024-09-12T19:48:49.249453+0000, chain.objs.size()=1 2024-09-12T18:13:48.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.448+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.w50Epsz0k4N-EnsDzVzgZwFRQdzi-A__0 2024-09-12T18:13:48.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.450+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7477647087014668479', time=2024-09-12T19:48:49.250087+0000, chain.objs.size()=1 2024-09-12T18:13:48.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.450+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.iuzhliXbUeDZDeKV2l3ypnD9JB8LMSJ_0 2024-09-12T18:13:48.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.450+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2763609403828086458', time=2024-09-12T19:48:49.685823+0000, chain.objs.size()=1 2024-09-12T18:13:48.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.450+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.r4eYAsI7s2WHEcHWYw3uP_sKQkiOZwH_0 2024-09-12T18:13:48.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.450+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1564861222569745241', time=2024-09-12T19:48:50.509629+0000, chain.objs.size()=1 2024-09-12T18:13:48.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.451+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.0PTm5aAJh-hzjQ2vI1CBdHz3P05ji24_0 2024-09-12T18:13:48.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.451+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10761194012499254207', time=2024-09-12T19:48:50.985935+0000, chain.objs.size()=1 2024-09-12T18:13:48.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.451+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Cu2tbECliU_2RwYGWeGflQf9Ziu5Yve_0 2024-09-12T18:13:48.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.451+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9051972406358869261', time=2024-09-12T19:48:51.046135+0000, chain.objs.size()=1 2024-09-12T18:13:48.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.451+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.axNpFzl6RrtqMEvVin-_NBNOe-BhTII_0 2024-09-12T18:13:48.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.451+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1607163281353152846', time=2024-09-12T19:48:51.251706+0000, chain.objs.size()=1 2024-09-12T18:13:48.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.451+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.QzZwaBhsWO3Gr45f8mChDU9Hr5CZZIM_0 2024-09-12T18:13:48.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.451+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13046274646953278714', time=2024-09-12T19:48:52.750246+0000, chain.objs.size()=1 2024-09-12T18:13:48.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.451+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.inDopFX3FFjFnROGrbMkELPgK-QqxKv_0 2024-09-12T18:13:48.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.451+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7493130934651834337', time=2024-09-12T19:48:53.283097+0000, chain.objs.size()=1 2024-09-12T18:13:48.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.451+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.oEVsSe2Y6bhIWVtlWCyIW9EXrIGf6Os_0 2024-09-12T18:13:48.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.451+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11746540976299062838', time=2024-09-12T19:48:53.857405+0000, chain.objs.size()=1 2024-09-12T18:13:48.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.451+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.FkAPSOnFAkE7r7gWLDQDNkMNDdlS9U6_0 2024-09-12T18:13:48.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.451+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11597347299358571646', time=2024-09-12T19:48:55.365577+0000, chain.objs.size()=1 2024-09-12T18:13:48.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.451+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.JW1OWrDFrmxSUy8idm_brmnhP7CVxCZ_0 2024-09-12T18:13:48.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.451+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13838368309118358447', time=2024-09-12T19:48:55.440236+0000, chain.objs.size()=1 2024-09-12T18:13:48.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.451+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.9bWn02slYtRMhk_FvcZgE2b1UeF3hgn_0 2024-09-12T18:13:48.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.452+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6946288653285836515', time=2024-09-12T19:48:55.445341+0000, chain.objs.size()=1 2024-09-12T18:13:48.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.452+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.m2z2ZuovSsxFs5OOC39J3NhsdVTc_o0_0 2024-09-12T18:13:48.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.452+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17133190548292047116', time=2024-09-12T19:48:55.982775+0000, chain.objs.size()=1 2024-09-12T18:13:48.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.452+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.3BY10gO60jtGz2qv_oDCNin4zsS2qpY_0 2024-09-12T18:13:48.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.453+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.413928019375542192', time=2024-09-12T19:48:56.241771+0000, chain.objs.size()=1 2024-09-12T18:13:48.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.453+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.M2yFYoqtCfeaV3Dgtkb5TFWPFeWRFe__0 2024-09-12T18:13:48.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.453+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2580467457751881365', time=2024-09-12T19:48:56.428928+0000, chain.objs.size()=1 2024-09-12T18:13:48.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.453+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.1RuR797qrvg1w8Yn2NNngB2cO1-91Z0_0 2024-09-12T18:13:48.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.453+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12429287587616434800', time=2024-09-12T19:48:57.586119+0000, chain.objs.size()=1 2024-09-12T18:13:48.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.453+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.mXFVeli2Ojk1CjTy8WzdTvoWVgNVQa1_0 2024-09-12T18:13:48.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.453+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12155118734520669240', time=2024-09-12T19:48:58.002131+0000, chain.objs.size()=1 2024-09-12T18:13:48.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.453+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.EpGoGbaF6BFxoJspkWBelBsrCjBpW-5_0 2024-09-12T18:13:48.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.453+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5632747383653165197', time=2024-09-12T19:49:35.024232+0000, chain.objs.size()=1 2024-09-12T18:13:48.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.453+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.371__shadow_.9pVM9yKjYeyiF3fT1YbmK0C0Ymyx51K_0 2024-09-12T18:13:48.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.453+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6244123627753594478', time=2024-09-12T19:50:34.573262+0000, chain.objs.size()=1 2024-09-12T18:13:48.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.453+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.437__shadow_.HWnFTcnZ_HXlWYtnK7aqEL2bpdwoTFB_0 2024-09-12T18:13:48.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.453+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16622841480866269324', time=2024-09-12T19:50:37.195004+0000, chain.objs.size()=1 2024-09-12T18:13:48.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.453+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.440__shadow_.HiVoys7ek0rI1HS_NofJ-tE7mu6bI4o_0 2024-09-12T18:13:48.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.453+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4591954522269025829', time=2024-09-12T19:51:30.369006+0000, chain.objs.size()=1 2024-09-12T18:13:48.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.453+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.492__shadow_.SFyLicxyWbxjuQYVBtbCQheiF0ZLYxb_0 2024-09-12T18:13:48.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.453+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~Sja3wHCUU0GvuvITnj1cFRAL3LKWIEP', time=2024-09-12T19:56:09.688807+0000, chain.objs.size()=1 2024-09-12T18:13:48.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.453+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.532__multipart_mymultipart.2~Sja3wHCUU0GvuvITnj1cFRAL3LKWIEP.1 2024-09-12T18:13:48.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.455+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10846731066540432978', time=2024-09-12T19:57:00.701388+0000, chain.objs.size()=1 2024-09-12T18:13:48.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.455+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.551__shadow_.8DenNRflmA-GIjW0gr2Jo3r9C8C6e0D_0 2024-09-12T18:13:48.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.455+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9825059804743535938', time=2024-09-12T19:57:17.383880+0000, chain.objs.size()=1 2024-09-12T18:13:48.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.455+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.555__shadow_.7oicPq5QmVaV4kMheEXxg1vouvT2kyw_0 2024-09-12T18:13:48.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.455+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10382707307654490902', time=2024-09-12T19:57:31.453699+0000, chain.objs.size()=1 2024-09-12T18:13:48.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.455+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.558__shadow_.Oo1xKx9MkOBlExHfuxQOt-oXOGztYym_0 2024-09-12T18:13:48.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.455+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2066743797376555436', time=2024-09-12T19:58:05.633488+0000, chain.objs.size()=1 2024-09-12T18:13:48.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.455+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:5GmiM-f49Znr4nuykdrE8bLA2tJufLr_.lXbqnkd3ErQ9sVe45u0chitZ9gU2O6D_0 2024-09-12T18:13:48.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.455+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12511341112452569297', time=2024-09-12T19:58:24.587225+0000, chain.objs.size()=1 2024-09-12T18:13:48.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.455+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.577__shadow:.R4Kl11akvkKwWKt7goOfZ1Rh7O9tNT_.cFGlUOjhxid7Gc_sSI0paUmgB-0gdkR_0 2024-09-12T18:13:48.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.455+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17585040331121735763', time=2024-09-12T19:58:34.410633+0000, chain.objs.size()=1 2024-09-12T18:13:48.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.455+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:Qapjv7B.nHZP6qtG.hfY2Z-4M2K9y46_.a1B2_gOWXsN7syOnkCTjlSloSdcLiLq_0 2024-09-12T18:13:48.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.455+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17478882443001977745', time=2024-09-12T19:58:39.035568+0000, chain.objs.size()=1 2024-09-12T18:13:48.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.455+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:HoZtztxPHUxW.yBZF42Q.YMGeN7EPVn_.NGCYLa2Jk-K9kvKqOYNdFoVjtowsN5y_0 2024-09-12T18:13:48.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.455+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14958380937493169506', time=2024-09-12T19:59:23.022354+0000, chain.objs.size()=4 2024-09-12T18:13:48.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.455+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.579__multipart_testobj.2~zfhJOQx7upBE1D2VDFCOuRhAZ86CErr.1 2024-09-12T18:13:48.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.456+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.579__multipart_testobj.2~zfhJOQx7upBE1D2VDFCOuRhAZ86CErr.2 2024-09-12T18:13:48.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.456+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.579__multipart_testobj.2~zfhJOQx7upBE1D2VDFCOuRhAZ86CErr.3 2024-09-12T18:13:48.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.456+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.579__multipart_testobj.2~zfhJOQx7upBE1D2VDFCOuRhAZ86CErr.4 2024-09-12T18:13:48.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.456+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9864236273254937562', time=2024-09-12T19:59:48.155007+0000, chain.objs.size()=1 2024-09-12T18:13:48.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.456+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.597__shadow_.9QrTBXvaVqMRi-pJIaRuHvm8IqailIb_0 2024-09-12T18:13:48.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.457+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~MAfFR3_GxDSy8vY1gDFc2H9EUA9qb3l', time=2024-09-12T20:04:41.314561+0000, chain.objs.size()=12 2024-09-12T18:13:48.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.457+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.625__multipart_multipart_enc.2~MAfFR3_GxDSy8vY1gDFc2H9EUA9qb3l.1 2024-09-12T18:13:48.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.457+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.625__shadow_multipart_enc.2~MAfFR3_GxDSy8vY1gDFc2H9EUA9qb3l.1_1 2024-09-12T18:13:48.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.457+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.625__multipart_multipart_enc.2~MAfFR3_GxDSy8vY1gDFc2H9EUA9qb3l.2 2024-09-12T18:13:48.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.458+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.625__shadow_multipart_enc.2~MAfFR3_GxDSy8vY1gDFc2H9EUA9qb3l.2_1 2024-09-12T18:13:48.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.458+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.625__multipart_multipart_enc.2~MAfFR3_GxDSy8vY1gDFc2H9EUA9qb3l.3 2024-09-12T18:13:48.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.458+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.625__shadow_multipart_enc.2~MAfFR3_GxDSy8vY1gDFc2H9EUA9qb3l.3_1 2024-09-12T18:13:48.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.458+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.625__multipart_multipart_enc.2~MAfFR3_GxDSy8vY1gDFc2H9EUA9qb3l.4 2024-09-12T18:13:48.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.460+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.625__shadow_multipart_enc.2~MAfFR3_GxDSy8vY1gDFc2H9EUA9qb3l.4_1 2024-09-12T18:13:48.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.460+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.625__multipart_multipart_enc.2~MAfFR3_GxDSy8vY1gDFc2H9EUA9qb3l.5 2024-09-12T18:13:48.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.460+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.625__shadow_multipart_enc.2~MAfFR3_GxDSy8vY1gDFc2H9EUA9qb3l.5_1 2024-09-12T18:13:48.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.460+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.625__multipart_multipart_enc.2~MAfFR3_GxDSy8vY1gDFc2H9EUA9qb3l.6 2024-09-12T18:13:48.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.460+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.625__shadow_multipart_enc.2~MAfFR3_GxDSy8vY1gDFc2H9EUA9qb3l.6_1 2024-09-12T18:13:48.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.460+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5625271034773111822', time=2024-09-12T20:05:16.369020+0000, chain.objs.size()=1 2024-09-12T18:13:48.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.460+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.647__shadow_.PhBTLfrYBJJI1DtUVCFCdel0DGQGcc8_0 2024-09-12T18:13:48.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.460+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18201004849527814691', time=2024-09-12T20:05:31.411891+0000, chain.objs.size()=1 2024-09-12T18:13:48.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.460+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.655__shadow_.T5GwGB3MQ_YlFv17khfb0lgeHH7oFpq_0 2024-09-12T18:13:48.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.463+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5229081605365508656', time=2024-09-12T20:06:09.322493+0000, chain.objs.size()=1 2024-09-12T18:13:48.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.463+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.672__shadow_.nzqb4aYWUCNSiI6Lj4zEp9ZCm8k2UE6_0 2024-09-12T18:13:48.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.468+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:48.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.471+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:13:48.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.472+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:48.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.473+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:48.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.473+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48221' 2024-09-12T18:13:48.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.473+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7409315660573953682', time=2024-09-12T19:41:24.517726+0000, chain.objs.size()=1 2024-09-12T18:13:48.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.473+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.159__shadow_.-X4WfR6PXkuTZ7gCkJ0q0YkNAVO0zu9_0 2024-09-12T18:13:48.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.473+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11717276644024161116', time=2024-09-12T19:45:08.048614+0000, chain.objs.size()=1 2024-09-12T18:13:48.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.473+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.238__shadow_.f4UC03Gik6RgNC_Z-ajTXzYUodjvtJk_0 2024-09-12T18:13:48.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.473+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17489621753463014605', time=2024-09-12T19:46:08.778570+0000, chain.objs.size()=1 2024-09-12T18:13:48.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.473+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.izdTXfzFByzOmG4V7uNoKdS5kg_E2yg_0 2024-09-12T18:13:48.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.473+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10061991970652217444', time=2024-09-12T19:46:08.962578+0000, chain.objs.size()=1 2024-09-12T18:13:48.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.473+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.McjX9dKBt__IInvSLVUWCyGvQ7FyGKf_0 2024-09-12T18:13:48.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.473+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6509253389447073174', time=2024-09-12T19:46:09.100186+0000, chain.objs.size()=1 2024-09-12T18:13:48.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.473+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.EueXGN0eRJvTWtmRMXzdY4LxVdmAZX6_0 2024-09-12T18:13:48.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.473+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7773033287537393967', time=2024-09-12T19:46:09.131790+0000, chain.objs.size()=1 2024-09-12T18:13:48.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.474+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.9UfQKGH8UYzQFdj3ZV60fy56R1IMxc8_0 2024-09-12T18:13:48.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.474+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4789516680482979993', time=2024-09-12T19:46:09.274143+0000, chain.objs.size()=1 2024-09-12T18:13:48.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.474+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.7cTJ5cENrvmpjtKMe_CtwzUoODlP5W5_0 2024-09-12T18:13:48.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.474+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11576503494602941509', time=2024-09-12T19:46:09.477651+0000, chain.objs.size()=1 2024-09-12T18:13:48.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.474+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.PRwtpn5d_x3_Hw7dxBL_ua0n2R37xRY_0 2024-09-12T18:13:48.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.474+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1781393787749015107', time=2024-09-12T19:46:09.741184+0000, chain.objs.size()=1 2024-09-12T18:13:48.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.474+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.qO9cRuJ0At0MMV0R1oafEJVwM1HRrBV_0 2024-09-12T18:13:48.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.474+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5959798190592247673', time=2024-09-12T19:46:11.889008+0000, chain.objs.size()=1 2024-09-12T18:13:48.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.474+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.XgDvIvmvKaT35jz569jlvDvNrG42L1u_0 2024-09-12T18:13:48.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.474+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7611549078953545965', time=2024-09-12T19:46:12.016141+0000, chain.objs.size()=1 2024-09-12T18:13:48.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.474+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Pp-t5MHRzXZ9GWO7P8DwzKWR53uySQt_0 2024-09-12T18:13:48.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.474+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3991234302119547903', time=2024-09-12T19:46:12.128099+0000, chain.objs.size()=1 2024-09-12T18:13:48.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.474+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.MU15ccT_4cWfzJo_VuNT4R_qQGdKIgQ_0 2024-09-12T18:13:48.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.478+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16396667854137697646', time=2024-09-12T19:46:12.813374+0000, chain.objs.size()=1 2024-09-12T18:13:48.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.478+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.JQHuWrIJgaPGZ59GbPvzWU8nYQW27Mb_0 2024-09-12T18:13:48.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.478+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13544839266987488194', time=2024-09-12T19:46:13.491482+0000, chain.objs.size()=1 2024-09-12T18:13:48.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.478+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.fY-0BRK2SZ_7-WFidiKnhtT_uiuxJez_0 2024-09-12T18:13:48.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.478+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9899226305597988058', time=2024-09-12T19:46:13.527159+0000, chain.objs.size()=1 2024-09-12T18:13:48.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.478+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ebF9Xx6j6kk1CLFsLi0cZCmag8tu4PC_0 2024-09-12T18:13:48.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.478+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18033796802758727472', time=2024-09-12T19:46:13.659725+0000, chain.objs.size()=1 2024-09-12T18:13:48.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.478+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.vc0a4zJ1Xps1QreImI5bl-GruOH-eEx_0 2024-09-12T18:13:48.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.478+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5734310140498327139', time=2024-09-12T19:46:14.215787+0000, chain.objs.size()=1 2024-09-12T18:13:48.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.478+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.9v-Nml9XDTr9AYcMMk9sDsa0xY2i2u0_0 2024-09-12T18:13:48.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.478+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2195256574650780165', time=2024-09-12T19:46:14.216542+0000, chain.objs.size()=1 2024-09-12T18:13:48.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.478+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.3DTw_5kkBqnaQ28QlF4r9ICwCOUxcTw_0 2024-09-12T18:13:48.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.478+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14903306467292239162', time=2024-09-12T19:46:14.313843+0000, chain.objs.size()=1 2024-09-12T18:13:48.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.478+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.o0RolEnVcfmSprAqCIcL6iMHxTnNFzw_0 2024-09-12T18:13:48.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.478+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15231845058250243162', time=2024-09-12T19:46:15.308937+0000, chain.objs.size()=1 2024-09-12T18:13:48.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.478+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.hb1310ewqzMRCnuuD8oQY_nhmAKoOWM_0 2024-09-12T18:13:48.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.478+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.676284279938802422', time=2024-09-12T19:46:16.251669+0000, chain.objs.size()=1 2024-09-12T18:13:48.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.478+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.qWxcNio5D4MIAPYC6Cz_lnK5S7BxI_t_0 2024-09-12T18:13:48.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.478+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16840593706042901852', time=2024-09-12T19:46:16.970524+0000, chain.objs.size()=1 2024-09-12T18:13:48.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.478+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.0o4d5QLoWHlisAYbetDdZ7JtU2npHdj_0 2024-09-12T18:13:48.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.478+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17161179946055426409', time=2024-09-12T19:46:18.081956+0000, chain.objs.size()=1 2024-09-12T18:13:48.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.478+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.8_Cg5EAGBWxqAnuoxKbHuvpfIdwVLAm_0 2024-09-12T18:13:48.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.480+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.870977010324786256', time=2024-09-12T19:46:18.409153+0000, chain.objs.size()=1 2024-09-12T18:13:48.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.480+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.BD52_gVTIjafyjmVkcecC7ApNMbL2SV_0 2024-09-12T18:13:48.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.480+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7066449541450285251', time=2024-09-12T19:46:19.040478+0000, chain.objs.size()=1 2024-09-12T18:13:48.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.480+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.lqBIzV5t_6KT8HI2o1wj2bsZ9SOJeUy_0 2024-09-12T18:13:48.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.481+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8852229873754862932', time=2024-09-12T19:46:29.186086+0000, chain.objs.size()=1 2024-09-12T18:13:48.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.481+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.274__shadow_.8Jbv-1NFCJj5rRB79lLGXE0_npuZybj_0 2024-09-12T18:13:48.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.481+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15659498841804478325', time=2024-09-12T19:46:31.922356+0000, chain.objs.size()=1 2024-09-12T18:13:48.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.481+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.277__shadow_.o-ll0R2fTm8tXyWXoKHabgqTjkOn3RW_0 2024-09-12T18:13:48.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.481+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18128678610531670409', time=2024-09-12T19:46:42.097448+0000, chain.objs.size()=1 2024-09-12T18:13:48.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.481+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.288__shadow_.8_f2Df466WWCQxkxahbyiRG9XT9sH5T_0 2024-09-12T18:13:48.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.481+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16079809853154337166', time=2024-09-12T19:46:42.996837+0000, chain.objs.size()=1 2024-09-12T18:13:48.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.481+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.289__shadow_.RqJFXAfSmhTvUrQwxYHzPpnxcpMB_jl_0 2024-09-12T18:13:48.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.481+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.530023983389771899', time=2024-09-12T19:46:48.225197+0000, chain.objs.size()=1 2024-09-12T18:13:48.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.481+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.293__shadow_.P4B3l779WiePtlnnegprfn363awjN8N_0 2024-09-12T18:13:48.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.481+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5063903150537167114', time=2024-09-12T19:46:50.295475+0000, chain.objs.size()=1 2024-09-12T18:13:48.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.481+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.294__shadow_.EXB7-loOAPBwJFid66UIKGGSebCZeTP_0 2024-09-12T18:13:48.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.481+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16837774224780484203', time=2024-09-12T19:47:18.613998+0000, chain.objs.size()=1 2024-09-12T18:13:48.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.481+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.320__shadow:yuzbq40CQLa2qEdNywHJ2hJJVmTHHqN_.CRNYs2uno6uV2TcCfUewWs0pjBxzozb_0 2024-09-12T18:13:48.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.481+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12253105939618875405', time=2024-09-12T19:47:59.454141+0000, chain.objs.size()=1 2024-09-12T18:13:48.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.481+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.4jjz-6w1ykr0rAIBfDnV4pBxWjgf4WU_0 2024-09-12T18:13:48.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.481+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1818433746714600737', time=2024-09-12T19:47:59.760910+0000, chain.objs.size()=1 2024-09-12T18:13:48.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.481+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.RWZ8iRva75hnqLbicfZk5S88w5u-Ale_0 2024-09-12T18:13:48.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.481+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11633556139141288157', time=2024-09-12T19:48:00.162378+0000, chain.objs.size()=1 2024-09-12T18:13:48.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.481+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.jf1r39sjU44Q0FCX2YhtHON2w0Z3Gex_0 2024-09-12T18:13:48.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.481+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.627609504970728967', time=2024-09-12T19:48:00.467897+0000, chain.objs.size()=1 2024-09-12T18:13:48.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.481+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.YKh1aT8LzODQD7JApgX1mU8Qu2-_dUi_0 2024-09-12T18:13:48.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.482+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17474098325245016310', time=2024-09-12T19:48:01.197039+0000, chain.objs.size()=1 2024-09-12T18:13:48.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.482+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.o7YAlhz0eOz7jdg8jcKF4n1V8K5MEWM_0 2024-09-12T18:13:48.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.483+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11754641717378360934', time=2024-09-12T19:48:01.669549+0000, chain.objs.size()=1 2024-09-12T18:13:48.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.483+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ziyqo_KqaS8TBR7G1YRIxv24twbPmjh_0 2024-09-12T18:13:48.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.483+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4721226715833511267', time=2024-09-12T19:48:02.617974+0000, chain.objs.size()=1 2024-09-12T18:13:48.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.483+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.LXjcQDwz_5DvksJQLf06ob3c-CGNSWi_0 2024-09-12T18:13:48.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.483+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.701953741552673179', time=2024-09-12T19:48:04.075624+0000, chain.objs.size()=1 2024-09-12T18:13:48.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.483+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.S6tEzLo0uToz4nTlTkS-tFJkDSneVgA_0 2024-09-12T18:13:48.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.483+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5865632662267915615', time=2024-09-12T19:48:04.122222+0000, chain.objs.size()=1 2024-09-12T18:13:48.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.483+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ESeDkzSbDhPfrddojOJZQdHuA6V5soP_0 2024-09-12T18:13:48.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.483+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7859806423511882685', time=2024-09-12T19:48:04.342854+0000, chain.objs.size()=1 2024-09-12T18:13:48.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.483+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.4XnlQK1PZz1Kx1xZcnB1NcKrF_oh5B1_0 2024-09-12T18:13:48.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.483+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15492824850480563123', time=2024-09-12T19:48:04.407089+0000, chain.objs.size()=1 2024-09-12T18:13:48.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.483+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.CLAv_5Q4wIQJM_6MZYQtSjNv6VY2xHB_0 2024-09-12T18:13:48.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.486+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1875767834072332559', time=2024-09-12T19:48:04.614086+0000, chain.objs.size()=1 2024-09-12T18:13:48.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.486+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Cw41kgXbgijXMfPpaE0qPy2lRg63leh_0 2024-09-12T18:13:48.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.486+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4210671086781627151', time=2024-09-12T19:48:04.821944+0000, chain.objs.size()=1 2024-09-12T18:13:48.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.486+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.vgbbX3p8kzuweUlMuXwy5S4gpAFBuWx_0 2024-09-12T18:13:48.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.486+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2902143874221938143', time=2024-09-12T19:48:05.750078+0000, chain.objs.size()=1 2024-09-12T18:13:48.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.486+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ooIvETa7clOgfSNQn1uZmHhinwhdIqG_0 2024-09-12T18:13:48.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.486+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11250767241411238859', time=2024-09-12T19:48:06.701853+0000, chain.objs.size()=1 2024-09-12T18:13:48.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.486+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.s69kqPJyS_BClggVp-mnyeC55JfSvi3_0 2024-09-12T18:13:48.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.486+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16648736524517741819', time=2024-09-12T19:48:07.494687+0000, chain.objs.size()=1 2024-09-12T18:13:48.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.486+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.OEu7-Yl0kXqC4mG6ZPdp0QvL0dmw1T0_0 2024-09-12T18:13:48.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.486+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2157381289548937989', time=2024-09-12T19:48:08.171969+0000, chain.objs.size()=1 2024-09-12T18:13:48.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.486+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.wq18IvgKhlad9WCrUwJKhM0QoKrjPAS_0 2024-09-12T18:13:48.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.486+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14820546279514488708', time=2024-09-12T19:48:08.451825+0000, chain.objs.size()=1 2024-09-12T18:13:48.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.486+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.f8pZ4y_vqWgpIz0k6k8di3MM7qwn2B7_0 2024-09-12T18:13:48.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.486+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14954103795200684564', time=2024-09-12T19:48:08.659995+0000, chain.objs.size()=1 2024-09-12T18:13:48.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.486+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.mi6b0_jAczxTyjOm6QCOj8hwgzzGV7r_0 2024-09-12T18:13:48.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.486+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10063518358139282096', time=2024-09-12T19:48:09.809121+0000, chain.objs.size()=1 2024-09-12T18:13:48.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.486+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.72fWEo8K9-BBy5lEAYqMyUAefXX6Xnf_0 2024-09-12T18:13:48.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.486+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6586337727084690343', time=2024-09-12T19:48:09.903008+0000, chain.objs.size()=1 2024-09-12T18:13:48.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.486+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.1gLxFaLzGPWnaUjCttgdPtomzAsy7g9_0 2024-09-12T18:13:48.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.487+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8910668175780588236', time=2024-09-12T19:48:10.043691+0000, chain.objs.size()=1 2024-09-12T18:13:48.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.487+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.-I4XYNNG1YNE_EamByuPM7cOsLw7Jwt_0 2024-09-12T18:13:48.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.489+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6820865697516072599', time=2024-09-12T19:48:10.084522+0000, chain.objs.size()=1 2024-09-12T18:13:48.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.489+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.11ofUyauRezqX1Z7KBPoYg_5UCmGZhw_0 2024-09-12T18:13:48.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.489+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.811776609780751253', time=2024-09-12T19:48:47.491563+0000, chain.objs.size()=1 2024-09-12T18:13:48.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.489+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.cLux1QqrkIfFFzSojQBl1wJ5xYS7Fns_0 2024-09-12T18:13:48.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.489+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8697529146652362420', time=2024-09-12T19:48:47.565293+0000, chain.objs.size()=1 2024-09-12T18:13:48.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.489+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_._pGiO3Bjg2MS8EBNxd9PwSucFJ1b4w1_0 2024-09-12T18:13:48.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.489+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17338402828975194155', time=2024-09-12T19:48:47.686828+0000, chain.objs.size()=1 2024-09-12T18:13:48.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.489+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.pGealVuHpJPwKKNK95qwoviwBSX0J_j_0 2024-09-12T18:13:48.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.489+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7848921589830131927', time=2024-09-12T19:48:47.714536+0000, chain.objs.size()=1 2024-09-12T18:13:48.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.489+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.7Yxs2LJKUsDpyhQpNLD_4ezs7RsSI9c_0 2024-09-12T18:13:48.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.489+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15013186605062397840', time=2024-09-12T19:48:47.992958+0000, chain.objs.size()=1 2024-09-12T18:13:48.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.489+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.0a1HCIdo9ik7vcMspu1EPJ3a1yo0B_i_0 2024-09-12T18:13:48.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.489+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14892401505088742435', time=2024-09-12T19:48:48.976933+0000, chain.objs.size()=1 2024-09-12T18:13:48.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.489+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Ik2pUzO8aJXhIZb9NmkqLdDhSHhGYWt_0 2024-09-12T18:13:48.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.489+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1518886231483823315', time=2024-09-12T19:48:49.480697+0000, chain.objs.size()=1 2024-09-12T18:13:48.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.489+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.d8WtUTVif6m91zF0lHIgnabfxmcf8Ud_0 2024-09-12T18:13:48.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.489+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7882211622159478633', time=2024-09-12T19:48:49.688676+0000, chain.objs.size()=1 2024-09-12T18:13:48.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.489+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.d90zjVMjPRyZyQEv94x3Et9G6KFOy2M_0 2024-09-12T18:13:48.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.489+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7976401041426333510', time=2024-09-12T19:48:50.746906+0000, chain.objs.size()=1 2024-09-12T18:13:48.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.489+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.36Fv4BfUDWn0qatWkNSiqi2NAv3TTVy_0 2024-09-12T18:13:48.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.489+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11397577663151348004', time=2024-09-12T19:48:50.902618+0000, chain.objs.size()=1 2024-09-12T18:13:48.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.489+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Edqv7ax3iiSEZ0P7CbukP6gLcKx8kEu_0 2024-09-12T18:13:48.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.492+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6604603161191280212', time=2024-09-12T19:48:51.003145+0000, chain.objs.size()=1 2024-09-12T18:13:48.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.492+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.iuozl3wglbchRdpyR060Vq5fHkWjMAR_0 2024-09-12T18:13:48.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.492+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17368332115437896862', time=2024-09-12T19:48:51.174091+0000, chain.objs.size()=1 2024-09-12T18:13:48.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.492+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.9RGz08eae_Nku7v-lHCEqWF_4JzVi_g_0 2024-09-12T18:13:48.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.492+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12276507187631631325', time=2024-09-12T19:48:51.372634+0000, chain.objs.size()=1 2024-09-12T18:13:48.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.492+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ZY6diGrWYwLLIYCcKd6Vf0ucWmhXCdE_0 2024-09-12T18:13:48.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.492+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1085482092408738485', time=2024-09-12T19:48:51.477489+0000, chain.objs.size()=1 2024-09-12T18:13:48.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.492+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Zru0IwXek4oq0Zj2xybioGSisYes4xg_0 2024-09-12T18:13:48.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.492+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15374618831978597929', time=2024-09-12T19:48:51.958476+0000, chain.objs.size()=1 2024-09-12T18:13:48.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.492+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.xZ08CgmqQC2662ylIBE2TkzY9C0wmzM_0 2024-09-12T18:13:48.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.492+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5885457196735987491', time=2024-09-12T19:48:52.797620+0000, chain.objs.size()=1 2024-09-12T18:13:48.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.492+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.8RlSSj_wgfjynaAiVAFuL0AENrRUIIV_0 2024-09-12T18:13:48.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.492+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11114166945218005155', time=2024-09-12T19:48:52.818183+0000, chain.objs.size()=1 2024-09-12T18:13:48.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.492+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.8dCxjTIpME_5nbLWLsaYo7Ceb7bv42A_0 2024-09-12T18:13:48.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.492+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6054705701798112567', time=2024-09-12T19:48:52.903247+0000, chain.objs.size()=1 2024-09-12T18:13:48.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.492+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.e3j-GhiTXsVajH8F6WbH-w6dIx8s2J4_0 2024-09-12T18:13:48.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.492+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12661395292824628007', time=2024-09-12T19:48:53.304988+0000, chain.objs.size()=1 2024-09-12T18:13:48.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.492+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.w4BRbH8IDyyvOn4MFNe5fgE8CQdzuqZ_0 2024-09-12T18:13:48.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.492+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14427224343036930912', time=2024-09-12T19:48:53.305503+0000, chain.objs.size()=1 2024-09-12T18:13:48.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.492+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.6Y22RFc8rnjGRFbxXaUZjXUakZOKjp2_0 2024-09-12T18:13:48.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.492+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9027829106744532397', time=2024-09-12T19:48:53.336259+0000, chain.objs.size()=1 2024-09-12T18:13:48.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.492+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.3SIeehns76sCf7hBVxLhAdYyAXAFEHO_0 2024-09-12T18:13:48.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.493+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8658235478303738321', time=2024-09-12T19:48:53.680889+0000, chain.objs.size()=1 2024-09-12T18:13:48.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.493+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.hvEB_u5D7o4mWQJDBMHrDZgKSAV4DEZ_0 2024-09-12T18:13:48.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.495+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11504129628341767399', time=2024-09-12T19:48:53.802446+0000, chain.objs.size()=1 2024-09-12T18:13:48.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.495+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.W8P4p0ewXzl56wPg_eryi1xXGPoHX-U_0 2024-09-12T18:13:48.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.495+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.965240509767267821', time=2024-09-12T19:48:55.952950+0000, chain.objs.size()=1 2024-09-12T18:13:48.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.495+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.WOA1EtrMN_31AGxUcFHJi8f-l-ZdfYZ_0 2024-09-12T18:13:48.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.495+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17481817474821286771', time=2024-09-12T19:48:56.164988+0000, chain.objs.size()=1 2024-09-12T18:13:48.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.495+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.HBFZAcPRX9-AV3hP7rXzvo6cEAoXKLA_0 2024-09-12T18:13:48.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.495+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15423314824251163830', time=2024-09-12T19:48:56.477655+0000, chain.objs.size()=1 2024-09-12T18:13:48.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.495+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.jkNniAMWUrqXxl4gL5RTXsfICUrbY0Q_0 2024-09-12T18:13:48.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.495+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2216846949348944358', time=2024-09-12T19:48:56.738880+0000, chain.objs.size()=1 2024-09-12T18:13:48.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.495+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.AFVPbbI6xs26xJFglyiApBYgJrsQnkk_0 2024-09-12T18:13:48.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.495+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13391578161911249775', time=2024-09-12T19:48:56.921953+0000, chain.objs.size()=1 2024-09-12T18:13:48.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.495+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.rq0STLvxrLxiWrpFArOlTvLgqeFG6hf_0 2024-09-12T18:13:48.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.495+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17322862476306125767', time=2024-09-12T19:48:56.937461+0000, chain.objs.size()=1 2024-09-12T18:13:48.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.495+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.-03DpFdsD1i4x1rGrBYkrg2K57iZtbV_0 2024-09-12T18:13:48.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.495+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16624891635123869282', time=2024-09-12T19:48:57.238319+0000, chain.objs.size()=1 2024-09-12T18:13:48.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.495+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.BfYX7Ut28bEqte9FhloVGdRG4WtTxio_0 2024-09-12T18:13:48.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.495+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18129278409555744180', time=2024-09-12T19:48:57.545523+0000, chain.objs.size()=1 2024-09-12T18:13:48.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.495+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.FfuZCX4OnuV7LhrSye3ay6fJg_2737I_0 2024-09-12T18:13:48.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.495+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17156521025427374421', time=2024-09-12T19:48:57.624383+0000, chain.objs.size()=1 2024-09-12T18:13:48.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.495+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.jBPefgyDzAiyEzKUZjWXXr48mTIavwT_0 2024-09-12T18:13:48.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.495+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10802608530820391024', time=2024-09-12T19:48:57.820658+0000, chain.objs.size()=1 2024-09-12T18:13:48.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.495+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.72xtvsYleqdDu6viEHAwAE58LfN_ar3_0 2024-09-12T18:13:48.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.496+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13979424565671814303', time=2024-09-12T19:48:58.031531+0000, chain.objs.size()=1 2024-09-12T18:13:48.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.496+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.mlX6lKALO-yXgKz1YECr3_CgZxoQaSc_0 2024-09-12T18:13:48.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.498+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6104582406999808716', time=2024-09-12T19:49:41.109878+0000, chain.objs.size()=1 2024-09-12T18:13:48.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.498+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.377__shadow_.qxJYJwXEbRgRcFpEyFvdZHtPtN2kJDq_0 2024-09-12T18:13:48.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.498+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8782882116954693225', time=2024-09-12T19:50:09.442885+0000, chain.objs.size()=1 2024-09-12T18:13:48.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.498+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.408__shadow_.smka5Gds2AvOCUqhSsqNzay8aNHx5lU_0 2024-09-12T18:13:48.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.498+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15554230706072457685', time=2024-09-12T19:51:26.485958+0000, chain.objs.size()=1 2024-09-12T18:13:48.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.498+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.488__shadow_.OA1xtT4a7UAnSi6kRQ4KbGrX8PFIlo6_0 2024-09-12T18:13:48.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.498+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9077079151986488651', time=2024-09-12T19:51:35.148396+0000, chain.objs.size()=1 2024-09-12T18:13:48.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.498+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.498__shadow_.gEW-hUnPNiAzlPo7t7akSlihTVqlwpY_0 2024-09-12T18:13:48.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.498+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9606694906277630710', time=2024-09-12T19:51:36.684994+0000, chain.objs.size()=1 2024-09-12T18:13:48.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.498+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.500__shadow_.fNJgxy9SfkI8mcueWZ08eiOTagaWBHl_0 2024-09-12T18:13:48.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.498+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4695256436651168370', time=2024-09-12T19:52:11.219588+0000, chain.objs.size()=6 2024-09-12T18:13:48.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.498+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.1 2024-09-12T18:13:48.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.498+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.2 2024-09-12T18:13:48.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.498+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.3 2024-09-12T18:13:48.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.498+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.4 2024-09-12T18:13:48.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.498+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.5 2024-09-12T18:13:48.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.498+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.6 2024-09-12T18:13:48.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.501+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17755017352090103330', time=2024-09-12T19:52:52.842675+0000, chain.objs.size()=6 2024-09-12T18:13:48.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.501+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.520__multipart_mymultipart.2~lVWWe20vzOicOG2PMgixXofUQHlTjiU.1 2024-09-12T18:13:48.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.501+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.520__multipart_mymultipart.2~lVWWe20vzOicOG2PMgixXofUQHlTjiU.2 2024-09-12T18:13:48.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.501+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.520__multipart_mymultipart.2~lVWWe20vzOicOG2PMgixXofUQHlTjiU.3 2024-09-12T18:13:48.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.501+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.520__multipart_mymultipart.2~lVWWe20vzOicOG2PMgixXofUQHlTjiU.4 2024-09-12T18:13:48.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.501+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.520__multipart_mymultipart.2~lVWWe20vzOicOG2PMgixXofUQHlTjiU.5 2024-09-12T18:13:48.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.501+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.520__multipart_mymultipart.2~lVWWe20vzOicOG2PMgixXofUQHlTjiU.6 2024-09-12T18:13:48.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.501+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15396092468552137042', time=2024-09-12T19:57:18.141901+0000, chain.objs.size()=1 2024-09-12T18:13:48.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.501+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.555__shadow_.8cFeMXi6a_q1-ZpKfo09aWA2fJaB_Xh_0 2024-09-12T18:13:48.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.501+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10679014044983930717', time=2024-09-12T19:57:41.872636+0000, chain.objs.size()=1 2024-09-12T18:13:48.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.501+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.561__shadow_.9Q794lpjxQHlK4lRGIOfjQ-is-HvJZ0_0 2024-09-12T18:13:48.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.501+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4540723914669149535', time=2024-09-12T19:58:33.053998+0000, chain.objs.size()=1 2024-09-12T18:13:48.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.501+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:zUtso25mNaIJCnv9G8gJ3frak5BHw6F_.pV1A-8lsLD_COmzIStpImbPlvT5CtZo_0 2024-09-12T18:13:48.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.501+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1722908803358442489', time=2024-09-12T19:59:32.412997+0000, chain.objs.size()=1 2024-09-12T18:13:48.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.501+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.581__shadow:PxtTY6zDjyBHKb9UO7QqAfd0p1ZH1zl_.3hOil_IKSSU_ejz9wFrHDZtfEplNEsw_0 2024-09-12T18:13:48.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.503+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/48221 2024-09-12T18:13:48.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.506+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:13:48.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.506+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14303137630769105316', time=2024-09-12T20:06:22.725948+0000, chain.objs.size()=1 2024-09-12T18:13:48.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.506+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.691__shadow:4fqoDvM9MhbO63MEdvQbTMg6p9DZYAs_.NDbAS_vegrVkiVlrzuSMdwbgq4n-rfa_0 2024-09-12T18:13:48.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.507+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:48.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.509+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:13:48.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.510+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:48.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.511+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:48.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.511+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/55778' 2024-09-12T18:13:48.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.511+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12439239968011440728', time=2024-09-12T19:41:24.492667+0000, chain.objs.size()=3 2024-09-12T18:13:48.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.511+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.159__shadow_.RTwrhbDJ_B0kj4dlhIYs70ga5xq2Uwr_0 2024-09-12T18:13:48.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.511+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.159__shadow_.RTwrhbDJ_B0kj4dlhIYs70ga5xq2Uwr_1 2024-09-12T18:13:48.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.511+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.159__shadow_.RTwrhbDJ_B0kj4dlhIYs70ga5xq2Uwr_2 2024-09-12T18:13:48.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.511+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1044196477802309799', time=2024-09-12T19:41:40.887320+0000, chain.objs.size()=3 2024-09-12T18:13:48.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.511+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.161__shadow_.I4vghHPL9B1bjdp4RtWOt0QZYYZGmaL_0 2024-09-12T18:13:48.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.511+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.161__shadow_.I4vghHPL9B1bjdp4RtWOt0QZYYZGmaL_1 2024-09-12T18:13:48.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.511+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.161__shadow_.I4vghHPL9B1bjdp4RtWOt0QZYYZGmaL_2 2024-09-12T18:13:48.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.511+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='_3I3FwGXjpZTGBNbQcwy9TbgH_8SwxEk', time=2024-09-12T19:42:10.703048+0000, chain.objs.size()=3 2024-09-12T18:13:48.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.511+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__shadow_.euWFeFzWiITczKDxZd6A-ATJYQNGh_d_0 2024-09-12T18:13:48.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.511+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__shadow_.euWFeFzWiITczKDxZd6A-ATJYQNGh_d_1 2024-09-12T18:13:48.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.512+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__shadow_.euWFeFzWiITczKDxZd6A-ATJYQNGh_d_2 2024-09-12T18:13:48.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.512+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='_J3jbQzcfm2qHm0adgQp24m7yud31CJy', time=2024-09-12T19:42:23.124873+0000, chain.objs.size()=1 2024-09-12T18:13:48.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.512+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.166__shadow_.VpzPM88_UUYhrzRfNK1WBGsiRNTLAXA_0 2024-09-12T18:13:48.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.512+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9348845108842762639', time=2024-09-12T19:42:45.508053+0000, chain.objs.size()=1 2024-09-12T18:13:48.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.512+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.183__shadow_.Hi6DboO6P6dwALVtpTNk0hnXkNAwY7i_0 2024-09-12T18:13:48.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.512+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.911908491368996171', time=2024-09-12T19:45:18.183697+0000, chain.objs.size()=1 2024-09-12T18:13:48.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.512+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.247__shadow_.NqlUl3X0lDxT2KCEBwPo9nYvnw4fQ-l_0 2024-09-12T18:13:48.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.515+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.687285003482499325', time=2024-09-12T19:45:22.735236+0000, chain.objs.size()=1 2024-09-12T18:13:48.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.515+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.252__shadow_.awRg7x2cCgZQHDUlzktwR4HwIk9hbDE_0 2024-09-12T18:13:48.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.516+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.631782033926146467', time=2024-09-12T19:45:25.492468+0000, chain.objs.size()=1 2024-09-12T18:13:48.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.516+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.255__shadow_.FXWTfyG6UWSA3cDJnuUg1HwN2kQXOV__0 2024-09-12T18:13:48.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.516+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1826494638775476159', time=2024-09-12T19:46:09.267338+0000, chain.objs.size()=1 2024-09-12T18:13:48.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.516+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.fwjUCxzB9F4_DVDkpuJwxbklMz5eQKe_0 2024-09-12T18:13:48.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.516+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11401548818841787241', time=2024-09-12T19:46:09.430024+0000, chain.objs.size()=1 2024-09-12T18:13:48.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.516+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.RfxUzwRbNIcwPazWW8UGry5l-lLFoyH_0 2024-09-12T18:13:48.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.516+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16906767364830816408', time=2024-09-12T19:46:09.610728+0000, chain.objs.size()=1 2024-09-12T18:13:48.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.516+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.5zlP9A2Ci2xVzBRID0JeBdza9qYhvnp_0 2024-09-12T18:13:48.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.516+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5805108304072033905', time=2024-09-12T19:46:10.381581+0000, chain.objs.size()=1 2024-09-12T18:13:48.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.516+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.XfLeWYORqADAXTxz_GT2WX0sNae3TjK_0 2024-09-12T18:13:48.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.516+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9300602861940944720', time=2024-09-12T19:46:10.531063+0000, chain.objs.size()=1 2024-09-12T18:13:48.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.516+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.TdJ-L1q7MZQkNxicLe2O-gIZIVQL5nj_0 2024-09-12T18:13:48.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.516+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13264229385717630048', time=2024-09-12T19:46:10.636881+0000, chain.objs.size()=1 2024-09-12T18:13:48.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.516+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.2EV1Z373bDaSTtBjcrrwlXB-dykSieG_0 2024-09-12T18:13:48.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.516+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16996832447199919558', time=2024-09-12T19:46:10.808290+0000, chain.objs.size()=1 2024-09-12T18:13:48.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.516+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.IitRtQA3XR5PWh2vUln0fAXecTQ6lKu_0 2024-09-12T18:13:48.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.516+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.156072114449368983', time=2024-09-12T19:46:11.051641+0000, chain.objs.size()=1 2024-09-12T18:13:48.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.516+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.6lrEIlpJtMh5or8xLwanI7Ws4Eyt5gY_0 2024-09-12T18:13:48.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.516+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10394167527575132115', time=2024-09-12T19:46:11.171951+0000, chain.objs.size()=1 2024-09-12T18:13:48.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.516+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.6GSqxl_JnVCzjjiVIwbBeYQkLjJv4a2_0 2024-09-12T18:13:48.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.517+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1018552030273732392', time=2024-09-12T19:46:11.221937+0000, chain.objs.size()=1 2024-09-12T18:13:48.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.517+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.4dHzNj1QulmjA9DRyy8dbNlB713OHhQ_0 2024-09-12T18:13:48.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.517+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11856894264254062806', time=2024-09-12T19:46:11.876113+0000, chain.objs.size()=1 2024-09-12T18:13:48.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.517+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.0x9yGWDhk3ZBlkERoCeIaUtua5qvHcg_0 2024-09-12T18:13:48.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.518+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7805566839209599216', time=2024-09-12T19:46:12.295939+0000, chain.objs.size()=1 2024-09-12T18:13:48.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.518+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.VTL7zwcMRc0INo3kG8fivQluVjvPbgH_0 2024-09-12T18:13:48.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.518+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18204999054340599171', time=2024-09-12T19:46:12.840264+0000, chain.objs.size()=1 2024-09-12T18:13:48.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.518+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.iG_446JSjPGznoRlRa4mIKCwuSW_gQR_0 2024-09-12T18:13:48.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.518+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17778517073736131565', time=2024-09-12T19:46:13.367041+0000, chain.objs.size()=1 2024-09-12T18:13:48.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.518+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.BDlQKhqSZwvhewPtuz-ClnKejX8O8CB_0 2024-09-12T18:13:48.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.521+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11561688022121815071', time=2024-09-12T19:46:13.800915+0000, chain.objs.size()=1 2024-09-12T18:13:48.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.521+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_._-s6Xe2_glSrBN7r2psFo6eHCEVpbmP_0 2024-09-12T18:13:48.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.521+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14664939236353256829', time=2024-09-12T19:46:14.778939+0000, chain.objs.size()=1 2024-09-12T18:13:48.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.521+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.qnqXW9KIYjFAeZHCX1nK0651bh_0yJb_0 2024-09-12T18:13:48.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.521+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8879716167997082491', time=2024-09-12T19:46:14.916287+0000, chain.objs.size()=1 2024-09-12T18:13:48.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.521+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_._U4v8PUoTxzZSdEzeYtZY-IUH5uFUmu_0 2024-09-12T18:13:48.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.521+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5028887191421147549', time=2024-09-12T19:46:15.081280+0000, chain.objs.size()=1 2024-09-12T18:13:48.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.521+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.S5k75GZWzoo5fr6mcN7ub1iK3n8T5OK_0 2024-09-12T18:13:48.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.521+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2855339582886047595', time=2024-09-12T19:46:15.475095+0000, chain.objs.size()=1 2024-09-12T18:13:48.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.521+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Hctgt53p1Y3BM1ZWrlRF8ePePBnzRUU_0 2024-09-12T18:13:48.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.521+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11772563847767499705', time=2024-09-12T19:46:15.543216+0000, chain.objs.size()=1 2024-09-12T18:13:48.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.521+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.aguI5ep2-AOkwAXP2x6rJy6YrDF-PeM_0 2024-09-12T18:13:48.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.521+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6043750619081560079', time=2024-09-12T19:46:15.704044+0000, chain.objs.size()=1 2024-09-12T18:13:48.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.521+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.sfb--s-8Z-YaND2uYo5QEC0iBYNuEsT_0 2024-09-12T18:13:48.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.521+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5360777532366397931', time=2024-09-12T19:46:16.150151+0000, chain.objs.size()=1 2024-09-12T18:13:48.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.521+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.psNDoja1uL9DQvdpTSCUDiuEM9SVUCu_0 2024-09-12T18:13:48.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.521+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5180330220466258073', time=2024-09-12T19:46:16.393254+0000, chain.objs.size()=1 2024-09-12T18:13:48.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.521+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.gs8L1Yn5JB86Tqcc8vaYTMGMFJOuoQM_0 2024-09-12T18:13:48.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.521+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9912410684912446117', time=2024-09-12T19:46:16.443390+0000, chain.objs.size()=1 2024-09-12T18:13:48.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.521+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.g6V-SpzCleXgS6hsCISmoJ90l_SrnUF_0 2024-09-12T18:13:48.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.521+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8178309182207293983', time=2024-09-12T19:46:16.527978+0000, chain.objs.size()=1 2024-09-12T18:13:48.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.521+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.dItjfneKlD184UyP8pREyjbP03ajGP__0 2024-09-12T18:13:48.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.523+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.177244469594321302', time=2024-09-12T19:46:17.129212+0000, chain.objs.size()=1 2024-09-12T18:13:48.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.523+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.QdxvkM4zmojtKTiJ61PlQwnIkuCcPWN_0 2024-09-12T18:13:48.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.523+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3552723827877015353', time=2024-09-12T19:46:17.523768+0000, chain.objs.size()=1 2024-09-12T18:13:48.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.523+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.2AW_LUVqbQ5DnP6gg2546PW_wqYegxb_0 2024-09-12T18:13:48.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.523+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7065028639185471959', time=2024-09-12T19:46:17.594969+0000, chain.objs.size()=1 2024-09-12T18:13:48.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.523+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.juxQJhx-uJX9YEedcoiOcn87bW_akRT_0 2024-09-12T18:13:48.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.523+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10044792680325590273', time=2024-09-12T19:46:17.794222+0000, chain.objs.size()=1 2024-09-12T18:13:48.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.523+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.c_g0QG-aklhKDURJQXfcBiHuidZeFuz_0 2024-09-12T18:13:48.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.523+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1849917267302742147', time=2024-09-12T19:46:17.885149+0000, chain.objs.size()=1 2024-09-12T18:13:48.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.524+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.vK4B-jlfwdbWElpmoCmVJb2vnssWh4M_0 2024-09-12T18:13:48.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.524+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8520253190406399232', time=2024-09-12T19:46:18.004017+0000, chain.objs.size()=1 2024-09-12T18:13:48.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.524+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.UEHhkGVemHtVz4mV2C5niuh8n2TQI0b_0 2024-09-12T18:13:48.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.524+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5010763260414423562', time=2024-09-12T19:46:18.243867+0000, chain.objs.size()=1 2024-09-12T18:13:48.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.524+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.-9Miy-4lSomXRIAaAXEY2vGev6nwFzE_0 2024-09-12T18:13:48.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.524+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16882848706648882868', time=2024-09-12T19:46:18.755429+0000, chain.objs.size()=1 2024-09-12T18:13:48.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.524+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.z4fFwNR9gP0C6V6FSL9EU9FAutV3K7f_0 2024-09-12T18:13:48.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.524+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4260843567220731796', time=2024-09-12T19:46:18.798010+0000, chain.objs.size()=1 2024-09-12T18:13:48.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.524+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.wNdCqOrP_51CtMbOVYYT7tq39l-p411_0 2024-09-12T18:13:48.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.524+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8790557854809306291', time=2024-09-12T19:46:19.466247+0000, chain.objs.size()=1 2024-09-12T18:13:48.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.524+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.-6wNbgf4Iiu8jruk_Nv00Mzk4WQeF1x_0 2024-09-12T18:13:48.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.524+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5780626517583778828', time=2024-09-12T19:46:33.738829+0000, chain.objs.size()=1 2024-09-12T18:13:48.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.524+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.279__shadow_.yr-1gUH4Sp-VWpW1RIEE-uFReEI7hIv_0 2024-09-12T18:13:48.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.524+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17473755517600186661', time=2024-09-12T19:46:48.124669+0000, chain.objs.size()=1 2024-09-12T18:13:48.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.524+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.293__shadow_.2WQk5cMK77rEOf5ZdbyuMFGZgBHIArm_0 2024-09-12T18:13:48.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.525+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5934145374254388119', time=2024-09-12T19:47:02.745840+0000, chain.objs.size()=1 2024-09-12T18:13:48.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.525+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.307__shadow_.CT4V3W4Ny1F6L71ywMG5eOpyHXrki_V_0 2024-09-12T18:13:48.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.525+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17794440076625950917', time=2024-09-12T19:47:59.484669+0000, chain.objs.size()=1 2024-09-12T18:13:48.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.525+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.EUW1iazvOVOQ9AUNF9J-_c2xwL6J1b6_0 2024-09-12T18:13:48.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.525+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9215381537711366914', time=2024-09-12T19:47:59.834433+0000, chain.objs.size()=1 2024-09-12T18:13:48.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.525+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Znmu7iMMZTJGIUP0b3DaqsTiGeunNw5_0 2024-09-12T18:13:48.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.525+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10781573199089342823', time=2024-09-12T19:48:00.159283+0000, chain.objs.size()=1 2024-09-12T18:13:48.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.525+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.qjXU0agAsWfPhCGMvhT306RXi1Cdv0x_0 2024-09-12T18:13:48.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.526+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16821955199567598205', time=2024-09-12T19:48:00.426854+0000, chain.objs.size()=1 2024-09-12T18:13:48.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.526+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.0Nhhsh4XX23wnVtnTV_6kSs-ag69P5R_0 2024-09-12T18:13:48.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.526+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.404372582964302396', time=2024-09-12T19:48:01.016707+0000, chain.objs.size()=1 2024-09-12T18:13:48.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.526+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.WwacpY8rULVjD6B-Rx62mM5fkZ1ZBf1_0 2024-09-12T18:13:48.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.528+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2725370055121930839', time=2024-09-12T19:48:01.588644+0000, chain.objs.size()=1 2024-09-12T18:13:48.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.528+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.VkROv8AfmksePTF2brZWxvfjR1vx3kq_0 2024-09-12T18:13:48.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.528+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12647025469637541741', time=2024-09-12T19:48:01.684886+0000, chain.objs.size()=1 2024-09-12T18:13:48.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.528+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.J06IrXE5w_Jo_ZaSsKscx3Ul3PfdFb9_0 2024-09-12T18:13:48.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.528+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18100988808409005499', time=2024-09-12T19:48:01.711244+0000, chain.objs.size()=1 2024-09-12T18:13:48.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.528+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.1Nwe3CX5hp_iz2edAgew3RzI5BN_PM2_0 2024-09-12T18:13:48.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.528+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6834511566087895352', time=2024-09-12T19:48:02.536203+0000, chain.objs.size()=1 2024-09-12T18:13:48.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.528+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.F3l3YjxlOhuGayw5YcBDdCM7C2oJxQu_0 2024-09-12T18:13:48.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.528+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15580691117873207390', time=2024-09-12T19:48:02.974854+0000, chain.objs.size()=1 2024-09-12T18:13:48.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.528+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.WQRCLIRt0vHVhmNWlk7wp0Cc4lzLb2o_0 2024-09-12T18:13:48.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.529+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11618182239232331799', time=2024-09-12T19:48:03.143059+0000, chain.objs.size()=1 2024-09-12T18:13:48.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.529+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.3X6M9J5OJkmae_FNjexpHBW9zjgLq4d_0 2024-09-12T18:13:48.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.529+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6405731474381023049', time=2024-09-12T19:48:03.347981+0000, chain.objs.size()=1 2024-09-12T18:13:48.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.529+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.OlZ-SLOQKaztPpVEB8L94IvPSrCF5X1_0 2024-09-12T18:13:48.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.529+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13475279816035146300', time=2024-09-12T19:48:03.458596+0000, chain.objs.size()=1 2024-09-12T18:13:48.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.529+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Q27VUMo5GLwzIvxaAMhZUzGa4HzsbV__0 2024-09-12T18:13:48.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.529+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17053912538941555999', time=2024-09-12T19:48:03.919166+0000, chain.objs.size()=1 2024-09-12T18:13:48.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.529+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.OkLhoXYO0aVKxF7EXGuJDrAeeazBlYM_0 2024-09-12T18:13:48.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.529+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17803214512219893708', time=2024-09-12T19:48:04.048223+0000, chain.objs.size()=1 2024-09-12T18:13:48.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.529+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.amy2GGWwsBqV49OO5OB-0EAWPMrW03k_0 2024-09-12T18:13:48.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.529+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.311999607628231134', time=2024-09-12T19:48:04.048919+0000, chain.objs.size()=1 2024-09-12T18:13:48.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.529+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Y7yzFcY7ocqPBM0Re4tOKskgFWjRDvw_0 2024-09-12T18:13:48.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.531+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11792082586761032581', time=2024-09-12T19:48:04.859159+0000, chain.objs.size()=1 2024-09-12T18:13:48.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.531+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.tSUy35eU7OBm6l_97kut5qXdPOTMyMt_0 2024-09-12T18:13:48.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.531+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11724820123768375271', time=2024-09-12T19:48:05.253736+0000, chain.objs.size()=1 2024-09-12T18:13:48.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.531+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.WwccZts_e1nLc8Uzg-ZCZxsykuf10e2_0 2024-09-12T18:13:48.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.531+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12501140843932773126', time=2024-09-12T19:48:05.303455+0000, chain.objs.size()=1 2024-09-12T18:13:48.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.531+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.zjnKYFreVtDcpP1U-isHUE9qGCtdNJ3_0 2024-09-12T18:13:48.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.531+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.592422263366078575', time=2024-09-12T19:48:05.462910+0000, chain.objs.size()=1 2024-09-12T18:13:48.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.531+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ifEuJAc8dwNy5vrTXFTbTr_GJAk16tF_0 2024-09-12T18:13:48.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.531+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4504015860488593673', time=2024-09-12T19:48:05.582393+0000, chain.objs.size()=1 2024-09-12T18:13:48.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.531+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.F7tbNXmzpRvrcTPxOW8Fm9A_7pG2jnx_0 2024-09-12T18:13:48.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.531+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4295137047054299059', time=2024-09-12T19:48:05.594866+0000, chain.objs.size()=1 2024-09-12T18:13:48.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.531+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.qZwQm8mAERiMI7Ja_jCaGQ0nU_EmEPN_0 2024-09-12T18:13:48.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.531+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8897682150345488328', time=2024-09-12T19:48:06.027793+0000, chain.objs.size()=1 2024-09-12T18:13:48.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.531+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.fZIR9EEpNXiP3pOxXywZ5tVF0y6nVVD_0 2024-09-12T18:13:48.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.531+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3412061386399165608', time=2024-09-12T19:48:06.124042+0000, chain.objs.size()=1 2024-09-12T18:13:48.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.531+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.IIzbPia2GWZoxuXykTv_10Qk51hWqZ-_0 2024-09-12T18:13:48.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.531+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8443897121712455653', time=2024-09-12T19:48:06.124833+0000, chain.objs.size()=1 2024-09-12T18:13:48.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.531+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.fSOajsphoOxJ3whq7e47xC2Ebm1AkY4_0 2024-09-12T18:13:48.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.531+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12703914307136317649', time=2024-09-12T19:48:06.641998+0000, chain.objs.size()=1 2024-09-12T18:13:48.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.531+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.lD54BSS84InFqYEOVvOwsS-uK45JcCY_0 2024-09-12T18:13:48.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.531+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10763700813400697344', time=2024-09-12T19:48:06.812868+0000, chain.objs.size()=1 2024-09-12T18:13:48.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.531+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.FJ0gnhqrrS7i_K5ibgEx4oLQ90hJ0ap_0 2024-09-12T18:13:48.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.533+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11055082906986032763', time=2024-09-12T19:48:07.101638+0000, chain.objs.size()=1 2024-09-12T18:13:48.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.533+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.c-VFtrQOT_KA8lCEgtD4eNCKsrn0G_l_0 2024-09-12T18:13:48.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.533+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16731163325735133129', time=2024-09-12T19:48:07.247117+0000, chain.objs.size()=1 2024-09-12T18:13:48.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.533+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.UBv8C8JZABXFT9NcPGKO7xflsKDTBPx_0 2024-09-12T18:13:48.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.533+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10570495701676116959', time=2024-09-12T19:48:07.357174+0000, chain.objs.size()=1 2024-09-12T18:13:48.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.533+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.n6q7CKsDoNB8KJTPU5qUDOV6nkwhZ6a_0 2024-09-12T18:13:48.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.534+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12488697425289665887', time=2024-09-12T19:48:07.379987+0000, chain.objs.size()=1 2024-09-12T18:13:48.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.534+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ojZdj1jq-BUydrKGyXGlPHld744qNUu_0 2024-09-12T18:13:48.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.534+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5543646670722539363', time=2024-09-12T19:48:07.380874+0000, chain.objs.size()=1 2024-09-12T18:13:48.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.534+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.1uta6UHSRym3VTXwpVCwoyflH_Yi3YY_0 2024-09-12T18:13:48.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.534+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15427931424087788547', time=2024-09-12T19:48:07.572045+0000, chain.objs.size()=1 2024-09-12T18:13:48.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.534+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.U7CzY-0B02LoLZH63TzW7Gh_hL79tUr_0 2024-09-12T18:13:48.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.534+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6609540488073076832', time=2024-09-12T19:48:08.030330+0000, chain.objs.size()=1 2024-09-12T18:13:48.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.534+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ukzv7AYqdlkBhBaq4nVegerzowPqr5d_0 2024-09-12T18:13:48.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.534+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8547295772400004031', time=2024-09-12T19:48:08.374130+0000, chain.objs.size()=1 2024-09-12T18:13:48.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.534+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.oE96Th0zuOTK9PPjUTub2nbVKzDCo5u_0 2024-09-12T18:13:48.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.534+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8154107790558203016', time=2024-09-12T19:48:08.556791+0000, chain.objs.size()=1 2024-09-12T18:13:48.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.534+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.YPUihHXoS0PoLoUkeX0oKiUNy-ZPeW-_0 2024-09-12T18:13:48.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.534+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13586263940838267248', time=2024-09-12T19:48:08.688405+0000, chain.objs.size()=1 2024-09-12T18:13:48.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.534+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.vDRE8MJqMdVP3djxFOJYOvRmmH5UDST_0 2024-09-12T18:13:48.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.534+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11354700157999020454', time=2024-09-12T19:48:08.723753+0000, chain.objs.size()=1 2024-09-12T18:13:48.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.534+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.OULAzE7YtIqcuuVJp9N1lTFZHdpLEej_0 2024-09-12T18:13:48.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.534+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11467539471936081237', time=2024-09-12T19:48:09.299178+0000, chain.objs.size()=1 2024-09-12T18:13:48.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.534+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.gXNUGHsCvR-JK-e-qEkM35QgjtIhpbW_0 2024-09-12T18:13:48.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.534+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3765159129696744463', time=2024-09-12T19:48:09.299932+0000, chain.objs.size()=1 2024-09-12T18:13:48.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.534+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.5jwTAAOfFIS0MKjf1Dhd88i32zNxmPm_0 2024-09-12T18:13:48.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.535+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10363221775460462765', time=2024-09-12T19:48:47.517050+0000, chain.objs.size()=1 2024-09-12T18:13:48.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.535+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.7sg2UjNbGPiry9_MqgKiJHPFWC82hOW_0 2024-09-12T18:13:48.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.535+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18316453350745433098', time=2024-09-12T19:48:47.640789+0000, chain.objs.size()=1 2024-09-12T18:13:48.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.535+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.qNrcZgTKSczRrpYCa-bFme9NANd5X2E_0 2024-09-12T18:13:48.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.536+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18068177554863204202', time=2024-09-12T19:48:48.088828+0000, chain.objs.size()=1 2024-09-12T18:13:48.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.536+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.d5HXGP5TgA6zAcJIjlZUcCxd4qCKfHh_0 2024-09-12T18:13:48.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.536+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1162413854434170910', time=2024-09-12T19:48:48.448894+0000, chain.objs.size()=1 2024-09-12T18:13:48.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.536+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.jup5PDd_KQlRH54nUrL1EyTw0rjmODg_0 2024-09-12T18:13:48.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.536+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9645468374854005548', time=2024-09-12T19:48:48.945588+0000, chain.objs.size()=1 2024-09-12T18:13:48.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.536+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.C3SlB1UAJqMRukPCEe609Np6uJZqH44_0 2024-09-12T18:13:48.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.536+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16220028900213639195', time=2024-09-12T19:48:49.205858+0000, chain.objs.size()=1 2024-09-12T18:13:48.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.536+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.1hHbV1gfZsu4YUU58Cy3rUZRWx0PjDK_0 2024-09-12T18:13:48.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.536+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15034096168429399290', time=2024-09-12T19:48:49.250473+0000, chain.objs.size()=1 2024-09-12T18:13:48.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.536+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.87IkN9ale_b6FBFNAGgrwjGr5j_Ic9A_0 2024-09-12T18:13:48.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.536+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6037493743366329955', time=2024-09-12T19:48:49.390886+0000, chain.objs.size()=1 2024-09-12T18:13:48.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.536+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Uin10ixYTbJHNon5eoT5iwgF_t9Vpn0_0 2024-09-12T18:13:48.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.536+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2556177848931664805', time=2024-09-12T19:48:49.655900+0000, chain.objs.size()=1 2024-09-12T18:13:48.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.537+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.hWZvr2-8nGwyF9TD0w32stBbvic7kGe_0 2024-09-12T18:13:48.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.537+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11875339353953549749', time=2024-09-12T19:48:49.695081+0000, chain.objs.size()=1 2024-09-12T18:13:48.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.537+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.42oktxg1IFgCjIkfPBEBzD_q4P7AN82_0 2024-09-12T18:13:48.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.537+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6508617390007879988', time=2024-09-12T19:48:49.951837+0000, chain.objs.size()=1 2024-09-12T18:13:48.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.537+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.KpcBRDrVG2-Y5v_wd1UoQjR--AGPuxK_0 2024-09-12T18:13:48.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.537+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.655738767291111697', time=2024-09-12T19:48:51.435289+0000, chain.objs.size()=1 2024-09-12T18:13:48.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.537+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.yDnWKK9RCAkqfc17xtIGvxcd3pol2Dp_0 2024-09-12T18:13:48.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.537+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5327362558460695685', time=2024-09-12T19:48:52.245592+0000, chain.objs.size()=1 2024-09-12T18:13:48.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.537+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Bkz_AGCbSISabJLqxlfN2PRIS9AyOoC_0 2024-09-12T18:13:48.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.538+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12974324725199049499', time=2024-09-12T19:48:52.350846+0000, chain.objs.size()=1 2024-09-12T18:13:48.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.538+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.iOi7dOqs6sKKWixkgQGA8EzhU_iwJw8_0 2024-09-12T18:13:48.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.542+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/55778 2024-09-12T18:13:48.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.544+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-12T18:13:48.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.544+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9229963768020809376', time=2024-09-12T19:48:52.676708+0000, chain.objs.size()=1 2024-09-12T18:13:48.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.544+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.PW0t6H5nuhqArs3Z1GE8bUI0W4hHP4c_0 2024-09-12T18:13:48.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.544+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.273117922209028720', time=2024-09-12T19:48:52.855483+0000, chain.objs.size()=1 2024-09-12T18:13:48.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.544+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.myaKK89mfM9z6KskE7hMn1eS699l0GS_0 2024-09-12T18:13:48.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.544+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4017448470780854363', time=2024-09-12T19:48:52.881706+0000, chain.objs.size()=1 2024-09-12T18:13:48.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.544+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.LH0hNsgETAsXyB2z2iEn2XCYyzPvDgv_0 2024-09-12T18:13:48.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.544+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2932076993972949455', time=2024-09-12T19:48:53.303478+0000, chain.objs.size()=1 2024-09-12T18:13:48.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.544+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.9VgnYNjruX6uTQOdC24rYOaAcF_ntPV_0 2024-09-12T18:13:48.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.544+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2465960590385461169', time=2024-09-12T19:48:53.633789+0000, chain.objs.size()=1 2024-09-12T18:13:48.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.544+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.WFgqq-P363tQWKFI__jqO2Ck5jX_G59_0 2024-09-12T18:13:48.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.544+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5123051008187601760', time=2024-09-12T19:48:54.112080+0000, chain.objs.size()=1 2024-09-12T18:13:48.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.544+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.nTBzzdvYZ4OyehvIY_ob86KaRwISK1W_0 2024-09-12T18:13:48.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.544+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2781214348400300323', time=2024-09-12T19:48:54.146176+0000, chain.objs.size()=1 2024-09-12T18:13:48.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.544+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.guBsaqJimqPx0_gfJYL5QyOorIKNtv0_0 2024-09-12T18:13:48.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.544+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17832550998362515777', time=2024-09-12T19:48:54.849536+0000, chain.objs.size()=1 2024-09-12T18:13:48.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.544+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.cdxeakjkfnA9u06xanQUziww7YFWO82_0 2024-09-12T18:13:48.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.544+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6329863869697634297', time=2024-09-12T19:48:55.257189+0000, chain.objs.size()=1 2024-09-12T18:13:48.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.544+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.KzUC9gWXxUbVROcLCy35d4GB3rR7E3A_0 2024-09-12T18:13:48.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.544+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15209319966799856677', time=2024-09-12T19:48:55.488181+0000, chain.objs.size()=1 2024-09-12T18:13:48.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.544+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.iYfTiNhGmSeoJHGpm1mcDLGfQvzUJn8_0 2024-09-12T18:13:48.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.544+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2188217377405474441', time=2024-09-12T19:48:55.521539+0000, chain.objs.size()=1 2024-09-12T18:13:48.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.544+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.fkcq65XUF_YntSXfwDtIixZtVKdll3U_0 2024-09-12T18:13:48.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.544+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7199996061934144941', time=2024-09-12T19:48:55.573357+0000, chain.objs.size()=1 2024-09-12T18:13:48.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.544+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.u6jynJXfOzeJYO0xBMeycoonAcbq31f_0 2024-09-12T18:13:48.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.546+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3632039826510520040', time=2024-09-12T19:48:56.131536+0000, chain.objs.size()=1 2024-09-12T18:13:48.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.546+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.R9UeSagFDgcJbgci8iGEayYhbk_-TIW_0 2024-09-12T18:13:48.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.546+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2274934684810686518', time=2024-09-12T19:48:56.393916+0000, chain.objs.size()=1 2024-09-12T18:13:48.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.546+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.DXhwyCwn9WsVE9zeuw1R8T_xbyn_lIw_0 2024-09-12T18:13:48.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.547+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8605792114920472566', time=2024-09-12T19:48:56.394507+0000, chain.objs.size()=1 2024-09-12T18:13:48.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.547+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ec3_pyoiKugvJYkbt_0poWQJUeKjPJS_0 2024-09-12T18:13:48.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.547+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15911262352370117586', time=2024-09-12T19:48:56.748983+0000, chain.objs.size()=1 2024-09-12T18:13:48.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.547+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.k8pLUAuKOF7FCf_0SuMb3a4a-7s8cwa_0 2024-09-12T18:13:48.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.547+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10340240176953745740', time=2024-09-12T19:48:57.288571+0000, chain.objs.size()=1 2024-09-12T18:13:48.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.547+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.M0qGxUeF1kZtdeqGxVkBAv6sc5wWRW7_0 2024-09-12T18:13:48.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.547+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3892103516522544313', time=2024-09-12T19:48:57.700697+0000, chain.objs.size()=1 2024-09-12T18:13:48.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.547+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.4vaJJoZ0pFixXBKJ4kmXAddhQ1La8-z_0 2024-09-12T18:13:48.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.547+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9685938899220946307', time=2024-09-12T19:48:58.015092+0000, chain.objs.size()=1 2024-09-12T18:13:48.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.547+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.2Lj1TLVDs93e61Lqrnn0UMsG7YkpB3Y_0 2024-09-12T18:13:48.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.547+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4222566401031582041', time=2024-09-12T19:50:29.271897+0000, chain.objs.size()=1 2024-09-12T18:13:48.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.547+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.431__shadow_._G4FlA_Y_P4QGulViz0-Y2Tcd7JeMYF_0 2024-09-12T18:13:48.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.547+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5988400411969931376', time=2024-09-12T19:50:59.145195+0000, chain.objs.size()=1 2024-09-12T18:13:48.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.547+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.460__shadow_.-mLnHo6mm5Vm45vjHPA6zOeNn0VAzdO_0 2024-09-12T18:13:48.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.547+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6002152519536681298', time=2024-09-12T19:52:30.843320+0000, chain.objs.size()=1 2024-09-12T18:13:48.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.547+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.519__multipart_mymultipart.2~mZ3jtL4TJBA7FcnICkltXNpLWTAl6gw.1 2024-09-12T18:13:48.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.547+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13959524716215355264', time=2024-09-12T19:58:16.567386+0000, chain.objs.size()=1 2024-09-12T18:13:48.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.547+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.575__shadow:z.zHJozg.0NL2AINhhBegJUvHiA.EMU_.wzoFvYnaQKt3Lo7W71gA2bUi1mwiXb__0 2024-09-12T18:13:48.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.548+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17350577999041716258', time=2024-09-12T19:58:19.277588+0000, chain.objs.size()=1 2024-09-12T18:13:48.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.548+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.576__shadow_.pk9gXeRJvbVxoyf8Bv9bDXvtogyZuFW_0 2024-09-12T18:13:48.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.549+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15196892132567536859', time=2024-09-12T19:58:31.060067+0000, chain.objs.size()=1 2024-09-12T18:13:48.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.549+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:KLZsY0zeSLdvPJU77MC7NiDzPDn3OAQ_.mfeLel2pIp7TphJZrkbuMMWksgLmS2O_0 2024-09-12T18:13:48.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.549+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.628905459216685360', time=2024-09-12T19:58:37.550191+0000, chain.objs.size()=1 2024-09-12T18:13:48.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.549+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:rKRk7z5ScVdcG16Qj6r5Dp4l0lS1tip_.AjI8sVZB1Sb70vFa9bgprPlvaBdB5fk_0 2024-09-12T18:13:48.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.549+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12234489290403182392', time=2024-09-12T19:58:40.257564+0000, chain.objs.size()=1 2024-09-12T18:13:48.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.549+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:RSsYJg29ky.qgq8WBYYJF9Royb-BLwi_.GPNShkCkTQfaba2w-1xXfhzFGPORgPu_0 2024-09-12T18:13:48.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.549+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17046178601677166180', time=2024-09-12T19:58:46.465359+0000, chain.objs.size()=1 2024-09-12T18:13:48.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.549+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:FAzhT.Ep3AhhGWb3fRcAb5du-DUaLVI_.eMSRUaYlIRH-9gDJtqHYOPfcYscxT71_0 2024-09-12T18:13:48.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.549+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10126524986338949130', time=2024-09-12T19:59:29.939838+0000, chain.objs.size()=1 2024-09-12T18:13:48.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.549+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.580__shadow:fIaR8q5wXANn2a1yRmlMp4.kGxklAvj_.coXpuf4GDyyoF0fByNWinQb3vZZpfQU_0 2024-09-12T18:13:48.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.549+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7455523552379021170', time=2024-09-12T19:59:32.605635+0000, chain.objs.size()=1 2024-09-12T18:13:48.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.549+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.581__shadow:UeQ-5Ra3l.edmsxZ-H.QeS6oe4gASyZ_.GnJpbme5dvyNcuhCSDq4-c2PWjamwiP_0 2024-09-12T18:13:48.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.549+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3042514691580771847', time=2024-09-12T20:04:59.752255+0000, chain.objs.size()=1 2024-09-12T18:13:48.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.549+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.636__shadow_.BHLXzPP0gbXpZYw28Zt8H6qEt3o6T7E_0 2024-09-12T18:13:48.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.549+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17686486575329820190', time=2024-09-12T20:06:05.649347+0000, chain.objs.size()=1 2024-09-12T18:13:48.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.549+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.667__shadow_.UKAAQkU94aE4tFs0qTqscCTZAwkYK7Q_0 2024-09-12T18:13:48.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.549+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14645765529815022910', time=2024-09-12T20:07:06.005858+0000, chain.objs.size()=1 2024-09-12T18:13:48.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.549+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.719__shadow_.pRUr_5ev1EJKmODU3H1q5rW5qBLLlqm_0 2024-09-12T18:13:48.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.553+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:48.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.555+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:13:48.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.556+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:48.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.557+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:48.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.558+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50552' 2024-09-12T18:13:48.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.558+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='_oVABqFk55NXUPHah2m-QidUvfo9PAWo', time=2024-09-12T19:41:47.998524+0000, chain.objs.size()=3 2024-09-12T18:13:48.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.558+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.161__shadow_.jT_iszPskxrJOMfnihgfEjfXmjW0Y_K_0 2024-09-12T18:13:48.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.558+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.161__shadow_.jT_iszPskxrJOMfnihgfEjfXmjW0Y_K_1 2024-09-12T18:13:48.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.558+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.161__shadow_.jT_iszPskxrJOMfnihgfEjfXmjW0Y_K_2 2024-09-12T18:13:48.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.558+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='_GGFEoMmJznwQxcL-bpehl5exB0iSQAw', time=2024-09-12T19:42:09.145966+0000, chain.objs.size()=3 2024-09-12T18:13:48.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.558+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__shadow_._nr5QBsuh_ZNLHFs3zOHEHndY_KERvy_0 2024-09-12T18:13:48.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.558+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__shadow_._nr5QBsuh_ZNLHFs3zOHEHndY_KERvy_1 2024-09-12T18:13:48.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.558+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__shadow_._nr5QBsuh_ZNLHFs3zOHEHndY_KERvy_2 2024-09-12T18:13:48.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.558+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13182346443284995506', time=2024-09-12T19:42:50.134357+0000, chain.objs.size()=1 2024-09-12T18:13:48.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.558+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.189__shadow_.wzcXwRFsen2VJzWLj68TvI3AHveLXnm_0 2024-09-12T18:13:48.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.558+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4990869269339200307', time=2024-09-12T19:45:04.607674+0000, chain.objs.size()=1 2024-09-12T18:13:48.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.558+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.235__shadow_.rla-qyX4LbvvqqBPywYkEhqdJY9-GXV_0 2024-09-12T18:13:48.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.558+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5190615759786541515', time=2024-09-12T19:45:04.613583+0000, chain.objs.size()=1 2024-09-12T18:13:48.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.558+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.235__shadow_.a9PP9Ep9ZTzVVgiWih8h0tpR5wpBNho_0 2024-09-12T18:13:48.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.558+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1200184689408963266', time=2024-09-12T19:45:12.211956+0000, chain.objs.size()=1 2024-09-12T18:13:48.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.558+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.242__shadow_.xj7QtcfJFyAJ8YgdvqEscRfss6S3p6N_0 2024-09-12T18:13:48.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.558+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15454046822760743372', time=2024-09-12T19:45:31.763640+0000, chain.objs.size()=1 2024-09-12T18:13:48.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.558+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.262__shadow_.hNGxlg4jzfyzrx5ByPxqjbTd62bh63P_0 2024-09-12T18:13:48.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.558+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10596080579689628599', time=2024-09-12T19:46:08.976734+0000, chain.objs.size()=1 2024-09-12T18:13:48.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.558+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.HGh1x6wfBoU2Vsqg5w5PujS49TcQaj6_0 2024-09-12T18:13:48.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.561+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13377053201143921530', time=2024-09-12T19:46:09.059598+0000, chain.objs.size()=1 2024-09-12T18:13:48.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.561+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.jf7nGWPVZ-FLgRrqZsYtwzrqsUWKGUt_0 2024-09-12T18:13:48.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.561+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14102581708745969836', time=2024-09-12T19:46:09.245598+0000, chain.objs.size()=1 2024-09-12T18:13:48.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.561+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.95D5vfWu6M6v-ae3pLEoAtkspwT6xOQ_0 2024-09-12T18:13:48.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.561+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8506911605468762955', time=2024-09-12T19:46:09.578013+0000, chain.objs.size()=1 2024-09-12T18:13:48.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.561+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.W5zLJSvR-5auz3aPHUlloVAWmkha1Go_0 2024-09-12T18:13:48.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.561+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13236781828088581703', time=2024-09-12T19:46:09.671983+0000, chain.objs.size()=1 2024-09-12T18:13:48.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.561+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.XJgV6aQltV50-Inhqz6GOBoj1tRLiVm_0 2024-09-12T18:13:48.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.562+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7439511578545417222', time=2024-09-12T19:46:10.631150+0000, chain.objs.size()=1 2024-09-12T18:13:48.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.562+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.2tTI0k4sLtTp60q0APdTaDkrh78pTzv_0 2024-09-12T18:13:48.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.562+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14745297829276756616', time=2024-09-12T19:46:11.170645+0000, chain.objs.size()=1 2024-09-12T18:13:48.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.562+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.CDQslWc0VywekFP_VSOD5vg6KIStrW0_0 2024-09-12T18:13:48.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.562+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4132109084147222994', time=2024-09-12T19:46:11.210101+0000, chain.objs.size()=1 2024-09-12T18:13:48.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.562+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.QNot4Yg6FK9Pg_fOQMj3JMqgWn6sq0h_0 2024-09-12T18:13:48.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.562+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14748034389104182576', time=2024-09-12T19:46:11.232286+0000, chain.objs.size()=1 2024-09-12T18:13:48.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.562+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.GV2dh_fffXC9VCdyghdjL9UmHDaiS46_0 2024-09-12T18:13:48.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.562+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17764549445171402210', time=2024-09-12T19:46:11.957051+0000, chain.objs.size()=1 2024-09-12T18:13:48.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.562+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.m4Fbkk6OnIH5kMBn1OL6yhsxBqNF7xn_0 2024-09-12T18:13:48.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.562+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13855307781955145348', time=2024-09-12T19:46:12.057127+0000, chain.objs.size()=1 2024-09-12T18:13:48.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.562+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_._AMZI-tyY0UJ_TFbrjPcASYuxdgMFzF_0 2024-09-12T18:13:48.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.562+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8135918450982664749', time=2024-09-12T19:46:12.293387+0000, chain.objs.size()=1 2024-09-12T18:13:48.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.562+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.LqTFixVeBYDp4blDQUTILbocG8SEEFV_0 2024-09-12T18:13:48.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.563+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.482980756858462859', time=2024-09-12T19:46:12.452998+0000, chain.objs.size()=1 2024-09-12T18:13:48.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.563+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.qgCFR36c24lbjO38HylkR0mIIddjtC4_0 2024-09-12T18:13:48.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.563+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13354667194707890849', time=2024-09-12T19:46:13.472122+0000, chain.objs.size()=1 2024-09-12T18:13:48.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.563+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ECJlEL4izH3jvnSkhBfoaJgq0hCyHIO_0 2024-09-12T18:13:48.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.563+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9287601264980060109', time=2024-09-12T19:46:13.644355+0000, chain.objs.size()=1 2024-09-12T18:13:48.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.563+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.VXOpZYeakTWST2wDmScTLNs0FQV3px1_0 2024-09-12T18:13:48.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.563+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14911410994414819091', time=2024-09-12T19:46:14.308807+0000, chain.objs.size()=1 2024-09-12T18:13:48.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.563+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.zSN-XCUYmHzSduvwt6ClX78JhjewZM2_0 2024-09-12T18:13:48.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.563+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12240511618266419503', time=2024-09-12T19:46:14.359104+0000, chain.objs.size()=1 2024-09-12T18:13:48.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.563+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.fM75lILeTpZGct51x0ugvuNL5GBuhzo_0 2024-09-12T18:13:48.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.564+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17030935463070809798', time=2024-09-12T19:46:15.706675+0000, chain.objs.size()=1 2024-09-12T18:13:48.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.564+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.8dyE0lkFHMZkQ89YVdYCEt0EJhOJyEd_0 2024-09-12T18:13:48.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.564+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7186644184026854241', time=2024-09-12T19:46:16.274066+0000, chain.objs.size()=1 2024-09-12T18:13:48.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.564+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.dthyrz7ayJ7jpz-dAHaFDc4E7ro9eCv_0 2024-09-12T18:13:48.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.564+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.434445112002237915', time=2024-09-12T19:46:16.590735+0000, chain.objs.size()=1 2024-09-12T18:13:48.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.564+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.i5BFHH9iARVVfSBpD57Ze_MSnHoqTh-_0 2024-09-12T18:13:48.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.564+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14461551242272547761', time=2024-09-12T19:46:17.046349+0000, chain.objs.size()=1 2024-09-12T18:13:48.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.564+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.bEmt_juBy5FUWJ7Ev1KRk6UYDNijVJJ_0 2024-09-12T18:13:48.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.564+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10120322330715156350', time=2024-09-12T19:46:17.148068+0000, chain.objs.size()=1 2024-09-12T18:13:48.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.564+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Ktk8o6Vf5yyxXRC0mXHTuqbpJjeRWhg_0 2024-09-12T18:13:48.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.565+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12016935281665879023', time=2024-09-12T19:46:17.590125+0000, chain.objs.size()=1 2024-09-12T18:13:48.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.565+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.jXQKYEjMIldQl597NNKEKhE2LojCs_T_0 2024-09-12T18:13:48.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.565+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16899742983191152737', time=2024-09-12T19:46:17.667261+0000, chain.objs.size()=1 2024-09-12T18:13:48.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.565+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.jFC3pT2PuupDANv6bGmsAiywoK9_uqS_0 2024-09-12T18:13:48.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.565+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.945489518599726189', time=2024-09-12T19:46:17.747745+0000, chain.objs.size()=1 2024-09-12T18:13:48.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.565+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.yGUmYnOu2QHDbdrzDZGzl7Hi6uTFSd5_0 2024-09-12T18:13:48.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.565+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12718885376762783008', time=2024-09-12T19:46:17.833473+0000, chain.objs.size()=1 2024-09-12T18:13:48.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.565+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.RNfK_8EOLM1D0GVeX5GR88Y0C4TRNUG_0 2024-09-12T18:13:48.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.565+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9568417868938524941', time=2024-09-12T19:46:19.149193+0000, chain.objs.size()=1 2024-09-12T18:13:48.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.565+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.rueyehCNIxtWfDy5CkN5osby1CicBgL_0 2024-09-12T18:13:48.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.566+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12543958717292521772', time=2024-09-12T19:46:19.149993+0000, chain.objs.size()=1 2024-09-12T18:13:48.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.566+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ttmKT4W9u5uJyjP6r68ZWVFXg7sS_iu_0 2024-09-12T18:13:48.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.566+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12749495689306676952', time=2024-09-12T19:46:19.250520+0000, chain.objs.size()=1 2024-09-12T18:13:48.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.566+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.mXPEXMbdpnzMptxN7vGRBWLs6Azvsmz_0 2024-09-12T18:13:48.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.566+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12548574269148925425', time=2024-09-12T19:46:19.413561+0000, chain.objs.size()=1 2024-09-12T18:13:48.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.566+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Z-pu_HjDJZVm4Ae_txcGo3KOO51hs0c_0 2024-09-12T18:13:48.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.566+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12278289228605157880', time=2024-09-12T19:46:40.197564+0000, chain.objs.size()=1 2024-09-12T18:13:48.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.566+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.286__shadow_.s7vr7zhYYqE-uZOwrDy92B-z8HMonjH_0 2024-09-12T18:13:48.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.566+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10556775510261099523', time=2024-09-12T19:46:48.234552+0000, chain.objs.size()=1 2024-09-12T18:13:48.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.566+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.293__shadow_.x_eCfU2lE6rMJTSFqmJ0nA-xrE2Ilb8_0 2024-09-12T18:13:48.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.566+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7547895685894914856', time=2024-09-12T19:46:53.188153+0000, chain.objs.size()=1 2024-09-12T18:13:48.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.566+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.297__shadow_.dUFLg6W4w-2jP35CCrXagG9F2YcTSSY_0 2024-09-12T18:13:48.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.567+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12434197954777544458', time=2024-09-12T19:46:57.907147+0000, chain.objs.size()=1 2024-09-12T18:13:48.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.567+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.302__shadow_.uTNxGguiPI5E3EwyfEeuclBG5FUqQEC_0 2024-09-12T18:13:48.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.567+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12615498893812801328', time=2024-09-12T19:46:57.907866+0000, chain.objs.size()=1 2024-09-12T18:13:48.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.567+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.302__shadow_.XZgXshXCjh_O6Wn6mOgF4cyClcc7zon_0 2024-09-12T18:13:48.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.567+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17183741452671011221', time=2024-09-12T19:47:59.636730+0000, chain.objs.size()=1 2024-09-12T18:13:48.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.567+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.swjvqDDWTU9AFMV-4bz7AhhGr5RcsKo_0 2024-09-12T18:13:48.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.567+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5324780101118276552', time=2024-09-12T19:47:59.746053+0000, chain.objs.size()=1 2024-09-12T18:13:48.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.567+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.f6CGoEN2nPblmEWJDCc3sBgB3Skv_4H_0 2024-09-12T18:13:48.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.568+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8686461734629598055', time=2024-09-12T19:48:00.007000+0000, chain.objs.size()=1 2024-09-12T18:13:48.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.568+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.5JJvCe745Dn6Nmt1acgU7vYTBt7A1dj_0 2024-09-12T18:13:48.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.568+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9967903567659171234', time=2024-09-12T19:48:00.073371+0000, chain.objs.size()=1 2024-09-12T18:13:48.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.568+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.bJ8nVohJgWwnKjdr1vZe7jjuANFn2bY_0 2024-09-12T18:13:48.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.569+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8130900272856313132', time=2024-09-12T19:48:00.373340+0000, chain.objs.size()=1 2024-09-12T18:13:48.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.569+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Z3il_IzkfDYDjysbrR_71gaI0WBAt5Z_0 2024-09-12T18:13:48.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.569+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15149470911596458959', time=2024-09-12T19:48:00.982434+0000, chain.objs.size()=1 2024-09-12T18:13:48.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.569+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.FCsao9Z3pSUFgEK4ML6lBgvDpHMgd8g_0 2024-09-12T18:13:48.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.569+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11270642506282511954', time=2024-09-12T19:48:01.017797+0000, chain.objs.size()=1 2024-09-12T18:13:48.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.569+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.RIA09KqoRgKo0ER4CIzbAHAQT4MEgrh_0 2024-09-12T18:13:48.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.569+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13546787640461101411', time=2024-09-12T19:48:01.242569+0000, chain.objs.size()=1 2024-09-12T18:13:48.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.569+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.zHuDr7bz9Xt2i2KDXNsiTj0lZ_oiGsN_0 2024-09-12T18:13:48.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.569+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10123907009339037377', time=2024-09-12T19:48:01.288431+0000, chain.objs.size()=1 2024-09-12T18:13:48.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.569+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.MCcsF_DCygEDurbvr2qSpcakt7Zc7av_0 2024-09-12T18:13:48.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.569+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14335232564063770321', time=2024-09-12T19:48:01.365847+0000, chain.objs.size()=1 2024-09-12T18:13:48.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.569+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.kpoIkY_XJ12z9oIzhO3u-7fCxFwxUQo_0 2024-09-12T18:13:48.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.570+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8728806880862094652', time=2024-09-12T19:48:01.429190+0000, chain.objs.size()=1 2024-09-12T18:13:48.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.570+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.EnzaUjHggV6KY25FzdXE0eatTgQAD83_0 2024-09-12T18:13:48.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.570+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17762182749347030052', time=2024-09-12T19:48:01.816744+0000, chain.objs.size()=1 2024-09-12T18:13:48.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.570+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.9mGbZmwqgu8e_7VPXceh5v65Q-tp37k_0 2024-09-12T18:13:48.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.570+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2605461343640693793', time=2024-09-12T19:48:01.858973+0000, chain.objs.size()=1 2024-09-12T18:13:48.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.570+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.l-flZ71vD2MAMMwPxfF6nul-NxdDMI-_0 2024-09-12T18:13:48.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.570+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6695438240585359195', time=2024-09-12T19:48:02.594185+0000, chain.objs.size()=1 2024-09-12T18:13:48.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.570+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.QZSG5E_LJiUJfe1MxgpjnmXu7Zz1Kvm_0 2024-09-12T18:13:48.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.570+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14727108779613796310', time=2024-09-12T19:48:02.635915+0000, chain.objs.size()=1 2024-09-12T18:13:48.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.570+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.2zXfbV8qPx5c-lAju2zLOY8okHpsLpm_0 2024-09-12T18:13:48.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.570+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8564990942056250238', time=2024-09-12T19:48:02.887355+0000, chain.objs.size()=1 2024-09-12T18:13:48.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.570+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.PQG6dO43gDp5sg-mr2UUmiMfbNvEzv4_0 2024-09-12T18:13:48.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.570+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15854682523006541560', time=2024-09-12T19:48:03.158642+0000, chain.objs.size()=1 2024-09-12T18:13:48.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.570+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.F0tbMbkl1IjFywfHOmG-JkoHnY0hxDp_0 2024-09-12T18:13:48.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.571+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11999376547008412812', time=2024-09-12T19:48:03.177405+0000, chain.objs.size()=1 2024-09-12T18:13:48.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.571+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.xxCffD3gHdvvsTKP1T7938gtp-74EE5_0 2024-09-12T18:13:48.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.571+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8203631163215332557', time=2024-09-12T19:48:03.191796+0000, chain.objs.size()=1 2024-09-12T18:13:48.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.571+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.hrzpuv69ReNHNTajrNkmWT3vwlz1Qoa_0 2024-09-12T18:13:48.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.571+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9884046896215058098', time=2024-09-12T19:48:03.410872+0000, chain.objs.size()=1 2024-09-12T18:13:48.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.571+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.cip2K1x2A6KR4M-d_5piNyfo6d_qT7G_0 2024-09-12T18:13:48.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.571+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18377744351570583055', time=2024-09-12T19:48:03.413624+0000, chain.objs.size()=1 2024-09-12T18:13:48.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.571+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.44iNw-ZTsr3vfjmQQt-2XShXKAbFsJv_0 2024-09-12T18:13:48.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.572+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5728416636892264592', time=2024-09-12T19:48:03.483059+0000, chain.objs.size()=1 2024-09-12T18:13:48.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.572+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.XIH2NxT1ZnCSZ5dwyRrFsHdnqb7JdqJ_0 2024-09-12T18:13:48.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.573+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12925369351379252093', time=2024-09-12T19:48:04.380924+0000, chain.objs.size()=1 2024-09-12T18:13:48.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.573+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.z88LhfkJXwiFrOYIPE53L4tCPctPYQD_0 2024-09-12T18:13:48.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.573+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3744339323258693407', time=2024-09-12T19:48:04.840455+0000, chain.objs.size()=1 2024-09-12T18:13:48.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.573+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Qo94vxrHM8N5Wsrua6-sZ0Fpx8a_lC7_0 2024-09-12T18:13:48.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.573+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15533136988099093320', time=2024-09-12T19:48:05.426334+0000, chain.objs.size()=1 2024-09-12T18:13:48.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.573+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.0QFDy-COGU2PgkXwg0Rn4fDOBV63-mU_0 2024-09-12T18:13:48.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.573+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17927239550422192791', time=2024-09-12T19:48:05.427089+0000, chain.objs.size()=1 2024-09-12T18:13:48.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.573+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.LvAHrdVAGF3sz-epbGCsnbUTISsFxdj_0 2024-09-12T18:13:48.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.573+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5327034394621455043', time=2024-09-12T19:48:05.427734+0000, chain.objs.size()=1 2024-09-12T18:13:48.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.573+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.bXDfKZ4n7TQpA8YTOlm4vNAiv9VkA2j_0 2024-09-12T18:13:48.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.573+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6457434456918060294', time=2024-09-12T19:48:05.771631+0000, chain.objs.size()=1 2024-09-12T18:13:48.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.573+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Zy6VX8rv0geAECX8CfZAOX2QgKXh4yf_0 2024-09-12T18:13:48.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.573+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13491571430935255355', time=2024-09-12T19:48:06.129785+0000, chain.objs.size()=1 2024-09-12T18:13:48.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.573+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.S8yYvi721MKUNRUV7y3BpsYkRRkHWql_0 2024-09-12T18:13:48.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.573+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15451034635545158962', time=2024-09-12T19:48:06.191030+0000, chain.objs.size()=1 2024-09-12T18:13:48.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.573+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.1JSTJRw8OswN76hjiV_1kBfIcJQagVC_0 2024-09-12T18:13:48.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.573+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15948965693553189411', time=2024-09-12T19:48:06.207584+0000, chain.objs.size()=1 2024-09-12T18:13:48.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.573+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.hknQwEQ6iKORjuLqu0jgBDjOJ3qYo4a_0 2024-09-12T18:13:48.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.573+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14215299770512453333', time=2024-09-12T19:48:06.208457+0000, chain.objs.size()=1 2024-09-12T18:13:48.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.573+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.BjFNrO7c4dFV8kZQAR2CIyi5LkvxsrN_0 2024-09-12T18:13:48.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.574+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16744049930489260949', time=2024-09-12T19:48:06.276370+0000, chain.objs.size()=1 2024-09-12T18:13:48.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.574+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.swBYiH_8oMjbO-wrOE2rHP9mmvDJv15_0 2024-09-12T18:13:48.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.575+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6025885472616924857', time=2024-09-12T19:48:06.666493+0000, chain.objs.size()=1 2024-09-12T18:13:48.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.575+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.KjY5Zue12VnXdUE4TNesKoSEOHqZRTv_0 2024-09-12T18:13:48.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.575+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10736001111300944104', time=2024-09-12T19:48:07.323253+0000, chain.objs.size()=1 2024-09-12T18:13:48.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.575+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.QptLR7WEcW7Mb3mWDJaUYqWRxss5aIJ_0 2024-09-12T18:13:48.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.575+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14842618329974275795', time=2024-09-12T19:48:07.361128+0000, chain.objs.size()=1 2024-09-12T18:13:48.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.575+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.QxDuhXdknY2R-2M719PYOinbQBTJTtM_0 2024-09-12T18:13:48.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.575+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11399095988921728900', time=2024-09-12T19:48:07.636762+0000, chain.objs.size()=1 2024-09-12T18:13:48.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.575+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.xh4bmGI5QMimi_OaNt3a3Moq2aawbNJ_0 2024-09-12T18:13:48.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.575+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3515952053063018075', time=2024-09-12T19:48:07.977400+0000, chain.objs.size()=1 2024-09-12T18:13:48.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.575+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.akGr_09KrXTJxcLqV6PU9LlMTqF1oYL_0 2024-09-12T18:13:48.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.575+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4728967746291897345', time=2024-09-12T19:48:08.140587+0000, chain.objs.size()=1 2024-09-12T18:13:48.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.575+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.FK6eKoJjMTIS8E1xiIRRbtVuQBLn4T4_0 2024-09-12T18:13:48.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.575+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4454478050185918613', time=2024-09-12T19:48:08.142294+0000, chain.objs.size()=1 2024-09-12T18:13:48.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.575+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.nQupSzWrq1iFQ5rkVIGV8sKv6gydBhE_0 2024-09-12T18:13:48.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.576+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5618976330837418909', time=2024-09-12T19:48:09.420355+0000, chain.objs.size()=1 2024-09-12T18:13:48.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.576+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.S9iaORBIvABqwiPHvlvdxkkyIC_koV5_0 2024-09-12T18:13:48.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.576+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17987791396623889707', time=2024-09-12T19:48:47.451485+0000, chain.objs.size()=1 2024-09-12T18:13:48.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.576+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.FOW9gHjFQMxd5I0IgghmKccR0rDAeoI_0 2024-09-12T18:13:48.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.576+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4259924035444212667', time=2024-09-12T19:48:47.930740+0000, chain.objs.size()=1 2024-09-12T18:13:48.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.576+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.IMsK--InBlMTqXvnwRg-BIQXIoYjzWl_0 2024-09-12T18:13:48.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.576+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17647268097414556980', time=2024-09-12T19:48:48.080942+0000, chain.objs.size()=1 2024-09-12T18:13:48.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.576+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.v3ozoQ_BBZAhfw7CpZEFn6JcDShifND_0 2024-09-12T18:13:48.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.578+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.400351749145900716', time=2024-09-12T19:48:48.201596+0000, chain.objs.size()=1 2024-09-12T18:13:48.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.578+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.0vJREwZvoBemb9eBBuGrwCNVZivLCRW_0 2024-09-12T18:13:48.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.578+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16980908434984887296', time=2024-09-12T19:48:48.214242+0000, chain.objs.size()=1 2024-09-12T18:13:48.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.578+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.bG0JNu738kQ_SZYq0yn-v7zQLbgsY8w_0 2024-09-12T18:13:48.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.578+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3637174465733955106', time=2024-09-12T19:48:48.333366+0000, chain.objs.size()=1 2024-09-12T18:13:48.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.578+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_._sYNLlTbBaIdFEK5PVwKj535dcmvrYw_0 2024-09-12T18:13:48.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.578+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12614194699607606774', time=2024-09-12T19:48:48.333843+0000, chain.objs.size()=1 2024-09-12T18:13:48.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.578+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ZYZI_m8dY_Vf2nyLJH_rD0XOhB8dV68_0 2024-09-12T18:13:48.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.578+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10872147992838499588', time=2024-09-12T19:48:49.828554+0000, chain.objs.size()=1 2024-09-12T18:13:48.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.578+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.gAxhy8V6avLYZMpnwIC1RbUyMQWVISg_0 2024-09-12T18:13:48.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.578+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17565240286748846705', time=2024-09-12T19:48:50.469738+0000, chain.objs.size()=1 2024-09-12T18:13:48.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.578+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.duDvIO-dSK4hcu9rFUvjfgKsFaq8T9E_0 2024-09-12T18:13:48.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.578+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9589256380105538433', time=2024-09-12T19:48:50.619478+0000, chain.objs.size()=1 2024-09-12T18:13:48.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.578+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.N5LH2K7ZBKAYpPdVQNuWG8HavYLTFdL_0 2024-09-12T18:13:48.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.578+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1684490705304564156', time=2024-09-12T19:48:50.743564+0000, chain.objs.size()=1 2024-09-12T18:13:48.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.578+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Fx-e5cwSoc1cUFLYzGcKkc-L5uEA_mc_0 2024-09-12T18:13:48.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.578+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1433285244206658281', time=2024-09-12T19:48:51.046180+0000, chain.objs.size()=1 2024-09-12T18:13:48.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.578+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.NIeEchGUJHwS2jK5WP1uFYM9B8ThGZm_0 2024-09-12T18:13:48.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.579+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6351372196993491172', time=2024-09-12T19:48:51.172100+0000, chain.objs.size()=1 2024-09-12T18:13:48.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.579+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.WY1dZmLO8iR_TJxU_ZwqKCSUQztRZFs_0 2024-09-12T18:13:48.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.579+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14559789906788814314', time=2024-09-12T19:48:51.409950+0000, chain.objs.size()=1 2024-09-12T18:13:48.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.579+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.motvcjxd3yVWH1VPeXjd5gDozykUnhM_0 2024-09-12T18:13:48.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.579+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12604818480699188446', time=2024-09-12T19:48:51.477402+0000, chain.objs.size()=1 2024-09-12T18:13:48.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.579+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.MOKC60fW--cmBACajInl6tQpVAfOTg2_0 2024-09-12T18:13:48.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.579+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5611886542776441411', time=2024-09-12T19:48:51.502439+0000, chain.objs.size()=1 2024-09-12T18:13:48.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.579+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.sHeyhioNH7-98HFB7CHcbcG0pqap2Y7_0 2024-09-12T18:13:48.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.580+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17518965257637117078', time=2024-09-12T19:48:51.915647+0000, chain.objs.size()=1 2024-09-12T18:13:48.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.580+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.3JTeK6af-EbkhJMI82Yn0nuJIM2kSCs_0 2024-09-12T18:13:48.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.582+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/50552 2024-09-12T18:13:48.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.585+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=36, truncated=0, next_marker='' 2024-09-12T18:13:48.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.585+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7741250298011048095', time=2024-09-12T19:48:52.175065+0000, chain.objs.size()=1 2024-09-12T18:13:48.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.585+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.oWD6FFwOlxOM-tW4X3Qq_Yq9A0N2Wqa_0 2024-09-12T18:13:48.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.585+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3052474392804805246', time=2024-09-12T19:48:52.310631+0000, chain.objs.size()=1 2024-09-12T18:13:48.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.585+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ACKy9-vZivjg-p3Jt_4vlNd73c8ZWEQ_0 2024-09-12T18:13:48.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.585+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4389704896703514755', time=2024-09-12T19:48:53.284595+0000, chain.objs.size()=1 2024-09-12T18:13:48.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.585+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.PGHouEErArowBjAgVRs9NWOVOj4o_Qc_0 2024-09-12T18:13:48.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.585+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13305789689254536029', time=2024-09-12T19:48:53.537233+0000, chain.objs.size()=1 2024-09-12T18:13:48.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.585+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.wiJQ-000HVcXyXfl9uYPzHhxk2p-A7O_0 2024-09-12T18:13:48.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.585+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.98603286470714582', time=2024-09-12T19:48:53.940549+0000, chain.objs.size()=1 2024-09-12T18:13:48.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.585+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Lt0WpekvoI0p5XMFYzve9coJ2yt1xw-_0 2024-09-12T18:13:48.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.585+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4273839191982856614', time=2024-09-12T19:48:54.014006+0000, chain.objs.size()=1 2024-09-12T18:13:48.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.585+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.IVWjhs7HTTQC3_ZhuiGtVUmH_tRU5pa_0 2024-09-12T18:13:48.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.585+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7767177285731742159', time=2024-09-12T19:48:54.014823+0000, chain.objs.size()=1 2024-09-12T18:13:48.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.585+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.RhDhu5s0DBm4YDiwiYnRfINYqhzdKZb_0 2024-09-12T18:13:48.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.585+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4454429136568083826', time=2024-09-12T19:48:55.422846+0000, chain.objs.size()=1 2024-09-12T18:13:48.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.585+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.n8wV-5341ucm8H9hcevp-Eb7oCGVoXH_0 2024-09-12T18:13:48.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.585+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13967246109929599110', time=2024-09-12T19:48:55.618444+0000, chain.objs.size()=1 2024-09-12T18:13:48.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.585+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_._Q83ohSflLCtwEP3EeJ4Rqb0akK4wad_0 2024-09-12T18:13:48.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.585+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10936524225959659103', time=2024-09-12T19:48:55.928341+0000, chain.objs.size()=1 2024-09-12T18:13:48.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.585+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.dhBocd1Qr4EUPBMev5nIQRcr8qh6xIy_0 2024-09-12T18:13:48.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.585+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7352491546591330741', time=2024-09-12T19:48:56.164545+0000, chain.objs.size()=1 2024-09-12T18:13:48.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.585+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.-vUxl0pCGVYSmmSacVNxyGPUan5kGZG_0 2024-09-12T18:13:48.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.585+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4448731671835907902', time=2024-09-12T19:48:56.502333+0000, chain.objs.size()=1 2024-09-12T18:13:48.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.585+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.J9SQwYOmMMVx7ATUcyFWSK3MqYQXS82_0 2024-09-12T18:13:48.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.586+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1227702554055359184', time=2024-09-12T19:48:56.520938+0000, chain.objs.size()=1 2024-09-12T18:13:48.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.586+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.P-J-XawvaKLL8i7x6Uwx2rAnwzma41X_0 2024-09-12T18:13:48.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.587+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6861111187458027135', time=2024-09-12T19:48:56.532526+0000, chain.objs.size()=1 2024-09-12T18:13:48.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.587+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.wzhAg-xrtiqGmIbjHDYaPY08JTlQcGb_0 2024-09-12T18:13:48.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.587+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2413805254057952680', time=2024-09-12T19:48:57.269635+0000, chain.objs.size()=1 2024-09-12T18:13:48.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.587+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.00pTQMQca57NDgpxTQvntKCi0WWZ46f_0 2024-09-12T18:13:48.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.587+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1117326556283068741', time=2024-09-12T19:48:57.271097+0000, chain.objs.size()=1 2024-09-12T18:13:48.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.587+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Gk3oi6j_YUBC88Pr1Q2RsCP8Y9fUjbJ_0 2024-09-12T18:13:48.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.587+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6319021404052337582', time=2024-09-12T19:48:57.506200+0000, chain.objs.size()=1 2024-09-12T18:13:48.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.587+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.6oYzopOUeoYepHJvzB2MQZHzOiGN1l1_0 2024-09-12T18:13:48.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.587+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.570281632479308127', time=2024-09-12T19:48:57.771494+0000, chain.objs.size()=1 2024-09-12T18:13:48.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.587+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.9b5XFgbn8fN_mHwmhmdhrZI4TaELv45_0 2024-09-12T18:13:48.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.587+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8722198813660266367', time=2024-09-12T19:49:43.960550+0000, chain.objs.size()=1 2024-09-12T18:13:48.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.587+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.380__shadow_.gpnimZFDdXm5DF5pOnxIFTn0_TYmwps_0 2024-09-12T18:13:48.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.587+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1637353502005914577', time=2024-09-12T19:51:18.591944+0000, chain.objs.size()=1 2024-09-12T18:13:48.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.587+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.484__shadow_.l9efRFnhH7x2feBQjuGcAuF9RhDi5OG_0 2024-09-12T18:13:48.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.588+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17220113384375630817', time=2024-09-12T19:52:30.683236+0000, chain.objs.size()=1 2024-09-12T18:13:48.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.588+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.518__shadow_.2eE51viRI8OeOP0GeM70tQpWWGkCSvh_0 2024-09-12T18:13:48.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.588+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3507858553355264301', time=2024-09-12T19:56:35.686791+0000, chain.objs.size()=1 2024-09-12T18:13:48.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.588+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.537__multipart_mymultipart.2~8NLw7XqKwqXg6eTx-AjDOhIhwj0pyl0.1 2024-09-12T18:13:48.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.588+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17074203388100510460', time=2024-09-12T19:57:43.274150+0000, chain.objs.size()=1 2024-09-12T18:13:48.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.588+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.562__multipart_mymultipart._2FqrRpdtyH7KVWboB-gyyUo6KqKNzPv.1 2024-09-12T18:13:48.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.589+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1692431756102643107', time=2024-09-12T19:57:57.498241+0000, chain.objs.size()=1 2024-09-12T18:13:48.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.589+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:FMbgdRlKby.BtYCs594vIeSdYKS84R9_.JUKGHS_SilJaM_DO54XnRVYaBogs0Si_0 2024-09-12T18:13:48.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.589+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5904641501188956965', time=2024-09-12T19:57:57.880104+0000, chain.objs.size()=1 2024-09-12T18:13:48.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.589+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:L-A.aOEJiUMtd72TBfm-eEIynYEvZYf_.XDpUUQCjwslWugep2QYTEM06JzjtAxI_0 2024-09-12T18:13:48.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.589+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4319843805690027222', time=2024-09-12T19:58:11.228674+0000, chain.objs.size()=1 2024-09-12T18:13:48.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.589+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.573__shadow_.2UdxiGBS1pAwSeoxTRi5zFp7owZmXFk_0 2024-09-12T18:13:48.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.589+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5449296081546670030', time=2024-09-12T19:58:24.964009+0000, chain.objs.size()=1 2024-09-12T18:13:48.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.589+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.577__shadow:6TtkrgHsBABApGh5Fv3VEkxHBvAz35D_.7uavCA4ofeB_NpmpubnhxBzSxLGACZ5_0 2024-09-12T18:13:48.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.589+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11995682549873971820', time=2024-09-12T19:58:30.680090+0000, chain.objs.size()=1 2024-09-12T18:13:48.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.589+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:m0w7IYYg.RZtkhtMh4AgSAdX5.lm8W0_.fqrCQO-8S6rvLNBDRVEZFvD6YyEhz5g_0 2024-09-12T18:13:48.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.589+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11979840771893786287', time=2024-09-12T19:58:40.766628+0000, chain.objs.size()=1 2024-09-12T18:13:48.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.589+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:sil5GCelBlKas6ksjvjZkF2xP5aeOvl_.qkLywB6dQD2xrB4Ix3lP5CSEybfpI3C_0 2024-09-12T18:13:48.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.590+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11724605219103025849', time=2024-09-12T19:59:29.773190+0000, chain.objs.size()=1 2024-09-12T18:13:48.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.590+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.580__shadow:rFhbpZcPwZjQlVxCdt1dTzz9g3F4E4a_.qFxUtM3f7-vPCZqhC90b89wjQ9Rnkk4_0 2024-09-12T18:13:48.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.590+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2875824430793424717', time=2024-09-12T19:59:29.853095+0000, chain.objs.size()=1 2024-09-12T18:13:48.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.590+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.580__shadow:FbAKtt9LSTjBB.5uDbrijaxlRYz4AVI_.x89TNzM5H11SIyCJzzlwxZ2UWHQlaIp_0 2024-09-12T18:13:48.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.590+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10292238548887701465', time=2024-09-12T19:59:32.601332+0000, chain.objs.size()=1 2024-09-12T18:13:48.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.590+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.581__shadow:UeQ-5Ra3l.edmsxZ-H.QeS6oe4gASyZ_.GnJpbme5dvyNcuhCSDq4-c2PWjamwiP_0 2024-09-12T18:13:48.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.591+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17098759533939467921', time=2024-09-12T20:02:55.399010+0000, chain.objs.size()=1 2024-09-12T18:13:48.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.591+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.618__shadow_.H-U3ZyB71tYBxqBmOigNS4H_243P_xJ_0 2024-09-12T18:13:48.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.591+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1234043560248336036', time=2024-09-12T20:06:25.235467+0000, chain.objs.size()=1 2024-09-12T18:13:48.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.591+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.694__shadow:t5kc9XqJbUh6E7QiylJIREcoUza8IjV_.PTvUyNHQJT3kgi31eBlnxZC6HPcFq3b_0 2024-09-12T18:13:48.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.591+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1626566768292357312', time=2024-09-12T20:06:41.705313+0000, chain.objs.size()=1 2024-09-12T18:13:48.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.591+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.713__shadow:sIIE4Slr00t4DzGnKb-wY21khC-cxfO_.PG19I3WuZTVJTZsUCQWVFgpOSRYOu02_0 2024-09-12T18:13:48.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.592+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3638074173933792592', time=2024-09-12T20:07:33.732289+0000, chain.objs.size()=1 2024-09-12T18:13:48.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.592+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.740__shadow_.Twf5405Dg-uvgtWnXWs5XiX-YFtoadp_0 2024-09-12T18:13:48.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.594+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:48.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.597+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:13:48.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.598+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:48.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.598+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:48.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.599+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46916' 2024-09-12T18:13:48.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.599+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='_SW1yVvyvlBj2j9XphmvovHyc3teXfVM', time=2024-09-12T19:42:10.755187+0000, chain.objs.size()=1 2024-09-12T18:13:48.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.599+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__shadow_.U0YOwDg4JAXV36WunVj2z5vzo6g9G3K_0 2024-09-12T18:13:48.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.599+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17651227978727601161', time=2024-09-12T19:45:03.668237+0000, chain.objs.size()=1 2024-09-12T18:13:48.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.599+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.234__shadow_.jboyG0egYygCayajiCSuuhy0Mi8JwMh_0 2024-09-12T18:13:48.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.599+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1046617073740568610', time=2024-09-12T19:45:08.047162+0000, chain.objs.size()=1 2024-09-12T18:13:48.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.599+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.238__shadow_.XqU-xbJXT-CZiLNDFI1jfqt92i4UnX-_0 2024-09-12T18:13:48.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.599+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4248317759722728406', time=2024-09-12T19:45:09.663403+0000, chain.objs.size()=1 2024-09-12T18:13:48.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.599+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.239__shadow_.RosQ8EzoLvS8noNK3M_RdKlY88WBH3-_0 2024-09-12T18:13:48.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.599+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3046992906488188438', time=2024-09-12T19:45:29.027545+0000, chain.objs.size()=1 2024-09-12T18:13:48.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.599+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.259__shadow_.TNChFsKI7YCn8QsBJ-uZa4qLtPtO1k-_0 2024-09-12T18:13:48.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.599+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7265647626854410690', time=2024-09-12T19:46:09.477557+0000, chain.objs.size()=1 2024-09-12T18:13:48.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.599+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.MMqHkPM2fkjgtkJWE92ygnsCJlG8psW_0 2024-09-12T18:13:48.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.599+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17619345961512866100', time=2024-09-12T19:46:09.730873+0000, chain.objs.size()=1 2024-09-12T18:13:48.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.599+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.F5L2PJFiLNfCrjz84GpyxjFrz1Rmego_0 2024-09-12T18:13:48.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.599+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12738824607082532355', time=2024-09-12T19:46:09.840164+0000, chain.objs.size()=1 2024-09-12T18:13:48.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.599+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.C488oGGgu9qRIbeE2d-v-hrCGvUHJdg_0 2024-09-12T18:13:48.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.599+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1716418371936428638', time=2024-09-12T19:46:10.892304+0000, chain.objs.size()=1 2024-09-12T18:13:48.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.599+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.PiNK-yr1AJ5YyzlpIC6BgFpkCojIneY_0 2024-09-12T18:13:48.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.599+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17161894039348609746', time=2024-09-12T19:46:11.284921+0000, chain.objs.size()=1 2024-09-12T18:13:48.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.599+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.62J474ce8tOMn_jxnX7qRtYDMuHjnmW_0 2024-09-12T18:13:48.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.599+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18133355733373562025', time=2024-09-12T19:46:11.992616+0000, chain.objs.size()=1 2024-09-12T18:13:48.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.599+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.9al1x175dWHZHDn7Ud4pK9oumyD0Jga_0 2024-09-12T18:13:48.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.599+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7545430127739671584', time=2024-09-12T19:46:12.230536+0000, chain.objs.size()=1 2024-09-12T18:13:48.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.599+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.h4hbPqoApYBV7piaByKAQps7oMexwEJ_0 2024-09-12T18:13:48.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.600+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10212545934509718744', time=2024-09-12T19:46:12.270713+0000, chain.objs.size()=1 2024-09-12T18:13:48.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.600+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.siBts-gthIM8MBG-U8puN_41vlyD4cJ_0 2024-09-12T18:13:48.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.601+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2673670420538099821', time=2024-09-12T19:46:12.525425+0000, chain.objs.size()=1 2024-09-12T18:13:48.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.601+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Vejk1Iq4owmnSbdki9gy77R_Ozr0kAD_0 2024-09-12T18:13:48.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.601+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8022974094208445924', time=2024-09-12T19:46:12.798482+0000, chain.objs.size()=1 2024-09-12T18:13:48.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.601+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.IlaYj9dockXn38kfdaukGqWijAZijFL_0 2024-09-12T18:13:48.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.601+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11167207408217275260', time=2024-09-12T19:46:12.824775+0000, chain.objs.size()=1 2024-09-12T18:13:48.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.601+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.8ciqkK6p9rV7XHpWqD0wVACNxIR2lPO_0 2024-09-12T18:13:48.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.601+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15281505151523729754', time=2024-09-12T19:46:13.358849+0000, chain.objs.size()=1 2024-09-12T18:13:48.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.601+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.BsgzOTffx9YJcRLo5GnI3RQnSBbruKT_0 2024-09-12T18:13:48.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.601+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3253785985877394596', time=2024-09-12T19:46:13.568125+0000, chain.objs.size()=1 2024-09-12T18:13:48.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.601+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.dfJwu9nHn55_Y66sc_H710GvhOBKJSI_0 2024-09-12T18:13:48.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.601+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5942117703396581821', time=2024-09-12T19:46:13.723576+0000, chain.objs.size()=1 2024-09-12T18:13:48.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.601+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.qrUD937SvOVRemVqM8F2IhSq719bPrp_0 2024-09-12T18:13:48.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.601+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13719732217143121883', time=2024-09-12T19:46:13.843375+0000, chain.objs.size()=1 2024-09-12T18:13:48.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.601+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.RuJ8Ue4GRZgkEeuemD6of_u5LWdLpCZ_0 2024-09-12T18:13:48.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.601+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17486143769104156783', time=2024-09-12T19:46:13.947768+0000, chain.objs.size()=1 2024-09-12T18:13:48.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.601+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ODLX9JNFm3QDyipp7XAn73421XwOr6c_0 2024-09-12T18:13:48.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.601+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16299027362987645137', time=2024-09-12T19:46:14.177751+0000, chain.objs.size()=1 2024-09-12T18:13:48.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.601+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.bB5WTMUvtpJ-FwscfvBqBL50GOiSVL2_0 2024-09-12T18:13:48.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.601+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8302173312495633876', time=2024-09-12T19:46:14.755461+0000, chain.objs.size()=1 2024-09-12T18:13:48.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.601+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.FqaSdeLYRpxrRbisRUyvy2oWcIvlDNu_0 2024-09-12T18:13:48.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.602+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2870426099989365781', time=2024-09-12T19:46:14.998406+0000, chain.objs.size()=1 2024-09-12T18:13:48.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.602+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.uPIbAPS6rjL8xmgizRr5TvwaO_kctRH_0 2024-09-12T18:13:48.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.603+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6040707464909426603', time=2024-09-12T19:46:15.057610+0000, chain.objs.size()=1 2024-09-12T18:13:48.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.603+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.0uB07pg8ODPaEunSALy3rz1KknCeh7E_0 2024-09-12T18:13:48.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.603+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1126201859973288942', time=2024-09-12T19:46:16.819857+0000, chain.objs.size()=1 2024-09-12T18:13:48.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.603+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.3J8jJ_9lzHGUsZy6MqsXf5Nhd_FwdYE_0 2024-09-12T18:13:48.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.603+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2467432495786033211', time=2024-09-12T19:46:17.008998+0000, chain.objs.size()=1 2024-09-12T18:13:48.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.603+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.V--yGeKw6lX9_G23Cw-ZE8lnCOtJFHB_0 2024-09-12T18:13:48.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.603+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10245205140728463541', time=2024-09-12T19:46:17.010510+0000, chain.objs.size()=1 2024-09-12T18:13:48.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.603+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.MhEBwotG5an7pVzag9gZcdBNzdeQpxy_0 2024-09-12T18:13:48.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.603+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10944011814857066674', time=2024-09-12T19:46:17.448187+0000, chain.objs.size()=1 2024-09-12T18:13:48.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.603+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.8vAK7dxUCN7-O7nWOLD38wUctetae4T_0 2024-09-12T18:13:48.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.603+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5979202974621725751', time=2024-09-12T19:46:17.489970+0000, chain.objs.size()=1 2024-09-12T18:13:48.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.603+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ljbZYeYISq1fecpGbtkL1MKTLJMHqv__0 2024-09-12T18:13:48.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.603+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.663295617373146230', time=2024-09-12T19:46:17.699783+0000, chain.objs.size()=1 2024-09-12T18:13:48.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.603+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.shuXsVEVH7wPPDBjbrcMeRJXI_59XLx_0 2024-09-12T18:13:48.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.603+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16091749728038708612', time=2024-09-12T19:46:17.736203+0000, chain.objs.size()=1 2024-09-12T18:13:48.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.603+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.BM-Fmfsdus7CueVbch5u7qidIkvMd5P_0 2024-09-12T18:13:48.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.603+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6015918472038851711', time=2024-09-12T19:46:17.901490+0000, chain.objs.size()=1 2024-09-12T18:13:48.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.603+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.yhNSYxnSSBBqoIl63TlbY76HlLc2l-J_0 2024-09-12T18:13:48.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.603+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6362397842279945140', time=2024-09-12T19:46:18.116914+0000, chain.objs.size()=1 2024-09-12T18:13:48.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.603+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.LoY6FSTqivg4SxXaoaImPZyeObN4HH8_0 2024-09-12T18:13:48.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.604+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5022035988513014704', time=2024-09-12T19:46:18.313302+0000, chain.objs.size()=1 2024-09-12T18:13:48.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.604+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.nch9B251Z7iqERSCssSfBrz7pupNXq5_0 2024-09-12T18:13:48.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.605+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14211176170207356985', time=2024-09-12T19:46:19.002285+0000, chain.objs.size()=1 2024-09-12T18:13:48.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.605+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.JiCk6l7OuVHnFR9RyDoKmaxLfpERgb4_0 2024-09-12T18:13:48.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.605+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6078130853638427636', time=2024-09-12T19:46:19.223565+0000, chain.objs.size()=1 2024-09-12T18:13:48.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.605+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.jhUkNhdRTkKllHzdDd_g6FtXE3Ni659_0 2024-09-12T18:13:48.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.605+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.390263586592252504', time=2024-09-12T19:46:19.331131+0000, chain.objs.size()=1 2024-09-12T18:13:48.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.605+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.JeibldiCqu-0NYohhSP-fjF7JSDzEhD_0 2024-09-12T18:13:48.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.605+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8922148670253023028', time=2024-09-12T19:46:23.092589+0000, chain.objs.size()=1 2024-09-12T18:13:48.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.605+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.267__shadow_.PoSkmmguFxr89ZkRUOwfH8mTHiakO3K_0 2024-09-12T18:13:48.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.605+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3366623691336616082', time=2024-09-12T19:46:38.313306+0000, chain.objs.size()=1 2024-09-12T18:13:48.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.605+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.284__shadow_.4QgtDdwi-t6TyyAjrF1_Nf3hGXMll5m_0 2024-09-12T18:13:48.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.605+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9981329899407184250', time=2024-09-12T19:46:39.216442+0000, chain.objs.size()=1 2024-09-12T18:13:48.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.605+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.285__shadow_.HXbQXQ56t9J-EzBMO78adbAdjHcOzJ2_0 2024-09-12T18:13:48.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.606+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13703563291091409977', time=2024-09-12T19:46:48.162159+0000, chain.objs.size()=1 2024-09-12T18:13:48.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.606+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.293__shadow_.pGrlINl5yn--tpaesox00V81GtKvxce_0 2024-09-12T18:13:48.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.606+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15301508705924564616', time=2024-09-12T19:46:48.234590+0000, chain.objs.size()=1 2024-09-12T18:13:48.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.606+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.293__shadow_.UqBp61DoxVAFB8NMTgdtoFJ6K33-ef4_0 2024-09-12T18:13:48.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.606+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17414061625747019552', time=2024-09-12T19:46:50.426620+0000, chain.objs.size()=1 2024-09-12T18:13:48.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.606+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.294__shadow_.1PCMb2HBg1bli74M0h2rkWhk5Gj5jHd_0 2024-09-12T18:13:48.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.606+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12198603256446093094', time=2024-09-12T19:46:51.346701+0000, chain.objs.size()=1 2024-09-12T18:13:48.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.606+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.295__shadow_.FaQaj7-oGF5RlR2nsOOjGEutC8iBVSn_0 2024-09-12T18:13:48.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.606+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5230578657996385328', time=2024-09-12T19:46:55.104631+0000, chain.objs.size()=1 2024-09-12T18:13:48.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.606+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.299__shadow_.JkHHYVAy4Q8jOCv14QcvEnCwQNuEAEP_0 2024-09-12T18:13:48.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.606+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12495874698224097699', time=2024-09-12T19:47:21.320508+0000, chain.objs.size()=1 2024-09-12T18:13:48.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.606+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.323__shadow_.N7znUE7d3X0aYigde_HN-LHir2TSF1O_0 2024-09-12T18:13:48.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.606+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10201515931944845639', time=2024-09-12T19:47:59.638470+0000, chain.objs.size()=1 2024-09-12T18:13:48.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.606+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.8B73B47ji2KTlf4HICK2kiQk4oYvI_X_0 2024-09-12T18:13:48.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.607+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5766111338681013998', time=2024-09-12T19:47:59.832820+0000, chain.objs.size()=1 2024-09-12T18:13:48.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.607+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.UxZwNXEBN3SKo7KiCre2kjU_VBjX6-P_0 2024-09-12T18:13:48.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.607+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3858618358007037121', time=2024-09-12T19:48:00.069893+0000, chain.objs.size()=1 2024-09-12T18:13:48.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.607+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.DYMXe2j9j0kd_pJaxYHILBULxUdJyrt_0 2024-09-12T18:13:48.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.608+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16802571924902640569', time=2024-09-12T19:48:00.372458+0000, chain.objs.size()=1 2024-09-12T18:13:48.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.608+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.9z51WDVzQCQjygfMkyentk8W24DNsNI_0 2024-09-12T18:13:48.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.608+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2426563339499970262', time=2024-09-12T19:48:00.375617+0000, chain.objs.size()=1 2024-09-12T18:13:48.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.608+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.aVdJX88kDt-DZcu-FN6wjAOoUE75ywo_0 2024-09-12T18:13:48.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.608+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1597363837350424572', time=2024-09-12T19:48:00.461795+0000, chain.objs.size()=1 2024-09-12T18:13:48.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.608+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.txL4f2lbtTFwS2RbGQGDzvXHQ7D7dzw_0 2024-09-12T18:13:48.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.608+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14546749575362242136', time=2024-09-12T19:48:01.370601+0000, chain.objs.size()=1 2024-09-12T18:13:48.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.608+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.mSETbEKK_ZVTrYnlqDC885gqwoSR25Y_0 2024-09-12T18:13:48.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.608+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2461928724857215622', time=2024-09-12T19:48:01.958310+0000, chain.objs.size()=1 2024-09-12T18:13:48.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.608+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Di5zczIzmqxFkgjchXSvc_GwIJdXn7k_0 2024-09-12T18:13:48.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.608+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.151672699923574774', time=2024-09-12T19:48:02.494357+0000, chain.objs.size()=1 2024-09-12T18:13:48.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.608+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.uoeobjdwA__KoajPLQL-PteLlDgcsfe_0 2024-09-12T18:13:48.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.608+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10332814294334354671', time=2024-09-12T19:48:02.976814+0000, chain.objs.size()=1 2024-09-12T18:13:48.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.608+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Yk6byopIhq4PARyuJiWXUM1yLZwhan6_0 2024-09-12T18:13:48.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.609+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7940524273933682101', time=2024-09-12T19:48:03.234528+0000, chain.objs.size()=1 2024-09-12T18:13:48.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.609+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.R9ryh6_PeDVoxGXvDSuvpZL1X8ZxzPh_0 2024-09-12T18:13:48.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.609+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9532762968307691580', time=2024-09-12T19:48:03.306252+0000, chain.objs.size()=1 2024-09-12T18:13:48.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.609+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.U0FuqxveqzE6RZ0YHVm7Viwyoh0UhIk_0 2024-09-12T18:13:48.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.609+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15912550745266978966', time=2024-09-12T19:48:03.483110+0000, chain.objs.size()=1 2024-09-12T18:13:48.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.609+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.P5ztMNO0nHSkayyOJLAPEVzI4ASXtKs_0 2024-09-12T18:13:48.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.610+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5878219733658842189', time=2024-09-12T19:48:04.065870+0000, chain.objs.size()=1 2024-09-12T18:13:48.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.610+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_._rLc2ifEqdimdjX1Gn5_N_dAa4esWWI_0 2024-09-12T18:13:48.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.610+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8685101518580086090', time=2024-09-12T19:48:04.318136+0000, chain.objs.size()=1 2024-09-12T18:13:48.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.610+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Yfhs4XTfGQLNQH5zMwG10RkVLaUctNy_0 2024-09-12T18:13:48.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.610+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13666539041091638042', time=2024-09-12T19:48:04.431551+0000, chain.objs.size()=1 2024-09-12T18:13:48.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.610+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.2tEyxhCiz_Djv1oFEX0krpUcoEHhhQP_0 2024-09-12T18:13:48.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.610+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17564133578832827290', time=2024-09-12T19:48:05.718816+0000, chain.objs.size()=1 2024-09-12T18:13:48.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.610+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.6FG07l92Nkf4g5f_7o4o7JcWhVY_sYc_0 2024-09-12T18:13:48.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.610+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9669595548887440835', time=2024-09-12T19:48:05.868820+0000, chain.objs.size()=1 2024-09-12T18:13:48.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.610+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.50SttNBU-qFgNdfa5kGEVldW36pRBlO_0 2024-09-12T18:13:48.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.610+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7376544152966536509', time=2024-09-12T19:48:06.066740+0000, chain.objs.size()=1 2024-09-12T18:13:48.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.610+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.UlAdR1esuRSWRMTfnG6yL6wrVilcy8k_0 2024-09-12T18:13:48.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.610+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6464279949622488612', time=2024-09-12T19:48:06.213565+0000, chain.objs.size()=1 2024-09-12T18:13:48.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.610+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_._i3aXNK3Ktsz1Ip_H-3CaqI92CauHYf_0 2024-09-12T18:13:48.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.610+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13499113023026554517', time=2024-09-12T19:48:07.643583+0000, chain.objs.size()=1 2024-09-12T18:13:48.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.610+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.1vT7Zz61VHqy1w8ISPGrLppMM5plgYE_0 2024-09-12T18:13:48.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.611+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10691415851510776981', time=2024-09-12T19:48:08.173067+0000, chain.objs.size()=1 2024-09-12T18:13:48.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.611+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.yUqEpG99w_SFy9RK1yAwWcpC_JJv1X4_0 2024-09-12T18:13:48.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.611+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16457770995918220069', time=2024-09-12T19:48:08.408125+0000, chain.objs.size()=1 2024-09-12T18:13:48.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.611+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.XA5JKAy875wU-qWBVGEYcH-jhBzlfOE_0 2024-09-12T18:13:48.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.611+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12058053404121976427', time=2024-09-12T19:48:08.507477+0000, chain.objs.size()=1 2024-09-12T18:13:48.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.611+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.L-lpd5_s2HZ4NReGCWEN30bbwG6Ocsd_0 2024-09-12T18:13:48.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.611+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2636074795830266829', time=2024-09-12T19:48:08.780021+0000, chain.objs.size()=1 2024-09-12T18:13:48.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.611+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.lvfcLBxvvF08xwcMu43WYXTwIb_XcZH_0 2024-09-12T18:13:48.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.612+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18203348822649893656', time=2024-09-12T19:48:08.923466+0000, chain.objs.size()=1 2024-09-12T18:13:48.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.612+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.7C7rzIgjTzZSYI0jWlP1q9ylQQfRccx_0 2024-09-12T18:13:48.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.612+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9655401352582401815', time=2024-09-12T19:48:09.578183+0000, chain.objs.size()=1 2024-09-12T18:13:48.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.612+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.gfD4wY5OwLP8J7FrmcXiQ0CHSEpyHAN_0 2024-09-12T18:13:48.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.612+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11047801063664542569', time=2024-09-12T19:48:09.579586+0000, chain.objs.size()=1 2024-09-12T18:13:48.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.612+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.X5ld1Quc2imquekpnXgvx55P2vuqFfR_0 2024-09-12T18:13:48.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.612+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4491031430646330344', time=2024-09-12T19:48:09.893292+0000, chain.objs.size()=1 2024-09-12T18:13:48.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.612+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.FyVHAuEJo6XBEs7q3oQ2la8b6b7xgj__0 2024-09-12T18:13:48.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.612+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5245461373011696102', time=2024-09-12T19:48:09.955210+0000, chain.objs.size()=1 2024-09-12T18:13:48.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.612+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.8BBmKSKXye3m5u7RbUxV8cgqQPfQkN8_0 2024-09-12T18:13:48.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.612+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11941094460608156893', time=2024-09-12T19:48:10.041299+0000, chain.objs.size()=1 2024-09-12T18:13:48.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.612+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.S0O0FV1X1gmu69VAu2sWdosRLQdrfUV_0 2024-09-12T18:13:48.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.613+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12265218426294658085', time=2024-09-12T19:48:47.983574+0000, chain.objs.size()=1 2024-09-12T18:13:48.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.613+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.GHcXaen6nBVXE-C4OTA_xlwdt5litTa_0 2024-09-12T18:13:48.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.613+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.674355910431908900', time=2024-09-12T19:48:48.180054+0000, chain.objs.size()=1 2024-09-12T18:13:48.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.613+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.DOJ_Dz5mk7L3DO3AwSRj7j-4q7HgJMh_0 2024-09-12T18:13:48.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.613+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9419944686990067479', time=2024-09-12T19:48:48.201596+0000, chain.objs.size()=1 2024-09-12T18:13:48.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.613+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ZIk4VWz3g-6N2bGJSEEvGwuz8m04AnD_0 2024-09-12T18:13:48.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.613+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16778125857789420241', time=2024-09-12T19:48:48.954665+0000, chain.objs.size()=1 2024-09-12T18:13:48.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.613+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.nlnSP1tyqn1DaOPa1sPIp1MjPgT3wH6_0 2024-09-12T18:13:48.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.614+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.616939457841802716', time=2024-09-12T19:48:49.397222+0000, chain.objs.size()=1 2024-09-12T18:13:48.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.614+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.v8igLMqtWkWqEwTr5MbHCx_JwM6plMc_0 2024-09-12T18:13:48.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.614+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6836816390276732933', time=2024-09-12T19:48:49.516000+0000, chain.objs.size()=1 2024-09-12T18:13:48.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.614+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.UnVqkFEhnJ5z0y1eShF-W9nhnS5cHj7_0 2024-09-12T18:13:48.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.614+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16659072942418757737', time=2024-09-12T19:48:49.817738+0000, chain.objs.size()=1 2024-09-12T18:13:48.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.614+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.gubB3QU_57K2sNP72JSuo1wZL4SPo6i_0 2024-09-12T18:13:48.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.614+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8902164677433814543', time=2024-09-12T19:48:49.919394+0000, chain.objs.size()=1 2024-09-12T18:13:48.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.614+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_._3Y_AzwDMPz7XwAv7nq35PCdmEiIbax_0 2024-09-12T18:13:48.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.614+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4072103385965765744', time=2024-09-12T19:48:50.618125+0000, chain.objs.size()=1 2024-09-12T18:13:48.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.614+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_._66f7U7w0oqfSma8Lg3-dketEz9c6Rj_0 2024-09-12T18:13:48.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.614+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5133866174807156745', time=2024-09-12T19:48:50.895736+0000, chain.objs.size()=1 2024-09-12T18:13:48.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.614+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.CHlVw4rmGu8xhhxuWHa0touhQU_QaLZ_0 2024-09-12T18:13:48.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.614+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8980388163129294145', time=2024-09-12T19:48:51.272720+0000, chain.objs.size()=1 2024-09-12T18:13:48.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.614+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ZSCPiSSEZT-dtHT1BirkVX-PwRi06Pd_0 2024-09-12T18:13:48.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.615+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2008180512971949179', time=2024-09-12T19:48:51.915819+0000, chain.objs.size()=1 2024-09-12T18:13:48.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.615+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.5Ay5qdy541Bp156JLaJj3zEaUki-XsD_0 2024-09-12T18:13:48.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.616+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14845650742349143365', time=2024-09-12T19:48:51.916557+0000, chain.objs.size()=1 2024-09-12T18:13:48.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.616+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.mySBL0zh9sNCDQ_W7kZwoEjYFVNVhb3_0 2024-09-12T18:13:48.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.616+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17434233271450812083', time=2024-09-12T19:48:53.515921+0000, chain.objs.size()=1 2024-09-12T18:13:48.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.616+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.vSG6iSczbA4RnBgRymI2Hzxjb5emtIR_0 2024-09-12T18:13:48.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.616+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1773742791247121054', time=2024-09-12T19:48:53.680858+0000, chain.objs.size()=1 2024-09-12T18:13:48.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.616+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.VQvOfSlahQxRbQE2WyVxRchCJbPVnjs_0 2024-09-12T18:13:48.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.616+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15563745410842605430', time=2024-09-12T19:48:54.116734+0000, chain.objs.size()=1 2024-09-12T18:13:48.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.616+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.yZIFAPwlvxXv-VOyb_HbGM0WzfC5bQH_0 2024-09-12T18:13:48.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.616+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14200897930241113290', time=2024-09-12T19:48:54.139414+0000, chain.objs.size()=1 2024-09-12T18:13:48.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.616+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.SyAeJ3pZE29WjOaHqygalkIS4L7gO-l_0 2024-09-12T18:13:48.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.616+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17107006468259604445', time=2024-09-12T19:48:54.618786+0000, chain.objs.size()=1 2024-09-12T18:13:48.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.616+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.BUaDDKiOxhG2g7OMKYxF-hEOn2YqcT-_0 2024-09-12T18:13:48.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.616+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1690903298425141763', time=2024-09-12T19:48:54.662610+0000, chain.objs.size()=1 2024-09-12T18:13:48.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.616+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.8MmNePLphmjdqyP_k7SarlbXz7s7uPA_0 2024-09-12T18:13:48.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.617+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6106255883235417503', time=2024-09-12T19:48:54.663271+0000, chain.objs.size()=1 2024-09-12T18:13:48.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.617+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.8WkaLLdRNL9PrtMIMC7lrJmPyfTlm5Y_0 2024-09-12T18:13:48.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.617+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13692927339827192813', time=2024-09-12T19:48:54.939389+0000, chain.objs.size()=1 2024-09-12T18:13:48.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.617+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ftyViLloFPkXyFnt4gqXzOkAYtY6DJS_0 2024-09-12T18:13:48.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.617+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8173809887435413938', time=2024-09-12T19:48:55.142100+0000, chain.objs.size()=1 2024-09-12T18:13:48.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.617+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.zxc8bvq5HKoN_ondTXoq3PEM8GLuS96_0 2024-09-12T18:13:48.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.619+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/46916 2024-09-12T18:13:48.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.621+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T18:13:48.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.621+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15224018061201206235', time=2024-09-12T19:48:55.160228+0000, chain.objs.size()=1 2024-09-12T18:13:48.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.621+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.FBDJ6af_yB6KlkNA22P1G6cfhM16K-B_0 2024-09-12T18:13:48.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.621+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.258532588761465286', time=2024-09-12T19:48:55.394210+0000, chain.objs.size()=1 2024-09-12T18:13:48.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.621+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Mj6aHNZ7EPPoSLTzreAtBdMNXhJALEK_0 2024-09-12T18:13:48.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.621+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16660746796614463058', time=2024-09-12T19:48:55.586891+0000, chain.objs.size()=1 2024-09-12T18:13:48.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.621+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.0RoCc177Gh9JlecQJMr-lB9XWWqN_0r_0 2024-09-12T18:13:48.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.621+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2679801708279321246', time=2024-09-12T19:48:56.123264+0000, chain.objs.size()=1 2024-09-12T18:13:48.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.621+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.MfMctGIHnV3BnRIBBi1MKdXYHK0Mjli_0 2024-09-12T18:13:48.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.621+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13894860140355855086', time=2024-09-12T19:48:57.991171+0000, chain.objs.size()=1 2024-09-12T18:13:48.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.621+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.WVhTLBWpNvU0e7_jx1uRloAWlv3FXVS_0 2024-09-12T18:13:48.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.621+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2562951595804534', time=2024-09-12T19:49:01.240636+0000, chain.objs.size()=1 2024-09-12T18:13:48.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.621+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.329__shadow_.6ZTzen1P0xk44neMRKgnBMA8ooonF-C_0 2024-09-12T18:13:48.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.621+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12736416077949335757', time=2024-09-12T19:49:05.317506+0000, chain.objs.size()=1 2024-09-12T18:13:48.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.621+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.334__shadow_.foZuriIhpXc8ScmS7ZqLJR6Yj5GhDbe_0 2024-09-12T18:13:48.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.621+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15307780367180413645', time=2024-09-12T19:49:35.816161+0000, chain.objs.size()=1 2024-09-12T18:13:48.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.621+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.372__shadow_.WG27KOki225EAHNpSGvNsMnVrAsC0XJ_0 2024-09-12T18:13:48.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.621+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14077988557179223085', time=2024-09-12T19:50:49.824646+0000, chain.objs.size()=1 2024-09-12T18:13:48.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.621+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.452__shadow_.kFoHuUsLCPRtL5Ki61uyoQKJnltLDYK_0 2024-09-12T18:13:48.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.621+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7937023588347518810', time=2024-09-12T19:51:00.461493+0000, chain.objs.size()=1 2024-09-12T18:13:48.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.621+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.461__shadow_.Q-a4grl62oQK27LB_7wUacTeoIiT4u7_0 2024-09-12T18:13:48.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.621+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2984515738082740807', time=2024-09-12T19:51:26.485870+0000, chain.objs.size()=1 2024-09-12T18:13:48.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.621+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.488__shadow_.OA1xtT4a7UAnSi6kRQ4KbGrX8PFIlo6_0 2024-09-12T18:13:48.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.621+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13187186028831157478', time=2024-09-12T19:55:23.339828+0000, chain.objs.size()=3 2024-09-12T18:13:48.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.621+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.524__multipart_mymultipart.2~X-5vSQIspMtI4BRCmZRXXpmyLAzCLnX.1 2024-09-12T18:13:48.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.623+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.524__multipart_mymultipart.2~X-5vSQIspMtI4BRCmZRXXpmyLAzCLnX.2 2024-09-12T18:13:48.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.623+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.524__multipart_mymultipart.2~X-5vSQIspMtI4BRCmZRXXpmyLAzCLnX.3 2024-09-12T18:13:48.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.623+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17857756902676068795', time=2024-09-12T19:57:27.678058+0000, chain.objs.size()=1 2024-09-12T18:13:48.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.623+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.557__shadow_.b4CB6Fa1gv-NTSZHN-b9RQMq4h2ikdS_0 2024-09-12T18:13:48.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.623+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1788841912030597897', time=2024-09-12T19:58:00.235852+0000, chain.objs.size()=1 2024-09-12T18:13:48.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.623+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:QP4LCEUo3iMAFnD2HdyDUXv7auzno6I_.c9xisW76WhHLpnmjD-sBNf_O12FIHOM_0 2024-09-12T18:13:48.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.624+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18022508299121791786', time=2024-09-12T19:58:14.258586+0000, chain.objs.size()=1 2024-09-12T18:13:48.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.624+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.575__shadow_.efOSxGfN5aRYlA7qjRZcnJB4GwXIh4W_0 2024-09-12T18:13:48.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.624+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7854065867035600057', time=2024-09-12T19:58:17.998225+0000, chain.objs.size()=1 2024-09-12T18:13:48.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.624+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.575__shadow:JL6gP9ky6EWxm7HtrmbHN8oGzNdyqrc_.mTNN7faTH_dFUdYJ0ne7VqqFoTqS9AT_0 2024-09-12T18:13:48.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.624+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10422030929339433445', time=2024-09-12T19:58:33.765020+0000, chain.objs.size()=1 2024-09-12T18:13:48.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.624+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:kyo7snY8YWR73XAlAgqT1vafyVkASS-_.1jwus8VmK2jh9zRFVPUyu-Y980ynh0g_0 2024-09-12T18:13:48.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.624+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17468996119720922903', time=2024-09-12T19:58:46.021077+0000, chain.objs.size()=1 2024-09-12T18:13:48.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.624+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:uQewL6XV8jjP4v-4IsnQzkwRPsz0kvz_.jOvc2zoE5_e-BT5Anp8So-9626L1Kvm_0 2024-09-12T18:13:48.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.625+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4013515276455939613', time=2024-09-12T19:59:38.839498+0000, chain.objs.size()=1 2024-09-12T18:13:48.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.625+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.587__shadow:p5A4puGsFKb-8mTF-9YNpGExRfMzARd_.emNZFsvZpwqqVOK0FvdSoWp6cXS_NCM_0 2024-09-12T18:13:48.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.625+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3705963765041288551', time=2024-09-12T20:02:55.194412+0000, chain.objs.size()=1 2024-09-12T18:13:48.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.625+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.618__shadow_.onmOau5CB4tEw_bsKrZs7Av5_RphSDS_0 2024-09-12T18:13:48.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.625+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14031338849368440836', time=2024-09-12T20:06:00.450020+0000, chain.objs.size()=6 2024-09-12T18:13:48.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.625+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.663__multipart_foo.2~1E5iRhIrywbCHIMIyndhjzR3z0O6JlQ.1 2024-09-12T18:13:48.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.625+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.663__multipart_foo.2~1E5iRhIrywbCHIMIyndhjzR3z0O6JlQ.2 2024-09-12T18:13:48.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.625+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.663__multipart_foo.2~1E5iRhIrywbCHIMIyndhjzR3z0O6JlQ.3 2024-09-12T18:13:48.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.625+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.663__multipart_foo.2~1E5iRhIrywbCHIMIyndhjzR3z0O6JlQ.4 2024-09-12T18:13:48.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.625+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.663__multipart_foo.2~1E5iRhIrywbCHIMIyndhjzR3z0O6JlQ.5 2024-09-12T18:13:48.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.626+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.663__multipart_foo.2~1E5iRhIrywbCHIMIyndhjzR3z0O6JlQ.6 2024-09-12T18:13:48.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.626+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17334845679159620135', time=2024-09-12T20:06:27.844733+0000, chain.objs.size()=1 2024-09-12T18:13:48.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.626+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.697__shadow:ErwnJSfoFLX-2a385Oxm8f1Y6yzGLHp_.uGLJDX_GVVAOe97oaA2eyKiE7MrHE9F_0 2024-09-12T18:13:48.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.627+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2556112165482809347', time=2024-09-12T20:06:31.088592+0000, chain.objs.size()=1 2024-09-12T18:13:48.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.627+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.701__shadow:cihpXUxyIbfANm3767tdGSVrWg9uYoF_.emi-o2ku7hcecLdUM4ErsbGv5GMOhuu_0 2024-09-12T18:13:48.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.627+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8289420331662209881', time=2024-09-12T20:06:54.022930+0000, chain.objs.size()=1 2024-09-12T18:13:48.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.627+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.716__shadow:KZYsuIaEK2N9re3RmJQGyI9wdpRgnGZ_.A0q-i9QbnIAMMz-cq-bR3oNLP5ccSej_0 2024-09-12T18:13:48.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.627+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.692998748415626248', time=2024-09-12T20:07:45.543381+0000, chain.objs.size()=1 2024-09-12T18:13:48.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.627+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.745__shadow_.xNXuqR6-JA94nkyMIiUifq6xL_gtlGN_0 2024-09-12T18:13:48.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.628+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:48.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.630+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:13:48.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.631+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:48.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.632+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:48.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.633+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44240' 2024-09-12T18:13:48.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.633+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15304261079945326468', time=2024-09-12T19:41:14.814727+0000, chain.objs.size()=1 2024-09-12T18:13:48.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.633+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.158__shadow:Hg0j4n3h7xmg9lrnSE9GeJuPtCvAC-Y_.M0ByQVWC9rhDlfTEo4Btjkq-uSlZz9g_0 2024-09-12T18:13:48.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.633+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4746470551447565624', time=2024-09-12T19:43:07.150739+0000, chain.objs.size()=1 2024-09-12T18:13:48.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.633+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.198__shadow_.sL_GEsSmmPJ01Afqn-3kCKmuIKKDRFV_0 2024-09-12T18:13:48.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.633+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4211669391022279579', time=2024-09-12T19:45:12.212027+0000, chain.objs.size()=1 2024-09-12T18:13:48.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.633+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.242__shadow_.yMNNBcAOwBJzWp1YhHOvIwi_iUw4qlW_0 2024-09-12T18:13:48.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.633+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12751920891633407448', time=2024-09-12T19:45:24.580232+0000, chain.objs.size()=1 2024-09-12T18:13:48.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.633+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.254__shadow_.BGauEnQvrpnSix5aIRmE18CtHKt8HvJ_0 2024-09-12T18:13:48.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.633+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.403343204392095058', time=2024-09-12T19:45:27.289648+0000, chain.objs.size()=1 2024-09-12T18:13:48.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.633+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.257__shadow_.SW8COBW8u_tmWZG5pKSBqiG6pc4QiqC_0 2024-09-12T18:13:48.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.633+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1938353960208264051', time=2024-09-12T19:45:30.823128+0000, chain.objs.size()=1 2024-09-12T18:13:48.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.633+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.261__shadow_.dLq-WvOuo9NnH2kCN5Hl8Ef8zgKEnr0_0 2024-09-12T18:13:48.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.633+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6700079276829638599', time=2024-09-12T19:46:08.779132+0000, chain.objs.size()=1 2024-09-12T18:13:48.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.633+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.TFcp-bMLBxVvucDTWnwafnk2wjD616Y_0 2024-09-12T18:13:48.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.633+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17142540443139912570', time=2024-09-12T19:46:09.522724+0000, chain.objs.size()=1 2024-09-12T18:13:48.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.633+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.sOxhClJO7hMs97wTeRa8TW_Fqbi7MaW_0 2024-09-12T18:13:48.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.633+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15838500344729534191', time=2024-09-12T19:46:09.594054+0000, chain.objs.size()=1 2024-09-12T18:13:48.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.633+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ReGJ2m31okOHB97CBUgjddOlqdfzn2U_0 2024-09-12T18:13:48.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.633+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.805286584236323019', time=2024-09-12T19:46:09.733059+0000, chain.objs.size()=1 2024-09-12T18:13:48.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.633+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.fTj7bXkrvd6HJMmOVB2xkcpBoNpcGdI_0 2024-09-12T18:13:48.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.633+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13664655580114217656', time=2024-09-12T19:46:10.367259+0000, chain.objs.size()=1 2024-09-12T18:13:48.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.633+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.hCplN4kyPgjUNcWpB42bNFwR9ubIUQp_0 2024-09-12T18:13:48.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.633+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4178017670224120448', time=2024-09-12T19:46:10.748898+0000, chain.objs.size()=1 2024-09-12T18:13:48.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.633+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.NXkBWu3SA1Y1YgK4xBI54uA2Peaa_E6_0 2024-09-12T18:13:48.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.635+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17941662129105424261', time=2024-09-12T19:46:11.170673+0000, chain.objs.size()=1 2024-09-12T18:13:48.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.635+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.d9j2lHDN1jHqKjobwAVrAlEme_Q7KNA_0 2024-09-12T18:13:48.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.635+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13577333652546431629', time=2024-09-12T19:46:12.176788+0000, chain.objs.size()=1 2024-09-12T18:13:48.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.635+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.DV9jEZsZxpTe-f9YAulmxURypzWkeN8_0 2024-09-12T18:13:48.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.635+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17001787602630476984', time=2024-09-12T19:46:12.199408+0000, chain.objs.size()=1 2024-09-12T18:13:48.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.635+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.1wt_SGXGyFr_PNjsZuyN1IjawoTY5p__0 2024-09-12T18:13:48.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.635+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4979538419140848720', time=2024-09-12T19:46:12.345563+0000, chain.objs.size()=1 2024-09-12T18:13:48.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.635+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.2LAduldrBHe5OarA3QjG2mMssx-Kr3C_0 2024-09-12T18:13:48.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.635+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18376887606264808287', time=2024-09-12T19:46:12.659163+0000, chain.objs.size()=1 2024-09-12T18:13:48.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.635+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.fPcK31oraZqJqmYSivAxfUgh2ZAPEYo_0 2024-09-12T18:13:48.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.635+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18431567312194949100', time=2024-09-12T19:46:12.812496+0000, chain.objs.size()=1 2024-09-12T18:13:48.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.635+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Y3jidqnt8EUO2p0cxm-rhzwTO7XIIsu_0 2024-09-12T18:13:48.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.635+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18321782761817453905', time=2024-09-12T19:46:13.358930+0000, chain.objs.size()=1 2024-09-12T18:13:48.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.635+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.5PwIyKKZX_Akjn6emkZ4MuA5R1pkIQp_0 2024-09-12T18:13:48.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.635+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11362007369743378743', time=2024-09-12T19:46:13.471914+0000, chain.objs.size()=1 2024-09-12T18:13:48.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.635+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_._6-wm51pOt2PdzPPue8CH7oJwHzEoJ3_0 2024-09-12T18:13:48.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.635+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11968039412936150600', time=2024-09-12T19:46:13.568109+0000, chain.objs.size()=1 2024-09-12T18:13:48.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.635+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.UMp2NG5bzSKAgg6aOMS1OgXeZvHz6FJ_0 2024-09-12T18:13:48.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.635+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5500244760992058772', time=2024-09-12T19:46:13.723835+0000, chain.objs.size()=1 2024-09-12T18:13:48.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.635+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.F1wDCwDfF9tsMXYpp8fl3Pd6BaHubtr_0 2024-09-12T18:13:48.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.635+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17576596995000152865', time=2024-09-12T19:46:14.074325+0000, chain.objs.size()=1 2024-09-12T18:13:48.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.635+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.wAbXbfiieSPOWnWE80igiYZZTNQVXSq_0 2024-09-12T18:13:48.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.637+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.654471187968657599', time=2024-09-12T19:46:14.754237+0000, chain.objs.size()=1 2024-09-12T18:13:48.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.637+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.DBrCbjPShnYcCEVw2VXlUq07oX-n71a_0 2024-09-12T18:13:48.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.637+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7345580488550571880', time=2024-09-12T19:46:15.234163+0000, chain.objs.size()=1 2024-09-12T18:13:48.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.637+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.uvPWjTMMqqo_lFb49Sgqeac1ev96H6w_0 2024-09-12T18:13:48.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.637+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7428251686057033661', time=2024-09-12T19:46:15.234843+0000, chain.objs.size()=1 2024-09-12T18:13:48.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.637+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ZZRBsDxXS3GDgE9B_b5vaKWfsFTyU4e_0 2024-09-12T18:13:48.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.637+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1626650746297588683', time=2024-09-12T19:46:15.285912+0000, chain.objs.size()=1 2024-09-12T18:13:48.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.637+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.znMTNeodsZ8MDDuQ-mvMoWss_XLg15r_0 2024-09-12T18:13:48.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.637+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15359867801691081921', time=2024-09-12T19:46:15.539717+0000, chain.objs.size()=1 2024-09-12T18:13:48.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.637+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.TimxdEOkB7Q1__B3pbvxKOT1Bp0d72p_0 2024-09-12T18:13:48.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.638+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7853939709973988119', time=2024-09-12T19:46:15.768921+0000, chain.objs.size()=1 2024-09-12T18:13:48.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.638+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.JPH3xDgPxB66SgzDzF8paxuiL8G3AfO_0 2024-09-12T18:13:48.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.638+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11776558357525348511', time=2024-09-12T19:46:16.315311+0000, chain.objs.size()=1 2024-09-12T18:13:48.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.638+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.hykN20i36OnaQlnh_yayHGPlKDGROxj_0 2024-09-12T18:13:48.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.638+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10850427664297922553', time=2024-09-12T19:46:16.590830+0000, chain.objs.size()=1 2024-09-12T18:13:48.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.638+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.aDFyMrtEBpRGEyuw9_bIXHt82Kccffg_0 2024-09-12T18:13:48.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.638+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10096038629668702799', time=2024-09-12T19:46:16.778694+0000, chain.objs.size()=1 2024-09-12T18:13:48.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.638+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.kX7eW8Jhq0dDGz13tZUydnc5RM4jPnr_0 2024-09-12T18:13:48.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.638+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3717199957714672804', time=2024-09-12T19:46:18.169177+0000, chain.objs.size()=1 2024-09-12T18:13:48.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.638+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.bchXRFZTC1uqiUjEq3UrxlmV7-PTKu8_0 2024-09-12T18:13:48.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.638+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1863638251145426740', time=2024-09-12T19:46:18.188607+0000, chain.objs.size()=1 2024-09-12T18:13:48.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.638+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.DdWM-Z0mnSowc0T8Ad-XQ3q8A4nf3Nh_0 2024-09-12T18:13:48.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.638+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15991035362722559268', time=2024-09-12T19:46:18.189167+0000, chain.objs.size()=1 2024-09-12T18:13:48.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.638+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.m2VjI53KaqsfJfy7kwNS7ifXS6ttpp1_0 2024-09-12T18:13:48.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.640+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8522612090804143806', time=2024-09-12T19:46:18.242364+0000, chain.objs.size()=1 2024-09-12T18:13:48.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.640+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.0W9uw3ZVTdwbXCYc7ka9ft5KF8KP2KH_0 2024-09-12T18:13:48.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.640+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7096347845923952527', time=2024-09-12T19:46:18.787633+0000, chain.objs.size()=1 2024-09-12T18:13:48.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.640+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.aGG9adEEwDplkchy5KB8ge8V4EA-aBG_0 2024-09-12T18:13:48.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.640+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8869273616328661601', time=2024-09-12T19:46:18.899618+0000, chain.objs.size()=1 2024-09-12T18:13:48.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.640+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.kaS31a-7gwEvlrV_Hx_MW9EkXdcQvrK_0 2024-09-12T18:13:48.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.640+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1846238953364109414', time=2024-09-12T19:46:19.380680+0000, chain.objs.size()=1 2024-09-12T18:13:48.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.640+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.HjaY4evbUmViSkTh51hvr7afunaTwDl_0 2024-09-12T18:13:48.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.640+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12413669160420880338', time=2024-09-12T19:46:19.503696+0000, chain.objs.size()=1 2024-09-12T18:13:48.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.640+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.yVN-1m42_cXDl2h9RT7eN4R8onaiqhz_0 2024-09-12T18:13:48.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.640+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12832130967720561855', time=2024-09-12T19:46:20.486343+0000, chain.objs.size()=1 2024-09-12T18:13:48.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.640+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.264__shadow_.8JHR2rT0kS1sXM1edXgqlmKimmUME5N_0 2024-09-12T18:13:48.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.640+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.811284963174508274', time=2024-09-12T19:46:25.746091+0000, chain.objs.size()=1 2024-09-12T18:13:48.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.640+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.270__shadow_.V_RsjBGXl1JqTTc3CMJw2mi2HLS68Fb_0 2024-09-12T18:13:48.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.640+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12153352481970489947', time=2024-09-12T19:46:25.749538+0000, chain.objs.size()=1 2024-09-12T18:13:48.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.640+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.270__shadow_.wkKOVi0M5gfyMrxp97p0lFbIFvie-vp_0 2024-09-12T18:13:48.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.640+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17554418177260327171', time=2024-09-12T19:46:35.544344+0000, chain.objs.size()=1 2024-09-12T18:13:48.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.640+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.281__shadow_.vEY5t9k67PMBzl3bfYBph8aPoEAFTp8_0 2024-09-12T18:13:48.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.640+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6193224480406154181', time=2024-09-12T19:46:48.234765+0000, chain.objs.size()=1 2024-09-12T18:13:48.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.640+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.293__shadow_.GQkxqGL_WOtDsdB2J6fXmp14jKyYg1O_0 2024-09-12T18:13:48.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.640+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3889045499499792430', time=2024-09-12T19:46:54.096004+0000, chain.objs.size()=1 2024-09-12T18:13:48.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.640+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.298__shadow_.VB7-wBn0c9tTmjWFeakoWLv2VBU5GET_0 2024-09-12T18:13:48.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.642+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16246607819679404058', time=2024-09-12T19:46:59.717879+0000, chain.objs.size()=1 2024-09-12T18:13:48.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.642+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.304__shadow_.d6UCtb-FZEgZ4aPhYUZdDfSKAklfQN__0 2024-09-12T18:13:48.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.642+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1971630542742256812', time=2024-09-12T19:47:00.634589+0000, chain.objs.size()=1 2024-09-12T18:13:48.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.642+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.305__shadow_.U_vst4yyl8m4bKAWF8dUeupGpeK8PIo_0 2024-09-12T18:13:48.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.642+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3582566827771516520', time=2024-09-12T19:47:59.844435+0000, chain.objs.size()=1 2024-09-12T18:13:48.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.642+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.T_0JLkHCIg_a2RhABvN_86diGttz4U7_0 2024-09-12T18:13:48.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.642+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.822661692572554559', time=2024-09-12T19:48:00.189689+0000, chain.objs.size()=1 2024-09-12T18:13:48.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.642+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.2ZGMtahN1iDby2cbCuEsHRtFGdvp07v_0 2024-09-12T18:13:48.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.642+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16489295452160013371', time=2024-09-12T19:48:00.196056+0000, chain.objs.size()=1 2024-09-12T18:13:48.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.642+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Af2mexerZJr9NG9aNIFCKtXBw9BiMau_0 2024-09-12T18:13:48.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.642+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10889934484951526426', time=2024-09-12T19:48:01.427981+0000, chain.objs.size()=1 2024-09-12T18:13:48.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.642+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.jF8bPMO4gnnkGJFcuaVpfhvpDVk3sT0_0 2024-09-12T18:13:48.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.642+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14497370512588053742', time=2024-09-12T19:48:01.439062+0000, chain.objs.size()=1 2024-09-12T18:13:48.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.642+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.waZ2AElMA6U5arteg0-CJ2XmMpBJERQ_0 2024-09-12T18:13:48.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.642+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6092052403285936970', time=2024-09-12T19:48:01.666251+0000, chain.objs.size()=1 2024-09-12T18:13:48.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.642+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.pfyiJKEjkswneFoRHTXvAJYrMzcIZ1m_0 2024-09-12T18:13:48.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.642+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9457353623049927', time=2024-09-12T19:48:01.816592+0000, chain.objs.size()=1 2024-09-12T18:13:48.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.642+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.aNQrfEJMoK7zufEGA2LLE0aaDpDXm5e_0 2024-09-12T18:13:48.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.642+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18067115611594127572', time=2024-09-12T19:48:02.505108+0000, chain.objs.size()=1 2024-09-12T18:13:48.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.642+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.mInwWlJ5jwHNn62TCaTsU9_azbOY5u2_0 2024-09-12T18:13:48.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.642+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9748821116276852886', time=2024-09-12T19:48:02.717124+0000, chain.objs.size()=1 2024-09-12T18:13:48.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.642+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.xmIh5y_Mf44H3GpNMSIDvtk4MSixZ25_0 2024-09-12T18:13:48.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.644+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9021011933128577790', time=2024-09-12T19:48:02.720245+0000, chain.objs.size()=1 2024-09-12T18:13:48.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.644+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.tR3p2laOPjqpvIIXze57BAR0f8ZH_Ga_0 2024-09-12T18:13:48.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.644+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11954660379885631715', time=2024-09-12T19:48:02.901361+0000, chain.objs.size()=1 2024-09-12T18:13:48.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.644+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.WU5wvYSJoDh9ojAho0Z2A_B7xRvPPb4_0 2024-09-12T18:13:48.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.644+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9340825908355681759', time=2024-09-12T19:48:03.191989+0000, chain.objs.size()=1 2024-09-12T18:13:48.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.644+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.BAJcNOo6DzRiJaHntRrRYxvVYM3pZIV_0 2024-09-12T18:13:48.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.644+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4706735223860743027', time=2024-09-12T19:48:04.253343+0000, chain.objs.size()=1 2024-09-12T18:13:48.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.644+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.BjwPI0o_lZrJGk_ogGTEeoInJ3APnHZ_0 2024-09-12T18:13:48.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.644+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1820566768719664253', time=2024-09-12T19:48:04.471495+0000, chain.objs.size()=1 2024-09-12T18:13:48.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.644+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.O1VEhVuGF1WzzoR8Pd4C8SVvtsyXgoi_0 2024-09-12T18:13:48.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.644+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11590939188071439450', time=2024-09-12T19:48:04.819441+0000, chain.objs.size()=1 2024-09-12T18:13:48.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.644+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Q1fOGP-Iw4lzoczV_TtZnsgEt4dCicN_0 2024-09-12T18:13:48.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.644+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17986273962066196806', time=2024-09-12T19:48:04.859557+0000, chain.objs.size()=1 2024-09-12T18:13:48.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.644+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.78UCNGy_iMnmLrHLtskeddEQlAGZVV6_0 2024-09-12T18:13:48.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.644+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12255027016214230539', time=2024-09-12T19:48:04.860413+0000, chain.objs.size()=1 2024-09-12T18:13:48.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.644+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.SLRrjB4VvyEwXtusUpo8WGQCf90lYlm_0 2024-09-12T18:13:48.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.645+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2275927852230255370', time=2024-09-12T19:48:05.311699+0000, chain.objs.size()=1 2024-09-12T18:13:48.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.645+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.zdsLDZCJfbn1PaTwIN25Jva4r3T_JSY_0 2024-09-12T18:13:48.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.645+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1044407909959426720', time=2024-09-12T19:48:05.611654+0000, chain.objs.size()=1 2024-09-12T18:13:48.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.645+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.KO8ZiRg8r3H-Kyz1DLMw4mDJzS4R9-s_0 2024-09-12T18:13:48.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.645+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2690204451731844875', time=2024-09-12T19:48:05.948488+0000, chain.objs.size()=1 2024-09-12T18:13:48.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.645+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Y8teOhSxq7EE1ehe-ZGj1qqGAr9emgI_0 2024-09-12T18:13:48.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.646+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15515214995149983541', time=2024-09-12T19:48:06.019216+0000, chain.objs.size()=1 2024-09-12T18:13:48.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.646+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.UrJSM2Es4y2pxq7vEpI2fcF7rWjj8Iy_0 2024-09-12T18:13:48.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.646+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4038505883111560310', time=2024-09-12T19:48:06.705806+0000, chain.objs.size()=1 2024-09-12T18:13:48.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.646+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.jcdccw_GbMrntK3Rhz_E3cjpbhZ6k8l_0 2024-09-12T18:13:48.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.646+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2675780876608403213', time=2024-09-12T19:48:06.941011+0000, chain.objs.size()=1 2024-09-12T18:13:48.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.646+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.H685LVA975WdjdjJNDnDbWusqgxX8mW_0 2024-09-12T18:13:48.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.646+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16192074487380139725', time=2024-09-12T19:48:07.062345+0000, chain.objs.size()=1 2024-09-12T18:13:48.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.646+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.pUx6nxNmgwnbMmjomv6fJALOH_dkarP_0 2024-09-12T18:13:48.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.646+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17177170775599570119', time=2024-09-12T19:48:07.062984+0000, chain.objs.size()=1 2024-09-12T18:13:48.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.646+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.vT2_xQ4ZWPe43rqqIsfWJGq0KA2i0dB_0 2024-09-12T18:13:48.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.646+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17583698186288535793', time=2024-09-12T19:48:07.098510+0000, chain.objs.size()=1 2024-09-12T18:13:48.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.646+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.LNqsFCpTVld-zraFYl1C4iXFOTUMOSo_0 2024-09-12T18:13:48.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.646+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8800652225786764126', time=2024-09-12T19:48:07.378484+0000, chain.objs.size()=1 2024-09-12T18:13:48.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.646+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.GZoW4S2_tEpzMecunzgn77vNGk-lvXx_0 2024-09-12T18:13:48.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.646+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4946416469524474677', time=2024-09-12T19:48:07.641946+0000, chain.objs.size()=1 2024-09-12T18:13:48.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.646+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ASJr_EgpbD7UdxdIlHBvblATV1j_TII_0 2024-09-12T18:13:48.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.646+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6563552749424465898', time=2024-09-12T19:48:08.773885+0000, chain.objs.size()=1 2024-09-12T18:13:48.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.646+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.UP3HJq89QwtSR4yU0hKFg1LLEwxeDAZ_0 2024-09-12T18:13:48.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.647+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15571026019351335149', time=2024-09-12T19:48:08.931480+0000, chain.objs.size()=1 2024-09-12T18:13:48.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.647+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.KVp4ydtjEOlMA-m1nzuxO8mc_mEFA5p_0 2024-09-12T18:13:48.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.647+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10096785257593749086', time=2024-09-12T19:48:08.962530+0000, chain.objs.size()=1 2024-09-12T18:13:48.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.647+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.DRhmY4hPJ7vrf79mjEhoFBUwTlTVEKc_0 2024-09-12T18:13:48.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.647+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16114712439278941502', time=2024-09-12T19:48:08.976242+0000, chain.objs.size()=1 2024-09-12T18:13:48.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.647+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.G9-7q-GBfXsbo5vH9WXN9qbk5bXbqoX_0 2024-09-12T18:13:48.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.648+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15237642832728595522', time=2024-09-12T19:48:09.416103+0000, chain.objs.size()=1 2024-09-12T18:13:48.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.648+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.pQyfkCW-ld5jHo3ZCMT0CWhQmHOTv15_0 2024-09-12T18:13:48.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.649+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2121360149895832296', time=2024-09-12T19:48:09.687040+0000, chain.objs.size()=1 2024-09-12T18:13:48.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.649+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.euoYC2hHZEH7kScsaUfKU7r9mOh7Ndv_0 2024-09-12T18:13:48.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.649+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1566991532281736618', time=2024-09-12T19:48:48.201584+0000, chain.objs.size()=1 2024-09-12T18:13:48.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.649+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.KgKhC0HLbihhTNSEAlGd_8uiTQ6850d_0 2024-09-12T18:13:48.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.649+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8834181781726636640', time=2024-09-12T19:48:48.945704+0000, chain.objs.size()=1 2024-09-12T18:13:48.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.649+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.LTgfXbEQ8xSUo1pYA-RH_rhkuGJPQbW_0 2024-09-12T18:13:48.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.649+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9296879261512742317', time=2024-09-12T19:48:49.091637+0000, chain.objs.size()=1 2024-09-12T18:13:48.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.649+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.FhYGXpD4e9gTCIzr5tFF222tRujx-ET_0 2024-09-12T18:13:48.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.649+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13290886779144948437', time=2024-09-12T19:48:49.472444+0000, chain.objs.size()=1 2024-09-12T18:13:48.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.649+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Kox_rm-WZo4Pc_gxCff30iCClCWqReE_0 2024-09-12T18:13:48.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.649+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13511178451524910608', time=2024-09-12T19:48:49.554213+0000, chain.objs.size()=1 2024-09-12T18:13:48.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.649+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.B0KiTdqAPFs0z-WapK0ZE3EMsgMkMwf_0 2024-09-12T18:13:48.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.649+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.172012933002946423', time=2024-09-12T19:48:49.720557+0000, chain.objs.size()=1 2024-09-12T18:13:48.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.649+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.7iHkCPw1LcRxy9_ikGPR5yghqNPbEqC_0 2024-09-12T18:13:48.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.649+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.46281673478131209', time=2024-09-12T19:48:49.909854+0000, chain.objs.size()=1 2024-09-12T18:13:48.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.649+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.J15qYeegobU9_tqUCyb9QabwIPociB0_0 2024-09-12T18:13:48.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.649+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1975247554132958207', time=2024-09-12T19:48:50.478928+0000, chain.objs.size()=1 2024-09-12T18:13:48.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.649+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.TEGHzheTH_lrOGvRevF5m0d2tdVQO0U_0 2024-09-12T18:13:48.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.650+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12903020883251139852', time=2024-09-12T19:48:50.895800+0000, chain.objs.size()=1 2024-09-12T18:13:48.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.650+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.3jG4Q482wSesqDwwEUvlkpzn1PkSJ-p_0 2024-09-12T18:13:48.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.650+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.519431991459827645', time=2024-09-12T19:48:51.358075+0000, chain.objs.size()=1 2024-09-12T18:13:48.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.650+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.-bC8os4gih3r0Krx593WIFQfQOLgUdL_0 2024-09-12T18:13:48.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.651+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7209284093736460824', time=2024-09-12T19:48:51.477396+0000, chain.objs.size()=1 2024-09-12T18:13:48.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.651+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.d7rn93wuyk4eE_KChycEysrmVhSlbwF_0 2024-09-12T18:13:48.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.651+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6574856191074535846', time=2024-09-12T19:48:52.347987+0000, chain.objs.size()=1 2024-09-12T18:13:48.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.651+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.uecI4521l5rqNzYH1TfW2bJys7N74Ph_0 2024-09-12T18:13:48.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.651+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7281584418844638755', time=2024-09-12T19:48:52.365950+0000, chain.objs.size()=1 2024-09-12T18:13:48.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.651+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.diiqy1LDqQMXzMm4C3ayU6cqbUf1a2__0 2024-09-12T18:13:48.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.651+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15224259296369609890', time=2024-09-12T19:48:52.412905+0000, chain.objs.size()=1 2024-09-12T18:13:48.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.651+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.D5pOnN01ztleBNxIuJr_opzoNwU0bxF_0 2024-09-12T18:13:48.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.651+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15697777169791356347', time=2024-09-12T19:48:52.818401+0000, chain.objs.size()=1 2024-09-12T18:13:48.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.651+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.aAI0hVcorVMtr5rKa07TsR9t7J5VrcT_0 2024-09-12T18:13:48.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.651+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1988344693389013594', time=2024-09-12T19:48:53.566793+0000, chain.objs.size()=1 2024-09-12T18:13:48.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.651+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.f-ngeYP4GWbObOYwe4xlKZdf0YPw1Lz_0 2024-09-12T18:13:48.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.651+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11537719226246805340', time=2024-09-12T19:48:54.014631+0000, chain.objs.size()=1 2024-09-12T18:13:48.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.651+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.tCuH9IFnX9eDfHz1oQBP3tayadxiyRW_0 2024-09-12T18:13:48.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.651+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11113311084682417023', time=2024-09-12T19:48:54.225850+0000, chain.objs.size()=1 2024-09-12T18:13:48.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.651+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.32GTCrPDJRabIhyVWHURi0_woEnqMHk_0 2024-09-12T18:13:48.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.653+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/44240 2024-09-12T18:13:48.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.655+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T18:13:48.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.656+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10660756320403983924', time=2024-09-12T19:48:54.235783+0000, chain.objs.size()=1 2024-09-12T18:13:48.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.656+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.0jxObsjlbQ87XyWWznSV46avjmnyTJq_0 2024-09-12T18:13:48.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.656+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16663296592622475708', time=2024-09-12T19:48:54.272061+0000, chain.objs.size()=1 2024-09-12T18:13:48.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.656+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.hyJUdPu0Xxoedqx69N99-CA9G93H_4__0 2024-09-12T18:13:48.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.656+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12020011685587526298', time=2024-09-12T19:48:55.318793+0000, chain.objs.size()=1 2024-09-12T18:13:48.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.656+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.RThrrc1QevhT4XJECQM8GBWYUvb51kU_0 2024-09-12T18:13:48.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.656+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15079105619689080209', time=2024-09-12T19:48:55.588042+0000, chain.objs.size()=1 2024-09-12T18:13:48.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.656+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.waEM6NOt8iNDwr7pn1svQ4Lt0zNYenQ_0 2024-09-12T18:13:48.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.656+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17498161299752392356', time=2024-09-12T19:48:56.041388+0000, chain.objs.size()=1 2024-09-12T18:13:48.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.656+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.EebcvYyjq81vT1-_xhkwz1jEvo02BDh_0 2024-09-12T18:13:48.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.656+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8482687748817433155', time=2024-09-12T19:48:56.042144+0000, chain.objs.size()=1 2024-09-12T18:13:48.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.656+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.exIYwWvO5eKFI_iwnTOTgKoIduoObHF_0 2024-09-12T18:13:48.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.656+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8294858412699670653', time=2024-09-12T19:48:56.296960+0000, chain.objs.size()=1 2024-09-12T18:13:48.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.656+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.VjpmD0JDTeGxY72MoK_ode4X3gSEmz6_0 2024-09-12T18:13:48.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.656+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13428443582777517830', time=2024-09-12T19:48:56.376466+0000, chain.objs.size()=1 2024-09-12T18:13:48.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.656+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.zV_7S34JOFpFgUIobfp8duln97L_5g1_0 2024-09-12T18:13:48.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.656+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17915139188533967749', time=2024-09-12T19:48:56.836892+0000, chain.objs.size()=1 2024-09-12T18:13:48.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.656+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.gO51ZdhfXG-8g07pkS5tbrCQkjP1nTO_0 2024-09-12T18:13:48.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.656+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3986130597640155108', time=2024-09-12T19:48:57.430882+0000, chain.objs.size()=1 2024-09-12T18:13:48.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.656+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Z5C00SysFNw2gYNnZOIbPR83JVaU-VF_0 2024-09-12T18:13:48.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.656+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10722320485434272740', time=2024-09-12T19:48:57.445647+0000, chain.objs.size()=1 2024-09-12T18:13:48.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.656+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.jv9ujcHWLPc7cTGsELp3DstsAHMo1ab_0 2024-09-12T18:13:48.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.656+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7029562269766907921', time=2024-09-12T19:48:57.972663+0000, chain.objs.size()=1 2024-09-12T18:13:48.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.656+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.LiuVC_lXJsdFp4kwjY6AbB6wD15ZGbK_0 2024-09-12T18:13:48.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.659+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.960423958310964727', time=2024-09-12T19:49:08.213657+0000, chain.objs.size()=1 2024-09-12T18:13:48.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.659+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.337__shadow_.OyPT8XU2a7Z7qO-nMq-USzgZm-vbRw6_0 2024-09-12T18:13:48.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.659+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11011267777365852753', time=2024-09-12T19:50:10.211013+0000, chain.objs.size()=1 2024-09-12T18:13:48.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.659+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.409__shadow_.rkMebxG9_YtumKz_pxPxlKu0jUTM5zI_0 2024-09-12T18:13:48.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.659+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16340884955749778979', time=2024-09-12T19:50:39.041776+0000, chain.objs.size()=1 2024-09-12T18:13:48.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.659+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.442__shadow_.uQz05nlzCHW4eew1pUNczB4mvGLSLL__0 2024-09-12T18:13:48.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.659+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17351538086364290292', time=2024-09-12T19:51:19.626799+0000, chain.objs.size()=1 2024-09-12T18:13:48.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.659+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.485__shadow_.Yb3DwFF3V_MzscwlzeHEtnq-Z5jIGYR_0 2024-09-12T18:13:48.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.660+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7408935900888829262', time=2024-09-12T19:51:40.729195+0000, chain.objs.size()=1 2024-09-12T18:13:48.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.660+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.504__shadow:-V-p6OxZtM7hRMUzkyItZ02ZaGvL5CT_.X0PQumandVzjwgbUSUv4JkorH1YhtZM_0 2024-09-12T18:13:48.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.660+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4961901912754477114', time=2024-09-12T19:54:58.467696+0000, chain.objs.size()=6 2024-09-12T18:13:48.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.660+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~x_Teqbfdd2YsKMCE6RGzqf8I8ak8L29.1 2024-09-12T18:13:48.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.660+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.mKsjVGXiQef8uRCVX4GsvlfCuMQdP5fK.2 2024-09-12T18:13:48.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.660+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.6HC-Lz79Pq90H-oQ5aH5qdR6Yfk87mWI.3 2024-09-12T18:13:48.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.660+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~x_Teqbfdd2YsKMCE6RGzqf8I8ak8L29.4 2024-09-12T18:13:48.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.660+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~x_Teqbfdd2YsKMCE6RGzqf8I8ak8L29.5 2024-09-12T18:13:48.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.660+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~x_Teqbfdd2YsKMCE6RGzqf8I8ak8L29.6 2024-09-12T18:13:48.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.660+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1284572124180070776', time=2024-09-12T19:57:32.270527+0000, chain.objs.size()=1 2024-09-12T18:13:48.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.660+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.558__shadow_.gMas5fqb2Il_hegOXA38ktAlQCJ8Btq_0 2024-09-12T18:13:48.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.660+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14171307137094830155', time=2024-09-12T19:58:12.544104+0000, chain.objs.size()=1 2024-09-12T18:13:48.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.660+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.574__shadow_.xHZAR7RI3JllGKG18Bd0odTxMxbAb3u_0 2024-09-12T18:13:48.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.660+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13137999004137494962', time=2024-09-12T19:58:34.990093+0000, chain.objs.size()=1 2024-09-12T18:13:48.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.660+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:fpSbBLutmH6HUJ0eKuQx4xrNrfizxND_.oj7IwG3sEKALeqxL7zCcZfQfVjXi3YJ_0 2024-09-12T18:13:48.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.660+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14844177273568224733', time=2024-09-12T19:58:47.165006+0000, chain.objs.size()=1 2024-09-12T18:13:48.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.660+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:PXENTUkRuvJuHYWk.UhY4l7PJfyGbrE_.rqLbXUrObPWT6egRYvZSZFldBoUz_yJ_0 2024-09-12T18:13:48.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.662+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10485218632629796986', time=2024-09-12T19:59:37.389809+0000, chain.objs.size()=1 2024-09-12T18:13:48.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.662+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.586__shadow:Y-twcYET0X0GRJLfDISUw2uYeS94Gp5_.BKcIOHz_6ih0hcmvFSA3E4rR9QxxIgp_0 2024-09-12T18:13:48.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.663+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1091539347219359994', time=2024-09-12T20:06:38.949054+0000, chain.objs.size()=1 2024-09-12T18:13:48.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.663+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.710__shadow_.TAyBms-2h1rQcx4o_7U_-cH-DEmSngN_0 2024-09-12T18:13:48.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.663+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11831291446021766804', time=2024-09-12T20:06:42.546382+0000, chain.objs.size()=1 2024-09-12T18:13:48.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.663+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.714__shadow:iQxIZd.k5lZNU7qrN3UBtBGttjn4Ch4_.pwJc7iwmZwlj7Kuj3tRRfhzXgAZdich_0 2024-09-12T18:13:48.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.666+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:48.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.668+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:13:48.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.669+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:48.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.670+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:48.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.671+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50102' 2024-09-12T18:13:48.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.671+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.479033307425524289', time=2024-09-12T19:42:28.288681+0000, chain.objs.size()=1 2024-09-12T18:13:48.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.671+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.172__shadow_.IyYuZpYLKcejpmHcHfinZXFbufT6iks_0 2024-09-12T18:13:48.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.671+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10549506335044781576', time=2024-09-12T19:45:01.884384+0000, chain.objs.size()=1 2024-09-12T18:13:48.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.671+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.232__shadow_.NX6UzRFcii0xw_6Z5GcbtJxqWPxry5B_0 2024-09-12T18:13:48.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.671+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5792890757379072753', time=2024-09-12T19:45:06.448628+0000, chain.objs.size()=1 2024-09-12T18:13:48.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.671+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.237__shadow_.65cp4_ue1MmygQJSynZ64HHEr94D0re_0 2024-09-12T18:13:48.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.671+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18046565404510446589', time=2024-09-12T19:45:19.116248+0000, chain.objs.size()=1 2024-09-12T18:13:48.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.671+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.248__shadow_.90xRKBxMsPh2qZUlWUs-YkarLlTwfJ5_0 2024-09-12T18:13:48.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.671+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14273379094214937898', time=2024-09-12T19:45:31.756383+0000, chain.objs.size()=1 2024-09-12T18:13:48.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.671+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.262__shadow_.C4nfiYEeP-Ha4qtAebGof29G3uHc1RP_0 2024-09-12T18:13:48.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.671+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2413934507815234650', time=2024-09-12T19:46:08.993445+0000, chain.objs.size()=1 2024-09-12T18:13:48.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.671+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Qykmfdg4WZrb37heB8K9nyCNeNbt5su_0 2024-09-12T18:13:48.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.671+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5395662068749677996', time=2024-09-12T19:46:09.150392+0000, chain.objs.size()=1 2024-09-12T18:13:48.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.671+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.7IYRQIermwPnb_x6FUnRk0-H4Eotc-1_0 2024-09-12T18:13:48.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.671+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.217532357637736223', time=2024-09-12T19:46:10.665531+0000, chain.objs.size()=1 2024-09-12T18:13:48.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.671+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.2Xi1W3qPMY2FG2TnjcE7k8iVXWpZK52_0 2024-09-12T18:13:48.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.671+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9957682859230063409', time=2024-09-12T19:46:11.065397+0000, chain.objs.size()=1 2024-09-12T18:13:48.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.671+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.qXRG3EcTyHCg8knrMQJ1TNOS06bhej4_0 2024-09-12T18:13:48.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.671+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6602957954651634717', time=2024-09-12T19:46:11.297687+0000, chain.objs.size()=1 2024-09-12T18:13:48.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.671+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Tn8UifK-WqGUR5rcWsYFQM4dF1q289M_0 2024-09-12T18:13:48.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.671+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4738668856248865943', time=2024-09-12T19:46:11.895584+0000, chain.objs.size()=1 2024-09-12T18:13:48.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.671+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Wa4gZ4TRxpAGHh0BYveUjNEVdCb-Ls4_0 2024-09-12T18:13:48.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.671+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18021586460929786135', time=2024-09-12T19:46:11.973481+0000, chain.objs.size()=1 2024-09-12T18:13:48.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.671+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.vgwThe36xnNtp3oje-ZUkHGjYO4EXyS_0 2024-09-12T18:13:48.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.672+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3771929395460304191', time=2024-09-12T19:46:12.661608+0000, chain.objs.size()=1 2024-09-12T18:13:48.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.672+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.6XWkKUbotlueLFu4vZcfn6JT60DmpVV_0 2024-09-12T18:13:48.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.675+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4908914870976492643', time=2024-09-12T19:46:12.663022+0000, chain.objs.size()=1 2024-09-12T18:13:48.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.675+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.HUK8yqyro3xJShw3w2DvTOPXy9NUt_x_0 2024-09-12T18:13:48.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.675+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13145198157954042391', time=2024-09-12T19:46:12.722766+0000, chain.objs.size()=1 2024-09-12T18:13:48.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.675+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.nBMGjNSqcSYWsjiM1chY-iTuq5Ofe1M_0 2024-09-12T18:13:48.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.675+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11757601237145318713', time=2024-09-12T19:46:12.874829+0000, chain.objs.size()=1 2024-09-12T18:13:48.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.675+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.aMkYzITkVuezylVTb83KU2x0FwHqrPg_0 2024-09-12T18:13:48.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.675+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3799253899165895183', time=2024-09-12T19:46:13.856864+0000, chain.objs.size()=1 2024-09-12T18:13:48.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.675+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.-cZkQhyeKO3oQJThZQuivxF077BLSNt_0 2024-09-12T18:13:48.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.675+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.28006985792106169', time=2024-09-12T19:46:13.889292+0000, chain.objs.size()=1 2024-09-12T18:13:48.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.675+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.M8GdLRdF721613vqBbjfky0bqoZnQnK_0 2024-09-12T18:13:48.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.675+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13465815702080687135', time=2024-09-12T19:46:13.956407+0000, chain.objs.size()=1 2024-09-12T18:13:48.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.675+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.dBZz21OJLhnhEBscF6RZlcpuxGDpJTG_0 2024-09-12T18:13:48.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.675+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16842564832283814604', time=2024-09-12T19:46:14.036802+0000, chain.objs.size()=1 2024-09-12T18:13:48.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.675+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.GlkjCR9vS3FMlsF75lAGGcq4fVdpeou_0 2024-09-12T18:13:48.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.675+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4675979089593572218', time=2024-09-12T19:46:14.121418+0000, chain.objs.size()=1 2024-09-12T18:13:48.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.675+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.KQ4PDJzuSxTw4_2n_c6PwAESGl34Tpw_0 2024-09-12T18:13:48.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.675+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1735866995040171064', time=2024-09-12T19:46:15.546867+0000, chain.objs.size()=1 2024-09-12T18:13:48.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.675+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.XpJ7xaaBMxTAVqsSujUVh63kf3t64DA_0 2024-09-12T18:13:48.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.675+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.581975244896698639', time=2024-09-12T19:46:15.547731+0000, chain.objs.size()=1 2024-09-12T18:13:48.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.675+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.W3a2ml4nu15Ptd2h1o5JTzKd40g0xcc_0 2024-09-12T18:13:48.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.675+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10482953921601937798', time=2024-09-12T19:46:15.706006+0000, chain.objs.size()=1 2024-09-12T18:13:48.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.675+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.LP4JKvfICYPJf8rtZ3qSxlI4WY1hxCN_0 2024-09-12T18:13:48.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.676+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4391120013602107665', time=2024-09-12T19:46:16.177277+0000, chain.objs.size()=1 2024-09-12T18:13:48.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.676+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.8Cexh-mHbsuqenFpk_stFQnWb5o3El3_0 2024-09-12T18:13:48.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.678+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6381798951936164941', time=2024-09-12T19:46:16.326186+0000, chain.objs.size()=1 2024-09-12T18:13:48.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.678+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ns_XGziwnS0o6H4sKyOFKBEX_-5NxSW_0 2024-09-12T18:13:48.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.678+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4240376648794619965', time=2024-09-12T19:46:16.444628+0000, chain.objs.size()=1 2024-09-12T18:13:48.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.678+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.cPPAr6Ed5Y2tHWr7MIxJkQemkPUa8u9_0 2024-09-12T18:13:48.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.678+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5841425186750041299', time=2024-09-12T19:46:16.541511+0000, chain.objs.size()=1 2024-09-12T18:13:48.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.678+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.rUk795YyMKzoen-XRluPcbo4jmLpprv_0 2024-09-12T18:13:48.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.678+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3056560235756936948', time=2024-09-12T19:46:16.864044+0000, chain.objs.size()=1 2024-09-12T18:13:48.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.678+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.pqBiBW3JNhy8W4Wwd_rdQqZm6FMit76_0 2024-09-12T18:13:48.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.678+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1278448679110503707', time=2024-09-12T19:46:17.796876+0000, chain.objs.size()=1 2024-09-12T18:13:48.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.678+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Euo0kDzceI5WReSYxzfcW7KIzaMDRHE_0 2024-09-12T18:13:48.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.678+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9657257628351587674', time=2024-09-12T19:46:17.869772+0000, chain.objs.size()=1 2024-09-12T18:13:48.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.678+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.EWKCq8uJFPLBv_9sBZiw9lGWCf6B1jq_0 2024-09-12T18:13:48.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.678+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9849908925479311183', time=2024-09-12T19:46:18.831362+0000, chain.objs.size()=1 2024-09-12T18:13:48.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.678+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.oy33srFPQPG1bZA1qiQYr8V9i7diUSw_0 2024-09-12T18:13:48.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.678+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12772054941046769308', time=2024-09-12T19:46:42.094708+0000, chain.objs.size()=1 2024-09-12T18:13:48.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.678+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.288__shadow_.BvP-gwtuJTiVUX9CuM3TRb-pJw0f_O8_0 2024-09-12T18:13:48.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.678+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2914439566308883512', time=2024-09-12T19:46:48.102522+0000, chain.objs.size()=1 2024-09-12T18:13:48.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.678+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.293__shadow_.71NgyWqcNjANuLbM2fHV2cfx3BgTCxu_0 2024-09-12T18:13:48.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.678+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2852431890895005712', time=2024-09-12T19:46:50.330402+0000, chain.objs.size()=1 2024-09-12T18:13:48.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.678+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.294__shadow_.FBN6QixFQRff3mdbz55sPPiDaR-MSNl_0 2024-09-12T18:13:48.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.678+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1550384786722652984', time=2024-09-12T19:46:56.088490+0000, chain.objs.size()=1 2024-09-12T18:13:48.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.678+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.300__shadow_.d0zBdwHb_KQLxduDAOg6Eig3u7oCYos_0 2024-09-12T18:13:48.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.679+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11871494870724847976', time=2024-09-12T19:46:57.911573+0000, chain.objs.size()=1 2024-09-12T18:13:48.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.679+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.302__shadow_.RrdPkyz-gyo5Tv3PvDeEoeVTBX_Hza6_0 2024-09-12T18:13:48.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.681+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14768458035396149651', time=2024-09-12T19:47:04.244121+0000, chain.objs.size()=1 2024-09-12T18:13:48.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.681+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.308__shadow:0UKU6h5jWC5LJQv.TKX.27LRAJt1yTy_.kZtSqugC-f777KPZ4Vr9lUtnKKIfD6p_0 2024-09-12T18:13:48.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.681+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5871837100317084385', time=2024-09-12T19:47:59.622502+0000, chain.objs.size()=1 2024-09-12T18:13:48.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.681+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Nn_WghfUI6c9vhY3tlWBtk4p8mCjzzS_0 2024-09-12T18:13:48.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.681+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9859349457731295955', time=2024-09-12T19:47:59.671020+0000, chain.objs.size()=1 2024-09-12T18:13:48.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.681+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.8SuRuXGpc1kDVOs3fW8_AdlbYh1D9dy_0 2024-09-12T18:13:48.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.681+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10872102755741457143', time=2024-09-12T19:48:00.156215+0000, chain.objs.size()=1 2024-09-12T18:13:48.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.681+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.M00YsDVuPnugmowF-2xS5xkdag11nFq_0 2024-09-12T18:13:48.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.681+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11417742660193754853', time=2024-09-12T19:48:00.313859+0000, chain.objs.size()=1 2024-09-12T18:13:48.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.681+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.eT_7yByEQw2qXoRNcfoIIBFh-qr2psL_0 2024-09-12T18:13:48.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.681+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.954524826106214867', time=2024-09-12T19:48:00.426367+0000, chain.objs.size()=1 2024-09-12T18:13:48.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.681+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.whBCSC2vA_GGhcyYE4MMGFQiDl1aQLZ_0 2024-09-12T18:13:48.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.681+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2679251726970772975', time=2024-09-12T19:48:00.493345+0000, chain.objs.size()=1 2024-09-12T18:13:48.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.681+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.e4gk5i97l_6FnJHAWTweXJ8UugvOLgS_0 2024-09-12T18:13:48.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.681+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12489633525032179911', time=2024-09-12T19:48:01.946100+0000, chain.objs.size()=1 2024-09-12T18:13:48.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.681+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ePfiIeKaiYboXyv_39CrQMea2RWUD_C_0 2024-09-12T18:13:48.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.681+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11763126178133601976', time=2024-09-12T19:48:02.494185+0000, chain.objs.size()=1 2024-09-12T18:13:48.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.681+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.6nFMALOAA18_vQtMzrRRR2sEORv9NLT_0 2024-09-12T18:13:48.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.681+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6333748043029708416', time=2024-09-12T19:48:02.661467+0000, chain.objs.size()=1 2024-09-12T18:13:48.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.681+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.bONwb_-bkeUhuwv4RjFLCRZZXQgo6Fg_0 2024-09-12T18:13:48.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.681+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5324340965193127135', time=2024-09-12T19:48:02.872841+0000, chain.objs.size()=1 2024-09-12T18:13:48.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.681+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.7faHq6jILkqBrMyb-ZiS1EBwOUGWBoQ_0 2024-09-12T18:13:48.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.683+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7977929247846298659', time=2024-09-12T19:48:03.036089+0000, chain.objs.size()=1 2024-09-12T18:13:48.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.683+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.8bdy6FO4867hkJwnmZMOa3xHszl26Qc_0 2024-09-12T18:13:48.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.684+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15395620825912613758', time=2024-09-12T19:48:03.096573+0000, chain.objs.size()=1 2024-09-12T18:13:48.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.684+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.c1acgRTGNT8AFsLncJfzqzL0cqmML6P_0 2024-09-12T18:13:48.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.684+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4838918253356916733', time=2024-09-12T19:48:03.214025+0000, chain.objs.size()=1 2024-09-12T18:13:48.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.684+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Z7BaeipvYp5PtzdK395lv9RDQ3Hfqgo_0 2024-09-12T18:13:48.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.684+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14650343294253455575', time=2024-09-12T19:48:03.281042+0000, chain.objs.size()=1 2024-09-12T18:13:48.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.684+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.5drsHqH1i4E0VwewWe2n-AUIOLXZ5Vh_0 2024-09-12T18:13:48.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.684+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16042684672780774684', time=2024-09-12T19:48:04.049947+0000, chain.objs.size()=1 2024-09-12T18:13:48.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.684+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.-_irPzvbOWmHJDjK5wAZAq6-_Nh87aF_0 2024-09-12T18:13:48.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.684+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16583536117230178187', time=2024-09-12T19:48:04.500591+0000, chain.objs.size()=1 2024-09-12T18:13:48.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.684+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.qNfPf47UPoSzcXO4DNnp8B3YVOduM-Q_0 2024-09-12T18:13:48.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.684+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7819200026791263810', time=2024-09-12T19:48:04.586451+0000, chain.objs.size()=1 2024-09-12T18:13:48.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.684+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.EzMrX_FDMjzJC_Y_4BK2Ezg-xMnefYC_0 2024-09-12T18:13:48.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.684+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1155444867568675568', time=2024-09-12T19:48:04.610153+0000, chain.objs.size()=1 2024-09-12T18:13:48.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.684+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.wP-uKLMpRYM6UWqDUZOBbmBgQWWW4pK_0 2024-09-12T18:13:48.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.684+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16176557467303493182', time=2024-09-12T19:48:04.854807+0000, chain.objs.size()=1 2024-09-12T18:13:48.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.684+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.YnwXcWPu6oZrCqPdjFe6jsTceLXPdrm_0 2024-09-12T18:13:48.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.684+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6293909910301199803', time=2024-09-12T19:48:05.305927+0000, chain.objs.size()=1 2024-09-12T18:13:48.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.684+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.uA2xQo7r-nUpkMEj4fdcGcKoqIZ_meL_0 2024-09-12T18:13:48.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.685+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5049960387880183046', time=2024-09-12T19:48:05.426612+0000, chain.objs.size()=1 2024-09-12T18:13:48.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.685+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.HTqIVTmC_iDyVXDe8rBlaFGvoWK1g0k_0 2024-09-12T18:13:48.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.686+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16576048826835333583', time=2024-09-12T19:48:05.475759+0000, chain.objs.size()=1 2024-09-12T18:13:48.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.686+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.XeogVXpwebEpohdt3-3_tnCp9BwsdSA_0 2024-09-12T18:13:48.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.686+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7616464619443246900', time=2024-09-12T19:48:05.654519+0000, chain.objs.size()=1 2024-09-12T18:13:48.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.686+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.wb8zC3masRwS0O4WV1KtMxnjZSgmESX_0 2024-09-12T18:13:48.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.687+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14623597795325035149', time=2024-09-12T19:48:05.778359+0000, chain.objs.size()=1 2024-09-12T18:13:48.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.687+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.5Wcb6FqDqzSeJX7zP83r1c3a_JjHtFQ_0 2024-09-12T18:13:48.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.687+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.182085386590780940', time=2024-09-12T19:48:05.866258+0000, chain.objs.size()=1 2024-09-12T18:13:48.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.687+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.AM6-bPQWqIVg5sV8xcGlgkRY56cpIfb_0 2024-09-12T18:13:48.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.687+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13896317245183321858', time=2024-09-12T19:48:06.129021+0000, chain.objs.size()=1 2024-09-12T18:13:48.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.687+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.w2ajiXfxt1E2epq95bdlhjkTFMZKcKe_0 2024-09-12T18:13:48.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.687+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11706484266679430173', time=2024-09-12T19:48:06.827905+0000, chain.objs.size()=1 2024-09-12T18:13:48.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.687+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.WOcNYFcPLC5mKenrJe2-dkujaPo5qNf_0 2024-09-12T18:13:48.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.687+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11419607253232195181', time=2024-09-12T19:48:06.828604+0000, chain.objs.size()=1 2024-09-12T18:13:48.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.687+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.h40MhDqAN0718yzdTESpkTxJDBgCjRr_0 2024-09-12T18:13:48.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.687+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14840525689567730491', time=2024-09-12T19:48:07.098107+0000, chain.objs.size()=1 2024-09-12T18:13:48.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.687+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.JPrKBIX4d86XLbFthNViUrJhAMOIgcZ_0 2024-09-12T18:13:48.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.687+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5299011287543448203', time=2024-09-12T19:48:07.250529+0000, chain.objs.size()=1 2024-09-12T18:13:48.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.688+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.0bpfYml1XM1Ycx6ik4BLKH8X-cW3VOe_0 2024-09-12T18:13:48.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.688+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5076807283189992320', time=2024-09-12T19:48:07.378992+0000, chain.objs.size()=1 2024-09-12T18:13:48.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.688+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.3jb25Aetmd_z-eVZYx4kJ09z_bL_NWu_0 2024-09-12T18:13:48.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.688+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4636519294904888139', time=2024-09-12T19:48:08.270771+0000, chain.objs.size()=1 2024-09-12T18:13:48.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.688+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.micyG0d-Ziuf6XONeL1q74d9milWrtI_0 2024-09-12T18:13:48.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.689+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4264308769656910168', time=2024-09-12T19:48:08.394177+0000, chain.objs.size()=1 2024-09-12T18:13:48.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.689+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.nFTBB2RbCDMewqs4PTx5OHFvJ_a47Kc_0 2024-09-12T18:13:48.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.689+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12768249422066303573', time=2024-09-12T19:48:08.490463+0000, chain.objs.size()=1 2024-09-12T18:13:48.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.689+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.x4zuPVJD21TF5jGmdhjmNQ7Gqso6R1J_0 2024-09-12T18:13:48.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.689+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6398081100654260366', time=2024-09-12T19:48:08.787613+0000, chain.objs.size()=1 2024-09-12T18:13:48.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.689+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.BeFTEnEu4rck4_4ED_p2qON5bEBmTKz_0 2024-09-12T18:13:48.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.689+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6302598508154535731', time=2024-09-12T19:48:09.247738+0000, chain.objs.size()=1 2024-09-12T18:13:48.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.689+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.GKIbOguZjXeSRpS01on0ARwLKlIFdmz_0 2024-09-12T18:13:48.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.693+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11568499124753989047', time=2024-09-12T19:48:09.415688+0000, chain.objs.size()=1 2024-09-12T18:13:48.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.693+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ceI8TvTr7hWMryRQu3QZtAqMO7GZnnv_0 2024-09-12T18:13:48.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.693+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1726041050881852770', time=2024-09-12T19:48:09.459229+0000, chain.objs.size()=1 2024-09-12T18:13:48.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.693+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.QZS6nPjFT9-J-XCj_tKF1b6XNTTD3WU_0 2024-09-12T18:13:48.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.693+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18037052147155604166', time=2024-09-12T19:48:09.460061+0000, chain.objs.size()=1 2024-09-12T18:13:48.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.693+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.7AxdB3pdKFPRqpw5GHmdS8aANJ16TMS_0 2024-09-12T18:13:48.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.693+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11713905362520311505', time=2024-09-12T19:48:09.579721+0000, chain.objs.size()=1 2024-09-12T18:13:48.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.693+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.dF_Pab3HK4a77OZE61zqLUcyjbFnmQC_0 2024-09-12T18:13:48.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.693+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1915022447977718400', time=2024-09-12T19:48:09.593951+0000, chain.objs.size()=1 2024-09-12T18:13:48.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.693+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.myeCTN05MihyTjs95_0ezSpWVZZEKjR_0 2024-09-12T18:13:48.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.693+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17652517574224716221', time=2024-09-12T19:48:09.688863+0000, chain.objs.size()=1 2024-09-12T18:13:48.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.693+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.JrDKBn9VZUC_LwicrUHhmWpFCdmFnvp_0 2024-09-12T18:13:48.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.693+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3007106860877072942', time=2024-09-12T19:48:09.835551+0000, chain.objs.size()=1 2024-09-12T18:13:48.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.693+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.D1CGf42pVw7LlhWvOKDOliDKAfcGKlE_0 2024-09-12T18:13:48.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.693+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.960854317401762733', time=2024-09-12T19:48:09.836641+0000, chain.objs.size()=1 2024-09-12T18:13:48.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.693+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.MhjLMvPClLcajA646qNRYI5lgzpUyaK_0 2024-09-12T18:13:48.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.693+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17496680585304962108', time=2024-09-12T19:48:47.507430+0000, chain.objs.size()=1 2024-09-12T18:13:48.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.693+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.btDZudZxB4_Lbt0rQwQ8sdW5nFEwt7i_0 2024-09-12T18:13:48.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.693+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7049198232220185061', time=2024-09-12T19:48:47.942173+0000, chain.objs.size()=1 2024-09-12T18:13:48.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.693+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.CF0l-3BxIRnslBfhLMlIogGG6nJK_Qx_0 2024-09-12T18:13:48.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.693+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9048496475010427701', time=2024-09-12T19:48:47.962794+0000, chain.objs.size()=1 2024-09-12T18:13:48.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.693+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.BFI5HSbakOeM7Yxt87iyvum0i3q5wpW_0 2024-09-12T18:13:48.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.695+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3688530558227801549', time=2024-09-12T19:48:48.188606+0000, chain.objs.size()=1 2024-09-12T18:13:48.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.695+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.a6UBKdQ-SiX7B7ZeMBpvrXG1isU6cRL_0 2024-09-12T18:13:48.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.695+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14939902660321681901', time=2024-09-12T19:48:48.340163+0000, chain.objs.size()=1 2024-09-12T18:13:48.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.695+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Fd-NYD1wVHTQOWyyH-VpPJ766qO68YU_0 2024-09-12T18:13:48.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.695+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10715625272664061715', time=2024-09-12T19:48:48.958824+0000, chain.objs.size()=1 2024-09-12T18:13:48.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.695+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.uIH6yV_XZMDSOM_0g9hvEaAhAy5NM2n_0 2024-09-12T18:13:48.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.695+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9364973664033458598', time=2024-09-12T19:48:49.802429+0000, chain.objs.size()=1 2024-09-12T18:13:48.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.695+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.OIxaJVFHx9PBy_H6jppcydnXesDV6rJ_0 2024-09-12T18:13:48.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.695+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9289329977074820509', time=2024-09-12T19:48:50.434355+0000, chain.objs.size()=1 2024-09-12T18:13:48.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.695+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.P7gkmTxAaQe3fXjecjrglwmbByh-8TN_0 2024-09-12T18:13:48.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.695+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.769818449572403421', time=2024-09-12T19:48:51.088723+0000, chain.objs.size()=1 2024-09-12T18:13:48.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.695+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Yygnb745CWYgpLg3h8TnKeumSsakqYF_0 2024-09-12T18:13:48.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.695+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4959404979617615512', time=2024-09-12T19:48:51.144650+0000, chain.objs.size()=1 2024-09-12T18:13:48.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.695+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.RsWqTIdOBKia2eyPUBrM7L76xNZ1FjO_0 2024-09-12T18:13:48.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.697+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9831471547453950963', time=2024-09-12T19:48:51.348064+0000, chain.objs.size()=1 2024-09-12T18:13:48.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.697+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.VBlWF4PRvD20ty_JUPWloDJWsb7iJ___0 2024-09-12T18:13:48.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.697+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6588196079486814253', time=2024-09-12T19:48:51.479400+0000, chain.objs.size()=1 2024-09-12T18:13:48.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.697+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.rh_6zrn1yhfeu8KSj5cYkjX2-Cxi6Xn_0 2024-09-12T18:13:48.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.697+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5141921124734278716', time=2024-09-12T19:48:51.922541+0000, chain.objs.size()=1 2024-09-12T18:13:48.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.697+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ZGBkRWedlhfmbV1UCBsq9f6FWE1U29Q_0 2024-09-12T18:13:48.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.697+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16035124236373000447', time=2024-09-12T19:48:51.957920+0000, chain.objs.size()=1 2024-09-12T18:13:48.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.697+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ihQiF19ADj_dlvVY3NCRqpj-MFGjjD-_0 2024-09-12T18:13:48.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.697+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13810391394775095636', time=2024-09-12T19:48:52.547807+0000, chain.objs.size()=1 2024-09-12T18:13:48.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.697+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Yq6F3Yc1IXsRTxpJtqFDk4qRNeVgWPs_0 2024-09-12T18:13:48.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.700+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4970682808029782529', time=2024-09-12T19:48:52.699040+0000, chain.objs.size()=1 2024-09-12T18:13:48.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.700+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.K9kHqLaOL9V4pkrr0t2JXf_stRICBYH_0 2024-09-12T18:13:48.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.700+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9480894969688328556', time=2024-09-12T19:48:52.800131+0000, chain.objs.size()=1 2024-09-12T18:13:48.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.700+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.WJpsuyLP6kOYv2IdHeraC2wqDOR62R6_0 2024-09-12T18:13:48.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.700+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10252319442507095228', time=2024-09-12T19:48:52.907165+0000, chain.objs.size()=1 2024-09-12T18:13:48.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.700+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.7lPGFpdK6BKXPkpmBYLyZmmP9gjpoLe_0 2024-09-12T18:13:48.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.703+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/50102 2024-09-12T18:13:48.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.706+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-12T18:13:48.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.706+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14843403380977427158', time=2024-09-12T19:48:53.302033+0000, chain.objs.size()=1 2024-09-12T18:13:48.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.706+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.5d9eLTsMRirT9P1rPTOJanvzmtdE8PP_0 2024-09-12T18:13:48.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.706+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16319772369837434556', time=2024-09-12T19:48:53.587277+0000, chain.objs.size()=1 2024-09-12T18:13:48.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.706+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.omWf7L2QayA5bgTMSG088QW6ueGhMDI_0 2024-09-12T18:13:48.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.706+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8805227739644722047', time=2024-09-12T19:48:53.714148+0000, chain.objs.size()=1 2024-09-12T18:13:48.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.706+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.bYdjF2iloiNQuD3KAjTWlGX9ZjT-ens_0 2024-09-12T18:13:48.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.706+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7098409448506450622', time=2024-09-12T19:48:53.960556+0000, chain.objs.size()=1 2024-09-12T18:13:48.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.706+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ptKok6VkfdbI3oFVQeemxW_JYM1tyyd_0 2024-09-12T18:13:48.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.706+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7218557101625607519', time=2024-09-12T19:48:53.961105+0000, chain.objs.size()=1 2024-09-12T18:13:48.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.706+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.GgxnhhRBWWaQvjw_NjCbM0UzG4DE1eD_0 2024-09-12T18:13:48.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.706+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12849701172177947539', time=2024-09-12T19:48:53.961788+0000, chain.objs.size()=1 2024-09-12T18:13:48.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.706+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.bZUVkX5juCxWiiUnTjeV-bbBtJ0VQx9_0 2024-09-12T18:13:48.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.706+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9160800082074451304', time=2024-09-12T19:48:54.623038+0000, chain.objs.size()=1 2024-09-12T18:13:48.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.706+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.FrpobwCDHtmaOART4TsFv80d968uBvL_0 2024-09-12T18:13:48.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.706+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14348265868868860283', time=2024-09-12T19:48:55.319636+0000, chain.objs.size()=1 2024-09-12T18:13:48.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.706+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.srgsQzMfVOnZXyNiUij7lMe_MbTHKyv_0 2024-09-12T18:13:48.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.706+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14587446882219554666', time=2024-09-12T19:48:55.438845+0000, chain.objs.size()=1 2024-09-12T18:13:48.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.706+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.MytuBT7C3ozrfP63easSG2L_PQTBE7p_0 2024-09-12T18:13:48.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.706+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18295001992341593407', time=2024-09-12T19:48:55.530565+0000, chain.objs.size()=1 2024-09-12T18:13:48.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.706+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.MKeXTxHaljkOvg4Lj2UU9DoYRuAeWHK_0 2024-09-12T18:13:48.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.706+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11286103740739890916', time=2024-09-12T19:48:56.328341+0000, chain.objs.size()=1 2024-09-12T18:13:48.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.706+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_._URCM_WO1NmT6pm8NnQdxQLZYP0KRR1_0 2024-09-12T18:13:48.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.706+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5957511302327193548', time=2024-09-12T19:48:56.660034+0000, chain.objs.size()=1 2024-09-12T18:13:48.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.706+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.XVlBBhNadM7looiGmCkIuFm8GCL_NyG_0 2024-09-12T18:13:48.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.710+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1047778643850660816', time=2024-09-12T19:48:57.898281+0000, chain.objs.size()=1 2024-09-12T18:13:48.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.710+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.iyg6MzYzfFRUxYepEDLOec69X1vRwS6_0 2024-09-12T18:13:48.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.710+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5617166962920627929', time=2024-09-12T19:48:58.042077+0000, chain.objs.size()=1 2024-09-12T18:13:48.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.710+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.nlgC64sXZHXbSQ5ObF7lYfVUo6GO1se_0 2024-09-12T18:13:48.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.710+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9349793825150438038', time=2024-09-12T19:49:03.741813+0000, chain.objs.size()=1 2024-09-12T18:13:48.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.710+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.332__shadow_.pT72K4Tr1OZE-GsbwOHdZtCNc51bh61_0 2024-09-12T18:13:48.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.710+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16643939904013126212', time=2024-09-12T19:49:07.265986+0000, chain.objs.size()=1 2024-09-12T18:13:48.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.710+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.336__shadow_.0Voak3g8Av1FmcSylvKc6mmrdCsaagn_0 2024-09-12T18:13:48.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.710+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11234757273343074819', time=2024-09-12T19:49:40.271790+0000, chain.objs.size()=1 2024-09-12T18:13:48.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.710+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.376__shadow_.rm3QUq-RuyAFn4oFAoO3nbTCTgCmZDg_0 2024-09-12T18:13:48.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.710+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11237417564691912484', time=2024-09-12T19:51:01.800928+0000, chain.objs.size()=1 2024-09-12T18:13:48.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.710+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.462__shadow_.o08yYAeRhsTzbTNd_y0Hf0GubD5zMH9_0 2024-09-12T18:13:48.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.710+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5253263124045407561', time=2024-09-12T19:51:30.184663+0000, chain.objs.size()=1 2024-09-12T18:13:48.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.710+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.492__shadow_.SFyLicxyWbxjuQYVBtbCQheiF0ZLYxb_0 2024-09-12T18:13:48.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.710+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13153108224615602264', time=2024-09-12T19:51:33.372945+0000, chain.objs.size()=1 2024-09-12T18:13:48.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.710+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.497__shadow_.p8b-D26SN0YNNeOuv_Go35i3AD34zjy_0 2024-09-12T18:13:48.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.710+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.608737805716218150', time=2024-09-12T19:52:18.714510+0000, chain.objs.size()=1 2024-09-12T18:13:48.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.710+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.516__shadow_.kGA51yaYcshOxDSJQJshO19s0N7WBZQ_0 2024-09-12T18:13:48.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.710+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9311956877226682818', time=2024-09-12T19:57:01.157065+0000, chain.objs.size()=1 2024-09-12T18:13:48.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.710+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.551__shadow_.mFgsI7lvxN-5D1DkKLASzDlWssXAD_e_0 2024-09-12T18:13:48.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.710+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10818943185924562299', time=2024-09-12T19:58:25.521926+0000, chain.objs.size()=1 2024-09-12T18:13:48.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.710+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.577__shadow:fM9ej2APDxDMYgXFSU.N.g2fIlMX3PU_.5dgKc237kvliWL23j6V1LFeh3D-WJf0_0 2024-09-12T18:13:48.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.712+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13734616776861321784', time=2024-09-12T19:58:29.152485+0000, chain.objs.size()=1 2024-09-12T18:13:48.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.712+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:6xF0o-CRqV1c1I-kmTxvywMMw0X6qyI_.J7EQyAZAxItU1v5xDLySBsKOzg838jb_0 2024-09-12T18:13:48.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.712+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1587754374122788202', time=2024-09-12T19:58:43.587294+0000, chain.objs.size()=1 2024-09-12T18:13:48.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.712+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:pkMf2-9OpCDYFAtv2ZMYhaZuq5A7Jtb_.z8ZtFQOq7YZNeMx1QYPs9qU1JEvQZMH_0 2024-09-12T18:13:48.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.712+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2490673757162541084', time=2024-09-12T20:05:02.762771+0000, chain.objs.size()=1 2024-09-12T18:13:48.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.712+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.639__shadow_.OcGls5UbjZ5q0lEq6abK9F-qR0JHvvA_0 2024-09-12T18:13:48.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.713+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5287847497847853651', time=2024-09-12T20:05:36.301560+0000, chain.objs.size()=1 2024-09-12T18:13:48.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.713+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.657__shadow_.3tuM3Y0qVxjTotwenG6ZYZHBLGMYp7t_0 2024-09-12T18:13:48.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.713+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12832005721199141989', time=2024-09-12T20:06:05.828973+0000, chain.objs.size()=1 2024-09-12T18:13:48.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.713+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.667__shadow_.iBc6Dmgi-kd5qF0d0XIpTR6AyivOp-Z_0 2024-09-12T18:13:48.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.716+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:48.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.720+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:13:48.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.721+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:48.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.722+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:48.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.723+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53213' 2024-09-12T18:13:48.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.723+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10037448185825867451', time=2024-09-12T19:42:22.988996+0000, chain.objs.size()=2 2024-09-12T18:13:48.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.723+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.165__multipart_foo.2~el9ohJYMO73vIgPjcA6vxQVYr1JkSCt.1 2024-09-12T18:13:48.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.723+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.165__multipart_foo.2~el9ohJYMO73vIgPjcA6vxQVYr1JkSCt.2 2024-09-12T18:13:48.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.723+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3431674840900178049', time=2024-09-12T19:43:14.707344+0000, chain.objs.size()=1 2024-09-12T18:13:48.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.723+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.204__shadow_.z0mRIW5-6xlUv7kudwJycV5q5MgIr-o_0 2024-09-12T18:13:48.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.723+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6286876738942182003', time=2024-09-12T19:45:05.526729+0000, chain.objs.size()=1 2024-09-12T18:13:48.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.723+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.236__shadow_.bgeZ5Zq2B-BhRiYAZ7LpJhr-xFBa_TX_0 2024-09-12T18:13:48.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.723+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4793731107172235523', time=2024-09-12T19:46:08.757422+0000, chain.objs.size()=1 2024-09-12T18:13:48.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.723+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.RJXz-Ub7NVlN7j9hBqtHD0zmDe-Ocid_0 2024-09-12T18:13:48.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.723+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6801991311738495079', time=2024-09-12T19:46:08.780215+0000, chain.objs.size()=1 2024-09-12T18:13:48.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.723+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.1dNBiR0_ZsFLsioja1yykInN4N2lwvZ_0 2024-09-12T18:13:48.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.723+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13673354226122173171', time=2024-09-12T19:46:08.941678+0000, chain.objs.size()=1 2024-09-12T18:13:48.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.723+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.VeWTJa2DN80kZH_4LNWlYJS8ani8Vtx_0 2024-09-12T18:13:48.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.723+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6568226593033165783', time=2024-09-12T19:46:08.961024+0000, chain.objs.size()=1 2024-09-12T18:13:48.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.723+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.hRaxd08WumKRtQcVllbfe_Kw2C31Gkw_0 2024-09-12T18:13:48.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.723+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2942702521269984563', time=2024-09-12T19:46:09.132462+0000, chain.objs.size()=1 2024-09-12T18:13:48.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.723+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.hPcIYoFlzv7RA9SLfm5tacVLtn8uGyS_0 2024-09-12T18:13:48.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.723+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12234279576246444677', time=2024-09-12T19:46:09.199022+0000, chain.objs.size()=1 2024-09-12T18:13:48.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.723+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_._bjx79bdzvjYfJbOIZNC0WWmKhChT4B_0 2024-09-12T18:13:48.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.723+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2949852422163642437', time=2024-09-12T19:46:09.303552+0000, chain.objs.size()=1 2024-09-12T18:13:48.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.723+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Yetm5AtIWUBRD62yaNmzje6LUTAmMln_0 2024-09-12T18:13:48.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.723+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2948242797559002699', time=2024-09-12T19:46:10.405103+0000, chain.objs.size()=1 2024-09-12T18:13:48.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.723+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.nvdjr6kz9Kd6C81n7iFiHYkPRt0MduT_0 2024-09-12T18:13:48.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.725+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17568614935533406620', time=2024-09-12T19:46:10.572792+0000, chain.objs.size()=1 2024-09-12T18:13:48.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.725+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.vOmzEfMQGyjHXL2Vx2XCFbHYWqk4EWd_0 2024-09-12T18:13:48.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.725+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8498557777166077903', time=2024-09-12T19:46:10.631162+0000, chain.objs.size()=1 2024-09-12T18:13:48.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.725+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.n0o1b41z9NZdVp3H-u0oCnJI2lceb6__0 2024-09-12T18:13:48.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.725+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6063434107867345756', time=2024-09-12T19:46:10.804714+0000, chain.objs.size()=1 2024-09-12T18:13:48.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.725+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_._xd39ODNfq2a9bmu7AJ7mfGKPF5IfC7_0 2024-09-12T18:13:48.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.725+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2832716400057452623', time=2024-09-12T19:46:11.031943+0000, chain.objs.size()=1 2024-09-12T18:13:48.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.725+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.UlVsTxQGUWjZ3FhJzTUadwo8SwV_i0M_0 2024-09-12T18:13:48.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.725+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11698537320992590931', time=2024-09-12T19:46:11.280136+0000, chain.objs.size()=1 2024-09-12T18:13:48.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.725+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.lH0EAO0Cir_nsTmiVm_e0eusH276J4O_0 2024-09-12T18:13:48.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.725+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14414571536657138008', time=2024-09-12T19:46:11.341029+0000, chain.objs.size()=1 2024-09-12T18:13:48.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.725+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.3jYLny9L8I5XqAF0VJmSy3rkeU2Sdea_0 2024-09-12T18:13:48.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.725+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12531890975936177800', time=2024-09-12T19:46:12.017269+0000, chain.objs.size()=1 2024-09-12T18:13:48.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.725+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.wnpkys91DeeqtMUnCK8cDVM3MVRJJGB_0 2024-09-12T18:13:48.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.725+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1283672566305265000', time=2024-09-12T19:46:12.017970+0000, chain.objs.size()=1 2024-09-12T18:13:48.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.725+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.7W4o5UxPGV2LWgYk-n7AxdiyoRgp-t1_0 2024-09-12T18:13:48.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.725+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7000406633227451600', time=2024-09-12T19:46:12.230576+0000, chain.objs.size()=1 2024-09-12T18:13:48.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.725+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.HHOv4bpeG7402gBnLOrnmXrR1FZ5_WU_0 2024-09-12T18:13:48.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.725+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13501071700207341228', time=2024-09-12T19:46:12.507232+0000, chain.objs.size()=1 2024-09-12T18:13:48.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.725+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.8LvSZ6k7k3Lht6M6KSduXvsONGAPc0S_0 2024-09-12T18:13:48.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.725+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18039597394757674168', time=2024-09-12T19:46:12.525380+0000, chain.objs.size()=1 2024-09-12T18:13:48.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.725+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.8sJ8a_YO84GEDWaRuF_iWIQ5vkHaCUl_0 2024-09-12T18:13:48.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.727+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9950740290915140873', time=2024-09-12T19:46:12.699763+0000, chain.objs.size()=1 2024-09-12T18:13:48.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.727+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.B1ZduL6RJ8Q1wU0nJc9fq-sv9yVSwfM_0 2024-09-12T18:13:48.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.727+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6153870770092364655', time=2024-09-12T19:46:12.776851+0000, chain.objs.size()=1 2024-09-12T18:13:48.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.727+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.rRcvgvyrekkMvenQ2ApZPuoY3ibJ9DQ_0 2024-09-12T18:13:48.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.727+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8061063029835372970', time=2024-09-12T19:46:13.492211+0000, chain.objs.size()=1 2024-09-12T18:13:48.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.727+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.dQwnuiiroKnk8NnahyWKzAUhWTIASmm_0 2024-09-12T18:13:48.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.727+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10488236012501476750', time=2024-09-12T19:46:13.594569+0000, chain.objs.size()=1 2024-09-12T18:13:48.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.727+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.EART3Nx_n0AE3nKpeNmXOe7BibyDsdC_0 2024-09-12T18:13:48.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.727+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14901224950938023592', time=2024-09-12T19:46:13.683034+0000, chain.objs.size()=1 2024-09-12T18:13:48.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.727+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.sBKwYf4XIt7GcqL88rQ1-hiMEvhn69t_0 2024-09-12T18:13:48.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.727+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11950508941532146322', time=2024-09-12T19:46:13.947780+0000, chain.objs.size()=1 2024-09-12T18:13:48.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.727+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.hFO8q3_VL3WHIcIcq6x7wI0T5IOq0-8_0 2024-09-12T18:13:48.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.727+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3114434224056090659', time=2024-09-12T19:46:15.265943+0000, chain.objs.size()=1 2024-09-12T18:13:48.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.727+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.R2kUre5808zGLmKVjmYRJoDYsLOCVOr_0 2024-09-12T18:13:48.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.727+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12851713700080110484', time=2024-09-12T19:46:15.334595+0000, chain.objs.size()=1 2024-09-12T18:13:48.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.727+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.e77NrOtcRPJAd2MmnNIVcb2VH_Wjays_0 2024-09-12T18:13:48.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.727+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.307047170933247206', time=2024-09-12T19:46:15.385715+0000, chain.objs.size()=1 2024-09-12T18:13:48.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.727+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.s2f1pqV5zRygn07l3OU2zd9GifrAjPL_0 2024-09-12T18:13:48.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.727+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3494153965678538363', time=2024-09-12T19:46:16.576098+0000, chain.objs.size()=1 2024-09-12T18:13:48.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.727+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.37IEis_9e5vYuWj3PbEdLQGSoIoE5ko_0 2024-09-12T18:13:48.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.727+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6045318180594810100', time=2024-09-12T19:46:16.739498+0000, chain.objs.size()=1 2024-09-12T18:13:48.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.727+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.zr6PJsd3UXU874FBFEtviIjbGUGgJIm_0 2024-09-12T18:13:48.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.728+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12532456984040606810', time=2024-09-12T19:46:17.121228+0000, chain.objs.size()=1 2024-09-12T18:13:48.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.728+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.CAsTb-pmuSNO7I7R5xz3jMTPFSvjjj5_0 2024-09-12T18:13:48.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.729+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12725440469423436689', time=2024-09-12T19:46:17.471884+0000, chain.objs.size()=1 2024-09-12T18:13:48.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.729+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.VLJGpjucTkLQS-aXnQGRgX7gbXhp32G_0 2024-09-12T18:13:48.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.729+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1217472594194299835', time=2024-09-12T19:46:17.489898+0000, chain.objs.size()=1 2024-09-12T18:13:48.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.729+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.OJ4O1bXcbIAwbl1MgTayr5vI7Ta0d5Y_0 2024-09-12T18:13:48.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.729+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18089136607378145037', time=2024-09-12T19:46:17.638927+0000, chain.objs.size()=1 2024-09-12T18:13:48.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.729+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.cfbJ7yXygO-K-7FQ1sGPKQZBcS_KWCM_0 2024-09-12T18:13:48.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.729+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1441429757787689876', time=2024-09-12T19:46:19.038048+0000, chain.objs.size()=1 2024-09-12T18:13:48.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.729+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.0i8pKVBijEUQMK-TUBjnpzkyWn3t3d9_0 2024-09-12T18:13:48.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.730+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13294875638829122206', time=2024-09-12T19:46:19.249357+0000, chain.objs.size()=1 2024-09-12T18:13:48.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.730+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.UMc37pi2rbLiRwz8gAFi8644yukJpBy_0 2024-09-12T18:13:48.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.730+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4003335587432967735', time=2024-09-12T19:46:19.503658+0000, chain.objs.size()=1 2024-09-12T18:13:48.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.730+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.pdJrlKthyd6XBnd2OH_Fh97xpia0nns_0 2024-09-12T18:13:48.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.730+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14904664258813739690', time=2024-09-12T19:46:19.581609+0000, chain.objs.size()=1 2024-09-12T18:13:48.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.730+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.dguXHJ7VIHIyQCbVAgQHswjuvmV4Go3_0 2024-09-12T18:13:48.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.730+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6928451233199566782', time=2024-09-12T19:46:22.226098+0000, chain.objs.size()=1 2024-09-12T18:13:48.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.730+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.266__shadow_.8LngVUI_XzzTYtreJMDiSJrarLU5QTK_0 2024-09-12T18:13:48.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.730+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5845125235540775651', time=2024-09-12T19:46:46.067898+0000, chain.objs.size()=1 2024-09-12T18:13:48.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.730+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.292__shadow_.ci5ke1QT8MLhXzGzL1yg2HFXoALr5W2_0 2024-09-12T18:13:48.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.731+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9400812689205631726', time=2024-09-12T19:46:56.081315+0000, chain.objs.size()=1 2024-09-12T18:13:48.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.731+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.300__shadow_.47oXwTqrlh3LTPY2XhP1BaiOB-PZ5Qe_0 2024-09-12T18:13:48.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.731+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17641163165946395224', time=2024-09-12T19:47:04.239264+0000, chain.objs.size()=1 2024-09-12T18:13:48.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.731+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.308__shadow:JIKehBkgnfitV2oQw3Clw56cMcH028b_.vcGvmzAaop55k-UGJ9aXBz0vV5hS06w_0 2024-09-12T18:13:48.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.731+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13935088740206763583', time=2024-09-12T19:47:59.637909+0000, chain.objs.size()=1 2024-09-12T18:13:48.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.731+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Sf2Vufx3_q6wnlOzTELtdEQgMVRpZDV_0 2024-09-12T18:13:48.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.731+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.238020963670922901', time=2024-09-12T19:47:59.639499+0000, chain.objs.size()=1 2024-09-12T18:13:48.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.731+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.iOa5hpUqO_072aFsbgdySi5kryzC6tC_0 2024-09-12T18:13:48.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.732+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12220467091704441854', time=2024-09-12T19:47:59.758513+0000, chain.objs.size()=1 2024-09-12T18:13:48.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.732+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.qiXkZHac4FgVJeb4nfLoXmCZLb-QAMH_0 2024-09-12T18:13:48.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.732+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8060772762936609613', time=2024-09-12T19:48:00.297173+0000, chain.objs.size()=1 2024-09-12T18:13:48.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.732+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.RuY9rsPE6L3EBgkiP2wO5tza_WPwDKU_0 2024-09-12T18:13:48.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.732+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1474827055617146673', time=2024-09-12T19:48:00.372900+0000, chain.objs.size()=1 2024-09-12T18:13:48.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.732+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.KECFOVRcEGpw1tT75hJbcImWmC2Uz3q_0 2024-09-12T18:13:48.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.732+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5534620863758054757', time=2024-09-12T19:48:00.998185+0000, chain.objs.size()=1 2024-09-12T18:13:48.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.732+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.jo38UAuHqTaxM8udTS1AXI6Rt2ge62l_0 2024-09-12T18:13:48.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.732+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17490787554149016027', time=2024-09-12T19:48:01.018469+0000, chain.objs.size()=1 2024-09-12T18:13:48.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.732+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.CCoeZ2Uh5zLkNq2imclcZYnSm1hsHGD_0 2024-09-12T18:13:48.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.732+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9755624831507468542', time=2024-09-12T19:48:01.141531+0000, chain.objs.size()=1 2024-09-12T18:13:48.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.732+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.lsWZS9vMrd6UC9NQCDhVz2w4ZSeAOt5_0 2024-09-12T18:13:48.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.732+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6772536977213513729', time=2024-09-12T19:48:01.514317+0000, chain.objs.size()=1 2024-09-12T18:13:48.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.732+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.sjwJtXF_AEdH8O3oqAghbSp2q9q0AXN_0 2024-09-12T18:13:48.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.733+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1442017322501666100', time=2024-09-12T19:48:01.586438+0000, chain.objs.size()=1 2024-09-12T18:13:48.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.733+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.FXBDmbtkKuG5rVXTdjcfbphlxWqOHZm_0 2024-09-12T18:13:48.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.734+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14590418458054055587', time=2024-09-12T19:48:02.498380+0000, chain.objs.size()=1 2024-09-12T18:13:48.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.734+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.zaKHOLAytA0SFKN6Lmhsp-CWMhO0j_k_0 2024-09-12T18:13:48.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.734+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3366456991613935151', time=2024-09-12T19:48:03.458314+0000, chain.objs.size()=1 2024-09-12T18:13:48.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.734+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.rGFyW4GUdY2iTMdBuqoKyVpL9Vb-fhg_0 2024-09-12T18:13:48.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.734+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13875524931046053302', time=2024-09-12T19:48:03.920927+0000, chain.objs.size()=1 2024-09-12T18:13:48.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.734+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Jki3Z-fAsW1I8Zw1d6qr8JnRsCYLlv8_0 2024-09-12T18:13:48.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.734+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8652273840950803443', time=2024-09-12T19:48:04.068795+0000, chain.objs.size()=1 2024-09-12T18:13:48.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.734+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ejLEXrzcVVpvyYg_Mr574_zM3DULryA_0 2024-09-12T18:13:48.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.734+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15826795301167215554', time=2024-09-12T19:48:05.583214+0000, chain.objs.size()=1 2024-09-12T18:13:48.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.734+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.LcqXv6f4nakaX-7yWIxaAr26t5o6SaB_0 2024-09-12T18:13:48.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.734+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13804984961451810725', time=2024-09-12T19:48:05.719298+0000, chain.objs.size()=1 2024-09-12T18:13:48.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.734+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.DjWjeG9Y1jdeBlLK26rMXPbS2UuJdjn_0 2024-09-12T18:13:48.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.734+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7118314490619005015', time=2024-09-12T19:48:05.741245+0000, chain.objs.size()=1 2024-09-12T18:13:48.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.734+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.KCLiGSG9xnYde2kcioyjtm-d7QlryjR_0 2024-09-12T18:13:48.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.734+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7011524636065904545', time=2024-09-12T19:48:05.788985+0000, chain.objs.size()=1 2024-09-12T18:13:48.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.734+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Ln7WcJU5kKFnm9sis0dpDQGv8-SJlWQ_0 2024-09-12T18:13:48.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.734+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.804837187554009168', time=2024-09-12T19:48:06.054737+0000, chain.objs.size()=1 2024-09-12T18:13:48.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.734+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.p2R3h5SstJwtbipe4KgGQu7R49cV9AF_0 2024-09-12T18:13:48.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.734+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16934072444394810015', time=2024-09-12T19:48:06.788908+0000, chain.objs.size()=1 2024-09-12T18:13:48.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.734+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.7DvnJQ-2gj2PaAQn0-cN_spvZ16GUQ7_0 2024-09-12T18:13:48.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.735+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12300768713588424004', time=2024-09-12T19:48:06.936917+0000, chain.objs.size()=1 2024-09-12T18:13:48.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.735+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ub6jOWFYOY85onpbmE03BZ1dkspN4md_0 2024-09-12T18:13:48.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.736+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8218783376652508919', time=2024-09-12T19:48:07.259443+0000, chain.objs.size()=1 2024-09-12T18:13:48.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.736+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.UvSGKS5LP1BrDxj6jbRnoHs61gLVKPo_0 2024-09-12T18:13:48.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.736+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18254388358544447922', time=2024-09-12T19:48:08.005612+0000, chain.objs.size()=1 2024-09-12T18:13:48.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.736+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.KnU0TmNxp1j9_IFWSk1TnDln_i7TPoU_0 2024-09-12T18:13:48.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.736+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14199339858532348270', time=2024-09-12T19:48:08.174246+0000, chain.objs.size()=1 2024-09-12T18:13:48.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.736+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.udkijQgsQBoXAinsa5c4bHaWLkJ_gVC_0 2024-09-12T18:13:48.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.736+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11063820738434754169', time=2024-09-12T19:48:08.320293+0000, chain.objs.size()=1 2024-09-12T18:13:48.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.736+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.CiaTU0V7TRZGxD5Iv97Ad6P_-SDdjzB_0 2024-09-12T18:13:48.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.736+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8568581835546442247', time=2024-09-12T19:48:08.376026+0000, chain.objs.size()=1 2024-09-12T18:13:48.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.736+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.a9IpFIUNjcV0L0g_who5dLohDZdmLjj_0 2024-09-12T18:13:48.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.736+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13281148852440213607', time=2024-09-12T19:48:08.865439+0000, chain.objs.size()=1 2024-09-12T18:13:48.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.736+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.2AJ5MuCyCU3KFeLGgVqTUmFGdYXUpdC_0 2024-09-12T18:13:48.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.736+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3997275643951795876', time=2024-09-12T19:48:09.304431+0000, chain.objs.size()=1 2024-09-12T18:13:48.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.736+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ZteLqHTpAqZ2YsY0OiA46caUNSdw6FW_0 2024-09-12T18:13:48.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.736+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6540937525232566550', time=2024-09-12T19:48:09.763789+0000, chain.objs.size()=1 2024-09-12T18:13:48.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.736+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.C0nkW61k4d1iCy-3xN5Qww3jJHr0xYe_0 2024-09-12T18:13:48.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.737+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14270063965552933331', time=2024-09-12T19:48:09.937289+0000, chain.objs.size()=1 2024-09-12T18:13:48.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.737+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.AFR1ixq03F1pZBGGS83tXSf7R5jLJZ2_0 2024-09-12T18:13:48.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.737+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16708574844366374990', time=2024-09-12T19:48:10.036532+0000, chain.objs.size()=1 2024-09-12T18:13:48.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.737+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.A7bgTXJGrx2Ts-UCZ3_1nwWK4GTM6I0_0 2024-09-12T18:13:48.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.737+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7847828890059567431', time=2024-09-12T19:48:48.300930+0000, chain.objs.size()=1 2024-09-12T18:13:48.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.737+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.D0X0-kmpY1UJGEOQjpYgMNqQ0fkR8lC_0 2024-09-12T18:13:48.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.738+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3403613113174041263', time=2024-09-12T19:48:48.445194+0000, chain.objs.size()=1 2024-09-12T18:13:48.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.738+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.VCef654fd1cQ6MuhUkXy4Vn0bEPSVuO_0 2024-09-12T18:13:48.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.738+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18095660282107171328', time=2024-09-12T19:48:48.956974+0000, chain.objs.size()=1 2024-09-12T18:13:48.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.738+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_._1FQ1l-Pg01nhgXBOhywttlUN3bV8HD_0 2024-09-12T18:13:48.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.738+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15295882250442350784', time=2024-09-12T19:48:49.479909+0000, chain.objs.size()=1 2024-09-12T18:13:48.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.738+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Lh2w9MyffG2rO829xY5PWNiGF4g29tw_0 2024-09-12T18:13:48.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.738+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11390436103149449582', time=2024-09-12T19:48:49.500637+0000, chain.objs.size()=1 2024-09-12T18:13:48.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.738+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.yhseSmIHRxV3dxv_UBcmrYX0_CnfeZw_0 2024-09-12T18:13:48.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.738+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17590430157824017625', time=2024-09-12T19:48:49.614879+0000, chain.objs.size()=1 2024-09-12T18:13:48.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.738+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.i99aPQyzOZD8ZOwW3xjevX5Yolc3nrN_0 2024-09-12T18:13:48.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.738+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14195547918197230048', time=2024-09-12T19:48:49.795269+0000, chain.objs.size()=1 2024-09-12T18:13:48.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.738+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.f75TQF3aGCB5ybAvaMyprTzJyTVgu2J_0 2024-09-12T18:13:48.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.738+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1344120741922576535', time=2024-09-12T19:48:51.005052+0000, chain.objs.size()=1 2024-09-12T18:13:48.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.738+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ovdBhgXPN6LW5H34apLc48uXEwrkPPp_0 2024-09-12T18:13:48.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.739+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1139211978215971057', time=2024-09-12T19:48:51.065410+0000, chain.objs.size()=1 2024-09-12T18:13:48.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.739+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.tcaKPtkrcpZs102t2WDfr6WyQyDHnpG_0 2024-09-12T18:13:48.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.739+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8743785754505206213', time=2024-09-12T19:48:51.493143+0000, chain.objs.size()=1 2024-09-12T18:13:48.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.739+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.34_Hy8tSKYhH-7uH5wlceIMFSEkGk95_0 2024-09-12T18:13:48.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.739+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3091063738987323964', time=2024-09-12T19:48:51.986542+0000, chain.objs.size()=1 2024-09-12T18:13:48.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.739+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.GSLMzJ3fwj19QBCAcrriMsHiOWcu7Ue_0 2024-09-12T18:13:48.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.739+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1410608227836707505', time=2024-09-12T19:48:52.175445+0000, chain.objs.size()=1 2024-09-12T18:13:48.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.739+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.-jCN55gSaR0Z2yV88Ac3oldsn8ZLwtZ_0 2024-09-12T18:13:48.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.739+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1747512134077336460', time=2024-09-12T19:48:53.280663+0000, chain.objs.size()=1 2024-09-12T18:13:48.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.739+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.R5PCEKFtxnvsT43brbO-ejH9RfuSHkB_0 2024-09-12T18:13:48.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.739+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15495199809886695231', time=2024-09-12T19:48:53.301623+0000, chain.objs.size()=1 2024-09-12T18:13:48.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.739+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Wtps7rImel9QpI1KyPDkS_4avD21LMh_0 2024-09-12T18:13:48.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.740+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17108685517258888767', time=2024-09-12T19:48:53.680859+0000, chain.objs.size()=1 2024-09-12T18:13:48.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.740+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.f_O68NXNCGSEQQJG6ZM4gyNIPmeSFD5_0 2024-09-12T18:13:48.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.740+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12843105560478746654', time=2024-09-12T19:48:54.618786+0000, chain.objs.size()=1 2024-09-12T18:13:48.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.740+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.q3ilm-Ga7VoUawV6EG6NP5m3S6vO9r4_0 2024-09-12T18:13:48.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.740+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16372902441588106992', time=2024-09-12T19:48:54.636584+0000, chain.objs.size()=1 2024-09-12T18:13:48.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.740+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.IFvYAE5Sa6pg90HJGh6UV1FrkvV1rdR_0 2024-09-12T18:13:48.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.741+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15110409005791723526', time=2024-09-12T19:48:54.756169+0000, chain.objs.size()=1 2024-09-12T18:13:48.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.741+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.6bQb0Y8Rb2BIR30RsGBMY373hAQOnoT_0 2024-09-12T18:13:48.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.741+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7664134967646893230', time=2024-09-12T19:48:54.794456+0000, chain.objs.size()=1 2024-09-12T18:13:48.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.741+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.MLiQsiERU2gU4zdVLSjOkA1SucCH_ZK_0 2024-09-12T18:13:48.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.741+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12965181750609832407', time=2024-09-12T19:48:54.815382+0000, chain.objs.size()=1 2024-09-12T18:13:48.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.741+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.YeTHB_PcSLqnxg4otlgiyU0G_fd8ZXA_0 2024-09-12T18:13:48.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.741+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11094960828602934560', time=2024-09-12T19:48:55.038119+0000, chain.objs.size()=1 2024-09-12T18:13:48.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.741+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ICO_AM1WWbKeaRZZlZBsRnyRz0bpIHO_0 2024-09-12T18:13:48.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.741+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12480700846572356909', time=2024-09-12T19:48:55.038856+0000, chain.objs.size()=1 2024-09-12T18:13:48.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.741+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.pSWPQIg-YCvQnXD5gClXKWOU6MZKvtP_0 2024-09-12T18:13:48.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.741+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14151544401247311066', time=2024-09-12T19:48:55.160213+0000, chain.objs.size()=1 2024-09-12T18:13:48.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.741+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.j6xlwbDyvytkdi4JvhutL_QOXapQmy-_0 2024-09-12T18:13:48.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.741+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2833633537370966657', time=2024-09-12T19:48:55.212808+0000, chain.objs.size()=1 2024-09-12T18:13:48.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.741+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.vMObmDDw4UKItxwWg9o8_kYOavvmosh_0 2024-09-12T18:13:48.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.743+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/53213 2024-09-12T18:13:48.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.745+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T18:13:48.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.745+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4364607228560293390', time=2024-09-12T19:48:55.221562+0000, chain.objs.size()=1 2024-09-12T18:13:48.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.745+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.3PfSVA2UlvnMzyHBdSPHn-zxF_nsC43_0 2024-09-12T18:13:48.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.745+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4134408885332484202', time=2024-09-12T19:48:56.296919+0000, chain.objs.size()=1 2024-09-12T18:13:48.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.745+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.TZKbUWmH38rht-VJf8IvG-dav7bodv8_0 2024-09-12T18:13:48.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.745+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10965461137430460115', time=2024-09-12T19:48:56.455448+0000, chain.objs.size()=1 2024-09-12T18:13:48.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.745+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.17A0zpMXyZp6wIdtu_DjHgGdj_4h3qW_0 2024-09-12T18:13:48.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.745+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13465940381661987409', time=2024-09-12T19:48:57.771515+0000, chain.objs.size()=1 2024-09-12T18:13:48.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.745+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.n6PMoh0lgnw15eiWJfhma-uG-HHrsqp_0 2024-09-12T18:13:48.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.745+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.175143894173602163', time=2024-09-12T19:48:58.002210+0000, chain.objs.size()=1 2024-09-12T18:13:48.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.745+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Zaydwip8si86rzqnHmG7cvs08HPx8Xt_0 2024-09-12T18:13:48.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.745+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6821089615240823262', time=2024-09-12T19:49:01.910195+0000, chain.objs.size()=1 2024-09-12T18:13:48.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.745+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.330__shadow_.Bzv-eVxZ5Jlgc7k1OiZBS1QcEr2dgxT_0 2024-09-12T18:13:48.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.745+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16862574107625856258', time=2024-09-12T19:49:12.945508+0000, chain.objs.size()=1 2024-09-12T18:13:48.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.745+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.342__shadow_.FD-XcU4lilIOQ4CYW1eIfwMFMC8k73Z_0 2024-09-12T18:13:48.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.745+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11589071584237364016', time=2024-09-12T19:49:42.051219+0000, chain.objs.size()=1 2024-09-12T18:13:48.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.745+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.378__shadow_.mWjvdL-DVkaCgxui2Aq8ckze9wAfNZB_0 2024-09-12T18:13:48.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.745+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8652408448426714742', time=2024-09-12T19:51:06.934050+0000, chain.objs.size()=1 2024-09-12T18:13:48.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.745+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.466__shadow_.SeTWe8-kMnXRez56U4AXLlgyVvGN-t3_0 2024-09-12T18:13:48.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.745+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16133401293902365734', time=2024-09-12T19:52:30.677925+0000, chain.objs.size()=2 2024-09-12T18:13:48.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.745+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.518__shadow_.jiLmLjkEIp4G-MhgEL3kJdsdrDfrp0s_0 2024-09-12T18:13:48.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.745+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.518__shadow_.jiLmLjkEIp4G-MhgEL3kJdsdrDfrp0s_1 2024-09-12T18:13:48.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.745+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6790857357266677250', time=2024-09-12T19:55:59.979354+0000, chain.objs.size()=2 2024-09-12T18:13:48.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.745+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.529__shadow_.Y6j8HfAjViG9VoKEPzPyNAvuZDvbnZE_0 2024-09-12T18:13:48.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.747+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.529__shadow_.Y6j8HfAjViG9VoKEPzPyNAvuZDvbnZE_1 2024-09-12T18:13:48.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.748+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10611102091954234475', time=2024-09-12T19:57:27.592911+0000, chain.objs.size()=1 2024-09-12T18:13:48.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.748+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.557__shadow_.GBxlhAzExQUFlAcT0winHYkKoqPmQpn_0 2024-09-12T18:13:48.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.748+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3657901646182467366', time=2024-09-12T19:58:02.031970+0000, chain.objs.size()=1 2024-09-12T18:13:48.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.748+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:yWmwhezDKLw3sO25I8DAcYUIeAQ4nAY_.P2DecrJfL7oBkKbY7R30eJlHIuzjbaj_0 2024-09-12T18:13:48.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.748+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1863690542781474096', time=2024-09-12T19:58:08.720946+0000, chain.objs.size()=1 2024-09-12T18:13:48.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.748+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.571__shadow:.LqOTdWM5dsf9b9kzK2LPmCwck4loTj_.eqEIBJdeiMzVwz-75VsfqJ4ubvT3Mdw_0 2024-09-12T18:13:48.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.748+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14023574578660152392', time=2024-09-12T19:58:09.861021+0000, chain.objs.size()=1 2024-09-12T18:13:48.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.748+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.572__shadow_.5nABejmX1rWBhiHoFk4q0MRASVrW2Sr_0 2024-09-12T18:13:48.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.748+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12391669714803908728', time=2024-09-12T19:58:11.110888+0000, chain.objs.size()=1 2024-09-12T18:13:48.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.748+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.573__shadow:zsfXf3bzFuyXnIHYXxKZHVFDXj1CQ8b_.knRBHcqNXSnPw57IZ2ylVkDA_9v0LgK_0 2024-09-12T18:13:48.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.748+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4993655204497058449', time=2024-09-12T19:58:20.920407+0000, chain.objs.size()=1 2024-09-12T18:13:48.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.748+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.577__shadow:M2R3OprbYhopiWLDIgKVPZVrfXs4u5y_.gVc_jTJLO-k223mcOLNovCYDYkeEX-8_0 2024-09-12T18:13:48.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.748+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15882838513117579134', time=2024-09-12T19:58:27.794617+0000, chain.objs.size()=1 2024-09-12T18:13:48.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.748+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:2LYOSgJucA7C.zG00iFhix.58efxeb4_.LJ-_GuHrP_IVziniJuYoFhO-mwwijYo_0 2024-09-12T18:13:48.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.748+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1591399019549318801', time=2024-09-12T19:58:31.618261+0000, chain.objs.size()=1 2024-09-12T18:13:48.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.748+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:.NCybe7VnEgTQK8IPIGumGDwBkjC0RR_.m7SS6ZKULASdUXwNtYnvWI5pmrxv5fc_0 2024-09-12T18:13:48.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.748+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11196288582326024259', time=2024-09-12T19:58:47.411710+0000, chain.objs.size()=1 2024-09-12T18:13:48.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.748+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:3FGDZjVCHsT7uiAdUx-ZfuCkAaeDYNU_.gN83D2A5lmz3GqvvYmtgaR2TBcPb-kT_0 2024-09-12T18:13:48.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.748+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2313526015283623808', time=2024-09-12T19:59:40.664476+0000, chain.objs.size()=1 2024-09-12T18:13:48.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.748+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.588__shadow:3x7t1bZ4KLtljyvogqUIsRbq7by3Pdp_.Z2RbNhnnmznsDWlNIRlPMWdO3ZllmBZ_0 2024-09-12T18:13:48.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.749+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14748327295280985864', time=2024-09-12T20:05:28.930551+0000, chain.objs.size()=1 2024-09-12T18:13:48.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.749+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.654__shadow_.LqTxo0YIEAno1cL_JbRY2pMhzcBgxd1_0 2024-09-12T18:13:48.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.752+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12630910714284756760', time=2024-09-12T20:06:03.007839+0000, chain.objs.size()=1 2024-09-12T18:13:48.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.752+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.665__shadow_.Yyis_FnqkvszK-IvLka0IWK02pJI0D5_0 2024-09-12T18:13:48.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.752+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14306849293242289492', time=2024-09-12T20:07:18.924392+0000, chain.objs.size()=1 2024-09-12T18:13:48.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.752+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.735__shadow_.J0_-EQ5S9cQAbn5eIgnqNe1MZu7hDQ__0 2024-09-12T18:13:48.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.753+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:48.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.755+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:13:48.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.757+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:48.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.757+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:48.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.758+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44188' 2024-09-12T18:13:48.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.758+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2596915812267553531', time=2024-09-12T19:42:07.422410+0000, chain.objs.size()=5 2024-09-12T18:13:48.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.758+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__multipart_foo-FROZEN.2~i7cnKhrMVq9JaqU93lgFJnox5nKiE3O.1 2024-09-12T18:13:48.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.758+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__shadow_foo-FROZEN.2~i7cnKhrMVq9JaqU93lgFJnox5nKiE3O.1_1 2024-09-12T18:13:48.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.758+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__multipart_foo-FROZEN.2~i7cnKhrMVq9JaqU93lgFJnox5nKiE3O.2 2024-09-12T18:13:48.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.758+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__shadow_foo-FROZEN.2~i7cnKhrMVq9JaqU93lgFJnox5nKiE3O.2_1 2024-09-12T18:13:48.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.758+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__multipart_foo-FROZEN.2~i7cnKhrMVq9JaqU93lgFJnox5nKiE3O.3 2024-09-12T18:13:48.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.758+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2453204139191288320', time=2024-09-12T19:45:14.716872+0000, chain.objs.size()=1 2024-09-12T18:13:48.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.758+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.244__shadow_.IB-UtoNyVey785iHD-egDI5Auu6HGZ1_0 2024-09-12T18:13:48.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.758+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4774553410578159930', time=2024-09-12T19:45:22.728248+0000, chain.objs.size()=1 2024-09-12T18:13:48.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.758+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.252__shadow_.Ucfu87OK3tE4WyLFTRpdDTrqv_wbGtq_0 2024-09-12T18:13:48.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.758+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9572531844146590943', time=2024-09-12T19:45:29.912156+0000, chain.objs.size()=1 2024-09-12T18:13:48.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.758+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.260__shadow_.g03-Zcr1M-flJEIqlcPtkjzsDQV9KaI_0 2024-09-12T18:13:48.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.758+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7724128422928267927', time=2024-09-12T19:46:08.805660+0000, chain.objs.size()=1 2024-09-12T18:13:48.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.758+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.VEscLgxY8gqtdk-4HjWg_ZpLoJ5Onaw_0 2024-09-12T18:13:48.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.758+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17126715325468258217', time=2024-09-12T19:46:08.806647+0000, chain.objs.size()=1 2024-09-12T18:13:48.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.758+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Z8qrcv3s-o6SpZLdGRiA4uJDYv1DbJB_0 2024-09-12T18:13:48.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.758+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13589043014732161249', time=2024-09-12T19:46:09.305289+0000, chain.objs.size()=1 2024-09-12T18:13:48.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.758+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.VujR2d-kyA0nZCz-sc234wOa-di5gzU_0 2024-09-12T18:13:48.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.758+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12774490790680745778', time=2024-09-12T19:46:09.349618+0000, chain.objs.size()=1 2024-09-12T18:13:48.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.758+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.lveCvU6Ti1vKmHt9OMwk5IfiHeuJ9I2_0 2024-09-12T18:13:48.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.761+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10238312916266660684', time=2024-09-12T19:46:09.476968+0000, chain.objs.size()=1 2024-09-12T18:13:48.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.761+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.KzSdQwgDhPDALAk_zhq8d9nwarys2Xu_0 2024-09-12T18:13:48.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.761+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4233161251284646044', time=2024-09-12T19:46:09.756304+0000, chain.objs.size()=1 2024-09-12T18:13:48.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.761+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.yUjpskEbxLa2Q4tlKynZ-RQiXyOdybO_0 2024-09-12T18:13:48.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.761+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3091442253122185644', time=2024-09-12T19:46:10.382458+0000, chain.objs.size()=1 2024-09-12T18:13:48.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.761+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.qWsWcqXSB-qzCFmO6R8n9IF7KI4jJmC_0 2024-09-12T18:13:48.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.761+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11292098572007327815', time=2024-09-12T19:46:10.680202+0000, chain.objs.size()=1 2024-09-12T18:13:48.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.761+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.5UONAN8CUT9w0nTj-VbmhvkvNiqg2x7_0 2024-09-12T18:13:48.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.761+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1467717995887120759', time=2024-09-12T19:46:10.852966+0000, chain.objs.size()=1 2024-09-12T18:13:48.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.761+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ARbDo5s3AgifavBwmfOqyzV3LFX4m5R_0 2024-09-12T18:13:48.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.761+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.577730287193502808', time=2024-09-12T19:46:11.011061+0000, chain.objs.size()=1 2024-09-12T18:13:48.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.761+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ywnmvuzq09D_sE1Smci9ulhOfOOoj_e_0 2024-09-12T18:13:48.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.761+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2936188956973090996', time=2024-09-12T19:46:11.238846+0000, chain.objs.size()=1 2024-09-12T18:13:48.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.761+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.IcuNCXqSKcb04v2bB_jI6A28F7pzxQL_0 2024-09-12T18:13:48.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.761+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15391659694754289125', time=2024-09-12T19:46:11.302244+0000, chain.objs.size()=1 2024-09-12T18:13:48.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.761+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.0N6sCU64dB-KfkG2HINK9b5rak9sBxY_0 2024-09-12T18:13:48.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.761+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9017491063185656752', time=2024-09-12T19:46:12.389141+0000, chain.objs.size()=1 2024-09-12T18:13:48.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.761+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.fZM7gu_YMW9Hjl3RD_C9pQccyD5m_nn_0 2024-09-12T18:13:48.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.761+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15748303577632636275', time=2024-09-12T19:46:12.508719+0000, chain.objs.size()=1 2024-09-12T18:13:48.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.761+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ZwXOgxTaa79B8FcDVpJd1N0RxoXCrye_0 2024-09-12T18:13:48.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.761+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14669239404145615643', time=2024-09-12T19:46:12.860731+0000, chain.objs.size()=1 2024-09-12T18:13:48.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.761+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.o7P-nGLjgHY-6EBMv2WSXxDECW3ttV-_0 2024-09-12T18:13:48.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.762+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13802810681668027367', time=2024-09-12T19:46:13.387021+0000, chain.objs.size()=1 2024-09-12T18:13:48.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.762+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.uJ5bzR4FQiTw-EiLVhf72iPI0tq8ezd_0 2024-09-12T18:13:48.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.763+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10651200405100143109', time=2024-09-12T19:46:13.540953+0000, chain.objs.size()=1 2024-09-12T18:13:48.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.763+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.43c8c9CR66-Ol2T6okGh4VHB3N0VGdV_0 2024-09-12T18:13:48.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.763+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12409222258217568940', time=2024-09-12T19:46:13.669448+0000, chain.objs.size()=1 2024-09-12T18:13:48.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.763+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.EbBgf6Z9XBntHinQSz_DLblvOENkjGG_0 2024-09-12T18:13:48.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.763+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7799462418846545274', time=2024-09-12T19:46:13.802228+0000, chain.objs.size()=1 2024-09-12T18:13:48.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.763+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Pt-fFHKPJ-EcH9_Koli2gT2y7vHgnBo_0 2024-09-12T18:13:48.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.764+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3318959826436837359', time=2024-09-12T19:46:13.953050+0000, chain.objs.size()=1 2024-09-12T18:13:48.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.764+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.9lL_WJErD3JfGRbT5w4GIibKELnpop8_0 2024-09-12T18:13:48.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.764+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5331994555875568412', time=2024-09-12T19:46:14.870190+0000, chain.objs.size()=1 2024-09-12T18:13:48.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.764+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.5sIoTOiVwPZEIYmKyfAUpPz0U4LTpVr_0 2024-09-12T18:13:48.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.764+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2162316889840370397', time=2024-09-12T19:46:14.986872+0000, chain.objs.size()=1 2024-09-12T18:13:48.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.764+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.g1BtilfRmDV_p6LmrsII18K-u5n2_G8_0 2024-09-12T18:13:48.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.764+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6821480434553280632', time=2024-09-12T19:46:15.099066+0000, chain.objs.size()=1 2024-09-12T18:13:48.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.764+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.uImlNLBMmftJkfsDhLVLNDnvNcNUljM_0 2024-09-12T18:13:48.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.764+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12792887748452579632', time=2024-09-12T19:46:15.428137+0000, chain.objs.size()=1 2024-09-12T18:13:48.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.764+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.B__Lh7oNsxQ6U0t6bznDmPuJr11BGJM_0 2024-09-12T18:13:48.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.764+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18111645403595094158', time=2024-09-12T19:46:16.221352+0000, chain.objs.size()=1 2024-09-12T18:13:48.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.764+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Z07RnmRUhqZzNHzIdfG-B1d5LBwcRyA_0 2024-09-12T18:13:48.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.764+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5245737541569968708', time=2024-09-12T19:46:16.457611+0000, chain.objs.size()=1 2024-09-12T18:13:48.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.764+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Zn_TMwkeYlaRAbSTwEy-sgbDqBk11xs_0 2024-09-12T18:13:48.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.764+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4131615137567994852', time=2024-09-12T19:46:16.922173+0000, chain.objs.size()=1 2024-09-12T18:13:48.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.764+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.kBLGf0jkvkmAFD7Irk5JA3GBjM93T05_0 2024-09-12T18:13:48.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.765+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5231323222173496282', time=2024-09-12T19:46:17.471237+0000, chain.objs.size()=1 2024-09-12T18:13:48.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.765+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Q8HgW6kYhBJ4hmudaK42gsgfGBaPWIt_0 2024-09-12T18:13:48.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.766+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13054741115949741328', time=2024-09-12T19:46:18.799455+0000, chain.objs.size()=1 2024-09-12T18:13:48.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.766+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.n7FKsSBDFn0g24pPUQQaxqx66Owphrz_0 2024-09-12T18:13:48.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.766+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2187402916383619243', time=2024-09-12T19:46:19.228188+0000, chain.objs.size()=1 2024-09-12T18:13:48.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.766+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.cb8U_qF-gyjwsXPuciZi85S8HKuntVH_0 2024-09-12T18:13:48.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.766+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3530124911803556087', time=2024-09-12T19:46:19.385553+0000, chain.objs.size()=1 2024-09-12T18:13:48.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.766+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.NJlearnLrvvw1G7BtLKnSedmn5YSRCY_0 2024-09-12T18:13:48.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.766+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3109044478958826011', time=2024-09-12T19:46:19.470370+0000, chain.objs.size()=1 2024-09-12T18:13:48.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.766+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.O5k2vDq3NjCL0CVgoe4LLDNVYWWPkS__0 2024-09-12T18:13:48.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.766+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12824006524678780804', time=2024-09-12T19:46:21.364714+0000, chain.objs.size()=1 2024-09-12T18:13:48.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.766+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.265__shadow_.-0yWuOhCSQ3F14sYck-3f3754ZvG0Gd_0 2024-09-12T18:13:48.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.766+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4270673649612423021', time=2024-09-12T19:46:30.098529+0000, chain.objs.size()=1 2024-09-12T18:13:48.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.766+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.275__shadow_.a_xBwUpoLgiVFc8OmBSkVrDc2mq4caM_0 2024-09-12T18:13:48.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.766+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1607117631936023425', time=2024-09-12T19:46:32.832375+0000, chain.objs.size()=1 2024-09-12T18:13:48.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.766+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.278__shadow_.yx_1RDBKlozUMnl8zCHaX5HDoWAgWRm_0 2024-09-12T18:13:48.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.766+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1319911939249422265', time=2024-09-12T19:46:38.304146+0000, chain.objs.size()=1 2024-09-12T18:13:48.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.766+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.284__shadow_.9gVO0QOYZHiAmjI72-fNFN7PSI4xtXn_0 2024-09-12T18:13:48.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.766+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17733513850227764346', time=2024-09-12T19:46:44.809266+0000, chain.objs.size()=1 2024-09-12T18:13:48.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.766+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.291__shadow_.hwWhr5zstDDkIZAXWO008qha-vb60vI_0 2024-09-12T18:13:48.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.766+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6060797608676043684', time=2024-09-12T19:46:48.120741+0000, chain.objs.size()=1 2024-09-12T18:13:48.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.766+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.293__shadow_.oLEBleXRmwnnaAaa5gk0Rvjv5n9rcV8_0 2024-09-12T18:13:48.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.766+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7048506049874123683', time=2024-09-12T19:46:59.709602+0000, chain.objs.size()=1 2024-09-12T18:13:48.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.766+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.304__shadow_.Ei5u7LJNs7TP2vmrghjsoClbN4nRi0D_0 2024-09-12T18:13:48.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.767+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.836606819627520574', time=2024-09-12T19:47:18.670200+0000, chain.objs.size()=1 2024-09-12T18:13:48.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.767+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.320__shadow:4G8YXtjmJQjBz5bTT39n5SrBQbyYDn8_.Soc4TkhR73yPxxCCXqVfyO7_x2tPLTs_0 2024-09-12T18:13:48.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.769+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18074166171264330119', time=2024-09-12T19:47:59.575647+0000, chain.objs.size()=1 2024-09-12T18:13:48.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.769+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.YtjEESZshwaCqFpXAkem_ssnWYtAdXP_0 2024-09-12T18:13:48.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.769+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.767155514650508113', time=2024-09-12T19:47:59.607928+0000, chain.objs.size()=1 2024-09-12T18:13:48.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.769+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.TKSR09BwQTs7qgiLgaRy7mBYrWSQ9G9_0 2024-09-12T18:13:48.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.770+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2072339640239794947', time=2024-09-12T19:47:59.893794+0000, chain.objs.size()=1 2024-09-12T18:13:48.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.770+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.iJnf5xbv0t2lJIpyFbbFl7UvHWozrrc_0 2024-09-12T18:13:48.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.770+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1984687884519917203', time=2024-09-12T19:47:59.917271+0000, chain.objs.size()=1 2024-09-12T18:13:48.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.770+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.4lNu6KR9GPKacfjQUUjwY7PK6VL2WQo_0 2024-09-12T18:13:48.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.770+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1098788101853870364', time=2024-09-12T19:48:00.997394+0000, chain.objs.size()=1 2024-09-12T18:13:48.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.770+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.LlvFGAlLp2g6k6n12TVCVxcp38N9iVn_0 2024-09-12T18:13:48.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.770+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18117809434275739280', time=2024-09-12T19:48:01.511759+0000, chain.objs.size()=1 2024-09-12T18:13:48.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.770+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.mENrXh4JPRssMzJjqvACbxGl0j2MqoK_0 2024-09-12T18:13:48.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.770+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16935170804976568619', time=2024-09-12T19:48:01.568697+0000, chain.objs.size()=1 2024-09-12T18:13:48.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.770+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.CyDNW0TWk8b92MREtiJKJCIfDozgsPa_0 2024-09-12T18:13:48.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.770+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14805467729637851152', time=2024-09-12T19:48:01.569446+0000, chain.objs.size()=1 2024-09-12T18:13:48.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.770+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.bksEpd61i5HGqULwEnVfXtTHCLMxA1l_0 2024-09-12T18:13:48.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.770+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3007880504357817969', time=2024-09-12T19:48:01.586841+0000, chain.objs.size()=1 2024-09-12T18:13:48.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.770+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.3TkAvC22hSPzi08HtX7FO9BKsQEZPzk_0 2024-09-12T18:13:48.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.770+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1920084617650849722', time=2024-09-12T19:48:01.776391+0000, chain.objs.size()=1 2024-09-12T18:13:48.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.770+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.BgnmFB3jX4TA8rPkecEUzPDtzzBhQWT_0 2024-09-12T18:13:48.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.770+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11376921695965357677', time=2024-09-12T19:48:02.489808+0000, chain.objs.size()=1 2024-09-12T18:13:48.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.770+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.8Oa-w3aYQZMOKDJd4oFdEXURyQAeBjj_0 2024-09-12T18:13:48.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.771+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6292742043719779401', time=2024-09-12T19:48:02.610739+0000, chain.objs.size()=1 2024-09-12T18:13:48.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.771+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.XbszzEhsuXMGUbzkMi-o7x6m2DNU6nK_0 2024-09-12T18:13:48.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.771+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14264569800393642011', time=2024-09-12T19:48:03.064212+0000, chain.objs.size()=1 2024-09-12T18:13:48.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.771+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.wspMlSHufaTwBkTEHW7FkxyrVKBHk2O_0 2024-09-12T18:13:48.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.771+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16905408020666488361', time=2024-09-12T19:48:03.997751+0000, chain.objs.size()=1 2024-09-12T18:13:48.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.771+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.YSwIjguJwGP2_y6uED_KHhPfOSYFe3B_0 2024-09-12T18:13:48.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.772+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12625911835744976254', time=2024-09-12T19:48:04.112497+0000, chain.objs.size()=1 2024-09-12T18:13:48.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.772+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.58E7L2jbTZUuL1pctb6rccqFl2c_Hc7_0 2024-09-12T18:13:48.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.772+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.751084879694546823', time=2024-09-12T19:48:04.303451+0000, chain.objs.size()=1 2024-09-12T18:13:48.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.772+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.gZc54M4XwBkBx4I4M5ihGYogoM04G73_0 2024-09-12T18:13:48.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.773+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15115486757728158622', time=2024-09-12T19:48:04.445943+0000, chain.objs.size()=1 2024-09-12T18:13:48.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.773+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.qg1sCE4tMAlpMJYTWSFgOwZpOn8kl9K_0 2024-09-12T18:13:48.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.773+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11667379926265760266', time=2024-09-12T19:48:04.446465+0000, chain.objs.size()=1 2024-09-12T18:13:48.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.773+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.el5NY9vwWPShl5e895If0QUjSwRWXEp_0 2024-09-12T18:13:48.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.773+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3317159239649415502', time=2024-09-12T19:48:04.528559+0000, chain.objs.size()=1 2024-09-12T18:13:48.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.773+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.xskzW7_sGpmXFGPrkR6iM83_bno264w_0 2024-09-12T18:13:48.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.773+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4815815830032195763', time=2024-09-12T19:48:04.907250+0000, chain.objs.size()=1 2024-09-12T18:13:48.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.773+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.LdchCp6fsB35iOCAMb-mI2RAXw_0tFs_0 2024-09-12T18:13:48.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.773+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16390117279817997077', time=2024-09-12T19:48:05.311006+0000, chain.objs.size()=1 2024-09-12T18:13:48.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.773+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.xSMSCle3bbsUbYIFqoQgTYvqDusp9D5_0 2024-09-12T18:13:48.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.773+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6573907298671823301', time=2024-09-12T19:48:05.474732+0000, chain.objs.size()=1 2024-09-12T18:13:48.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.773+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Dy4zUX1lgyp5rWvhWVEHeE3k_rLr-j9_0 2024-09-12T18:13:48.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.773+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15950097978199604056', time=2024-09-12T19:48:06.270514+0000, chain.objs.size()=1 2024-09-12T18:13:48.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.773+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.-YPC37fG2UHTDDeinNPbQQDfkOC5d-1_0 2024-09-12T18:13:48.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.773+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10427080512512409734', time=2024-09-12T19:48:07.499476+0000, chain.objs.size()=1 2024-09-12T18:13:48.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.773+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ZHpjH8b9SgIZHfyb2p34nJZUFc4e0_Z_0 2024-09-12T18:13:48.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.773+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1342766721411871475', time=2024-09-12T19:48:08.117750+0000, chain.objs.size()=1 2024-09-12T18:13:48.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.773+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.9W6S1x5XDeBCAWozxQnJqJury80Vs9b_0 2024-09-12T18:13:48.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.773+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2629264236515707462', time=2024-09-12T19:48:08.279371+0000, chain.objs.size()=1 2024-09-12T18:13:48.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.773+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.vSjGZyZdsQFRhB3er_dLQ8_isanTazK_0 2024-09-12T18:13:48.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.776+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10992369887195833954', time=2024-09-12T19:48:08.559783+0000, chain.objs.size()=1 2024-09-12T18:13:48.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.776+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.l2EnqNG_OzuzuLR_XEBobwgTBs01ieg_0 2024-09-12T18:13:48.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.776+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15392823631409897343', time=2024-09-12T19:48:08.838662+0000, chain.objs.size()=1 2024-09-12T18:13:48.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.776+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.nUSJPMLKDhMmV75Q7Y5wC39ZMFj6jRm_0 2024-09-12T18:13:48.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.776+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7814052938507702703', time=2024-09-12T19:48:09.303542+0000, chain.objs.size()=1 2024-09-12T18:13:48.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.776+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.bnO9kLizaDrBEw8pZzqbdmptXVSmZ7X_0 2024-09-12T18:13:48.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.777+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12649833897715127799', time=2024-09-12T19:48:09.417956+0000, chain.objs.size()=1 2024-09-12T18:13:48.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.777+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.lCYC1PwYqF_w4XrqYPA3Vu3umV5qNPC_0 2024-09-12T18:13:48.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.777+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7565843947069582537', time=2024-09-12T19:48:09.442688+0000, chain.objs.size()=1 2024-09-12T18:13:48.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.777+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.KgvPCrD80pgCxczHZCb8Rvc8e99YkXS_0 2024-09-12T18:13:48.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.777+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7920277583826542679', time=2024-09-12T19:48:09.723235+0000, chain.objs.size()=1 2024-09-12T18:13:48.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.777+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Xy0H8JL494roWg7789sm4CMZGty2nC9_0 2024-09-12T18:13:48.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.777+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7691708407457495529', time=2024-09-12T19:48:09.999034+0000, chain.objs.size()=1 2024-09-12T18:13:48.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.777+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.rMzMA7P_JBfGlGZ6S_nck8Rk_Ntld35_0 2024-09-12T18:13:48.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.777+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6112795299142764284', time=2024-09-12T19:48:09.999770+0000, chain.objs.size()=1 2024-09-12T18:13:48.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.777+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.4Xh2sx2KjYwjb-3nV4m0lnjfjiempm-_0 2024-09-12T18:13:48.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.777+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13836676551211376465', time=2024-09-12T19:48:47.859274+0000, chain.objs.size()=1 2024-09-12T18:13:48.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.777+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Tbl8LolILx-QO_LmW3WR9Y6j5Si_DGP_0 2024-09-12T18:13:48.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.777+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11377643163775096616', time=2024-09-12T19:48:48.412389+0000, chain.objs.size()=1 2024-09-12T18:13:48.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.777+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.CBOHjSJZYpUzi6QBUSiNXDnNtWEycWz_0 2024-09-12T18:13:48.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.777+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13425830929431229064', time=2024-09-12T19:48:49.201888+0000, chain.objs.size()=1 2024-09-12T18:13:48.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.777+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.QbGhwjh_J6_4ktrz5PvssGpisCrcd3p_0 2024-09-12T18:13:48.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.779+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3664560553310036779', time=2024-09-12T19:48:49.641774+0000, chain.objs.size()=1 2024-09-12T18:13:48.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.779+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.GntiA9eqwsyOmqC3WBFbB9N0vmhojK9_0 2024-09-12T18:13:48.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.779+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13794339294895527383', time=2024-09-12T19:48:49.761521+0000, chain.objs.size()=1 2024-09-12T18:13:48.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.779+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.JDOyyRsIuEcLLO45Gt2pjNx55Ffsj2T_0 2024-09-12T18:13:48.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.782+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.827198602962352546', time=2024-09-12T19:48:50.469290+0000, chain.objs.size()=1 2024-09-12T18:13:48.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.782+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.NvatO67gRfwE8R7J0XkxnTYxdpaPRak_0 2024-09-12T18:13:48.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.782+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12161660830508581365', time=2024-09-12T19:48:50.639874+0000, chain.objs.size()=1 2024-09-12T18:13:48.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.782+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.fcZ3aleiInvLQIHnfpNLbiBX-LW_YOL_0 2024-09-12T18:13:48.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.782+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7090118443182017632', time=2024-09-12T19:48:50.687935+0000, chain.objs.size()=1 2024-09-12T18:13:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.782+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Lk8s2INmIlq1QuoGHV_3fCkRJg5cjnh_0 2024-09-12T18:13:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.782+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15910532930218700735', time=2024-09-12T19:48:50.865203+0000, chain.objs.size()=1 2024-09-12T18:13:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.782+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.60qAaS_zJhSUroeqf6iYWnKAYSMGafG_0 2024-09-12T18:13:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.782+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4998553960123201930', time=2024-09-12T19:48:51.134249+0000, chain.objs.size()=1 2024-09-12T18:13:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.782+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.GzqWnFp9miDxf2MTktjZetW_8Dvl9fd_0 2024-09-12T18:13:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.782+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13543559558582458746', time=2024-09-12T19:48:51.173920+0000, chain.objs.size()=1 2024-09-12T18:13:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.782+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.8bc_EtdRWJBq9GxcXgva6FGew8ZkXt__0 2024-09-12T18:13:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.782+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17096943577491287137', time=2024-09-12T19:48:51.209409+0000, chain.objs.size()=1 2024-09-12T18:13:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.782+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.F00ekeFB7eXwFseVDz1fVhuo_HEP9dB_0 2024-09-12T18:13:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.783+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5562035893197741511', time=2024-09-12T19:48:51.347407+0000, chain.objs.size()=1 2024-09-12T18:13:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.783+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.s7VDYBAnR_tSKu6zPdnDdZpDS38LGRA_0 2024-09-12T18:13:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.783+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12971014750538132132', time=2024-09-12T19:48:51.425576+0000, chain.objs.size()=1 2024-09-12T18:13:48.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.783+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.rejJ25RWLtwBaqiryuXulz0MoQ6RDF2_0 2024-09-12T18:13:48.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.783+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8035778297222674875', time=2024-09-12T19:48:51.993403+0000, chain.objs.size()=1 2024-09-12T18:13:48.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.783+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.yxjVFjxH8txd1Ik5TaYfogEPuAsPFdg_0 2024-09-12T18:13:48.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.785+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.673225764695945443', time=2024-09-12T19:48:52.313261+0000, chain.objs.size()=1 2024-09-12T18:13:48.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.785+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.msXi5PxsPUiBoCoylbC9tDDZWlsVLb2_0 2024-09-12T18:13:48.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.785+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14828514749598368369', time=2024-09-12T19:48:52.314016+0000, chain.objs.size()=1 2024-09-12T18:13:48.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.785+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.CMlFTxnQAk_HMQuNQqZ5g70MQF5Skz5_0 2024-09-12T18:13:48.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.785+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1702688843189441558', time=2024-09-12T19:48:52.314775+0000, chain.objs.size()=1 2024-09-12T18:13:48.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.785+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.My8eQzmHG9GPjxoP6OhXkZ5z8DamMmZ_0 2024-09-12T18:13:48.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.785+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10250800042986504638', time=2024-09-12T19:48:52.437086+0000, chain.objs.size()=1 2024-09-12T18:13:48.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.785+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.R5eBW3EJaarn7d6Z7uNaknu6MqFnKjR_0 2024-09-12T18:13:48.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.785+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13268872814277414094', time=2024-09-12T19:48:54.234619+0000, chain.objs.size()=1 2024-09-12T18:13:48.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.785+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.1RkDfaDIRwRSleAjvZfCIar7X1tQsyV_0 2024-09-12T18:13:48.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.785+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8203466868693175792', time=2024-09-12T19:48:54.262927+0000, chain.objs.size()=1 2024-09-12T18:13:48.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.785+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Z7Xk1QT1KfuAwYEPk3nmOj8g7IIa2ln_0 2024-09-12T18:13:48.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.785+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15863927909744861769', time=2024-09-12T19:48:54.835016+0000, chain.objs.size()=1 2024-09-12T18:13:48.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.785+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Ek9gkqW_glxGdWXAcKRhjCyjoY5wN1Y_0 2024-09-12T18:13:48.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.788+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/44188 2024-09-12T18:13:48.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.790+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-12T18:13:48.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.790+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13951567932828940829', time=2024-09-12T19:48:55.221139+0000, chain.objs.size()=1 2024-09-12T18:13:48.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.790+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.1BwuSqDcDjh2BsN-mHnYMmdQ6ltq9Ss_0 2024-09-12T18:13:48.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.790+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11011639125291719578', time=2024-09-12T19:48:55.266438+0000, chain.objs.size()=1 2024-09-12T18:13:48.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.790+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ihyCiMcjd7h_sszbPtELUviNYK_KwCa_0 2024-09-12T18:13:48.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.790+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.753996456513891377', time=2024-09-12T19:48:55.365578+0000, chain.objs.size()=1 2024-09-12T18:13:48.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.790+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.vOfU3anE1XAEh4PnrAYJpI8f_qNbWs7_0 2024-09-12T18:13:48.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.790+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5888434742621764558', time=2024-09-12T19:48:55.560029+0000, chain.objs.size()=1 2024-09-12T18:13:48.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.790+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.MRWdEJxHCkCpP-eQs74jFsI_mB39pMr_0 2024-09-12T18:13:48.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.790+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6595469294151484293', time=2024-09-12T19:48:55.982775+0000, chain.objs.size()=1 2024-09-12T18:13:48.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.790+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ofcBvQBObGYFouKDNQ4Wc2CZMxmLKLn_0 2024-09-12T18:13:48.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.790+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2266902088215779824', time=2024-09-12T19:48:56.804219+0000, chain.objs.size()=1 2024-09-12T18:13:48.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.790+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.5LNtoQemTNNSyeFPvZzTTXjIZuv3oQK_0 2024-09-12T18:13:48.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.790+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9475421575153418652', time=2024-09-12T19:48:56.866044+0000, chain.objs.size()=1 2024-09-12T18:13:48.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.790+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.kO7SltCGKlgdu9s-sCayy4eQgDYp5Md_0 2024-09-12T18:13:48.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.790+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4355337343136805357', time=2024-09-12T19:48:56.939766+0000, chain.objs.size()=1 2024-09-12T18:13:48.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.790+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.S6yd9t_MgzEzdHyo5dPpKtC2teChygC_0 2024-09-12T18:13:48.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.790+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17571902468814590137', time=2024-09-12T19:48:57.293993+0000, chain.objs.size()=1 2024-09-12T18:13:48.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.790+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.frVfuSW8pMfer8K2TsNDA-mMai2SmYB_0 2024-09-12T18:13:48.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.790+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7608111259295660602', time=2024-09-12T19:48:57.404012+0000, chain.objs.size()=1 2024-09-12T18:13:48.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.790+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.eMTR5l5kNiNDmqq9oEjYt7CI7SXR-7J_0 2024-09-12T18:13:48.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.790+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1100940968910636859', time=2024-09-12T19:49:04.691565+0000, chain.objs.size()=1 2024-09-12T18:13:48.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.790+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.333__shadow_.aZX7_Yr2yOk--JbBtO-c6N-Qw4OhLjZ_0 2024-09-12T18:13:48.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.790+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5985857573863386446', time=2024-09-12T19:49:41.784630+0000, chain.objs.size()=1 2024-09-12T18:13:48.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.790+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.378__shadow_.P1EDFWHAqhxJ8gLT59TFV-y_U6ye8Hs_0 2024-09-12T18:13:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.791+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1201393528151543261', time=2024-09-12T19:50:57.824497+0000, chain.objs.size()=1 2024-09-12T18:13:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.791+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.459__shadow_.zCQuELhiChcfLjfd91FTbLbKuG3HDWl_0 2024-09-12T18:13:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.794+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13709172147807411474', time=2024-09-12T19:51:35.328491+0000, chain.objs.size()=1 2024-09-12T18:13:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.794+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.499__shadow_.TXPmGu5dckLCje2HKu_r3vXMRI2ky0V_0 2024-09-12T18:13:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.794+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14490952022431232197', time=2024-09-12T19:51:36.687910+0000, chain.objs.size()=1 2024-09-12T18:13:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.794+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.500__shadow_.fNJgxy9SfkI8mcueWZ08eiOTagaWBHl_0 2024-09-12T18:13:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.794+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~x_Teqbfdd2YsKMCE6RGzqf8I8ak8L29', time=2024-09-12T19:54:33.397888+0000, chain.objs.size()=1 2024-09-12T18:13:48.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.794+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~x_Teqbfdd2YsKMCE6RGzqf8I8ak8L29.2 2024-09-12T18:13:48.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.794+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~x_Teqbfdd2YsKMCE6RGzqf8I8ak8L29', time=2024-09-12T19:54:33.401365+0000, chain.objs.size()=1 2024-09-12T18:13:48.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.794+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~x_Teqbfdd2YsKMCE6RGzqf8I8ak8L29.3 2024-09-12T18:13:48.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.794+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8436708958803226678', time=2024-09-12T19:58:00.664652+0000, chain.objs.size()=1 2024-09-12T18:13:48.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.794+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:5txn2P9PhsOceWEWqLv0uOlQ4CycYG2_.ayZs3tklHyv8K00y2YURaG6EPugowIB_0 2024-09-12T18:13:48.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.794+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9992917844064784897', time=2024-09-12T19:58:02.459849+0000, chain.objs.size()=1 2024-09-12T18:13:48.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.794+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:8mfxE53sTzjfgCJTLfggTkCsY7k3N16_.8cmm2SnJuhZPNISdHra-W2QbG60rgTc_0 2024-09-12T18:13:48.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.794+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8370763502003449714', time=2024-09-12T19:58:17.421525+0000, chain.objs.size()=1 2024-09-12T18:13:48.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.794+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.575__shadow:T1I2fXNOs6XFAt808ksbsxrT.6au-6r_.m_tNFpfFG9tpu7ymRbar5J40rRr5cOG_0 2024-09-12T18:13:48.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.794+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5024288881845881033', time=2024-09-12T19:58:32.276202+0000, chain.objs.size()=1 2024-09-12T18:13:48.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.794+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:iVjfH7X.psGR0smWGtCYZcF5lXtcqpc_.-YIceGCrPseYhs3h6VJFIkJHkF-2lTV_0 2024-09-12T18:13:48.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.794+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4260056059477062201', time=2024-09-12T19:58:42.811061+0000, chain.objs.size()=1 2024-09-12T18:13:48.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.794+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:ul7Qj4f.nuJRwPitk9s7zJp5xLtfzX6_.WWgIUe4ez8ll6znQRu5qJh8NlhyqJqF_0 2024-09-12T18:13:48.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.794+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10791220469062454258', time=2024-09-12T19:59:33.456307+0000, chain.objs.size()=1 2024-09-12T18:13:48.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.794+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.583__shadow:EI0SiCpSQEGZYu-Lw2X97TT0Pv6sjvI_.0HlkglOftnrXizMfBQhOxhM6qrV0cyh_0 2024-09-12T18:13:48.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.794+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15419074861634004871', time=2024-09-12T19:59:34.692500+0000, chain.objs.size()=1 2024-09-12T18:13:48.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.794+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.584__shadow:tfafqMUOIcI1Osay.8DM-qBPQmmIL28_.cVw7fHXdZOktMU5kknUOvpWF3LAE6mz_0 2024-09-12T18:13:48.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.797+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.851635768686195189', time=2024-09-12T20:05:23.964720+0000, chain.objs.size()=1 2024-09-12T18:13:48.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.797+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.650__shadow_.B9FYtSawmkImBwoPrnbnYIAdSdRymA8_0 2024-09-12T18:13:48.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.797+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13495914604571685947', time=2024-09-12T20:07:06.929552+0000, chain.objs.size()=1 2024-09-12T18:13:48.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.797+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.720__shadow_.cXgxiqz7OFDKXHGxUbR1fu636UZLx7O_0 2024-09-12T18:13:48.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.797+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14403061606395993945', time=2024-09-12T20:07:35.876812+0000, chain.objs.size()=1 2024-09-12T18:13:48.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.797+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.741__shadow_.vqiaKQ9BR6ynw1SqUjgtCix3qTpQXbo_0 2024-09-12T18:13:48.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.799+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:48.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.802+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:13:48.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.803+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:48.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.804+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:48.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.805+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54263' 2024-09-12T18:13:48.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.805+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8852138787523148937', time=2024-09-12T19:41:32.289184+0000, chain.objs.size()=5 2024-09-12T18:13:48.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.805+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.160__multipart_mymultipart-LUKEWARM.2~NEaqrEbl-boTYOksLypEWfZhgEvVij1.1 2024-09-12T18:13:48.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.805+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.160__shadow_mymultipart-LUKEWARM.2~NEaqrEbl-boTYOksLypEWfZhgEvVij1.1_1 2024-09-12T18:13:48.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.805+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.160__multipart_mymultipart-LUKEWARM.2~NEaqrEbl-boTYOksLypEWfZhgEvVij1.2 2024-09-12T18:13:48.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.805+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.160__shadow_mymultipart-LUKEWARM.2~NEaqrEbl-boTYOksLypEWfZhgEvVij1.2_1 2024-09-12T18:13:48.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.805+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.160__multipart_mymultipart-LUKEWARM.2~NEaqrEbl-boTYOksLypEWfZhgEvVij1.3 2024-09-12T18:13:48.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.805+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7813510462713237667', time=2024-09-12T19:41:53.152260+0000, chain.objs.size()=3 2024-09-12T18:13:48.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.805+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__multipart_foo-STANDARD.2~jL_XV3e0_8TF1pUKk0FJUgowH3xbMxT.1 2024-09-12T18:13:48.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.805+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__multipart_foo-STANDARD.2~jL_XV3e0_8TF1pUKk0FJUgowH3xbMxT.2 2024-09-12T18:13:48.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.805+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__multipart_foo-STANDARD.2~jL_XV3e0_8TF1pUKk0FJUgowH3xbMxT.3 2024-09-12T18:13:48.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.805+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11925640007957208505', time=2024-09-12T19:42:42.253238+0000, chain.objs.size()=1 2024-09-12T18:13:48.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.805+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.179__shadow_.k7JbEyORrorJ6dA3verGCQbxlgmZ1fG_0 2024-09-12T18:13:48.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.805+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11827059280978752688', time=2024-09-12T19:45:05.525920+0000, chain.objs.size()=1 2024-09-12T18:13:48.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.805+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.236__shadow_.E0c_l4lW80mzQUdZo1DIdfbpmbFVv_R_0 2024-09-12T18:13:48.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.805+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12391448932429819445', time=2024-09-12T19:45:09.664853+0000, chain.objs.size()=1 2024-09-12T18:13:48.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.805+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.239__shadow_.JRVTB9m8Gqv1pDDzjKqdPqOkHvqkDEK_0 2024-09-12T18:13:48.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.805+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5144013999218390203', time=2024-09-12T19:45:10.465963+0000, chain.objs.size()=1 2024-09-12T18:13:48.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.805+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.240__shadow_.kJlWQC6wz45hNAFAWWp4m-uctuncbaI_0 2024-09-12T18:13:48.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.808+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2975242665768597328', time=2024-09-12T19:45:14.724317+0000, chain.objs.size()=1 2024-09-12T18:13:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.808+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.244__shadow_.vgQ-2Qv9KGWqqCVJyrcd2z3K5uBLUzz_0 2024-09-12T18:13:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.808+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16326961486236864663', time=2024-09-12T19:45:21.830455+0000, chain.objs.size()=1 2024-09-12T18:13:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.808+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.251__shadow_.5-i1US4zfKilQJ719fXOye87sTnB5U5_0 2024-09-12T18:13:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.808+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18290134205819482639', time=2024-09-12T19:45:29.027227+0000, chain.objs.size()=1 2024-09-12T18:13:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.808+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.259__shadow_.p283RG4IEuYMu1D8Q7j7jJzxvBDm7r2_0 2024-09-12T18:13:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.808+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15974206857676663430', time=2024-09-12T19:45:30.819152+0000, chain.objs.size()=1 2024-09-12T18:13:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.808+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.261__shadow_.IiFPS6lSCOXqpRoXQF04y2Cjvl4996r_0 2024-09-12T18:13:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.808+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4553643464227726828', time=2024-09-12T19:46:08.986018+0000, chain.objs.size()=1 2024-09-12T18:13:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.808+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.vChqMFTvr8wUI3fjyD1b5nsm5QGyP8G_0 2024-09-12T18:13:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.808+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8009790225999095679', time=2024-09-12T19:46:09.347037+0000, chain.objs.size()=1 2024-09-12T18:13:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.808+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.T2qJU35cP0Lv8vAG4ERP4nRGNUtLbFp_0 2024-09-12T18:13:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.808+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1717661048843629748', time=2024-09-12T19:46:09.456245+0000, chain.objs.size()=1 2024-09-12T18:13:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.808+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.I9MkQH38RFWNEhhRwFBiiBehWIFftmj_0 2024-09-12T18:13:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.808+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11314969344458150063', time=2024-09-12T19:46:10.808260+0000, chain.objs.size()=1 2024-09-12T18:13:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.808+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.vOz_I2eBvO35rTSY4dPhqnyLfGI9ElK_0 2024-09-12T18:13:48.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.808+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3356268317449084727', time=2024-09-12T19:46:10.936440+0000, chain.objs.size()=1 2024-09-12T18:13:48.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.808+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.JrffOGcTik2vxCyttRZWQZmJfAtJU5b_0 2024-09-12T18:13:48.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.808+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7692493409068136473', time=2024-09-12T19:46:10.937325+0000, chain.objs.size()=1 2024-09-12T18:13:48.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.808+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Fa4_vbPOTcfx0t6d3bzwm6x6O9rKkx2_0 2024-09-12T18:13:48.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.808+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13313530008890272164', time=2024-09-12T19:46:11.222074+0000, chain.objs.size()=1 2024-09-12T18:13:48.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.808+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.lxxQmoAi5jLpw-rOhe1OonnwBvDRVu6_0 2024-09-12T18:13:48.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.810+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17414343274726448214', time=2024-09-12T19:46:11.354305+0000, chain.objs.size()=1 2024-09-12T18:13:48.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.810+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.XHlSmh5UNXuauIZGOQc6ftbPYHwen25_0 2024-09-12T18:13:48.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.810+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17352877027126814386', time=2024-09-12T19:46:11.876760+0000, chain.objs.size()=1 2024-09-12T18:13:48.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.810+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.FCJzPd6PbRSmUrZw1Cv3wnmu-YRV1uM_0 2024-09-12T18:13:48.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.810+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14621469448428457814', time=2024-09-12T19:46:12.019429+0000, chain.objs.size()=1 2024-09-12T18:13:48.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.810+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.u-a-x7T5WR5nmtkl7X6blMSwHAapiCC_0 2024-09-12T18:13:48.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.810+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7348392432086399499', time=2024-09-12T19:46:12.388508+0000, chain.objs.size()=1 2024-09-12T18:13:48.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.810+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ULBnLYI4igPBVxpZjBDmk8vVkVVhxEE_0 2024-09-12T18:13:48.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.810+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17800465952159936384', time=2024-09-12T19:46:12.527969+0000, chain.objs.size()=1 2024-09-12T18:13:48.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.810+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.joCSGlLRr8RxohY9KpeHWX2Hg5txTe9_0 2024-09-12T18:13:48.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.810+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12471924690830551265', time=2024-09-12T19:46:12.529338+0000, chain.objs.size()=1 2024-09-12T18:13:48.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.810+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_._HO2l3DDkSOnzeHHcJn6pv8NNKYfT2y_0 2024-09-12T18:13:48.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.810+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3562375992003659175', time=2024-09-12T19:46:12.717999+0000, chain.objs.size()=1 2024-09-12T18:13:48.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.810+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.UNUX-Hv-nm_G62TVn6C0nFXZ5pLYPFu_0 2024-09-12T18:13:48.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.811+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8893534364890273488', time=2024-09-12T19:46:13.366895+0000, chain.objs.size()=1 2024-09-12T18:13:48.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.811+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.nI-iWZsYdRoEbV4mWHPMFP0hjlCqr4Z_0 2024-09-12T18:13:48.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.811+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7573615465591899856', time=2024-09-12T19:46:13.367653+0000, chain.objs.size()=1 2024-09-12T18:13:48.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.811+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.G2RGXIKC20LUK5dc21wafNXLAceR5kZ_0 2024-09-12T18:13:48.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.811+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7420497564435886095', time=2024-09-12T19:46:13.801452+0000, chain.objs.size()=1 2024-09-12T18:13:48.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.811+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.MBGVbjK5U2I70WGpONT4K7fbfF6GJv7_0 2024-09-12T18:13:48.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.811+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5096219123905958956', time=2024-09-12T19:46:13.835154+0000, chain.objs.size()=1 2024-09-12T18:13:48.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.811+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_._uHQYQfkzI5Hdj7uXQ9bV0J_92eu_OO_0 2024-09-12T18:13:48.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.813+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5283417157168035789', time=2024-09-12T19:46:14.112273+0000, chain.objs.size()=1 2024-09-12T18:13:48.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.813+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.1F1D74smcScAL_JlBWe34OISLpcDJXS_0 2024-09-12T18:13:48.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.813+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16787884421973525207', time=2024-09-12T19:46:14.735191+0000, chain.objs.size()=1 2024-09-12T18:13:48.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.813+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.rA330D5Y3ngjNvgvFUoAsk38drJaLgC_0 2024-09-12T18:13:48.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.813+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10498593542479462917', time=2024-09-12T19:46:15.026404+0000, chain.objs.size()=1 2024-09-12T18:13:48.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.813+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.dEgTc2R0lNk0hmWX78do7NPmuQQRlpy_0 2024-09-12T18:13:48.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.813+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15396788679609031442', time=2024-09-12T19:46:15.064584+0000, chain.objs.size()=1 2024-09-12T18:13:48.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.813+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.GXEMdZhZwR8eEvTtFuJg3g0TSZ4AzIp_0 2024-09-12T18:13:48.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.813+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17198604612547196977', time=2024-09-12T19:46:15.578917+0000, chain.objs.size()=1 2024-09-12T18:13:48.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.813+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.-EsgzHRMlMPjzntPYrotsXyN8EB0E0z_0 2024-09-12T18:13:48.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.813+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3821501475575225031', time=2024-09-12T19:46:15.637411+0000, chain.objs.size()=1 2024-09-12T18:13:48.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.813+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.dijkLpgRORVDVlPIkSNp3DqFpYFwRSs_0 2024-09-12T18:13:48.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.813+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5072055627049861627', time=2024-09-12T19:46:15.704811+0000, chain.objs.size()=1 2024-09-12T18:13:48.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.813+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Aoos1wFx4amTihTlPlluMbraI8c9pVe_0 2024-09-12T18:13:48.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.814+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.240686746178418887', time=2024-09-12T19:46:15.741286+0000, chain.objs.size()=1 2024-09-12T18:13:48.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.814+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.2mkdiljEXwWMBKMqCQUCaoNvFZGH5VQ_0 2024-09-12T18:13:48.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.814+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12007452795845044443', time=2024-09-12T19:46:16.203126+0000, chain.objs.size()=1 2024-09-12T18:13:48.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.814+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.XvV2-6Jtnam5F79eYmIrzwmiPoYUAug_0 2024-09-12T18:13:48.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.814+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6911930722668673816', time=2024-09-12T19:46:16.827906+0000, chain.objs.size()=1 2024-09-12T18:13:48.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.814+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.d2DZ2zFZzYXKxSfshJPI7nwI_4alzqS_0 2024-09-12T18:13:48.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.814+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13661969297567414138', time=2024-09-12T19:46:16.976943+0000, chain.objs.size()=1 2024-09-12T18:13:48.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.814+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.sho4zi0S3iCdwFuwvU4KWHq5itnsVRX_0 2024-09-12T18:13:48.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.816+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12760117918043016252', time=2024-09-12T19:46:16.997950+0000, chain.objs.size()=1 2024-09-12T18:13:48.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.816+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.hCfO-mK8Z7I6fIGxptE9xmkxWcE8F6Y_0 2024-09-12T18:13:48.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.816+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14010986379831487993', time=2024-09-12T19:46:17.074878+0000, chain.objs.size()=1 2024-09-12T18:13:48.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.816+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.XxXPoIkAKZfVBCQ4hNe7FMVHoZ_Q_bW_0 2024-09-12T18:13:48.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.816+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15702848294541393485', time=2024-09-12T19:46:17.129209+0000, chain.objs.size()=1 2024-09-12T18:13:48.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.816+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.7KUQZoCA6SX2yMDZ8jxnj0FN0h6P1Vu_0 2024-09-12T18:13:48.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.816+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17515143739778259687', time=2024-09-12T19:46:17.455956+0000, chain.objs.size()=1 2024-09-12T18:13:48.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.816+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.KlvVMDtznSYC1HA_JPrE0xsNjQFQUGE_0 2024-09-12T18:13:48.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.816+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1932281200444388688', time=2024-09-12T19:46:18.004142+0000, chain.objs.size()=1 2024-09-12T18:13:48.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.816+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.jD2mzTowqFYZrDBYyiXF3LjsAT2WtQ7_0 2024-09-12T18:13:48.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.816+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3508074351380785365', time=2024-09-12T19:46:18.474283+0000, chain.objs.size()=1 2024-09-12T18:13:48.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.816+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.lfJwiTKATAZ4gmBgt2tbuuNWxexidT7_0 2024-09-12T18:13:48.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.816+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17519076122348020009', time=2024-09-12T19:46:19.212072+0000, chain.objs.size()=1 2024-09-12T18:13:48.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.816+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.YiVWdC5CBn2TM9iRu31_UTq9JtvG-oF_0 2024-09-12T18:13:48.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.816+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16700465257732710987', time=2024-09-12T19:46:23.095371+0000, chain.objs.size()=1 2024-09-12T18:13:48.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.816+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.267__shadow_.DvJWgUhCv6H2sjtzMcW1hqeS4eyXVcC_0 2024-09-12T18:13:48.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.817+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6319998602658521120', time=2024-09-12T19:46:24.860888+0000, chain.objs.size()=1 2024-09-12T18:13:48.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.817+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.269__shadow_.ZROGHOvl-kF4EyxgOtNNifJ__gP9XEz_0 2024-09-12T18:13:48.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.817+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16526571496587916362', time=2024-09-12T19:46:27.475860+0000, chain.objs.size()=1 2024-09-12T18:13:48.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.817+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.272__shadow_._g-S8KuK8QIqqOocPF2Ydy3zQS3tAFi_0 2024-09-12T18:13:48.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.817+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1968515518172479591', time=2024-09-12T19:46:34.629625+0000, chain.objs.size()=1 2024-09-12T18:13:48.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.817+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.280__shadow_.o--xqiPldmPyDjVjgbFoKv-tYBwZoz0_0 2024-09-12T18:13:48.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.819+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9687934814059604844', time=2024-09-12T19:46:37.399669+0000, chain.objs.size()=1 2024-09-12T18:13:48.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.819+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.283__shadow_.GapapA4kVJEJ-dI6zNSv9eK8ZDBuK1T_0 2024-09-12T18:13:48.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.819+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9019295962154005039', time=2024-09-12T19:46:37.405675+0000, chain.objs.size()=1 2024-09-12T18:13:48.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.819+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.283__shadow_.UIlkzS70YwT4WyhyGy-EkGdtQg7lJi7_0 2024-09-12T18:13:48.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.819+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17096385298240988474', time=2024-09-12T19:46:41.156907+0000, chain.objs.size()=1 2024-09-12T18:13:48.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.819+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.287__shadow_.60i-9J00zN9JmLrcxAjZwGdRxi1N6V6_0 2024-09-12T18:13:48.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.819+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14569619871067980624', time=2024-09-12T19:46:50.325794+0000, chain.objs.size()=1 2024-09-12T18:13:48.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.819+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.294__shadow_.6UFZVCHki9zZQ0oB7uXDAeSgM_5wZNC_0 2024-09-12T18:13:48.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.822+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6549010503425991456', time=2024-09-12T19:46:50.419143+0000, chain.objs.size()=1 2024-09-12T18:13:48.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.822+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.294__shadow_.BXG5rIynBkGzYcs1d2HIqZMfXuzt3jq_0 2024-09-12T18:13:48.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.822+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8158106389156914334', time=2024-09-12T19:46:50.419910+0000, chain.objs.size()=1 2024-09-12T18:13:48.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.822+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.294__shadow_.8REFwKQzLVF_aWLFFDZhIUnvlO5J2PN_0 2024-09-12T18:13:48.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.822+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3716556678248927142', time=2024-09-12T19:47:02.750370+0000, chain.objs.size()=1 2024-09-12T18:13:48.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.822+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.307__shadow_.BiYJL8leT_itd-st18cKnUH5vPNWH6p_0 2024-09-12T18:13:48.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.822+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1909822672918043391', time=2024-09-12T19:47:21.321439+0000, chain.objs.size()=1 2024-09-12T18:13:48.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.822+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.323__shadow_.bzJLWCSIgkK1yRMK504xKYPgkVTREph_0 2024-09-12T18:13:48.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.822+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6414642926946368599', time=2024-09-12T19:47:59.469654+0000, chain.objs.size()=1 2024-09-12T18:13:48.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.822+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.haZiJmYkJFGi_tcIpvmstHCwOn7nLgu_0 2024-09-12T18:13:48.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.822+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10887585954833486195', time=2024-09-12T19:47:59.725084+0000, chain.objs.size()=1 2024-09-12T18:13:48.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.822+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.njMJUMlmuI8fa4q_DKb4mg5YYd1vJbV_0 2024-09-12T18:13:48.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.822+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3280408920512444147', time=2024-09-12T19:47:59.918620+0000, chain.objs.size()=1 2024-09-12T18:13:48.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.822+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.DIjmVxrIOUaoEsst0w1pZ5YvCCRcJzl_0 2024-09-12T18:13:48.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.822+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9539447104270566031', time=2024-09-12T19:48:00.050703+0000, chain.objs.size()=1 2024-09-12T18:13:48.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.822+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ryUwKgO3jY-quQaCP8dmi0V1NhFsNgE_0 2024-09-12T18:13:48.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.822+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8690316223062910355', time=2024-09-12T19:48:00.242774+0000, chain.objs.size()=1 2024-09-12T18:13:48.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.822+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.uZpIQKvjb8_X9F3BkIQtxiE1W25RaxX_0 2024-09-12T18:13:48.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.822+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7109138105217740149', time=2024-09-12T19:48:00.997766+0000, chain.objs.size()=1 2024-09-12T18:13:48.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.822+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.wEp1H8s_q37B_zJ5tEmrPQB0nulw8iD_0 2024-09-12T18:13:48.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.822+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2968708343732325063', time=2024-09-12T19:48:01.055573+0000, chain.objs.size()=1 2024-09-12T18:13:48.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.822+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Wxg3jX7bcPfHf1Wo-87P6v6q3TK-rW-_0 2024-09-12T18:13:48.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.824+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4967061381378149766', time=2024-09-12T19:48:01.325899+0000, chain.objs.size()=1 2024-09-12T18:13:48.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.824+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.qCU2hcTK5QyceFkQdNEvRth21xtCW2x_0 2024-09-12T18:13:48.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.824+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16404747811707611608', time=2024-09-12T19:48:01.479909+0000, chain.objs.size()=1 2024-09-12T18:13:48.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.824+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.531s9E2N2hh-kKsVcHjBA7e-QqWoiSF_0 2024-09-12T18:13:48.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.824+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8943938622905786776', time=2024-09-12T19:48:02.495316+0000, chain.objs.size()=1 2024-09-12T18:13:48.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.824+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.zOdA_QfW2E_bVv3D7zBuRxGrg2bZ6F6_0 2024-09-12T18:13:48.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.824+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6752858913013855524', time=2024-09-12T19:48:03.347981+0000, chain.objs.size()=1 2024-09-12T18:13:48.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.824+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.JVxPd6tphcmnzr7Y_mlNeSvkYBRpBaG_0 2024-09-12T18:13:48.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.824+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9441507635959929603', time=2024-09-12T19:48:03.993581+0000, chain.objs.size()=1 2024-09-12T18:13:48.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.824+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.erjLyZlxs0DsEQiVMxRvwvgG2HmrWK5_0 2024-09-12T18:13:48.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.824+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5352382246567450908', time=2024-09-12T19:48:04.217190+0000, chain.objs.size()=1 2024-09-12T18:13:48.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.824+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.vW_3zgRk-XZGrvVWqzbKbvUwfSTPx6g_0 2024-09-12T18:13:48.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.824+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1961726869805042183', time=2024-09-12T19:48:04.359127+0000, chain.objs.size()=1 2024-09-12T18:13:48.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.824+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Sm34u3eaHHMyR5_V5-BfQ_JPg6dgMuz_0 2024-09-12T18:13:48.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.824+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17659576363116654664', time=2024-09-12T19:48:04.450493+0000, chain.objs.size()=1 2024-09-12T18:13:48.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.824+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.T0-ziRx707RxICSbExx3jILtkE6Aeu-_0 2024-09-12T18:13:48.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.824+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3967784269339001182', time=2024-09-12T19:48:04.772381+0000, chain.objs.size()=1 2024-09-12T18:13:48.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.824+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.5mKQBIVhukphctQ9OQ7pVNxwESGu8aB_0 2024-09-12T18:13:48.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.824+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9392623355142645568', time=2024-09-12T19:48:04.816290+0000, chain.objs.size()=1 2024-09-12T18:13:48.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.825+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.f-uhA_N-uVMQkrGtdcM09rS0A7rAnSK_0 2024-09-12T18:13:48.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.825+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16651376683049815803', time=2024-09-12T19:48:05.303460+0000, chain.objs.size()=1 2024-09-12T18:13:48.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.825+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.X-VmSXdPvk-MoKg-j6krR-0BvuOVb_c_0 2024-09-12T18:13:48.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.826+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16919898146828968493', time=2024-09-12T19:48:05.304274+0000, chain.objs.size()=1 2024-09-12T18:13:48.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.826+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.as9DoLjaF2xNTRu8oC2JNQbW7aSugvr_0 2024-09-12T18:13:48.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.826+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15974089415171889766', time=2024-09-12T19:48:05.423441+0000, chain.objs.size()=1 2024-09-12T18:13:48.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.826+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.PRXFpBFhaijgOfuGJUp3bn-HzB1-2iJ_0 2024-09-12T18:13:48.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.827+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14410540375509041045', time=2024-09-12T19:48:05.582405+0000, chain.objs.size()=1 2024-09-12T18:13:48.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.827+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.u242StDzs5a9GSYj6EnZ7ulBGR4Sx_n_0 2024-09-12T18:13:48.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.827+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12876325820518358584', time=2024-09-12T19:48:05.675100+0000, chain.objs.size()=1 2024-09-12T18:13:48.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.827+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.1VHCc7bIzt66LrNdzvulmK7aRtcE_7A_0 2024-09-12T18:13:48.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.827+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8042571234148516924', time=2024-09-12T19:48:05.825197+0000, chain.objs.size()=1 2024-09-12T18:13:48.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.827+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Mpx_sJhaZ24REmSLAYxSBb6ofFKBJ_q_0 2024-09-12T18:13:48.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.827+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11214639431115631750', time=2024-09-12T19:48:05.926345+0000, chain.objs.size()=1 2024-09-12T18:13:48.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.827+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.8EJYLNbjcgzblgHhwj74Naht9KUpZYp_0 2024-09-12T18:13:48.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.827+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13028598035995930527', time=2024-09-12T19:48:06.681544+0000, chain.objs.size()=1 2024-09-12T18:13:48.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.827+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Q3tZoQQcFc4_ch_xRcYizTDSwOlEAvb_0 2024-09-12T18:13:48.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.827+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12265126137462690410', time=2024-09-12T19:48:06.812868+0000, chain.objs.size()=1 2024-09-12T18:13:48.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.827+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.vQ28N3XWgzpZ47iRhIOnsehXtHXC2wp_0 2024-09-12T18:13:48.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.827+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8438286269968533319', time=2024-09-12T19:48:06.825055+0000, chain.objs.size()=1 2024-09-12T18:13:48.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.827+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Vx4KITi_Rr0cJhyaSe3LpyCNjguP7_b_0 2024-09-12T18:13:48.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.827+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12158104490300678126', time=2024-09-12T19:48:06.993283+0000, chain.objs.size()=1 2024-09-12T18:13:48.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.827+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.1unlbYqw416SGnQKY17UFIVkDuLtFMh_0 2024-09-12T18:13:48.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.827+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12179494535419067408', time=2024-09-12T19:48:07.101613+0000, chain.objs.size()=1 2024-09-12T18:13:48.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.827+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Coe9shpuGpMOPSumSNNSgLOxII8TxvP_0 2024-09-12T18:13:48.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.827+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4181728546712138826', time=2024-09-12T19:48:07.481572+0000, chain.objs.size()=1 2024-09-12T18:13:48.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.827+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.TNH8N2rLt_izL54BSa1TSUFWFf0IaGg_0 2024-09-12T18:13:48.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.827+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6738698191945877868', time=2024-09-12T19:48:07.672469+0000, chain.objs.size()=1 2024-09-12T18:13:48.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.827+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.8YOk6uxnnCuKAEnx_z24DxiCigPghCI_0 2024-09-12T18:13:48.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.829+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.231738741007846018', time=2024-09-12T19:48:09.300585+0000, chain.objs.size()=1 2024-09-12T18:13:48.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.829+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Uas842_omd3XshxMzKBT-3RdNhqNGNe_0 2024-09-12T18:13:48.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.829+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13069593160363582356', time=2024-09-12T19:48:09.311304+0000, chain.objs.size()=1 2024-09-12T18:13:48.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.829+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.dNunM7TYycQnfs5Iz1jkf3GWfV6keso_0 2024-09-12T18:13:48.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.829+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15001771424668757396', time=2024-09-12T19:48:09.510440+0000, chain.objs.size()=1 2024-09-12T18:13:48.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.829+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.EKVSgQpXiKG7hF2RXQh2AdKDsmKh18H_0 2024-09-12T18:13:48.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.829+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3815296552190953883', time=2024-09-12T19:48:47.526185+0000, chain.objs.size()=1 2024-09-12T18:13:48.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.829+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.8TBsSL_Ev4O_u3YbPYbzxebM8dh87GV_0 2024-09-12T18:13:48.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.829+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16852438188957134232', time=2024-09-12T19:48:48.187929+0000, chain.objs.size()=1 2024-09-12T18:13:48.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.829+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.V0-gZo2TcyQahDCcR4sj7pvAp0lEby7_0 2024-09-12T18:13:48.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.830+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1164946562781079039', time=2024-09-12T19:48:49.097872+0000, chain.objs.size()=1 2024-09-12T18:13:48.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.830+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.FwFmBgRwXK-jThAi0RkC5eFv2fPsvTx_0 2024-09-12T18:13:48.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.830+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3746498862599350567', time=2024-09-12T19:48:49.098433+0000, chain.objs.size()=1 2024-09-12T18:13:48.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.830+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.I4332-gCjc5sO8ldGzA-oFqOKK_reT9_0 2024-09-12T18:13:48.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.830+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2318173116069182484', time=2024-09-12T19:48:49.361071+0000, chain.objs.size()=1 2024-09-12T18:13:48.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.830+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Cod7cs2x4lbgFi56BHrf2d855uXblVF_0 2024-09-12T18:13:48.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.830+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4679495396098030631', time=2024-09-12T19:48:49.655895+0000, chain.objs.size()=1 2024-09-12T18:13:48.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.830+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.TUZSJkj_vlSmtUjKp4UW8y56azXXUCj_0 2024-09-12T18:13:48.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.830+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5974196970675442191', time=2024-09-12T19:48:50.548656+0000, chain.objs.size()=1 2024-09-12T18:13:48.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.830+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_._qjW9gQJbXv58Nup8H7OCrX1U3kF_Jd_0 2024-09-12T18:13:48.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.830+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13193389985840224776', time=2024-09-12T19:48:50.549451+0000, chain.objs.size()=1 2024-09-12T18:13:48.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.830+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.9GDnf7ntigaEkmnaS9eKVZ0kMdZruJa_0 2024-09-12T18:13:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.833+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/54263 2024-09-12T18:13:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.835+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=39, truncated=0, next_marker='' 2024-09-12T18:13:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.835+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9497102531420690385', time=2024-09-12T19:48:50.640513+0000, chain.objs.size()=1 2024-09-12T18:13:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.835+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.3aThuZNxyZiWTPJYaARPGRMIGd0umaR_0 2024-09-12T18:13:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.835+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8116075974148324864', time=2024-09-12T19:48:51.117766+0000, chain.objs.size()=1 2024-09-12T18:13:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.835+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.3j_WNuKURBMzrbm551fdmq9dBpo7lcy_0 2024-09-12T18:13:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.835+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9534743382488063557', time=2024-09-12T19:48:51.359542+0000, chain.objs.size()=1 2024-09-12T18:13:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.835+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.0xaGit-WhQMUM2E64zEfNE7EpL_2lV9_0 2024-09-12T18:13:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.835+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4447173426179606189', time=2024-09-12T19:48:52.189404+0000, chain.objs.size()=1 2024-09-12T18:13:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.835+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.zj6cIlWTLj0B6jwbft1-Bb9cQ0WnXXr_0 2024-09-12T18:13:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.835+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11063347425039878451', time=2024-09-12T19:48:52.208143+0000, chain.objs.size()=1 2024-09-12T18:13:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.835+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ymbL5sKuuwYoUBGpvOCz6HXBR83qKzj_0 2024-09-12T18:13:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.835+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2746127261921793751', time=2024-09-12T19:48:52.246143+0000, chain.objs.size()=1 2024-09-12T18:13:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.835+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.2r_RchinHMPpnp1ba-PHKwky5HoxLcN_0 2024-09-12T18:13:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.835+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.191072089719516869', time=2024-09-12T19:48:52.677633+0000, chain.objs.size()=1 2024-09-12T18:13:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.835+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.oqnYdWIw9daojAP_1mDCld_YukeiiHd_0 2024-09-12T18:13:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.835+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14830609861777951882', time=2024-09-12T19:48:52.807710+0000, chain.objs.size()=1 2024-09-12T18:13:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.835+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.-7dIinozEYqqt8qA8u7zizGQC_DufWn_0 2024-09-12T18:13:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.835+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1707724063879388183', time=2024-09-12T19:48:53.897563+0000, chain.objs.size()=1 2024-09-12T18:13:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.835+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.AOD-1jUBnd0fSHakD2rh6wTjeoXI1I2_0 2024-09-12T18:13:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.835+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14094229325711089653', time=2024-09-12T19:48:54.287403+0000, chain.objs.size()=1 2024-09-12T18:13:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.835+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ITXSoFYnPp-90TiopZm_RWlmbqTyjXQ_0 2024-09-12T18:13:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.835+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15581843054296284244', time=2024-09-12T19:48:54.691179+0000, chain.objs.size()=1 2024-09-12T18:13:48.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.835+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ozA5A0k4bng1tbriXjGuJyj_SBm-0Ky_0 2024-09-12T18:13:48.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.835+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18130215275955919925', time=2024-09-12T19:48:55.051625+0000, chain.objs.size()=1 2024-09-12T18:13:48.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.835+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.wNzwlVwA0_k0ELIrFuXi-zLFJ8338Wj_0 2024-09-12T18:13:48.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.837+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3810260863345908504', time=2024-09-12T19:48:55.080623+0000, chain.objs.size()=1 2024-09-12T18:13:48.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.837+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.JP4AqohVUimsjiC7IwwYr5Yg8wKbiPb_0 2024-09-12T18:13:48.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.837+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7353899183745845852', time=2024-09-12T19:48:55.120584+0000, chain.objs.size()=1 2024-09-12T18:13:48.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.837+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.DyGug5b5ZczoGTitd8pFYlsjhWylivs_0 2024-09-12T18:13:48.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.837+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2892184765708029772', time=2024-09-12T19:48:55.222586+0000, chain.objs.size()=1 2024-09-12T18:13:48.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.837+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.WzMR4kpSpAr5CmJZrLZvn3FVhkWDR0V_0 2024-09-12T18:13:48.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.837+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5921740934892003283', time=2024-09-12T19:48:55.989171+0000, chain.objs.size()=1 2024-09-12T18:13:48.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.837+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.84KEgtPydZUddbEtrxGN5M4g-UhbahB_0 2024-09-12T18:13:48.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.837+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11234894956039618008', time=2024-09-12T19:48:58.041758+0000, chain.objs.size()=1 2024-09-12T18:13:48.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.837+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Soggtt6rMnAN375tMQ3cOTOchw0msBn_0 2024-09-12T18:13:48.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.837+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7036547221150770865', time=2024-09-12T19:48:58.042658+0000, chain.objs.size()=1 2024-09-12T18:13:48.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.837+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.La_34vMFRCcPB18_IJKQzJUF5a0qj4n_0 2024-09-12T18:13:48.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.837+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14975176834892186992', time=2024-09-12T19:49:11.225074+0000, chain.objs.size()=1 2024-09-12T18:13:48.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.837+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.341__shadow_.aUQ8f2bFr0pyiUsjFvLYlOX9Vy4MlBD_0 2024-09-12T18:13:48.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.837+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9647154873532361327', time=2024-09-12T19:50:31.022104+0000, chain.objs.size()=1 2024-09-12T18:13:48.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.837+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.433__shadow_.jjSEtulQBqBPHUkfJtDy9byjvJHS_PJ_0 2024-09-12T18:13:48.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.837+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3750865306550689867', time=2024-09-12T19:51:18.594137+0000, chain.objs.size()=1 2024-09-12T18:13:48.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.837+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.484__shadow_.EoszkV3n-9TQwEhGnE_KTUsSBn-oi4o_0 2024-09-12T18:13:48.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.837+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2236495225569802194', time=2024-09-12T19:51:28.894867+0000, chain.objs.size()=1 2024-09-12T18:13:48.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.837+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.491__shadow_.lUqbqNLNCBhGbqRIuzD1MTY-qOTrigg_0 2024-09-12T18:13:48.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.837+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2236495225569802194', time=2024-09-12T19:51:29.159302+0000, chain.objs.size()=1 2024-09-12T18:13:48.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.837+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.491__shadow_.lUqbqNLNCBhGbqRIuzD1MTY-qOTrigg_0 2024-09-12T18:13:48.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.839+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6652805999312268322', time=2024-09-12T19:52:17.263718+0000, chain.objs.size()=1 2024-09-12T18:13:48.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.839+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.515__shadow_.huNagEoHDlzE8lhRij6pmg_I5JptGA0_0 2024-09-12T18:13:48.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.839+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1961279987845741989', time=2024-09-12T19:52:18.893529+0000, chain.objs.size()=1 2024-09-12T18:13:48.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.839+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.517__multipart_mymultipartcopy.2~sSG5QRFP2ThBLaTivfTQdll2EPLvJ3e.1 2024-09-12T18:13:48.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.839+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2192841545033695530', time=2024-09-12T19:53:22.305747+0000, chain.objs.size()=6 2024-09-12T18:13:48.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.839+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.522__multipart_mymultipart.2~FpFzJnU21ckbraL0srirVFFTv5MHY5M.1 2024-09-12T18:13:48.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.839+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.522__shadow_mymultipart.2~FpFzJnU21ckbraL0srirVFFTv5MHY5M.1_1 2024-09-12T18:13:48.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.839+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.522__multipart_mymultipart.2~FpFzJnU21ckbraL0srirVFFTv5MHY5M.2 2024-09-12T18:13:48.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.839+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.522__shadow_mymultipart.2~FpFzJnU21ckbraL0srirVFFTv5MHY5M.2_1 2024-09-12T18:13:48.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.839+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.522__multipart_mymultipart.2~FpFzJnU21ckbraL0srirVFFTv5MHY5M.3 2024-09-12T18:13:48.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.839+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.522__shadow_mymultipart.2~FpFzJnU21ckbraL0srirVFFTv5MHY5M.3_1 2024-09-12T18:13:48.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.839+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~Qf8n3HRGn2sJqyyShVMlfLrpgJnIGy6', time=2024-09-12T19:54:58.429604+0000, chain.objs.size()=1 2024-09-12T18:13:48.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.839+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~Qf8n3HRGn2sJqyyShVMlfLrpgJnIGy6.1 2024-09-12T18:13:48.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.839+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~Qf8n3HRGn2sJqyyShVMlfLrpgJnIGy6', time=2024-09-12T19:54:58.433550+0000, chain.objs.size()=1 2024-09-12T18:13:48.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.839+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~Qf8n3HRGn2sJqyyShVMlfLrpgJnIGy6.2 2024-09-12T18:13:48.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.839+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~Qf8n3HRGn2sJqyyShVMlfLrpgJnIGy6', time=2024-09-12T19:54:58.437088+0000, chain.objs.size()=1 2024-09-12T18:13:48.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.839+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~Qf8n3HRGn2sJqyyShVMlfLrpgJnIGy6.3 2024-09-12T18:13:48.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.841+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~Qf8n3HRGn2sJqyyShVMlfLrpgJnIGy6', time=2024-09-12T19:54:58.440806+0000, chain.objs.size()=1 2024-09-12T18:13:48.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.841+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~Qf8n3HRGn2sJqyyShVMlfLrpgJnIGy6.4 2024-09-12T18:13:48.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.841+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~Qf8n3HRGn2sJqyyShVMlfLrpgJnIGy6', time=2024-09-12T19:54:58.444484+0000, chain.objs.size()=1 2024-09-12T18:13:48.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.841+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~Qf8n3HRGn2sJqyyShVMlfLrpgJnIGy6.5 2024-09-12T18:13:48.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.841+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~Qf8n3HRGn2sJqyyShVMlfLrpgJnIGy6', time=2024-09-12T19:54:58.448263+0000, chain.objs.size()=1 2024-09-12T18:13:48.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.841+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~Qf8n3HRGn2sJqyyShVMlfLrpgJnIGy6.6 2024-09-12T18:13:48.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.842+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4686410345409610328', time=2024-09-12T19:57:59.306126+0000, chain.objs.size()=1 2024-09-12T18:13:48.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.842+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:jEmIBrf1J9lwaEQaoBxPqdR5Jc8daqV_.vODtkck_YyV5u7SY5bqHjPx5vzmBGmy_0 2024-09-12T18:13:48.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.842+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8402611066868417296', time=2024-09-12T19:58:04.708063+0000, chain.objs.size()=1 2024-09-12T18:13:48.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.842+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:j7qhA6LAbwKNSmMFk6UO9Oly.khyqlb_.Jnk13GnEgr8T8S-S4NifqjFt1ko8VuK_0 2024-09-12T18:13:48.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.842+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4900351773049646841', time=2024-09-12T19:58:08.491773+0000, chain.objs.size()=1 2024-09-12T18:13:48.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.842+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.571__shadow:yPkDupVYLR2QeSIMc.9A5S.d7jaLBxd_.RuWTQV4uwB3yJe22b4CnK_iZe4SxQ90_0 2024-09-12T18:13:48.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.842+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8380660567081770462', time=2024-09-12T19:58:22.419345+0000, chain.objs.size()=1 2024-09-12T18:13:48.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.842+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.577__shadow:blUUPtLRdeSXmFNcIw1eafkDiduww2m_.WcXf8GMZ7j8irwVzo38XRRqAuceN91Z_0 2024-09-12T18:13:48.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.842+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18432408866082519346', time=2024-09-12T19:59:29.867582+0000, chain.objs.size()=1 2024-09-12T18:13:48.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.842+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.580__shadow:zjGV5iZ1.0VkiYcEhh9RczutFnSXz4Q_.bhwK5I64aFwk0fnRo5ApyJ9LQUZc4Hq_0 2024-09-12T18:13:48.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.844+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.488679512238411036', time=2024-09-12T19:59:32.314342+0000, chain.objs.size()=1 2024-09-12T18:13:48.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.844+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.581__shadow:UeQ-5Ra3l.edmsxZ-H.QeS6oe4gASyZ_.GnJpbme5dvyNcuhCSDq4-c2PWjamwiP_0 2024-09-12T18:13:48.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.844+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10237156077100066437', time=2024-09-12T20:06:54.821063+0000, chain.objs.size()=1 2024-09-12T18:13:48.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.844+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.717__shadow:1JBOAgYc5M3CGmeaJkg9JUzoFKzfOb0_.TM4AZj2OhlJPw3XcAyY9Yam8ZNlQKHg_0 2024-09-12T18:13:48.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.845+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:48.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.847+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:13:48.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.848+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:48.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.849+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:48.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.850+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44687' 2024-09-12T18:13:48.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.850+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='_khmkBUHEQkMomXOBixWevil_MT4e28y', time=2024-09-12T19:41:54.495019+0000, chain.objs.size()=1 2024-09-12T18:13:48.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.850+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__shadow_.r-OV_S2xV10Df5WS908y10-FefTUCra_0 2024-09-12T18:13:48.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.850+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16076886462935000659', time=2024-09-12T19:42:27.844446+0000, chain.objs.size()=1 2024-09-12T18:13:48.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.850+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.171__shadow_.G7IndQDzmPBtVCTijM6o4W9RrJXt4b__0 2024-09-12T18:13:48.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.850+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17403594931878506036', time=2024-09-12T19:42:43.122018+0000, chain.objs.size()=1 2024-09-12T18:13:48.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.850+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.180__shadow_.FVDxlqvpSJyhFP1us18laF6Kp9rQ1Lw_0 2024-09-12T18:13:48.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.850+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4891991532310592325', time=2024-09-12T19:45:03.667445+0000, chain.objs.size()=1 2024-09-12T18:13:48.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.850+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.234__shadow_.xa_onTa6OludVusFRWuyRy0JGUblX0N_0 2024-09-12T18:13:48.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.850+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9887014917936326110', time=2024-09-12T19:45:06.441459+0000, chain.objs.size()=1 2024-09-12T18:13:48.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.850+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.237__shadow_.lxDKFAyI_0vtdmtBLKnhsHR2oE7mWbn_0 2024-09-12T18:13:48.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.850+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8078366340788942555', time=2024-09-12T19:45:22.729064+0000, chain.objs.size()=1 2024-09-12T18:13:48.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.850+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.252__shadow_.8oeZ2GRCEB3qmQ09AKjIh4lpQq1QpGx_0 2024-09-12T18:13:48.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.850+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5521442997812470647', time=2024-09-12T19:45:24.577777+0000, chain.objs.size()=1 2024-09-12T18:13:48.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.850+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.254__shadow_.X9jZG7XqIB1ime3tL9Jdu7PlkO8ibvL_0 2024-09-12T18:13:48.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.850+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1766525525411736217', time=2024-09-12T19:45:29.027336+0000, chain.objs.size()=1 2024-09-12T18:13:48.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.850+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.259__shadow_.85zVqafQIqXwH8hudz486f4haIkkj34_0 2024-09-12T18:13:48.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.850+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11664971474442563170', time=2024-09-12T19:46:09.150802+0000, chain.objs.size()=1 2024-09-12T18:13:48.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.850+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.zUnjHztxhORw72fzex5AsFi1db2HD4q_0 2024-09-12T18:13:48.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.850+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1283330557530603867', time=2024-09-12T19:46:09.273949+0000, chain.objs.size()=1 2024-09-12T18:13:48.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.850+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.clqfOPALtfDKJz5R2hn1gPA2CPT4SP4_0 2024-09-12T18:13:48.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.850+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6371079355529269815', time=2024-09-12T19:46:09.405489+0000, chain.objs.size()=1 2024-09-12T18:13:48.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.850+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.6c1giyZ47phVPul6yShBjorUOIz4pKF_0 2024-09-12T18:13:48.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.850+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13798859770464375367', time=2024-09-12T19:46:09.594850+0000, chain.objs.size()=1 2024-09-12T18:13:48.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.850+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_._MKCMTcGNSHGu53FTmsAupo5thSiFnL_0 2024-09-12T18:13:48.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.851+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1500884411647857814', time=2024-09-12T19:46:09.841288+0000, chain.objs.size()=1 2024-09-12T18:13:48.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.851+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.iJVAPLMvPVccddgS1a531vroX_WcTxe_0 2024-09-12T18:13:48.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.851+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14726905750625951978', time=2024-09-12T19:46:09.845859+0000, chain.objs.size()=1 2024-09-12T18:13:48.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.851+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.VgIn5jotPen2QLDxblmBfHWQS7e1VcS_0 2024-09-12T18:13:48.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.852+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8205152076723759318', time=2024-09-12T19:46:09.857735+0000, chain.objs.size()=1 2024-09-12T18:13:48.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.852+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.z4bhdcI6ldtVIHdKyGW3ljBXZrjZJU3_0 2024-09-12T18:13:48.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.852+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6791247850159082570', time=2024-09-12T19:46:10.368742+0000, chain.objs.size()=1 2024-09-12T18:13:48.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.852+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Taslk25wCEBeSCkfQyWfS9k2PE3bgu7_0 2024-09-12T18:13:48.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.852+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15457842521221654344', time=2024-09-12T19:46:10.410206+0000, chain.objs.size()=1 2024-09-12T18:13:48.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.852+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.0xQp4c5amBarlLUg9iJ-aWEeYXXuuz4_0 2024-09-12T18:13:48.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.852+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3134162275623793345', time=2024-09-12T19:46:11.179993+0000, chain.objs.size()=1 2024-09-12T18:13:48.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.852+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.qSf8Y4vUCQtAHoLciVyjtT2Kb5gSsPI_0 2024-09-12T18:13:48.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.852+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.267245051787318597', time=2024-09-12T19:46:12.402477+0000, chain.objs.size()=1 2024-09-12T18:13:48.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.852+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Q2EkLo3AtjgqEyRw1lSMSNeLJW5BEdE_0 2024-09-12T18:13:48.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.852+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14596800803630769495', time=2024-09-12T19:46:12.592268+0000, chain.objs.size()=1 2024-09-12T18:13:48.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.852+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.nz9MW_e6HQ3ndJcEp7EUHrYdz5oR0qw_0 2024-09-12T18:13:48.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.852+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12397164197793267092', time=2024-09-12T19:46:13.443160+0000, chain.objs.size()=1 2024-09-12T18:13:48.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.852+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.HXyCv52Q_MbYN5SzdMJ-uv3vcrP679d_0 2024-09-12T18:13:48.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.852+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5151522708782753029', time=2024-09-12T19:46:13.948316+0000, chain.objs.size()=1 2024-09-12T18:13:48.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.852+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.f6atThyKynkVYx04jRy9_7sW56N-sz6_0 2024-09-12T18:13:48.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.852+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14117884388949902902', time=2024-09-12T19:46:14.075406+0000, chain.objs.size()=1 2024-09-12T18:13:48.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.852+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.OMKs-xTpaRLpSfEIdBoNhaWz2RXutaq_0 2024-09-12T18:13:48.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.854+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11758418442672752845', time=2024-09-12T19:46:14.348393+0000, chain.objs.size()=1 2024-09-12T18:13:48.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.854+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.KP1n5USR-KSplwxdeKnh_ZlsKn__X4I_0 2024-09-12T18:13:48.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.854+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17138695685031152813', time=2024-09-12T19:46:14.729423+0000, chain.objs.size()=1 2024-09-12T18:13:48.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.854+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.UHk5fLNjKNmmf5QqylJuLV2VpXwDEWh_0 2024-09-12T18:13:48.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.854+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8127779570295338179', time=2024-09-12T19:46:15.098067+0000, chain.objs.size()=1 2024-09-12T18:13:48.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.854+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.br15u1Lh0W_eoUfYkZAm9XE5aY0S3YT_0 2024-09-12T18:13:48.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.854+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10913785763159246638', time=2024-09-12T19:46:15.377130+0000, chain.objs.size()=1 2024-09-12T18:13:48.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.854+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.VZ_n01LftjdaTHy1HyBRo2CSLJpavYS_0 2024-09-12T18:13:48.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.854+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15944384482376529681', time=2024-09-12T19:46:15.399175+0000, chain.objs.size()=1 2024-09-12T18:13:48.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.854+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.3AonKm6zWrF_dljbrQtqp5J2R3cMyc-_0 2024-09-12T18:13:48.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.854+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12989998781246338473', time=2024-09-12T19:46:15.612616+0000, chain.objs.size()=1 2024-09-12T18:13:48.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.854+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.FsruzfL6svsjDm643Dlrag9LCnMidoF_0 2024-09-12T18:13:48.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.854+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15112140041481990878', time=2024-09-12T19:46:15.768845+0000, chain.objs.size()=1 2024-09-12T18:13:48.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.854+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.dy6BMrgjkP8o8aUEcSEmIr3tQVImVh0_0 2024-09-12T18:13:48.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.855+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9270166101793660424', time=2024-09-12T19:46:16.738874+0000, chain.objs.size()=1 2024-09-12T18:13:48.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.855+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.UGrA9cur1cPcv6Kd4RISWvGboq_YnOR_0 2024-09-12T18:13:48.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.855+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9302367630568310990', time=2024-09-12T19:46:16.838080+0000, chain.objs.size()=1 2024-09-12T18:13:48.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.855+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.qada47yomHKGr_HSHXKTAfbRGdZynYF_0 2024-09-12T18:13:48.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.855+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.535578946434388102', time=2024-09-12T19:46:17.927451+0000, chain.objs.size()=1 2024-09-12T18:13:48.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.855+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.u4FNTR2BpQlZ64StHoJM4BrnnJpbFoX_0 2024-09-12T18:13:48.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.855+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1733060866935570169', time=2024-09-12T19:46:18.062320+0000, chain.objs.size()=1 2024-09-12T18:13:48.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.855+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.hgyMzLMlqLWjB_yLDZtX-wc5o5UGxt8_0 2024-09-12T18:13:48.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.855+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15300889654558946506', time=2024-09-12T19:46:18.447978+0000, chain.objs.size()=1 2024-09-12T18:13:48.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.855+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.8rH-zPvO2avZ1vxAKZdxvLL-kdbYUzE_0 2024-09-12T18:13:48.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.855+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15586868669216704600', time=2024-09-12T19:46:18.754196+0000, chain.objs.size()=1 2024-09-12T18:13:48.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.855+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.PB3yWr7nis5RHoYcd9ezDdnRrAzC11u_0 2024-09-12T18:13:48.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.856+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2521000183031534340', time=2024-09-12T19:46:18.837500+0000, chain.objs.size()=1 2024-09-12T18:13:48.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.856+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.NbF8caMg_WumwvvD4xsuTGEDa4uQGic_0 2024-09-12T18:13:48.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.856+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1177851219424014777', time=2024-09-12T19:46:19.121601+0000, chain.objs.size()=1 2024-09-12T18:13:48.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.856+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.iKWKf6KDGn6Acu-NxFNQYs9DNf2XPYY_0 2024-09-12T18:13:48.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.857+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11015798595296882385', time=2024-09-12T19:46:50.404062+0000, chain.objs.size()=1 2024-09-12T18:13:48.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.857+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.294__shadow_.-hSm1Nj6j27ltcmkf34LF4IKYPTIYIu_0 2024-09-12T18:13:48.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.857+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9039364089745961158', time=2024-09-12T19:46:59.718267+0000, chain.objs.size()=1 2024-09-12T18:13:48.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.857+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.304__shadow_.C50exMy0Rw34jQz7eDIrmcj5Opq4dqs_0 2024-09-12T18:13:48.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.857+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.379103482007418494', time=2024-09-12T19:47:59.491604+0000, chain.objs.size()=1 2024-09-12T18:13:48.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.857+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.EszMyahX9kmuxZev6Pz0lIv3J6PyL3e_0 2024-09-12T18:13:48.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.857+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12318044970331286695', time=2024-09-12T19:47:59.492199+0000, chain.objs.size()=1 2024-09-12T18:13:48.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.857+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.-56zXU8KExKJdrQe1qyRkEtQ7Orszlp_0 2024-09-12T18:13:48.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.857+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4894621683490572135', time=2024-09-12T19:47:59.597117+0000, chain.objs.size()=1 2024-09-12T18:13:48.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.857+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.vAQLzCcMegd39VQ_c6LWRnCZwOEjqDk_0 2024-09-12T18:13:48.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.857+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.812598657921706900', time=2024-09-12T19:47:59.760360+0000, chain.objs.size()=1 2024-09-12T18:13:48.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.857+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.20YdOml8pvqN3lS6En-ta1l2HVROOLI_0 2024-09-12T18:13:48.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.857+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12259213278435044974', time=2024-09-12T19:48:00.087066+0000, chain.objs.size()=1 2024-09-12T18:13:48.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.857+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.eI99wwxJ9NOIBLQSg19SsOp1ymsZf9q_0 2024-09-12T18:13:48.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.857+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3205719844750241748', time=2024-09-12T19:48:00.330833+0000, chain.objs.size()=1 2024-09-12T18:13:48.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.857+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.iWk2zUVEma8_NILG5g8VjCZ62C4J5Z__0 2024-09-12T18:13:48.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.858+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18397558073373857270', time=2024-09-12T19:48:00.464671+0000, chain.objs.size()=1 2024-09-12T18:13:48.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.858+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.zD4Lod8e5SlPjV7hjqa68O6loltkmAc_0 2024-09-12T18:13:48.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.858+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12056819068106534769', time=2024-09-12T19:48:01.152138+0000, chain.objs.size()=1 2024-09-12T18:13:48.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.858+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Ro8gXrGnaBAlvZEqdBQnYsGa-FQRyK5_0 2024-09-12T18:13:48.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.858+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5195854559224448440', time=2024-09-12T19:48:01.457221+0000, chain.objs.size()=1 2024-09-12T18:13:48.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.858+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ls9S7_fu1HWtoWfBh7qOaszqDa2sWgs_0 2024-09-12T18:13:48.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.859+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5710630299399287176', time=2024-09-12T19:48:01.713835+0000, chain.objs.size()=1 2024-09-12T18:13:48.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.859+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.b0_W927GxFrJWDtOwjkCJidY1_uhK6p_0 2024-09-12T18:13:48.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.859+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3414094395013132008', time=2024-09-12T19:48:01.714332+0000, chain.objs.size()=1 2024-09-12T18:13:48.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.859+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.-UUu-s6gU5aD5xih8f-MKhsqVYpKwAP_0 2024-09-12T18:13:48.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.859+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5737394569629150469', time=2024-09-12T19:48:01.750887+0000, chain.objs.size()=1 2024-09-12T18:13:48.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.859+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.-Y44TGelsL45Ry4R5Gr9CE-dyD0nc70_0 2024-09-12T18:13:48.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.859+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12992171957214888989', time=2024-09-12T19:48:01.972134+0000, chain.objs.size()=1 2024-09-12T18:13:48.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.859+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.z98rHYpua1SdDIZHt2BZgIWwP9IZsrF_0 2024-09-12T18:13:48.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.859+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3840559599344060778', time=2024-09-12T19:48:01.973376+0000, chain.objs.size()=1 2024-09-12T18:13:48.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.859+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.UUKGWPnzJfrFB3TVxAZiMlSO-ftfhq6_0 2024-09-12T18:13:48.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.859+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13973731509758051582', time=2024-09-12T19:48:02.694145+0000, chain.objs.size()=1 2024-09-12T18:13:48.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.859+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.5jrU8vAef0bhB4IJo4AQA0YmV5YrU5H_0 2024-09-12T18:13:48.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.859+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1928408711662262536', time=2024-09-12T19:48:02.948140+0000, chain.objs.size()=1 2024-09-12T18:13:48.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.859+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.M4Lj2dmiZKwqBQHdxNo_DAgs9nAdKvV_0 2024-09-12T18:13:48.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.859+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15592828206314196444', time=2024-09-12T19:48:03.236657+0000, chain.objs.size()=1 2024-09-12T18:13:48.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.859+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.MDuC46j9dfZE-B_YZXamVqpM0rPg4jp_0 2024-09-12T18:13:48.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.860+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2822822066599708091', time=2024-09-12T19:48:03.324166+0000, chain.objs.size()=1 2024-09-12T18:13:48.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.860+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.U9oBEcfH-vw0v3yR-HTVthYgy3UlLyd_0 2024-09-12T18:13:48.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.861+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14572889839942942248', time=2024-09-12T19:48:03.942475+0000, chain.objs.size()=1 2024-09-12T18:13:48.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.861+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Zy-8nGEy7krHXAUJHUJR2A2cZz6ttc-_0 2024-09-12T18:13:48.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.861+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7225229892343588771', time=2024-09-12T19:48:04.354627+0000, chain.objs.size()=1 2024-09-12T18:13:48.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.861+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.0XdJspguB90BxQK5To4Qq7HITC7DtrX_0 2024-09-12T18:13:48.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.861+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16555335463404719119', time=2024-09-12T19:48:04.355138+0000, chain.objs.size()=1 2024-09-12T18:13:48.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.861+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.SB8ryZKaZtiav9L3UV0z2-DXp5e9Bmo_0 2024-09-12T18:13:48.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.861+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15948962747182551089', time=2024-09-12T19:48:04.509578+0000, chain.objs.size()=1 2024-09-12T18:13:48.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.861+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.S0r0TGqR0yBxAWMo-biXTUSRS_crzQv_0 2024-09-12T18:13:48.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.861+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1654436361300464641', time=2024-09-12T19:48:04.908507+0000, chain.objs.size()=1 2024-09-12T18:13:48.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.861+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.yRTYkv243WqIyWl2w9PMMM-qA1zH3AB_0 2024-09-12T18:13:48.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.861+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10173681918724260420', time=2024-09-12T19:48:06.686056+0000, chain.objs.size()=1 2024-09-12T18:13:48.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.861+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.qH5kEuhCPXJUpae6zIas-iHV_OQy348_0 2024-09-12T18:13:48.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.861+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5985134815405875254', time=2024-09-12T19:48:07.216843+0000, chain.objs.size()=1 2024-09-12T18:13:48.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.861+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.zClsrmFy1ssoVPMdTRJ5rV83pxMmPhv_0 2024-09-12T18:13:48.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.862+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12244313701246177244', time=2024-09-12T19:48:08.885447+0000, chain.objs.size()=1 2024-09-12T18:13:48.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.862+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.vZUr-7dhxmD4AJFt4RISn6bwohKEZyL_0 2024-09-12T18:13:48.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.862+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16768780955880108012', time=2024-09-12T19:48:08.886012+0000, chain.objs.size()=1 2024-09-12T18:13:48.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.862+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.mDmRHwE90bSEUbqJO7OF84vPoFYUYb2_0 2024-09-12T18:13:48.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.862+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8631164482731639879', time=2024-09-12T19:48:09.585337+0000, chain.objs.size()=1 2024-09-12T18:13:48.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.862+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.m7IOsnLqqu1t5ChH3vWfqerjYO1EDi6_0 2024-09-12T18:13:48.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.863+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4254926593582218412', time=2024-09-12T19:48:09.645612+0000, chain.objs.size()=1 2024-09-12T18:13:48.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.863+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.auCWBHlOstRjPL8uvhIg9xZehNMprKX_0 2024-09-12T18:13:48.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.863+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11218498931815001352', time=2024-09-12T19:48:47.564887+0000, chain.objs.size()=1 2024-09-12T18:13:48.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.863+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.j0l6RSiy-pQZ7hPEDNQ43Dm-sriOUB0_0 2024-09-12T18:13:48.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.863+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4604488286256190778', time=2024-09-12T19:48:49.294460+0000, chain.objs.size()=1 2024-09-12T18:13:48.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.863+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.lB0J6OQ-6rAjMEn6KVhMGBhV4BB4AXg_0 2024-09-12T18:13:48.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.863+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6713599830160026990', time=2024-09-12T19:48:49.298906+0000, chain.objs.size()=1 2024-09-12T18:13:48.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.863+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.U4snh7UZnye2lp4kTRf65zIGyk6lNfA_0 2024-09-12T18:13:48.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.863+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10227136321025864893', time=2024-09-12T19:48:50.478789+0000, chain.objs.size()=1 2024-09-12T18:13:48.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.863+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.E209OR6L-a-VxfaDmuKiBX-5u4M1jCj_0 2024-09-12T18:13:48.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.863+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11771374257071496755', time=2024-09-12T19:48:50.503955+0000, chain.objs.size()=1 2024-09-12T18:13:48.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.863+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.5C2jSamWEyewUR5W0ZDvhtosfTmiGxz_0 2024-09-12T18:13:48.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.863+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7919663269846923887', time=2024-09-12T19:48:50.637763+0000, chain.objs.size()=1 2024-09-12T18:13:48.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.863+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Gm1gNX4knOL-K78AQNstaOSMg2VQXGH_0 2024-09-12T18:13:48.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.863+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1200859511361362592', time=2024-09-12T19:48:50.910707+0000, chain.objs.size()=1 2024-09-12T18:13:48.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.863+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Ixxdk8G437mIrC514wiJzHtpFnLbqQW_0 2024-09-12T18:13:48.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.863+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17690169695374466737', time=2024-09-12T19:48:51.276160+0000, chain.objs.size()=1 2024-09-12T18:13:48.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.863+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.dAbdLpLLl0kPTtCKem-5IV4U9RIUIKl_0 2024-09-12T18:13:48.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.863+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13283234884987865030', time=2024-09-12T19:48:51.454924+0000, chain.objs.size()=1 2024-09-12T18:13:48.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.863+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ub7kmZh1CpC5F_-Aw4r4DNM4-k8Lg6l_0 2024-09-12T18:13:48.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.863+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13907469191413918115', time=2024-09-12T19:48:53.664470+0000, chain.objs.size()=1 2024-09-12T18:13:48.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.863+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.CBk4tjpgIm7G7-g2EWNKBkoObfadyKt_0 2024-09-12T18:13:48.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.866+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15293671491068372315', time=2024-09-12T19:48:54.167896+0000, chain.objs.size()=1 2024-09-12T18:13:48.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.866+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.35Z5xDeFPZovkfY7Iusd39U0TI0UZj5_0 2024-09-12T18:13:48.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.866+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4428839901276153049', time=2024-09-12T19:48:55.245497+0000, chain.objs.size()=1 2024-09-12T18:13:48.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.866+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.miZ4pP53fDbA1Z8QPFQ5Ogyovhkl7sB_0 2024-09-12T18:13:48.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.866+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14392746964149554641', time=2024-09-12T19:48:55.516358+0000, chain.objs.size()=1 2024-09-12T18:13:48.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.866+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.2KxvnN8Lbg5hwnaon5IlHWJiivaX9XT_0 2024-09-12T18:13:48.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.866+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5949686134948559383', time=2024-09-12T19:48:55.532827+0000, chain.objs.size()=1 2024-09-12T18:13:48.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.866+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.-Rkp6gnqsOvZZRVCbArhjVBv0_yMDWw_0 2024-09-12T18:13:48.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.866+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2846422553262008798', time=2024-09-12T19:48:55.957833+0000, chain.objs.size()=1 2024-09-12T18:13:48.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.866+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.M6ucCQl48z8nvRxr7p0QLgZ_2kPP-Ei_0 2024-09-12T18:13:48.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.867+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16465465298914249320', time=2024-09-12T19:48:56.075395+0000, chain.objs.size()=1 2024-09-12T18:13:48.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.867+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.iU6mwleLQaQYPl1UkfXJ-ezazlW_NVx_0 2024-09-12T18:13:48.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.867+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1863564181707302317', time=2024-09-12T19:48:56.101243+0000, chain.objs.size()=1 2024-09-12T18:13:48.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.867+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.wwW1mi11Pw650px2P57HQ67GTUm2G7N_0 2024-09-12T18:13:48.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.867+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10129068329108100515', time=2024-09-12T19:48:56.258638+0000, chain.objs.size()=1 2024-09-12T18:13:48.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.867+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.lLHexK-kL59E4nuVp9piAbj61cWHWUV_0 2024-09-12T18:13:48.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.867+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9628392043960832604', time=2024-09-12T19:48:56.358424+0000, chain.objs.size()=1 2024-09-12T18:13:48.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.867+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.cWBhiE40JohEN0CGHotwxPGEwtqL0Lv_0 2024-09-12T18:13:48.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.867+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14694746087372632647', time=2024-09-12T19:48:56.775570+0000, chain.objs.size()=1 2024-09-12T18:13:48.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.867+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ccjWmbhOsP-Pai8WTg17x-sF0nj87A__0 2024-09-12T18:13:48.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.867+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14350359636713143412', time=2024-09-12T19:48:56.776275+0000, chain.objs.size()=1 2024-09-12T18:13:48.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.867+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.K4wvxBwR-rGgU8jTKbrMR2m4zS4botm_0 2024-09-12T18:13:48.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.867+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18330762814137286893', time=2024-09-12T19:48:56.860476+0000, chain.objs.size()=1 2024-09-12T18:13:48.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.867+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.L78eVgWqzTgGsY6mxT6SAp7rxeE9xEi_0 2024-09-12T18:13:48.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.868+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2964797290137080743', time=2024-09-12T19:48:56.877396+0000, chain.objs.size()=1 2024-09-12T18:13:48.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.868+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.NALjRdooysl3tNIzuds2aVM7z0MZpNA_0 2024-09-12T18:13:48.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.868+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13352337541118815682', time=2024-09-12T19:48:57.237881+0000, chain.objs.size()=1 2024-09-12T18:13:48.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.868+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.OinOswOvF8MugRypzTRaTA13edGmi_b_0 2024-09-12T18:13:48.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.868+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15311611018358697645', time=2024-09-12T19:48:57.271993+0000, chain.objs.size()=1 2024-09-12T18:13:48.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.868+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.dy83EvsNWPx4w6mRqjGVR0SSUzFGuZV_0 2024-09-12T18:13:48.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.868+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17564203172880007661', time=2024-09-12T19:48:57.376631+0000, chain.objs.size()=1 2024-09-12T18:13:48.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.868+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.BNzbRHKJYcSNJoXrwz-MG1LxXvith4-_0 2024-09-12T18:13:48.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.869+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3280654968229362975', time=2024-09-12T19:48:57.468551+0000, chain.objs.size()=1 2024-09-12T18:13:48.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.869+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.BP2RsWbjndxZ9_AZ1Z6K0pTrvG5fRVP_0 2024-09-12T18:13:48.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.869+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2908374187504065110', time=2024-09-12T19:48:57.862751+0000, chain.objs.size()=1 2024-09-12T18:13:48.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.869+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.4rpnRnJuwU-C4GE0nIKOgb7UUeo4J6Q_0 2024-09-12T18:13:48.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.869+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17796887140507292953', time=2024-09-12T19:48:57.886779+0000, chain.objs.size()=1 2024-09-12T18:13:48.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.869+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.wzCXbF8MiwJfGgq2gm1mdRCCwRpFTeD_0 2024-09-12T18:13:48.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.869+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9279322380148167045', time=2024-09-12T19:50:30.193371+0000, chain.objs.size()=1 2024-09-12T18:13:48.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.869+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.432__shadow_.Uhycpm36H-gsRt2rgiHsnruMv9Kw1m0_0 2024-09-12T18:13:48.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.869+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10187998956350211946', time=2024-09-12T19:50:53.812723+0000, chain.objs.size()=1 2024-09-12T18:13:48.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.869+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.456__shadow_.pVyw-iEThN8iAGUeDStwYmve3cD_CB4_0 2024-09-12T18:13:48.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.873+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/44687 2024-09-12T18:13:48.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.876+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T18:13:48.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.876+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17173925258164749547', time=2024-09-12T19:51:05.691602+0000, chain.objs.size()=1 2024-09-12T18:13:48.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.876+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.465__shadow_.e8ozBfnuId00QseMmWCbY56pjTOtoNF_0 2024-09-12T18:13:48.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.876+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.913271114766515949', time=2024-09-12T19:51:06.937976+0000, chain.objs.size()=1 2024-09-12T18:13:48.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.876+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.466__shadow_.gQEG6bJTUkgqeSs5XrMgQbYPbcxc-8w_0 2024-09-12T18:13:48.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.876+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16835153367982464977', time=2024-09-12T19:51:36.873279+0000, chain.objs.size()=1 2024-09-12T18:13:48.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.876+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.501__shadow_.Moo9oFeu-PrLzr59Zfb5MPjXzt1wrb1_0 2024-09-12T18:13:48.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.876+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~rgUCp4FIlsKKjAhIPDiWk5ntOh0NSYF', time=2024-09-12T19:55:49.446355+0000, chain.objs.size()=10 2024-09-12T18:13:48.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.876+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.527__multipart_mymultipart.2~rgUCp4FIlsKKjAhIPDiWk5ntOh0NSYF.1 2024-09-12T18:13:48.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.876+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.527__multipart_mymultipart.2~rgUCp4FIlsKKjAhIPDiWk5ntOh0NSYF.2 2024-09-12T18:13:48.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.876+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.527__multipart_mymultipart.2~rgUCp4FIlsKKjAhIPDiWk5ntOh0NSYF.3 2024-09-12T18:13:48.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.876+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.527__multipart_mymultipart.2~rgUCp4FIlsKKjAhIPDiWk5ntOh0NSYF.4 2024-09-12T18:13:48.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.876+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.527__multipart_mymultipart.2~rgUCp4FIlsKKjAhIPDiWk5ntOh0NSYF.5 2024-09-12T18:13:48.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.876+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.527__multipart_mymultipart.2~rgUCp4FIlsKKjAhIPDiWk5ntOh0NSYF.6 2024-09-12T18:13:48.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.876+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.527__multipart_mymultipart.2~rgUCp4FIlsKKjAhIPDiWk5ntOh0NSYF.7 2024-09-12T18:13:48.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.876+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.527__multipart_mymultipart.2~rgUCp4FIlsKKjAhIPDiWk5ntOh0NSYF.8 2024-09-12T18:13:48.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.876+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.527__multipart_mymultipart.2~rgUCp4FIlsKKjAhIPDiWk5ntOh0NSYF.9 2024-09-12T18:13:48.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.878+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.527__multipart_mymultipart.2~rgUCp4FIlsKKjAhIPDiWk5ntOh0NSYF.10 2024-09-12T18:13:48.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.878+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9966051629840900435', time=2024-09-12T19:57:09.958295+0000, chain.objs.size()=1 2024-09-12T18:13:48.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.878+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.553__shadow_.ASqG7oBd6xrehDlggZGNgrEX6YtSxNu_0 2024-09-12T18:13:48.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.878+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2769427268173193439', time=2024-09-12T19:57:51.439490+0000, chain.objs.size()=2 2024-09-12T18:13:48.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.878+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.564__shadow_.52S8EGR0AIHJZxkr40TlbHmFa4L_ekV_0 2024-09-12T18:13:48.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.878+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.564__shadow_.52S8EGR0AIHJZxkr40TlbHmFa4L_ekV_1 2024-09-12T18:13:48.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.880+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17235214407844509018', time=2024-09-12T19:58:41.216569+0000, chain.objs.size()=1 2024-09-12T18:13:48.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.880+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:ythMggfdIhH9FxJFQZ4RlV4pNUD8cFu_.s9kyLPafZvp6HQPMQpkWhjEIcOmTTyC_0 2024-09-12T18:13:48.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.880+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5214811838519528566', time=2024-09-12T19:58:45.509036+0000, chain.objs.size()=1 2024-09-12T18:13:48.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.880+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:PxkxNjkVAnVWwCaisnZWUS98WLaO7B4_.5C5ZaMssbpD7gmEaEtvabbYrM98jeHn_0 2024-09-12T18:13:48.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.880+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4486450393417207307', time=2024-09-12T19:59:30.003036+0000, chain.objs.size()=1 2024-09-12T18:13:48.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.880+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.580__shadow:fq5ht3b3tsnpqtrKt-ytPhu6fikx2Nm_.0s6d8d5g2jrXTStBTFVBNVc34o_tTEa_0 2024-09-12T18:13:48.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.880+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15296664428089896033', time=2024-09-12T19:59:33.438776+0000, chain.objs.size()=1 2024-09-12T18:13:48.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.880+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.583__shadow:EnbR6ineaFv7MjHbaSoFUtVjRIBBUNg_.a7ClRgSDFos5In1aiFZLGtlcocqswXq_0 2024-09-12T18:13:48.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.880+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16363598838260006406', time=2024-09-12T20:04:55.937177+0000, chain.objs.size()=1 2024-09-12T18:13:48.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.880+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.632__shadow_.SR6V4Ouq8xFj-zu0g6kDBAAaCfI0YTy_0 2024-09-12T18:13:48.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.880+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1185411840516844778', time=2024-09-12T20:05:33.859511+0000, chain.objs.size()=1 2024-09-12T18:13:48.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.880+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.656__shadow_.NmZo-pTNy2JeYkaX8kUG3N-CqvHkcMw_0 2024-09-12T18:13:48.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.880+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13802261355347117261', time=2024-09-12T20:06:07.027968+0000, chain.objs.size()=1 2024-09-12T18:13:48.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.880+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.669__shadow_.pDp-uLRNlRI1WKMGcaFlF5zAB-iKF36_0 2024-09-12T18:13:48.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.880+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7962695068611815387', time=2024-09-12T20:06:27.626715+0000, chain.objs.size()=1 2024-09-12T18:13:48.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.880+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.697__shadow:LWRG0Iga9Pg.MR4ok5fqBywrgatM2bW_.Ln04V-7N0ow9_Xj0aGTwxOarttUQl-B_0 2024-09-12T18:13:48.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.885+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:48.964 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-12T18:13:48.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.888+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:13:48.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.889+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:48.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.890+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:48.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.891+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49423' 2024-09-12T18:13:48.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.891+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='_XBXDBBcpIH25QDNhmX5BVDNUeflQLr8', time=2024-09-12T19:42:01.633187+0000, chain.objs.size()=3 2024-09-12T18:13:48.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.891+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__shadow_.5Fe2L3qQqjXO4UUKcoK1-v1u0f-Khv4_0 2024-09-12T18:13:48.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.891+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__shadow_.5Fe2L3qQqjXO4UUKcoK1-v1u0f-Khv4_1 2024-09-12T18:13:48.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.891+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__shadow_.5Fe2L3qQqjXO4UUKcoK1-v1u0f-Khv4_2 2024-09-12T18:13:48.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.891+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16733417559108282130', time=2024-09-12T19:45:00.938509+0000, chain.objs.size()=1 2024-09-12T18:13:48.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.891+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.231__shadow_.hK5kaEn0Sq2DPXrxbIvpXnMPb4M-flr_0 2024-09-12T18:13:48.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.891+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2420833342283415035', time=2024-09-12T19:45:03.671752+0000, chain.objs.size()=1 2024-09-12T18:13:48.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.891+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.234__shadow_.SKtyxvlNxNr6NP_2bzRn4fa3h7KWUgh_0 2024-09-12T18:13:48.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.891+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2706643904858139356', time=2024-09-12T19:45:06.449921+0000, chain.objs.size()=1 2024-09-12T18:13:48.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.891+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.237__shadow_.LOX-G2pwGh_Ov8EcxDnwpZaisbfDgTE_0 2024-09-12T18:13:48.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.891+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14721181577430625287', time=2024-09-12T19:45:17.246150+0000, chain.objs.size()=1 2024-09-12T18:13:48.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.891+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.246__shadow_.rV9Pfz5w7Ad7WI2zE76oh8SkJNmAKo3_0 2024-09-12T18:13:48.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.891+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1726406984959060776', time=2024-09-12T19:45:21.831847+0000, chain.objs.size()=1 2024-09-12T18:13:48.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.891+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.251__shadow_.CP0-GU8qsfqaXYOh387sRphFt6BqKnn_0 2024-09-12T18:13:48.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.891+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8582044309727079253', time=2024-09-12T19:45:25.489296+0000, chain.objs.size()=1 2024-09-12T18:13:48.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.891+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.255__shadow_.WCzEaQtpm9r6yTNQQA2a4E6gyZg3mwa_0 2024-09-12T18:13:48.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.891+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4743026486858346131', time=2024-09-12T19:46:08.780350+0000, chain.objs.size()=1 2024-09-12T18:13:48.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.891+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.72vWosspA1mYsWrPYkgRld9-rzXUMKi_0 2024-09-12T18:13:48.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.891+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12898113209055598256', time=2024-09-12T19:46:08.781036+0000, chain.objs.size()=1 2024-09-12T18:13:48.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.891+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.DrgwqFn1jjorZvhOFRZxXlr186j2-sh_0 2024-09-12T18:13:48.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.891+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4641012196567902797', time=2024-09-12T19:46:09.610295+0000, chain.objs.size()=1 2024-09-12T18:13:48.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.891+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.t2x4EZKFJpgSZE_zeiMHtUxxwPq4suH_0 2024-09-12T18:13:48.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.895+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2459970906676610111', time=2024-09-12T19:46:09.745569+0000, chain.objs.size()=1 2024-09-12T18:13:48.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.895+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Wg4utekfzeTptsYLiswzaZsCx0K2DjR_0 2024-09-12T18:13:48.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.895+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15161694956625774083', time=2024-09-12T19:46:10.512368+0000, chain.objs.size()=1 2024-09-12T18:13:48.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.895+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.2TZfhC3eKL9M1n2WOm5_RVc-xoy9G8e_0 2024-09-12T18:13:48.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.895+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16153761249625897735', time=2024-09-12T19:46:10.524888+0000, chain.objs.size()=1 2024-09-12T18:13:48.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.895+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.BfxPeCmx_mHyv6p2BwEBPYcMYegVl-U_0 2024-09-12T18:13:48.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.895+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1955428996158663836', time=2024-09-12T19:46:10.651358+0000, chain.objs.size()=1 2024-09-12T18:13:48.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.895+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.IoIzgYJ8YGD9rKYXe-GhCxDZ2uRsPlr_0 2024-09-12T18:13:48.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.895+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17015764967962260241', time=2024-09-12T19:46:12.501667+0000, chain.objs.size()=1 2024-09-12T18:13:48.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.895+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.--c699177H5bDYVA4B09lhjfh75YiBF_0 2024-09-12T18:13:48.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.895+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12017302877908454457', time=2024-09-12T19:46:12.507206+0000, chain.objs.size()=1 2024-09-12T18:13:48.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.895+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.C1p20fj8sWpfaLWxWZpHHdJjWlYgMu5_0 2024-09-12T18:13:48.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.895+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1235727995178756482', time=2024-09-12T19:46:12.816977+0000, chain.objs.size()=1 2024-09-12T18:13:48.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.895+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.gLjWoaSwRmG08EeEo_gN2HqVAZBzpZB_0 2024-09-12T18:13:48.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.895+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3776231738670621894', time=2024-09-12T19:46:12.831083+0000, chain.objs.size()=1 2024-09-12T18:13:48.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.895+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.KOkDqyKdKGuFktyO84_AxLxPpKZ44P4_0 2024-09-12T18:13:48.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.895+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17401752874709819490', time=2024-09-12T19:46:13.391781+0000, chain.objs.size()=1 2024-09-12T18:13:48.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.895+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.t4FnD7L5cgBgdSe5_4mF-2PSsUUO4XY_0 2024-09-12T18:13:48.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.895+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9716823003040128192', time=2024-09-12T19:46:13.493545+0000, chain.objs.size()=1 2024-09-12T18:13:48.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.895+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.YVdJoz2GPoB2Z8tUxSYLs7Xe867MCCL_0 2024-09-12T18:13:48.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.895+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8931384515646813752', time=2024-09-12T19:46:13.902614+0000, chain.objs.size()=1 2024-09-12T18:13:48.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.895+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.XTnKzETWlJrUvU1zkmVAXC4GPcPH2Pq_0 2024-09-12T18:13:48.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.898+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2241624410142086640', time=2024-09-12T19:46:14.004221+0000, chain.objs.size()=1 2024-09-12T18:13:48.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.898+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.PlW3WuPWW897B0bhNwdE40fiv9IoO84_0 2024-09-12T18:13:48.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.898+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3865006022942356304', time=2024-09-12T19:46:14.216067+0000, chain.objs.size()=1 2024-09-12T18:13:48.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.898+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.L0O7waYbTmsT8oEKQ6UmW1VNzKYMwUx_0 2024-09-12T18:13:48.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.898+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17899313568347190588', time=2024-09-12T19:46:14.284455+0000, chain.objs.size()=1 2024-09-12T18:13:48.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.898+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.dsJM19O2SNoQRVVLYrMFqF9PIVc5UYa_0 2024-09-12T18:13:48.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.898+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15281228265700305846', time=2024-09-12T19:46:14.839870+0000, chain.objs.size()=1 2024-09-12T18:13:48.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.898+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.uIbvlQjQmfl9WTM6C25d9Hua4Za76ha_0 2024-09-12T18:13:48.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.898+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1350088744466854105', time=2024-09-12T19:46:15.063070+0000, chain.objs.size()=1 2024-09-12T18:13:48.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.898+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.RT-ApNDmS-Bg3GnSY52ogcTT11Wpfsi_0 2024-09-12T18:13:48.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.898+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9924833120328627093', time=2024-09-12T19:46:15.404017+0000, chain.objs.size()=1 2024-09-12T18:13:48.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.898+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.g652LIAm-tLSUmYo4X36B7-uZtOJnzc_0 2024-09-12T18:13:48.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.898+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18366937899507883150', time=2024-09-12T19:46:16.162473+0000, chain.objs.size()=1 2024-09-12T18:13:48.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.898+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.4oiFJwoORCaTAOKFk2RE8lGJhokgFNe_0 2024-09-12T18:13:48.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.898+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.956022243812185355', time=2024-09-12T19:46:16.638168+0000, chain.objs.size()=1 2024-09-12T18:13:48.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.898+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.NHQjevab9qF_1xf6WhFhZfFe32HqrbW_0 2024-09-12T18:13:48.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.898+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1145778229288978526', time=2024-09-12T19:46:16.795811+0000, chain.objs.size()=1 2024-09-12T18:13:48.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.898+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.FPGolvb8G7nxMmnbEgqhkPGOOQeSqqo_0 2024-09-12T18:13:48.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.898+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17699284563477738159', time=2024-09-12T19:46:17.046393+0000, chain.objs.size()=1 2024-09-12T18:13:48.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.898+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.cNhFsZYYw25B7dzpRtix96ZKID_Oq-V_0 2024-09-12T18:13:48.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.898+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7852407938703270990', time=2024-09-12T19:46:17.648924+0000, chain.objs.size()=1 2024-09-12T18:13:48.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.898+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.HpPwdQZt0A7_kPHeuYPU3SKAcMSl2FW_0 2024-09-12T18:13:48.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.901+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8126575488266261579', time=2024-09-12T19:46:17.939049+0000, chain.objs.size()=1 2024-09-12T18:13:48.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.901+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.zxMGLyayuCNIzLprdBfORu8Be4bXJpJ_0 2024-09-12T18:13:48.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.902+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12616088365507179816', time=2024-09-12T19:46:17.997716+0000, chain.objs.size()=1 2024-09-12T18:13:48.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.902+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.TFy0bntWvM0p3IHYYc_epNd2xiHnKgR_0 2024-09-12T18:13:48.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.902+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15099327175450917719', time=2024-09-12T19:46:18.063576+0000, chain.objs.size()=1 2024-09-12T18:13:48.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.902+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.mHRJeNCwzxN3COq-9SRBzjayF0ESt3__0 2024-09-12T18:13:48.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.902+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14180348066757504787', time=2024-09-12T19:46:18.241803+0000, chain.objs.size()=1 2024-09-12T18:13:48.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.902+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.2N4UUSHe0M19ixH9Zm43PCrJQ-bLIWs_0 2024-09-12T18:13:48.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.902+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15762148826589050519', time=2024-09-12T19:46:18.381844+0000, chain.objs.size()=1 2024-09-12T18:13:48.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.902+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.CrbtilrZrAEdUnLRe4Gig3R8ATVQk1T_0 2024-09-12T18:13:48.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.902+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.782799456298944668', time=2024-09-12T19:46:18.492593+0000, chain.objs.size()=1 2024-09-12T18:13:48.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.902+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.GwJQmDh5KS6NktPrcvOAnU5w__uGoSy_0 2024-09-12T18:13:48.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.902+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2619143446987676821', time=2024-09-12T19:46:21.360818+0000, chain.objs.size()=1 2024-09-12T18:13:48.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.902+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.265__shadow_.k70GYu3GWVzkQblJWeLThKqAts1OrLw_0 2024-09-12T18:13:48.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.902+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5500516952379492422', time=2024-09-12T19:46:35.548954+0000, chain.objs.size()=1 2024-09-12T18:13:48.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.902+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.281__shadow_.iTm2Xzs4-yaasp9YAOaeK2WJ39a56bv_0 2024-09-12T18:13:48.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.902+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11275547972847587866', time=2024-09-12T19:46:48.160663+0000, chain.objs.size()=1 2024-09-12T18:13:48.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.902+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.293__shadow_.ZRr89zBnphu6Z2B3zwuELyIrrgcVeH7_0 2024-09-12T18:13:48.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.902+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13284799732060559265', time=2024-09-12T19:46:48.231119+0000, chain.objs.size()=1 2024-09-12T18:13:48.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.902+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.293__shadow_.AfEbvEHa0dWd_NdHheLDX9B3cg4yPWZ_0 2024-09-12T18:13:48.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.902+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.975650945566414096', time=2024-09-12T19:46:48.232536+0000, chain.objs.size()=1 2024-09-12T18:13:48.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.902+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.293__shadow_.9h-oa_aWa9zLNw_H_KOMJOgDFuOSG1J_0 2024-09-12T18:13:48.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.904+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16621594489630658137', time=2024-09-12T19:46:50.298503+0000, chain.objs.size()=1 2024-09-12T18:13:48.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.904+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.294__shadow_.Ff1fqlVY-uFtZDKCsTO-qeol_2zg4Xt_0 2024-09-12T18:13:48.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.904+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17428494009917319420', time=2024-09-12T19:46:56.997218+0000, chain.objs.size()=1 2024-09-12T18:13:48.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.904+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.301__shadow_.tbAE7Yv07B9jxHnF6n7I41mHCLql-Uj_0 2024-09-12T18:13:48.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.905+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17307991314843235327', time=2024-09-12T19:46:57.000866+0000, chain.objs.size()=1 2024-09-12T18:13:48.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.905+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.301__shadow_.6dEuop45NbRQFiBXuh1QO3N_kkCt7e2_0 2024-09-12T18:13:48.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.905+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11653660383395879636', time=2024-09-12T19:47:59.576828+0000, chain.objs.size()=1 2024-09-12T18:13:48.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.905+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.p2RVLp6e_OyK9DddAONHfktw-V72tUD_0 2024-09-12T18:13:48.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.905+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7552422876697679371', time=2024-09-12T19:47:59.695393+0000, chain.objs.size()=1 2024-09-12T18:13:48.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.905+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.O1uppaiKnnguvL3Fv4P3UxS-z-LxE8j_0 2024-09-12T18:13:48.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.905+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9928826021608636602', time=2024-09-12T19:48:00.190769+0000, chain.objs.size()=1 2024-09-12T18:13:48.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.905+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.5GGnljjElVAVHR0JyKYoEY0f1roGxF2_0 2024-09-12T18:13:48.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.905+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8402507630361598098', time=2024-09-12T19:48:00.374644+0000, chain.objs.size()=1 2024-09-12T18:13:48.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.905+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.oITPD7Wcr4cYjqBnOo5ZkNpzLQfVAVP_0 2024-09-12T18:13:48.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.905+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17565081305142793856', time=2024-09-12T19:48:01.139517+0000, chain.objs.size()=1 2024-09-12T18:13:48.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.905+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.4yjKFt_5IgZHzyiwxxGUyXQI9cEK8n3_0 2024-09-12T18:13:48.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.905+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11488822204309333656', time=2024-09-12T19:48:01.309112+0000, chain.objs.size()=1 2024-09-12T18:13:48.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.905+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.rsBKaGaBMaoLDQupm6YDq64Phgt36SX_0 2024-09-12T18:13:48.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.905+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12599041844067794965', time=2024-09-12T19:48:01.524404+0000, chain.objs.size()=1 2024-09-12T18:13:48.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.905+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.908fbmMXmNk6M0m3yJhxROQav77blGV_0 2024-09-12T18:13:48.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.905+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11278788905368924477', time=2024-09-12T19:48:01.970169+0000, chain.objs.size()=1 2024-09-12T18:13:48.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.905+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.b96GetsB_HQ6F1PrYA_rKsOcfvVYFsI_0 2024-09-12T18:13:48.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.908+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13643052155055817388', time=2024-09-12T19:48:02.497396+0000, chain.objs.size()=1 2024-09-12T18:13:48.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.908+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.lNZbRcYDud1tzmXzzifcCKS9i6elz8A_0 2024-09-12T18:13:48.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.908+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2842418873677225682', time=2024-09-12T19:48:02.888128+0000, chain.objs.size()=1 2024-09-12T18:13:48.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.908+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.2_-5KBYxYXvGHT3L6RA_sMkTfHtwLAA_0 2024-09-12T18:13:48.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.908+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.512145582552357567', time=2024-09-12T19:48:03.036496+0000, chain.objs.size()=1 2024-09-12T18:13:48.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.908+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Ue4q8paSRxh2do1ZNg2fjdef8ugrscz_0 2024-09-12T18:13:48.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.908+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17576724535052073341', time=2024-09-12T19:48:03.228862+0000, chain.objs.size()=1 2024-09-12T18:13:48.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.908+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.iQH9Ub1XHee_3Wp-EUBu5vWB6S8osek_0 2024-09-12T18:13:48.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.908+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11075384291782209642', time=2024-09-12T19:48:03.308116+0000, chain.objs.size()=1 2024-09-12T18:13:48.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.908+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.31mT1WB5wTLyUfn6bSNaMvcaXgSTwgx_0 2024-09-12T18:13:48.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.908+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8769905952841673493', time=2024-09-12T19:48:03.375654+0000, chain.objs.size()=1 2024-09-12T18:13:48.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.908+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.nbM79Ti31NeU4v_CrI8iU5NJI1S_5XZ_0 2024-09-12T18:13:48.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.908+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2360083421377435664', time=2024-09-12T19:48:03.922472+0000, chain.objs.size()=1 2024-09-12T18:13:48.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.908+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.aqUVdRxCW9pb2TrJqm3KOMLvUTqNr3Q_0 2024-09-12T18:13:48.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.908+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2556965225677806767', time=2024-09-12T19:48:04.115576+0000, chain.objs.size()=1 2024-09-12T18:13:48.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.908+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.2Pnfc-I3QepXRlGZOEgtzrDsI7Y972d_0 2024-09-12T18:13:48.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.908+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12589709689721171744', time=2024-09-12T19:48:04.317529+0000, chain.objs.size()=1 2024-09-12T18:13:48.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.908+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.fs86qBQSEOK45XsVnS45snpU6zXNZ5q_0 2024-09-12T18:13:48.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.908+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8650492403424920987', time=2024-09-12T19:48:04.562529+0000, chain.objs.size()=1 2024-09-12T18:13:48.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.908+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.uE7SdvP88kwMrnDiecDguIEGsLxBvTf_0 2024-09-12T18:13:48.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.908+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1084949894551458313', time=2024-09-12T19:48:04.790557+0000, chain.objs.size()=1 2024-09-12T18:13:48.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.908+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.fjnGf38cgb894dYF66TU8HqkJochhsM_0 2024-09-12T18:13:48.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.911+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1931094206076416609', time=2024-09-12T19:48:05.307773+0000, chain.objs.size()=1 2024-09-12T18:13:48.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.911+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.SsAmxLtMNKav1Ad-TUx76BSsM_yGk93_0 2024-09-12T18:13:48.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.911+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9139763244945602356', time=2024-09-12T19:48:05.308874+0000, chain.objs.size()=1 2024-09-12T18:13:48.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.911+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.vODB6k8pEJuFJhE2-1XFuTeqMYd0424_0 2024-09-12T18:13:48.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.911+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14714163749962327366', time=2024-09-12T19:48:05.326872+0000, chain.objs.size()=1 2024-09-12T18:13:48.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.911+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.w4lLS0MLAW7Qq7eYkjHt2t-VAfJHVxI_0 2024-09-12T18:13:48.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.911+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2923813511014322113', time=2024-09-12T19:48:05.581664+0000, chain.objs.size()=1 2024-09-12T18:13:48.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.911+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_._CgzX-rmoj1_5U22dRym8wv1Bs4rZSS_0 2024-09-12T18:13:48.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.911+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17302327548688167879', time=2024-09-12T19:48:06.313833+0000, chain.objs.size()=1 2024-09-12T18:13:48.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.911+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.tgymawtkuEFOPRKS4OjPi_7G-tXS3jP_0 2024-09-12T18:13:48.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.911+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12868683779093370347', time=2024-09-12T19:48:06.683296+0000, chain.objs.size()=1 2024-09-12T18:13:48.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.911+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ir9S6MhBZygL99KAOF9wOZYWeyiCjt4_0 2024-09-12T18:13:48.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.911+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4357074980243465231', time=2024-09-12T19:48:07.102232+0000, chain.objs.size()=1 2024-09-12T18:13:48.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.911+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.igryHVp5bKNvCT7urdlSwLq_nrNkLGs_0 2024-09-12T18:13:48.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.911+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2935868528430482060', time=2024-09-12T19:48:07.997120+0000, chain.objs.size()=1 2024-09-12T18:13:48.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.911+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.vzdSsOsxohBzohCcva6dZ2RFRAMd5U-_0 2024-09-12T18:13:48.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.911+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16048605118927520569', time=2024-09-12T19:48:07.998265+0000, chain.objs.size()=1 2024-09-12T18:13:48.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.911+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.15Qv4woHKcK8nXiM4xgmMzCiGUT_8pA_0 2024-09-12T18:13:48.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.911+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1174800452362792222', time=2024-09-12T19:48:07.999436+0000, chain.objs.size()=1 2024-09-12T18:13:48.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.911+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.B1lhf9g72nfVVNxbJEkr4PK58YX3Ipt_0 2024-09-12T18:13:48.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.911+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7902977801216217373', time=2024-09-12T19:48:08.104157+0000, chain.objs.size()=1 2024-09-12T18:13:48.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.911+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Ia6xmFeMsyw0rmhsxCUyF2uIlasxqiZ_0 2024-09-12T18:13:48.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.914+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17251160730441747497', time=2024-09-12T19:48:08.397173+0000, chain.objs.size()=1 2024-09-12T18:13:48.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.914+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.vMPrQnG9ZEQiFErGPoXxQqcilp94cS9_0 2024-09-12T18:13:48.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.914+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17621277391207905147', time=2024-09-12T19:48:08.559023+0000, chain.objs.size()=1 2024-09-12T18:13:48.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.914+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.zGnQFp3DsxndtD9TEn-TPTQqBvMcS9t_0 2024-09-12T18:13:48.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.914+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15737727019788447732', time=2024-09-12T19:48:08.654125+0000, chain.objs.size()=1 2024-09-12T18:13:48.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.914+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.R9COhyblKygerMLuoQx9qBBlJAgadkX_0 2024-09-12T18:13:48.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.914+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9266946921304395444', time=2024-09-12T19:48:08.875327+0000, chain.objs.size()=1 2024-09-12T18:13:48.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.914+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.b0OVhQlOUfUtA2tk9-2lIN8hgidvz44_0 2024-09-12T18:13:48.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.914+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8192063353521979238', time=2024-09-12T19:48:09.604580+0000, chain.objs.size()=1 2024-09-12T18:13:48.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.914+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.oOi6rr13pF-0wbinX25psBu8fCTnFMU_0 2024-09-12T18:13:48.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.914+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2292971987796636938', time=2024-09-12T19:48:09.900380+0000, chain.objs.size()=1 2024-09-12T18:13:48.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.914+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.wypp7d5y3X9UCxLeuvrGtzUsPJ6PTio_0 2024-09-12T18:13:48.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.914+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14563515397017398551', time=2024-09-12T19:48:09.919255+0000, chain.objs.size()=1 2024-09-12T18:13:48.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.914+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.gfEFQK55BXq0TUcODK25Ywc0VQ8IU1n_0 2024-09-12T18:13:48.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.914+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.407985469006633578', time=2024-09-12T19:48:47.859020+0000, chain.objs.size()=1 2024-09-12T18:13:48.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.914+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.wYMcV3pb5inWZKlSZY914lbPYm-EwFr_0 2024-09-12T18:13:48.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.914+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16774399169255583230', time=2024-09-12T19:48:47.932112+0000, chain.objs.size()=1 2024-09-12T18:13:48.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.914+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.cu0T31V2F1x5sc9Vjk1i9gVqUj_gpV2_0 2024-09-12T18:13:48.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.914+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13917349430826189608', time=2024-09-12T19:48:48.079504+0000, chain.objs.size()=1 2024-09-12T18:13:48.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.914+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.35xccqkTOQjwLZZ5p9iDax_2hj5yZsX_0 2024-09-12T18:13:48.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.914+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15393185463761240119', time=2024-09-12T19:48:48.118541+0000, chain.objs.size()=1 2024-09-12T18:13:48.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.914+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.qvfU9G5SNIm_fF9fAW8jY7GXz5YAv35_0 2024-09-12T18:13:48.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.915+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5124354405670128251', time=2024-09-12T19:48:48.464081+0000, chain.objs.size()=1 2024-09-12T18:13:48.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.915+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.hOQsbXbe4Mk68QkjKkTiYvow8MfXLHb_0 2024-09-12T18:13:48.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.915+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5184696297195019910', time=2024-09-12T19:48:48.955846+0000, chain.objs.size()=1 2024-09-12T18:13:48.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.915+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ONGYh4TVRZLSkxL3gvxemYGITLaXYu-_0 2024-09-12T18:13:48.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.915+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6962463925201387036', time=2024-09-12T19:48:48.956990+0000, chain.objs.size()=1 2024-09-12T18:13:48.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.915+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.p0wo4_Kx7qgEPYHHJPLb1EKIuWyiLrW_0 2024-09-12T18:13:48.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.916+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6463354690462261332', time=2024-09-12T19:48:49.187079+0000, chain.objs.size()=1 2024-09-12T18:13:48.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.916+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.P84y6Ijgwo6JcLy4zUiVK3MvInj-2Oy_0 2024-09-12T18:13:48.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.916+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4399596343920650455', time=2024-09-12T19:48:49.359711+0000, chain.objs.size()=1 2024-09-12T18:13:48.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.916+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.0DXflBg4TEHpSi9E-Wi8rnOT5f947yZ_0 2024-09-12T18:13:48.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.916+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16846571189801679417', time=2024-09-12T19:48:49.586671+0000, chain.objs.size()=1 2024-09-12T18:13:48.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.916+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.d3kgWp9s5SdJhQf9bn8Qayfnh4FIwWu_0 2024-09-12T18:13:48.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.916+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8967309563244649507', time=2024-09-12T19:48:50.603740+0000, chain.objs.size()=1 2024-09-12T18:13:48.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.916+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.HCG97MJUtmZ3X7jd87p3BUqD5_jh_fl_0 2024-09-12T18:13:48.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.917+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9922061633553833541', time=2024-09-12T19:48:50.620099+0000, chain.objs.size()=1 2024-09-12T18:13:48.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.917+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.loZ_0JBvwBdI8rmdigavSzez6uuBeJf_0 2024-09-12T18:13:48.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.917+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3079458547753568468', time=2024-09-12T19:48:50.788211+0000, chain.objs.size()=1 2024-09-12T18:13:48.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.917+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.4gHo8wPQm-IO0mF98m_2C3wbF4ov-0K_0 2024-09-12T18:13:48.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.917+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8482380149442530441', time=2024-09-12T19:48:51.451091+0000, chain.objs.size()=1 2024-09-12T18:13:48.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.917+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.kif0CrJQi2SoJ-7I1hh8YX9u1QZ2ckd_0 2024-09-12T18:13:48.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.917+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6066947347741157285', time=2024-09-12T19:48:52.657977+0000, chain.objs.size()=1 2024-09-12T18:13:48.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.917+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.pyDfpiKEt8aBGPoD23Ya37oH-uQW2mf_0 2024-09-12T18:13:48.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.917+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17738776248548149288', time=2024-09-12T19:48:53.567570+0000, chain.objs.size()=1 2024-09-12T18:13:48.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.917+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.S31qNxwtqERRE2MTVWJIqMKd9IrTjN0_0 2024-09-12T18:13:48.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.917+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13628806219022364239', time=2024-09-12T19:48:53.936919+0000, chain.objs.size()=1 2024-09-12T18:13:48.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.917+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.PZibLDAXFt_qhHvM-1yDxi6DBKDkjkc_0 2024-09-12T18:13:48.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.921+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/49423 2024-09-12T18:13:48.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.924+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T18:13:48.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.924+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3465018114060755531', time=2024-09-12T19:48:54.038773+0000, chain.objs.size()=1 2024-09-12T18:13:48.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.924+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.o-Us3VvSczjaW1bO3WUrfG3NcuqmBy__0 2024-09-12T18:13:48.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.924+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6038381313893607085', time=2024-09-12T19:48:54.140609+0000, chain.objs.size()=1 2024-09-12T18:13:48.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.924+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.TYM5oMu5nv3ulRzND3jyhibpfjnZOnw_0 2024-09-12T18:13:48.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.924+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11760977410655217064', time=2024-09-12T19:48:55.330861+0000, chain.objs.size()=1 2024-09-12T18:13:48.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.924+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.H1Fv5H_G7vTTHbg6hkDwdx53QN7XNGd_0 2024-09-12T18:13:48.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.924+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.60227129100683339', time=2024-09-12T19:48:55.341983+0000, chain.objs.size()=1 2024-09-12T18:13:48.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.924+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.379u18ken7Fvxi278lEAJaSVf2Rlg_D_0 2024-09-12T18:13:48.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.924+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9193723340653896075', time=2024-09-12T19:48:55.347066+0000, chain.objs.size()=1 2024-09-12T18:13:48.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.924+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.zZRysD_U5kuhJQmPTf9OKxnv1YVm516_0 2024-09-12T18:13:48.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.924+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13035402629554231460', time=2024-09-12T19:48:55.551701+0000, chain.objs.size()=1 2024-09-12T18:13:48.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.924+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.3SNSUT6RHHRL1Z1EKxSJab0gJxVyP2y_0 2024-09-12T18:13:48.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.924+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12655932296486911529', time=2024-09-12T19:48:55.932719+0000, chain.objs.size()=1 2024-09-12T18:13:48.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.924+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.zohVEwKG7-57jzGKC5rCvkWh9gNkyq0_0 2024-09-12T18:13:48.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.924+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17139872669899513459', time=2024-09-12T19:48:56.930395+0000, chain.objs.size()=1 2024-09-12T18:13:48.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.924+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.0N03CWczeoxyIz2zB5ROM92TenK_5Sx_0 2024-09-12T18:13:48.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.924+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12063597872331895625', time=2024-09-12T19:48:56.949377+0000, chain.objs.size()=1 2024-09-12T18:13:48.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.924+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.76BA-Qzcp6D5t8RpoXQBoXK1H7HSTUY_0 2024-09-12T18:13:48.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.924+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7563816532694279396', time=2024-09-12T19:48:57.268322+0000, chain.objs.size()=1 2024-09-12T18:13:48.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.924+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.IDSHNt8XrhJIY9CcnAiHpluqwad2M9k_0 2024-09-12T18:13:48.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.924+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7692637012423445389', time=2024-09-12T19:48:57.539848+0000, chain.objs.size()=1 2024-09-12T18:13:48.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.924+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.d9aV8_tcxHRUKbSwu5oZefmoqPYB_4Z_0 2024-09-12T18:13:48.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.924+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7235490763326185408', time=2024-09-12T19:49:09.012598+0000, chain.objs.size()=1 2024-09-12T18:13:48.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.924+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.338__shadow_.U34-LWnI6TfTBcNr1G_KBWk5GzFUCnw_0 2024-09-12T18:13:48.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.925+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1232621380220753209', time=2024-09-12T19:50:57.827138+0000, chain.objs.size()=1 2024-09-12T18:13:48.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.925+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.459__shadow_.6K8FKg4GTFTMbnWu7lQywDipo_aCygS_0 2024-09-12T18:13:48.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.925+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6363075458130417013', time=2024-09-12T19:51:31.172569+0000, chain.objs.size()=1 2024-09-12T18:13:48.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.925+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.494__shadow_.VX9wgK6zn-lkA-zEAaERnhxdCYq5FfP_0 2024-09-12T18:13:48.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.925+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2811406607030991951', time=2024-09-12T19:57:59.682865+0000, chain.objs.size()=1 2024-09-12T18:13:48.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.925+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:j7bvVxYeQ5vbM3LgoEqPxU8odUKTizj_.TtHynrVGDyc3p3Mo7piM-0IsvWEw-23_0 2024-09-12T18:13:48.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.925+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6799890620352734672', time=2024-09-12T19:58:27.018335+0000, chain.objs.size()=1 2024-09-12T18:13:48.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.925+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:4oCPVUrYs4frPYtDqMXSIesxek.Erzg_.gYTAfpHdKKHlo5rMpwOtONhsGJUehDe_0 2024-09-12T18:13:48.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.926+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4504160610609144491', time=2024-09-12T19:59:32.323316+0000, chain.objs.size()=1 2024-09-12T18:13:48.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.926+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.581__shadow:txwT6n29sKsEo.QjcF-goizg3IHoYVA_.Lu0pkJi7CcsEBws6jASd7-1rCe4k6na_0 2024-09-12T18:13:48.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.926+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17115018766680229383', time=2024-09-12T20:01:52.576243+0000, chain.objs.size()=12 2024-09-12T18:13:48.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.926+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.616__multipart_multipart_enc.2~re88OxBsfM5RFOa5XGieerWPS8fnFgD.1 2024-09-12T18:13:48.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.926+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.616__shadow_multipart_enc.2~re88OxBsfM5RFOa5XGieerWPS8fnFgD.1_1 2024-09-12T18:13:48.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.926+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.616__multipart_multipart_enc.2~re88OxBsfM5RFOa5XGieerWPS8fnFgD.2 2024-09-12T18:13:48.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.926+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.616__shadow_multipart_enc.2~re88OxBsfM5RFOa5XGieerWPS8fnFgD.2_1 2024-09-12T18:13:48.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.926+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.616__multipart_multipart_enc.2~re88OxBsfM5RFOa5XGieerWPS8fnFgD.3 2024-09-12T18:13:48.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.926+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.616__shadow_multipart_enc.2~re88OxBsfM5RFOa5XGieerWPS8fnFgD.3_1 2024-09-12T18:13:48.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.926+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.616__multipart_multipart_enc.2~re88OxBsfM5RFOa5XGieerWPS8fnFgD.4 2024-09-12T18:13:48.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.927+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.616__shadow_multipart_enc.2~re88OxBsfM5RFOa5XGieerWPS8fnFgD.4_1 2024-09-12T18:13:48.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.927+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.616__multipart_multipart_enc.2~re88OxBsfM5RFOa5XGieerWPS8fnFgD.5 2024-09-12T18:13:48.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.927+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.616__shadow_multipart_enc.2~re88OxBsfM5RFOa5XGieerWPS8fnFgD.5_1 2024-09-12T18:13:48.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.930+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.616__multipart_multipart_enc.2~re88OxBsfM5RFOa5XGieerWPS8fnFgD.6 2024-09-12T18:13:48.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.930+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.616__shadow_multipart_enc.2~re88OxBsfM5RFOa5XGieerWPS8fnFgD.6_1 2024-09-12T18:13:48.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.930+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9816143526744672497', time=2024-09-12T20:04:55.107680+0000, chain.objs.size()=1 2024-09-12T18:13:48.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.930+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.631__shadow_.Lpjs92AfzF87tELAuptvd5_a8BcBJSk_0 2024-09-12T18:13:48.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.930+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4155478589955783121', time=2024-09-12T20:04:56.836763+0000, chain.objs.size()=1 2024-09-12T18:13:48.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.930+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.633__shadow_.XySNDZBgi5M3PHWpw6O5VEZ2OZoqW62_0 2024-09-12T18:13:48.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.933+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:48.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.935+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:13:48.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.936+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:48.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.937+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:48.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.938+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49756' 2024-09-12T18:13:48.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.938+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2058639184353940581', time=2024-09-12T19:41:59.971825+0000, chain.objs.size()=5 2024-09-12T18:13:48.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.938+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__multipart_foo-LUKEWARM.2~wGWHh1QokeiWyvEOWzO1ET4yWofSLUH.1 2024-09-12T18:13:48.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.938+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__shadow_foo-LUKEWARM.2~wGWHh1QokeiWyvEOWzO1ET4yWofSLUH.1_1 2024-09-12T18:13:48.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.938+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__multipart_foo-LUKEWARM.2~wGWHh1QokeiWyvEOWzO1ET4yWofSLUH.2 2024-09-12T18:13:48.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.938+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__shadow_foo-LUKEWARM.2~wGWHh1QokeiWyvEOWzO1ET4yWofSLUH.2_1 2024-09-12T18:13:48.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.938+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__multipart_foo-LUKEWARM.2~wGWHh1QokeiWyvEOWzO1ET4yWofSLUH.3 2024-09-12T18:13:48.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.938+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9998641325764965722', time=2024-09-12T19:46:08.805659+0000, chain.objs.size()=1 2024-09-12T18:13:48.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.938+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.rN5bXE4G3P8HjBrWu_dXefqSZgCm-lE_0 2024-09-12T18:13:48.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.938+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8099022937192565611', time=2024-09-12T19:46:09.141719+0000, chain.objs.size()=1 2024-09-12T18:13:48.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.938+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.CbLM6FWZCar092_EEuN5im6KIFRKg5E_0 2024-09-12T18:13:48.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.938+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4526596449793187037', time=2024-09-12T19:46:09.200829+0000, chain.objs.size()=1 2024-09-12T18:13:48.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.938+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ley7KecZmR8wmSGa1CJGROiPuvQ7_rb_0 2024-09-12T18:13:48.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.938+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15751521199036572377', time=2024-09-12T19:46:09.548787+0000, chain.objs.size()=1 2024-09-12T18:13:48.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.938+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Iha-Xiru5NSOCpm1yflzUI6ULSRaIX3_0 2024-09-12T18:13:48.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.938+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3045326680214108979', time=2024-09-12T19:46:10.531727+0000, chain.objs.size()=1 2024-09-12T18:13:48.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.938+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Pdp74wJ7bftkZGu3YWa7nwkpu9_Zn0Y_0 2024-09-12T18:13:48.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.938+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11710371869569727733', time=2024-09-12T19:46:10.532524+0000, chain.objs.size()=1 2024-09-12T18:13:48.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.938+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.eeXTHa4uYFKXCnJ2UvrEJy_IBaApc2z_0 2024-09-12T18:13:48.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.938+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5051606771250076785', time=2024-09-12T19:46:10.700739+0000, chain.objs.size()=1 2024-09-12T18:13:48.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.938+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.PXMhsrTMmqbdnc32bFEMVClXMaSzX03_0 2024-09-12T18:13:48.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.940+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5064939968050926838', time=2024-09-12T19:46:11.302254+0000, chain.objs.size()=1 2024-09-12T18:13:48.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.940+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.d5VXjR14XoH46PXb4L9nmGHHF2WzkhI_0 2024-09-12T18:13:49.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.940+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2730523315321793868', time=2024-09-12T19:46:11.879620+0000, chain.objs.size()=1 2024-09-12T18:13:49.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.940+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ReZqnmC9MGOuiyEBtbY9SzBa9WB1RdX_0 2024-09-12T18:13:49.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.941+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15068860337412288705', time=2024-09-12T19:46:11.880377+0000, chain.objs.size()=1 2024-09-12T18:13:49.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.941+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_._F9Ad__pPA05xNpizpOM9tUi5_YYUtM_0 2024-09-12T18:13:49.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.941+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11913114363669239543', time=2024-09-12T19:46:12.139445+0000, chain.objs.size()=1 2024-09-12T18:13:49.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.941+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.r0MDxhr4o6x9nOb-prWX7oOJjgP0gQP_0 2024-09-12T18:13:49.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.941+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11798464135615061620', time=2024-09-12T19:46:12.389141+0000, chain.objs.size()=1 2024-09-12T18:13:49.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.941+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Q4T2XORGAQ9zwjy-uo3OKSSsVLJaHTn_0 2024-09-12T18:13:49.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.941+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14464975161160000855', time=2024-09-12T19:46:13.387009+0000, chain.objs.size()=1 2024-09-12T18:13:49.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.941+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.DU5dPXJs6y-1BZfSp0j0vzHQ3ysJt1d_0 2024-09-12T18:13:49.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.941+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17425987142443345434', time=2024-09-12T19:46:13.886371+0000, chain.objs.size()=1 2024-09-12T18:13:49.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.941+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.UTfegeQeBVUteSTSvPNY5MFlXBrdCEb_0 2024-09-12T18:13:49.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.941+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11309927846624379319', time=2024-09-12T19:46:14.211268+0000, chain.objs.size()=1 2024-09-12T18:13:49.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.941+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.rMxPuGXSRJZD8E4XM_GrU5i6L7fO6MY_0 2024-09-12T18:13:49.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.941+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3282450493358217111', time=2024-09-12T19:46:14.340807+0000, chain.objs.size()=1 2024-09-12T18:13:49.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.941+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.itfcaZO-9M-D5TaSkhorYYJO3ldFfCS_0 2024-09-12T18:13:49.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.941+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3236228829632761340', time=2024-09-12T19:46:15.068121+0000, chain.objs.size()=1 2024-09-12T18:13:49.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.941+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.8k0tfAoPeM-8u-iW-TTdHWaa_nIfTn2_0 2024-09-12T18:13:49.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.941+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1240986835090890803', time=2024-09-12T19:46:15.582920+0000, chain.objs.size()=1 2024-09-12T18:13:49.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.941+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.00nismJTrJ0OEOTaYmFRg43vzKl3EKZ_0 2024-09-12T18:13:49.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.943+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15357827476543055344', time=2024-09-12T19:46:15.638693+0000, chain.objs.size()=1 2024-09-12T18:13:49.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.943+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.m8eZl9cdvkSU3z0KONJunjPtqyvKaIx_0 2024-09-12T18:13:49.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.943+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8506465550297153972', time=2024-09-12T19:46:16.751744+0000, chain.objs.size()=1 2024-09-12T18:13:49.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.943+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.7fh9zyDonILSaQwMtEh1DiB_qWe3P7__0 2024-09-12T18:13:49.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.943+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12129308933752194933', time=2024-09-12T19:46:16.867903+0000, chain.objs.size()=1 2024-09-12T18:13:49.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.943+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.WV6G0EA-0F0EqcXKC6n9OC5yzH4d6V8_0 2024-09-12T18:13:49.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.943+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5880509969877102541', time=2024-09-12T19:46:17.596985+0000, chain.objs.size()=1 2024-09-12T18:13:49.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.943+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ZrSU2hmQSDmimfKMeHopkepJSLjadLG_0 2024-09-12T18:13:49.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.943+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.888445595060719174', time=2024-09-12T19:46:17.702243+0000, chain.objs.size()=1 2024-09-12T18:13:49.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.943+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.rxt1ZAhiohS9_z_g-XBM4Uukq_hHncP_0 2024-09-12T18:13:49.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.943+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12690291449031831985', time=2024-09-12T19:46:18.274523+0000, chain.objs.size()=1 2024-09-12T18:13:49.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.943+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.tBgreBMA4fphGOxkE8rug7TGqRasr9E_0 2024-09-12T18:13:49.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.943+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3507077453752946458', time=2024-09-12T19:46:18.275280+0000, chain.objs.size()=1 2024-09-12T18:13:49.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.943+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.KpVLLUaveFqLmcfI0vZTNSbMJMdCnJ2_0 2024-09-12T18:13:49.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.943+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2099338694546701083', time=2024-09-12T19:46:18.276171+0000, chain.objs.size()=1 2024-09-12T18:13:49.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.943+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.mYm-e8ustnfQ2RhbK-BRavnsqtXyZPW_0 2024-09-12T18:13:49.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.943+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5227377031175823170', time=2024-09-12T19:46:19.325868+0000, chain.objs.size()=1 2024-09-12T18:13:49.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.943+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.0ay2D5AmyucAgTLJgiCWVRMGPJLxF7v_0 2024-09-12T18:13:49.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.944+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14480876358330220445', time=2024-09-12T19:46:19.609306+0000, chain.objs.size()=1 2024-09-12T18:13:49.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.944+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.R0MCelEmN_T_e6cRc9F9xVT6WrVx5L__0 2024-09-12T18:13:49.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.944+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14145948201898996357', time=2024-09-12T19:46:28.333121+0000, chain.objs.size()=1 2024-09-12T18:13:49.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.944+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.273__shadow_.k9UfOnv6caifeX6z4Yg-Y6eyWB-MQ72_0 2024-09-12T18:13:49.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.945+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16818298815903591508', time=2024-09-12T19:46:40.189804+0000, chain.objs.size()=1 2024-09-12T18:13:49.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.945+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.286__shadow_.Ga9oEQDB89W9weJWvwwDu6T7dtB4rXg_0 2024-09-12T18:13:49.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.945+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5546785974932438202', time=2024-09-12T19:46:43.891125+0000, chain.objs.size()=1 2024-09-12T18:13:49.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.945+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.290__shadow_.HBIjYsOFUiGVJfS62zRapETArHj9-S5_0 2024-09-12T18:13:49.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.946+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.83771980468748175', time=2024-09-12T19:46:48.120731+0000, chain.objs.size()=1 2024-09-12T18:13:49.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.946+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.293__shadow_.cgzTUYjI4akZdH2JHmDjIrsmBf8Ao50_0 2024-09-12T18:13:49.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.946+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12001799829469738326', time=2024-09-12T19:46:50.403731+0000, chain.objs.size()=1 2024-09-12T18:13:49.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.946+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.294__shadow_.VMdtxcb_C9cAwMx2Iy5500STVr4S5WI_0 2024-09-12T18:13:49.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.946+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16949435342658945654', time=2024-09-12T19:46:55.096941+0000, chain.objs.size()=1 2024-09-12T18:13:49.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.946+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.299__shadow_.dI7Y2j_ENY2EPS-GEGOWPgRDtdbmYa4_0 2024-09-12T18:13:49.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.946+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15566594656461301659', time=2024-09-12T19:47:00.635182+0000, chain.objs.size()=1 2024-09-12T18:13:49.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.946+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.305__shadow_.i2XaT5_vLzANXGZkCWJ4raKo6upY0IS_0 2024-09-12T18:13:49.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.946+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16141620126031574300', time=2024-09-12T19:47:59.471516+0000, chain.objs.size()=1 2024-09-12T18:13:49.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.946+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.CaWbDxX0JN284aO5DdZFvxR7RbDwxGQ_0 2024-09-12T18:13:49.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.946+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12005762974983487873', time=2024-09-12T19:48:01.137882+0000, chain.objs.size()=1 2024-09-12T18:13:49.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.946+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.kxBhfm4gR_sDiNjk9NmRlN4pVcla_UR_0 2024-09-12T18:13:49.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.946+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14011071120199363373', time=2024-09-12T19:48:01.284211+0000, chain.objs.size()=1 2024-09-12T18:13:49.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.946+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.QOgL6EnPNTCeZwJnbGUTUSIfGC9TWF7_0 2024-09-12T18:13:49.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.946+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14483194965176965380', time=2024-09-12T19:48:01.930242+0000, chain.objs.size()=1 2024-09-12T18:13:49.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.946+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.bcXsF9OVRhEBgDdcPbHBbDoaumcQvYX_0 2024-09-12T18:13:49.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.946+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8903617521620365757', time=2024-09-12T19:48:02.822739+0000, chain.objs.size()=1 2024-09-12T18:13:49.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.946+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.GNnf2dsOhMFM3Ejtlpdyij7VAWuQcvy_0 2024-09-12T18:13:49.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.947+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15578197238481989954', time=2024-09-12T19:48:02.833807+0000, chain.objs.size()=1 2024-09-12T18:13:49.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.947+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.V7vdEBbpH8mxd5eAM-YS_HhYu2-C22E_0 2024-09-12T18:13:49.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.948+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17556183579400343882', time=2024-09-12T19:48:02.975327+0000, chain.objs.size()=1 2024-09-12T18:13:49.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.948+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.IwKjeN6lyjw0jV_wo5_IFS_maC2G9ko_0 2024-09-12T18:13:49.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.948+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16204291772078045611', time=2024-09-12T19:48:03.092882+0000, chain.objs.size()=1 2024-09-12T18:13:49.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.948+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.hcljbcr3E3nNcquHJbDUGtazaJexTNk_0 2024-09-12T18:13:49.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.948+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2050067578030299993', time=2024-09-12T19:48:04.248204+0000, chain.objs.size()=1 2024-09-12T18:13:49.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.948+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Oc8udV4JdrroJlnmnpmR5IBg42HJuBJ_0 2024-09-12T18:13:49.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.948+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1683596928500961050', time=2024-09-12T19:48:04.586564+0000, chain.objs.size()=1 2024-09-12T18:13:49.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.948+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.kOUnVAgJGcK8n6hjTJwNYxp6YDS-UC-_0 2024-09-12T18:13:49.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.948+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3681714095434496885', time=2024-09-12T19:48:04.907275+0000, chain.objs.size()=1 2024-09-12T18:13:49.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.948+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.bFMmNv8-VmyKfv7e95qHt2blzg05dLU_0 2024-09-12T18:13:49.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.948+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2500121913041134006', time=2024-09-12T19:48:05.474627+0000, chain.objs.size()=1 2024-09-12T18:13:49.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.948+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.t4dm1zt6h0b26L9nOLb72SYM013nmJJ_0 2024-09-12T18:13:49.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.948+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5510742960839718251', time=2024-09-12T19:48:05.899953+0000, chain.objs.size()=1 2024-09-12T18:13:49.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.948+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.jtYSzxdGDeyiB6L0tvUEoT0BCCjqKFm_0 2024-09-12T18:13:49.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.949+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1479396809878889648', time=2024-09-12T19:48:06.053285+0000, chain.objs.size()=1 2024-09-12T18:13:49.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.949+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.AldX18BAIeJcwkGbJ5k4_-WTFoE0CAn_0 2024-09-12T18:13:49.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.949+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8278991481046679131', time=2024-09-12T19:48:06.077032+0000, chain.objs.size()=1 2024-09-12T18:13:49.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.949+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ORChO8nlxpIA-aHRJxoWZgl6Y5K0nF4_0 2024-09-12T18:13:49.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.949+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9939825402964567186', time=2024-09-12T19:48:06.281233+0000, chain.objs.size()=1 2024-09-12T18:13:49.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.949+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ls_ninDtc3NTnU5JnatCytPvBflD8V7_0 2024-09-12T18:13:49.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.949+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14931269433620042931', time=2024-09-12T19:48:06.679995+0000, chain.objs.size()=1 2024-09-12T18:13:49.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.949+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.MlWO8WmIWA3rbQkecXG8x5ze6xgGSv7_0 2024-09-12T18:13:49.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.950+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6997413466423379411', time=2024-09-12T19:48:06.940436+0000, chain.objs.size()=1 2024-09-12T18:13:49.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.950+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.C8w_r35wymQTQqlx2DG9GqPX-HBAE5d_0 2024-09-12T18:13:49.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.950+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10366664845756955713', time=2024-09-12T19:48:06.957541+0000, chain.objs.size()=1 2024-09-12T18:13:49.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.950+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.anhYJnsT0htJ9bzYDLwUSG-_G1ar-4W_0 2024-09-12T18:13:49.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.951+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10212749880480256507', time=2024-09-12T19:48:07.099990+0000, chain.objs.size()=1 2024-09-12T18:13:49.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.951+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.3k1V8W0a-cTT27Jwz_gV0f_tUI620e4_0 2024-09-12T18:13:49.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.951+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12043955752994819734', time=2024-09-12T19:48:07.365296+0000, chain.objs.size()=1 2024-09-12T18:13:49.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.951+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.AKcCgAVe_eJ54mwqDuRMxEPyLUXja6d_0 2024-09-12T18:13:49.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.951+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12612164465564225650', time=2024-09-12T19:48:07.975479+0000, chain.objs.size()=1 2024-09-12T18:13:49.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.951+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.R8RtFbsx3TVXna3T_2EKRPi13w8sHFI_0 2024-09-12T18:13:49.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.951+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6752255471829030271', time=2024-09-12T19:48:07.996489+0000, chain.objs.size()=1 2024-09-12T18:13:49.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.951+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Vw0JC04MukjSVXcG2wPfmZi-hzIUYph_0 2024-09-12T18:13:49.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.951+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10620849218550926763', time=2024-09-12T19:48:08.404447+0000, chain.objs.size()=1 2024-09-12T18:13:49.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.951+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.YhS6Iz5rRzUgO7rcn3uXtuepouiH7XG_0 2024-09-12T18:13:49.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.951+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6367458079202668762', time=2024-09-12T19:48:08.864577+0000, chain.objs.size()=1 2024-09-12T18:13:49.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.951+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.YB2IbLK7RWkLOxx4YiM0Bl4gkpBmzj__0 2024-09-12T18:13:49.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.951+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16134668312727201599', time=2024-09-12T19:48:09.461712+0000, chain.objs.size()=1 2024-09-12T18:13:49.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.951+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.PFWcgnIjGD0pSgq6ckg3k0QCrQ96EsH_0 2024-09-12T18:13:49.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.951+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.56293204625614569', time=2024-09-12T19:48:09.580736+0000, chain.objs.size()=1 2024-09-12T18:13:49.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.951+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.rD_wa1ZazkGlvjBcUa0hZHv9rDcBw-9_0 2024-09-12T18:13:49.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.951+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14730683440148064092', time=2024-09-12T19:48:09.967298+0000, chain.objs.size()=1 2024-09-12T18:13:49.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.951+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.6KqPQYGbJx44mdlh-zZNIRvgp1EughF_0 2024-09-12T18:13:49.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.951+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5507535499260425292', time=2024-09-12T19:48:47.507873+0000, chain.objs.size()=1 2024-09-12T18:13:49.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.951+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.vnK9cQ9EB0n7x0dX5w6GkKz3VPYxjcR_0 2024-09-12T18:13:49.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.952+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14208931244101171286', time=2024-09-12T19:48:47.508770+0000, chain.objs.size()=1 2024-09-12T18:13:49.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.952+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.4E7xg5FarqxXOI47H2Fc2j5Uxn2xJHk_0 2024-09-12T18:13:49.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.953+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18274885765034490994', time=2024-09-12T19:48:47.533326+0000, chain.objs.size()=1 2024-09-12T18:13:49.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.953+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.osFp_PQb5zBVdKOmTpiCNtAJ8WGJ7G9_0 2024-09-12T18:13:49.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.953+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.596263699291637541', time=2024-09-12T19:48:47.831558+0000, chain.objs.size()=1 2024-09-12T18:13:49.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.953+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.VZRjJfdM9fw8Pc8SSf7q6l37R7vzgSO_0 2024-09-12T18:13:49.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.953+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10690418807852890464', time=2024-09-12T19:48:47.994957+0000, chain.objs.size()=1 2024-09-12T18:13:49.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.953+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.INQdFm-qCGt_uB_F-JoZtMkUINJKKt5_0 2024-09-12T18:13:49.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.953+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18227612792462201849', time=2024-09-12T19:48:48.050664+0000, chain.objs.size()=1 2024-09-12T18:13:49.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.953+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.HdRSzFmybLPQtUQt5AHBzERQbWZEcv7_0 2024-09-12T18:13:49.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.953+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15981980257409394383', time=2024-09-12T19:48:48.447039+0000, chain.objs.size()=1 2024-09-12T18:13:49.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.953+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.1hgwFmBexklvdndrPOCGysAeB4AAzpK_0 2024-09-12T18:13:49.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.953+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17953597842133900987', time=2024-09-12T19:48:49.361499+0000, chain.objs.size()=1 2024-09-12T18:13:49.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.953+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.DTGFKaZzeIkrBfNTG6Z672bhjijMbIw_0 2024-09-12T18:13:49.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.954+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15742525886578520371', time=2024-09-12T19:48:49.501078+0000, chain.objs.size()=1 2024-09-12T18:13:49.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.954+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.oxncT-aVFAdd7d-Zba6Rp1S7Bop5O0Z_0 2024-09-12T18:13:49.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.954+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13543045146323913514', time=2024-09-12T19:48:49.946234+0000, chain.objs.size()=1 2024-09-12T18:13:49.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.954+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.lgR2D2wQNR7tUltmWJaO9TfW4tXVJ8A_0 2024-09-12T18:13:49.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.954+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10473099550980123143', time=2024-09-12T19:48:50.809674+0000, chain.objs.size()=1 2024-09-12T18:13:49.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.954+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.hbKsI0sJRWfe1IEkzjsJ8n7W3DJnu_Q_0 2024-09-12T18:13:49.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.954+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15376785281975729649', time=2024-09-12T19:48:50.912465+0000, chain.objs.size()=1 2024-09-12T18:13:49.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.954+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.zV1TlRMwXQDilhJR78zbM45VOdGqLfM_0 2024-09-12T18:13:49.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.954+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3606592132973446493', time=2024-09-12T19:48:50.930656+0000, chain.objs.size()=1 2024-09-12T18:13:49.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.954+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.A-pBhECxRUCMbTyNMPhHNBbxPS6ETdW_0 2024-09-12T18:13:49.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.955+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5841412937407457387', time=2024-09-12T19:48:51.315082+0000, chain.objs.size()=1 2024-09-12T18:13:49.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.955+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.qK4o27ldjf_fQQflyJExQ5BmQrKk6jn_0 2024-09-12T18:13:49.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.955+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15998334628715224651', time=2024-09-12T19:48:52.437085+0000, chain.objs.size()=1 2024-09-12T18:13:49.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.955+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.s_7_1XZ7I2TCEB1TleukzOgSdAw1pMw_0 2024-09-12T18:13:49.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.955+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12757886712317224770', time=2024-09-12T19:48:52.473344+0000, chain.objs.size()=1 2024-09-12T18:13:49.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.955+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.W_c1WPLlGN8Fl7h8dcKywGDJp-IJd9Z_0 2024-09-12T18:13:49.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.956+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6529273344308867597', time=2024-09-12T19:48:53.283033+0000, chain.objs.size()=1 2024-09-12T18:13:49.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.956+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.OH03dhjdlkOZpspeflSXl9WZUG5npV0_0 2024-09-12T18:13:49.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.956+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13636849394204502411', time=2024-09-12T19:48:53.481747+0000, chain.objs.size()=1 2024-09-12T18:13:49.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.956+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.iaxugOyvJ-sTr97vxivUDjY_KeCdmzq_0 2024-09-12T18:13:49.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.956+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6645248930185204389', time=2024-09-12T19:48:53.756002+0000, chain.objs.size()=1 2024-09-12T18:13:49.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.956+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.NlH4UyVKUXvXXHGHQyvNxeNH_pRwmHB_0 2024-09-12T18:13:49.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.956+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11827389512860946375', time=2024-09-12T19:48:54.116853+0000, chain.objs.size()=1 2024-09-12T18:13:49.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.956+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.OHShpQSvqcBlwkXM_PWxRN7NCE1JWA__0 2024-09-12T18:13:49.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.956+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4743913477560500951', time=2024-09-12T19:48:54.192196+0000, chain.objs.size()=1 2024-09-12T18:13:49.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.956+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Dog_Gr37EERpzvR5IUL5pcUtCkLG6-5_0 2024-09-12T18:13:49.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.957+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3840207087144684022', time=2024-09-12T19:48:54.952194+0000, chain.objs.size()=1 2024-09-12T18:13:49.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.957+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.-znyqicB38D-MPWxby2Rw9rtToEJRg1_0 2024-09-12T18:13:49.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.957+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16190260721382437807', time=2024-09-12T19:48:54.987848+0000, chain.objs.size()=1 2024-09-12T18:13:49.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.957+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.zOOtT7kWBl1G_EEmq3choJmfA0NnL1x_0 2024-09-12T18:13:49.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.957+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17821156015210635798', time=2024-09-12T19:48:55.080145+0000, chain.objs.size()=1 2024-09-12T18:13:49.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.957+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.LcgiMoTR-AMLwr3QN0eHaq6ZyWQx8gE_0 2024-09-12T18:13:49.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.957+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6403399110646376196', time=2024-09-12T19:48:55.221088+0000, chain.objs.size()=1 2024-09-12T18:13:49.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.957+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.rt8rc6dS7on58V3wKQR8sWDg5ArM5Kv_0 2024-09-12T18:13:49.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.958+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17718203782622272960', time=2024-09-12T19:48:55.440275+0000, chain.objs.size()=1 2024-09-12T18:13:49.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.958+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.6er2Narhq4X8CDE5xqb1_G49yEeptzS_0 2024-09-12T18:13:49.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.958+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15866140831651796409', time=2024-09-12T19:48:55.560088+0000, chain.objs.size()=1 2024-09-12T18:13:49.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.958+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.OM79pM62-m2hrXHKh1NELMrapMf2vrM_0 2024-09-12T18:13:49.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.958+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12968453443927674596', time=2024-09-12T19:48:55.607086+0000, chain.objs.size()=1 2024-09-12T18:13:49.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.958+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ID0vG6DoB1KLMdnZ7YBJ1JftfjF8Wz__0 2024-09-12T18:13:49.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.958+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5313442623733527007', time=2024-09-12T19:48:56.662243+0000, chain.objs.size()=1 2024-09-12T18:13:49.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.958+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.3EuXhRITdkX9CObRpmFEBbNwJ5ZGkQ6_0 2024-09-12T18:13:49.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.958+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4256680463644802513', time=2024-09-12T19:48:57.293702+0000, chain.objs.size()=1 2024-09-12T18:13:49.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.958+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.0ek5K259Jcpo3-lzIPWKJcdx3vJ7e0A_0 2024-09-12T18:13:49.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.958+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16023230240688306893', time=2024-09-12T19:48:57.586163+0000, chain.objs.size()=1 2024-09-12T18:13:49.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.958+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.H55DGnIgrycdXppN0NI5GEOcVUjM_QT_0 2024-09-12T18:13:49.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.958+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.566015569141643406', time=2024-09-12T19:48:57.945534+0000, chain.objs.size()=1 2024-09-12T18:13:49.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.958+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.xbEPY6l-VNxhbdmS19v8kGyr-uTmPHJ_0 2024-09-12T18:13:49.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.959+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2662726897816469026', time=2024-09-12T19:50:33.402441+0000, chain.objs.size()=1 2024-09-12T18:13:49.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.959+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.436__shadow_.8nHlTqs9TElFSnjzpOJfTlZxWg6wDcv_0 2024-09-12T18:13:49.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.959+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1405156031278785970', time=2024-09-12T19:50:52.480928+0000, chain.objs.size()=1 2024-09-12T18:13:49.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.959+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.455__shadow_.GKV0icRG6x0HND72R6t4D0-rodPjUeI_0 2024-09-12T18:13:49.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.960+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9704224904234375463', time=2024-09-12T19:50:56.440627+0000, chain.objs.size()=1 2024-09-12T18:13:49.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.960+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.458__shadow_.YhnFPCrBOE2-tjNyMl_62Ew2V5wu3Bf_0 2024-09-12T18:13:49.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.960+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18439881033779173924', time=2024-09-12T19:51:27.432348+0000, chain.objs.size()=1 2024-09-12T18:13:49.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.960+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.489__shadow_.91iV6tMZS0dLomsJGf4ZraWXcuVAm4S_0 2024-09-12T18:13:49.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.961+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/49756 2024-09-12T18:13:49.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.963+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T18:13:49.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.963+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~sBu0BG-DrIAA1NjuAaNA8zyom7nLCmF', time=2024-09-12T19:56:09.761116+0000, chain.objs.size()=1 2024-09-12T18:13:49.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.963+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.532__multipart_mymultipart2.2~sBu0BG-DrIAA1NjuAaNA8zyom7nLCmF.1 2024-09-12T18:13:49.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.963+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7705681260890827033', time=2024-09-12T19:57:40.390780+0000, chain.objs.size()=1 2024-09-12T18:13:49.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.963+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.560__shadow_.ZWbhul-A1vRP5y1AOkA3m1buTM5ohVb_0 2024-09-12T18:13:49.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.963+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2909930813945025261', time=2024-09-12T19:57:53.169797+0000, chain.objs.size()=1 2024-09-12T18:13:49.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.963+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.566__shadow_.gAzpJRJsb1LM2FdIb2NSyXTIRK4bibZ_0 2024-09-12T18:13:49.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.963+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4003017789578413724', time=2024-09-12T19:58:03.277810+0000, chain.objs.size()=1 2024-09-12T18:13:49.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.963+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:lTC8SOZN.nsDaG2VTEhdOg3iQuKSh5E_.Q9Da8T8lR3GA_je_cFrp_IIhF_IxMop_0 2024-09-12T18:13:49.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.963+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7161124989462198059', time=2024-09-12T19:58:41.906635+0000, chain.objs.size()=1 2024-09-12T18:13:49.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.963+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:8rvPPEEsOJhEr.iDGmE-XS.TlzNBFdJ_.46brlPVfR40smk_9f-RZbr2bdmI84Ln_0 2024-09-12T18:13:49.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.963+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9320115018845589151', time=2024-09-12T19:59:40.973003+0000, chain.objs.size()=1 2024-09-12T18:13:49.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.963+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.588__shadow:evcZOnMZCz-kj-9Mq5mFodHi.Rgxgf0_.XvAn0Exg1Gi_8KmIPJyf_DYCArfSJk8_0 2024-09-12T18:13:49.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.963+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16813719593312351256', time=2024-09-12T19:59:41.000490+0000, chain.objs.size()=1 2024-09-12T18:13:49.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.963+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.588__shadow:k94NUuVYfKqHiQZV4gQ3udRA8h6uvXU_.l5QnLXzFhNHbY9jA15ASgsMs4nQ1DKI_0 2024-09-12T18:13:49.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.963+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1538666048549945566', time=2024-09-12T19:59:58.064749+0000, chain.objs.size()=1 2024-09-12T18:13:49.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.963+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.609__shadow_.cLY1X8LZxxkm-UgB-WjkNmO3lrMYgCy_0 2024-09-12T18:13:49.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.963+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~K-0x_xCwrxUISahU6vTlQ-a7T46XfCL', time=2024-09-12T20:04:50.457812+0000, chain.objs.size()=12 2024-09-12T18:13:49.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.963+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.626__multipart_multipart_enc.2~K-0x_xCwrxUISahU6vTlQ-a7T46XfCL.1 2024-09-12T18:13:49.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.963+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.626__shadow_multipart_enc.2~K-0x_xCwrxUISahU6vTlQ-a7T46XfCL.1_1 2024-09-12T18:13:49.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.963+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.626__multipart_multipart_enc.2~K-0x_xCwrxUISahU6vTlQ-a7T46XfCL.2 2024-09-12T18:13:49.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.963+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.626__shadow_multipart_enc.2~K-0x_xCwrxUISahU6vTlQ-a7T46XfCL.2_1 2024-09-12T18:13:49.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.965+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.626__multipart_multipart_enc.2~K-0x_xCwrxUISahU6vTlQ-a7T46XfCL.3 2024-09-12T18:13:49.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.965+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.626__shadow_multipart_enc.2~K-0x_xCwrxUISahU6vTlQ-a7T46XfCL.3_1 2024-09-12T18:13:49.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.965+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.626__multipart_multipart_enc.2~K-0x_xCwrxUISahU6vTlQ-a7T46XfCL.4 2024-09-12T18:13:49.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.965+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.626__shadow_multipart_enc.2~K-0x_xCwrxUISahU6vTlQ-a7T46XfCL.4_1 2024-09-12T18:13:49.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.965+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.626__multipart_multipart_enc.2~K-0x_xCwrxUISahU6vTlQ-a7T46XfCL.5 2024-09-12T18:13:49.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.965+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.626__shadow_multipart_enc.2~K-0x_xCwrxUISahU6vTlQ-a7T46XfCL.5_1 2024-09-12T18:13:49.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.965+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.626__multipart_multipart_enc.2~K-0x_xCwrxUISahU6vTlQ-a7T46XfCL.6 2024-09-12T18:13:49.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.966+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.626__shadow_multipart_enc.2~K-0x_xCwrxUISahU6vTlQ-a7T46XfCL.6_1 2024-09-12T18:13:49.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.967+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10646749038243389924', time=2024-09-12T20:05:06.611951+0000, chain.objs.size()=1 2024-09-12T18:13:49.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.967+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.643__shadow_.o7MKdgAOValgCNDlKRpalikIjmff9No_0 2024-09-12T18:13:49.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.967+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9153627490691007032', time=2024-09-12T20:05:13.583400+0000, chain.objs.size()=2 2024-09-12T18:13:49.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.967+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.646__shadow_.o-yKHaAwzRwJntLkdTSPRzbrdYyaBdK_0 2024-09-12T18:13:49.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.967+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.646__shadow_.o-yKHaAwzRwJntLkdTSPRzbrdYyaBdK_1 2024-09-12T18:13:49.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.968+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3981083267195137210', time=2024-09-12T20:06:33.875395+0000, chain.objs.size()=1 2024-09-12T18:13:49.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.968+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.704__shadow:aWcYz.tRkrp4zANSBfjyqrjPqJGoc9n_.M015NJ3ih5Zep_ZH3hxEBl5LlCK8WLf_0 2024-09-12T18:13:49.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.971+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:49.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.973+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:13:49.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.974+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:49.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.974+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:49.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.975+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46864' 2024-09-12T18:13:49.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.975+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='__Tl2fz6Uvfe_ZBl5I_kjSzblpZ_aOfN', time=2024-09-12T19:41:49.296072+0000, chain.objs.size()=3 2024-09-12T18:13:49.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.975+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.161__shadow_.DJiixX_0GBtP0MwGYaeAaQpcIZ34_V4_0 2024-09-12T18:13:49.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.975+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.161__shadow_.DJiixX_0GBtP0MwGYaeAaQpcIZ34_V4_1 2024-09-12T18:13:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.975+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.161__shadow_.DJiixX_0GBtP0MwGYaeAaQpcIZ34_V4_2 2024-09-12T18:13:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.975+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7021915692820946142', time=2024-09-12T19:42:23.843034+0000, chain.objs.size()=1 2024-09-12T18:13:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.975+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.167__shadow_.Ukt6YHol9-US7qNEnXmAGAmmAfm6AZt_0 2024-09-12T18:13:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.975+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1735844186437859751', time=2024-09-12T19:42:40.500774+0000, chain.objs.size()=1 2024-09-12T18:13:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.975+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.177__shadow_.SWh3t5h7RAkulnd328clUomjohiYE8Q_0 2024-09-12T18:13:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.975+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14611362031385748004', time=2024-09-12T19:42:44.742638+0000, chain.objs.size()=1 2024-09-12T18:13:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.975+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.182__shadow_.-uy99GYHN3m_PeV7u_Gtj5-YWy6qBCJ_0 2024-09-12T18:13:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.975+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9985455750292755342', time=2024-09-12T19:45:00.934443+0000, chain.objs.size()=1 2024-09-12T18:13:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.975+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.231__shadow_.VrX76GugjJUdj_K-pTOWYXkVZgAtT5N_0 2024-09-12T18:13:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.975+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13325122965813930113', time=2024-09-12T19:45:03.667456+0000, chain.objs.size()=1 2024-09-12T18:13:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.975+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.234__shadow_.m1lW05c2b_83xoPhyGSEZbrukvHusjA_0 2024-09-12T18:13:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.975+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4491911613772049154', time=2024-09-12T19:45:08.058677+0000, chain.objs.size()=1 2024-09-12T18:13:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.975+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.238__shadow_.rF03KUOgKHvo6yqWWkoyCUWoy5SJ0-g_0 2024-09-12T18:13:49.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.975+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18029391050959079654', time=2024-09-12T19:45:16.339008+0000, chain.objs.size()=1 2024-09-12T18:13:49.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.975+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.245__shadow_.ZrBNb0qSbCDpeMIosCeNDVjsqda1Uur_0 2024-09-12T18:13:49.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.975+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1992290280939042607', time=2024-09-12T19:45:23.666111+0000, chain.objs.size()=1 2024-09-12T18:13:49.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.975+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.253__shadow_.5jTNjE__9KgPWPAkauFddBuBB0DQE43_0 2024-09-12T18:13:49.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.975+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5315523442150095352', time=2024-09-12T19:45:26.387501+0000, chain.objs.size()=1 2024-09-12T18:13:49.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.975+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.256__shadow_.Q5fXlRlHroQ4aj8cFm_WMRxxN53W3T8_0 2024-09-12T18:13:49.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.979+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1644273555926071055', time=2024-09-12T19:45:28.151582+0000, chain.objs.size()=1 2024-09-12T18:13:49.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.979+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.258__shadow_.kjXoWlX6hXM_nqPTeODCkkfKgYQe1ld_0 2024-09-12T18:13:49.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.979+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4867557465429903361', time=2024-09-12T19:46:09.019819+0000, chain.objs.size()=1 2024-09-12T18:13:49.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.979+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.SrOWA7nmECNF-0DcclyOAjjq7NBoEHE_0 2024-09-12T18:13:49.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.979+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14585756863787939614', time=2024-09-12T19:46:09.395954+0000, chain.objs.size()=1 2024-09-12T18:13:49.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.979+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.QfsbjOLRnPNo8k1irx8xSGTPkKRJvDl_0 2024-09-12T18:13:49.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.979+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1333241107339422490', time=2024-09-12T19:46:09.405536+0000, chain.objs.size()=1 2024-09-12T18:13:49.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.979+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.8o4QwZ537ZrYSa1zqUiBBFVTnKHTMIF_0 2024-09-12T18:13:49.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.979+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11143496512114167658', time=2024-09-12T19:46:09.567478+0000, chain.objs.size()=1 2024-09-12T18:13:49.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.979+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.z_QHfW7XnklbKFFiX1t2-9rmkF8lVtc_0 2024-09-12T18:13:49.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.979+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6469993937223166724', time=2024-09-12T19:46:09.681137+0000, chain.objs.size()=1 2024-09-12T18:13:49.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.979+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.cabP9bHjVwIEtkkhpsGwualSKQj5469_0 2024-09-12T18:13:49.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.979+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11490855554375872083', time=2024-09-12T19:46:10.380578+0000, chain.objs.size()=1 2024-09-12T18:13:49.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.979+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.13E-6NsDZYANpgcOdYByYNfSjboU-dR_0 2024-09-12T18:13:49.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.979+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14452282641054330622', time=2024-09-12T19:46:10.980559+0000, chain.objs.size()=1 2024-09-12T18:13:49.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.979+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.DFfR6ndSre8XFLcnNeKIZgbOR6A-1Dp_0 2024-09-12T18:13:49.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.979+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11109085233290751533', time=2024-09-12T19:46:11.874766+0000, chain.objs.size()=1 2024-09-12T18:13:49.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.979+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.DgrokhEjTd_YDP6yA5E-kA8GD88OjeE_0 2024-09-12T18:13:49.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.979+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14575846091214227367', time=2024-09-12T19:46:12.386769+0000, chain.objs.size()=1 2024-09-12T18:13:49.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.979+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.dK_NozrXnyslzdW4zaAE7QFctaqgmpN_0 2024-09-12T18:13:49.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.979+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14381132076951270656', time=2024-09-12T19:46:12.658802+0000, chain.objs.size()=1 2024-09-12T18:13:49.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.979+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.W0poqC_4ZoMnZ2Lso2akEwUGJR2LoAw_0 2024-09-12T18:13:49.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.980+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11234108674518723882', time=2024-09-12T19:46:12.714638+0000, chain.objs.size()=1 2024-09-12T18:13:49.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.980+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.AXqo9v8_1KBGWv44MCNV9Cgi01aydf7_0 2024-09-12T18:13:49.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.981+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15856876171096910525', time=2024-09-12T19:46:12.831384+0000, chain.objs.size()=1 2024-09-12T18:13:49.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.981+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.CYowsFTtNQXkWYqZMVQjT755YdGPOzt_0 2024-09-12T18:13:49.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.981+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12637450920472270245', time=2024-09-12T19:46:13.359548+0000, chain.objs.size()=1 2024-09-12T18:13:49.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.981+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.oZiQCgLqcdwRZOppDV8zRtwC8NAUa_o_0 2024-09-12T18:13:49.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.981+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1091364020987359362', time=2024-09-12T19:46:13.579932+0000, chain.objs.size()=1 2024-09-12T18:13:49.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.981+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.YDcUk848lX_E9glsmGGbFbke4DMQnmp_0 2024-09-12T18:13:49.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.981+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1379102341031348100', time=2024-09-12T19:46:13.888986+0000, chain.objs.size()=1 2024-09-12T18:13:49.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.981+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.gxVPMeeTvkmUGtGyEu8eN456Yb16eME_0 2024-09-12T18:13:49.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.981+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15895425331103435448', time=2024-09-12T19:46:14.035582+0000, chain.objs.size()=1 2024-09-12T18:13:49.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.981+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.wUamBkCr851HczzQqCaFJMmCLyu3Lwj_0 2024-09-12T18:13:49.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.981+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2782861013092753405', time=2024-09-12T19:46:14.209145+0000, chain.objs.size()=1 2024-09-12T18:13:49.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.981+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.7Xcx2C0DrQszCV_J09mml6gSlzywZzv_0 2024-09-12T18:13:49.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.981+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1097082539813993304', time=2024-09-12T19:46:14.847461+0000, chain.objs.size()=1 2024-09-12T18:13:49.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.981+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.YVg1RwN5JZxWlhUikVudjQpzAwvWmnz_0 2024-09-12T18:13:49.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.981+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16462116819570209663', time=2024-09-12T19:46:14.867141+0000, chain.objs.size()=1 2024-09-12T18:13:49.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.981+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.aXt6zMyf_4mwu0wZbjsOBHyPlp1W74b_0 2024-09-12T18:13:49.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.981+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11403289301386530534', time=2024-09-12T19:46:15.058488+0000, chain.objs.size()=1 2024-09-12T18:13:49.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.981+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.3kxOQxYIjVSVwY2mVn0fg7V3FlsdFk4_0 2024-09-12T18:13:49.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.981+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1416045205058935435', time=2024-09-12T19:46:15.399209+0000, chain.objs.size()=1 2024-09-12T18:13:49.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.981+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Sf0Xf8JUA4-cTOzKb4Ie6cT6MQKGNGp_0 2024-09-12T18:13:49.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.982+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16260078982646873902', time=2024-09-12T19:46:15.538645+0000, chain.objs.size()=1 2024-09-12T18:13:49.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.982+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.-RXdr3qnoK1ktotNS8kk1l4mNMDETvN_0 2024-09-12T18:13:49.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.983+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9212379168867853620', time=2024-09-12T19:46:16.148923+0000, chain.objs.size()=1 2024-09-12T18:13:49.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.983+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.1zDHcwRSH126Ka8B0YC8n7hbEZq1Mfa_0 2024-09-12T18:13:49.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.983+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10091450237250528237', time=2024-09-12T19:46:17.111258+0000, chain.objs.size()=1 2024-09-12T18:13:49.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.983+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.0XVDezz0ksYENhLkVRSyefXiWl-Z98d_0 2024-09-12T18:13:49.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.984+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13367734163730065233', time=2024-09-12T19:46:17.782164+0000, chain.objs.size()=1 2024-09-12T18:13:49.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.984+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.PkZE3zf7KUuxHo4Ynvs6ifaEslhPg-a_0 2024-09-12T18:13:49.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.984+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9647492668911133674', time=2024-09-12T19:46:17.863555+0000, chain.objs.size()=1 2024-09-12T18:13:49.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.984+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.SFz3FCL9lvkml-8exECcBuGQVUrmrGy_0 2024-09-12T18:13:49.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.984+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2218625900069302240', time=2024-09-12T19:46:18.124501+0000, chain.objs.size()=1 2024-09-12T18:13:49.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.984+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ue1I77gJExvFgDhRBtjNvTha2q9jUET_0 2024-09-12T18:13:49.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.984+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4112936187216659856', time=2024-09-12T19:46:18.435240+0000, chain.objs.size()=1 2024-09-12T18:13:49.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.984+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.DIKfdZ88ijmfDFxDhnHCOCD1FA3iW0l_0 2024-09-12T18:13:49.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.984+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17758612353748661928', time=2024-09-12T19:46:18.472043+0000, chain.objs.size()=1 2024-09-12T18:13:49.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.984+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.3789y4ScwE1PbqFQFbRbyhB6cWoE5bv_0 2024-09-12T18:13:49.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.984+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2028900117038880061', time=2024-09-12T19:46:19.145263+0000, chain.objs.size()=1 2024-09-12T18:13:49.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.984+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.JI4j48y1C2veLoAlmRxqs2WZBAGFeYm_0 2024-09-12T18:13:49.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.984+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.748218280124673095', time=2024-09-12T19:46:19.212278+0000, chain.objs.size()=1 2024-09-12T18:13:49.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.984+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.h11gFKBkeB89h9SlpF1StMlNQGcZdem_0 2024-09-12T18:13:49.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.984+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3320965971967653988', time=2024-09-12T19:46:23.092859+0000, chain.objs.size()=1 2024-09-12T18:13:49.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.984+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.267__shadow_.FU9pD1COfeOtxFRo-JYIlq3y1Y2bdRS_0 2024-09-12T18:13:49.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.985+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9324484984697671371', time=2024-09-12T19:46:37.402198+0000, chain.objs.size()=1 2024-09-12T18:13:49.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.985+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.283__shadow_.gnhKpvyAqaEtIzDxh09T8JLzI8foGoi_0 2024-09-12T18:13:49.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.985+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3661955255152799538', time=2024-09-12T19:46:48.158452+0000, chain.objs.size()=1 2024-09-12T18:13:49.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.985+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.293__shadow_.TwWwnvNtDL0Pj0Ft4FaqqUGatT96gD4_0 2024-09-12T18:13:49.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.985+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4686363910007315109', time=2024-09-12T19:46:48.234985+0000, chain.objs.size()=1 2024-09-12T18:13:49.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.985+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.293__shadow_.5LbweIO4FjWbxMOAIHCywvkTDuwahff_0 2024-09-12T18:13:49.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.985+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8775920764453325104', time=2024-09-12T19:46:54.095769+0000, chain.objs.size()=1 2024-09-12T18:13:49.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.985+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.298__shadow_.4-S7s8RX3sy0GY605ZJI4RztFhg4qIJ_0 2024-09-12T18:13:49.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.986+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2464127608553689001', time=2024-09-12T19:47:00.634945+0000, chain.objs.size()=1 2024-09-12T18:13:49.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.986+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.305__shadow_.WMknRvWXtXkjXcUbMsTraHUK1IaQPCB_0 2024-09-12T18:13:49.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.986+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12703726843231756661', time=2024-09-12T19:47:59.817143+0000, chain.objs.size()=1 2024-09-12T18:13:49.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.986+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.1jIAJMYgyGPXeZwzR-KODTr1wC98BjV_0 2024-09-12T18:13:49.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.986+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2594768187259392809', time=2024-09-12T19:48:00.161082+0000, chain.objs.size()=1 2024-09-12T18:13:49.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.986+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.2CC1x8wcL0iiDG2mOi_gHj-2Y8pITeg_0 2024-09-12T18:13:49.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.986+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11459135679887856687', time=2024-09-12T19:48:01.022193+0000, chain.objs.size()=1 2024-09-12T18:13:49.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.986+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.zxqgfLD2PzWkS7rY5YHM4AJQQRAqBlF_0 2024-09-12T18:13:49.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.986+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.300469037740233288', time=2024-09-12T19:48:01.023281+0000, chain.objs.size()=1 2024-09-12T18:13:49.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.986+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Q_b9cTZgsAA346H7w9F3uLZSZCDMnG6_0 2024-09-12T18:13:49.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.986+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1476437496271958551', time=2024-09-12T19:48:01.382990+0000, chain.objs.size()=1 2024-09-12T18:13:49.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.986+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.UxjtJcypUN1OAgGny2LQcyJkM9EXYEn_0 2024-09-12T18:13:49.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.986+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11455980400422071175', time=2024-09-12T19:48:01.539009+0000, chain.objs.size()=1 2024-09-12T18:13:49.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.986+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.JJ0ckil8LjBrkDHQxRsOnXR4cdr3rsw_0 2024-09-12T18:13:49.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.986+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8217464306711693240', time=2024-09-12T19:48:02.580361+0000, chain.objs.size()=1 2024-09-12T18:13:49.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.986+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.fLTMus4nmtxiA9S-Sh4mMGGt8slWRi1_0 2024-09-12T18:13:49.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.986+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.526993649795359639', time=2024-09-12T19:48:02.616935+0000, chain.objs.size()=1 2024-09-12T18:13:49.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.986+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.M5-2_zhTz2BoRbmibDYq_C8DTahGLkO_0 2024-09-12T18:13:49.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.986+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4098783819925444370', time=2024-09-12T19:48:02.912485+0000, chain.objs.size()=1 2024-09-12T18:13:49.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.986+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.x9xOfnWOwErANVo4m8HeKflTfLz78-R_0 2024-09-12T18:13:49.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.987+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1427172951106943641', time=2024-09-12T19:48:03.379433+0000, chain.objs.size()=1 2024-09-12T18:13:49.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.988+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.tDPY-TF81edHKZDB0bvV09Wx0qwle1C_0 2024-09-12T18:13:49.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.988+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3570111398158375652', time=2024-09-12T19:48:03.940001+0000, chain.objs.size()=1 2024-09-12T18:13:49.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.988+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.awX0OloikFhd3SqIJGJjfMRFkHJ8wX4_0 2024-09-12T18:13:49.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.988+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1595034643326463153', time=2024-09-12T19:48:05.328098+0000, chain.objs.size()=1 2024-09-12T18:13:49.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.988+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.VvJBlNyzHg4oi1CvSPFTyTNlM-t0BGv_0 2024-09-12T18:13:49.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.988+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16277606155490182372', time=2024-09-12T19:48:05.430334+0000, chain.objs.size()=1 2024-09-12T18:13:49.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.988+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.rvf2zN5EanEclbqHpna3A2-rrCX3U8w_0 2024-09-12T18:13:49.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.988+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.678776138532093585', time=2024-09-12T19:48:05.638046+0000, chain.objs.size()=1 2024-09-12T18:13:49.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.988+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.W5dxPS6lGZa7_ingzUZ2AeQm-g4tKgL_0 2024-09-12T18:13:49.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.989+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15936663767272428983', time=2024-09-12T19:48:05.894315+0000, chain.objs.size()=1 2024-09-12T18:13:49.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.989+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.8hCKsPx9aJb78mImL1dUguxTBQg91MK_0 2024-09-12T18:13:49.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.989+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5362822335052852207', time=2024-09-12T19:48:05.931738+0000, chain.objs.size()=1 2024-09-12T18:13:49.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.989+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.rIMFl_tiZHSE5xbTXecWkFwdmOofHpo_0 2024-09-12T18:13:49.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.989+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12996861672999436997', time=2024-09-12T19:48:06.074895+0000, chain.objs.size()=1 2024-09-12T18:13:49.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.989+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.YHMJzPyQCUKuohyMAScgk6I_BtTsGWS_0 2024-09-12T18:13:49.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.989+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2049357668067999100', time=2024-09-12T19:48:07.216793+0000, chain.objs.size()=1 2024-09-12T18:13:49.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.989+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.W-QZ7h3_2cO3-K-M-OnEHB2b4MxoiMg_0 2024-09-12T18:13:49.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.989+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2853988261783411956', time=2024-09-12T19:48:07.261103+0000, chain.objs.size()=1 2024-09-12T18:13:49.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.989+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.XC_dcSuuJDneP_D8ETiUIPQVl1yqC8s_0 2024-09-12T18:13:49.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.989+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16758526323386344146', time=2024-09-12T19:48:07.668299+0000, chain.objs.size()=1 2024-09-12T18:13:49.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.989+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.80EmlIou8lOivNshcDKut6hW_sMsryR_0 2024-09-12T18:13:49.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.989+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13705111943863188139', time=2024-09-12T19:48:08.009733+0000, chain.objs.size()=1 2024-09-12T18:13:49.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.989+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.pxIYeTkZhxryceAsSxsKp9W27FV00d5_0 2024-09-12T18:13:49.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.990+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17132545552973456313', time=2024-09-12T19:48:08.011069+0000, chain.objs.size()=1 2024-09-12T18:13:49.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.990+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.xrAbzM37YT6sKCxucq9SRBtCUyoCtVv_0 2024-09-12T18:13:49.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.990+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3573464284173344865', time=2024-09-12T19:48:08.691050+0000, chain.objs.size()=1 2024-09-12T18:13:49.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.990+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.lKDx8hzSTMqC_HeJQviVsqbHWowOiaz_0 2024-09-12T18:13:49.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.991+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12952589319057775145', time=2024-09-12T19:48:09.421851+0000, chain.objs.size()=1 2024-09-12T18:13:49.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.991+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.9BwMHSAxmQj0DrFhxsE5yKeYAIhstMq_0 2024-09-12T18:13:49.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.991+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1681547899533615270', time=2024-09-12T19:48:10.057555+0000, chain.objs.size()=1 2024-09-12T18:13:49.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.991+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.y2HYFaUNT7x0xMV3EotW3emj0QlMtkl_0 2024-09-12T18:13:49.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.991+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16786848933762529084', time=2024-09-12T19:48:47.630422+0000, chain.objs.size()=1 2024-09-12T18:13:49.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.991+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.SOWfLIX35-sWihZvyR2Ex0jUvpa5BO-_0 2024-09-12T18:13:49.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.991+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10721483494985165119', time=2024-09-12T19:48:47.669168+0000, chain.objs.size()=1 2024-09-12T18:13:49.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.991+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.foBX-Yt0gSOtNqSMlSINirB1MEJpHOZ_0 2024-09-12T18:13:49.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.991+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10865231709929138578', time=2024-09-12T19:48:47.908072+0000, chain.objs.size()=1 2024-09-12T18:13:49.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.991+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.AdTMXgk3BoT6g97NWgH4Kuy2StJfdYr_0 2024-09-12T18:13:49.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.992+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.335932447903156286', time=2024-09-12T19:48:47.949539+0000, chain.objs.size()=1 2024-09-12T18:13:49.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.992+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.kbEgffrJVsDNaa6isYHOUXCYbBPyLem_0 2024-09-12T18:13:49.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.992+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2691194827400808021', time=2024-09-12T19:48:48.277032+0000, chain.objs.size()=1 2024-09-12T18:13:49.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.992+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_._i2GaHVmUFwTg8eODG-8AI5aDxfQS4R_0 2024-09-12T18:13:49.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.992+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16445294011843015634', time=2024-09-12T19:48:49.360775+0000, chain.objs.size()=1 2024-09-12T18:13:49.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.992+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ZbCdA6nSRbTE546wRkd8ixGA0EfQMpD_0 2024-09-12T18:13:49.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.993+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13295814070757128188', time=2024-09-12T19:48:49.441075+0000, chain.objs.size()=1 2024-09-12T18:13:49.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.993+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Oku9Tx5lFEH7ea0n4Z4xrxKlpgfiHQ3_0 2024-09-12T18:13:49.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.993+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11370475019865073701', time=2024-09-12T19:48:49.920598+0000, chain.objs.size()=1 2024-09-12T18:13:49.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.993+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.hCzcWzrDfd4GF8bnOCjot6hYrjELVe6_0 2024-09-12T18:13:49.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.993+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11909541000225245373', time=2024-09-12T19:48:50.637818+0000, chain.objs.size()=1 2024-09-12T18:13:49.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.993+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.s39n7m0dgYt7BxkO34ltCwslw5zAlSX_0 2024-09-12T18:13:49.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.993+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.914765032046731241', time=2024-09-12T19:48:51.152076+0000, chain.objs.size()=1 2024-09-12T18:13:49.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.993+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ht43FB5YDAROn921FEgn9rks1dyBjdm_0 2024-09-12T18:13:49.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.993+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15426735925618022588', time=2024-09-12T19:48:51.173592+0000, chain.objs.size()=1 2024-09-12T18:13:49.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.993+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.X2yO9rAl3dUsXhkjvk6vMyzBbD7evhS_0 2024-09-12T18:13:49.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.993+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6898029127595373758', time=2024-09-12T19:48:51.293248+0000, chain.objs.size()=1 2024-09-12T18:13:49.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.993+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Lo2QEpVK_DZGICCNcmJ3IQGKNF17ArA_0 2024-09-12T18:13:49.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.993+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15363064038285490243', time=2024-09-12T19:48:51.451003+0000, chain.objs.size()=1 2024-09-12T18:13:49.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.993+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.gYh8FwGURIXIfiR3DWiquXOJpgiH-ni_0 2024-09-12T18:13:49.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.993+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.223346721557088008', time=2024-09-12T19:48:52.596854+0000, chain.objs.size()=1 2024-09-12T18:13:49.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.993+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_._bQNc1XwSg0P0LnTJ2erSsVJYiAX1Z-_0 2024-09-12T18:13:49.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.994+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10849966024715526149', time=2024-09-12T19:48:53.620021+0000, chain.objs.size()=1 2024-09-12T18:13:49.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.994+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.g6MfdhgS5-nQL91Kc4vaBHG4mo5HAhU_0 2024-09-12T18:13:49.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.996+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14754840971247902987', time=2024-09-12T19:48:53.806814+0000, chain.objs.size()=1 2024-09-12T18:13:49.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.996+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.DIl6G2s5JCtWdDwGiZJd-i8cwcus8d-_0 2024-09-12T18:13:49.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.996+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3938064718508057526', time=2024-09-12T19:48:53.807699+0000, chain.objs.size()=1 2024-09-12T18:13:49.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.996+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.HFHrUynKCIBOM17YrTZNBEvVVzW8GJ4_0 2024-09-12T18:13:49.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.997+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5961596840334260924', time=2024-09-12T19:48:53.839390+0000, chain.objs.size()=1 2024-09-12T18:13:49.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.997+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.lHE6HAB8l7JoqNgPsNpg79j8kTeu2Dn_0 2024-09-12T18:13:49.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.997+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15547639700761728485', time=2024-09-12T19:48:54.017940+0000, chain.objs.size()=1 2024-09-12T18:13:49.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.997+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.aSiT-X5PUjZWN5S-ip8v_kM3nPNP1z5_0 2024-09-12T18:13:49.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.997+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7589177920335647326', time=2024-09-12T19:48:54.236764+0000, chain.objs.size()=1 2024-09-12T18:13:49.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.997+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ugILo1wb8dmKSuOfOP0tmkHY3DbhQM9_0 2024-09-12T18:13:49.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.997+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14303831346430490136', time=2024-09-12T19:48:54.950681+0000, chain.objs.size()=1 2024-09-12T18:13:49.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.997+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Bd2OlSG9q4Imgl9UoOftfOjU-1cSoSz_0 2024-09-12T18:13:49.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.997+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12009492811752988982', time=2024-09-12T19:48:55.151918+0000, chain.objs.size()=1 2024-09-12T18:13:49.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.997+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.-pWcFNUx1t11o4ilZqajdCW-sVQ0tsV_0 2024-09-12T18:13:49.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.997+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16889418791010198942', time=2024-09-12T19:48:55.291838+0000, chain.objs.size()=1 2024-09-12T18:13:49.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.997+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.4I74VuQW6kSSxLr3z5wPoOFkjpokSmu_0 2024-09-12T18:13:49.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.997+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7639883569302253705', time=2024-09-12T19:48:56.182887+0000, chain.objs.size()=1 2024-09-12T18:13:49.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.997+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.J9RP-GxH5-XtCBoycalxV8KLPopLYbI_0 2024-09-12T18:13:49.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.997+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.348139817591453865', time=2024-09-12T19:48:56.259002+0000, chain.objs.size()=1 2024-09-12T18:13:49.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.997+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.DhCZLSZ5BTdkCEb7X76qmvTACuAh5Q0_0 2024-09-12T18:13:49.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.997+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3735086106733721560', time=2024-09-12T19:48:56.296032+0000, chain.objs.size()=1 2024-09-12T18:13:49.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.997+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.aNySOft_d5DhNLJPGbvYQ6cQO74moGz_0 2024-09-12T18:13:49.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.998+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15727849535619257438', time=2024-09-12T19:48:56.376266+0000, chain.objs.size()=1 2024-09-12T18:13:49.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:48.998+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.wnErc5ktdQLjAcfa7Jxg5sp_fs6Ggdx_0 2024-09-12T18:13:49.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.000+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/46864 2024-09-12T18:13:49.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.003+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T18:13:49.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.003+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5689071160095211868', time=2024-09-12T19:48:57.273093+0000, chain.objs.size()=1 2024-09-12T18:13:49.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.003+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.GcnNQZ4sGRSYYj2w7GCeZLbCvl5f6ZB_0 2024-09-12T18:13:49.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.003+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10789761455107101575', time=2024-09-12T19:48:57.273786+0000, chain.objs.size()=1 2024-09-12T18:13:49.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.003+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.kxZ7uDLwXUEu2LHixP9Pbf6TamyxhPk_0 2024-09-12T18:13:49.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.003+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11888813096069080452', time=2024-09-12T19:48:57.427534+0000, chain.objs.size()=1 2024-09-12T18:13:49.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.003+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.36YrJQcm2S7tq3hep6KA8ygitR3VXa8_0 2024-09-12T18:13:49.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.003+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10286271325886088334', time=2024-09-12T19:48:57.629086+0000, chain.objs.size()=1 2024-09-12T18:13:49.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.003+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.SX3BfTuEAoiL3JjXJtTM7nu5eSqtIbp_0 2024-09-12T18:13:49.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.003+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11263094164597272207', time=2024-09-12T19:49:36.662405+0000, chain.objs.size()=1 2024-09-12T18:13:49.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.003+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.373__shadow_.6jR3qLqdkloILH2oRBzVgYa-2Hv97Iq_0 2024-09-12T18:13:49.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.003+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.246735724522277728', time=2024-09-12T19:51:18.571036+0000, chain.objs.size()=1 2024-09-12T18:13:49.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.003+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.484__shadow_.yVbZG2hkvk15D4S_jIU1M9Zv45r5zCS_0 2024-09-12T18:13:49.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.003+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.225152387183098016', time=2024-09-12T19:51:40.563825+0000, chain.objs.size()=1 2024-09-12T18:13:49.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.003+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.504__shadow:-V-p6OxZtM7hRMUzkyItZ02ZaGvL5CT_.X0PQumandVzjwgbUSUv4JkorH1YhtZM_0 2024-09-12T18:13:49.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.003+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4189616917176605234', time=2024-09-12T19:58:24.144180+0000, chain.objs.size()=1 2024-09-12T18:13:49.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.003+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.577__shadow:Ee7jlwvZwqD2VyotKzlWAHR0PBuKgIY_.CELW_6u8PzoNZnbvPZrY29s4DeA3-_P_0 2024-09-12T18:13:49.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.003+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12173922362305820863', time=2024-09-12T19:58:44.934674+0000, chain.objs.size()=1 2024-09-12T18:13:49.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.003+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:me1Ji1yQUJCiEDx8xkznxOsnYatX8Hd_.MYK1l_FBpL5dU0meC8LAIwoPXJbF90N_0 2024-09-12T18:13:49.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.003+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15108965425922126554', time=2024-09-12T19:58:46.843309+0000, chain.objs.size()=1 2024-09-12T18:13:49.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.003+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:nERdBfuYPPE06C.eFT1BOwMUQZWENpR_.UClkEYhDTqcDHPqN8icPE_HA65lw9xA_0 2024-09-12T18:13:49.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.003+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1028766972664123912', time=2024-09-12T19:59:16.617694+0000, chain.objs.size()=4 2024-09-12T18:13:49.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.003+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.579__multipart_testobj.2~09AtvxXjSZicJMrLYVPkFoZtQvrqRQG.1 2024-09-12T18:13:49.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.003+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.579__multipart_testobj.2~09AtvxXjSZicJMrLYVPkFoZtQvrqRQG.2 2024-09-12T18:13:49.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.004+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.579__multipart_testobj.2~09AtvxXjSZicJMrLYVPkFoZtQvrqRQG.3 2024-09-12T18:13:49.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.005+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.579__multipart_testobj.2~09AtvxXjSZicJMrLYVPkFoZtQvrqRQG.4 2024-09-12T18:13:49.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.005+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13338448304910639445', time=2024-09-12T19:59:30.038786+0000, chain.objs.size()=1 2024-09-12T18:13:49.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.005+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.580__shadow:kF4e9zWuo6Eh9yB.ThHsJ.3qpIM1FES_.o_8mUhPG4sxmRIWM4vre7drNh79GRSa_0 2024-09-12T18:13:49.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.007+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7373361514344979777', time=2024-09-12T19:59:40.693508+0000, chain.objs.size()=1 2024-09-12T18:13:49.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.007+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.588__shadow:qafMdZgtUbr3v.wGv0Z7B3BhaLEgvLF_.zIEwO3M_GZX1faxLrz2UG4Zi7gTtKzu_0 2024-09-12T18:13:49.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.007+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17554272533779604711', time=2024-09-12T20:03:56.230467+0000, chain.objs.size()=1 2024-09-12T18:13:49.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.007+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.619__shadow_.j6dVc0TjF8RIVIz8eTtYLA8chSKz9mN_0 2024-09-12T18:13:49.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.007+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17759579796260287487', time=2024-09-12T20:03:57.314439+0000, chain.objs.size()=1 2024-09-12T18:13:49.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.007+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.620__shadow_.14tSxFATQ-vXjhtoupKg8Ld1I2DUUN2_0 2024-09-12T18:13:49.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.007+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16305998344881061316', time=2024-09-12T20:04:52.096656+0000, chain.objs.size()=1 2024-09-12T18:13:49.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.007+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.628__shadow_.HIGOBaN8KigFYWaY2W81CfrwZIEnkTd_0 2024-09-12T18:13:49.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.007+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14894833371109378590', time=2024-09-12T20:05:04.160548+0000, chain.objs.size()=1 2024-09-12T18:13:49.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.007+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.641__shadow_.iaamWeO6Qn3mH_uJ25zfq4FpKjqk6kU_0 2024-09-12T18:13:49.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.007+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8495132239063266441', time=2024-09-12T20:05:04.344435+0000, chain.objs.size()=1 2024-09-12T18:13:49.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.007+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.642__shadow_.rPzaNNhpfHfonFoIt6wZrrvxpqQod3g_0 2024-09-12T18:13:49.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.007+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12822897903339857766', time=2024-09-12T20:06:31.896243+0000, chain.objs.size()=1 2024-09-12T18:13:49.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.007+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.702__shadow:OKt9x9EKW9q7IN0c8vH.Nkd0zj1cgEM_.eCSjG7P1eJriQ50--C_OOiV6GcXttwg_0 2024-09-12T18:13:49.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.007+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~u3blZNys8k1FoEycnjk1TMrGfYLgQO4', time=2024-09-12T20:07:38.150092+0000, chain.objs.size()=1 2024-09-12T18:13:49.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.007+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.743__multipart_mymultipart2.2~u3blZNys8k1FoEycnjk1TMrGfYLgQO4.1 2024-09-12T18:13:49.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.011+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:49.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.013+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:13:49.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.014+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:49.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.015+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:49.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.016+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45680' 2024-09-12T18:13:49.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.016+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17508705838364843475', time=2024-09-12T19:41:07.801241+0000, chain.objs.size()=1 2024-09-12T18:13:49.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.016+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.148__shadow_.491kUzwbyFPabXszxCoinI5DfL4Mg_Y_0 2024-09-12T18:13:49.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.016+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='_EP6kc_yo5m08DN00dJjKsp4bcVYzFO6', time=2024-09-12T19:41:36.658106+0000, chain.objs.size()=1 2024-09-12T18:13:49.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.016+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.161__shadow_.v_aBlZVn89lqTtQOkxOMO_iTLsItuzj_0 2024-09-12T18:13:49.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.016+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4996561184930222485', time=2024-09-12T19:45:14.711024+0000, chain.objs.size()=1 2024-09-12T18:13:49.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.016+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.244__shadow_.pW1DeOqxPYwO8ZgVEmpDGy_R2jKl-Wf_0 2024-09-12T18:13:49.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.016+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13418055463803079131', time=2024-09-12T19:45:21.823089+0000, chain.objs.size()=1 2024-09-12T18:13:49.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.016+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.251__shadow_.C56O4rysWesZkWpVcyvubgHde1KlGIK_0 2024-09-12T18:13:49.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.016+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12392181165659329273', time=2024-09-12T19:45:30.819690+0000, chain.objs.size()=1 2024-09-12T18:13:49.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.016+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.261__shadow_.u-eeJAiFG-hNg33wOOh7MPR7XF-Oy3k_0 2024-09-12T18:13:49.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.016+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16039160212217096230', time=2024-09-12T19:46:08.789729+0000, chain.objs.size()=1 2024-09-12T18:13:49.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.016+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.QbS2KnHcuM00tPlQWEf50GYtGrM7Vde_0 2024-09-12T18:13:49.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.016+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1538754897086187535', time=2024-09-12T19:46:09.467525+0000, chain.objs.size()=1 2024-09-12T18:13:49.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.016+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.2uZsMY7fS0mQUWfUIWAU7rFZAyKSC3o_0 2024-09-12T18:13:49.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.016+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5557128094447173641', time=2024-09-12T19:46:09.611486+0000, chain.objs.size()=1 2024-09-12T18:13:49.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.016+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.kgkVFwkG7q0_dfr_keTU9SJVLL8e93p_0 2024-09-12T18:13:49.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.016+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14517787031326034116', time=2024-09-12T19:46:11.171841+0000, chain.objs.size()=1 2024-09-12T18:13:49.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.016+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.c2CsAaNOitzHYH1eiP6b06Y_oscPXAE_0 2024-09-12T18:13:49.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.016+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15262006652721966403', time=2024-09-12T19:46:11.876038+0000, chain.objs.size()=1 2024-09-12T18:13:49.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.016+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.7IWQDDRlvxcxqy-gASbD1QBwmqjE5ne_0 2024-09-12T18:13:49.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.016+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4750251067080257080', time=2024-09-12T19:46:12.064550+0000, chain.objs.size()=1 2024-09-12T18:13:49.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.016+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.IjRDr5LVeRkcSzP5SQJqgJQhKxMN86S_0 2024-09-12T18:13:49.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.016+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.697875391229621994', time=2024-09-12T19:46:12.138040+0000, chain.objs.size()=1 2024-09-12T18:13:49.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.016+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.hOJUoN8I1UuYs6q0-pF9ZqiMw2EIey__0 2024-09-12T18:13:49.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.018+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4275017123898917033', time=2024-09-12T19:46:12.389279+0000, chain.objs.size()=1 2024-09-12T18:13:49.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.018+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.RkT9rH_8dziXEONo1GxnT1xAA6UAet8_0 2024-09-12T18:13:49.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.018+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2679756277907238031', time=2024-09-12T19:46:12.528649+0000, chain.objs.size()=1 2024-09-12T18:13:49.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.018+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.r10HrmiIoQ2QlQZQ3pwSVNy_4XHiGrQ_0 2024-09-12T18:13:49.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.018+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13721622704742024485', time=2024-09-12T19:46:12.592013+0000, chain.objs.size()=1 2024-09-12T18:13:49.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.018+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_._k8TgUdZJJTLHVXGvoS993ibbILbmdr_0 2024-09-12T18:13:49.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.019+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14248275597755487091', time=2024-09-12T19:46:12.718732+0000, chain.objs.size()=1 2024-09-12T18:13:49.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.019+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.wyjxEtA9DLafElwaIZXVA8YgBFKlhFU_0 2024-09-12T18:13:49.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.019+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16626922579989900349', time=2024-09-12T19:46:13.473449+0000, chain.objs.size()=1 2024-09-12T18:13:49.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.019+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Mo9QLbzLBoaFsfBy1KV5pzAMoC5dWrs_0 2024-09-12T18:13:49.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.019+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14121656325318301429', time=2024-09-12T19:46:13.901911+0000, chain.objs.size()=1 2024-09-12T18:13:49.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.019+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.jVDs1gpAckauUZRALzXlY0HTIoTAcTZ_0 2024-09-12T18:13:49.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.019+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3275694246477631373', time=2024-09-12T19:46:14.156567+0000, chain.objs.size()=1 2024-09-12T18:13:49.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.019+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.DKEebz4gy1xKzwhGcjBTGCOMpbRts8n_0 2024-09-12T18:13:49.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.019+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11301585870376677568', time=2024-09-12T19:46:14.916485+0000, chain.objs.size()=1 2024-09-12T18:13:49.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.019+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.spRpLGyokHEp0Zd5ChA_guzn8aUnkjv_0 2024-09-12T18:13:49.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.019+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12315362823870338849', time=2024-09-12T19:46:15.475167+0000, chain.objs.size()=1 2024-09-12T18:13:49.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.019+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.RzlOafIZrEf57-xv6231wRNiuj95qNg_0 2024-09-12T18:13:49.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.019+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15668962588536360027', time=2024-09-12T19:46:15.703960+0000, chain.objs.size()=1 2024-09-12T18:13:49.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.019+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.lInHhRAK-5llzEED4MsegyuoC-vxq8Q_0 2024-09-12T18:13:49.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.019+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11651727023097916536', time=2024-09-12T19:46:16.443422+0000, chain.objs.size()=1 2024-09-12T18:13:49.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.019+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.KeByt5UJMGuB4VDWIY2yVaseSvO7DpF_0 2024-09-12T18:13:49.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.019+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.313436399248896173', time=2024-09-12T19:46:16.596085+0000, chain.objs.size()=1 2024-09-12T18:13:49.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.019+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.vgnIlyJbw-65wws-6qAWycAGDbEK1wa_0 2024-09-12T18:13:49.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.021+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.576413375490625588', time=2024-09-12T19:46:16.640988+0000, chain.objs.size()=1 2024-09-12T18:13:49.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.021+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.9gaX8-NnXy0_aiqwXhVX-K6rrMjzggr_0 2024-09-12T18:13:49.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.021+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.831619030780079360', time=2024-09-12T19:46:17.073165+0000, chain.objs.size()=1 2024-09-12T18:13:49.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.021+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.4w85LNk7Va58JE28CHFudhWYp_uAc9j_0 2024-09-12T18:13:49.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.021+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6030263199535644219', time=2024-09-12T19:46:17.523661+0000, chain.objs.size()=1 2024-09-12T18:13:49.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.021+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.hlJUz7u4Ns-riakb1UkT_TJBrW8ZDOV_0 2024-09-12T18:13:49.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.021+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4546941306441050801', time=2024-09-12T19:46:17.649826+0000, chain.objs.size()=1 2024-09-12T18:13:49.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.021+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.T737-po_n7BCFLA5nQDVAvwNrEj9qKq_0 2024-09-12T18:13:49.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.022+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5577913738448035179', time=2024-09-12T19:46:17.756265+0000, chain.objs.size()=1 2024-09-12T18:13:49.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.022+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.iGVx5ID85d9XM1RpywQO0-cObdZDPu0_0 2024-09-12T18:13:49.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.022+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15476092897055050971', time=2024-09-12T19:46:17.830741+0000, chain.objs.size()=1 2024-09-12T18:13:49.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.022+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.nc05oZgSaOF4M6pKoNqBic5Br73887u_0 2024-09-12T18:13:49.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.022+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6818849516715639101', time=2024-09-12T19:46:17.865023+0000, chain.objs.size()=1 2024-09-12T18:13:49.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.022+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.5jAMBTBl73fxhbIUsdLAJJ4xxsHPf0M_0 2024-09-12T18:13:49.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.022+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6383408952353367148', time=2024-09-12T19:46:18.431979+0000, chain.objs.size()=1 2024-09-12T18:13:49.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.022+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.9qQLmk9FTcQ-WrVkNb3twlQmUL2-j_d_0 2024-09-12T18:13:49.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.022+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16567033791733121225', time=2024-09-12T19:46:18.798015+0000, chain.objs.size()=1 2024-09-12T18:13:49.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.022+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.PdWZwOwAEnUDW3ajKGH-FxuL0pLV0Za_0 2024-09-12T18:13:49.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.022+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3869021842347217035', time=2024-09-12T19:46:19.111744+0000, chain.objs.size()=1 2024-09-12T18:13:49.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.022+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.HH-bGcUbo3eGLCsykqrmNn5YDRXQuBz_0 2024-09-12T18:13:49.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.022+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13489801265639233890', time=2024-09-12T19:46:19.226041+0000, chain.objs.size()=1 2024-09-12T18:13:49.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.022+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.PHYzZjmx-nNNsQtAYrN14Ivs9qtro09_0 2024-09-12T18:13:49.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.024+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4276437289571074946', time=2024-09-12T19:46:23.987586+0000, chain.objs.size()=1 2024-09-12T18:13:49.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.024+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.268__shadow_.-73i0Ydi3Po7wPpKev_mq6Fni_hGIxP_0 2024-09-12T18:13:49.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.024+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7282203437997750070', time=2024-09-12T19:46:23.993140+0000, chain.objs.size()=1 2024-09-12T18:13:49.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.024+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.268__shadow_.fb8hHItBznkieDMtcLtDb7ISgxMBpmr_0 2024-09-12T18:13:49.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.024+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8443658019012001827', time=2024-09-12T19:46:43.883832+0000, chain.objs.size()=1 2024-09-12T18:13:49.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.024+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.290__shadow_.yO9OInzR5ZnSsG1w9bKhkFsZUKCNg33_0 2024-09-12T18:13:49.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.024+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7195554302994418478', time=2024-09-12T19:46:51.347715+0000, chain.objs.size()=1 2024-09-12T18:13:49.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.024+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.295__shadow_.nO62OO9bMfdAHVXLsAHicUxPtEn0tFy_0 2024-09-12T18:13:49.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.024+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13851869887134744130', time=2024-09-12T19:46:58.807274+0000, chain.objs.size()=1 2024-09-12T18:13:49.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.024+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.303__shadow_.Q2o4i3J8L_-O8xBzgStJBBRuzV-UeVz_0 2024-09-12T18:13:49.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.024+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11846079851407183630', time=2024-09-12T19:47:59.456803+0000, chain.objs.size()=1 2024-09-12T18:13:49.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.024+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.2Cpt3jPDlwHUaFOxeAOotZEZc5E9Sko_0 2024-09-12T18:13:49.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.024+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16671355513277935276', time=2024-09-12T19:47:59.725766+0000, chain.objs.size()=1 2024-09-12T18:13:49.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.024+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.6v9L0BXUEBW3txobcUutrUl8ufCxU-X_0 2024-09-12T18:13:49.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.024+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1752113100110663337', time=2024-09-12T19:47:59.796812+0000, chain.objs.size()=1 2024-09-12T18:13:49.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.024+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.gzlkOsdvKa3FUjq8NrA-3SfYFD7zAxz_0 2024-09-12T18:13:49.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.024+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5786248834832602923', time=2024-09-12T19:48:01.137608+0000, chain.objs.size()=1 2024-09-12T18:13:49.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.024+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.eooeAe3lBUBgDfoKe_VUWdEiA4CG3oX_0 2024-09-12T18:13:49.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.025+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6896628091857251169', time=2024-09-12T19:48:01.374675+0000, chain.objs.size()=1 2024-09-12T18:13:49.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.025+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.CsvvERVzvJfqoqo_5vDsBlVNYHwcnvQ_0 2024-09-12T18:13:49.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.025+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13885082448385232055', time=2024-09-12T19:48:01.657914+0000, chain.objs.size()=1 2024-09-12T18:13:49.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.025+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.iH72nT9zMso3pW8hRYWN3qeI9qPDkmg_0 2024-09-12T18:13:49.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.027+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.22154338382161947', time=2024-09-12T19:48:01.822466+0000, chain.objs.size()=1 2024-09-12T18:13:49.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.027+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ELw8W7du56mJOJ9_U5269dCYJtmiT-2_0 2024-09-12T18:13:49.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.027+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10292165216042232421', time=2024-09-12T19:48:01.947457+0000, chain.objs.size()=1 2024-09-12T18:13:49.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.027+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.TjuKpP2x41QLgNlEgVvfHqLCt2oVEIF_0 2024-09-12T18:13:49.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.027+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1753143170178016541', time=2024-09-12T19:48:02.644903+0000, chain.objs.size()=1 2024-09-12T18:13:49.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.027+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.SwZEy0HJXvlgDzOEf02wlFUmIr6Teaf_0 2024-09-12T18:13:49.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.027+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5990494497644281549', time=2024-09-12T19:48:03.062449+0000, chain.objs.size()=1 2024-09-12T18:13:49.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.027+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.hagVCkBkH3cDJ1dv_-zOBYIVvJomoGq_0 2024-09-12T18:13:49.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.027+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4055000896369574807', time=2024-09-12T19:48:03.157347+0000, chain.objs.size()=1 2024-09-12T18:13:49.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.027+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.7j4G87j4HfoghAXi14wxeW6i0nHnMLC_0 2024-09-12T18:13:49.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.027+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1692839167003617161', time=2024-09-12T19:48:03.305605+0000, chain.objs.size()=1 2024-09-12T18:13:49.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.027+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.05tCqEk4kcztWyPRQ_CNQfHlubjH_gj_0 2024-09-12T18:13:49.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.027+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6321956332791608058', time=2024-09-12T19:48:03.919199+0000, chain.objs.size()=1 2024-09-12T18:13:49.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.027+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.UJ-H-x24L-2K_KMkvVajQbcM9H3JA5D_0 2024-09-12T18:13:49.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.027+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9555437603099639979', time=2024-09-12T19:48:04.048294+0000, chain.objs.size()=1 2024-09-12T18:13:49.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.027+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.poSKUNB62spouuDRtybPs83Urt0R9x7_0 2024-09-12T18:13:49.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.027+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8600454682934242998', time=2024-09-12T19:48:04.217954+0000, chain.objs.size()=1 2024-09-12T18:13:49.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.027+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.RVfZtZ6mXNlA7jafRPVIwepkQoIcYSR_0 2024-09-12T18:13:49.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.027+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.838789247028022614', time=2024-09-12T19:48:04.530263+0000, chain.objs.size()=1 2024-09-12T18:13:49.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.027+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.j1Iu8K4a595TJp5PN7j5LX2Gz4ouqEa_0 2024-09-12T18:13:49.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.027+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15513674208672364718', time=2024-09-12T19:48:04.559717+0000, chain.objs.size()=1 2024-09-12T18:13:49.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.027+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_._-82iIW59YL4PqXqwOSZ1ECEM0CvlnK_0 2024-09-12T18:13:49.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.028+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16384820122055279877', time=2024-09-12T19:48:04.859149+0000, chain.objs.size()=1 2024-09-12T18:13:49.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.028+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.BeG36L293vuIeKdDt3StnT0QmiWuedv_0 2024-09-12T18:13:49.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.030+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5766016182935924762', time=2024-09-12T19:48:05.716762+0000, chain.objs.size()=1 2024-09-12T18:13:49.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.030+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.3Wf2p_sqvt90pFOpsdo5DDjQmQGb1S-_0 2024-09-12T18:13:49.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.030+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4763411832479733951', time=2024-09-12T19:48:06.186310+0000, chain.objs.size()=1 2024-09-12T18:13:49.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.030+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.WLrSsg9ZPOxN_J6VJglYkLr-1pM4MwN_0 2024-09-12T18:13:49.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.030+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8165039547124835018', time=2024-09-12T19:48:06.793064+0000, chain.objs.size()=1 2024-09-12T18:13:49.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.030+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.4lQ3zyK-V5SAAymkCcCAfki3aZRn8Gj_0 2024-09-12T18:13:49.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.030+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13039251613943882721', time=2024-09-12T19:48:06.948950+0000, chain.objs.size()=1 2024-09-12T18:13:49.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.030+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.1dh2bQmyH_dUF_FC1mS2lVXiPrNiWoh_0 2024-09-12T18:13:49.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.030+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6079870612475518268', time=2024-09-12T19:48:06.949877+0000, chain.objs.size()=1 2024-09-12T18:13:49.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.030+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.JTA_1YcyNv_NjPXV0b7Xgoqqwl7fpjX_0 2024-09-12T18:13:49.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.030+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17728004792152831471', time=2024-09-12T19:48:06.951157+0000, chain.objs.size()=1 2024-09-12T18:13:49.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.030+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.0DEQJhXDhtsHuvGQC5CXW8daLB3rPw2_0 2024-09-12T18:13:49.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.030+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6734636267853791680', time=2024-09-12T19:48:07.642407+0000, chain.objs.size()=1 2024-09-12T18:13:49.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.030+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.A49vAQLJKhfiTB5f-VgtbiJrQ3-lBNZ_0 2024-09-12T18:13:49.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.030+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14946294594487901648', time=2024-09-12T19:48:08.392718+0000, chain.objs.size()=1 2024-09-12T18:13:49.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.030+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Ico6L1q7BjiVZbHN4eaO5sio4tlvINu_0 2024-09-12T18:13:49.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.030+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14556131766469420257', time=2024-09-12T19:48:08.507131+0000, chain.objs.size()=1 2024-09-12T18:13:49.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.030+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.mwMdJLG9IieAE7tv9_bhGSLoNsH1vv6_0 2024-09-12T18:13:49.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.030+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5458450427150768951', time=2024-09-12T19:48:08.864849+0000, chain.objs.size()=1 2024-09-12T18:13:49.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.030+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.pkIcawEznqE8-z2hkH30FuTTrNGL7pi_0 2024-09-12T18:13:49.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.030+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8824270173775248176', time=2024-09-12T19:48:09.299750+0000, chain.objs.size()=1 2024-09-12T18:13:49.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.030+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Ba0TZ2i1Py552LBo2ZNOQfmZfrU6HVH_0 2024-09-12T18:13:49.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.033+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10107594415507019771', time=2024-09-12T19:48:09.763669+0000, chain.objs.size()=1 2024-09-12T18:13:49.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.033+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.oRO871hReHia_jKEBD2jn3QkvOjVOmA_0 2024-09-12T18:13:49.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.033+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.988105874811966221', time=2024-09-12T19:48:09.842866+0000, chain.objs.size()=1 2024-09-12T18:13:49.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.033+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.e-ErjFh1ypa_N-QP2i_6bZp0OZpUKxx_0 2024-09-12T18:13:49.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.033+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3763444200259891417', time=2024-09-12T19:48:47.787898+0000, chain.objs.size()=1 2024-09-12T18:13:49.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.033+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.3nbrmgxTzfL_5ksIgvqZOBUT_y_BTYN_0 2024-09-12T18:13:49.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.033+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2753445185398394798', time=2024-09-12T19:48:47.889743+0000, chain.objs.size()=1 2024-09-12T18:13:49.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.033+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.oCMNK5VT-AnLdFaogw-GksiMXVPT6n__0 2024-09-12T18:13:49.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.033+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16677337665702697663', time=2024-09-12T19:48:48.246780+0000, chain.objs.size()=1 2024-09-12T18:13:49.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.033+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.R8XkQewdCbAg05poJoF3iCAjibe6BjA_0 2024-09-12T18:13:49.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.033+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18017284373272022339', time=2024-09-12T19:48:48.416281+0000, chain.objs.size()=1 2024-09-12T18:13:49.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.033+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.rK49L2ZNZk_2RbJOoSs0yIJ7LBQhkRa_0 2024-09-12T18:13:49.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.033+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6295072938564099596', time=2024-09-12T19:48:49.174317+0000, chain.objs.size()=1 2024-09-12T18:13:49.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.033+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ctEVgI5TMCuZKtk0mJ52xf6wUTqwA_f_0 2024-09-12T18:13:49.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.033+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12489290792549866117', time=2024-09-12T19:48:49.390794+0000, chain.objs.size()=1 2024-09-12T18:13:49.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.033+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.E_CIHmilGrOgJFInvtIAke94MbVQztq_0 2024-09-12T18:13:49.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.033+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11309109625329230918', time=2024-09-12T19:48:49.744543+0000, chain.objs.size()=1 2024-09-12T18:13:49.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.033+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.RAKgU3S3af88UQEGv-8sayLrn0PeW48_0 2024-09-12T18:13:49.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.033+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.767092809784780966', time=2024-09-12T19:48:51.198747+0000, chain.objs.size()=1 2024-09-12T18:13:49.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.033+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.4OMHXvm91MTG6ZSR2fuHh_EKCMkQzfj_0 2024-09-12T18:13:49.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.033+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4879852584134227779', time=2024-09-12T19:48:51.242174+0000, chain.objs.size()=1 2024-09-12T18:13:49.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.033+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.2Fd2VbswA5DcamD3m7ku3qSXeTETXMY_0 2024-09-12T18:13:49.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.034+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10671362853059512247', time=2024-09-12T19:48:52.110019+0000, chain.objs.size()=1 2024-09-12T18:13:49.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.034+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.YyI1pDbVEYv4fQ5SWd_g5BCviSG9vv9_0 2024-09-12T18:13:49.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.036+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1176624408250160431', time=2024-09-12T19:48:52.245476+0000, chain.objs.size()=1 2024-09-12T18:13:49.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.036+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Ps_bvvOEirE48ZwsiH_SIGYyLSXwVHS_0 2024-09-12T18:13:49.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.036+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.672009618009340695', time=2024-09-12T19:48:52.562956+0000, chain.objs.size()=1 2024-09-12T18:13:49.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.036+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.5o83PHu6nodhgTsQwU9yHa42YUCHsmC_0 2024-09-12T18:13:49.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.036+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.459396595494605858', time=2024-09-12T19:48:52.644213+0000, chain.objs.size()=1 2024-09-12T18:13:49.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.036+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.i0U-DvIL4gwRMkzdGULNBYDv5_iAX3U_0 2024-09-12T18:13:49.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.036+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2279341817453108809', time=2024-09-12T19:48:52.676761+0000, chain.objs.size()=1 2024-09-12T18:13:49.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.036+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.IB1nMCqGkjz45rrNPbIpOamQKroUsuy_0 2024-09-12T18:13:49.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.036+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12295831891369233839', time=2024-09-12T19:48:52.905567+0000, chain.objs.size()=1 2024-09-12T18:13:49.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.036+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.y2BlyXEaVbHRkQQ6cR_t98weB3bZqTr_0 2024-09-12T18:13:49.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.036+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3391955235164171865', time=2024-09-12T19:48:53.594378+0000, chain.objs.size()=1 2024-09-12T18:13:49.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.036+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.jMuip0lcKLcd1hUZ0iBdBILJyrbe165_0 2024-09-12T18:13:49.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.036+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15772310826650774230', time=2024-09-12T19:48:53.755666+0000, chain.objs.size()=1 2024-09-12T18:13:49.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.036+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.WHBkd-AVq-QOcLPE2WLkfilMRnzYL7m_0 2024-09-12T18:13:49.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.036+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.936444723436236157', time=2024-09-12T19:48:53.781290+0000, chain.objs.size()=1 2024-09-12T18:13:49.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.036+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.vE5jZ99MNbv8cRuanHy-2dZnixaiiAz_0 2024-09-12T18:13:49.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.036+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18250418265866749726', time=2024-09-12T19:48:54.622893+0000, chain.objs.size()=1 2024-09-12T18:13:49.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.036+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.pctCsks4qxhfZZLGAjdzS1DUKY4yt9q_0 2024-09-12T18:13:49.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.036+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12328251342047370292', time=2024-09-12T19:48:54.691731+0000, chain.objs.size()=1 2024-09-12T18:13:49.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.036+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.mwBY0hl2s1_0LQPq1bERIxwmlJa_3al_0 2024-09-12T18:13:49.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.036+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.240591796593373139', time=2024-09-12T19:48:54.824351+0000, chain.objs.size()=1 2024-09-12T18:13:49.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.036+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.fWDm-fvN4WXCLD6eAsaokGgFlozC6Vb_0 2024-09-12T18:13:49.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.037+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7954894157250797857', time=2024-09-12T19:48:54.909929+0000, chain.objs.size()=1 2024-09-12T18:13:49.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.037+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.N9ebMu3lolxWzVcamkJo0MJruH7Nmpg_0 2024-09-12T18:13:49.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.038+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9262387170099779349', time=2024-09-12T19:48:55.192146+0000, chain.objs.size()=1 2024-09-12T18:13:49.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.038+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.jsxB1jrzqqfM46HdwKvYccSU9oT6BT-_0 2024-09-12T18:13:49.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.038+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11295425477561816634', time=2024-09-12T19:48:56.260830+0000, chain.objs.size()=1 2024-09-12T18:13:49.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.038+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.wzTNst-UlnrsYmWEjpa9hpZN8lTmJ23_0 2024-09-12T18:13:49.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.038+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.39718164763202221', time=2024-09-12T19:48:56.590920+0000, chain.objs.size()=1 2024-09-12T18:13:49.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.038+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.3iVP5K5loLO7mDxn9O3nbB-ZpjAaPIN_0 2024-09-12T18:13:49.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.038+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16264892478210049183', time=2024-09-12T19:48:56.671221+0000, chain.objs.size()=1 2024-09-12T18:13:49.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.038+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.n4bfYTujm2BOTUJHgIYuZrGUPMncsKv_0 2024-09-12T18:13:49.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.039+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2191981297154681919', time=2024-09-12T19:48:57.546188+0000, chain.objs.size()=1 2024-09-12T18:13:49.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.039+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.WzIu6aEgii5L99EKs00dWRQVViSbV_r_0 2024-09-12T18:13:49.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.039+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7491683560148920108', time=2024-09-12T19:48:57.546822+0000, chain.objs.size()=1 2024-09-12T18:13:49.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.039+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.lX_EaAxiL1eGsdaB4kwtf43i_DaRb4F_0 2024-09-12T18:13:49.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.039+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2469155162667018416', time=2024-09-12T19:48:57.701607+0000, chain.objs.size()=1 2024-09-12T18:13:49.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.039+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ZweFRf4IWSrS7j2Zn2jdgGxtHk_yYar_0 2024-09-12T18:13:49.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.041+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/45680 2024-09-12T18:13:49.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.042+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-12T18:13:49.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.043+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16196548802426750474', time=2024-09-12T19:48:57.741533+0000, chain.objs.size()=1 2024-09-12T18:13:49.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.043+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.xj86II2Yn7sklIqezs6wcOWoquwGaLt_0 2024-09-12T18:13:49.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.043+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8940364623801658518', time=2024-09-12T19:49:06.394864+0000, chain.objs.size()=1 2024-09-12T18:13:49.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.043+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.335__shadow_.47XlUrjxbOdmpSZBOx3u23Qx-l5CSZ-_0 2024-09-12T18:13:49.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.043+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10742786038050096463', time=2024-09-12T19:49:34.188155+0000, chain.objs.size()=1 2024-09-12T18:13:49.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.043+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.370__shadow_.9QpXCCxi9ILFrR5K1pLRDSvaAaCLBFQ_0 2024-09-12T18:13:49.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.043+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7994415041884868427', time=2024-09-12T19:50:11.062729+0000, chain.objs.size()=1 2024-09-12T18:13:49.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.043+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.410__shadow_.f8f_yevcH7HXPDymwec1hfvAi9FXjyz_0 2024-09-12T18:13:49.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.043+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1601051638946058659', time=2024-09-12T19:51:28.279598+0000, chain.objs.size()=1 2024-09-12T18:13:49.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.043+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.490__shadow_.qEPCpGEqZKBgzyVIrkpJeIx0r_LqETN_0 2024-09-12T18:13:49.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.043+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15337852574093264408', time=2024-09-12T19:51:33.669781+0000, chain.objs.size()=1 2024-09-12T18:13:49.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.043+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.497__shadow_.p8b-D26SN0YNNeOuv_Go35i3AD34zjy_0 2024-09-12T18:13:49.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.043+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9907899160125486237', time=2024-09-12T19:51:35.324750+0000, chain.objs.size()=1 2024-09-12T18:13:49.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.043+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.499__shadow_.TXPmGu5dckLCje2HKu_r3vXMRI2ky0V_0 2024-09-12T18:13:49.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.043+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3408058239394478030', time=2024-09-12T19:51:40.355093+0000, chain.objs.size()=1 2024-09-12T18:13:49.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.043+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.504__shadow:-V-p6OxZtM7hRMUzkyItZ02ZaGvL5CT_.X0PQumandVzjwgbUSUv4JkorH1YhtZM_0 2024-09-12T18:13:49.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.043+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.772441537623393314', time=2024-09-12T19:51:40.372609+0000, chain.objs.size()=1 2024-09-12T18:13:49.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.043+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.504__shadow:-V-p6OxZtM7hRMUzkyItZ02ZaGvL5CT_.X0PQumandVzjwgbUSUv4JkorH1YhtZM_0 2024-09-12T18:13:49.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.043+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13516143281445008799', time=2024-09-12T19:53:17.471726+0000, chain.objs.size()=3 2024-09-12T18:13:49.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.043+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.522__multipart_mymultipart.2~eVXpPxglvMoOPamplaDltji4MgPRHu4.1 2024-09-12T18:13:49.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.043+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.522__multipart_mymultipart.2~eVXpPxglvMoOPamplaDltji4MgPRHu4.2 2024-09-12T18:13:49.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.043+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.522__multipart_mymultipart.2~eVXpPxglvMoOPamplaDltji4MgPRHu4.3 2024-09-12T18:13:49.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.044+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17169671493562179157', time=2024-09-12T19:53:22.081675+0000, chain.objs.size()=4 2024-09-12T18:13:49.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.044+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.521__shadow:CSQaFxfcFZgz5iLGWkLBbnMk4K5rieU_.iy1Io6m6q6qbnEvXF6N-PD7ofpEToUn_0 2024-09-12T18:13:49.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.045+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.521__shadow:CSQaFxfcFZgz5iLGWkLBbnMk4K5rieU_.iy1Io6m6q6qbnEvXF6N-PD7ofpEToUn_1 2024-09-12T18:13:49.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.045+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.521__shadow:CSQaFxfcFZgz5iLGWkLBbnMk4K5rieU_.iy1Io6m6q6qbnEvXF6N-PD7ofpEToUn_2 2024-09-12T18:13:49.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.045+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.521__shadow:CSQaFxfcFZgz5iLGWkLBbnMk4K5rieU_.iy1Io6m6q6qbnEvXF6N-PD7ofpEToUn_3 2024-09-12T18:13:49.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.045+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6103512198001488489', time=2024-09-12T19:55:44.939746+0000, chain.objs.size()=3 2024-09-12T18:13:49.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.045+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.526__multipart_mymultipart.2~yP9Nqsq85eSapibNQi3dh4tiG1AIVol.1 2024-09-12T18:13:49.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.045+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.526__multipart_mymultipart.2~yP9Nqsq85eSapibNQi3dh4tiG1AIVol.2 2024-09-12T18:13:49.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.045+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.526__multipart_mymultipart.2~yP9Nqsq85eSapibNQi3dh4tiG1AIVol.3 2024-09-12T18:13:49.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.045+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~NgDrC071YG8HfyKSgMLUD-ew6Gm1DRH', time=2024-09-12T19:56:09.725398+0000, chain.objs.size()=2 2024-09-12T18:13:49.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.045+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.532__multipart_mymultipart.2~NgDrC071YG8HfyKSgMLUD-ew6Gm1DRH.1 2024-09-12T18:13:49.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.046+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.532__multipart_mymultipart.2~NgDrC071YG8HfyKSgMLUD-ew6Gm1DRH.2 2024-09-12T18:13:49.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.046+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14231510343040450268', time=2024-09-12T19:56:31.832255+0000, chain.objs.size()=4 2024-09-12T18:13:49.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.046+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.536__multipart_mymultipart.2~_bI_RETzaXeAfLfLbYx7PZEA2iTL_-n.1 2024-09-12T18:13:49.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.046+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.536__multipart_mymultipart.2~_bI_RETzaXeAfLfLbYx7PZEA2iTL_-n.2 2024-09-12T18:13:49.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.047+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.536__multipart_mymultipart.f6bBWiX82Wr9UKga4dwgsOnm-ZYHmNVL.3 2024-09-12T18:13:49.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.047+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.536__multipart_mymultipart.2~_bI_RETzaXeAfLfLbYx7PZEA2iTL_-n.4 2024-09-12T18:13:49.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.048+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.201499767799800281', time=2024-09-12T19:58:07.185275+0000, chain.objs.size()=1 2024-09-12T18:13:49.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.048+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:Rta5FrkhX5lRyusNDUOQw8n0S8sb9A6_.MKT8mkmWOXcQqcrRmH2OaB42qDGXmwv_0 2024-09-12T18:13:49.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.048+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10092998765467280125', time=2024-09-12T19:58:08.820746+0000, chain.objs.size()=1 2024-09-12T18:13:49.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.048+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.571__shadow:gCJOyALGNsxvUqNrOBMNbu.TznqXuaH_.7gz-FySO63R9y7wHIxsJzVidFM7ZxNd_0 2024-09-12T18:13:49.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.048+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3222338360759308275', time=2024-09-12T19:58:15.482774+0000, chain.objs.size()=1 2024-09-12T18:13:49.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.048+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.575__shadow:usYj41SDrh6wXqPHEwuTT8SNAGMPuNO_.06L1GDMK_1yaMCQ_NNaKuzXWQkX2TlS_0 2024-09-12T18:13:49.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.048+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4940726684253918681', time=2024-09-12T19:58:36.894458+0000, chain.objs.size()=1 2024-09-12T18:13:49.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.048+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:5cR3SklRwcLHKsEJxAPWHEQUDsHQEv5_.ceBf6I5Hie0S2vOAW5gLoJEEo-RSt_V_0 2024-09-12T18:13:49.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.048+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8427934067939187851', time=2024-09-12T19:59:41.154447+0000, chain.objs.size()=1 2024-09-12T18:13:49.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.048+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.588__shadow:ADol-C.LsfBbyahFeC6mdI0iZ-1Hu7G_.PuudNN3_1oDYbl2e1UKWRCOobCg70d6_0 2024-09-12T18:13:49.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.048+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6228264856602324356', time=2024-09-12T19:59:48.158829+0000, chain.objs.size()=1 2024-09-12T18:13:49.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.048+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.597__shadow_.fznTYH8qh6sh-6l1n0bd35W-RLtP6-h_0 2024-09-12T18:13:49.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.048+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1789281241230788084', time=2024-09-12T20:04:57.769011+0000, chain.objs.size()=1 2024-09-12T18:13:49.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.048+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.634__shadow_._FwVXcwrqcLtd2olRBS-_ATw3Q3-Vwe_0 2024-09-12T18:13:49.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.048+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15198787613104992686', time=2024-09-12T20:06:07.027410+0000, chain.objs.size()=1 2024-09-12T18:13:49.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.048+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.669__shadow_.mkNXFXnPVDBQSV7TAAuCi0DvvaPurAA_0 2024-09-12T18:13:49.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.049+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1683865342435097873', time=2024-09-12T20:07:05.090190+0000, chain.objs.size()=1 2024-09-12T18:13:49.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.049+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.718__shadow:h9PtSP6EA9bhwxXNuhShns7aA9kiQBR_.hMkfNbr3uvumh-eVmk_xMf0IvWwMW_c_0 2024-09-12T18:13:49.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.051+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:49.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.053+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:13:49.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.054+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:49.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.055+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:49.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.055+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51098' 2024-09-12T18:13:49.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.055+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8737459454395331505', time=2024-09-12T19:41:35.470712+0000, chain.objs.size()=1 2024-09-12T18:13:49.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.055+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.161__shadow_.Uut3MbBUDSPXgoq3ox0jlL3tDrcV8rl_0 2024-09-12T18:13:49.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.055+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='_ykMXUrsz7J7FvSkYYZ9L8FJ7TPTzV6X', time=2024-09-12T19:41:42.294838+0000, chain.objs.size()=3 2024-09-12T18:13:49.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.055+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.161__shadow_.yIMbSL83x5QPn7FvERLo2fmHoFJiPOd_0 2024-09-12T18:13:49.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.055+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.161__shadow_.yIMbSL83x5QPn7FvERLo2fmHoFJiPOd_1 2024-09-12T18:13:49.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.055+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.161__shadow_.yIMbSL83x5QPn7FvERLo2fmHoFJiPOd_2 2024-09-12T18:13:49.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.055+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12925207736937660672', time=2024-09-12T19:42:41.380699+0000, chain.objs.size()=1 2024-09-12T18:13:49.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.055+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.178__shadow_.LqcMxgaxBDCRVxVztZ3EOo3ad9kTBDC_0 2024-09-12T18:13:49.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.055+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13930385722804409693', time=2024-09-12T19:45:23.669509+0000, chain.objs.size()=1 2024-09-12T18:13:49.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.055+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.253__shadow_.54NdiElIK0O-a9gAu67LGHgOzQqw7-7_0 2024-09-12T18:13:49.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.055+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1543097740007548365', time=2024-09-12T19:45:24.570964+0000, chain.objs.size()=1 2024-09-12T18:13:49.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.055+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.254__shadow_.6EJJa3Hgq1HxWEpjidVZndlYmrYE-KA_0 2024-09-12T18:13:49.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.055+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13547382317696577971', time=2024-09-12T19:45:30.822539+0000, chain.objs.size()=1 2024-09-12T18:13:49.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.055+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.261__shadow_.z5YQdKOaabJHNGPkUCMrS06ggHs1FH8_0 2024-09-12T18:13:49.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.055+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11343618402820730502', time=2024-09-12T19:46:09.332078+0000, chain.objs.size()=1 2024-09-12T18:13:49.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.055+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.3K8id7t1-MnyttBjWGs0kXs3f46K-nY_0 2024-09-12T18:13:49.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.055+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13267834023210721257', time=2024-09-12T19:46:09.840537+0000, chain.objs.size()=1 2024-09-12T18:13:49.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.055+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.60crrLp3uiX84um0ne4oEUXDriw99or_0 2024-09-12T18:13:49.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.055+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6829320104002490712', time=2024-09-12T19:46:10.511930+0000, chain.objs.size()=1 2024-09-12T18:13:49.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.055+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Vsq7Lb0zV6InhsQTA3V2gJa4MUFnLDN_0 2024-09-12T18:13:49.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.055+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2994884875300675439', time=2024-09-12T19:46:10.572632+0000, chain.objs.size()=1 2024-09-12T18:13:49.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.055+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.3wmMp3pHbQ2y7CwRLAxvrhJAWeQct6F_0 2024-09-12T18:13:49.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.057+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9612682906346126616', time=2024-09-12T19:46:10.935638+0000, chain.objs.size()=1 2024-09-12T18:13:49.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.057+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.TgEL0iQdRTXTg8Ev4LoYmOp7a-bpJQU_0 2024-09-12T18:13:49.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.058+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7391874011936202743', time=2024-09-12T19:46:11.083220+0000, chain.objs.size()=1 2024-09-12T18:13:49.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.058+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.d0ZZ028XclEniQhcd4qEWptrhT_PN0y_0 2024-09-12T18:13:49.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.058+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17593580856671320082', time=2024-09-12T19:46:11.860879+0000, chain.objs.size()=1 2024-09-12T18:13:49.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.058+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.2-fHn7aJIRqkg6-wC5MDWE-Zi7LQudD_0 2024-09-12T18:13:49.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.058+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.309692590841431040', time=2024-09-12T19:46:12.005070+0000, chain.objs.size()=1 2024-09-12T18:13:49.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.058+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.EoS294pFS-BtoWMlFmie2aCQXdn4TuO_0 2024-09-12T18:13:49.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.058+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.647621872713422941', time=2024-09-12T19:46:12.292412+0000, chain.objs.size()=1 2024-09-12T18:13:49.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.058+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.21EMCBG00gDoPTEqNhJ71ajq7VSulOf_0 2024-09-12T18:13:49.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.058+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16844927179419786243', time=2024-09-12T19:46:12.658814+0000, chain.objs.size()=1 2024-09-12T18:13:49.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.058+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.4gSiGnUHGAv-wgBYDb9UOXJaU1ylMMT_0 2024-09-12T18:13:49.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.058+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5381613329092822025', time=2024-09-12T19:46:12.776429+0000, chain.objs.size()=1 2024-09-12T18:13:49.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.058+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.dXdYyTFMO7sIiQZtx41PRdBRr1uEA8C_0 2024-09-12T18:13:49.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.058+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7618926170362644874', time=2024-09-12T19:46:13.701647+0000, chain.objs.size()=1 2024-09-12T18:13:49.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.058+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.dFHmCbZnjJcsBKmW6jqZFq0dAFHHd-E_0 2024-09-12T18:13:49.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.058+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7120021323979150251', time=2024-09-12T19:46:15.188649+0000, chain.objs.size()=1 2024-09-12T18:13:49.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.058+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_._NUCyYje6PsynCT6a_0c-MTloyrj3Li_0 2024-09-12T18:13:49.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.058+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18300899617001025261', time=2024-09-12T19:46:15.508439+0000, chain.objs.size()=1 2024-09-12T18:13:49.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.058+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.xcVbK9NicynDaBL4fvpvSMPuSfpkbVs_0 2024-09-12T18:13:49.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.058+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5949502081274717759', time=2024-09-12T19:46:16.300588+0000, chain.objs.size()=1 2024-09-12T18:13:49.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.058+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_._X350bLtypZRTRVz8fuL8V1xKaql2r-_0 2024-09-12T18:13:49.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.059+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14919739057007085855', time=2024-09-12T19:46:16.393099+0000, chain.objs.size()=1 2024-09-12T18:13:49.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.059+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.N1FJAgWpbwTQx2aCp5SjyuBlGVGsnNd_0 2024-09-12T18:13:49.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.060+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13104741192904961874', time=2024-09-12T19:46:16.487879+0000, chain.objs.size()=1 2024-09-12T18:13:49.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.060+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.GkUmgESi9q19oY9D_W1aUaLZX3AwoeK_0 2024-09-12T18:13:49.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.060+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6051006928622664103', time=2024-09-12T19:46:18.754843+0000, chain.objs.size()=1 2024-09-12T18:13:49.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.060+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.zOCscxOghK3QRpCp6S0UjMjL0hY3XJ3_0 2024-09-12T18:13:49.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.062+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9997132418931571684', time=2024-09-12T19:46:18.791993+0000, chain.objs.size()=1 2024-09-12T18:13:49.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.062+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ttsGe3PuAq58VWDoAr6ZJ6D0bE-_ccv_0 2024-09-12T18:13:49.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.062+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10516196416861240090', time=2024-09-12T19:46:19.206427+0000, chain.objs.size()=1 2024-09-12T18:13:49.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.062+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Nge9VR2gz7q7CBWdnN7l-JLZUVOHs8h_0 2024-09-12T18:13:49.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.062+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13763986121908375206', time=2024-09-12T19:46:19.585973+0000, chain.objs.size()=1 2024-09-12T18:13:49.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.062+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ZkLM1fxHlz6Q8nHmgWLfy8cqERIlHCi_0 2024-09-12T18:13:49.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.062+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3944148580849274899', time=2024-09-12T19:46:20.487149+0000, chain.objs.size()=1 2024-09-12T18:13:49.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.062+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.264__shadow_.7e-gmBgq33TkvyqGmmytQqjJdtoHnB-_0 2024-09-12T18:13:49.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.062+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3746336556662613280', time=2024-09-12T19:46:24.857340+0000, chain.objs.size()=1 2024-09-12T18:13:49.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.062+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.269__shadow_.qXid0SkM6lClb5C4ZscUO_FYQoRgOGA_0 2024-09-12T18:13:49.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.063+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14513243190952257492', time=2024-09-12T19:46:32.831068+0000, chain.objs.size()=1 2024-09-12T18:13:49.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.063+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.278__shadow_.L_PmD7xLlVA9DidRThpu8WNN2UKxuwS_0 2024-09-12T18:13:49.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.063+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7798598810129322718', time=2024-09-12T19:46:34.638337+0000, chain.objs.size()=1 2024-09-12T18:13:49.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.063+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.280__shadow_.UpWTN_zmab-uzgiy_ha7mP6dtNj2r6V_0 2024-09-12T18:13:49.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.063+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7106058800022997677', time=2024-09-12T19:46:48.159626+0000, chain.objs.size()=1 2024-09-12T18:13:49.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.063+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.293__shadow_.g-pCoe4acATgu_2QAyNyTqXHhZd2Qhe_0 2024-09-12T18:13:49.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.063+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8708181502672556857', time=2024-09-12T19:46:48.160374+0000, chain.objs.size()=1 2024-09-12T18:13:49.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.063+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.293__shadow_.N5KWaGeaS5lO6IaJZSOqL9w_rFBQUCY_0 2024-09-12T18:13:49.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.063+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11495533669362972985', time=2024-09-12T19:46:50.418599+0000, chain.objs.size()=1 2024-09-12T18:13:49.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.063+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.294__shadow_.Ti9nLj-zDwCpHd8WARwgnUlRhU2KURE_0 2024-09-12T18:13:49.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.063+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15760060826930967342', time=2024-09-12T19:47:01.579330+0000, chain.objs.size()=1 2024-09-12T18:13:49.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.063+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.306__shadow_.E-PkWDFQeZUDEbEd73cixnUANbJy9hI_0 2024-09-12T18:13:49.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.064+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2438573998146773041', time=2024-09-12T19:48:00.206838+0000, chain.objs.size()=1 2024-09-12T18:13:49.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.064+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.2FYCQJ3Wz9bkJgoF7-BdQ-mXiN-k3cw_0 2024-09-12T18:13:49.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.065+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11446480644402576763', time=2024-09-12T19:48:00.298513+0000, chain.objs.size()=1 2024-09-12T18:13:49.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.065+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.7VSxfyvqVK2TAtGT51O_ckK3XTIZjG6_0 2024-09-12T18:13:49.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.065+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13276606352106719655', time=2024-09-12T19:48:01.028839+0000, chain.objs.size()=1 2024-09-12T18:13:49.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.065+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.0Ovps4iAD0eR59L4-JE_-Che8hGJflJ_0 2024-09-12T18:13:49.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.065+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17916425055970296401', time=2024-09-12T19:48:01.152911+0000, chain.objs.size()=1 2024-09-12T18:13:49.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.065+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.S6HahacF-CH9GSeyKHOagK_H_eJO5ec_0 2024-09-12T18:13:49.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.065+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1035153166561632790', time=2024-09-12T19:48:01.637732+0000, chain.objs.size()=1 2024-09-12T18:13:49.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.065+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_._T_1KimzXIVQ1FKItspQkir0t4X0PBs_0 2024-09-12T18:13:49.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.065+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4810111239893516785', time=2024-09-12T19:48:01.713271+0000, chain.objs.size()=1 2024-09-12T18:13:49.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.065+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.l1v1VyNSBk-tycwRY6CfjdUJQn3pZ1P_0 2024-09-12T18:13:49.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.066+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16753910863872459972', time=2024-09-12T19:48:01.832715+0000, chain.objs.size()=1 2024-09-12T18:13:49.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.066+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.GvHEyyuVnDSXK0KNbGSEl8mF_1p0WaW_0 2024-09-12T18:13:49.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.066+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12967753792575054490', time=2024-09-12T19:48:01.974138+0000, chain.objs.size()=1 2024-09-12T18:13:49.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.066+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.sZFkrQSF-EBBMkwqnRqj6rIS9Tm7mUn_0 2024-09-12T18:13:49.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.066+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15442893368984812303', time=2024-09-12T19:48:01.989745+0000, chain.objs.size()=1 2024-09-12T18:13:49.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.066+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.uxYN0nO9Jt3NSbHQZARA6SIR--pNvfk_0 2024-09-12T18:13:49.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.066+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12740122350196366097', time=2024-09-12T19:48:02.694696+0000, chain.objs.size()=1 2024-09-12T18:13:49.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.066+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.FNhWWsw0yrxuegJObJgIDm6S1xYgE-I_0 2024-09-12T18:13:49.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.066+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4641193108448581682', time=2024-09-12T19:48:02.831117+0000, chain.objs.size()=1 2024-09-12T18:13:49.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.066+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.nkVc5xNWodf98sFfV64DQMnuFVEN6iW_0 2024-09-12T18:13:49.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.066+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7690862771171564130', time=2024-09-12T19:48:02.913824+0000, chain.objs.size()=1 2024-09-12T18:13:49.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.066+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.xem0D84PWjrSczzb3ePwBWhllm0rxxD_0 2024-09-12T18:13:49.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.067+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18244238476827780490', time=2024-09-12T19:48:02.914317+0000, chain.objs.size()=1 2024-09-12T18:13:49.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.067+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.emavP83OTX65eQ7zUxqXK0_OwgtMh1j_0 2024-09-12T18:13:49.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.067+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6341906781653740683', time=2024-09-12T19:48:03.006174+0000, chain.objs.size()=1 2024-09-12T18:13:49.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.067+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.JEGqydohcPLld33vw2I7esG1DcoILXh_0 2024-09-12T18:13:49.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.068+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2979090496950505328', time=2024-09-12T19:48:03.057573+0000, chain.objs.size()=1 2024-09-12T18:13:49.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.068+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.lWLvG_QoLsuygXQJZ0bI4qinQFca5QU_0 2024-09-12T18:13:49.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.068+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15301754976981530556', time=2024-09-12T19:48:03.060536+0000, chain.objs.size()=1 2024-09-12T18:13:49.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.068+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ESRrNQmyh8pwGZClW8m_RpfcYLiMOPA_0 2024-09-12T18:13:49.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.068+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7860121846230935678', time=2024-09-12T19:48:03.888977+0000, chain.objs.size()=1 2024-09-12T18:13:49.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.068+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.m1-2-5BpvnJAE25_WzRxm3IIEiieMct_0 2024-09-12T18:13:49.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.068+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4901874945728533352', time=2024-09-12T19:48:03.943251+0000, chain.objs.size()=1 2024-09-12T18:13:49.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.068+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.c9n9t0xelFGQmr-JHAdpLFhBgVp-zVm_0 2024-09-12T18:13:49.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.068+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16856297771261521048', time=2024-09-12T19:48:04.660183+0000, chain.objs.size()=1 2024-09-12T18:13:49.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.068+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.sPWGQTETNqHB0Lltna2uZhmzvWtHZot_0 2024-09-12T18:13:49.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.068+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16839670036033009792', time=2024-09-12T19:48:05.594827+0000, chain.objs.size()=1 2024-09-12T18:13:49.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.068+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.CMFxWy2mK1a7XsNtg8SOiqP_yjBk-no_0 2024-09-12T18:13:49.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.068+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7942881615246097797', time=2024-09-12T19:48:06.237191+0000, chain.objs.size()=1 2024-09-12T18:13:49.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.068+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ftv44yhz39eLM9-U4TeQOm0IW4CYqzR_0 2024-09-12T18:13:49.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.068+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13147184224355623470', time=2024-09-12T19:48:06.823784+0000, chain.objs.size()=1 2024-09-12T18:13:49.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.068+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.3lM7zljWeX_fu79jM9_mbdqRJQV14SX_0 2024-09-12T18:13:49.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.068+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5872118212421399797', time=2024-09-12T19:48:06.827453+0000, chain.objs.size()=1 2024-09-12T18:13:49.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.068+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.cLI1tUcWH53Mv5am1QmloNMkOL5wOTj_0 2024-09-12T18:13:49.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.068+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2268396720613662771', time=2024-09-12T19:48:06.828021+0000, chain.objs.size()=1 2024-09-12T18:13:49.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.068+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.G1TWJIJuVZoPDx57Cz3fkiBEZd2n0sN_0 2024-09-12T18:13:49.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.068+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8490469727814457037', time=2024-09-12T19:48:07.217496+0000, chain.objs.size()=1 2024-09-12T18:13:49.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.068+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Bc-KcZ3HO5tn88mivQFguqmPkpZ0glv_0 2024-09-12T18:13:49.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.070+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.908881269502740308', time=2024-09-12T19:48:07.401318+0000, chain.objs.size()=1 2024-09-12T18:13:49.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.070+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.USowR9qp0L1A9hnrtmPduAZQvkTY-KC_0 2024-09-12T18:13:49.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.070+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12894372503786287708', time=2024-09-12T19:48:07.644081+0000, chain.objs.size()=1 2024-09-12T18:13:49.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.070+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_._N91lYFsXzZOwzd7MXm-7dqF_LdTGgH_0 2024-09-12T18:13:49.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.072+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7793066108074402313', time=2024-09-12T19:48:08.007307+0000, chain.objs.size()=1 2024-09-12T18:13:49.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.072+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.1xCkKzyMjaloxBmr1arrLortSb4Np5u_0 2024-09-12T18:13:49.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.072+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2400520307297280631', time=2024-09-12T19:48:08.103095+0000, chain.objs.size()=1 2024-09-12T18:13:49.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.072+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.DXJwgn7QxBuu48BnETsC2OAjh-zzdGQ_0 2024-09-12T18:13:49.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.072+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1214426454996536689', time=2024-09-12T19:48:08.278098+0000, chain.objs.size()=1 2024-09-12T18:13:49.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.072+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.1gCL7kfQ2uS370qyAJRT-75Pcn3LCt8_0 2024-09-12T18:13:49.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.072+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8052925379665789163', time=2024-09-12T19:48:08.395254+0000, chain.objs.size()=1 2024-09-12T18:13:49.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.072+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.bYhTy-lHEd9UlYa4VhDDgVaMpntcGeK_0 2024-09-12T18:13:49.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.072+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16519775286871383941', time=2024-09-12T19:48:08.656296+0000, chain.objs.size()=1 2024-09-12T18:13:49.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.072+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.jNpuEoLED5GNW-5qpov6ZdZaShvXdi5_0 2024-09-12T18:13:49.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.075+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1805967210229100147', time=2024-09-12T19:48:08.884151+0000, chain.objs.size()=1 2024-09-12T18:13:49.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.075+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.dzIflP9Wa1V2VcRDyGCxgjA7A5g-kiC_0 2024-09-12T18:13:49.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.075+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9414938882761326048', time=2024-09-12T19:48:08.967357+0000, chain.objs.size()=1 2024-09-12T18:13:49.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.075+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.rbqRtCCoYM1G06-xAKaAmIA3GahYXJC_0 2024-09-12T18:13:49.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.075+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2087114076134765008', time=2024-09-12T19:48:09.423086+0000, chain.objs.size()=1 2024-09-12T18:13:49.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.075+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.m0-YA-oB9a-DSQUa0x4Oa-UPnFVxTxA_0 2024-09-12T18:13:49.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.075+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2321340290539960357', time=2024-09-12T19:48:47.993234+0000, chain.objs.size()=1 2024-09-12T18:13:49.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.075+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.d7KVj383lDs2i8hHKkIJ21z9Fnp3xDw_0 2024-09-12T18:13:49.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.075+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17378564952949580037', time=2024-09-12T19:48:48.214979+0000, chain.objs.size()=1 2024-09-12T18:13:49.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.075+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.5WU2yCSP5fo48jSh_IJ6s2yGl6unWfM_0 2024-09-12T18:13:49.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.075+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2653374821108143324', time=2024-09-12T19:48:49.075319+0000, chain.objs.size()=1 2024-09-12T18:13:49.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.075+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.DxhwogvtbsLaLMc_SQzUdPkAPLvqcP__0 2024-09-12T18:13:49.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.078+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12850115558160392937', time=2024-09-12T19:48:49.549325+0000, chain.objs.size()=1 2024-09-12T18:13:49.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.078+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.jAzgwLDumODrRN7nXLwcL9URDbrMUVm_0 2024-09-12T18:13:49.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.078+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12408327968161374373', time=2024-09-12T19:48:49.849761+0000, chain.objs.size()=1 2024-09-12T18:13:49.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.078+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.jW_OYpXREd73GrA38ASc0myAjzeQgxl_0 2024-09-12T18:13:49.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.078+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.796072606839645194', time=2024-09-12T19:48:49.921273+0000, chain.objs.size()=1 2024-09-12T18:13:49.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.078+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.M9WxXO9DyBfne3bN3OJj6hPw6H1TKoB_0 2024-09-12T18:13:49.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.078+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2392352248521282344', time=2024-09-12T19:48:49.933343+0000, chain.objs.size()=1 2024-09-12T18:13:49.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.078+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ycSVwua4DZ-zc94Bz_0IxBfJndDd3hV_0 2024-09-12T18:13:49.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.078+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11474208276893238527', time=2024-09-12T19:48:50.746641+0000, chain.objs.size()=1 2024-09-12T18:13:49.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.078+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.nGcRTf5qeOjTnv98d2-ogf8msnueO0T_0 2024-09-12T18:13:49.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.078+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16292757795544737783', time=2024-09-12T19:48:50.799995+0000, chain.objs.size()=1 2024-09-12T18:13:49.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.078+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Maq-q56NgYo3RnX7FnfbAAQhPat3NlP_0 2024-09-12T18:13:49.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.078+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2956235616003018474', time=2024-09-12T19:48:50.911228+0000, chain.objs.size()=1 2024-09-12T18:13:49.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.078+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.iSk-M0sCNspASFJIg2IiySKbJdVAWE__0 2024-09-12T18:13:49.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.078+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.160524357486323798', time=2024-09-12T19:48:51.152980+0000, chain.objs.size()=1 2024-09-12T18:13:49.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.078+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.XaRLNtzbAlRdzW-yje_sJWTzT1XP_vb_0 2024-09-12T18:13:49.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.078+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7392584703588651722', time=2024-09-12T19:48:52.104601+0000, chain.objs.size()=1 2024-09-12T18:13:49.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.078+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.6DFJHXuiu2GtPLzbA3POpPTGQKvpIRG_0 2024-09-12T18:13:49.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.078+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6760385955789585611', time=2024-09-12T19:48:52.134475+0000, chain.objs.size()=1 2024-09-12T18:13:49.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.078+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.eWnktxrDOXvPIzW7MEVxrh0EK8Fpz8R_0 2024-09-12T18:13:49.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.078+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16333396132039610933', time=2024-09-12T19:48:52.440529+0000, chain.objs.size()=1 2024-09-12T18:13:49.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.078+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.QdEQ6e-FHmQpXmVpsaIkSvs_z1OBa_p_0 2024-09-12T18:13:49.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.081+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5226068172599661506', time=2024-09-12T19:48:52.452406+0000, chain.objs.size()=1 2024-09-12T18:13:49.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.081+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.a__iOfqx4wRkD97gkuhRMoJwnNLuU5y_0 2024-09-12T18:13:49.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.081+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11357292105145924588', time=2024-09-12T19:48:52.548023+0000, chain.objs.size()=1 2024-09-12T18:13:49.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.081+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.gBUPKEyc8PI28ddheg14pvXgxQsRWPm_0 2024-09-12T18:13:49.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.081+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7392300076026094749', time=2024-09-12T19:48:53.957150+0000, chain.objs.size()=1 2024-09-12T18:13:49.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.081+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.W4wiGyozkJlUnstEAIKFPXVGgIAZ0q__0 2024-09-12T18:13:49.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.081+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10360143969221019681', time=2024-09-12T19:48:54.118048+0000, chain.objs.size()=1 2024-09-12T18:13:49.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.081+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.nHLU2_Xfll_U3HHGJkrvyv-4d2Tm8Rp_0 2024-09-12T18:13:49.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.081+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2825731547458627323', time=2024-09-12T19:48:54.236751+0000, chain.objs.size()=1 2024-09-12T18:13:49.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.081+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.eUvSEXiDK-sW5GCXnIl_ue7jN5M7vfB_0 2024-09-12T18:13:49.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.081+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8065389693488304092', time=2024-09-12T19:48:54.284871+0000, chain.objs.size()=1 2024-09-12T18:13:49.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.081+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.KJYs42W2RczV7YfKu60hQLR_zpu1CAn_0 2024-09-12T18:13:49.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.081+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.370203600174513708', time=2024-09-12T19:48:54.285404+0000, chain.objs.size()=1 2024-09-12T18:13:49.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.081+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.JjNW9BBb6A3H9VQL4CDX4OY0h4rTSbN_0 2024-09-12T18:13:49.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.081+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10522553879350188281', time=2024-09-12T19:48:55.204746+0000, chain.objs.size()=1 2024-09-12T18:13:49.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.081+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.qiXq6i8b9Cql5pkkKDwnPLOwCD2Zkkd_0 2024-09-12T18:13:49.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.081+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4605654316724740671', time=2024-09-12T19:48:55.433115+0000, chain.objs.size()=1 2024-09-12T18:13:49.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.081+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.c1Oks2nJVEeREZ_NAZciGyN3Ce6wc7i_0 2024-09-12T18:13:49.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.081+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6733965738754814707', time=2024-09-12T19:48:55.959222+0000, chain.objs.size()=1 2024-09-12T18:13:49.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.081+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.DlfZBr-2lAJrliZHcrQYPckZZi1oESw_0 2024-09-12T18:13:49.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.081+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.866068588799087016', time=2024-09-12T19:48:56.164714+0000, chain.objs.size()=1 2024-09-12T18:13:49.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.081+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.bcmsedtXfRM7zFSyHDft1_N0qzq9hnT_0 2024-09-12T18:13:49.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.082+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9024397514837943928', time=2024-09-12T19:48:56.512450+0000, chain.objs.size()=1 2024-09-12T18:13:49.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.082+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.VWLaLIdLmRc7vKbbmd1oHIkCXbm3uKM_0 2024-09-12T18:13:49.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.084+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1721528881844773796', time=2024-09-12T19:48:56.573899+0000, chain.objs.size()=1 2024-09-12T18:13:49.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.084+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.0KmXwLbI8dhUdwSc2Hx04dzQkqj7c34_0 2024-09-12T18:13:49.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.084+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9273455316567698640', time=2024-09-12T19:48:56.814544+0000, chain.objs.size()=1 2024-09-12T18:13:49.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.084+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.vVtU3-WXwqpn5jEUg0WX-RWNUpbugW1_0 2024-09-12T18:13:49.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.084+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15200075346719198189', time=2024-09-12T19:48:56.896933+0000, chain.objs.size()=1 2024-09-12T18:13:49.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.084+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.5r1Eox4XBrcqB-hcqfRR_eCb0AD8YKk_0 2024-09-12T18:13:49.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.084+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17724969783449933030', time=2024-09-12T19:48:57.403165+0000, chain.objs.size()=1 2024-09-12T18:13:49.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.084+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.7HnnbEKnYLf2OxapVpbiE4VYdVyePTd_0 2024-09-12T18:13:49.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.085+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/51098 2024-09-12T18:13:49.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.088+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T18:13:49.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.088+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18109224758264324928', time=2024-09-12T19:48:57.427512+0000, chain.objs.size()=1 2024-09-12T18:13:49.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.088+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.hSYt5jMculIc8pZy0NZb4MbMPk6nFxg_0 2024-09-12T18:13:49.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.088+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9914351277991918115', time=2024-09-12T19:48:57.447861+0000, chain.objs.size()=1 2024-09-12T18:13:49.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.088+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ABQOnKZCUkoCk3CwiDWaDLS93-5MUh1_0 2024-09-12T18:13:49.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.088+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15614754271840672238', time=2024-09-12T19:48:57.887335+0000, chain.objs.size()=1 2024-09-12T18:13:49.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.088+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.wJDATffDv-on__T-EXdm2fLD8mTrsci_0 2024-09-12T18:13:49.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.088+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9188120185551614099', time=2024-09-12T19:48:57.991078+0000, chain.objs.size()=1 2024-09-12T18:13:49.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.088+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.lVcw61O_nm8DRmzmi74WVrw2siAncI-_0 2024-09-12T18:13:49.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.088+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4700188098426769976', time=2024-09-12T19:49:37.530608+0000, chain.objs.size()=1 2024-09-12T18:13:49.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.088+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.374__shadow_.LrrJ8zUz751V2fs_3KZx0VGUqo6ch-F_0 2024-09-12T18:13:49.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.088+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10472333917676067806', time=2024-09-12T19:50:59.145376+0000, chain.objs.size()=1 2024-09-12T18:13:49.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.088+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.460__shadow_.u0ysCjwTrcjPLC2Me_Ry7NCtAGq_MzA_0 2024-09-12T18:13:49.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.088+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7783689446780890667', time=2024-09-12T19:51:05.267378+0000, chain.objs.size()=1 2024-09-12T18:13:49.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.088+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.465__shadow_.ulfr7A3Vxrr2zP-pznS4C4itWxPwzoF_0 2024-09-12T18:13:49.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.088+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17261863866257653572', time=2024-09-12T19:51:16.092871+0000, chain.objs.size()=1 2024-09-12T18:13:49.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.088+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.482__shadow_.hqjNgS7DwUD6t5aKJuNtRqxAL2ornj4_0 2024-09-12T18:13:49.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.088+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4529323790401168268', time=2024-09-12T19:51:18.572468+0000, chain.objs.size()=1 2024-09-12T18:13:49.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.088+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.484__shadow_.uSsjnKd4VpKLSqZcYq_0e1F08MdaHK-_0 2024-09-12T18:13:49.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.088+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7116687941563295184', time=2024-09-12T19:52:10.848812+0000, chain.objs.size()=6 2024-09-12T18:13:49.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.088+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.1 2024-09-12T18:13:49.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.088+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.2 2024-09-12T18:13:49.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.088+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.3 2024-09-12T18:13:49.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.090+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.4 2024-09-12T18:13:49.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.092+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.5 2024-09-12T18:13:49.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.092+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.6 2024-09-12T18:13:49.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.092+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9974662013580237650', time=2024-09-12T19:52:10.849677+0000, chain.objs.size()=6 2024-09-12T18:13:49.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.092+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.1 2024-09-12T18:13:49.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.092+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.2 2024-09-12T18:13:49.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.092+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.3 2024-09-12T18:13:49.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.092+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.4 2024-09-12T18:13:49.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.092+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.5 2024-09-12T18:13:49.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.092+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.6 2024-09-12T18:13:49.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.092+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11607642261910859658', time=2024-09-12T19:52:16.274125+0000, chain.objs.size()=1 2024-09-12T18:13:49.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.092+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.514__multipart_mymultipart.2~ZFMBqqToKkV8Ay-kd13AwAw8XQyk6TN.1 2024-09-12T18:13:49.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.092+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6652209247591354164', time=2024-09-12T19:53:11.612238+0000, chain.objs.size()=3 2024-09-12T18:13:49.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.092+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.522__multipart_mymultipart.2~uEe5cWz42daT21lNWjNoAs4h2hH3QFB.1 2024-09-12T18:13:49.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.092+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.522__multipart_mymultipart.2~uEe5cWz42daT21lNWjNoAs4h2hH3QFB.2 2024-09-12T18:13:49.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.094+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.522__multipart_mymultipart.2~uEe5cWz42daT21lNWjNoAs4h2hH3QFB.3 2024-09-12T18:13:49.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.094+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13419859093598642889', time=2024-09-12T19:56:01.411240+0000, chain.objs.size()=2 2024-09-12T18:13:49.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.094+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.529__multipart_mymultipart.2~3uQXI_aREB0mNaLmIVHOw8OV7a3PPPn.1 2024-09-12T18:13:49.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.094+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.529__multipart_mymultipart.2~3uQXI_aREB0mNaLmIVHOw8OV7a3PPPn.2 2024-09-12T18:13:49.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.094+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13597426920926191019', time=2024-09-12T19:57:42.589539+0000, chain.objs.size()=1 2024-09-12T18:13:49.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.094+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.562__multipart_mymultipart.2~lNfM7Zm0FnihDgiNX13A3MbqfctqpDC.1 2024-09-12T18:13:49.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.094+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9021399335767814437', time=2024-09-12T19:57:58.865177+0000, chain.objs.size()=1 2024-09-12T18:13:49.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.094+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:KhLyspABZ.iSXnTml7NbYsXBri.SL9T_.5lkJPu-5ml3Fl-bjO7w1ISdmTny7KWl_0 2024-09-12T18:13:49.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.094+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11753068117093820271', time=2024-09-12T19:57:59.991833+0000, chain.objs.size()=1 2024-09-12T18:13:49.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.094+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:LtziupkDVT2lhMzvW6ysP77DVGf26qX_.0LYpWhUq1ThpWsJnn9fXhfYVeugF8i7_0 2024-09-12T18:13:49.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.096+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12082070982617293312', time=2024-09-12T19:58:14.422043+0000, chain.objs.size()=1 2024-09-12T18:13:49.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.096+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.575__shadow_.CpYbouvu9kStNta2i1tNkRFcXvJAw7c_0 2024-09-12T18:13:49.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.096+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1389115731914206952', time=2024-09-12T20:05:21.569006+0000, chain.objs.size()=1 2024-09-12T18:13:49.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.096+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.649__shadow_.WKk6yunM8sixWM8o3QskWYJWCRz13MT_0 2024-09-12T18:13:49.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.096+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18035761838688355516', time=2024-09-12T20:06:09.504456+0000, chain.objs.size()=1 2024-09-12T18:13:49.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.096+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.673__shadow_.X8vBRKYp0m_uhJK9zkOD7q5ieHpBsAf_0 2024-09-12T18:13:49.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.096+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.409612565674958924', time=2024-09-12T20:06:24.586827+0000, chain.objs.size()=1 2024-09-12T18:13:49.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.096+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.693__shadow:bOCOwElB7Sluia8ZczG6H7vbIImFLc9_.R8zpAS-GulZTSNnZE5VoOBbFgd0hv9S_0 2024-09-12T18:13:49.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.097+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12273787481387777315', time=2024-09-12T20:06:26.914077+0000, chain.objs.size()=1 2024-09-12T18:13:49.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.097+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.696__shadow_.I18NqegiOtnt89dxQo_YdWC0q3dwNNw_0 2024-09-12T18:13:49.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.097+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15976262453700411290', time=2024-09-12T20:06:34.739749+0000, chain.objs.size()=1 2024-09-12T18:13:49.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.097+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.705__shadow:JiEJobCiicaMoPopy-J1MV8nvgYMsZu_.rANulUiTVs_t9VUIZZenZr_0uBN6DE6_0 2024-09-12T18:13:49.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.097+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14426529280892762061', time=2024-09-12T20:07:06.932359+0000, chain.objs.size()=1 2024-09-12T18:13:49.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.098+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.720__shadow_.cXgxiqz7OFDKXHGxUbR1fu636UZLx7O_0 2024-09-12T18:13:49.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.098+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12608853930405690050', time=2024-09-12T20:07:38.074926+0000, chain.objs.size()=1 2024-09-12T18:13:49.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.098+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.743__multipart_mymultipart3.2~i5Hw4l9jlK2aKxrkHGMxGbik9beDnet.1 2024-09-12T18:13:49.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.098+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11836348135273742070', time=2024-09-12T20:07:43.725398+0000, chain.objs.size()=3 2024-09-12T18:13:49.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.098+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.744__multipart_mymultipart3.2~hpZsp5AWJmTA2F1Tzy-JN0FWyttOpwn.1 2024-09-12T18:13:49.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.098+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.744__multipart_mymultipart3.2~hpZsp5AWJmTA2F1Tzy-JN0FWyttOpwn.2 2024-09-12T18:13:49.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.098+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.744__multipart_mymultipart3.2~hpZsp5AWJmTA2F1Tzy-JN0FWyttOpwn.3 2024-09-12T18:13:49.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.101+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:49.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.103+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:13:49.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.104+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:49.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.105+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:49.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.106+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47718' 2024-09-12T18:13:49.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.106+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3923151006471191344', time=2024-09-12T19:46:09.864517+0000, chain.objs.size()=1 2024-09-12T18:13:49.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.106+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.XvOisLE3LeC2RXzifii_XJ99ClEkew8_0 2024-09-12T18:13:49.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.106+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18436507220372290226', time=2024-09-12T19:46:10.368578+0000, chain.objs.size()=1 2024-09-12T18:13:49.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.106+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.SVUY-NelOAhGhG5j9DQiGk2HkJLQK-__0 2024-09-12T18:13:49.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.106+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5138007272945944137', time=2024-09-12T19:46:10.524817+0000, chain.objs.size()=1 2024-09-12T18:13:49.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.106+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.d3hHmX2lG1Xnlx-jcOuB7TIn3LZFy5G_0 2024-09-12T18:13:49.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.106+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2763861443071269156', time=2024-09-12T19:46:10.773038+0000, chain.objs.size()=1 2024-09-12T18:13:49.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.106+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.WUDbs3RmwxwnDY_q4zyYGuo5Tve0NJb_0 2024-09-12T18:13:49.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.106+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6536418039661427399', time=2024-09-12T19:46:10.783111+0000, chain.objs.size()=1 2024-09-12T18:13:49.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.106+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.7IfU_sIeTNioOMtWaO2XdrwHg0gXnmi_0 2024-09-12T18:13:49.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.106+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5984686168201202694', time=2024-09-12T19:46:11.135764+0000, chain.objs.size()=1 2024-09-12T18:13:49.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.106+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.aLQ6096LIOpNs7WyQP12tAoobRgTsEu_0 2024-09-12T18:13:49.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.106+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18211331242896732811', time=2024-09-12T19:46:11.387744+0000, chain.objs.size()=1 2024-09-12T18:13:49.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.106+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.4zO1YXmiWPaw7t40fMaKSVedb-XxYX7_0 2024-09-12T18:13:49.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.106+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7027893382739767195', time=2024-09-12T19:46:11.874768+0000, chain.objs.size()=1 2024-09-12T18:13:49.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.106+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.FhPY61H_WX3DbI78K5mIzseWVZvt-JC_0 2024-09-12T18:13:49.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.106+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1642959556233808103', time=2024-09-12T19:46:12.160778+0000, chain.objs.size()=1 2024-09-12T18:13:49.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.106+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.VQvpYtCXNt8pWv6R_5J3cvBVY8SyMfm_0 2024-09-12T18:13:49.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.106+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15449478041316705606', time=2024-09-12T19:46:12.345470+0000, chain.objs.size()=1 2024-09-12T18:13:49.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.106+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.6UvVQFBfhAu0KI9usJQs6pOytsdG_z__0 2024-09-12T18:13:49.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.106+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6523892756153534541', time=2024-09-12T19:46:14.188636+0000, chain.objs.size()=1 2024-09-12T18:13:49.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.106+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.k1FBe8jE2FPF1lP5cQ2KA-531v9sYV__0 2024-09-12T18:13:49.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.106+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3330482972415769184', time=2024-09-12T19:46:14.291954+0000, chain.objs.size()=1 2024-09-12T18:13:49.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.106+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.V7hMajrRxAhaS_JT31ZFI7R1xoqtUSI_0 2024-09-12T18:13:49.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.107+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4004657217194340196', time=2024-09-12T19:46:14.334559+0000, chain.objs.size()=1 2024-09-12T18:13:49.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.107+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.zgprlsNHmqW-QEFjSUAtdu3qs2fhMC9_0 2024-09-12T18:13:49.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.107+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18341256630936521799', time=2024-09-12T19:46:14.339614+0000, chain.objs.size()=1 2024-09-12T18:13:49.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.107+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.pQiJyZwyBXsId7frEIo8WqF1_TJ-HhU_0 2024-09-12T18:13:49.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.108+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5435484312122334862', time=2024-09-12T19:46:14.908542+0000, chain.objs.size()=1 2024-09-12T18:13:49.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.108+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.YGrm6_VJtYlfBFTq4SqiTluDJy6OxPL_0 2024-09-12T18:13:49.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.108+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3393146095032959344', time=2024-09-12T19:46:15.058492+0000, chain.objs.size()=1 2024-09-12T18:13:49.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.108+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.DCom7Tedav61GDEVwA6zbRXsLHvqsar_0 2024-09-12T18:13:49.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.108+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6872846182209163763', time=2024-09-12T19:46:16.516962+0000, chain.objs.size()=1 2024-09-12T18:13:49.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.108+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ebDzf7rQdniMLpLVJy9RQocgbkxwnoM_0 2024-09-12T18:13:49.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.108+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13460053621207364088', time=2024-09-12T19:46:16.517548+0000, chain.objs.size()=1 2024-09-12T18:13:49.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.108+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.N9wwpdGjcMfmJCxdjgENNxInH9J3hNM_0 2024-09-12T18:13:49.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.108+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9630034967707496560', time=2024-09-12T19:46:16.705181+0000, chain.objs.size()=1 2024-09-12T18:13:49.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.108+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.I9oprtLr56R3DGyuJfGgmGcj06k1f5S_0 2024-09-12T18:13:49.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.108+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9883565632773522180', time=2024-09-12T19:46:16.794055+0000, chain.objs.size()=1 2024-09-12T18:13:49.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.108+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.FS795zzeVUGmDwPlR1cWn2smz3CZKyY_0 2024-09-12T18:13:49.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.108+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12998419272258085551', time=2024-09-12T19:46:16.823951+0000, chain.objs.size()=1 2024-09-12T18:13:49.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.108+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.zcjeebOH03DtL5lD32poaS7RiCdfW-l_0 2024-09-12T18:13:49.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.108+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1675938269717450693', time=2024-09-12T19:46:16.949900+0000, chain.objs.size()=1 2024-09-12T18:13:49.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.108+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.qndRED9RLO5taPPP-Oew6LeHlPaztG2_0 2024-09-12T18:13:49.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.108+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16889037547402261499', time=2024-09-12T19:46:17.015826+0000, chain.objs.size()=1 2024-09-12T18:13:49.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.108+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.a8PAgxdjLXBSgLmqNIQpyTAItXhm1Wm_0 2024-09-12T18:13:49.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.110+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11622866592708248666', time=2024-09-12T19:46:17.111272+0000, chain.objs.size()=1 2024-09-12T18:13:49.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.110+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.iYK4zXS4TOv0X5zDekvzzEGZt9NLtbQ_0 2024-09-12T18:13:49.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.110+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15342007386169944658', time=2024-09-12T19:46:17.473152+0000, chain.objs.size()=1 2024-09-12T18:13:49.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.110+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.XjMxqm5qz30FaNHSCiH--ot4U9QHaFF_0 2024-09-12T18:13:49.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.110+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.51037437786628491', time=2024-09-12T19:46:17.863547+0000, chain.objs.size()=1 2024-09-12T18:13:49.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.110+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.DHz1DGY9_LX8kmH_kIHczweMPjtg_X4_0 2024-09-12T18:13:49.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.110+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3895833774202151016', time=2024-09-12T19:46:18.124471+0000, chain.objs.size()=1 2024-09-12T18:13:49.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.110+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.RCmpqi-CTcIIoV-Wx-xIFyG8IIPiUVe_0 2024-09-12T18:13:49.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.110+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10852333399150041455', time=2024-09-12T19:46:18.305301+0000, chain.objs.size()=1 2024-09-12T18:13:49.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.110+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.77vZtR7aVZx5_Nt2R3-_Vv2E-u_dMHl_0 2024-09-12T18:13:49.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.110+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.949260862257999688', time=2024-09-12T19:46:18.340928+0000, chain.objs.size()=1 2024-09-12T18:13:49.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.110+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.IoCN0wpCg5eiHFSPSoBMUX_kOaR4CEP_0 2024-09-12T18:13:49.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.110+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9503917454456170248', time=2024-09-12T19:46:18.377307+0000, chain.objs.size()=1 2024-09-12T18:13:49.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.110+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.s-_aumNs0eoIjO-iR62_kxPy7xqGVaE_0 2024-09-12T18:13:49.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.110+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15339996078048055823', time=2024-09-12T19:46:18.941002+0000, chain.objs.size()=1 2024-09-12T18:13:49.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.110+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.s1xtlhAz1MMOyHRrJRAcN2D-wKAIPLc_0 2024-09-12T18:13:49.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.110+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17110251910531909162', time=2024-09-12T19:46:19.136119+0000, chain.objs.size()=1 2024-09-12T18:13:49.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.110+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.mBWpkzLywtcQx_hFm_miGplh71ZXL6t_0 2024-09-12T18:13:49.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.111+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4165183004915948886', time=2024-09-12T19:46:19.137300+0000, chain.objs.size()=1 2024-09-12T18:13:49.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.111+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.HiSuC6cWzU3v7a5TuBwko8j5el1H2Va_0 2024-09-12T18:13:49.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.111+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5774959998333113828', time=2024-09-12T19:46:19.267699+0000, chain.objs.size()=1 2024-09-12T18:13:49.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.111+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.3AEoVkFqaqbxzANHeb1dttfMGvAiXbV_0 2024-09-12T18:13:49.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.112+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13147027841225118751', time=2024-09-12T19:46:19.277438+0000, chain.objs.size()=1 2024-09-12T18:13:49.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.112+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.9aNVLKkS-zmH7TB_auxz_VlWdRebYoT_0 2024-09-12T18:13:49.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.113+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6215558334793700563', time=2024-09-12T19:46:19.415915+0000, chain.objs.size()=1 2024-09-12T18:13:49.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.113+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.1mHJxXPtGqBqOeXicvKax0_1Eb3DkO7_0 2024-09-12T18:13:49.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.113+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3451893615648928924', time=2024-09-12T19:46:27.468134+0000, chain.objs.size()=1 2024-09-12T18:13:49.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.113+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.272__shadow_.BWlstp2U6YIxGuMU5enP1XkapPEMbky_0 2024-09-12T18:13:49.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.113+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16871831805984273516', time=2024-09-12T19:46:31.921200+0000, chain.objs.size()=1 2024-09-12T18:13:49.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.113+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.277__shadow_.f9CU5buxNYJQbzfb9KQJ649zH-ODwau_0 2024-09-12T18:13:49.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.113+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10488771008551863987', time=2024-09-12T19:46:34.638218+0000, chain.objs.size()=1 2024-09-12T18:13:49.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.113+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.280__shadow_.aOExVjWk1w2OyTuKMx3uwVYqwpBsDKQ_0 2024-09-12T18:13:49.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.113+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.368015200575251875', time=2024-09-12T19:46:41.152035+0000, chain.objs.size()=1 2024-09-12T18:13:49.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.113+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.287__shadow_.hNye9-brdPMl7SVs_dOiBYf1TfWbQ2K_0 2024-09-12T18:13:49.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.113+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10734740962330057386', time=2024-09-12T19:46:42.085664+0000, chain.objs.size()=1 2024-09-12T18:13:49.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.113+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.288__shadow_.mrB0Ls3UwHR0NZ6gzyVFqL44X1QdN0k_0 2024-09-12T18:13:49.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.113+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3259703099103420619', time=2024-09-12T19:46:58.804460+0000, chain.objs.size()=1 2024-09-12T18:13:49.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.113+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.303__shadow_.Lqh6jhRnHCjAHTWbAm9VZ2n5eXYifRS_0 2024-09-12T18:13:49.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.113+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8425822398531111708', time=2024-09-12T19:47:20.143984+0000, chain.objs.size()=1 2024-09-12T18:13:49.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.113+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.322__shadow_.HnVFoPbYzGISh8TJ7d8ee6lylXBmsTE_0 2024-09-12T18:13:49.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.113+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2697151572747710965', time=2024-09-12T19:48:00.488585+0000, chain.objs.size()=1 2024-09-12T18:13:49.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.113+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.pR_y9kjfz7VSWCgvk7o8Ka7qfulKopF_0 2024-09-12T18:13:49.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.113+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11033963700329791741', time=2024-09-12T19:48:01.489740+0000, chain.objs.size()=1 2024-09-12T18:13:49.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.113+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.eNjiCk-l10M-yb2V7fo7njPHN0IIYe1_0 2024-09-12T18:13:49.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.114+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6300373878075131335', time=2024-09-12T19:48:02.000013+0000, chain.objs.size()=1 2024-09-12T18:13:49.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.114+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.07zSFs4UHDcV0FiFTayK18A3Td4eKGp_0 2024-09-12T18:13:49.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.114+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.79538812543022508', time=2024-09-12T19:48:02.508501+0000, chain.objs.size()=1 2024-09-12T18:13:49.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.114+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.oacSzltuf8yTvi2WMy93Amehz2SvoPZ_0 2024-09-12T18:13:49.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.114+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15011395119381895797', time=2024-09-12T19:48:02.509217+0000, chain.objs.size()=1 2024-09-12T18:13:49.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.114+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.MPVNU0BWujVxk5Hdl6kN8RHBHWe3aS6_0 2024-09-12T18:13:49.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.116+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14595563465409677737', time=2024-09-12T19:48:03.174124+0000, chain.objs.size()=1 2024-09-12T18:13:49.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.116+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Phg01ZtmH6ZzTdOt32ReFQXavA1GaBf_0 2024-09-12T18:13:49.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.116+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10058056695399346931', time=2024-09-12T19:48:03.474532+0000, chain.objs.size()=1 2024-09-12T18:13:49.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.116+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ttmh0fyMGsbKg-MkHdxNFv9rg5Ps8Rj_0 2024-09-12T18:13:49.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.116+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4680899796969363071', time=2024-09-12T19:48:04.121134+0000, chain.objs.size()=1 2024-09-12T18:13:49.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.116+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.6sBlvLzOFwvwtjTFq93pyCSI-_pEk6x_0 2024-09-12T18:13:49.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.116+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5697443078941712992', time=2024-09-12T19:48:04.214544+0000, chain.objs.size()=1 2024-09-12T18:13:49.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.116+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.URIV-fRoM_Dr1a8sZgCdOQJF2PT5TGx_0 2024-09-12T18:13:49.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.116+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11709023795487777030', time=2024-09-12T19:48:04.356917+0000, chain.objs.size()=1 2024-09-12T18:13:49.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.116+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.w9s91vzxGmfErVIR4P9o9U3FnXc_i5h_0 2024-09-12T18:13:49.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.116+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16233985514248545113', time=2024-09-12T19:48:04.504922+0000, chain.objs.size()=1 2024-09-12T18:13:49.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.116+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.YtlxF-HQ_yH8f2dhIiW72Og5u9fMeFG_0 2024-09-12T18:13:49.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.116+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6289722232877586841', time=2024-09-12T19:48:04.660219+0000, chain.objs.size()=1 2024-09-12T18:13:49.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.116+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.P-dssjaMrGmqaQ5PbtrRrWMLIpUfj7X_0 2024-09-12T18:13:49.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.116+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3271299631615349619', time=2024-09-12T19:48:05.701388+0000, chain.objs.size()=1 2024-09-12T18:13:49.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.116+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.xGLgh_1o9Na2tHkFMSjNELmVg54H7Td_0 2024-09-12T18:13:49.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.117+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2342862825698814280', time=2024-09-12T19:48:05.931731+0000, chain.objs.size()=1 2024-09-12T18:13:49.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.117+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.eXSaiYUD77OxWAKIUYUSIuJb6YHzzgi_0 2024-09-12T18:13:49.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.117+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3742218322961148979', time=2024-09-12T19:48:05.980401+0000, chain.objs.size()=1 2024-09-12T18:13:49.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.117+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.O8HMoqMFigv4oCZeveU9X7lrWtE0vgi_0 2024-09-12T18:13:49.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.117+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17299284368746045773', time=2024-09-12T19:48:06.035766+0000, chain.objs.size()=1 2024-09-12T18:13:49.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.117+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_._iUJuSuWw6gU71DGHaKTDQk3qyKoVgY_0 2024-09-12T18:13:49.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.118+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7904423921578867050', time=2024-09-12T19:48:06.823806+0000, chain.objs.size()=1 2024-09-12T18:13:49.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.118+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Iznk0_1EBIjTG8zPzI1sNAI2LoLmZAl_0 2024-09-12T18:13:49.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.118+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18074431593730335913', time=2024-09-12T19:48:07.102839+0000, chain.objs.size()=1 2024-09-12T18:13:49.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.118+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.25qQGbZSXiLmxm_anLBMFBcsifiJKfx_0 2024-09-12T18:13:49.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.118+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12310754919263048329', time=2024-09-12T19:48:07.260662+0000, chain.objs.size()=1 2024-09-12T18:13:49.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.118+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.3tFEsWMknlCKKyd76uHPzjhGkRRKoUy_0 2024-09-12T18:13:49.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.118+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7721871056351941193', time=2024-09-12T19:48:07.430968+0000, chain.objs.size()=1 2024-09-12T18:13:49.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.118+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.PtIgscruqOEulxTrN4cIiYSyX5UNpW2_0 2024-09-12T18:13:49.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.118+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8149017752771676307', time=2024-09-12T19:48:07.550304+0000, chain.objs.size()=1 2024-09-12T18:13:49.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.118+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ViIwveTC7LI2fNuaKkE40Iiyld6Rqly_0 2024-09-12T18:13:49.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.118+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.113279512874951241', time=2024-09-12T19:48:07.658832+0000, chain.objs.size()=1 2024-09-12T18:13:49.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.118+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.8X56dC4yz9oboJrFjIp2YNP2GwcS_jS_0 2024-09-12T18:13:49.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.118+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17463946323945401767', time=2024-09-12T19:48:08.103083+0000, chain.objs.size()=1 2024-09-12T18:13:49.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.118+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ZFeExJswtT9eKw8I6gamksXhxWWssEf_0 2024-09-12T18:13:49.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.118+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12863185735548260909', time=2024-09-12T19:48:08.278110+0000, chain.objs.size()=1 2024-09-12T18:13:49.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.118+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_._MK9K5dHpYMUr9V7z8IIJ47wosmeZyR_0 2024-09-12T18:13:49.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.119+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6637325821753393447', time=2024-09-12T19:48:08.487145+0000, chain.objs.size()=1 2024-09-12T18:13:49.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.119+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.g8Jo2b2pvsq1AD367Hip3kJ7cILn0Qz_0 2024-09-12T18:13:49.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.119+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17748207172883124144', time=2024-09-12T19:48:08.807662+0000, chain.objs.size()=1 2024-09-12T18:13:49.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.119+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.bwjvDNZyI50ZcuWuG8X-6jAaqucP2-W_0 2024-09-12T18:13:49.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.119+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17743698003904161205', time=2024-09-12T19:48:08.885880+0000, chain.objs.size()=1 2024-09-12T18:13:49.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.119+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.nnpwlafX_GZtuAW-yx3C3J2exF1wjMt_0 2024-09-12T18:13:49.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.120+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17355942637711168077', time=2024-09-12T19:48:08.931497+0000, chain.objs.size()=1 2024-09-12T18:13:49.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.120+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.A5ucuw37oq3bAxXDwymNTkufY2zhQgK_0 2024-09-12T18:13:49.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.121+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1926506509448405625', time=2024-09-12T19:48:09.463818+0000, chain.objs.size()=1 2024-09-12T18:13:49.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.121+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.bbIc8L3LY0ads4Wj3NeXs50btltuQfT_0 2024-09-12T18:13:49.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.121+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4057354445196173699', time=2024-09-12T19:48:09.645598+0000, chain.objs.size()=1 2024-09-12T18:13:49.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.121+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.gbJxR28WNlLZ4jMNfCgxqLIF8IJQP5c_0 2024-09-12T18:13:49.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.121+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13481001590472466990', time=2024-09-12T19:48:09.748292+0000, chain.objs.size()=1 2024-09-12T18:13:49.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.121+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.8O15sOJKLFJwRhv0kvANxY42zQywCGb_0 2024-09-12T18:13:49.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.121+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14989072086249132082', time=2024-09-12T19:48:09.918400+0000, chain.objs.size()=1 2024-09-12T18:13:49.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.121+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.8W2wXBGc5h-yLG7caYo0ZSpm9rl5Gj7_0 2024-09-12T18:13:49.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.121+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9611859348512352510', time=2024-09-12T19:48:09.919048+0000, chain.objs.size()=1 2024-09-12T18:13:49.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.121+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.9GPVLtW7MSIPtmZoLwGMPucBpynLhqr_0 2024-09-12T18:13:49.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.121+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6337353913188076453', time=2024-09-12T19:48:10.082698+0000, chain.objs.size()=1 2024-09-12T18:13:49.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.121+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.yZLe6l2D23eWsmWLucv0BkjQjRUfcKQ_0 2024-09-12T18:13:49.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.121+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3258177521224026748', time=2024-09-12T19:48:47.475043+0000, chain.objs.size()=1 2024-09-12T18:13:49.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.121+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.70QTg40d5hfEGjxJ0lvUsj3gIyAGGkU_0 2024-09-12T18:13:49.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.121+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1721025572163570574', time=2024-09-12T19:48:47.885691+0000, chain.objs.size()=1 2024-09-12T18:13:49.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.121+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.YYzglhbShI26CGBPFH2ZjxFky1u6kPU_0 2024-09-12T18:13:49.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.121+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14868294111681979731', time=2024-09-12T19:48:48.078765+0000, chain.objs.size()=1 2024-09-12T18:13:49.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.121+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.HMicWy9Bf2s5nfoOz41yRfFIpwJXNUx_0 2024-09-12T18:13:49.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.121+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15343539556875746045', time=2024-09-12T19:48:48.173059+0000, chain.objs.size()=1 2024-09-12T18:13:49.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.121+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.2iyCArJ2netKGe50nNlll7hL368gHeA_0 2024-09-12T18:13:49.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.123+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15400773718889899324', time=2024-09-12T19:48:48.327351+0000, chain.objs.size()=1 2024-09-12T18:13:49.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.123+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.S4OjWjg9j2_uHHYFeza5yviVbpT7mPq_0 2024-09-12T18:13:49.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.124+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2347427735199535287', time=2024-09-12T19:48:48.372043+0000, chain.objs.size()=1 2024-09-12T18:13:49.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.124+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.dzwNloIP9tmi8DD8icA_tLTGs_1Vi03_0 2024-09-12T18:13:49.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.124+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6605899285089755586', time=2024-09-12T19:48:48.390143+0000, chain.objs.size()=1 2024-09-12T18:13:49.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.124+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Mrly7QsL2kwFZgPYM2dXu4y-fBmkydx_0 2024-09-12T18:13:49.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.124+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.306661752584412325', time=2024-09-12T19:48:49.218765+0000, chain.objs.size()=1 2024-09-12T18:13:49.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.124+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.MQ3RL1tB8x_Gh_Rt9WImAzqHMulpkAn_0 2024-09-12T18:13:49.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.124+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17885238957752394132', time=2024-09-12T19:48:49.687233+0000, chain.objs.size()=1 2024-09-12T18:13:49.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.124+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Zq9phrxcKNaaBQ6c-NY0RgfIYIH_sXz_0 2024-09-12T18:13:49.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.124+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6690393203670825101', time=2024-09-12T19:48:49.722415+0000, chain.objs.size()=1 2024-09-12T18:13:49.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.124+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.RGKDeOEQq8CRdge-BcQKYfC4LbDx9Wo_0 2024-09-12T18:13:49.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.124+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15929197187371936305', time=2024-09-12T19:48:49.921259+0000, chain.objs.size()=1 2024-09-12T18:13:49.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.124+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.l-26uM7hHvhHedAHeGaGzH4mN7IvKng_0 2024-09-12T18:13:49.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.124+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5954365570648438880', time=2024-09-12T19:48:50.478684+0000, chain.objs.size()=1 2024-09-12T18:13:49.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.124+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.iOIEuUskKogNAu1BV2EzLOI43p64T6L_0 2024-09-12T18:13:49.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.124+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7610538312767781584', time=2024-09-12T19:48:50.729414+0000, chain.objs.size()=1 2024-09-12T18:13:49.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.124+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.vyJniUy2tw7kJrGi1eMD9MNlAm0h5zA_0 2024-09-12T18:13:49.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.124+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10000294804476356173', time=2024-09-12T19:48:50.746666+0000, chain.objs.size()=1 2024-09-12T18:13:49.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.124+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.TpAhgM3u6btB-wXCHy461D-ihGF85F4_0 2024-09-12T18:13:49.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.124+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9346682653196473499', time=2024-09-12T19:48:50.848121+0000, chain.objs.size()=1 2024-09-12T18:13:49.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.124+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ZNy9U0rUVHxQ28vAOUQchKgZi_EpEDS_0 2024-09-12T18:13:49.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.125+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8275537492857866325', time=2024-09-12T19:48:50.872086+0000, chain.objs.size()=1 2024-09-12T18:13:49.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.125+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ShSYBjix5-j5bhNh7Q5JQTizVPf1XvW_0 2024-09-12T18:13:49.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.126+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7837069476846790038', time=2024-09-12T19:48:50.910687+0000, chain.objs.size()=1 2024-09-12T18:13:49.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.126+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.CseeHbkAd541gxBvzpPNv9j2UhQ3YVM_0 2024-09-12T18:13:49.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.126+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5777741610572543275', time=2024-09-12T19:48:50.988923+0000, chain.objs.size()=1 2024-09-12T18:13:49.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.126+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.0Z6ZHpHYcj4A3J20BYYp7cbSX-psrWd_0 2024-09-12T18:13:49.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.126+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16271412319650766869', time=2024-09-12T19:48:50.990005+0000, chain.objs.size()=1 2024-09-12T18:13:49.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.126+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.WelNESqoOC5xIS2-ABN9rA-V6Q7aew0_0 2024-09-12T18:13:49.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.126+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4232350771728630708', time=2024-09-12T19:48:51.028148+0000, chain.objs.size()=1 2024-09-12T18:13:49.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.126+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.6kHq7iJ7no3KnySPmP7UTsLdv36cWcc_0 2024-09-12T18:13:49.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.126+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7661472893872679575', time=2024-09-12T19:48:51.934280+0000, chain.objs.size()=1 2024-09-12T18:13:49.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.126+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Jr9hcGHGzhz1JjJd08H7xOcWbOjTBTg_0 2024-09-12T18:13:49.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.126+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11282108771416928362', time=2024-09-12T19:48:52.029569+0000, chain.objs.size()=1 2024-09-12T18:13:49.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.126+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.CeAAbvM8JXDtXgXFDXODQBFgCARo7qN_0 2024-09-12T18:13:49.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.126+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11104664294367916905', time=2024-09-12T19:48:52.232782+0000, chain.objs.size()=1 2024-09-12T18:13:49.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.126+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.dj_lcsy1171HLFmFI6wTKD-vbwm_gmo_0 2024-09-12T18:13:49.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.128+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/47718 2024-09-12T18:13:49.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.131+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-12T18:13:49.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.131+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9446541570297121687', time=2024-09-12T19:48:52.381789+0000, chain.objs.size()=1 2024-09-12T18:13:49.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.131+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.MvYSVtPsRIYWHMuT0NOrpGWR8zbUmIh_0 2024-09-12T18:13:49.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.131+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14935945852081785963', time=2024-09-12T19:48:52.689315+0000, chain.objs.size()=1 2024-09-12T18:13:49.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.131+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.4YcJTLZsRKovaExl6r98Dyk2-E8bAE-_0 2024-09-12T18:13:49.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.131+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.717565846506894009', time=2024-09-12T19:48:53.278579+0000, chain.objs.size()=1 2024-09-12T18:13:49.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.131+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.xO0hSZzwTBCA3lrHuDdU2srj4870dtl_0 2024-09-12T18:13:49.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.131+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10005707203555899518', time=2024-09-12T19:48:53.432249+0000, chain.objs.size()=1 2024-09-12T18:13:49.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.131+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.BXvAlLXX0_q_MPPl9s58ox4Etgol6oe_0 2024-09-12T18:13:49.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.131+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2913332448220277574', time=2024-09-12T19:48:54.634673+0000, chain.objs.size()=1 2024-09-12T18:13:49.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.131+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ECLMu9DfaF_O3A52kmFY62V1t8CtwSf_0 2024-09-12T18:13:49.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.131+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15640821377523439999', time=2024-09-12T19:48:54.815594+0000, chain.objs.size()=1 2024-09-12T18:13:49.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.131+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.j_rBQ-gh9WKD9IbpUhVbhv1JN9jnQdz_0 2024-09-12T18:13:49.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.131+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3370958730241330710', time=2024-09-12T19:48:55.049182+0000, chain.objs.size()=1 2024-09-12T18:13:49.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.131+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.nrpCY-u4QpH7BvboBp12YQP1NNhZLJg_0 2024-09-12T18:13:49.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.131+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14954512329244378731', time=2024-09-12T19:48:55.291790+0000, chain.objs.size()=1 2024-09-12T18:13:49.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.131+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.hlb9egpH7liDYKR3jcQyKF7mkezciXn_0 2024-09-12T18:13:49.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.131+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.339959666240404735', time=2024-09-12T19:48:55.606863+0000, chain.objs.size()=1 2024-09-12T18:13:49.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.131+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.q1GxYqJs83f02qelZi6-AXt80M87csq_0 2024-09-12T18:13:49.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.131+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17763899499864267242', time=2024-09-12T19:48:55.959187+0000, chain.objs.size()=1 2024-09-12T18:13:49.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.131+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ctsiZpltQTZhJEgIxvKQsSTDR1VfdrQ_0 2024-09-12T18:13:49.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.131+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3171224738246625962', time=2024-09-12T19:48:56.657636+0000, chain.objs.size()=1 2024-09-12T18:13:49.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.131+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_._P839oiKvArAga2wz4oKO2h0GKMsdw-_0 2024-09-12T18:13:49.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.131+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12491338356921902951', time=2024-09-12T19:48:56.727706+0000, chain.objs.size()=1 2024-09-12T18:13:49.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.131+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.dFrsiUAgQuRe9KHceGH1UPHVfMpqk7B_0 2024-09-12T18:13:49.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.133+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2607226279773095397', time=2024-09-12T19:48:56.937548+0000, chain.objs.size()=1 2024-09-12T18:13:49.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.133+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.UHunjpH_gUx_YyBRV9vmHRLlQjO0VXb_0 2024-09-12T18:13:49.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.133+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7173319280872736868', time=2024-09-12T19:48:57.273450+0000, chain.objs.size()=1 2024-09-12T18:13:49.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.133+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.HYKT6PgqYCKRHNKxQ1UwAl5F_-ytYS-_0 2024-09-12T18:13:49.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.133+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3653579329070453116', time=2024-09-12T19:48:57.468718+0000, chain.objs.size()=1 2024-09-12T18:13:49.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.133+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.qIkm7O5YU1G_-HDc4BtpOyBjgm9J2sz_0 2024-09-12T18:13:49.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.133+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5145936271971497658', time=2024-09-12T19:48:58.030213+0000, chain.objs.size()=1 2024-09-12T18:13:49.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.133+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.nrZxrprFvciRXa-mJgUI1ksxrkX5VUo_0 2024-09-12T18:13:49.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.133+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7961733155913856303', time=2024-09-12T19:49:05.545841+0000, chain.objs.size()=1 2024-09-12T18:13:49.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.133+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.334__shadow_.7gXNf8wsZE87CA7T55QGC1tqB40_Yja_0 2024-09-12T18:13:49.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.133+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4110640247237196336', time=2024-09-12T19:49:39.436599+0000, chain.objs.size()=1 2024-09-12T18:13:49.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.133+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.375__shadow_.fQNz84EJvmOK59gnzhBfZc9TCRqwn08_0 2024-09-12T18:13:49.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.133+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14212017442772367888', time=2024-09-12T19:50:31.881029+0000, chain.objs.size()=1 2024-09-12T18:13:49.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.133+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.434__shadow_.37Wm0tZbEJsiRQ3lITDglV3HhXwwkcU_0 2024-09-12T18:13:49.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.133+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9882220421309675326', time=2024-09-12T19:50:42.290082+0000, chain.objs.size()=1 2024-09-12T18:13:49.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.133+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.445__shadow_._A6mthMBNDKZlw4A7LyD1emBL8Vouzw_0 2024-09-12T18:13:49.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.133+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10947828614657428824', time=2024-09-12T19:51:00.460701+0000, chain.objs.size()=1 2024-09-12T18:13:49.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.133+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.461__shadow_.jXRUTT2nOhyfYttp2R3-TzFeJrEkVXY_0 2024-09-12T18:13:49.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.133+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10102568207876474387', time=2024-09-12T19:51:18.573411+0000, chain.objs.size()=1 2024-09-12T18:13:49.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.133+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.484__shadow_.OcLxjRZOq-emJcjTzaEop5CNXh9IGvY_0 2024-09-12T18:13:49.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.133+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5331634664864618342', time=2024-09-12T19:52:11.044267+0000, chain.objs.size()=6 2024-09-12T18:13:49.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.133+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.1 2024-09-12T18:13:49.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.134+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.2 2024-09-12T18:13:49.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.135+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.3 2024-09-12T18:13:49.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.135+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.4 2024-09-12T18:13:49.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.135+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.5 2024-09-12T18:13:49.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.135+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.6 2024-09-12T18:13:49.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.135+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11096175128439166534', time=2024-09-12T19:52:27.502597+0000, chain.objs.size()=1 2024-09-12T18:13:49.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.135+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.519__multipart_mymultipart.2~nZIkaE7zXeVyUA-FWHEYFwFGZh8YotW.1 2024-09-12T18:13:49.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.135+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8497873100334099760', time=2024-09-12T19:55:48.119510+0000, chain.objs.size()=2 2024-09-12T18:13:49.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.135+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.526__multipart_mymultipart.2~jRDsu0bGUXbzxqy47FG-Tf9q5ZckRXM.1 2024-09-12T18:13:49.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.135+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.526__multipart_mymultipart.2~jRDsu0bGUXbzxqy47FG-Tf9q5ZckRXM.2 2024-09-12T18:13:49.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.135+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13814043882873280591', time=2024-09-12T19:58:06.503446+0000, chain.objs.size()=1 2024-09-12T18:13:49.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.135+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:Ui8sotLSMHJ.qmcdcR9kHR4hmHlHb1k_.jmRwj8jzXkR6Zp_e6AKurqrHiJNjKeR_0 2024-09-12T18:13:49.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.135+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1351071086336622578', time=2024-09-12T19:59:40.626045+0000, chain.objs.size()=1 2024-09-12T18:13:49.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.135+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.588__shadow:Q1G5C-smJXIxpBtN2au2A4ARcrIloRE_.jN1qBMoGt17Pccq3MmpiQHXiCpBorix_0 2024-09-12T18:13:49.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.136+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9868952899367662113', time=2024-09-12T19:59:41.037645+0000, chain.objs.size()=1 2024-09-12T18:13:49.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.136+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.588__shadow:qgcKgA7ed4G6pdgk0tS9c0kunisaIvx_.JU9dJZfr5iQITL7GW6Yqu7Em-qSApLx_0 2024-09-12T18:13:49.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.136+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12461419118613819831', time=2024-09-12T20:05:26.316384+0000, chain.objs.size()=1 2024-09-12T18:13:49.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.136+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.651__shadow_.l-HP5chGo-HrYaaVfSrF14VarneSaH2_0 2024-09-12T18:13:49.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.137+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10474802774392006886', time=2024-09-12T20:05:27.159388+0000, chain.objs.size()=1 2024-09-12T18:13:49.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.137+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.652__shadow_.ptFe10fDJu2-kqQP2lbB9jiTUNhpmqV_0 2024-09-12T18:13:49.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.137+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6631628601836252359', time=2024-09-12T20:06:34.677485+0000, chain.objs.size()=1 2024-09-12T18:13:49.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.137+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.705__shadow:WgcBtbW-.p4.g4lA1c08AZ0VjeMcOr7_.-3CRlzoFS6KtBj4r0AfJOElbgU12mLs_0 2024-09-12T18:13:49.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.137+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5364221992095683970', time=2024-09-12T20:06:37.246177+0000, chain.objs.size()=1 2024-09-12T18:13:49.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.137+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.708__shadow:JxIfnpYoYxhknTTFJg.g1GLUGP-h1po_.Ii8OINW01hBJCMkTSCDVoD2p8gv_sGJ_0 2024-09-12T18:13:49.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.139+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:49.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.141+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:13:49.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.142+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:49.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.143+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:49.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.144+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49267' 2024-09-12T18:13:49.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.144+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5544264736385449546', time=2024-09-12T19:45:12.215820+0000, chain.objs.size()=1 2024-09-12T18:13:49.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.144+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.242__shadow_.ZBT4rFYdcoSsh15lrD9LCyYsQ-hqFSN_0 2024-09-12T18:13:49.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.144+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8352662386041538399', time=2024-09-12T19:45:13.112657+0000, chain.objs.size()=1 2024-09-12T18:13:49.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.144+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.243__shadow_.MgrdH4uZynnYYGk7UX9pNjvjtQrDT2P_0 2024-09-12T18:13:49.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.144+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4701476714663678468', time=2024-09-12T19:45:16.334158+0000, chain.objs.size()=1 2024-09-12T18:13:49.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.144+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.245__shadow_.p837jJmCeq5Dvu7Poek301fFeQEfrJn_0 2024-09-12T18:13:49.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.144+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10579344006990642044', time=2024-09-12T19:45:20.919209+0000, chain.objs.size()=1 2024-09-12T18:13:49.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.144+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.250__shadow_.mMoZfGQaLXtByAbiDzyZ_vmhWTIiufN_0 2024-09-12T18:13:49.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.144+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6655729275714097626', time=2024-09-12T19:45:23.666530+0000, chain.objs.size()=1 2024-09-12T18:13:49.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.144+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.253__shadow_.bSuRcmhznEjJK6eprqjfG6y_8KewVg4_0 2024-09-12T18:13:49.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.144+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18200943199084809967', time=2024-09-12T19:45:27.283776+0000, chain.objs.size()=1 2024-09-12T18:13:49.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.144+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.257__shadow_.SDEDHbxxN7m2JENIQrPRb_fiNLbdFUq_0 2024-09-12T18:13:49.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.144+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2636502000242899378', time=2024-09-12T19:45:27.292451+0000, chain.objs.size()=1 2024-09-12T18:13:49.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.144+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.257__shadow_.02XD11RAWo6QCYCAp_GIAPhn7TBR0-g_0 2024-09-12T18:13:49.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.144+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3741281707818509429', time=2024-09-12T19:45:29.917619+0000, chain.objs.size()=1 2024-09-12T18:13:49.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.144+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.260__shadow_.LJcR2u9rICsdt_edXAfR-PAqEMYOD8n_0 2024-09-12T18:13:49.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.144+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5144793541882862815', time=2024-09-12T19:46:08.808890+0000, chain.objs.size()=1 2024-09-12T18:13:49.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.144+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.dud1py9jsReN_sFqD6XGrCGIRHaPUQb_0 2024-09-12T18:13:49.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.144+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2006335363402610313', time=2024-09-12T19:46:09.093639+0000, chain.objs.size()=1 2024-09-12T18:13:49.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.144+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.3n-cNu5pYKOUwj7Xlo9_9dd5jNqGb5K_0 2024-09-12T18:13:49.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.144+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3561995708328424223', time=2024-09-12T19:46:09.236151+0000, chain.objs.size()=1 2024-09-12T18:13:49.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.144+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.EeAj5-P16khkXBOsdn_Lty3vVrxt8JP_0 2024-09-12T18:13:49.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.144+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4217553222286285008', time=2024-09-12T19:46:09.796146+0000, chain.objs.size()=1 2024-09-12T18:13:49.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.144+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.98pled0QgconrIiN7NHrHu1sV7ZetSe_0 2024-09-12T18:13:49.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.146+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13134405443451740327', time=2024-09-12T19:46:09.841137+0000, chain.objs.size()=1 2024-09-12T18:13:49.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.146+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ndkJmexaNgv43bFwSUQRc-Wav1wWRer_0 2024-09-12T18:13:49.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.146+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11737287772659093709', time=2024-09-12T19:46:09.864038+0000, chain.objs.size()=1 2024-09-12T18:13:49.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.146+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.PYyBAteZIwmbAm31w3mhhM8zfi5WKsN_0 2024-09-12T18:13:49.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.146+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5075498781098889048', time=2024-09-12T19:46:10.697555+0000, chain.objs.size()=1 2024-09-12T18:13:49.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.146+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.NYFO2BXyxinBVTepD9tJB-yaKK-Gh_l_0 2024-09-12T18:13:49.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.146+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.428968824784217820', time=2024-09-12T19:46:10.742202+0000, chain.objs.size()=1 2024-09-12T18:13:49.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.146+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Fx7AZWVZUigihuJt9Z-AK6znScCka1y_0 2024-09-12T18:13:49.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.146+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2119713092210796315', time=2024-09-12T19:46:10.936914+0000, chain.objs.size()=1 2024-09-12T18:13:49.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.146+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.OKTa01aUURAMes_yQQ_H6vOa57s2e2J_0 2024-09-12T18:13:49.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.146+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15470411111223665594', time=2024-09-12T19:46:13.585173+0000, chain.objs.size()=1 2024-09-12T18:13:49.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.146+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.HB9y3BDb64ChZ6Hf6X5Of7SClUdnOnk_0 2024-09-12T18:13:49.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.146+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15675134436118654069', time=2024-09-12T19:46:13.674335+0000, chain.objs.size()=1 2024-09-12T18:13:49.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.146+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.H2y-tzAdUMYe16jZSAQ6fsviAqigfO4_0 2024-09-12T18:13:49.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.146+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2877310821084569050', time=2024-09-12T19:46:14.339883+0000, chain.objs.size()=1 2024-09-12T18:13:49.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.146+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.SlbRLuuggmbyg0X7ZD8zVwZLUnypRH2_0 2024-09-12T18:13:49.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.146+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10860188796892569307', time=2024-09-12T19:46:15.167686+0000, chain.objs.size()=1 2024-09-12T18:13:49.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.146+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ImHog2ozyQtCFa0iLr4p9EMCkcrte3G_0 2024-09-12T18:13:49.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.147+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8077545937633333906', time=2024-09-12T19:46:15.195892+0000, chain.objs.size()=1 2024-09-12T18:13:49.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.147+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.x_xJ32_TwJaDOLj-G9MrL60UZ7B10R8_0 2024-09-12T18:13:49.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.147+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5191068420669560732', time=2024-09-12T19:46:15.236397+0000, chain.objs.size()=1 2024-09-12T18:13:49.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.147+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.qbpf9LTN_-5HN82V9gfjniB_gQHl-SQ_0 2024-09-12T18:13:49.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.148+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9846231180628281689', time=2024-09-12T19:46:15.339930+0000, chain.objs.size()=1 2024-09-12T18:13:49.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.148+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Yg13rW4yi2pvnAiJYva_-GwuXrPoC_w_0 2024-09-12T18:13:49.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.148+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8554828175336864806', time=2024-09-12T19:46:16.326209+0000, chain.objs.size()=1 2024-09-12T18:13:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.148+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.mCEEVm52ydjFhC3EUtJSP3oVR9C5AUm_0 2024-09-12T18:13:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.148+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14883390034837282057', time=2024-09-12T19:46:16.397478+0000, chain.objs.size()=1 2024-09-12T18:13:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.148+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.pjO4XMy4T1xj6NB9xukpAHxjNEvhrVk_0 2024-09-12T18:13:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.148+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.506065903542022638', time=2024-09-12T19:46:16.444608+0000, chain.objs.size()=1 2024-09-12T18:13:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.148+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_._Vzw-W-aKF8Qy6Xp_eDbsel8b1PvJXw_0 2024-09-12T18:13:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.149+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16421610878625781222', time=2024-09-12T19:46:16.884269+0000, chain.objs.size()=1 2024-09-12T18:13:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.149+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.oP7QWkMr8JL8jgzaFB7bqId3L9S02dP_0 2024-09-12T18:13:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.149+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13683112036533619134', time=2024-09-12T19:46:16.923771+0000, chain.objs.size()=1 2024-09-12T18:13:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.149+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.vtgZHH4EZB03tcpHRjvpCeTggVWd_mq_0 2024-09-12T18:13:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.149+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6378949184474841827', time=2024-09-12T19:46:16.924601+0000, chain.objs.size()=1 2024-09-12T18:13:49.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.149+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.uL3n5MjudgsuUOPsbpUOgxa0N2dnqcB_0 2024-09-12T18:13:49.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.149+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1379928490898168977', time=2024-09-12T19:46:17.460483+0000, chain.objs.size()=1 2024-09-12T18:13:49.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.149+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.5by6q6bihSZ3xs_peytVJdulYs3LkV6_0 2024-09-12T18:13:49.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.149+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18142605228280248823', time=2024-09-12T19:46:17.598859+0000, chain.objs.size()=1 2024-09-12T18:13:49.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.149+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.2HZ7G1QVpnZFZm0zMAQ7_d_ExS1vWKu_0 2024-09-12T18:13:49.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.149+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2841163526517335066', time=2024-09-12T19:46:18.410421+0000, chain.objs.size()=1 2024-09-12T18:13:49.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.149+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.wklVcHd5suD_DUahu-VV0wXsqMEnFFv_0 2024-09-12T18:13:49.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.149+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16366244608210764079', time=2024-09-12T19:46:18.865017+0000, chain.objs.size()=1 2024-09-12T18:13:49.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.149+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.RU7nVpIu6HzZSTlA_gAsaOMARpwbtru_0 2024-09-12T18:13:49.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.149+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16929141800534423131', time=2024-09-12T19:46:19.320881+0000, chain.objs.size()=1 2024-09-12T18:13:49.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.149+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.a5tzcz-XNN4RXUsrhEdYpo-HSLsR-Un_0 2024-09-12T18:13:49.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.149+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17551130637536642295', time=2024-09-12T19:46:19.471040+0000, chain.objs.size()=1 2024-09-12T18:13:49.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.149+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.dMjugjSfDmLnzUp0PwFChF2mCAuiVzC_0 2024-09-12T18:13:49.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.149+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14962879396887373334', time=2024-09-12T19:46:28.329257+0000, chain.objs.size()=1 2024-09-12T18:13:49.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.149+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.273__shadow_.kdCpcWZ2Rw1ZQC_k6akWbGsXpOgC5Uf_0 2024-09-12T18:13:49.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.150+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9467809132727157308', time=2024-09-12T19:46:31.927356+0000, chain.objs.size()=1 2024-09-12T18:13:49.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.150+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.277__shadow_.q6SzX2peTkFhHrSrloFm-xEiueAPWMF_0 2024-09-12T18:13:49.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.152+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6282516765409707592', time=2024-09-12T19:46:42.990514+0000, chain.objs.size()=1 2024-09-12T18:13:49.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.152+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.289__shadow_.OWlht8K_04VPVOHXW-NKviMzsDoMYUh_0 2024-09-12T18:13:49.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.152+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17160709123761092977', time=2024-09-12T19:46:48.156086+0000, chain.objs.size()=1 2024-09-12T18:13:49.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.152+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.293__shadow_.Brdy-5yuBYoxfqUaXmNPmkvS-ery6dx_0 2024-09-12T18:13:49.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.152+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11468099825671817498', time=2024-09-12T19:46:50.330404+0000, chain.objs.size()=1 2024-09-12T18:13:49.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.152+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.294__shadow_.eAJ7wKBn-J2bSRWcCGbqh-dElocPILR_0 2024-09-12T18:13:49.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.152+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9783743221033074539', time=2024-09-12T19:46:50.331228+0000, chain.objs.size()=1 2024-09-12T18:13:49.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.152+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.294__shadow_.BmHCRLpeQQ-KUbW7NTS7iKd2Drfq53O_0 2024-09-12T18:13:49.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.152+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8754909512644856392', time=2024-09-12T19:47:59.916891+0000, chain.objs.size()=1 2024-09-12T18:13:49.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.152+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.qEkofw4U10dSEj-pMaqhgwBVzHnsbjO_0 2024-09-12T18:13:49.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.152+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17511345672624349056', time=2024-09-12T19:47:59.990326+0000, chain.objs.size()=1 2024-09-12T18:13:49.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.152+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.-YIKMHWVKMOnScETNGGFPgQKfRxComv_0 2024-09-12T18:13:49.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.152+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14712948595420931904', time=2024-09-12T19:48:00.079173+0000, chain.objs.size()=1 2024-09-12T18:13:49.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.152+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.vhEcTk6GDWAnxXETZQRf6EUzN30TByD_0 2024-09-12T18:13:49.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.152+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17266228347393578830', time=2024-09-12T19:48:00.459427+0000, chain.objs.size()=1 2024-09-12T18:13:49.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.152+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.k-aFmTOryyHkCydkHXDM6l9jhW2kbdl_0 2024-09-12T18:13:49.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.152+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11620792324168078777', time=2024-09-12T19:48:01.919444+0000, chain.objs.size()=1 2024-09-12T18:13:49.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.152+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.DggY7XuNtXmWeetwKPKX_YFXIVqq3RU_0 2024-09-12T18:13:49.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.152+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1957913493120402115', time=2024-09-12T19:48:01.991691+0000, chain.objs.size()=1 2024-09-12T18:13:49.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.152+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.iUBM87FhGUqg_SYZc8nTjq9qp_-u4KF_0 2024-09-12T18:13:49.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.152+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11926033900342814118', time=2024-09-12T19:48:02.872868+0000, chain.objs.size()=1 2024-09-12T18:13:49.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.152+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.uOkFoOcy9-1ORl8VmwiA9AbTFs0X1qP_0 2024-09-12T18:13:49.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.153+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11643521204821469956', time=2024-09-12T19:48:02.930246+0000, chain.objs.size()=1 2024-09-12T18:13:49.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.153+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.-ddsGYXjU6vBnGMgUtQkmydRHlNuqts_0 2024-09-12T18:13:49.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.153+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15374786010593879879', time=2024-09-12T19:48:03.360414+0000, chain.objs.size()=1 2024-09-12T18:13:49.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.153+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.iAFtfJfVmB6hB7XqJ7pAQHNK3_sbQ-G_0 2024-09-12T18:13:49.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.154+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1612258526828261274', time=2024-09-12T19:48:03.361156+0000, chain.objs.size()=1 2024-09-12T18:13:49.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.154+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.cZmo5EP-wsicvDm-E2bdd1jdpaCeNtE_0 2024-09-12T18:13:49.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.154+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14989320571379065065', time=2024-09-12T19:48:03.890325+0000, chain.objs.size()=1 2024-09-12T18:13:49.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.154+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.teHv40Zsj1w6-SBG6Wufsm4XtB9n209_0 2024-09-12T18:13:49.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.154+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10815455065363566317', time=2024-09-12T19:48:04.076518+0000, chain.objs.size()=1 2024-09-12T18:13:49.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.154+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.qEQocNssxHCAaNXznOvlAdjS91OX_iS_0 2024-09-12T18:13:49.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.154+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2834672777265254171', time=2024-09-12T19:48:04.327294+0000, chain.objs.size()=1 2024-09-12T18:13:49.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.154+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.4q-ffU2AlRgudvVMHdmNQ4Cq5ewReWH_0 2024-09-12T18:13:49.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.155+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11671818880569895111', time=2024-09-12T19:48:04.586367+0000, chain.objs.size()=1 2024-09-12T18:13:49.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.155+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.9LyvHpw5CJjwN67x4VieC7CbIjuRQqk_0 2024-09-12T18:13:49.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.155+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.892676954791063415', time=2024-09-12T19:48:04.708800+0000, chain.objs.size()=1 2024-09-12T18:13:49.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.155+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.WKi02HLKAcdKP7kKYz2X8vC_raoLxhY_0 2024-09-12T18:13:49.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.155+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9286071138694689978', time=2024-09-12T19:48:05.426695+0000, chain.objs.size()=1 2024-09-12T18:13:49.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.155+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.4cF1byp5KsGRDHUUjpkPDjwPy2J8FxH_0 2024-09-12T18:13:49.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.155+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10842494776149048649', time=2024-09-12T19:48:05.475710+0000, chain.objs.size()=1 2024-09-12T18:13:49.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.155+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.V7DMjz5B9Gwn7uNwtv_W1NgdJ22r0d5_0 2024-09-12T18:13:49.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.155+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.510883981871147815', time=2024-09-12T19:48:05.515335+0000, chain.objs.size()=1 2024-09-12T18:13:49.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.155+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.iw_8cyWm_rZtVO8TX07_0oIgOZ-oqq5_0 2024-09-12T18:13:49.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.155+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.728452359533982207', time=2024-09-12T19:48:05.739760+0000, chain.objs.size()=1 2024-09-12T18:13:49.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.155+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.zucGOfWxX464iFyjOd_YnFq4HzbpF4S_0 2024-09-12T18:13:49.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.155+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14397983762117039370', time=2024-09-12T19:48:05.778356+0000, chain.objs.size()=1 2024-09-12T18:13:49.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.155+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.2ip22fY32UV9cRMSlSFt0PzKvLaOROO_0 2024-09-12T18:13:49.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.155+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16054520754673234928', time=2024-09-12T19:48:06.702562+0000, chain.objs.size()=1 2024-09-12T18:13:49.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.155+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.uPvJfC1FKyN88QEUxC9V3ed_fRvlduC_0 2024-09-12T18:13:49.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.156+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5212371693884646096', time=2024-09-12T19:48:06.991514+0000, chain.objs.size()=1 2024-09-12T18:13:49.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.156+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.6YwX5heIb-K-vS42dTrMZKTspQDT8-d_0 2024-09-12T18:13:49.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.156+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5230509171324227607', time=2024-09-12T19:48:07.535653+0000, chain.objs.size()=1 2024-09-12T18:13:49.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.156+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_._5gruuBe-FQ_TZCRDRmQnr_xrP6jzQd_0 2024-09-12T18:13:49.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.156+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9155810671864168075', time=2024-09-12T19:48:07.619586+0000, chain.objs.size()=1 2024-09-12T18:13:49.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.156+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.JUfU7NHOAi5qXJMYkucD7ZVY6V3aKLn_0 2024-09-12T18:13:49.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.156+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15091928572529781109', time=2024-09-12T19:48:07.654708+0000, chain.objs.size()=1 2024-09-12T18:13:49.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.156+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.dJOVz4fWyf4GN1DqelP3af-hUGvaumV_0 2024-09-12T18:13:49.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.157+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9951598251706172039', time=2024-09-12T19:48:08.556026+0000, chain.objs.size()=1 2024-09-12T18:13:49.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.157+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.OmV80fCeQ2lO-r7KtmeanVzyqp6vYsP_0 2024-09-12T18:13:49.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.157+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12524058908638588146', time=2024-09-12T19:48:08.724795+0000, chain.objs.size()=1 2024-09-12T18:13:49.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.157+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.3SvEw4MWmNY2WIXqDSZedkMsf_vUgyB_0 2024-09-12T18:13:49.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.157+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8030045334307994055', time=2024-09-12T19:48:47.461946+0000, chain.objs.size()=1 2024-09-12T18:13:49.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.157+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.xWyRmJb7Irru5Q7Vv9pK0wo5QSK8VMw_0 2024-09-12T18:13:49.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.157+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12205279002124697674', time=2024-09-12T19:48:47.507466+0000, chain.objs.size()=1 2024-09-12T18:13:49.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.157+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.erJbiry7PCK7NT2M9YlMI_dqoCfo6tz_0 2024-09-12T18:13:49.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.157+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17720871740547727835', time=2024-09-12T19:48:47.596989+0000, chain.objs.size()=1 2024-09-12T18:13:49.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.157+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.UW7gWW7L8pnRszHPeDsq1JcCnUBBhtp_0 2024-09-12T18:13:49.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.157+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12595471360421908268', time=2024-09-12T19:48:47.787428+0000, chain.objs.size()=1 2024-09-12T18:13:49.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.157+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.uP8cwelG8xAxHq5dgxT-KNT8RCpRR65_0 2024-09-12T18:13:49.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.157+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7271717120270097040', time=2024-09-12T19:48:49.329703+0000, chain.objs.size()=1 2024-09-12T18:13:49.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.157+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.8Sy1zZAuaxgyDdvPR3P3sZCdG-9uwE-_0 2024-09-12T18:13:49.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.158+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16163672172524641692', time=2024-09-12T19:48:50.506754+0000, chain.objs.size()=1 2024-09-12T18:13:49.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.158+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.22ujSbrya9FNYm50D3plY4Fjp2H1-oU_0 2024-09-12T18:13:49.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.159+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3694459132663762039', time=2024-09-12T19:48:50.507475+0000, chain.objs.size()=1 2024-09-12T18:13:49.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.159+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Mu2XtRI1SsWBcI0-MwPvXKddD77YIRR_0 2024-09-12T18:13:49.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.159+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16178473351242752962', time=2024-09-12T19:48:50.638106+0000, chain.objs.size()=1 2024-09-12T18:13:49.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.159+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.xYk9nq5gp2TYAKBXFD_9jEp4GIB2-at_0 2024-09-12T18:13:49.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.159+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1652673456703491575', time=2024-09-12T19:48:51.426294+0000, chain.objs.size()=1 2024-09-12T18:13:49.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.159+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.njPk01OajrrKji1rVR-qfMa-OZMQrbO_0 2024-09-12T18:13:49.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.159+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17328533685697763313', time=2024-09-12T19:48:51.503851+0000, chain.objs.size()=1 2024-09-12T18:13:49.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.159+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.lHuceUzVl7uzulEjoP1L9h3mNC05AMg_0 2024-09-12T18:13:49.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.160+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15255517557045234318', time=2024-09-12T19:48:52.176709+0000, chain.objs.size()=1 2024-09-12T18:13:49.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.160+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.2Wu2UOCek3kmsi18AZ4AJj0MIJ3hN10_0 2024-09-12T18:13:49.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.160+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13027230980157475757', time=2024-09-12T19:48:52.265480+0000, chain.objs.size()=1 2024-09-12T18:13:49.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.160+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.l4x7l70VilVWDK2AvZ8r0kdkEcSHbXv_0 2024-09-12T18:13:49.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.160+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8797231107239884938', time=2024-09-12T19:48:52.414288+0000, chain.objs.size()=1 2024-09-12T18:13:49.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.160+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Y7-iVBfenuZ5DSgoHJSm_HwHS0yVdkt_0 2024-09-12T18:13:49.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.160+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10172726472150148513', time=2024-09-12T19:48:53.432590+0000, chain.objs.size()=1 2024-09-12T18:13:49.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.160+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.MslNF-zv80TsoyUokBcIOp-icr2mMu8_0 2024-09-12T18:13:49.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.160+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16624523787623757653', time=2024-09-12T19:48:54.084318+0000, chain.objs.size()=1 2024-09-12T18:13:49.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.160+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.kHG7ABKjorAVgZQzOZLU5uB3X44h9z__0 2024-09-12T18:13:49.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.160+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12576633821457103322', time=2024-09-12T19:48:54.104004+0000, chain.objs.size()=1 2024-09-12T18:13:49.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.160+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.hY-ktDUUp2fwUllBm2OIOiUobb3_Y5G_0 2024-09-12T18:13:49.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.160+0000 7f35f175d640 0 -- 172.21.15.67:0/1761719668 >> [v2:172.21.15.118:6808/1825660705,v1:172.21.15.118:6809/1825660705] conn(0x5575e84e8f20 msgr2=0x5575e84eb370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:13:49.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.161+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7319138184473641871', time=2024-09-12T19:48:54.666929+0000, chain.objs.size()=1 2024-09-12T18:13:49.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.161+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.iBeE9EC2pZurPdvuLFPCqzKi87uN-a9_0 2024-09-12T18:13:49.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.161+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14938878392800552703', time=2024-09-12T19:48:54.823575+0000, chain.objs.size()=1 2024-09-12T18:13:49.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.161+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.kFxfjJ0WEWvHZ-TRTiAkjFU_Rs1L6Kp_0 2024-09-12T18:13:49.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.161+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16626454532266152193', time=2024-09-12T19:48:54.849041+0000, chain.objs.size()=1 2024-09-12T18:13:49.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.161+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.c45qQckzamr51v4DESLfMZ4QluzsZU3_0 2024-09-12T18:13:49.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.161+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10673660989931922380', time=2024-09-12T19:48:54.907019+0000, chain.objs.size()=1 2024-09-12T18:13:49.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.161+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.HQ1al1cyQFzP8XRgWWfsCIQGW4N26DT_0 2024-09-12T18:13:49.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.161+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16254113110423062514', time=2024-09-12T19:48:55.100352+0000, chain.objs.size()=1 2024-09-12T18:13:49.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.161+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Bvfnz8rYvVX2NjIWbgUZD_3B9xvZZTi_0 2024-09-12T18:13:49.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.162+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4063999820923371953', time=2024-09-12T19:48:55.990013+0000, chain.objs.size()=1 2024-09-12T18:13:49.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.162+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.xmhakiIbU1JsoZDyi2M9V2anSAv8PbD_0 2024-09-12T18:13:49.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.162+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7672000157991486762', time=2024-09-12T19:48:55.990829+0000, chain.objs.size()=1 2024-09-12T18:13:49.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.162+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.SFNFhr3DUM2huQDDA-GiFcMI8JBBEd6_0 2024-09-12T18:13:49.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.162+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7322457066966438282', time=2024-09-12T19:48:56.131199+0000, chain.objs.size()=1 2024-09-12T18:13:49.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.162+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.bCiMab9vi9s_V9jKYrws0dfez_yGMRI_0 2024-09-12T18:13:49.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.163+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.820345523138823779', time=2024-09-12T19:48:56.376773+0000, chain.objs.size()=1 2024-09-12T18:13:49.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.163+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.vLW3Xhrs5as9Wtwq34h5pnKVIGSiogS_0 2024-09-12T18:13:49.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.163+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10450497211790941795', time=2024-09-12T19:48:56.592168+0000, chain.objs.size()=1 2024-09-12T18:13:49.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.163+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.c7LbhfCG-b-XRQ3anExGxb3_fyBrTG3_0 2024-09-12T18:13:49.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.163+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4291249819976580774', time=2024-09-12T19:48:56.953828+0000, chain.objs.size()=1 2024-09-12T18:13:49.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.163+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.t1iBoof7kIpgLvfjfXaYVwFrF5yAJCF_0 2024-09-12T18:13:49.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.163+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8515875263770137741', time=2024-09-12T19:48:57.365483+0000, chain.objs.size()=1 2024-09-12T18:13:49.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.163+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.rHbiPvVuQ4O-FbDlej2vg6lj0Li056t_0 2024-09-12T18:13:49.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.163+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8476790141338021731', time=2024-09-12T19:48:57.379263+0000, chain.objs.size()=1 2024-09-12T18:13:49.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.163+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Dhzs1gex5F38pCrjZc5OmL2wD29aZBJ_0 2024-09-12T18:13:49.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.163+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6233643076064657753', time=2024-09-12T19:48:57.722678+0000, chain.objs.size()=1 2024-09-12T18:13:49.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.163+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Za_4CEGVWhIlpYIGWj6pApBnLwnb4_4_0 2024-09-12T18:13:49.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.163+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11051847961695942310', time=2024-09-12T19:48:57.898146+0000, chain.objs.size()=1 2024-09-12T18:13:49.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.163+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.5EYNw6w6k0M-eSAJ72Ne356MkccVTHT_0 2024-09-12T18:13:49.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.165+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/49267 2024-09-12T18:13:49.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.167+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T18:13:49.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.167+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5831192134488329630', time=2024-09-12T19:48:57.945013+0000, chain.objs.size()=1 2024-09-12T18:13:49.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.167+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.MKSz75R4KB6eRKwOJ1bJUvuBa-hYYlV_0 2024-09-12T18:13:49.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.167+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11540167194225838089', time=2024-09-12T19:49:16.203041+0000, chain.objs.size()=1 2024-09-12T18:13:49.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.167+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.346__shadow_.qPr7h9_UL8f6Yfs7iVk-bpiT4S_cWeK_0 2024-09-12T18:13:49.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.167+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3692619388353063374', time=2024-09-12T19:49:47.565505+0000, chain.objs.size()=1 2024-09-12T18:13:49.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.167+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.384__shadow_.2g7IsD5gSK8AM91iYBNw2NBS-ZOojCi_0 2024-09-12T18:13:49.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.167+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4028585257805752893', time=2024-09-12T19:50:35.507954+0000, chain.objs.size()=1 2024-09-12T18:13:49.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.167+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.438__shadow_.GFyUQXvxzu4ZDwVQnyFjeOr_WmqivLf_0 2024-09-12T18:13:49.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.167+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8004438899684935201', time=2024-09-12T19:50:38.112364+0000, chain.objs.size()=1 2024-09-12T18:13:49.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.167+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.441__shadow_.rrWCC7ImIct3sC3eEiz1TUj4L3vNssJ_0 2024-09-12T18:13:49.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.167+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10100188992124444433', time=2024-09-12T19:50:40.915247+0000, chain.objs.size()=1 2024-09-12T18:13:49.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.167+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.444__shadow_.-FzWu4uq43yX6kW-9GSJS0VqyKyZN02_0 2024-09-12T18:13:49.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.167+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9312260705590790064', time=2024-09-12T19:51:06.475357+0000, chain.objs.size()=1 2024-09-12T18:13:49.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.167+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.466__shadow_.pWamRdciPpOUzx9dotnY5Y7u4KL8czk_0 2024-09-12T18:13:49.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.167+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2472981611186915895', time=2024-09-12T19:51:08.138409+0000, chain.objs.size()=1 2024-09-12T18:13:49.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.167+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.467__shadow_.fYAYj8i-ZYJq7tuOGm-QGYKYTC-Jjd4_0 2024-09-12T18:13:49.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.167+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5645732442713061255', time=2024-09-12T19:51:33.672972+0000, chain.objs.size()=1 2024-09-12T18:13:49.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.167+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.497__shadow_.p8b-D26SN0YNNeOuv_Go35i3AD34zjy_0 2024-09-12T18:13:49.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.167+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~oFfnDrleS9_Z1Y62Vrx2QtMY47ND3ko', time=2024-09-12T19:54:11.027496+0000, chain.objs.size()=1 2024-09-12T18:13:49.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.167+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~oFfnDrleS9_Z1Y62Vrx2QtMY47ND3ko.3 2024-09-12T18:13:49.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.167+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6767067428851915148', time=2024-09-12T19:55:30.163798+0000, chain.objs.size()=1 2024-09-12T18:13:49.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.167+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.526__multipart_mymultipart.2~eRP_AStPmjNrH692id7D5SOUtVH9js3.1 2024-09-12T18:13:49.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.167+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3747700556607923431', time=2024-09-12T19:58:19.479748+0000, chain.objs.size()=1 2024-09-12T18:13:49.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.167+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.576__shadow:9POJ4bVWN5Z0Xw02T8-pspTE.JiIrbX_.SZ7j5y7eQeDiPB1C0EGO8DpP_C6Xayc_0 2024-09-12T18:13:49.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.167+0000 7f35f175d640 0 -- 172.21.15.67:0/1761719668 >> [v2:172.21.15.118:6808/1825660705,v1:172.21.15.118:6809/1825660705] conn(0x7f34bc08d6f0 msgr2=0x7f34bc08c2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:13:49.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.169+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7130682581388722373', time=2024-09-12T19:58:35.504146+0000, chain.objs.size()=1 2024-09-12T18:13:49.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.169+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:8rVrkmMUa.9x8BZvwuZnHNi2c30cnEt_.xN5UXrFfY3sxzfa6zMfSLVAeYYpoa9U_0 2024-09-12T18:13:49.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.169+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7674957921103073987', time=2024-09-12T19:58:41.592054+0000, chain.objs.size()=1 2024-09-12T18:13:49.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.169+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:lf2AbcUZ-cLUB7VtlINM5dvTBOjsU8U_.vgp35qJ5YxdbTnUeQRQywi-ktSx0uwn_0 2024-09-12T18:13:49.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.169+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3653350274524618877', time=2024-09-12T19:59:37.493659+0000, chain.objs.size()=1 2024-09-12T18:13:49.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.169+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.586__shadow:--76mD7sNzj.eKY0N9nQIJGJH7Q67IM_.JdpkXddUDwFq06GpY8-AjcVdPNA1sBv_0 2024-09-12T18:13:49.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.169+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5313195871636459595', time=2024-09-12T19:59:38.856293+0000, chain.objs.size()=1 2024-09-12T18:13:49.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.169+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.587__shadow:6EQdsmT1GY16RyuPqVyJniC1C2dUdAu_.TvvSaqdi6azZSys05C2xn4UQHYq4bTN_0 2024-09-12T18:13:49.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.169+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14010289846649508837', time=2024-09-12T20:05:11.258345+0000, chain.objs.size()=2 2024-09-12T18:13:49.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.169+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.645__shadow_.aRBsEvGl2E_UJTGUi4oM5zEUvdpJQtT_0 2024-09-12T18:13:49.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.169+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.645__shadow_.aRBsEvGl2E_UJTGUi4oM5zEUvdpJQtT_1 2024-09-12T18:13:49.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.170+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9609474482686647519', time=2024-09-12T20:06:01.686905+0000, chain.objs.size()=1 2024-09-12T18:13:49.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.170+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.664__shadow_.DvdYpSAbF7D69B5HCUyNsGbXMD4HZJH_0 2024-09-12T18:13:49.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.170+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8991959743833442932', time=2024-09-12T20:06:08.129550+0000, chain.objs.size()=1 2024-09-12T18:13:49.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.170+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.671__shadow_.LyonUt7Jbk02pHVqeA7m4SV0YHza_Ol_0 2024-09-12T18:13:49.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.170+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2507037498012847791', time=2024-09-12T20:06:29.420808+0000, chain.objs.size()=1 2024-09-12T18:13:49.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.170+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.699__shadow:22J.MQyyoUMdWd4cfmlSQHHrbS-Hb1l_.ogv0TEQXNFHvUVeBcJd2JZIxfQgxWS9_0 2024-09-12T18:13:49.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.171+0000 7f35f175d640 0 -- 172.21.15.67:0/1761719668 >> [v2:172.21.15.118:6808/1825660705,v1:172.21.15.118:6809/1825660705] conn(0x5575e84e8f20 msgr2=0x7f34bc091c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:13:49.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.173+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:49.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.175+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:13:49.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.177+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:49.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.177+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:49.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.178+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47689' 2024-09-12T18:13:49.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.178+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2572717195189047840', time=2024-09-12T19:41:08.105088+0000, chain.objs.size()=1 2024-09-12T18:13:49.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.178+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.149__shadow_.rV7UkXvd15U1ox3h6CCy0x8drIeM44B_0 2024-09-12T18:13:49.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.178+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='_fjkJXGIZja2kzOuNdD2OdvsydTVWr4K', time=2024-09-12T19:42:17.189233+0000, chain.objs.size()=1 2024-09-12T18:13:49.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.178+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.164__shadow_.538j6uSE19BJAdy2onjsy52Is59DRxi_0 2024-09-12T18:13:49.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.178+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2426335798941955388', time=2024-09-12T19:45:21.821534+0000, chain.objs.size()=1 2024-09-12T18:13:49.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.178+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.251__shadow_.B84Dm8cP6_SGvPYpVXRm5-6l-TrCrsr_0 2024-09-12T18:13:49.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.178+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1605739056905138763', time=2024-09-12T19:46:08.757733+0000, chain.objs.size()=1 2024-09-12T18:13:49.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.178+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.BTteus8nyWpcSXJnd7DG-CRVPtpgBd9_0 2024-09-12T18:13:49.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.178+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16247469725428767385', time=2024-09-12T19:46:09.477521+0000, chain.objs.size()=1 2024-09-12T18:13:49.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.178+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.PG-mWFSz_Xlmhqq6dSIf_7lT0WE1NhR_0 2024-09-12T18:13:49.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.178+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2914814607935512691', time=2024-09-12T19:46:09.566192+0000, chain.objs.size()=1 2024-09-12T18:13:49.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.178+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Kni9QOUvHbpbaZDZBkI0NjkWEPbHnwJ_0 2024-09-12T18:13:49.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.178+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6952782297368511248', time=2024-09-12T19:46:09.751134+0000, chain.objs.size()=1 2024-09-12T18:13:49.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.178+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.pXtHC0wkhSUt9CbzrPs18BKKLitjVX4_0 2024-09-12T18:13:49.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.178+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11240862148976224797', time=2024-09-12T19:46:09.840209+0000, chain.objs.size()=1 2024-09-12T18:13:49.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.178+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ekdH5XCc17lAXrCwIx24Cmi8xk1yE3u_0 2024-09-12T18:13:49.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.178+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18411998429065838674', time=2024-09-12T19:46:10.367210+0000, chain.objs.size()=1 2024-09-12T18:13:49.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.178+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ZtLj-LLlikflDwdPB7eP2fc1wOEVqT__0 2024-09-12T18:13:49.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.178+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15332148376947168329', time=2024-09-12T19:46:10.405098+0000, chain.objs.size()=1 2024-09-12T18:13:49.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.178+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.WXb8wWpRjp20MlSt3QVtwwOplyWKBUV_0 2024-09-12T18:13:49.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.178+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6092301442470986827', time=2024-09-12T19:46:10.761866+0000, chain.objs.size()=1 2024-09-12T18:13:49.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.178+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.kwmPqH3D7Hg6JfcDuIQsO-zRqxDyYuV_0 2024-09-12T18:13:49.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.178+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3810771049323562232', time=2024-09-12T19:46:10.874114+0000, chain.objs.size()=1 2024-09-12T18:13:49.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.178+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.dAFZSJ4-9UlmLMNEyaKkrp1ALBbw0LN_0 2024-09-12T18:13:49.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.180+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12318819249472165810', time=2024-09-12T19:46:11.082973+0000, chain.objs.size()=1 2024-09-12T18:13:49.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.180+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.LMPWBwEGh_7ysJBDM9d26x9KJAznwGC_0 2024-09-12T18:13:49.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.180+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17623334584971990039', time=2024-09-12T19:46:11.210104+0000, chain.objs.size()=1 2024-09-12T18:13:49.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.180+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.xM4EQkJWHXeZqmGOWFmZtiMeF8MOYwu_0 2024-09-12T18:13:49.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.180+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1791469952217615602', time=2024-09-12T19:46:12.131971+0000, chain.objs.size()=1 2024-09-12T18:13:49.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.180+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.43k_M57iFhjcq2oZjviibGyjEtVlQRC_0 2024-09-12T18:13:49.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.180+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4082970670273814586', time=2024-09-12T19:46:12.293007+0000, chain.objs.size()=1 2024-09-12T18:13:49.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.180+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.8M_eAAIpOyRqVMr-laDV9gBXNBSCgxc_0 2024-09-12T18:13:49.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.180+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5066695532491368356', time=2024-09-12T19:46:12.607530+0000, chain.objs.size()=1 2024-09-12T18:13:49.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.180+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.KmGVdAW-j9AF73P-lfOK6GrLUzY5Fpy_0 2024-09-12T18:13:49.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.180+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1251045804523380933', time=2024-09-12T19:46:13.815190+0000, chain.objs.size()=1 2024-09-12T18:13:49.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.180+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Ld4FBSyAYnKhCXZ0raCypFLuCslAujF_0 2024-09-12T18:13:49.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.180+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17441543219110747494', time=2024-09-12T19:46:14.035879+0000, chain.objs.size()=1 2024-09-12T18:13:49.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.180+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.XhJH2xAtG3PnrYbRKmoStAPAaCcX-o0_0 2024-09-12T18:13:49.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.182+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13155654460067863840', time=2024-09-12T19:46:14.908876+0000, chain.objs.size()=1 2024-09-12T18:13:49.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.182+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.duFXHvqFqXKlMvk41eVR0m0YAaN3C7s_0 2024-09-12T18:13:49.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.182+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9150646347741971190', time=2024-09-12T19:46:15.188457+0000, chain.objs.size()=1 2024-09-12T18:13:49.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.182+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.BlXelaShD7Nx-kS0Dkr_rZcP5ZsnZu1_0 2024-09-12T18:13:49.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.182+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13922347229173259061', time=2024-09-12T19:46:15.232914+0000, chain.objs.size()=1 2024-09-12T18:13:49.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.182+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.mZGTk_XwTdoC1Od940Gf6sOVZ-e3ZkP_0 2024-09-12T18:13:49.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.182+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4668538631888606638', time=2024-09-12T19:46:15.705127+0000, chain.objs.size()=1 2024-09-12T18:13:49.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.182+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.JJEqX28F8IO_Av9yah2XFP-CuBlzwrE_0 2024-09-12T18:13:49.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.185+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8684110189420905006', time=2024-09-12T19:46:16.302837+0000, chain.objs.size()=1 2024-09-12T18:13:49.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.185+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.9R4njt19b25PMO9GtflYeVcBHzK04Q8_0 2024-09-12T18:13:49.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.185+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17497377885144602985', time=2024-09-12T19:46:16.656890+0000, chain.objs.size()=1 2024-09-12T18:13:49.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.185+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.8uZDjQlopLU9yInJi5z-sv8s5MAGmjE_0 2024-09-12T18:13:49.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.185+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11684097925233312018', time=2024-09-12T19:46:17.123963+0000, chain.objs.size()=1 2024-09-12T18:13:49.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.185+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.SIkO5ugyXxpBdntVylddyC5juG7H9fK_0 2024-09-12T18:13:49.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.185+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13118457512376662551', time=2024-09-12T19:46:17.667336+0000, chain.objs.size()=1 2024-09-12T18:13:49.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.185+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.0pkiPj_vrJT252yqoW1p41Xi3u1l0JH_0 2024-09-12T18:13:49.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.185+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18050935963072653837', time=2024-09-12T19:46:17.746964+0000, chain.objs.size()=1 2024-09-12T18:13:49.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.185+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.52W3O8mucJxhRkjskjuWw5sMxcUy3oq_0 2024-09-12T18:13:49.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.185+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14552652186517725856', time=2024-09-12T19:46:17.997823+0000, chain.objs.size()=1 2024-09-12T18:13:49.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.185+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.dlDGcCTbzJS1mWP5yx7HxftcrzzM46R_0 2024-09-12T18:13:49.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.187+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13635040859517904001', time=2024-09-12T19:46:18.455184+0000, chain.objs.size()=1 2024-09-12T18:13:49.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.187+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.cmFzJTvDlEDA66UyXpPUbIkiQxgRBK9_0 2024-09-12T18:13:49.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.187+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9392205382834460466', time=2024-09-12T19:46:18.753408+0000, chain.objs.size()=1 2024-09-12T18:13:49.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.187+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.d3zhPQhEow4gdsLxI2TDdlDFO14wfOP_0 2024-09-12T18:13:49.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.187+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14856879251265889978', time=2024-09-12T19:46:18.863199+0000, chain.objs.size()=1 2024-09-12T18:13:49.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.187+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Xg2TVsUxxF3Ch3HkZQLOXwhV_4mBqY4_0 2024-09-12T18:13:49.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.187+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5107899250020521434', time=2024-09-12T19:46:18.899686+0000, chain.objs.size()=1 2024-09-12T18:13:49.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.187+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Kj8Y-CnMl8qceDU5EwNWgFAztX-MhB__0 2024-09-12T18:13:49.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.187+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16458048300504232312', time=2024-09-12T19:46:19.087133+0000, chain.objs.size()=1 2024-09-12T18:13:49.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.187+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.mHpyEh2BSBiSgRPSGDrh49-6GBNvmrE_0 2024-09-12T18:13:49.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.187+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14271914625608434595', time=2024-09-12T19:46:19.184898+0000, chain.objs.size()=1 2024-09-12T18:13:49.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.187+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ZUCVqOekLFWPcqiwVryLhXusBguxub6_0 2024-09-12T18:13:49.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.187+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16325554149732412972', time=2024-09-12T19:46:19.380110+0000, chain.objs.size()=1 2024-09-12T18:13:49.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.187+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.0gUBLb0b7kYGaauBmlyNQNQGUc2KCBY_0 2024-09-12T18:13:49.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.187+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14405767336706899831', time=2024-09-12T19:46:19.521057+0000, chain.objs.size()=1 2024-09-12T18:13:49.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.187+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.nFu7_-4yIxuBqBnMnn70w_TqRqEn3ZT_0 2024-09-12T18:13:49.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.187+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.543977848624097977', time=2024-09-12T19:46:25.752460+0000, chain.objs.size()=1 2024-09-12T18:13:49.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.187+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.270__shadow_.s3CFFpiyZnpe9Zcf35D4luqS8EMOz6q_0 2024-09-12T18:13:49.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.187+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6659358935882467191', time=2024-09-12T19:46:26.607720+0000, chain.objs.size()=1 2024-09-12T18:13:49.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.187+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.271__shadow_.e6IoZ2e8BcNdrnLByLArzoyn6ORMHwy_0 2024-09-12T18:13:49.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.187+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11040741140892364942', time=2024-09-12T19:46:38.315898+0000, chain.objs.size()=1 2024-09-12T18:13:49.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.187+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.284__shadow_.3pxpWjjMWyxJuCeqhqoVk8eFvbPzZeK_0 2024-09-12T18:13:49.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.188+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14083224775321585504', time=2024-09-12T19:46:50.297433+0000, chain.objs.size()=1 2024-09-12T18:13:49.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.188+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.294__shadow_.qw_YFdTugVlznPMVqnf2mfHQOOnWCiU_0 2024-09-12T18:13:49.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.189+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2290028795475606512', time=2024-09-12T19:46:53.187900+0000, chain.objs.size()=1 2024-09-12T18:13:49.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.189+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.297__shadow_.zBJ3OCguF3ntavVCBr0OqKsPUZHkEn3_0 2024-09-12T18:13:49.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.189+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9621933404135524965', time=2024-09-12T19:46:53.188636+0000, chain.objs.size()=1 2024-09-12T18:13:49.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.189+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.297__shadow_.7JabQ-QMJe94YUh1h9b2WrBs7N_44lx_0 2024-09-12T18:13:49.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.189+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10437215726800983176', time=2024-09-12T19:47:01.579028+0000, chain.objs.size()=1 2024-09-12T18:13:49.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.189+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.306__shadow_._vM1J5LdDRzb6tJQ5qYwlRZ5fXujZjg_0 2024-09-12T18:13:49.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.189+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1749852203043608677', time=2024-09-12T19:47:02.746300+0000, chain.objs.size()=1 2024-09-12T18:13:49.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.189+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.307__shadow_.DSPLtw0vHZIQ8iu9Z2DrxAIBu--MEYF_0 2024-09-12T18:13:49.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.189+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4822349067580739263', time=2024-09-12T19:47:59.635862+0000, chain.objs.size()=1 2024-09-12T18:13:49.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.189+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.1uZnRf4jorqmFJM5wiJGJwHLp4jKwwo_0 2024-09-12T18:13:49.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.189+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16395433125129673089', time=2024-09-12T19:47:59.672266+0000, chain.objs.size()=1 2024-09-12T18:13:49.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.189+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.dI8gvvhkOW9gZuavYZ7Ys0yP_7TVjuw_0 2024-09-12T18:13:49.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.189+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10990430561141612420', time=2024-09-12T19:47:59.873775+0000, chain.objs.size()=1 2024-09-12T18:13:49.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.189+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.QKNzagPzhtRrQv1RK22FMFZ9EzXz-7A_0 2024-09-12T18:13:49.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.189+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4140151211349140102', time=2024-09-12T19:48:00.481763+0000, chain.objs.size()=1 2024-09-12T18:13:49.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.189+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.AtU_C1JkJK37wMNXL5Tp_7u_qsMlPf5_0 2024-09-12T18:13:49.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.189+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11907198665646012047', time=2024-09-12T19:48:00.482396+0000, chain.objs.size()=1 2024-09-12T18:13:49.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.189+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.WycZRQLVbU7tfcr_VXxxkzqQRT9-0v5_0 2024-09-12T18:13:49.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.190+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13011769241037490340', time=2024-09-12T19:48:01.282047+0000, chain.objs.size()=1 2024-09-12T18:13:49.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.190+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.SBJbr-nxKvJhffjDHf7kNntoXT9VqFn_0 2024-09-12T18:13:49.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.190+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15311074987213092062', time=2024-09-12T19:48:01.287270+0000, chain.objs.size()=1 2024-09-12T18:13:49.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.190+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.DthM2B-Yu9mck9fftmxFqE2pLq_-xcM_0 2024-09-12T18:13:49.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.192+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12987654853221752215', time=2024-09-12T19:48:01.481154+0000, chain.objs.size()=1 2024-09-12T18:13:49.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.192+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_._JW6dNInz3TwQYolTDAX1kw6JDDLqL2_0 2024-09-12T18:13:49.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.192+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17355748958940296107', time=2024-09-12T19:48:01.547905+0000, chain.objs.size()=1 2024-09-12T18:13:49.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.192+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.s5VtIulaNUkvg26oa8rTjRrQgS2xVbE_0 2024-09-12T18:13:49.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.192+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4158836632119339987', time=2024-09-12T19:48:01.811967+0000, chain.objs.size()=1 2024-09-12T18:13:49.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.192+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_._ywlDxlDRvYti3HSHsQo51gsI8yRXBO_0 2024-09-12T18:13:49.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.192+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8657823248411747735', time=2024-09-12T19:48:01.823070+0000, chain.objs.size()=1 2024-09-12T18:13:49.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.192+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.D9PCF643yJRHgrmmbMzqL-iCJmWeZS6_0 2024-09-12T18:13:49.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.192+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5906389276645238646', time=2024-09-12T19:48:02.748434+0000, chain.objs.size()=1 2024-09-12T18:13:49.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.192+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.REw4b27uY_fjPV_rMCErvD-TxI-GYvr_0 2024-09-12T18:13:49.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.193+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13900367306482905674', time=2024-09-12T19:48:03.072255+0000, chain.objs.size()=1 2024-09-12T18:13:49.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.193+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.raRRMIT3Cc_y-5tiGAlE1qMdaLAE9aP_0 2024-09-12T18:13:49.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.193+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3592127194843796404', time=2024-09-12T19:48:03.929057+0000, chain.objs.size()=1 2024-09-12T18:13:49.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.193+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.MoXzcnhYq-m6HDw013-lLzNrJ6A9nAG_0 2024-09-12T18:13:49.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.193+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5783138281358768848', time=2024-09-12T19:48:04.514637+0000, chain.objs.size()=1 2024-09-12T18:13:49.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.193+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.hg6PSiuHOMtrYefIYQ76SPU9SQz5DID_0 2024-09-12T18:13:49.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.193+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17491254105064948442', time=2024-09-12T19:48:04.852278+0000, chain.objs.size()=1 2024-09-12T18:13:49.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.193+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.xKGxp8epnnJF_clnuqp_eG3Q8z-h98L_0 2024-09-12T18:13:49.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.193+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5838293244171695344', time=2024-09-12T19:48:05.582283+0000, chain.objs.size()=1 2024-09-12T18:13:49.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.193+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.4tHOqgZdZBKgqJUTWkYTyBRlAnOVS_w_0 2024-09-12T18:13:49.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.193+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16873663565888287927', time=2024-09-12T19:48:06.303177+0000, chain.objs.size()=1 2024-09-12T18:13:49.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.193+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.fTRvIfx6JdazZ5ImKCM7gITtw6lHNws_0 2024-09-12T18:13:49.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.194+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3643055672752406969', time=2024-09-12T19:48:06.671269+0000, chain.objs.size()=1 2024-09-12T18:13:49.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.194+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.K-GMDJqvp9vCtW6yq8TBFNZIO_a0inx_0 2024-09-12T18:13:49.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.194+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11222754317780396951', time=2024-09-12T19:48:07.379550+0000, chain.objs.size()=1 2024-09-12T18:13:49.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.194+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.j7ATH-Q4pFrlmOXeZscxAZrqqddbztN_0 2024-09-12T18:13:49.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.194+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1452280695322273676', time=2024-09-12T19:48:07.403059+0000, chain.objs.size()=1 2024-09-12T18:13:49.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.194+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.BQ8tR2LnlilX_jB8IivRAonfkyQd_UR_0 2024-09-12T18:13:49.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.197+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3043893017501603961', time=2024-09-12T19:48:07.474720+0000, chain.objs.size()=1 2024-09-12T18:13:49.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.197+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.KVY3KxxWlTjpnutQHBF8s4vEV1Jv5oC_0 2024-09-12T18:13:49.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.197+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1203474565613141006', time=2024-09-12T19:48:08.123868+0000, chain.objs.size()=1 2024-09-12T18:13:49.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.197+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.iq3edN3U_lfxkuIDkxCtFeQf6xn4I3Y_0 2024-09-12T18:13:49.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.197+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6658582891496215710', time=2024-09-12T19:48:08.173083+0000, chain.objs.size()=1 2024-09-12T18:13:49.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.197+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.HtVE7ey9CWiT7krdQHtdtpdPEG7ZgIa_0 2024-09-12T18:13:49.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.197+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12022801088958599229', time=2024-09-12T19:48:08.177140+0000, chain.objs.size()=1 2024-09-12T18:13:49.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.197+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.s7xQMji4ZG9zH2i4f7sBUpkWkyqFBJ8_0 2024-09-12T18:13:49.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.197+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4032294843645999018', time=2024-09-12T19:48:08.595652+0000, chain.objs.size()=1 2024-09-12T18:13:49.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.197+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ocnG7I-43Ranhr9c7lWsgcs322piw0C_0 2024-09-12T18:13:49.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.197+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3697835003376079711', time=2024-09-12T19:48:09.462838+0000, chain.objs.size()=1 2024-09-12T18:13:49.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.197+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.g1beYsbPtyotDAVvnL_tyqKzC_Tt0SK_0 2024-09-12T18:13:49.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.197+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10189263299389500179', time=2024-09-12T19:48:09.554106+0000, chain.objs.size()=1 2024-09-12T18:13:49.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.197+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Z_kWUngl-nv-uKVAMVbhQSxO-pOqSDw_0 2024-09-12T18:13:49.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.197+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12442177072168670093', time=2024-09-12T19:48:09.801497+0000, chain.objs.size()=1 2024-09-12T18:13:49.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.197+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.yUcqH-pTsrEdsO3Mp6_44km6-KAuC_i_0 2024-09-12T18:13:49.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.197+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18216919511525874591', time=2024-09-12T19:48:10.042818+0000, chain.objs.size()=1 2024-09-12T18:13:49.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.197+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.aJl678lNr4hhwJ8fw0S7VuVfIjR08kr_0 2024-09-12T18:13:49.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.197+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17433049184798470172', time=2024-09-12T19:48:47.471692+0000, chain.objs.size()=1 2024-09-12T18:13:49.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.197+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ik0S29CYF9xP7wu3VG11QRxywn26sdN_0 2024-09-12T18:13:49.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.197+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13268767060617606109', time=2024-09-12T19:48:47.561887+0000, chain.objs.size()=1 2024-09-12T18:13:49.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.197+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.8aLlY7Kny7YpYG9bVSDSgEHkhgal1QX_0 2024-09-12T18:13:49.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.200+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.657711495567362387', time=2024-09-12T19:48:47.623685+0000, chain.objs.size()=1 2024-09-12T18:13:49.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.200+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.0R89cf-Yyi1hnY08gS8j6EfjWTnVhRm_0 2024-09-12T18:13:49.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.200+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8805739012257588187', time=2024-09-12T19:48:47.773463+0000, chain.objs.size()=1 2024-09-12T18:13:49.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.200+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.bYjlNti52TtlGsMf_0T0RQ4VNUUgqgl_0 2024-09-12T18:13:49.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.200+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9266398797583739018', time=2024-09-12T19:48:48.160612+0000, chain.objs.size()=1 2024-09-12T18:13:49.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.200+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.44wBWSV2XoNKuSDVp_Jdg1dfXuUNoL9_0 2024-09-12T18:13:49.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.200+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9038887198615330742', time=2024-09-12T19:48:48.333555+0000, chain.objs.size()=1 2024-09-12T18:13:49.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.200+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Kt1QsjCKLT7gqablu_yuBOsu1FqnZGq_0 2024-09-12T18:13:49.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.200+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18280457003985040484', time=2024-09-12T19:48:49.073845+0000, chain.objs.size()=1 2024-09-12T18:13:49.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.200+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.toPg929U0tNNUYj4bEcbilIsilO0-we_0 2024-09-12T18:13:49.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.200+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13667941410427541944', time=2024-09-12T19:48:49.441893+0000, chain.objs.size()=1 2024-09-12T18:13:49.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.200+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.bfv2Ed0RbX9gxQ9sYb5NQRLdUoIZKNO_0 2024-09-12T18:13:49.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.200+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17044331351852384280', time=2024-09-12T19:48:49.555453+0000, chain.objs.size()=1 2024-09-12T18:13:49.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.200+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.An8ukguv_GVrbfOAE8IZHF_stG0qlcI_0 2024-09-12T18:13:49.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.200+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9970153400803892038', time=2024-09-12T19:48:49.735527+0000, chain.objs.size()=1 2024-09-12T18:13:49.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.200+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.89V7SaA0phPiSaOvNsHl3o-F1MCX0bE_0 2024-09-12T18:13:49.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.200+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13728478196208561971', time=2024-09-12T19:48:51.172082+0000, chain.objs.size()=1 2024-09-12T18:13:49.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.200+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.hcZbCha6TpdlKp0iAQw-J-pdv-hocRT_0 2024-09-12T18:13:49.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.200+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4974887938189577022', time=2024-09-12T19:48:51.172574+0000, chain.objs.size()=1 2024-09-12T18:13:49.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.200+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.z2AqcH5pkCVRB_AmLe7ViJkb7SJXnAB_0 2024-09-12T18:13:49.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.200+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10917875078619610841', time=2024-09-12T19:48:52.006943+0000, chain.objs.size()=1 2024-09-12T18:13:49.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.200+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.IFwOGwok5ggx1jwg_G-8U6FdyZkgFNK_0 2024-09-12T18:13:49.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.201+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16621743356509560550', time=2024-09-12T19:48:52.074880+0000, chain.objs.size()=1 2024-09-12T18:13:49.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.201+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.l1c0iYt1zpt5U2hbAgkZ6DAVCpayWkz_0 2024-09-12T18:13:49.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.203+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12845567940333319486', time=2024-09-12T19:48:52.550696+0000, chain.objs.size()=1 2024-09-12T18:13:49.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.203+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.q8mt_QYmfKl6SR-VVTiS7ZsWcKNkTZT_0 2024-09-12T18:13:49.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.203+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12512774835295103805', time=2024-09-12T19:48:52.668097+0000, chain.objs.size()=1 2024-09-12T18:13:49.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.203+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.DPgJ_vA1LXW52aMYljRIVeU2u9ZHIg9_0 2024-09-12T18:13:49.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.203+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17238772972862881565', time=2024-09-12T19:48:53.412684+0000, chain.objs.size()=1 2024-09-12T18:13:49.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.203+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.YVPlK6ZWA1HI_HoU8A6gapccky5vR1x_0 2024-09-12T18:13:49.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.203+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10369910736856855107', time=2024-09-12T19:48:53.431154+0000, chain.objs.size()=1 2024-09-12T18:13:49.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.203+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.T1Co0nYQLWKB0VhKTS-BMTM7uz1wxJj_0 2024-09-12T18:13:49.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.203+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4527575952667373450', time=2024-09-12T19:48:53.431977+0000, chain.objs.size()=1 2024-09-12T18:13:49.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.203+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.x-aNPvLCtDI1lzCWuIBuEftBXkQhcjm_0 2024-09-12T18:13:49.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.203+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16986598752835572442', time=2024-09-12T19:48:53.568690+0000, chain.objs.size()=1 2024-09-12T18:13:49.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.203+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.aKWiPF209Ih4LS2iaLM9u5bEXwRbhJx_0 2024-09-12T18:13:49.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.203+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5518093328753180028', time=2024-09-12T19:48:53.744750+0000, chain.objs.size()=1 2024-09-12T18:13:49.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.203+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.hWKQVtiQmSzZZ3sIkuas2I3EdKm2QB6_0 2024-09-12T18:13:49.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.203+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7877490514213308671', time=2024-09-12T19:48:54.272086+0000, chain.objs.size()=1 2024-09-12T18:13:49.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.203+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.umcfh70ZN1i5PBST2eB765QKt5LXDZN_0 2024-09-12T18:13:49.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.203+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14639786630853446818', time=2024-09-12T19:48:54.636631+0000, chain.objs.size()=1 2024-09-12T18:13:49.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.203+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.95lBHZbtpQcrMRT1IPZHSvVAP_RmC3g_0 2024-09-12T18:13:49.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.203+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15600602200904536072', time=2024-09-12T19:48:54.794451+0000, chain.objs.size()=1 2024-09-12T18:13:49.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.203+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.TR2fdqvQTISMRFJ_yMoUaUCLqa8xVl7_0 2024-09-12T18:13:49.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.203+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15908302248483019785', time=2024-09-12T19:48:55.422941+0000, chain.objs.size()=1 2024-09-12T18:13:49.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.203+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.oeKVKN2iQ7f0ul4H4KqnIoaJu53SryQ_0 2024-09-12T18:13:49.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.208+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/47689 2024-09-12T18:13:49.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.211+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T18:13:49.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.211+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.978510799837364951', time=2024-09-12T19:48:55.472878+0000, chain.objs.size()=1 2024-09-12T18:13:49.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.211+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.dlXfOVt89arkbg7XWi3rUMIVQQlfyps_0 2024-09-12T18:13:49.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.211+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17374657449172567720', time=2024-09-12T19:48:55.588078+0000, chain.objs.size()=1 2024-09-12T18:13:49.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.211+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.4w7OPDxQUgsKc7F0XadSJK3MD5BYzpU_0 2024-09-12T18:13:49.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.211+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4234311725259897599', time=2024-09-12T19:48:55.932706+0000, chain.objs.size()=1 2024-09-12T18:13:49.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.211+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.iGhXozQKaYnY1rtv8WEg6m2DE_3DD6v_0 2024-09-12T18:13:49.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.211+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5211936917385399463', time=2024-09-12T19:48:56.123219+0000, chain.objs.size()=1 2024-09-12T18:13:49.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.211+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.lFUfo0oZh7ToawVdPL9cLtMrpdvwzFF_0 2024-09-12T18:13:49.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.211+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16588832658660265376', time=2024-09-12T19:48:56.210400+0000, chain.objs.size()=1 2024-09-12T18:13:49.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.211+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.KRhoxtvTvHJrT6ORU2kLfJlj-IU8YRQ_0 2024-09-12T18:13:49.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.211+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5758374927496102323', time=2024-09-12T19:48:56.702427+0000, chain.objs.size()=1 2024-09-12T18:13:49.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.211+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.7S4daI1hzyMkExrRbNr2L2tGUFkoIaw_0 2024-09-12T18:13:49.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.211+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10480020584160486189', time=2024-09-12T19:48:56.740180+0000, chain.objs.size()=1 2024-09-12T18:13:49.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.211+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.5sodf5kWAOLYO2tTzy6DEOSwlD42ZuN_0 2024-09-12T18:13:49.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.211+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7257357403220125786', time=2024-09-12T19:48:57.621623+0000, chain.objs.size()=1 2024-09-12T18:13:49.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.211+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.VkOnEQzgkxH0tPz5LoLyACO0WFlRtWp_0 2024-09-12T18:13:49.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.211+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8501636994313301802', time=2024-09-12T19:48:57.645123+0000, chain.objs.size()=1 2024-09-12T18:13:49.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.211+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Fb-5MH7ksxVACB1M_aGCadRIUSo84oi_0 2024-09-12T18:13:49.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.211+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15846614396016623175', time=2024-09-12T19:48:57.699670+0000, chain.objs.size()=1 2024-09-12T18:13:49.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.211+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.c7vwsF_UWakmzqBUaXMmfkJwVhs6eLk_0 2024-09-12T18:13:49.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.211+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12092828007809566969', time=2024-09-12T19:48:58.008856+0000, chain.objs.size()=1 2024-09-12T18:13:49.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.211+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.89bY_jzOCrqB7fn2zfq1J0BJuWubVNB_0 2024-09-12T18:13:49.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.211+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18305962776671865416', time=2024-09-12T19:48:58.009436+0000, chain.objs.size()=1 2024-09-12T18:13:49.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.211+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.1iX5lIADSCbtAMlwQP8K84tOevXx3t0_0 2024-09-12T18:13:49.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.212+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10630637630843811170', time=2024-09-12T19:49:04.465207+0000, chain.objs.size()=1 2024-09-12T18:13:49.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.212+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.333__shadow_.Lj8KQyRGGfE9POQXgkCgRTJ40E5oLz3_0 2024-09-12T18:13:49.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.213+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1848268957624942067', time=2024-09-12T19:49:48.540046+0000, chain.objs.size()=1 2024-09-12T18:13:49.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.213+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.385__shadow_.LMajaqsF5dtv3yFpPXl7X2tVg5oN9kS_0 2024-09-12T18:13:49.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.213+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1426553977051325033', time=2024-09-12T19:51:18.591928+0000, chain.objs.size()=1 2024-09-12T18:13:49.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.213+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.484__shadow_.iVWQhS8k5OXUwgFjqGqfXcPcKENfx8e_0 2024-09-12T18:13:49.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.213+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5451920086580353354', time=2024-09-12T19:52:10.849259+0000, chain.objs.size()=6 2024-09-12T18:13:49.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.213+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.1 2024-09-12T18:13:49.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.213+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.2 2024-09-12T18:13:49.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.213+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.3 2024-09-12T18:13:49.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.213+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.4 2024-09-12T18:13:49.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.213+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.5 2024-09-12T18:13:49.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.213+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.6 2024-09-12T18:13:49.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.213+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12535566289816694498', time=2024-09-12T19:54:11.046657+0000, chain.objs.size()=6 2024-09-12T18:13:49.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.213+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~VW9LPkNYRwCEBf-WP9pETC8HUY997zk.1 2024-09-12T18:13:49.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.213+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.1-OvuNQByHQ21jPrw2Qbfh385dBN_xh_.2 2024-09-12T18:13:49.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.214+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~VW9LPkNYRwCEBf-WP9pETC8HUY997zk.3 2024-09-12T18:13:49.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.214+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~VW9LPkNYRwCEBf-WP9pETC8HUY997zk.4 2024-09-12T18:13:49.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.215+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~VW9LPkNYRwCEBf-WP9pETC8HUY997zk.5 2024-09-12T18:13:49.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.215+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~VW9LPkNYRwCEBf-WP9pETC8HUY997zk.6 2024-09-12T18:13:49.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.215+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4289056951428876248', time=2024-09-12T19:55:13.695853+0000, chain.objs.size()=1 2024-09-12T18:13:49.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.215+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.524__multipart_mymultipart.2~39IP3ZjnHvXKFx8KxNOpVz135goq635.1 2024-09-12T18:13:49.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.216+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18034162026013285535', time=2024-09-12T19:55:15.065501+0000, chain.objs.size()=2 2024-09-12T18:13:49.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.216+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.524__multipart_mymultipart.2~KWwOOG3xrirCDHtRomMOYgHS5Jni7Cz.1 2024-09-12T18:13:49.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.216+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.524__multipart_mymultipart.2~KWwOOG3xrirCDHtRomMOYgHS5Jni7Cz.2 2024-09-12T18:13:49.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.216+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5804010267762843704', time=2024-09-12T19:55:17.309531+0000, chain.objs.size()=2 2024-09-12T18:13:49.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.216+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.524__multipart_mymultipart.2~hzEopK1FbaoQDDN8YNgDeUSFEv4DSKG.1 2024-09-12T18:13:49.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.216+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.524__multipart_mymultipart.2~hzEopK1FbaoQDDN8YNgDeUSFEv4DSKG.2 2024-09-12T18:13:49.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.216+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3023438361303078760', time=2024-09-12T19:57:25.041254+0000, chain.objs.size()=1 2024-09-12T18:13:49.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.216+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.556__shadow_.A6uUSpj8swqi_M71ojSiMnDZK1ZlezT_0 2024-09-12T18:13:49.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.217+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17749218881821587392', time=2024-09-12T19:57:30.867775+0000, chain.objs.size()=1 2024-09-12T18:13:49.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.217+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.558__shadow_.T_LU3sqzsYyp6N-OxLujOhF3RW7lJhv_0 2024-09-12T18:13:49.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.217+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11926692689056831346', time=2024-09-12T19:58:25.276791+0000, chain.objs.size()=1 2024-09-12T18:13:49.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.217+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.577__shadow:rQHO5gz4ciK5aF1omDM01h1W1W16DmP_.BQNYWuicH_4SmUZsw144ZYpSnHfiYAA_0 2024-09-12T18:13:49.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.217+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14878921844461980070', time=2024-09-12T19:58:36.333486+0000, chain.objs.size()=1 2024-09-12T18:13:49.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.217+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:Iy8gn.zfMMDEGyxdEwdNr1jDfJ0ZL43_.PAszTEpKQ38BIoWm-MTlqOKJMTreb0w_0 2024-09-12T18:13:49.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.217+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10578856642500302347', time=2024-09-12T20:06:03.010396+0000, chain.objs.size()=1 2024-09-12T18:13:49.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.217+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.665__shadow_.kmtxLXry4K837K_FLKxYOJ3pRbyJB-4_0 2024-09-12T18:13:49.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.217+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14469836812273334208', time=2024-09-12T20:06:05.645825+0000, chain.objs.size()=1 2024-09-12T18:13:49.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.217+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.667__shadow_.iBc6Dmgi-kd5qF0d0XIpTR6AyivOp-Z_0 2024-09-12T18:13:49.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.219+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:49.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.221+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:13:49.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.223+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:49.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.223+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:49.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.224+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47056' 2024-09-12T18:13:49.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.224+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17517583173590492214', time=2024-09-12T19:41:24.466167+0000, chain.objs.size()=3 2024-09-12T18:13:49.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.224+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.159__shadow_.lk2-DkFE86ctg-6e6LFSwifA-vgTcrZ_0 2024-09-12T18:13:49.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.224+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.159__shadow_.lk2-DkFE86ctg-6e6LFSwifA-vgTcrZ_1 2024-09-12T18:13:49.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.224+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.159__shadow_.lk2-DkFE86ctg-6e6LFSwifA-vgTcrZ_2 2024-09-12T18:13:49.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.224+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17602482321212075535', time=2024-09-12T19:43:10.108014+0000, chain.objs.size()=1 2024-09-12T18:13:49.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.224+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.201__shadow_.pV9JknakjId5A6eWI1cpydwjZK9ETP2_0 2024-09-12T18:13:49.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.224+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1577095721631265569', time=2024-09-12T19:44:59.885628+0000, chain.objs.size()=1 2024-09-12T18:13:49.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.224+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.229__shadow_.8P4AVV_354GoVwTyasqmv_Li2SnfJm6_0 2024-09-12T18:13:49.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.224+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18374324908074074013', time=2024-09-12T19:45:13.112766+0000, chain.objs.size()=1 2024-09-12T18:13:49.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.224+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.243__shadow_.D2EWI6Fi0t4WOzgE7MX4q6qRSoBeAYs_0 2024-09-12T18:13:49.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.224+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6206014924384997567', time=2024-09-12T19:45:20.016387+0000, chain.objs.size()=1 2024-09-12T18:13:49.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.224+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.249__shadow_.EfWlPmlAM9fB_2FRS-ycdkdsh5BgQYK_0 2024-09-12T18:13:49.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.224+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1565831108936886314', time=2024-09-12T19:45:20.928349+0000, chain.objs.size()=1 2024-09-12T18:13:49.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.224+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.250__shadow_.fZDp0fFAQeCx3WiY_yot9PKK5foDFZY_0 2024-09-12T18:13:49.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.224+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14456188345225946519', time=2024-09-12T19:45:22.734831+0000, chain.objs.size()=1 2024-09-12T18:13:49.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.224+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.252__shadow_.m-JtsgRTOwoS2XwvMuxcLY84wsfHMVV_0 2024-09-12T18:13:49.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.224+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4722227745252221746', time=2024-09-12T19:45:28.152426+0000, chain.objs.size()=1 2024-09-12T18:13:49.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.224+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.258__shadow_.7BzIIrIe8hvysLONZNVHC5Ah8rXoQLY_0 2024-09-12T18:13:49.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.224+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15940470886140749009', time=2024-09-12T19:46:09.763251+0000, chain.objs.size()=1 2024-09-12T18:13:49.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.224+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.2csjQgXOM6O47l9EiQOIHFEBHTmAfOP_0 2024-09-12T18:13:49.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.224+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5476131352436527215', time=2024-09-12T19:46:10.769847+0000, chain.objs.size()=1 2024-09-12T18:13:49.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.224+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.CtbcSreg1vNvfVpQQrL9pDtBf8nci7r_0 2024-09-12T18:13:49.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.227+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11885159519188149020', time=2024-09-12T19:46:10.809585+0000, chain.objs.size()=1 2024-09-12T18:13:49.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.227+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.3uAiQLgVKqvYmNjcRFq5BnT4YrUs7vG_0 2024-09-12T18:13:49.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.227+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17860300251887721539', time=2024-09-12T19:46:10.843585+0000, chain.objs.size()=1 2024-09-12T18:13:49.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.227+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.MFImXgdStMIpUBNTYL6UEFrcZXYWt5o_0 2024-09-12T18:13:49.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.227+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12977106947328607598', time=2024-09-12T19:46:11.013363+0000, chain.objs.size()=1 2024-09-12T18:13:49.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.227+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.8z7tzoB3NUvThs5jwBstbirACkMccfr_0 2024-09-12T18:13:49.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.227+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14493475249563640331', time=2024-09-12T19:46:11.037955+0000, chain.objs.size()=1 2024-09-12T18:13:49.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.227+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.NyaPDtoWT-TuH9e7SsvJhyfZSuw4yMR_0 2024-09-12T18:13:49.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.227+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1224843616767101760', time=2024-09-12T19:46:11.038724+0000, chain.objs.size()=1 2024-09-12T18:13:49.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.227+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.vktsSxgmvdx1pZSq03m_z40u7Bn5ZO__0 2024-09-12T18:13:49.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.227+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14484309994657240170', time=2024-09-12T19:46:11.138550+0000, chain.objs.size()=1 2024-09-12T18:13:49.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.228+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Ii_RwPg7ZXWnCZQIuN3TUsXutyCUm7K_0 2024-09-12T18:13:49.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.228+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14655972026086132781', time=2024-09-12T19:46:12.163588+0000, chain.objs.size()=1 2024-09-12T18:13:49.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.228+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.wPXl5FwMQFF051o8iLT_oDnwjGUrLCY_0 2024-09-12T18:13:49.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.228+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14676675528194667069', time=2024-09-12T19:46:12.574887+0000, chain.objs.size()=1 2024-09-12T18:13:49.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.228+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Aigeyx0d26A3rLczcE7R5mOQ0bBrVws_0 2024-09-12T18:13:49.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.228+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15998240407132849276', time=2024-09-12T19:46:12.661596+0000, chain.objs.size()=1 2024-09-12T18:13:49.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.228+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.pLSPxFgdzlqa2MCYBzYzdjsyqA3LUit_0 2024-09-12T18:13:49.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.228+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1374689470267698587', time=2024-09-12T19:46:13.369195+0000, chain.objs.size()=1 2024-09-12T18:13:49.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.228+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.C0tm9SvKH4bnM-mK7k0LgrKufXb8TeN_0 2024-09-12T18:13:49.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.228+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10080265515868001488', time=2024-09-12T19:46:14.036918+0000, chain.objs.size()=1 2024-09-12T18:13:49.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.228+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Vr5mZ_f-XlQHjG-DF3zlJTGy3UmKLfX_0 2024-09-12T18:13:49.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.229+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8723347193822576247', time=2024-09-12T19:46:14.780647+0000, chain.objs.size()=1 2024-09-12T18:13:49.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.229+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.QFvJzvAxyW94sMoo3ObKaJlmAGBObCt_0 2024-09-12T18:13:49.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.229+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9871909792741582679', time=2024-09-12T19:46:14.857378+0000, chain.objs.size()=1 2024-09-12T18:13:49.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.229+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.9Uj509W6gXE2FMRo0cb618-Fs3rbAug_0 2024-09-12T18:13:49.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.229+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16581053035471238435', time=2024-09-12T19:46:14.942884+0000, chain.objs.size()=1 2024-09-12T18:13:49.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.229+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.GzjqjPDPF1UAQwV47f5G5slAd886RXM_0 2024-09-12T18:13:49.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.229+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14406205267884311921', time=2024-09-12T19:46:15.510236+0000, chain.objs.size()=1 2024-09-12T18:13:49.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.229+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.wdKxpjyJ3u_VpwGZPFb90M5obQRm7n0_0 2024-09-12T18:13:49.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.230+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8816603137592470666', time=2024-09-12T19:46:15.606574+0000, chain.objs.size()=1 2024-09-12T18:13:49.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.230+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.7m9NJ-pNY__Ts7NEChR-j9N6idQ9mhP_0 2024-09-12T18:13:49.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.230+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7436256753843633348', time=2024-09-12T19:46:15.706007+0000, chain.objs.size()=1 2024-09-12T18:13:49.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.230+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.S0QWGN-QidXcZkZJFYuv0qeR2opozTJ_0 2024-09-12T18:13:49.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.230+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17803604494007191214', time=2024-09-12T19:46:16.177345+0000, chain.objs.size()=1 2024-09-12T18:13:49.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.230+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.cc4xdPX-pCMjl9nbeSCPW_vMiVyTAvP_0 2024-09-12T18:13:49.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.230+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14445156141473109089', time=2024-09-12T19:46:16.178116+0000, chain.objs.size()=1 2024-09-12T18:13:49.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.230+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.4sMRJAfPTQ9p1YN5Hmcwt5Gh0rK-fd__0 2024-09-12T18:13:49.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.230+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13512386442004811668', time=2024-09-12T19:46:16.326144+0000, chain.objs.size()=1 2024-09-12T18:13:49.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.230+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Jy8hfnv6AtjqTkWmy_DhH32abrBPi36_0 2024-09-12T18:13:49.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.230+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12399809815271509408', time=2024-09-12T19:46:16.370784+0000, chain.objs.size()=1 2024-09-12T18:13:49.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.230+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.x8j1gZq4M1p3U8kNuno8uZU9oEOB0RK_0 2024-09-12T18:13:49.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.231+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14959381322661760891', time=2024-09-12T19:46:16.444592+0000, chain.objs.size()=1 2024-09-12T18:13:49.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.231+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.vkAhSQxbSvtZEKZTOxzn4fVgCFW9HH__0 2024-09-12T18:13:49.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.231+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12496480894652004151', time=2024-09-12T19:46:16.684283+0000, chain.objs.size()=1 2024-09-12T18:13:49.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.231+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.0MFWBMxrgtXHSg5jiiueIRgM3H709f__0 2024-09-12T18:13:49.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.231+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.706641056431714733', time=2024-09-12T19:46:16.750650+0000, chain.objs.size()=1 2024-09-12T18:13:49.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.231+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ixmLbkFS_UZarGPFtLdqkw0ApuMF61W_0 2024-09-12T18:13:49.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.232+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9345263559127041633', time=2024-09-12T19:46:16.827841+0000, chain.objs.size()=1 2024-09-12T18:13:49.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.232+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.IbTb_K3HVHf0GZn9ASqESJMgQgBzTG0_0 2024-09-12T18:13:49.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.232+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2210725681844819825', time=2024-09-12T19:46:16.923822+0000, chain.objs.size()=1 2024-09-12T18:13:49.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.232+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.URMCR6CQ-QAn9A0oN9MN-t160Kwg19E_0 2024-09-12T18:13:49.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.232+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10504321823843156197', time=2024-09-12T19:46:16.997990+0000, chain.objs.size()=1 2024-09-12T18:13:49.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.232+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.AP4kll2h-YCbMOh-o_Yb8Xj8cw21lJ7_0 2024-09-12T18:13:49.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.232+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17393756233714997375', time=2024-09-12T19:46:17.460389+0000, chain.objs.size()=1 2024-09-12T18:13:49.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.232+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.pHu7O7V24Q0__25Y4bsQerd1W_pr2DD_0 2024-09-12T18:13:49.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.232+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15671148069682506233', time=2024-09-12T19:46:17.757646+0000, chain.objs.size()=1 2024-09-12T18:13:49.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.232+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.QWzmXl8QWUyTliXmppK5cRr8PK-Z6dG_0 2024-09-12T18:13:49.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.232+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5868895890138972078', time=2024-09-12T19:46:17.929622+0000, chain.objs.size()=1 2024-09-12T18:13:49.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.232+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.lnMOBMU_3BVIROmHsCd2powVCKWqo5Y_0 2024-09-12T18:13:49.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.232+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7133336030801099974', time=2024-09-12T19:46:18.010055+0000, chain.objs.size()=1 2024-09-12T18:13:49.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.232+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.T_GlX5XbYO_IDjv5vR8KfgXCk36TEQy_0 2024-09-12T18:13:49.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.232+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11332072428911983287', time=2024-09-12T19:46:18.186505+0000, chain.objs.size()=1 2024-09-12T18:13:49.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.232+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.CIGvBemhlAuiv7xfymiHz2ihh7-J0k7_0 2024-09-12T18:13:49.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.232+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6648720723300256212', time=2024-09-12T19:46:18.210362+0000, chain.objs.size()=1 2024-09-12T18:13:49.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.232+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.leC3yeHO03CIwJjYQVNhj_bQ1XSRVR__0 2024-09-12T18:13:49.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.233+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2915583851187829521', time=2024-09-12T19:46:18.369184+0000, chain.objs.size()=1 2024-09-12T18:13:49.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.233+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.u_tBBdmLHQzxr9tXMCByM_usHuv40GK_0 2024-09-12T18:13:49.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.233+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1687441667282216730', time=2024-09-12T19:46:19.041138+0000, chain.objs.size()=1 2024-09-12T18:13:49.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.233+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.hZqJUf1ory_lAJ_Msv92GbNQ00nUPBS_0 2024-09-12T18:13:49.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.235+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2489507164048872505', time=2024-09-12T19:46:19.152096+0000, chain.objs.size()=1 2024-09-12T18:13:49.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.235+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.hAcOV_L9hY89Ki-CuCG3_FV8CgtIRjb_0 2024-09-12T18:13:49.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.235+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13703979111604157979', time=2024-09-12T19:46:19.250316+0000, chain.objs.size()=1 2024-09-12T18:13:49.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.235+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.LgC9PZz6Cjqb_ZyrQphoW7p-HabmcBp_0 2024-09-12T18:13:49.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.235+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1993719534833117616', time=2024-09-12T19:46:19.535778+0000, chain.objs.size()=1 2024-09-12T18:13:49.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.235+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.aGQ0Jqsoa022BuggAl0DGaqDGd1-2Pj_0 2024-09-12T18:13:49.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.235+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.431836367106773609', time=2024-09-12T19:46:19.560193+0000, chain.objs.size()=1 2024-09-12T18:13:49.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.235+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.2cpfY4E3-hDdOt5OTgwh4Om2DZxNvUt_0 2024-09-12T18:13:49.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.235+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.898797545832528447', time=2024-09-12T19:46:19.608916+0000, chain.objs.size()=1 2024-09-12T18:13:49.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.235+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.WAK1NxLPPNgOmmp1cSSOj2uZmOOChDC_0 2024-09-12T18:13:49.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.235+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1757894074692971878', time=2024-09-12T19:46:20.483950+0000, chain.objs.size()=1 2024-09-12T18:13:49.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.235+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.264__shadow_.gi4i7vi_mDd4EmeEmijD6i6mpznw3x9_0 2024-09-12T18:13:49.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.235+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16683593194935143756', time=2024-09-12T19:46:29.193574+0000, chain.objs.size()=1 2024-09-12T18:13:49.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.235+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.274__shadow_.VMuuH3cXFvB3Ykktb0nhghvLMEegPMd_0 2024-09-12T18:13:49.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.235+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18408216532590339133', time=2024-09-12T19:46:30.098015+0000, chain.objs.size()=1 2024-09-12T18:13:49.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.235+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.275__shadow_.K5U6ozd7xbbaqwMHZfbaNjbTDp4UKkt_0 2024-09-12T18:13:49.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.235+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5161384352988601995', time=2024-09-12T19:46:55.093930+0000, chain.objs.size()=1 2024-09-12T18:13:49.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.235+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.299__shadow_.aWH-SpBeln7rxYQyXzSK141gBD0-viR_0 2024-09-12T18:13:49.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.235+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2710335402302053056', time=2024-09-12T19:46:56.992950+0000, chain.objs.size()=1 2024-09-12T18:13:49.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.235+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.301__shadow_.75HaaeOBYY2dQx3mWZsLvlUYUVyRHo9_0 2024-09-12T18:13:49.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.236+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7456191057797360319', time=2024-09-12T19:47:20.145110+0000, chain.objs.size()=1 2024-09-12T18:13:49.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.236+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.322__shadow_.SalVCt4Vu8ZsdZuEezqG03zIjpTAQYY_0 2024-09-12T18:13:49.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.236+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.46222428235633845', time=2024-09-12T19:47:21.317457+0000, chain.objs.size()=1 2024-09-12T18:13:49.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.236+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.323__shadow_.RxXKRjORfXTnfjXJQcYS1H61xu7Oi1c_0 2024-09-12T18:13:49.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.237+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5376987662509301548', time=2024-09-12T19:47:59.916891+0000, chain.objs.size()=1 2024-09-12T18:13:49.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.237+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.kwf2pvXJlPSukwVvTMwNVN72acedLwI_0 2024-09-12T18:13:49.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.237+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2144068766734932161', time=2024-09-12T19:48:00.047747+0000, chain.objs.size()=1 2024-09-12T18:13:49.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.237+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.1T9l5k3VEdLWoTDgDJYhn9bDwf9uSh9_0 2024-09-12T18:13:49.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.241+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3619803289471069815', time=2024-09-12T19:48:00.079173+0000, chain.objs.size()=1 2024-09-12T18:13:49.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.241+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.RQ9-NBD3KL0oZA5hObeLhQ4Z_fFSc4p_0 2024-09-12T18:13:49.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.241+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8698774102057560969', time=2024-09-12T19:48:01.286205+0000, chain.objs.size()=1 2024-09-12T18:13:49.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.241+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.vPCP46-fxgmTPeoFVpaavJdm7OuQqhg_0 2024-09-12T18:13:49.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.241+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3453993405084482265', time=2024-09-12T19:48:03.096561+0000, chain.objs.size()=1 2024-09-12T18:13:49.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.241+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.lnGXp9djura-1v4f0wCySdezM4_gndR_0 2024-09-12T18:13:49.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.241+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3733079301920265860', time=2024-09-12T19:48:03.281042+0000, chain.objs.size()=1 2024-09-12T18:13:49.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.241+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.DCl-EWptKIS07Fwr1rq-6VsoMjKwmcC_0 2024-09-12T18:13:49.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.241+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11434755135160957842', time=2024-09-12T19:48:03.470625+0000, chain.objs.size()=1 2024-09-12T18:13:49.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.241+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.3lRfwdv-x0MmLrYKXqaVpOdh5CusmUq_0 2024-09-12T18:13:49.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.241+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5198418490080459542', time=2024-09-12T19:48:03.910669+0000, chain.objs.size()=1 2024-09-12T18:13:49.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.241+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.hsUdpRZUIfYDi49pTHEmqNfMlnlMrb5_0 2024-09-12T18:13:49.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.241+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3114772156874891998', time=2024-09-12T19:48:04.749380+0000, chain.objs.size()=1 2024-09-12T18:13:49.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.241+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.wO_DaL50riDHsf4c48IvhtsaNOY6yHZ_0 2024-09-12T18:13:49.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.241+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13202407789070521051', time=2024-09-12T19:48:05.924528+0000, chain.objs.size()=1 2024-09-12T18:13:49.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.241+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.s1K_NibSrDoxFKmGVFNkGfx6Db3hsrl_0 2024-09-12T18:13:49.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.241+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12211767051968709148', time=2024-09-12T19:48:06.313703+0000, chain.objs.size()=1 2024-09-12T18:13:49.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.241+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.YvgH2Jci7MX9h-qYOnOT15DDkyhzeE0_0 2024-09-12T18:13:49.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.241+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14617454245356227094', time=2024-09-12T19:48:06.788685+0000, chain.objs.size()=1 2024-09-12T18:13:49.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.241+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.rPsIPNfAlCkgqUVEwRfWu_YlyAqOBI9_0 2024-09-12T18:13:49.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.241+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8707413219352942518', time=2024-09-12T19:48:06.949331+0000, chain.objs.size()=1 2024-09-12T18:13:49.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.241+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.VRgpd1SQU7iGNd5L_gZ8WJhWZMxstiX_0 2024-09-12T18:13:49.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.244+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14786287389470717916', time=2024-09-12T19:48:07.058654+0000, chain.objs.size()=1 2024-09-12T18:13:49.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.245+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.W0763r0RsQh9rnVNfcRkbnKnFrQ2BEt_0 2024-09-12T18:13:49.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.247+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1013442699343135931', time=2024-09-12T19:48:07.098876+0000, chain.objs.size()=1 2024-09-12T18:13:49.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.247+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.HxuBXXKGfPdXONgoqe2vKX3e42e0JA-_0 2024-09-12T18:13:49.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.247+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12184701835320329729', time=2024-09-12T19:48:07.132506+0000, chain.objs.size()=1 2024-09-12T18:13:49.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.247+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.yfmEPb6TGM2Wy1HzOnpTemltR6318e-_0 2024-09-12T18:13:49.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.247+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6048589792307635075', time=2024-09-12T19:48:07.196477+0000, chain.objs.size()=1 2024-09-12T18:13:49.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.247+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.KQmvleBEKwbxvI-ZwdO_D2oShJvJRhO_0 2024-09-12T18:13:49.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.247+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5732368692713674847', time=2024-09-12T19:48:07.230953+0000, chain.objs.size()=1 2024-09-12T18:13:49.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.247+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.IqQ7qrF1SpVirtNyUHNPLQZiFMeJDNB_0 2024-09-12T18:13:49.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.247+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16998102176170343915', time=2024-09-12T19:48:07.568753+0000, chain.objs.size()=1 2024-09-12T18:13:49.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.247+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ltqPI8RtiyME9ybBDKLT1ZDdybz0UcB_0 2024-09-12T18:13:49.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.247+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10780267394258825325', time=2024-09-12T19:48:07.619448+0000, chain.objs.size()=1 2024-09-12T18:13:49.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.247+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.rWyG6RiZXbZ0rIahBg7mykvswg9vuSe_0 2024-09-12T18:13:49.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.247+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15736144462279517606', time=2024-09-12T19:48:08.450720+0000, chain.objs.size()=1 2024-09-12T18:13:49.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.247+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.vvX1joE1bmDMAD2RMZaf8n7LUzKvEki_0 2024-09-12T18:13:49.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.247+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4310873054194656177', time=2024-09-12T19:48:08.602755+0000, chain.objs.size()=1 2024-09-12T18:13:49.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.247+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_._aVRuL-nN9W885SehJint8PBvh4rwU-_0 2024-09-12T18:13:49.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.247+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3126324064327390852', time=2024-09-12T19:48:08.860203+0000, chain.objs.size()=1 2024-09-12T18:13:49.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.247+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.0PanSM7SP61N3enyZ5QM5uDk2jws08J_0 2024-09-12T18:13:49.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.247+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11645884745967676657', time=2024-09-12T19:48:09.968108+0000, chain.objs.size()=1 2024-09-12T18:13:49.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.247+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.3oiAyN7wNMk_KdAARFpAd4uM2zjM-i0_0 2024-09-12T18:13:49.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.247+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2424987488634954855', time=2024-09-12T19:48:09.969012+0000, chain.objs.size()=1 2024-09-12T18:13:49.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.247+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.B5nJBxIA2z7xqs6GAP60ohxUGbIMkQA_0 2024-09-12T18:13:49.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.250+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7343540429692618281', time=2024-09-12T19:48:47.910093+0000, chain.objs.size()=1 2024-09-12T18:13:49.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.250+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.qmAxxWnOFyMHBpRBB3XaqzBN_rLoLDO_0 2024-09-12T18:13:49.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.250+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13652456613595192666', time=2024-09-12T19:48:48.370898+0000, chain.objs.size()=1 2024-09-12T18:13:49.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.250+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.FjmRB3H3SO0EujR2ZQfoxpPS-uXRE3d_0 2024-09-12T18:13:49.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.250+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17005387955860181264', time=2024-09-12T19:48:49.076307+0000, chain.objs.size()=1 2024-09-12T18:13:49.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.250+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.RrlUljiaZpdIgmDHi9Md7U0tLG9mArT_0 2024-09-12T18:13:49.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.250+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13046723077260388715', time=2024-09-12T19:48:49.396127+0000, chain.objs.size()=1 2024-09-12T18:13:49.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.250+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.VYFlTKnARCnYk1qN8C149wtyX0tJj6h_0 2024-09-12T18:13:49.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.250+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17277424581526034112', time=2024-09-12T19:48:49.396888+0000, chain.objs.size()=1 2024-09-12T18:13:49.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.250+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.xgdN0OdfJFixXeZZ19LDzcw8SP7AI5A_0 2024-09-12T18:13:49.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.250+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10560949952639420646', time=2024-09-12T19:48:49.449308+0000, chain.objs.size()=1 2024-09-12T18:13:49.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.250+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.wMs1WMzW5eRQcLEbAQtNjqC2QTR78dI_0 2024-09-12T18:13:49.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.250+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16198609251801505308', time=2024-09-12T19:48:49.586336+0000, chain.objs.size()=1 2024-09-12T18:13:49.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.250+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.s-s4tkTOPqJcGy7Psl8CZKz7BQ4IjPX_0 2024-09-12T18:13:49.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.250+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3204890097820162096', time=2024-09-12T19:48:49.884688+0000, chain.objs.size()=1 2024-09-12T18:13:49.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.250+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ENpkobUD1MA2nGD4JUjJ8vZd8MySTGD_0 2024-09-12T18:13:49.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.250+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16861418067329430527', time=2024-09-12T19:48:50.506847+0000, chain.objs.size()=1 2024-09-12T18:13:49.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.250+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.1nHNha-MiqSUvC9VNXS13GVCwuahyDw_0 2024-09-12T18:13:49.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.250+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13115984697817388592', time=2024-09-12T19:48:52.032537+0000, chain.objs.size()=1 2024-09-12T18:13:49.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.250+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.NLfoWr0igKwzd8WlumhDcL9kj4e4MC8_0 2024-09-12T18:13:49.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.250+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6693653725691310784', time=2024-09-12T19:48:53.432600+0000, chain.objs.size()=1 2024-09-12T18:13:49.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.250+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.bi0lw_Hf_BzuyRVvVDzSR19uH0eBkx7_0 2024-09-12T18:13:49.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.252+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15055584609871061385', time=2024-09-12T19:48:53.587311+0000, chain.objs.size()=1 2024-09-12T18:13:49.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.252+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.20lg6h8CnrT2OaVNGEhFwqNbjqctk8a_0 2024-09-12T18:13:49.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.252+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7401202861279628797', time=2024-09-12T19:48:55.100352+0000, chain.objs.size()=1 2024-09-12T18:13:49.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.252+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.30QQfKP-nBZ3FhFqaB3vjUHU3ML9XTt_0 2024-09-12T18:13:49.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.252+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12328414799044367193', time=2024-09-12T19:48:55.204994+0000, chain.objs.size()=1 2024-09-12T18:13:49.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.252+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.jEbSGauZD5knZ7OpfGkWNoOTk2gi06T_0 2024-09-12T18:13:49.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.252+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6115866362230768142', time=2024-09-12T19:48:56.302699+0000, chain.objs.size()=1 2024-09-12T18:13:49.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.252+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.eLohR8B_xGXYOz2V4YM8O3YJaobbyPl_0 2024-09-12T18:13:49.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.252+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11859512123141449644', time=2024-09-12T19:48:56.376773+0000, chain.objs.size()=1 2024-09-12T18:13:49.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.252+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.UsKVy23unXPAQrds7QQpQFg4qs9dBl2_0 2024-09-12T18:13:49.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.252+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10044104299055347511', time=2024-09-12T19:48:56.407822+0000, chain.objs.size()=1 2024-09-12T18:13:49.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.252+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.AgmYJUbKpzyQ77WNqBUCcnFvE4611VP_0 2024-09-12T18:13:49.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.252+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5941765820414837794', time=2024-09-12T19:48:56.660034+0000, chain.objs.size()=1 2024-09-12T18:13:49.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.252+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.okSs8Xv_peUuPw7mdf4q6e0IafSSW79_0 2024-09-12T18:13:49.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.254+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/47056 2024-09-12T18:13:49.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.256+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T18:13:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.256+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15304384140311285180', time=2024-09-12T19:48:56.699882+0000, chain.objs.size()=1 2024-09-12T18:13:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.256+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.TiHw07YuVn8nDrDjB7mlhseRDHDccyD_0 2024-09-12T18:13:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.256+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5876969446010035647', time=2024-09-12T19:48:56.824098+0000, chain.objs.size()=1 2024-09-12T18:13:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.256+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.SYCXMcsf_j9k2NqzEa6FDDJ430hDPVX_0 2024-09-12T18:13:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.256+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4246870969339954199', time=2024-09-12T19:48:57.771254+0000, chain.objs.size()=1 2024-09-12T18:13:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.256+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.9KhQIDTj6vJ12nP3VoTmj6TROHpiXon_0 2024-09-12T18:13:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.256+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2539769644084478733', time=2024-09-12T19:49:02.008715+0000, chain.objs.size()=1 2024-09-12T18:13:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.256+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.330__shadow_.Ogv9j9GiH00mOhufSxss0LxcTuWLlnn_0 2024-09-12T18:13:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.256+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1880216039808418928', time=2024-09-12T19:51:19.633349+0000, chain.objs.size()=1 2024-09-12T18:13:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.256+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.485__shadow_.oUUrQcA2ifm5_ooqLbTbmlNZKLjDdJ1_0 2024-09-12T18:13:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.256+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14683376732491141964', time=2024-09-12T19:51:20.201287+0000, chain.objs.size()=1 2024-09-12T18:13:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.256+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.486__shadow_.2X7sxOeBWqrxm2gBiZxuPqkqtpP3mJe_0 2024-09-12T18:13:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.256+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5310559007370063707', time=2024-09-12T19:51:40.371806+0000, chain.objs.size()=1 2024-09-12T18:13:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.256+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.504__shadow:-V-p6OxZtM7hRMUzkyItZ02ZaGvL5CT_.X0PQumandVzjwgbUSUv4JkorH1YhtZM_0 2024-09-12T18:13:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.256+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11381897684297809656', time=2024-09-12T19:53:22.101175+0000, chain.objs.size()=1 2024-09-12T18:13:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.256+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.521__shadow:8L0wMWAJQPo8fgb4vvCMATQFmSi1CTH_.dnmn3QCMEKG2G1PC3lGU_BolB-5RqmG_0 2024-09-12T18:13:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.256+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12282559617008734943', time=2024-09-12T19:55:23.549103+0000, chain.objs.size()=2 2024-09-12T18:13:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.256+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.524__multipart_mymultipart.2~6ji-u1xPG9QCaQ6wSmAZ2WWzFuTEv6Z.1 2024-09-12T18:13:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.256+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.524__multipart_mymultipart.2~6ji-u1xPG9QCaQ6wSmAZ2WWzFuTEv6Z.2 2024-09-12T18:13:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.256+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.167473117045035527', time=2024-09-12T19:55:56.321183+0000, chain.objs.size()=7 2024-09-12T18:13:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.256+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.528__multipart_mymultipart.2~MplnEtZrtDfJnluun5x-pNnJ2zie4hz.1 2024-09-12T18:13:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.256+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.528__shadow_mymultipart.2~MplnEtZrtDfJnluun5x-pNnJ2zie4hz.1_1 2024-09-12T18:13:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.258+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.528__multipart_mymultipart.2~MplnEtZrtDfJnluun5x-pNnJ2zie4hz.2 2024-09-12T18:13:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.258+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.528__shadow_mymultipart.2~MplnEtZrtDfJnluun5x-pNnJ2zie4hz.2_1 2024-09-12T18:13:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.258+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.528__multipart_mymultipart.2~MplnEtZrtDfJnluun5x-pNnJ2zie4hz.3 2024-09-12T18:13:49.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.259+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.528__shadow_mymultipart.2~MplnEtZrtDfJnluun5x-pNnJ2zie4hz.3_1 2024-09-12T18:13:49.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.259+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.528__multipart_mymultipart.2~MplnEtZrtDfJnluun5x-pNnJ2zie4hz.4 2024-09-12T18:13:49.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.259+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12800000720928447718', time=2024-09-12T19:57:37.345863+0000, chain.objs.size()=1 2024-09-12T18:13:49.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.259+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.559__shadow_.u1S12Kju9255aspPmZB8VwT1x-P3xCv_0 2024-09-12T18:13:49.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.259+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6023811944964411253', time=2024-09-12T19:57:40.854670+0000, chain.objs.size()=1 2024-09-12T18:13:49.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.259+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.560__shadow_.da1OJUmZui01Fm5MPIH0t7QvnzE-LDs_0 2024-09-12T18:13:49.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.259+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10986856961472568420', time=2024-09-12T19:57:52.297966+0000, chain.objs.size()=1 2024-09-12T18:13:49.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.259+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.565__shadow_.dYzwX365wC1lZlFoiqKbnw517whkR_v_0 2024-09-12T18:13:49.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.259+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13496612443433923721', time=2024-09-12T19:58:01.480768+0000, chain.objs.size()=1 2024-09-12T18:13:49.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.259+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:2X.MhSda22X369bIKzGRThBL--ty6rl_._cNXU_9pge473tnms-NQ2DvC9ZOKdbm_0 2024-09-12T18:13:49.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.259+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11507572299203176089', time=2024-09-12T19:58:02.901084+0000, chain.objs.size()=1 2024-09-12T18:13:49.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.259+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:JqLa5DpfE7uq6A29tzMWwl0Ia625TpS_.fRscreGZ9CUhnTKRh-EYTATqG5Vt9Ns_0 2024-09-12T18:13:49.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.259+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.632728954923443158', time=2024-09-12T19:58:14.317550+0000, chain.objs.size()=1 2024-09-12T18:13:49.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.259+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.575__shadow_.OfGTZdKaq_hC9Uw3rUEM4FsdOu_UFMg_0 2024-09-12T18:13:49.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.261+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4217273394387240490', time=2024-09-12T19:58:21.696143+0000, chain.objs.size()=1 2024-09-12T18:13:49.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.261+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.577__shadow:tZbJUtE8fieqGgJrNHvIF-4i7yd8L.J_.UQri59w0tmWFcmyyWhR0Gv8diLLYaEN_0 2024-09-12T18:13:49.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.261+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1853360017621684404', time=2024-09-12T19:58:23.059671+0000, chain.objs.size()=1 2024-09-12T18:13:49.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.261+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.577__shadow:-PXFxQ-rL0bIu-Qtk91ruhD9jeiySqS_.XoG38gpLya2WFyTdyhHAA224iP0V_uY_0 2024-09-12T18:13:49.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.261+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3335648082523131867', time=2024-09-12T19:58:29.724960+0000, chain.objs.size()=1 2024-09-12T18:13:49.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.261+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:8zdHWk8X2bNmm25sVkOFV8wyxdR5F8U_.BcuJbp5yVCCvRTFiaBFIPs8VkuSTEvp_0 2024-09-12T18:13:49.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.262+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8684110762803525957', time=2024-09-12T19:59:27.284973+0000, chain.objs.size()=4 2024-09-12T18:13:49.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.262+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.579__multipart_testobj.2~BN_BgOCipOTEVUUjf5r35AgIlYaKhwv.1 2024-09-12T18:13:49.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.262+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.579__multipart_testobj.2~BN_BgOCipOTEVUUjf5r35AgIlYaKhwv.2 2024-09-12T18:13:49.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.262+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.579__multipart_testobj.2~BN_BgOCipOTEVUUjf5r35AgIlYaKhwv.3 2024-09-12T18:13:49.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.262+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.579__multipart_testobj.2~BN_BgOCipOTEVUUjf5r35AgIlYaKhwv.4 2024-09-12T18:13:49.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.262+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10321870840332738372', time=2024-09-12T19:59:38.881384+0000, chain.objs.size()=1 2024-09-12T18:13:49.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.262+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.587__shadow:qiJjQlWwW29HoOnzak52ZpmL8w6YfbE_.Z6OTZnptLFovB1bgFHjsryWUNH8ZXfv_0 2024-09-12T18:13:49.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.262+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10933214532621301079', time=2024-09-12T20:06:00.265615+0000, chain.objs.size()=6 2024-09-12T18:13:49.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.262+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.662__multipart_baz.2~K1KzVr9kJi8eNHEMuBjzqCmacq-7F3H.1 2024-09-12T18:13:49.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.262+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.662__multipart_baz.2~K1KzVr9kJi8eNHEMuBjzqCmacq-7F3H.2 2024-09-12T18:13:49.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.262+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.662__multipart_baz.2~K1KzVr9kJi8eNHEMuBjzqCmacq-7F3H.3 2024-09-12T18:13:49.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.262+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.662__multipart_baz.2~K1KzVr9kJi8eNHEMuBjzqCmacq-7F3H.4 2024-09-12T18:13:49.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.262+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.662__multipart_baz.2~K1KzVr9kJi8eNHEMuBjzqCmacq-7F3H.5 2024-09-12T18:13:49.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.262+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.662__multipart_baz.2~K1KzVr9kJi8eNHEMuBjzqCmacq-7F3H.6 2024-09-12T18:13:49.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.264+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~o83Ver6IqsoavVrzSjpkouxF4gkneWU', time=2024-09-12T20:07:38.135633+0000, chain.objs.size()=1 2024-09-12T18:13:49.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.264+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.743__multipart_mymultipart.2~o83Ver6IqsoavVrzSjpkouxF4gkneWU.1 2024-09-12T18:13:49.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.264+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15022212942459494337', time=2024-09-12T20:08:08.034681+0000, chain.objs.size()=1 2024-09-12T18:13:49.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.264+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.746__shadow_.pGH0EXiXDa8grozxf0nerBq3VxrL2MJ_0 2024-09-12T18:13:49.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.266+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:49.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.267+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:13:49.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.269+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:49.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.269+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:49.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.270+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49724' 2024-09-12T18:13:49.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.270+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.197617514333131144', time=2024-09-12T19:41:09.017215+0000, chain.objs.size()=1 2024-09-12T18:13:49.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.270+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.152__shadow_.DC9-jr84uKcJQxtorD_vrgeBk9jpKgi_0 2024-09-12T18:13:49.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.270+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10302318626102144132', time=2024-09-12T19:45:01.878385+0000, chain.objs.size()=1 2024-09-12T18:13:49.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.270+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.232__shadow_.bGb9Fwj8ZDy-dyu0RewGyn3YGNsPUMH_0 2024-09-12T18:13:49.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.270+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12673520084678006377', time=2024-09-12T19:45:09.664601+0000, chain.objs.size()=1 2024-09-12T18:13:49.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.270+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.239__shadow_.yx4faDpz8V5h0Xbyhr5jAhCBdXpdz2C_0 2024-09-12T18:13:49.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.270+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4908882617667189036', time=2024-09-12T19:45:13.110578+0000, chain.objs.size()=1 2024-09-12T18:13:49.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.270+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.243__shadow_.G7oCF6Fq8vWt3gHg8QpduAHyd7rdkVa_0 2024-09-12T18:13:49.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.270+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14387068339438836080', time=2024-09-12T19:45:27.282982+0000, chain.objs.size()=1 2024-09-12T18:13:49.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.270+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.257__shadow_.ff3xdDxpRlckHoRJXs9Z4SIS7LeLdA6_0 2024-09-12T18:13:49.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.270+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11395853338400013083', time=2024-09-12T19:46:09.065319+0000, chain.objs.size()=1 2024-09-12T18:13:49.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.270+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.YlDlStGbQy8hxaBF1nNG3n5Jl1PfJjE_0 2024-09-12T18:13:49.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.270+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4591327239534154564', time=2024-09-12T19:46:09.099743+0000, chain.objs.size()=1 2024-09-12T18:13:49.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.270+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.tJGNiXzVgqxRP8VqMxqb0QAmJzcIzvI_0 2024-09-12T18:13:49.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.270+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5720490530549821262', time=2024-09-12T19:46:09.756288+0000, chain.objs.size()=1 2024-09-12T18:13:49.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.270+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_._5iEixktcAFPHIUpEt0k8-w-xFoPxec_0 2024-09-12T18:13:49.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.270+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.696464431891906092', time=2024-09-12T19:46:09.849204+0000, chain.objs.size()=1 2024-09-12T18:13:49.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.270+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.UuMZERWLp7IwKR--4Zj9VBaPqEragYD_0 2024-09-12T18:13:49.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.270+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4041757443612638818', time=2024-09-12T19:46:10.382446+0000, chain.objs.size()=1 2024-09-12T18:13:49.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.270+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.HrKjDKxmoK7Kq_x2Ph0j1MTtgAbed2w_0 2024-09-12T18:13:49.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.270+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.622885019006346436', time=2024-09-12T19:46:10.680158+0000, chain.objs.size()=1 2024-09-12T18:13:49.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.270+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.8OvEf87ckxhUCj3Dpgx7M_AjfFEjhbD_0 2024-09-12T18:13:49.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.270+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2192162065152830453', time=2024-09-12T19:46:10.892698+0000, chain.objs.size()=1 2024-09-12T18:13:49.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.270+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.5J6kve7KiFFQbRhXlLedz8oWypFWhGM_0 2024-09-12T18:13:49.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.273+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1734484691948499994', time=2024-09-12T19:46:11.105001+0000, chain.objs.size()=1 2024-09-12T18:13:49.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.273+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.RP0o7JyGxHLvmIucLw_WeS4RUZpLmtu_0 2024-09-12T18:13:49.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.273+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17706804354144455271', time=2024-09-12T19:46:11.378162+0000, chain.objs.size()=1 2024-09-12T18:13:49.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.273+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.B7WRKflbtqMwEAyBIgxQnxX5zwRD-Yk_0 2024-09-12T18:13:49.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.273+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1836058832693563289', time=2024-09-12T19:46:12.139424+0000, chain.objs.size()=1 2024-09-12T18:13:49.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.273+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.yarUyvPr7Qi6tgVhUWPBQVFYNPpL055_0 2024-09-12T18:13:49.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.273+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8044886093606971374', time=2024-09-12T19:46:12.508774+0000, chain.objs.size()=1 2024-09-12T18:13:49.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.273+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.wBDQyVFDgtDatg0DBSnfcoc_EutJoB8_0 2024-09-12T18:13:49.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.273+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7040612948466159316', time=2024-09-12T19:46:12.821444+0000, chain.objs.size()=1 2024-09-12T18:13:49.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.273+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.-0oFZpLWvxZCS3TumbOlYXLbhm_cl36_0 2024-09-12T18:13:49.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.273+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1969173722766356797', time=2024-09-12T19:46:13.669464+0000, chain.objs.size()=1 2024-09-12T18:13:49.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.273+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.s6ZjRuUyRT6PhrlBs-KH0LkTzSy5t3m_0 2024-09-12T18:13:49.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.273+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5792520639970982303', time=2024-09-12T19:46:13.734856+0000, chain.objs.size()=1 2024-09-12T18:13:49.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.273+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.LW5e3QiNEJbbFDQaQCwPXAvsun-0YdP_0 2024-09-12T18:13:49.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.273+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14770667373124828234', time=2024-09-12T19:46:13.769695+0000, chain.objs.size()=1 2024-09-12T18:13:49.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.273+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.atsVkqOvAZO06Rww3JMTF0WEZgN3KDb_0 2024-09-12T18:13:49.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.273+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14352401793679056398', time=2024-09-12T19:46:13.802079+0000, chain.objs.size()=1 2024-09-12T18:13:49.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.273+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.qHUG4CkJl7O9hlPx_7veW-bNARLI0yj_0 2024-09-12T18:13:49.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.273+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.863679168124904406', time=2024-09-12T19:46:13.802873+0000, chain.objs.size()=1 2024-09-12T18:13:49.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.273+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.rTP1bdOK7SWjoz2wA1uoT2vHFm2CKT7_0 2024-09-12T18:13:49.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.273+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17061763491358146141', time=2024-09-12T19:46:14.784661+0000, chain.objs.size()=1 2024-09-12T18:13:49.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.273+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.o_oNSU2Ec94AjZhyYtiwBlLynCct7eF_0 2024-09-12T18:13:49.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.274+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5097544662118155877', time=2024-09-12T19:46:15.068157+0000, chain.objs.size()=1 2024-09-12T18:13:49.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.274+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.GTDg_bxKBjCm-Rk96OzAvUf3ZHamtqI_0 2024-09-12T18:13:49.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.275+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7966876275616563460', time=2024-09-12T19:46:15.638723+0000, chain.objs.size()=1 2024-09-12T18:13:49.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.275+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.njAi1DnUtL10NoZ1A_SigHLwspWiaDT_0 2024-09-12T18:13:49.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.275+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6592293329961352291', time=2024-09-12T19:46:15.704657+0000, chain.objs.size()=1 2024-09-12T18:13:49.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.275+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.YMrtqBskRZWEB1h2RjJUmxOQWwomdoL_0 2024-09-12T18:13:49.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.275+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1909905057477921830', time=2024-09-12T19:46:16.153040+0000, chain.objs.size()=1 2024-09-12T18:13:49.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.275+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.JLnC1Gd-3BzOnsZPgI3a_PFm33YQ_6n_0 2024-09-12T18:13:49.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.275+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18324514584258880547', time=2024-09-12T19:46:16.249130+0000, chain.objs.size()=1 2024-09-12T18:13:49.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.275+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.GKpGfpzem95lrRuraXHflmlhjEfuExP_0 2024-09-12T18:13:49.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.275+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7656422387274508496', time=2024-09-12T19:46:16.786400+0000, chain.objs.size()=1 2024-09-12T18:13:49.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.275+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.D3rkqURbbtmimvyFc1g_YXnRnnQhnd__0 2024-09-12T18:13:49.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.275+0000 7f35f0f5c640 0 -- 172.21.15.67:0/1761719668 >> [v2:172.21.15.67:6800/3672311065,v1:172.21.15.67:6801/3672311065] conn(0x7f35e401a040 msgr2=0x7f35e4097460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:13:49.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.276+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11805896102103236038', time=2024-09-12T19:46:17.131436+0000, chain.objs.size()=1 2024-09-12T18:13:49.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.276+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.1TJ5pd3X0S2Z9f_xJePX7TJleb__THl_0 2024-09-12T18:13:49.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.276+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1591685717302312466', time=2024-09-12T19:46:18.274482+0000, chain.objs.size()=1 2024-09-12T18:13:49.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.276+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.-knD6EaIkQ2Qhvpk0xlkNAFSnBIxZvG_0 2024-09-12T18:13:49.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.276+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1793024920788226037', time=2024-09-12T19:46:19.470290+0000, chain.objs.size()=1 2024-09-12T18:13:49.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.276+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.5JpXqoT9kjUaZASiv4EuKS6oK8O8Axh_0 2024-09-12T18:13:49.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.276+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13243538135099196931', time=2024-09-12T19:46:19.471190+0000, chain.objs.size()=1 2024-09-12T18:13:49.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.276+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.yr_gry9-biqClQIraUVo0H7d_4saQWe_0 2024-09-12T18:13:49.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.276+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8005621571134478585', time=2024-09-12T19:46:24.854714+0000, chain.objs.size()=1 2024-09-12T18:13:49.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.276+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.269__shadow_.EKIOQdUkuH9PPxCoXp2XoyEJoXFd7m__0 2024-09-12T18:13:49.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.276+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9219483321559361235', time=2024-09-12T19:46:29.193783+0000, chain.objs.size()=1 2024-09-12T18:13:49.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.276+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.274__shadow_.MEyhkP6g53IgpDV_i34ajEDmm4p28-S_0 2024-09-12T18:13:49.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.276+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4711168991951283877', time=2024-09-12T19:46:33.733759+0000, chain.objs.size()=1 2024-09-12T18:13:49.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.276+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.279__shadow_.TvEEMg11MSnkzurVxtFn8qiR6EOnVDj_0 2024-09-12T18:13:49.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.276+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16066348076911347385', time=2024-09-12T19:46:33.734549+0000, chain.objs.size()=1 2024-09-12T18:13:49.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.276+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.279__shadow_.s-kOu7pY377oecfJCydR67OCJTKFBx5_0 2024-09-12T18:13:49.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.277+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4322973310855359022', time=2024-09-12T19:46:48.153322+0000, chain.objs.size()=1 2024-09-12T18:13:49.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.277+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.293__shadow_.X6ACphmF7L2jJ952WNnd6aE5hpE24-s_0 2024-09-12T18:13:49.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.277+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8137863047002981139', time=2024-09-12T19:46:50.333379+0000, chain.objs.size()=1 2024-09-12T18:13:49.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.277+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.294__shadow_.0Hg26Cl_zWT9PBe-CdtLxpaEcTTiWbF_0 2024-09-12T18:13:49.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.277+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5317792673666408105', time=2024-09-12T19:46:50.403728+0000, chain.objs.size()=1 2024-09-12T18:13:49.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.277+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.294__shadow_.75m2QIwOfuhWbzvpeEs6RJypm4c9CVa_0 2024-09-12T18:13:49.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.278+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6971890088527840785', time=2024-09-12T19:46:50.419455+0000, chain.objs.size()=1 2024-09-12T18:13:49.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.278+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.294__shadow_.lnZpn-nh0xgDc2duhCEaTYzASKJ9KTh_0 2024-09-12T18:13:49.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.278+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11879766069652619753', time=2024-09-12T19:47:01.578721+0000, chain.objs.size()=1 2024-09-12T18:13:49.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.278+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.306__shadow_.iFBkZ2vEG4bwmjUl1oRnre6QBp4hHTk_0 2024-09-12T18:13:49.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.278+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1667555516731164184', time=2024-09-12T19:47:04.238609+0000, chain.objs.size()=1 2024-09-12T18:13:49.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.278+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.308__shadow:pRpDbvqupufdIOma-bdBBEhGHmF67n1_.cDUvbRSS_8Q_ul2riI6NJ9yztKWb8GC_0 2024-09-12T18:13:49.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.278+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14624991112946529656', time=2024-09-12T19:47:59.793762+0000, chain.objs.size()=1 2024-09-12T18:13:49.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.279+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.xDTfJOOeaRy4SeVFzo-w0Jbd14U3Zc8_0 2024-09-12T18:13:49.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.279+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16916891850207126662', time=2024-09-12T19:47:59.804721+0000, chain.objs.size()=1 2024-09-12T18:13:49.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.279+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.xzhwcgd6zwcPvJ7EYqtJ-Ldx-G3uQkb_0 2024-09-12T18:13:49.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.279+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6471835309339208763', time=2024-09-12T19:48:00.031875+0000, chain.objs.size()=1 2024-09-12T18:13:49.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.279+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.s9cPOizHeq7PPrkt733cysD4qAMIy7F_0 2024-09-12T18:13:49.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.279+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8700695945310577824', time=2024-09-12T19:48:00.242112+0000, chain.objs.size()=1 2024-09-12T18:13:49.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.279+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.2Oz4GEfGgUQbvvwXEKYt53Wtg1aaXqT_0 2024-09-12T18:13:49.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.279+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3664742096555832040', time=2024-09-12T19:48:01.184294+0000, chain.objs.size()=1 2024-09-12T18:13:49.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.279+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.DDjwZJmt0paEdxtxFzwP7vOY3W32Eba_0 2024-09-12T18:13:49.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.279+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12361764826093852554', time=2024-09-12T19:48:01.184917+0000, chain.objs.size()=1 2024-09-12T18:13:49.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.279+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.aYopHKpfB_4_7f67fLIN6WU2Odt3uAG_0 2024-09-12T18:13:49.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.279+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4068549152455806898', time=2024-09-12T19:48:01.236575+0000, chain.objs.size()=1 2024-09-12T18:13:49.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.279+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.zq7laj_CX6-eSd68ghXMcWUFCZ-tTIg_0 2024-09-12T18:13:49.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.279+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4555627731023911487', time=2024-09-12T19:48:01.821004+0000, chain.objs.size()=1 2024-09-12T18:13:49.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.279+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.zMlZEaDSJAfudQ3-v1dBhq1oZkSzbn5_0 2024-09-12T18:13:49.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.279+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5463266248456934831', time=2024-09-12T19:48:01.970955+0000, chain.objs.size()=1 2024-09-12T18:13:49.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.279+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.xeSiMRZQilG5-ALp7eKpPQrJKJNhGbK_0 2024-09-12T18:13:49.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.280+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11794640871838335940', time=2024-09-12T19:48:02.592847+0000, chain.objs.size()=1 2024-09-12T18:13:49.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.280+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.eogZho5602xUeNtvttxDrwOWEnts1vr_0 2024-09-12T18:13:49.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.280+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15187809567166079463', time=2024-09-12T19:48:02.890212+0000, chain.objs.size()=1 2024-09-12T18:13:49.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.280+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.jgptRqfvgf3r2R4xRF5ZJjwfdixctdN_0 2024-09-12T18:13:49.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.281+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.129102296213629989', time=2024-09-12T19:48:03.035716+0000, chain.objs.size()=1 2024-09-12T18:13:49.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.281+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.MHqiEoYSAh1WTo8suxB6vvOZpnKExgD_0 2024-09-12T18:13:49.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.281+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14317511435422048250', time=2024-09-12T19:48:03.174761+0000, chain.objs.size()=1 2024-09-12T18:13:49.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.281+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.aS2LNcI_YViKdWgZjh0UfFNWBCbedMp_0 2024-09-12T18:13:49.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.281+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8082126272629792006', time=2024-09-12T19:48:03.473527+0000, chain.objs.size()=1 2024-09-12T18:13:49.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.281+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.kTcx1l8veAsVwkFfSCb7FdY3gi_owpE_0 2024-09-12T18:13:49.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.281+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11436453339864282924', time=2024-09-12T19:48:03.474329+0000, chain.objs.size()=1 2024-09-12T18:13:49.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.281+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.a2aYwSY1d8bf8TArET4DvFz_AMIwEJi_0 2024-09-12T18:13:49.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.281+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7670694610861006818', time=2024-09-12T19:48:03.916496+0000, chain.objs.size()=1 2024-09-12T18:13:49.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.281+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.X9EuZBJr1dmF5DjC5eo64hUMqK8JnKW_0 2024-09-12T18:13:49.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.281+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12806539108183077512', time=2024-09-12T19:48:04.170946+0000, chain.objs.size()=1 2024-09-12T18:13:49.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.281+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Pk1vDDxYdNzLpBk_3qoB3jhppnrvGHA_0 2024-09-12T18:13:49.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.281+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12569208306060289716', time=2024-09-12T19:48:04.171689+0000, chain.objs.size()=1 2024-09-12T18:13:49.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.281+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.qXCqElNVhRYORIe-mWPauUtArE5rB_D_0 2024-09-12T18:13:49.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.281+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.566764857819750960', time=2024-09-12T19:48:04.569114+0000, chain.objs.size()=1 2024-09-12T18:13:49.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.281+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.7HH8lHA30A7VCPs3OtT4Qis9XdyHLJ8_0 2024-09-12T18:13:49.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.281+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14329745504983477978', time=2024-09-12T19:48:04.899910+0000, chain.objs.size()=1 2024-09-12T18:13:49.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.281+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.m8dHJU4_8y1LX7l7UdXyvT7RV8BywxY_0 2024-09-12T18:13:49.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.282+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4838500158641189004', time=2024-09-12T19:48:05.701949+0000, chain.objs.size()=1 2024-09-12T18:13:49.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.282+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.q8W1GHXJfyYjiExNyrMh-UPnhh9IsqD_0 2024-09-12T18:13:49.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.282+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12317194888719417586', time=2024-09-12T19:48:05.771604+0000, chain.objs.size()=1 2024-09-12T18:13:49.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.282+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.vmSX5ieb1c642a6ESuRQdCUD5dltrp4_0 2024-09-12T18:13:49.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.282+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3004810072634930487', time=2024-09-12T19:48:05.927838+0000, chain.objs.size()=1 2024-09-12T18:13:49.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.282+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.qds-3QtjxTmNuI-EbyD2kVIBx1e1cwZ_0 2024-09-12T18:13:49.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.282+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16484741924411693264', time=2024-09-12T19:48:06.128497+0000, chain.objs.size()=1 2024-09-12T18:13:49.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.282+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.OKbEQa-HDHy0ErOyh6lVBdEOzzjuRMP_0 2024-09-12T18:13:49.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.283+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16299131220404569929', time=2024-09-12T19:48:07.380717+0000, chain.objs.size()=1 2024-09-12T18:13:49.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.283+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.1HrIkYx42ZyOLuf9oZHvdnmo98voD15_0 2024-09-12T18:13:49.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.283+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11654181205943260267', time=2024-09-12T19:48:07.402281+0000, chain.objs.size()=1 2024-09-12T18:13:49.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.283+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.2H3wNjkqPgTL8agWW25wbmTivwCldex_0 2024-09-12T18:13:49.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.284+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17726220212833786276', time=2024-09-12T19:48:07.547212+0000, chain.objs.size()=1 2024-09-12T18:13:49.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.284+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.6GJqMWXiHlU1PVVAlhWfw-5Zc_MQABq_0 2024-09-12T18:13:49.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.284+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4370671578712394805', time=2024-09-12T19:48:07.661558+0000, chain.objs.size()=1 2024-09-12T18:13:49.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.284+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.R2keY7NOkL4lvsGrpRkSM1-FUy9nj-K_0 2024-09-12T18:13:49.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.284+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13142415162724321212', time=2024-09-12T19:48:08.507742+0000, chain.objs.size()=1 2024-09-12T18:13:49.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.284+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.df6UmzyNpYNnscCRnnPRBxHn_3qe78g_0 2024-09-12T18:13:49.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.284+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18168699650168778744', time=2024-09-12T19:48:08.599982+0000, chain.objs.size()=1 2024-09-12T18:13:49.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.284+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.8VPg_2Tk35VhKhHz6TGvyfi3tcMH5Em_0 2024-09-12T18:13:49.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.284+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.886934740444431071', time=2024-09-12T19:48:09.534128+0000, chain.objs.size()=1 2024-09-12T18:13:49.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.284+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.plE5u6jMtf0SL64ikT0mxhmg-FlNBuZ_0 2024-09-12T18:13:49.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.284+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5878123235725986634', time=2024-09-12T19:48:09.658318+0000, chain.objs.size()=1 2024-09-12T18:13:49.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.284+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.M_8ZEFxFCdLmcRl07ruj5nmNC4i5ljd_0 2024-09-12T18:13:49.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.284+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13050260416384283810', time=2024-09-12T19:48:09.762554+0000, chain.objs.size()=1 2024-09-12T18:13:49.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.284+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.3qJ0Xs0NByYHFes-BsncxsGnWwBCfAY_0 2024-09-12T18:13:49.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.284+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4277019766856478013', time=2024-09-12T19:48:47.452177+0000, chain.objs.size()=1 2024-09-12T18:13:49.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.284+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.9xjfmKN2CyAt7W93wxuQazAoXRJ1zX5_0 2024-09-12T18:13:49.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.284+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2015299874261664940', time=2024-09-12T19:48:47.831555+0000, chain.objs.size()=1 2024-09-12T18:13:49.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.284+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Wk4IsfHpepsSRHQX-DhRJkvIljabs7E_0 2024-09-12T18:13:49.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.284+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15883379339631679460', time=2024-09-12T19:48:48.050670+0000, chain.objs.size()=1 2024-09-12T18:13:49.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.284+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.kV-tWR4zNm7jMtYRNyjEYXtcMcr0GbV_0 2024-09-12T18:13:49.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.284+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16513490921002854964', time=2024-09-12T19:48:48.295882+0000, chain.objs.size()=1 2024-09-12T18:13:49.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.284+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.sJJ0R_E5yQnGtVaUMAKYj_6_9WUxSHL_0 2024-09-12T18:13:49.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.286+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4124515574084955298', time=2024-09-12T19:48:48.422109+0000, chain.objs.size()=1 2024-09-12T18:13:49.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.286+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.QqxqHrSeh5QMCQK3htx_YCifdtMLE4t_0 2024-09-12T18:13:49.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.286+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2217652285641374759', time=2024-09-12T19:48:49.201880+0000, chain.objs.size()=1 2024-09-12T18:13:49.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.286+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Dx3xDpoE1fUYUmtLcV0F9_tkuXVBgjy_0 2024-09-12T18:13:49.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.286+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15539878909004173901', time=2024-09-12T19:48:49.250861+0000, chain.objs.size()=1 2024-09-12T18:13:49.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.287+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.9bwDuIUl2w0U3CEgPXIFcZSJMUqboaz_0 2024-09-12T18:13:49.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.287+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16480607333199278462', time=2024-09-12T19:48:49.641740+0000, chain.objs.size()=1 2024-09-12T18:13:49.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.287+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.W0DRyWQfdyCzu8BzOSffJfs0C89M0zs_0 2024-09-12T18:13:49.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.287+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18443455342123384220', time=2024-09-12T19:48:50.687871+0000, chain.objs.size()=1 2024-09-12T18:13:49.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.287+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.k4wxSf_FzRoKHXi1BaGsIhikqdrJM6q_0 2024-09-12T18:13:49.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.287+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17168386122198471954', time=2024-09-12T19:48:50.774664+0000, chain.objs.size()=1 2024-09-12T18:13:49.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.287+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.837GHIg0UKfz_H8LEWm2TG_OFPkrwFb_0 2024-09-12T18:13:49.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.287+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11077017429369309277', time=2024-09-12T19:48:50.985183+0000, chain.objs.size()=1 2024-09-12T18:13:49.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.287+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_._R1uAc5AngM7L4wc_guG_XyeZiiKDqF_0 2024-09-12T18:13:49.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.287+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10045742629298542500', time=2024-09-12T19:48:51.016165+0000, chain.objs.size()=1 2024-09-12T18:13:49.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.287+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.6FzVmKx_ul20lrw-kOM75mJb_eSVCJv_0 2024-09-12T18:13:49.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.287+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2334399223615456421', time=2024-09-12T19:48:51.944082+0000, chain.objs.size()=1 2024-09-12T18:13:49.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.287+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.LZ6yjvgOCzTdHSmWafbg8Ay9QxssHyP_0 2024-09-12T18:13:49.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.287+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13105922174271648747', time=2024-09-12T19:48:52.074463+0000, chain.objs.size()=1 2024-09-12T18:13:49.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.287+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.r5CasWga3lkAxxkv2NbOzvks2mFvXji_0 2024-09-12T18:13:49.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.287+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11756122867768383141', time=2024-09-12T19:48:52.177877+0000, chain.objs.size()=1 2024-09-12T18:13:49.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.287+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.sfnMqGriAlrtUvjZXA_JdW1dDT-yrmc_0 2024-09-12T18:13:49.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.288+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7776428700503833939', time=2024-09-12T19:48:52.518201+0000, chain.objs.size()=1 2024-09-12T18:13:49.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.288+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.xUodvP7a2IQAbPYVMEti_QqgU5Z480q_0 2024-09-12T18:13:49.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.288+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17012041099096518019', time=2024-09-12T19:48:52.607099+0000, chain.objs.size()=1 2024-09-12T18:13:49.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.288+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Hqt0A4E7-w3LJHbfsMjBrx1mavr-fOV_0 2024-09-12T18:13:49.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.289+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.758207477267445255', time=2024-09-12T19:48:52.844760+0000, chain.objs.size()=1 2024-09-12T18:13:49.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.289+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.LyfzVOpuWo47j1SqQ_3-6UjVB8NvBPj_0 2024-09-12T18:13:49.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.289+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7361670519730641472', time=2024-09-12T19:48:53.447069+0000, chain.objs.size()=1 2024-09-12T18:13:49.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.289+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.3sCgY2xoW3Pty_Ga3IdduI-z6UY8dKg_0 2024-09-12T18:13:49.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.289+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9507700716741957897', time=2024-09-12T19:48:53.628980+0000, chain.objs.size()=1 2024-09-12T18:13:49.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.289+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.JL83GvUou4brogrXzBcVDLv02uYt5TN_0 2024-09-12T18:13:49.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.289+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1776044001192679430', time=2024-09-12T19:48:53.968319+0000, chain.objs.size()=1 2024-09-12T18:13:49.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.289+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.2JKHeF9Oh2sid0gVtut4hZCQj4AlCYM_0 2024-09-12T18:13:49.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.289+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15228207637015236455', time=2024-09-12T19:48:54.084917+0000, chain.objs.size()=1 2024-09-12T18:13:49.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.289+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.bzC1ikuTZ8GEN32ZF_ShviWROrOKtz8_0 2024-09-12T18:13:49.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.289+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6118028910219576761', time=2024-09-12T19:48:54.148992+0000, chain.objs.size()=1 2024-09-12T18:13:49.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.289+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.VBW-O44PfqQjWhloLJaT2kiUc2r2HNS_0 2024-09-12T18:13:49.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.290+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14166625856692061531', time=2024-09-12T19:48:54.905764+0000, chain.objs.size()=1 2024-09-12T18:13:49.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.290+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.23qrlZ91QCns_RCqAfhrEv2BPGoaOa__0 2024-09-12T18:13:49.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.291+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/49724 2024-09-12T18:13:49.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.293+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-12T18:13:49.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.293+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5779998317866214132', time=2024-09-12T19:48:55.607057+0000, chain.objs.size()=1 2024-09-12T18:13:49.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.293+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.8CanLpqshjzHmMS-bCmBIivxzi3v_X5_0 2024-09-12T18:13:49.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.293+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3864239485540610254', time=2024-09-12T19:48:56.133494+0000, chain.objs.size()=1 2024-09-12T18:13:49.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.293+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.6CXJz4_eWB8OEyjvm6sESqPoN143EAU_0 2024-09-12T18:13:49.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.293+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15832884729829607103', time=2024-09-12T19:48:56.429634+0000, chain.objs.size()=1 2024-09-12T18:13:49.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.293+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.tWhtpcqwlo8tC9j31VonRXZyw__VwAW_0 2024-09-12T18:13:49.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.293+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12223446033465513371', time=2024-09-12T19:48:56.628081+0000, chain.objs.size()=1 2024-09-12T18:13:49.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.293+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.xH0f-lAdEX0dSqeYCfzPVGBn87u7Zup_0 2024-09-12T18:13:49.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.293+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15127717395583881262', time=2024-09-12T19:48:56.954192+0000, chain.objs.size()=1 2024-09-12T18:13:49.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.293+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.xwvbMtyDAp93JzhyLX3hbK7KtQoOzAt_0 2024-09-12T18:13:49.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.293+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11083196402358106373', time=2024-09-12T19:48:57.293714+0000, chain.objs.size()=1 2024-09-12T18:13:49.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.293+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.3FI8Abn-5k5OTu4x9c58BTwNQvPEe6Z_0 2024-09-12T18:13:49.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.293+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13278878156328591908', time=2024-09-12T19:48:57.294552+0000, chain.objs.size()=1 2024-09-12T18:13:49.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.293+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.F9qO09Ib2OIN44o0xLQiq3jr0IlEJKQ_0 2024-09-12T18:13:49.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.293+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.338423054503683350', time=2024-09-12T19:48:57.722197+0000, chain.objs.size()=1 2024-09-12T18:13:49.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.293+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.S-3OmyAo7QpzemoYRqqFK8wgBkyPPHx_0 2024-09-12T18:13:49.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.293+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2096897282886568149', time=2024-09-12T19:48:57.722960+0000, chain.objs.size()=1 2024-09-12T18:13:49.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.293+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.V1lwECVB576KGBGN2e5xdjgBItWR0yn_0 2024-09-12T18:13:49.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.293+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17143370769895114532', time=2024-09-12T19:50:53.808171+0000, chain.objs.size()=1 2024-09-12T18:13:49.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.293+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.456__shadow_.r8qOBkPeEzybzeCBiJmLtsxR-39VYtq_0 2024-09-12T18:13:49.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.293+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5185740667467889641', time=2024-09-12T19:51:05.375218+0000, chain.objs.size()=1 2024-09-12T18:13:49.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.293+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.465__shadow_.Eap-z92SAydaclvOcaqQBwPAlPSsuUT_0 2024-09-12T18:13:49.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.293+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7195036748942710507', time=2024-09-12T19:51:16.089804+0000, chain.objs.size()=1 2024-09-12T18:13:49.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.293+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.482__shadow_.mHNPaeyXKqhO1BjMPA1bw3iI54XyK8R_0 2024-09-12T18:13:49.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.295+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14425125640236589983', time=2024-09-12T19:51:19.635172+0000, chain.objs.size()=1 2024-09-12T18:13:49.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.295+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.485__shadow_.SOV4Y-1NXjY6Wh_P7xg-YTizVqbcQDD_0 2024-09-12T18:13:49.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.295+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13669174771477794746', time=2024-09-12T19:52:11.226765+0000, chain.objs.size()=6 2024-09-12T18:13:49.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.295+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.1 2024-09-12T18:13:49.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.295+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.2 2024-09-12T18:13:49.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.295+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.3 2024-09-12T18:13:49.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.295+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.4 2024-09-12T18:13:49.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.297+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.5 2024-09-12T18:13:49.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.297+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.508__multipart_srcmultipart.2~lYxbzO8dbE5heQQFSaXVLdwnh1fWy7r.6 2024-09-12T18:13:49.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.297+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1173031539059551662', time=2024-09-12T19:52:30.672213+0000, chain.objs.size()=1 2024-09-12T18:13:49.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.297+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.518__shadow_.soIp38thRpuHGpPJB8aFT0a_9pKeL3R_0 2024-09-12T18:13:49.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.297+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~xEe8SLiYxbdaVQ_ead1TZzbu3GiYFcl', time=2024-09-12T19:56:04.042888+0000, chain.objs.size()=2 2024-09-12T18:13:49.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.297+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.530__multipart_mymultipart.2~xEe8SLiYxbdaVQ_ead1TZzbu3GiYFcl.1 2024-09-12T18:13:49.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.297+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.530__multipart_mymultipart.2~xEe8SLiYxbdaVQ_ead1TZzbu3GiYFcl.2 2024-09-12T18:13:49.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.297+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~SIpbBCeeqKKcqEnpSoN7QivEOpTvuyr', time=2024-09-12T19:57:42.844101+0000, chain.objs.size()=1 2024-09-12T18:13:49.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.297+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.562__multipart_mymultipart.2~SIpbBCeeqKKcqEnpSoN7QivEOpTvuyr.1 2024-09-12T18:13:49.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.297+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16244418060712355476', time=2024-09-12T19:58:06.061514+0000, chain.objs.size()=1 2024-09-12T18:13:49.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.297+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:5yksRCUd6mPia-mZ.5cP21yXGSlxGX4_.BlfnKIGqJH87lCJoje3cRVdLZrJwhZo_0 2024-09-12T18:13:49.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.297+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10346532434886439492', time=2024-09-12T19:58:06.877862+0000, chain.objs.size()=1 2024-09-12T18:13:49.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.297+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:BPVeGfdlaAddI4ntJRt0v0ttw818HTh_.rg0kwaHgiMkZGp2iJUXu3LUk1n5s_-Q_0 2024-09-12T18:13:49.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.297+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11532116470579607622', time=2024-09-12T19:58:19.388910+0000, chain.objs.size()=1 2024-09-12T18:13:49.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.297+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.576__shadow_.pk9gXeRJvbVxoyf8Bv9bDXvtogyZuFW_0 2024-09-12T18:13:49.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.297+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9710673914667635044', time=2024-09-12T19:58:38.327753+0000, chain.objs.size()=1 2024-09-12T18:13:49.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.297+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:ygIOOT0TCepttliNTMu6yTYCFBsOskE_.Cbns38yiBQoxCuqDWWh0t3k4L1Lhz5u_0 2024-09-12T18:13:49.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.297+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14019816089939590551', time=2024-09-12T19:59:32.330034+0000, chain.objs.size()=1 2024-09-12T18:13:49.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.297+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.581__shadow:PxtTY6zDjyBHKb9UO7QqAfd0p1ZH1zl_.3hOil_IKSSU_ejz9wFrHDZtfEplNEsw_0 2024-09-12T18:13:49.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.299+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12542137029165648737', time=2024-09-12T19:59:32.607490+0000, chain.objs.size()=1 2024-09-12T18:13:49.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.299+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.581__shadow:txwT6n29sKsEo.QjcF-goizg3IHoYVA_.Lu0pkJi7CcsEBws6jASd7-1rCe4k6na_0 2024-09-12T18:13:49.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.299+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10192274481574872585', time=2024-09-12T19:59:41.110701+0000, chain.objs.size()=1 2024-09-12T18:13:49.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.299+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.588__shadow:G5pn1H0B6buPqv-io9t4llgb-4pdGQp_.OS046Q3geToiG-zb9oi971f_CrZKPzq_0 2024-09-12T18:13:49.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.299+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2382443470975490934', time=2024-09-12T19:59:53.386182+0000, chain.objs.size()=1 2024-09-12T18:13:49.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.299+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.604__shadow_.rKbpLdRhVUDKfKHxo64zQL-THehfeph_0 2024-09-12T18:13:49.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.299+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14484585091612786729', time=2024-09-12T20:00:51.519637+0000, chain.objs.size()=12 2024-09-12T18:13:49.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.299+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.614__multipart_multipart_enc.2~McpJE0ML98jN_ludBjEtyt_PQCM0cau.1 2024-09-12T18:13:49.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.299+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.614__shadow_multipart_enc.2~McpJE0ML98jN_ludBjEtyt_PQCM0cau.1_1 2024-09-12T18:13:49.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.299+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.614__multipart_multipart_enc.2~McpJE0ML98jN_ludBjEtyt_PQCM0cau.2 2024-09-12T18:13:49.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.299+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.614__shadow_multipart_enc.2~McpJE0ML98jN_ludBjEtyt_PQCM0cau.2_1 2024-09-12T18:13:49.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.299+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.614__multipart_multipart_enc.2~McpJE0ML98jN_ludBjEtyt_PQCM0cau.3 2024-09-12T18:13:49.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.299+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.614__shadow_multipart_enc.2~McpJE0ML98jN_ludBjEtyt_PQCM0cau.3_1 2024-09-12T18:13:49.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.299+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.614__multipart_multipart_enc.2~McpJE0ML98jN_ludBjEtyt_PQCM0cau.4 2024-09-12T18:13:49.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.299+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.614__shadow_multipart_enc.2~McpJE0ML98jN_ludBjEtyt_PQCM0cau.4_1 2024-09-12T18:13:49.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.302+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.614__multipart_multipart_enc.2~McpJE0ML98jN_ludBjEtyt_PQCM0cau.5 2024-09-12T18:13:49.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.302+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.614__shadow_multipart_enc.2~McpJE0ML98jN_ludBjEtyt_PQCM0cau.5_1 2024-09-12T18:13:49.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.302+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.614__multipart_multipart_enc.2~McpJE0ML98jN_ludBjEtyt_PQCM0cau.6 2024-09-12T18:13:49.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.302+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.614__shadow_multipart_enc.2~McpJE0ML98jN_ludBjEtyt_PQCM0cau.6_1 2024-09-12T18:13:49.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.303+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1974817145649649782', time=2024-09-12T20:06:04.236804+0000, chain.objs.size()=1 2024-09-12T18:13:49.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.303+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.666__shadow_.HE3ilAMgE9W4FUE2cwit-YC0nxn2kRH_0 2024-09-12T18:13:49.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.303+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10443600870570787343', time=2024-09-12T20:06:05.643995+0000, chain.objs.size()=1 2024-09-12T18:13:49.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.303+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.667__shadow_.kFTBjubEQVZEwv8sKotoS-_ZA3YX9Cy_0 2024-09-12T18:13:49.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.303+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3425008488388554891', time=2024-09-12T20:06:26.008723+0000, chain.objs.size()=1 2024-09-12T18:13:49.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.303+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.695__shadow:PSC5Y-mEBm8c2GqMztbG29aelWSrYBH_.DGgj39nIeg2w7qMKU_DEnnvVqOkNRnZ_0 2024-09-12T18:13:49.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.303+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8438776426209461916', time=2024-09-12T20:06:38.169478+0000, chain.objs.size()=1 2024-09-12T18:13:49.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.303+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.709__shadow:WgIRruU.V3pPxVkwYuYaOZeyXLkKxkC_.ZMn0RFUIaWC8Dauc5a63PjNHEI63IpA_0 2024-09-12T18:13:49.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.303+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8860375123928549906', time=2024-09-12T20:06:43.323213+0000, chain.objs.size()=1 2024-09-12T18:13:49.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.303+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.715__shadow:JNi8.563PkYPnA8F7CtOuZg39Od21yR_.9wOMlNLWj4Hq5RsQTsDImFQYvFKnkxF_0 2024-09-12T18:13:49.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.305+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:49.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.307+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:13:49.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.308+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:49.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.309+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:49.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.309+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47739' 2024-09-12T18:13:49.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.309+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='_KDOmthDXXkZ5B9W8N9pGV2i6eB3Lw7R', time=2024-09-12T19:42:23.149841+0000, chain.objs.size()=1 2024-09-12T18:13:49.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.309+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.166__shadow_.UwzHNXznEE1voxNgU7ro7PWC-e07cmW_0 2024-09-12T18:13:49.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.309+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2998404598478354575', time=2024-09-12T19:45:05.529915+0000, chain.objs.size()=1 2024-09-12T18:13:49.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.309+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.236__shadow_.wnQk-qoSFe8AF0nZt0Y88r8LJ3BL-ib_0 2024-09-12T18:13:49.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.309+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.468555448702155626', time=2024-09-12T19:45:08.038150+0000, chain.objs.size()=1 2024-09-12T18:13:49.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.309+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.238__shadow_.d5X2aPQmHbRaL4A0Xp1V4WJq74D_7QG_0 2024-09-12T18:13:49.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.309+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11211840329632496265', time=2024-09-12T19:45:12.206496+0000, chain.objs.size()=1 2024-09-12T18:13:49.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.309+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.242__shadow_.YNPh74vK2o8M0joO-ZQ7cKT_NKND_Ct_0 2024-09-12T18:13:49.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.309+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6304696686964766128', time=2024-09-12T19:45:14.716666+0000, chain.objs.size()=1 2024-09-12T18:13:49.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.309+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.244__shadow_.Whf0KEys43u_s8xo8JuKaVUWvRpl0Yq_0 2024-09-12T18:13:49.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.309+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11236922396184926585', time=2024-09-12T19:45:18.187661+0000, chain.objs.size()=1 2024-09-12T18:13:49.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.309+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.247__shadow_.L48el69x9y3zGHALtZc4ZeHjNEdnABZ_0 2024-09-12T18:13:49.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.309+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17830257175818515721', time=2024-09-12T19:45:24.577846+0000, chain.objs.size()=1 2024-09-12T18:13:49.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.309+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.254__shadow_.LwkkCcpm9L3AtYRMfN9mlIYKCRRLhJj_0 2024-09-12T18:13:49.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.309+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11172865500676145882', time=2024-09-12T19:45:26.380610+0000, chain.objs.size()=1 2024-09-12T18:13:49.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.309+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.256__shadow_.YvWiQO9tDwTkzcemUydG1msB3ycIE1y_0 2024-09-12T18:13:49.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.309+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12621760637911558403', time=2024-09-12T19:45:29.913464+0000, chain.objs.size()=1 2024-09-12T18:13:49.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.309+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.260__shadow_.WgINyECYXPluV3a8RPzlu1Rp9eZXe-z_0 2024-09-12T18:13:49.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.309+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18031029125649720736', time=2024-09-12T19:46:08.993392+0000, chain.objs.size()=1 2024-09-12T18:13:49.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.309+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_._VQmuRLgTS8chh7a6AOR8WQ2lmAo3r-_0 2024-09-12T18:13:49.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.309+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6676700459459097458', time=2024-09-12T19:46:09.390078+0000, chain.objs.size()=1 2024-09-12T18:13:49.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.309+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.hdo5qrUfclO_ncgyD-sL_Z6NQ0pLX5t_0 2024-09-12T18:13:49.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.309+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7551389445792117222', time=2024-09-12T19:46:11.360167+0000, chain.objs.size()=1 2024-09-12T18:13:49.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.309+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.RzgxyVKCGNNa3kDN2rCz4pUNtVfeUkB_0 2024-09-12T18:13:49.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.311+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5304793529151024014', time=2024-09-12T19:46:12.371027+0000, chain.objs.size()=1 2024-09-12T18:13:49.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.311+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.6IwG2MReSTa555mlPM9aWrHIFg2Gy2__0 2024-09-12T18:13:49.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.311+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1271930744650188285', time=2024-09-12T19:46:12.534247+0000, chain.objs.size()=1 2024-09-12T18:13:49.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.311+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.qxbqYIS_EWJHfA1L8ApetBNz9Yst5m4_0 2024-09-12T18:13:49.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.312+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1585846270577669641', time=2024-09-12T19:46:12.722842+0000, chain.objs.size()=1 2024-09-12T18:13:49.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.312+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.N4gQkN-HjGBVhPw-fv8AD_snts6Hary_0 2024-09-12T18:13:49.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.312+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6677849391529040565', time=2024-09-12T19:46:13.538748+0000, chain.objs.size()=1 2024-09-12T18:13:49.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.312+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.z46IPqNoQo66NWiwAB60x8CBnjwMF_G_0 2024-09-12T18:13:49.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.312+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4820303062294031307', time=2024-09-12T19:46:13.652927+0000, chain.objs.size()=1 2024-09-12T18:13:49.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.312+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.0GtesTEe2-lX5Dkqq2Jlk4wwFM3AzRy_0 2024-09-12T18:13:49.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.312+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3411687132905185874', time=2024-09-12T19:46:14.115385+0000, chain.objs.size()=1 2024-09-12T18:13:49.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.312+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.1Z0TZrNSnjSHYEaCQAkDKkZ0-_DsKTv_0 2024-09-12T18:13:49.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.312+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6728476255146510927', time=2024-09-12T19:46:14.339901+0000, chain.objs.size()=1 2024-09-12T18:13:49.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.312+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.QjhFFqvP7GXBTzuWzWCA1njqDVT_kpY_0 2024-09-12T18:13:49.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.312+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1584840005552837942', time=2024-09-12T19:46:14.780455+0000, chain.objs.size()=1 2024-09-12T18:13:49.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.312+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.9t5z1KjWThInW_fMj_IC5Y6fQzlkgXY_0 2024-09-12T18:13:49.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.312+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17355258158449248416', time=2024-09-12T19:46:14.987762+0000, chain.objs.size()=1 2024-09-12T18:13:49.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.312+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.GNzfqhbQVg7H-v1GRzlQOzbh-rg5eph_0 2024-09-12T18:13:49.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.312+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13014573337606662697', time=2024-09-12T19:46:15.236362+0000, chain.objs.size()=1 2024-09-12T18:13:49.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.312+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.pHxp3XLMcwqy7nG-dKq--G2cWO0hhaG_0 2024-09-12T18:13:49.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.312+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17222540886675346476', time=2024-09-12T19:46:15.317466+0000, chain.objs.size()=1 2024-09-12T18:13:49.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.312+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.gVZQRAJqshlfEcgSZ63m6ZmfiqAwjc3_0 2024-09-12T18:13:49.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.312+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14489688963597214858', time=2024-09-12T19:46:15.407059+0000, chain.objs.size()=1 2024-09-12T18:13:49.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.312+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.TXAhoO1GFMS7GFvIsgI_4pgc_kwzNLr_0 2024-09-12T18:13:49.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.313+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10678372384733543423', time=2024-09-12T19:46:15.750878+0000, chain.objs.size()=1 2024-09-12T18:13:49.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.313+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.81TBo0WwhxqPyi-XMCSeNc8_leUCqCC_0 2024-09-12T18:13:49.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.313+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1726819644351141962', time=2024-09-12T19:46:17.141563+0000, chain.objs.size()=1 2024-09-12T18:13:49.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.313+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.rCvPcTKWW4PrBknsP9fcKBc6mNn0QcK_0 2024-09-12T18:13:49.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.313+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15975295550211382628', time=2024-09-12T19:46:17.460966+0000, chain.objs.size()=1 2024-09-12T18:13:49.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.313+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ESQEi6_zV_196TspOBuBuJbUHJUSp7H_0 2024-09-12T18:13:49.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.313+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9831666961405172151', time=2024-09-12T19:46:17.527584+0000, chain.objs.size()=1 2024-09-12T18:13:49.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.314+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.xcOoF2JrCDYD_m8WdTo_3YDMY1ZZD0H_0 2024-09-12T18:13:49.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.314+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10486066732098747976', time=2024-09-12T19:46:17.638409+0000, chain.objs.size()=1 2024-09-12T18:13:49.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.314+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.CCRFmMckqhhSdVy4t-7WYs0xZf7u3iw_0 2024-09-12T18:13:49.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.314+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10696631672693836806', time=2024-09-12T19:46:17.929658+0000, chain.objs.size()=1 2024-09-12T18:13:49.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.314+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.BPw7Vs9H_5g3HAq5CHPMJEIVCHpknDQ_0 2024-09-12T18:13:49.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.314+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8016637808221464766', time=2024-09-12T19:46:18.264394+0000, chain.objs.size()=1 2024-09-12T18:13:49.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.314+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.I-O4VT0a7FCr5NyCk_4e4B7sfwo1wLz_0 2024-09-12T18:13:49.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.314+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5161782677815142600', time=2024-09-12T19:46:18.470047+0000, chain.objs.size()=1 2024-09-12T18:13:49.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.314+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.13mqSIQRlFLksa3MihbLMwggcEQdK1I_0 2024-09-12T18:13:49.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.314+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.618923668802975597', time=2024-09-12T19:46:18.470906+0000, chain.objs.size()=1 2024-09-12T18:13:49.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.314+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.yzq76DW3W9ZYTXrKbHoio0ELe8gwKmv_0 2024-09-12T18:13:49.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.314+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7960195386674373945', time=2024-09-12T19:46:18.905637+0000, chain.objs.size()=1 2024-09-12T18:13:49.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.314+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.58I_2bT9Kom5H3yD7_a3M8gTSr9YKJ-_0 2024-09-12T18:13:49.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.314+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6533631821033526267', time=2024-09-12T19:46:18.906398+0000, chain.objs.size()=1 2024-09-12T18:13:49.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.314+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.tQJeFWze_Mdx-XUs1192B4U2f4qjU1L_0 2024-09-12T18:13:49.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.315+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4677493378063084668', time=2024-09-12T19:46:18.969598+0000, chain.objs.size()=1 2024-09-12T18:13:49.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.315+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.YnrTjweuMYNpN-nBoBB8XviK2C5Y1bC_0 2024-09-12T18:13:49.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.315+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5348462802687936717', time=2024-09-12T19:46:19.077500+0000, chain.objs.size()=1 2024-09-12T18:13:49.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.315+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.h2ZeYVbifyNkqWNTawfDroadXTGuN86_0 2024-09-12T18:13:49.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.315+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14939410178337762705', time=2024-09-12T19:46:19.608948+0000, chain.objs.size()=1 2024-09-12T18:13:49.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.315+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.r-W9dElbhbGh3xCZpa9G-dUVCouG7zx_0 2024-09-12T18:13:49.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.315+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18386352276421884779', time=2024-09-12T19:46:31.027061+0000, chain.objs.size()=1 2024-09-12T18:13:49.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.315+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.276__shadow_.5cExrP78XKwfmt6nw9nbwOGQ5GOqtIm_0 2024-09-12T18:13:49.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.315+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8801345999430644371', time=2024-09-12T19:46:31.027627+0000, chain.objs.size()=1 2024-09-12T18:13:49.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.315+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.276__shadow_.Vas6r9J-av6JXKA-07rtLBgD1_LjWsu_0 2024-09-12T18:13:49.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.316+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11461820721179398371', time=2024-09-12T19:46:36.490620+0000, chain.objs.size()=1 2024-09-12T18:13:49.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.316+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.282__shadow_.znGr7pPSXunWHD7M7F6UgKGOyJNu8rJ_0 2024-09-12T18:13:49.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.316+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3483586736576300846', time=2024-09-12T19:46:36.497870+0000, chain.objs.size()=1 2024-09-12T18:13:49.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.316+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.282__shadow_.oQIjHmV6PJlA_Lbd9SC2yxN7-zfkom3_0 2024-09-12T18:13:49.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.316+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10035792082868923434', time=2024-09-12T19:46:37.411339+0000, chain.objs.size()=1 2024-09-12T18:13:49.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.316+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.283__shadow_.TvSNoMAWaTTlK-Parb4V3BcJX9gvmT1_0 2024-09-12T18:13:49.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.316+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7937353489514642735', time=2024-09-12T19:46:44.813105+0000, chain.objs.size()=1 2024-09-12T18:13:49.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.316+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.291__shadow_.sJgeO9aM0tDkxxZHizYSTK8T4rCrSFi_0 2024-09-12T18:13:49.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.317+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4208511923253532460', time=2024-09-12T19:46:48.107643+0000, chain.objs.size()=1 2024-09-12T18:13:49.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.317+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.293__shadow_.nLa0v2sNbZ40CqKK6QsDdGSvZWU4BnS_0 2024-09-12T18:13:49.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.317+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.951026820600616920', time=2024-09-12T19:47:18.737732+0000, chain.objs.size()=1 2024-09-12T18:13:49.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.317+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.320__shadow:fVsfYeyrqubRNk88e.NKcBojk0n94vk_.RFD85OfsbW_BMgVrBNW9c-W4K6kvGzs_0 2024-09-12T18:13:49.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.317+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18093607190068968472', time=2024-09-12T19:47:20.139578+0000, chain.objs.size()=1 2024-09-12T18:13:49.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.317+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.322__shadow_.jUo53R7eE9V8admlc7CMekH5dpLrJ3R_0 2024-09-12T18:13:49.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.318+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12456823205649075669', time=2024-09-12T19:48:00.121938+0000, chain.objs.size()=1 2024-09-12T18:13:49.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.318+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.yhJXu1Qj1UY9_juNxnaBignyqlTHheX_0 2024-09-12T18:13:49.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.318+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1630436334326366931', time=2024-09-12T19:48:01.016869+0000, chain.objs.size()=1 2024-09-12T18:13:49.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.318+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.6IIZHzvuciowufIO6aB2gVqS6yp-nnd_0 2024-09-12T18:13:49.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.318+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3296614830816957619', time=2024-09-12T19:48:01.286196+0000, chain.objs.size()=1 2024-09-12T18:13:49.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.318+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.FmwlHhhWxpgDyiNLx71KaJ5eVoJfAHk_0 2024-09-12T18:13:49.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.318+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18156301956105316781', time=2024-09-12T19:48:01.429098+0000, chain.objs.size()=1 2024-09-12T18:13:49.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.318+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.TZ8N6aSBSrPzYzR9ckpLXBXLY8Z9PSP_0 2024-09-12T18:13:49.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.318+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.904463846038147241', time=2024-09-12T19:48:02.952674+0000, chain.objs.size()=1 2024-09-12T18:13:49.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.318+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Dm6wcGuKa6S2_BuRi_DjOQY0pZrUvSz_0 2024-09-12T18:13:49.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.318+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16425926175558831421', time=2024-09-12T19:48:03.161412+0000, chain.objs.size()=1 2024-09-12T18:13:49.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.318+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.3n5b7DIcDF02rbBFCb1EhRVdEf7TZnU_0 2024-09-12T18:13:49.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.318+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7778766263337077505', time=2024-09-12T19:48:03.373753+0000, chain.objs.size()=1 2024-09-12T18:13:49.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.318+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.xkgntN7yY4Gi9t7cwcFbQVRMLi1qRlD_0 2024-09-12T18:13:49.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.318+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1532135471754463333', time=2024-09-12T19:48:04.240935+0000, chain.objs.size()=1 2024-09-12T18:13:49.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.318+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.VGTa1F-7XydNRm89hxX1t9PAo0Cavh4_0 2024-09-12T18:13:49.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.318+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15957954200582289054', time=2024-09-12T19:48:04.327256+0000, chain.objs.size()=1 2024-09-12T18:13:49.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.318+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ZoilrhlKx7PoWv7bFlhtz_UwFS6GszF_0 2024-09-12T18:13:49.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.320+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17908065732213935316', time=2024-09-12T19:48:04.447609+0000, chain.objs.size()=1 2024-09-12T18:13:49.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.320+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.PkiFhdehfxyyl8btMXNeEBm4izsa0Xc_0 2024-09-12T18:13:49.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.320+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11131308379734928053', time=2024-09-12T19:48:04.772100+0000, chain.objs.size()=1 2024-09-12T18:13:49.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.320+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ddJ_LuCs2fzTLQpEZWBMLO58KZn4ZdR_0 2024-09-12T18:13:49.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.320+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5171121837308243507', time=2024-09-12T19:48:04.814051+0000, chain.objs.size()=1 2024-09-12T18:13:49.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.320+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.zfkTdH9NqZ375274nvCgINeoe9UCRpw_0 2024-09-12T18:13:49.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.320+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10149098020736948840', time=2024-09-12T19:48:05.305976+0000, chain.objs.size()=1 2024-09-12T18:13:49.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.320+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.AGs7Wy71sufCAjVoJPB5xoo426HF2NE_0 2024-09-12T18:13:49.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.320+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10000044811801105184', time=2024-09-12T19:48:05.306830+0000, chain.objs.size()=1 2024-09-12T18:13:49.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.320+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.q_oXIRsVESv_EQgxLnpl_KBDRfQbLoG_0 2024-09-12T18:13:49.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.321+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10627603814003664144', time=2024-09-12T19:48:06.239267+0000, chain.objs.size()=1 2024-09-12T18:13:49.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.321+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.H3sp_-5s3BwiYPhwLgYfIV1JF9hcF7d_0 2024-09-12T18:13:49.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.321+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7856694710387803990', time=2024-09-12T19:48:06.297310+0000, chain.objs.size()=1 2024-09-12T18:13:49.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.321+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Zb2eXlOjWb9S2jCkkhDPuGx2DEe3qdj_0 2024-09-12T18:13:49.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.321+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.700887490397687831', time=2024-09-12T19:48:06.827937+0000, chain.objs.size()=1 2024-09-12T18:13:49.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.321+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.cbXlE-mV9EicQbWOCWGsuUrRhM3tw3a_0 2024-09-12T18:13:49.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.321+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4185530137914276024', time=2024-09-12T19:48:07.217562+0000, chain.objs.size()=1 2024-09-12T18:13:49.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.321+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.TfndYQO4S_Nxns4VKKd37cR9bKwTEIL_0 2024-09-12T18:13:49.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.321+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17667473055145376447', time=2024-09-12T19:48:07.421150+0000, chain.objs.size()=1 2024-09-12T18:13:49.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.321+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.1R_6xphMXPzOJNWBcPvbq1Fvs65XKVg_0 2024-09-12T18:13:49.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.321+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17102553830082583084', time=2024-09-12T19:48:07.974087+0000, chain.objs.size()=1 2024-09-12T18:13:49.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.321+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.UjWWGYPr6VYmZGJiTiAFTydqvMe9Kzy_0 2024-09-12T18:13:49.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.322+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3903641755134659822', time=2024-09-12T19:48:08.270777+0000, chain.objs.size()=1 2024-09-12T18:13:49.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.322+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.KH7yNcxaKXyrq2Ldq1JMi3CyOxeXgTm_0 2024-09-12T18:13:49.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.323+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13173288239128676942', time=2024-09-12T19:48:08.315248+0000, chain.objs.size()=1 2024-09-12T18:13:49.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.323+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.NANnviKOoab--xihXCi_2ZyUkYF62e5_0 2024-09-12T18:13:49.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.323+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3960877149814073123', time=2024-09-12T19:48:08.450749+0000, chain.objs.size()=1 2024-09-12T18:13:49.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.323+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.yW1oW_rBtszKnJcYebIGzXNEvhSgZ5J_0 2024-09-12T18:13:49.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.323+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9613831527028504038', time=2024-09-12T19:48:08.614556+0000, chain.objs.size()=1 2024-09-12T18:13:49.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.323+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Z5PiAnY-_j8ZE7NIDV0RMpnkkHROtR__0 2024-09-12T18:13:49.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.323+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6138731173220349668', time=2024-09-12T19:48:08.773835+0000, chain.objs.size()=1 2024-09-12T18:13:49.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.323+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.kDEOYiQbKOM73yVL373nsES2DyJVis2_0 2024-09-12T18:13:49.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.323+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.985911908891530212', time=2024-09-12T19:48:09.307005+0000, chain.objs.size()=1 2024-09-12T18:13:49.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.323+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.253BoeCTPZCKgS_eG840J5NY7CV3BwH_0 2024-09-12T18:13:49.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.323+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4249500104752219740', time=2024-09-12T19:48:09.955532+0000, chain.objs.size()=1 2024-09-12T18:13:49.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.323+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ASh0P-T23Hbf29-v6u-BPzIlHRlSiLJ_0 2024-09-12T18:13:49.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.323+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7305657278296616766', time=2024-09-12T19:48:10.068515+0000, chain.objs.size()=1 2024-09-12T18:13:49.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.323+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.yf0QmG_Apq8NJF74IMCJWtqVaaJBCzA_0 2024-09-12T18:13:49.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.323+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8646236843511971889', time=2024-09-12T19:48:10.083012+0000, chain.objs.size()=1 2024-09-12T18:13:49.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.323+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.BJlB1ip3tAlOAG720V4GFTv_6VLMOmA_0 2024-09-12T18:13:49.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.323+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2577648768917130873', time=2024-09-12T19:48:47.787430+0000, chain.objs.size()=1 2024-09-12T18:13:49.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.323+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.et4SSo31tXlYXCAEn_rZ4S5qJMiJNDj_0 2024-09-12T18:13:49.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.323+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11650765776125097882', time=2024-09-12T19:48:47.788201+0000, chain.objs.size()=1 2024-09-12T18:13:49.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.323+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.KRH3PO0clJctHOvSGBoGp2tc4AEqd-t_0 2024-09-12T18:13:49.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.323+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17111904085710524642', time=2024-09-12T19:48:49.396211+0000, chain.objs.size()=1 2024-09-12T18:13:49.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.323+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.EqEZQY2aMLY8zwd-7gdTHM3BWectTpu_0 2024-09-12T18:13:49.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.324+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12892781487273073215', time=2024-09-12T19:48:49.820109+0000, chain.objs.size()=1 2024-09-12T18:13:49.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.324+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.FP5DAyoYEYeLvoVU3hYmhFROY1LSLmI_0 2024-09-12T18:13:49.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.324+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9756577043945898231', time=2024-09-12T19:48:49.884734+0000, chain.objs.size()=1 2024-09-12T18:13:49.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.324+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.8Q7PHPjNHVc8g-9JmUbHCf-wXgiyrQq_0 2024-09-12T18:13:49.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.324+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15672193281775553540', time=2024-09-12T19:48:49.921037+0000, chain.objs.size()=1 2024-09-12T18:13:49.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.324+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.awPePsw0oRpGplNwv4Dy-_FXciMPMha_0 2024-09-12T18:13:49.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.325+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2509971844779512310', time=2024-09-12T19:48:50.506847+0000, chain.objs.size()=1 2024-09-12T18:13:49.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.325+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.MYV55W_YPYyBlKirWTNTbTlsOpxdW6D_0 2024-09-12T18:13:49.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.325+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7727003271047364822', time=2024-09-12T19:48:50.638045+0000, chain.objs.size()=1 2024-09-12T18:13:49.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.325+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.M1St9y0WGFunctD8tz2Ht4Odzou5776_0 2024-09-12T18:13:49.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.325+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.871433843801168846', time=2024-09-12T19:48:50.806502+0000, chain.objs.size()=1 2024-09-12T18:13:49.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.325+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.jNW0neyF65JPmvmT-8FAKBo4nfytQbK_0 2024-09-12T18:13:49.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.326+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4551485054472291140', time=2024-09-12T19:48:51.479404+0000, chain.objs.size()=1 2024-09-12T18:13:49.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.326+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_._f8ijTf08DGo_lD28IybFgOSi5mxwdr_0 2024-09-12T18:13:49.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.326+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11501444595640210721', time=2024-09-12T19:48:52.378804+0000, chain.objs.size()=1 2024-09-12T18:13:49.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.326+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.H1T8KoXxzc9VikG1lut-Lsvd5P2y0bK_0 2024-09-12T18:13:49.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.326+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14495268272854483528', time=2024-09-12T19:48:52.414201+0000, chain.objs.size()=1 2024-09-12T18:13:49.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.326+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.N8BlQIxysRxcwWFRiUtUhdG4IZ42oqI_0 2024-09-12T18:13:49.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.326+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.843698136708820608', time=2024-09-12T19:48:52.414966+0000, chain.objs.size()=1 2024-09-12T18:13:49.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.326+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_._eOxFX0gJCqOGPG7BV5C_-hfGvqqyj7_0 2024-09-12T18:13:49.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.326+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5623636868533295200', time=2024-09-12T19:48:52.442342+0000, chain.objs.size()=1 2024-09-12T18:13:49.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.326+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.pzcv0xM-7qeRjdkkRgn6uI16r3Nj2K__0 2024-09-12T18:13:49.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.327+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7451391499512141814', time=2024-09-12T19:48:52.547812+0000, chain.objs.size()=1 2024-09-12T18:13:49.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.327+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.7Edhb30RbMUkhyWP0JfQJWu9yGawUYM_0 2024-09-12T18:13:49.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.327+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13855447208422073179', time=2024-09-12T19:48:52.853969+0000, chain.objs.size()=1 2024-09-12T18:13:49.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.327+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.yovfTwVLXJSrEqs-cWkzkqN4MnKvEuH_0 2024-09-12T18:13:49.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.327+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8032571488483536434', time=2024-09-12T19:48:52.874076+0000, chain.objs.size()=1 2024-09-12T18:13:49.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.327+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Z2bHKDoWVyaIFfJUcqUtuVXrCNm3ObS_0 2024-09-12T18:13:49.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.327+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4324675471254535336', time=2024-09-12T19:48:52.907079+0000, chain.objs.size()=1 2024-09-12T18:13:49.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.327+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.kVZ0lU-SBRfw_jkXAJVgR-2p5gwCXvT_0 2024-09-12T18:13:49.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.327+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6911580650029794862', time=2024-09-12T19:48:53.432571+0000, chain.objs.size()=1 2024-09-12T18:13:49.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.327+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.8dJXXSXQ_kr4U8cGwaPky1KIqXsqBCs_0 2024-09-12T18:13:49.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.327+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.841231455410840417', time=2024-09-12T19:48:53.433421+0000, chain.objs.size()=1 2024-09-12T18:13:49.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.327+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.kptedY_xP5MRfVHtt3UdsXOwsZ1o-aU_0 2024-09-12T18:13:49.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.328+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3830461856790891733', time=2024-09-12T19:48:53.625821+0000, chain.objs.size()=1 2024-09-12T18:13:49.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.328+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.bEcn2RjOvNoe_OtjH0QLrDqU5NKZ7NA_0 2024-09-12T18:13:49.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.328+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16740590010904213763', time=2024-09-12T19:48:54.936232+0000, chain.objs.size()=1 2024-09-12T18:13:49.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.328+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.bDxhAo9vdup3s1HxrE090P7TQ-qVFAi_0 2024-09-12T18:13:49.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.328+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14703324114722627705', time=2024-09-12T19:48:55.530565+0000, chain.objs.size()=1 2024-09-12T18:13:49.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.328+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.fQNeDmtI8Ogvty7pbcmrup6LqiXDf25_0 2024-09-12T18:13:49.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.328+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15104579239999122825', time=2024-09-12T19:48:55.619139+0000, chain.objs.size()=1 2024-09-12T18:13:49.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.328+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.E8q9F-4Er5rTvDJ_Y7QJy-9gVoP_VFK_0 2024-09-12T18:13:49.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.330+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/47739 2024-09-12T18:13:49.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.332+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T18:13:49.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.332+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13207178834992225075', time=2024-09-12T19:48:56.302701+0000, chain.objs.size()=1 2024-09-12T18:13:49.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.332+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.S7y85DvM2dCVYWlO6hBaT9rDMAHQaQn_0 2024-09-12T18:13:49.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.332+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1081610174861749637', time=2024-09-12T19:48:56.376802+0000, chain.objs.size()=1 2024-09-12T18:13:49.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.332+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.HKnkczBe8yR8E-bUUKwko72SK7gpQ-I_0 2024-09-12T18:13:49.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.332+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13358255156859964513', time=2024-09-12T19:48:56.407749+0000, chain.objs.size()=1 2024-09-12T18:13:49.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.332+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.LogSe2ak23xcoLNwR85cs7-OY2hQxRP_0 2024-09-12T18:13:49.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.332+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16664300632836821293', time=2024-09-12T19:48:57.451839+0000, chain.objs.size()=1 2024-09-12T18:13:49.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.332+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Xk3aeIGNswZNYJIDEdFsGEMv6hZPFMg_0 2024-09-12T18:13:49.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.332+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6533778368611939440', time=2024-09-12T19:48:57.588034+0000, chain.objs.size()=1 2024-09-12T18:13:49.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.332+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.JTgJyzPnixdOSs_7NjUr8V_Zxe7VtUz_0 2024-09-12T18:13:49.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.332+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13255096089912971433', time=2024-09-12T19:48:57.863590+0000, chain.objs.size()=1 2024-09-12T18:13:49.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.332+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Y1CyJ0MBKcK01qr4z_4P66e0SLnBE82_0 2024-09-12T18:13:49.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.332+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11371265924954459942', time=2024-09-12T19:49:02.941148+0000, chain.objs.size()=1 2024-09-12T18:13:49.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.332+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.331__shadow_.gf_06vXSlFQUreZTDaYyjnQYlkWE1ZX_0 2024-09-12T18:13:49.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.332+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7003619143580309562', time=2024-09-12T19:49:15.312132+0000, chain.objs.size()=1 2024-09-12T18:13:49.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.332+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.345__shadow_.BCwsPBMwORMossMEgrHp3J6-pXS3eGV_0 2024-09-12T18:13:49.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.332+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6753757723558503656', time=2024-09-12T19:50:39.967897+0000, chain.objs.size()=1 2024-09-12T18:13:49.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.332+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.443__shadow_.OTR5BRPxLfG8VddUzWOc8IoyqFMfPIa_0 2024-09-12T18:13:49.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.332+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2207508444843481616', time=2024-09-12T19:50:56.439779+0000, chain.objs.size()=1 2024-09-12T18:13:49.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.332+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.458__shadow_.aLMixEwyjpRFDQ_f23nkNCu5wz8MOY3_0 2024-09-12T18:13:49.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.332+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4201793757998479771', time=2024-09-12T19:51:08.132750+0000, chain.objs.size()=1 2024-09-12T18:13:49.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.332+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.467__shadow_.wSFT1QxBEOD58vtt-RevF3nHoRKIiF3_0 2024-09-12T18:13:49.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.332+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15668039174079021874', time=2024-09-12T19:51:18.593860+0000, chain.objs.size()=1 2024-09-12T18:13:49.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.332+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.484__shadow_.qa12EtqswRHCcU0sSLJFiolOW4tGr26_0 2024-09-12T18:13:49.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.334+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4098112592888820172', time=2024-09-12T19:51:18.594698+0000, chain.objs.size()=1 2024-09-12T18:13:49.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.334+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.484__shadow_.NXZzvHYdCiAM8qMle2W6ooSGd6M2Rrd_0 2024-09-12T18:13:49.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.334+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5716741452176261273', time=2024-09-12T19:55:10.457572+0000, chain.objs.size()=6 2024-09-12T18:13:49.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.334+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.pf0PqHJCc2vgo2R6mv7ymMuBPOgv30xP.1 2024-09-12T18:13:49.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.334+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.o3TlKVat0Sjl_RXDjjqbN3dfoIKtuiBJ.2 2024-09-12T18:13:49.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.334+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.sOjx_NTCf4fMvh4OgXrMg0lgecM3qAhY.3 2024-09-12T18:13:49.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.334+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.ufIv5RMj5_9-LjhU7OfNhFpRXsriwP_I.4 2024-09-12T18:13:49.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.334+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.W9NNr1bOLkk4TGXTYEmsCsi2HjH1rlpo.5 2024-09-12T18:13:49.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.334+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.Jmk9XsdKGZ_Sh2oRTRqarcztxo_-OvAt.6 2024-09-12T18:13:49.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.334+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15072417712715410290', time=2024-09-12T19:55:40.130702+0000, chain.objs.size()=3 2024-09-12T18:13:49.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.334+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.526__multipart_mymultipart.2~T1ijtSwsPYejIg7hO0EfHMaNRf2X2Vz.1 2024-09-12T18:13:49.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.334+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.526__multipart_mymultipart.2~T1ijtSwsPYejIg7hO0EfHMaNRf2X2Vz.2 2024-09-12T18:13:49.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.334+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.526__multipart_mymultipart.2~T1ijtSwsPYejIg7hO0EfHMaNRf2X2Vz.3 2024-09-12T18:13:49.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.334+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~_bI_RETzaXeAfLfLbYx7PZEA2iTL_-n', time=2024-09-12T19:56:17.830512+0000, chain.objs.size()=1 2024-09-12T18:13:49.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.334+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.536__multipart_mymultipart.2~_bI_RETzaXeAfLfLbYx7PZEA2iTL_-n.3 2024-09-12T18:13:49.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.336+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13021897093694510898', time=2024-09-12T19:58:14.839225+0000, chain.objs.size()=1 2024-09-12T18:13:49.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.336+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.575__shadow:upf2TWmPb0T5WHsysKbEG7VHwEB2TNO_.8DMAcol64wvNVsGH6oZpBsXI_jWNxDV_0 2024-09-12T18:13:49.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.336+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8828181470038043685', time=2024-09-12T19:59:29.818937+0000, chain.objs.size()=1 2024-09-12T18:13:49.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.336+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.580__shadow:rG-3BipNDSI0bGbsoaZtoNEVRryt9kC_.qx4nugaUVXPbsL9BDjo0kxIqXWNnhZw_0 2024-09-12T18:13:49.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.336+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14214947183150560722', time=2024-09-12T19:59:54.700344+0000, chain.objs.size()=1 2024-09-12T18:13:49.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.336+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.605__shadow_.TkGmUtAdAMsiQF4PZ8vE5G0vHOim1xy_0 2024-09-12T18:13:49.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.337+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15988584416160398208', time=2024-09-12T20:01:53.414765+0000, chain.objs.size()=1 2024-09-12T18:13:49.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.337+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.617__shadow_.DGh3eNbLzNSmKmeQRBjT0KcB44HGbLS_0 2024-09-12T18:13:49.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.337+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8120706212760326584', time=2024-09-12T20:04:32.164795+0000, chain.objs.size()=12 2024-09-12T18:13:49.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.337+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.624__multipart_multipart_enc.2~chg1L4GJ6ivVGkqq85kHwjITtS6ElrO.1 2024-09-12T18:13:49.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.337+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.624__shadow_multipart_enc.2~chg1L4GJ6ivVGkqq85kHwjITtS6ElrO.1_1 2024-09-12T18:13:49.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.337+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.624__multipart_multipart_enc.2~chg1L4GJ6ivVGkqq85kHwjITtS6ElrO.2 2024-09-12T18:13:49.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.337+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.624__shadow_multipart_enc.2~chg1L4GJ6ivVGkqq85kHwjITtS6ElrO.2_1 2024-09-12T18:13:49.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.337+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.624__multipart_multipart_enc.2~chg1L4GJ6ivVGkqq85kHwjITtS6ElrO.3 2024-09-12T18:13:49.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.337+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.624__shadow_multipart_enc.2~chg1L4GJ6ivVGkqq85kHwjITtS6ElrO.3_1 2024-09-12T18:13:49.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.337+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.624__multipart_multipart_enc.2~chg1L4GJ6ivVGkqq85kHwjITtS6ElrO.4 2024-09-12T18:13:49.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.338+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.624__shadow_multipart_enc.2~chg1L4GJ6ivVGkqq85kHwjITtS6ElrO.4_1 2024-09-12T18:13:49.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.338+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.624__multipart_multipart_enc.2~chg1L4GJ6ivVGkqq85kHwjITtS6ElrO.5 2024-09-12T18:13:49.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.338+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.624__shadow_multipart_enc.2~chg1L4GJ6ivVGkqq85kHwjITtS6ElrO.5_1 2024-09-12T18:13:49.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.341+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.624__multipart_multipart_enc.2~chg1L4GJ6ivVGkqq85kHwjITtS6ElrO.6 2024-09-12T18:13:49.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.341+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.624__shadow_multipart_enc.2~chg1L4GJ6ivVGkqq85kHwjITtS6ElrO.6_1 2024-09-12T18:13:49.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.341+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15000039914380889931', time=2024-09-12T20:04:52.991382+0000, chain.objs.size()=1 2024-09-12T18:13:49.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.341+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.629__shadow_.FB5BR79R5pyJwMunrxLjzYtNQZP2-oK_0 2024-09-12T18:13:49.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.341+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6243072374741772882', time=2024-09-12T20:06:04.237272+0000, chain.objs.size()=1 2024-09-12T18:13:49.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.341+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.666__shadow_.mr_NbhdwdWHfaVSH5ll1n0Exg0fbryf_0 2024-09-12T18:13:49.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.341+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7238563510054544418', time=2024-09-12T20:06:30.236309+0000, chain.objs.size()=1 2024-09-12T18:13:49.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.341+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.700__shadow:gBv7-5eEUulysu6a61Mhu4tigXo-ZLs_.eNt1K5w9WhoZvFr_y_fQ9eoNkpt6Drp_0 2024-09-12T18:13:49.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.341+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10830972439777787605', time=2024-09-12T20:07:36.751425+0000, chain.objs.size()=1 2024-09-12T18:13:49.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.341+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.742__shadow_.EwC9qt2HkteCab2UvG7H-aYJ5AtKLUt_0 2024-09-12T18:13:49.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.343+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:49.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.345+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:13:49.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.346+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:49.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.346+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:49.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.347+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49596' 2024-09-12T18:13:49.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.347+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='_4lp_MGcdX-7enNAXglBpA6UCndxJqDD', time=2024-09-12T19:42:10.729663+0000, chain.objs.size()=3 2024-09-12T18:13:49.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.347+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__shadow_.9FcZTe0Ids9oqlvuZwJ9DtXPKe2NBuq_0 2024-09-12T18:13:49.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.347+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__shadow_.9FcZTe0Ids9oqlvuZwJ9DtXPKe2NBuq_1 2024-09-12T18:13:49.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.347+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.162__shadow_.9FcZTe0Ids9oqlvuZwJ9DtXPKe2NBuq_2 2024-09-12T18:13:49.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.347+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='_JuD9e0-4EsfskroYcoC301E7JCrUyRx', time=2024-09-12T19:42:17.214658+0000, chain.objs.size()=1 2024-09-12T18:13:49.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.347+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:06eb12d0-49d6-461d-9efe-05d212954deb.4538.164__shadow_.RtMB79XuGbCXGkB57VpBHO4DOBb3rbP_0 2024-09-12T18:13:49.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.347+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15234688481995211308', time=2024-09-12T19:45:16.338890+0000, chain.objs.size()=1 2024-09-12T18:13:49.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.347+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.245__shadow_.4qgDC8CDdmoTzCrUNFbxTgmWGVVW3II_0 2024-09-12T18:13:49.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.347+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7380432939129583672', time=2024-09-12T19:45:17.240490+0000, chain.objs.size()=1 2024-09-12T18:13:49.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.347+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.246__shadow_.3yvymk3_o_bn__hHRxd8pz1jJQIj3Xr_0 2024-09-12T18:13:49.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.347+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17218603135354470460', time=2024-09-12T19:46:09.131787+0000, chain.objs.size()=1 2024-09-12T18:13:49.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.347+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.HEKCjzsLS5U3tGXSn-NLX76frWgi80U_0 2024-09-12T18:13:49.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.347+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6899488996255906735', time=2024-09-12T19:46:09.160543+0000, chain.objs.size()=1 2024-09-12T18:13:49.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.347+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ywcoapXyKutidoUTAngMoKmrBz-xYxz_0 2024-09-12T18:13:49.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.347+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16584369922936114009', time=2024-09-12T19:46:10.388220+0000, chain.objs.size()=1 2024-09-12T18:13:49.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.347+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.3UfKlhvBUtgk02E88UJHRWPxxPi8SCM_0 2024-09-12T18:13:49.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.347+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6526186527157540531', time=2024-09-12T19:46:10.572066+0000, chain.objs.size()=1 2024-09-12T18:13:49.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.347+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.eKKQ5HogiO6fZiNsLZBsy5BZEN44qgs_0 2024-09-12T18:13:49.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.347+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12314379586492864669', time=2024-09-12T19:46:11.098477+0000, chain.objs.size()=1 2024-09-12T18:13:49.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.347+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.bHam-YxFvhLi-SZZ2Mby4g_Fc5ZF0LY_0 2024-09-12T18:13:49.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.347+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6480040951520635003', time=2024-09-12T19:46:11.164524+0000, chain.objs.size()=1 2024-09-12T18:13:49.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.347+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.s87hSwwFKXSfLKXFGXUvOjGLIrpa3KO_0 2024-09-12T18:13:49.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.350+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2100741635117742289', time=2024-09-12T19:46:11.379418+0000, chain.objs.size()=1 2024-09-12T18:13:49.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.350+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.dmgYED4dPkL31iQQYz3yyqG24oKGeqM_0 2024-09-12T18:13:49.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.350+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12293954101940509826', time=2024-09-12T19:46:11.395500+0000, chain.objs.size()=1 2024-09-12T18:13:49.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.350+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.CC2r19KX7wTRQo1s5Nl__uvWAM6Bb9s_0 2024-09-12T18:13:49.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.351+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13226928741672037942', time=2024-09-12T19:46:11.860408+0000, chain.objs.size()=1 2024-09-12T18:13:49.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.351+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.wU98_gnYV5934qBgt0CLFOMH3ssRAt6_0 2024-09-12T18:13:49.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.351+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2598545198171361775', time=2024-09-12T19:46:12.016096+0000, chain.objs.size()=1 2024-09-12T18:13:49.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.351+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.sOCFtAlhEcTyYiJaKpT_7tVHw6ggA9m_0 2024-09-12T18:13:49.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.351+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8887863355216178071', time=2024-09-12T19:46:12.054966+0000, chain.objs.size()=1 2024-09-12T18:13:49.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.351+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.KBYsKxodfGuQht5VpUCT2rRKGxPjI23_0 2024-09-12T18:13:49.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.351+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4975043230389851617', time=2024-09-12T19:46:13.491472+0000, chain.objs.size()=1 2024-09-12T18:13:49.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.351+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.a8ZuCvRRJdTzm7XxuJmHVZiqnaeOTUV_0 2024-09-12T18:13:49.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.351+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18072682424546243429', time=2024-09-12T19:46:13.733512+0000, chain.objs.size()=1 2024-09-12T18:13:49.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.351+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.9xrwoXQAOMlO0TucyfQzhT2y8PEoPAr_0 2024-09-12T18:13:49.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.351+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5732203234246255750', time=2024-09-12T19:46:14.106335+0000, chain.objs.size()=1 2024-09-12T18:13:49.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.351+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.hykRCPvmZNdDqLrZ3qCSk4Ytjk6K_I8_0 2024-09-12T18:13:49.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.351+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10532231349622187061', time=2024-09-12T19:46:14.334750+0000, chain.objs.size()=1 2024-09-12T18:13:49.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.351+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.LzpLWVkgHdnjchsLOu6CAVVigOYKMBC_0 2024-09-12T18:13:49.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.351+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11893071649597644226', time=2024-09-12T19:46:14.908631+0000, chain.objs.size()=1 2024-09-12T18:13:49.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.351+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.sWJAHuXF98hnbWRCaEYA_7Ff-aaQCdm_0 2024-09-12T18:13:49.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.351+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1293884042629925378', time=2024-09-12T19:46:15.458098+0000, chain.objs.size()=1 2024-09-12T18:13:49.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.351+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.QscktD5DSJ6hVdapEPs5_Ac9wsv3CGR_0 2024-09-12T18:13:49.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.351+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1144814564230649794', time=2024-09-12T19:46:16.179945+0000, chain.objs.size()=1 2024-09-12T18:13:49.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.351+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.GaSNZu3hT8naMcI74E-uo1YxYDa9eQM_0 2024-09-12T18:13:49.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.352+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13933575031562373443', time=2024-09-12T19:46:16.249320+0000, chain.objs.size()=1 2024-09-12T18:13:49.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.352+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.KhVkg1c7H7djczhqVbAjXbl6svKMeWO_0 2024-09-12T18:13:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.353+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14280351667406172944', time=2024-09-12T19:46:17.622690+0000, chain.objs.size()=1 2024-09-12T18:13:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.353+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.jxl8a4UxiAhNsHaxuMfHP6lDY__Mdsw_0 2024-09-12T18:13:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.353+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7800775153661041409', time=2024-09-12T19:46:17.688206+0000, chain.objs.size()=1 2024-09-12T18:13:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.353+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.G5vWWiMib237nwlOVVRCn3eJrbhXv9l_0 2024-09-12T18:13:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.353+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13642126324660452804', time=2024-09-12T19:46:17.782427+0000, chain.objs.size()=1 2024-09-12T18:13:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.353+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.JGn0nFX_Nw_Q0nGIP3Arna1WUaTqvPH_0 2024-09-12T18:13:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.353+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16209209861650784257', time=2024-09-12T19:46:18.010728+0000, chain.objs.size()=1 2024-09-12T18:13:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.353+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.o-m13Kd4SJbMqkxIUY3J78JWsb2IBCG_0 2024-09-12T18:13:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.353+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9794027070270501470', time=2024-09-12T19:46:18.055421+0000, chain.objs.size()=1 2024-09-12T18:13:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.353+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.KxBb6BJAEPJELquFcatiT3fKnhPYE_L_0 2024-09-12T18:13:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.353+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18152725369263142658', time=2024-09-12T19:46:18.081919+0000, chain.objs.size()=1 2024-09-12T18:13:49.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.353+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.MFh67_qADT304EekxaRGNWPD-fTXzid_0 2024-09-12T18:13:49.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.353+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8833823838498614247', time=2024-09-12T19:46:18.409105+0000, chain.objs.size()=1 2024-09-12T18:13:49.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.353+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.FqbTPr4pndanmR7QHlVzJ2qyYyGEAhI_0 2024-09-12T18:13:49.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.353+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16574537358033899116', time=2024-09-12T19:46:18.432830+0000, chain.objs.size()=1 2024-09-12T18:13:49.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.353+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.PmgHe2yDs9RnNNwswG-5cT7C9HFxo7h_0 2024-09-12T18:13:49.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.354+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17046035264611930242', time=2024-09-12T19:46:18.471539+0000, chain.objs.size()=1 2024-09-12T18:13:49.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.354+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.PeVIXLPmblHNnNx-OoZB8uuDI7B4B27_0 2024-09-12T18:13:49.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.354+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9713507668218080137', time=2024-09-12T19:46:18.486220+0000, chain.objs.size()=1 2024-09-12T18:13:49.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.354+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.kDMa_bOcgQfJIL5dhRJn0EyqpUan3ae_0 2024-09-12T18:13:49.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.354+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17056129949124437409', time=2024-09-12T19:46:19.001613+0000, chain.objs.size()=1 2024-09-12T18:13:49.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.354+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.nzbzJIBvSpHdW8o8NgcOIqaj7QVFveN_0 2024-09-12T18:13:49.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.354+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8415921644047012706', time=2024-09-12T19:46:19.002273+0000, chain.objs.size()=1 2024-09-12T18:13:49.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.354+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.TojfIKF2Cbl7X9SoRUUv82Jslm7vImQ_0 2024-09-12T18:13:49.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.354+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10731707768265041730', time=2024-09-12T19:46:19.266538+0000, chain.objs.size()=1 2024-09-12T18:13:49.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.354+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.rQAl7SNJtwXyjD6MMz5Wz2qo8675Yk4_0 2024-09-12T18:13:49.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.354+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4671076614496627335', time=2024-09-12T19:46:19.559768+0000, chain.objs.size()=1 2024-09-12T18:13:49.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.354+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.TJoPk_7dxm0bCXiqCVMZqg6srlsRpxQ_0 2024-09-12T18:13:49.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.355+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4092723440501680552', time=2024-09-12T19:46:28.328294+0000, chain.objs.size()=1 2024-09-12T18:13:49.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.355+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.273__shadow_.ZHbMTiI1aVhEF610rc3_lLwoaQPSc4R_0 2024-09-12T18:13:49.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.355+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5076508237309393905', time=2024-09-12T19:46:42.996947+0000, chain.objs.size()=1 2024-09-12T18:13:49.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.355+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.289__shadow_.PhirJsJMPPj4jTvxa8KOTrq44ZThW___0 2024-09-12T18:13:49.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.355+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13584203794261059481', time=2024-09-12T19:46:48.124621+0000, chain.objs.size()=1 2024-09-12T18:13:49.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.355+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.293__shadow_.bEKZD3mV3In-5zTsKHdgy8TI9Bb9tV0_0 2024-09-12T18:13:49.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.355+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15587409723365869750', time=2024-09-12T19:46:50.321085+0000, chain.objs.size()=1 2024-09-12T18:13:49.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.355+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.294__shadow_.qlkf1pgv4goG7imkDkQcp2tJuzYwpyR_0 2024-09-12T18:13:49.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.355+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7971460091711272679', time=2024-09-12T19:46:56.997104+0000, chain.objs.size()=1 2024-09-12T18:13:49.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.355+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.301__shadow_.Aq9FyQirl4XQUTIZh9VbIUUocLTbP6B_0 2024-09-12T18:13:49.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.356+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17616024267941976712', time=2024-09-12T19:47:59.454201+0000, chain.objs.size()=1 2024-09-12T18:13:49.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.356+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.OVTcC2E2xoV1-EovuWbE7TRAoavM1fM_0 2024-09-12T18:13:49.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.356+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2944621315072358158', time=2024-09-12T19:47:59.492730+0000, chain.objs.size()=1 2024-09-12T18:13:49.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.356+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.5g4oKOxwJGHSwEBaN6q9T0TGNd9ItXb_0 2024-09-12T18:13:49.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.356+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4796723009098540895', time=2024-09-12T19:47:59.961446+0000, chain.objs.size()=1 2024-09-12T18:13:49.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.356+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.VH3ZaJTRzkI94vr07vJk70_Lri8G-Sm_0 2024-09-12T18:13:49.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.357+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15423647240141301412', time=2024-09-12T19:47:59.990940+0000, chain.objs.size()=1 2024-09-12T18:13:49.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.357+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Jzrkdwh_mfSNCz08r9cgGnmAChfGQC3_0 2024-09-12T18:13:49.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.357+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9360460157103580599', time=2024-09-12T19:48:01.151748+0000, chain.objs.size()=1 2024-09-12T18:13:49.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.357+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.W0VA8a39t5JjRTpoRJ8zL8UAWUnEiY6_0 2024-09-12T18:13:49.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.357+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11547670187143995029', time=2024-09-12T19:48:01.734409+0000, chain.objs.size()=1 2024-09-12T18:13:49.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.357+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.WIVyxtEzQuTwW96I-LuHDw6qTRCHYFi_0 2024-09-12T18:13:49.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.357+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.569933995105959681', time=2024-09-12T19:48:01.911547+0000, chain.objs.size()=1 2024-09-12T18:13:49.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.357+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.7GezDdr9XA2k4AZCH9FyIAXwd7Pn8Xw_0 2024-09-12T18:13:49.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.357+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5629330179999611828', time=2024-09-12T19:48:01.988685+0000, chain.objs.size()=1 2024-09-12T18:13:49.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.357+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.z9xE9CvJq2kO192faD42pmko6M9bl1B_0 2024-09-12T18:13:49.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.357+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18096834694269972474', time=2024-09-12T19:48:02.507984+0000, chain.objs.size()=1 2024-09-12T18:13:49.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.357+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.oUn0PGob5O9xhf9ipLHY12KTVS0B1U7_0 2024-09-12T18:13:49.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.357+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10303026182403931731', time=2024-09-12T19:48:02.508497+0000, chain.objs.size()=1 2024-09-12T18:13:49.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.357+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.yE0lILQ2Qb_rpFmmr8oHyqOsTvuwB7D_0 2024-09-12T18:13:49.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.358+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15814534016332544957', time=2024-09-12T19:48:02.647560+0000, chain.objs.size()=1 2024-09-12T18:13:49.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.358+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.dWOFKK-o2c2U-blKJoVDO9mhbAzjsOv_0 2024-09-12T18:13:49.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.358+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7530755539878280564', time=2024-09-12T19:48:02.791165+0000, chain.objs.size()=1 2024-09-12T18:13:49.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.358+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.YiJ7k4dYXTTZ80E18_OHC8gB8xYTqim_0 2024-09-12T18:13:49.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.358+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14437334910462788467', time=2024-09-12T19:48:03.425977+0000, chain.objs.size()=1 2024-09-12T18:13:49.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.358+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.6qeE0b4UbbjeNN_wEhAAcyncSS_lTWm_0 2024-09-12T18:13:49.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.358+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8001039702822697043', time=2024-09-12T19:48:04.037905+0000, chain.objs.size()=1 2024-09-12T18:13:49.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.358+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.M_RbVrncfpo09ktGGzXH0brpBPZiDrn_0 2024-09-12T18:13:49.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.359+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5936214054998396108', time=2024-09-12T19:48:04.452359+0000, chain.objs.size()=1 2024-09-12T18:13:49.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.359+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.GmNTDCARfDXL2sRvOmK4ntf7lWVfmI5_0 2024-09-12T18:13:49.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.359+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17199949613555999437', time=2024-09-12T19:48:04.861829+0000, chain.objs.size()=1 2024-09-12T18:13:49.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.359+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.38bGtllfdFgw432bvH6SF-9aeFVU0I4_0 2024-09-12T18:13:49.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.359+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9276339364578752993', time=2024-09-12T19:48:05.574470+0000, chain.objs.size()=1 2024-09-12T18:13:49.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.359+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.d47E-VCKZqqmSUux7-wUK6wT3tCsZbd_0 2024-09-12T18:13:49.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.359+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15641922933585889473', time=2024-09-12T19:48:05.923342+0000, chain.objs.size()=1 2024-09-12T18:13:49.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.359+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.whcp0G7JO88F2_Dqfi6aPUdamqNqTXU_0 2024-09-12T18:13:49.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.359+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12653698784345633525', time=2024-09-12T19:48:06.215794+0000, chain.objs.size()=1 2024-09-12T18:13:49.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.359+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.lDXV6-dhy8g4wWek87rxV5KzHYBR6wb_0 2024-09-12T18:13:49.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.359+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8854504222764755184', time=2024-09-12T19:48:06.304355+0000, chain.objs.size()=1 2024-09-12T18:13:49.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.359+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.32zy4Wnzyxax4PrgeNQ_IdMLtaGu2pX_0 2024-09-12T18:13:49.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.359+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17112059068670717199', time=2024-09-12T19:48:06.844177+0000, chain.objs.size()=1 2024-09-12T18:13:49.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.359+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.i52eMv2aFkqlQbnus0lZBjxuOYfj9jt_0 2024-09-12T18:13:49.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.360+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.819284758847495846', time=2024-09-12T19:48:06.958179+0000, chain.objs.size()=1 2024-09-12T18:13:49.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.360+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Dsr1f-5vI7ukxzIvzUdAVam0f3EJ98x_0 2024-09-12T18:13:49.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.360+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18347968991497866835', time=2024-09-12T19:48:07.494639+0000, chain.objs.size()=1 2024-09-12T18:13:49.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.360+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.qH54iFXFpQGUmXkV7QLx8n1IKYnjqiQ_0 2024-09-12T18:13:49.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.360+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.356527387421273259', time=2024-09-12T19:48:07.548617+0000, chain.objs.size()=1 2024-09-12T18:13:49.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.360+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.vYI_lBdZC4tVWeqMsb17LjW_-AHiSEO_0 2024-09-12T18:13:49.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.360+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6420843499494721969', time=2024-09-12T19:48:08.138250+0000, chain.objs.size()=1 2024-09-12T18:13:49.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.360+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.MoE9MA7TTEGONEDSW87C3WjDoSHesXu_0 2024-09-12T18:13:49.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.360+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8434621227582700126', time=2024-09-12T19:48:08.255342+0000, chain.objs.size()=1 2024-09-12T18:13:49.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.360+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.g5r7yHxx8zxOXwBudPCoRxFWv31YJm2_0 2024-09-12T18:13:49.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.361+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.864570329272938952', time=2024-09-12T19:48:08.749995+0000, chain.objs.size()=1 2024-09-12T18:13:49.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.361+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.VujIoWQ9vR5zw-pAvq7pzL6fJaiwu3z_0 2024-09-12T18:13:49.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.361+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16506954243158585758', time=2024-09-12T19:48:08.987589+0000, chain.objs.size()=1 2024-09-12T18:13:49.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.361+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.VKI9vMZaYPi5bkXJzS-cXxwFenbQWn2_0 2024-09-12T18:13:49.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.361+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8179583444551157817', time=2024-09-12T19:48:09.442827+0000, chain.objs.size()=1 2024-09-12T18:13:49.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.361+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.NrTo9AZW4B7gULo7K5h8kVbfFFNRuH8_0 2024-09-12T18:13:49.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.361+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8563393959786777311', time=2024-09-12T19:48:09.721528+0000, chain.objs.size()=1 2024-09-12T18:13:49.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.361+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.W43Kjmp6V6rTA0yxijbP_3OjQnadEHE_0 2024-09-12T18:13:49.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.362+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10409506612206744437', time=2024-09-12T19:48:09.809138+0000, chain.objs.size()=1 2024-09-12T18:13:49.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.362+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.2ZhM58UIT1slURRb04LnUgVpAezIy2r_0 2024-09-12T18:13:49.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.362+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13280514573148883274', time=2024-09-12T19:48:47.631141+0000, chain.objs.size()=1 2024-09-12T18:13:49.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.362+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ByJEMAC_WvelN4D-fvVrcqZcIQI1nH2_0 2024-09-12T18:13:49.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.362+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15604983243563954866', time=2024-09-12T19:48:47.631846+0000, chain.objs.size()=1 2024-09-12T18:13:49.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.362+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.qZ9Xu3Lqg-rxQAIPq-q6QI7eU7t1whA_0 2024-09-12T18:13:49.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.362+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15274609720843767374', time=2024-09-12T19:48:47.654367+0000, chain.objs.size()=1 2024-09-12T18:13:49.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.362+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.yuWFQQxonVw6v8wktltUzboatwTfKAB_0 2024-09-12T18:13:49.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.362+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6873475930274538266', time=2024-09-12T19:48:47.858318+0000, chain.objs.size()=1 2024-09-12T18:13:49.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.362+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.x7EHuCaQWtJ2pg6DM4sNUMP3JoXvGX9_0 2024-09-12T18:13:49.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.362+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12768929937042386996', time=2024-09-12T19:48:48.083114+0000, chain.objs.size()=1 2024-09-12T18:13:49.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.362+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.zUvFVs9VaQsbdY0W1eHZmkFbIGCB7y7_0 2024-09-12T18:13:49.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.362+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6299660770484655925', time=2024-09-12T19:48:48.281691+0000, chain.objs.size()=1 2024-09-12T18:13:49.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.362+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.4zp0pelF3mA3_dr73rmsX-RPYaR4ow6_0 2024-09-12T18:13:49.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.363+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1584904772019016775', time=2024-09-12T19:48:48.977206+0000, chain.objs.size()=1 2024-09-12T18:13:49.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.363+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.QtY2vuKWWQQ6e0uej4b4YfTvMnrL6HM_0 2024-09-12T18:13:49.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.364+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2585471142397675685', time=2024-09-12T19:48:49.105275+0000, chain.objs.size()=1 2024-09-12T18:13:49.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.364+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.HnrLhLPwyrcCYvz3MTB3FT8ZEfOeLPw_0 2024-09-12T18:13:49.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.364+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2468831648166258519', time=2024-09-12T19:48:49.134103+0000, chain.objs.size()=1 2024-09-12T18:13:49.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.364+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.HPjXsazp7OPPFozjbraXAiPJ967YDNg_0 2024-09-12T18:13:49.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.364+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14352244600940880898', time=2024-09-12T19:48:49.491893+0000, chain.objs.size()=1 2024-09-12T18:13:49.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.364+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.zArAZQdneJ3HA0eJXnpGP44KD_Zi8H4_0 2024-09-12T18:13:49.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.364+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8723960073271892435', time=2024-09-12T19:48:49.630852+0000, chain.objs.size()=1 2024-09-12T18:13:49.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.364+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.QqKkZBkRfyqPAMEn2z0SYKzm0E9jLj__0 2024-09-12T18:13:49.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.364+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13926666449589620085', time=2024-09-12T19:48:50.682516+0000, chain.objs.size()=1 2024-09-12T18:13:49.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.364+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.DI5yN_0o7VwsHZRmS2qUsKUWVyu6HkB_0 2024-09-12T18:13:49.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.364+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5450515155276409023', time=2024-09-12T19:48:50.729430+0000, chain.objs.size()=1 2024-09-12T18:13:49.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.364+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.qsqKzEPwkWXn4lsjQy-ujwyojTDaCkE_0 2024-09-12T18:13:49.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.364+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9777392110850466322', time=2024-09-12T19:48:51.275325+0000, chain.objs.size()=1 2024-09-12T18:13:49.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.364+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.P2wDApF5wo5dtqW3-zr27u7Jp5VNGR1_0 2024-09-12T18:13:49.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.364+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15014658510462969882', time=2024-09-12T19:48:51.915122+0000, chain.objs.size()=1 2024-09-12T18:13:49.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.364+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.2zJRgWjEkgMjaWBTaSHaXn1jNyz4wdq_0 2024-09-12T18:13:49.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.364+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12364330902302816203', time=2024-09-12T19:48:51.915744+0000, chain.objs.size()=1 2024-09-12T18:13:49.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.365+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.7SfO4-fnF9rjH-YIN2TgGl9tOusb8MF_0 2024-09-12T18:13:49.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.365+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7641937329213097444', time=2024-09-12T19:48:52.546382+0000, chain.objs.size()=1 2024-09-12T18:13:49.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.365+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.pN2uduqX0kUu3zrwA4nMaQ8D1EFGB3d_0 2024-09-12T18:13:49.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.365+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1969301743858361939', time=2024-09-12T19:48:52.846109+0000, chain.objs.size()=1 2024-09-12T18:13:49.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.365+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.4sEWkMmXWPm8DJR0q2ABm7kULD56ndF_0 2024-09-12T18:13:49.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.366+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12632053571075901524', time=2024-09-12T19:48:53.278355+0000, chain.objs.size()=1 2024-09-12T18:13:49.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.366+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.54lsAolejqiiFmHvaCtmafXdI_Ew_ur_0 2024-09-12T18:13:49.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.366+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8370285713217629944', time=2024-09-12T19:48:53.279080+0000, chain.objs.size()=1 2024-09-12T18:13:49.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.366+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.k0FgMLBZ4DVJUqAT47BOqXp2ApulrB7_0 2024-09-12T18:13:49.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.366+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12192015349978517573', time=2024-09-12T19:48:53.431353+0000, chain.objs.size()=1 2024-09-12T18:13:49.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.366+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.uuy-xn_fKmsYw1Tt5MykivdU2psLt0I_0 2024-09-12T18:13:49.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.366+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9715852034332742001', time=2024-09-12T19:48:54.039829+0000, chain.objs.size()=1 2024-09-12T18:13:49.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.366+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.UQs7sPViyEABqtyK2wHl1Z5CpyEJYMY_0 2024-09-12T18:13:49.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.366+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11513835999674845847', time=2024-09-12T19:48:54.735124+0000, chain.objs.size()=1 2024-09-12T18:13:49.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.366+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.aldKk6ZPq10Hm4FBYaVDzAmD2FovY-h_0 2024-09-12T18:13:49.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.366+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12979746257598002647', time=2024-09-12T19:48:54.746688+0000, chain.objs.size()=1 2024-09-12T18:13:49.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.366+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.jSy_D2dCxodmukgq1ItZwwYRmvVNcHj_0 2024-09-12T18:13:49.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.368+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4434861425974220738', time=2024-09-12T19:48:54.761644+0000, chain.objs.size()=1 2024-09-12T18:13:49.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.368+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.WOPpsF4aad64g8zvI9_qWWMtewbyJ0C_0 2024-09-12T18:13:49.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.368+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2874659774725181550', time=2024-09-12T19:48:54.985891+0000, chain.objs.size()=1 2024-09-12T18:13:49.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.368+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.VQXC1i56pQbMZ44qOamrpSi_koA_u4l_0 2024-09-12T18:13:49.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.368+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5239106697978335905', time=2024-09-12T19:48:55.319345+0000, chain.objs.size()=1 2024-09-12T18:13:49.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.368+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.iacnuOZnBO_13Df4Ztp8YYHbtW3tpce_0 2024-09-12T18:13:49.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.369+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/49596 2024-09-12T18:13:49.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.371+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T18:13:49.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.371+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6262116771687713053', time=2024-09-12T19:48:55.320038+0000, chain.objs.size()=1 2024-09-12T18:13:49.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.371+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.xkOL4KA_3Oe1Jlkit1QhDlOn7gQv0Kb_0 2024-09-12T18:13:49.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.371+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15529433153265077135', time=2024-09-12T19:48:55.439022+0000, chain.objs.size()=1 2024-09-12T18:13:49.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.371+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.rk3qVG7UBN3QU6YX8ok-wWYOhjmFtom_0 2024-09-12T18:13:49.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.371+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.340608056757228537', time=2024-09-12T19:48:56.512137+0000, chain.objs.size()=1 2024-09-12T18:13:49.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.371+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.l0zXOQcl75n5eIqYYgFZ5bZVzhAb9U3_0 2024-09-12T18:13:49.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.371+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15510548270505285351', time=2024-09-12T19:48:56.773408+0000, chain.objs.size()=1 2024-09-12T18:13:49.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.371+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.0V2SedGtpk78c2qXO2SMBS16QG1q2B__0 2024-09-12T18:13:49.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.371+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5416625652490574661', time=2024-09-12T19:48:56.949703+0000, chain.objs.size()=1 2024-09-12T18:13:49.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.371+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.5PARYovk9yH9rn0GgcQrmMfQQmR7F64_0 2024-09-12T18:13:49.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.371+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12888699494789270548', time=2024-09-12T19:48:57.238252+0000, chain.objs.size()=1 2024-09-12T18:13:49.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.371+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.BuZ1d3LkU6it6aSp1vM9GfpY3SygYh0_0 2024-09-12T18:13:49.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.371+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4481201964587269130', time=2024-09-12T19:49:58.768615+0000, chain.objs.size()=1 2024-09-12T18:13:49.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.371+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.395__shadow:1oeHW.pHbXubTjJeeeVyovlgZ7OXsCd_.1AUNY6JWRMOW6_IifhMI9v4sFtgbQq4_0 2024-09-12T18:13:49.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.371+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4587624128407791040', time=2024-09-12T19:51:01.801745+0000, chain.objs.size()=1 2024-09-12T18:13:49.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.371+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.462__shadow_.KljQWaiO3RplcTUy7BByA4Gax-KgWi1_0 2024-09-12T18:13:49.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.371+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14088545609276797029', time=2024-09-12T19:51:19.623260+0000, chain.objs.size()=1 2024-09-12T18:13:49.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.371+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.485__shadow_.MHPFFRmk6Z4ZSJCfIGsQ2mRV-_BUcZ4_0 2024-09-12T18:13:49.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.372+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15622240325275272720', time=2024-09-12T19:53:22.127527+0000, chain.objs.size()=1 2024-09-12T18:13:49.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.372+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.521__shadow:zxh--Nvp2x2eLLybfff-x0sOM267.zf_.hQJhwz9-dTY42MLBTQJIAfDJhnV8-cx_0 2024-09-12T18:13:49.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.372+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15818320510606497565', time=2024-09-12T19:57:03.895746+0000, chain.objs.size()=1 2024-09-12T18:13:49.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.372+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.552__shadow_.5sXq4dM3g26GZxe_SJtmSD5oeL4v4ut_0 2024-09-12T18:13:49.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.372+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1028479409468447688', time=2024-09-12T19:57:53.993410+0000, chain.objs.size()=1 2024-09-12T18:13:49.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.372+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.567__shadow_.LhS6f1NnvOhc7jmF0ytMuk6whHXy986_0 2024-09-12T18:13:49.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.374+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4039588547612507937', time=2024-09-12T19:57:58.433705+0000, chain.objs.size()=1 2024-09-12T18:13:49.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.374+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:2xd1UnzrlHWFo.5j82-H7Zj1vbYF977_.TXZGi3n4ZWET9Ht5-FgTxmmqZHDwiWW_0 2024-09-12T18:13:49.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.374+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3545280909136530635', time=2024-09-12T19:58:07.427115+0000, chain.objs.size()=1 2024-09-12T18:13:49.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.374+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:4d6DnnfIDRhcW5bs9VJb2dTy0fsDWOq_.fRpgkSH7dQI9qPwNX-jlWBpfq7UFVEJ_0 2024-09-12T18:13:49.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.374+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14000486449098446590', time=2024-09-12T19:58:28.504312+0000, chain.objs.size()=1 2024-09-12T18:13:49.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.374+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:NhkkUGc44hZVL8P1FthTd.Z-AQ8iE1-_.K-NBELY69WE4yvj5QzH8RlBXp5lGB_m_0 2024-09-12T18:13:49.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.374+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14697960738783425444', time=2024-09-12T19:58:35.950903+0000, chain.objs.size()=1 2024-09-12T18:13:49.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.374+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:nJ50H2fUFUoawG1nFwIGhfWNHZJI7Xb_.wgdfZjsHJ7-8m1Ga1V-ps7n0qfnuMyV_0 2024-09-12T18:13:49.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.374+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9537382310502394778', time=2024-09-12T20:03:58.202508+0000, chain.objs.size()=1 2024-09-12T18:13:49.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.374+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.621__shadow_.E8ot0v26sffhyYh5gR8lXE9xVKjYEKc_0 2024-09-12T18:13:49.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.374+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15072670142803675434', time=2024-09-12T20:04:51.262818+0000, chain.objs.size()=1 2024-09-12T18:13:49.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.374+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.627__shadow_.gQ3MN3aWm94C3CUG-A1LiX1JuUc3FaI_0 2024-09-12T18:13:49.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.374+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13172495764216459558', time=2024-09-12T20:05:00.693264+0000, chain.objs.size()=1 2024-09-12T18:13:49.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.374+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.637__shadow_.C2NIbbazWQGym69vgS42KgREe9rCC33_0 2024-09-12T18:13:49.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.374+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17114833890513714260', time=2024-09-12T20:05:08.935566+0000, chain.objs.size()=2 2024-09-12T18:13:49.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.374+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.644__shadow_.3Mf6DUrY8vfGvRxOUMnce5Q2x_yXrH6_0 2024-09-12T18:13:49.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.374+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.644__shadow_.3Mf6DUrY8vfGvRxOUMnce5Q2x_yXrH6_1 2024-09-12T18:13:49.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.376+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:49.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.378+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:13:49.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.380+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:49.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.380+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:49.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.382+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/55417' 2024-09-12T18:13:49.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.382+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='_NEDgAqU4W4FTIi4_GhZ9j8rgbt6LgN9', time=2024-09-12T19:41:49.322671+0000, chain.objs.size()=3 2024-09-12T18:13:49.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.382+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.161__shadow_.hg7HuBieTRbnlSE5CVM2ZNiGwj6OvnE_0 2024-09-12T18:13:49.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.382+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.161__shadow_.hg7HuBieTRbnlSE5CVM2ZNiGwj6OvnE_1 2024-09-12T18:13:49.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.382+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:06eb12d0-49d6-461d-9efe-05d212954deb.4538.161__shadow_.hg7HuBieTRbnlSE5CVM2ZNiGwj6OvnE_2 2024-09-12T18:13:49.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.382+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10023626116989359695', time=2024-09-12T19:45:09.654938+0000, chain.objs.size()=1 2024-09-12T18:13:49.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.382+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.239__shadow_.WOhk16qN21ZyjhR8t-smrxYe6cgmWY4_0 2024-09-12T18:13:49.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.382+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7356895468720575797', time=2024-09-12T19:45:16.326465+0000, chain.objs.size()=1 2024-09-12T18:13:49.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.382+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.245__shadow_.eJGHbVEZVk-YfCVzcSW1ZEb9YVaDs-z_0 2024-09-12T18:13:49.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.382+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18169382456527862324', time=2024-09-12T19:45:17.244676+0000, chain.objs.size()=1 2024-09-12T18:13:49.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.382+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.246__shadow_.hkvRsclWDsrhytJleAsqiZYgwl0oeQE_0 2024-09-12T18:13:49.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.382+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9606159465694666508', time=2024-09-12T19:45:18.179975+0000, chain.objs.size()=1 2024-09-12T18:13:49.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.382+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.247__shadow_.UkYeuqm8KtiAon8xcPE1o3hwFy_ezBG_0 2024-09-12T18:13:49.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.382+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1031635618801912543', time=2024-09-12T19:45:19.118016+0000, chain.objs.size()=1 2024-09-12T18:13:49.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.382+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.248__shadow_.8m3rVztBVKunbmKRin394i8psGvdR1X_0 2024-09-12T18:13:49.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.382+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12851664286094686954', time=2024-09-12T19:45:20.915936+0000, chain.objs.size()=1 2024-09-12T18:13:49.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.382+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.250__shadow_.8LPoTCXpN8OZKn5ojQ413g6MRl-GTcj_0 2024-09-12T18:13:49.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.382+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17110420768492528552', time=2024-09-12T19:46:08.789574+0000, chain.objs.size()=1 2024-09-12T18:13:49.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.382+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.rzfZMKhoYXZlZ2wR5UtjQdKHj2TcfIg_0 2024-09-12T18:13:49.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.382+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12331749564450513992', time=2024-09-12T19:46:08.986233+0000, chain.objs.size()=1 2024-09-12T18:13:49.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.382+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ikRKNt86AO4ZGgEB8dwIJGVlgjryco2_0 2024-09-12T18:13:49.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.382+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12255766623960295969', time=2024-09-12T19:46:09.196740+0000, chain.objs.size()=1 2024-09-12T18:13:49.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.382+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Jr-sDcbgkjwM0-bgajfJlNnftHtENbz_0 2024-09-12T18:13:49.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.384+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13314914369287377208', time=2024-09-12T19:46:09.387315+0000, chain.objs.size()=1 2024-09-12T18:13:49.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.384+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.rs3wLR1AeNUfZnyp3Yt0jkl-i6WaRO1_0 2024-09-12T18:13:49.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.385+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8926048041445803028', time=2024-09-12T19:46:09.753950+0000, chain.objs.size()=1 2024-09-12T18:13:49.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.385+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.8huon49NGQCbf2S0w7yZOsDNHx2j3zm_0 2024-09-12T18:13:49.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.385+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15770716986174464042', time=2024-09-12T19:46:10.697756+0000, chain.objs.size()=1 2024-09-12T18:13:49.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.385+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.jXsSffYGvu0vidx8vIr6eViaioNEHBJ_0 2024-09-12T18:13:49.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.385+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7515981441140881624', time=2024-09-12T19:46:10.974988+0000, chain.objs.size()=1 2024-09-12T18:13:49.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.385+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.y1UfLL7tu9APHEZtm0i4BQ_AIu2_8s__0 2024-09-12T18:13:49.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.385+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18352206387851967653', time=2024-09-12T19:46:11.086573+0000, chain.objs.size()=1 2024-09-12T18:13:49.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.385+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Dxg0uRUhPhlP304yK5t4px4GWWw0vFt_0 2024-09-12T18:13:49.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.385+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9226861686436245580', time=2024-09-12T19:46:11.380131+0000, chain.objs.size()=1 2024-09-12T18:13:49.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.385+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.v9DLu569hMrER0r-9pdokZaxvvfRyGc_0 2024-09-12T18:13:49.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.385+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16242642215277652632', time=2024-09-12T19:46:12.219271+0000, chain.objs.size()=1 2024-09-12T18:13:49.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.385+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.NjKdKVnnsaXE6Rbz2ou1xAiBq5uRG1E_0 2024-09-12T18:13:49.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.385+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17513089075769725235', time=2024-09-12T19:46:12.718091+0000, chain.objs.size()=1 2024-09-12T18:13:49.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.385+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.VCwufVVBOMo25UFuD85WThU7Zq9bfzR_0 2024-09-12T18:13:49.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.385+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11037167103133228530', time=2024-09-12T19:46:13.648825+0000, chain.objs.size()=1 2024-09-12T18:13:49.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.385+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ZYgGBr9z2iJ_bqkV0kxSzJ02KKdK7bt_0 2024-09-12T18:13:49.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.385+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6588044652787355058', time=2024-09-12T19:46:13.734420+0000, chain.objs.size()=1 2024-09-12T18:13:49.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.385+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.KgvbStSQmxWBDG-qNE_Qq_wPZmtZP2L_0 2024-09-12T18:13:49.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.385+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5558910820473344703', time=2024-09-12T19:46:14.009747+0000, chain.objs.size()=1 2024-09-12T18:13:49.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.385+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.CwtXJ0lJ4EnNxIfRBTXDZrOPz1Dy1Df_0 2024-09-12T18:13:49.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.387+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16220024300267668869', time=2024-09-12T19:46:14.287358+0000, chain.objs.size()=1 2024-09-12T18:13:49.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.387+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.55McZOe128oB3b-7GPWZT9JXnvOGlCT_0 2024-09-12T18:13:49.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.387+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6218804215156097692', time=2024-09-12T19:46:14.917028+0000, chain.objs.size()=1 2024-09-12T18:13:49.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.387+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.AxKTgdsSitYuD-hGdsbF3djlmmqbZCB_0 2024-09-12T18:13:49.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.387+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6382482658097921522', time=2024-09-12T19:46:15.164621+0000, chain.objs.size()=1 2024-09-12T18:13:49.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.387+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ZufawxPdabeKvEUg1B5Fr0iCANfl_IO_0 2024-09-12T18:13:49.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.387+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3872897002619889913', time=2024-09-12T19:46:15.316847+0000, chain.objs.size()=1 2024-09-12T18:13:49.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.387+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.hT2ItLYBb0D2dIi8dk-GkhJA1e8vXk9_0 2024-09-12T18:13:49.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.387+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3836727932398062509', time=2024-09-12T19:46:15.317838+0000, chain.objs.size()=1 2024-09-12T18:13:49.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.387+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.H2vo9RnEB9j_Oa7oDM6V-SESFrar6cb_0 2024-09-12T18:13:49.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.387+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2168708375178995467', time=2024-09-12T19:46:16.149434+0000, chain.objs.size()=1 2024-09-12T18:13:49.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.387+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.W_0Ljg7HWlrtDgB65NMbKvtGDtqfRUh_0 2024-09-12T18:13:49.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.387+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6941135088140909160', time=2024-09-12T19:46:16.444168+0000, chain.objs.size()=1 2024-09-12T18:13:49.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.387+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.-77Csa9ePKpYd1tNPC8YWXzFPoZrCaR_0 2024-09-12T18:13:49.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.387+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16115216897872870273', time=2024-09-12T19:46:16.745260+0000, chain.objs.size()=1 2024-09-12T18:13:49.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.387+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Vx5IF8FZzfETshZKIpxE54tvQ_j1INA_0 2024-09-12T18:13:49.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.387+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13359408199245757856', time=2024-09-12T19:46:16.827705+0000, chain.objs.size()=1 2024-09-12T18:13:49.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.387+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.RrOActUT0z7P9aF2EUkHstXjTNjGygO_0 2024-09-12T18:13:49.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.387+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.728291934807641748', time=2024-09-12T19:46:17.073243+0000, chain.objs.size()=1 2024-09-12T18:13:49.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.387+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.6isuYc3xXTAObOGmi1GP5yH1sbmT0vT_0 2024-09-12T18:13:49.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.387+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12705999993936412945', time=2024-09-12T19:46:17.129882+0000, chain.objs.size()=1 2024-09-12T18:13:49.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.387+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.o4JF6NS_dP16lOZMsnEYUoIeo1Vii_T_0 2024-09-12T18:13:49.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.389+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6790942501364654600', time=2024-09-12T19:46:17.928282+0000, chain.objs.size()=1 2024-09-12T18:13:49.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.389+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.qBI0MWwAPfzgSue4Ri4MwcrGCEXBRIG_0 2024-09-12T18:13:49.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.389+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5540714885923915273', time=2024-09-12T19:46:18.308975+0000, chain.objs.size()=1 2024-09-12T18:13:49.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.389+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.idv2f_3qaYOiM2J4310_4g2h-kycMS8_0 2024-09-12T18:13:49.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.389+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4270367628650353262', time=2024-09-12T19:46:18.334628+0000, chain.objs.size()=1 2024-09-12T18:13:49.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.389+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.QXViHGamhb2BI96oemOnBRNSNIGBv2P_0 2024-09-12T18:13:49.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.389+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6981226724707909417', time=2024-09-12T19:46:18.903408+0000, chain.objs.size()=1 2024-09-12T18:13:49.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.389+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.S7-qiEsKoIHx24ZH6LE1MhtC1rqqp5v_0 2024-09-12T18:13:49.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.389+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15919270967827465629', time=2024-09-12T19:46:19.019473+0000, chain.objs.size()=1 2024-09-12T18:13:49.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.389+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.BP9LvP36J0UEJZ763qHsSQjQ6TS0guT_0 2024-09-12T18:13:49.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.389+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2514631912172806200', time=2024-09-12T19:46:19.266591+0000, chain.objs.size()=1 2024-09-12T18:13:49.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.389+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.xwRus5j8hrB20XiJQnPXFfXySBEjipg_0 2024-09-12T18:13:49.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.389+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5967156472044861949', time=2024-09-12T19:46:19.319479+0000, chain.objs.size()=1 2024-09-12T18:13:49.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.389+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.-jSnrdUzf_VDrEBp-eUn1xpboBSXvPV_0 2024-09-12T18:13:49.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.390+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15872381034173492635', time=2024-09-12T19:46:19.588743+0000, chain.objs.size()=1 2024-09-12T18:13:49.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.390+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Nk63ipkyWRDIXBaZn-WJqbBE7PwlZ9k_0 2024-09-12T18:13:49.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.390+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10742484236926416849', time=2024-09-12T19:46:30.102934+0000, chain.objs.size()=1 2024-09-12T18:13:49.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.390+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.275__shadow_.qQmk_olQS3vec0L6_EyH1_Z302R9Yj__0 2024-09-12T18:13:49.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.390+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.309898860407458949', time=2024-09-12T19:46:35.540921+0000, chain.objs.size()=1 2024-09-12T18:13:49.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.390+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.281__shadow_.SCdlDJqOVLiBjEpyv9lNCXJok3BTHB0_0 2024-09-12T18:13:49.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.390+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1794360451320030767', time=2024-09-12T19:46:41.156932+0000, chain.objs.size()=1 2024-09-12T18:13:49.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.390+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.287__shadow_.xGXB20qDPCIaJQG9N9zBHtHK_kM5B_C_0 2024-09-12T18:13:49.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.391+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17975444177411075056', time=2024-09-12T19:46:48.081923+0000, chain.objs.size()=1 2024-09-12T18:13:49.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.391+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.293__shadow_.4wMoNygIKJ1CMuvvNg479hO4ln6DwlI_0 2024-09-12T18:13:49.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.391+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7542313881242136606', time=2024-09-12T19:46:50.325856+0000, chain.objs.size()=1 2024-09-12T18:13:49.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.391+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.294__shadow_.7m989l4g5gr-2O0AO1Fu9QLpPb8mqyW_0 2024-09-12T18:13:49.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.392+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9478286235530383321', time=2024-09-12T19:46:51.356266+0000, chain.objs.size()=1 2024-09-12T18:13:49.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.392+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.295__shadow_.Bjpt_3ULW_JITMth8jGllSoBbV9yd47_0 2024-09-12T18:13:49.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.392+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1381128460463861276', time=2024-09-12T19:46:52.284722+0000, chain.objs.size()=1 2024-09-12T18:13:49.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.392+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.296__shadow_.R3YhlMA0IcBLzcWYj9WUkJ1GC-d3nEw_0 2024-09-12T18:13:49.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.392+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16770471687281856654', time=2024-09-12T19:47:14.923052+0000, chain.objs.size()=1 2024-09-12T18:13:49.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.392+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.316__shadow_.if8fji_FtlVUU4StCgZs1H820iUDJPx_0 2024-09-12T18:13:49.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.392+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8222892371807024414', time=2024-09-12T19:47:59.483951+0000, chain.objs.size()=1 2024-09-12T18:13:49.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.392+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.-Db1KkIjJvFgXbt3UP5gOKmoXuLqAM2_0 2024-09-12T18:13:49.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.392+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.137818223157730795', time=2024-09-12T19:47:59.739549+0000, chain.objs.size()=1 2024-09-12T18:13:49.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.392+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.P2qAWU8A1sJ-dLoGHpSxTIbftI9tCcn_0 2024-09-12T18:13:49.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.392+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2727005898559601254', time=2024-09-12T19:47:59.796785+0000, chain.objs.size()=1 2024-09-12T18:13:49.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.392+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.eXRxe0zyMz9-BijHX-SN2x3pKUXG7Da_0 2024-09-12T18:13:49.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.392+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7160944932286699468', time=2024-09-12T19:48:00.314262+0000, chain.objs.size()=1 2024-09-12T18:13:49.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.392+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.-ytrUy3ugtPyXIxQUSWSkctyBbAZ4ES_0 2024-09-12T18:13:49.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.392+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6391270266459643015', time=2024-09-12T19:48:00.336048+0000, chain.objs.size()=1 2024-09-12T18:13:49.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.392+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.YKyLgpmCEk_7G9_vXrRr1H8ORqP4NXH_0 2024-09-12T18:13:49.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.392+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4238618101476066036', time=2024-09-12T19:48:00.336623+0000, chain.objs.size()=1 2024-09-12T18:13:49.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.392+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.q1gseD_UWz3aEd9uEpOaQ_3SCNPOlHN_0 2024-09-12T18:13:49.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.393+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11143332204707008175', time=2024-09-12T19:48:00.458820+0000, chain.objs.size()=1 2024-09-12T18:13:49.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.393+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.jpowPHW789irFSKHhuHDR-c7jTxjs25_0 2024-09-12T18:13:49.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.393+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.172108125255543360', time=2024-09-12T19:48:01.654519+0000, chain.objs.size()=1 2024-09-12T18:13:49.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.393+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.iI54yGwlnAjt3bfKpzlsL4RNVz0oq1d_0 2024-09-12T18:13:49.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.393+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16039657749417081788', time=2024-09-12T19:48:01.862887+0000, chain.objs.size()=1 2024-09-12T18:13:49.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.393+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.NS1U5Mxwcw1x3Mdmw9RssYi-FRUnJpV_0 2024-09-12T18:13:49.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.394+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9842133535013677105', time=2024-09-12T19:48:02.495221+0000, chain.objs.size()=1 2024-09-12T18:13:49.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.394+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.tWmLz7QPmnHBfT2xcAVPblieQyIzRMl_0 2024-09-12T18:13:49.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.394+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12083963065809032493', time=2024-09-12T19:48:03.459506+0000, chain.objs.size()=1 2024-09-12T18:13:49.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.394+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.W66gcEDtZYTmftLfw1yZw9zT7qPFUZW_0 2024-09-12T18:13:49.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.394+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15643746885178239970', time=2024-09-12T19:48:04.677438+0000, chain.objs.size()=1 2024-09-12T18:13:49.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.394+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.hFn1UoldwIFzUmYy2AScHY2L7RXYrDo_0 2024-09-12T18:13:49.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.394+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12777217089751007304', time=2024-09-12T19:48:05.737914+0000, chain.objs.size()=1 2024-09-12T18:13:49.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.394+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Zgt-m_xI-fwingBrx4xrgfxo2tQljYW_0 2024-09-12T18:13:49.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.394+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12234973549607867051', time=2024-09-12T19:48:05.926397+0000, chain.objs.size()=1 2024-09-12T18:13:49.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.394+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.M7lzawMzbycvTf7iP36bhFs9gcFeTx5_0 2024-09-12T18:13:49.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.394+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5957989009507996104', time=2024-09-12T19:48:06.202078+0000, chain.objs.size()=1 2024-09-12T18:13:49.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.394+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.HMcuXZbijMG7GdcpqyGz3BqCDdZQvaL_0 2024-09-12T18:13:49.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.394+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7561899806934842040', time=2024-09-12T19:48:06.948106+0000, chain.objs.size()=1 2024-09-12T18:13:49.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.394+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.7XHAlC9HbWG1y__CHZXaR0o7yYb2luN_0 2024-09-12T18:13:49.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.394+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10720532390656985984', time=2024-09-12T19:48:07.667489+0000, chain.objs.size()=1 2024-09-12T18:13:49.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.394+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.pB-3olAbOPpvTALoT2ncj1_b57757OX_0 2024-09-12T18:13:49.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.395+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15315329333788268409', time=2024-09-12T19:48:08.187398+0000, chain.objs.size()=1 2024-09-12T18:13:49.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.395+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.5a43La3F41PIeqcP2__9xttmT6AIHHO_0 2024-09-12T18:13:49.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.396+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14009289248878372605', time=2024-09-12T19:48:08.279656+0000, chain.objs.size()=1 2024-09-12T18:13:49.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.396+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.zCg1XVOoZiQPx0iQe6cKPuQdU5pBZu4_0 2024-09-12T18:13:49.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.396+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1874600830786077457', time=2024-09-12T19:48:08.313253+0000, chain.objs.size()=1 2024-09-12T18:13:49.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.396+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.uXNM5AnwZx2pGGFZYt-HOpCvx_fXQ2d_0 2024-09-12T18:13:49.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.396+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16787615615046805485', time=2024-09-12T19:48:08.414657+0000, chain.objs.size()=1 2024-09-12T18:13:49.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.396+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Wk3X65rDaDtWXgPfi2gLQWI2WnzWIIq_0 2024-09-12T18:13:49.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.396+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1178500896293593120', time=2024-09-12T19:48:08.962474+0000, chain.objs.size()=1 2024-09-12T18:13:49.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.396+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.SwTqv-w9KoFurC_zTtxwT4d_llG_ZAy_0 2024-09-12T18:13:49.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.396+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8758122720935361579', time=2024-09-12T19:48:10.037828+0000, chain.objs.size()=1 2024-09-12T18:13:49.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.396+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.OMMV0ntulKq7i_3Wf06PM6sMVKh4Kue_0 2024-09-12T18:13:49.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.396+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4275635550341903320', time=2024-09-12T19:48:47.456390+0000, chain.objs.size()=1 2024-09-12T18:13:49.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.396+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.MTQxjJ83iQTn89VtgWg6AFO4A7jO1_b_0 2024-09-12T18:13:49.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.397+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16182443267825414012', time=2024-09-12T19:48:47.457250+0000, chain.objs.size()=1 2024-09-12T18:13:49.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.397+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.pUvVOKLUXASFXqkXd60F8VkyKkklsIg_0 2024-09-12T18:13:49.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.397+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5921576436357286677', time=2024-09-12T19:48:47.860132+0000, chain.objs.size()=1 2024-09-12T18:13:49.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.397+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.8dLdizy2FlaTS8WehseTgk5LUhB7miR_0 2024-09-12T18:13:49.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.397+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12824038185277959383', time=2024-09-12T19:48:48.187749+0000, chain.objs.size()=1 2024-09-12T18:13:49.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.397+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.UuVuqZg4bkhUNq9II30aZEWyuRmHAfh_0 2024-09-12T18:13:49.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.397+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10565641077184265822', time=2024-09-12T19:48:48.977521+0000, chain.objs.size()=1 2024-09-12T18:13:49.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.397+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.9cp1sBpJtBhyfbokW5N2ci0BxhFO9wg_0 2024-09-12T18:13:49.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.397+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.494698537245951433', time=2024-09-12T19:48:48.978128+0000, chain.objs.size()=1 2024-09-12T18:13:49.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.397+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.J7SLPNke5zpEYop4FytQM0TopWJQ3eq_0 2024-09-12T18:13:49.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.398+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13656606314620794776', time=2024-09-12T19:48:49.281951+0000, chain.objs.size()=1 2024-09-12T18:13:49.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.398+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.PsuD4I-d7QBbyvFkA63JIDdh5wZ-Olp_0 2024-09-12T18:13:49.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.399+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8759342202690169836', time=2024-09-12T19:48:49.656688+0000, chain.objs.size()=1 2024-09-12T18:13:49.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.399+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.3SJ-2VG3CPHDpcpWMsbFVg3O4KWMNLA_0 2024-09-12T18:13:49.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.399+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7877442972848263351', time=2024-09-12T19:48:49.817949+0000, chain.objs.size()=1 2024-09-12T18:13:49.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.399+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.fv7nBdPViLqICxsdNQGNWRmhaltVroH_0 2024-09-12T18:13:49.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.399+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6550376423236706589', time=2024-09-12T19:48:50.548654+0000, chain.objs.size()=1 2024-09-12T18:13:49.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.399+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Xwp3JqlWFCBI3yz7WOsvy9BILs3lm4-_0 2024-09-12T18:13:49.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.399+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3352469378409990178', time=2024-09-12T19:48:50.549462+0000, chain.objs.size()=1 2024-09-12T18:13:49.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.399+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.8qqpyPyYPrNHlb2JPjlm2gOot6AowBc_0 2024-09-12T18:13:49.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.399+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1444552730256643650', time=2024-09-12T19:48:50.659559+0000, chain.objs.size()=1 2024-09-12T18:13:49.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.399+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.5RgLUUalz2hBAHpM_AuMgaoOSz6d_Pb_0 2024-09-12T18:13:49.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.399+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3088749908181586501', time=2024-09-12T19:48:50.849207+0000, chain.objs.size()=1 2024-09-12T18:13:49.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.399+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.iqOlYqiDMQu6XBLgYawuGeUKVPVQ1Wt_0 2024-09-12T18:13:49.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.399+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5142970015495602012', time=2024-09-12T19:48:51.198022+0000, chain.objs.size()=1 2024-09-12T18:13:49.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.399+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ImRbGDBhmWG9XxL4htDKfKwgYyKyrro_0 2024-09-12T18:13:49.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.399+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3940961853386855655', time=2024-09-12T19:48:52.562892+0000, chain.objs.size()=1 2024-09-12T18:13:49.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.399+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.jZhGmUPF7SvElsqnwLOsXeJ7BqOI2Z3_0 2024-09-12T18:13:49.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.399+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4461096427537421751', time=2024-09-12T19:48:52.803862+0000, chain.objs.size()=1 2024-09-12T18:13:49.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.399+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.HqjN4oKqcFmRu6Rs9waNOHfu-zHJbz8_0 2024-09-12T18:13:49.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.399+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12466156133095861970', time=2024-09-12T19:48:52.890330+0000, chain.objs.size()=1 2024-09-12T18:13:49.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.399+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.AJG8ungdAlzM8trFfeRlBbRHuHtyrMr_0 2024-09-12T18:13:49.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.399+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9820104112437865262', time=2024-09-12T19:48:53.357221+0000, chain.objs.size()=1 2024-09-12T18:13:49.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.399+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.wHd3jjWgZPKgF7O2Ff2OYKwzb7R7d0x_0 2024-09-12T18:13:49.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.400+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7747624311285987557', time=2024-09-12T19:48:53.445555+0000, chain.objs.size()=1 2024-09-12T18:13:49.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.400+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.9eFCMJyhyu4QD3tXWMJLR4YtPxxfEX2_0 2024-09-12T18:13:49.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.401+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7932287115035607633', time=2024-09-12T19:48:53.710902+0000, chain.objs.size()=1 2024-09-12T18:13:49.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.401+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.tO91MbhkgMwwQnzEmYAJN1MgtQscR5u_0 2024-09-12T18:13:49.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.402+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.635740905913977738', time=2024-09-12T19:48:53.816012+0000, chain.objs.size()=1 2024-09-12T18:13:49.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.402+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.CtRhMITIJSaJeI_qDReXAttylkiiVKy_0 2024-09-12T18:13:49.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.402+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.694991880093680891', time=2024-09-12T19:48:53.973558+0000, chain.objs.size()=1 2024-09-12T18:13:49.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.402+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.A5r-mDwK2HkS76snI4QvdaYFcMzpxlN_0 2024-09-12T18:13:49.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.402+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10516229761100773821', time=2024-09-12T19:48:54.019000+0000, chain.objs.size()=1 2024-09-12T18:13:49.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.402+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.fgwewcoFf58yKdwX-gUtalrOacT2CH2_0 2024-09-12T18:13:49.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.402+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5803785439497900969', time=2024-09-12T19:48:54.622839+0000, chain.objs.size()=1 2024-09-12T18:13:49.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.402+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.mwGOnnOQLLoLEMbIGFTtQbrPcERRn4p_0 2024-09-12T18:13:49.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.402+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16946852131543867518', time=2024-09-12T19:48:54.909930+0000, chain.objs.size()=1 2024-09-12T18:13:49.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.402+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.QP3LwZQJ0OptCwx6HWwIUWbPK3t1Q7h_0 2024-09-12T18:13:49.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.402+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15388541914941430705', time=2024-09-12T19:48:55.051628+0000, chain.objs.size()=1 2024-09-12T18:13:49.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.402+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.PJ_XVcJu4fN5FcJzHs4pspMXVlZtokB_0 2024-09-12T18:13:49.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.402+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17507366927667325723', time=2024-09-12T19:48:55.192148+0000, chain.objs.size()=1 2024-09-12T18:13:49.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.402+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.422HIcuKbh3uQ0ruSfEFXqlRl34ZLw__0 2024-09-12T18:13:49.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.403+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9133537737769489203', time=2024-09-12T19:48:55.989105+0000, chain.objs.size()=1 2024-09-12T18:13:49.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.403+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.NcUIeDLIDVY0wvfkRaxzzqjixtikBiZ_0 2024-09-12T18:13:49.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.403+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.50769665955127115', time=2024-09-12T19:48:56.540431+0000, chain.objs.size()=1 2024-09-12T18:13:49.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.403+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.y45Nxsj-h8jmBTcumdlLkMYl1u77z91_0 2024-09-12T18:13:49.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.404+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/55417 2024-09-12T18:13:49.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.406+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T18:13:49.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.406+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.113795265173779145', time=2024-09-12T19:48:56.795790+0000, chain.objs.size()=1 2024-09-12T18:13:49.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.406+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.phC2GPNhfe1qTT4vWTWRaL5nzs5jt4o_0 2024-09-12T18:13:49.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.406+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7521185897751544173', time=2024-09-12T19:48:57.379650+0000, chain.objs.size()=1 2024-09-12T18:13:49.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.406+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.A5vkJCyjHlDeAtNxXAKwLvDeWS6QsuM_0 2024-09-12T18:13:49.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.406+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13140515885406064481', time=2024-09-12T19:48:57.431371+0000, chain.objs.size()=1 2024-09-12T18:13:49.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.406+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.tm6UhZuKigx681FHHg3PvdCLEpWLbut_0 2024-09-12T18:13:49.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.406+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5112775736066984111', time=2024-09-12T19:48:57.701710+0000, chain.objs.size()=1 2024-09-12T18:13:49.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.406+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.f0js3u6xZBnJEIeKpTi9eXDDt5xg4os_0 2024-09-12T18:13:49.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.406+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8504104324156418799', time=2024-09-12T19:49:17.038874+0000, chain.objs.size()=1 2024-09-12T18:13:49.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.406+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.347__shadow_.84GpROMj0CnIs_0nSg32-tqCWcVE3H2_0 2024-09-12T18:13:49.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.406+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6323737070232359642', time=2024-09-12T19:51:03.119673+0000, chain.objs.size()=1 2024-09-12T18:13:49.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.406+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.463__shadow_.W8A5bNz2mTIxM4K9oSD004bKuZJ_PZf_0 2024-09-12T18:13:49.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.406+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10361315100003145449', time=2024-09-12T19:51:05.682777+0000, chain.objs.size()=1 2024-09-12T18:13:49.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.406+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.465__shadow_.efJlUzbJ7tcr8byHRHc0BycL9nn_vVs_0 2024-09-12T18:13:49.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.406+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3876666793635335893', time=2024-09-12T19:51:05.688465+0000, chain.objs.size()=1 2024-09-12T18:13:49.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.406+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.465__shadow_.qRwuFp0-8pao4yajjSjQOV8pLFJZayD_0 2024-09-12T18:13:49.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.406+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17713620305832652121', time=2024-09-12T19:52:13.020198+0000, chain.objs.size()=1 2024-09-12T18:13:49.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.406+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.512__multipart_mymultipart.2~T4GkxDp8LSxfSy8wy06HmhoEV67r6gd.1 2024-09-12T18:13:49.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.406+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14837005156782380574', time=2024-09-12T19:52:30.683648+0000, chain.objs.size()=1 2024-09-12T18:13:49.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.406+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.518__shadow_.IsLj1HnkqAD6ipdmCy1WbFgZWJmuRHE_0 2024-09-12T18:13:49.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.406+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~VW9LPkNYRwCEBf-WP9pETC8HUY997zk', time=2024-09-12T19:53:50.357176+0000, chain.objs.size()=1 2024-09-12T18:13:49.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.406+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~VW9LPkNYRwCEBf-WP9pETC8HUY997zk.2 2024-09-12T18:13:49.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.406+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2787853700388744718', time=2024-09-12T19:58:03.588658+0000, chain.objs.size()=1 2024-09-12T18:13:49.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.406+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:BlCmVLyw9TUQvmXfDMwPVkihibJXzar_.RfiZEs54076vloX9ONnTgRIWjX3OERc_0 2024-09-12T18:13:49.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.408+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13191326373197285867', time=2024-09-12T19:58:08.870912+0000, chain.objs.size()=1 2024-09-12T18:13:49.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.408+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.571__shadow:T19fVsXLXXT3VoZbuZcDDVvKMXkJkJr_.fnHbHa19REnDGc5_c1EkzvDhOmC1c7r_0 2024-09-12T18:13:49.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.408+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11925370528862846994', time=2024-09-12T19:58:42.186267+0000, chain.objs.size()=1 2024-09-12T18:13:49.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.408+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:jVF2-f9wLzKhYWjgvJXQbg2yaJjxjjb_.8gEq-SPNCE2pAdvuZDcZfjvgVbPGKPL_0 2024-09-12T18:13:49.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.408+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6663384386826859627', time=2024-09-12T19:59:41.072410+0000, chain.objs.size()=1 2024-09-12T18:13:49.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.408+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.588__shadow:4WIs36RtTB4rourB77PRotZcq-9aLIS_.XOla_4ebcRpGMRy3O33ZfuQOMOwbDKI_0 2024-09-12T18:13:49.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.408+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16189123817462548759', time=2024-09-12T20:05:28.034439+0000, chain.objs.size()=1 2024-09-12T18:13:49.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.408+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.653__shadow_.GaIszHbbx9yFSFJhUOyEsDQT03RqWvn_0 2024-09-12T18:13:49.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.408+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14362670339828255251', time=2024-09-12T20:06:36.447362+0000, chain.objs.size()=1 2024-09-12T18:13:49.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.408+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.707__shadow_.vHVXekyHi2BMYPnNKjJitn9Tl9bZsEH_0 2024-09-12T18:13:49.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.409+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9558871552961709036', time=2024-09-12T20:13:17.494990+0000, chain.objs.size()=1 2024-09-12T18:13:49.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.409+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.783__shadow_.sEdj3cCmSNJ8k5MhlaONDyundnHHyMX_0 2024-09-12T18:13:49.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.410+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:49.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.412+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:13:49.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.413+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:49.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.414+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:49.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.415+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/57896' 2024-09-12T18:13:49.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.415+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3791188291194008167', time=2024-09-12T19:42:50.953363+0000, chain.objs.size()=1 2024-09-12T18:13:49.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.415+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.190__shadow_.UYjBZGiMcod0A3Y_KF_hBoeMcZd_1Lj_0 2024-09-12T18:13:49.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.415+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~8n_y8z4C-OMTYgUSNz04byonxpn5WyP', time=2024-09-12T19:43:13.671511+0000, chain.objs.size()=1 2024-09-12T18:13:49.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.415+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.203__multipart_mymultipart.2~8n_y8z4C-OMTYgUSNz04byonxpn5WyP.1 2024-09-12T18:13:49.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.415+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14525617664093321166', time=2024-09-12T19:45:05.526553+0000, chain.objs.size()=1 2024-09-12T18:13:49.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.415+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.236__shadow_.PDj5a7YIeYGtk9hu38IOhUjM8g5z3Kh_0 2024-09-12T18:13:49.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.415+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8438940950514183958', time=2024-09-12T19:45:19.108341+0000, chain.objs.size()=1 2024-09-12T18:13:49.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.415+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.248__shadow_.1QGaAL5qsAjoH-mCWHq72ZYlvkIFhD5_0 2024-09-12T18:13:49.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.415+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5625507227610451833', time=2024-09-12T19:45:20.016342+0000, chain.objs.size()=1 2024-09-12T18:13:49.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.415+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.249__shadow_.9nd7775j1KOQrWkfUo_9VkQotjEuVDH_0 2024-09-12T18:13:49.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.415+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2297176737848851250', time=2024-09-12T19:45:23.672541+0000, chain.objs.size()=1 2024-09-12T18:13:49.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.415+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.253__shadow_.lEH3ekGEm2A6j97fK0GHTv35gb65WtR_0 2024-09-12T18:13:49.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.415+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15011612231677694097', time=2024-09-12T19:45:31.763624+0000, chain.objs.size()=1 2024-09-12T18:13:49.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.415+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.262__shadow_.qrsOnvpV_l5GASdqHBGbazVRRIsYOfl_0 2024-09-12T18:13:49.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.415+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17772464717374060155', time=2024-09-12T19:45:31.764488+0000, chain.objs.size()=1 2024-09-12T18:13:49.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.415+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.262__shadow_.ioGjNOFbjgoa1zwyQ-8SYirWoWMmvvj_0 2024-09-12T18:13:49.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.415+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3061334423471803711', time=2024-09-12T19:46:08.960545+0000, chain.objs.size()=1 2024-09-12T18:13:49.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.415+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.b9FO_CUvetKTxGQ6ip1t8LPt24DTWIW_0 2024-09-12T18:13:49.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.415+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12136807320281880188', time=2024-09-12T19:46:09.681156+0000, chain.objs.size()=1 2024-09-12T18:13:49.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.415+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.hpMud2mkx-A4HgT25QDWNvI0zlneELu_0 2024-09-12T18:13:49.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.415+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15000694027986420978', time=2024-09-12T19:46:10.369335+0000, chain.objs.size()=1 2024-09-12T18:13:49.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.415+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.tY7ymmptuPp7Q-mFT_N6xTEfx-voHvM_0 2024-09-12T18:13:49.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.415+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8414755729543504081', time=2024-09-12T19:46:10.380542+0000, chain.objs.size()=1 2024-09-12T18:13:49.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.415+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ese97gFbqtn8Iu4ZhchlTshCPeov3ua_0 2024-09-12T18:13:49.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.416+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3266919791556184505', time=2024-09-12T19:46:10.410920+0000, chain.objs.size()=1 2024-09-12T18:13:49.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.416+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.mTLNtX0I_CDOc8akEzeagLzeJ3CAPoR_0 2024-09-12T18:13:49.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.417+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.742698538234986545', time=2024-09-12T19:46:10.917828+0000, chain.objs.size()=1 2024-09-12T18:13:49.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.417+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.mEgFmURr4oZ4O8IrfFw33DydsDy9EgC_0 2024-09-12T18:13:49.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.417+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16624306451987895435', time=2024-09-12T19:46:12.132763+0000, chain.objs.size()=1 2024-09-12T18:13:49.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.417+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.O8ckI3YR20yDTYqmv3PuO8DZjj3W4Sx_0 2024-09-12T18:13:49.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.417+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3206981503413946925', time=2024-09-12T19:46:12.386013+0000, chain.objs.size()=1 2024-09-12T18:13:49.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.417+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.MgyjVOpWA1H3BtE6Kfe-A1X3_RSyBfI_0 2024-09-12T18:13:49.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.417+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17184061786723600225', time=2024-09-12T19:46:12.386764+0000, chain.objs.size()=1 2024-09-12T18:13:49.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.417+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.je5hffwR4AkTy9HTwcKXs_MAPZ2mwiY_0 2024-09-12T18:13:49.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.417+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11637175787662545836', time=2024-09-12T19:46:12.387437+0000, chain.objs.size()=1 2024-09-12T18:13:49.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.417+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ETuKDegEcEqrQKZDIDE1qJJhMc2Q_W__0 2024-09-12T18:13:49.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.418+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15198962935041975606', time=2024-09-12T19:46:12.676941+0000, chain.objs.size()=1 2024-09-12T18:13:49.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.418+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.hN6pi9WkaV_jifk2kyU5fDJ5X72mkyW_0 2024-09-12T18:13:49.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.418+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1126967300002303509', time=2024-09-12T19:46:12.882360+0000, chain.objs.size()=1 2024-09-12T18:13:49.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.418+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.X6WZAQFQtqMPgOmWyjXb4fOJ6vJxrRV_0 2024-09-12T18:13:49.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.418+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10779972806589150532', time=2024-09-12T19:46:12.885420+0000, chain.objs.size()=1 2024-09-12T18:13:49.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.418+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.nveXjZtUKHNDE3GFjtGbjCmyigJXAAH_0 2024-09-12T18:13:49.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.418+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5842955257200399652', time=2024-09-12T19:46:13.359543+0000, chain.objs.size()=1 2024-09-12T18:13:49.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.418+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.-HtUZnWZolbJWaVYiOzhWV_XtD9gvxj_0 2024-09-12T18:13:49.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.418+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12175951299258928375', time=2024-09-12T19:46:13.594586+0000, chain.objs.size()=1 2024-09-12T18:13:49.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.418+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.DBtKHTyyW1kejkfvcve0uDx3spsW675_0 2024-09-12T18:13:49.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.418+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1107320922171829319', time=2024-09-12T19:46:13.838540+0000, chain.objs.size()=1 2024-09-12T18:13:49.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.418+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.dxHuW8go0WzSRB7yjxPOl01SW6GoFmn_0 2024-09-12T18:13:49.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.419+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8205025135824465229', time=2024-09-12T19:46:14.162229+0000, chain.objs.size()=1 2024-09-12T18:13:49.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.419+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.IgkKGcWL5zy_hDZO3gcYlwXLCyMSBmO_0 2024-09-12T18:13:49.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.419+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15332357023796180903', time=2024-09-12T19:46:14.209035+0000, chain.objs.size()=1 2024-09-12T18:13:49.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.419+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.-nsctwPGrnYEWDjB3tR4h4wQv5vFlEx_0 2024-09-12T18:13:49.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.419+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3857264343938833420', time=2024-09-12T19:46:14.724494+0000, chain.objs.size()=1 2024-09-12T18:13:49.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.419+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.cQVrTb9FjSJj-R5lLwm45X2MSTpx7iE_0 2024-09-12T18:13:49.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.419+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2743291326510888410', time=2024-09-12T19:46:14.730089+0000, chain.objs.size()=1 2024-09-12T18:13:49.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.419+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.S0MoWE56v5cunGh9oe7lw00ytMpUulc_0 2024-09-12T18:13:49.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.419+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.325116179615868912', time=2024-09-12T19:46:14.908563+0000, chain.objs.size()=1 2024-09-12T18:13:49.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.419+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.1uU4W_mBhHUzZIEUDYmHu116AS2IWUJ_0 2024-09-12T18:13:49.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.420+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13492708721405225943', time=2024-09-12T19:46:15.456958+0000, chain.objs.size()=1 2024-09-12T18:13:49.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.420+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.1BAfyQGrO2-MfG8qOe7NLpfiAFHV1xa_0 2024-09-12T18:13:49.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.420+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10968854527451490167', time=2024-09-12T19:46:15.538814+0000, chain.objs.size()=1 2024-09-12T18:13:49.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.420+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.AXTMEzrMbYFGzKEVJDcxatbwA8Far0v_0 2024-09-12T18:13:49.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.420+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1836240547739411596', time=2024-09-12T19:46:15.700654+0000, chain.objs.size()=1 2024-09-12T18:13:49.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.420+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.YAuAcntHdJnoA2kP0Qa9cAUAAMvB9Nc_0 2024-09-12T18:13:49.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.420+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5864993065765463654', time=2024-09-12T19:46:16.100702+0000, chain.objs.size()=1 2024-09-12T18:13:49.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.420+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.V8Vc4ZMvckVwaI3bj-qVsIaeRbI6W4u_0 2024-09-12T18:13:49.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.420+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8643183881705286368', time=2024-09-12T19:46:16.591289+0000, chain.objs.size()=1 2024-09-12T18:13:49.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.420+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.1d2DM677w_C-ivDumqbDlep68aIuaEl_0 2024-09-12T18:13:49.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.420+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8973871175716678496', time=2024-09-12T19:46:16.625807+0000, chain.objs.size()=1 2024-09-12T18:13:49.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.420+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.AYvnRYPvcbGvKY6aQxZ46v5tJ9blP0L_0 2024-09-12T18:13:49.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.421+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.97696809349449240', time=2024-09-12T19:46:17.638844+0000, chain.objs.size()=1 2024-09-12T18:13:49.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.421+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.RZMdiymYLGgQTg1i1kuNuMgA8jh6vKK_0 2024-09-12T18:13:49.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.421+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15964559175383465019', time=2024-09-12T19:46:18.217914+0000, chain.objs.size()=1 2024-09-12T18:13:49.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.421+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.whpt2WG0XvzlEpHOOQcgWJO2sXWJeQ4_0 2024-09-12T18:13:49.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.421+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1131963691736559441', time=2024-09-12T19:46:18.967861+0000, chain.objs.size()=1 2024-09-12T18:13:49.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.421+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.sTrq0jFKr8Pbo-QGX-QXPkjJxJMY2G__0 2024-09-12T18:13:49.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.421+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1671632632241454894', time=2024-09-12T19:46:19.450094+0000, chain.objs.size()=1 2024-09-12T18:13:49.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.421+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.BxXpcDDHfPKKTqZLCKzUvXo0mYpsr7G_0 2024-09-12T18:13:49.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.421+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6986526706433722312', time=2024-09-12T19:46:34.639201+0000, chain.objs.size()=1 2024-09-12T18:13:49.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.421+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.280__shadow_.-OSH4gyZZ-CLMJHIaASREfVC9oPiNFq_0 2024-09-12T18:13:49.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.422+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13798019333277040681', time=2024-09-12T19:46:36.495447+0000, chain.objs.size()=1 2024-09-12T18:13:49.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.422+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.282__shadow_.CWz5NVkL6FEJL9BL24kk5F59bRPdKv4_0 2024-09-12T18:13:49.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.422+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3435657223722985570', time=2024-09-12T19:46:36.498417+0000, chain.objs.size()=1 2024-09-12T18:13:49.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.422+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.282__shadow_.f9bl4dn_ddQP0sIGtnvdvRCO2hQ_Fua_0 2024-09-12T18:13:49.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.422+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13862768011696781699', time=2024-09-12T19:46:50.304778+0000, chain.objs.size()=1 2024-09-12T18:13:49.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.422+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.294__shadow_.MC4uOV5uyfOFCJMBYWFZh9d_HFcTF2n_0 2024-09-12T18:13:49.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.423+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.61062835344520066', time=2024-09-12T19:46:50.321219+0000, chain.objs.size()=1 2024-09-12T18:13:49.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.423+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.294__shadow_.eMz0KSeSw4NFdSf5W-tYoLUi3cCgAnf_0 2024-09-12T18:13:49.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.423+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14095284038346141032', time=2024-09-12T19:46:51.347206+0000, chain.objs.size()=1 2024-09-12T18:13:49.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.423+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.295__shadow_.tkUwGdIIDjBXK7MHWlHAv31yLj1K7HI_0 2024-09-12T18:13:49.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.423+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4877306928507088513', time=2024-09-12T19:46:52.274574+0000, chain.objs.size()=1 2024-09-12T18:13:49.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.423+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.296__shadow_.oxMetcaJs1YsMtuUjrs0o9P4Q7UFW5R_0 2024-09-12T18:13:49.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.423+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14457148754673605309', time=2024-09-12T19:46:52.278739+0000, chain.objs.size()=1 2024-09-12T18:13:49.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.423+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.296__shadow_.r3cKf2nxav5CcJNAOk_FMvVrzYIrp6C_0 2024-09-12T18:13:49.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.423+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.148383216711979933', time=2024-09-12T19:47:59.759767+0000, chain.objs.size()=1 2024-09-12T18:13:49.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.423+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.-Y3ng2Br-hoUJBll6mNwa6TADbOyS-6_0 2024-09-12T18:13:49.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.423+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12572088956725627423', time=2024-09-12T19:47:59.805137+0000, chain.objs.size()=1 2024-09-12T18:13:49.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.423+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.6NIrnhbdDW9E4UdkGDzcTRQoilpg4Q1_0 2024-09-12T18:13:49.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.423+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15201391154606842567', time=2024-09-12T19:47:59.805712+0000, chain.objs.size()=1 2024-09-12T18:13:49.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.423+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.k2wWHFrT3BtqLCGeIIvTFtElsBKu52B_0 2024-09-12T18:13:49.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.423+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16816152088550620140', time=2024-09-12T19:48:00.086090+0000, chain.objs.size()=1 2024-09-12T18:13:49.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.423+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.GobF1Tq-MJIuZ5miwFFpaoSOEJth2di_0 2024-09-12T18:13:49.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.423+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15065547777160825926', time=2024-09-12T19:48:01.596082+0000, chain.objs.size()=1 2024-09-12T18:13:49.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.423+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.roxfTnm8j2Yo-sc5MJ5_BRMpkV3u3uV_0 2024-09-12T18:13:49.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.423+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13757564994620997377', time=2024-09-12T19:48:01.870159+0000, chain.objs.size()=1 2024-09-12T18:13:49.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.423+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.mB5WWMMFITzSNCrMVuxg-YoPsDvKkui_0 2024-09-12T18:13:49.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.424+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6760974748873820951', time=2024-09-12T19:48:01.974862+0000, chain.objs.size()=1 2024-09-12T18:13:49.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.424+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.PvhK6MRu9x2eMgQzd51FqKrVyjngLq4_0 2024-09-12T18:13:49.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.425+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3370382635327273959', time=2024-09-12T19:48:04.121894+0000, chain.objs.size()=1 2024-09-12T18:13:49.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.425+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.jzuD3BdFFnmruVTYHgYC3oYgIb2d4WD_0 2024-09-12T18:13:49.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.425+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13295106812957903556', time=2024-09-12T19:48:04.171281+0000, chain.objs.size()=1 2024-09-12T18:13:49.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.425+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.VaIvG6E6ZdKVhuerTTpDtutEtA9vOV8_0 2024-09-12T18:13:49.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.425+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7512510184900926245', time=2024-09-12T19:48:05.462198+0000, chain.objs.size()=1 2024-09-12T18:13:49.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.426+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.TwYCOAQWGBvA-13Mb9TN1vw7Bp-ZLUt_0 2024-09-12T18:13:49.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.426+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13288190968138618152', time=2024-09-12T19:48:05.637967+0000, chain.objs.size()=1 2024-09-12T18:13:49.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.426+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.aIW0qS0AdbOHCEN2jpO9l2uogqDhcBf_0 2024-09-12T18:13:49.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.426+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1708264570415937818', time=2024-09-12T19:48:05.857301+0000, chain.objs.size()=1 2024-09-12T18:13:49.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.426+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.r7Wv0UQWat2JNlV_PozZ0sVjEuDXXCV_0 2024-09-12T18:13:49.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.426+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16146908277177391618', time=2024-09-12T19:48:05.893451+0000, chain.objs.size()=1 2024-09-12T18:13:49.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.426+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.HVRTxMYSP4sMbqD9V-5OJKnf_QcnFcs_0 2024-09-12T18:13:49.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.426+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11414731059245794112', time=2024-09-12T19:48:06.009506+0000, chain.objs.size()=1 2024-09-12T18:13:49.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.426+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.KQ54oRPi8q_xCQ3OWVgdrrr3lguzEbA_0 2024-09-12T18:13:49.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.426+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13986538042810288844', time=2024-09-12T19:48:06.074837+0000, chain.objs.size()=1 2024-09-12T18:13:49.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.426+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.BDrEzs0ENwwqV0cYHbNRRSZPUwi0lj1_0 2024-09-12T18:13:49.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.426+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16474145029738198005', time=2024-09-12T19:48:06.279043+0000, chain.objs.size()=1 2024-09-12T18:13:49.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.426+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.TsLpnn-ti92OLvJDVKnCsa74q-RhDD4_0 2024-09-12T18:13:49.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.426+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16777978835613406955', time=2024-09-12T19:48:06.684464+0000, chain.objs.size()=1 2024-09-12T18:13:49.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.426+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.1u0CdBvp46zUPO4JS9CAlvKYkRnt96a_0 2024-09-12T18:13:49.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.426+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10625631790107562038', time=2024-09-12T19:48:07.215351+0000, chain.objs.size()=1 2024-09-12T18:13:49.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.426+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.58K5aaz6X-xzwEpkfdIsqHWg8ZaySRD_0 2024-09-12T18:13:49.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.428+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12822970158140099404', time=2024-09-12T19:48:07.310708+0000, chain.objs.size()=1 2024-09-12T18:13:49.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.428+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.dzKDB9--caGJ2JvKWtTAuP66xbQNtpE_0 2024-09-12T18:13:49.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.428+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12150558493685933055', time=2024-09-12T19:48:07.550339+0000, chain.objs.size()=1 2024-09-12T18:13:49.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.428+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.IpF7gRWgni2kgyhKQH0TOA2zCAYSQIQ_0 2024-09-12T18:13:49.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.428+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18305264222691976793', time=2024-09-12T19:48:07.590604+0000, chain.objs.size()=1 2024-09-12T18:13:49.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.428+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.sK2UqaV5ACr5JLOcYNSzwLsMj0GbNc4_0 2024-09-12T18:13:49.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.429+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3633580200668051887', time=2024-09-12T19:48:08.008492+0000, chain.objs.size()=1 2024-09-12T18:13:49.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.429+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.s90NrkdXziZTj8YiaJquVq9DlMDyGJI_0 2024-09-12T18:13:49.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.429+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8584431030993192442', time=2024-09-12T19:48:08.395911+0000, chain.objs.size()=1 2024-09-12T18:13:49.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.429+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.fzk87kRbzyNDlSNvs3XGxK22dsPymZV_0 2024-09-12T18:13:49.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.429+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.683899383118125033', time=2024-09-12T19:48:08.657534+0000, chain.objs.size()=1 2024-09-12T18:13:49.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.429+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.yNSMq7rgzHSeJ2pCcx3Cf9KZmberRa__0 2024-09-12T18:13:49.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.429+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13870560910733625892', time=2024-09-12T19:48:08.722392+0000, chain.objs.size()=1 2024-09-12T18:13:49.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.429+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.BtaFY_AV2K1nubaKtWd3P4CT7RtMbnh_0 2024-09-12T18:13:49.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.430+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6877855334391111421', time=2024-09-12T19:48:08.723409+0000, chain.objs.size()=1 2024-09-12T18:13:49.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.430+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.RyC3DaHAhfsNnEZJJXxId3ze1eDm1lF_0 2024-09-12T18:13:49.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.430+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9131918936895413796', time=2024-09-12T19:48:08.807750+0000, chain.objs.size()=1 2024-09-12T18:13:49.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.430+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.uhJ1V7x9XQoBm9pgOK0CPCFDrxpdKIC_0 2024-09-12T18:13:49.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.430+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11790796051452063046', time=2024-09-12T19:48:08.966692+0000, chain.objs.size()=1 2024-09-12T18:13:49.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.430+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.YrIjZTl0DAIDxitPyKDefD-KgzTXfLU_0 2024-09-12T18:13:49.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.430+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17216079592539478929', time=2024-09-12T19:48:09.424279+0000, chain.objs.size()=1 2024-09-12T18:13:49.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.430+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.42iunQ5i3tGdBY6Uzk55VsrK3U3iRnr_0 2024-09-12T18:13:49.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.430+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18422476824664320587', time=2024-09-12T19:48:09.806902+0000, chain.objs.size()=1 2024-09-12T18:13:49.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.430+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.3XFe7fcZhbYc5XrcruqtaRKI5ZYO0Nw_0 2024-09-12T18:13:49.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.430+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7385686137558027962', time=2024-09-12T19:48:47.815629+0000, chain.objs.size()=1 2024-09-12T18:13:49.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.430+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Rd8klwb74opSPLiuqXWvz-rkO_b2ARg_0 2024-09-12T18:13:49.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.430+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9579438907836507224', time=2024-09-12T19:48:48.091933+0000, chain.objs.size()=1 2024-09-12T18:13:49.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.430+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.p9ubP2IPUpL-qosPLYxUIAjBfLQWQP7_0 2024-09-12T18:13:49.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.430+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13054351664595055713', time=2024-09-12T19:48:49.188624+0000, chain.objs.size()=1 2024-09-12T18:13:49.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.430+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.xAbVqq6bGGLXgpJTDOEjXJq2F1RR9JA_0 2024-09-12T18:13:49.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.430+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7225669294558811166', time=2024-09-12T19:48:49.218655+0000, chain.objs.size()=1 2024-09-12T18:13:49.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.430+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.TQFMxbTUunUfwhxz3DZq-hIG158KVyt_0 2024-09-12T18:13:49.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.430+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15768053303922411090', time=2024-09-12T19:48:49.308955+0000, chain.objs.size()=1 2024-09-12T18:13:49.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.430+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.MdPx3i1_V48vjrHOLQhJKBDLzZRU_Vi_0 2024-09-12T18:13:49.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.430+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16229588494185755999', time=2024-09-12T19:48:49.360747+0000, chain.objs.size()=1 2024-09-12T18:13:49.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.430+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.eGgyDUsDLyd1v5Oe2SjLgVowdViEHvB_0 2024-09-12T18:13:49.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.432+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14590401690370518563', time=2024-09-12T19:48:49.588027+0000, chain.objs.size()=1 2024-09-12T18:13:49.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.432+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.W_R0RllZ-4EAaoKathzCCGEF051SDcK_0 2024-09-12T18:13:49.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.432+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1122992472086089642', time=2024-09-12T19:48:49.685203+0000, chain.objs.size()=1 2024-09-12T18:13:49.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.432+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.44cnVsnChBOolWbPxjX0-6KjsiPyiLC_0 2024-09-12T18:13:49.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.432+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9713866008733686335', time=2024-09-12T19:48:49.922075+0000, chain.objs.size()=1 2024-09-12T18:13:49.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.432+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.DHh4pwtQa3mGd3ReuPycN0QOLu-5abg_0 2024-09-12T18:13:49.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.432+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11919181774009486483', time=2024-09-12T19:48:50.799433+0000, chain.objs.size()=1 2024-09-12T18:13:49.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.432+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.lyV-23cCy7AT70sLzXIisrk8tzSqEsK_0 2024-09-12T18:13:49.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.432+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12199170535870790280', time=2024-09-12T19:48:50.990308+0000, chain.objs.size()=1 2024-09-12T18:13:49.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.432+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.I9SnY6UkzoRZcHWLzrJG6HQ4884Vouz_0 2024-09-12T18:13:49.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.432+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3826343023936801045', time=2024-09-12T19:48:51.028178+0000, chain.objs.size()=1 2024-09-12T18:13:49.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.432+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.zBisgJim6lEjc6Ysb94ZXr0EJX6ArLb_0 2024-09-12T18:13:49.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.432+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18398665709010072381', time=2024-09-12T19:48:51.332282+0000, chain.objs.size()=1 2024-09-12T18:13:49.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.432+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.k_IvZLHr9iMRgRrbuNZZkk8xxXMZqBU_0 2024-09-12T18:13:49.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.432+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2793048675784907272', time=2024-09-12T19:48:52.041810+0000, chain.objs.size()=1 2024-09-12T18:13:49.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.432+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.vGC_RBNuV4qO9-UoSd9Q6gg_CPDFaim_0 2024-09-12T18:13:49.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.432+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6699928292515272722', time=2024-09-12T19:48:52.053501+0000, chain.objs.size()=1 2024-09-12T18:13:49.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.432+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Mj-XSZS_jAj5hHMntTh27FSMGtWbEpL_0 2024-09-12T18:13:49.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.432+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5657646182516902885', time=2024-09-12T19:48:52.153614+0000, chain.objs.size()=1 2024-09-12T18:13:49.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.432+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.t5ho_Lqe145_Yog4aehWfy70pfeG5LQ_0 2024-09-12T18:13:49.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.432+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16675691312397810266', time=2024-09-12T19:48:52.232798+0000, chain.objs.size()=1 2024-09-12T18:13:49.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.432+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.4StltQv5ldZpahymqLshFdWXBdG-rf-_0 2024-09-12T18:13:49.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.434+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12046656262732141183', time=2024-09-12T19:48:52.274209+0000, chain.objs.size()=1 2024-09-12T18:13:49.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.434+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.asaH-5xKw_ojZc9zXlu2Xu5C7rDDarT_0 2024-09-12T18:13:49.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.434+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7394991342921466486', time=2024-09-12T19:48:52.381775+0000, chain.objs.size()=1 2024-09-12T18:13:49.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.434+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.r_fvx0riVCSJlhbaJWUsLupnOs4kJWW_0 2024-09-12T18:13:49.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.434+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11841758451277846005', time=2024-09-12T19:48:52.546992+0000, chain.objs.size()=1 2024-09-12T18:13:49.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.434+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Ps5nDb9hbJnoE-63bek8LKOafh7hTl4_0 2024-09-12T18:13:49.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.434+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14061338769268543166', time=2024-09-12T19:48:52.668188+0000, chain.objs.size()=1 2024-09-12T18:13:49.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.434+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.mytfXC14XRL0UIbyMGNDuwkTAtdDxLZ_0 2024-09-12T18:13:49.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.435+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1588223186356714432', time=2024-09-12T19:48:52.738843+0000, chain.objs.size()=1 2024-09-12T18:13:49.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.435+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.LewCW3xW2ZlcKHMDoJBtwJp1X9fMoRR_0 2024-09-12T18:13:49.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.435+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16242747427767346461', time=2024-09-12T19:48:53.302209+0000, chain.objs.size()=1 2024-09-12T18:13:49.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.435+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.odlwa73Moh0xha7q5JOI8Dub8Fwfx1F_0 2024-09-12T18:13:49.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.436+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/57896 2024-09-12T18:13:49.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.438+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-12T18:13:49.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.438+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3285526158539691748', time=2024-09-12T19:48:53.664993+0000, chain.objs.size()=1 2024-09-12T18:13:49.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.438+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Eew9kAE21HwJF5SdlMDaZ-qKhVWOU5M_0 2024-09-12T18:13:49.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.438+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11555257121559875639', time=2024-09-12T19:48:53.717797+0000, chain.objs.size()=1 2024-09-12T18:13:49.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.438+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.BnFj18JeLe_S36OnQ0Nj-7paQnah6XL_0 2024-09-12T18:13:49.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.438+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10459106158852459147', time=2024-09-12T19:48:53.718337+0000, chain.objs.size()=1 2024-09-12T18:13:49.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.438+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.5MgDslmktm-3VHVdsIil7vr8H9DMc8m_0 2024-09-12T18:13:49.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.438+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1965815860992837983', time=2024-09-12T19:48:53.958746+0000, chain.objs.size()=1 2024-09-12T18:13:49.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.438+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.IEBJpoziVUeLxRo6LsDcjGCesVj5NOp_0 2024-09-12T18:13:49.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.438+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2514483614381507026', time=2024-09-12T19:48:54.017598+0000, chain.objs.size()=1 2024-09-12T18:13:49.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.438+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.-9hB6Wxhnanxfm3Kg1fKX5I7kAcxdtA_0 2024-09-12T18:13:49.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.438+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14165425942961381010', time=2024-09-12T19:48:54.746177+0000, chain.objs.size()=1 2024-09-12T18:13:49.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.438+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.9x28RyRhXq8cCt8bgOBfdpxeWzhy990_0 2024-09-12T18:13:49.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.438+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13269303682325836267', time=2024-09-12T19:48:54.895677+0000, chain.objs.size()=1 2024-09-12T18:13:49.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.438+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.yn0ywjBx8AgWR7l2HeAgLx_boNA-0XI_0 2024-09-12T18:13:49.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.438+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3387129962708529138', time=2024-09-12T19:48:55.003228+0000, chain.objs.size()=1 2024-09-12T18:13:49.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.438+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.KH8Dq2bUI89nJDPnfmg2YIa52JhJhwC_0 2024-09-12T18:13:49.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.438+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8901944550047363425', time=2024-09-12T19:48:55.079254+0000, chain.objs.size()=1 2024-09-12T18:13:49.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.438+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.7pR9DEzzbNTE-wf0L75x4GEVFzOW_CB_0 2024-09-12T18:13:49.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.438+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9583990066891827672', time=2024-09-12T19:48:55.204172+0000, chain.objs.size()=1 2024-09-12T18:13:49.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.438+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.29p8j_CxeEMOia9unkMH1QNjUa5TuLL_0 2024-09-12T18:13:49.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.438+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17487982549187135245', time=2024-09-12T19:48:55.457780+0000, chain.objs.size()=1 2024-09-12T18:13:49.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.438+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.cahVF-2kWk86rsG9qiC21-sgaIlUG-8_0 2024-09-12T18:13:49.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.438+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15729728753135782696', time=2024-09-12T19:48:56.231779+0000, chain.objs.size()=1 2024-09-12T18:13:49.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.438+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.gUio-UuXjgjbcPh6OulWG6CuLwvJKYy_0 2024-09-12T18:13:49.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.440+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2642102275547073881', time=2024-09-12T19:48:56.813999+0000, chain.objs.size()=1 2024-09-12T18:13:49.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.440+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.S_hLt9YTVEE8vjrgr6jx754CusCmWqw_0 2024-09-12T18:13:49.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.440+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2356995197613295077', time=2024-09-12T19:48:57.579230+0000, chain.objs.size()=1 2024-09-12T18:13:49.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.440+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.iG4cjEVjaauG5aQulMYtiQTYmaWggL9_0 2024-09-12T18:13:49.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.440+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15270283720768459423', time=2024-09-12T19:48:57.862018+0000, chain.objs.size()=1 2024-09-12T18:13:49.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.440+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.9meC5rze9C38N1hoF1r5-T-S7dsZ7uZ_0 2024-09-12T18:13:49.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.440+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13435457503942474938', time=2024-09-12T19:48:58.049551+0000, chain.objs.size()=1 2024-09-12T18:13:49.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.440+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.UEzbzP58hRIJ7_2YgpBk7nGm1QaYLQ6_0 2024-09-12T18:13:49.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.440+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3484757444300820567', time=2024-09-12T19:49:10.465856+0000, chain.objs.size()=1 2024-09-12T18:13:49.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.440+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.340__shadow_.3vQh5X4-Pl65YMdE02WqpPzC7ZXjIXI_0 2024-09-12T18:13:49.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.440+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4477287270978756975', time=2024-09-12T19:49:45.720032+0000, chain.objs.size()=1 2024-09-12T18:13:49.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.440+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.382__shadow_.CrkLtacAl_ESViNSRWpgXvjtW6d8YxT_0 2024-09-12T18:13:49.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.440+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2469738531165109478', time=2024-09-12T19:49:53.917224+0000, chain.objs.size()=1 2024-09-12T18:13:49.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.440+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.391__shadow_.BowMFI3lhffv-28ArLmbPEPKQNB3VhV_0 2024-09-12T18:13:49.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.441+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12175187860700336004', time=2024-09-12T19:49:53.917956+0000, chain.objs.size()=1 2024-09-12T18:13:49.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.441+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.391__shadow_.dx37sWme18B1s69CdP0rdQcVwV0jQA3_0 2024-09-12T18:13:49.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.441+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6490480086515835170', time=2024-09-12T19:51:03.122524+0000, chain.objs.size()=1 2024-09-12T18:13:49.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.441+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.463__shadow_.EyXeq3ClpTNDiExlilnX5X8bxqzzEZ1_0 2024-09-12T18:13:49.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.441+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5104707952677138206', time=2024-09-12T19:51:18.573471+0000, chain.objs.size()=1 2024-09-12T18:13:49.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.441+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.484__shadow_.xm2WzGfeAjyfyPB2YIqrUEwtUpfcWUV_0 2024-09-12T18:13:49.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.441+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13986273805764533106', time=2024-09-12T19:51:18.574468+0000, chain.objs.size()=1 2024-09-12T18:13:49.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.441+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.484__shadow_.zkHDOl-DH2ZAVM4E6dtgle8-91vGsPW_0 2024-09-12T18:13:49.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.442+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17834327558914886276', time=2024-09-12T19:51:32.582425+0000, chain.objs.size()=1 2024-09-12T18:13:49.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.442+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.496__shadow_.STdmWA-iiuEQP-Xwf9fynizpduUnKkP_0 2024-09-12T18:13:49.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.442+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='2~vgEpqhD3u78xb3tulDrymR_3vl7NF_u', time=2024-09-12T19:53:30.323822+0000, chain.objs.size()=2 2024-09-12T18:13:49.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.442+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~vgEpqhD3u78xb3tulDrymR_3vl7NF_u.1 2024-09-12T18:13:49.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.442+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__shadow_mymultipart.2~vgEpqhD3u78xb3tulDrymR_3vl7NF_u.1_1 2024-09-12T18:13:49.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.442+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16941130281944030973', time=2024-09-12T19:54:33.421242+0000, chain.objs.size()=6 2024-09-12T18:13:49.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.442+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~oFfnDrleS9_Z1Y62Vrx2QtMY47ND3ko.1 2024-09-12T18:13:49.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.442+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~oFfnDrleS9_Z1Y62Vrx2QtMY47ND3ko.2 2024-09-12T18:13:49.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.442+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.xPFOUa__ZIuxdE7P6scIOxzQtGNb8SC-.3 2024-09-12T18:13:49.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.442+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~oFfnDrleS9_Z1Y62Vrx2QtMY47ND3ko.4 2024-09-12T18:13:49.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.443+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~oFfnDrleS9_Z1Y62Vrx2QtMY47ND3ko.5 2024-09-12T18:13:49.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.443+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~oFfnDrleS9_Z1Y62Vrx2QtMY47ND3ko.6 2024-09-12T18:13:49.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.443+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12991060406685348059', time=2024-09-12T19:55:32.570843+0000, chain.objs.size()=2 2024-09-12T18:13:49.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.443+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.526__multipart_mymultipart.2~7sTK9pAHQuAcuAUlZnoZGDOLPiixAOY.1 2024-09-12T18:13:49.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.443+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.526__multipart_mymultipart.2~7sTK9pAHQuAcuAUlZnoZGDOLPiixAOY.2 2024-09-12T18:13:49.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.445+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9417061319736656727', time=2024-09-12T19:57:28.113745+0000, chain.objs.size()=1 2024-09-12T18:13:49.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.445+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.557__shadow_.tC014km84u89aoUmt0uFmObXEn5rhf5_0 2024-09-12T18:13:49.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.445+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8981150467807647332', time=2024-09-12T19:58:36.647030+0000, chain.objs.size()=1 2024-09-12T18:13:49.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.445+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:ZWLUpOeVAwzORV4wmAzNLu5ASgB9BcR_.r8HQWmPA5sj_VShPQbLjd9uzieEcsUp_0 2024-09-12T18:13:49.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.445+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10580784966909703162', time=2024-09-12T19:59:34.716990+0000, chain.objs.size()=1 2024-09-12T18:13:49.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.445+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.584__shadow:h03P2-GxjGJBZJc6r2V52O1I65ZU39a_.KKIplxOPnR8u9hOTBrnUTl0JNeuDMBV_0 2024-09-12T18:13:49.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.445+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1404393975710485331', time=2024-09-12T19:59:37.471238+0000, chain.objs.size()=1 2024-09-12T18:13:49.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.445+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.586__shadow:rfCPV0.n-JgGen9xgKR3AvQNqfFNhbL_.BGFjqHVKjqsH5haRv3nPOcbafhV8LTR_0 2024-09-12T18:13:49.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.445+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18269114003229125823', time=2024-09-12T20:03:56.439247+0000, chain.objs.size()=1 2024-09-12T18:13:49.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.445+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.619__shadow_.5msFD3aYVvmQ9jLRxrKOybMKG9B6HJV_0 2024-09-12T18:13:49.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.445+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4514891118465824504', time=2024-09-12T20:06:41.122139+0000, chain.objs.size()=1 2024-09-12T18:13:49.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.445+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.712__multipart_file1.2~PYl668dU2o7KS_0eKOE37iPHxyZmvRH.1 2024-09-12T18:13:49.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.447+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:49.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.449+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:13:49.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.450+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:49.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.450+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:49.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.451+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51617' 2024-09-12T18:13:49.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.451+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2741538158680969246', time=2024-09-12T19:45:00.941971+0000, chain.objs.size()=1 2024-09-12T18:13:49.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.451+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.231__shadow_.CXZrIRI_uEk2ZcpK9933i6F-vfTrhbn_0 2024-09-12T18:13:49.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.451+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7341918119802802672', time=2024-09-12T19:45:04.615186+0000, chain.objs.size()=1 2024-09-12T18:13:49.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.451+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.235__shadow_.VV_A5vQk4i1evpVRu3UNfPP5V5syGuD_0 2024-09-12T18:13:49.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.451+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1888079387597606980', time=2024-09-12T19:45:18.191170+0000, chain.objs.size()=1 2024-09-12T18:13:49.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.451+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.247__shadow_.kH7ONrGgGVJJR63PCvAXM0RiqKLM3vG_0 2024-09-12T18:13:49.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.451+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6169377260974290139', time=2024-09-12T19:45:19.117376+0000, chain.objs.size()=1 2024-09-12T18:13:49.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.451+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.248__shadow_.9gZpFeYaH3Joq_-Awynqu4AHK-X7l-O_0 2024-09-12T18:13:49.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.451+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9671260166683680997', time=2024-09-12T19:45:25.492205+0000, chain.objs.size()=1 2024-09-12T18:13:49.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.451+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.255__shadow_.0OfLOZKetjaA5iXBSra1zxYeqO0XkDr_0 2024-09-12T18:13:49.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.451+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.168230952774946021', time=2024-09-12T19:45:25.492994+0000, chain.objs.size()=1 2024-09-12T18:13:49.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.451+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.255__shadow_.ax4KNe1Icf9LAkkCdgV-O3SMV-qFOQy_0 2024-09-12T18:13:49.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.451+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2092577497677571180', time=2024-09-12T19:45:28.151779+0000, chain.objs.size()=1 2024-09-12T18:13:49.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.451+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.258__shadow_.jlD4WR_0K7xykW8OCJ_onRdrZpdNpas_0 2024-09-12T18:13:49.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.451+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16172062982932644663', time=2024-09-12T19:46:09.348745+0000, chain.objs.size()=1 2024-09-12T18:13:49.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.451+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.oehQi_5b4OgTVUE1S6EJvPl1XnGjAQU_0 2024-09-12T18:13:49.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.451+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7210050300423137112', time=2024-09-12T19:46:09.651502+0000, chain.objs.size()=1 2024-09-12T18:13:49.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.451+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.vys1LjzNMMGKLfvzS4tCLZw5N3lzwh-_0 2024-09-12T18:13:49.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.451+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17844835944357194334', time=2024-09-12T19:46:10.631329+0000, chain.objs.size()=1 2024-09-12T18:13:49.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.451+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.7u5qTP5oq7XgTE--9cQCsPm8lugixT7_0 2024-09-12T18:13:49.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.451+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12119812630913428945', time=2024-09-12T19:46:11.377615+0000, chain.objs.size()=1 2024-09-12T18:13:49.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.451+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.o2vNCHebvFYvdSryUcehgMIQHy6-Pbo_0 2024-09-12T18:13:49.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.451+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1642731012793081678', time=2024-09-12T19:46:11.399144+0000, chain.objs.size()=1 2024-09-12T18:13:49.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.451+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.gDIEczhkp53zpjYW8k8x1QNAxNSkoU1_0 2024-09-12T18:13:49.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.453+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16611530065547017387', time=2024-09-12T19:46:11.879718+0000, chain.objs.size()=1 2024-09-12T18:13:49.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.453+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.3jtRlVa6vYya2lgWbEPJwNJeyUcFuyM_0 2024-09-12T18:13:49.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.453+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3287063315741545001', time=2024-09-12T19:46:11.881227+0000, chain.objs.size()=1 2024-09-12T18:13:49.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.453+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Tx2PyxAaMk9Z--shuqU-mkaCzolRfen_0 2024-09-12T18:13:49.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.453+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8926991565097383073', time=2024-09-12T19:46:12.576467+0000, chain.objs.size()=1 2024-09-12T18:13:49.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.453+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.7HzsI1u9wOWZ504BBKMobML0ZU6hgra_0 2024-09-12T18:13:49.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.453+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17759368544493208618', time=2024-09-12T19:46:12.867604+0000, chain.objs.size()=1 2024-09-12T18:13:49.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.453+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.lWytpAoU2Vysk9ohpzD6Zh2QQ8LzDex_0 2024-09-12T18:13:49.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.453+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15875075174424470486', time=2024-09-12T19:46:13.953868+0000, chain.objs.size()=1 2024-09-12T18:13:49.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.453+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.sKpUN_8BL53_Jud4CLfRdQIgG2ryVjd_0 2024-09-12T18:13:49.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.453+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.816838835288894353', time=2024-09-12T19:46:14.003997+0000, chain.objs.size()=1 2024-09-12T18:13:49.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.453+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Nlzx-MpGkQ-dJRkgL36D0eEI8fc76yg_0 2024-09-12T18:13:49.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.453+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12234247194087097084', time=2024-09-12T19:46:14.103713+0000, chain.objs.size()=1 2024-09-12T18:13:49.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.453+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.TZAwS-RM012c73qojWjQrptelXTQZlD_0 2024-09-12T18:13:49.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.453+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.148835727269967440', time=2024-09-12T19:46:14.340805+0000, chain.objs.size()=1 2024-09-12T18:13:49.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.453+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ZI4icXRRRYe8XedkqSQ5ibHUxs4B0zw_0 2024-09-12T18:13:49.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.453+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18022093629669303398', time=2024-09-12T19:46:14.783775+0000, chain.objs.size()=1 2024-09-12T18:13:49.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.453+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.n3CUEXS2Dm8TuylHvq2MhZGuMSfc-lp_0 2024-09-12T18:13:49.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.453+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9174391958189901537', time=2024-09-12T19:46:14.941007+0000, chain.objs.size()=1 2024-09-12T18:13:49.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.453+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.CheJE-I9bxrE-KJWRTbkWirMoqlHzWb_0 2024-09-12T18:13:49.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.453+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3951224027902210457', time=2024-09-12T19:46:15.428858+0000, chain.objs.size()=1 2024-09-12T18:13:49.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.453+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.y8nm6oS36CASDJrCgV0fs7i4oaXeU4Q_0 2024-09-12T18:13:49.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.455+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14631688904864801540', time=2024-09-12T19:46:15.705061+0000, chain.objs.size()=1 2024-09-12T18:13:49.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.455+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.V3zEnihn7tjbRT98CH5w6gkJ5fufu2N_0 2024-09-12T18:13:49.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.455+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11239816668445620865', time=2024-09-12T19:46:15.769850+0000, chain.objs.size()=1 2024-09-12T18:13:49.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.455+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.qgRhSLqRkMkbjdGp0wZzAOw3PKI1BxR_0 2024-09-12T18:13:49.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.455+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15632142533617178403', time=2024-09-12T19:46:16.347702+0000, chain.objs.size()=1 2024-09-12T18:13:49.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.455+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ZmCqWEziWrsWOjTIvb3k35bYB_-JmVT_0 2024-09-12T18:13:49.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.455+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6604242290920123574', time=2024-09-12T19:46:16.458451+0000, chain.objs.size()=1 2024-09-12T18:13:49.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.455+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.6IbCW8m3SiO27AvbhrqUXfOzPgOq5Ln_0 2024-09-12T18:13:49.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.455+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5627330309465135671', time=2024-09-12T19:46:16.672630+0000, chain.objs.size()=1 2024-09-12T18:13:49.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.455+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.qf0277H1BDOwr-9R36gIxTNuOde0mCS_0 2024-09-12T18:13:49.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.455+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.407555228028360487', time=2024-09-12T19:46:16.786471+0000, chain.objs.size()=1 2024-09-12T18:13:49.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.455+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Cxj3Ld8b8nhYDLo135F2_K4wpU8RqFS_0 2024-09-12T18:13:49.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.455+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2425389943104883385', time=2024-09-12T19:46:17.073527+0000, chain.objs.size()=1 2024-09-12T18:13:49.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.455+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.LhSmkMdUIMY2LG_n3o6HkUlqA6vRLji_0 2024-09-12T18:13:49.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.455+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11170833028937292732', time=2024-09-12T19:46:17.130611+0000, chain.objs.size()=1 2024-09-12T18:13:49.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.455+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.0tVLLRUGcMWmzlxEzB9z87LZmYm9d8v_0 2024-09-12T18:13:49.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.455+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13421163500406382290', time=2024-09-12T19:46:18.097751+0000, chain.objs.size()=1 2024-09-12T18:13:49.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.455+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ZJrwodd0XgQINzf5gDBru_bZPLbsWOu_0 2024-09-12T18:13:49.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.455+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6704746686526981296', time=2024-09-12T19:46:18.274517+0000, chain.objs.size()=1 2024-09-12T18:13:49.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.455+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.VqZo6XRHIbkA9jkvsEotOE08z82zRlL_0 2024-09-12T18:13:49.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.455+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1883537733379308316', time=2024-09-12T19:46:18.868254+0000, chain.objs.size()=1 2024-09-12T18:13:49.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.455+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.omwsAQz0vd3sla1ACQ016hm0wJ9-bSt_0 2024-09-12T18:13:49.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.457+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5318449158112422458', time=2024-09-12T19:46:19.227330+0000, chain.objs.size()=1 2024-09-12T18:13:49.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.457+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ZckfWdF1AS_V98K8mx-zPQ9Ki3fJWkY_0 2024-09-12T18:13:49.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.457+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15751834931672768859', time=2024-09-12T19:46:19.526661+0000, chain.objs.size()=1 2024-09-12T18:13:49.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.457+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.kdGBPKb18K7M89_gm-xnYiFQ18ns8M3_0 2024-09-12T18:13:49.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.457+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17135774371444754357', time=2024-09-12T19:46:19.591549+0000, chain.objs.size()=1 2024-09-12T18:13:49.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.457+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.-H826wmCc-KdwTjF74sd_0hOi2DIg9h_0 2024-09-12T18:13:49.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.457+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.232936685480611138', time=2024-09-12T19:46:22.219535+0000, chain.objs.size()=1 2024-09-12T18:13:49.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.457+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.266__shadow_.GmcsXO9pvEZFdu1izHewTKUvsbcxOtT_0 2024-09-12T18:13:49.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.457+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1841132397004098229', time=2024-09-12T19:46:32.833087+0000, chain.objs.size()=1 2024-09-12T18:13:49.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.457+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.278__shadow_.iSXbLIAyeYFCZIrs4j6oAjHNjxykt-f_0 2024-09-12T18:13:49.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.457+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10926075197429871965', time=2024-09-12T19:46:48.153362+0000, chain.objs.size()=1 2024-09-12T18:13:49.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.457+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.293__shadow_.0srf0qh1F-hf5noahucKsUMpx0GD5o6_0 2024-09-12T18:13:49.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.458+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4810637259392010482', time=2024-09-12T19:46:50.403714+0000, chain.objs.size()=1 2024-09-12T18:13:49.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.458+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.294__shadow_.sxmd9FItkXm8GCxC4ZurH8-B-I2Ac37_0 2024-09-12T18:13:49.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.458+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2106048149539933210', time=2024-09-12T19:46:54.095494+0000, chain.objs.size()=1 2024-09-12T18:13:49.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.458+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.298__shadow_.ueeChuQJOF08gnJ2zHZtDxRvIg6lFBG_0 2024-09-12T18:13:49.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.458+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2127043887805112644', time=2024-09-12T19:46:57.906697+0000, chain.objs.size()=1 2024-09-12T18:13:49.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.458+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.302__shadow_.2mrpPbjO78RgjzuwWzI2ED_RHg71efd_0 2024-09-12T18:13:49.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.458+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5243864715014791578', time=2024-09-12T19:47:18.735020+0000, chain.objs.size()=1 2024-09-12T18:13:49.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.458+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.320__shadow:KUYlP7G4SgVoh52P5HeY1Gcw8e8IEEH_.WKAYYzZ9txn-9tt9ik_sLueTUXekwfN_0 2024-09-12T18:13:49.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.458+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12484258739423087667', time=2024-09-12T19:47:59.450845+0000, chain.objs.size()=1 2024-09-12T18:13:49.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.458+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.F1qlyExuhAJygtawHiovnl9Hc58MAJ6_0 2024-09-12T18:13:49.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.458+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2480253509433825052', time=2024-09-12T19:47:59.451938+0000, chain.objs.size()=1 2024-09-12T18:13:49.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.458+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.tDncdjN-4PnB60g9F4ruClkz9rwaE1x_0 2024-09-12T18:13:49.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.459+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1036989408299092612', time=2024-09-12T19:47:59.894614+0000, chain.objs.size()=1 2024-09-12T18:13:49.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.459+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.XSkLutd9wiMQvSHwUKmmkCUSztAYO39_0 2024-09-12T18:13:49.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.459+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15484712437736319778', time=2024-09-12T19:48:00.158142+0000, chain.objs.size()=1 2024-09-12T18:13:49.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.459+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.byJumH5S32qa9LGutf108HiOpS2Hxsd_0 2024-09-12T18:13:49.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.459+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8470581283732920687', time=2024-09-12T19:48:00.457960+0000, chain.objs.size()=1 2024-09-12T18:13:49.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.459+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ZizVYqy7mfNVKdYWd1B03U93k_RSnv__0 2024-09-12T18:13:49.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.459+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16728648907649583201', time=2024-09-12T19:48:01.429532+0000, chain.objs.size()=1 2024-09-12T18:13:49.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.459+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.vzgrA657fT4p-ZQbzgdiwq6TH70DkXB_0 2024-09-12T18:13:49.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.460+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16766438378633323497', time=2024-09-12T19:48:01.782162+0000, chain.objs.size()=1 2024-09-12T18:13:49.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.460+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.fvfK5Spc_9lKgMc-RpPaXVsYz6wkxv6_0 2024-09-12T18:13:49.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.460+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5219196291409666724', time=2024-09-12T19:48:01.910279+0000, chain.objs.size()=1 2024-09-12T18:13:49.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.460+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.S8YFg5lwBjXB3tmnkJbvnMtbgkYPf6z_0 2024-09-12T18:13:49.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.460+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11121512088262864783', time=2024-09-12T19:48:02.687241+0000, chain.objs.size()=1 2024-09-12T18:13:49.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.460+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.H83xkMu8GOyD6fcjLAegqtjzvNaq8rT_0 2024-09-12T18:13:49.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.460+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.668253079219190178', time=2024-09-12T19:48:02.796701+0000, chain.objs.size()=1 2024-09-12T18:13:49.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.460+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Aij9yjYJrO1LVLhvERtBR5ucTnqQLyr_0 2024-09-12T18:13:49.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.460+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6144404781369993215', time=2024-09-12T19:48:03.192488+0000, chain.objs.size()=1 2024-09-12T18:13:49.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.460+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Dyg-rXbKI4OP7ktVCMVLRYZ-XCGacJE_0 2024-09-12T18:13:49.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.460+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6489972275673682460', time=2024-09-12T19:48:03.916474+0000, chain.objs.size()=1 2024-09-12T18:13:49.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.460+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.qY6jfZQhNzo1L9-ebJ3dHC12tXSZLfE_0 2024-09-12T18:13:49.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.460+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14349559435094312940', time=2024-09-12T19:48:03.917430+0000, chain.objs.size()=1 2024-09-12T18:13:49.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.460+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.vM7H_PbDHzF8E2e_jN3rgrbejEQP63p_0 2024-09-12T18:13:49.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.461+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16504148669109101737', time=2024-09-12T19:48:03.918170+0000, chain.objs.size()=1 2024-09-12T18:13:49.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.461+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.e55_AoL1naa1-RyfXbmY3ph-ZxrUN8L_0 2024-09-12T18:13:49.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.461+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10923631737054290063', time=2024-09-12T19:48:04.209961+0000, chain.objs.size()=1 2024-09-12T18:13:49.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.461+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.90vzLb21IZrrjgSKzGReorGAUmiIjHP_0 2024-09-12T18:13:49.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.461+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17577774540366131744', time=2024-09-12T19:48:04.468873+0000, chain.objs.size()=1 2024-09-12T18:13:49.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.461+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.bAlLVopY3lX6bj6kOEHfmvx0mDfBtiH_0 2024-09-12T18:13:49.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.461+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17047348519121519197', time=2024-09-12T19:48:05.311656+0000, chain.objs.size()=1 2024-09-12T18:13:49.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.461+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.DFqBSYQVzjTOi2yuqKuDnJWlfXXQOlr_0 2024-09-12T18:13:49.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.462+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12072050144202846650', time=2024-09-12T19:48:05.771617+0000, chain.objs.size()=1 2024-09-12T18:13:49.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.462+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.K6RqyFXJ6UcedBSCn-F0TEQp66b0Sku_0 2024-09-12T18:13:49.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.462+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17716634936903752045', time=2024-09-12T19:48:06.128439+0000, chain.objs.size()=1 2024-09-12T18:13:49.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.462+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.YgiEZ1kpZqxOnJXYSb3AoeCfX98iZ8u_0 2024-09-12T18:13:49.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.462+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12385754609490806260', time=2024-09-12T19:48:06.679929+0000, chain.objs.size()=1 2024-09-12T18:13:49.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.462+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.pMVs9v2xYIBmBIIx07keF8mRbPkA5ta_0 2024-09-12T18:13:49.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.462+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6249854559132846760', time=2024-09-12T19:48:07.313714+0000, chain.objs.size()=1 2024-09-12T18:13:49.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.462+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.gwI5yJTFtWCvUG3yN-uMR0tnkSCx_Ga_0 2024-09-12T18:13:49.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.462+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6432422349487904161', time=2024-09-12T19:48:08.278689+0000, chain.objs.size()=1 2024-09-12T18:13:49.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.462+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.l6Xp9Cfy1lVKuOWoebwb0wL7HCB7Kgy_0 2024-09-12T18:13:49.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.462+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17386591646065741434', time=2024-09-12T19:48:08.391344+0000, chain.objs.size()=1 2024-09-12T18:13:49.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.462+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.jmpkX0yH45QMRrriUIhmXJnnzJeEp0N_0 2024-09-12T18:13:49.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.462+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2110169482084551190', time=2024-09-12T19:48:08.451012+0000, chain.objs.size()=1 2024-09-12T18:13:49.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.462+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.gwJyR--4QTw_ACmk2mz-DBsP5Bim1b3_0 2024-09-12T18:13:49.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.463+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13591114173691675194', time=2024-09-12T19:48:08.638837+0000, chain.objs.size()=1 2024-09-12T18:13:49.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.463+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Apb4CQ8nN01FwU0c3Kpt7rSZYdxKOWN_0 2024-09-12T18:13:49.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.464+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.160765843912263648', time=2024-09-12T19:48:08.967109+0000, chain.objs.size()=1 2024-09-12T18:13:49.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.464+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.y2TzUxVYYmLAbee5_2IB30JA_estKXg_0 2024-09-12T18:13:49.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.464+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15408060329662395178', time=2024-09-12T19:48:09.304344+0000, chain.objs.size()=1 2024-09-12T18:13:49.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.464+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Ka8zucHMIKwXakU0LQHxR9BUp9asWUj_0 2024-09-12T18:13:49.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.464+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7461683240813733520', time=2024-09-12T19:48:09.748105+0000, chain.objs.size()=1 2024-09-12T18:13:49.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.464+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.0rGB_rvFtudaIpblrUVkhY7D49TcAGZ_0 2024-09-12T18:13:49.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.465+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.604963769092376589', time=2024-09-12T19:48:09.842472+0000, chain.objs.size()=1 2024-09-12T18:13:49.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.465+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.g_B9iH7Iopgnkcae5nTg3181UEYds-M_0 2024-09-12T18:13:49.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.465+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14916931204459604395', time=2024-09-12T19:48:48.370661+0000, chain.objs.size()=1 2024-09-12T18:13:49.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.465+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.ThpYB57ugmrvX4BSIs_dxzanUP_mHg8_0 2024-09-12T18:13:49.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.465+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3437691048387124110', time=2024-09-12T19:48:48.935126+0000, chain.objs.size()=1 2024-09-12T18:13:49.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.465+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.USxVrTI91P0Me_m2ptQST7p9DpB8Ul2_0 2024-09-12T18:13:49.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.465+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11467069354021896389', time=2024-09-12T19:48:49.095368+0000, chain.objs.size()=1 2024-09-12T18:13:49.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.465+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.RPBKtUO8AqDU-hREcKC9YBO6Tk4Qm5L_0 2024-09-12T18:13:49.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.465+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14123411125248564873', time=2024-09-12T19:48:49.329155+0000, chain.objs.size()=1 2024-09-12T18:13:49.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.465+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_._x13_lb7FwXnDrhNbB1Xan-ZUF1OXZA_0 2024-09-12T18:13:49.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.465+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10312093756104726734', time=2024-09-12T19:48:49.869666+0000, chain.objs.size()=1 2024-09-12T18:13:49.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.465+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.thVlI5ceyljeKtJK5LcwfbWfAZls157_0 2024-09-12T18:13:49.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.465+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9008712306820802525', time=2024-09-12T19:48:51.046135+0000, chain.objs.size()=1 2024-09-12T18:13:49.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.465+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.CdzEg-Jp3iwLOjmbyxo7sR5fleF3mvV_0 2024-09-12T18:13:49.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.465+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9431042075971655271', time=2024-09-12T19:48:51.346757+0000, chain.objs.size()=1 2024-09-12T18:13:49.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.465+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.o3h2jRR5BhhendkJ9CbwEB8Ycx5DyFE_0 2024-09-12T18:13:49.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.465+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2443412505647707607', time=2024-09-12T19:48:51.490562+0000, chain.objs.size()=1 2024-09-12T18:13:49.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.465+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.oiWxG2w9KPyExEfJkoyVLQmtFKIY9gc_0 2024-09-12T18:13:49.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.466+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6207441648523538942', time=2024-09-12T19:48:52.267721+0000, chain.objs.size()=1 2024-09-12T18:13:49.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.466+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.br8zfj3Inoe6QXV1pXdqfV519YJsHAD_0 2024-09-12T18:13:49.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.466+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3232616710248091879', time=2024-09-12T19:48:52.268415+0000, chain.objs.size()=1 2024-09-12T18:13:49.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.466+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.TFR3ubIPZMgDRUqhWNO7bz6iGX1dkba_0 2024-09-12T18:13:49.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.466+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.346325815368702117', time=2024-09-12T19:48:52.888913+0000, chain.objs.size()=1 2024-09-12T18:13:49.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.466+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.o6-ItNZF_pz3P3YwStCOTtWye_1YCLU_0 2024-09-12T18:13:49.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.467+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3798562434084985107', time=2024-09-12T19:48:52.907364+0000, chain.objs.size()=1 2024-09-12T18:13:49.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.467+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.aT7-5aQ2M2UgBqNnICxsrIUJyMAVqzv_0 2024-09-12T18:13:49.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.467+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1936555606821296508', time=2024-09-12T19:48:53.302828+0000, chain.objs.size()=1 2024-09-12T18:13:49.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.467+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.maoAzVqBNqrrtWNOTZoKxpoA9U5dFay_0 2024-09-12T18:13:49.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.467+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5082184476147092377', time=2024-09-12T19:48:53.647120+0000, chain.objs.size()=1 2024-09-12T18:13:49.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.467+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.tpMRFBDTbWuHtG7jwzavJdpkO7zJxMO_0 2024-09-12T18:13:49.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.467+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12541343044560612894', time=2024-09-12T19:48:53.713856+0000, chain.objs.size()=1 2024-09-12T18:13:49.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.467+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.-5YDCjNsAwq7LmkwoulhStbOXnpFZP2_0 2024-09-12T18:13:49.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.467+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14516115867948413210', time=2024-09-12T19:48:53.840751+0000, chain.objs.size()=1 2024-09-12T18:13:49.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.467+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.zTwt7L40E5LZ6RBNt1IcO6NYRTOrzSp_0 2024-09-12T18:13:49.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.467+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4124923339323504097', time=2024-09-12T19:48:53.841552+0000, chain.objs.size()=1 2024-09-12T18:13:49.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.467+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.tBAUUwS8ojld_aW8HZEWYrI4Sb3br41_0 2024-09-12T18:13:49.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.467+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12861762604177960597', time=2024-09-12T19:48:53.842406+0000, chain.objs.size()=1 2024-09-12T18:13:49.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.467+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.5xnctcLRoR7OkkmA2xQY0UHVojDl2B-_0 2024-09-12T18:13:49.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.467+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4176567014340530841', time=2024-09-12T19:48:53.897806+0000, chain.objs.size()=1 2024-09-12T18:13:49.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.467+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.mEuqzNWtEi6AJPXVZahUFcGRY1UZACK_0 2024-09-12T18:13:49.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.467+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7435913218196150132', time=2024-09-12T19:48:54.084867+0000, chain.objs.size()=1 2024-09-12T18:13:49.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.467+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.A47NnE9MhleOijwmzIqzjNZ--NXT0nC_0 2024-09-12T18:13:49.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.467+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13288213987195990665', time=2024-09-12T19:48:54.257692+0000, chain.objs.size()=1 2024-09-12T18:13:49.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.468+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.olgzEyPMXNX-hSH6PzLFxQC5hqO3e8W_0 2024-09-12T18:13:49.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.468+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5127282282017927881', time=2024-09-12T19:48:54.834420+0000, chain.objs.size()=1 2024-09-12T18:13:49.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.468+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.NSAvsOePc01nsL79LvSqDu_lUzwwYNY_0 2024-09-12T18:13:49.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.469+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6098583149733938184', time=2024-09-12T19:48:55.560791+0000, chain.objs.size()=1 2024-09-12T18:13:49.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.469+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Fxy11VTCqaCsbuJS05eEQe1ZOc7JzT7_0 2024-09-12T18:13:49.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.469+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9518263403880720513', time=2024-09-12T19:48:56.133468+0000, chain.objs.size()=1 2024-09-12T18:13:49.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.469+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_._cDY03iPovGm9JqFelETCr9GCNzRhi9_0 2024-09-12T18:13:49.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.469+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3541496637525530076', time=2024-09-12T19:48:56.299009+0000, chain.objs.size()=1 2024-09-12T18:13:49.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.469+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.TbavYuxhp6at2i93O8h-iaF_fBxVfuz_0 2024-09-12T18:13:49.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.469+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17895589879871486418', time=2024-09-12T19:48:56.373795+0000, chain.objs.size()=1 2024-09-12T18:13:49.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.469+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.4ihuJKzjJIklVpWh90Ci6GdkTe6923D_0 2024-09-12T18:13:49.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.469+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7352704033171170085', time=2024-09-12T19:48:56.628079+0000, chain.objs.size()=1 2024-09-12T18:13:49.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.469+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.OSB7_FfGvxdUOGfXGRZcWxwOWIde94e_0 2024-09-12T18:13:49.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.471+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/51617 2024-09-12T18:13:49.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.473+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T18:13:49.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.473+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2972773297947550434', time=2024-09-12T19:48:56.628965+0000, chain.objs.size()=1 2024-09-12T18:13:49.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.473+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.cv8m5eAATK3h2EJMufLrCgm7MmKjLsl_0 2024-09-12T18:13:49.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.473+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14118423991388761824', time=2024-09-12T19:48:56.866808+0000, chain.objs.size()=1 2024-09-12T18:13:49.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.473+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.GfZYuQo2VcNof1bPuecSyJ2gpqVajWP_0 2024-09-12T18:13:49.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.473+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1760320767385016756', time=2024-09-12T19:48:57.586086+0000, chain.objs.size()=1 2024-09-12T18:13:49.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.473+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.pgn6RMHosHO-LzBmLrjSEMbAVXSpK0H_0 2024-09-12T18:13:49.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.473+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4857222039674079923', time=2024-09-12T19:48:57.646525+0000, chain.objs.size()=1 2024-09-12T18:13:49.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.473+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.QTLsK8Cy3YEn7MTu9k04x6rBXizzJPd_0 2024-09-12T18:13:49.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.473+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4657570728594332934', time=2024-09-12T19:48:57.722216+0000, chain.objs.size()=1 2024-09-12T18:13:49.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.473+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.s7ZcK6BbU_PZ92-Wce3dbZKWHOdDZtT_0 2024-09-12T18:13:49.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.473+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9200933038697684540', time=2024-09-12T19:48:57.723189+0000, chain.objs.size()=1 2024-09-12T18:13:49.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.473+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.wrzITkrOH19Hw0bULeQBU4REM9R9LeM_0 2024-09-12T18:13:49.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.473+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2747822724267040352', time=2024-09-12T19:48:57.911901+0000, chain.objs.size()=1 2024-09-12T18:13:49.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.473+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.6KBJ44fEU2WwH9LH9M30R7nMQCcsYPq_0 2024-09-12T18:13:49.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.473+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17970680443728413497', time=2024-09-12T19:48:58.002071+0000, chain.objs.size()=1 2024-09-12T18:13:49.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.473+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.4J26HpEfBKxYP3gK7VdO6GSCjSekEaT_0 2024-09-12T18:13:49.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.473+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12048771842738525433', time=2024-09-12T19:48:58.003133+0000, chain.objs.size()=1 2024-09-12T18:13:49.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.473+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Y8OktnukC_eW2MqtPW4m_DulbJH4c8r_0 2024-09-12T18:13:49.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.473+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8604009906441910677', time=2024-09-12T19:48:58.045027+0000, chain.objs.size()=1 2024-09-12T18:13:49.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.473+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.dyF3xRr8LCJ4vWWOx5ktEZnszmvlqnb_0 2024-09-12T18:13:49.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.473+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2781835248763825272', time=2024-09-12T19:49:22.116201+0000, chain.objs.size()=1 2024-09-12T18:13:49.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.473+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.354__shadow_.AGHoE5vxj5tkys5AZ0FJjDk9mUR28Gc_0 2024-09-12T18:13:49.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.473+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7972488673560811954', time=2024-09-12T19:49:43.694746+0000, chain.objs.size()=1 2024-09-12T18:13:49.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.473+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.380__shadow_.31t-TyihQU8cSSg6sL_E3IIGhFIaa89_0 2024-09-12T18:13:49.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.475+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6090604144012836105', time=2024-09-12T19:51:07.712338+0000, chain.objs.size()=1 2024-09-12T18:13:49.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.475+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.467__shadow_.xlk696igj_o6e4AtgYFMa4NtLyzIZbb_0 2024-09-12T18:13:49.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.475+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2777066449127578280', time=2024-09-12T19:51:19.635175+0000, chain.objs.size()=1 2024-09-12T18:13:49.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.475+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.485__shadow_.ROHTxNDjthhL2H6mGx66Cf_itKv0R3x_0 2024-09-12T18:13:49.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.475+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3139412613581634239', time=2024-09-12T19:52:29.883158+0000, chain.objs.size()=1 2024-09-12T18:13:49.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.476+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.519__multipart_mymultipart.2~-uO_Tp8Kxf7pzoCq61ZNTVR0x8aaJ4g.1 2024-09-12T18:13:49.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.476+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11033849330898166320', time=2024-09-12T19:56:36.652564+0000, chain.objs.size()=1 2024-09-12T18:13:49.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.476+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.538__shadow_._e_dscfbEDomcsHTmwaHgJkgeB2Fjnj_0 2024-09-12T18:13:49.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.476+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7706346824968773476', time=2024-09-12T19:57:26.381165+0000, chain.objs.size()=2 2024-09-12T18:13:49.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.476+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.556__shadow_.zBla7-e_OeiKBJ43gRo7_YHoxnCEqdL_0 2024-09-12T18:13:49.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.476+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.556__shadow_.zBla7-e_OeiKBJ43gRo7_YHoxnCEqdL_1 2024-09-12T18:13:49.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.476+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5928848495666729809', time=2024-09-12T19:57:44.102237+0000, chain.objs.size()=1 2024-09-12T18:13:49.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.476+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.563__shadow_.jCaFJDNcelbcPnnJLBibpHDQhztAJVJ_0 2024-09-12T18:13:49.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.476+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10174009833453448514', time=2024-09-12T19:58:01.107003+0000, chain.objs.size()=1 2024-09-12T18:13:49.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.476+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:mQIuFD3BOy8m5sv2Il2arRplD4gMe4R_.iLddbkn7Pe82ADdQwzlmMuGh09VCtz4_0 2024-09-12T18:13:49.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.476+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5286856866626319792', time=2024-09-12T19:58:17.754642+0000, chain.objs.size()=1 2024-09-12T18:13:49.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.476+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.575__shadow:TAo6.TIkKqa0mjlnD-zWUyeY75w2uoI_.-qN4Xk3wfTQSm18gocAoHy3lM5VymuP_0 2024-09-12T18:13:49.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.476+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13427242655426606687', time=2024-09-12T19:59:32.330033+0000, chain.objs.size()=1 2024-09-12T18:13:49.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.476+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.581__shadow:txwT6n29sKsEo.QjcF-goizg3IHoYVA_.Lu0pkJi7CcsEBws6jASd7-1rCe4k6na_0 2024-09-12T18:13:49.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.476+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.481789939939684440', time=2024-09-12T19:59:57.203893+0000, chain.objs.size()=1 2024-09-12T18:13:49.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.476+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.608__shadow_.mykje4tY5OC3sW792RwNJMBEo9Xa5tN_0 2024-09-12T18:13:49.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.479+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12602523092627358153', time=2024-09-12T20:05:18.783238+0000, chain.objs.size()=1 2024-09-12T18:13:49.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.479+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.648__shadow_.gGeJtMpkAXFYHOIVIBYyn_PwWgaT2Bp_0 2024-09-12T18:13:49.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.479+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9942309002271116111', time=2024-09-12T20:06:00.096002+0000, chain.objs.size()=6 2024-09-12T18:13:49.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.479+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.661__multipart_bar.2~In5tjylgstAdqv6Tdd9ZlnnfM-eXNtk.1 2024-09-12T18:13:49.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.479+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.661__multipart_bar.2~In5tjylgstAdqv6Tdd9ZlnnfM-eXNtk.2 2024-09-12T18:13:49.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.479+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.661__multipart_bar.2~In5tjylgstAdqv6Tdd9ZlnnfM-eXNtk.3 2024-09-12T18:13:49.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.479+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.661__multipart_bar.2~In5tjylgstAdqv6Tdd9ZlnnfM-eXNtk.4 2024-09-12T18:13:49.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.479+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.661__multipart_bar.2~In5tjylgstAdqv6Tdd9ZlnnfM-eXNtk.5 2024-09-12T18:13:49.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.479+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.661__multipart_bar.2~In5tjylgstAdqv6Tdd9ZlnnfM-eXNtk.6 2024-09-12T18:13:49.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.479+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8905654354932655756', time=2024-09-12T20:06:01.687085+0000, chain.objs.size()=1 2024-09-12T18:13:49.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.479+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.664__shadow_.yiun23cW3LHt7qAtAVYaj9RE4MKi8Al_0 2024-09-12T18:13:49.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.479+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12961730384519089520', time=2024-09-12T20:07:30.533107+0000, chain.objs.size()=10 2024-09-12T18:13:49.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.479+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.736__multipart_foo.2~wBHqVc55wyOHtWj4rnguUH6sxxhigG8.1 2024-09-12T18:13:49.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.479+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.736__multipart_foo.2~wBHqVc55wyOHtWj4rnguUH6sxxhigG8.2 2024-09-12T18:13:49.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.479+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.736__multipart_foo.2~wBHqVc55wyOHtWj4rnguUH6sxxhigG8.3 2024-09-12T18:13:49.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.481+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.736__multipart_foo.2~wBHqVc55wyOHtWj4rnguUH6sxxhigG8.4 2024-09-12T18:13:49.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.481+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.736__multipart_foo.2~wBHqVc55wyOHtWj4rnguUH6sxxhigG8.5 2024-09-12T18:13:49.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.481+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.736__multipart_foo.2~wBHqVc55wyOHtWj4rnguUH6sxxhigG8.6 2024-09-12T18:13:49.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.481+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.736__multipart_foo.2~wBHqVc55wyOHtWj4rnguUH6sxxhigG8.7 2024-09-12T18:13:49.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.481+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.736__multipart_foo.2~wBHqVc55wyOHtWj4rnguUH6sxxhigG8.8 2024-09-12T18:13:49.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.481+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.736__multipart_foo.2~wBHqVc55wyOHtWj4rnguUH6sxxhigG8.9 2024-09-12T18:13:49.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.481+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.736__multipart_foo.2~wBHqVc55wyOHtWj4rnguUH6sxxhigG8.10 2024-09-12T18:13:49.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.483+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:49.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.485+0000 7f35f5b26800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:13:49.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.487+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:13:49.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.487+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:13:49.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.488+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48847' 2024-09-12T18:13:49.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.488+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13841698685033579314', time=2024-09-12T19:45:09.656181+0000, chain.objs.size()=1 2024-09-12T18:13:49.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.488+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.239__shadow_.Fw0w7IG4TExzGMdnADONoUfui3Ixulq_0 2024-09-12T18:13:49.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.488+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13886860495007899224', time=2024-09-12T19:45:17.234205+0000, chain.objs.size()=1 2024-09-12T18:13:49.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.488+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.246__shadow_.10v0xbFR1P2PSbCMtaIBYS_SvSut5xk_0 2024-09-12T18:13:49.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.488+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4929751887483190847', time=2024-09-12T19:46:08.966394+0000, chain.objs.size()=1 2024-09-12T18:13:49.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.488+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.Es6HlIpcHpqdAfD1mrnDsjy2ds2KXjP_0 2024-09-12T18:13:49.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.488+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3887728931396987690', time=2024-09-12T19:46:09.131216+0000, chain.objs.size()=1 2024-09-12T18:13:49.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.488+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.QgptcBmDFBnB3vSx2gInWwgiW6XEiFM_0 2024-09-12T18:13:49.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.488+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.685523045933226032', time=2024-09-12T19:46:09.198319+0000, chain.objs.size()=1 2024-09-12T18:13:49.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.488+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_._D9rVYNPTwzhEfUYLtEcUfbopUdcWxy_0 2024-09-12T18:13:49.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.488+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10984216976888031129', time=2024-09-12T19:46:09.262114+0000, chain.objs.size()=1 2024-09-12T18:13:49.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.488+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.k8hganvw6n02cjnJ9kvKvrBh7yWGPEN_0 2024-09-12T18:13:49.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.488+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.12964012756590674180', time=2024-09-12T19:46:09.290392+0000, chain.objs.size()=1 2024-09-12T18:13:49.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.488+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.MCAfU3_HkCal-QrxJDx7h5ZbizYHVjw_0 2024-09-12T18:13:49.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.488+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11516291236942912001', time=2024-09-12T19:46:09.604119+0000, chain.objs.size()=1 2024-09-12T18:13:49.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.488+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.lHfqxZVkJ_klTaO66jyTHLNdcRlk-QZ_0 2024-09-12T18:13:49.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.488+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5093435100023520790', time=2024-09-12T19:46:09.812855+0000, chain.objs.size()=1 2024-09-12T18:13:49.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.488+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.NwGeHX8lxijrW_ZjMocEkAbiYUbgSG__0 2024-09-12T18:13:49.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.488+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9671497991621365288', time=2024-09-12T19:46:10.511810+0000, chain.objs.size()=1 2024-09-12T18:13:49.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.488+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.jmwXaJv264KFeRSwEvyqfva8vJanwWX_0 2024-09-12T18:13:49.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.488+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14156609736336110110', time=2024-09-12T19:46:10.512562+0000, chain.objs.size()=1 2024-09-12T18:13:49.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.488+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.jq18rt-QCJakzXzqIQcCqxhs3X2OGdP_0 2024-09-12T18:13:49.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.488+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11457918644136047591', time=2024-09-12T19:46:10.875823+0000, chain.objs.size()=1 2024-09-12T18:13:49.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.488+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ZeScs95hO3JuCcC4sI6FU0weomrvF_c_0 2024-09-12T18:13:49.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.490+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11365751579733411781', time=2024-09-12T19:46:11.085607+0000, chain.objs.size()=1 2024-09-12T18:13:49.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.490+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.PJ01ut3AnyR3rwLPf3U99HCqk2L_3b6_0 2024-09-12T18:13:49.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.490+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.917547559121353666', time=2024-09-12T19:46:11.860086+0000, chain.objs.size()=1 2024-09-12T18:13:49.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.490+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.CqKhJP_WlF8c1rfvfZNTnYBT3UYFwUO_0 2024-09-12T18:13:49.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.491+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6825104902065554843', time=2024-09-12T19:46:12.199811+0000, chain.objs.size()=1 2024-09-12T18:13:49.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.491+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.62NSCdUbn64OJwSrwqSngewjRhlDoET_0 2024-09-12T18:13:49.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.491+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17719137511524303678', time=2024-09-12T19:46:12.223179+0000, chain.objs.size()=1 2024-09-12T18:13:49.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.491+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.fTNelZBcEmOwLZ2-BetKRKFI-DURwyr_0 2024-09-12T18:13:49.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.491+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6556523875213837745', time=2024-09-12T19:46:12.363085+0000, chain.objs.size()=1 2024-09-12T18:13:49.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.491+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.25PIR407U2D8_4zRww9G49iUiCPpF0Z_0 2024-09-12T18:13:49.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.491+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6667550576360939871', time=2024-09-12T19:46:13.335405+0000, chain.objs.size()=1 2024-09-12T18:13:49.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.491+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.AV0LCp6CokqTLUbP0H6fXYVPvdscx0p_0 2024-09-12T18:13:49.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.491+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15359519741260127428', time=2024-09-12T19:46:13.357244+0000, chain.objs.size()=1 2024-09-12T18:13:49.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.491+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.MAxWUhLGJlO6uMGj_5HQnjecm5DwuYP_0 2024-09-12T18:13:49.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.491+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18061892933442121318', time=2024-09-12T19:46:13.357961+0000, chain.objs.size()=1 2024-09-12T18:13:49.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.491+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.6ehsNOiviNwJHyQqJkTITliUAX4eOTO_0 2024-09-12T18:13:49.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.491+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14940186065956481117', time=2024-09-12T19:46:14.282002+0000, chain.objs.size()=1 2024-09-12T18:13:49.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.491+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.G6LuPj1PKxsLA7Z94qyXDjDI3Ih4UUV_0 2024-09-12T18:13:49.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.491+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6601898373633056387', time=2024-09-12T19:46:15.133951+0000, chain.objs.size()=1 2024-09-12T18:13:49.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.491+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.krTnhc7L02Rr19b2aeq2h7A9rZOHcnd_0 2024-09-12T18:13:49.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.491+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5890515481580799336', time=2024-09-12T19:46:15.151227+0000, chain.objs.size()=1 2024-09-12T18:13:49.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.491+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.XeVnkZY2RDFzvpzOrVfkLzICMy8Dc-y_0 2024-09-12T18:13:49.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.491+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5390778712849266172', time=2024-09-12T19:46:15.306351+0000, chain.objs.size()=1 2024-09-12T18:13:49.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.491+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.IgD-yEBL2aY0OEUU_AP1CZyk0_H49Bv_0 2024-09-12T18:13:49.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.491+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16132062389647349341', time=2024-09-12T19:46:16.438002+0000, chain.objs.size()=1 2024-09-12T18:13:49.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.491+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.KMM9cNzYka-AUU-YysAST2KAMmIuR6D_0 2024-09-12T18:13:49.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.492+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3433504094671163809', time=2024-09-12T19:46:16.575509+0000, chain.objs.size()=1 2024-09-12T18:13:49.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.492+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.zu0WRE6XrEdDZFf6wUCtlCC4lbSFaW2_0 2024-09-12T18:13:49.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.493+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16549077999274381679', time=2024-09-12T19:46:16.576188+0000, chain.objs.size()=1 2024-09-12T18:13:49.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.493+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ItxA0Ais_Th0o5xAnHdEZEDdGosSiFn_0 2024-09-12T18:13:49.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.493+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1024345827581245796', time=2024-09-12T19:46:16.658716+0000, chain.objs.size()=1 2024-09-12T18:13:49.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.493+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.ba8xCeAQ9HVB8cVPxg3C3cwH45r7IAS_0 2024-09-12T18:13:49.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.493+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6098234657655409444', time=2024-09-12T19:46:16.978976+0000, chain.objs.size()=1 2024-09-12T18:13:49.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.493+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.mW9X-Be9Tl10o-oL2V60ysrZyg7Yg6p_0 2024-09-12T18:13:49.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.493+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7211666801324227356', time=2024-09-12T19:46:17.783030+0000, chain.objs.size()=1 2024-09-12T18:13:49.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.493+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.mevIgCNePKeeO9idmkJQdOaFfIkzk63_0 2024-09-12T18:13:49.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.493+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11846764124509059803', time=2024-09-12T19:46:17.834178+0000, chain.objs.size()=1 2024-09-12T18:13:49.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.493+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.SeAbp78ZwRnQxp0XWUVOcuw_FIbU_jd_0 2024-09-12T18:13:49.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.493+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11828650578814526524', time=2024-09-12T19:46:17.834989+0000, chain.objs.size()=1 2024-09-12T18:13:49.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.493+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.w9Q3WnH4vpe5HZLWZxXbFbWZ8PUb02w_0 2024-09-12T18:13:49.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.493+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8063076496195217070', time=2024-09-12T19:46:17.988131+0000, chain.objs.size()=1 2024-09-12T18:13:49.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.493+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.xwfjh0-P72GehQ6SSq-j8NqA7jqZn_W_0 2024-09-12T18:13:49.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.493+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.545972369734945711', time=2024-09-12T19:46:18.054813+0000, chain.objs.size()=1 2024-09-12T18:13:49.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.493+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.jxp5X5BsMmS_IJT84KtCoy0IGBxPpkf_0 2024-09-12T18:13:49.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.493+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4391231883343205794', time=2024-09-12T19:46:18.370442+0000, chain.objs.size()=1 2024-09-12T18:13:49.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.493+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.xEo-4VeYAJklvedn0vxKDM2eMwu6O1G_0 2024-09-12T18:13:49.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.493+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18281077318080941764', time=2024-09-12T19:46:18.722882+0000, chain.objs.size()=1 2024-09-12T18:13:49.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.493+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.eHpAhkIQtB_dUY7cVlsidL44NzE-zCH_0 2024-09-12T18:13:49.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.494+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5214372816411886352', time=2024-09-12T19:46:19.059439+0000, chain.objs.size()=1 2024-09-12T18:13:49.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.494+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.xar46LHsb5L2lpMtoNJPllVlY3UFYyo_0 2024-09-12T18:13:49.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.495+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7469587678876606080', time=2024-09-12T19:46:19.447944+0000, chain.objs.size()=1 2024-09-12T18:13:49.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.495+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.V_7TYzpqXhgyViy6x3FJku1K_zzJzVg_0 2024-09-12T18:13:49.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.495+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17892333833241944787', time=2024-09-12T19:46:19.448664+0000, chain.objs.size()=1 2024-09-12T18:13:49.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.495+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.CrXfVCiRyWytv5q0DLmBT3Ti4rxHywR_0 2024-09-12T18:13:49.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.495+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16693901555742741229', time=2024-09-12T19:46:19.587374+0000, chain.objs.size()=1 2024-09-12T18:13:49.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.495+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.263__shadow_.IJc0Sv7zTsVhA6mRJ-SGry5bvSWScWM_0 2024-09-12T18:13:49.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.495+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18184619249270380091', time=2024-09-12T19:46:48.215442+0000, chain.objs.size()=1 2024-09-12T18:13:49.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.495+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.293__shadow_.PbQ26Exo-iQB-4KTjqWkiY1tLHKu_YX_0 2024-09-12T18:13:49.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.496+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1712176614008890971', time=2024-09-12T19:46:50.402087+0000, chain.objs.size()=1 2024-09-12T18:13:49.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.496+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.294__shadow_.pWaBmANvDY36IXk1qTO3SWQh7nmdMlw_0 2024-09-12T18:13:49.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.496+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9672053571463594530', time=2024-09-12T19:46:56.076650+0000, chain.objs.size()=1 2024-09-12T18:13:49.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.496+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.300__shadow_.pQeqWuW9oOc0XK0MAlUd9wovDveso7x_0 2024-09-12T18:13:49.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.496+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18198601596803214308', time=2024-09-12T19:47:01.568568+0000, chain.objs.size()=1 2024-09-12T18:13:49.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.496+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.306__shadow_.IFSQQorknruUuarMPupY96QR1G5WN-q_0 2024-09-12T18:13:49.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.496+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16157020581931132456', time=2024-09-12T19:47:09.450288+0000, chain.objs.size()=1 2024-09-12T18:13:49.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.496+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.314__shadow_.zBE9iJYY0Zoy3c_ghtCtIWum92jUzUC_0 2024-09-12T18:13:49.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.496+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4621143200250468815', time=2024-09-12T19:47:59.449919+0000, chain.objs.size()=1 2024-09-12T18:13:49.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.496+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ETGWVeo1gwFeValXsTvCPyNt8Z4r34E_0 2024-09-12T18:13:49.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.496+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7908797808766776448', time=2024-09-12T19:47:59.472929+0000, chain.objs.size()=1 2024-09-12T18:13:49.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.496+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Npad8sK1JKM6147fFceQHYxb5xSrzXo_0 2024-09-12T18:13:49.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.496+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16366740605652924836', time=2024-09-12T19:47:59.473661+0000, chain.objs.size()=1 2024-09-12T18:13:49.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.496+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.d979wk364N0aSEkTeE4BFJMJpc0pd0e_0 2024-09-12T18:13:49.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.496+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5017607425963571926', time=2024-09-12T19:47:59.673100+0000, chain.objs.size()=1 2024-09-12T18:13:49.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.496+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.8ZKbjdCyQJpOi10jK2xscwwoi7QxZYB_0 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.496+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7632937210649031624', time=2024-09-12T19:47:59.897706+0000, chain.objs.size()=1 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.496+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.lL8RcXnMsZuSnL4kWxIu6hyGyFIuqw6_0 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.498+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3245909568400432780', time=2024-09-12T19:47:59.898499+0000, chain.objs.size()=1 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.498+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.fi0M8-lcgZ50mkUkvguSjIvvRWIrvsI_0 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.498+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4259390879801713651', time=2024-09-12T19:48:00.309264+0000, chain.objs.size()=1 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.498+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.X6zeRMksnHvTl1DpjHWVFBswhiW82fJ_0 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.498+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17678656423602617806', time=2024-09-12T19:48:01.122528+0000, chain.objs.size()=1 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.498+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_._uSXDQ8_3rq6r8bUKe3Em8nbx1XIFnr_0 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.498+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10896859108752646888', time=2024-09-12T19:48:01.166460+0000, chain.objs.size()=1 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.498+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.2p1Pi9dWlL-8kNxHnhVIeQwP47wBPkh_0 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.498+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17549904779852989081', time=2024-09-12T19:48:01.412760+0000, chain.objs.size()=1 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.498+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.SBrXi4S1FpM9DD3Z2nb8BE45KcCzwH7_0 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.498+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7185147588813557252', time=2024-09-12T19:48:01.446766+0000, chain.objs.size()=1 2024-09-12T18:13:49.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.498+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.V-Yc8VtzR35TPY9ZdFB-1TJtqJHOoGV_0 2024-09-12T18:13:49.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.498+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14265420829053210893', time=2024-09-12T19:48:01.712847+0000, chain.objs.size()=1 2024-09-12T18:13:49.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.498+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.QczaZcmhzflwx0tYyAEbD5pyefbGNb4_0 2024-09-12T18:13:49.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.498+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13379880516488008529', time=2024-09-12T19:48:02.646220+0000, chain.objs.size()=1 2024-09-12T18:13:49.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.498+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.hXRhm0Un6QEn39mIWAKgfma4ADeMoFr_0 2024-09-12T18:13:49.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.498+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8493921229197745269', time=2024-09-12T19:48:02.756000+0000, chain.objs.size()=1 2024-09-12T18:13:49.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.498+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.KemaCWqdfEu6olpfoPuuQY6eaoYfV8T_0 2024-09-12T18:13:49.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.498+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1787646364168321519', time=2024-09-12T19:48:02.866494+0000, chain.objs.size()=1 2024-09-12T18:13:49.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.499+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.-MnDfmnw1MiGgZ2qCP3ZY7VoEqQGbOY_0 2024-09-12T18:13:49.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.499+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8865891973135126265', time=2024-09-12T19:48:03.445985+0000, chain.objs.size()=1 2024-09-12T18:13:49.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.499+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.s7zxTdc8xAZ0CvCftyXN8THRdQSGQHJ_0 2024-09-12T18:13:49.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.499+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10809075749909991592', time=2024-09-12T19:48:04.332680+0000, chain.objs.size()=1 2024-09-12T18:13:49.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.499+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.tAgpNxZyNKPTAv8qJJ2lb5doqH9GA1e_0 2024-09-12T18:13:49.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.499+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10913590321290502755', time=2024-09-12T19:48:04.402868+0000, chain.objs.size()=1 2024-09-12T18:13:49.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.499+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.TivSJr0QU5oBD_uy65Uu4gxaBdICt-3_0 2024-09-12T18:13:49.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.499+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3219156450140421916', time=2024-09-12T19:48:04.500522+0000, chain.objs.size()=1 2024-09-12T18:13:49.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.499+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_._sLm9QvlvfNul0_NX9WPR0c-RiPg2PH_0 2024-09-12T18:13:49.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.500+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4744998416264428305', time=2024-09-12T19:48:04.690438+0000, chain.objs.size()=1 2024-09-12T18:13:49.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.500+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ksv3posFBD6hNtWoXOqKcS1uYzS4kgx_0 2024-09-12T18:13:49.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.500+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5899753850287639141', time=2024-09-12T19:48:04.691169+0000, chain.objs.size()=1 2024-09-12T18:13:49.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.500+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.k1IiWSVJOexSQtwFXbPwh_LpxMuYbht_0 2024-09-12T18:13:49.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.500+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2028987861759889188', time=2024-09-12T19:48:04.713812+0000, chain.objs.size()=1 2024-09-12T18:13:49.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.500+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.Na4-XeGMHDY5lopVfwolPlYqKrIma9y_0 2024-09-12T18:13:49.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.500+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3064354657371585512', time=2024-09-12T19:48:04.892474+0000, chain.objs.size()=1 2024-09-12T18:13:49.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.500+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.u00uabogdsNEaWpR37W4TWxQSdL49BG_0 2024-09-12T18:13:49.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.500+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7486442188005470489', time=2024-09-12T19:48:05.305075+0000, chain.objs.size()=1 2024-09-12T18:13:49.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.500+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.9YeMB_GPNijPZbs8aaHIWE7KPvTPlVP_0 2024-09-12T18:13:49.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.501+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9730794746215725495', time=2024-09-12T19:48:05.526097+0000, chain.objs.size()=1 2024-09-12T18:13:49.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.501+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.cPL847rXR2ieP4jGhDWNPR1A0sjcQqe_0 2024-09-12T18:13:49.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.501+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3409060930978555937', time=2024-09-12T19:48:05.611608+0000, chain.objs.size()=1 2024-09-12T18:13:49.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.501+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.NlvhEZSBrBGgK_N3s6NMIOQjX2D1RqI_0 2024-09-12T18:13:49.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.502+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5578760628874231130', time=2024-09-12T19:48:06.991962+0000, chain.objs.size()=1 2024-09-12T18:13:49.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.502+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.NdRYk7NxNO40oy1_Rt12AzZ5Ff5PhtP_0 2024-09-12T18:13:49.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.502+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8050114993067789969', time=2024-09-12T19:48:07.971625+0000, chain.objs.size()=1 2024-09-12T18:13:49.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.502+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.RCWcVuXANCVN6ahSaQBgVIOkJ8xQEq9_0 2024-09-12T18:13:49.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.502+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1108360598008708792', time=2024-09-12T19:48:08.262478+0000, chain.objs.size()=1 2024-09-12T18:13:49.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.502+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.-gc0DBrSc9xU2LgaDjIxhpAK7hO-vYR_0 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.502+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.16824510156019199414', time=2024-09-12T19:48:08.523802+0000, chain.objs.size()=1 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.502+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.melASoc32wzvc6IJXq0H-yUk1qh6Tyy_0 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.502+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4439410059569008458', time=2024-09-12T19:48:08.568997+0000, chain.objs.size()=1 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.502+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.WUMWvWrZqBOEKiLqksTi0X-bNBpOKJW_0 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.502+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17513031445447568527', time=2024-09-12T19:48:08.721231+0000, chain.objs.size()=1 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.502+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.6Q0Mb9fjPugSgMGhpDWTZwko7PLZprL_0 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.502+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7753060410180530210', time=2024-09-12T19:48:09.286928+0000, chain.objs.size()=1 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.502+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.ED1hO92F62rtJ15LTYUKueXFYREfgpe_0 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.503+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2937188962034102200', time=2024-09-12T19:48:09.306699+0000, chain.objs.size()=1 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.503+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.GuiOEGR3DktGxzCuscOmdgBM1zKfwyb_0 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.503+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.798904056122087412', time=2024-09-12T19:48:09.511457+0000, chain.objs.size()=1 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.503+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.isJ0i9eXcy9i0LYTCxt15_fJxcjT9Kf_0 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.503+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14575315284937223933', time=2024-09-12T19:48:09.675100+0000, chain.objs.size()=1 2024-09-12T18:13:49.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.503+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.yS46N8Ed1oLVyvD7vSGvf68tZFJbqf7_0 2024-09-12T18:13:49.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.503+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6638211197535207611', time=2024-09-12T19:48:09.721045+0000, chain.objs.size()=1 2024-09-12T18:13:49.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.503+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.GEmHOjPa7s5H2lfjxS4X-Ktb3aVCspM_0 2024-09-12T18:13:49.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.503+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11008898775125994073', time=2024-09-12T19:48:09.857652+0000, chain.objs.size()=1 2024-09-12T18:13:49.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.503+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.amCAFJjYZw7gSJIhCTatCc9hbzSpkaJ_0 2024-09-12T18:13:49.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.504+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9982766055367715201', time=2024-09-12T19:48:10.072314+0000, chain.objs.size()=1 2024-09-12T18:13:49.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.504+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.324__shadow_.v5ZrOZVlw_61oQ-KWV17E7CQ1eLCppC_0 2024-09-12T18:13:49.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.504+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14137446462355093671', time=2024-09-12T19:48:47.771694+0000, chain.objs.size()=1 2024-09-12T18:13:49.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.504+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.4dM_a-l-R6e-bwOd4QW0ZrCoL7hmkZl_0 2024-09-12T18:13:49.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.504+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13514880813173632841', time=2024-09-12T19:48:48.018862+0000, chain.objs.size()=1 2024-09-12T18:13:49.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.504+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.1j0TPFpVll0jyRaMoZMgu7o-g-Bu-FZ_0 2024-09-12T18:13:49.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.504+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13115311097792747023', time=2024-09-12T19:48:48.104133+0000, chain.objs.size()=1 2024-09-12T18:13:49.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.504+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.cJWuAaNa-xlTu_-YMeoqLpj_S7DcAGu_0 2024-09-12T18:13:49.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.504+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.466163079509851047', time=2024-09-12T19:48:48.444782+0000, chain.objs.size()=1 2024-09-12T18:13:49.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.504+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.bwKESctmjVyJx8BA81tmUV4kkm8DM5l_0 2024-09-12T18:13:49.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.504+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14831794085870322785', time=2024-09-12T19:48:49.386540+0000, chain.objs.size()=1 2024-09-12T18:13:49.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.504+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.HL2G3gi-6ORwA-3JDPFUc5ljL5JUrdo_0 2024-09-12T18:13:49.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.504+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8415594839575558813', time=2024-09-12T19:48:49.545957+0000, chain.objs.size()=1 2024-09-12T18:13:49.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.504+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.aFmhAZ-wJcMgHIyTYBOqPj3luGH1KFT_0 2024-09-12T18:13:49.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.504+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5728261099876955161', time=2024-09-12T19:48:49.687858+0000, chain.objs.size()=1 2024-09-12T18:13:49.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.504+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.HzHhwTlKyqI4McoKvXdBHW42BHH_1Wg_0 2024-09-12T18:13:49.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.504+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8311019347902180140', time=2024-09-12T19:48:49.825380+0000, chain.objs.size()=1 2024-09-12T18:13:49.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.504+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.PZqbzUcGWajUIa8J3b6pCOWfubhso1R_0 2024-09-12T18:13:49.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.506+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5813258839244335712', time=2024-09-12T19:48:50.503774+0000, chain.objs.size()=1 2024-09-12T18:13:49.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.506+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.slSTgXENTnRGlxCakeWIVIRhdBarwXS_0 2024-09-12T18:13:49.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.506+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10151823703474580355', time=2024-09-12T19:48:51.332359+0000, chain.objs.size()=1 2024-09-12T18:13:49.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.506+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.JlvkYN-_iiXf85iBy1XrEsPHWZ4SUPu_0 2024-09-12T18:13:49.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.506+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13217356625624779695', time=2024-09-12T19:48:51.452120+0000, chain.objs.size()=1 2024-09-12T18:13:49.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.506+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.TOGCbj1Y1-5Fz4LiVdQEuZzv3akYJfP_0 2024-09-12T18:13:49.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.506+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.937733270953130153', time=2024-09-12T19:48:52.280792+0000, chain.objs.size()=1 2024-09-12T18:13:49.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.506+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.hdoSXYftYk-Kmg3ejc069mSRy-IvOqC_0 2024-09-12T18:13:49.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.506+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13220361749711374188', time=2024-09-12T19:48:53.479633+0000, chain.objs.size()=1 2024-09-12T18:13:49.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.506+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Dp1vcGYUgCpLWCpM0H1zbI2o1DzS8II_0 2024-09-12T18:13:49.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.506+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4581471367809523262', time=2024-09-12T19:48:53.619476+0000, chain.objs.size()=1 2024-09-12T18:13:49.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.506+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.fXA0qCLNtjKG2GiJhAKIptQQ9VQA-p1_0 2024-09-12T18:13:49.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.506+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18147329789407147209', time=2024-09-12T19:48:54.165904+0000, chain.objs.size()=1 2024-09-12T18:13:49.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.506+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.a9JaRwvvhnEOF_U37eu26NUWvLqAJUu_0 2024-09-12T18:13:49.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.507+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17337655453719990224', time=2024-09-12T19:48:54.245975+0000, chain.objs.size()=1 2024-09-12T18:13:49.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.507+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.Qu79zQv7I50b11PK7GzOAMprKLV7HTu_0 2024-09-12T18:13:49.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.508+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 0/48847 2024-09-12T18:13:49.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.510+0000 7f35f5b26800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=39, truncated=0, next_marker='' 2024-09-12T18:13:49.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.510+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9995232357775649608', time=2024-09-12T19:48:54.636436+0000, chain.objs.size()=1 2024-09-12T18:13:49.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.510+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.diRRpjLVFGJ1-3w_fEwnM8-4C9gjkll_0 2024-09-12T18:13:49.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.510+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9441497007980187706', time=2024-09-12T19:48:54.647321+0000, chain.objs.size()=1 2024-09-12T18:13:49.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.510+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.6FZn8ZgOdR3QBySBltZs_AeJIJGXvfu_0 2024-09-12T18:13:49.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.510+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3018991334544741088', time=2024-09-12T19:48:54.754640+0000, chain.objs.size()=1 2024-09-12T18:13:49.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.510+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.9EpXyj7szjc-cl1b3By33BVrbYC_cE__0 2024-09-12T18:13:49.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.510+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11760091326198236604', time=2024-09-12T19:48:54.910106+0000, chain.objs.size()=1 2024-09-12T18:13:49.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.510+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.3T7keHuhpXABF9BnaSSqCVwz78p9VHb_0 2024-09-12T18:13:49.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.510+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.18398363721053853356', time=2024-09-12T19:48:54.936696+0000, chain.objs.size()=1 2024-09-12T18:13:49.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.510+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.rjVvDKUaiqu0Nq4Fgb_IkUzalfndMzC_0 2024-09-12T18:13:49.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.510+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17930624195821378227', time=2024-09-12T19:48:54.947153+0000, chain.objs.size()=1 2024-09-12T18:13:49.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.510+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.1omrEVrvbu1xClJJEpxeSVQ-dws-8y9_0 2024-09-12T18:13:49.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.510+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1740986333322861699', time=2024-09-12T19:48:55.097774+0000, chain.objs.size()=1 2024-09-12T18:13:49.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.510+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.cXO6qljate3w0ynysEwhBlXGMcLg-eN_0 2024-09-12T18:13:49.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.510+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4588600996298904816', time=2024-09-12T19:48:55.551380+0000, chain.objs.size()=1 2024-09-12T18:13:49.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.510+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.i9KqMsLHg6-Pc4puQOV7W546t7Lue_N_0 2024-09-12T18:13:49.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.510+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9210711241773415385', time=2024-09-12T19:48:56.121966+0000, chain.objs.size()=1 2024-09-12T18:13:49.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.510+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.dDHHBQzDhcLCIMVMTzN6uHP8EbtboCC_0 2024-09-12T18:13:49.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.510+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15841774505525396877', time=2024-09-12T19:48:56.231205+0000, chain.objs.size()=1 2024-09-12T18:13:49.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.510+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.g71UyAbwFY6bf1iVTx1Kn9dkP3ds-UM_0 2024-09-12T18:13:49.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.510+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.2701433643553752348', time=2024-09-12T19:48:56.450647+0000, chain.objs.size()=1 2024-09-12T18:13:49.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.510+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_._GxIVy8Swhm70cI0K6ctc039nUU6ri6_0 2024-09-12T18:13:49.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.510+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9004544452973871206', time=2024-09-12T19:48:56.905563+0000, chain.objs.size()=1 2024-09-12T18:13:49.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.510+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.1yKg17Jz4_rKyRLt_vwwNf7e_r5L1iR_0 2024-09-12T18:13:49.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.512+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3197697199672417450', time=2024-09-12T19:48:57.361528+0000, chain.objs.size()=1 2024-09-12T18:13:49.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.512+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.NnEvRpVNh1snM23ochE5K2udjCJXi7O_0 2024-09-12T18:13:49.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.512+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11961100433094501833', time=2024-09-12T19:48:57.733763+0000, chain.objs.size()=1 2024-09-12T18:13:49.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.512+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.325__shadow_.tz5u6JggfalPQCb9by2HHC4oYGgwhH__0 2024-09-12T18:13:49.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.512+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9497410828733240324', time=2024-09-12T19:49:13.807302+0000, chain.objs.size()=1 2024-09-12T18:13:49.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.512+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.343__shadow_.KmdG_hHoSOdnsTFea_t0YG_sO8vUmSu_0 2024-09-12T18:13:49.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.512+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.1470979922372885898', time=2024-09-12T19:49:14.557397+0000, chain.objs.size()=1 2024-09-12T18:13:49.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.512+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.344__shadow_.qRBg3Gq_6xAwnjisD3ME0XIaV0itTd4_0 2024-09-12T18:13:49.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.512+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5926112260111872252', time=2024-09-12T19:49:32.658198+0000, chain.objs.size()=2 2024-09-12T18:13:49.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.512+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.368__shadow_.3dRXA86g12TprVIZHE-U_ugX8VALaFj_0 2024-09-12T18:13:49.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.513+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.368__shadow_.3dRXA86g12TprVIZHE-U_ugX8VALaFj_1 2024-09-12T18:13:49.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.513+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.15177199394497283305', time=2024-09-12T19:51:04.475632+0000, chain.objs.size()=1 2024-09-12T18:13:49.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.513+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.464__shadow_.syIL3734j4Q2k4T4829LuD5HsZ_4wKC_0 2024-09-12T18:13:49.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.513+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8751413003947074186', time=2024-09-12T19:51:04.476211+0000, chain.objs.size()=1 2024-09-12T18:13:49.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.513+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.464__shadow_.bWtC621xUaap_tAcq4lu6SQ0pfATano_0 2024-09-12T18:13:49.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.513+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13460197787207774884', time=2024-09-12T19:51:07.821330+0000, chain.objs.size()=1 2024-09-12T18:13:49.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.513+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.467__shadow_.QAxiPZ5Kcz5rLAQRNSgan2wewrWjq6l_0 2024-09-12T18:13:49.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.513+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.17794816050267793504', time=2024-09-12T19:51:08.136932+0000, chain.objs.size()=1 2024-09-12T18:13:49.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.513+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.467__shadow_.6tM8egq7iWmSo_ZaKxk0VAfRpAaA51Y_0 2024-09-12T18:13:49.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.513+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14344019803055413898', time=2024-09-12T19:51:25.535958+0000, chain.objs.size()=1 2024-09-12T18:13:49.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.513+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.487__shadow_.hP5HwTv6Zhl2BsUbWbJ_skSl-fKML2W_0 2024-09-12T18:13:49.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.514+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.6035864943730145380', time=2024-09-12T19:51:27.432269+0000, chain.objs.size()=1 2024-09-12T18:13:49.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.514+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.489__shadow_.91iV6tMZS0dLomsJGf4ZraWXcuVAm4S_0 2024-09-12T18:13:49.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.514+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.8043003379959708632', time=2024-09-12T19:51:36.865250+0000, chain.objs.size()=1 2024-09-12T18:13:49.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.514+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.501__shadow_.Moo9oFeu-PrLzr59Zfb5MPjXzt1wrb1_0 2024-09-12T18:13:49.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.515+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3805236996490840084', time=2024-09-12T19:52:24.671682+0000, chain.objs.size()=1 2024-09-12T18:13:49.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.515+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.519__multipart_mymultipart.2~4k_eT3Nruu6wrcNg151Q3p44WziFF1X.1 2024-09-12T18:13:49.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.515+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.14452263148192718741', time=2024-09-12T19:53:50.381859+0000, chain.objs.size()=12 2024-09-12T18:13:49.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.515+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.iGUsXgA1ChLd0ANgX7z6JyftU0UUfzVs.1 2024-09-12T18:13:49.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.515+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__shadow_mymultipart.iGUsXgA1ChLd0ANgX7z6JyftU0UUfzVs.1_1 2024-09-12T18:13:49.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.517+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~vgEpqhD3u78xb3tulDrymR_3vl7NF_u.2 2024-09-12T18:13:49.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.517+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__shadow_mymultipart.2~vgEpqhD3u78xb3tulDrymR_3vl7NF_u.2_1 2024-09-12T18:13:49.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.517+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~vgEpqhD3u78xb3tulDrymR_3vl7NF_u.3 2024-09-12T18:13:49.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.517+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__shadow_mymultipart.2~vgEpqhD3u78xb3tulDrymR_3vl7NF_u.3_1 2024-09-12T18:13:49.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.517+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~vgEpqhD3u78xb3tulDrymR_3vl7NF_u.4 2024-09-12T18:13:49.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.517+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__shadow_mymultipart.2~vgEpqhD3u78xb3tulDrymR_3vl7NF_u.4_1 2024-09-12T18:13:49.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.517+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~vgEpqhD3u78xb3tulDrymR_3vl7NF_u.5 2024-09-12T18:13:49.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.517+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__shadow_mymultipart.2~vgEpqhD3u78xb3tulDrymR_3vl7NF_u.5_1 2024-09-12T18:13:49.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.517+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__multipart_mymultipart.2~vgEpqhD3u78xb3tulDrymR_3vl7NF_u.6 2024-09-12T18:13:49.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.517+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.523__shadow_mymultipart.2~vgEpqhD3u78xb3tulDrymR_3vl7NF_u.6_1 2024-09-12T18:13:49.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.518+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10270050043773332288', time=2024-09-12T19:55:20.436208+0000, chain.objs.size()=3 2024-09-12T18:13:49.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.518+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.524__multipart_mymultipart.2~KQtlE-tWrrFffHE0CnCwCYEklJHOtNg.1 2024-09-12T18:13:49.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.520+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.524__multipart_mymultipart.2~KQtlE-tWrrFffHE0CnCwCYEklJHOtNg.2 2024-09-12T18:13:49.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.521+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.524__multipart_mymultipart.2~KQtlE-tWrrFffHE0CnCwCYEklJHOtNg.3 2024-09-12T18:13:49.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.521+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.13123595499553303844', time=2024-09-12T19:57:13.504918+0000, chain.objs.size()=1 2024-09-12T18:13:49.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.521+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.554__shadow_.MVvS-T-RtyS3GtK1rIy4VPGeFe6-0pV_0 2024-09-12T18:13:49.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.521+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5158285063154643905', time=2024-09-12T19:58:01.789092+0000, chain.objs.size()=1 2024-09-12T18:13:49.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.521+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:K.nK1LRB9W8TusEsVyCU7x.HXtWp8a9_.RKU6npA3vohVVyxhVt-gjOdAnTBvSKd_0 2024-09-12T18:13:49.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.521+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.7879218622860441778', time=2024-09-12T19:58:05.081772+0000, chain.objs.size()=1 2024-09-12T18:13:49.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.521+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.570__shadow:KeJ8.SfuLBb5Kp5x03olhoPM-2j8hnD_.H8j6odZzakX7pArvkknYQH89VCwhwBf_0 2024-09-12T18:13:49.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.521+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11080006850932591434', time=2024-09-12T19:58:39.680941+0000, chain.objs.size()=1 2024-09-12T18:13:49.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.521+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.578__shadow:26O3R3k7T.PS-JHg2yQbzJ9f6bYh7VE_.GxIGqPVVZ5aGqhnfU8TJMwciCnRq6_g_0 2024-09-12T18:13:49.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.521+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.9335608459367278560', time=2024-09-12T19:59:29.974571+0000, chain.objs.size()=1 2024-09-12T18:13:49.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.521+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.580__shadow:XJGMoYZksMMB0rB24n9QtrvqCc8nxj9_.UwzNFAkdpuTZc-j5zx252EOs5Xs2QxL_0 2024-09-12T18:13:49.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.521+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.4104479867307338120', time=2024-09-12T19:59:52.480206+0000, chain.objs.size()=1 2024-09-12T18:13:49.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.521+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.603__shadow_.pToz9LxB2yMf_8uKbkeNxmTMPCOZqqz_0 2024-09-12T18:13:49.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.521+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3010078204781541745', time=2024-09-12T20:06:04.243153+0000, chain.objs.size()=1 2024-09-12T18:13:49.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.521+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.666__shadow_.g-tCz2Ih-GDsgoYFe7wZ-Y9FApTJnkS_0 2024-09-12T18:13:49.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.521+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.561896463554995187', time=2024-09-12T20:06:15.263323+0000, chain.objs.size()=1 2024-09-12T18:13:49.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.521+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.680__shadow_.2qGCPTSLMPeiWEmumDsRsh765Qu9sWk_0 2024-09-12T18:13:49.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.521+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.11476233311838022938', time=2024-09-12T20:06:15.269079+0000, chain.objs.size()=1 2024-09-12T18:13:49.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.521+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.680__shadow_.pqQV6VE7Jz4vu3Kck-YEpA68q4lN2fI_0 2024-09-12T18:13:49.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.522+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.5436389131373250488', time=2024-09-12T20:06:23.690531+0000, chain.objs.size()=1 2024-09-12T18:13:49.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.522+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.692__shadow_.SLayhsuWuIC4uNikPoEyw0vxBvMkMIY_0 2024-09-12T18:13:49.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.523+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.10039674722885674111', time=2024-09-12T20:06:28.573607+0000, chain.objs.size()=1 2024-09-12T18:13:49.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.523+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.698__shadow:.tOzwq8TeJIEBcS81UqR5qzkirgI1E4_.I7hxXttvyZY9OJtDOT68xk1gkKslMzC_0 2024-09-12T18:13:49.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.523+0000 7f35f5b26800 20 garbage collection: RGWGC::process iterating over entry tag='06eb12d0-49d6-461d-9efe-05d212954deb.4538.3421772632558272366', time=2024-09-12T20:06:35.690917+0000, chain.objs.size()=1 2024-09-12T18:13:49.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.523+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:06eb12d0-49d6-461d-9efe-05d212954deb.4538.706__shadow:MXhaw5B0eoIkr2kV9WMn7Wn3PKwe4RQ_.s8Dte9s_B1Sr2c2gof4edMrtoZd8pYv_0 2024-09-12T18:13:49.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.524+0000 7f35f5b26800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:13:49.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.527+0000 7f34a7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:13:49.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.529+0000 7f35f5b26800 20 remove_watcher() i=0 2024-09-12T18:13:49.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.529+0000 7f35f5b26800 2 removed watcher, disabling cache 2024-09-12T18:13:49.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.530+0000 7f35f5b26800 20 remove_watcher() i=1 2024-09-12T18:13:49.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.531+0000 7f35f5b26800 20 remove_watcher() i=2 2024-09-12T18:13:49.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.532+0000 7f35f5b26800 20 remove_watcher() i=3 2024-09-12T18:13:49.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.533+0000 7f35f5b26800 20 remove_watcher() i=4 2024-09-12T18:13:49.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.534+0000 7f35f5b26800 20 remove_watcher() i=5 2024-09-12T18:13:49.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.535+0000 7f35f5b26800 20 remove_watcher() i=6 2024-09-12T18:13:49.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T18:13:49.536+0000 7f35f5b26800 20 remove_watcher() i=7 2024-09-12T18:13:49.549 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-12T18:13:49.836 DEBUG:teuthology.orchestra.run.smithi067:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-09-12T18:13:49.868 DEBUG:teuthology.orchestra.run.smithi067:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-12T18:13:49.942 DEBUG:teuthology.orchestra.run.smithi067:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-09-12T18:13:50.015 DEBUG:teuthology.orchestra.run.smithi067:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-12T18:13:50.088 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm /usr/share/pki/ca-trust-source/anchors/root.crt 2024-09-12T18:13:50.171 DEBUG:teuthology.orchestra.run.smithi067:> sudo update-ca-trust 2024-09-12T18:13:51.245 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T18:13:51.256 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T18:13:51.257 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:13:51.597 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:13:51.611 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-12T18:13:51.614 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":2477,"stamp":"2024-09-12T18:13:50.630404+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":570641228,"num_objects":4560,"num_object_clones":0,"num_object_copies":9120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4560,"num_whiteouts":0,"num_read":178556,"num_read_kb":2302209,"num_write":139726,"num_write_kb":2241551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13454,"ondisk_log_size":13454,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2495432,"kb_used_data":1260424,"kb_used_omap":12,"kb_used_meta":1234867,"kb_avail":752479288,"statfs":{"total":773094113280,"available":770538790912,"internally_reserved":0,"allocated":1290674176,"data_stored":1245593882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1264504368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-44087978,"num_objects":-294,"num_object_clones":0,"num_object_copies":-588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-294,"num_whiteouts":0,"num_read":345,"num_read_kb":436,"num_write":318,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005590"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:07.943317+0000","last_change":"2024-09-12T17:39:05.922525+0000","last_active":"2024-09-12T18:09:07.943317+0000","last_peered":"2024-09-12T18:09:07.943317+0000","last_clean":"2024-09-12T18:09:07.943317+0000","last_became_active":"2024-09-12T17:39:05.922265+0000","last_became_peered":"2024-09-12T17:39:05.922265+0000","last_unstale":"2024-09-12T18:09:07.943317+0000","last_undegraded":"2024-09-12T18:09:07.943317+0000","last_fullsized":"2024-09-12T18:09:07.943317+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:50.266071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'7","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.956905+0000","last_change":"2024-09-12T17:20:34.559305+0000","last_active":"2024-09-12T18:10:37.956905+0000","last_peered":"2024-09-12T18:10:37.956905+0000","last_clean":"2024-09-12T18:10:37.956905+0000","last_became_active":"2024-09-12T17:20:34.559027+0000","last_became_peered":"2024-09-12T17:20:34.559027+0000","last_unstale":"2024-09-12T18:10:37.956905+0000","last_undegraded":"2024-09-12T18:10:37.956905+0000","last_fullsized":"2024-09-12T18:10:37.956905+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:57.688429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"261'5","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844168+0000","last_change":"2024-09-12T17:20:30.533512+0000","last_active":"2024-09-12T18:10:31.844168+0000","last_peered":"2024-09-12T18:10:31.844168+0000","last_clean":"2024-09-12T18:10:31.844168+0000","last_became_active":"2024-09-12T17:20:30.533235+0000","last_became_peered":"2024-09-12T17:20:30.533235+0000","last_unstale":"2024-09-12T18:10:31.844168+0000","last_undegraded":"2024-09-12T18:10:31.844168+0000","last_fullsized":"2024-09-12T18:10:31.844168+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:11.739116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4098,"num_write":10,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'40","reported_seq":175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619269+0000","last_change":"2024-09-12T17:16:11.492013+0000","last_active":"2024-09-12T18:10:21.619269+0000","last_peered":"2024-09-12T18:10:21.619269+0000","last_clean":"2024-09-12T18:10:21.619269+0000","last_became_active":"2024-09-12T17:16:11.491724+0000","last_became_peered":"2024-09-12T17:16:11.491724+0000","last_unstale":"2024-09-12T18:10:21.619269+0000","last_undegraded":"2024-09-12T18:10:21.619269+0000","last_fullsized":"2024-09-12T18:10:21.619269+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:52.666913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":153,"num_write":69,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:08.691783+0000","last_change":"2024-09-12T17:39:05.929786+0000","last_active":"2024-09-12T18:09:08.691783+0000","last_peered":"2024-09-12T18:09:08.691783+0000","last_clean":"2024-09-12T18:09:08.691783+0000","last_became_active":"2024-09-12T17:39:05.929533+0000","last_became_peered":"2024-09-12T17:39:05.929533+0000","last_unstale":"2024-09-12T18:09:08.691783+0000","last_undegraded":"2024-09-12T18:09:08.691783+0000","last_fullsized":"2024-09-12T18:09:08.691783+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:13.745522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"261'8","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:35.755523+0000","last_change":"2024-09-12T17:20:34.559278+0000","last_active":"2024-09-12T18:10:35.755523+0000","last_peered":"2024-09-12T18:10:35.755523+0000","last_clean":"2024-09-12T18:10:35.755523+0000","last_became_active":"2024-09-12T17:20:34.558970+0000","last_became_peered":"2024-09-12T17:20:34.558970+0000","last_unstale":"2024-09-12T18:10:35.755523+0000","last_undegraded":"2024-09-12T18:10:35.755523+0000","last_fullsized":"2024-09-12T18:10:35.755523+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:15.197078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8194,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.601484+0000","last_change":"2024-09-12T17:20:30.539641+0000","last_active":"2024-09-12T18:13:48.601484+0000","last_peered":"2024-09-12T18:13:48.601484+0000","last_clean":"2024-09-12T18:13:48.601484+0000","last_became_active":"2024-09-12T17:20:30.539358+0000","last_became_peered":"2024-09-12T17:20:30.539358+0000","last_unstale":"2024-09-12T18:13:48.601484+0000","last_undegraded":"2024-09-12T18:13:48.601484+0000","last_fullsized":"2024-09-12T18:13:48.601484+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:09.857477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8242,"num_write":10,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'68","reported_seq":250,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:23.699050+0000","last_change":"2024-09-12T17:16:11.491901+0000","last_active":"2024-09-12T18:10:23.699050+0000","last_peered":"2024-09-12T18:10:23.699050+0000","last_clean":"2024-09-12T18:10:23.699050+0000","last_became_active":"2024-09-12T17:16:11.491610+0000","last_became_peered":"2024-09-12T17:16:11.491610+0000","last_unstale":"2024-09-12T18:10:23.699050+0000","last_undegraded":"2024-09-12T18:10:23.699050+0000","last_fullsized":"2024-09-12T18:10:23.699050+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:14.980006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":357,"num_read_kb":265,"num_write":116,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.743901+0000","last_change":"2024-09-12T17:39:05.922376+0000","last_active":"2024-09-12T18:10:32.743901+0000","last_peered":"2024-09-12T18:10:32.743901+0000","last_clean":"2024-09-12T18:10:32.743901+0000","last_became_active":"2024-09-12T17:39:05.921846+0000","last_became_peered":"2024-09-12T17:39:05.921846+0000","last_unstale":"2024-09-12T18:10:32.743901+0000","last_undegraded":"2024-09-12T18:10:32.743901+0000","last_fullsized":"2024-09-12T18:10:32.743901+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:48.115093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"261'8","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.621019+0000","last_change":"2024-09-12T17:20:34.615861+0000","last_active":"2024-09-12T18:10:36.621019+0000","last_peered":"2024-09-12T18:10:36.621019+0000","last_clean":"2024-09-12T18:10:36.621019+0000","last_became_active":"2024-09-12T17:20:34.615550+0000","last_became_peered":"2024-09-12T17:20:34.615550+0000","last_unstale":"2024-09-12T18:10:36.621019+0000","last_undegraded":"2024-09-12T18:10:36.621019+0000","last_fullsized":"2024-09-12T18:10:36.621019+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:16.087575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":6148,"num_write":8,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'8","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:43.700956+0000","last_change":"2024-09-12T17:20:30.535465+0000","last_active":"2024-09-12T18:10:43.700956+0000","last_peered":"2024-09-12T18:10:43.700956+0000","last_clean":"2024-09-12T18:10:43.700956+0000","last_became_active":"2024-09-12T17:20:30.535182+0000","last_became_peered":"2024-09-12T17:20:30.535182+0000","last_unstale":"2024-09-12T18:10:43.700956+0000","last_undegraded":"2024-09-12T18:10:43.700956+0000","last_fullsized":"2024-09-12T18:10:43.700956+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:33.062178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":13,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'51","reported_seq":202,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.624811+0000","last_change":"2024-09-12T17:16:11.493397+0000","last_active":"2024-09-12T18:11:11.624811+0000","last_peered":"2024-09-12T18:11:11.624811+0000","last_clean":"2024-09-12T18:11:11.624811+0000","last_became_active":"2024-09-12T17:16:11.493043+0000","last_became_peered":"2024-09-12T17:16:11.493043+0000","last_unstale":"2024-09-12T18:11:11.624811+0000","last_undegraded":"2024-09-12T18:11:11.624811+0000","last_fullsized":"2024-09-12T18:11:11.624811+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:13.681249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":193,"num_write":93,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.844692+0000","last_change":"2024-09-12T17:39:05.931399+0000","last_active":"2024-09-12T18:10:36.844692+0000","last_peered":"2024-09-12T18:10:36.844692+0000","last_clean":"2024-09-12T18:10:36.844692+0000","last_became_active":"2024-09-12T17:39:05.931122+0000","last_became_peered":"2024-09-12T17:39:05.931122+0000","last_unstale":"2024-09-12T18:10:36.844692+0000","last_undegraded":"2024-09-12T18:10:36.844692+0000","last_fullsized":"2024-09-12T18:10:36.844692+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:02.508518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'5","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:46.845829+0000","last_change":"2024-09-12T17:20:34.613048+0000","last_active":"2024-09-12T18:10:46.845829+0000","last_peered":"2024-09-12T18:10:46.845829+0000","last_clean":"2024-09-12T18:10:46.845829+0000","last_became_active":"2024-09-12T17:20:34.612720+0000","last_became_peered":"2024-09-12T17:20:34.612720+0000","last_unstale":"2024-09-12T18:10:46.845829+0000","last_undegraded":"2024-09-12T18:10:46.845829+0000","last_fullsized":"2024-09-12T18:10:46.845829+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:30.901799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":14336,"num_write":10,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'7","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:30.754899+0000","last_change":"2024-09-12T17:20:30.534475+0000","last_active":"2024-09-12T18:10:30.754899+0000","last_peered":"2024-09-12T18:10:30.754899+0000","last_clean":"2024-09-12T18:10:30.754899+0000","last_became_active":"2024-09-12T17:20:30.534068+0000","last_became_peered":"2024-09-12T17:20:30.534068+0000","last_unstale":"2024-09-12T18:10:30.754899+0000","last_undegraded":"2024-09-12T18:10:30.754899+0000","last_fullsized":"2024-09-12T18:10:30.754899+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:16.971800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":5122,"num_write":17,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'25","reported_seq":124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.848415+0000","last_change":"2024-09-12T17:16:11.490345+0000","last_active":"2024-09-12T18:11:11.848415+0000","last_peered":"2024-09-12T18:11:11.848415+0000","last_clean":"2024-09-12T18:11:11.848415+0000","last_became_active":"2024-09-12T17:16:11.489860+0000","last_became_peered":"2024-09-12T17:16:11.489860+0000","last_unstale":"2024-09-12T18:11:11.848415+0000","last_undegraded":"2024-09-12T18:11:11.848415+0000","last_fullsized":"2024-09-12T18:11:11.848415+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:28:30.353456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.848437+0000","last_change":"2024-09-12T17:39:05.931395+0000","last_active":"2024-09-12T18:11:11.848437+0000","last_peered":"2024-09-12T18:11:11.848437+0000","last_clean":"2024-09-12T18:11:11.848437+0000","last_became_active":"2024-09-12T17:39:05.931089+0000","last_became_peered":"2024-09-12T17:39:05.931089+0000","last_unstale":"2024-09-12T18:11:11.848437+0000","last_undegraded":"2024-09-12T18:11:11.848437+0000","last_fullsized":"2024-09-12T18:11:11.848437+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:40.976622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"264'1","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:07.943295+0000","last_change":"2024-09-12T17:20:34.557572+0000","last_active":"2024-09-12T18:09:07.943295+0000","last_peered":"2024-09-12T18:09:07.943295+0000","last_clean":"2024-09-12T18:09:07.943295+0000","last_became_active":"2024-09-12T17:20:34.557008+0000","last_became_peered":"2024-09-12T17:20:34.557008+0000","last_unstale":"2024-09-12T18:09:07.943295+0000","last_undegraded":"2024-09-12T18:09:07.943295+0000","last_fullsized":"2024-09-12T18:09:07.943295+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:29.589642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'7","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:16.625332+0000","last_change":"2024-09-12T17:20:30.538674+0000","last_active":"2024-09-12T18:11:16.625332+0000","last_peered":"2024-09-12T18:11:16.625332+0000","last_clean":"2024-09-12T18:11:16.625332+0000","last_became_active":"2024-09-12T17:20:30.538361+0000","last_became_peered":"2024-09-12T17:20:30.538361+0000","last_unstale":"2024-09-12T18:11:16.625332+0000","last_undegraded":"2024-09-12T18:11:16.625332+0000","last_fullsized":"2024-09-12T18:11:16.625332+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:34.525214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4098,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'48","reported_seq":182,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.848386+0000","last_change":"2024-09-12T17:16:11.488078+0000","last_active":"2024-09-12T18:11:11.848386+0000","last_peered":"2024-09-12T18:11:11.848386+0000","last_clean":"2024-09-12T18:11:11.848386+0000","last_became_active":"2024-09-12T17:16:11.487771+0000","last_became_peered":"2024-09-12T17:16:11.487771+0000","last_unstale":"2024-09-12T18:11:11.848386+0000","last_undegraded":"2024-09-12T18:11:11.848386+0000","last_fullsized":"2024-09-12T18:11:11.848386+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:38.032910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":161,"num_write":84,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:23.917612+0000","last_change":"2024-09-12T17:39:05.921998+0000","last_active":"2024-09-12T18:10:23.917612+0000","last_peered":"2024-09-12T18:10:23.917612+0000","last_clean":"2024-09-12T18:10:23.917612+0000","last_became_active":"2024-09-12T17:39:05.921661+0000","last_became_peered":"2024-09-12T17:39:05.921661+0000","last_unstale":"2024-09-12T18:10:23.917612+0000","last_undegraded":"2024-09-12T18:10:23.917612+0000","last_fullsized":"2024-09-12T18:10:23.917612+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:09.613996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:22.751338+0000","last_change":"2024-09-12T17:20:34.555394+0000","last_active":"2024-09-12T18:11:22.751338+0000","last_peered":"2024-09-12T18:11:22.751338+0000","last_clean":"2024-09-12T18:11:22.751338+0000","last_became_active":"2024-09-12T17:20:34.555047+0000","last_became_peered":"2024-09-12T17:20:34.555047+0000","last_unstale":"2024-09-12T18:11:22.751338+0000","last_undegraded":"2024-09-12T18:11:22.751338+0000","last_fullsized":"2024-09-12T18:11:22.751338+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:29.139249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'2","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.742462+0000","last_change":"2024-09-12T17:20:30.528356+0000","last_active":"2024-09-12T18:09:05.742462+0000","last_peered":"2024-09-12T18:09:05.742462+0000","last_clean":"2024-09-12T18:09:05.742462+0000","last_became_active":"2024-09-12T17:20:30.528029+0000","last_became_peered":"2024-09-12T17:20:30.528029+0000","last_unstale":"2024-09-12T18:09:05.742462+0000","last_undegraded":"2024-09-12T18:09:05.742462+0000","last_fullsized":"2024-09-12T18:09:05.742462+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:17.569528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'34","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:12.750037+0000","last_change":"2024-09-12T17:16:11.491282+0000","last_active":"2024-09-12T18:11:12.750037+0000","last_peered":"2024-09-12T18:11:12.750037+0000","last_clean":"2024-09-12T18:11:12.750037+0000","last_became_active":"2024-09-12T17:16:11.490952+0000","last_became_peered":"2024-09-12T17:16:11.490952+0000","last_unstale":"2024-09-12T18:11:12.750037+0000","last_undegraded":"2024-09-12T18:11:12.750037+0000","last_fullsized":"2024-09-12T18:11:12.750037+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:58.052602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":115,"num_write":60,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:07.744407+0000","last_change":"2024-09-12T17:39:05.929242+0000","last_active":"2024-09-12T18:09:07.744407+0000","last_peered":"2024-09-12T18:09:07.744407+0000","last_clean":"2024-09-12T18:09:07.744407+0000","last_became_active":"2024-09-12T17:39:05.928959+0000","last_became_peered":"2024-09-12T17:39:05.928959+0000","last_unstale":"2024-09-12T18:09:07.744407+0000","last_undegraded":"2024-09-12T18:09:07.744407+0000","last_fullsized":"2024-09-12T18:09:07.744407+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:49.943631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.744728+0000","last_change":"2024-09-12T17:20:34.552499+0000","last_active":"2024-09-12T18:10:37.744728+0000","last_peered":"2024-09-12T18:10:37.744728+0000","last_clean":"2024-09-12T18:10:37.744728+0000","last_became_active":"2024-09-12T17:20:34.552180+0000","last_became_peered":"2024-09-12T17:20:34.552180+0000","last_unstale":"2024-09-12T18:10:37.744728+0000","last_undegraded":"2024-09-12T18:10:37.744728+0000","last_fullsized":"2024-09-12T18:10:37.744728+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:03.689040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:30.754825+0000","last_change":"2024-09-12T17:20:30.535560+0000","last_active":"2024-09-12T18:10:30.754825+0000","last_peered":"2024-09-12T18:10:30.754825+0000","last_clean":"2024-09-12T18:10:30.754825+0000","last_became_active":"2024-09-12T17:20:30.535001+0000","last_became_peered":"2024-09-12T17:20:30.535001+0000","last_unstale":"2024-09-12T18:10:30.754825+0000","last_undegraded":"2024-09-12T18:10:30.754825+0000","last_fullsized":"2024-09-12T18:10:30.754825+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:47.724576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'14","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:36.614251+0000","last_change":"2024-09-12T17:16:11.480542+0000","last_active":"2024-09-12T18:09:36.614251+0000","last_peered":"2024-09-12T18:09:36.614251+0000","last_clean":"2024-09-12T18:09:36.614251+0000","last_became_active":"2024-09-12T17:16:11.477940+0000","last_became_peered":"2024-09-12T17:16:11.477940+0000","last_unstale":"2024-09-12T18:09:36.614251+0000","last_undegraded":"2024-09-12T18:09:36.614251+0000","last_fullsized":"2024-09-12T18:09:36.614251+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:48.061800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":35,"num_write":34,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:07.744444+0000","last_change":"2024-09-12T17:39:05.930937+0000","last_active":"2024-09-12T18:09:07.744444+0000","last_peered":"2024-09-12T18:09:07.744444+0000","last_clean":"2024-09-12T18:09:07.744444+0000","last_became_active":"2024-09-12T17:39:05.930694+0000","last_became_peered":"2024-09-12T17:39:05.930694+0000","last_unstale":"2024-09-12T18:09:07.744444+0000","last_undegraded":"2024-09-12T18:09:07.744444+0000","last_fullsized":"2024-09-12T18:09:07.744444+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:15.777013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"261'4","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.844714+0000","last_change":"2024-09-12T17:20:34.553025+0000","last_active":"2024-09-12T18:10:36.844714+0000","last_peered":"2024-09-12T18:10:36.844714+0000","last_clean":"2024-09-12T18:10:36.844714+0000","last_became_active":"2024-09-12T17:20:34.552726+0000","last_became_peered":"2024-09-12T17:20:34.552726+0000","last_unstale":"2024-09-12T18:10:36.844714+0000","last_undegraded":"2024-09-12T18:10:36.844714+0000","last_fullsized":"2024-09-12T18:10:36.844714+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:22.335524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'2","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.620340+0000","last_change":"2024-09-12T17:20:30.539217+0000","last_active":"2024-09-12T18:10:31.620340+0000","last_peered":"2024-09-12T18:10:31.620340+0000","last_clean":"2024-09-12T18:10:31.620340+0000","last_became_active":"2024-09-12T17:20:30.538942+0000","last_became_peered":"2024-09-12T17:20:30.538942+0000","last_unstale":"2024-09-12T18:10:31.620340+0000","last_undegraded":"2024-09-12T18:10:31.620340+0000","last_fullsized":"2024-09-12T18:10:31.620340+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:53.625617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'32","reported_seq":144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:23.910689+0000","last_change":"2024-09-12T17:16:11.488019+0000","last_active":"2024-09-12T18:09:23.910689+0000","last_peered":"2024-09-12T18:09:23.910689+0000","last_clean":"2024-09-12T18:09:23.910689+0000","last_became_active":"2024-09-12T17:16:11.487242+0000","last_became_peered":"2024-09-12T17:16:11.487242+0000","last_unstale":"2024-09-12T18:09:23.910689+0000","last_undegraded":"2024-09-12T18:09:23.910689+0000","last_fullsized":"2024-09-12T18:09:23.910689+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:20.980571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":114,"num_write":62,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:28.911251+0000","last_change":"2024-09-12T17:39:05.927350+0000","last_active":"2024-09-12T18:09:28.911251+0000","last_peered":"2024-09-12T18:09:28.911251+0000","last_clean":"2024-09-12T18:09:28.911251+0000","last_became_active":"2024-09-12T17:39:05.924899+0000","last_became_peered":"2024-09-12T17:39:05.924899+0000","last_unstale":"2024-09-12T18:09:28.911251+0000","last_undegraded":"2024-09-12T18:09:28.911251+0000","last_fullsized":"2024-09-12T18:09:28.911251+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:09.168419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'3","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:21.849703+0000","last_change":"2024-09-12T17:20:34.610704+0000","last_active":"2024-09-12T18:11:21.849703+0000","last_peered":"2024-09-12T18:11:21.849703+0000","last_clean":"2024-09-12T18:11:21.849703+0000","last_became_active":"2024-09-12T17:20:34.610374+0000","last_became_peered":"2024-09-12T17:20:34.610374+0000","last_unstale":"2024-09-12T18:11:21.849703+0000","last_undegraded":"2024-09-12T18:11:21.849703+0000","last_fullsized":"2024-09-12T18:11:21.849703+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:34.456941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1632939,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":1142,"num_write":8,"num_write_kb":1595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"264'2","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:42.948454+0000","last_change":"2024-09-12T17:20:30.526974+0000","last_active":"2024-09-12T18:09:42.948454+0000","last_peered":"2024-09-12T18:09:42.948454+0000","last_clean":"2024-09-12T18:09:42.948454+0000","last_became_active":"2024-09-12T17:20:30.526672+0000","last_became_peered":"2024-09-12T17:20:30.526672+0000","last_unstale":"2024-09-12T18:09:42.948454+0000","last_undegraded":"2024-09-12T18:09:42.948454+0000","last_fullsized":"2024-09-12T18:09:42.948454+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:59.866468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'19","reported_seq":109,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:21.612655+0000","last_change":"2024-09-12T17:16:11.481645+0000","last_active":"2024-09-12T18:09:21.612655+0000","last_peered":"2024-09-12T18:09:21.612655+0000","last_clean":"2024-09-12T18:09:21.612655+0000","last_became_active":"2024-09-12T17:16:11.481351+0000","last_became_peered":"2024-09-12T17:16:11.481351+0000","last_unstale":"2024-09-12T18:09:21.612655+0000","last_undegraded":"2024-09-12T18:09:21.612655+0000","last_fullsized":"2024-09-12T18:09:21.612655+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:59.636662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":68,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:28.693677+0000","last_change":"2024-09-12T17:39:05.928807+0000","last_active":"2024-09-12T18:09:28.693677+0000","last_peered":"2024-09-12T18:09:28.693677+0000","last_clean":"2024-09-12T18:09:28.693677+0000","last_became_active":"2024-09-12T17:39:05.928497+0000","last_became_peered":"2024-09-12T17:39:05.928497+0000","last_unstale":"2024-09-12T18:09:28.693677+0000","last_undegraded":"2024-09-12T18:09:28.693677+0000","last_fullsized":"2024-09-12T18:09:28.693677+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:21.617561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'1","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:46.838997+0000","last_change":"2024-09-12T17:20:34.610626+0000","last_active":"2024-09-12T18:09:46.838997+0000","last_peered":"2024-09-12T18:09:46.838997+0000","last_clean":"2024-09-12T18:09:46.838997+0000","last_became_active":"2024-09-12T17:20:34.610260+0000","last_became_peered":"2024-09-12T17:20:34.610260+0000","last_unstale":"2024-09-12T18:09:46.838997+0000","last_undegraded":"2024-09-12T18:09:46.838997+0000","last_fullsized":"2024-09-12T18:09:46.838997+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:16.730940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'12","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:17.764735+0000","last_change":"2024-09-12T17:20:30.527312+0000","last_active":"2024-09-12T18:11:17.764735+0000","last_peered":"2024-09-12T18:11:17.764735+0000","last_clean":"2024-09-12T18:11:17.764735+0000","last_became_active":"2024-09-12T17:20:30.527032+0000","last_became_peered":"2024-09-12T17:20:30.527032+0000","last_unstale":"2024-09-12T18:11:17.764735+0000","last_undegraded":"2024-09-12T18:11:17.764735+0000","last_fullsized":"2024-09-12T18:11:17.764735+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:12.370876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":13314,"num_write":22,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"0'0","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:21.836307+0000","last_change":"2024-09-12T17:16:11.494751+0000","last_active":"2024-09-12T18:09:21.836307+0000","last_peered":"2024-09-12T18:09:21.836307+0000","last_clean":"2024-09-12T18:09:21.836307+0000","last_became_active":"2024-09-12T17:16:11.494493+0000","last_became_peered":"2024-09-12T17:16:11.494493+0000","last_unstale":"2024-09-12T18:09:21.836307+0000","last_undegraded":"2024-09-12T18:09:21.836307+0000","last_fullsized":"2024-09-12T18:09:21.836307+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:52.903537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:27.747165+0000","last_change":"2024-09-12T17:39:05.926661+0000","last_active":"2024-09-12T18:09:27.747165+0000","last_peered":"2024-09-12T18:09:27.747165+0000","last_clean":"2024-09-12T18:09:27.747165+0000","last_became_active":"2024-09-12T17:39:05.926388+0000","last_became_peered":"2024-09-12T17:39:05.926388+0000","last_unstale":"2024-09-12T18:09:27.747165+0000","last_undegraded":"2024-09-12T18:09:27.747165+0000","last_fullsized":"2024-09-12T18:09:27.747165+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:08.792424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"261'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:21.849742+0000","last_change":"2024-09-12T17:20:34.615918+0000","last_active":"2024-09-12T18:11:21.849742+0000","last_peered":"2024-09-12T18:11:21.849742+0000","last_clean":"2024-09-12T18:11:21.849742+0000","last_became_active":"2024-09-12T17:20:34.615468+0000","last_became_peered":"2024-09-12T17:20:34.615468+0000","last_unstale":"2024-09-12T18:11:21.849742+0000","last_undegraded":"2024-09-12T18:11:21.849742+0000","last_fullsized":"2024-09-12T18:11:21.849742+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:26.561082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:18.704540+0000","last_change":"2024-09-12T17:20:30.533763+0000","last_active":"2024-09-12T18:11:18.704540+0000","last_peered":"2024-09-12T18:11:18.704540+0000","last_clean":"2024-09-12T18:11:18.704540+0000","last_became_active":"2024-09-12T17:20:30.533436+0000","last_became_peered":"2024-09-12T17:20:30.533436+0000","last_unstale":"2024-09-12T18:11:18.704540+0000","last_undegraded":"2024-09-12T18:11:18.704540+0000","last_fullsized":"2024-09-12T18:11:18.704540+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:28.574849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'18","reported_seq":106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:23.693173+0000","last_change":"2024-09-12T17:16:11.489669+0000","last_active":"2024-09-12T18:09:23.693173+0000","last_peered":"2024-09-12T18:09:23.693173+0000","last_clean":"2024-09-12T18:09:23.693173+0000","last_became_active":"2024-09-12T17:16:11.488588+0000","last_became_peered":"2024-09-12T17:16:11.488588+0000","last_unstale":"2024-09-12T18:09:23.693173+0000","last_undegraded":"2024-09-12T18:09:23.693173+0000","last_fullsized":"2024-09-12T18:09:23.693173+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:28.499624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:27.946007+0000","last_change":"2024-09-12T17:39:05.923338+0000","last_active":"2024-09-12T18:09:27.946007+0000","last_peered":"2024-09-12T18:09:27.946007+0000","last_clean":"2024-09-12T18:09:27.946007+0000","last_became_active":"2024-09-12T17:39:05.922973+0000","last_became_peered":"2024-09-12T17:39:05.922973+0000","last_unstale":"2024-09-12T18:09:27.946007+0000","last_undegraded":"2024-09-12T18:09:27.946007+0000","last_fullsized":"2024-09-12T18:09:27.946007+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:17.786298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:20.762674+0000","last_change":"2024-09-12T17:20:34.555891+0000","last_active":"2024-09-12T18:11:20.762674+0000","last_peered":"2024-09-12T18:11:20.762674+0000","last_clean":"2024-09-12T18:11:20.762674+0000","last_became_active":"2024-09-12T17:20:34.554893+0000","last_became_peered":"2024-09-12T17:20:34.554893+0000","last_unstale":"2024-09-12T18:11:20.762674+0000","last_undegraded":"2024-09-12T18:11:20.762674+0000","last_fullsized":"2024-09-12T18:11:20.762674+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:56.253377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'5","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:16.625434+0000","last_change":"2024-09-12T17:20:30.536540+0000","last_active":"2024-09-12T18:11:16.625434+0000","last_peered":"2024-09-12T18:11:16.625434+0000","last_clean":"2024-09-12T18:11:16.625434+0000","last_became_active":"2024-09-12T17:20:30.535226+0000","last_became_peered":"2024-09-12T17:20:30.535226+0000","last_unstale":"2024-09-12T18:11:16.625434+0000","last_undegraded":"2024-09-12T18:11:16.625434+0000","last_fullsized":"2024-09-12T18:11:16.625434+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:28:25.047253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":4098,"num_write":5,"num_write_kb":3074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'26","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:02.752551+0000","last_change":"2024-09-12T17:16:11.491564+0000","last_active":"2024-09-12T18:10:02.752551+0000","last_peered":"2024-09-12T18:10:02.752551+0000","last_clean":"2024-09-12T18:10:02.752551+0000","last_became_active":"2024-09-12T17:16:11.491240+0000","last_became_peered":"2024-09-12T17:16:11.491240+0000","last_unstale":"2024-09-12T18:10:02.752551+0000","last_undegraded":"2024-09-12T18:10:02.752551+0000","last_fullsized":"2024-09-12T18:10:02.752551+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:43.068567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":97,"num_write":43,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844211+0000","last_change":"2024-09-12T17:39:05.932135+0000","last_active":"2024-09-12T18:10:31.844211+0000","last_peered":"2024-09-12T18:10:31.844211+0000","last_clean":"2024-09-12T18:10:31.844211+0000","last_became_active":"2024-09-12T17:39:05.931841+0000","last_became_peered":"2024-09-12T17:39:05.931841+0000","last_unstale":"2024-09-12T18:10:31.844211+0000","last_undegraded":"2024-09-12T18:10:31.844211+0000","last_fullsized":"2024-09-12T18:10:31.844211+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:08.525616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:33.911887+0000","last_change":"2024-09-12T17:20:34.560852+0000","last_active":"2024-09-12T18:09:33.911887+0000","last_peered":"2024-09-12T18:09:33.911887+0000","last_clean":"2024-09-12T18:09:33.911887+0000","last_became_active":"2024-09-12T17:20:34.560497+0000","last_became_peered":"2024-09-12T17:20:34.560497+0000","last_unstale":"2024-09-12T18:09:33.911887+0000","last_undegraded":"2024-09-12T18:09:33.911887+0000","last_fullsized":"2024-09-12T18:09:33.911887+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:07.183237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"261'7","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:30.746005+0000","last_change":"2024-09-12T17:20:30.535717+0000","last_active":"2024-09-12T18:09:30.746005+0000","last_peered":"2024-09-12T18:09:30.746005+0000","last_clean":"2024-09-12T18:09:30.746005+0000","last_became_active":"2024-09-12T17:20:30.535358+0000","last_became_peered":"2024-09-12T17:20:30.535358+0000","last_unstale":"2024-09-12T18:09:30.746005+0000","last_undegraded":"2024-09-12T18:09:30.746005+0000","last_fullsized":"2024-09-12T18:09:30.746005+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:14.210209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":15362,"num_write":12,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'12","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:52.751072+0000","last_change":"2024-09-12T17:16:11.490206+0000","last_active":"2024-09-12T18:09:52.751072+0000","last_peered":"2024-09-12T18:09:52.751072+0000","last_clean":"2024-09-12T18:09:52.751072+0000","last_became_active":"2024-09-12T17:16:11.489897+0000","last_became_peered":"2024-09-12T17:16:11.489897+0000","last_unstale":"2024-09-12T18:09:52.751072+0000","last_undegraded":"2024-09-12T18:09:52.751072+0000","last_fullsized":"2024-09-12T18:09:52.751072+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:03.772651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.620396+0000","last_change":"2024-09-12T17:39:05.927618+0000","last_active":"2024-09-12T18:10:31.620396+0000","last_peered":"2024-09-12T18:10:31.620396+0000","last_clean":"2024-09-12T18:10:31.620396+0000","last_became_active":"2024-09-12T17:39:05.926766+0000","last_became_peered":"2024-09-12T17:39:05.926766+0000","last_unstale":"2024-09-12T18:10:31.620396+0000","last_undegraded":"2024-09-12T18:10:31.620396+0000","last_fullsized":"2024-09-12T18:10:31.620396+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:41.020632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"264'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.926650+0000","last_change":"2024-09-12T17:20:34.559252+0000","last_active":"2024-09-12T18:11:53.926650+0000","last_peered":"2024-09-12T18:11:53.926650+0000","last_clean":"2024-09-12T18:11:53.926650+0000","last_became_active":"2024-09-12T17:20:34.558970+0000","last_became_peered":"2024-09-12T17:20:34.558970+0000","last_unstale":"2024-09-12T18:11:53.926650+0000","last_undegraded":"2024-09-12T18:11:53.926650+0000","last_fullsized":"2024-09-12T18:11:53.926650+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:58.158311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'2","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:31.837338+0000","last_change":"2024-09-12T17:20:30.536062+0000","last_active":"2024-09-12T18:09:31.837338+0000","last_peered":"2024-09-12T18:09:31.837338+0000","last_clean":"2024-09-12T18:09:31.837338+0000","last_became_active":"2024-09-12T17:20:30.535761+0000","last_became_peered":"2024-09-12T17:20:30.535761+0000","last_unstale":"2024-09-12T18:09:31.837338+0000","last_undegraded":"2024-09-12T18:09:31.837338+0000","last_fullsized":"2024-09-12T18:09:31.837338+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:41.021041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4197517,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":8196,"num_write":2,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'42","reported_seq":175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:51.615812+0000","last_change":"2024-09-12T17:16:11.488259+0000","last_active":"2024-09-12T18:09:51.615812+0000","last_peered":"2024-09-12T18:09:51.615812+0000","last_clean":"2024-09-12T18:09:51.615812+0000","last_became_active":"2024-09-12T17:16:11.487923+0000","last_became_peered":"2024-09-12T17:16:11.487923+0000","last_unstale":"2024-09-12T18:09:51.615812+0000","last_undegraded":"2024-09-12T18:09:51.615812+0000","last_fullsized":"2024-09-12T18:09:51.615812+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:17.535117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":152,"num_write":79,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:36.614300+0000","last_change":"2024-09-12T17:39:05.921610+0000","last_active":"2024-09-12T18:09:36.614300+0000","last_peered":"2024-09-12T18:09:36.614300+0000","last_clean":"2024-09-12T18:09:36.614300+0000","last_became_active":"2024-09-12T17:39:05.921257+0000","last_became_peered":"2024-09-12T17:39:05.921257+0000","last_unstale":"2024-09-12T18:09:36.614300+0000","last_undegraded":"2024-09-12T18:09:36.614300+0000","last_fullsized":"2024-09-12T18:09:36.614300+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:57.829484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:36.837884+0000","last_change":"2024-09-12T17:20:34.554048+0000","last_active":"2024-09-12T18:09:36.837884+0000","last_peered":"2024-09-12T18:09:36.837884+0000","last_clean":"2024-09-12T18:09:36.837884+0000","last_became_active":"2024-09-12T17:20:34.553659+0000","last_became_peered":"2024-09-12T17:20:34.553659+0000","last_unstale":"2024-09-12T18:09:36.837884+0000","last_undegraded":"2024-09-12T18:09:36.837884+0000","last_fullsized":"2024-09-12T18:09:36.837884+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:41.787619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51635,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":52,"num_write":2,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:32.735296+0000","last_change":"2024-09-12T17:20:30.535174+0000","last_active":"2024-09-12T18:09:32.735296+0000","last_peered":"2024-09-12T18:09:32.735296+0000","last_clean":"2024-09-12T18:09:32.735296+0000","last_became_active":"2024-09-12T17:20:30.534878+0000","last_became_peered":"2024-09-12T17:20:30.534878+0000","last_unstale":"2024-09-12T18:09:32.735296+0000","last_undegraded":"2024-09-12T18:09:32.735296+0000","last_fullsized":"2024-09-12T18:09:32.735296+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:22.315962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'92","reported_seq":343,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:50.748679+0000","last_change":"2024-09-12T17:16:11.489329+0000","last_active":"2024-09-12T18:09:50.748679+0000","last_peered":"2024-09-12T18:09:50.748679+0000","last_clean":"2024-09-12T18:09:50.748679+0000","last_became_active":"2024-09-12T17:16:11.489044+0000","last_became_peered":"2024-09-12T17:16:11.489044+0000","last_unstale":"2024-09-12T18:09:50.748679+0000","last_undegraded":"2024-09-12T18:09:50.748679+0000","last_fullsized":"2024-09-12T18:09:50.748679+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:09.438571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":552,"num_read_kb":376,"num_write":139,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844194+0000","last_change":"2024-09-12T17:39:05.932942+0000","last_active":"2024-09-12T18:10:31.844194+0000","last_peered":"2024-09-12T18:10:31.844194+0000","last_clean":"2024-09-12T18:10:31.844194+0000","last_became_active":"2024-09-12T17:39:05.932617+0000","last_became_peered":"2024-09-12T17:39:05.932617+0000","last_unstale":"2024-09-12T18:10:31.844194+0000","last_undegraded":"2024-09-12T18:10:31.844194+0000","last_fullsized":"2024-09-12T18:10:31.844194+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:47.846584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"261'5","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:37.736113+0000","last_change":"2024-09-12T17:20:34.559301+0000","last_active":"2024-09-12T18:09:37.736113+0000","last_peered":"2024-09-12T18:09:37.736113+0000","last_clean":"2024-09-12T18:09:37.736113+0000","last_became_active":"2024-09-12T17:20:34.559024+0000","last_became_peered":"2024-09-12T17:20:34.559024+0000","last_unstale":"2024-09-12T18:09:37.736113+0000","last_undegraded":"2024-09-12T18:09:37.736113+0000","last_fullsized":"2024-09-12T18:09:37.736113+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:19.256473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'5","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:32.946858+0000","last_change":"2024-09-12T17:20:30.534604+0000","last_active":"2024-09-12T18:09:32.946858+0000","last_peered":"2024-09-12T18:09:32.946858+0000","last_clean":"2024-09-12T18:09:32.946858+0000","last_became_active":"2024-09-12T17:20:30.534298+0000","last_became_peered":"2024-09-12T17:20:30.534298+0000","last_unstale":"2024-09-12T18:09:32.946858+0000","last_undegraded":"2024-09-12T18:09:32.946858+0000","last_fullsized":"2024-09-12T18:09:32.946858+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:07.258749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'39","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:51.839494+0000","last_change":"2024-09-12T17:16:11.489376+0000","last_active":"2024-09-12T18:09:51.839494+0000","last_peered":"2024-09-12T18:09:51.839494+0000","last_clean":"2024-09-12T18:09:51.839494+0000","last_became_active":"2024-09-12T17:16:11.489085+0000","last_became_peered":"2024-09-12T17:16:11.489085+0000","last_unstale":"2024-09-12T18:09:51.839494+0000","last_undegraded":"2024-09-12T18:09:51.839494+0000","last_fullsized":"2024-09-12T18:09:51.839494+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:34.809544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":137,"num_write":73,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:33.694207+0000","last_change":"2024-09-12T17:39:05.928701+0000","last_active":"2024-09-12T18:09:33.694207+0000","last_peered":"2024-09-12T18:09:33.694207+0000","last_clean":"2024-09-12T18:09:33.694207+0000","last_became_active":"2024-09-12T17:39:05.928320+0000","last_became_peered":"2024-09-12T17:39:05.928320+0000","last_unstale":"2024-09-12T18:09:33.694207+0000","last_undegraded":"2024-09-12T18:09:33.694207+0000","last_fullsized":"2024-09-12T18:09:33.694207+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:56.483652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"261'5","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:06.841342+0000","last_change":"2024-09-12T17:20:34.553728+0000","last_active":"2024-09-12T18:10:06.841342+0000","last_peered":"2024-09-12T18:10:06.841342+0000","last_clean":"2024-09-12T18:10:06.841342+0000","last_became_active":"2024-09-12T17:20:34.553407+0000","last_became_peered":"2024-09-12T17:20:34.553407+0000","last_unstale":"2024-09-12T18:10:06.841342+0000","last_undegraded":"2024-09-12T18:10:06.841342+0000","last_fullsized":"2024-09-12T18:10:06.841342+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:51.963850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'4","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:02.752571+0000","last_change":"2024-09-12T17:20:30.525002+0000","last_active":"2024-09-12T18:10:02.752571+0000","last_peered":"2024-09-12T18:10:02.752571+0000","last_clean":"2024-09-12T18:10:02.752571+0000","last_became_active":"2024-09-12T17:20:30.524670+0000","last_became_peered":"2024-09-12T17:20:30.524670+0000","last_unstale":"2024-09-12T18:10:02.752571+0000","last_undegraded":"2024-09-12T18:10:02.752571+0000","last_fullsized":"2024-09-12T18:10:02.752571+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:48.793238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8972971,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":4667,"num_write":9,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'33","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.843088+0000","last_change":"2024-09-12T17:16:11.487281+0000","last_active":"2024-09-12T18:10:21.843088+0000","last_peered":"2024-09-12T18:10:21.843088+0000","last_clean":"2024-09-12T18:10:21.843088+0000","last_became_active":"2024-09-12T17:16:11.486986+0000","last_became_peered":"2024-09-12T17:16:11.486986+0000","last_unstale":"2024-09-12T18:10:21.843088+0000","last_undegraded":"2024-09-12T18:10:21.843088+0000","last_fullsized":"2024-09-12T18:10:21.843088+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:58.383837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":108,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.758368+0000","last_change":"2024-09-12T17:39:05.927856+0000","last_active":"2024-09-12T18:10:37.758368+0000","last_peered":"2024-09-12T18:10:37.758368+0000","last_clean":"2024-09-12T18:10:37.758368+0000","last_became_active":"2024-09-12T17:39:05.927578+0000","last_became_peered":"2024-09-12T17:39:05.927578+0000","last_unstale":"2024-09-12T18:10:37.758368+0000","last_undegraded":"2024-09-12T18:10:37.758368+0000","last_fullsized":"2024-09-12T18:10:37.758368+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:21.888828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:06.841313+0000","last_change":"2024-09-12T17:20:34.552899+0000","last_active":"2024-09-12T18:10:06.841313+0000","last_peered":"2024-09-12T18:10:06.841313+0000","last_clean":"2024-09-12T18:10:06.841313+0000","last_became_active":"2024-09-12T17:20:34.552569+0000","last_became_peered":"2024-09-12T17:20:34.552569+0000","last_unstale":"2024-09-12T18:10:06.841313+0000","last_undegraded":"2024-09-12T18:10:06.841313+0000","last_fullsized":"2024-09-12T18:10:06.841313+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:59.485671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:03.697087+0000","last_change":"2024-09-12T17:20:30.538454+0000","last_active":"2024-09-12T18:10:03.697087+0000","last_peered":"2024-09-12T18:10:03.697087+0000","last_clean":"2024-09-12T18:10:03.697087+0000","last_became_active":"2024-09-12T17:20:30.538157+0000","last_became_peered":"2024-09-12T17:20:30.538157+0000","last_unstale":"2024-09-12T18:10:03.697087+0000","last_undegraded":"2024-09-12T18:10:03.697087+0000","last_fullsized":"2024-09-12T18:10:03.697087+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:21.990887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'29","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.953012+0000","last_change":"2024-09-12T17:16:11.488323+0000","last_active":"2024-09-12T18:10:12.953012+0000","last_peered":"2024-09-12T18:10:12.953012+0000","last_clean":"2024-09-12T18:10:12.953012+0000","last_became_active":"2024-09-12T17:16:11.487998+0000","last_became_peered":"2024-09-12T17:16:11.487998+0000","last_unstale":"2024-09-12T18:10:12.953012+0000","last_undegraded":"2024-09-12T18:10:12.953012+0000","last_fullsized":"2024-09-12T18:10:12.953012+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:46.362889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:37.753323+0000","last_change":"2024-09-12T17:39:05.921302+0000","last_active":"2024-09-12T18:11:37.753323+0000","last_peered":"2024-09-12T18:11:37.753323+0000","last_clean":"2024-09-12T18:11:37.753323+0000","last_became_active":"2024-09-12T17:39:05.921008+0000","last_became_peered":"2024-09-12T17:39:05.921008+0000","last_unstale":"2024-09-12T18:11:37.753323+0000","last_undegraded":"2024-09-12T18:11:37.753323+0000","last_fullsized":"2024-09-12T18:11:37.753323+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:44.290086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:28.933628+0000","last_change":"2024-09-12T17:20:34.616039+0000","last_active":"2024-09-12T18:12:28.933628+0000","last_peered":"2024-09-12T18:12:28.933628+0000","last_clean":"2024-09-12T18:12:28.933628+0000","last_became_active":"2024-09-12T17:20:34.615689+0000","last_became_peered":"2024-09-12T17:20:34.615689+0000","last_unstale":"2024-09-12T18:12:28.933628+0000","last_undegraded":"2024-09-12T18:12:28.933628+0000","last_fullsized":"2024-09-12T18:12:28.933628+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:14.341361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'3","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:01.616967+0000","last_change":"2024-09-12T17:20:30.540013+0000","last_active":"2024-09-12T18:10:01.616967+0000","last_peered":"2024-09-12T18:10:01.616967+0000","last_clean":"2024-09-12T18:10:01.616967+0000","last_became_active":"2024-09-12T17:20:30.536917+0000","last_became_peered":"2024-09-12T17:20:30.536917+0000","last_unstale":"2024-09-12T18:10:01.616967+0000","last_undegraded":"2024-09-12T18:10:01.616967+0000","last_fullsized":"2024-09-12T18:10:01.616967+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:21.908709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'41","reported_seq":168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.740858+0000","last_change":"2024-09-12T17:16:11.488593+0000","last_active":"2024-09-12T18:10:12.740858+0000","last_peered":"2024-09-12T18:10:12.740858+0000","last_clean":"2024-09-12T18:10:12.740858+0000","last_became_active":"2024-09-12T17:16:11.488252+0000","last_became_peered":"2024-09-12T17:16:11.488252+0000","last_unstale":"2024-09-12T18:10:12.740858+0000","last_undegraded":"2024-09-12T18:10:12.740858+0000","last_fullsized":"2024-09-12T18:10:12.740858+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:41.338780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":141,"num_write":74,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:37.767690+0000","last_change":"2024-09-12T17:39:05.926009+0000","last_active":"2024-09-12T18:11:37.767690+0000","last_peered":"2024-09-12T18:11:37.767690+0000","last_clean":"2024-09-12T18:11:37.767690+0000","last_became_active":"2024-09-12T17:39:05.925589+0000","last_became_peered":"2024-09-12T17:39:05.925589+0000","last_unstale":"2024-09-12T18:11:37.767690+0000","last_undegraded":"2024-09-12T18:11:37.767690+0000","last_fullsized":"2024-09-12T18:11:37.767690+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:14.643645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'10","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:06.841353+0000","last_change":"2024-09-12T17:20:34.560582+0000","last_active":"2024-09-12T18:10:06.841353+0000","last_peered":"2024-09-12T18:10:06.841353+0000","last_clean":"2024-09-12T18:10:06.841353+0000","last_became_active":"2024-09-12T17:20:34.560319+0000","last_became_peered":"2024-09-12T17:20:34.560319+0000","last_unstale":"2024-09-12T18:10:06.841353+0000","last_undegraded":"2024-09-12T18:10:06.841353+0000","last_fullsized":"2024-09-12T18:10:06.841353+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:25.756495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":15462,"num_write":15,"num_write_kb":7218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'2","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:28.933593+0000","last_change":"2024-09-12T17:20:30.531674+0000","last_active":"2024-09-12T18:12:28.933593+0000","last_peered":"2024-09-12T18:12:28.933593+0000","last_clean":"2024-09-12T18:12:28.933593+0000","last_became_active":"2024-09-12T17:20:30.531384+0000","last_became_peered":"2024-09-12T17:20:30.531384+0000","last_unstale":"2024-09-12T18:12:28.933593+0000","last_undegraded":"2024-09-12T18:12:28.933593+0000","last_fullsized":"2024-09-12T18:12:28.933593+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:07.405605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'7","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:13.698059+0000","last_change":"2024-09-12T17:16:11.486387+0000","last_active":"2024-09-12T18:10:13.698059+0000","last_peered":"2024-09-12T18:10:13.698059+0000","last_clean":"2024-09-12T18:10:13.698059+0000","last_became_active":"2024-09-12T17:16:11.486098+0000","last_became_peered":"2024-09-12T17:16:11.486098+0000","last_unstale":"2024-09-12T18:10:13.698059+0000","last_undegraded":"2024-09-12T18:10:13.698059+0000","last_fullsized":"2024-09-12T18:10:13.698059+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:46.177478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.844775+0000","last_change":"2024-09-12T17:39:05.926486+0000","last_active":"2024-09-12T18:10:36.844775+0000","last_peered":"2024-09-12T18:10:36.844775+0000","last_clean":"2024-09-12T18:10:36.844775+0000","last_became_active":"2024-09-12T17:39:05.925637+0000","last_became_peered":"2024-09-12T17:39:05.925637+0000","last_unstale":"2024-09-12T18:10:36.844775+0000","last_undegraded":"2024-09-12T18:10:36.844775+0000","last_fullsized":"2024-09-12T18:10:36.844775+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:55.840960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:25.753841+0000","last_change":"2024-09-12T17:20:47.596669+0000","last_active":"2024-09-12T18:10:25.753841+0000","last_peered":"2024-09-12T18:10:25.753841+0000","last_clean":"2024-09-12T18:10:25.753841+0000","last_became_active":"2024-09-12T17:20:47.581310+0000","last_became_peered":"2024-09-12T17:20:47.581310+0000","last_unstale":"2024-09-12T18:10:25.753841+0000","last_undegraded":"2024-09-12T18:10:25.753841+0000","last_fullsized":"2024-09-12T18:10:25.753841+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:11.897529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619107+0000","last_change":"2024-09-12T17:20:30.536180+0000","last_active":"2024-09-12T18:10:21.619107+0000","last_peered":"2024-09-12T18:10:21.619107+0000","last_clean":"2024-09-12T18:10:21.619107+0000","last_became_active":"2024-09-12T17:20:30.535668+0000","last_became_peered":"2024-09-12T17:20:30.535668+0000","last_unstale":"2024-09-12T18:10:21.619107+0000","last_undegraded":"2024-09-12T18:10:21.619107+0000","last_fullsized":"2024-09-12T18:10:21.619107+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:31.430438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'13","reported_seq":92,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:11.618041+0000","last_change":"2024-09-12T17:16:11.484443+0000","last_active":"2024-09-12T18:10:11.618041+0000","last_peered":"2024-09-12T18:10:11.618041+0000","last_clean":"2024-09-12T18:10:11.618041+0000","last_became_active":"2024-09-12T17:16:11.484154+0000","last_became_peered":"2024-09-12T17:16:11.484154+0000","last_unstale":"2024-09-12T18:10:11.618041+0000","last_undegraded":"2024-09-12T18:10:11.618041+0000","last_fullsized":"2024-09-12T18:10:11.618041+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:54.824715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":37,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:42.759255+0000","last_change":"2024-09-12T17:39:05.928118+0000","last_active":"2024-09-12T18:10:42.759255+0000","last_peered":"2024-09-12T18:10:42.759255+0000","last_clean":"2024-09-12T18:10:42.759255+0000","last_became_active":"2024-09-12T17:39:05.927841+0000","last_became_peered":"2024-09-12T17:39:05.927841+0000","last_unstale":"2024-09-12T18:10:42.759255+0000","last_undegraded":"2024-09-12T18:10:42.759255+0000","last_fullsized":"2024-09-12T18:10:42.759255+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:37.026584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.756629+0000","last_change":"2024-09-12T17:20:34.611017+0000","last_active":"2024-09-12T18:10:27.756629+0000","last_peered":"2024-09-12T18:10:27.756629+0000","last_clean":"2024-09-12T18:10:27.756629+0000","last_became_active":"2024-09-12T17:20:34.610737+0000","last_became_peered":"2024-09-12T17:20:34.610737+0000","last_unstale":"2024-09-12T18:10:27.756629+0000","last_undegraded":"2024-09-12T18:10:27.756629+0000","last_fullsized":"2024-09-12T18:10:27.756629+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:07.818994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:23.917473+0000","last_change":"2024-09-12T17:20:30.529241+0000","last_active":"2024-09-12T18:10:23.917473+0000","last_peered":"2024-09-12T18:10:23.917473+0000","last_clean":"2024-09-12T18:10:23.917473+0000","last_became_active":"2024-09-12T17:20:30.528902+0000","last_became_peered":"2024-09-12T17:20:30.528902+0000","last_unstale":"2024-09-12T18:10:23.917473+0000","last_undegraded":"2024-09-12T18:10:23.917473+0000","last_fullsized":"2024-09-12T18:10:23.917473+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:59.483184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'31","reported_seq":148,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.757491+0000","last_change":"2024-09-12T17:16:11.489013+0000","last_active":"2024-09-12T18:10:32.757491+0000","last_peered":"2024-09-12T18:10:32.757491+0000","last_clean":"2024-09-12T18:10:32.757491+0000","last_became_active":"2024-09-12T17:16:11.488722+0000","last_became_peered":"2024-09-12T17:16:11.488722+0000","last_unstale":"2024-09-12T18:10:32.757491+0000","last_undegraded":"2024-09-12T18:10:32.757491+0000","last_fullsized":"2024-09-12T18:10:32.757491+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:19.504993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":116,"num_write":54,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.758386+0000","last_change":"2024-09-12T17:39:05.929421+0000","last_active":"2024-09-12T18:10:37.758386+0000","last_peered":"2024-09-12T18:10:37.758386+0000","last_clean":"2024-09-12T18:10:37.758386+0000","last_became_active":"2024-09-12T17:39:05.929156+0000","last_became_peered":"2024-09-12T17:39:05.929156+0000","last_unstale":"2024-09-12T18:10:37.758386+0000","last_undegraded":"2024-09-12T18:10:37.758386+0000","last_fullsized":"2024-09-12T18:10:37.758386+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:37.940351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:03.915183+0000","last_change":"2024-09-12T17:20:34.559128+0000","last_active":"2024-09-12T18:10:03.915183+0000","last_peered":"2024-09-12T18:10:03.915183+0000","last_clean":"2024-09-12T18:10:03.915183+0000","last_became_active":"2024-09-12T17:20:34.558826+0000","last_became_peered":"2024-09-12T17:20:34.558826+0000","last_unstale":"2024-09-12T18:10:03.915183+0000","last_undegraded":"2024-09-12T18:10:03.915183+0000","last_fullsized":"2024-09-12T18:10:03.915183+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:41.318428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.620862+0000","last_change":"2024-09-12T17:20:30.537479+0000","last_active":"2024-09-12T18:10:36.620862+0000","last_peered":"2024-09-12T18:10:36.620862+0000","last_clean":"2024-09-12T18:10:36.620862+0000","last_became_active":"2024-09-12T17:20:30.537204+0000","last_became_peered":"2024-09-12T17:20:30.537204+0000","last_unstale":"2024-09-12T18:10:36.620862+0000","last_undegraded":"2024-09-12T18:10:36.620862+0000","last_fullsized":"2024-09-12T18:10:36.620862+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:58.505650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'43","reported_seq":176,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.842925+0000","last_change":"2024-09-12T17:16:11.487416+0000","last_active":"2024-09-12T18:10:21.842925+0000","last_peered":"2024-09-12T18:10:21.842925+0000","last_clean":"2024-09-12T18:10:21.842925+0000","last_became_active":"2024-09-12T17:16:11.487129+0000","last_became_peered":"2024-09-12T17:16:11.487129+0000","last_unstale":"2024-09-12T18:10:21.842925+0000","last_undegraded":"2024-09-12T18:10:21.842925+0000","last_fullsized":"2024-09-12T18:10:21.842925+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:13.494114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":153,"num_write":79,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.620937+0000","last_change":"2024-09-12T17:39:05.926264+0000","last_active":"2024-09-12T18:10:36.620937+0000","last_peered":"2024-09-12T18:10:36.620937+0000","last_clean":"2024-09-12T18:10:36.620937+0000","last_became_active":"2024-09-12T17:39:05.925950+0000","last_became_peered":"2024-09-12T17:39:05.925950+0000","last_unstale":"2024-09-12T18:10:36.620937+0000","last_undegraded":"2024-09-12T18:10:36.620937+0000","last_fullsized":"2024-09-12T18:10:36.620937+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:25.942839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.758339+0000","last_change":"2024-09-12T17:20:34.555836+0000","last_active":"2024-09-12T18:10:37.758339+0000","last_peered":"2024-09-12T18:10:37.758339+0000","last_clean":"2024-09-12T18:10:37.758339+0000","last_became_active":"2024-09-12T17:20:34.555493+0000","last_became_peered":"2024-09-12T17:20:34.555493+0000","last_unstale":"2024-09-12T18:10:37.758339+0000","last_undegraded":"2024-09-12T18:10:37.758339+0000","last_fullsized":"2024-09-12T18:10:37.758339+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:04.010344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'3","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:00.750159+0000","last_change":"2024-09-12T17:20:30.534904+0000","last_active":"2024-09-12T18:10:00.750159+0000","last_peered":"2024-09-12T18:10:00.750159+0000","last_clean":"2024-09-12T18:10:00.750159+0000","last_became_active":"2024-09-12T17:20:30.534448+0000","last_became_peered":"2024-09-12T17:20:30.534448+0000","last_unstale":"2024-09-12T18:10:00.750159+0000","last_undegraded":"2024-09-12T18:10:00.750159+0000","last_fullsized":"2024-09-12T18:10:00.750159+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:56.106715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48422,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4144,"num_write":3,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'9","reported_seq":87,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.742416+0000","last_change":"2024-09-12T17:16:11.488846+0000","last_active":"2024-09-12T18:10:22.742416+0000","last_peered":"2024-09-12T18:10:22.742416+0000","last_clean":"2024-09-12T18:10:22.742416+0000","last_became_active":"2024-09-12T17:16:11.488433+0000","last_became_peered":"2024-09-12T17:16:11.488433+0000","last_unstale":"2024-09-12T18:10:22.742416+0000","last_undegraded":"2024-09-12T18:10:22.742416+0000","last_fullsized":"2024-09-12T18:10:22.742416+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:14.398588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":34,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.755896+0000","last_change":"2024-09-12T17:39:05.927566+0000","last_active":"2024-09-12T18:10:22.755896+0000","last_peered":"2024-09-12T18:10:22.755896+0000","last_clean":"2024-09-12T18:10:22.755896+0000","last_became_active":"2024-09-12T17:39:05.925525+0000","last_became_peered":"2024-09-12T17:39:05.925525+0000","last_unstale":"2024-09-12T18:10:22.755896+0000","last_undegraded":"2024-09-12T18:10:22.755896+0000","last_fullsized":"2024-09-12T18:10:22.755896+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:27.269945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'2","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:51.622647+0000","last_change":"2024-09-12T17:20:34.559275+0000","last_active":"2024-09-12T18:10:51.622647+0000","last_peered":"2024-09-12T18:10:51.622647+0000","last_clean":"2024-09-12T18:10:51.622647+0000","last_became_active":"2024-09-12T17:20:34.558946+0000","last_became_peered":"2024-09-12T17:20:34.558946+0000","last_unstale":"2024-09-12T18:10:51.622647+0000","last_undegraded":"2024-09-12T18:10:51.622647+0000","last_fullsized":"2024-09-12T18:10:51.622647+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:44.945949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'4","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.757518+0000","last_change":"2024-09-12T17:20:30.528368+0000","last_active":"2024-09-12T18:10:32.757518+0000","last_peered":"2024-09-12T18:10:32.757518+0000","last_clean":"2024-09-12T18:10:32.757518+0000","last_became_active":"2024-09-12T17:20:30.528078+0000","last_became_peered":"2024-09-12T17:20:30.528078+0000","last_unstale":"2024-09-12T18:10:32.757518+0000","last_undegraded":"2024-09-12T18:10:32.757518+0000","last_fullsized":"2024-09-12T18:10:32.757518+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:37.188849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'44","reported_seq":182,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619260+0000","last_change":"2024-09-12T17:16:11.481733+0000","last_active":"2024-09-12T18:10:21.619260+0000","last_peered":"2024-09-12T18:10:21.619260+0000","last_clean":"2024-09-12T18:10:21.619260+0000","last_became_active":"2024-09-12T17:16:11.481431+0000","last_became_peered":"2024-09-12T17:16:11.481431+0000","last_unstale":"2024-09-12T18:10:21.619260+0000","last_undegraded":"2024-09-12T18:10:21.619260+0000","last_fullsized":"2024-09-12T18:10:21.619260+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:47.517502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":166,"num_write":69,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954425+0000","last_change":"2024-09-12T17:39:05.919499+0000","last_active":"2024-09-12T18:10:22.954425+0000","last_peered":"2024-09-12T18:10:22.954425+0000","last_clean":"2024-09-12T18:10:22.954425+0000","last_became_active":"2024-09-12T17:39:05.919207+0000","last_became_peered":"2024-09-12T17:39:05.919207+0000","last_unstale":"2024-09-12T18:10:22.954425+0000","last_undegraded":"2024-09-12T18:10:22.954425+0000","last_fullsized":"2024-09-12T18:10:22.954425+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:26.247547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'8","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.620919+0000","last_change":"2024-09-12T17:20:34.613162+0000","last_active":"2024-09-12T18:10:36.620919+0000","last_peered":"2024-09-12T18:10:36.620919+0000","last_clean":"2024-09-12T18:10:36.620919+0000","last_became_active":"2024-09-12T17:20:34.612840+0000","last_became_peered":"2024-09-12T17:20:34.612840+0000","last_unstale":"2024-09-12T18:10:36.620919+0000","last_undegraded":"2024-09-12T18:10:36.620919+0000","last_fullsized":"2024-09-12T18:10:36.620919+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:07.359408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":23554,"num_write":8,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:43.700925+0000","last_change":"2024-09-12T17:20:30.539195+0000","last_active":"2024-09-12T18:10:43.700925+0000","last_peered":"2024-09-12T18:10:43.700925+0000","last_clean":"2024-09-12T18:10:43.700925+0000","last_became_active":"2024-09-12T17:20:30.538913+0000","last_became_peered":"2024-09-12T17:20:30.538913+0000","last_unstale":"2024-09-12T18:10:43.700925+0000","last_undegraded":"2024-09-12T18:10:43.700925+0000","last_fullsized":"2024-09-12T18:10:43.700925+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:30.309214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'103","reported_seq":385,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.742516+0000","last_change":"2024-09-12T17:16:11.489384+0000","last_active":"2024-09-12T18:10:22.742516+0000","last_peered":"2024-09-12T18:10:22.742516+0000","last_clean":"2024-09-12T18:10:22.742516+0000","last_became_active":"2024-09-12T17:16:11.489087+0000","last_became_peered":"2024-09-12T17:16:11.489087+0000","last_unstale":"2024-09-12T18:10:22.742516+0000","last_undegraded":"2024-09-12T18:10:22.742516+0000","last_fullsized":"2024-09-12T18:10:22.742516+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:44.577138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":629,"num_read_kb":433,"num_write":144,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.922659+0000","last_change":"2024-09-12T17:39:05.921957+0000","last_active":"2024-09-12T18:11:13.922659+0000","last_peered":"2024-09-12T18:11:13.922659+0000","last_clean":"2024-09-12T18:11:13.922659+0000","last_became_active":"2024-09-12T17:39:05.921608+0000","last_became_peered":"2024-09-12T17:39:05.921608+0000","last_unstale":"2024-09-12T18:11:13.922659+0000","last_undegraded":"2024-09-12T18:11:13.922659+0000","last_fullsized":"2024-09-12T18:11:13.922659+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:54.960277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.756818+0000","last_change":"2024-09-12T17:20:34.611054+0000","last_active":"2024-09-12T18:10:27.756818+0000","last_peered":"2024-09-12T18:10:27.756818+0000","last_clean":"2024-09-12T18:10:27.756818+0000","last_became_active":"2024-09-12T17:20:34.610719+0000","last_became_peered":"2024-09-12T17:20:34.610719+0000","last_unstale":"2024-09-12T18:10:27.756818+0000","last_undegraded":"2024-09-12T18:10:27.756818+0000","last_fullsized":"2024-09-12T18:10:27.756818+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:24.284192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954530+0000","last_change":"2024-09-12T17:20:30.535657+0000","last_active":"2024-09-12T18:10:22.954530+0000","last_peered":"2024-09-12T18:10:22.954530+0000","last_clean":"2024-09-12T18:10:22.954530+0000","last_became_active":"2024-09-12T17:20:30.535382+0000","last_became_peered":"2024-09-12T17:20:30.535382+0000","last_unstale":"2024-09-12T18:10:22.954530+0000","last_undegraded":"2024-09-12T18:10:22.954530+0000","last_fullsized":"2024-09-12T18:10:22.954530+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:06.602123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'27","reported_seq":132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.757540+0000","last_change":"2024-09-12T17:16:11.487072+0000","last_active":"2024-09-12T18:10:32.757540+0000","last_peered":"2024-09-12T18:10:32.757540+0000","last_clean":"2024-09-12T18:10:32.757540+0000","last_became_active":"2024-09-12T17:16:11.486799+0000","last_became_peered":"2024-09-12T17:16:11.486799+0000","last_unstale":"2024-09-12T18:10:32.757540+0000","last_undegraded":"2024-09-12T18:10:32.757540+0000","last_fullsized":"2024-09-12T18:10:32.757540+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:25.256158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":89,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.753105+0000","last_change":"2024-09-12T17:39:05.923468+0000","last_active":"2024-09-12T18:10:20.753105+0000","last_peered":"2024-09-12T18:10:20.753105+0000","last_clean":"2024-09-12T18:10:20.753105+0000","last_became_active":"2024-09-12T17:39:05.923192+0000","last_became_peered":"2024-09-12T17:39:05.923192+0000","last_unstale":"2024-09-12T18:10:20.753105+0000","last_undegraded":"2024-09-12T18:10:20.753105+0000","last_fullsized":"2024-09-12T18:10:20.753105+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:18.451237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'2","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:25.753945+0000","last_change":"2024-09-12T17:20:34.555545+0000","last_active":"2024-09-12T18:10:25.753945+0000","last_peered":"2024-09-12T18:10:25.753945+0000","last_clean":"2024-09-12T18:10:25.753945+0000","last_became_active":"2024-09-12T17:20:34.555267+0000","last_became_peered":"2024-09-12T17:20:34.555267+0000","last_unstale":"2024-09-12T18:10:25.753945+0000","last_undegraded":"2024-09-12T18:10:25.753945+0000","last_fullsized":"2024-09-12T18:10:25.753945+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:48.447926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'3","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.756008+0000","last_change":"2024-09-12T17:20:30.531341+0000","last_active":"2024-09-12T18:10:22.756008+0000","last_peered":"2024-09-12T18:10:22.756008+0000","last_clean":"2024-09-12T18:10:22.756008+0000","last_became_active":"2024-09-12T17:20:30.530998+0000","last_became_peered":"2024-09-12T17:20:30.530998+0000","last_unstale":"2024-09-12T18:10:22.756008+0000","last_undegraded":"2024-09-12T18:10:22.756008+0000","last_fullsized":"2024-09-12T18:10:22.756008+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:28.087866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'20","reported_seq":119,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:23.917537+0000","last_change":"2024-09-12T17:16:11.487744+0000","last_active":"2024-09-12T18:10:23.917537+0000","last_peered":"2024-09-12T18:10:23.917537+0000","last_clean":"2024-09-12T18:10:23.917537+0000","last_became_active":"2024-09-12T17:16:11.487439+0000","last_became_peered":"2024-09-12T17:16:11.487439+0000","last_unstale":"2024-09-12T18:10:23.917537+0000","last_undegraded":"2024-09-12T18:10:23.917537+0000","last_fullsized":"2024-09-12T18:10:23.917537+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:01.381415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":36,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:38.706396+0000","last_change":"2024-09-12T17:39:05.923711+0000","last_active":"2024-09-12T18:11:38.706396+0000","last_peered":"2024-09-12T18:11:38.706396+0000","last_clean":"2024-09-12T18:11:38.706396+0000","last_became_active":"2024-09-12T17:39:05.923420+0000","last_became_peered":"2024-09-12T17:39:05.923420+0000","last_unstale":"2024-09-12T18:11:38.706396+0000","last_undegraded":"2024-09-12T18:11:38.706396+0000","last_fullsized":"2024-09-12T18:11:38.706396+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:30.324051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'5","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:38.934756+0000","last_change":"2024-09-12T17:20:34.558121+0000","last_active":"2024-09-12T18:12:38.934756+0000","last_peered":"2024-09-12T18:12:38.934756+0000","last_clean":"2024-09-12T18:12:38.934756+0000","last_became_active":"2024-09-12T17:20:34.557794+0000","last_became_peered":"2024-09-12T17:20:34.557794+0000","last_unstale":"2024-09-12T18:12:38.934756+0000","last_undegraded":"2024-09-12T18:12:38.934756+0000","last_fullsized":"2024-09-12T18:12:38.934756+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:35.789851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'6","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:42.759117+0000","last_change":"2024-09-12T17:20:30.538275+0000","last_active":"2024-09-12T18:10:42.759117+0000","last_peered":"2024-09-12T18:10:42.759117+0000","last_clean":"2024-09-12T18:10:42.759117+0000","last_became_active":"2024-09-12T17:20:30.537970+0000","last_became_peered":"2024-09-12T17:20:30.537970+0000","last_unstale":"2024-09-12T18:10:42.759117+0000","last_undegraded":"2024-09-12T18:10:42.759117+0000","last_fullsized":"2024-09-12T18:10:42.759117+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:25.105193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":19458,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'24","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954441+0000","last_change":"2024-09-12T17:16:11.487378+0000","last_active":"2024-09-12T18:10:22.954441+0000","last_peered":"2024-09-12T18:10:22.954441+0000","last_clean":"2024-09-12T18:10:22.954441+0000","last_became_active":"2024-09-12T17:16:11.486298+0000","last_became_peered":"2024-09-12T17:16:11.486298+0000","last_unstale":"2024-09-12T18:10:22.954441+0000","last_undegraded":"2024-09-12T18:10:22.954441+0000","last_fullsized":"2024-09-12T18:10:22.954441+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:22.173224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:36.627544+0000","last_change":"2024-09-12T17:39:05.921428+0000","last_active":"2024-09-12T18:11:36.627544+0000","last_peered":"2024-09-12T18:11:36.627544+0000","last_clean":"2024-09-12T18:11:36.627544+0000","last_became_active":"2024-09-12T17:39:05.921085+0000","last_became_peered":"2024-09-12T17:39:05.921085+0000","last_unstale":"2024-09-12T18:11:36.627544+0000","last_undegraded":"2024-09-12T18:11:36.627544+0000","last_fullsized":"2024-09-12T18:11:36.627544+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:12.796863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'4","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:47.958321+0000","last_change":"2024-09-12T17:20:34.559242+0000","last_active":"2024-09-12T18:10:47.958321+0000","last_peered":"2024-09-12T18:10:47.958321+0000","last_clean":"2024-09-12T18:10:47.958321+0000","last_became_active":"2024-09-12T17:20:34.558963+0000","last_became_peered":"2024-09-12T17:20:34.558963+0000","last_unstale":"2024-09-12T18:10:47.958321+0000","last_undegraded":"2024-09-12T18:10:47.958321+0000","last_fullsized":"2024-09-12T18:10:47.958321+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:24.912978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.757457+0000","last_change":"2024-09-12T17:20:30.524694+0000","last_active":"2024-09-12T18:10:32.757457+0000","last_peered":"2024-09-12T18:10:32.757457+0000","last_clean":"2024-09-12T18:10:32.757457+0000","last_became_active":"2024-09-12T17:20:30.524377+0000","last_became_peered":"2024-09-12T17:20:30.524377+0000","last_unstale":"2024-09-12T18:10:32.757457+0000","last_undegraded":"2024-09-12T18:10:32.757457+0000","last_fullsized":"2024-09-12T18:10:32.757457+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:30.709529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'59","reported_seq":225,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.753135+0000","last_change":"2024-09-12T17:16:11.491864+0000","last_active":"2024-09-12T18:10:20.753135+0000","last_peered":"2024-09-12T18:10:20.753135+0000","last_clean":"2024-09-12T18:10:20.753135+0000","last_became_active":"2024-09-12T17:16:11.491512+0000","last_became_peered":"2024-09-12T17:16:11.491512+0000","last_unstale":"2024-09-12T18:10:20.753135+0000","last_undegraded":"2024-09-12T18:10:20.753135+0000","last_fullsized":"2024-09-12T18:10:20.753135+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:58.986968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":313,"num_read_kb":225,"num_write":101,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619193+0000","last_change":"2024-09-12T17:39:05.926334+0000","last_active":"2024-09-12T18:10:21.619193+0000","last_peered":"2024-09-12T18:10:21.619193+0000","last_clean":"2024-09-12T18:10:21.619193+0000","last_became_active":"2024-09-12T17:39:05.926029+0000","last_became_peered":"2024-09-12T17:39:05.926029+0000","last_unstale":"2024-09-12T18:10:21.619193+0000","last_undegraded":"2024-09-12T18:10:21.619193+0000","last_fullsized":"2024-09-12T18:10:21.619193+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:44.569050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"261'2","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.744693+0000","last_change":"2024-09-12T17:20:34.555632+0000","last_active":"2024-09-12T18:10:37.744693+0000","last_peered":"2024-09-12T18:10:37.744693+0000","last_clean":"2024-09-12T18:10:37.744693+0000","last_became_active":"2024-09-12T17:20:34.555137+0000","last_became_peered":"2024-09-12T17:20:34.555137+0000","last_unstale":"2024-09-12T18:10:37.744693+0000","last_undegraded":"2024-09-12T18:10:37.744693+0000","last_fullsized":"2024-09-12T18:10:37.744693+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:44.659171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'1","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:33.918629+0000","last_change":"2024-09-12T17:20:30.531528+0000","last_active":"2024-09-12T18:10:33.918629+0000","last_peered":"2024-09-12T18:10:33.918629+0000","last_clean":"2024-09-12T18:10:33.918629+0000","last_became_active":"2024-09-12T17:20:30.531232+0000","last_became_peered":"2024-09-12T17:20:30.531232+0000","last_unstale":"2024-09-12T18:10:33.918629+0000","last_undegraded":"2024-09-12T18:10:33.918629+0000","last_fullsized":"2024-09-12T18:10:33.918629+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:17.702865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'13","reported_seq":98,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.742450+0000","last_change":"2024-09-12T17:16:11.491691+0000","last_active":"2024-09-12T18:10:22.742450+0000","last_peered":"2024-09-12T18:10:22.742450+0000","last_clean":"2024-09-12T18:10:22.742450+0000","last_became_active":"2024-09-12T17:16:11.491334+0000","last_became_peered":"2024-09-12T17:16:11.491334+0000","last_unstale":"2024-09-12T18:10:22.742450+0000","last_undegraded":"2024-09-12T18:10:22.742450+0000","last_fullsized":"2024-09-12T18:10:22.742450+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:26.856534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":49,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.756721+0000","last_change":"2024-09-12T17:39:05.930558+0000","last_active":"2024-09-12T18:10:27.756721+0000","last_peered":"2024-09-12T18:10:27.756721+0000","last_clean":"2024-09-12T18:10:27.756721+0000","last_became_active":"2024-09-12T17:39:05.930326+0000","last_became_peered":"2024-09-12T17:39:05.930326+0000","last_unstale":"2024-09-12T18:10:27.756721+0000","last_undegraded":"2024-09-12T18:10:27.756721+0000","last_fullsized":"2024-09-12T18:10:27.756721+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:01.120642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'5","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:35.755466+0000","last_change":"2024-09-12T17:20:34.556804+0000","last_active":"2024-09-12T18:10:35.755466+0000","last_peered":"2024-09-12T18:10:35.755466+0000","last_clean":"2024-09-12T18:10:35.755466+0000","last_became_active":"2024-09-12T17:20:34.554832+0000","last_became_peered":"2024-09-12T17:20:34.554832+0000","last_unstale":"2024-09-12T18:10:35.755466+0000","last_undegraded":"2024-09-12T18:10:35.755466+0000","last_fullsized":"2024-09-12T18:10:35.755466+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:59.545466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":15,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'2","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.743952+0000","last_change":"2024-09-12T17:20:30.528814+0000","last_active":"2024-09-12T18:10:32.743952+0000","last_peered":"2024-09-12T18:10:32.743952+0000","last_clean":"2024-09-12T18:10:32.743952+0000","last_became_active":"2024-09-12T17:20:30.528541+0000","last_became_peered":"2024-09-12T17:20:30.528541+0000","last_unstale":"2024-09-12T18:10:32.743952+0000","last_undegraded":"2024-09-12T18:10:32.743952+0000","last_fullsized":"2024-09-12T18:10:32.743952+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:39.437987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'21","reported_seq":117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.755820+0000","last_change":"2024-09-12T17:16:11.487563+0000","last_active":"2024-09-12T18:10:22.755820+0000","last_peered":"2024-09-12T18:10:22.755820+0000","last_clean":"2024-09-12T18:10:22.755820+0000","last_became_active":"2024-09-12T17:16:11.487238+0000","last_became_peered":"2024-09-12T17:16:11.487238+0000","last_unstale":"2024-09-12T18:10:22.755820+0000","last_undegraded":"2024-09-12T18:10:22.755820+0000","last_fullsized":"2024-09-12T18:10:22.755820+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:39.870434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":71,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'303","reported_seq":940,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.261952+0000","last_change":"2024-09-12T17:00:12.304380+0000","last_active":"2024-09-12T18:11:11.261952+0000","last_peered":"2024-09-12T18:11:11.261952+0000","last_clean":"2024-09-12T18:11:11.261952+0000","last_became_active":"2024-09-12T17:00:12.304074+0000","last_became_peered":"2024-09-12T17:00:12.304074+0000","last_unstale":"2024-09-12T18:11:11.261952+0000","last_undegraded":"2024-09-12T18:11:11.261952+0000","last_fullsized":"2024-09-12T18:11:11.261952+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:10:33.200742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1686994,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":473,"num_read_kb":3821,"num_write":1093,"num_write_kb":12701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'137","reported_seq":747,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.953601+0000","last_change":"2024-09-12T17:00:14.328728+0000","last_active":"2024-09-12T18:10:17.953601+0000","last_peered":"2024-09-12T18:10:17.953601+0000","last_clean":"2024-09-12T18:10:17.953601+0000","last_became_active":"2024-09-12T17:00:14.328464+0000","last_became_peered":"2024-09-12T17:00:14.328464+0000","last_unstale":"2024-09-12T18:10:17.953601+0000","last_undegraded":"2024-09-12T18:10:17.953601+0000","last_fullsized":"2024-09-12T18:10:17.953601+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:22.736868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":594,"num_read_kb":496,"num_write":221,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'298","reported_seq":932,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.864070+0000","last_change":"2024-09-12T17:00:12.303038+0000","last_active":"2024-09-12T18:13:48.864070+0000","last_peered":"2024-09-12T18:13:48.864070+0000","last_clean":"2024-09-12T18:13:48.864070+0000","last_became_active":"2024-09-12T17:00:12.302750+0000","last_became_peered":"2024-09-12T17:00:12.302750+0000","last_unstale":"2024-09-12T18:13:48.864070+0000","last_undegraded":"2024-09-12T18:13:48.864070+0000","last_fullsized":"2024-09-12T18:13:48.864070+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:48.905725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262421,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":398,"num_read_kb":57739,"num_write":1002,"num_write_kb":55497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'222","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:21.909979+0000","last_change":"2024-09-12T17:00:14.336471+0000","last_active":"2024-09-12T18:13:21.909979+0000","last_peered":"2024-09-12T18:13:21.909979+0000","last_clean":"2024-09-12T18:13:21.909979+0000","last_became_active":"2024-09-12T17:00:14.336238+0000","last_became_peered":"2024-09-12T17:00:14.336238+0000","last_unstale":"2024-09-12T18:13:21.909979+0000","last_undegraded":"2024-09-12T18:13:21.909979+0000","last_fullsized":"2024-09-12T18:13:21.909979+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:33.594656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":973,"num_read_kb":793,"num_write":333,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'282","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:01.623680+0000","last_change":"2024-09-12T17:00:12.309414+0000","last_active":"2024-09-12T18:11:01.623680+0000","last_peered":"2024-09-12T18:11:01.623680+0000","last_clean":"2024-09-12T18:11:01.623680+0000","last_became_active":"2024-09-12T17:00:12.309132+0000","last_became_peered":"2024-09-12T17:00:12.309132+0000","last_unstale":"2024-09-12T18:11:01.623680+0000","last_undegraded":"2024-09-12T18:11:01.623680+0000","last_fullsized":"2024-09-12T18:11:01.623680+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:14.849278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14712901,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":469,"num_read_kb":32498,"num_write":1072,"num_write_kb":31975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'254","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:15.752313+0000","last_change":"2024-09-12T17:00:14.324328+0000","last_active":"2024-09-12T18:10:15.752313+0000","last_peered":"2024-09-12T18:10:15.752313+0000","last_clean":"2024-09-12T18:10:15.752313+0000","last_became_active":"2024-09-12T17:00:14.323358+0000","last_became_peered":"2024-09-12T17:00:14.323358+0000","last_unstale":"2024-09-12T18:10:15.752313+0000","last_undegraded":"2024-09-12T18:10:15.752313+0000","last_fullsized":"2024-09-12T18:10:15.752313+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:08.155945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1058,"num_read_kb":862,"num_write":363,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'244","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.955171+0000","last_change":"2024-09-12T17:00:12.321038+0000","last_active":"2024-09-12T18:10:27.955171+0000","last_peered":"2024-09-12T18:10:27.955171+0000","last_clean":"2024-09-12T18:10:27.955171+0000","last_became_active":"2024-09-12T17:00:12.320515+0000","last_became_peered":"2024-09-12T17:00:12.320515+0000","last_unstale":"2024-09-12T18:10:27.955171+0000","last_undegraded":"2024-09-12T18:10:27.955171+0000","last_fullsized":"2024-09-12T18:10:27.955171+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:58.500452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3181254,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":370,"num_read_kb":6790,"num_write":936,"num_write_kb":19852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'120","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:24.988567+0000","last_change":"2024-09-12T17:00:14.335557+0000","last_active":"2024-09-12T18:10:24.988567+0000","last_peered":"2024-09-12T18:10:24.988567+0000","last_clean":"2024-09-12T18:10:24.988567+0000","last_became_active":"2024-09-12T17:00:14.335297+0000","last_became_peered":"2024-09-12T17:00:14.335297+0000","last_unstale":"2024-09-12T18:10:24.988567+0000","last_undegraded":"2024-09-12T18:10:24.988567+0000","last_fullsized":"2024-09-12T18:10:24.988567+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:16.622130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":395,"num_write":174,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'267","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.110434+0000","last_change":"2024-09-12T17:00:12.313071+0000","last_active":"2024-09-12T18:11:11.110434+0000","last_peered":"2024-09-12T18:11:11.110434+0000","last_clean":"2024-09-12T18:11:11.110434+0000","last_became_active":"2024-09-12T17:00:12.312762+0000","last_became_peered":"2024-09-12T17:00:12.312762+0000","last_unstale":"2024-09-12T18:11:11.110434+0000","last_undegraded":"2024-09-12T18:11:11.110434+0000","last_fullsized":"2024-09-12T18:11:11.110434+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:00.055270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5075509,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":429,"num_read_kb":9220,"num_write":985,"num_write_kb":31558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'219","reported_seq":883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.743184+0000","last_change":"2024-09-12T17:00:14.322764+0000","last_active":"2024-09-12T18:10:27.743184+0000","last_peered":"2024-09-12T18:10:27.743184+0000","last_clean":"2024-09-12T18:10:27.743184+0000","last_became_active":"2024-09-12T17:00:14.321640+0000","last_became_peered":"2024-09-12T17:00:14.321640+0000","last_unstale":"2024-09-12T18:10:27.743184+0000","last_undegraded":"2024-09-12T18:10:27.743184+0000","last_fullsized":"2024-09-12T18:10:27.743184+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:15.723927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1016,"num_read_kb":865,"num_write":355,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'295","reported_seq":945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:17.499050+0000","last_change":"2024-09-12T17:00:12.320191+0000","last_active":"2024-09-12T18:13:17.499050+0000","last_peered":"2024-09-12T18:13:17.499050+0000","last_clean":"2024-09-12T18:13:17.499050+0000","last_became_active":"2024-09-12T17:00:12.319917+0000","last_became_peered":"2024-09-12T17:00:12.319917+0000","last_unstale":"2024-09-12T18:13:17.499050+0000","last_undegraded":"2024-09-12T18:13:17.499050+0000","last_fullsized":"2024-09-12T18:13:17.499050+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:05.028474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5225273,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":433,"num_read_kb":38212,"num_write":990,"num_write_kb":26572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'175","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:05.760285+0000","last_change":"2024-09-12T17:00:14.333352+0000","last_active":"2024-09-12T18:11:05.760285+0000","last_peered":"2024-09-12T18:11:05.760285+0000","last_clean":"2024-09-12T18:11:05.760285+0000","last_became_active":"2024-09-12T17:00:14.332940+0000","last_became_peered":"2024-09-12T17:00:14.332940+0000","last_unstale":"2024-09-12T18:11:05.760285+0000","last_undegraded":"2024-09-12T18:11:05.760285+0000","last_fullsized":"2024-09-12T18:11:05.760285+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:50.722062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":715,"num_read_kb":606,"num_write":241,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'264","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:16.757602+0000","last_change":"2024-09-12T17:00:12.305312+0000","last_active":"2024-09-12T18:13:16.757602+0000","last_peered":"2024-09-12T18:13:16.757602+0000","last_clean":"2024-09-12T18:13:16.757602+0000","last_became_active":"2024-09-12T17:00:12.304504+0000","last_became_peered":"2024-09-12T17:00:12.304504+0000","last_unstale":"2024-09-12T18:13:16.757602+0000","last_undegraded":"2024-09-12T18:13:16.757602+0000","last_fullsized":"2024-09-12T18:13:16.757602+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:07.619706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7430088,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":476,"num_read_kb":24452,"num_write":1034,"num_write_kb":21520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'176","reported_seq":772,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.961391+0000","last_change":"2024-09-12T17:00:14.332604+0000","last_active":"2024-09-12T18:11:07.961391+0000","last_peered":"2024-09-12T18:11:07.961391+0000","last_clean":"2024-09-12T18:11:07.961391+0000","last_became_active":"2024-09-12T17:00:14.332360+0000","last_became_peered":"2024-09-12T17:00:14.332360+0000","last_unstale":"2024-09-12T18:11:07.961391+0000","last_undegraded":"2024-09-12T18:11:07.961391+0000","last_fullsized":"2024-09-12T18:11:07.961391+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:55.182932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":738,"num_read_kb":599,"num_write":278,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'296","reported_seq":1001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:11.841796+0000","last_change":"2024-09-12T17:00:12.322666+0000","last_active":"2024-09-12T18:10:11.841796+0000","last_peered":"2024-09-12T18:10:11.841796+0000","last_clean":"2024-09-12T18:10:11.841796+0000","last_became_active":"2024-09-12T17:00:12.322419+0000","last_became_peered":"2024-09-12T17:00:12.322419+0000","last_unstale":"2024-09-12T18:10:11.841796+0000","last_undegraded":"2024-09-12T18:10:11.841796+0000","last_fullsized":"2024-09-12T18:10:11.841796+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:12.248593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1062757,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":594,"num_read_kb":7776,"num_write":1063,"num_write_kb":24985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'60","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:03.703001+0000","last_change":"2024-09-12T17:00:14.334885+0000","last_active":"2024-09-12T18:11:03.703001+0000","last_peered":"2024-09-12T18:11:03.703001+0000","last_clean":"2024-09-12T18:11:03.703001+0000","last_became_active":"2024-09-12T17:00:14.334586+0000","last_became_peered":"2024-09-12T17:00:14.334586+0000","last_unstale":"2024-09-12T18:11:03.703001+0000","last_undegraded":"2024-09-12T18:11:03.703001+0000","last_fullsized":"2024-09-12T18:11:03.703001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:29.087177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":225,"num_write":86,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'142","reported_seq":765,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:15.752206+0000","last_change":"2024-09-12T17:00:14.323537+0000","last_active":"2024-09-12T18:10:15.752206+0000","last_peered":"2024-09-12T18:10:15.752206+0000","last_clean":"2024-09-12T18:10:15.752206+0000","last_became_active":"2024-09-12T17:00:14.322771+0000","last_became_peered":"2024-09-12T17:00:14.322771+0000","last_unstale":"2024-09-12T18:10:15.752206+0000","last_undegraded":"2024-09-12T18:10:15.752206+0000","last_fullsized":"2024-09-12T18:10:15.752206+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:13.873569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":650,"num_read_kb":543,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'318","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.757582+0000","last_change":"2024-09-12T17:00:46.407269+0000","last_active":"2024-09-12T18:10:32.757582+0000","last_peered":"2024-09-12T18:10:32.757582+0000","last_clean":"2024-09-12T18:10:32.757582+0000","last_became_active":"2024-09-12T17:00:46.406911+0000","last_became_peered":"2024-09-12T17:00:46.406911+0000","last_unstale":"2024-09-12T18:10:32.757582+0000","last_undegraded":"2024-09-12T18:10:32.757582+0000","last_fullsized":"2024-09-12T18:10:32.757582+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:22.337640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14233470,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":693,"num_read_kb":51923,"num_write":1262,"num_write_kb":31895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'117","reported_seq":724,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.755079+0000","last_change":"2024-09-12T17:00:14.336399+0000","last_active":"2024-09-12T18:10:17.755079+0000","last_peered":"2024-09-12T18:10:17.755079+0000","last_clean":"2024-09-12T18:10:17.755079+0000","last_became_active":"2024-09-12T17:00:14.336161+0000","last_became_peered":"2024-09-12T17:00:14.336161+0000","last_unstale":"2024-09-12T18:10:17.755079+0000","last_undegraded":"2024-09-12T18:10:17.755079+0000","last_fullsized":"2024-09-12T18:10:17.755079+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:57.473607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":545,"num_read_kb":462,"num_write":195,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'271","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.741666+0000","last_change":"2024-09-12T17:00:12.310880+0000","last_active":"2024-09-12T18:10:17.741666+0000","last_peered":"2024-09-12T18:10:17.741666+0000","last_clean":"2024-09-12T18:10:17.741666+0000","last_became_active":"2024-09-12T17:00:12.310589+0000","last_became_peered":"2024-09-12T17:00:12.310589+0000","last_unstale":"2024-09-12T18:10:17.741666+0000","last_undegraded":"2024-09-12T18:10:17.741666+0000","last_fullsized":"2024-09-12T18:10:17.741666+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:43.821237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6903652,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":529,"num_read_kb":8321,"num_write":937,"num_write_kb":31830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'144","reported_seq":725,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.964476+0000","last_change":"2024-09-12T17:00:14.325153+0000","last_active":"2024-09-12T18:12:02.964476+0000","last_peered":"2024-09-12T18:12:02.964476+0000","last_clean":"2024-09-12T18:12:02.964476+0000","last_became_active":"2024-09-12T17:00:14.324889+0000","last_became_peered":"2024-09-12T17:00:14.324889+0000","last_unstale":"2024-09-12T18:12:02.964476+0000","last_undegraded":"2024-09-12T18:12:02.964476+0000","last_fullsized":"2024-09-12T18:12:02.964476+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:11.915771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":586,"num_read_kb":478,"num_write":211,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'274","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.741645+0000","last_change":"2024-09-12T17:00:12.315972+0000","last_active":"2024-09-12T18:10:17.741645+0000","last_peered":"2024-09-12T18:10:17.741645+0000","last_clean":"2024-09-12T18:10:17.741645+0000","last_became_active":"2024-09-12T17:00:12.315652+0000","last_became_peered":"2024-09-12T17:00:12.315652+0000","last_unstale":"2024-09-12T18:10:17.741645+0000","last_undegraded":"2024-09-12T18:10:17.741645+0000","last_fullsized":"2024-09-12T18:10:17.741645+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:33.033611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12167588,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":445,"num_read_kb":21524,"num_write":1030,"num_write_kb":35144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'78","reported_seq":629,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:18.698535+0000","last_change":"2024-09-12T17:00:14.335255+0000","last_active":"2024-09-12T18:10:18.698535+0000","last_peered":"2024-09-12T18:10:18.698535+0000","last_clean":"2024-09-12T18:10:18.698535+0000","last_became_active":"2024-09-12T17:00:14.335009+0000","last_became_peered":"2024-09-12T17:00:14.335009+0000","last_unstale":"2024-09-12T18:10:18.698535+0000","last_undegraded":"2024-09-12T18:10:18.698535+0000","last_fullsized":"2024-09-12T18:10:18.698535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:36.037057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":353,"num_read_kb":297,"num_write":121,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'284","reported_seq":945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.110941+0000","last_change":"2024-09-12T17:00:12.313118+0000","last_active":"2024-09-12T18:11:11.110941+0000","last_peered":"2024-09-12T18:11:11.110941+0000","last_clean":"2024-09-12T18:11:11.110941+0000","last_became_active":"2024-09-12T17:00:12.312828+0000","last_became_peered":"2024-09-12T17:00:12.312828+0000","last_unstale":"2024-09-12T18:11:11.110941+0000","last_undegraded":"2024-09-12T18:11:11.110941+0000","last_fullsized":"2024-09-12T18:11:11.110941+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:31.791812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22704252,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":470,"num_read_kb":47218,"num_write":1097,"num_write_kb":32154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'190","reported_seq":830,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:18.698566+0000","last_change":"2024-09-12T17:00:14.328021+0000","last_active":"2024-09-12T18:10:18.698566+0000","last_peered":"2024-09-12T18:10:18.698566+0000","last_clean":"2024-09-12T18:10:18.698566+0000","last_became_active":"2024-09-12T17:00:14.327744+0000","last_became_peered":"2024-09-12T17:00:14.327744+0000","last_unstale":"2024-09-12T18:10:18.698566+0000","last_undegraded":"2024-09-12T18:10:18.698566+0000","last_fullsized":"2024-09-12T18:10:18.698566+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:10.529599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":833,"num_read_kb":695,"num_write":274,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'251","reported_seq":1034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.234870+0000","last_change":"2024-09-12T17:00:12.319914+0000","last_active":"2024-09-12T18:10:20.234870+0000","last_peered":"2024-09-12T18:10:20.234870+0000","last_clean":"2024-09-12T18:10:20.234870+0000","last_became_active":"2024-09-12T17:00:12.319649+0000","last_became_peered":"2024-09-12T17:00:12.319649+0000","last_unstale":"2024-09-12T18:10:20.234870+0000","last_undegraded":"2024-09-12T18:10:20.234870+0000","last_fullsized":"2024-09-12T18:10:20.234870+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:03.094320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15976363,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":678,"num_read_kb":130250,"num_write":882,"num_write_kb":66985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'137","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.753208+0000","last_change":"2024-09-12T17:00:14.329425+0000","last_active":"2024-09-12T18:10:20.753208+0000","last_peered":"2024-09-12T18:10:20.753208+0000","last_clean":"2024-09-12T18:10:20.753208+0000","last_became_active":"2024-09-12T17:00:14.329107+0000","last_became_peered":"2024-09-12T17:00:14.329107+0000","last_unstale":"2024-09-12T18:10:20.753208+0000","last_undegraded":"2024-09-12T18:10:20.753208+0000","last_fullsized":"2024-09-12T18:10:20.753208+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:18.916868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":644,"num_read_kb":539,"num_write":215,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'300","reported_seq":1037,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.620317+0000","last_change":"2024-09-12T17:00:12.308630+0000","last_active":"2024-09-12T18:10:31.620317+0000","last_peered":"2024-09-12T18:10:31.620317+0000","last_clean":"2024-09-12T18:10:31.620317+0000","last_became_active":"2024-09-12T17:00:12.307906+0000","last_became_peered":"2024-09-12T17:00:12.307906+0000","last_unstale":"2024-09-12T18:10:31.620317+0000","last_undegraded":"2024-09-12T18:10:31.620317+0000","last_fullsized":"2024-09-12T18:10:31.620317+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:48.118605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1577780,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":645,"num_read_kb":3845,"num_write":1020,"num_write_kb":30178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'131","reported_seq":641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.108183+0000","last_change":"2024-09-12T17:00:22.355877+0000","last_active":"2024-09-12T18:12:03.108183+0000","last_peered":"2024-09-12T18:12:03.108183+0000","last_clean":"2024-09-12T18:12:03.108183+0000","last_became_active":"2024-09-12T17:00:22.355591+0000","last_became_peered":"2024-09-12T17:00:22.355591+0000","last_unstale":"2024-09-12T18:12:03.108183+0000","last_undegraded":"2024-09-12T18:12:03.108183+0000","last_fullsized":"2024-09-12T18:12:03.108183+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:28:58.673978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1447,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":175,"num_read_kb":172,"num_write":326,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'85","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.843638+0000","last_change":"2024-09-12T17:00:14.336449+0000","last_active":"2024-09-12T18:10:26.843638+0000","last_peered":"2024-09-12T18:10:26.843638+0000","last_clean":"2024-09-12T18:10:26.843638+0000","last_became_active":"2024-09-12T17:00:14.336144+0000","last_became_peered":"2024-09-12T17:00:14.336144+0000","last_unstale":"2024-09-12T18:10:26.843638+0000","last_undegraded":"2024-09-12T18:10:26.843638+0000","last_fullsized":"2024-09-12T18:10:26.843638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:36.033113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":388,"num_read_kb":332,"num_write":123,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'295","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.603834+0000","last_change":"2024-09-12T17:00:46.721301+0000","last_active":"2024-09-12T18:13:48.603834+0000","last_peered":"2024-09-12T18:13:48.603834+0000","last_clean":"2024-09-12T18:13:48.603834+0000","last_became_active":"2024-09-12T17:00:46.720989+0000","last_became_peered":"2024-09-12T17:00:46.720989+0000","last_unstale":"2024-09-12T18:13:48.603834+0000","last_undegraded":"2024-09-12T18:13:48.603834+0000","last_fullsized":"2024-09-12T18:13:48.603834+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:03.810826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4241249,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":444,"num_read_kb":63990,"num_write":1012,"num_write_kb":41211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954509+0000","last_change":"2024-09-12T17:00:16.326154+0000","last_active":"2024-09-12T18:10:22.954509+0000","last_peered":"2024-09-12T18:10:22.954509+0000","last_clean":"2024-09-12T18:10:22.954509+0000","last_became_active":"2024-09-12T17:00:16.325868+0000","last_became_peered":"2024-09-12T17:00:16.325868+0000","last_unstale":"2024-09-12T18:10:22.954509+0000","last_undegraded":"2024-09-12T18:10:22.954509+0000","last_fullsized":"2024-09-12T18:10:22.954509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:07.781526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'334","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:51.637120+0000","last_change":"2024-09-12T17:00:18.329828+0000","last_active":"2024-09-12T18:12:51.637120+0000","last_peered":"2024-09-12T18:12:51.637120+0000","last_clean":"2024-09-12T18:12:51.637120+0000","last_became_active":"2024-09-12T17:00:18.329515+0000","last_became_peered":"2024-09-12T17:00:18.329515+0000","last_unstale":"2024-09-12T18:12:51.637120+0000","last_undegraded":"2024-09-12T18:12:51.637120+0000","last_fullsized":"2024-09-12T18:12:51.637120+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:07.586238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57242,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":538,"num_read_kb":1038,"num_write":424,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.756841+0000","last_change":"2024-09-12T17:00:20.349019+0000","last_active":"2024-09-12T18:10:27.756841+0000","last_peered":"2024-09-12T18:10:27.756841+0000","last_clean":"2024-09-12T18:10:27.756841+0000","last_became_active":"2024-09-12T17:00:20.348524+0000","last_became_peered":"2024-09-12T17:00:20.348524+0000","last_unstale":"2024-09-12T18:10:27.756841+0000","last_undegraded":"2024-09-12T18:10:27.756841+0000","last_fullsized":"2024-09-12T18:10:27.756841+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:34.615435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'165","reported_seq":725,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:42.957515+0000","last_change":"2024-09-12T17:00:22.357994+0000","last_active":"2024-09-12T18:10:42.957515+0000","last_peered":"2024-09-12T18:10:42.957515+0000","last_clean":"2024-09-12T18:10:42.957515+0000","last_became_active":"2024-09-12T17:00:22.357688+0000","last_became_peered":"2024-09-12T17:00:22.357688+0000","last_unstale":"2024-09-12T18:10:42.957515+0000","last_undegraded":"2024-09-12T18:10:42.957515+0000","last_fullsized":"2024-09-12T18:10:42.957515+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:48.716325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":624,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":254,"num_read_kb":249,"num_write":335,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'314","reported_seq":940,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954488+0000","last_change":"2024-09-12T17:00:14.327416+0000","last_active":"2024-09-12T18:10:22.954488+0000","last_peered":"2024-09-12T18:10:22.954488+0000","last_clean":"2024-09-12T18:10:22.954488+0000","last_became_active":"2024-09-12T17:00:14.327170+0000","last_became_peered":"2024-09-12T17:00:14.327170+0000","last_unstale":"2024-09-12T18:10:22.954488+0000","last_undegraded":"2024-09-12T18:10:22.954488+0000","last_fullsized":"2024-09-12T18:10:22.954488+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:31.084615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1382,"num_read_kb":1112,"num_write":506,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'321","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:11.618016+0000","last_change":"2024-09-12T17:00:12.304639+0000","last_active":"2024-09-12T18:10:11.618016+0000","last_peered":"2024-09-12T18:10:11.618016+0000","last_clean":"2024-09-12T18:10:11.618016+0000","last_became_active":"2024-09-12T17:00:12.304357+0000","last_became_peered":"2024-09-12T17:00:12.304357+0000","last_unstale":"2024-09-12T18:10:11.618016+0000","last_undegraded":"2024-09-12T18:10:11.618016+0000","last_fullsized":"2024-09-12T18:10:11.618016+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:22.101694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14850658,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":585,"num_read_kb":22986,"num_write":1100,"num_write_kb":36092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.843647+0000","last_change":"2024-09-12T17:00:16.323972+0000","last_active":"2024-09-12T18:10:26.843647+0000","last_peered":"2024-09-12T18:10:26.843647+0000","last_clean":"2024-09-12T18:10:26.843647+0000","last_became_active":"2024-09-12T17:00:16.323601+0000","last_became_peered":"2024-09-12T17:00:16.323601+0000","last_unstale":"2024-09-12T18:10:26.843647+0000","last_undegraded":"2024-09-12T18:10:26.843647+0000","last_fullsized":"2024-09-12T18:10:26.843647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:58.961774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'106","reported_seq":646,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.602728+0000","last_change":"2024-09-12T17:00:18.328151+0000","last_active":"2024-09-12T18:11:11.602728+0000","last_peered":"2024-09-12T18:11:11.602728+0000","last_clean":"2024-09-12T18:11:11.602728+0000","last_became_active":"2024-09-12T17:00:18.327744+0000","last_became_peered":"2024-09-12T17:00:18.327744+0000","last_unstale":"2024-09-12T18:11:11.602728+0000","last_undegraded":"2024-09-12T18:11:11.602728+0000","last_fullsized":"2024-09-12T18:11:11.602728+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:37.786807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":113,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:25.753957+0000","last_change":"2024-09-12T17:00:20.348202+0000","last_active":"2024-09-12T18:10:25.753957+0000","last_peered":"2024-09-12T18:10:25.753957+0000","last_clean":"2024-09-12T18:10:25.753957+0000","last_became_active":"2024-09-12T17:00:20.347865+0000","last_became_peered":"2024-09-12T17:00:20.347865+0000","last_unstale":"2024-09-12T18:10:25.753957+0000","last_undegraded":"2024-09-12T18:10:25.753957+0000","last_fullsized":"2024-09-12T18:10:25.753957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:50.254374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'111","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619154+0000","last_change":"2024-09-12T17:00:22.353337+0000","last_active":"2024-09-12T18:10:21.619154+0000","last_peered":"2024-09-12T18:10:21.619154+0000","last_clean":"2024-09-12T18:10:21.619154+0000","last_became_active":"2024-09-12T17:00:22.352912+0000","last_became_peered":"2024-09-12T17:00:22.352912+0000","last_unstale":"2024-09-12T18:10:21.619154+0000","last_undegraded":"2024-09-12T18:10:21.619154+0000","last_fullsized":"2024-09-12T18:10:21.619154+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:40.097046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":708,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":149,"num_read_kb":144,"num_write":248,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'179","reported_seq":806,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619226+0000","last_change":"2024-09-12T17:00:14.337811+0000","last_active":"2024-09-12T18:10:21.619226+0000","last_peered":"2024-09-12T18:10:21.619226+0000","last_clean":"2024-09-12T18:10:21.619226+0000","last_became_active":"2024-09-12T17:00:14.337515+0000","last_became_peered":"2024-09-12T17:00:14.337515+0000","last_unstale":"2024-09-12T18:10:21.619226+0000","last_undegraded":"2024-09-12T18:10:21.619226+0000","last_fullsized":"2024-09-12T18:10:21.619226+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:45.954756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":863,"num_read_kb":715,"num_write":299,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'304","reported_seq":965,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.671210+0000","last_change":"2024-09-12T17:00:12.308357+0000","last_active":"2024-09-12T18:10:17.671210+0000","last_peered":"2024-09-12T18:10:17.671210+0000","last_clean":"2024-09-12T18:10:17.671210+0000","last_became_active":"2024-09-12T17:00:12.308065+0000","last_became_peered":"2024-09-12T17:00:12.308065+0000","last_unstale":"2024-09-12T18:10:17.671210+0000","last_undegraded":"2024-09-12T18:10:17.671210+0000","last_fullsized":"2024-09-12T18:10:17.671210+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:01.954058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1304272,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":441,"num_read_kb":43207,"num_write":1105,"num_write_kb":32106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.843124+0000","last_change":"2024-09-12T17:00:16.326520+0000","last_active":"2024-09-12T18:10:21.843124+0000","last_peered":"2024-09-12T18:10:21.843124+0000","last_clean":"2024-09-12T18:10:21.843124+0000","last_became_active":"2024-09-12T17:00:16.326073+0000","last_became_peered":"2024-09-12T17:00:16.326073+0000","last_unstale":"2024-09-12T18:10:21.843124+0000","last_undegraded":"2024-09-12T18:10:21.843124+0000","last_fullsized":"2024-09-12T18:10:21.843124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:41.659835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'139","reported_seq":693,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.703133+0000","last_change":"2024-09-12T17:00:18.327751+0000","last_active":"2024-09-12T18:11:11.703133+0000","last_peered":"2024-09-12T18:11:11.703133+0000","last_clean":"2024-09-12T18:11:11.703133+0000","last_became_active":"2024-09-12T17:00:18.327448+0000","last_became_peered":"2024-09-12T17:00:18.327448+0000","last_unstale":"2024-09-12T18:11:11.703133+0000","last_undegraded":"2024-09-12T18:11:11.703133+0000","last_fullsized":"2024-09-12T18:11:11.703133+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:36.026074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":172,"num_read_kb":164,"num_write":118,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'763","reported_seq":2562,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.300067+0000","last_change":"2024-09-12T17:00:20.351615+0000","last_active":"2024-09-12T18:13:23.300067+0000","last_peered":"2024-09-12T18:13:23.300067+0000","last_clean":"2024-09-12T18:13:23.300067+0000","last_became_active":"2024-09-12T17:00:20.351202+0000","last_became_peered":"2024-09-12T17:00:20.351202+0000","last_unstale":"2024-09-12T18:13:23.300067+0000","last_undegraded":"2024-09-12T18:13:23.300067+0000","last_fullsized":"2024-09-12T18:13:23.300067+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:43.494236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'205","reported_seq":1031,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.168160+0000","last_change":"2024-09-12T17:00:22.588416+0000","last_active":"2024-09-12T18:12:03.168160+0000","last_peered":"2024-09-12T18:12:03.168160+0000","last_clean":"2024-09-12T18:12:03.168160+0000","last_became_active":"2024-09-12T17:00:22.588111+0000","last_became_peered":"2024-09-12T17:00:22.588111+0000","last_unstale":"2024-09-12T18:12:03.168160+0000","last_undegraded":"2024-09-12T18:12:03.168160+0000","last_fullsized":"2024-09-12T18:12:03.168160+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:50.047140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":621,"num_read_kb":619,"num_write":443,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'162","reported_seq":797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.843103+0000","last_change":"2024-09-12T17:00:14.332706+0000","last_active":"2024-09-12T18:10:21.843103+0000","last_peered":"2024-09-12T18:10:21.843103+0000","last_clean":"2024-09-12T18:10:21.843103+0000","last_became_active":"2024-09-12T17:00:14.332424+0000","last_became_peered":"2024-09-12T17:00:14.332424+0000","last_unstale":"2024-09-12T18:10:21.843103+0000","last_undegraded":"2024-09-12T18:10:21.843103+0000","last_fullsized":"2024-09-12T18:10:21.843103+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:36.277637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":720,"num_read_kb":605,"num_write":258,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'291","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.740789+0000","last_change":"2024-09-12T17:00:12.310686+0000","last_active":"2024-09-12T18:10:12.740789+0000","last_peered":"2024-09-12T18:10:12.740789+0000","last_clean":"2024-09-12T18:10:12.740789+0000","last_became_active":"2024-09-12T17:00:12.310337+0000","last_became_peered":"2024-09-12T17:00:12.310337+0000","last_unstale":"2024-09-12T18:10:12.740789+0000","last_undegraded":"2024-09-12T18:10:12.740789+0000","last_fullsized":"2024-09-12T18:10:12.740789+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:54.402983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5640791,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":490,"num_read_kb":13227,"num_write":1060,"num_write_kb":37058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954568+0000","last_change":"2024-09-12T17:00:16.325390+0000","last_active":"2024-09-12T18:10:22.954568+0000","last_peered":"2024-09-12T18:10:22.954568+0000","last_clean":"2024-09-12T18:10:22.954568+0000","last_became_active":"2024-09-12T17:00:16.325141+0000","last_became_peered":"2024-09-12T17:00:16.325141+0000","last_unstale":"2024-09-12T18:10:22.954568+0000","last_undegraded":"2024-09-12T18:10:22.954568+0000","last_fullsized":"2024-09-12T18:10:22.954568+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:43.724058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'304","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:47.778635+0000","last_change":"2024-09-12T17:00:18.430347+0000","last_active":"2024-09-12T18:12:47.778635+0000","last_peered":"2024-09-12T18:12:47.778635+0000","last_clean":"2024-09-12T18:12:47.778635+0000","last_became_active":"2024-09-12T17:00:18.430046+0000","last_became_peered":"2024-09-12T17:00:18.430046+0000","last_unstale":"2024-09-12T18:12:47.778635+0000","last_undegraded":"2024-09-12T18:12:47.778635+0000","last_fullsized":"2024-09-12T18:12:47.778635+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:57.355912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62169,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":1042,"num_write":394,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'768","reported_seq":2857,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.310309+0000","last_change":"2024-09-12T17:00:20.354448+0000","last_active":"2024-09-12T18:13:23.310309+0000","last_peered":"2024-09-12T18:13:23.310309+0000","last_clean":"2024-09-12T18:13:23.310309+0000","last_became_active":"2024-09-12T17:00:20.353914+0000","last_became_peered":"2024-09-12T17:00:20.353914+0000","last_unstale":"2024-09-12T18:13:23.310309+0000","last_undegraded":"2024-09-12T18:13:23.310309+0000","last_fullsized":"2024-09-12T18:13:23.310309+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:46.082984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'89","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:37.947552+0000","last_change":"2024-09-12T17:00:14.325929+0000","last_active":"2024-09-12T18:09:37.947552+0000","last_peered":"2024-09-12T18:09:37.947552+0000","last_clean":"2024-09-12T18:09:37.947552+0000","last_became_active":"2024-09-12T17:00:14.325669+0000","last_became_peered":"2024-09-12T17:00:14.325669+0000","last_unstale":"2024-09-12T18:09:37.947552+0000","last_undegraded":"2024-09-12T18:09:37.947552+0000","last_fullsized":"2024-09-12T18:09:37.947552+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:13.770284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":392,"num_read_kb":330,"num_write":131,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'290","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.754262+0000","last_change":"2024-09-12T17:00:12.315298+0000","last_active":"2024-09-12T18:10:12.754262+0000","last_peered":"2024-09-12T18:10:12.754262+0000","last_clean":"2024-09-12T18:10:12.754262+0000","last_became_active":"2024-09-12T17:00:12.315015+0000","last_became_peered":"2024-09-12T17:00:12.315015+0000","last_unstale":"2024-09-12T18:10:12.754262+0000","last_undegraded":"2024-09-12T18:10:12.754262+0000","last_fullsized":"2024-09-12T18:10:12.754262+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:05.029334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7831419,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":401,"num_read_kb":13972,"num_write":1058,"num_write_kb":21819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:37.748595+0000","last_change":"2024-09-12T17:00:16.323002+0000","last_active":"2024-09-12T18:09:37.748595+0000","last_peered":"2024-09-12T18:09:37.748595+0000","last_clean":"2024-09-12T18:09:37.748595+0000","last_became_active":"2024-09-12T17:00:16.322693+0000","last_became_peered":"2024-09-12T17:00:16.322693+0000","last_unstale":"2024-09-12T18:09:37.748595+0000","last_undegraded":"2024-09-12T18:09:37.748595+0000","last_fullsized":"2024-09-12T18:09:37.748595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:02.469282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'390","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.970788+0000","last_change":"2024-09-12T17:00:18.429427+0000","last_active":"2024-09-12T18:12:02.970788+0000","last_peered":"2024-09-12T18:12:02.970788+0000","last_clean":"2024-09-12T18:12:02.970788+0000","last_became_active":"2024-09-12T17:00:18.429137+0000","last_became_peered":"2024-09-12T17:00:18.429137+0000","last_unstale":"2024-09-12T18:12:02.970788+0000","last_undegraded":"2024-09-12T18:12:02.970788+0000","last_fullsized":"2024-09-12T18:12:02.970788+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:07.774572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60365,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":643,"num_read_kb":1198,"num_write":502,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:08.915747+0000","last_change":"2024-09-12T17:00:20.348773+0000","last_active":"2024-09-12T18:10:08.915747+0000","last_peered":"2024-09-12T18:10:08.915747+0000","last_clean":"2024-09-12T18:10:08.915747+0000","last_became_active":"2024-09-12T17:00:20.348507+0000","last_became_peered":"2024-09-12T17:00:20.348507+0000","last_unstale":"2024-09-12T18:10:08.915747+0000","last_undegraded":"2024-09-12T18:10:08.915747+0000","last_fullsized":"2024-09-12T18:10:08.915747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:15:32.541811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'560","reported_seq":1385,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.026506+0000","last_change":"2024-09-12T17:00:22.358717+0000","last_active":"2024-09-12T18:13:23.026506+0000","last_peered":"2024-09-12T18:13:23.026506+0000","last_clean":"2024-09-12T18:13:23.026506+0000","last_became_active":"2024-09-12T17:00:22.358335+0000","last_became_peered":"2024-09-12T17:00:22.358335+0000","last_unstale":"2024-09-12T18:13:23.026506+0000","last_undegraded":"2024-09-12T18:13:23.026506+0000","last_fullsized":"2024-09-12T18:13:23.026506+0000","mapping_epoch":34,"log_start":"264'500","ondisk_log_start":"264'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:28.398620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1357,"num_read_kb":1346,"num_write":1162,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'63","reported_seq":629,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:02.633138+0000","last_change":"2024-09-12T17:00:14.336132+0000","last_active":"2024-09-12T18:10:02.633138+0000","last_peered":"2024-09-12T18:10:02.633138+0000","last_clean":"2024-09-12T18:10:02.633138+0000","last_became_active":"2024-09-12T17:00:14.335783+0000","last_became_peered":"2024-09-12T17:00:14.335783+0000","last_unstale":"2024-09-12T18:10:02.633138+0000","last_undegraded":"2024-09-12T18:10:02.633138+0000","last_fullsized":"2024-09-12T18:10:02.633138+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:05.231999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":238,"num_write":99,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'353","reported_seq":1084,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.099603+0000","last_change":"2024-09-12T17:00:12.307583+0000","last_active":"2024-09-12T18:11:11.099603+0000","last_peered":"2024-09-12T18:11:11.099603+0000","last_clean":"2024-09-12T18:11:11.099603+0000","last_became_active":"2024-09-12T17:00:12.307222+0000","last_became_peered":"2024-09-12T17:00:12.307222+0000","last_unstale":"2024-09-12T18:11:11.099603+0000","last_undegraded":"2024-09-12T18:11:11.099603+0000","last_fullsized":"2024-09-12T18:11:11.099603+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:19.672373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10140548,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":799,"num_read_kb":14510,"num_write":1323,"num_write_kb":34813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:38.694721+0000","last_change":"2024-09-12T17:00:16.323257+0000","last_active":"2024-09-12T18:09:38.694721+0000","last_peered":"2024-09-12T18:09:38.694721+0000","last_clean":"2024-09-12T18:09:38.694721+0000","last_became_active":"2024-09-12T17:00:16.322917+0000","last_became_peered":"2024-09-12T17:00:16.322917+0000","last_unstale":"2024-09-12T18:09:38.694721+0000","last_undegraded":"2024-09-12T18:09:38.694721+0000","last_fullsized":"2024-09-12T18:09:38.694721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:45.972956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'263","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.857790+0000","last_change":"2024-09-12T17:00:18.327458+0000","last_active":"2024-09-12T18:12:21.857790+0000","last_peered":"2024-09-12T18:12:21.857790+0000","last_clean":"2024-09-12T18:12:21.857790+0000","last_became_active":"2024-09-12T17:00:18.326791+0000","last_became_peered":"2024-09-12T17:00:18.326791+0000","last_unstale":"2024-09-12T18:12:21.857790+0000","last_undegraded":"2024-09-12T18:12:21.857790+0000","last_fullsized":"2024-09-12T18:12:21.857790+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:25.837684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44513,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":415,"num_read_kb":856,"num_write":332,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:51.839530+0000","last_change":"2024-09-12T17:00:20.354443+0000","last_active":"2024-09-12T18:09:51.839530+0000","last_peered":"2024-09-12T18:09:51.839530+0000","last_clean":"2024-09-12T18:09:51.839530+0000","last_became_active":"2024-09-12T17:00:20.353959+0000","last_became_peered":"2024-09-12T17:00:20.353959+0000","last_unstale":"2024-09-12T18:09:51.839530+0000","last_undegraded":"2024-09-12T18:09:51.839530+0000","last_fullsized":"2024-09-12T18:09:51.839530+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:48.338493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'2407","reported_seq":4230,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:12.155626+0000","last_change":"2024-09-12T17:00:22.356576+0000","last_active":"2024-09-12T18:13:12.155626+0000","last_peered":"2024-09-12T18:13:12.155626+0000","last_clean":"2024-09-12T18:13:12.155626+0000","last_became_active":"2024-09-12T17:00:22.355651+0000","last_became_peered":"2024-09-12T17:00:22.355651+0000","last_unstale":"2024-09-12T18:13:12.155626+0000","last_undegraded":"2024-09-12T18:13:12.155626+0000","last_fullsized":"2024-09-12T18:13:12.155626+0000","mapping_epoch":34,"log_start":"264'2300","ondisk_log_start":"264'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":2300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:33.472074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6022,"num_read_kb":6027,"num_write":4838,"num_write_kb":1790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'196","reported_seq":775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:47.737352+0000","last_change":"2024-09-12T17:00:14.322357+0000","last_active":"2024-09-12T18:09:47.737352+0000","last_peered":"2024-09-12T18:09:47.737352+0000","last_clean":"2024-09-12T18:09:47.737352+0000","last_became_active":"2024-09-12T17:00:14.321270+0000","last_became_peered":"2024-09-12T17:00:14.321270+0000","last_unstale":"2024-09-12T18:09:47.737352+0000","last_undegraded":"2024-09-12T18:09:47.737352+0000","last_fullsized":"2024-09-12T18:09:47.737352+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:12.413462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":834,"num_read_kb":668,"num_write":296,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'253","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:57.751764+0000","last_change":"2024-09-12T17:00:12.313574+0000","last_active":"2024-09-12T18:09:57.751764+0000","last_peered":"2024-09-12T18:09:57.751764+0000","last_clean":"2024-09-12T18:09:57.751764+0000","last_became_active":"2024-09-12T17:00:12.313262+0000","last_became_peered":"2024-09-12T17:00:12.313262+0000","last_unstale":"2024-09-12T18:09:57.751764+0000","last_undegraded":"2024-09-12T18:09:57.751764+0000","last_fullsized":"2024-09-12T18:09:57.751764+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:31.359986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5803248,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":389,"num_read_kb":16364,"num_write":921,"num_write_kb":27335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:03.697059+0000","last_change":"2024-09-12T17:00:16.321983+0000","last_active":"2024-09-12T18:10:03.697059+0000","last_peered":"2024-09-12T18:10:03.697059+0000","last_clean":"2024-09-12T18:10:03.697059+0000","last_became_active":"2024-09-12T17:00:16.321641+0000","last_became_peered":"2024-09-12T17:00:16.321641+0000","last_unstale":"2024-09-12T18:10:03.697059+0000","last_undegraded":"2024-09-12T18:10:03.697059+0000","last_fullsized":"2024-09-12T18:10:03.697059+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:37.927815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'333","reported_seq":933,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.769289+0000","last_change":"2024-09-12T17:00:18.331983+0000","last_active":"2024-09-12T18:11:47.769289+0000","last_peered":"2024-09-12T18:11:47.769289+0000","last_clean":"2024-09-12T18:11:47.769289+0000","last_became_active":"2024-09-12T17:00:18.331707+0000","last_became_peered":"2024-09-12T17:00:18.331707+0000","last_unstale":"2024-09-12T18:11:47.769289+0000","last_undegraded":"2024-09-12T18:11:47.769289+0000","last_fullsized":"2024-09-12T18:11:47.769289+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:34.769849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":539,"num_read_kb":1080,"num_write":430,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'762","reported_seq":2724,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.300062+0000","last_change":"2024-09-12T17:00:20.348555+0000","last_active":"2024-09-12T18:13:23.300062+0000","last_peered":"2024-09-12T18:13:23.300062+0000","last_clean":"2024-09-12T18:13:23.300062+0000","last_became_active":"2024-09-12T17:00:20.348227+0000","last_became_peered":"2024-09-12T17:00:20.348227+0000","last_unstale":"2024-09-12T18:13:23.300062+0000","last_undegraded":"2024-09-12T18:13:23.300062+0000","last_fullsized":"2024-09-12T18:13:23.300062+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:53.853058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'115","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:21.824797+0000","last_change":"2024-09-12T17:00:22.353551+0000","last_active":"2024-09-12T18:13:21.824797+0000","last_peered":"2024-09-12T18:13:21.824797+0000","last_clean":"2024-09-12T18:13:21.824797+0000","last_became_active":"2024-09-12T17:00:22.353172+0000","last_became_peered":"2024-09-12T17:00:22.353172+0000","last_unstale":"2024-09-12T18:13:21.824797+0000","last_undegraded":"2024-09-12T18:13:21.824797+0000","last_fullsized":"2024-09-12T18:13:21.824797+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:21.794645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":136,"num_write":299,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'230","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:01.616940+0000","last_change":"2024-09-12T17:00:14.325124+0000","last_active":"2024-09-12T18:10:01.616940+0000","last_peered":"2024-09-12T18:10:01.616940+0000","last_clean":"2024-09-12T18:10:01.616940+0000","last_became_active":"2024-09-12T17:00:14.324823+0000","last_became_peered":"2024-09-12T17:00:14.324823+0000","last_unstale":"2024-09-12T18:10:01.616940+0000","last_undegraded":"2024-09-12T18:10:01.616940+0000","last_fullsized":"2024-09-12T18:10:01.616940+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:32.044281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1013,"num_read_kb":830,"num_write":393,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'330","reported_seq":1018,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.111454+0000","last_change":"2024-09-12T17:00:12.320393+0000","last_active":"2024-09-12T18:11:11.111454+0000","last_peered":"2024-09-12T18:11:11.111454+0000","last_clean":"2024-09-12T18:11:11.111454+0000","last_became_active":"2024-09-12T17:00:12.318599+0000","last_became_peered":"2024-09-12T17:00:12.318599+0000","last_unstale":"2024-09-12T18:11:11.111454+0000","last_undegraded":"2024-09-12T18:11:11.111454+0000","last_fullsized":"2024-09-12T18:11:11.111454+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:50.621777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15341102,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":618,"num_read_kb":44820,"num_write":1100,"num_write_kb":32428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.695712+0000","last_change":"2024-09-12T17:00:16.328658+0000","last_active":"2024-09-12T18:09:48.695712+0000","last_peered":"2024-09-12T18:09:48.695712+0000","last_clean":"2024-09-12T18:09:48.695712+0000","last_became_active":"2024-09-12T17:00:16.328352+0000","last_became_peered":"2024-09-12T17:00:16.328352+0000","last_unstale":"2024-09-12T18:09:48.695712+0000","last_undegraded":"2024-09-12T18:09:48.695712+0000","last_fullsized":"2024-09-12T18:09:48.695712+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:37.939908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'469","reported_seq":1117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:22.995145+0000","last_change":"2024-09-12T17:00:18.330361+0000","last_active":"2024-09-12T18:13:22.995145+0000","last_peered":"2024-09-12T18:13:22.995145+0000","last_clean":"2024-09-12T18:13:22.995145+0000","last_became_active":"2024-09-12T17:00:18.329414+0000","last_became_peered":"2024-09-12T17:00:18.329414+0000","last_unstale":"2024-09-12T18:13:22.995145+0000","last_undegraded":"2024-09-12T18:13:22.995145+0000","last_fullsized":"2024-09-12T18:13:22.995145+0000","mapping_epoch":30,"log_start":"264'400","ondisk_log_start":"264'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:30.562657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112362,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":817,"num_read_kb":1813,"num_write":672,"num_write_kb":559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:43.695251+0000","last_change":"2024-09-12T17:00:20.352541+0000","last_active":"2024-09-12T18:09:43.695251+0000","last_peered":"2024-09-12T18:09:43.695251+0000","last_clean":"2024-09-12T18:09:43.695251+0000","last_became_active":"2024-09-12T17:00:20.352249+0000","last_became_peered":"2024-09-12T17:00:20.352249+0000","last_unstale":"2024-09-12T18:09:43.695251+0000","last_undegraded":"2024-09-12T18:09:43.695251+0000","last_fullsized":"2024-09-12T18:09:43.695251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:48.788159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'178","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:21.825345+0000","last_change":"2024-09-12T17:00:22.356296+0000","last_active":"2024-09-12T18:13:21.825345+0000","last_peered":"2024-09-12T18:13:21.825345+0000","last_clean":"2024-09-12T18:13:21.825345+0000","last_became_active":"2024-09-12T17:00:22.355850+0000","last_became_peered":"2024-09-12T17:00:22.355850+0000","last_unstale":"2024-09-12T18:13:21.825345+0000","last_undegraded":"2024-09-12T18:13:21.825345+0000","last_fullsized":"2024-09-12T18:13:21.825345+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:23.406645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":278,"num_read_kb":264,"num_write":436,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'144","reported_seq":751,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:00.750221+0000","last_change":"2024-09-12T17:00:14.334908+0000","last_active":"2024-09-12T18:10:00.750221+0000","last_peered":"2024-09-12T18:10:00.750221+0000","last_clean":"2024-09-12T18:10:00.750221+0000","last_became_active":"2024-09-12T17:00:14.334594+0000","last_became_peered":"2024-09-12T17:00:14.334594+0000","last_unstale":"2024-09-12T18:10:00.750221+0000","last_undegraded":"2024-09-12T18:10:00.750221+0000","last_fullsized":"2024-09-12T18:10:00.750221+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:18.668081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":624,"num_read_kb":516,"num_write":207,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'275","reported_seq":910,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:56.840088+0000","last_change":"2024-09-12T17:00:12.314796+0000","last_active":"2024-09-12T18:09:56.840088+0000","last_peered":"2024-09-12T18:09:56.840088+0000","last_clean":"2024-09-12T18:09:56.840088+0000","last_became_active":"2024-09-12T17:00:12.314509+0000","last_became_peered":"2024-09-12T17:00:12.314509+0000","last_unstale":"2024-09-12T18:09:56.840088+0000","last_undegraded":"2024-09-12T18:09:56.840088+0000","last_fullsized":"2024-09-12T18:09:56.840088+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:46.851692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2230784,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":373,"num_read_kb":51555,"num_write":969,"num_write_kb":32245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:03.697102+0000","last_change":"2024-09-12T17:00:16.319604+0000","last_active":"2024-09-12T18:10:03.697102+0000","last_peered":"2024-09-12T18:10:03.697102+0000","last_clean":"2024-09-12T18:10:03.697102+0000","last_became_active":"2024-09-12T17:00:16.319269+0000","last_became_peered":"2024-09-12T17:00:16.319269+0000","last_unstale":"2024-09-12T18:10:03.697102+0000","last_undegraded":"2024-09-12T18:10:03.697102+0000","last_fullsized":"2024-09-12T18:10:03.697102+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:36.474369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'290","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:20.771635+0000","last_change":"2024-09-12T17:00:18.331052+0000","last_active":"2024-09-12T18:12:20.771635+0000","last_peered":"2024-09-12T18:12:20.771635+0000","last_clean":"2024-09-12T18:12:20.771635+0000","last_became_active":"2024-09-12T17:00:18.330634+0000","last_became_peered":"2024-09-12T17:00:18.330634+0000","last_unstale":"2024-09-12T18:12:20.771635+0000","last_undegraded":"2024-09-12T18:12:20.771635+0000","last_fullsized":"2024-09-12T18:12:20.771635+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:16.080984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48618,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":482,"num_read_kb":940,"num_write":426,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.619832+0000","last_change":"2024-09-12T17:00:20.351332+0000","last_active":"2024-09-12T18:10:26.619832+0000","last_peered":"2024-09-12T18:10:26.619832+0000","last_clean":"2024-09-12T18:10:26.619832+0000","last_became_active":"2024-09-12T17:00:20.351001+0000","last_became_peered":"2024-09-12T17:00:20.351001+0000","last_unstale":"2024-09-12T18:10:26.619832+0000","last_undegraded":"2024-09-12T18:10:26.619832+0000","last_fullsized":"2024-09-12T18:10:26.619832+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:04.653097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'120","reported_seq":621,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:31.859249+0000","last_change":"2024-09-12T17:00:22.357302+0000","last_active":"2024-09-12T18:12:31.859249+0000","last_peered":"2024-09-12T18:12:31.859249+0000","last_clean":"2024-09-12T18:12:31.859249+0000","last_became_active":"2024-09-12T17:00:22.357001+0000","last_became_peered":"2024-09-12T17:00:22.357001+0000","last_unstale":"2024-09-12T18:12:31.859249+0000","last_undegraded":"2024-09-12T18:12:31.859249+0000","last_fullsized":"2024-09-12T18:12:31.859249+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:15.408471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":156,"num_write":307,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'263","reported_seq":888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:00.750266+0000","last_change":"2024-09-12T17:00:14.321295+0000","last_active":"2024-09-12T18:10:00.750266+0000","last_peered":"2024-09-12T18:10:00.750266+0000","last_clean":"2024-09-12T18:10:00.750266+0000","last_became_active":"2024-09-12T17:00:14.320928+0000","last_became_peered":"2024-09-12T17:00:14.320928+0000","last_unstale":"2024-09-12T18:10:00.750266+0000","last_undegraded":"2024-09-12T18:10:00.750266+0000","last_fullsized":"2024-09-12T18:10:00.750266+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:10.035416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1139,"num_read_kb":929,"num_write":426,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'288","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:21.087995+0000","last_change":"2024-09-12T17:00:12.309266+0000","last_active":"2024-09-12T18:13:21.087995+0000","last_peered":"2024-09-12T18:13:21.087995+0000","last_clean":"2024-09-12T18:13:21.087995+0000","last_became_active":"2024-09-12T17:00:12.308967+0000","last_became_peered":"2024-09-12T17:00:12.308967+0000","last_unstale":"2024-09-12T18:13:21.087995+0000","last_undegraded":"2024-09-12T18:13:21.087995+0000","last_fullsized":"2024-09-12T18:13:21.087995+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:08.219861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17328515,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":460,"num_read_kb":120658,"num_write":1027,"num_write_kb":55796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:03.915218+0000","last_change":"2024-09-12T17:00:16.329927+0000","last_active":"2024-09-12T18:10:03.915218+0000","last_peered":"2024-09-12T18:10:03.915218+0000","last_clean":"2024-09-12T18:10:03.915218+0000","last_became_active":"2024-09-12T17:00:16.329596+0000","last_became_peered":"2024-09-12T17:00:16.329596+0000","last_unstale":"2024-09-12T18:10:03.915218+0000","last_undegraded":"2024-09-12T18:10:03.915218+0000","last_fullsized":"2024-09-12T18:10:03.915218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:12.864819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'340","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.024314+0000","last_change":"2024-09-12T17:00:18.332460+0000","last_active":"2024-09-12T18:13:23.024314+0000","last_peered":"2024-09-12T18:13:23.024314+0000","last_clean":"2024-09-12T18:13:23.024314+0000","last_became_active":"2024-09-12T17:00:18.331483+0000","last_became_peered":"2024-09-12T17:00:18.331483+0000","last_unstale":"2024-09-12T18:13:23.024314+0000","last_undegraded":"2024-09-12T18:13:23.024314+0000","last_fullsized":"2024-09-12T18:13:23.024314+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:15:12.963116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65937,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":560,"num_read_kb":1138,"num_write":450,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'737","reported_seq":4702,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.188075+0000","last_change":"2024-09-12T17:00:20.352350+0000","last_active":"2024-09-12T18:13:48.188075+0000","last_peered":"2024-09-12T18:13:48.188075+0000","last_clean":"2024-09-12T18:13:48.188075+0000","last_became_active":"2024-09-12T17:00:20.352022+0000","last_became_peered":"2024-09-12T17:00:20.352022+0000","last_unstale":"2024-09-12T18:13:48.188075+0000","last_undegraded":"2024-09-12T18:13:48.188075+0000","last_fullsized":"2024-09-12T18:13:48.188075+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:52.501993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'82","reported_seq":594,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.524395+0000","last_change":"2024-09-12T17:00:22.350570+0000","last_active":"2024-09-12T18:12:00.524395+0000","last_peered":"2024-09-12T18:12:00.524395+0000","last_clean":"2024-09-12T18:12:00.524395+0000","last_became_active":"2024-09-12T17:00:22.350283+0000","last_became_peered":"2024-09-12T17:00:22.350283+0000","last_unstale":"2024-09-12T18:12:00.524395+0000","last_undegraded":"2024-09-12T18:12:00.524395+0000","last_fullsized":"2024-09-12T18:12:00.524395+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:18.622278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":129,"num_read_kb":121,"num_write":196,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'24","reported_seq":569,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:09.884675+0000","last_change":"2024-09-12T17:00:14.326073+0000","last_active":"2024-09-12T18:10:09.884675+0000","last_peered":"2024-09-12T18:10:09.884675+0000","last_clean":"2024-09-12T18:10:09.884675+0000","last_became_active":"2024-09-12T17:00:14.325788+0000","last_became_peered":"2024-09-12T17:00:14.325788+0000","last_unstale":"2024-09-12T18:10:09.884675+0000","last_undegraded":"2024-09-12T18:10:09.884675+0000","last_fullsized":"2024-09-12T18:10:09.884675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:24.940646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":96,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'260","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:35.746667+0000","last_change":"2024-09-12T17:00:12.309670+0000","last_active":"2024-09-12T18:09:35.746667+0000","last_peered":"2024-09-12T18:09:35.746667+0000","last_clean":"2024-09-12T18:09:35.746667+0000","last_became_active":"2024-09-12T17:00:12.309388+0000","last_became_peered":"2024-09-12T17:00:12.309388+0000","last_unstale":"2024-09-12T18:09:35.746667+0000","last_undegraded":"2024-09-12T18:09:35.746667+0000","last_fullsized":"2024-09-12T18:09:35.746667+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:00.188061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6128646,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":479,"num_read_kb":20467,"num_write":1037,"num_write_kb":21258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1468,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:47.955497+0000","last_change":"2024-09-12T17:00:16.330362+0000","last_active":"2024-09-12T18:13:47.955497+0000","last_peered":"2024-09-12T18:13:47.955497+0000","last_clean":"2024-09-12T18:13:47.955497+0000","last_became_active":"2024-09-12T17:00:16.330035+0000","last_became_peered":"2024-09-12T17:00:16.330035+0000","last_unstale":"2024-09-12T18:13:47.955497+0000","last_undegraded":"2024-09-12T18:13:47.955497+0000","last_fullsized":"2024-09-12T18:13:47.955497+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:23.800125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":963,"num_read_kb":963,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'102","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.018578+0000","last_change":"2024-09-12T17:00:18.429647+0000","last_active":"2024-09-12T18:11:11.018578+0000","last_peered":"2024-09-12T18:11:11.018578+0000","last_clean":"2024-09-12T18:11:11.018578+0000","last_became_active":"2024-09-12T17:00:18.429253+0000","last_became_peered":"2024-09-12T17:00:18.429253+0000","last_unstale":"2024-09-12T18:11:11.018578+0000","last_undegraded":"2024-09-12T18:11:11.018578+0000","last_fullsized":"2024-09-12T18:11:11.018578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:37.177018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'781","reported_seq":2530,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.332686+0000","last_change":"2024-09-12T17:00:20.353257+0000","last_active":"2024-09-12T18:13:23.332686+0000","last_peered":"2024-09-12T18:13:23.332686+0000","last_clean":"2024-09-12T18:13:23.332686+0000","last_became_active":"2024-09-12T17:00:20.352792+0000","last_became_peered":"2024-09-12T17:00:20.352792+0000","last_unstale":"2024-09-12T18:13:23.332686+0000","last_undegraded":"2024-09-12T18:13:23.332686+0000","last_fullsized":"2024-09-12T18:13:23.332686+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:31.802808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'111","reported_seq":615,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.521752+0000","last_change":"2024-09-12T17:00:22.352596+0000","last_active":"2024-09-12T18:12:00.521752+0000","last_peered":"2024-09-12T18:12:00.521752+0000","last_clean":"2024-09-12T18:12:00.521752+0000","last_became_active":"2024-09-12T17:00:22.352182+0000","last_became_peered":"2024-09-12T17:00:22.352182+0000","last_unstale":"2024-09-12T18:12:00.521752+0000","last_undegraded":"2024-09-12T18:12:00.521752+0000","last_fullsized":"2024-09-12T18:12:00.521752+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:18.301972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":119,"num_write":244,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'121","reported_seq":766,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:13.916333+0000","last_change":"2024-09-12T17:00:14.329674+0000","last_active":"2024-09-12T18:10:13.916333+0000","last_peered":"2024-09-12T18:10:13.916333+0000","last_clean":"2024-09-12T18:10:13.916333+0000","last_became_active":"2024-09-12T17:00:14.329394+0000","last_became_peered":"2024-09-12T17:00:14.329394+0000","last_unstale":"2024-09-12T18:10:13.916333+0000","last_undegraded":"2024-09-12T18:10:13.916333+0000","last_fullsized":"2024-09-12T18:10:13.916333+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:56.581515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":562,"num_read_kb":483,"num_write":177,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'357","reported_seq":1046,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:38.341797+0000","last_change":"2024-09-12T17:00:12.314422+0000","last_active":"2024-09-12T18:09:38.341797+0000","last_peered":"2024-09-12T18:09:38.341797+0000","last_clean":"2024-09-12T18:09:38.341797+0000","last_became_active":"2024-09-12T17:00:12.314142+0000","last_became_peered":"2024-09-12T17:00:12.314142+0000","last_unstale":"2024-09-12T18:09:38.341797+0000","last_undegraded":"2024-09-12T18:09:38.341797+0000","last_fullsized":"2024-09-12T18:09:38.341797+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:28.691515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8321153,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":749,"num_read_kb":14993,"num_write":1087,"num_write_kb":29270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:00.750294+0000","last_change":"2024-09-12T17:00:16.328779+0000","last_active":"2024-09-12T18:10:00.750294+0000","last_peered":"2024-09-12T18:10:00.750294+0000","last_clean":"2024-09-12T18:10:00.750294+0000","last_became_active":"2024-09-12T17:00:16.328306+0000","last_became_peered":"2024-09-12T17:00:16.328306+0000","last_unstale":"2024-09-12T18:10:00.750294+0000","last_undegraded":"2024-09-12T18:10:00.750294+0000","last_fullsized":"2024-09-12T18:10:00.750294+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:34.580723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'383","reported_seq":1011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:17.973195+0000","last_change":"2024-09-12T17:00:18.328815+0000","last_active":"2024-09-12T18:12:17.973195+0000","last_peered":"2024-09-12T18:12:17.973195+0000","last_clean":"2024-09-12T18:12:17.973195+0000","last_became_active":"2024-09-12T17:00:18.328500+0000","last_became_peered":"2024-09-12T17:00:18.328500+0000","last_unstale":"2024-09-12T18:12:17.973195+0000","last_undegraded":"2024-09-12T18:12:17.973195+0000","last_fullsized":"2024-09-12T18:12:17.973195+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:13.655611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54759,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":607,"num_read_kb":1130,"num_write":474,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:07.740171+0000","last_change":"2024-09-12T17:00:20.350311+0000","last_active":"2024-09-12T18:10:07.740171+0000","last_peered":"2024-09-12T18:10:07.740171+0000","last_clean":"2024-09-12T18:10:07.740171+0000","last_became_active":"2024-09-12T17:00:20.350003+0000","last_became_peered":"2024-09-12T17:00:20.350003+0000","last_unstale":"2024-09-12T18:10:07.740171+0000","last_undegraded":"2024-09-12T18:10:07.740171+0000","last_fullsized":"2024-09-12T18:10:07.740171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:27.609870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'130","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.096280+0000","last_change":"2024-09-12T17:00:22.354899+0000","last_active":"2024-09-12T18:12:03.096280+0000","last_peered":"2024-09-12T18:12:03.096280+0000","last_clean":"2024-09-12T18:12:03.096280+0000","last_became_active":"2024-09-12T17:00:22.354601+0000","last_became_peered":"2024-09-12T17:00:22.354601+0000","last_unstale":"2024-09-12T18:12:03.096280+0000","last_undegraded":"2024-09-12T18:12:03.096280+0000","last_fullsized":"2024-09-12T18:12:03.096280+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:04.146875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":184,"num_read_kb":175,"num_write":297,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'262","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:17.750658+0000","last_change":"2024-09-12T17:00:14.329597+0000","last_active":"2024-09-12T18:11:17.750658+0000","last_peered":"2024-09-12T18:11:17.750658+0000","last_clean":"2024-09-12T18:11:17.750658+0000","last_became_active":"2024-09-12T17:00:14.329297+0000","last_became_peered":"2024-09-12T17:00:14.329297+0000","last_unstale":"2024-09-12T18:11:17.750658+0000","last_undegraded":"2024-09-12T18:11:17.750658+0000","last_fullsized":"2024-09-12T18:11:17.750658+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:20.710892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1103,"num_read_kb":898,"num_write":417,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.754092+0000","last_change":"2024-09-12T16:59:54.636782+0000","last_active":"2024-09-12T18:10:12.754092+0000","last_peered":"2024-09-12T18:10:12.754092+0000","last_clean":"2024-09-12T18:10:12.754092+0000","last_became_active":"2024-09-12T16:59:54.636487+0000","last_became_peered":"2024-09-12T16:59:54.636487+0000","last_unstale":"2024-09-12T18:10:12.754092+0000","last_undegraded":"2024-09-12T18:10:12.754092+0000","last_fullsized":"2024-09-12T18:10:12.754092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:53.619137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:53.619137+0000","last_clean_scrub_stamp":"2024-09-12T16:59:53.619137+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:25.991554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":530,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:52.959116+0000","last_change":"2024-09-12T17:00:02.680922+0000","last_active":"2024-09-12T18:10:52.959116+0000","last_peered":"2024-09-12T18:10:52.959116+0000","last_clean":"2024-09-12T18:10:52.959116+0000","last_became_active":"2024-09-12T17:00:00.669728+0000","last_became_peered":"2024-09-12T17:00:00.669728+0000","last_unstale":"2024-09-12T18:10:52.959116+0000","last_undegraded":"2024-09-12T18:10:52.959116+0000","last_fullsized":"2024-09-12T18:10:52.959116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:04.614720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058116500000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'328","reported_seq":1015,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.570675+0000","last_change":"2024-09-12T17:00:46.405193+0000","last_active":"2024-09-12T18:13:48.570675+0000","last_peered":"2024-09-12T18:13:48.570675+0000","last_clean":"2024-09-12T18:13:48.570675+0000","last_became_active":"2024-09-12T17:00:46.404905+0000","last_became_peered":"2024-09-12T17:00:46.404905+0000","last_unstale":"2024-09-12T18:13:48.570675+0000","last_undegraded":"2024-09-12T18:13:48.570675+0000","last_fullsized":"2024-09-12T18:13:48.570675+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:32.250482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6794004,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":613,"num_read_kb":82700,"num_write":1206,"num_write_kb":21344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.763082+0000","last_change":"2024-09-12T17:00:16.321475+0000","last_active":"2024-09-12T18:11:07.763082+0000","last_peered":"2024-09-12T18:11:07.763082+0000","last_clean":"2024-09-12T18:11:07.763082+0000","last_became_active":"2024-09-12T17:00:16.321151+0000","last_became_peered":"2024-09-12T17:00:16.321151+0000","last_unstale":"2024-09-12T18:11:07.763082+0000","last_undegraded":"2024-09-12T18:11:07.763082+0000","last_fullsized":"2024-09-12T18:11:07.763082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:40.509096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'739","reported_seq":1442,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.012263+0000","last_change":"2024-09-12T17:00:18.330396+0000","last_active":"2024-09-12T18:13:23.012263+0000","last_peered":"2024-09-12T18:13:23.012263+0000","last_clean":"2024-09-12T18:13:23.012263+0000","last_became_active":"2024-09-12T17:00:18.330037+0000","last_became_peered":"2024-09-12T17:00:18.330037+0000","last_unstale":"2024-09-12T18:13:23.012263+0000","last_undegraded":"2024-09-12T18:13:23.012263+0000","last_fullsized":"2024-09-12T18:13:23.012263+0000","mapping_epoch":30,"log_start":"264'700","ondisk_log_start":"264'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:20.891636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187511,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1448,"num_read_kb":3071,"num_write":1416,"num_write_kb":1268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:41.614845+0000","last_change":"2024-09-12T17:00:20.349669+0000","last_active":"2024-09-12T18:09:41.614845+0000","last_peered":"2024-09-12T18:09:41.614845+0000","last_clean":"2024-09-12T18:09:41.614845+0000","last_became_active":"2024-09-12T17:00:20.349363+0000","last_became_peered":"2024-09-12T17:00:20.349363+0000","last_unstale":"2024-09-12T18:09:41.614845+0000","last_undegraded":"2024-09-12T18:09:41.614845+0000","last_fullsized":"2024-09-12T18:09:41.614845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:59.536610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'187","reported_seq":888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.997884+0000","last_change":"2024-09-12T17:00:22.354974+0000","last_active":"2024-09-12T18:12:00.997884+0000","last_peered":"2024-09-12T18:12:00.997884+0000","last_clean":"2024-09-12T18:12:00.997884+0000","last_became_active":"2024-09-12T17:00:22.354654+0000","last_became_peered":"2024-09-12T17:00:22.354654+0000","last_unstale":"2024-09-12T18:12:00.997884+0000","last_undegraded":"2024-09-12T18:12:00.997884+0000","last_fullsized":"2024-09-12T18:12:00.997884+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:31.363438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":450,"num_read_kb":449,"num_write":373,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'132","reported_seq":742,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:59.044067+0000","last_change":"2024-09-12T17:00:14.319895+0000","last_active":"2024-09-12T18:09:59.044067+0000","last_peered":"2024-09-12T18:09:59.044067+0000","last_clean":"2024-09-12T18:09:59.044067+0000","last_became_active":"2024-09-12T17:00:14.319539+0000","last_became_peered":"2024-09-12T17:00:14.319539+0000","last_unstale":"2024-09-12T18:09:59.044067+0000","last_undegraded":"2024-09-12T18:09:59.044067+0000","last_fullsized":"2024-09-12T18:09:59.044067+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:30.605432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":596,"num_read_kb":500,"num_write":197,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.755045+0000","last_change":"2024-09-12T17:00:02.996796+0000","last_active":"2024-09-12T18:10:17.755045+0000","last_peered":"2024-09-12T18:10:17.755045+0000","last_clean":"2024-09-12T18:10:17.755045+0000","last_became_active":"2024-09-12T17:00:00.671211+0000","last_became_peered":"2024-09-12T17:00:00.671211+0000","last_unstale":"2024-09-12T18:10:17.755045+0000","last_undegraded":"2024-09-12T18:10:17.755045+0000","last_fullsized":"2024-09-12T18:10:17.755045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:37.005108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000441562,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'251","reported_seq":935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:01.623620+0000","last_change":"2024-09-12T17:00:12.306702+0000","last_active":"2024-09-12T18:11:01.623620+0000","last_peered":"2024-09-12T18:11:01.623620+0000","last_clean":"2024-09-12T18:11:01.623620+0000","last_became_active":"2024-09-12T17:00:12.306408+0000","last_became_peered":"2024-09-12T17:00:12.306408+0000","last_unstale":"2024-09-12T18:11:01.623620+0000","last_undegraded":"2024-09-12T18:11:01.623620+0000","last_fullsized":"2024-09-12T18:11:01.623620+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:21.843306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1530728,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":446,"num_read_kb":8959,"num_write":905,"num_write_kb":13821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:37.947663+0000","last_change":"2024-09-12T17:00:16.326370+0000","last_active":"2024-09-12T18:09:37.947663+0000","last_peered":"2024-09-12T18:09:37.947663+0000","last_clean":"2024-09-12T18:09:37.947663+0000","last_became_active":"2024-09-12T17:00:16.325914+0000","last_became_peered":"2024-09-12T17:00:16.325914+0000","last_unstale":"2024-09-12T18:09:37.947663+0000","last_undegraded":"2024-09-12T18:09:37.947663+0000","last_fullsized":"2024-09-12T18:09:37.947663+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:00.425804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1353","reported_seq":3187,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.847360+0000","last_change":"2024-09-12T17:00:18.331031+0000","last_active":"2024-09-12T18:13:48.847360+0000","last_peered":"2024-09-12T18:13:48.847360+0000","last_clean":"2024-09-12T18:13:48.847360+0000","last_became_active":"2024-09-12T17:00:18.330715+0000","last_became_peered":"2024-09-12T17:00:18.330715+0000","last_unstale":"2024-09-12T18:13:48.847360+0000","last_undegraded":"2024-09-12T18:13:48.847360+0000","last_fullsized":"2024-09-12T18:13:48.847360+0000","mapping_epoch":30,"log_start":"264'1300","ondisk_log_start":"264'1300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":1300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:19.772064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165470,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2166,"num_read_kb":4126,"num_write":1264,"num_write_kb":1076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:27.766397+0000","last_change":"2024-09-12T17:00:20.352790+0000","last_active":"2024-09-12T18:11:27.766397+0000","last_peered":"2024-09-12T18:11:27.766397+0000","last_clean":"2024-09-12T18:11:27.766397+0000","last_became_active":"2024-09-12T17:00:20.352287+0000","last_became_peered":"2024-09-12T17:00:20.352287+0000","last_unstale":"2024-09-12T18:11:27.766397+0000","last_undegraded":"2024-09-12T18:11:27.766397+0000","last_fullsized":"2024-09-12T18:11:27.766397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:15.288688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'96","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.928594+0000","last_change":"2024-09-12T17:00:22.587542+0000","last_active":"2024-09-12T18:12:08.928594+0000","last_peered":"2024-09-12T18:12:08.928594+0000","last_clean":"2024-09-12T18:12:08.928594+0000","last_became_active":"2024-09-12T17:00:22.587206+0000","last_became_peered":"2024-09-12T17:00:22.587206+0000","last_unstale":"2024-09-12T18:12:08.928594+0000","last_undegraded":"2024-09-12T18:12:08.928594+0000","last_fullsized":"2024-09-12T18:12:08.928594+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:21.704751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":151,"num_write":236,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'4068","reported_seq":4652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:33.912025+0000","last_change":"2024-09-12T17:00:14.331924+0000","last_active":"2024-09-12T18:09:33.912025+0000","last_peered":"2024-09-12T18:09:33.912025+0000","last_clean":"2024-09-12T18:09:33.912025+0000","last_became_active":"2024-09-12T17:00:14.331560+0000","last_became_peered":"2024-09-12T17:00:14.331560+0000","last_unstale":"2024-09-12T18:09:33.912025+0000","last_undegraded":"2024-09-12T18:09:33.912025+0000","last_fullsized":"2024-09-12T18:09:33.912025+0000","mapping_epoch":26,"log_start":"264'4000","ondisk_log_start":"264'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":3000,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:08.452289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16331,"num_read_kb":13702,"num_write":6093,"num_write_kb":3038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":529,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:53.701863+0000","last_change":"2024-09-12T17:00:02.677610+0000","last_active":"2024-09-12T18:10:53.701863+0000","last_peered":"2024-09-12T18:10:53.701863+0000","last_clean":"2024-09-12T18:10:53.701863+0000","last_became_active":"2024-09-12T17:00:01.173083+0000","last_became_peered":"2024-09-12T17:00:01.173083+0000","last_unstale":"2024-09-12T18:10:53.701863+0000","last_undegraded":"2024-09-12T18:10:53.701863+0000","last_fullsized":"2024-09-12T18:10:53.701863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:35.997474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056135799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'292","reported_seq":949,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.909053+0000","last_change":"2024-09-12T17:00:12.309409+0000","last_active":"2024-09-12T18:13:48.909053+0000","last_peered":"2024-09-12T18:13:48.909053+0000","last_clean":"2024-09-12T18:13:48.909053+0000","last_became_active":"2024-09-12T17:00:12.309100+0000","last_became_peered":"2024-09-12T17:00:12.309100+0000","last_unstale":"2024-09-12T18:13:48.909053+0000","last_undegraded":"2024-09-12T18:13:48.909053+0000","last_fullsized":"2024-09-12T18:13:48.909053+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:25.648067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850464,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":454,"num_read_kb":31712,"num_write":1024,"num_write_kb":22323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:38.694803+0000","last_change":"2024-09-12T17:00:16.325113+0000","last_active":"2024-09-12T18:09:38.694803+0000","last_peered":"2024-09-12T18:09:38.694803+0000","last_clean":"2024-09-12T18:09:38.694803+0000","last_became_active":"2024-09-12T17:00:16.324792+0000","last_became_peered":"2024-09-12T17:00:16.324792+0000","last_unstale":"2024-09-12T18:09:38.694803+0000","last_undegraded":"2024-09-12T18:09:38.694803+0000","last_fullsized":"2024-09-12T18:09:38.694803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:38.734680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'290","reported_seq":1723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.201178+0000","last_change":"2024-09-12T17:00:18.430289+0000","last_active":"2024-09-12T18:13:23.201178+0000","last_peered":"2024-09-12T18:13:23.201178+0000","last_clean":"2024-09-12T18:13:23.201178+0000","last_became_active":"2024-09-12T17:00:18.429997+0000","last_became_peered":"2024-09-12T17:00:18.429997+0000","last_unstale":"2024-09-12T18:13:23.201178+0000","last_undegraded":"2024-09-12T18:13:23.201178+0000","last_fullsized":"2024-09-12T18:13:23.201178+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:55.412482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":262,"num_read_kb":252,"num_write":239,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.624787+0000","last_change":"2024-09-12T17:00:20.353031+0000","last_active":"2024-09-12T18:11:11.624787+0000","last_peered":"2024-09-12T18:11:11.624787+0000","last_clean":"2024-09-12T18:11:11.624787+0000","last_became_active":"2024-09-12T17:00:20.350197+0000","last_became_peered":"2024-09-12T17:00:20.350197+0000","last_unstale":"2024-09-12T18:11:11.624787+0000","last_undegraded":"2024-09-12T18:11:11.624787+0000","last_fullsized":"2024-09-12T18:11:11.624787+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:17.466054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'275","reported_seq":881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.253630+0000","last_change":"2024-09-12T17:00:22.357898+0000","last_active":"2024-09-12T18:12:03.253630+0000","last_peered":"2024-09-12T18:12:03.253630+0000","last_clean":"2024-09-12T18:12:03.253630+0000","last_became_active":"2024-09-12T17:00:22.357583+0000","last_became_peered":"2024-09-12T17:00:22.357583+0000","last_unstale":"2024-09-12T18:12:03.253630+0000","last_undegraded":"2024-09-12T18:12:03.253630+0000","last_fullsized":"2024-09-12T18:12:03.253630+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:16.279162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":565,"num_read_kb":582,"num_write":607,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'184","reported_seq":770,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:03.921621+0000","last_change":"2024-09-12T17:00:14.325136+0000","last_active":"2024-09-12T18:11:03.921621+0000","last_peered":"2024-09-12T18:11:03.921621+0000","last_clean":"2024-09-12T18:11:03.921621+0000","last_became_active":"2024-09-12T17:00:14.324830+0000","last_became_peered":"2024-09-12T17:00:14.324830+0000","last_unstale":"2024-09-12T18:11:03.921621+0000","last_undegraded":"2024-09-12T18:11:03.921621+0000","last_fullsized":"2024-09-12T18:11:03.921621+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:00.282511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":771,"num_read_kb":626,"num_write":320,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:52.959075+0000","last_change":"2024-09-12T17:00:02.681561+0000","last_active":"2024-09-12T18:10:52.959075+0000","last_peered":"2024-09-12T18:10:52.959075+0000","last_clean":"2024-09-12T18:10:52.959075+0000","last_became_active":"2024-09-12T17:00:00.668696+0000","last_became_peered":"2024-09-12T17:00:00.668696+0000","last_unstale":"2024-09-12T18:10:52.959075+0000","last_undegraded":"2024-09-12T18:10:52.959075+0000","last_fullsized":"2024-09-12T18:10:52.959075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:34.470591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012259720000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'277","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:05.760259+0000","last_change":"2024-09-12T17:00:12.316101+0000","last_active":"2024-09-12T18:11:05.760259+0000","last_peered":"2024-09-12T18:11:05.760259+0000","last_clean":"2024-09-12T18:11:05.760259+0000","last_became_active":"2024-09-12T17:00:12.315813+0000","last_became_peered":"2024-09-12T17:00:12.315813+0000","last_unstale":"2024-09-12T18:11:05.760259+0000","last_undegraded":"2024-09-12T18:11:05.760259+0000","last_fullsized":"2024-09-12T18:11:05.760259+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:20.815493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6901853,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":392,"num_read_kb":35449,"num_write":993,"num_write_kb":30387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:26.626503+0000","last_change":"2024-09-12T17:00:16.325100+0000","last_active":"2024-09-12T18:11:26.626503+0000","last_peered":"2024-09-12T18:11:26.626503+0000","last_clean":"2024-09-12T18:11:26.626503+0000","last_became_active":"2024-09-12T17:00:16.324683+0000","last_became_peered":"2024-09-12T17:00:16.324683+0000","last_unstale":"2024-09-12T18:11:26.626503+0000","last_undegraded":"2024-09-12T18:11:26.626503+0000","last_fullsized":"2024-09-12T18:11:26.626503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:22.409202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'157","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.925935+0000","last_change":"2024-09-12T17:00:18.327666+0000","last_active":"2024-09-12T18:12:01.925935+0000","last_peered":"2024-09-12T18:12:01.925935+0000","last_clean":"2024-09-12T18:12:01.925935+0000","last_became_active":"2024-09-12T17:00:18.327205+0000","last_became_peered":"2024-09-12T17:00:18.327205+0000","last_unstale":"2024-09-12T18:12:01.925935+0000","last_undegraded":"2024-09-12T18:12:01.925935+0000","last_fullsized":"2024-09-12T18:12:01.925935+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:47.691766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":197,"num_read_kb":191,"num_write":142,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:42.736815+0000","last_change":"2024-09-12T17:00:20.356502+0000","last_active":"2024-09-12T18:09:42.736815+0000","last_peered":"2024-09-12T18:09:42.736815+0000","last_clean":"2024-09-12T18:09:42.736815+0000","last_became_active":"2024-09-12T17:00:20.356122+0000","last_became_peered":"2024-09-12T17:00:20.356122+0000","last_unstale":"2024-09-12T18:09:42.736815+0000","last_undegraded":"2024-09-12T18:09:42.736815+0000","last_fullsized":"2024-09-12T18:09:42.736815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:23.096424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'120","reported_seq":673,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:50.327979+0000","last_change":"2024-09-12T17:00:22.359257+0000","last_active":"2024-09-12T18:09:50.327979+0000","last_peered":"2024-09-12T18:09:50.327979+0000","last_clean":"2024-09-12T18:09:50.327979+0000","last_became_active":"2024-09-12T17:00:22.358888+0000","last_became_peered":"2024-09-12T17:00:22.358888+0000","last_unstale":"2024-09-12T18:09:50.327979+0000","last_undegraded":"2024-09-12T18:09:50.327979+0000","last_fullsized":"2024-09-12T18:09:50.327979+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:22.887398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":246,"num_write":283,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'172","reported_seq":804,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:03.921583+0000","last_change":"2024-09-12T17:00:14.331104+0000","last_active":"2024-09-12T18:11:03.921583+0000","last_peered":"2024-09-12T18:11:03.921583+0000","last_clean":"2024-09-12T18:11:03.921583+0000","last_became_active":"2024-09-12T17:00:14.330844+0000","last_became_peered":"2024-09-12T17:00:14.330844+0000","last_unstale":"2024-09-12T18:11:03.921583+0000","last_undegraded":"2024-09-12T18:11:03.921583+0000","last_fullsized":"2024-09-12T18:11:03.921583+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:40.344941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":795,"num_read_kb":654,"num_write":268,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'337","reported_seq":1017,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:17.963142+0000","last_change":"2024-09-12T17:00:12.318919+0000","last_active":"2024-09-12T18:11:17.963142+0000","last_peered":"2024-09-12T18:11:17.963142+0000","last_clean":"2024-09-12T18:11:17.963142+0000","last_became_active":"2024-09-12T17:00:12.318621+0000","last_became_peered":"2024-09-12T17:00:12.318621+0000","last_unstale":"2024-09-12T18:11:17.963142+0000","last_undegraded":"2024-09-12T18:11:17.963142+0000","last_fullsized":"2024-09-12T18:11:17.963142+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:47.056781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9640734,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":531,"num_read_kb":4542,"num_write":1271,"num_write_kb":25874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":534,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:53.920647+0000","last_change":"2024-09-12T17:00:02.683370+0000","last_active":"2024-09-12T18:10:53.920647+0000","last_peered":"2024-09-12T18:10:53.920647+0000","last_clean":"2024-09-12T18:10:53.920647+0000","last_became_active":"2024-09-12T17:00:00.667379+0000","last_became_peered":"2024-09-12T17:00:00.667379+0000","last_unstale":"2024-09-12T18:10:53.920647+0000","last_undegraded":"2024-09-12T18:10:53.920647+0000","last_fullsized":"2024-09-12T18:10:53.920647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:23.577096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056755300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:06.624201+0000","last_change":"2024-09-12T17:00:16.323271+0000","last_active":"2024-09-12T18:11:06.624201+0000","last_peered":"2024-09-12T18:11:06.624201+0000","last_clean":"2024-09-12T18:11:06.624201+0000","last_became_active":"2024-09-12T17:00:16.322854+0000","last_became_peered":"2024-09-12T17:00:16.322854+0000","last_unstale":"2024-09-12T18:11:06.624201+0000","last_undegraded":"2024-09-12T18:11:06.624201+0000","last_fullsized":"2024-09-12T18:11:06.624201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:28.816131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'654","reported_seq":1345,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.004591+0000","last_change":"2024-09-12T17:00:18.333420+0000","last_active":"2024-09-12T18:13:23.004591+0000","last_peered":"2024-09-12T18:13:23.004591+0000","last_clean":"2024-09-12T18:13:23.004591+0000","last_became_active":"2024-09-12T17:00:18.333147+0000","last_became_peered":"2024-09-12T17:00:18.333147+0000","last_unstale":"2024-09-12T18:13:23.004591+0000","last_undegraded":"2024-09-12T18:13:23.004591+0000","last_fullsized":"2024-09-12T18:13:23.004591+0000","mapping_epoch":30,"log_start":"264'600","ondisk_log_start":"264'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":600,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:53.163746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117831,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1744,"num_read_kb":2835,"num_write":2306,"num_write_kb":2105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:10.760988+0000","last_change":"2024-09-12T17:00:20.355077+0000","last_active":"2024-09-12T18:11:10.760988+0000","last_peered":"2024-09-12T18:11:10.760988+0000","last_clean":"2024-09-12T18:11:10.760988+0000","last_became_active":"2024-09-12T17:00:20.354771+0000","last_became_peered":"2024-09-12T17:00:20.354771+0000","last_unstale":"2024-09-12T18:11:10.760988+0000","last_undegraded":"2024-09-12T18:11:10.760988+0000","last_fullsized":"2024-09-12T18:11:10.760988+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:56.739823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'217","reported_seq":740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.100251+0000","last_change":"2024-09-12T17:00:22.588915+0000","last_active":"2024-09-12T18:12:01.100251+0000","last_peered":"2024-09-12T18:12:01.100251+0000","last_clean":"2024-09-12T18:12:01.100251+0000","last_became_active":"2024-09-12T17:00:22.588561+0000","last_became_peered":"2024-09-12T17:00:22.588561+0000","last_unstale":"2024-09-12T18:12:01.100251+0000","last_undegraded":"2024-09-12T18:12:01.100251+0000","last_fullsized":"2024-09-12T18:12:01.100251+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:58.487409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":223,"num_read_kb":213,"num_write":499,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'180","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:06.624221+0000","last_change":"2024-09-12T17:00:14.327539+0000","last_active":"2024-09-12T18:11:06.624221+0000","last_peered":"2024-09-12T18:11:06.624221+0000","last_clean":"2024-09-12T18:11:06.624221+0000","last_became_active":"2024-09-12T17:00:14.327268+0000","last_became_peered":"2024-09-12T17:00:14.327268+0000","last_unstale":"2024-09-12T18:11:06.624221+0000","last_undegraded":"2024-09-12T18:11:06.624221+0000","last_fullsized":"2024-09-12T18:11:06.624221+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:36.093079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":852,"num_read_kb":727,"num_write":266,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'323","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.838166+0000","last_change":"2024-09-12T17:00:12.310211+0000","last_active":"2024-09-12T18:13:48.838166+0000","last_peered":"2024-09-12T18:13:48.838166+0000","last_clean":"2024-09-12T18:13:48.838166+0000","last_became_active":"2024-09-12T17:00:12.309896+0000","last_became_peered":"2024-09-12T17:00:12.309896+0000","last_unstale":"2024-09-12T18:13:48.838166+0000","last_undegraded":"2024-09-12T18:13:48.838166+0000","last_fullsized":"2024-09-12T18:13:48.838166+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:33.087927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5569873,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":573,"num_read_kb":32728,"num_write":1222,"num_write_kb":26986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.763102+0000","last_change":"2024-09-12T17:00:02.996744+0000","last_active":"2024-09-12T18:11:07.763102+0000","last_peered":"2024-09-12T18:11:07.763102+0000","last_clean":"2024-09-12T18:11:07.763102+0000","last_became_active":"2024-09-12T17:00:00.670355+0000","last_became_peered":"2024-09-12T17:00:00.670355+0000","last_unstale":"2024-09-12T18:11:07.763102+0000","last_undegraded":"2024-09-12T18:11:07.763102+0000","last_fullsized":"2024-09-12T18:11:07.763102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:16.719229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042464500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.749307+0000","last_change":"2024-09-12T17:00:16.323451+0000","last_active":"2024-09-12T18:11:07.749307+0000","last_peered":"2024-09-12T18:11:07.749307+0000","last_clean":"2024-09-12T18:11:07.749307+0000","last_became_active":"2024-09-12T17:00:16.323157+0000","last_became_peered":"2024-09-12T17:00:16.323157+0000","last_unstale":"2024-09-12T18:11:07.749307+0000","last_undegraded":"2024-09-12T18:11:07.749307+0000","last_fullsized":"2024-09-12T18:11:07.749307+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:42.424080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'213","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.796757+0000","last_change":"2024-09-12T17:00:18.429323+0000","last_active":"2024-09-12T18:11:11.796757+0000","last_peered":"2024-09-12T18:11:11.796757+0000","last_clean":"2024-09-12T18:11:11.796757+0000","last_became_active":"2024-09-12T17:00:18.428978+0000","last_became_peered":"2024-09-12T17:00:18.428978+0000","last_unstale":"2024-09-12T18:11:11.796757+0000","last_undegraded":"2024-09-12T18:11:11.796757+0000","last_fullsized":"2024-09-12T18:11:11.796757+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:03.066210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":266,"num_read_kb":257,"num_write":182,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'767","reported_seq":2983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.299783+0000","last_change":"2024-09-12T17:00:20.345525+0000","last_active":"2024-09-12T18:13:23.299783+0000","last_peered":"2024-09-12T18:13:23.299783+0000","last_clean":"2024-09-12T18:13:23.299783+0000","last_became_active":"2024-09-12T17:00:20.345236+0000","last_became_peered":"2024-09-12T17:00:20.345236+0000","last_unstale":"2024-09-12T18:13:23.299783+0000","last_undegraded":"2024-09-12T18:13:23.299783+0000","last_fullsized":"2024-09-12T18:13:23.299783+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:26.183021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'111","reported_seq":634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:31.859446+0000","last_change":"2024-09-12T17:00:22.587755+0000","last_active":"2024-09-12T18:12:31.859446+0000","last_peered":"2024-09-12T18:12:31.859446+0000","last_clean":"2024-09-12T18:12:31.859446+0000","last_became_active":"2024-09-12T17:00:22.587443+0000","last_became_peered":"2024-09-12T17:00:22.587443+0000","last_unstale":"2024-09-12T18:12:31.859446+0000","last_undegraded":"2024-09-12T18:12:31.859446+0000","last_fullsized":"2024-09-12T18:12:31.859446+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:05.679814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":705,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":239,"num_read_kb":213,"num_write":277,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'317","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.843564+0000","last_change":"2024-09-12T17:00:14.333428+0000","last_active":"2024-09-12T18:10:26.843564+0000","last_peered":"2024-09-12T18:10:26.843564+0000","last_clean":"2024-09-12T18:10:26.843564+0000","last_became_active":"2024-09-12T17:00:14.333128+0000","last_became_peered":"2024-09-12T17:00:14.333128+0000","last_unstale":"2024-09-12T18:10:26.843564+0000","last_undegraded":"2024-09-12T18:10:26.843564+0000","last_fullsized":"2024-09-12T18:10:26.843564+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:34.464037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1338,"num_read_kb":1083,"num_write":472,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'295","reported_seq":950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.967580+0000","last_change":"2024-09-12T17:00:12.316074+0000","last_active":"2024-09-12T18:10:22.967580+0000","last_peered":"2024-09-12T18:10:22.967580+0000","last_clean":"2024-09-12T18:10:22.967580+0000","last_became_active":"2024-09-12T17:00:12.315812+0000","last_became_peered":"2024-09-12T17:00:12.315812+0000","last_unstale":"2024-09-12T18:10:22.967580+0000","last_undegraded":"2024-09-12T18:10:22.967580+0000","last_fullsized":"2024-09-12T18:10:22.967580+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:36.960724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8925376,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":491,"num_read_kb":23161,"num_write":1061,"num_write_kb":14173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:33.924599+0000","last_change":"2024-09-12T17:00:02.683419+0000","last_active":"2024-09-12T18:11:33.924599+0000","last_peered":"2024-09-12T18:11:33.924599+0000","last_clean":"2024-09-12T18:11:33.924599+0000","last_became_active":"2024-09-12T17:00:00.669898+0000","last_became_peered":"2024-09-12T17:00:00.669898+0000","last_unstale":"2024-09-12T18:11:33.924599+0000","last_undegraded":"2024-09-12T18:11:33.924599+0000","last_fullsized":"2024-09-12T18:11:33.924599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:32.053145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060387199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:05.760206+0000","last_change":"2024-09-12T17:00:16.327641+0000","last_active":"2024-09-12T18:11:05.760206+0000","last_peered":"2024-09-12T18:11:05.760206+0000","last_clean":"2024-09-12T18:11:05.760206+0000","last_became_active":"2024-09-12T17:00:16.327270+0000","last_became_peered":"2024-09-12T17:00:16.327270+0000","last_unstale":"2024-09-12T18:11:05.760206+0000","last_undegraded":"2024-09-12T18:11:05.760206+0000","last_fullsized":"2024-09-12T18:11:05.760206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:48.314834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'129","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.726748+0000","last_change":"2024-09-12T17:00:18.328546+0000","last_active":"2024-09-12T18:11:11.726748+0000","last_peered":"2024-09-12T18:11:11.726748+0000","last_clean":"2024-09-12T18:11:11.726748+0000","last_became_active":"2024-09-12T17:00:18.327994+0000","last_became_peered":"2024-09-12T17:00:18.327994+0000","last_unstale":"2024-09-12T18:11:11.726748+0000","last_undegraded":"2024-09-12T18:11:11.726748+0000","last_fullsized":"2024-09-12T18:11:11.726748+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:08.620648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":161,"num_write":110,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'771","reported_seq":2833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.310287+0000","last_change":"2024-09-12T17:00:20.354844+0000","last_active":"2024-09-12T18:13:23.310287+0000","last_peered":"2024-09-12T18:13:23.310287+0000","last_clean":"2024-09-12T18:13:23.310287+0000","last_became_active":"2024-09-12T17:00:20.354519+0000","last_became_peered":"2024-09-12T17:00:20.354519+0000","last_unstale":"2024-09-12T18:13:23.310287+0000","last_undegraded":"2024-09-12T18:13:23.310287+0000","last_fullsized":"2024-09-12T18:13:23.310287+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:52.962681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'283","reported_seq":819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.915298+0000","last_change":"2024-09-12T17:00:22.356453+0000","last_active":"2024-09-12T18:12:01.915298+0000","last_peered":"2024-09-12T18:12:01.915298+0000","last_clean":"2024-09-12T18:12:01.915298+0000","last_became_active":"2024-09-12T17:00:22.356132+0000","last_became_peered":"2024-09-12T17:00:22.356132+0000","last_unstale":"2024-09-12T18:12:01.915298+0000","last_undegraded":"2024-09-12T18:12:01.915298+0000","last_fullsized":"2024-09-12T18:12:01.915298+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:55.124427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":378,"num_read_kb":377,"num_write":631,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'145","reported_seq":762,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:05.760147+0000","last_change":"2024-09-12T17:00:14.330712+0000","last_active":"2024-09-12T18:11:05.760147+0000","last_peered":"2024-09-12T18:11:05.760147+0000","last_clean":"2024-09-12T18:11:05.760147+0000","last_became_active":"2024-09-12T17:00:14.330433+0000","last_became_peered":"2024-09-12T17:00:14.330433+0000","last_unstale":"2024-09-12T18:11:05.760147+0000","last_undegraded":"2024-09-12T18:11:05.760147+0000","last_fullsized":"2024-09-12T18:11:05.760147+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:23.434335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":651,"num_read_kb":539,"num_write":208,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'310","reported_seq":1077,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:36.642376+0000","last_change":"2024-09-12T17:00:12.308249+0000","last_active":"2024-09-12T18:09:36.642376+0000","last_peered":"2024-09-12T18:09:36.642376+0000","last_clean":"2024-09-12T18:09:36.642376+0000","last_became_active":"2024-09-12T17:00:12.307371+0000","last_became_peered":"2024-09-12T17:00:12.307371+0000","last_unstale":"2024-09-12T18:09:36.642376+0000","last_undegraded":"2024-09-12T18:09:36.642376+0000","last_fullsized":"2024-09-12T18:09:36.642376+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:08.255196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5888395,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":775,"num_read_kb":7035,"num_write":1133,"num_write_kb":32501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:32.752719+0000","last_change":"2024-09-12T17:00:02.674920+0000","last_active":"2024-09-12T18:11:32.752719+0000","last_peered":"2024-09-12T18:11:32.752719+0000","last_clean":"2024-09-12T18:11:32.752719+0000","last_became_active":"2024-09-12T17:00:00.670451+0000","last_became_peered":"2024-09-12T17:00:00.670451+0000","last_unstale":"2024-09-12T18:11:32.752719+0000","last_undegraded":"2024-09-12T18:11:32.752719+0000","last_fullsized":"2024-09-12T18:11:32.752719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:42.274336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046867000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.843580+0000","last_change":"2024-09-12T17:00:16.326975+0000","last_active":"2024-09-12T18:10:26.843580+0000","last_peered":"2024-09-12T18:10:26.843580+0000","last_clean":"2024-09-12T18:10:26.843580+0000","last_became_active":"2024-09-12T17:00:16.326163+0000","last_became_peered":"2024-09-12T17:00:16.326163+0000","last_unstale":"2024-09-12T18:10:26.843580+0000","last_undegraded":"2024-09-12T18:10:26.843580+0000","last_fullsized":"2024-09-12T18:10:26.843580+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:07.452685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'774","reported_seq":1498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.001066+0000","last_change":"2024-09-12T17:00:18.429419+0000","last_active":"2024-09-12T18:13:23.001066+0000","last_peered":"2024-09-12T18:13:23.001066+0000","last_clean":"2024-09-12T18:13:23.001066+0000","last_became_active":"2024-09-12T17:00:18.429131+0000","last_became_peered":"2024-09-12T17:00:18.429131+0000","last_unstale":"2024-09-12T18:13:23.001066+0000","last_undegraded":"2024-09-12T18:13:23.001066+0000","last_fullsized":"2024-09-12T18:13:23.001066+0000","mapping_epoch":30,"log_start":"264'700","ondisk_log_start":"264'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:04:14.159447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194231,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1370,"num_read_kb":3063,"num_write":1130,"num_write_kb":945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.848361+0000","last_change":"2024-09-12T17:00:20.350091+0000","last_active":"2024-09-12T18:11:11.848361+0000","last_peered":"2024-09-12T18:11:11.848361+0000","last_clean":"2024-09-12T18:11:11.848361+0000","last_became_active":"2024-09-12T17:00:20.349800+0000","last_became_peered":"2024-09-12T17:00:20.349800+0000","last_unstale":"2024-09-12T18:11:11.848361+0000","last_undegraded":"2024-09-12T18:11:11.848361+0000","last_fullsized":"2024-09-12T18:11:11.848361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:28:56.661972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'139","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:07.952151+0000","last_change":"2024-09-12T17:00:22.361129+0000","last_active":"2024-09-12T18:10:07.952151+0000","last_peered":"2024-09-12T18:10:07.952151+0000","last_clean":"2024-09-12T18:10:07.952151+0000","last_became_active":"2024-09-12T17:00:22.360730+0000","last_became_peered":"2024-09-12T17:00:22.360730+0000","last_unstale":"2024-09-12T18:10:07.952151+0000","last_undegraded":"2024-09-12T18:10:07.952151+0000","last_fullsized":"2024-09-12T18:10:07.952151+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:53.958932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":172,"num_read_kb":170,"num_write":343,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'181","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.194693+0000","last_change":"2024-09-12T17:00:22.354855+0000","last_active":"2024-09-12T18:12:03.194693+0000","last_peered":"2024-09-12T18:12:03.194693+0000","last_clean":"2024-09-12T18:12:03.194693+0000","last_became_active":"2024-09-12T17:00:22.354464+0000","last_became_peered":"2024-09-12T17:00:22.354464+0000","last_unstale":"2024-09-12T18:12:03.194693+0000","last_undegraded":"2024-09-12T18:12:03.194693+0000","last_fullsized":"2024-09-12T18:12:03.194693+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:18.356184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":465,"num_read_kb":419,"num_write":437,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'369","reported_seq":1045,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:15.752357+0000","last_change":"2024-09-12T17:00:14.330391+0000","last_active":"2024-09-12T18:10:15.752357+0000","last_peered":"2024-09-12T18:10:15.752357+0000","last_clean":"2024-09-12T18:10:15.752357+0000","last_became_active":"2024-09-12T17:00:14.329093+0000","last_became_peered":"2024-09-12T17:00:14.329093+0000","last_unstale":"2024-09-12T18:10:15.752357+0000","last_undegraded":"2024-09-12T18:10:15.752357+0000","last_fullsized":"2024-09-12T18:10:15.752357+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:02.679602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1637,"num_read_kb":1326,"num_write":585,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'292","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:15.272447+0000","last_change":"2024-09-12T17:00:12.307582+0000","last_active":"2024-09-12T18:13:15.272447+0000","last_peered":"2024-09-12T18:13:15.272447+0000","last_clean":"2024-09-12T18:13:15.272447+0000","last_became_active":"2024-09-12T17:00:12.307309+0000","last_became_peered":"2024-09-12T17:00:12.307309+0000","last_unstale":"2024-09-12T18:13:15.272447+0000","last_undegraded":"2024-09-12T18:13:15.272447+0000","last_fullsized":"2024-09-12T18:13:15.272447+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:28.009676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7766719,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":648,"num_read_kb":21828,"num_write":1203,"num_write_kb":15847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:18.916856+0000","last_change":"2024-09-12T17:00:16.325960+0000","last_active":"2024-09-12T18:10:18.916856+0000","last_peered":"2024-09-12T18:10:18.916856+0000","last_clean":"2024-09-12T18:10:18.916856+0000","last_became_active":"2024-09-12T17:00:16.325555+0000","last_became_peered":"2024-09-12T17:00:16.325555+0000","last_unstale":"2024-09-12T18:10:18.916856+0000","last_undegraded":"2024-09-12T18:10:18.916856+0000","last_fullsized":"2024-09-12T18:10:18.916856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:08:46.715410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'294","reported_seq":878,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:41.860734+0000","last_change":"2024-09-12T17:00:18.328249+0000","last_active":"2024-09-12T18:12:41.860734+0000","last_peered":"2024-09-12T18:12:41.860734+0000","last_clean":"2024-09-12T18:12:41.860734+0000","last_became_active":"2024-09-12T17:00:18.327374+0000","last_became_peered":"2024-09-12T17:00:18.327374+0000","last_unstale":"2024-09-12T18:12:41.860734+0000","last_undegraded":"2024-09-12T18:12:41.860734+0000","last_fullsized":"2024-09-12T18:12:41.860734+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:36.522799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56561,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":484,"num_read_kb":1007,"num_write":392,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.842898+0000","last_change":"2024-09-12T17:00:20.353374+0000","last_active":"2024-09-12T18:10:21.842898+0000","last_peered":"2024-09-12T18:10:21.842898+0000","last_clean":"2024-09-12T18:10:21.842898+0000","last_became_active":"2024-09-12T17:00:20.352801+0000","last_became_peered":"2024-09-12T17:00:20.352801+0000","last_unstale":"2024-09-12T18:10:21.842898+0000","last_undegraded":"2024-09-12T18:10:21.842898+0000","last_fullsized":"2024-09-12T18:10:21.842898+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:10.323586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'192","reported_seq":718,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844219+0000","last_change":"2024-09-12T17:00:22.354964+0000","last_active":"2024-09-12T18:10:31.844219+0000","last_peered":"2024-09-12T18:10:31.844219+0000","last_clean":"2024-09-12T18:10:31.844219+0000","last_became_active":"2024-09-12T17:00:22.354651+0000","last_became_peered":"2024-09-12T17:00:22.354651+0000","last_unstale":"2024-09-12T18:10:31.844219+0000","last_undegraded":"2024-09-12T18:10:31.844219+0000","last_fullsized":"2024-09-12T18:10:31.844219+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:50.025969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":300,"num_read_kb":268,"num_write":394,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'230","reported_seq":866,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:13.916251+0000","last_change":"2024-09-12T17:00:14.322018+0000","last_active":"2024-09-12T18:10:13.916251+0000","last_peered":"2024-09-12T18:10:13.916251+0000","last_clean":"2024-09-12T18:10:13.916251+0000","last_became_active":"2024-09-12T17:00:14.320955+0000","last_became_peered":"2024-09-12T17:00:14.320955+0000","last_unstale":"2024-09-12T18:10:13.916251+0000","last_undegraded":"2024-09-12T18:10:13.916251+0000","last_fullsized":"2024-09-12T18:10:13.916251+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:51.522285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1027,"num_read_kb":855,"num_write":338,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'334","reported_seq":977,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.755206+0000","last_change":"2024-09-12T17:00:12.316146+0000","last_active":"2024-09-12T18:10:17.755206+0000","last_peered":"2024-09-12T18:10:17.755206+0000","last_clean":"2024-09-12T18:10:17.755206+0000","last_became_active":"2024-09-12T17:00:12.315834+0000","last_became_peered":"2024-09-12T17:00:12.315834+0000","last_unstale":"2024-09-12T18:10:17.755206+0000","last_undegraded":"2024-09-12T18:10:17.755206+0000","last_fullsized":"2024-09-12T18:10:17.755206+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:21.977408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7879099,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":483,"num_read_kb":44669,"num_write":1191,"num_write_kb":42862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:16.842404+0000","last_change":"2024-09-12T17:00:16.327598+0000","last_active":"2024-09-12T18:10:16.842404+0000","last_peered":"2024-09-12T18:10:16.842404+0000","last_clean":"2024-09-12T18:10:16.842404+0000","last_became_active":"2024-09-12T17:00:16.327292+0000","last_became_peered":"2024-09-12T17:00:16.327292+0000","last_unstale":"2024-09-12T18:10:16.842404+0000","last_undegraded":"2024-09-12T18:10:16.842404+0000","last_fullsized":"2024-09-12T18:10:16.842404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:28.781328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'50","reported_seq":574,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:00.089541+0000","last_change":"2024-09-12T17:00:18.331826+0000","last_active":"2024-09-12T18:11:00.089541+0000","last_peered":"2024-09-12T18:11:00.089541+0000","last_clean":"2024-09-12T18:11:00.089541+0000","last_became_active":"2024-09-12T17:00:18.331495+0000","last_became_peered":"2024-09-12T17:00:18.331495+0000","last_unstale":"2024-09-12T18:11:00.089541+0000","last_undegraded":"2024-09-12T18:11:00.089541+0000","last_fullsized":"2024-09-12T18:11:00.089541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:10.249483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.755874+0000","last_change":"2024-09-12T17:00:20.348626+0000","last_active":"2024-09-12T18:10:22.755874+0000","last_peered":"2024-09-12T18:10:22.755874+0000","last_clean":"2024-09-12T18:10:22.755874+0000","last_became_active":"2024-09-12T17:00:20.348274+0000","last_became_peered":"2024-09-12T17:00:20.348274+0000","last_unstale":"2024-09-12T18:10:22.755874+0000","last_undegraded":"2024-09-12T18:10:22.755874+0000","last_fullsized":"2024-09-12T18:10:22.755874+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:44.279723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'244","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.928095+0000","last_change":"2024-09-12T17:00:22.350497+0000","last_active":"2024-09-12T18:12:01.928095+0000","last_peered":"2024-09-12T18:12:01.928095+0000","last_clean":"2024-09-12T18:12:01.928095+0000","last_became_active":"2024-09-12T17:00:22.350195+0000","last_became_peered":"2024-09-12T17:00:22.350195+0000","last_unstale":"2024-09-12T18:12:01.928095+0000","last_undegraded":"2024-09-12T18:12:01.928095+0000","last_fullsized":"2024-09-12T18:12:01.928095+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:00.704663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":636,"num_read_kb":568,"num_write":560,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'163","reported_seq":757,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:16.842370+0000","last_change":"2024-09-12T17:00:14.334938+0000","last_active":"2024-09-12T18:10:16.842370+0000","last_peered":"2024-09-12T18:10:16.842370+0000","last_clean":"2024-09-12T18:10:16.842370+0000","last_became_active":"2024-09-12T17:00:14.334652+0000","last_became_peered":"2024-09-12T17:00:14.334652+0000","last_unstale":"2024-09-12T18:10:16.842370+0000","last_undegraded":"2024-09-12T18:10:16.842370+0000","last_fullsized":"2024-09-12T18:10:16.842370+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:28.183092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":705,"num_read_kb":585,"num_write":252,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'322","reported_seq":1000,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.953719+0000","last_change":"2024-09-12T17:00:12.312907+0000","last_active":"2024-09-12T18:10:17.953719+0000","last_peered":"2024-09-12T18:10:17.953719+0000","last_clean":"2024-09-12T18:10:17.953719+0000","last_became_active":"2024-09-12T17:00:12.312629+0000","last_became_peered":"2024-09-12T17:00:12.312629+0000","last_unstale":"2024-09-12T18:10:17.953719+0000","last_undegraded":"2024-09-12T18:10:17.953719+0000","last_fullsized":"2024-09-12T18:10:17.953719+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:48.636890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5500381,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":591,"num_read_kb":31722,"num_write":1444,"num_write_kb":32347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.755061+0000","last_change":"2024-09-12T17:00:16.327231+0000","last_active":"2024-09-12T18:10:17.755061+0000","last_peered":"2024-09-12T18:10:17.755061+0000","last_clean":"2024-09-12T18:10:17.755061+0000","last_became_active":"2024-09-12T17:00:16.326905+0000","last_became_peered":"2024-09-12T17:00:16.326905+0000","last_unstale":"2024-09-12T18:10:17.755061+0000","last_undegraded":"2024-09-12T18:10:17.755061+0000","last_fullsized":"2024-09-12T18:10:17.755061+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:18.823688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'341","reported_seq":940,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:41.860773+0000","last_change":"2024-09-12T17:00:18.330035+0000","last_active":"2024-09-12T18:12:41.860773+0000","last_peered":"2024-09-12T18:12:41.860773+0000","last_clean":"2024-09-12T18:12:41.860773+0000","last_became_active":"2024-09-12T17:00:18.329759+0000","last_became_peered":"2024-09-12T17:00:18.329759+0000","last_unstale":"2024-09-12T18:12:41.860773+0000","last_undegraded":"2024-09-12T18:12:41.860773+0000","last_fullsized":"2024-09-12T18:12:41.860773+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:49.034586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59603,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":554,"num_read_kb":1118,"num_write":444,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.742473+0000","last_change":"2024-09-12T17:00:20.355975+0000","last_active":"2024-09-12T18:10:22.742473+0000","last_peered":"2024-09-12T18:10:22.742473+0000","last_clean":"2024-09-12T18:10:22.742473+0000","last_became_active":"2024-09-12T17:00:20.355629+0000","last_became_peered":"2024-09-12T17:00:20.355629+0000","last_unstale":"2024-09-12T18:10:22.742473+0000","last_undegraded":"2024-09-12T18:10:22.742473+0000","last_fullsized":"2024-09-12T18:10:22.742473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:01.719912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'125","reported_seq":653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954454+0000","last_change":"2024-09-12T17:00:22.360360+0000","last_active":"2024-09-12T18:10:22.954454+0000","last_peered":"2024-09-12T18:10:22.954454+0000","last_clean":"2024-09-12T18:10:22.954454+0000","last_became_active":"2024-09-12T17:00:22.360051+0000","last_became_peered":"2024-09-12T17:00:22.360051+0000","last_unstale":"2024-09-12T18:10:22.954454+0000","last_undegraded":"2024-09-12T18:10:22.954454+0000","last_fullsized":"2024-09-12T18:10:22.954454+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:14:23.925876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":246,"num_read_kb":229,"num_write":325,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'696","reported_seq":1442,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:16.842347+0000","last_change":"2024-09-12T17:00:14.338751+0000","last_active":"2024-09-12T18:10:16.842347+0000","last_peered":"2024-09-12T18:10:16.842347+0000","last_clean":"2024-09-12T18:10:16.842347+0000","last_became_active":"2024-09-12T17:00:14.338453+0000","last_became_peered":"2024-09-12T17:00:14.338453+0000","last_unstale":"2024-09-12T18:10:16.842347+0000","last_undegraded":"2024-09-12T18:10:16.842347+0000","last_fullsized":"2024-09-12T18:10:16.842347+0000","mapping_epoch":26,"log_start":"264'600","ondisk_log_start":"264'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:37.142336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3211,"num_read_kb":2592,"num_write":1218,"num_write_kb":764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'297","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:25.715567+0000","last_change":"2024-09-12T17:00:46.407184+0000","last_active":"2024-09-12T18:10:25.715567+0000","last_peered":"2024-09-12T18:10:25.715567+0000","last_clean":"2024-09-12T18:10:25.715567+0000","last_became_active":"2024-09-12T17:00:46.406811+0000","last_became_peered":"2024-09-12T17:00:46.406811+0000","last_unstale":"2024-09-12T18:10:25.715567+0000","last_undegraded":"2024-09-12T18:10:25.715567+0000","last_fullsized":"2024-09-12T18:10:25.715567+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:48.447890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1257210,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":393,"num_read_kb":7185,"num_write":981,"num_write_kb":23441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.741569+0000","last_change":"2024-09-12T17:00:16.328869+0000","last_active":"2024-09-12T18:10:17.741569+0000","last_peered":"2024-09-12T18:10:17.741569+0000","last_clean":"2024-09-12T18:10:17.741569+0000","last_became_active":"2024-09-12T17:00:16.328571+0000","last_became_peered":"2024-09-12T17:00:16.328571+0000","last_unstale":"2024-09-12T18:10:17.741569+0000","last_undegraded":"2024-09-12T18:10:17.741569+0000","last_fullsized":"2024-09-12T18:10:17.741569+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:55.238346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'303","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:37.776945+0000","last_change":"2024-09-12T17:00:18.332118+0000","last_active":"2024-09-12T18:12:37.776945+0000","last_peered":"2024-09-12T18:12:37.776945+0000","last_clean":"2024-09-12T18:12:37.776945+0000","last_became_active":"2024-09-12T17:00:18.331634+0000","last_became_peered":"2024-09-12T17:00:18.331634+0000","last_unstale":"2024-09-12T18:12:37.776945+0000","last_undegraded":"2024-09-12T18:12:37.776945+0000","last_fullsized":"2024-09-12T18:12:37.776945+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:30.095230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63213,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":486,"num_read_kb":1055,"num_write":402,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619176+0000","last_change":"2024-09-12T17:00:20.347184+0000","last_active":"2024-09-12T18:10:21.619176+0000","last_peered":"2024-09-12T18:10:21.619176+0000","last_clean":"2024-09-12T18:10:21.619176+0000","last_became_active":"2024-09-12T17:00:20.346778+0000","last_became_peered":"2024-09-12T17:00:20.346778+0000","last_unstale":"2024-09-12T18:10:21.619176+0000","last_undegraded":"2024-09-12T18:10:21.619176+0000","last_fullsized":"2024-09-12T18:10:21.619176+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:00.409774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'4226","reported_seq":4832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.749351+0000","last_change":"2024-09-12T17:00:14.327640+0000","last_active":"2024-09-12T18:11:07.749351+0000","last_peered":"2024-09-12T18:11:07.749351+0000","last_clean":"2024-09-12T18:11:07.749351+0000","last_became_active":"2024-09-12T17:00:14.327366+0000","last_became_peered":"2024-09-12T17:00:14.327366+0000","last_unstale":"2024-09-12T18:11:07.749351+0000","last_undegraded":"2024-09-12T18:11:07.749351+0000","last_fullsized":"2024-09-12T18:11:07.749351+0000","mapping_epoch":26,"log_start":"264'4200","ondisk_log_start":"264'4200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":3000,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:10.766155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16999,"num_read_kb":14230,"num_write":6368,"num_write_kb":3177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'277","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:16.842327+0000","last_change":"2024-09-12T17:00:12.316740+0000","last_active":"2024-09-12T18:10:16.842327+0000","last_peered":"2024-09-12T18:10:16.842327+0000","last_clean":"2024-09-12T18:10:16.842327+0000","last_became_active":"2024-09-12T17:00:12.316401+0000","last_became_peered":"2024-09-12T17:00:12.316401+0000","last_unstale":"2024-09-12T18:10:16.842327+0000","last_undegraded":"2024-09-12T18:10:16.842327+0000","last_fullsized":"2024-09-12T18:10:16.842327+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:45.699943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12039717,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":390,"num_read_kb":29248,"num_write":1035,"num_write_kb":37912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.620995+0000","last_change":"2024-09-12T17:00:16.318371+0000","last_active":"2024-09-12T18:10:36.620995+0000","last_peered":"2024-09-12T18:10:36.620995+0000","last_clean":"2024-09-12T18:10:36.620995+0000","last_became_active":"2024-09-12T17:00:16.317972+0000","last_became_peered":"2024-09-12T17:00:16.317972+0000","last_unstale":"2024-09-12T18:10:36.620995+0000","last_undegraded":"2024-09-12T18:10:36.620995+0000","last_fullsized":"2024-09-12T18:10:36.620995+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:29.831275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'525","reported_seq":1169,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.555577+0000","last_change":"2024-09-12T17:00:18.327876+0000","last_active":"2024-09-12T18:13:48.555577+0000","last_peered":"2024-09-12T18:13:48.555577+0000","last_clean":"2024-09-12T18:13:48.555577+0000","last_became_active":"2024-09-12T17:00:18.327593+0000","last_became_peered":"2024-09-12T17:00:18.327593+0000","last_unstale":"2024-09-12T18:13:48.555577+0000","last_undegraded":"2024-09-12T18:13:48.555577+0000","last_fullsized":"2024-09-12T18:13:48.555577+0000","mapping_epoch":30,"log_start":"264'500","ondisk_log_start":"264'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:04.110712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117469,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":949,"num_read_kb":2249,"num_write":826,"num_write_kb":734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954467+0000","last_change":"2024-09-12T17:00:20.350747+0000","last_active":"2024-09-12T18:10:22.954467+0000","last_peered":"2024-09-12T18:10:22.954467+0000","last_clean":"2024-09-12T18:10:22.954467+0000","last_became_active":"2024-09-12T17:00:20.350413+0000","last_became_peered":"2024-09-12T17:00:20.350413+0000","last_unstale":"2024-09-12T18:10:22.954467+0000","last_undegraded":"2024-09-12T18:10:22.954467+0000","last_fullsized":"2024-09-12T18:10:22.954467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:40.936332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'144","reported_seq":644,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.842975+0000","last_change":"2024-09-12T17:00:22.589129+0000","last_active":"2024-09-12T18:10:21.842975+0000","last_peered":"2024-09-12T18:10:21.842975+0000","last_clean":"2024-09-12T18:10:21.842975+0000","last_became_active":"2024-09-12T17:00:22.588456+0000","last_became_peered":"2024-09-12T17:00:22.588456+0000","last_unstale":"2024-09-12T18:10:21.842975+0000","last_undegraded":"2024-09-12T18:10:21.842975+0000","last_fullsized":"2024-09-12T18:10:21.842975+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:28.680701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":212,"num_write":324,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'222","reported_seq":887,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.620980+0000","last_change":"2024-09-12T17:00:14.332252+0000","last_active":"2024-09-12T18:10:36.620980+0000","last_peered":"2024-09-12T18:10:36.620980+0000","last_clean":"2024-09-12T18:10:36.620980+0000","last_became_active":"2024-09-12T17:00:14.328921+0000","last_became_peered":"2024-09-12T17:00:14.328921+0000","last_unstale":"2024-09-12T18:10:36.620980+0000","last_undegraded":"2024-09-12T18:10:36.620980+0000","last_fullsized":"2024-09-12T18:10:36.620980+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:14.125302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":992,"num_read_kb":851,"num_write":318,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'318","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.928031+0000","last_change":"2024-09-12T17:00:12.311889+0000","last_active":"2024-09-12T18:13:48.928031+0000","last_peered":"2024-09-12T18:13:48.928031+0000","last_clean":"2024-09-12T18:13:48.928031+0000","last_became_active":"2024-09-12T17:00:12.311606+0000","last_became_peered":"2024-09-12T17:00:12.311606+0000","last_unstale":"2024-09-12T18:13:48.928031+0000","last_undegraded":"2024-09-12T18:13:48.928031+0000","last_fullsized":"2024-09-12T18:13:48.928031+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:22.040208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049198,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":437,"num_read_kb":10884,"num_write":1090,"num_write_kb":34953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.749361+0000","last_change":"2024-09-12T17:00:16.327834+0000","last_active":"2024-09-12T18:11:07.749361+0000","last_peered":"2024-09-12T18:11:07.749361+0000","last_clean":"2024-09-12T18:11:07.749361+0000","last_became_active":"2024-09-12T17:00:16.327527+0000","last_became_peered":"2024-09-12T17:00:16.327527+0000","last_unstale":"2024-09-12T18:11:07.749361+0000","last_undegraded":"2024-09-12T18:11:07.749361+0000","last_fullsized":"2024-09-12T18:11:07.749361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:26.325669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'333","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:47.778601+0000","last_change":"2024-09-12T17:00:18.327394+0000","last_active":"2024-09-12T18:12:47.778601+0000","last_peered":"2024-09-12T18:12:47.778601+0000","last_clean":"2024-09-12T18:12:47.778601+0000","last_became_active":"2024-09-12T17:00:18.326984+0000","last_became_peered":"2024-09-12T17:00:18.326984+0000","last_unstale":"2024-09-12T18:12:47.778601+0000","last_undegraded":"2024-09-12T18:12:47.778601+0000","last_fullsized":"2024-09-12T18:12:47.778601+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:47.996940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57552,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":549,"num_read_kb":1064,"num_write":458,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:23.917579+0000","last_change":"2024-09-12T17:00:20.348230+0000","last_active":"2024-09-12T18:10:23.917579+0000","last_peered":"2024-09-12T18:10:23.917579+0000","last_clean":"2024-09-12T18:10:23.917579+0000","last_became_active":"2024-09-12T17:00:20.347873+0000","last_became_peered":"2024-09-12T17:00:20.347873+0000","last_unstale":"2024-09-12T18:10:23.917579+0000","last_undegraded":"2024-09-12T18:10:23.917579+0000","last_fullsized":"2024-09-12T18:10:23.917579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:20.554953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'167","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.557258+0000","last_change":"2024-09-12T17:00:22.351181+0000","last_active":"2024-09-12T18:11:58.557258+0000","last_peered":"2024-09-12T18:11:58.557258+0000","last_clean":"2024-09-12T18:11:58.557258+0000","last_became_active":"2024-09-12T17:00:22.350856+0000","last_became_peered":"2024-09-12T17:00:22.350856+0000","last_unstale":"2024-09-12T18:11:58.557258+0000","last_undegraded":"2024-09-12T18:11:58.557258+0000","last_fullsized":"2024-09-12T18:11:58.557258+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:47.546741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1852,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":274,"num_read_kb":259,"num_write":495,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'116","reported_seq":702,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:16.842438+0000","last_change":"2024-09-12T17:00:14.337578+0000","last_active":"2024-09-12T18:10:16.842438+0000","last_peered":"2024-09-12T18:10:16.842438+0000","last_clean":"2024-09-12T18:10:16.842438+0000","last_became_active":"2024-09-12T17:00:14.336495+0000","last_became_peered":"2024-09-12T17:00:14.336495+0000","last_unstale":"2024-09-12T18:10:16.842438+0000","last_undegraded":"2024-09-12T18:10:16.842438+0000","last_fullsized":"2024-09-12T18:10:16.842438+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:35.177783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":523,"num_read_kb":437,"num_write":169,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'295","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:14.335860+0000","last_change":"2024-09-12T17:00:12.318854+0000","last_active":"2024-09-12T18:13:14.335860+0000","last_peered":"2024-09-12T18:13:14.335860+0000","last_clean":"2024-09-12T18:13:14.335860+0000","last_became_active":"2024-09-12T17:00:12.318234+0000","last_became_peered":"2024-09-12T17:00:12.318234+0000","last_unstale":"2024-09-12T18:13:14.335860+0000","last_undegraded":"2024-09-12T18:13:14.335860+0000","last_fullsized":"2024-09-12T18:13:14.335860+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:50.822617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12656318,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":393,"num_read_kb":38331,"num_write":1055,"num_write_kb":59769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"36'3","reported_seq":987,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:22.951577+0000","last_change":"2024-09-12T17:00:16.327679+0000","last_active":"2024-09-12T18:13:22.951577+0000","last_peered":"2024-09-12T18:13:22.951577+0000","last_clean":"2024-09-12T18:13:22.951577+0000","last_became_active":"2024-09-12T17:00:16.327396+0000","last_became_peered":"2024-09-12T17:00:16.327396+0000","last_unstale":"2024-09-12T18:13:22.951577+0000","last_undegraded":"2024-09-12T18:13:22.951577+0000","last_fullsized":"2024-09-12T18:13:22.951577+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:03.799735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'289","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:16.865306+0000","last_change":"2024-09-12T17:00:18.429503+0000","last_active":"2024-09-12T18:13:16.865306+0000","last_peered":"2024-09-12T18:13:16.865306+0000","last_clean":"2024-09-12T18:13:16.865306+0000","last_became_active":"2024-09-12T17:00:18.429149+0000","last_became_peered":"2024-09-12T17:00:18.429149+0000","last_unstale":"2024-09-12T18:13:16.865306+0000","last_undegraded":"2024-09-12T18:13:16.865306+0000","last_fullsized":"2024-09-12T18:13:16.865306+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:42.541128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61118,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":1019,"num_write":394,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:38.919197+0000","last_change":"2024-09-12T17:00:20.350078+0000","last_active":"2024-09-12T18:10:38.919197+0000","last_peered":"2024-09-12T18:10:38.919197+0000","last_clean":"2024-09-12T18:10:38.919197+0000","last_became_active":"2024-09-12T17:00:20.349769+0000","last_became_peered":"2024-09-12T17:00:20.349769+0000","last_unstale":"2024-09-12T18:10:38.919197+0000","last_undegraded":"2024-09-12T18:10:38.919197+0000","last_fullsized":"2024-09-12T18:10:38.919197+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:01.586846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'102","reported_seq":597,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.025748+0000","last_change":"2024-09-12T17:00:22.359344+0000","last_active":"2024-09-12T18:13:23.025748+0000","last_peered":"2024-09-12T18:13:23.025748+0000","last_clean":"2024-09-12T18:13:23.025748+0000","last_became_active":"2024-09-12T17:00:22.358484+0000","last_became_peered":"2024-09-12T17:00:22.358484+0000","last_unstale":"2024-09-12T18:13:23.025748+0000","last_undegraded":"2024-09-12T18:13:23.025748+0000","last_fullsized":"2024-09-12T18:13:23.025748+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:18.149297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":123,"num_write":242,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'161","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:13.698084+0000","last_change":"2024-09-12T17:00:14.330553+0000","last_active":"2024-09-12T18:10:13.698084+0000","last_peered":"2024-09-12T18:10:13.698084+0000","last_clean":"2024-09-12T18:10:13.698084+0000","last_became_active":"2024-09-12T17:00:14.330238+0000","last_became_peered":"2024-09-12T17:00:14.330238+0000","last_unstale":"2024-09-12T18:10:13.698084+0000","last_undegraded":"2024-09-12T18:10:13.698084+0000","last_fullsized":"2024-09-12T18:10:13.698084+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:59.558428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":737,"num_read_kb":617,"num_write":248,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'266","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:11.618055+0000","last_change":"2024-09-12T17:00:12.305559+0000","last_active":"2024-09-12T18:10:11.618055+0000","last_peered":"2024-09-12T18:10:11.618055+0000","last_clean":"2024-09-12T18:10:11.618055+0000","last_became_active":"2024-09-12T17:00:12.305259+0000","last_became_peered":"2024-09-12T17:00:12.305259+0000","last_unstale":"2024-09-12T18:10:11.618055+0000","last_undegraded":"2024-09-12T18:10:11.618055+0000","last_fullsized":"2024-09-12T18:10:11.618055+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:27.124942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1413041,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":401,"num_read_kb":5192,"num_write":964,"num_write_kb":36405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:18.916910+0000","last_change":"2024-09-12T17:00:16.327913+0000","last_active":"2024-09-12T18:10:18.916910+0000","last_peered":"2024-09-12T18:10:18.916910+0000","last_clean":"2024-09-12T18:10:18.916910+0000","last_became_active":"2024-09-12T17:00:16.327626+0000","last_became_peered":"2024-09-12T17:00:16.327626+0000","last_unstale":"2024-09-12T18:10:18.916910+0000","last_undegraded":"2024-09-12T18:10:18.916910+0000","last_fullsized":"2024-09-12T18:10:18.916910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:33.847646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'109","reported_seq":655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.784639+0000","last_change":"2024-09-12T17:00:18.429917+0000","last_active":"2024-09-12T18:11:11.784639+0000","last_peered":"2024-09-12T18:11:11.784639+0000","last_clean":"2024-09-12T18:11:11.784639+0000","last_became_active":"2024-09-12T17:00:18.429481+0000","last_became_peered":"2024-09-12T17:00:18.429481+0000","last_unstale":"2024-09-12T18:11:11.784639+0000","last_undegraded":"2024-09-12T18:11:11.784639+0000","last_fullsized":"2024-09-12T18:11:11.784639+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:59.225430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":118,"num_write":86,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'781","reported_seq":4456,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.332692+0000","last_change":"2024-09-12T17:00:20.351383+0000","last_active":"2024-09-12T18:13:23.332692+0000","last_peered":"2024-09-12T18:13:23.332692+0000","last_clean":"2024-09-12T18:13:23.332692+0000","last_became_active":"2024-09-12T17:00:20.350976+0000","last_became_peered":"2024-09-12T17:00:20.350976+0000","last_unstale":"2024-09-12T18:13:23.332692+0000","last_undegraded":"2024-09-12T18:13:23.332692+0000","last_fullsized":"2024-09-12T18:13:23.332692+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:56.750542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'112","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.755851+0000","last_change":"2024-09-12T17:00:22.357875+0000","last_active":"2024-09-12T18:10:22.755851+0000","last_peered":"2024-09-12T18:10:22.755851+0000","last_clean":"2024-09-12T18:10:22.755851+0000","last_became_active":"2024-09-12T17:00:22.357215+0000","last_became_peered":"2024-09-12T17:00:22.357215+0000","last_unstale":"2024-09-12T18:10:22.755851+0000","last_undegraded":"2024-09-12T18:10:22.755851+0000","last_fullsized":"2024-09-12T18:10:22.755851+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:29.171521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":135,"num_write":263,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'292","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.921553+0000","last_change":"2024-09-12T17:00:14.340729+0000","last_active":"2024-09-12T18:12:01.921553+0000","last_peered":"2024-09-12T18:12:01.921553+0000","last_clean":"2024-09-12T18:12:01.921553+0000","last_became_active":"2024-09-12T17:00:14.340459+0000","last_became_peered":"2024-09-12T17:00:14.340459+0000","last_unstale":"2024-09-12T18:12:01.921553+0000","last_undegraded":"2024-09-12T18:12:01.921553+0000","last_fullsized":"2024-09-12T18:12:01.921553+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:27.507845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1297,"num_read_kb":1099,"num_write":462,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'284","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.589509+0000","last_change":"2024-09-12T17:00:46.721548+0000","last_active":"2024-09-12T18:13:48.589509+0000","last_peered":"2024-09-12T18:13:48.589509+0000","last_clean":"2024-09-12T18:13:48.589509+0000","last_became_active":"2024-09-12T17:00:46.721297+0000","last_became_peered":"2024-09-12T17:00:46.721297+0000","last_unstale":"2024-09-12T18:13:48.589509+0000","last_undegraded":"2024-09-12T18:13:48.589509+0000","last_fullsized":"2024-09-12T18:13:48.589509+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:14.131705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10338638,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":473,"num_read_kb":37694,"num_write":998,"num_write_kb":18010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.755136+0000","last_change":"2024-09-12T17:00:16.327719+0000","last_active":"2024-09-12T18:10:17.755136+0000","last_peered":"2024-09-12T18:10:17.755136+0000","last_clean":"2024-09-12T18:10:17.755136+0000","last_became_active":"2024-09-12T17:00:16.327461+0000","last_became_peered":"2024-09-12T17:00:16.327461+0000","last_unstale":"2024-09-12T18:10:17.755136+0000","last_undegraded":"2024-09-12T18:10:17.755136+0000","last_fullsized":"2024-09-12T18:10:17.755136+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:19.144290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'320","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:02.979920+0000","last_change":"2024-09-12T17:00:18.329265+0000","last_active":"2024-09-12T18:13:02.979920+0000","last_peered":"2024-09-12T18:13:02.979920+0000","last_clean":"2024-09-12T18:13:02.979920+0000","last_became_active":"2024-09-12T17:00:18.328990+0000","last_became_peered":"2024-09-12T17:00:18.328990+0000","last_unstale":"2024-09-12T18:13:02.979920+0000","last_undegraded":"2024-09-12T18:13:02.979920+0000","last_fullsized":"2024-09-12T18:13:02.979920+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:43.048916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50183,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":511,"num_read_kb":967,"num_write":402,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.619737+0000","last_change":"2024-09-12T17:00:20.350160+0000","last_active":"2024-09-12T18:10:26.619737+0000","last_peered":"2024-09-12T18:10:26.619737+0000","last_clean":"2024-09-12T18:10:26.619737+0000","last_became_active":"2024-09-12T17:00:20.349643+0000","last_became_peered":"2024-09-12T17:00:20.349643+0000","last_unstale":"2024-09-12T18:10:26.619737+0000","last_undegraded":"2024-09-12T18:10:26.619737+0000","last_fullsized":"2024-09-12T18:10:26.619737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:12.715810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'119","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.422359+0000","last_change":"2024-09-12T17:00:22.355955+0000","last_active":"2024-09-12T18:11:59.422359+0000","last_peered":"2024-09-12T18:11:59.422359+0000","last_clean":"2024-09-12T18:11:59.422359+0000","last_became_active":"2024-09-12T17:00:22.355658+0000","last_became_peered":"2024-09-12T17:00:22.355658+0000","last_unstale":"2024-09-12T18:11:59.422359+0000","last_undegraded":"2024-09-12T18:11:59.422359+0000","last_fullsized":"2024-09-12T18:11:59.422359+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:47.710679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":157,"num_read_kb":152,"num_write":284,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'216","reported_seq":827,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:15.752295+0000","last_change":"2024-09-12T17:00:14.334900+0000","last_active":"2024-09-12T18:10:15.752295+0000","last_peered":"2024-09-12T18:10:15.752295+0000","last_clean":"2024-09-12T18:10:15.752295+0000","last_became_active":"2024-09-12T17:00:14.334620+0000","last_became_peered":"2024-09-12T17:00:14.334620+0000","last_unstale":"2024-09-12T18:10:15.752295+0000","last_undegraded":"2024-09-12T18:10:15.752295+0000","last_fullsized":"2024-09-12T18:10:15.752295+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:57.025216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":978,"num_read_kb":833,"num_write":353,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'322","reported_seq":1001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:13.318345+0000","last_change":"2024-09-12T17:00:12.318288+0000","last_active":"2024-09-12T18:10:13.318345+0000","last_peered":"2024-09-12T18:10:13.318345+0000","last_clean":"2024-09-12T18:10:13.318345+0000","last_became_active":"2024-09-12T17:00:12.317850+0000","last_became_peered":"2024-09-12T17:00:12.317850+0000","last_unstale":"2024-09-12T18:10:13.318345+0000","last_undegraded":"2024-09-12T18:10:13.318345+0000","last_fullsized":"2024-09-12T18:10:13.318345+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:24.624921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12901529,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":538,"num_read_kb":19368,"num_write":1045,"num_write_kb":17051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.953668+0000","last_change":"2024-09-12T17:00:16.329861+0000","last_active":"2024-09-12T18:10:17.953668+0000","last_peered":"2024-09-12T18:10:17.953668+0000","last_clean":"2024-09-12T18:10:17.953668+0000","last_became_active":"2024-09-12T17:00:16.329505+0000","last_became_peered":"2024-09-12T17:00:16.329505+0000","last_unstale":"2024-09-12T18:10:17.953668+0000","last_undegraded":"2024-09-12T18:10:17.953668+0000","last_fullsized":"2024-09-12T18:10:17.953668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:10.041738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'261","reported_seq":849,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:51.636926+0000","last_change":"2024-09-12T17:00:18.330870+0000","last_active":"2024-09-12T18:12:51.636926+0000","last_peered":"2024-09-12T18:12:51.636926+0000","last_clean":"2024-09-12T18:12:51.636926+0000","last_became_active":"2024-09-12T17:00:18.330548+0000","last_became_peered":"2024-09-12T17:00:18.330548+0000","last_unstale":"2024-09-12T18:12:51.636926+0000","last_undegraded":"2024-09-12T18:12:51.636926+0000","last_fullsized":"2024-09-12T18:12:51.636926+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:29.885447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51585,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":432,"num_read_kb":919,"num_write":346,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.744654+0000","last_change":"2024-09-12T17:00:20.347403+0000","last_active":"2024-09-12T18:10:37.744654+0000","last_peered":"2024-09-12T18:10:37.744654+0000","last_clean":"2024-09-12T18:10:37.744654+0000","last_became_active":"2024-09-12T17:00:20.347122+0000","last_became_peered":"2024-09-12T17:00:20.347122+0000","last_unstale":"2024-09-12T18:10:37.744654+0000","last_undegraded":"2024-09-12T18:10:37.744654+0000","last_fullsized":"2024-09-12T18:10:37.744654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:45.526521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'144","reported_seq":681,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.843667+0000","last_change":"2024-09-12T17:00:22.588688+0000","last_active":"2024-09-12T18:10:26.843667+0000","last_peered":"2024-09-12T18:10:26.843667+0000","last_clean":"2024-09-12T18:10:26.843667+0000","last_became_active":"2024-09-12T17:00:22.588367+0000","last_became_peered":"2024-09-12T17:00:22.588367+0000","last_unstale":"2024-09-12T18:10:26.843667+0000","last_undegraded":"2024-09-12T18:10:26.843667+0000","last_fullsized":"2024-09-12T18:10:26.843667+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:33.524563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":299,"num_read_kb":277,"num_write":353,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'86","reported_seq":667,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844124+0000","last_change":"2024-09-12T17:00:14.338550+0000","last_active":"2024-09-12T18:10:31.844124+0000","last_peered":"2024-09-12T18:10:31.844124+0000","last_clean":"2024-09-12T18:10:31.844124+0000","last_became_active":"2024-09-12T17:00:14.338251+0000","last_became_peered":"2024-09-12T17:00:14.338251+0000","last_unstale":"2024-09-12T18:10:31.844124+0000","last_undegraded":"2024-09-12T18:10:31.844124+0000","last_fullsized":"2024-09-12T18:10:31.844124+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:22.563527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":335,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'318","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.843064+0000","last_change":"2024-09-12T17:00:12.319168+0000","last_active":"2024-09-12T18:10:21.843064+0000","last_peered":"2024-09-12T18:10:21.843064+0000","last_clean":"2024-09-12T18:10:21.843064+0000","last_became_active":"2024-09-12T17:00:12.318883+0000","last_became_peered":"2024-09-12T17:00:12.318883+0000","last_unstale":"2024-09-12T18:10:21.843064+0000","last_undegraded":"2024-09-12T18:10:21.843064+0000","last_fullsized":"2024-09-12T18:10:21.843064+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:05.539963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1748566,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":632,"num_read_kb":40775,"num_write":1122,"num_write_kb":14251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"36'5","reported_seq":988,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:22.950870+0000","last_change":"2024-09-12T17:00:16.326343+0000","last_active":"2024-09-12T18:13:22.950870+0000","last_peered":"2024-09-12T18:13:22.950870+0000","last_clean":"2024-09-12T18:13:22.950870+0000","last_became_active":"2024-09-12T17:00:16.326067+0000","last_became_peered":"2024-09-12T17:00:16.326067+0000","last_unstale":"2024-09-12T18:13:22.950870+0000","last_undegraded":"2024-09-12T18:13:22.950870+0000","last_fullsized":"2024-09-12T18:13:22.950870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:58.899112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'265","reported_seq":822,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:51.862183+0000","last_change":"2024-09-12T17:00:18.326987+0000","last_active":"2024-09-12T18:12:51.862183+0000","last_peered":"2024-09-12T18:12:51.862183+0000","last_clean":"2024-09-12T18:12:51.862183+0000","last_became_active":"2024-09-12T17:00:18.326438+0000","last_became_peered":"2024-09-12T17:00:18.326438+0000","last_unstale":"2024-09-12T18:12:51.862183+0000","last_undegraded":"2024-09-12T18:12:51.862183+0000","last_fullsized":"2024-09-12T18:12:51.862183+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:02.146729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59502,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":432,"num_read_kb":968,"num_write":366,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.753168+0000","last_change":"2024-09-12T17:00:20.349597+0000","last_active":"2024-09-12T18:10:20.753168+0000","last_peered":"2024-09-12T18:10:20.753168+0000","last_clean":"2024-09-12T18:10:20.753168+0000","last_became_active":"2024-09-12T17:00:20.349324+0000","last_became_peered":"2024-09-12T17:00:20.349324+0000","last_unstale":"2024-09-12T18:10:20.753168+0000","last_undegraded":"2024-09-12T18:10:20.753168+0000","last_fullsized":"2024-09-12T18:10:20.753168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:28.300340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'171","reported_seq":1639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.329193+0000","last_change":"2024-09-12T17:00:22.354055+0000","last_active":"2024-09-12T18:11:59.329193+0000","last_peered":"2024-09-12T18:11:59.329193+0000","last_clean":"2024-09-12T18:11:59.329193+0000","last_became_active":"2024-09-12T17:00:22.353287+0000","last_became_peered":"2024-09-12T17:00:22.353287+0000","last_unstale":"2024-09-12T18:11:59.329193+0000","last_undegraded":"2024-09-12T18:11:59.329193+0000","last_fullsized":"2024-09-12T18:11:59.329193+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:04.187431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1233,"num_read_kb":1225,"num_write":392,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'366","reported_seq":1049,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.753093+0000","last_change":"2024-09-12T17:00:14.323586+0000","last_active":"2024-09-12T18:10:20.753093+0000","last_peered":"2024-09-12T18:10:20.753093+0000","last_clean":"2024-09-12T18:10:20.753093+0000","last_became_active":"2024-09-12T17:00:14.323113+0000","last_became_peered":"2024-09-12T17:00:14.323113+0000","last_unstale":"2024-09-12T18:10:20.753093+0000","last_undegraded":"2024-09-12T18:10:20.753093+0000","last_fullsized":"2024-09-12T18:10:20.753093+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:22.883267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1619,"num_read_kb":1299,"num_write":554,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'260","reported_seq":923,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:01.623714+0000","last_change":"2024-09-12T17:00:12.312702+0000","last_active":"2024-09-12T18:11:01.623714+0000","last_peered":"2024-09-12T18:11:01.623714+0000","last_clean":"2024-09-12T18:11:01.623714+0000","last_became_active":"2024-09-12T17:00:12.312456+0000","last_became_peered":"2024-09-12T17:00:12.312456+0000","last_unstale":"2024-09-12T18:11:01.623714+0000","last_undegraded":"2024-09-12T18:11:01.623714+0000","last_fullsized":"2024-09-12T18:11:01.623714+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:20.588667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716514,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":442,"num_read_kb":30859,"num_write":938,"num_write_kb":23841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:38.919143+0000","last_change":"2024-09-12T17:00:16.326062+0000","last_active":"2024-09-12T18:10:38.919143+0000","last_peered":"2024-09-12T18:10:38.919143+0000","last_clean":"2024-09-12T18:10:38.919143+0000","last_became_active":"2024-09-12T17:00:16.325535+0000","last_became_peered":"2024-09-12T17:00:16.325535+0000","last_unstale":"2024-09-12T18:10:38.919143+0000","last_undegraded":"2024-09-12T18:10:38.919143+0000","last_fullsized":"2024-09-12T18:10:38.919143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:32.939447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'301","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:50.776088+0000","last_change":"2024-09-12T17:00:18.326450+0000","last_active":"2024-09-12T18:12:50.776088+0000","last_peered":"2024-09-12T18:12:50.776088+0000","last_clean":"2024-09-12T18:12:50.776088+0000","last_became_active":"2024-09-12T17:00:18.326140+0000","last_became_peered":"2024-09-12T17:00:18.326140+0000","last_unstale":"2024-09-12T18:12:50.776088+0000","last_undegraded":"2024-09-12T18:12:50.776088+0000","last_fullsized":"2024-09-12T18:12:50.776088+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:38.985728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56862,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":502,"num_read_kb":1029,"num_write":400,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619169+0000","last_change":"2024-09-12T17:00:20.354653+0000","last_active":"2024-09-12T18:10:21.619169+0000","last_peered":"2024-09-12T18:10:21.619169+0000","last_clean":"2024-09-12T18:10:21.619169+0000","last_became_active":"2024-09-12T17:00:20.353962+0000","last_became_peered":"2024-09-12T17:00:20.353962+0000","last_unstale":"2024-09-12T18:10:21.619169+0000","last_undegraded":"2024-09-12T18:10:21.619169+0000","last_fullsized":"2024-09-12T18:10:21.619169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:46.119505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'120","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:21.908306+0000","last_change":"2024-09-12T17:00:22.353191+0000","last_active":"2024-09-12T18:13:21.908306+0000","last_peered":"2024-09-12T18:13:21.908306+0000","last_clean":"2024-09-12T18:13:21.908306+0000","last_became_active":"2024-09-12T17:00:22.352779+0000","last_became_peered":"2024-09-12T17:00:22.352779+0000","last_unstale":"2024-09-12T18:13:21.908306+0000","last_undegraded":"2024-09-12T18:13:21.908306+0000","last_fullsized":"2024-09-12T18:13:21.908306+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:10.560331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":133,"num_write":289,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'171","reported_seq":772,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:33.912004+0000","last_change":"2024-09-12T17:00:14.315744+0000","last_active":"2024-09-12T18:09:33.912004+0000","last_peered":"2024-09-12T18:09:33.912004+0000","last_clean":"2024-09-12T18:09:33.912004+0000","last_became_active":"2024-09-12T17:00:14.315424+0000","last_became_peered":"2024-09-12T17:00:14.315424+0000","last_unstale":"2024-09-12T18:09:33.912004+0000","last_undegraded":"2024-09-12T18:09:33.912004+0000","last_fullsized":"2024-09-12T18:09:33.912004+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:21.991890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":753,"num_read_kb":612,"num_write":278,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'265","reported_seq":1004,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:02.748584+0000","last_change":"2024-09-12T17:00:12.310622+0000","last_active":"2024-09-12T18:11:02.748584+0000","last_peered":"2024-09-12T18:11:02.748584+0000","last_clean":"2024-09-12T18:11:02.748584+0000","last_became_active":"2024-09-12T17:00:12.310322+0000","last_became_peered":"2024-09-12T17:00:12.310322+0000","last_unstale":"2024-09-12T18:11:02.748584+0000","last_undegraded":"2024-09-12T18:11:02.748584+0000","last_fullsized":"2024-09-12T18:11:02.748584+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:55.608530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9702271,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":504,"num_read_kb":27239,"num_write":985,"num_write_kb":25993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'258","reported_seq":883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:07.952184+0000","last_change":"2024-09-12T17:00:46.407147+0000","last_active":"2024-09-12T18:10:07.952184+0000","last_peered":"2024-09-12T18:10:07.952184+0000","last_clean":"2024-09-12T18:10:07.952184+0000","last_became_active":"2024-09-12T17:00:46.406809+0000","last_became_peered":"2024-09-12T17:00:46.406809+0000","last_unstale":"2024-09-12T18:10:07.952184+0000","last_undegraded":"2024-09-12T18:10:07.952184+0000","last_fullsized":"2024-09-12T18:10:07.952184+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:36.394344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1147,"num_read_kb":935,"num_write":403,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"264'268","reported_seq":974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.581040+0000","last_change":"2024-09-12T17:00:12.312943+0000","last_active":"2024-09-12T18:13:48.581040+0000","last_peered":"2024-09-12T18:13:48.581040+0000","last_clean":"2024-09-12T18:13:48.581040+0000","last_became_active":"2024-09-12T17:00:12.312579+0000","last_became_peered":"2024-09-12T17:00:12.312579+0000","last_unstale":"2024-09-12T18:13:48.581040+0000","last_undegraded":"2024-09-12T18:13:48.581040+0000","last_fullsized":"2024-09-12T18:13:48.581040+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:00.686097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1361008,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":660,"num_read_kb":733,"num_write":902,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'458","reported_seq":1235,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:37.947629+0000","last_change":"2024-09-12T17:00:14.327470+0000","last_active":"2024-09-12T18:09:37.947629+0000","last_peered":"2024-09-12T18:09:37.947629+0000","last_clean":"2024-09-12T18:09:37.947629+0000","last_became_active":"2024-09-12T17:00:14.327158+0000","last_became_peered":"2024-09-12T17:00:14.327158+0000","last_unstale":"2024-09-12T18:09:37.947629+0000","last_undegraded":"2024-09-12T18:09:37.947629+0000","last_fullsized":"2024-09-12T18:09:37.947629+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:08.515532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2228,"num_read_kb":1913,"num_write":817,"num_write_kb":525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'264","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:07.980665+0000","last_change":"2024-09-12T17:00:12.318140+0000","last_active":"2024-09-12T18:13:07.980665+0000","last_peered":"2024-09-12T18:13:07.980665+0000","last_clean":"2024-09-12T18:13:07.980665+0000","last_became_active":"2024-09-12T17:00:12.317893+0000","last_became_peered":"2024-09-12T17:00:12.317893+0000","last_unstale":"2024-09-12T18:13:07.980665+0000","last_undegraded":"2024-09-12T18:13:07.980665+0000","last_fullsized":"2024-09-12T18:13:07.980665+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:32.821778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":562519,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":426,"num_read_kb":13770,"num_write":950,"num_write_kb":25077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'105","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:33.911941+0000","last_change":"2024-09-12T17:00:14.323700+0000","last_active":"2024-09-12T18:09:33.911941+0000","last_peered":"2024-09-12T18:09:33.911941+0000","last_clean":"2024-09-12T18:09:33.911941+0000","last_became_active":"2024-09-12T17:00:14.323394+0000","last_became_peered":"2024-09-12T17:00:14.323394+0000","last_unstale":"2024-09-12T18:09:33.911941+0000","last_undegraded":"2024-09-12T18:09:33.911941+0000","last_fullsized":"2024-09-12T18:09:33.911941+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:59.080164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":480,"num_read_kb":401,"num_write":159,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'381","reported_seq":1139,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:21.625924+0000","last_change":"2024-09-12T17:00:12.315248+0000","last_active":"2024-09-12T18:11:21.625924+0000","last_peered":"2024-09-12T18:11:21.625924+0000","last_clean":"2024-09-12T18:11:21.625924+0000","last_became_active":"2024-09-12T17:00:12.314938+0000","last_became_peered":"2024-09-12T17:00:12.314938+0000","last_unstale":"2024-09-12T18:11:21.625924+0000","last_undegraded":"2024-09-12T18:11:21.625924+0000","last_fullsized":"2024-09-12T18:11:21.625924+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:26.555386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7272567,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":766,"num_read_kb":44492,"num_write":1327,"num_write_kb":38820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'333","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:16.849080+0000","last_change":"2024-09-12T17:00:14.334325+0000","last_active":"2024-09-12T18:11:16.849080+0000","last_peered":"2024-09-12T18:11:16.849080+0000","last_clean":"2024-09-12T18:11:16.849080+0000","last_became_active":"2024-09-12T17:00:14.333821+0000","last_became_peered":"2024-09-12T17:00:14.333821+0000","last_unstale":"2024-09-12T18:11:16.849080+0000","last_undegraded":"2024-09-12T18:11:16.849080+0000","last_fullsized":"2024-09-12T18:11:16.849080+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:38.122605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1469,"num_read_kb":1192,"num_write":564,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'262","reported_seq":915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:12.652661+0000","last_change":"2024-09-12T17:00:12.317044+0000","last_active":"2024-09-12T18:13:12.652661+0000","last_peered":"2024-09-12T18:13:12.652661+0000","last_clean":"2024-09-12T18:13:12.652661+0000","last_became_active":"2024-09-12T17:00:12.316672+0000","last_became_peered":"2024-09-12T17:00:12.316672+0000","last_unstale":"2024-09-12T18:13:12.652661+0000","last_undegraded":"2024-09-12T18:13:12.652661+0000","last_fullsized":"2024-09-12T18:13:12.652661+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:33.188507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13956928,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":420,"num_read_kb":22931,"num_write":895,"num_write_kb":33827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'55","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:05.760226+0000","last_change":"2024-09-12T17:00:14.324630+0000","last_active":"2024-09-12T18:11:05.760226+0000","last_peered":"2024-09-12T18:11:05.760226+0000","last_clean":"2024-09-12T18:11:05.760226+0000","last_became_active":"2024-09-12T17:00:14.324051+0000","last_became_peered":"2024-09-12T17:00:14.324051+0000","last_unstale":"2024-09-12T18:11:05.760226+0000","last_undegraded":"2024-09-12T18:11:05.760226+0000","last_fullsized":"2024-09-12T18:11:05.760226+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:00.419356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":201,"num_write":77,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'310","reported_seq":985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.920774+0000","last_change":"2024-09-12T17:00:12.314909+0000","last_active":"2024-09-12T18:13:48.920774+0000","last_peered":"2024-09-12T18:13:48.920774+0000","last_clean":"2024-09-12T18:13:48.920774+0000","last_became_active":"2024-09-12T17:00:12.314059+0000","last_became_peered":"2024-09-12T17:00:12.314059+0000","last_unstale":"2024-09-12T18:13:48.920774+0000","last_undegraded":"2024-09-12T18:13:48.920774+0000","last_fullsized":"2024-09-12T18:13:48.920774+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:36.683937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9064183,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":475,"num_read_kb":67840,"num_write":999,"num_write_kb":38572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'162","reported_seq":748,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:06.847823+0000","last_change":"2024-09-12T17:00:14.338773+0000","last_active":"2024-09-12T18:11:06.847823+0000","last_peered":"2024-09-12T18:11:06.847823+0000","last_clean":"2024-09-12T18:11:06.847823+0000","last_became_active":"2024-09-12T17:00:14.338503+0000","last_became_peered":"2024-09-12T17:00:14.338503+0000","last_unstale":"2024-09-12T18:11:06.847823+0000","last_undegraded":"2024-09-12T18:11:06.847823+0000","last_fullsized":"2024-09-12T18:11:06.847823+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:37.093331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":567,"num_write":272,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'256","reported_seq":864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:32.735364+0000","last_change":"2024-09-12T17:00:12.312243+0000","last_active":"2024-09-12T18:09:32.735364+0000","last_peered":"2024-09-12T18:09:32.735364+0000","last_clean":"2024-09-12T18:09:32.735364+0000","last_became_active":"2024-09-12T17:00:12.311933+0000","last_became_peered":"2024-09-12T17:00:12.311933+0000","last_unstale":"2024-09-12T18:09:32.735364+0000","last_undegraded":"2024-09-12T18:09:32.735364+0000","last_fullsized":"2024-09-12T18:09:32.735364+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:08:37.097651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7602949,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":354,"num_read_kb":17784,"num_write":928,"num_write_kb":43947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'289","reported_seq":1002,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.749263+0000","last_change":"2024-09-12T17:00:14.319474+0000","last_active":"2024-09-12T18:11:07.749263+0000","last_peered":"2024-09-12T18:11:07.749263+0000","last_clean":"2024-09-12T18:11:07.749263+0000","last_became_active":"2024-09-12T17:00:14.319152+0000","last_became_peered":"2024-09-12T17:00:14.319152+0000","last_unstale":"2024-09-12T18:11:07.749263+0000","last_undegraded":"2024-09-12T18:11:07.749263+0000","last_fullsized":"2024-09-12T18:11:07.749263+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:25.091276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1506,"num_read_kb":1343,"num_write":479,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'371","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:31.837441+0000","last_change":"2024-09-12T17:00:12.321281+0000","last_active":"2024-09-12T18:09:31.837441+0000","last_peered":"2024-09-12T18:09:31.837441+0000","last_clean":"2024-09-12T18:09:31.837441+0000","last_became_active":"2024-09-12T17:00:12.320948+0000","last_became_peered":"2024-09-12T17:00:12.320948+0000","last_unstale":"2024-09-12T18:09:31.837441+0000","last_undegraded":"2024-09-12T18:09:31.837441+0000","last_fullsized":"2024-09-12T18:09:31.837441+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:58.027696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6346303,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":552,"num_read_kb":23095,"num_write":1328,"num_write_kb":45480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'356","reported_seq":1089,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:16.618637+0000","last_change":"2024-09-12T17:00:14.332105+0000","last_active":"2024-09-12T18:10:16.618637+0000","last_peered":"2024-09-12T18:10:16.618637+0000","last_clean":"2024-09-12T18:10:16.618637+0000","last_became_active":"2024-09-12T17:00:14.331839+0000","last_became_peered":"2024-09-12T17:00:14.331839+0000","last_unstale":"2024-09-12T18:10:16.618637+0000","last_undegraded":"2024-09-12T18:10:16.618637+0000","last_fullsized":"2024-09-12T18:10:16.618637+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:36.033074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1691,"num_read_kb":1457,"num_write":527,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'347","reported_seq":989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:47.949200+0000","last_change":"2024-09-12T17:00:12.320366+0000","last_active":"2024-09-12T18:09:47.949200+0000","last_peered":"2024-09-12T18:09:47.949200+0000","last_clean":"2024-09-12T18:09:47.949200+0000","last_became_active":"2024-09-12T17:00:12.320094+0000","last_became_peered":"2024-09-12T17:00:12.320094+0000","last_unstale":"2024-09-12T18:09:47.949200+0000","last_undegraded":"2024-09-12T18:09:47.949200+0000","last_fullsized":"2024-09-12T18:09:47.949200+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:12.089633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12780512,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":563,"num_read_kb":22255,"num_write":1147,"num_write_kb":35121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'76","reported_seq":651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:18.486632+0000","last_change":"2024-09-12T17:00:14.335295+0000","last_active":"2024-09-12T18:10:18.486632+0000","last_peered":"2024-09-12T18:10:18.486632+0000","last_clean":"2024-09-12T18:10:18.486632+0000","last_became_active":"2024-09-12T17:00:14.334965+0000","last_became_peered":"2024-09-12T17:00:14.334965+0000","last_unstale":"2024-09-12T18:10:18.486632+0000","last_undegraded":"2024-09-12T18:10:18.486632+0000","last_fullsized":"2024-09-12T18:10:18.486632+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:26.399490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":336,"num_read_kb":283,"num_write":118,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'277","reported_seq":913,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:56.840050+0000","last_change":"2024-09-12T17:00:12.321716+0000","last_active":"2024-09-12T18:09:56.840050+0000","last_peered":"2024-09-12T18:09:56.840050+0000","last_clean":"2024-09-12T18:09:56.840050+0000","last_became_active":"2024-09-12T17:00:12.321156+0000","last_became_peered":"2024-09-12T17:00:12.321156+0000","last_unstale":"2024-09-12T18:09:56.840050+0000","last_undegraded":"2024-09-12T18:09:56.840050+0000","last_fullsized":"2024-09-12T18:09:56.840050+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:46.457048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6484933,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":458,"num_read_kb":18612,"num_write":978,"num_write_kb":25817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'177","reported_seq":795,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:08.697578+0000","last_change":"2024-09-12T17:00:14.323205+0000","last_active":"2024-09-12T18:10:08.697578+0000","last_peered":"2024-09-12T18:10:08.697578+0000","last_clean":"2024-09-12T18:10:08.697578+0000","last_became_active":"2024-09-12T17:00:14.322880+0000","last_became_peered":"2024-09-12T17:00:14.322880+0000","last_unstale":"2024-09-12T18:10:08.697578+0000","last_undegraded":"2024-09-12T18:10:08.697578+0000","last_fullsized":"2024-09-12T18:10:08.697578+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:18.369079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":741,"num_read_kb":611,"num_write":268,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'322","reported_seq":977,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.959939+0000","last_change":"2024-09-12T17:00:12.315023+0000","last_active":"2024-09-12T18:10:22.959939+0000","last_peered":"2024-09-12T18:10:22.959939+0000","last_clean":"2024-09-12T18:10:22.959939+0000","last_became_active":"2024-09-12T17:00:12.314707+0000","last_became_peered":"2024-09-12T17:00:12.314707+0000","last_unstale":"2024-09-12T18:10:22.959939+0000","last_undegraded":"2024-09-12T18:10:22.959939+0000","last_fullsized":"2024-09-12T18:10:22.959939+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:40.531969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6899968,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":496,"num_read_kb":37010,"num_write":1236,"num_write_kb":41769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'170","reported_seq":824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:00.750238+0000","last_change":"2024-09-12T17:00:14.325013+0000","last_active":"2024-09-12T18:10:00.750238+0000","last_peered":"2024-09-12T18:10:00.750238+0000","last_clean":"2024-09-12T18:10:00.750238+0000","last_became_active":"2024-09-12T17:00:14.324709+0000","last_became_peered":"2024-09-12T17:00:14.324709+0000","last_unstale":"2024-09-12T18:10:00.750238+0000","last_undegraded":"2024-09-12T18:10:00.750238+0000","last_fullsized":"2024-09-12T18:10:00.750238+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:55.903766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":785,"num_read_kb":657,"num_write":242,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'240","reported_seq":878,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:56.616357+0000","last_change":"2024-09-12T17:00:12.308878+0000","last_active":"2024-09-12T18:09:56.616357+0000","last_peered":"2024-09-12T18:09:56.616357+0000","last_clean":"2024-09-12T18:09:56.616357+0000","last_became_active":"2024-09-12T17:00:12.307159+0000","last_became_peered":"2024-09-12T17:00:12.307159+0000","last_unstale":"2024-09-12T18:09:56.616357+0000","last_undegraded":"2024-09-12T18:09:56.616357+0000","last_fullsized":"2024-09-12T18:09:56.616357+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:24.309768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2472218,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":372,"num_read_kb":7357,"num_write":892,"num_write_kb":31388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'4088","reported_seq":4668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:02.752498+0000","last_change":"2024-09-12T17:00:14.328088+0000","last_active":"2024-09-12T18:10:02.752498+0000","last_peered":"2024-09-12T18:10:02.752498+0000","last_clean":"2024-09-12T18:10:02.752498+0000","last_became_active":"2024-09-12T17:00:14.327792+0000","last_became_peered":"2024-09-12T17:00:14.327792+0000","last_unstale":"2024-09-12T18:10:02.752498+0000","last_undegraded":"2024-09-12T18:10:02.752498+0000","last_fullsized":"2024-09-12T18:10:02.752498+0000","mapping_epoch":26,"log_start":"264'4000","ondisk_log_start":"264'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:59.961621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16430,"num_read_kb":13786,"num_write":6128,"num_write_kb":3057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'284","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:57.738819+0000","last_change":"2024-09-12T17:00:12.311570+0000","last_active":"2024-09-12T18:09:57.738819+0000","last_peered":"2024-09-12T18:09:57.738819+0000","last_clean":"2024-09-12T18:09:57.738819+0000","last_became_active":"2024-09-12T17:00:12.311273+0000","last_became_peered":"2024-09-12T17:00:12.311273+0000","last_unstale":"2024-09-12T18:09:57.738819+0000","last_undegraded":"2024-09-12T18:09:57.738819+0000","last_fullsized":"2024-09-12T18:09:57.738819+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:26.620649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11038339,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":433,"num_read_kb":37128,"num_write":1024,"num_write_kb":49312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'265","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:01.616891+0000","last_change":"2024-09-12T17:00:14.318745+0000","last_active":"2024-09-12T18:10:01.616891+0000","last_peered":"2024-09-12T18:10:01.616891+0000","last_clean":"2024-09-12T18:10:01.616891+0000","last_became_active":"2024-09-12T17:00:14.318470+0000","last_became_peered":"2024-09-12T17:00:14.318470+0000","last_unstale":"2024-09-12T18:10:01.616891+0000","last_undegraded":"2024-09-12T18:10:01.616891+0000","last_fullsized":"2024-09-12T18:10:01.616891+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:04.138809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1277,"num_read_kb":1058,"num_write":468,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'287","reported_seq":1002,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.754212+0000","last_change":"2024-09-12T17:00:12.314662+0000","last_active":"2024-09-12T18:10:12.754212+0000","last_peered":"2024-09-12T18:10:12.754212+0000","last_clean":"2024-09-12T18:10:12.754212+0000","last_became_active":"2024-09-12T17:00:12.314371+0000","last_became_peered":"2024-09-12T17:00:12.314371+0000","last_unstale":"2024-09-12T18:10:12.754212+0000","last_undegraded":"2024-09-12T18:10:12.754212+0000","last_fullsized":"2024-09-12T18:10:12.754212+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:12.607432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2707189,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":498,"num_read_kb":6257,"num_write":1042,"num_write_kb":25577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'129","reported_seq":702,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:01.840698+0000","last_change":"2024-09-12T17:00:14.339614+0000","last_active":"2024-09-12T18:10:01.840698+0000","last_peered":"2024-09-12T18:10:01.840698+0000","last_clean":"2024-09-12T18:10:01.840698+0000","last_became_active":"2024-09-12T17:00:14.339316+0000","last_became_peered":"2024-09-12T17:00:14.339316+0000","last_unstale":"2024-09-12T18:10:01.840698+0000","last_undegraded":"2024-09-12T18:10:01.840698+0000","last_fullsized":"2024-09-12T18:10:01.840698+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:43.906333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":538,"num_read_kb":439,"num_write":190,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'280","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.566378+0000","last_change":"2024-09-12T17:00:12.310461+0000","last_active":"2024-09-12T18:13:48.566378+0000","last_peered":"2024-09-12T18:13:48.566378+0000","last_clean":"2024-09-12T18:13:48.566378+0000","last_became_active":"2024-09-12T17:00:12.310157+0000","last_became_peered":"2024-09-12T17:00:12.310157+0000","last_unstale":"2024-09-12T18:13:48.566378+0000","last_undegraded":"2024-09-12T18:13:48.566378+0000","last_fullsized":"2024-09-12T18:13:48.566378+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:09.011822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2813958,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":422,"num_read_kb":8306,"num_write":1057,"num_write_kb":29458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'208","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:52.751018+0000","last_change":"2024-09-12T17:00:46.406709+0000","last_active":"2024-09-12T18:09:52.751018+0000","last_peered":"2024-09-12T18:09:52.751018+0000","last_clean":"2024-09-12T18:09:52.751018+0000","last_became_active":"2024-09-12T17:00:46.406426+0000","last_became_peered":"2024-09-12T17:00:46.406426+0000","last_unstale":"2024-09-12T18:09:52.751018+0000","last_undegraded":"2024-09-12T18:09:52.751018+0000","last_fullsized":"2024-09-12T18:09:52.751018+0000","mapping_epoch":37,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:27.163775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":857,"num_read_kb":696,"num_write":294,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'239","reported_seq":846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.953042+0000","last_change":"2024-09-12T17:00:12.314652+0000","last_active":"2024-09-12T18:10:12.953042+0000","last_peered":"2024-09-12T18:10:12.953042+0000","last_clean":"2024-09-12T18:10:12.953042+0000","last_became_active":"2024-09-12T17:00:12.314251+0000","last_became_peered":"2024-09-12T17:00:12.314251+0000","last_unstale":"2024-09-12T18:10:12.953042+0000","last_undegraded":"2024-09-12T18:10:12.953042+0000","last_fullsized":"2024-09-12T18:10:12.953042+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:21.957765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5395730,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":339,"num_read_kb":8717,"num_write":907,"num_write_kb":22240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'257","reported_seq":1061,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.952879+0000","last_change":"2024-09-12T17:00:12.318997+0000","last_active":"2024-09-12T18:10:12.952879+0000","last_peered":"2024-09-12T18:10:12.952879+0000","last_clean":"2024-09-12T18:10:12.952879+0000","last_became_active":"2024-09-12T17:00:12.318408+0000","last_became_peered":"2024-09-12T17:00:12.318408+0000","last_unstale":"2024-09-12T18:10:12.952879+0000","last_undegraded":"2024-09-12T18:10:12.952879+0000","last_fullsized":"2024-09-12T18:10:12.952879+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:22.821486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5248793,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":798,"num_read_kb":6455,"num_write":984,"num_write_kb":20037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'90","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:41.621619+0000","last_change":"2024-09-12T17:00:14.334754+0000","last_active":"2024-09-12T18:10:41.621619+0000","last_peered":"2024-09-12T18:10:41.621619+0000","last_clean":"2024-09-12T18:10:41.621619+0000","last_became_active":"2024-09-12T17:00:14.334494+0000","last_became_peered":"2024-09-12T17:00:14.334494+0000","last_unstale":"2024-09-12T18:10:41.621619+0000","last_undegraded":"2024-09-12T18:10:41.621619+0000","last_fullsized":"2024-09-12T18:10:41.621619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:56.905718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":377,"num_read_kb":312,"num_write":145,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'313","reported_seq":950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.879094+0000","last_change":"2024-09-12T17:00:12.315356+0000","last_active":"2024-09-12T18:13:48.879094+0000","last_peered":"2024-09-12T18:13:48.879094+0000","last_clean":"2024-09-12T18:13:48.879094+0000","last_became_active":"2024-09-12T17:00:12.314988+0000","last_became_peered":"2024-09-12T17:00:12.314988+0000","last_unstale":"2024-09-12T18:13:48.879094+0000","last_undegraded":"2024-09-12T18:13:48.879094+0000","last_fullsized":"2024-09-12T18:13:48.879094+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:34.349627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352348,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":427,"num_read_kb":45801,"num_write":996,"num_write_kb":31559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'220","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954550+0000","last_change":"2024-09-12T17:00:14.333403+0000","last_active":"2024-09-12T18:10:22.954550+0000","last_peered":"2024-09-12T18:10:22.954550+0000","last_clean":"2024-09-12T18:10:22.954550+0000","last_became_active":"2024-09-12T17:00:14.333107+0000","last_became_peered":"2024-09-12T17:00:14.333107+0000","last_unstale":"2024-09-12T18:10:22.954550+0000","last_undegraded":"2024-09-12T18:10:22.954550+0000","last_fullsized":"2024-09-12T18:10:22.954550+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:26.316619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":970,"num_read_kb":803,"num_write":364,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5638,"num_read_kb":3956,"num_write":1906,"num_write_kb":804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1077,"ondisk_log_size":1077,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":16256,"num_read_kb":15929,"num_write":16738,"num_write_kb":4889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1664,"ondisk_log_size":1664,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":530,"ondisk_log_size":530,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1864610,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":18668,"num_read_kb":36144,"num_write":15719,"num_write_kb":11922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2965504,"data_stored":2482896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2053,"ondisk_log_size":2053,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2425,"num_read_kb":2890,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102836,"num_read_kb":85763,"num_write":37242,"num_write_kb":18813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3654,"ondisk_log_size":3654,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":457793760,"num_objects":4182,"num_object_clones":0,"num_object_copies":8364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4182,"num_whiteouts":0,"num_read":32389,"num_read_kb":1844161,"num_write":67660,"num_write_kb":1970689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":955830272,"data_stored":925329253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4185,"ondisk_log_size":4185,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":52066681,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":133,"num_read_kb":154912,"num_write":159,"num_write_kb":116389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98902016,"data_stored":98890482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":58307678,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":133,"num_read_kb":158387,"num_write":159,"num_write_kb":116389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":117719040,"data_stored":117711178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424510333,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":155752,"kb_used_data":106520,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94216088,"statfs":{"total":96636764160,"available":96477274112,"internally_reserved":0,"allocated":109076480,"data_stored":105026341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510336,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":241088,"kb_used_data":133616,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94130752,"statfs":{"total":96636764160,"available":96389890048,"internally_reserved":0,"allocated":136822784,"data_stored":132283647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543035,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":408228,"kb_used_data":170196,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":93963612,"statfs":{"total":96636764160,"available":96218738688,"internally_reserved":0,"allocated":174280704,"data_stored":168243840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":243726794},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543037,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":353796,"kb_used_data":133812,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94018044,"statfs":{"total":96636764160,"available":96274477056,"internally_reserved":0,"allocated":137023488,"data_stored":132465467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225245638},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543037,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":264308,"kb_used_data":165156,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94107532,"statfs":{"total":96636764160,"available":96366112768,"internally_reserved":0,"allocated":169119744,"data_stored":162881901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543037,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":462228,"kb_used_data":206148,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":93909612,"statfs":{"total":96636764160,"available":96163442688,"internally_reserved":0,"allocated":211095552,"data_stored":204497890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262207943},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543035,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":358224,"kb_used_data":150720,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94013616,"statfs":{"total":96636764160,"available":96269942784,"internally_reserved":0,"allocated":154337280,"data_stored":147909516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":212466117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575738,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":251808,"kb_used_data":194256,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94120032,"statfs":{"total":96636764160,"available":96378912768,"internally_reserved":0,"allocated":198918144,"data_stored":192285280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":120287232,"data_stored":115422877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":52461568,"data_stored":50989354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65630208,"data_stored":63760671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":162619392,"data_stored":157595782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":177336320,"data_stored":172183802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":130138112,"data_stored":125504544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":119406592,"data_stored":116366388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":127950848,"data_stored":123505835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":336341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":127094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":95998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":569344,"data_stored":486137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":77711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":679936,"data_stored":574850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":266159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":518606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":4704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21024768,"data_stored":21021979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12632064,"data_stored":12631334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18415616,"data_stored":18413368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7389184,"data_stored":7388454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":23654400,"data_stored":23653035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17362944,"data_stored":17361579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25858048,"data_stored":25852281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":14733312,"data_stored":14730523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4247552,"data_stored":4245939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:13:51.631 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:13:51.966 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:13:51.978 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-12T18:13:51.980 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":2477,"stamp":"2024-09-12T18:13:50.630404+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":570641228,"num_objects":4560,"num_object_clones":0,"num_object_copies":9120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4560,"num_whiteouts":0,"num_read":178556,"num_read_kb":2302209,"num_write":139726,"num_write_kb":2241551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13454,"ondisk_log_size":13454,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2495432,"kb_used_data":1260424,"kb_used_omap":12,"kb_used_meta":1234867,"kb_avail":752479288,"statfs":{"total":773094113280,"available":770538790912,"internally_reserved":0,"allocated":1290674176,"data_stored":1245593882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1264504368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-44087978,"num_objects":-294,"num_object_clones":0,"num_object_copies":-588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-294,"num_whiteouts":0,"num_read":345,"num_read_kb":436,"num_write":318,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005590"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:07.943317+0000","last_change":"2024-09-12T17:39:05.922525+0000","last_active":"2024-09-12T18:09:07.943317+0000","last_peered":"2024-09-12T18:09:07.943317+0000","last_clean":"2024-09-12T18:09:07.943317+0000","last_became_active":"2024-09-12T17:39:05.922265+0000","last_became_peered":"2024-09-12T17:39:05.922265+0000","last_unstale":"2024-09-12T18:09:07.943317+0000","last_undegraded":"2024-09-12T18:09:07.943317+0000","last_fullsized":"2024-09-12T18:09:07.943317+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:50.266071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'7","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.956905+0000","last_change":"2024-09-12T17:20:34.559305+0000","last_active":"2024-09-12T18:10:37.956905+0000","last_peered":"2024-09-12T18:10:37.956905+0000","last_clean":"2024-09-12T18:10:37.956905+0000","last_became_active":"2024-09-12T17:20:34.559027+0000","last_became_peered":"2024-09-12T17:20:34.559027+0000","last_unstale":"2024-09-12T18:10:37.956905+0000","last_undegraded":"2024-09-12T18:10:37.956905+0000","last_fullsized":"2024-09-12T18:10:37.956905+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:57.688429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"261'5","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844168+0000","last_change":"2024-09-12T17:20:30.533512+0000","last_active":"2024-09-12T18:10:31.844168+0000","last_peered":"2024-09-12T18:10:31.844168+0000","last_clean":"2024-09-12T18:10:31.844168+0000","last_became_active":"2024-09-12T17:20:30.533235+0000","last_became_peered":"2024-09-12T17:20:30.533235+0000","last_unstale":"2024-09-12T18:10:31.844168+0000","last_undegraded":"2024-09-12T18:10:31.844168+0000","last_fullsized":"2024-09-12T18:10:31.844168+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:11.739116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4098,"num_write":10,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'40","reported_seq":175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619269+0000","last_change":"2024-09-12T17:16:11.492013+0000","last_active":"2024-09-12T18:10:21.619269+0000","last_peered":"2024-09-12T18:10:21.619269+0000","last_clean":"2024-09-12T18:10:21.619269+0000","last_became_active":"2024-09-12T17:16:11.491724+0000","last_became_peered":"2024-09-12T17:16:11.491724+0000","last_unstale":"2024-09-12T18:10:21.619269+0000","last_undegraded":"2024-09-12T18:10:21.619269+0000","last_fullsized":"2024-09-12T18:10:21.619269+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:52.666913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":153,"num_write":69,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:08.691783+0000","last_change":"2024-09-12T17:39:05.929786+0000","last_active":"2024-09-12T18:09:08.691783+0000","last_peered":"2024-09-12T18:09:08.691783+0000","last_clean":"2024-09-12T18:09:08.691783+0000","last_became_active":"2024-09-12T17:39:05.929533+0000","last_became_peered":"2024-09-12T17:39:05.929533+0000","last_unstale":"2024-09-12T18:09:08.691783+0000","last_undegraded":"2024-09-12T18:09:08.691783+0000","last_fullsized":"2024-09-12T18:09:08.691783+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:13.745522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"261'8","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:35.755523+0000","last_change":"2024-09-12T17:20:34.559278+0000","last_active":"2024-09-12T18:10:35.755523+0000","last_peered":"2024-09-12T18:10:35.755523+0000","last_clean":"2024-09-12T18:10:35.755523+0000","last_became_active":"2024-09-12T17:20:34.558970+0000","last_became_peered":"2024-09-12T17:20:34.558970+0000","last_unstale":"2024-09-12T18:10:35.755523+0000","last_undegraded":"2024-09-12T18:10:35.755523+0000","last_fullsized":"2024-09-12T18:10:35.755523+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:15.197078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8194,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.601484+0000","last_change":"2024-09-12T17:20:30.539641+0000","last_active":"2024-09-12T18:13:48.601484+0000","last_peered":"2024-09-12T18:13:48.601484+0000","last_clean":"2024-09-12T18:13:48.601484+0000","last_became_active":"2024-09-12T17:20:30.539358+0000","last_became_peered":"2024-09-12T17:20:30.539358+0000","last_unstale":"2024-09-12T18:13:48.601484+0000","last_undegraded":"2024-09-12T18:13:48.601484+0000","last_fullsized":"2024-09-12T18:13:48.601484+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:09.857477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8242,"num_write":10,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'68","reported_seq":250,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:23.699050+0000","last_change":"2024-09-12T17:16:11.491901+0000","last_active":"2024-09-12T18:10:23.699050+0000","last_peered":"2024-09-12T18:10:23.699050+0000","last_clean":"2024-09-12T18:10:23.699050+0000","last_became_active":"2024-09-12T17:16:11.491610+0000","last_became_peered":"2024-09-12T17:16:11.491610+0000","last_unstale":"2024-09-12T18:10:23.699050+0000","last_undegraded":"2024-09-12T18:10:23.699050+0000","last_fullsized":"2024-09-12T18:10:23.699050+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:14.980006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":357,"num_read_kb":265,"num_write":116,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.743901+0000","last_change":"2024-09-12T17:39:05.922376+0000","last_active":"2024-09-12T18:10:32.743901+0000","last_peered":"2024-09-12T18:10:32.743901+0000","last_clean":"2024-09-12T18:10:32.743901+0000","last_became_active":"2024-09-12T17:39:05.921846+0000","last_became_peered":"2024-09-12T17:39:05.921846+0000","last_unstale":"2024-09-12T18:10:32.743901+0000","last_undegraded":"2024-09-12T18:10:32.743901+0000","last_fullsized":"2024-09-12T18:10:32.743901+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:48.115093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"261'8","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.621019+0000","last_change":"2024-09-12T17:20:34.615861+0000","last_active":"2024-09-12T18:10:36.621019+0000","last_peered":"2024-09-12T18:10:36.621019+0000","last_clean":"2024-09-12T18:10:36.621019+0000","last_became_active":"2024-09-12T17:20:34.615550+0000","last_became_peered":"2024-09-12T17:20:34.615550+0000","last_unstale":"2024-09-12T18:10:36.621019+0000","last_undegraded":"2024-09-12T18:10:36.621019+0000","last_fullsized":"2024-09-12T18:10:36.621019+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:16.087575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":6148,"num_write":8,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'8","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:43.700956+0000","last_change":"2024-09-12T17:20:30.535465+0000","last_active":"2024-09-12T18:10:43.700956+0000","last_peered":"2024-09-12T18:10:43.700956+0000","last_clean":"2024-09-12T18:10:43.700956+0000","last_became_active":"2024-09-12T17:20:30.535182+0000","last_became_peered":"2024-09-12T17:20:30.535182+0000","last_unstale":"2024-09-12T18:10:43.700956+0000","last_undegraded":"2024-09-12T18:10:43.700956+0000","last_fullsized":"2024-09-12T18:10:43.700956+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:33.062178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":13,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'51","reported_seq":202,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.624811+0000","last_change":"2024-09-12T17:16:11.493397+0000","last_active":"2024-09-12T18:11:11.624811+0000","last_peered":"2024-09-12T18:11:11.624811+0000","last_clean":"2024-09-12T18:11:11.624811+0000","last_became_active":"2024-09-12T17:16:11.493043+0000","last_became_peered":"2024-09-12T17:16:11.493043+0000","last_unstale":"2024-09-12T18:11:11.624811+0000","last_undegraded":"2024-09-12T18:11:11.624811+0000","last_fullsized":"2024-09-12T18:11:11.624811+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:13.681249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":193,"num_write":93,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.844692+0000","last_change":"2024-09-12T17:39:05.931399+0000","last_active":"2024-09-12T18:10:36.844692+0000","last_peered":"2024-09-12T18:10:36.844692+0000","last_clean":"2024-09-12T18:10:36.844692+0000","last_became_active":"2024-09-12T17:39:05.931122+0000","last_became_peered":"2024-09-12T17:39:05.931122+0000","last_unstale":"2024-09-12T18:10:36.844692+0000","last_undegraded":"2024-09-12T18:10:36.844692+0000","last_fullsized":"2024-09-12T18:10:36.844692+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:02.508518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'5","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:46.845829+0000","last_change":"2024-09-12T17:20:34.613048+0000","last_active":"2024-09-12T18:10:46.845829+0000","last_peered":"2024-09-12T18:10:46.845829+0000","last_clean":"2024-09-12T18:10:46.845829+0000","last_became_active":"2024-09-12T17:20:34.612720+0000","last_became_peered":"2024-09-12T17:20:34.612720+0000","last_unstale":"2024-09-12T18:10:46.845829+0000","last_undegraded":"2024-09-12T18:10:46.845829+0000","last_fullsized":"2024-09-12T18:10:46.845829+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:30.901799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":14336,"num_write":10,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'7","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:30.754899+0000","last_change":"2024-09-12T17:20:30.534475+0000","last_active":"2024-09-12T18:10:30.754899+0000","last_peered":"2024-09-12T18:10:30.754899+0000","last_clean":"2024-09-12T18:10:30.754899+0000","last_became_active":"2024-09-12T17:20:30.534068+0000","last_became_peered":"2024-09-12T17:20:30.534068+0000","last_unstale":"2024-09-12T18:10:30.754899+0000","last_undegraded":"2024-09-12T18:10:30.754899+0000","last_fullsized":"2024-09-12T18:10:30.754899+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:16.971800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":5122,"num_write":17,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'25","reported_seq":124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.848415+0000","last_change":"2024-09-12T17:16:11.490345+0000","last_active":"2024-09-12T18:11:11.848415+0000","last_peered":"2024-09-12T18:11:11.848415+0000","last_clean":"2024-09-12T18:11:11.848415+0000","last_became_active":"2024-09-12T17:16:11.489860+0000","last_became_peered":"2024-09-12T17:16:11.489860+0000","last_unstale":"2024-09-12T18:11:11.848415+0000","last_undegraded":"2024-09-12T18:11:11.848415+0000","last_fullsized":"2024-09-12T18:11:11.848415+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:28:30.353456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.848437+0000","last_change":"2024-09-12T17:39:05.931395+0000","last_active":"2024-09-12T18:11:11.848437+0000","last_peered":"2024-09-12T18:11:11.848437+0000","last_clean":"2024-09-12T18:11:11.848437+0000","last_became_active":"2024-09-12T17:39:05.931089+0000","last_became_peered":"2024-09-12T17:39:05.931089+0000","last_unstale":"2024-09-12T18:11:11.848437+0000","last_undegraded":"2024-09-12T18:11:11.848437+0000","last_fullsized":"2024-09-12T18:11:11.848437+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:40.976622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"264'1","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:07.943295+0000","last_change":"2024-09-12T17:20:34.557572+0000","last_active":"2024-09-12T18:09:07.943295+0000","last_peered":"2024-09-12T18:09:07.943295+0000","last_clean":"2024-09-12T18:09:07.943295+0000","last_became_active":"2024-09-12T17:20:34.557008+0000","last_became_peered":"2024-09-12T17:20:34.557008+0000","last_unstale":"2024-09-12T18:09:07.943295+0000","last_undegraded":"2024-09-12T18:09:07.943295+0000","last_fullsized":"2024-09-12T18:09:07.943295+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:29.589642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'7","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:16.625332+0000","last_change":"2024-09-12T17:20:30.538674+0000","last_active":"2024-09-12T18:11:16.625332+0000","last_peered":"2024-09-12T18:11:16.625332+0000","last_clean":"2024-09-12T18:11:16.625332+0000","last_became_active":"2024-09-12T17:20:30.538361+0000","last_became_peered":"2024-09-12T17:20:30.538361+0000","last_unstale":"2024-09-12T18:11:16.625332+0000","last_undegraded":"2024-09-12T18:11:16.625332+0000","last_fullsized":"2024-09-12T18:11:16.625332+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:34.525214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4098,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'48","reported_seq":182,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.848386+0000","last_change":"2024-09-12T17:16:11.488078+0000","last_active":"2024-09-12T18:11:11.848386+0000","last_peered":"2024-09-12T18:11:11.848386+0000","last_clean":"2024-09-12T18:11:11.848386+0000","last_became_active":"2024-09-12T17:16:11.487771+0000","last_became_peered":"2024-09-12T17:16:11.487771+0000","last_unstale":"2024-09-12T18:11:11.848386+0000","last_undegraded":"2024-09-12T18:11:11.848386+0000","last_fullsized":"2024-09-12T18:11:11.848386+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:38.032910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":161,"num_write":84,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:23.917612+0000","last_change":"2024-09-12T17:39:05.921998+0000","last_active":"2024-09-12T18:10:23.917612+0000","last_peered":"2024-09-12T18:10:23.917612+0000","last_clean":"2024-09-12T18:10:23.917612+0000","last_became_active":"2024-09-12T17:39:05.921661+0000","last_became_peered":"2024-09-12T17:39:05.921661+0000","last_unstale":"2024-09-12T18:10:23.917612+0000","last_undegraded":"2024-09-12T18:10:23.917612+0000","last_fullsized":"2024-09-12T18:10:23.917612+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:09.613996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:22.751338+0000","last_change":"2024-09-12T17:20:34.555394+0000","last_active":"2024-09-12T18:11:22.751338+0000","last_peered":"2024-09-12T18:11:22.751338+0000","last_clean":"2024-09-12T18:11:22.751338+0000","last_became_active":"2024-09-12T17:20:34.555047+0000","last_became_peered":"2024-09-12T17:20:34.555047+0000","last_unstale":"2024-09-12T18:11:22.751338+0000","last_undegraded":"2024-09-12T18:11:22.751338+0000","last_fullsized":"2024-09-12T18:11:22.751338+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:29.139249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'2","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.742462+0000","last_change":"2024-09-12T17:20:30.528356+0000","last_active":"2024-09-12T18:09:05.742462+0000","last_peered":"2024-09-12T18:09:05.742462+0000","last_clean":"2024-09-12T18:09:05.742462+0000","last_became_active":"2024-09-12T17:20:30.528029+0000","last_became_peered":"2024-09-12T17:20:30.528029+0000","last_unstale":"2024-09-12T18:09:05.742462+0000","last_undegraded":"2024-09-12T18:09:05.742462+0000","last_fullsized":"2024-09-12T18:09:05.742462+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:17.569528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'34","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:12.750037+0000","last_change":"2024-09-12T17:16:11.491282+0000","last_active":"2024-09-12T18:11:12.750037+0000","last_peered":"2024-09-12T18:11:12.750037+0000","last_clean":"2024-09-12T18:11:12.750037+0000","last_became_active":"2024-09-12T17:16:11.490952+0000","last_became_peered":"2024-09-12T17:16:11.490952+0000","last_unstale":"2024-09-12T18:11:12.750037+0000","last_undegraded":"2024-09-12T18:11:12.750037+0000","last_fullsized":"2024-09-12T18:11:12.750037+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:58.052602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":115,"num_write":60,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:07.744407+0000","last_change":"2024-09-12T17:39:05.929242+0000","last_active":"2024-09-12T18:09:07.744407+0000","last_peered":"2024-09-12T18:09:07.744407+0000","last_clean":"2024-09-12T18:09:07.744407+0000","last_became_active":"2024-09-12T17:39:05.928959+0000","last_became_peered":"2024-09-12T17:39:05.928959+0000","last_unstale":"2024-09-12T18:09:07.744407+0000","last_undegraded":"2024-09-12T18:09:07.744407+0000","last_fullsized":"2024-09-12T18:09:07.744407+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:49.943631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.744728+0000","last_change":"2024-09-12T17:20:34.552499+0000","last_active":"2024-09-12T18:10:37.744728+0000","last_peered":"2024-09-12T18:10:37.744728+0000","last_clean":"2024-09-12T18:10:37.744728+0000","last_became_active":"2024-09-12T17:20:34.552180+0000","last_became_peered":"2024-09-12T17:20:34.552180+0000","last_unstale":"2024-09-12T18:10:37.744728+0000","last_undegraded":"2024-09-12T18:10:37.744728+0000","last_fullsized":"2024-09-12T18:10:37.744728+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:03.689040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:30.754825+0000","last_change":"2024-09-12T17:20:30.535560+0000","last_active":"2024-09-12T18:10:30.754825+0000","last_peered":"2024-09-12T18:10:30.754825+0000","last_clean":"2024-09-12T18:10:30.754825+0000","last_became_active":"2024-09-12T17:20:30.535001+0000","last_became_peered":"2024-09-12T17:20:30.535001+0000","last_unstale":"2024-09-12T18:10:30.754825+0000","last_undegraded":"2024-09-12T18:10:30.754825+0000","last_fullsized":"2024-09-12T18:10:30.754825+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:47.724576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'14","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:36.614251+0000","last_change":"2024-09-12T17:16:11.480542+0000","last_active":"2024-09-12T18:09:36.614251+0000","last_peered":"2024-09-12T18:09:36.614251+0000","last_clean":"2024-09-12T18:09:36.614251+0000","last_became_active":"2024-09-12T17:16:11.477940+0000","last_became_peered":"2024-09-12T17:16:11.477940+0000","last_unstale":"2024-09-12T18:09:36.614251+0000","last_undegraded":"2024-09-12T18:09:36.614251+0000","last_fullsized":"2024-09-12T18:09:36.614251+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:48.061800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":35,"num_write":34,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:07.744444+0000","last_change":"2024-09-12T17:39:05.930937+0000","last_active":"2024-09-12T18:09:07.744444+0000","last_peered":"2024-09-12T18:09:07.744444+0000","last_clean":"2024-09-12T18:09:07.744444+0000","last_became_active":"2024-09-12T17:39:05.930694+0000","last_became_peered":"2024-09-12T17:39:05.930694+0000","last_unstale":"2024-09-12T18:09:07.744444+0000","last_undegraded":"2024-09-12T18:09:07.744444+0000","last_fullsized":"2024-09-12T18:09:07.744444+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:15.777013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"261'4","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.844714+0000","last_change":"2024-09-12T17:20:34.553025+0000","last_active":"2024-09-12T18:10:36.844714+0000","last_peered":"2024-09-12T18:10:36.844714+0000","last_clean":"2024-09-12T18:10:36.844714+0000","last_became_active":"2024-09-12T17:20:34.552726+0000","last_became_peered":"2024-09-12T17:20:34.552726+0000","last_unstale":"2024-09-12T18:10:36.844714+0000","last_undegraded":"2024-09-12T18:10:36.844714+0000","last_fullsized":"2024-09-12T18:10:36.844714+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:22.335524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'2","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.620340+0000","last_change":"2024-09-12T17:20:30.539217+0000","last_active":"2024-09-12T18:10:31.620340+0000","last_peered":"2024-09-12T18:10:31.620340+0000","last_clean":"2024-09-12T18:10:31.620340+0000","last_became_active":"2024-09-12T17:20:30.538942+0000","last_became_peered":"2024-09-12T17:20:30.538942+0000","last_unstale":"2024-09-12T18:10:31.620340+0000","last_undegraded":"2024-09-12T18:10:31.620340+0000","last_fullsized":"2024-09-12T18:10:31.620340+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:53.625617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'32","reported_seq":144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:23.910689+0000","last_change":"2024-09-12T17:16:11.488019+0000","last_active":"2024-09-12T18:09:23.910689+0000","last_peered":"2024-09-12T18:09:23.910689+0000","last_clean":"2024-09-12T18:09:23.910689+0000","last_became_active":"2024-09-12T17:16:11.487242+0000","last_became_peered":"2024-09-12T17:16:11.487242+0000","last_unstale":"2024-09-12T18:09:23.910689+0000","last_undegraded":"2024-09-12T18:09:23.910689+0000","last_fullsized":"2024-09-12T18:09:23.910689+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:20.980571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":114,"num_write":62,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:28.911251+0000","last_change":"2024-09-12T17:39:05.927350+0000","last_active":"2024-09-12T18:09:28.911251+0000","last_peered":"2024-09-12T18:09:28.911251+0000","last_clean":"2024-09-12T18:09:28.911251+0000","last_became_active":"2024-09-12T17:39:05.924899+0000","last_became_peered":"2024-09-12T17:39:05.924899+0000","last_unstale":"2024-09-12T18:09:28.911251+0000","last_undegraded":"2024-09-12T18:09:28.911251+0000","last_fullsized":"2024-09-12T18:09:28.911251+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:09.168419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'3","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:21.849703+0000","last_change":"2024-09-12T17:20:34.610704+0000","last_active":"2024-09-12T18:11:21.849703+0000","last_peered":"2024-09-12T18:11:21.849703+0000","last_clean":"2024-09-12T18:11:21.849703+0000","last_became_active":"2024-09-12T17:20:34.610374+0000","last_became_peered":"2024-09-12T17:20:34.610374+0000","last_unstale":"2024-09-12T18:11:21.849703+0000","last_undegraded":"2024-09-12T18:11:21.849703+0000","last_fullsized":"2024-09-12T18:11:21.849703+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:34.456941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1632939,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":1142,"num_write":8,"num_write_kb":1595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"264'2","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:42.948454+0000","last_change":"2024-09-12T17:20:30.526974+0000","last_active":"2024-09-12T18:09:42.948454+0000","last_peered":"2024-09-12T18:09:42.948454+0000","last_clean":"2024-09-12T18:09:42.948454+0000","last_became_active":"2024-09-12T17:20:30.526672+0000","last_became_peered":"2024-09-12T17:20:30.526672+0000","last_unstale":"2024-09-12T18:09:42.948454+0000","last_undegraded":"2024-09-12T18:09:42.948454+0000","last_fullsized":"2024-09-12T18:09:42.948454+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:59.866468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'19","reported_seq":109,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:21.612655+0000","last_change":"2024-09-12T17:16:11.481645+0000","last_active":"2024-09-12T18:09:21.612655+0000","last_peered":"2024-09-12T18:09:21.612655+0000","last_clean":"2024-09-12T18:09:21.612655+0000","last_became_active":"2024-09-12T17:16:11.481351+0000","last_became_peered":"2024-09-12T17:16:11.481351+0000","last_unstale":"2024-09-12T18:09:21.612655+0000","last_undegraded":"2024-09-12T18:09:21.612655+0000","last_fullsized":"2024-09-12T18:09:21.612655+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:59.636662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":68,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:28.693677+0000","last_change":"2024-09-12T17:39:05.928807+0000","last_active":"2024-09-12T18:09:28.693677+0000","last_peered":"2024-09-12T18:09:28.693677+0000","last_clean":"2024-09-12T18:09:28.693677+0000","last_became_active":"2024-09-12T17:39:05.928497+0000","last_became_peered":"2024-09-12T17:39:05.928497+0000","last_unstale":"2024-09-12T18:09:28.693677+0000","last_undegraded":"2024-09-12T18:09:28.693677+0000","last_fullsized":"2024-09-12T18:09:28.693677+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:21.617561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'1","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:46.838997+0000","last_change":"2024-09-12T17:20:34.610626+0000","last_active":"2024-09-12T18:09:46.838997+0000","last_peered":"2024-09-12T18:09:46.838997+0000","last_clean":"2024-09-12T18:09:46.838997+0000","last_became_active":"2024-09-12T17:20:34.610260+0000","last_became_peered":"2024-09-12T17:20:34.610260+0000","last_unstale":"2024-09-12T18:09:46.838997+0000","last_undegraded":"2024-09-12T18:09:46.838997+0000","last_fullsized":"2024-09-12T18:09:46.838997+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:16.730940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'12","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:17.764735+0000","last_change":"2024-09-12T17:20:30.527312+0000","last_active":"2024-09-12T18:11:17.764735+0000","last_peered":"2024-09-12T18:11:17.764735+0000","last_clean":"2024-09-12T18:11:17.764735+0000","last_became_active":"2024-09-12T17:20:30.527032+0000","last_became_peered":"2024-09-12T17:20:30.527032+0000","last_unstale":"2024-09-12T18:11:17.764735+0000","last_undegraded":"2024-09-12T18:11:17.764735+0000","last_fullsized":"2024-09-12T18:11:17.764735+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:12.370876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":13314,"num_write":22,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"0'0","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:21.836307+0000","last_change":"2024-09-12T17:16:11.494751+0000","last_active":"2024-09-12T18:09:21.836307+0000","last_peered":"2024-09-12T18:09:21.836307+0000","last_clean":"2024-09-12T18:09:21.836307+0000","last_became_active":"2024-09-12T17:16:11.494493+0000","last_became_peered":"2024-09-12T17:16:11.494493+0000","last_unstale":"2024-09-12T18:09:21.836307+0000","last_undegraded":"2024-09-12T18:09:21.836307+0000","last_fullsized":"2024-09-12T18:09:21.836307+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:52.903537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:27.747165+0000","last_change":"2024-09-12T17:39:05.926661+0000","last_active":"2024-09-12T18:09:27.747165+0000","last_peered":"2024-09-12T18:09:27.747165+0000","last_clean":"2024-09-12T18:09:27.747165+0000","last_became_active":"2024-09-12T17:39:05.926388+0000","last_became_peered":"2024-09-12T17:39:05.926388+0000","last_unstale":"2024-09-12T18:09:27.747165+0000","last_undegraded":"2024-09-12T18:09:27.747165+0000","last_fullsized":"2024-09-12T18:09:27.747165+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:08.792424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"261'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:21.849742+0000","last_change":"2024-09-12T17:20:34.615918+0000","last_active":"2024-09-12T18:11:21.849742+0000","last_peered":"2024-09-12T18:11:21.849742+0000","last_clean":"2024-09-12T18:11:21.849742+0000","last_became_active":"2024-09-12T17:20:34.615468+0000","last_became_peered":"2024-09-12T17:20:34.615468+0000","last_unstale":"2024-09-12T18:11:21.849742+0000","last_undegraded":"2024-09-12T18:11:21.849742+0000","last_fullsized":"2024-09-12T18:11:21.849742+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:26.561082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:18.704540+0000","last_change":"2024-09-12T17:20:30.533763+0000","last_active":"2024-09-12T18:11:18.704540+0000","last_peered":"2024-09-12T18:11:18.704540+0000","last_clean":"2024-09-12T18:11:18.704540+0000","last_became_active":"2024-09-12T17:20:30.533436+0000","last_became_peered":"2024-09-12T17:20:30.533436+0000","last_unstale":"2024-09-12T18:11:18.704540+0000","last_undegraded":"2024-09-12T18:11:18.704540+0000","last_fullsized":"2024-09-12T18:11:18.704540+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:28.574849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'18","reported_seq":106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:23.693173+0000","last_change":"2024-09-12T17:16:11.489669+0000","last_active":"2024-09-12T18:09:23.693173+0000","last_peered":"2024-09-12T18:09:23.693173+0000","last_clean":"2024-09-12T18:09:23.693173+0000","last_became_active":"2024-09-12T17:16:11.488588+0000","last_became_peered":"2024-09-12T17:16:11.488588+0000","last_unstale":"2024-09-12T18:09:23.693173+0000","last_undegraded":"2024-09-12T18:09:23.693173+0000","last_fullsized":"2024-09-12T18:09:23.693173+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:28.499624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:27.946007+0000","last_change":"2024-09-12T17:39:05.923338+0000","last_active":"2024-09-12T18:09:27.946007+0000","last_peered":"2024-09-12T18:09:27.946007+0000","last_clean":"2024-09-12T18:09:27.946007+0000","last_became_active":"2024-09-12T17:39:05.922973+0000","last_became_peered":"2024-09-12T17:39:05.922973+0000","last_unstale":"2024-09-12T18:09:27.946007+0000","last_undegraded":"2024-09-12T18:09:27.946007+0000","last_fullsized":"2024-09-12T18:09:27.946007+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:17.786298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:20.762674+0000","last_change":"2024-09-12T17:20:34.555891+0000","last_active":"2024-09-12T18:11:20.762674+0000","last_peered":"2024-09-12T18:11:20.762674+0000","last_clean":"2024-09-12T18:11:20.762674+0000","last_became_active":"2024-09-12T17:20:34.554893+0000","last_became_peered":"2024-09-12T17:20:34.554893+0000","last_unstale":"2024-09-12T18:11:20.762674+0000","last_undegraded":"2024-09-12T18:11:20.762674+0000","last_fullsized":"2024-09-12T18:11:20.762674+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:56.253377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'5","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:16.625434+0000","last_change":"2024-09-12T17:20:30.536540+0000","last_active":"2024-09-12T18:11:16.625434+0000","last_peered":"2024-09-12T18:11:16.625434+0000","last_clean":"2024-09-12T18:11:16.625434+0000","last_became_active":"2024-09-12T17:20:30.535226+0000","last_became_peered":"2024-09-12T17:20:30.535226+0000","last_unstale":"2024-09-12T18:11:16.625434+0000","last_undegraded":"2024-09-12T18:11:16.625434+0000","last_fullsized":"2024-09-12T18:11:16.625434+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:28:25.047253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":4098,"num_write":5,"num_write_kb":3074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'26","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:02.752551+0000","last_change":"2024-09-12T17:16:11.491564+0000","last_active":"2024-09-12T18:10:02.752551+0000","last_peered":"2024-09-12T18:10:02.752551+0000","last_clean":"2024-09-12T18:10:02.752551+0000","last_became_active":"2024-09-12T17:16:11.491240+0000","last_became_peered":"2024-09-12T17:16:11.491240+0000","last_unstale":"2024-09-12T18:10:02.752551+0000","last_undegraded":"2024-09-12T18:10:02.752551+0000","last_fullsized":"2024-09-12T18:10:02.752551+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:43.068567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":97,"num_write":43,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844211+0000","last_change":"2024-09-12T17:39:05.932135+0000","last_active":"2024-09-12T18:10:31.844211+0000","last_peered":"2024-09-12T18:10:31.844211+0000","last_clean":"2024-09-12T18:10:31.844211+0000","last_became_active":"2024-09-12T17:39:05.931841+0000","last_became_peered":"2024-09-12T17:39:05.931841+0000","last_unstale":"2024-09-12T18:10:31.844211+0000","last_undegraded":"2024-09-12T18:10:31.844211+0000","last_fullsized":"2024-09-12T18:10:31.844211+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:08.525616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:33.911887+0000","last_change":"2024-09-12T17:20:34.560852+0000","last_active":"2024-09-12T18:09:33.911887+0000","last_peered":"2024-09-12T18:09:33.911887+0000","last_clean":"2024-09-12T18:09:33.911887+0000","last_became_active":"2024-09-12T17:20:34.560497+0000","last_became_peered":"2024-09-12T17:20:34.560497+0000","last_unstale":"2024-09-12T18:09:33.911887+0000","last_undegraded":"2024-09-12T18:09:33.911887+0000","last_fullsized":"2024-09-12T18:09:33.911887+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:07.183237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"261'7","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:30.746005+0000","last_change":"2024-09-12T17:20:30.535717+0000","last_active":"2024-09-12T18:09:30.746005+0000","last_peered":"2024-09-12T18:09:30.746005+0000","last_clean":"2024-09-12T18:09:30.746005+0000","last_became_active":"2024-09-12T17:20:30.535358+0000","last_became_peered":"2024-09-12T17:20:30.535358+0000","last_unstale":"2024-09-12T18:09:30.746005+0000","last_undegraded":"2024-09-12T18:09:30.746005+0000","last_fullsized":"2024-09-12T18:09:30.746005+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:14.210209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":15362,"num_write":12,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'12","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:52.751072+0000","last_change":"2024-09-12T17:16:11.490206+0000","last_active":"2024-09-12T18:09:52.751072+0000","last_peered":"2024-09-12T18:09:52.751072+0000","last_clean":"2024-09-12T18:09:52.751072+0000","last_became_active":"2024-09-12T17:16:11.489897+0000","last_became_peered":"2024-09-12T17:16:11.489897+0000","last_unstale":"2024-09-12T18:09:52.751072+0000","last_undegraded":"2024-09-12T18:09:52.751072+0000","last_fullsized":"2024-09-12T18:09:52.751072+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:03.772651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.620396+0000","last_change":"2024-09-12T17:39:05.927618+0000","last_active":"2024-09-12T18:10:31.620396+0000","last_peered":"2024-09-12T18:10:31.620396+0000","last_clean":"2024-09-12T18:10:31.620396+0000","last_became_active":"2024-09-12T17:39:05.926766+0000","last_became_peered":"2024-09-12T17:39:05.926766+0000","last_unstale":"2024-09-12T18:10:31.620396+0000","last_undegraded":"2024-09-12T18:10:31.620396+0000","last_fullsized":"2024-09-12T18:10:31.620396+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:41.020632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"264'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.926650+0000","last_change":"2024-09-12T17:20:34.559252+0000","last_active":"2024-09-12T18:11:53.926650+0000","last_peered":"2024-09-12T18:11:53.926650+0000","last_clean":"2024-09-12T18:11:53.926650+0000","last_became_active":"2024-09-12T17:20:34.558970+0000","last_became_peered":"2024-09-12T17:20:34.558970+0000","last_unstale":"2024-09-12T18:11:53.926650+0000","last_undegraded":"2024-09-12T18:11:53.926650+0000","last_fullsized":"2024-09-12T18:11:53.926650+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:58.158311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'2","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:31.837338+0000","last_change":"2024-09-12T17:20:30.536062+0000","last_active":"2024-09-12T18:09:31.837338+0000","last_peered":"2024-09-12T18:09:31.837338+0000","last_clean":"2024-09-12T18:09:31.837338+0000","last_became_active":"2024-09-12T17:20:30.535761+0000","last_became_peered":"2024-09-12T17:20:30.535761+0000","last_unstale":"2024-09-12T18:09:31.837338+0000","last_undegraded":"2024-09-12T18:09:31.837338+0000","last_fullsized":"2024-09-12T18:09:31.837338+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:41.021041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4197517,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":8196,"num_write":2,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'42","reported_seq":175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:51.615812+0000","last_change":"2024-09-12T17:16:11.488259+0000","last_active":"2024-09-12T18:09:51.615812+0000","last_peered":"2024-09-12T18:09:51.615812+0000","last_clean":"2024-09-12T18:09:51.615812+0000","last_became_active":"2024-09-12T17:16:11.487923+0000","last_became_peered":"2024-09-12T17:16:11.487923+0000","last_unstale":"2024-09-12T18:09:51.615812+0000","last_undegraded":"2024-09-12T18:09:51.615812+0000","last_fullsized":"2024-09-12T18:09:51.615812+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:17.535117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":152,"num_write":79,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:36.614300+0000","last_change":"2024-09-12T17:39:05.921610+0000","last_active":"2024-09-12T18:09:36.614300+0000","last_peered":"2024-09-12T18:09:36.614300+0000","last_clean":"2024-09-12T18:09:36.614300+0000","last_became_active":"2024-09-12T17:39:05.921257+0000","last_became_peered":"2024-09-12T17:39:05.921257+0000","last_unstale":"2024-09-12T18:09:36.614300+0000","last_undegraded":"2024-09-12T18:09:36.614300+0000","last_fullsized":"2024-09-12T18:09:36.614300+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:57.829484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:36.837884+0000","last_change":"2024-09-12T17:20:34.554048+0000","last_active":"2024-09-12T18:09:36.837884+0000","last_peered":"2024-09-12T18:09:36.837884+0000","last_clean":"2024-09-12T18:09:36.837884+0000","last_became_active":"2024-09-12T17:20:34.553659+0000","last_became_peered":"2024-09-12T17:20:34.553659+0000","last_unstale":"2024-09-12T18:09:36.837884+0000","last_undegraded":"2024-09-12T18:09:36.837884+0000","last_fullsized":"2024-09-12T18:09:36.837884+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:41.787619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51635,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":52,"num_write":2,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:32.735296+0000","last_change":"2024-09-12T17:20:30.535174+0000","last_active":"2024-09-12T18:09:32.735296+0000","last_peered":"2024-09-12T18:09:32.735296+0000","last_clean":"2024-09-12T18:09:32.735296+0000","last_became_active":"2024-09-12T17:20:30.534878+0000","last_became_peered":"2024-09-12T17:20:30.534878+0000","last_unstale":"2024-09-12T18:09:32.735296+0000","last_undegraded":"2024-09-12T18:09:32.735296+0000","last_fullsized":"2024-09-12T18:09:32.735296+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:22.315962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'92","reported_seq":343,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:50.748679+0000","last_change":"2024-09-12T17:16:11.489329+0000","last_active":"2024-09-12T18:09:50.748679+0000","last_peered":"2024-09-12T18:09:50.748679+0000","last_clean":"2024-09-12T18:09:50.748679+0000","last_became_active":"2024-09-12T17:16:11.489044+0000","last_became_peered":"2024-09-12T17:16:11.489044+0000","last_unstale":"2024-09-12T18:09:50.748679+0000","last_undegraded":"2024-09-12T18:09:50.748679+0000","last_fullsized":"2024-09-12T18:09:50.748679+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:09.438571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":552,"num_read_kb":376,"num_write":139,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844194+0000","last_change":"2024-09-12T17:39:05.932942+0000","last_active":"2024-09-12T18:10:31.844194+0000","last_peered":"2024-09-12T18:10:31.844194+0000","last_clean":"2024-09-12T18:10:31.844194+0000","last_became_active":"2024-09-12T17:39:05.932617+0000","last_became_peered":"2024-09-12T17:39:05.932617+0000","last_unstale":"2024-09-12T18:10:31.844194+0000","last_undegraded":"2024-09-12T18:10:31.844194+0000","last_fullsized":"2024-09-12T18:10:31.844194+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:47.846584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"261'5","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:37.736113+0000","last_change":"2024-09-12T17:20:34.559301+0000","last_active":"2024-09-12T18:09:37.736113+0000","last_peered":"2024-09-12T18:09:37.736113+0000","last_clean":"2024-09-12T18:09:37.736113+0000","last_became_active":"2024-09-12T17:20:34.559024+0000","last_became_peered":"2024-09-12T17:20:34.559024+0000","last_unstale":"2024-09-12T18:09:37.736113+0000","last_undegraded":"2024-09-12T18:09:37.736113+0000","last_fullsized":"2024-09-12T18:09:37.736113+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:19.256473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'5","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:32.946858+0000","last_change":"2024-09-12T17:20:30.534604+0000","last_active":"2024-09-12T18:09:32.946858+0000","last_peered":"2024-09-12T18:09:32.946858+0000","last_clean":"2024-09-12T18:09:32.946858+0000","last_became_active":"2024-09-12T17:20:30.534298+0000","last_became_peered":"2024-09-12T17:20:30.534298+0000","last_unstale":"2024-09-12T18:09:32.946858+0000","last_undegraded":"2024-09-12T18:09:32.946858+0000","last_fullsized":"2024-09-12T18:09:32.946858+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:07.258749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'39","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:51.839494+0000","last_change":"2024-09-12T17:16:11.489376+0000","last_active":"2024-09-12T18:09:51.839494+0000","last_peered":"2024-09-12T18:09:51.839494+0000","last_clean":"2024-09-12T18:09:51.839494+0000","last_became_active":"2024-09-12T17:16:11.489085+0000","last_became_peered":"2024-09-12T17:16:11.489085+0000","last_unstale":"2024-09-12T18:09:51.839494+0000","last_undegraded":"2024-09-12T18:09:51.839494+0000","last_fullsized":"2024-09-12T18:09:51.839494+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:34.809544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":137,"num_write":73,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:33.694207+0000","last_change":"2024-09-12T17:39:05.928701+0000","last_active":"2024-09-12T18:09:33.694207+0000","last_peered":"2024-09-12T18:09:33.694207+0000","last_clean":"2024-09-12T18:09:33.694207+0000","last_became_active":"2024-09-12T17:39:05.928320+0000","last_became_peered":"2024-09-12T17:39:05.928320+0000","last_unstale":"2024-09-12T18:09:33.694207+0000","last_undegraded":"2024-09-12T18:09:33.694207+0000","last_fullsized":"2024-09-12T18:09:33.694207+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:56.483652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"261'5","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:06.841342+0000","last_change":"2024-09-12T17:20:34.553728+0000","last_active":"2024-09-12T18:10:06.841342+0000","last_peered":"2024-09-12T18:10:06.841342+0000","last_clean":"2024-09-12T18:10:06.841342+0000","last_became_active":"2024-09-12T17:20:34.553407+0000","last_became_peered":"2024-09-12T17:20:34.553407+0000","last_unstale":"2024-09-12T18:10:06.841342+0000","last_undegraded":"2024-09-12T18:10:06.841342+0000","last_fullsized":"2024-09-12T18:10:06.841342+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:51.963850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'4","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:02.752571+0000","last_change":"2024-09-12T17:20:30.525002+0000","last_active":"2024-09-12T18:10:02.752571+0000","last_peered":"2024-09-12T18:10:02.752571+0000","last_clean":"2024-09-12T18:10:02.752571+0000","last_became_active":"2024-09-12T17:20:30.524670+0000","last_became_peered":"2024-09-12T17:20:30.524670+0000","last_unstale":"2024-09-12T18:10:02.752571+0000","last_undegraded":"2024-09-12T18:10:02.752571+0000","last_fullsized":"2024-09-12T18:10:02.752571+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:48.793238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8972971,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":4667,"num_write":9,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'33","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.843088+0000","last_change":"2024-09-12T17:16:11.487281+0000","last_active":"2024-09-12T18:10:21.843088+0000","last_peered":"2024-09-12T18:10:21.843088+0000","last_clean":"2024-09-12T18:10:21.843088+0000","last_became_active":"2024-09-12T17:16:11.486986+0000","last_became_peered":"2024-09-12T17:16:11.486986+0000","last_unstale":"2024-09-12T18:10:21.843088+0000","last_undegraded":"2024-09-12T18:10:21.843088+0000","last_fullsized":"2024-09-12T18:10:21.843088+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:58.383837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":108,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.758368+0000","last_change":"2024-09-12T17:39:05.927856+0000","last_active":"2024-09-12T18:10:37.758368+0000","last_peered":"2024-09-12T18:10:37.758368+0000","last_clean":"2024-09-12T18:10:37.758368+0000","last_became_active":"2024-09-12T17:39:05.927578+0000","last_became_peered":"2024-09-12T17:39:05.927578+0000","last_unstale":"2024-09-12T18:10:37.758368+0000","last_undegraded":"2024-09-12T18:10:37.758368+0000","last_fullsized":"2024-09-12T18:10:37.758368+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:21.888828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:06.841313+0000","last_change":"2024-09-12T17:20:34.552899+0000","last_active":"2024-09-12T18:10:06.841313+0000","last_peered":"2024-09-12T18:10:06.841313+0000","last_clean":"2024-09-12T18:10:06.841313+0000","last_became_active":"2024-09-12T17:20:34.552569+0000","last_became_peered":"2024-09-12T17:20:34.552569+0000","last_unstale":"2024-09-12T18:10:06.841313+0000","last_undegraded":"2024-09-12T18:10:06.841313+0000","last_fullsized":"2024-09-12T18:10:06.841313+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:59.485671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:03.697087+0000","last_change":"2024-09-12T17:20:30.538454+0000","last_active":"2024-09-12T18:10:03.697087+0000","last_peered":"2024-09-12T18:10:03.697087+0000","last_clean":"2024-09-12T18:10:03.697087+0000","last_became_active":"2024-09-12T17:20:30.538157+0000","last_became_peered":"2024-09-12T17:20:30.538157+0000","last_unstale":"2024-09-12T18:10:03.697087+0000","last_undegraded":"2024-09-12T18:10:03.697087+0000","last_fullsized":"2024-09-12T18:10:03.697087+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:21.990887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'29","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.953012+0000","last_change":"2024-09-12T17:16:11.488323+0000","last_active":"2024-09-12T18:10:12.953012+0000","last_peered":"2024-09-12T18:10:12.953012+0000","last_clean":"2024-09-12T18:10:12.953012+0000","last_became_active":"2024-09-12T17:16:11.487998+0000","last_became_peered":"2024-09-12T17:16:11.487998+0000","last_unstale":"2024-09-12T18:10:12.953012+0000","last_undegraded":"2024-09-12T18:10:12.953012+0000","last_fullsized":"2024-09-12T18:10:12.953012+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:46.362889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:37.753323+0000","last_change":"2024-09-12T17:39:05.921302+0000","last_active":"2024-09-12T18:11:37.753323+0000","last_peered":"2024-09-12T18:11:37.753323+0000","last_clean":"2024-09-12T18:11:37.753323+0000","last_became_active":"2024-09-12T17:39:05.921008+0000","last_became_peered":"2024-09-12T17:39:05.921008+0000","last_unstale":"2024-09-12T18:11:37.753323+0000","last_undegraded":"2024-09-12T18:11:37.753323+0000","last_fullsized":"2024-09-12T18:11:37.753323+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:44.290086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:28.933628+0000","last_change":"2024-09-12T17:20:34.616039+0000","last_active":"2024-09-12T18:12:28.933628+0000","last_peered":"2024-09-12T18:12:28.933628+0000","last_clean":"2024-09-12T18:12:28.933628+0000","last_became_active":"2024-09-12T17:20:34.615689+0000","last_became_peered":"2024-09-12T17:20:34.615689+0000","last_unstale":"2024-09-12T18:12:28.933628+0000","last_undegraded":"2024-09-12T18:12:28.933628+0000","last_fullsized":"2024-09-12T18:12:28.933628+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:14.341361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'3","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:01.616967+0000","last_change":"2024-09-12T17:20:30.540013+0000","last_active":"2024-09-12T18:10:01.616967+0000","last_peered":"2024-09-12T18:10:01.616967+0000","last_clean":"2024-09-12T18:10:01.616967+0000","last_became_active":"2024-09-12T17:20:30.536917+0000","last_became_peered":"2024-09-12T17:20:30.536917+0000","last_unstale":"2024-09-12T18:10:01.616967+0000","last_undegraded":"2024-09-12T18:10:01.616967+0000","last_fullsized":"2024-09-12T18:10:01.616967+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:21.908709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'41","reported_seq":168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.740858+0000","last_change":"2024-09-12T17:16:11.488593+0000","last_active":"2024-09-12T18:10:12.740858+0000","last_peered":"2024-09-12T18:10:12.740858+0000","last_clean":"2024-09-12T18:10:12.740858+0000","last_became_active":"2024-09-12T17:16:11.488252+0000","last_became_peered":"2024-09-12T17:16:11.488252+0000","last_unstale":"2024-09-12T18:10:12.740858+0000","last_undegraded":"2024-09-12T18:10:12.740858+0000","last_fullsized":"2024-09-12T18:10:12.740858+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:41.338780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":141,"num_write":74,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:37.767690+0000","last_change":"2024-09-12T17:39:05.926009+0000","last_active":"2024-09-12T18:11:37.767690+0000","last_peered":"2024-09-12T18:11:37.767690+0000","last_clean":"2024-09-12T18:11:37.767690+0000","last_became_active":"2024-09-12T17:39:05.925589+0000","last_became_peered":"2024-09-12T17:39:05.925589+0000","last_unstale":"2024-09-12T18:11:37.767690+0000","last_undegraded":"2024-09-12T18:11:37.767690+0000","last_fullsized":"2024-09-12T18:11:37.767690+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:14.643645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'10","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:06.841353+0000","last_change":"2024-09-12T17:20:34.560582+0000","last_active":"2024-09-12T18:10:06.841353+0000","last_peered":"2024-09-12T18:10:06.841353+0000","last_clean":"2024-09-12T18:10:06.841353+0000","last_became_active":"2024-09-12T17:20:34.560319+0000","last_became_peered":"2024-09-12T17:20:34.560319+0000","last_unstale":"2024-09-12T18:10:06.841353+0000","last_undegraded":"2024-09-12T18:10:06.841353+0000","last_fullsized":"2024-09-12T18:10:06.841353+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:25.756495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":15462,"num_write":15,"num_write_kb":7218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'2","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:28.933593+0000","last_change":"2024-09-12T17:20:30.531674+0000","last_active":"2024-09-12T18:12:28.933593+0000","last_peered":"2024-09-12T18:12:28.933593+0000","last_clean":"2024-09-12T18:12:28.933593+0000","last_became_active":"2024-09-12T17:20:30.531384+0000","last_became_peered":"2024-09-12T17:20:30.531384+0000","last_unstale":"2024-09-12T18:12:28.933593+0000","last_undegraded":"2024-09-12T18:12:28.933593+0000","last_fullsized":"2024-09-12T18:12:28.933593+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:07.405605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'7","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:13.698059+0000","last_change":"2024-09-12T17:16:11.486387+0000","last_active":"2024-09-12T18:10:13.698059+0000","last_peered":"2024-09-12T18:10:13.698059+0000","last_clean":"2024-09-12T18:10:13.698059+0000","last_became_active":"2024-09-12T17:16:11.486098+0000","last_became_peered":"2024-09-12T17:16:11.486098+0000","last_unstale":"2024-09-12T18:10:13.698059+0000","last_undegraded":"2024-09-12T18:10:13.698059+0000","last_fullsized":"2024-09-12T18:10:13.698059+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:46.177478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.844775+0000","last_change":"2024-09-12T17:39:05.926486+0000","last_active":"2024-09-12T18:10:36.844775+0000","last_peered":"2024-09-12T18:10:36.844775+0000","last_clean":"2024-09-12T18:10:36.844775+0000","last_became_active":"2024-09-12T17:39:05.925637+0000","last_became_peered":"2024-09-12T17:39:05.925637+0000","last_unstale":"2024-09-12T18:10:36.844775+0000","last_undegraded":"2024-09-12T18:10:36.844775+0000","last_fullsized":"2024-09-12T18:10:36.844775+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:55.840960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:25.753841+0000","last_change":"2024-09-12T17:20:47.596669+0000","last_active":"2024-09-12T18:10:25.753841+0000","last_peered":"2024-09-12T18:10:25.753841+0000","last_clean":"2024-09-12T18:10:25.753841+0000","last_became_active":"2024-09-12T17:20:47.581310+0000","last_became_peered":"2024-09-12T17:20:47.581310+0000","last_unstale":"2024-09-12T18:10:25.753841+0000","last_undegraded":"2024-09-12T18:10:25.753841+0000","last_fullsized":"2024-09-12T18:10:25.753841+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:11.897529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619107+0000","last_change":"2024-09-12T17:20:30.536180+0000","last_active":"2024-09-12T18:10:21.619107+0000","last_peered":"2024-09-12T18:10:21.619107+0000","last_clean":"2024-09-12T18:10:21.619107+0000","last_became_active":"2024-09-12T17:20:30.535668+0000","last_became_peered":"2024-09-12T17:20:30.535668+0000","last_unstale":"2024-09-12T18:10:21.619107+0000","last_undegraded":"2024-09-12T18:10:21.619107+0000","last_fullsized":"2024-09-12T18:10:21.619107+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:31.430438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'13","reported_seq":92,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:11.618041+0000","last_change":"2024-09-12T17:16:11.484443+0000","last_active":"2024-09-12T18:10:11.618041+0000","last_peered":"2024-09-12T18:10:11.618041+0000","last_clean":"2024-09-12T18:10:11.618041+0000","last_became_active":"2024-09-12T17:16:11.484154+0000","last_became_peered":"2024-09-12T17:16:11.484154+0000","last_unstale":"2024-09-12T18:10:11.618041+0000","last_undegraded":"2024-09-12T18:10:11.618041+0000","last_fullsized":"2024-09-12T18:10:11.618041+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:54.824715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":37,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:42.759255+0000","last_change":"2024-09-12T17:39:05.928118+0000","last_active":"2024-09-12T18:10:42.759255+0000","last_peered":"2024-09-12T18:10:42.759255+0000","last_clean":"2024-09-12T18:10:42.759255+0000","last_became_active":"2024-09-12T17:39:05.927841+0000","last_became_peered":"2024-09-12T17:39:05.927841+0000","last_unstale":"2024-09-12T18:10:42.759255+0000","last_undegraded":"2024-09-12T18:10:42.759255+0000","last_fullsized":"2024-09-12T18:10:42.759255+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:37.026584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.756629+0000","last_change":"2024-09-12T17:20:34.611017+0000","last_active":"2024-09-12T18:10:27.756629+0000","last_peered":"2024-09-12T18:10:27.756629+0000","last_clean":"2024-09-12T18:10:27.756629+0000","last_became_active":"2024-09-12T17:20:34.610737+0000","last_became_peered":"2024-09-12T17:20:34.610737+0000","last_unstale":"2024-09-12T18:10:27.756629+0000","last_undegraded":"2024-09-12T18:10:27.756629+0000","last_fullsized":"2024-09-12T18:10:27.756629+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:07.818994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:23.917473+0000","last_change":"2024-09-12T17:20:30.529241+0000","last_active":"2024-09-12T18:10:23.917473+0000","last_peered":"2024-09-12T18:10:23.917473+0000","last_clean":"2024-09-12T18:10:23.917473+0000","last_became_active":"2024-09-12T17:20:30.528902+0000","last_became_peered":"2024-09-12T17:20:30.528902+0000","last_unstale":"2024-09-12T18:10:23.917473+0000","last_undegraded":"2024-09-12T18:10:23.917473+0000","last_fullsized":"2024-09-12T18:10:23.917473+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:59.483184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'31","reported_seq":148,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.757491+0000","last_change":"2024-09-12T17:16:11.489013+0000","last_active":"2024-09-12T18:10:32.757491+0000","last_peered":"2024-09-12T18:10:32.757491+0000","last_clean":"2024-09-12T18:10:32.757491+0000","last_became_active":"2024-09-12T17:16:11.488722+0000","last_became_peered":"2024-09-12T17:16:11.488722+0000","last_unstale":"2024-09-12T18:10:32.757491+0000","last_undegraded":"2024-09-12T18:10:32.757491+0000","last_fullsized":"2024-09-12T18:10:32.757491+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:19.504993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":116,"num_write":54,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.758386+0000","last_change":"2024-09-12T17:39:05.929421+0000","last_active":"2024-09-12T18:10:37.758386+0000","last_peered":"2024-09-12T18:10:37.758386+0000","last_clean":"2024-09-12T18:10:37.758386+0000","last_became_active":"2024-09-12T17:39:05.929156+0000","last_became_peered":"2024-09-12T17:39:05.929156+0000","last_unstale":"2024-09-12T18:10:37.758386+0000","last_undegraded":"2024-09-12T18:10:37.758386+0000","last_fullsized":"2024-09-12T18:10:37.758386+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:37.940351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:03.915183+0000","last_change":"2024-09-12T17:20:34.559128+0000","last_active":"2024-09-12T18:10:03.915183+0000","last_peered":"2024-09-12T18:10:03.915183+0000","last_clean":"2024-09-12T18:10:03.915183+0000","last_became_active":"2024-09-12T17:20:34.558826+0000","last_became_peered":"2024-09-12T17:20:34.558826+0000","last_unstale":"2024-09-12T18:10:03.915183+0000","last_undegraded":"2024-09-12T18:10:03.915183+0000","last_fullsized":"2024-09-12T18:10:03.915183+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:41.318428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.620862+0000","last_change":"2024-09-12T17:20:30.537479+0000","last_active":"2024-09-12T18:10:36.620862+0000","last_peered":"2024-09-12T18:10:36.620862+0000","last_clean":"2024-09-12T18:10:36.620862+0000","last_became_active":"2024-09-12T17:20:30.537204+0000","last_became_peered":"2024-09-12T17:20:30.537204+0000","last_unstale":"2024-09-12T18:10:36.620862+0000","last_undegraded":"2024-09-12T18:10:36.620862+0000","last_fullsized":"2024-09-12T18:10:36.620862+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:58.505650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'43","reported_seq":176,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.842925+0000","last_change":"2024-09-12T17:16:11.487416+0000","last_active":"2024-09-12T18:10:21.842925+0000","last_peered":"2024-09-12T18:10:21.842925+0000","last_clean":"2024-09-12T18:10:21.842925+0000","last_became_active":"2024-09-12T17:16:11.487129+0000","last_became_peered":"2024-09-12T17:16:11.487129+0000","last_unstale":"2024-09-12T18:10:21.842925+0000","last_undegraded":"2024-09-12T18:10:21.842925+0000","last_fullsized":"2024-09-12T18:10:21.842925+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:13.494114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":153,"num_write":79,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.620937+0000","last_change":"2024-09-12T17:39:05.926264+0000","last_active":"2024-09-12T18:10:36.620937+0000","last_peered":"2024-09-12T18:10:36.620937+0000","last_clean":"2024-09-12T18:10:36.620937+0000","last_became_active":"2024-09-12T17:39:05.925950+0000","last_became_peered":"2024-09-12T17:39:05.925950+0000","last_unstale":"2024-09-12T18:10:36.620937+0000","last_undegraded":"2024-09-12T18:10:36.620937+0000","last_fullsized":"2024-09-12T18:10:36.620937+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:25.942839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.758339+0000","last_change":"2024-09-12T17:20:34.555836+0000","last_active":"2024-09-12T18:10:37.758339+0000","last_peered":"2024-09-12T18:10:37.758339+0000","last_clean":"2024-09-12T18:10:37.758339+0000","last_became_active":"2024-09-12T17:20:34.555493+0000","last_became_peered":"2024-09-12T17:20:34.555493+0000","last_unstale":"2024-09-12T18:10:37.758339+0000","last_undegraded":"2024-09-12T18:10:37.758339+0000","last_fullsized":"2024-09-12T18:10:37.758339+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:04.010344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'3","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:00.750159+0000","last_change":"2024-09-12T17:20:30.534904+0000","last_active":"2024-09-12T18:10:00.750159+0000","last_peered":"2024-09-12T18:10:00.750159+0000","last_clean":"2024-09-12T18:10:00.750159+0000","last_became_active":"2024-09-12T17:20:30.534448+0000","last_became_peered":"2024-09-12T17:20:30.534448+0000","last_unstale":"2024-09-12T18:10:00.750159+0000","last_undegraded":"2024-09-12T18:10:00.750159+0000","last_fullsized":"2024-09-12T18:10:00.750159+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:56.106715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48422,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4144,"num_write":3,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'9","reported_seq":87,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.742416+0000","last_change":"2024-09-12T17:16:11.488846+0000","last_active":"2024-09-12T18:10:22.742416+0000","last_peered":"2024-09-12T18:10:22.742416+0000","last_clean":"2024-09-12T18:10:22.742416+0000","last_became_active":"2024-09-12T17:16:11.488433+0000","last_became_peered":"2024-09-12T17:16:11.488433+0000","last_unstale":"2024-09-12T18:10:22.742416+0000","last_undegraded":"2024-09-12T18:10:22.742416+0000","last_fullsized":"2024-09-12T18:10:22.742416+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:14.398588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":34,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.755896+0000","last_change":"2024-09-12T17:39:05.927566+0000","last_active":"2024-09-12T18:10:22.755896+0000","last_peered":"2024-09-12T18:10:22.755896+0000","last_clean":"2024-09-12T18:10:22.755896+0000","last_became_active":"2024-09-12T17:39:05.925525+0000","last_became_peered":"2024-09-12T17:39:05.925525+0000","last_unstale":"2024-09-12T18:10:22.755896+0000","last_undegraded":"2024-09-12T18:10:22.755896+0000","last_fullsized":"2024-09-12T18:10:22.755896+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:27.269945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'2","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:51.622647+0000","last_change":"2024-09-12T17:20:34.559275+0000","last_active":"2024-09-12T18:10:51.622647+0000","last_peered":"2024-09-12T18:10:51.622647+0000","last_clean":"2024-09-12T18:10:51.622647+0000","last_became_active":"2024-09-12T17:20:34.558946+0000","last_became_peered":"2024-09-12T17:20:34.558946+0000","last_unstale":"2024-09-12T18:10:51.622647+0000","last_undegraded":"2024-09-12T18:10:51.622647+0000","last_fullsized":"2024-09-12T18:10:51.622647+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:44.945949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'4","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.757518+0000","last_change":"2024-09-12T17:20:30.528368+0000","last_active":"2024-09-12T18:10:32.757518+0000","last_peered":"2024-09-12T18:10:32.757518+0000","last_clean":"2024-09-12T18:10:32.757518+0000","last_became_active":"2024-09-12T17:20:30.528078+0000","last_became_peered":"2024-09-12T17:20:30.528078+0000","last_unstale":"2024-09-12T18:10:32.757518+0000","last_undegraded":"2024-09-12T18:10:32.757518+0000","last_fullsized":"2024-09-12T18:10:32.757518+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:37.188849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'44","reported_seq":182,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619260+0000","last_change":"2024-09-12T17:16:11.481733+0000","last_active":"2024-09-12T18:10:21.619260+0000","last_peered":"2024-09-12T18:10:21.619260+0000","last_clean":"2024-09-12T18:10:21.619260+0000","last_became_active":"2024-09-12T17:16:11.481431+0000","last_became_peered":"2024-09-12T17:16:11.481431+0000","last_unstale":"2024-09-12T18:10:21.619260+0000","last_undegraded":"2024-09-12T18:10:21.619260+0000","last_fullsized":"2024-09-12T18:10:21.619260+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:47.517502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":166,"num_write":69,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954425+0000","last_change":"2024-09-12T17:39:05.919499+0000","last_active":"2024-09-12T18:10:22.954425+0000","last_peered":"2024-09-12T18:10:22.954425+0000","last_clean":"2024-09-12T18:10:22.954425+0000","last_became_active":"2024-09-12T17:39:05.919207+0000","last_became_peered":"2024-09-12T17:39:05.919207+0000","last_unstale":"2024-09-12T18:10:22.954425+0000","last_undegraded":"2024-09-12T18:10:22.954425+0000","last_fullsized":"2024-09-12T18:10:22.954425+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:26.247547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'8","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.620919+0000","last_change":"2024-09-12T17:20:34.613162+0000","last_active":"2024-09-12T18:10:36.620919+0000","last_peered":"2024-09-12T18:10:36.620919+0000","last_clean":"2024-09-12T18:10:36.620919+0000","last_became_active":"2024-09-12T17:20:34.612840+0000","last_became_peered":"2024-09-12T17:20:34.612840+0000","last_unstale":"2024-09-12T18:10:36.620919+0000","last_undegraded":"2024-09-12T18:10:36.620919+0000","last_fullsized":"2024-09-12T18:10:36.620919+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:07.359408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":23554,"num_write":8,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:43.700925+0000","last_change":"2024-09-12T17:20:30.539195+0000","last_active":"2024-09-12T18:10:43.700925+0000","last_peered":"2024-09-12T18:10:43.700925+0000","last_clean":"2024-09-12T18:10:43.700925+0000","last_became_active":"2024-09-12T17:20:30.538913+0000","last_became_peered":"2024-09-12T17:20:30.538913+0000","last_unstale":"2024-09-12T18:10:43.700925+0000","last_undegraded":"2024-09-12T18:10:43.700925+0000","last_fullsized":"2024-09-12T18:10:43.700925+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:30.309214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'103","reported_seq":385,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.742516+0000","last_change":"2024-09-12T17:16:11.489384+0000","last_active":"2024-09-12T18:10:22.742516+0000","last_peered":"2024-09-12T18:10:22.742516+0000","last_clean":"2024-09-12T18:10:22.742516+0000","last_became_active":"2024-09-12T17:16:11.489087+0000","last_became_peered":"2024-09-12T17:16:11.489087+0000","last_unstale":"2024-09-12T18:10:22.742516+0000","last_undegraded":"2024-09-12T18:10:22.742516+0000","last_fullsized":"2024-09-12T18:10:22.742516+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:44.577138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":629,"num_read_kb":433,"num_write":144,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.922659+0000","last_change":"2024-09-12T17:39:05.921957+0000","last_active":"2024-09-12T18:11:13.922659+0000","last_peered":"2024-09-12T18:11:13.922659+0000","last_clean":"2024-09-12T18:11:13.922659+0000","last_became_active":"2024-09-12T17:39:05.921608+0000","last_became_peered":"2024-09-12T17:39:05.921608+0000","last_unstale":"2024-09-12T18:11:13.922659+0000","last_undegraded":"2024-09-12T18:11:13.922659+0000","last_fullsized":"2024-09-12T18:11:13.922659+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:54.960277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.756818+0000","last_change":"2024-09-12T17:20:34.611054+0000","last_active":"2024-09-12T18:10:27.756818+0000","last_peered":"2024-09-12T18:10:27.756818+0000","last_clean":"2024-09-12T18:10:27.756818+0000","last_became_active":"2024-09-12T17:20:34.610719+0000","last_became_peered":"2024-09-12T17:20:34.610719+0000","last_unstale":"2024-09-12T18:10:27.756818+0000","last_undegraded":"2024-09-12T18:10:27.756818+0000","last_fullsized":"2024-09-12T18:10:27.756818+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:24.284192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954530+0000","last_change":"2024-09-12T17:20:30.535657+0000","last_active":"2024-09-12T18:10:22.954530+0000","last_peered":"2024-09-12T18:10:22.954530+0000","last_clean":"2024-09-12T18:10:22.954530+0000","last_became_active":"2024-09-12T17:20:30.535382+0000","last_became_peered":"2024-09-12T17:20:30.535382+0000","last_unstale":"2024-09-12T18:10:22.954530+0000","last_undegraded":"2024-09-12T18:10:22.954530+0000","last_fullsized":"2024-09-12T18:10:22.954530+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:06.602123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'27","reported_seq":132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.757540+0000","last_change":"2024-09-12T17:16:11.487072+0000","last_active":"2024-09-12T18:10:32.757540+0000","last_peered":"2024-09-12T18:10:32.757540+0000","last_clean":"2024-09-12T18:10:32.757540+0000","last_became_active":"2024-09-12T17:16:11.486799+0000","last_became_peered":"2024-09-12T17:16:11.486799+0000","last_unstale":"2024-09-12T18:10:32.757540+0000","last_undegraded":"2024-09-12T18:10:32.757540+0000","last_fullsized":"2024-09-12T18:10:32.757540+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:25.256158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":89,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.753105+0000","last_change":"2024-09-12T17:39:05.923468+0000","last_active":"2024-09-12T18:10:20.753105+0000","last_peered":"2024-09-12T18:10:20.753105+0000","last_clean":"2024-09-12T18:10:20.753105+0000","last_became_active":"2024-09-12T17:39:05.923192+0000","last_became_peered":"2024-09-12T17:39:05.923192+0000","last_unstale":"2024-09-12T18:10:20.753105+0000","last_undegraded":"2024-09-12T18:10:20.753105+0000","last_fullsized":"2024-09-12T18:10:20.753105+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:18.451237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'2","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:25.753945+0000","last_change":"2024-09-12T17:20:34.555545+0000","last_active":"2024-09-12T18:10:25.753945+0000","last_peered":"2024-09-12T18:10:25.753945+0000","last_clean":"2024-09-12T18:10:25.753945+0000","last_became_active":"2024-09-12T17:20:34.555267+0000","last_became_peered":"2024-09-12T17:20:34.555267+0000","last_unstale":"2024-09-12T18:10:25.753945+0000","last_undegraded":"2024-09-12T18:10:25.753945+0000","last_fullsized":"2024-09-12T18:10:25.753945+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:48.447926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'3","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.756008+0000","last_change":"2024-09-12T17:20:30.531341+0000","last_active":"2024-09-12T18:10:22.756008+0000","last_peered":"2024-09-12T18:10:22.756008+0000","last_clean":"2024-09-12T18:10:22.756008+0000","last_became_active":"2024-09-12T17:20:30.530998+0000","last_became_peered":"2024-09-12T17:20:30.530998+0000","last_unstale":"2024-09-12T18:10:22.756008+0000","last_undegraded":"2024-09-12T18:10:22.756008+0000","last_fullsized":"2024-09-12T18:10:22.756008+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:28.087866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'20","reported_seq":119,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:23.917537+0000","last_change":"2024-09-12T17:16:11.487744+0000","last_active":"2024-09-12T18:10:23.917537+0000","last_peered":"2024-09-12T18:10:23.917537+0000","last_clean":"2024-09-12T18:10:23.917537+0000","last_became_active":"2024-09-12T17:16:11.487439+0000","last_became_peered":"2024-09-12T17:16:11.487439+0000","last_unstale":"2024-09-12T18:10:23.917537+0000","last_undegraded":"2024-09-12T18:10:23.917537+0000","last_fullsized":"2024-09-12T18:10:23.917537+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:01.381415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":36,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:38.706396+0000","last_change":"2024-09-12T17:39:05.923711+0000","last_active":"2024-09-12T18:11:38.706396+0000","last_peered":"2024-09-12T18:11:38.706396+0000","last_clean":"2024-09-12T18:11:38.706396+0000","last_became_active":"2024-09-12T17:39:05.923420+0000","last_became_peered":"2024-09-12T17:39:05.923420+0000","last_unstale":"2024-09-12T18:11:38.706396+0000","last_undegraded":"2024-09-12T18:11:38.706396+0000","last_fullsized":"2024-09-12T18:11:38.706396+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:30.324051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'5","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:38.934756+0000","last_change":"2024-09-12T17:20:34.558121+0000","last_active":"2024-09-12T18:12:38.934756+0000","last_peered":"2024-09-12T18:12:38.934756+0000","last_clean":"2024-09-12T18:12:38.934756+0000","last_became_active":"2024-09-12T17:20:34.557794+0000","last_became_peered":"2024-09-12T17:20:34.557794+0000","last_unstale":"2024-09-12T18:12:38.934756+0000","last_undegraded":"2024-09-12T18:12:38.934756+0000","last_fullsized":"2024-09-12T18:12:38.934756+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:35.789851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'6","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:42.759117+0000","last_change":"2024-09-12T17:20:30.538275+0000","last_active":"2024-09-12T18:10:42.759117+0000","last_peered":"2024-09-12T18:10:42.759117+0000","last_clean":"2024-09-12T18:10:42.759117+0000","last_became_active":"2024-09-12T17:20:30.537970+0000","last_became_peered":"2024-09-12T17:20:30.537970+0000","last_unstale":"2024-09-12T18:10:42.759117+0000","last_undegraded":"2024-09-12T18:10:42.759117+0000","last_fullsized":"2024-09-12T18:10:42.759117+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:25.105193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":19458,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'24","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954441+0000","last_change":"2024-09-12T17:16:11.487378+0000","last_active":"2024-09-12T18:10:22.954441+0000","last_peered":"2024-09-12T18:10:22.954441+0000","last_clean":"2024-09-12T18:10:22.954441+0000","last_became_active":"2024-09-12T17:16:11.486298+0000","last_became_peered":"2024-09-12T17:16:11.486298+0000","last_unstale":"2024-09-12T18:10:22.954441+0000","last_undegraded":"2024-09-12T18:10:22.954441+0000","last_fullsized":"2024-09-12T18:10:22.954441+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:22.173224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:36.627544+0000","last_change":"2024-09-12T17:39:05.921428+0000","last_active":"2024-09-12T18:11:36.627544+0000","last_peered":"2024-09-12T18:11:36.627544+0000","last_clean":"2024-09-12T18:11:36.627544+0000","last_became_active":"2024-09-12T17:39:05.921085+0000","last_became_peered":"2024-09-12T17:39:05.921085+0000","last_unstale":"2024-09-12T18:11:36.627544+0000","last_undegraded":"2024-09-12T18:11:36.627544+0000","last_fullsized":"2024-09-12T18:11:36.627544+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:12.796863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'4","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:47.958321+0000","last_change":"2024-09-12T17:20:34.559242+0000","last_active":"2024-09-12T18:10:47.958321+0000","last_peered":"2024-09-12T18:10:47.958321+0000","last_clean":"2024-09-12T18:10:47.958321+0000","last_became_active":"2024-09-12T17:20:34.558963+0000","last_became_peered":"2024-09-12T17:20:34.558963+0000","last_unstale":"2024-09-12T18:10:47.958321+0000","last_undegraded":"2024-09-12T18:10:47.958321+0000","last_fullsized":"2024-09-12T18:10:47.958321+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:24.912978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.757457+0000","last_change":"2024-09-12T17:20:30.524694+0000","last_active":"2024-09-12T18:10:32.757457+0000","last_peered":"2024-09-12T18:10:32.757457+0000","last_clean":"2024-09-12T18:10:32.757457+0000","last_became_active":"2024-09-12T17:20:30.524377+0000","last_became_peered":"2024-09-12T17:20:30.524377+0000","last_unstale":"2024-09-12T18:10:32.757457+0000","last_undegraded":"2024-09-12T18:10:32.757457+0000","last_fullsized":"2024-09-12T18:10:32.757457+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:30.709529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'59","reported_seq":225,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.753135+0000","last_change":"2024-09-12T17:16:11.491864+0000","last_active":"2024-09-12T18:10:20.753135+0000","last_peered":"2024-09-12T18:10:20.753135+0000","last_clean":"2024-09-12T18:10:20.753135+0000","last_became_active":"2024-09-12T17:16:11.491512+0000","last_became_peered":"2024-09-12T17:16:11.491512+0000","last_unstale":"2024-09-12T18:10:20.753135+0000","last_undegraded":"2024-09-12T18:10:20.753135+0000","last_fullsized":"2024-09-12T18:10:20.753135+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:58.986968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":313,"num_read_kb":225,"num_write":101,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619193+0000","last_change":"2024-09-12T17:39:05.926334+0000","last_active":"2024-09-12T18:10:21.619193+0000","last_peered":"2024-09-12T18:10:21.619193+0000","last_clean":"2024-09-12T18:10:21.619193+0000","last_became_active":"2024-09-12T17:39:05.926029+0000","last_became_peered":"2024-09-12T17:39:05.926029+0000","last_unstale":"2024-09-12T18:10:21.619193+0000","last_undegraded":"2024-09-12T18:10:21.619193+0000","last_fullsized":"2024-09-12T18:10:21.619193+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:44.569050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"261'2","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.744693+0000","last_change":"2024-09-12T17:20:34.555632+0000","last_active":"2024-09-12T18:10:37.744693+0000","last_peered":"2024-09-12T18:10:37.744693+0000","last_clean":"2024-09-12T18:10:37.744693+0000","last_became_active":"2024-09-12T17:20:34.555137+0000","last_became_peered":"2024-09-12T17:20:34.555137+0000","last_unstale":"2024-09-12T18:10:37.744693+0000","last_undegraded":"2024-09-12T18:10:37.744693+0000","last_fullsized":"2024-09-12T18:10:37.744693+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:44.659171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'1","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:33.918629+0000","last_change":"2024-09-12T17:20:30.531528+0000","last_active":"2024-09-12T18:10:33.918629+0000","last_peered":"2024-09-12T18:10:33.918629+0000","last_clean":"2024-09-12T18:10:33.918629+0000","last_became_active":"2024-09-12T17:20:30.531232+0000","last_became_peered":"2024-09-12T17:20:30.531232+0000","last_unstale":"2024-09-12T18:10:33.918629+0000","last_undegraded":"2024-09-12T18:10:33.918629+0000","last_fullsized":"2024-09-12T18:10:33.918629+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:17.702865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'13","reported_seq":98,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.742450+0000","last_change":"2024-09-12T17:16:11.491691+0000","last_active":"2024-09-12T18:10:22.742450+0000","last_peered":"2024-09-12T18:10:22.742450+0000","last_clean":"2024-09-12T18:10:22.742450+0000","last_became_active":"2024-09-12T17:16:11.491334+0000","last_became_peered":"2024-09-12T17:16:11.491334+0000","last_unstale":"2024-09-12T18:10:22.742450+0000","last_undegraded":"2024-09-12T18:10:22.742450+0000","last_fullsized":"2024-09-12T18:10:22.742450+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:26.856534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":49,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.756721+0000","last_change":"2024-09-12T17:39:05.930558+0000","last_active":"2024-09-12T18:10:27.756721+0000","last_peered":"2024-09-12T18:10:27.756721+0000","last_clean":"2024-09-12T18:10:27.756721+0000","last_became_active":"2024-09-12T17:39:05.930326+0000","last_became_peered":"2024-09-12T17:39:05.930326+0000","last_unstale":"2024-09-12T18:10:27.756721+0000","last_undegraded":"2024-09-12T18:10:27.756721+0000","last_fullsized":"2024-09-12T18:10:27.756721+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:01.120642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'5","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:35.755466+0000","last_change":"2024-09-12T17:20:34.556804+0000","last_active":"2024-09-12T18:10:35.755466+0000","last_peered":"2024-09-12T18:10:35.755466+0000","last_clean":"2024-09-12T18:10:35.755466+0000","last_became_active":"2024-09-12T17:20:34.554832+0000","last_became_peered":"2024-09-12T17:20:34.554832+0000","last_unstale":"2024-09-12T18:10:35.755466+0000","last_undegraded":"2024-09-12T18:10:35.755466+0000","last_fullsized":"2024-09-12T18:10:35.755466+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:59.545466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":15,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'2","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.743952+0000","last_change":"2024-09-12T17:20:30.528814+0000","last_active":"2024-09-12T18:10:32.743952+0000","last_peered":"2024-09-12T18:10:32.743952+0000","last_clean":"2024-09-12T18:10:32.743952+0000","last_became_active":"2024-09-12T17:20:30.528541+0000","last_became_peered":"2024-09-12T17:20:30.528541+0000","last_unstale":"2024-09-12T18:10:32.743952+0000","last_undegraded":"2024-09-12T18:10:32.743952+0000","last_fullsized":"2024-09-12T18:10:32.743952+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:39.437987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'21","reported_seq":117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.755820+0000","last_change":"2024-09-12T17:16:11.487563+0000","last_active":"2024-09-12T18:10:22.755820+0000","last_peered":"2024-09-12T18:10:22.755820+0000","last_clean":"2024-09-12T18:10:22.755820+0000","last_became_active":"2024-09-12T17:16:11.487238+0000","last_became_peered":"2024-09-12T17:16:11.487238+0000","last_unstale":"2024-09-12T18:10:22.755820+0000","last_undegraded":"2024-09-12T18:10:22.755820+0000","last_fullsized":"2024-09-12T18:10:22.755820+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:39.870434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":71,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'303","reported_seq":940,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.261952+0000","last_change":"2024-09-12T17:00:12.304380+0000","last_active":"2024-09-12T18:11:11.261952+0000","last_peered":"2024-09-12T18:11:11.261952+0000","last_clean":"2024-09-12T18:11:11.261952+0000","last_became_active":"2024-09-12T17:00:12.304074+0000","last_became_peered":"2024-09-12T17:00:12.304074+0000","last_unstale":"2024-09-12T18:11:11.261952+0000","last_undegraded":"2024-09-12T18:11:11.261952+0000","last_fullsized":"2024-09-12T18:11:11.261952+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:10:33.200742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1686994,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":473,"num_read_kb":3821,"num_write":1093,"num_write_kb":12701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'137","reported_seq":747,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.953601+0000","last_change":"2024-09-12T17:00:14.328728+0000","last_active":"2024-09-12T18:10:17.953601+0000","last_peered":"2024-09-12T18:10:17.953601+0000","last_clean":"2024-09-12T18:10:17.953601+0000","last_became_active":"2024-09-12T17:00:14.328464+0000","last_became_peered":"2024-09-12T17:00:14.328464+0000","last_unstale":"2024-09-12T18:10:17.953601+0000","last_undegraded":"2024-09-12T18:10:17.953601+0000","last_fullsized":"2024-09-12T18:10:17.953601+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:22.736868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":594,"num_read_kb":496,"num_write":221,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'298","reported_seq":932,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.864070+0000","last_change":"2024-09-12T17:00:12.303038+0000","last_active":"2024-09-12T18:13:48.864070+0000","last_peered":"2024-09-12T18:13:48.864070+0000","last_clean":"2024-09-12T18:13:48.864070+0000","last_became_active":"2024-09-12T17:00:12.302750+0000","last_became_peered":"2024-09-12T17:00:12.302750+0000","last_unstale":"2024-09-12T18:13:48.864070+0000","last_undegraded":"2024-09-12T18:13:48.864070+0000","last_fullsized":"2024-09-12T18:13:48.864070+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:48.905725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262421,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":398,"num_read_kb":57739,"num_write":1002,"num_write_kb":55497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'222","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:21.909979+0000","last_change":"2024-09-12T17:00:14.336471+0000","last_active":"2024-09-12T18:13:21.909979+0000","last_peered":"2024-09-12T18:13:21.909979+0000","last_clean":"2024-09-12T18:13:21.909979+0000","last_became_active":"2024-09-12T17:00:14.336238+0000","last_became_peered":"2024-09-12T17:00:14.336238+0000","last_unstale":"2024-09-12T18:13:21.909979+0000","last_undegraded":"2024-09-12T18:13:21.909979+0000","last_fullsized":"2024-09-12T18:13:21.909979+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:33.594656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":973,"num_read_kb":793,"num_write":333,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'282","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:01.623680+0000","last_change":"2024-09-12T17:00:12.309414+0000","last_active":"2024-09-12T18:11:01.623680+0000","last_peered":"2024-09-12T18:11:01.623680+0000","last_clean":"2024-09-12T18:11:01.623680+0000","last_became_active":"2024-09-12T17:00:12.309132+0000","last_became_peered":"2024-09-12T17:00:12.309132+0000","last_unstale":"2024-09-12T18:11:01.623680+0000","last_undegraded":"2024-09-12T18:11:01.623680+0000","last_fullsized":"2024-09-12T18:11:01.623680+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:14.849278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14712901,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":469,"num_read_kb":32498,"num_write":1072,"num_write_kb":31975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'254","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:15.752313+0000","last_change":"2024-09-12T17:00:14.324328+0000","last_active":"2024-09-12T18:10:15.752313+0000","last_peered":"2024-09-12T18:10:15.752313+0000","last_clean":"2024-09-12T18:10:15.752313+0000","last_became_active":"2024-09-12T17:00:14.323358+0000","last_became_peered":"2024-09-12T17:00:14.323358+0000","last_unstale":"2024-09-12T18:10:15.752313+0000","last_undegraded":"2024-09-12T18:10:15.752313+0000","last_fullsized":"2024-09-12T18:10:15.752313+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:08.155945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1058,"num_read_kb":862,"num_write":363,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'244","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.955171+0000","last_change":"2024-09-12T17:00:12.321038+0000","last_active":"2024-09-12T18:10:27.955171+0000","last_peered":"2024-09-12T18:10:27.955171+0000","last_clean":"2024-09-12T18:10:27.955171+0000","last_became_active":"2024-09-12T17:00:12.320515+0000","last_became_peered":"2024-09-12T17:00:12.320515+0000","last_unstale":"2024-09-12T18:10:27.955171+0000","last_undegraded":"2024-09-12T18:10:27.955171+0000","last_fullsized":"2024-09-12T18:10:27.955171+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:58.500452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3181254,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":370,"num_read_kb":6790,"num_write":936,"num_write_kb":19852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'120","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:24.988567+0000","last_change":"2024-09-12T17:00:14.335557+0000","last_active":"2024-09-12T18:10:24.988567+0000","last_peered":"2024-09-12T18:10:24.988567+0000","last_clean":"2024-09-12T18:10:24.988567+0000","last_became_active":"2024-09-12T17:00:14.335297+0000","last_became_peered":"2024-09-12T17:00:14.335297+0000","last_unstale":"2024-09-12T18:10:24.988567+0000","last_undegraded":"2024-09-12T18:10:24.988567+0000","last_fullsized":"2024-09-12T18:10:24.988567+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:16.622130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":395,"num_write":174,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'267","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.110434+0000","last_change":"2024-09-12T17:00:12.313071+0000","last_active":"2024-09-12T18:11:11.110434+0000","last_peered":"2024-09-12T18:11:11.110434+0000","last_clean":"2024-09-12T18:11:11.110434+0000","last_became_active":"2024-09-12T17:00:12.312762+0000","last_became_peered":"2024-09-12T17:00:12.312762+0000","last_unstale":"2024-09-12T18:11:11.110434+0000","last_undegraded":"2024-09-12T18:11:11.110434+0000","last_fullsized":"2024-09-12T18:11:11.110434+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:00.055270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5075509,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":429,"num_read_kb":9220,"num_write":985,"num_write_kb":31558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'219","reported_seq":883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.743184+0000","last_change":"2024-09-12T17:00:14.322764+0000","last_active":"2024-09-12T18:10:27.743184+0000","last_peered":"2024-09-12T18:10:27.743184+0000","last_clean":"2024-09-12T18:10:27.743184+0000","last_became_active":"2024-09-12T17:00:14.321640+0000","last_became_peered":"2024-09-12T17:00:14.321640+0000","last_unstale":"2024-09-12T18:10:27.743184+0000","last_undegraded":"2024-09-12T18:10:27.743184+0000","last_fullsized":"2024-09-12T18:10:27.743184+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:15.723927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1016,"num_read_kb":865,"num_write":355,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'295","reported_seq":945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:17.499050+0000","last_change":"2024-09-12T17:00:12.320191+0000","last_active":"2024-09-12T18:13:17.499050+0000","last_peered":"2024-09-12T18:13:17.499050+0000","last_clean":"2024-09-12T18:13:17.499050+0000","last_became_active":"2024-09-12T17:00:12.319917+0000","last_became_peered":"2024-09-12T17:00:12.319917+0000","last_unstale":"2024-09-12T18:13:17.499050+0000","last_undegraded":"2024-09-12T18:13:17.499050+0000","last_fullsized":"2024-09-12T18:13:17.499050+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:05.028474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5225273,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":433,"num_read_kb":38212,"num_write":990,"num_write_kb":26572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'175","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:05.760285+0000","last_change":"2024-09-12T17:00:14.333352+0000","last_active":"2024-09-12T18:11:05.760285+0000","last_peered":"2024-09-12T18:11:05.760285+0000","last_clean":"2024-09-12T18:11:05.760285+0000","last_became_active":"2024-09-12T17:00:14.332940+0000","last_became_peered":"2024-09-12T17:00:14.332940+0000","last_unstale":"2024-09-12T18:11:05.760285+0000","last_undegraded":"2024-09-12T18:11:05.760285+0000","last_fullsized":"2024-09-12T18:11:05.760285+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:50.722062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":715,"num_read_kb":606,"num_write":241,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'264","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:16.757602+0000","last_change":"2024-09-12T17:00:12.305312+0000","last_active":"2024-09-12T18:13:16.757602+0000","last_peered":"2024-09-12T18:13:16.757602+0000","last_clean":"2024-09-12T18:13:16.757602+0000","last_became_active":"2024-09-12T17:00:12.304504+0000","last_became_peered":"2024-09-12T17:00:12.304504+0000","last_unstale":"2024-09-12T18:13:16.757602+0000","last_undegraded":"2024-09-12T18:13:16.757602+0000","last_fullsized":"2024-09-12T18:13:16.757602+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:07.619706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7430088,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":476,"num_read_kb":24452,"num_write":1034,"num_write_kb":21520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'176","reported_seq":772,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.961391+0000","last_change":"2024-09-12T17:00:14.332604+0000","last_active":"2024-09-12T18:11:07.961391+0000","last_peered":"2024-09-12T18:11:07.961391+0000","last_clean":"2024-09-12T18:11:07.961391+0000","last_became_active":"2024-09-12T17:00:14.332360+0000","last_became_peered":"2024-09-12T17:00:14.332360+0000","last_unstale":"2024-09-12T18:11:07.961391+0000","last_undegraded":"2024-09-12T18:11:07.961391+0000","last_fullsized":"2024-09-12T18:11:07.961391+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:55.182932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":738,"num_read_kb":599,"num_write":278,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'296","reported_seq":1001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:11.841796+0000","last_change":"2024-09-12T17:00:12.322666+0000","last_active":"2024-09-12T18:10:11.841796+0000","last_peered":"2024-09-12T18:10:11.841796+0000","last_clean":"2024-09-12T18:10:11.841796+0000","last_became_active":"2024-09-12T17:00:12.322419+0000","last_became_peered":"2024-09-12T17:00:12.322419+0000","last_unstale":"2024-09-12T18:10:11.841796+0000","last_undegraded":"2024-09-12T18:10:11.841796+0000","last_fullsized":"2024-09-12T18:10:11.841796+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:12.248593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1062757,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":594,"num_read_kb":7776,"num_write":1063,"num_write_kb":24985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'60","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:03.703001+0000","last_change":"2024-09-12T17:00:14.334885+0000","last_active":"2024-09-12T18:11:03.703001+0000","last_peered":"2024-09-12T18:11:03.703001+0000","last_clean":"2024-09-12T18:11:03.703001+0000","last_became_active":"2024-09-12T17:00:14.334586+0000","last_became_peered":"2024-09-12T17:00:14.334586+0000","last_unstale":"2024-09-12T18:11:03.703001+0000","last_undegraded":"2024-09-12T18:11:03.703001+0000","last_fullsized":"2024-09-12T18:11:03.703001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:29.087177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":225,"num_write":86,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'142","reported_seq":765,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:15.752206+0000","last_change":"2024-09-12T17:00:14.323537+0000","last_active":"2024-09-12T18:10:15.752206+0000","last_peered":"2024-09-12T18:10:15.752206+0000","last_clean":"2024-09-12T18:10:15.752206+0000","last_became_active":"2024-09-12T17:00:14.322771+0000","last_became_peered":"2024-09-12T17:00:14.322771+0000","last_unstale":"2024-09-12T18:10:15.752206+0000","last_undegraded":"2024-09-12T18:10:15.752206+0000","last_fullsized":"2024-09-12T18:10:15.752206+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:13.873569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":650,"num_read_kb":543,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'318","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.757582+0000","last_change":"2024-09-12T17:00:46.407269+0000","last_active":"2024-09-12T18:10:32.757582+0000","last_peered":"2024-09-12T18:10:32.757582+0000","last_clean":"2024-09-12T18:10:32.757582+0000","last_became_active":"2024-09-12T17:00:46.406911+0000","last_became_peered":"2024-09-12T17:00:46.406911+0000","last_unstale":"2024-09-12T18:10:32.757582+0000","last_undegraded":"2024-09-12T18:10:32.757582+0000","last_fullsized":"2024-09-12T18:10:32.757582+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:22.337640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14233470,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":693,"num_read_kb":51923,"num_write":1262,"num_write_kb":31895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'117","reported_seq":724,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.755079+0000","last_change":"2024-09-12T17:00:14.336399+0000","last_active":"2024-09-12T18:10:17.755079+0000","last_peered":"2024-09-12T18:10:17.755079+0000","last_clean":"2024-09-12T18:10:17.755079+0000","last_became_active":"2024-09-12T17:00:14.336161+0000","last_became_peered":"2024-09-12T17:00:14.336161+0000","last_unstale":"2024-09-12T18:10:17.755079+0000","last_undegraded":"2024-09-12T18:10:17.755079+0000","last_fullsized":"2024-09-12T18:10:17.755079+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:57.473607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":545,"num_read_kb":462,"num_write":195,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'271","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.741666+0000","last_change":"2024-09-12T17:00:12.310880+0000","last_active":"2024-09-12T18:10:17.741666+0000","last_peered":"2024-09-12T18:10:17.741666+0000","last_clean":"2024-09-12T18:10:17.741666+0000","last_became_active":"2024-09-12T17:00:12.310589+0000","last_became_peered":"2024-09-12T17:00:12.310589+0000","last_unstale":"2024-09-12T18:10:17.741666+0000","last_undegraded":"2024-09-12T18:10:17.741666+0000","last_fullsized":"2024-09-12T18:10:17.741666+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:43.821237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6903652,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":529,"num_read_kb":8321,"num_write":937,"num_write_kb":31830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'144","reported_seq":725,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.964476+0000","last_change":"2024-09-12T17:00:14.325153+0000","last_active":"2024-09-12T18:12:02.964476+0000","last_peered":"2024-09-12T18:12:02.964476+0000","last_clean":"2024-09-12T18:12:02.964476+0000","last_became_active":"2024-09-12T17:00:14.324889+0000","last_became_peered":"2024-09-12T17:00:14.324889+0000","last_unstale":"2024-09-12T18:12:02.964476+0000","last_undegraded":"2024-09-12T18:12:02.964476+0000","last_fullsized":"2024-09-12T18:12:02.964476+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:11.915771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":586,"num_read_kb":478,"num_write":211,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'274","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.741645+0000","last_change":"2024-09-12T17:00:12.315972+0000","last_active":"2024-09-12T18:10:17.741645+0000","last_peered":"2024-09-12T18:10:17.741645+0000","last_clean":"2024-09-12T18:10:17.741645+0000","last_became_active":"2024-09-12T17:00:12.315652+0000","last_became_peered":"2024-09-12T17:00:12.315652+0000","last_unstale":"2024-09-12T18:10:17.741645+0000","last_undegraded":"2024-09-12T18:10:17.741645+0000","last_fullsized":"2024-09-12T18:10:17.741645+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:33.033611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12167588,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":445,"num_read_kb":21524,"num_write":1030,"num_write_kb":35144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'78","reported_seq":629,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:18.698535+0000","last_change":"2024-09-12T17:00:14.335255+0000","last_active":"2024-09-12T18:10:18.698535+0000","last_peered":"2024-09-12T18:10:18.698535+0000","last_clean":"2024-09-12T18:10:18.698535+0000","last_became_active":"2024-09-12T17:00:14.335009+0000","last_became_peered":"2024-09-12T17:00:14.335009+0000","last_unstale":"2024-09-12T18:10:18.698535+0000","last_undegraded":"2024-09-12T18:10:18.698535+0000","last_fullsized":"2024-09-12T18:10:18.698535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:36.037057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":353,"num_read_kb":297,"num_write":121,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'284","reported_seq":945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.110941+0000","last_change":"2024-09-12T17:00:12.313118+0000","last_active":"2024-09-12T18:11:11.110941+0000","last_peered":"2024-09-12T18:11:11.110941+0000","last_clean":"2024-09-12T18:11:11.110941+0000","last_became_active":"2024-09-12T17:00:12.312828+0000","last_became_peered":"2024-09-12T17:00:12.312828+0000","last_unstale":"2024-09-12T18:11:11.110941+0000","last_undegraded":"2024-09-12T18:11:11.110941+0000","last_fullsized":"2024-09-12T18:11:11.110941+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:31.791812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22704252,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":470,"num_read_kb":47218,"num_write":1097,"num_write_kb":32154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'190","reported_seq":830,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:18.698566+0000","last_change":"2024-09-12T17:00:14.328021+0000","last_active":"2024-09-12T18:10:18.698566+0000","last_peered":"2024-09-12T18:10:18.698566+0000","last_clean":"2024-09-12T18:10:18.698566+0000","last_became_active":"2024-09-12T17:00:14.327744+0000","last_became_peered":"2024-09-12T17:00:14.327744+0000","last_unstale":"2024-09-12T18:10:18.698566+0000","last_undegraded":"2024-09-12T18:10:18.698566+0000","last_fullsized":"2024-09-12T18:10:18.698566+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:10.529599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":833,"num_read_kb":695,"num_write":274,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'251","reported_seq":1034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.234870+0000","last_change":"2024-09-12T17:00:12.319914+0000","last_active":"2024-09-12T18:10:20.234870+0000","last_peered":"2024-09-12T18:10:20.234870+0000","last_clean":"2024-09-12T18:10:20.234870+0000","last_became_active":"2024-09-12T17:00:12.319649+0000","last_became_peered":"2024-09-12T17:00:12.319649+0000","last_unstale":"2024-09-12T18:10:20.234870+0000","last_undegraded":"2024-09-12T18:10:20.234870+0000","last_fullsized":"2024-09-12T18:10:20.234870+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:03.094320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15976363,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":678,"num_read_kb":130250,"num_write":882,"num_write_kb":66985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'137","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.753208+0000","last_change":"2024-09-12T17:00:14.329425+0000","last_active":"2024-09-12T18:10:20.753208+0000","last_peered":"2024-09-12T18:10:20.753208+0000","last_clean":"2024-09-12T18:10:20.753208+0000","last_became_active":"2024-09-12T17:00:14.329107+0000","last_became_peered":"2024-09-12T17:00:14.329107+0000","last_unstale":"2024-09-12T18:10:20.753208+0000","last_undegraded":"2024-09-12T18:10:20.753208+0000","last_fullsized":"2024-09-12T18:10:20.753208+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:18.916868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":644,"num_read_kb":539,"num_write":215,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'300","reported_seq":1037,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.620317+0000","last_change":"2024-09-12T17:00:12.308630+0000","last_active":"2024-09-12T18:10:31.620317+0000","last_peered":"2024-09-12T18:10:31.620317+0000","last_clean":"2024-09-12T18:10:31.620317+0000","last_became_active":"2024-09-12T17:00:12.307906+0000","last_became_peered":"2024-09-12T17:00:12.307906+0000","last_unstale":"2024-09-12T18:10:31.620317+0000","last_undegraded":"2024-09-12T18:10:31.620317+0000","last_fullsized":"2024-09-12T18:10:31.620317+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:48.118605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1577780,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":645,"num_read_kb":3845,"num_write":1020,"num_write_kb":30178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'131","reported_seq":641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.108183+0000","last_change":"2024-09-12T17:00:22.355877+0000","last_active":"2024-09-12T18:12:03.108183+0000","last_peered":"2024-09-12T18:12:03.108183+0000","last_clean":"2024-09-12T18:12:03.108183+0000","last_became_active":"2024-09-12T17:00:22.355591+0000","last_became_peered":"2024-09-12T17:00:22.355591+0000","last_unstale":"2024-09-12T18:12:03.108183+0000","last_undegraded":"2024-09-12T18:12:03.108183+0000","last_fullsized":"2024-09-12T18:12:03.108183+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:28:58.673978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1447,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":175,"num_read_kb":172,"num_write":326,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'85","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.843638+0000","last_change":"2024-09-12T17:00:14.336449+0000","last_active":"2024-09-12T18:10:26.843638+0000","last_peered":"2024-09-12T18:10:26.843638+0000","last_clean":"2024-09-12T18:10:26.843638+0000","last_became_active":"2024-09-12T17:00:14.336144+0000","last_became_peered":"2024-09-12T17:00:14.336144+0000","last_unstale":"2024-09-12T18:10:26.843638+0000","last_undegraded":"2024-09-12T18:10:26.843638+0000","last_fullsized":"2024-09-12T18:10:26.843638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:36.033113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":388,"num_read_kb":332,"num_write":123,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'295","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.603834+0000","last_change":"2024-09-12T17:00:46.721301+0000","last_active":"2024-09-12T18:13:48.603834+0000","last_peered":"2024-09-12T18:13:48.603834+0000","last_clean":"2024-09-12T18:13:48.603834+0000","last_became_active":"2024-09-12T17:00:46.720989+0000","last_became_peered":"2024-09-12T17:00:46.720989+0000","last_unstale":"2024-09-12T18:13:48.603834+0000","last_undegraded":"2024-09-12T18:13:48.603834+0000","last_fullsized":"2024-09-12T18:13:48.603834+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:03.810826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4241249,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":444,"num_read_kb":63990,"num_write":1012,"num_write_kb":41211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954509+0000","last_change":"2024-09-12T17:00:16.326154+0000","last_active":"2024-09-12T18:10:22.954509+0000","last_peered":"2024-09-12T18:10:22.954509+0000","last_clean":"2024-09-12T18:10:22.954509+0000","last_became_active":"2024-09-12T17:00:16.325868+0000","last_became_peered":"2024-09-12T17:00:16.325868+0000","last_unstale":"2024-09-12T18:10:22.954509+0000","last_undegraded":"2024-09-12T18:10:22.954509+0000","last_fullsized":"2024-09-12T18:10:22.954509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:07.781526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'334","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:51.637120+0000","last_change":"2024-09-12T17:00:18.329828+0000","last_active":"2024-09-12T18:12:51.637120+0000","last_peered":"2024-09-12T18:12:51.637120+0000","last_clean":"2024-09-12T18:12:51.637120+0000","last_became_active":"2024-09-12T17:00:18.329515+0000","last_became_peered":"2024-09-12T17:00:18.329515+0000","last_unstale":"2024-09-12T18:12:51.637120+0000","last_undegraded":"2024-09-12T18:12:51.637120+0000","last_fullsized":"2024-09-12T18:12:51.637120+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:07.586238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57242,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":538,"num_read_kb":1038,"num_write":424,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.756841+0000","last_change":"2024-09-12T17:00:20.349019+0000","last_active":"2024-09-12T18:10:27.756841+0000","last_peered":"2024-09-12T18:10:27.756841+0000","last_clean":"2024-09-12T18:10:27.756841+0000","last_became_active":"2024-09-12T17:00:20.348524+0000","last_became_peered":"2024-09-12T17:00:20.348524+0000","last_unstale":"2024-09-12T18:10:27.756841+0000","last_undegraded":"2024-09-12T18:10:27.756841+0000","last_fullsized":"2024-09-12T18:10:27.756841+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:34.615435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'165","reported_seq":725,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:42.957515+0000","last_change":"2024-09-12T17:00:22.357994+0000","last_active":"2024-09-12T18:10:42.957515+0000","last_peered":"2024-09-12T18:10:42.957515+0000","last_clean":"2024-09-12T18:10:42.957515+0000","last_became_active":"2024-09-12T17:00:22.357688+0000","last_became_peered":"2024-09-12T17:00:22.357688+0000","last_unstale":"2024-09-12T18:10:42.957515+0000","last_undegraded":"2024-09-12T18:10:42.957515+0000","last_fullsized":"2024-09-12T18:10:42.957515+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:48.716325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":624,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":254,"num_read_kb":249,"num_write":335,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'314","reported_seq":940,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954488+0000","last_change":"2024-09-12T17:00:14.327416+0000","last_active":"2024-09-12T18:10:22.954488+0000","last_peered":"2024-09-12T18:10:22.954488+0000","last_clean":"2024-09-12T18:10:22.954488+0000","last_became_active":"2024-09-12T17:00:14.327170+0000","last_became_peered":"2024-09-12T17:00:14.327170+0000","last_unstale":"2024-09-12T18:10:22.954488+0000","last_undegraded":"2024-09-12T18:10:22.954488+0000","last_fullsized":"2024-09-12T18:10:22.954488+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:31.084615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1382,"num_read_kb":1112,"num_write":506,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'321","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:11.618016+0000","last_change":"2024-09-12T17:00:12.304639+0000","last_active":"2024-09-12T18:10:11.618016+0000","last_peered":"2024-09-12T18:10:11.618016+0000","last_clean":"2024-09-12T18:10:11.618016+0000","last_became_active":"2024-09-12T17:00:12.304357+0000","last_became_peered":"2024-09-12T17:00:12.304357+0000","last_unstale":"2024-09-12T18:10:11.618016+0000","last_undegraded":"2024-09-12T18:10:11.618016+0000","last_fullsized":"2024-09-12T18:10:11.618016+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:22.101694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14850658,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":585,"num_read_kb":22986,"num_write":1100,"num_write_kb":36092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.843647+0000","last_change":"2024-09-12T17:00:16.323972+0000","last_active":"2024-09-12T18:10:26.843647+0000","last_peered":"2024-09-12T18:10:26.843647+0000","last_clean":"2024-09-12T18:10:26.843647+0000","last_became_active":"2024-09-12T17:00:16.323601+0000","last_became_peered":"2024-09-12T17:00:16.323601+0000","last_unstale":"2024-09-12T18:10:26.843647+0000","last_undegraded":"2024-09-12T18:10:26.843647+0000","last_fullsized":"2024-09-12T18:10:26.843647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:58.961774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'106","reported_seq":646,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.602728+0000","last_change":"2024-09-12T17:00:18.328151+0000","last_active":"2024-09-12T18:11:11.602728+0000","last_peered":"2024-09-12T18:11:11.602728+0000","last_clean":"2024-09-12T18:11:11.602728+0000","last_became_active":"2024-09-12T17:00:18.327744+0000","last_became_peered":"2024-09-12T17:00:18.327744+0000","last_unstale":"2024-09-12T18:11:11.602728+0000","last_undegraded":"2024-09-12T18:11:11.602728+0000","last_fullsized":"2024-09-12T18:11:11.602728+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:37.786807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":113,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:25.753957+0000","last_change":"2024-09-12T17:00:20.348202+0000","last_active":"2024-09-12T18:10:25.753957+0000","last_peered":"2024-09-12T18:10:25.753957+0000","last_clean":"2024-09-12T18:10:25.753957+0000","last_became_active":"2024-09-12T17:00:20.347865+0000","last_became_peered":"2024-09-12T17:00:20.347865+0000","last_unstale":"2024-09-12T18:10:25.753957+0000","last_undegraded":"2024-09-12T18:10:25.753957+0000","last_fullsized":"2024-09-12T18:10:25.753957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:50.254374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'111","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619154+0000","last_change":"2024-09-12T17:00:22.353337+0000","last_active":"2024-09-12T18:10:21.619154+0000","last_peered":"2024-09-12T18:10:21.619154+0000","last_clean":"2024-09-12T18:10:21.619154+0000","last_became_active":"2024-09-12T17:00:22.352912+0000","last_became_peered":"2024-09-12T17:00:22.352912+0000","last_unstale":"2024-09-12T18:10:21.619154+0000","last_undegraded":"2024-09-12T18:10:21.619154+0000","last_fullsized":"2024-09-12T18:10:21.619154+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:40.097046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":708,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":149,"num_read_kb":144,"num_write":248,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'179","reported_seq":806,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619226+0000","last_change":"2024-09-12T17:00:14.337811+0000","last_active":"2024-09-12T18:10:21.619226+0000","last_peered":"2024-09-12T18:10:21.619226+0000","last_clean":"2024-09-12T18:10:21.619226+0000","last_became_active":"2024-09-12T17:00:14.337515+0000","last_became_peered":"2024-09-12T17:00:14.337515+0000","last_unstale":"2024-09-12T18:10:21.619226+0000","last_undegraded":"2024-09-12T18:10:21.619226+0000","last_fullsized":"2024-09-12T18:10:21.619226+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:45.954756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":863,"num_read_kb":715,"num_write":299,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'304","reported_seq":965,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.671210+0000","last_change":"2024-09-12T17:00:12.308357+0000","last_active":"2024-09-12T18:10:17.671210+0000","last_peered":"2024-09-12T18:10:17.671210+0000","last_clean":"2024-09-12T18:10:17.671210+0000","last_became_active":"2024-09-12T17:00:12.308065+0000","last_became_peered":"2024-09-12T17:00:12.308065+0000","last_unstale":"2024-09-12T18:10:17.671210+0000","last_undegraded":"2024-09-12T18:10:17.671210+0000","last_fullsized":"2024-09-12T18:10:17.671210+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:01.954058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1304272,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":441,"num_read_kb":43207,"num_write":1105,"num_write_kb":32106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.843124+0000","last_change":"2024-09-12T17:00:16.326520+0000","last_active":"2024-09-12T18:10:21.843124+0000","last_peered":"2024-09-12T18:10:21.843124+0000","last_clean":"2024-09-12T18:10:21.843124+0000","last_became_active":"2024-09-12T17:00:16.326073+0000","last_became_peered":"2024-09-12T17:00:16.326073+0000","last_unstale":"2024-09-12T18:10:21.843124+0000","last_undegraded":"2024-09-12T18:10:21.843124+0000","last_fullsized":"2024-09-12T18:10:21.843124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:41.659835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'139","reported_seq":693,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.703133+0000","last_change":"2024-09-12T17:00:18.327751+0000","last_active":"2024-09-12T18:11:11.703133+0000","last_peered":"2024-09-12T18:11:11.703133+0000","last_clean":"2024-09-12T18:11:11.703133+0000","last_became_active":"2024-09-12T17:00:18.327448+0000","last_became_peered":"2024-09-12T17:00:18.327448+0000","last_unstale":"2024-09-12T18:11:11.703133+0000","last_undegraded":"2024-09-12T18:11:11.703133+0000","last_fullsized":"2024-09-12T18:11:11.703133+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:36.026074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":172,"num_read_kb":164,"num_write":118,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'763","reported_seq":2562,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.300067+0000","last_change":"2024-09-12T17:00:20.351615+0000","last_active":"2024-09-12T18:13:23.300067+0000","last_peered":"2024-09-12T18:13:23.300067+0000","last_clean":"2024-09-12T18:13:23.300067+0000","last_became_active":"2024-09-12T17:00:20.351202+0000","last_became_peered":"2024-09-12T17:00:20.351202+0000","last_unstale":"2024-09-12T18:13:23.300067+0000","last_undegraded":"2024-09-12T18:13:23.300067+0000","last_fullsized":"2024-09-12T18:13:23.300067+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:43.494236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'205","reported_seq":1031,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.168160+0000","last_change":"2024-09-12T17:00:22.588416+0000","last_active":"2024-09-12T18:12:03.168160+0000","last_peered":"2024-09-12T18:12:03.168160+0000","last_clean":"2024-09-12T18:12:03.168160+0000","last_became_active":"2024-09-12T17:00:22.588111+0000","last_became_peered":"2024-09-12T17:00:22.588111+0000","last_unstale":"2024-09-12T18:12:03.168160+0000","last_undegraded":"2024-09-12T18:12:03.168160+0000","last_fullsized":"2024-09-12T18:12:03.168160+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:50.047140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":621,"num_read_kb":619,"num_write":443,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'162","reported_seq":797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.843103+0000","last_change":"2024-09-12T17:00:14.332706+0000","last_active":"2024-09-12T18:10:21.843103+0000","last_peered":"2024-09-12T18:10:21.843103+0000","last_clean":"2024-09-12T18:10:21.843103+0000","last_became_active":"2024-09-12T17:00:14.332424+0000","last_became_peered":"2024-09-12T17:00:14.332424+0000","last_unstale":"2024-09-12T18:10:21.843103+0000","last_undegraded":"2024-09-12T18:10:21.843103+0000","last_fullsized":"2024-09-12T18:10:21.843103+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:36.277637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":720,"num_read_kb":605,"num_write":258,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'291","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.740789+0000","last_change":"2024-09-12T17:00:12.310686+0000","last_active":"2024-09-12T18:10:12.740789+0000","last_peered":"2024-09-12T18:10:12.740789+0000","last_clean":"2024-09-12T18:10:12.740789+0000","last_became_active":"2024-09-12T17:00:12.310337+0000","last_became_peered":"2024-09-12T17:00:12.310337+0000","last_unstale":"2024-09-12T18:10:12.740789+0000","last_undegraded":"2024-09-12T18:10:12.740789+0000","last_fullsized":"2024-09-12T18:10:12.740789+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:54.402983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5640791,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":490,"num_read_kb":13227,"num_write":1060,"num_write_kb":37058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954568+0000","last_change":"2024-09-12T17:00:16.325390+0000","last_active":"2024-09-12T18:10:22.954568+0000","last_peered":"2024-09-12T18:10:22.954568+0000","last_clean":"2024-09-12T18:10:22.954568+0000","last_became_active":"2024-09-12T17:00:16.325141+0000","last_became_peered":"2024-09-12T17:00:16.325141+0000","last_unstale":"2024-09-12T18:10:22.954568+0000","last_undegraded":"2024-09-12T18:10:22.954568+0000","last_fullsized":"2024-09-12T18:10:22.954568+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:43.724058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'304","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:47.778635+0000","last_change":"2024-09-12T17:00:18.430347+0000","last_active":"2024-09-12T18:12:47.778635+0000","last_peered":"2024-09-12T18:12:47.778635+0000","last_clean":"2024-09-12T18:12:47.778635+0000","last_became_active":"2024-09-12T17:00:18.430046+0000","last_became_peered":"2024-09-12T17:00:18.430046+0000","last_unstale":"2024-09-12T18:12:47.778635+0000","last_undegraded":"2024-09-12T18:12:47.778635+0000","last_fullsized":"2024-09-12T18:12:47.778635+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:57.355912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62169,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":1042,"num_write":394,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'768","reported_seq":2857,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.310309+0000","last_change":"2024-09-12T17:00:20.354448+0000","last_active":"2024-09-12T18:13:23.310309+0000","last_peered":"2024-09-12T18:13:23.310309+0000","last_clean":"2024-09-12T18:13:23.310309+0000","last_became_active":"2024-09-12T17:00:20.353914+0000","last_became_peered":"2024-09-12T17:00:20.353914+0000","last_unstale":"2024-09-12T18:13:23.310309+0000","last_undegraded":"2024-09-12T18:13:23.310309+0000","last_fullsized":"2024-09-12T18:13:23.310309+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:46.082984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'89","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:37.947552+0000","last_change":"2024-09-12T17:00:14.325929+0000","last_active":"2024-09-12T18:09:37.947552+0000","last_peered":"2024-09-12T18:09:37.947552+0000","last_clean":"2024-09-12T18:09:37.947552+0000","last_became_active":"2024-09-12T17:00:14.325669+0000","last_became_peered":"2024-09-12T17:00:14.325669+0000","last_unstale":"2024-09-12T18:09:37.947552+0000","last_undegraded":"2024-09-12T18:09:37.947552+0000","last_fullsized":"2024-09-12T18:09:37.947552+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:13.770284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":392,"num_read_kb":330,"num_write":131,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'290","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.754262+0000","last_change":"2024-09-12T17:00:12.315298+0000","last_active":"2024-09-12T18:10:12.754262+0000","last_peered":"2024-09-12T18:10:12.754262+0000","last_clean":"2024-09-12T18:10:12.754262+0000","last_became_active":"2024-09-12T17:00:12.315015+0000","last_became_peered":"2024-09-12T17:00:12.315015+0000","last_unstale":"2024-09-12T18:10:12.754262+0000","last_undegraded":"2024-09-12T18:10:12.754262+0000","last_fullsized":"2024-09-12T18:10:12.754262+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:05.029334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7831419,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":401,"num_read_kb":13972,"num_write":1058,"num_write_kb":21819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:37.748595+0000","last_change":"2024-09-12T17:00:16.323002+0000","last_active":"2024-09-12T18:09:37.748595+0000","last_peered":"2024-09-12T18:09:37.748595+0000","last_clean":"2024-09-12T18:09:37.748595+0000","last_became_active":"2024-09-12T17:00:16.322693+0000","last_became_peered":"2024-09-12T17:00:16.322693+0000","last_unstale":"2024-09-12T18:09:37.748595+0000","last_undegraded":"2024-09-12T18:09:37.748595+0000","last_fullsized":"2024-09-12T18:09:37.748595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:02.469282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'390","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.970788+0000","last_change":"2024-09-12T17:00:18.429427+0000","last_active":"2024-09-12T18:12:02.970788+0000","last_peered":"2024-09-12T18:12:02.970788+0000","last_clean":"2024-09-12T18:12:02.970788+0000","last_became_active":"2024-09-12T17:00:18.429137+0000","last_became_peered":"2024-09-12T17:00:18.429137+0000","last_unstale":"2024-09-12T18:12:02.970788+0000","last_undegraded":"2024-09-12T18:12:02.970788+0000","last_fullsized":"2024-09-12T18:12:02.970788+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:07.774572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60365,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":643,"num_read_kb":1198,"num_write":502,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:08.915747+0000","last_change":"2024-09-12T17:00:20.348773+0000","last_active":"2024-09-12T18:10:08.915747+0000","last_peered":"2024-09-12T18:10:08.915747+0000","last_clean":"2024-09-12T18:10:08.915747+0000","last_became_active":"2024-09-12T17:00:20.348507+0000","last_became_peered":"2024-09-12T17:00:20.348507+0000","last_unstale":"2024-09-12T18:10:08.915747+0000","last_undegraded":"2024-09-12T18:10:08.915747+0000","last_fullsized":"2024-09-12T18:10:08.915747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:15:32.541811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'560","reported_seq":1385,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.026506+0000","last_change":"2024-09-12T17:00:22.358717+0000","last_active":"2024-09-12T18:13:23.026506+0000","last_peered":"2024-09-12T18:13:23.026506+0000","last_clean":"2024-09-12T18:13:23.026506+0000","last_became_active":"2024-09-12T17:00:22.358335+0000","last_became_peered":"2024-09-12T17:00:22.358335+0000","last_unstale":"2024-09-12T18:13:23.026506+0000","last_undegraded":"2024-09-12T18:13:23.026506+0000","last_fullsized":"2024-09-12T18:13:23.026506+0000","mapping_epoch":34,"log_start":"264'500","ondisk_log_start":"264'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:28.398620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1357,"num_read_kb":1346,"num_write":1162,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'63","reported_seq":629,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:02.633138+0000","last_change":"2024-09-12T17:00:14.336132+0000","last_active":"2024-09-12T18:10:02.633138+0000","last_peered":"2024-09-12T18:10:02.633138+0000","last_clean":"2024-09-12T18:10:02.633138+0000","last_became_active":"2024-09-12T17:00:14.335783+0000","last_became_peered":"2024-09-12T17:00:14.335783+0000","last_unstale":"2024-09-12T18:10:02.633138+0000","last_undegraded":"2024-09-12T18:10:02.633138+0000","last_fullsized":"2024-09-12T18:10:02.633138+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:05.231999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":238,"num_write":99,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'353","reported_seq":1084,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.099603+0000","last_change":"2024-09-12T17:00:12.307583+0000","last_active":"2024-09-12T18:11:11.099603+0000","last_peered":"2024-09-12T18:11:11.099603+0000","last_clean":"2024-09-12T18:11:11.099603+0000","last_became_active":"2024-09-12T17:00:12.307222+0000","last_became_peered":"2024-09-12T17:00:12.307222+0000","last_unstale":"2024-09-12T18:11:11.099603+0000","last_undegraded":"2024-09-12T18:11:11.099603+0000","last_fullsized":"2024-09-12T18:11:11.099603+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:19.672373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10140548,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":799,"num_read_kb":14510,"num_write":1323,"num_write_kb":34813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:38.694721+0000","last_change":"2024-09-12T17:00:16.323257+0000","last_active":"2024-09-12T18:09:38.694721+0000","last_peered":"2024-09-12T18:09:38.694721+0000","last_clean":"2024-09-12T18:09:38.694721+0000","last_became_active":"2024-09-12T17:00:16.322917+0000","last_became_peered":"2024-09-12T17:00:16.322917+0000","last_unstale":"2024-09-12T18:09:38.694721+0000","last_undegraded":"2024-09-12T18:09:38.694721+0000","last_fullsized":"2024-09-12T18:09:38.694721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:45.972956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'263","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.857790+0000","last_change":"2024-09-12T17:00:18.327458+0000","last_active":"2024-09-12T18:12:21.857790+0000","last_peered":"2024-09-12T18:12:21.857790+0000","last_clean":"2024-09-12T18:12:21.857790+0000","last_became_active":"2024-09-12T17:00:18.326791+0000","last_became_peered":"2024-09-12T17:00:18.326791+0000","last_unstale":"2024-09-12T18:12:21.857790+0000","last_undegraded":"2024-09-12T18:12:21.857790+0000","last_fullsized":"2024-09-12T18:12:21.857790+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:25.837684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44513,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":415,"num_read_kb":856,"num_write":332,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:51.839530+0000","last_change":"2024-09-12T17:00:20.354443+0000","last_active":"2024-09-12T18:09:51.839530+0000","last_peered":"2024-09-12T18:09:51.839530+0000","last_clean":"2024-09-12T18:09:51.839530+0000","last_became_active":"2024-09-12T17:00:20.353959+0000","last_became_peered":"2024-09-12T17:00:20.353959+0000","last_unstale":"2024-09-12T18:09:51.839530+0000","last_undegraded":"2024-09-12T18:09:51.839530+0000","last_fullsized":"2024-09-12T18:09:51.839530+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:48.338493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'2407","reported_seq":4230,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:12.155626+0000","last_change":"2024-09-12T17:00:22.356576+0000","last_active":"2024-09-12T18:13:12.155626+0000","last_peered":"2024-09-12T18:13:12.155626+0000","last_clean":"2024-09-12T18:13:12.155626+0000","last_became_active":"2024-09-12T17:00:22.355651+0000","last_became_peered":"2024-09-12T17:00:22.355651+0000","last_unstale":"2024-09-12T18:13:12.155626+0000","last_undegraded":"2024-09-12T18:13:12.155626+0000","last_fullsized":"2024-09-12T18:13:12.155626+0000","mapping_epoch":34,"log_start":"264'2300","ondisk_log_start":"264'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":2300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:33.472074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6022,"num_read_kb":6027,"num_write":4838,"num_write_kb":1790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'196","reported_seq":775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:47.737352+0000","last_change":"2024-09-12T17:00:14.322357+0000","last_active":"2024-09-12T18:09:47.737352+0000","last_peered":"2024-09-12T18:09:47.737352+0000","last_clean":"2024-09-12T18:09:47.737352+0000","last_became_active":"2024-09-12T17:00:14.321270+0000","last_became_peered":"2024-09-12T17:00:14.321270+0000","last_unstale":"2024-09-12T18:09:47.737352+0000","last_undegraded":"2024-09-12T18:09:47.737352+0000","last_fullsized":"2024-09-12T18:09:47.737352+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:12.413462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":834,"num_read_kb":668,"num_write":296,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'253","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:57.751764+0000","last_change":"2024-09-12T17:00:12.313574+0000","last_active":"2024-09-12T18:09:57.751764+0000","last_peered":"2024-09-12T18:09:57.751764+0000","last_clean":"2024-09-12T18:09:57.751764+0000","last_became_active":"2024-09-12T17:00:12.313262+0000","last_became_peered":"2024-09-12T17:00:12.313262+0000","last_unstale":"2024-09-12T18:09:57.751764+0000","last_undegraded":"2024-09-12T18:09:57.751764+0000","last_fullsized":"2024-09-12T18:09:57.751764+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:31.359986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5803248,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":389,"num_read_kb":16364,"num_write":921,"num_write_kb":27335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:03.697059+0000","last_change":"2024-09-12T17:00:16.321983+0000","last_active":"2024-09-12T18:10:03.697059+0000","last_peered":"2024-09-12T18:10:03.697059+0000","last_clean":"2024-09-12T18:10:03.697059+0000","last_became_active":"2024-09-12T17:00:16.321641+0000","last_became_peered":"2024-09-12T17:00:16.321641+0000","last_unstale":"2024-09-12T18:10:03.697059+0000","last_undegraded":"2024-09-12T18:10:03.697059+0000","last_fullsized":"2024-09-12T18:10:03.697059+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:37.927815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'333","reported_seq":933,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.769289+0000","last_change":"2024-09-12T17:00:18.331983+0000","last_active":"2024-09-12T18:11:47.769289+0000","last_peered":"2024-09-12T18:11:47.769289+0000","last_clean":"2024-09-12T18:11:47.769289+0000","last_became_active":"2024-09-12T17:00:18.331707+0000","last_became_peered":"2024-09-12T17:00:18.331707+0000","last_unstale":"2024-09-12T18:11:47.769289+0000","last_undegraded":"2024-09-12T18:11:47.769289+0000","last_fullsized":"2024-09-12T18:11:47.769289+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:34.769849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":539,"num_read_kb":1080,"num_write":430,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'762","reported_seq":2724,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.300062+0000","last_change":"2024-09-12T17:00:20.348555+0000","last_active":"2024-09-12T18:13:23.300062+0000","last_peered":"2024-09-12T18:13:23.300062+0000","last_clean":"2024-09-12T18:13:23.300062+0000","last_became_active":"2024-09-12T17:00:20.348227+0000","last_became_peered":"2024-09-12T17:00:20.348227+0000","last_unstale":"2024-09-12T18:13:23.300062+0000","last_undegraded":"2024-09-12T18:13:23.300062+0000","last_fullsized":"2024-09-12T18:13:23.300062+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:53.853058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'115","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:21.824797+0000","last_change":"2024-09-12T17:00:22.353551+0000","last_active":"2024-09-12T18:13:21.824797+0000","last_peered":"2024-09-12T18:13:21.824797+0000","last_clean":"2024-09-12T18:13:21.824797+0000","last_became_active":"2024-09-12T17:00:22.353172+0000","last_became_peered":"2024-09-12T17:00:22.353172+0000","last_unstale":"2024-09-12T18:13:21.824797+0000","last_undegraded":"2024-09-12T18:13:21.824797+0000","last_fullsized":"2024-09-12T18:13:21.824797+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:21.794645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":136,"num_write":299,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'230","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:01.616940+0000","last_change":"2024-09-12T17:00:14.325124+0000","last_active":"2024-09-12T18:10:01.616940+0000","last_peered":"2024-09-12T18:10:01.616940+0000","last_clean":"2024-09-12T18:10:01.616940+0000","last_became_active":"2024-09-12T17:00:14.324823+0000","last_became_peered":"2024-09-12T17:00:14.324823+0000","last_unstale":"2024-09-12T18:10:01.616940+0000","last_undegraded":"2024-09-12T18:10:01.616940+0000","last_fullsized":"2024-09-12T18:10:01.616940+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:32.044281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1013,"num_read_kb":830,"num_write":393,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'330","reported_seq":1018,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.111454+0000","last_change":"2024-09-12T17:00:12.320393+0000","last_active":"2024-09-12T18:11:11.111454+0000","last_peered":"2024-09-12T18:11:11.111454+0000","last_clean":"2024-09-12T18:11:11.111454+0000","last_became_active":"2024-09-12T17:00:12.318599+0000","last_became_peered":"2024-09-12T17:00:12.318599+0000","last_unstale":"2024-09-12T18:11:11.111454+0000","last_undegraded":"2024-09-12T18:11:11.111454+0000","last_fullsized":"2024-09-12T18:11:11.111454+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:50.621777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15341102,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":618,"num_read_kb":44820,"num_write":1100,"num_write_kb":32428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.695712+0000","last_change":"2024-09-12T17:00:16.328658+0000","last_active":"2024-09-12T18:09:48.695712+0000","last_peered":"2024-09-12T18:09:48.695712+0000","last_clean":"2024-09-12T18:09:48.695712+0000","last_became_active":"2024-09-12T17:00:16.328352+0000","last_became_peered":"2024-09-12T17:00:16.328352+0000","last_unstale":"2024-09-12T18:09:48.695712+0000","last_undegraded":"2024-09-12T18:09:48.695712+0000","last_fullsized":"2024-09-12T18:09:48.695712+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:37.939908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'469","reported_seq":1117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:22.995145+0000","last_change":"2024-09-12T17:00:18.330361+0000","last_active":"2024-09-12T18:13:22.995145+0000","last_peered":"2024-09-12T18:13:22.995145+0000","last_clean":"2024-09-12T18:13:22.995145+0000","last_became_active":"2024-09-12T17:00:18.329414+0000","last_became_peered":"2024-09-12T17:00:18.329414+0000","last_unstale":"2024-09-12T18:13:22.995145+0000","last_undegraded":"2024-09-12T18:13:22.995145+0000","last_fullsized":"2024-09-12T18:13:22.995145+0000","mapping_epoch":30,"log_start":"264'400","ondisk_log_start":"264'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:30.562657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112362,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":817,"num_read_kb":1813,"num_write":672,"num_write_kb":559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:43.695251+0000","last_change":"2024-09-12T17:00:20.352541+0000","last_active":"2024-09-12T18:09:43.695251+0000","last_peered":"2024-09-12T18:09:43.695251+0000","last_clean":"2024-09-12T18:09:43.695251+0000","last_became_active":"2024-09-12T17:00:20.352249+0000","last_became_peered":"2024-09-12T17:00:20.352249+0000","last_unstale":"2024-09-12T18:09:43.695251+0000","last_undegraded":"2024-09-12T18:09:43.695251+0000","last_fullsized":"2024-09-12T18:09:43.695251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:48.788159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'178","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:21.825345+0000","last_change":"2024-09-12T17:00:22.356296+0000","last_active":"2024-09-12T18:13:21.825345+0000","last_peered":"2024-09-12T18:13:21.825345+0000","last_clean":"2024-09-12T18:13:21.825345+0000","last_became_active":"2024-09-12T17:00:22.355850+0000","last_became_peered":"2024-09-12T17:00:22.355850+0000","last_unstale":"2024-09-12T18:13:21.825345+0000","last_undegraded":"2024-09-12T18:13:21.825345+0000","last_fullsized":"2024-09-12T18:13:21.825345+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:23.406645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":278,"num_read_kb":264,"num_write":436,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'144","reported_seq":751,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:00.750221+0000","last_change":"2024-09-12T17:00:14.334908+0000","last_active":"2024-09-12T18:10:00.750221+0000","last_peered":"2024-09-12T18:10:00.750221+0000","last_clean":"2024-09-12T18:10:00.750221+0000","last_became_active":"2024-09-12T17:00:14.334594+0000","last_became_peered":"2024-09-12T17:00:14.334594+0000","last_unstale":"2024-09-12T18:10:00.750221+0000","last_undegraded":"2024-09-12T18:10:00.750221+0000","last_fullsized":"2024-09-12T18:10:00.750221+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:18.668081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":624,"num_read_kb":516,"num_write":207,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'275","reported_seq":910,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:56.840088+0000","last_change":"2024-09-12T17:00:12.314796+0000","last_active":"2024-09-12T18:09:56.840088+0000","last_peered":"2024-09-12T18:09:56.840088+0000","last_clean":"2024-09-12T18:09:56.840088+0000","last_became_active":"2024-09-12T17:00:12.314509+0000","last_became_peered":"2024-09-12T17:00:12.314509+0000","last_unstale":"2024-09-12T18:09:56.840088+0000","last_undegraded":"2024-09-12T18:09:56.840088+0000","last_fullsized":"2024-09-12T18:09:56.840088+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:46.851692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2230784,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":373,"num_read_kb":51555,"num_write":969,"num_write_kb":32245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:03.697102+0000","last_change":"2024-09-12T17:00:16.319604+0000","last_active":"2024-09-12T18:10:03.697102+0000","last_peered":"2024-09-12T18:10:03.697102+0000","last_clean":"2024-09-12T18:10:03.697102+0000","last_became_active":"2024-09-12T17:00:16.319269+0000","last_became_peered":"2024-09-12T17:00:16.319269+0000","last_unstale":"2024-09-12T18:10:03.697102+0000","last_undegraded":"2024-09-12T18:10:03.697102+0000","last_fullsized":"2024-09-12T18:10:03.697102+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:36.474369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'290","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:20.771635+0000","last_change":"2024-09-12T17:00:18.331052+0000","last_active":"2024-09-12T18:12:20.771635+0000","last_peered":"2024-09-12T18:12:20.771635+0000","last_clean":"2024-09-12T18:12:20.771635+0000","last_became_active":"2024-09-12T17:00:18.330634+0000","last_became_peered":"2024-09-12T17:00:18.330634+0000","last_unstale":"2024-09-12T18:12:20.771635+0000","last_undegraded":"2024-09-12T18:12:20.771635+0000","last_fullsized":"2024-09-12T18:12:20.771635+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:16.080984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48618,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":482,"num_read_kb":940,"num_write":426,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.619832+0000","last_change":"2024-09-12T17:00:20.351332+0000","last_active":"2024-09-12T18:10:26.619832+0000","last_peered":"2024-09-12T18:10:26.619832+0000","last_clean":"2024-09-12T18:10:26.619832+0000","last_became_active":"2024-09-12T17:00:20.351001+0000","last_became_peered":"2024-09-12T17:00:20.351001+0000","last_unstale":"2024-09-12T18:10:26.619832+0000","last_undegraded":"2024-09-12T18:10:26.619832+0000","last_fullsized":"2024-09-12T18:10:26.619832+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:04.653097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'120","reported_seq":621,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:31.859249+0000","last_change":"2024-09-12T17:00:22.357302+0000","last_active":"2024-09-12T18:12:31.859249+0000","last_peered":"2024-09-12T18:12:31.859249+0000","last_clean":"2024-09-12T18:12:31.859249+0000","last_became_active":"2024-09-12T17:00:22.357001+0000","last_became_peered":"2024-09-12T17:00:22.357001+0000","last_unstale":"2024-09-12T18:12:31.859249+0000","last_undegraded":"2024-09-12T18:12:31.859249+0000","last_fullsized":"2024-09-12T18:12:31.859249+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:15.408471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":156,"num_write":307,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'263","reported_seq":888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:00.750266+0000","last_change":"2024-09-12T17:00:14.321295+0000","last_active":"2024-09-12T18:10:00.750266+0000","last_peered":"2024-09-12T18:10:00.750266+0000","last_clean":"2024-09-12T18:10:00.750266+0000","last_became_active":"2024-09-12T17:00:14.320928+0000","last_became_peered":"2024-09-12T17:00:14.320928+0000","last_unstale":"2024-09-12T18:10:00.750266+0000","last_undegraded":"2024-09-12T18:10:00.750266+0000","last_fullsized":"2024-09-12T18:10:00.750266+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:10.035416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1139,"num_read_kb":929,"num_write":426,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'288","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:21.087995+0000","last_change":"2024-09-12T17:00:12.309266+0000","last_active":"2024-09-12T18:13:21.087995+0000","last_peered":"2024-09-12T18:13:21.087995+0000","last_clean":"2024-09-12T18:13:21.087995+0000","last_became_active":"2024-09-12T17:00:12.308967+0000","last_became_peered":"2024-09-12T17:00:12.308967+0000","last_unstale":"2024-09-12T18:13:21.087995+0000","last_undegraded":"2024-09-12T18:13:21.087995+0000","last_fullsized":"2024-09-12T18:13:21.087995+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:08.219861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17328515,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":460,"num_read_kb":120658,"num_write":1027,"num_write_kb":55796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:03.915218+0000","last_change":"2024-09-12T17:00:16.329927+0000","last_active":"2024-09-12T18:10:03.915218+0000","last_peered":"2024-09-12T18:10:03.915218+0000","last_clean":"2024-09-12T18:10:03.915218+0000","last_became_active":"2024-09-12T17:00:16.329596+0000","last_became_peered":"2024-09-12T17:00:16.329596+0000","last_unstale":"2024-09-12T18:10:03.915218+0000","last_undegraded":"2024-09-12T18:10:03.915218+0000","last_fullsized":"2024-09-12T18:10:03.915218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:12.864819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'340","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.024314+0000","last_change":"2024-09-12T17:00:18.332460+0000","last_active":"2024-09-12T18:13:23.024314+0000","last_peered":"2024-09-12T18:13:23.024314+0000","last_clean":"2024-09-12T18:13:23.024314+0000","last_became_active":"2024-09-12T17:00:18.331483+0000","last_became_peered":"2024-09-12T17:00:18.331483+0000","last_unstale":"2024-09-12T18:13:23.024314+0000","last_undegraded":"2024-09-12T18:13:23.024314+0000","last_fullsized":"2024-09-12T18:13:23.024314+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:15:12.963116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65937,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":560,"num_read_kb":1138,"num_write":450,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'737","reported_seq":4702,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.188075+0000","last_change":"2024-09-12T17:00:20.352350+0000","last_active":"2024-09-12T18:13:48.188075+0000","last_peered":"2024-09-12T18:13:48.188075+0000","last_clean":"2024-09-12T18:13:48.188075+0000","last_became_active":"2024-09-12T17:00:20.352022+0000","last_became_peered":"2024-09-12T17:00:20.352022+0000","last_unstale":"2024-09-12T18:13:48.188075+0000","last_undegraded":"2024-09-12T18:13:48.188075+0000","last_fullsized":"2024-09-12T18:13:48.188075+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:52.501993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'82","reported_seq":594,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.524395+0000","last_change":"2024-09-12T17:00:22.350570+0000","last_active":"2024-09-12T18:12:00.524395+0000","last_peered":"2024-09-12T18:12:00.524395+0000","last_clean":"2024-09-12T18:12:00.524395+0000","last_became_active":"2024-09-12T17:00:22.350283+0000","last_became_peered":"2024-09-12T17:00:22.350283+0000","last_unstale":"2024-09-12T18:12:00.524395+0000","last_undegraded":"2024-09-12T18:12:00.524395+0000","last_fullsized":"2024-09-12T18:12:00.524395+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:18.622278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":129,"num_read_kb":121,"num_write":196,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'24","reported_seq":569,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:09.884675+0000","last_change":"2024-09-12T17:00:14.326073+0000","last_active":"2024-09-12T18:10:09.884675+0000","last_peered":"2024-09-12T18:10:09.884675+0000","last_clean":"2024-09-12T18:10:09.884675+0000","last_became_active":"2024-09-12T17:00:14.325788+0000","last_became_peered":"2024-09-12T17:00:14.325788+0000","last_unstale":"2024-09-12T18:10:09.884675+0000","last_undegraded":"2024-09-12T18:10:09.884675+0000","last_fullsized":"2024-09-12T18:10:09.884675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:24.940646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":96,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'260","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:35.746667+0000","last_change":"2024-09-12T17:00:12.309670+0000","last_active":"2024-09-12T18:09:35.746667+0000","last_peered":"2024-09-12T18:09:35.746667+0000","last_clean":"2024-09-12T18:09:35.746667+0000","last_became_active":"2024-09-12T17:00:12.309388+0000","last_became_peered":"2024-09-12T17:00:12.309388+0000","last_unstale":"2024-09-12T18:09:35.746667+0000","last_undegraded":"2024-09-12T18:09:35.746667+0000","last_fullsized":"2024-09-12T18:09:35.746667+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:00.188061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6128646,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":479,"num_read_kb":20467,"num_write":1037,"num_write_kb":21258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1468,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:47.955497+0000","last_change":"2024-09-12T17:00:16.330362+0000","last_active":"2024-09-12T18:13:47.955497+0000","last_peered":"2024-09-12T18:13:47.955497+0000","last_clean":"2024-09-12T18:13:47.955497+0000","last_became_active":"2024-09-12T17:00:16.330035+0000","last_became_peered":"2024-09-12T17:00:16.330035+0000","last_unstale":"2024-09-12T18:13:47.955497+0000","last_undegraded":"2024-09-12T18:13:47.955497+0000","last_fullsized":"2024-09-12T18:13:47.955497+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:23.800125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":963,"num_read_kb":963,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'102","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.018578+0000","last_change":"2024-09-12T17:00:18.429647+0000","last_active":"2024-09-12T18:11:11.018578+0000","last_peered":"2024-09-12T18:11:11.018578+0000","last_clean":"2024-09-12T18:11:11.018578+0000","last_became_active":"2024-09-12T17:00:18.429253+0000","last_became_peered":"2024-09-12T17:00:18.429253+0000","last_unstale":"2024-09-12T18:11:11.018578+0000","last_undegraded":"2024-09-12T18:11:11.018578+0000","last_fullsized":"2024-09-12T18:11:11.018578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:37.177018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'781","reported_seq":2530,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.332686+0000","last_change":"2024-09-12T17:00:20.353257+0000","last_active":"2024-09-12T18:13:23.332686+0000","last_peered":"2024-09-12T18:13:23.332686+0000","last_clean":"2024-09-12T18:13:23.332686+0000","last_became_active":"2024-09-12T17:00:20.352792+0000","last_became_peered":"2024-09-12T17:00:20.352792+0000","last_unstale":"2024-09-12T18:13:23.332686+0000","last_undegraded":"2024-09-12T18:13:23.332686+0000","last_fullsized":"2024-09-12T18:13:23.332686+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:31.802808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'111","reported_seq":615,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.521752+0000","last_change":"2024-09-12T17:00:22.352596+0000","last_active":"2024-09-12T18:12:00.521752+0000","last_peered":"2024-09-12T18:12:00.521752+0000","last_clean":"2024-09-12T18:12:00.521752+0000","last_became_active":"2024-09-12T17:00:22.352182+0000","last_became_peered":"2024-09-12T17:00:22.352182+0000","last_unstale":"2024-09-12T18:12:00.521752+0000","last_undegraded":"2024-09-12T18:12:00.521752+0000","last_fullsized":"2024-09-12T18:12:00.521752+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:18.301972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":119,"num_write":244,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'121","reported_seq":766,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:13.916333+0000","last_change":"2024-09-12T17:00:14.329674+0000","last_active":"2024-09-12T18:10:13.916333+0000","last_peered":"2024-09-12T18:10:13.916333+0000","last_clean":"2024-09-12T18:10:13.916333+0000","last_became_active":"2024-09-12T17:00:14.329394+0000","last_became_peered":"2024-09-12T17:00:14.329394+0000","last_unstale":"2024-09-12T18:10:13.916333+0000","last_undegraded":"2024-09-12T18:10:13.916333+0000","last_fullsized":"2024-09-12T18:10:13.916333+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:56.581515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":562,"num_read_kb":483,"num_write":177,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'357","reported_seq":1046,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:38.341797+0000","last_change":"2024-09-12T17:00:12.314422+0000","last_active":"2024-09-12T18:09:38.341797+0000","last_peered":"2024-09-12T18:09:38.341797+0000","last_clean":"2024-09-12T18:09:38.341797+0000","last_became_active":"2024-09-12T17:00:12.314142+0000","last_became_peered":"2024-09-12T17:00:12.314142+0000","last_unstale":"2024-09-12T18:09:38.341797+0000","last_undegraded":"2024-09-12T18:09:38.341797+0000","last_fullsized":"2024-09-12T18:09:38.341797+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:28.691515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8321153,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":749,"num_read_kb":14993,"num_write":1087,"num_write_kb":29270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:00.750294+0000","last_change":"2024-09-12T17:00:16.328779+0000","last_active":"2024-09-12T18:10:00.750294+0000","last_peered":"2024-09-12T18:10:00.750294+0000","last_clean":"2024-09-12T18:10:00.750294+0000","last_became_active":"2024-09-12T17:00:16.328306+0000","last_became_peered":"2024-09-12T17:00:16.328306+0000","last_unstale":"2024-09-12T18:10:00.750294+0000","last_undegraded":"2024-09-12T18:10:00.750294+0000","last_fullsized":"2024-09-12T18:10:00.750294+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:34.580723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'383","reported_seq":1011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:17.973195+0000","last_change":"2024-09-12T17:00:18.328815+0000","last_active":"2024-09-12T18:12:17.973195+0000","last_peered":"2024-09-12T18:12:17.973195+0000","last_clean":"2024-09-12T18:12:17.973195+0000","last_became_active":"2024-09-12T17:00:18.328500+0000","last_became_peered":"2024-09-12T17:00:18.328500+0000","last_unstale":"2024-09-12T18:12:17.973195+0000","last_undegraded":"2024-09-12T18:12:17.973195+0000","last_fullsized":"2024-09-12T18:12:17.973195+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:13.655611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54759,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":607,"num_read_kb":1130,"num_write":474,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:07.740171+0000","last_change":"2024-09-12T17:00:20.350311+0000","last_active":"2024-09-12T18:10:07.740171+0000","last_peered":"2024-09-12T18:10:07.740171+0000","last_clean":"2024-09-12T18:10:07.740171+0000","last_became_active":"2024-09-12T17:00:20.350003+0000","last_became_peered":"2024-09-12T17:00:20.350003+0000","last_unstale":"2024-09-12T18:10:07.740171+0000","last_undegraded":"2024-09-12T18:10:07.740171+0000","last_fullsized":"2024-09-12T18:10:07.740171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:27.609870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'130","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.096280+0000","last_change":"2024-09-12T17:00:22.354899+0000","last_active":"2024-09-12T18:12:03.096280+0000","last_peered":"2024-09-12T18:12:03.096280+0000","last_clean":"2024-09-12T18:12:03.096280+0000","last_became_active":"2024-09-12T17:00:22.354601+0000","last_became_peered":"2024-09-12T17:00:22.354601+0000","last_unstale":"2024-09-12T18:12:03.096280+0000","last_undegraded":"2024-09-12T18:12:03.096280+0000","last_fullsized":"2024-09-12T18:12:03.096280+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:04.146875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":184,"num_read_kb":175,"num_write":297,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'262","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:17.750658+0000","last_change":"2024-09-12T17:00:14.329597+0000","last_active":"2024-09-12T18:11:17.750658+0000","last_peered":"2024-09-12T18:11:17.750658+0000","last_clean":"2024-09-12T18:11:17.750658+0000","last_became_active":"2024-09-12T17:00:14.329297+0000","last_became_peered":"2024-09-12T17:00:14.329297+0000","last_unstale":"2024-09-12T18:11:17.750658+0000","last_undegraded":"2024-09-12T18:11:17.750658+0000","last_fullsized":"2024-09-12T18:11:17.750658+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:20.710892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1103,"num_read_kb":898,"num_write":417,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.754092+0000","last_change":"2024-09-12T16:59:54.636782+0000","last_active":"2024-09-12T18:10:12.754092+0000","last_peered":"2024-09-12T18:10:12.754092+0000","last_clean":"2024-09-12T18:10:12.754092+0000","last_became_active":"2024-09-12T16:59:54.636487+0000","last_became_peered":"2024-09-12T16:59:54.636487+0000","last_unstale":"2024-09-12T18:10:12.754092+0000","last_undegraded":"2024-09-12T18:10:12.754092+0000","last_fullsized":"2024-09-12T18:10:12.754092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:53.619137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:53.619137+0000","last_clean_scrub_stamp":"2024-09-12T16:59:53.619137+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:25.991554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":530,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:52.959116+0000","last_change":"2024-09-12T17:00:02.680922+0000","last_active":"2024-09-12T18:10:52.959116+0000","last_peered":"2024-09-12T18:10:52.959116+0000","last_clean":"2024-09-12T18:10:52.959116+0000","last_became_active":"2024-09-12T17:00:00.669728+0000","last_became_peered":"2024-09-12T17:00:00.669728+0000","last_unstale":"2024-09-12T18:10:52.959116+0000","last_undegraded":"2024-09-12T18:10:52.959116+0000","last_fullsized":"2024-09-12T18:10:52.959116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:04.614720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058116500000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'328","reported_seq":1015,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.570675+0000","last_change":"2024-09-12T17:00:46.405193+0000","last_active":"2024-09-12T18:13:48.570675+0000","last_peered":"2024-09-12T18:13:48.570675+0000","last_clean":"2024-09-12T18:13:48.570675+0000","last_became_active":"2024-09-12T17:00:46.404905+0000","last_became_peered":"2024-09-12T17:00:46.404905+0000","last_unstale":"2024-09-12T18:13:48.570675+0000","last_undegraded":"2024-09-12T18:13:48.570675+0000","last_fullsized":"2024-09-12T18:13:48.570675+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:32.250482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6794004,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":613,"num_read_kb":82700,"num_write":1206,"num_write_kb":21344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.763082+0000","last_change":"2024-09-12T17:00:16.321475+0000","last_active":"2024-09-12T18:11:07.763082+0000","last_peered":"2024-09-12T18:11:07.763082+0000","last_clean":"2024-09-12T18:11:07.763082+0000","last_became_active":"2024-09-12T17:00:16.321151+0000","last_became_peered":"2024-09-12T17:00:16.321151+0000","last_unstale":"2024-09-12T18:11:07.763082+0000","last_undegraded":"2024-09-12T18:11:07.763082+0000","last_fullsized":"2024-09-12T18:11:07.763082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:40.509096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'739","reported_seq":1442,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.012263+0000","last_change":"2024-09-12T17:00:18.330396+0000","last_active":"2024-09-12T18:13:23.012263+0000","last_peered":"2024-09-12T18:13:23.012263+0000","last_clean":"2024-09-12T18:13:23.012263+0000","last_became_active":"2024-09-12T17:00:18.330037+0000","last_became_peered":"2024-09-12T17:00:18.330037+0000","last_unstale":"2024-09-12T18:13:23.012263+0000","last_undegraded":"2024-09-12T18:13:23.012263+0000","last_fullsized":"2024-09-12T18:13:23.012263+0000","mapping_epoch":30,"log_start":"264'700","ondisk_log_start":"264'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:20.891636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187511,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1448,"num_read_kb":3071,"num_write":1416,"num_write_kb":1268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:41.614845+0000","last_change":"2024-09-12T17:00:20.349669+0000","last_active":"2024-09-12T18:09:41.614845+0000","last_peered":"2024-09-12T18:09:41.614845+0000","last_clean":"2024-09-12T18:09:41.614845+0000","last_became_active":"2024-09-12T17:00:20.349363+0000","last_became_peered":"2024-09-12T17:00:20.349363+0000","last_unstale":"2024-09-12T18:09:41.614845+0000","last_undegraded":"2024-09-12T18:09:41.614845+0000","last_fullsized":"2024-09-12T18:09:41.614845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:59.536610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'187","reported_seq":888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.997884+0000","last_change":"2024-09-12T17:00:22.354974+0000","last_active":"2024-09-12T18:12:00.997884+0000","last_peered":"2024-09-12T18:12:00.997884+0000","last_clean":"2024-09-12T18:12:00.997884+0000","last_became_active":"2024-09-12T17:00:22.354654+0000","last_became_peered":"2024-09-12T17:00:22.354654+0000","last_unstale":"2024-09-12T18:12:00.997884+0000","last_undegraded":"2024-09-12T18:12:00.997884+0000","last_fullsized":"2024-09-12T18:12:00.997884+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:31.363438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":450,"num_read_kb":449,"num_write":373,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'132","reported_seq":742,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:59.044067+0000","last_change":"2024-09-12T17:00:14.319895+0000","last_active":"2024-09-12T18:09:59.044067+0000","last_peered":"2024-09-12T18:09:59.044067+0000","last_clean":"2024-09-12T18:09:59.044067+0000","last_became_active":"2024-09-12T17:00:14.319539+0000","last_became_peered":"2024-09-12T17:00:14.319539+0000","last_unstale":"2024-09-12T18:09:59.044067+0000","last_undegraded":"2024-09-12T18:09:59.044067+0000","last_fullsized":"2024-09-12T18:09:59.044067+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:30.605432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":596,"num_read_kb":500,"num_write":197,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.755045+0000","last_change":"2024-09-12T17:00:02.996796+0000","last_active":"2024-09-12T18:10:17.755045+0000","last_peered":"2024-09-12T18:10:17.755045+0000","last_clean":"2024-09-12T18:10:17.755045+0000","last_became_active":"2024-09-12T17:00:00.671211+0000","last_became_peered":"2024-09-12T17:00:00.671211+0000","last_unstale":"2024-09-12T18:10:17.755045+0000","last_undegraded":"2024-09-12T18:10:17.755045+0000","last_fullsized":"2024-09-12T18:10:17.755045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:37.005108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000441562,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'251","reported_seq":935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:01.623620+0000","last_change":"2024-09-12T17:00:12.306702+0000","last_active":"2024-09-12T18:11:01.623620+0000","last_peered":"2024-09-12T18:11:01.623620+0000","last_clean":"2024-09-12T18:11:01.623620+0000","last_became_active":"2024-09-12T17:00:12.306408+0000","last_became_peered":"2024-09-12T17:00:12.306408+0000","last_unstale":"2024-09-12T18:11:01.623620+0000","last_undegraded":"2024-09-12T18:11:01.623620+0000","last_fullsized":"2024-09-12T18:11:01.623620+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:21.843306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1530728,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":446,"num_read_kb":8959,"num_write":905,"num_write_kb":13821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:37.947663+0000","last_change":"2024-09-12T17:00:16.326370+0000","last_active":"2024-09-12T18:09:37.947663+0000","last_peered":"2024-09-12T18:09:37.947663+0000","last_clean":"2024-09-12T18:09:37.947663+0000","last_became_active":"2024-09-12T17:00:16.325914+0000","last_became_peered":"2024-09-12T17:00:16.325914+0000","last_unstale":"2024-09-12T18:09:37.947663+0000","last_undegraded":"2024-09-12T18:09:37.947663+0000","last_fullsized":"2024-09-12T18:09:37.947663+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:00.425804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1353","reported_seq":3187,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.847360+0000","last_change":"2024-09-12T17:00:18.331031+0000","last_active":"2024-09-12T18:13:48.847360+0000","last_peered":"2024-09-12T18:13:48.847360+0000","last_clean":"2024-09-12T18:13:48.847360+0000","last_became_active":"2024-09-12T17:00:18.330715+0000","last_became_peered":"2024-09-12T17:00:18.330715+0000","last_unstale":"2024-09-12T18:13:48.847360+0000","last_undegraded":"2024-09-12T18:13:48.847360+0000","last_fullsized":"2024-09-12T18:13:48.847360+0000","mapping_epoch":30,"log_start":"264'1300","ondisk_log_start":"264'1300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":1300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:19.772064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165470,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2166,"num_read_kb":4126,"num_write":1264,"num_write_kb":1076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:27.766397+0000","last_change":"2024-09-12T17:00:20.352790+0000","last_active":"2024-09-12T18:11:27.766397+0000","last_peered":"2024-09-12T18:11:27.766397+0000","last_clean":"2024-09-12T18:11:27.766397+0000","last_became_active":"2024-09-12T17:00:20.352287+0000","last_became_peered":"2024-09-12T17:00:20.352287+0000","last_unstale":"2024-09-12T18:11:27.766397+0000","last_undegraded":"2024-09-12T18:11:27.766397+0000","last_fullsized":"2024-09-12T18:11:27.766397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:15.288688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'96","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.928594+0000","last_change":"2024-09-12T17:00:22.587542+0000","last_active":"2024-09-12T18:12:08.928594+0000","last_peered":"2024-09-12T18:12:08.928594+0000","last_clean":"2024-09-12T18:12:08.928594+0000","last_became_active":"2024-09-12T17:00:22.587206+0000","last_became_peered":"2024-09-12T17:00:22.587206+0000","last_unstale":"2024-09-12T18:12:08.928594+0000","last_undegraded":"2024-09-12T18:12:08.928594+0000","last_fullsized":"2024-09-12T18:12:08.928594+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:21.704751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":151,"num_write":236,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'4068","reported_seq":4652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:33.912025+0000","last_change":"2024-09-12T17:00:14.331924+0000","last_active":"2024-09-12T18:09:33.912025+0000","last_peered":"2024-09-12T18:09:33.912025+0000","last_clean":"2024-09-12T18:09:33.912025+0000","last_became_active":"2024-09-12T17:00:14.331560+0000","last_became_peered":"2024-09-12T17:00:14.331560+0000","last_unstale":"2024-09-12T18:09:33.912025+0000","last_undegraded":"2024-09-12T18:09:33.912025+0000","last_fullsized":"2024-09-12T18:09:33.912025+0000","mapping_epoch":26,"log_start":"264'4000","ondisk_log_start":"264'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":3000,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:08.452289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16331,"num_read_kb":13702,"num_write":6093,"num_write_kb":3038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":529,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:53.701863+0000","last_change":"2024-09-12T17:00:02.677610+0000","last_active":"2024-09-12T18:10:53.701863+0000","last_peered":"2024-09-12T18:10:53.701863+0000","last_clean":"2024-09-12T18:10:53.701863+0000","last_became_active":"2024-09-12T17:00:01.173083+0000","last_became_peered":"2024-09-12T17:00:01.173083+0000","last_unstale":"2024-09-12T18:10:53.701863+0000","last_undegraded":"2024-09-12T18:10:53.701863+0000","last_fullsized":"2024-09-12T18:10:53.701863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:35.997474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056135799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'292","reported_seq":949,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.909053+0000","last_change":"2024-09-12T17:00:12.309409+0000","last_active":"2024-09-12T18:13:48.909053+0000","last_peered":"2024-09-12T18:13:48.909053+0000","last_clean":"2024-09-12T18:13:48.909053+0000","last_became_active":"2024-09-12T17:00:12.309100+0000","last_became_peered":"2024-09-12T17:00:12.309100+0000","last_unstale":"2024-09-12T18:13:48.909053+0000","last_undegraded":"2024-09-12T18:13:48.909053+0000","last_fullsized":"2024-09-12T18:13:48.909053+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:25.648067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850464,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":454,"num_read_kb":31712,"num_write":1024,"num_write_kb":22323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:38.694803+0000","last_change":"2024-09-12T17:00:16.325113+0000","last_active":"2024-09-12T18:09:38.694803+0000","last_peered":"2024-09-12T18:09:38.694803+0000","last_clean":"2024-09-12T18:09:38.694803+0000","last_became_active":"2024-09-12T17:00:16.324792+0000","last_became_peered":"2024-09-12T17:00:16.324792+0000","last_unstale":"2024-09-12T18:09:38.694803+0000","last_undegraded":"2024-09-12T18:09:38.694803+0000","last_fullsized":"2024-09-12T18:09:38.694803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:38.734680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'290","reported_seq":1723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.201178+0000","last_change":"2024-09-12T17:00:18.430289+0000","last_active":"2024-09-12T18:13:23.201178+0000","last_peered":"2024-09-12T18:13:23.201178+0000","last_clean":"2024-09-12T18:13:23.201178+0000","last_became_active":"2024-09-12T17:00:18.429997+0000","last_became_peered":"2024-09-12T17:00:18.429997+0000","last_unstale":"2024-09-12T18:13:23.201178+0000","last_undegraded":"2024-09-12T18:13:23.201178+0000","last_fullsized":"2024-09-12T18:13:23.201178+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:55.412482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":262,"num_read_kb":252,"num_write":239,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.624787+0000","last_change":"2024-09-12T17:00:20.353031+0000","last_active":"2024-09-12T18:11:11.624787+0000","last_peered":"2024-09-12T18:11:11.624787+0000","last_clean":"2024-09-12T18:11:11.624787+0000","last_became_active":"2024-09-12T17:00:20.350197+0000","last_became_peered":"2024-09-12T17:00:20.350197+0000","last_unstale":"2024-09-12T18:11:11.624787+0000","last_undegraded":"2024-09-12T18:11:11.624787+0000","last_fullsized":"2024-09-12T18:11:11.624787+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:17.466054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'275","reported_seq":881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.253630+0000","last_change":"2024-09-12T17:00:22.357898+0000","last_active":"2024-09-12T18:12:03.253630+0000","last_peered":"2024-09-12T18:12:03.253630+0000","last_clean":"2024-09-12T18:12:03.253630+0000","last_became_active":"2024-09-12T17:00:22.357583+0000","last_became_peered":"2024-09-12T17:00:22.357583+0000","last_unstale":"2024-09-12T18:12:03.253630+0000","last_undegraded":"2024-09-12T18:12:03.253630+0000","last_fullsized":"2024-09-12T18:12:03.253630+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:16.279162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":565,"num_read_kb":582,"num_write":607,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'184","reported_seq":770,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:03.921621+0000","last_change":"2024-09-12T17:00:14.325136+0000","last_active":"2024-09-12T18:11:03.921621+0000","last_peered":"2024-09-12T18:11:03.921621+0000","last_clean":"2024-09-12T18:11:03.921621+0000","last_became_active":"2024-09-12T17:00:14.324830+0000","last_became_peered":"2024-09-12T17:00:14.324830+0000","last_unstale":"2024-09-12T18:11:03.921621+0000","last_undegraded":"2024-09-12T18:11:03.921621+0000","last_fullsized":"2024-09-12T18:11:03.921621+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:00.282511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":771,"num_read_kb":626,"num_write":320,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:52.959075+0000","last_change":"2024-09-12T17:00:02.681561+0000","last_active":"2024-09-12T18:10:52.959075+0000","last_peered":"2024-09-12T18:10:52.959075+0000","last_clean":"2024-09-12T18:10:52.959075+0000","last_became_active":"2024-09-12T17:00:00.668696+0000","last_became_peered":"2024-09-12T17:00:00.668696+0000","last_unstale":"2024-09-12T18:10:52.959075+0000","last_undegraded":"2024-09-12T18:10:52.959075+0000","last_fullsized":"2024-09-12T18:10:52.959075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:34.470591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012259720000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'277","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:05.760259+0000","last_change":"2024-09-12T17:00:12.316101+0000","last_active":"2024-09-12T18:11:05.760259+0000","last_peered":"2024-09-12T18:11:05.760259+0000","last_clean":"2024-09-12T18:11:05.760259+0000","last_became_active":"2024-09-12T17:00:12.315813+0000","last_became_peered":"2024-09-12T17:00:12.315813+0000","last_unstale":"2024-09-12T18:11:05.760259+0000","last_undegraded":"2024-09-12T18:11:05.760259+0000","last_fullsized":"2024-09-12T18:11:05.760259+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:20.815493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6901853,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":392,"num_read_kb":35449,"num_write":993,"num_write_kb":30387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:26.626503+0000","last_change":"2024-09-12T17:00:16.325100+0000","last_active":"2024-09-12T18:11:26.626503+0000","last_peered":"2024-09-12T18:11:26.626503+0000","last_clean":"2024-09-12T18:11:26.626503+0000","last_became_active":"2024-09-12T17:00:16.324683+0000","last_became_peered":"2024-09-12T17:00:16.324683+0000","last_unstale":"2024-09-12T18:11:26.626503+0000","last_undegraded":"2024-09-12T18:11:26.626503+0000","last_fullsized":"2024-09-12T18:11:26.626503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:22.409202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'157","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.925935+0000","last_change":"2024-09-12T17:00:18.327666+0000","last_active":"2024-09-12T18:12:01.925935+0000","last_peered":"2024-09-12T18:12:01.925935+0000","last_clean":"2024-09-12T18:12:01.925935+0000","last_became_active":"2024-09-12T17:00:18.327205+0000","last_became_peered":"2024-09-12T17:00:18.327205+0000","last_unstale":"2024-09-12T18:12:01.925935+0000","last_undegraded":"2024-09-12T18:12:01.925935+0000","last_fullsized":"2024-09-12T18:12:01.925935+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:47.691766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":197,"num_read_kb":191,"num_write":142,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:42.736815+0000","last_change":"2024-09-12T17:00:20.356502+0000","last_active":"2024-09-12T18:09:42.736815+0000","last_peered":"2024-09-12T18:09:42.736815+0000","last_clean":"2024-09-12T18:09:42.736815+0000","last_became_active":"2024-09-12T17:00:20.356122+0000","last_became_peered":"2024-09-12T17:00:20.356122+0000","last_unstale":"2024-09-12T18:09:42.736815+0000","last_undegraded":"2024-09-12T18:09:42.736815+0000","last_fullsized":"2024-09-12T18:09:42.736815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:23.096424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'120","reported_seq":673,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:50.327979+0000","last_change":"2024-09-12T17:00:22.359257+0000","last_active":"2024-09-12T18:09:50.327979+0000","last_peered":"2024-09-12T18:09:50.327979+0000","last_clean":"2024-09-12T18:09:50.327979+0000","last_became_active":"2024-09-12T17:00:22.358888+0000","last_became_peered":"2024-09-12T17:00:22.358888+0000","last_unstale":"2024-09-12T18:09:50.327979+0000","last_undegraded":"2024-09-12T18:09:50.327979+0000","last_fullsized":"2024-09-12T18:09:50.327979+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:22.887398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":246,"num_write":283,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'172","reported_seq":804,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:03.921583+0000","last_change":"2024-09-12T17:00:14.331104+0000","last_active":"2024-09-12T18:11:03.921583+0000","last_peered":"2024-09-12T18:11:03.921583+0000","last_clean":"2024-09-12T18:11:03.921583+0000","last_became_active":"2024-09-12T17:00:14.330844+0000","last_became_peered":"2024-09-12T17:00:14.330844+0000","last_unstale":"2024-09-12T18:11:03.921583+0000","last_undegraded":"2024-09-12T18:11:03.921583+0000","last_fullsized":"2024-09-12T18:11:03.921583+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:40.344941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":795,"num_read_kb":654,"num_write":268,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'337","reported_seq":1017,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:17.963142+0000","last_change":"2024-09-12T17:00:12.318919+0000","last_active":"2024-09-12T18:11:17.963142+0000","last_peered":"2024-09-12T18:11:17.963142+0000","last_clean":"2024-09-12T18:11:17.963142+0000","last_became_active":"2024-09-12T17:00:12.318621+0000","last_became_peered":"2024-09-12T17:00:12.318621+0000","last_unstale":"2024-09-12T18:11:17.963142+0000","last_undegraded":"2024-09-12T18:11:17.963142+0000","last_fullsized":"2024-09-12T18:11:17.963142+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:47.056781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9640734,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":531,"num_read_kb":4542,"num_write":1271,"num_write_kb":25874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":534,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:53.920647+0000","last_change":"2024-09-12T17:00:02.683370+0000","last_active":"2024-09-12T18:10:53.920647+0000","last_peered":"2024-09-12T18:10:53.920647+0000","last_clean":"2024-09-12T18:10:53.920647+0000","last_became_active":"2024-09-12T17:00:00.667379+0000","last_became_peered":"2024-09-12T17:00:00.667379+0000","last_unstale":"2024-09-12T18:10:53.920647+0000","last_undegraded":"2024-09-12T18:10:53.920647+0000","last_fullsized":"2024-09-12T18:10:53.920647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:23.577096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056755300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:06.624201+0000","last_change":"2024-09-12T17:00:16.323271+0000","last_active":"2024-09-12T18:11:06.624201+0000","last_peered":"2024-09-12T18:11:06.624201+0000","last_clean":"2024-09-12T18:11:06.624201+0000","last_became_active":"2024-09-12T17:00:16.322854+0000","last_became_peered":"2024-09-12T17:00:16.322854+0000","last_unstale":"2024-09-12T18:11:06.624201+0000","last_undegraded":"2024-09-12T18:11:06.624201+0000","last_fullsized":"2024-09-12T18:11:06.624201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:28.816131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'654","reported_seq":1345,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.004591+0000","last_change":"2024-09-12T17:00:18.333420+0000","last_active":"2024-09-12T18:13:23.004591+0000","last_peered":"2024-09-12T18:13:23.004591+0000","last_clean":"2024-09-12T18:13:23.004591+0000","last_became_active":"2024-09-12T17:00:18.333147+0000","last_became_peered":"2024-09-12T17:00:18.333147+0000","last_unstale":"2024-09-12T18:13:23.004591+0000","last_undegraded":"2024-09-12T18:13:23.004591+0000","last_fullsized":"2024-09-12T18:13:23.004591+0000","mapping_epoch":30,"log_start":"264'600","ondisk_log_start":"264'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":600,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:53.163746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117831,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1744,"num_read_kb":2835,"num_write":2306,"num_write_kb":2105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:10.760988+0000","last_change":"2024-09-12T17:00:20.355077+0000","last_active":"2024-09-12T18:11:10.760988+0000","last_peered":"2024-09-12T18:11:10.760988+0000","last_clean":"2024-09-12T18:11:10.760988+0000","last_became_active":"2024-09-12T17:00:20.354771+0000","last_became_peered":"2024-09-12T17:00:20.354771+0000","last_unstale":"2024-09-12T18:11:10.760988+0000","last_undegraded":"2024-09-12T18:11:10.760988+0000","last_fullsized":"2024-09-12T18:11:10.760988+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:56.739823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'217","reported_seq":740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.100251+0000","last_change":"2024-09-12T17:00:22.588915+0000","last_active":"2024-09-12T18:12:01.100251+0000","last_peered":"2024-09-12T18:12:01.100251+0000","last_clean":"2024-09-12T18:12:01.100251+0000","last_became_active":"2024-09-12T17:00:22.588561+0000","last_became_peered":"2024-09-12T17:00:22.588561+0000","last_unstale":"2024-09-12T18:12:01.100251+0000","last_undegraded":"2024-09-12T18:12:01.100251+0000","last_fullsized":"2024-09-12T18:12:01.100251+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:58.487409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":223,"num_read_kb":213,"num_write":499,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'180","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:06.624221+0000","last_change":"2024-09-12T17:00:14.327539+0000","last_active":"2024-09-12T18:11:06.624221+0000","last_peered":"2024-09-12T18:11:06.624221+0000","last_clean":"2024-09-12T18:11:06.624221+0000","last_became_active":"2024-09-12T17:00:14.327268+0000","last_became_peered":"2024-09-12T17:00:14.327268+0000","last_unstale":"2024-09-12T18:11:06.624221+0000","last_undegraded":"2024-09-12T18:11:06.624221+0000","last_fullsized":"2024-09-12T18:11:06.624221+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:36.093079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":852,"num_read_kb":727,"num_write":266,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'323","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.838166+0000","last_change":"2024-09-12T17:00:12.310211+0000","last_active":"2024-09-12T18:13:48.838166+0000","last_peered":"2024-09-12T18:13:48.838166+0000","last_clean":"2024-09-12T18:13:48.838166+0000","last_became_active":"2024-09-12T17:00:12.309896+0000","last_became_peered":"2024-09-12T17:00:12.309896+0000","last_unstale":"2024-09-12T18:13:48.838166+0000","last_undegraded":"2024-09-12T18:13:48.838166+0000","last_fullsized":"2024-09-12T18:13:48.838166+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:33.087927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5569873,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":573,"num_read_kb":32728,"num_write":1222,"num_write_kb":26986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.763102+0000","last_change":"2024-09-12T17:00:02.996744+0000","last_active":"2024-09-12T18:11:07.763102+0000","last_peered":"2024-09-12T18:11:07.763102+0000","last_clean":"2024-09-12T18:11:07.763102+0000","last_became_active":"2024-09-12T17:00:00.670355+0000","last_became_peered":"2024-09-12T17:00:00.670355+0000","last_unstale":"2024-09-12T18:11:07.763102+0000","last_undegraded":"2024-09-12T18:11:07.763102+0000","last_fullsized":"2024-09-12T18:11:07.763102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:16.719229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042464500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.749307+0000","last_change":"2024-09-12T17:00:16.323451+0000","last_active":"2024-09-12T18:11:07.749307+0000","last_peered":"2024-09-12T18:11:07.749307+0000","last_clean":"2024-09-12T18:11:07.749307+0000","last_became_active":"2024-09-12T17:00:16.323157+0000","last_became_peered":"2024-09-12T17:00:16.323157+0000","last_unstale":"2024-09-12T18:11:07.749307+0000","last_undegraded":"2024-09-12T18:11:07.749307+0000","last_fullsized":"2024-09-12T18:11:07.749307+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:42.424080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'213","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.796757+0000","last_change":"2024-09-12T17:00:18.429323+0000","last_active":"2024-09-12T18:11:11.796757+0000","last_peered":"2024-09-12T18:11:11.796757+0000","last_clean":"2024-09-12T18:11:11.796757+0000","last_became_active":"2024-09-12T17:00:18.428978+0000","last_became_peered":"2024-09-12T17:00:18.428978+0000","last_unstale":"2024-09-12T18:11:11.796757+0000","last_undegraded":"2024-09-12T18:11:11.796757+0000","last_fullsized":"2024-09-12T18:11:11.796757+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:03.066210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":266,"num_read_kb":257,"num_write":182,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'767","reported_seq":2983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.299783+0000","last_change":"2024-09-12T17:00:20.345525+0000","last_active":"2024-09-12T18:13:23.299783+0000","last_peered":"2024-09-12T18:13:23.299783+0000","last_clean":"2024-09-12T18:13:23.299783+0000","last_became_active":"2024-09-12T17:00:20.345236+0000","last_became_peered":"2024-09-12T17:00:20.345236+0000","last_unstale":"2024-09-12T18:13:23.299783+0000","last_undegraded":"2024-09-12T18:13:23.299783+0000","last_fullsized":"2024-09-12T18:13:23.299783+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:26.183021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'111","reported_seq":634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:31.859446+0000","last_change":"2024-09-12T17:00:22.587755+0000","last_active":"2024-09-12T18:12:31.859446+0000","last_peered":"2024-09-12T18:12:31.859446+0000","last_clean":"2024-09-12T18:12:31.859446+0000","last_became_active":"2024-09-12T17:00:22.587443+0000","last_became_peered":"2024-09-12T17:00:22.587443+0000","last_unstale":"2024-09-12T18:12:31.859446+0000","last_undegraded":"2024-09-12T18:12:31.859446+0000","last_fullsized":"2024-09-12T18:12:31.859446+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:05.679814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":705,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":239,"num_read_kb":213,"num_write":277,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'317","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.843564+0000","last_change":"2024-09-12T17:00:14.333428+0000","last_active":"2024-09-12T18:10:26.843564+0000","last_peered":"2024-09-12T18:10:26.843564+0000","last_clean":"2024-09-12T18:10:26.843564+0000","last_became_active":"2024-09-12T17:00:14.333128+0000","last_became_peered":"2024-09-12T17:00:14.333128+0000","last_unstale":"2024-09-12T18:10:26.843564+0000","last_undegraded":"2024-09-12T18:10:26.843564+0000","last_fullsized":"2024-09-12T18:10:26.843564+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:34.464037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1338,"num_read_kb":1083,"num_write":472,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'295","reported_seq":950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.967580+0000","last_change":"2024-09-12T17:00:12.316074+0000","last_active":"2024-09-12T18:10:22.967580+0000","last_peered":"2024-09-12T18:10:22.967580+0000","last_clean":"2024-09-12T18:10:22.967580+0000","last_became_active":"2024-09-12T17:00:12.315812+0000","last_became_peered":"2024-09-12T17:00:12.315812+0000","last_unstale":"2024-09-12T18:10:22.967580+0000","last_undegraded":"2024-09-12T18:10:22.967580+0000","last_fullsized":"2024-09-12T18:10:22.967580+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:36.960724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8925376,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":491,"num_read_kb":23161,"num_write":1061,"num_write_kb":14173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:33.924599+0000","last_change":"2024-09-12T17:00:02.683419+0000","last_active":"2024-09-12T18:11:33.924599+0000","last_peered":"2024-09-12T18:11:33.924599+0000","last_clean":"2024-09-12T18:11:33.924599+0000","last_became_active":"2024-09-12T17:00:00.669898+0000","last_became_peered":"2024-09-12T17:00:00.669898+0000","last_unstale":"2024-09-12T18:11:33.924599+0000","last_undegraded":"2024-09-12T18:11:33.924599+0000","last_fullsized":"2024-09-12T18:11:33.924599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:32.053145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060387199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:05.760206+0000","last_change":"2024-09-12T17:00:16.327641+0000","last_active":"2024-09-12T18:11:05.760206+0000","last_peered":"2024-09-12T18:11:05.760206+0000","last_clean":"2024-09-12T18:11:05.760206+0000","last_became_active":"2024-09-12T17:00:16.327270+0000","last_became_peered":"2024-09-12T17:00:16.327270+0000","last_unstale":"2024-09-12T18:11:05.760206+0000","last_undegraded":"2024-09-12T18:11:05.760206+0000","last_fullsized":"2024-09-12T18:11:05.760206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:48.314834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'129","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.726748+0000","last_change":"2024-09-12T17:00:18.328546+0000","last_active":"2024-09-12T18:11:11.726748+0000","last_peered":"2024-09-12T18:11:11.726748+0000","last_clean":"2024-09-12T18:11:11.726748+0000","last_became_active":"2024-09-12T17:00:18.327994+0000","last_became_peered":"2024-09-12T17:00:18.327994+0000","last_unstale":"2024-09-12T18:11:11.726748+0000","last_undegraded":"2024-09-12T18:11:11.726748+0000","last_fullsized":"2024-09-12T18:11:11.726748+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:08.620648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":161,"num_write":110,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'771","reported_seq":2833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.310287+0000","last_change":"2024-09-12T17:00:20.354844+0000","last_active":"2024-09-12T18:13:23.310287+0000","last_peered":"2024-09-12T18:13:23.310287+0000","last_clean":"2024-09-12T18:13:23.310287+0000","last_became_active":"2024-09-12T17:00:20.354519+0000","last_became_peered":"2024-09-12T17:00:20.354519+0000","last_unstale":"2024-09-12T18:13:23.310287+0000","last_undegraded":"2024-09-12T18:13:23.310287+0000","last_fullsized":"2024-09-12T18:13:23.310287+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:52.962681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'283","reported_seq":819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.915298+0000","last_change":"2024-09-12T17:00:22.356453+0000","last_active":"2024-09-12T18:12:01.915298+0000","last_peered":"2024-09-12T18:12:01.915298+0000","last_clean":"2024-09-12T18:12:01.915298+0000","last_became_active":"2024-09-12T17:00:22.356132+0000","last_became_peered":"2024-09-12T17:00:22.356132+0000","last_unstale":"2024-09-12T18:12:01.915298+0000","last_undegraded":"2024-09-12T18:12:01.915298+0000","last_fullsized":"2024-09-12T18:12:01.915298+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:55.124427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":378,"num_read_kb":377,"num_write":631,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'145","reported_seq":762,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:05.760147+0000","last_change":"2024-09-12T17:00:14.330712+0000","last_active":"2024-09-12T18:11:05.760147+0000","last_peered":"2024-09-12T18:11:05.760147+0000","last_clean":"2024-09-12T18:11:05.760147+0000","last_became_active":"2024-09-12T17:00:14.330433+0000","last_became_peered":"2024-09-12T17:00:14.330433+0000","last_unstale":"2024-09-12T18:11:05.760147+0000","last_undegraded":"2024-09-12T18:11:05.760147+0000","last_fullsized":"2024-09-12T18:11:05.760147+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:23.434335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":651,"num_read_kb":539,"num_write":208,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'310","reported_seq":1077,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:36.642376+0000","last_change":"2024-09-12T17:00:12.308249+0000","last_active":"2024-09-12T18:09:36.642376+0000","last_peered":"2024-09-12T18:09:36.642376+0000","last_clean":"2024-09-12T18:09:36.642376+0000","last_became_active":"2024-09-12T17:00:12.307371+0000","last_became_peered":"2024-09-12T17:00:12.307371+0000","last_unstale":"2024-09-12T18:09:36.642376+0000","last_undegraded":"2024-09-12T18:09:36.642376+0000","last_fullsized":"2024-09-12T18:09:36.642376+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:08.255196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5888395,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":775,"num_read_kb":7035,"num_write":1133,"num_write_kb":32501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:32.752719+0000","last_change":"2024-09-12T17:00:02.674920+0000","last_active":"2024-09-12T18:11:32.752719+0000","last_peered":"2024-09-12T18:11:32.752719+0000","last_clean":"2024-09-12T18:11:32.752719+0000","last_became_active":"2024-09-12T17:00:00.670451+0000","last_became_peered":"2024-09-12T17:00:00.670451+0000","last_unstale":"2024-09-12T18:11:32.752719+0000","last_undegraded":"2024-09-12T18:11:32.752719+0000","last_fullsized":"2024-09-12T18:11:32.752719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:42.274336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046867000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.843580+0000","last_change":"2024-09-12T17:00:16.326975+0000","last_active":"2024-09-12T18:10:26.843580+0000","last_peered":"2024-09-12T18:10:26.843580+0000","last_clean":"2024-09-12T18:10:26.843580+0000","last_became_active":"2024-09-12T17:00:16.326163+0000","last_became_peered":"2024-09-12T17:00:16.326163+0000","last_unstale":"2024-09-12T18:10:26.843580+0000","last_undegraded":"2024-09-12T18:10:26.843580+0000","last_fullsized":"2024-09-12T18:10:26.843580+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:07.452685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'774","reported_seq":1498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.001066+0000","last_change":"2024-09-12T17:00:18.429419+0000","last_active":"2024-09-12T18:13:23.001066+0000","last_peered":"2024-09-12T18:13:23.001066+0000","last_clean":"2024-09-12T18:13:23.001066+0000","last_became_active":"2024-09-12T17:00:18.429131+0000","last_became_peered":"2024-09-12T17:00:18.429131+0000","last_unstale":"2024-09-12T18:13:23.001066+0000","last_undegraded":"2024-09-12T18:13:23.001066+0000","last_fullsized":"2024-09-12T18:13:23.001066+0000","mapping_epoch":30,"log_start":"264'700","ondisk_log_start":"264'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:04:14.159447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194231,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1370,"num_read_kb":3063,"num_write":1130,"num_write_kb":945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.848361+0000","last_change":"2024-09-12T17:00:20.350091+0000","last_active":"2024-09-12T18:11:11.848361+0000","last_peered":"2024-09-12T18:11:11.848361+0000","last_clean":"2024-09-12T18:11:11.848361+0000","last_became_active":"2024-09-12T17:00:20.349800+0000","last_became_peered":"2024-09-12T17:00:20.349800+0000","last_unstale":"2024-09-12T18:11:11.848361+0000","last_undegraded":"2024-09-12T18:11:11.848361+0000","last_fullsized":"2024-09-12T18:11:11.848361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:28:56.661972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'139","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:07.952151+0000","last_change":"2024-09-12T17:00:22.361129+0000","last_active":"2024-09-12T18:10:07.952151+0000","last_peered":"2024-09-12T18:10:07.952151+0000","last_clean":"2024-09-12T18:10:07.952151+0000","last_became_active":"2024-09-12T17:00:22.360730+0000","last_became_peered":"2024-09-12T17:00:22.360730+0000","last_unstale":"2024-09-12T18:10:07.952151+0000","last_undegraded":"2024-09-12T18:10:07.952151+0000","last_fullsized":"2024-09-12T18:10:07.952151+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:53.958932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":172,"num_read_kb":170,"num_write":343,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'181","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.194693+0000","last_change":"2024-09-12T17:00:22.354855+0000","last_active":"2024-09-12T18:12:03.194693+0000","last_peered":"2024-09-12T18:12:03.194693+0000","last_clean":"2024-09-12T18:12:03.194693+0000","last_became_active":"2024-09-12T17:00:22.354464+0000","last_became_peered":"2024-09-12T17:00:22.354464+0000","last_unstale":"2024-09-12T18:12:03.194693+0000","last_undegraded":"2024-09-12T18:12:03.194693+0000","last_fullsized":"2024-09-12T18:12:03.194693+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:18.356184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":465,"num_read_kb":419,"num_write":437,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'369","reported_seq":1045,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:15.752357+0000","last_change":"2024-09-12T17:00:14.330391+0000","last_active":"2024-09-12T18:10:15.752357+0000","last_peered":"2024-09-12T18:10:15.752357+0000","last_clean":"2024-09-12T18:10:15.752357+0000","last_became_active":"2024-09-12T17:00:14.329093+0000","last_became_peered":"2024-09-12T17:00:14.329093+0000","last_unstale":"2024-09-12T18:10:15.752357+0000","last_undegraded":"2024-09-12T18:10:15.752357+0000","last_fullsized":"2024-09-12T18:10:15.752357+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:02.679602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1637,"num_read_kb":1326,"num_write":585,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'292","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:15.272447+0000","last_change":"2024-09-12T17:00:12.307582+0000","last_active":"2024-09-12T18:13:15.272447+0000","last_peered":"2024-09-12T18:13:15.272447+0000","last_clean":"2024-09-12T18:13:15.272447+0000","last_became_active":"2024-09-12T17:00:12.307309+0000","last_became_peered":"2024-09-12T17:00:12.307309+0000","last_unstale":"2024-09-12T18:13:15.272447+0000","last_undegraded":"2024-09-12T18:13:15.272447+0000","last_fullsized":"2024-09-12T18:13:15.272447+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:28.009676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7766719,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":648,"num_read_kb":21828,"num_write":1203,"num_write_kb":15847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:18.916856+0000","last_change":"2024-09-12T17:00:16.325960+0000","last_active":"2024-09-12T18:10:18.916856+0000","last_peered":"2024-09-12T18:10:18.916856+0000","last_clean":"2024-09-12T18:10:18.916856+0000","last_became_active":"2024-09-12T17:00:16.325555+0000","last_became_peered":"2024-09-12T17:00:16.325555+0000","last_unstale":"2024-09-12T18:10:18.916856+0000","last_undegraded":"2024-09-12T18:10:18.916856+0000","last_fullsized":"2024-09-12T18:10:18.916856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:08:46.715410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'294","reported_seq":878,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:41.860734+0000","last_change":"2024-09-12T17:00:18.328249+0000","last_active":"2024-09-12T18:12:41.860734+0000","last_peered":"2024-09-12T18:12:41.860734+0000","last_clean":"2024-09-12T18:12:41.860734+0000","last_became_active":"2024-09-12T17:00:18.327374+0000","last_became_peered":"2024-09-12T17:00:18.327374+0000","last_unstale":"2024-09-12T18:12:41.860734+0000","last_undegraded":"2024-09-12T18:12:41.860734+0000","last_fullsized":"2024-09-12T18:12:41.860734+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:36.522799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56561,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":484,"num_read_kb":1007,"num_write":392,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.842898+0000","last_change":"2024-09-12T17:00:20.353374+0000","last_active":"2024-09-12T18:10:21.842898+0000","last_peered":"2024-09-12T18:10:21.842898+0000","last_clean":"2024-09-12T18:10:21.842898+0000","last_became_active":"2024-09-12T17:00:20.352801+0000","last_became_peered":"2024-09-12T17:00:20.352801+0000","last_unstale":"2024-09-12T18:10:21.842898+0000","last_undegraded":"2024-09-12T18:10:21.842898+0000","last_fullsized":"2024-09-12T18:10:21.842898+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:10.323586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'192","reported_seq":718,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844219+0000","last_change":"2024-09-12T17:00:22.354964+0000","last_active":"2024-09-12T18:10:31.844219+0000","last_peered":"2024-09-12T18:10:31.844219+0000","last_clean":"2024-09-12T18:10:31.844219+0000","last_became_active":"2024-09-12T17:00:22.354651+0000","last_became_peered":"2024-09-12T17:00:22.354651+0000","last_unstale":"2024-09-12T18:10:31.844219+0000","last_undegraded":"2024-09-12T18:10:31.844219+0000","last_fullsized":"2024-09-12T18:10:31.844219+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:50.025969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":300,"num_read_kb":268,"num_write":394,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'230","reported_seq":866,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:13.916251+0000","last_change":"2024-09-12T17:00:14.322018+0000","last_active":"2024-09-12T18:10:13.916251+0000","last_peered":"2024-09-12T18:10:13.916251+0000","last_clean":"2024-09-12T18:10:13.916251+0000","last_became_active":"2024-09-12T17:00:14.320955+0000","last_became_peered":"2024-09-12T17:00:14.320955+0000","last_unstale":"2024-09-12T18:10:13.916251+0000","last_undegraded":"2024-09-12T18:10:13.916251+0000","last_fullsized":"2024-09-12T18:10:13.916251+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:51.522285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1027,"num_read_kb":855,"num_write":338,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'334","reported_seq":977,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.755206+0000","last_change":"2024-09-12T17:00:12.316146+0000","last_active":"2024-09-12T18:10:17.755206+0000","last_peered":"2024-09-12T18:10:17.755206+0000","last_clean":"2024-09-12T18:10:17.755206+0000","last_became_active":"2024-09-12T17:00:12.315834+0000","last_became_peered":"2024-09-12T17:00:12.315834+0000","last_unstale":"2024-09-12T18:10:17.755206+0000","last_undegraded":"2024-09-12T18:10:17.755206+0000","last_fullsized":"2024-09-12T18:10:17.755206+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:21.977408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7879099,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":483,"num_read_kb":44669,"num_write":1191,"num_write_kb":42862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:16.842404+0000","last_change":"2024-09-12T17:00:16.327598+0000","last_active":"2024-09-12T18:10:16.842404+0000","last_peered":"2024-09-12T18:10:16.842404+0000","last_clean":"2024-09-12T18:10:16.842404+0000","last_became_active":"2024-09-12T17:00:16.327292+0000","last_became_peered":"2024-09-12T17:00:16.327292+0000","last_unstale":"2024-09-12T18:10:16.842404+0000","last_undegraded":"2024-09-12T18:10:16.842404+0000","last_fullsized":"2024-09-12T18:10:16.842404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:28.781328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'50","reported_seq":574,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:00.089541+0000","last_change":"2024-09-12T17:00:18.331826+0000","last_active":"2024-09-12T18:11:00.089541+0000","last_peered":"2024-09-12T18:11:00.089541+0000","last_clean":"2024-09-12T18:11:00.089541+0000","last_became_active":"2024-09-12T17:00:18.331495+0000","last_became_peered":"2024-09-12T17:00:18.331495+0000","last_unstale":"2024-09-12T18:11:00.089541+0000","last_undegraded":"2024-09-12T18:11:00.089541+0000","last_fullsized":"2024-09-12T18:11:00.089541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:10.249483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.755874+0000","last_change":"2024-09-12T17:00:20.348626+0000","last_active":"2024-09-12T18:10:22.755874+0000","last_peered":"2024-09-12T18:10:22.755874+0000","last_clean":"2024-09-12T18:10:22.755874+0000","last_became_active":"2024-09-12T17:00:20.348274+0000","last_became_peered":"2024-09-12T17:00:20.348274+0000","last_unstale":"2024-09-12T18:10:22.755874+0000","last_undegraded":"2024-09-12T18:10:22.755874+0000","last_fullsized":"2024-09-12T18:10:22.755874+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:44.279723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'244","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.928095+0000","last_change":"2024-09-12T17:00:22.350497+0000","last_active":"2024-09-12T18:12:01.928095+0000","last_peered":"2024-09-12T18:12:01.928095+0000","last_clean":"2024-09-12T18:12:01.928095+0000","last_became_active":"2024-09-12T17:00:22.350195+0000","last_became_peered":"2024-09-12T17:00:22.350195+0000","last_unstale":"2024-09-12T18:12:01.928095+0000","last_undegraded":"2024-09-12T18:12:01.928095+0000","last_fullsized":"2024-09-12T18:12:01.928095+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:00.704663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":636,"num_read_kb":568,"num_write":560,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'163","reported_seq":757,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:16.842370+0000","last_change":"2024-09-12T17:00:14.334938+0000","last_active":"2024-09-12T18:10:16.842370+0000","last_peered":"2024-09-12T18:10:16.842370+0000","last_clean":"2024-09-12T18:10:16.842370+0000","last_became_active":"2024-09-12T17:00:14.334652+0000","last_became_peered":"2024-09-12T17:00:14.334652+0000","last_unstale":"2024-09-12T18:10:16.842370+0000","last_undegraded":"2024-09-12T18:10:16.842370+0000","last_fullsized":"2024-09-12T18:10:16.842370+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:28.183092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":705,"num_read_kb":585,"num_write":252,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'322","reported_seq":1000,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.953719+0000","last_change":"2024-09-12T17:00:12.312907+0000","last_active":"2024-09-12T18:10:17.953719+0000","last_peered":"2024-09-12T18:10:17.953719+0000","last_clean":"2024-09-12T18:10:17.953719+0000","last_became_active":"2024-09-12T17:00:12.312629+0000","last_became_peered":"2024-09-12T17:00:12.312629+0000","last_unstale":"2024-09-12T18:10:17.953719+0000","last_undegraded":"2024-09-12T18:10:17.953719+0000","last_fullsized":"2024-09-12T18:10:17.953719+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:48.636890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5500381,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":591,"num_read_kb":31722,"num_write":1444,"num_write_kb":32347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.755061+0000","last_change":"2024-09-12T17:00:16.327231+0000","last_active":"2024-09-12T18:10:17.755061+0000","last_peered":"2024-09-12T18:10:17.755061+0000","last_clean":"2024-09-12T18:10:17.755061+0000","last_became_active":"2024-09-12T17:00:16.326905+0000","last_became_peered":"2024-09-12T17:00:16.326905+0000","last_unstale":"2024-09-12T18:10:17.755061+0000","last_undegraded":"2024-09-12T18:10:17.755061+0000","last_fullsized":"2024-09-12T18:10:17.755061+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:18.823688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'341","reported_seq":940,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:41.860773+0000","last_change":"2024-09-12T17:00:18.330035+0000","last_active":"2024-09-12T18:12:41.860773+0000","last_peered":"2024-09-12T18:12:41.860773+0000","last_clean":"2024-09-12T18:12:41.860773+0000","last_became_active":"2024-09-12T17:00:18.329759+0000","last_became_peered":"2024-09-12T17:00:18.329759+0000","last_unstale":"2024-09-12T18:12:41.860773+0000","last_undegraded":"2024-09-12T18:12:41.860773+0000","last_fullsized":"2024-09-12T18:12:41.860773+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:49.034586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59603,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":554,"num_read_kb":1118,"num_write":444,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.742473+0000","last_change":"2024-09-12T17:00:20.355975+0000","last_active":"2024-09-12T18:10:22.742473+0000","last_peered":"2024-09-12T18:10:22.742473+0000","last_clean":"2024-09-12T18:10:22.742473+0000","last_became_active":"2024-09-12T17:00:20.355629+0000","last_became_peered":"2024-09-12T17:00:20.355629+0000","last_unstale":"2024-09-12T18:10:22.742473+0000","last_undegraded":"2024-09-12T18:10:22.742473+0000","last_fullsized":"2024-09-12T18:10:22.742473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:01.719912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'125","reported_seq":653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954454+0000","last_change":"2024-09-12T17:00:22.360360+0000","last_active":"2024-09-12T18:10:22.954454+0000","last_peered":"2024-09-12T18:10:22.954454+0000","last_clean":"2024-09-12T18:10:22.954454+0000","last_became_active":"2024-09-12T17:00:22.360051+0000","last_became_peered":"2024-09-12T17:00:22.360051+0000","last_unstale":"2024-09-12T18:10:22.954454+0000","last_undegraded":"2024-09-12T18:10:22.954454+0000","last_fullsized":"2024-09-12T18:10:22.954454+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:14:23.925876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":246,"num_read_kb":229,"num_write":325,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'696","reported_seq":1442,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:16.842347+0000","last_change":"2024-09-12T17:00:14.338751+0000","last_active":"2024-09-12T18:10:16.842347+0000","last_peered":"2024-09-12T18:10:16.842347+0000","last_clean":"2024-09-12T18:10:16.842347+0000","last_became_active":"2024-09-12T17:00:14.338453+0000","last_became_peered":"2024-09-12T17:00:14.338453+0000","last_unstale":"2024-09-12T18:10:16.842347+0000","last_undegraded":"2024-09-12T18:10:16.842347+0000","last_fullsized":"2024-09-12T18:10:16.842347+0000","mapping_epoch":26,"log_start":"264'600","ondisk_log_start":"264'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:37.142336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3211,"num_read_kb":2592,"num_write":1218,"num_write_kb":764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'297","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:25.715567+0000","last_change":"2024-09-12T17:00:46.407184+0000","last_active":"2024-09-12T18:10:25.715567+0000","last_peered":"2024-09-12T18:10:25.715567+0000","last_clean":"2024-09-12T18:10:25.715567+0000","last_became_active":"2024-09-12T17:00:46.406811+0000","last_became_peered":"2024-09-12T17:00:46.406811+0000","last_unstale":"2024-09-12T18:10:25.715567+0000","last_undegraded":"2024-09-12T18:10:25.715567+0000","last_fullsized":"2024-09-12T18:10:25.715567+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:48.447890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1257210,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":393,"num_read_kb":7185,"num_write":981,"num_write_kb":23441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.741569+0000","last_change":"2024-09-12T17:00:16.328869+0000","last_active":"2024-09-12T18:10:17.741569+0000","last_peered":"2024-09-12T18:10:17.741569+0000","last_clean":"2024-09-12T18:10:17.741569+0000","last_became_active":"2024-09-12T17:00:16.328571+0000","last_became_peered":"2024-09-12T17:00:16.328571+0000","last_unstale":"2024-09-12T18:10:17.741569+0000","last_undegraded":"2024-09-12T18:10:17.741569+0000","last_fullsized":"2024-09-12T18:10:17.741569+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:55.238346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'303","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:37.776945+0000","last_change":"2024-09-12T17:00:18.332118+0000","last_active":"2024-09-12T18:12:37.776945+0000","last_peered":"2024-09-12T18:12:37.776945+0000","last_clean":"2024-09-12T18:12:37.776945+0000","last_became_active":"2024-09-12T17:00:18.331634+0000","last_became_peered":"2024-09-12T17:00:18.331634+0000","last_unstale":"2024-09-12T18:12:37.776945+0000","last_undegraded":"2024-09-12T18:12:37.776945+0000","last_fullsized":"2024-09-12T18:12:37.776945+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:30.095230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63213,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":486,"num_read_kb":1055,"num_write":402,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619176+0000","last_change":"2024-09-12T17:00:20.347184+0000","last_active":"2024-09-12T18:10:21.619176+0000","last_peered":"2024-09-12T18:10:21.619176+0000","last_clean":"2024-09-12T18:10:21.619176+0000","last_became_active":"2024-09-12T17:00:20.346778+0000","last_became_peered":"2024-09-12T17:00:20.346778+0000","last_unstale":"2024-09-12T18:10:21.619176+0000","last_undegraded":"2024-09-12T18:10:21.619176+0000","last_fullsized":"2024-09-12T18:10:21.619176+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:00.409774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'4226","reported_seq":4832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.749351+0000","last_change":"2024-09-12T17:00:14.327640+0000","last_active":"2024-09-12T18:11:07.749351+0000","last_peered":"2024-09-12T18:11:07.749351+0000","last_clean":"2024-09-12T18:11:07.749351+0000","last_became_active":"2024-09-12T17:00:14.327366+0000","last_became_peered":"2024-09-12T17:00:14.327366+0000","last_unstale":"2024-09-12T18:11:07.749351+0000","last_undegraded":"2024-09-12T18:11:07.749351+0000","last_fullsized":"2024-09-12T18:11:07.749351+0000","mapping_epoch":26,"log_start":"264'4200","ondisk_log_start":"264'4200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":3000,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:10.766155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16999,"num_read_kb":14230,"num_write":6368,"num_write_kb":3177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'277","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:16.842327+0000","last_change":"2024-09-12T17:00:12.316740+0000","last_active":"2024-09-12T18:10:16.842327+0000","last_peered":"2024-09-12T18:10:16.842327+0000","last_clean":"2024-09-12T18:10:16.842327+0000","last_became_active":"2024-09-12T17:00:12.316401+0000","last_became_peered":"2024-09-12T17:00:12.316401+0000","last_unstale":"2024-09-12T18:10:16.842327+0000","last_undegraded":"2024-09-12T18:10:16.842327+0000","last_fullsized":"2024-09-12T18:10:16.842327+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:45.699943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12039717,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":390,"num_read_kb":29248,"num_write":1035,"num_write_kb":37912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.620995+0000","last_change":"2024-09-12T17:00:16.318371+0000","last_active":"2024-09-12T18:10:36.620995+0000","last_peered":"2024-09-12T18:10:36.620995+0000","last_clean":"2024-09-12T18:10:36.620995+0000","last_became_active":"2024-09-12T17:00:16.317972+0000","last_became_peered":"2024-09-12T17:00:16.317972+0000","last_unstale":"2024-09-12T18:10:36.620995+0000","last_undegraded":"2024-09-12T18:10:36.620995+0000","last_fullsized":"2024-09-12T18:10:36.620995+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:29.831275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'525","reported_seq":1169,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.555577+0000","last_change":"2024-09-12T17:00:18.327876+0000","last_active":"2024-09-12T18:13:48.555577+0000","last_peered":"2024-09-12T18:13:48.555577+0000","last_clean":"2024-09-12T18:13:48.555577+0000","last_became_active":"2024-09-12T17:00:18.327593+0000","last_became_peered":"2024-09-12T17:00:18.327593+0000","last_unstale":"2024-09-12T18:13:48.555577+0000","last_undegraded":"2024-09-12T18:13:48.555577+0000","last_fullsized":"2024-09-12T18:13:48.555577+0000","mapping_epoch":30,"log_start":"264'500","ondisk_log_start":"264'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:04.110712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117469,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":949,"num_read_kb":2249,"num_write":826,"num_write_kb":734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954467+0000","last_change":"2024-09-12T17:00:20.350747+0000","last_active":"2024-09-12T18:10:22.954467+0000","last_peered":"2024-09-12T18:10:22.954467+0000","last_clean":"2024-09-12T18:10:22.954467+0000","last_became_active":"2024-09-12T17:00:20.350413+0000","last_became_peered":"2024-09-12T17:00:20.350413+0000","last_unstale":"2024-09-12T18:10:22.954467+0000","last_undegraded":"2024-09-12T18:10:22.954467+0000","last_fullsized":"2024-09-12T18:10:22.954467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:40.936332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'144","reported_seq":644,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.842975+0000","last_change":"2024-09-12T17:00:22.589129+0000","last_active":"2024-09-12T18:10:21.842975+0000","last_peered":"2024-09-12T18:10:21.842975+0000","last_clean":"2024-09-12T18:10:21.842975+0000","last_became_active":"2024-09-12T17:00:22.588456+0000","last_became_peered":"2024-09-12T17:00:22.588456+0000","last_unstale":"2024-09-12T18:10:21.842975+0000","last_undegraded":"2024-09-12T18:10:21.842975+0000","last_fullsized":"2024-09-12T18:10:21.842975+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:28.680701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":212,"num_write":324,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'222","reported_seq":887,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.620980+0000","last_change":"2024-09-12T17:00:14.332252+0000","last_active":"2024-09-12T18:10:36.620980+0000","last_peered":"2024-09-12T18:10:36.620980+0000","last_clean":"2024-09-12T18:10:36.620980+0000","last_became_active":"2024-09-12T17:00:14.328921+0000","last_became_peered":"2024-09-12T17:00:14.328921+0000","last_unstale":"2024-09-12T18:10:36.620980+0000","last_undegraded":"2024-09-12T18:10:36.620980+0000","last_fullsized":"2024-09-12T18:10:36.620980+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:14.125302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":992,"num_read_kb":851,"num_write":318,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'318","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.928031+0000","last_change":"2024-09-12T17:00:12.311889+0000","last_active":"2024-09-12T18:13:48.928031+0000","last_peered":"2024-09-12T18:13:48.928031+0000","last_clean":"2024-09-12T18:13:48.928031+0000","last_became_active":"2024-09-12T17:00:12.311606+0000","last_became_peered":"2024-09-12T17:00:12.311606+0000","last_unstale":"2024-09-12T18:13:48.928031+0000","last_undegraded":"2024-09-12T18:13:48.928031+0000","last_fullsized":"2024-09-12T18:13:48.928031+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:22.040208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049198,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":437,"num_read_kb":10884,"num_write":1090,"num_write_kb":34953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.749361+0000","last_change":"2024-09-12T17:00:16.327834+0000","last_active":"2024-09-12T18:11:07.749361+0000","last_peered":"2024-09-12T18:11:07.749361+0000","last_clean":"2024-09-12T18:11:07.749361+0000","last_became_active":"2024-09-12T17:00:16.327527+0000","last_became_peered":"2024-09-12T17:00:16.327527+0000","last_unstale":"2024-09-12T18:11:07.749361+0000","last_undegraded":"2024-09-12T18:11:07.749361+0000","last_fullsized":"2024-09-12T18:11:07.749361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:26.325669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'333","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:47.778601+0000","last_change":"2024-09-12T17:00:18.327394+0000","last_active":"2024-09-12T18:12:47.778601+0000","last_peered":"2024-09-12T18:12:47.778601+0000","last_clean":"2024-09-12T18:12:47.778601+0000","last_became_active":"2024-09-12T17:00:18.326984+0000","last_became_peered":"2024-09-12T17:00:18.326984+0000","last_unstale":"2024-09-12T18:12:47.778601+0000","last_undegraded":"2024-09-12T18:12:47.778601+0000","last_fullsized":"2024-09-12T18:12:47.778601+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:47.996940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57552,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":549,"num_read_kb":1064,"num_write":458,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:23.917579+0000","last_change":"2024-09-12T17:00:20.348230+0000","last_active":"2024-09-12T18:10:23.917579+0000","last_peered":"2024-09-12T18:10:23.917579+0000","last_clean":"2024-09-12T18:10:23.917579+0000","last_became_active":"2024-09-12T17:00:20.347873+0000","last_became_peered":"2024-09-12T17:00:20.347873+0000","last_unstale":"2024-09-12T18:10:23.917579+0000","last_undegraded":"2024-09-12T18:10:23.917579+0000","last_fullsized":"2024-09-12T18:10:23.917579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:20.554953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'167","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.557258+0000","last_change":"2024-09-12T17:00:22.351181+0000","last_active":"2024-09-12T18:11:58.557258+0000","last_peered":"2024-09-12T18:11:58.557258+0000","last_clean":"2024-09-12T18:11:58.557258+0000","last_became_active":"2024-09-12T17:00:22.350856+0000","last_became_peered":"2024-09-12T17:00:22.350856+0000","last_unstale":"2024-09-12T18:11:58.557258+0000","last_undegraded":"2024-09-12T18:11:58.557258+0000","last_fullsized":"2024-09-12T18:11:58.557258+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:47.546741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1852,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":274,"num_read_kb":259,"num_write":495,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'116","reported_seq":702,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:16.842438+0000","last_change":"2024-09-12T17:00:14.337578+0000","last_active":"2024-09-12T18:10:16.842438+0000","last_peered":"2024-09-12T18:10:16.842438+0000","last_clean":"2024-09-12T18:10:16.842438+0000","last_became_active":"2024-09-12T17:00:14.336495+0000","last_became_peered":"2024-09-12T17:00:14.336495+0000","last_unstale":"2024-09-12T18:10:16.842438+0000","last_undegraded":"2024-09-12T18:10:16.842438+0000","last_fullsized":"2024-09-12T18:10:16.842438+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:35.177783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":523,"num_read_kb":437,"num_write":169,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'295","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:14.335860+0000","last_change":"2024-09-12T17:00:12.318854+0000","last_active":"2024-09-12T18:13:14.335860+0000","last_peered":"2024-09-12T18:13:14.335860+0000","last_clean":"2024-09-12T18:13:14.335860+0000","last_became_active":"2024-09-12T17:00:12.318234+0000","last_became_peered":"2024-09-12T17:00:12.318234+0000","last_unstale":"2024-09-12T18:13:14.335860+0000","last_undegraded":"2024-09-12T18:13:14.335860+0000","last_fullsized":"2024-09-12T18:13:14.335860+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:50.822617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12656318,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":393,"num_read_kb":38331,"num_write":1055,"num_write_kb":59769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"36'3","reported_seq":987,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:22.951577+0000","last_change":"2024-09-12T17:00:16.327679+0000","last_active":"2024-09-12T18:13:22.951577+0000","last_peered":"2024-09-12T18:13:22.951577+0000","last_clean":"2024-09-12T18:13:22.951577+0000","last_became_active":"2024-09-12T17:00:16.327396+0000","last_became_peered":"2024-09-12T17:00:16.327396+0000","last_unstale":"2024-09-12T18:13:22.951577+0000","last_undegraded":"2024-09-12T18:13:22.951577+0000","last_fullsized":"2024-09-12T18:13:22.951577+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:03.799735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'289","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:16.865306+0000","last_change":"2024-09-12T17:00:18.429503+0000","last_active":"2024-09-12T18:13:16.865306+0000","last_peered":"2024-09-12T18:13:16.865306+0000","last_clean":"2024-09-12T18:13:16.865306+0000","last_became_active":"2024-09-12T17:00:18.429149+0000","last_became_peered":"2024-09-12T17:00:18.429149+0000","last_unstale":"2024-09-12T18:13:16.865306+0000","last_undegraded":"2024-09-12T18:13:16.865306+0000","last_fullsized":"2024-09-12T18:13:16.865306+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:42.541128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61118,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":1019,"num_write":394,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:38.919197+0000","last_change":"2024-09-12T17:00:20.350078+0000","last_active":"2024-09-12T18:10:38.919197+0000","last_peered":"2024-09-12T18:10:38.919197+0000","last_clean":"2024-09-12T18:10:38.919197+0000","last_became_active":"2024-09-12T17:00:20.349769+0000","last_became_peered":"2024-09-12T17:00:20.349769+0000","last_unstale":"2024-09-12T18:10:38.919197+0000","last_undegraded":"2024-09-12T18:10:38.919197+0000","last_fullsized":"2024-09-12T18:10:38.919197+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:01.586846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'102","reported_seq":597,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.025748+0000","last_change":"2024-09-12T17:00:22.359344+0000","last_active":"2024-09-12T18:13:23.025748+0000","last_peered":"2024-09-12T18:13:23.025748+0000","last_clean":"2024-09-12T18:13:23.025748+0000","last_became_active":"2024-09-12T17:00:22.358484+0000","last_became_peered":"2024-09-12T17:00:22.358484+0000","last_unstale":"2024-09-12T18:13:23.025748+0000","last_undegraded":"2024-09-12T18:13:23.025748+0000","last_fullsized":"2024-09-12T18:13:23.025748+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:18.149297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":123,"num_write":242,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'161","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:13.698084+0000","last_change":"2024-09-12T17:00:14.330553+0000","last_active":"2024-09-12T18:10:13.698084+0000","last_peered":"2024-09-12T18:10:13.698084+0000","last_clean":"2024-09-12T18:10:13.698084+0000","last_became_active":"2024-09-12T17:00:14.330238+0000","last_became_peered":"2024-09-12T17:00:14.330238+0000","last_unstale":"2024-09-12T18:10:13.698084+0000","last_undegraded":"2024-09-12T18:10:13.698084+0000","last_fullsized":"2024-09-12T18:10:13.698084+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:59.558428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":737,"num_read_kb":617,"num_write":248,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'266","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:11.618055+0000","last_change":"2024-09-12T17:00:12.305559+0000","last_active":"2024-09-12T18:10:11.618055+0000","last_peered":"2024-09-12T18:10:11.618055+0000","last_clean":"2024-09-12T18:10:11.618055+0000","last_became_active":"2024-09-12T17:00:12.305259+0000","last_became_peered":"2024-09-12T17:00:12.305259+0000","last_unstale":"2024-09-12T18:10:11.618055+0000","last_undegraded":"2024-09-12T18:10:11.618055+0000","last_fullsized":"2024-09-12T18:10:11.618055+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:27.124942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1413041,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":401,"num_read_kb":5192,"num_write":964,"num_write_kb":36405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:18.916910+0000","last_change":"2024-09-12T17:00:16.327913+0000","last_active":"2024-09-12T18:10:18.916910+0000","last_peered":"2024-09-12T18:10:18.916910+0000","last_clean":"2024-09-12T18:10:18.916910+0000","last_became_active":"2024-09-12T17:00:16.327626+0000","last_became_peered":"2024-09-12T17:00:16.327626+0000","last_unstale":"2024-09-12T18:10:18.916910+0000","last_undegraded":"2024-09-12T18:10:18.916910+0000","last_fullsized":"2024-09-12T18:10:18.916910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:33.847646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'109","reported_seq":655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.784639+0000","last_change":"2024-09-12T17:00:18.429917+0000","last_active":"2024-09-12T18:11:11.784639+0000","last_peered":"2024-09-12T18:11:11.784639+0000","last_clean":"2024-09-12T18:11:11.784639+0000","last_became_active":"2024-09-12T17:00:18.429481+0000","last_became_peered":"2024-09-12T17:00:18.429481+0000","last_unstale":"2024-09-12T18:11:11.784639+0000","last_undegraded":"2024-09-12T18:11:11.784639+0000","last_fullsized":"2024-09-12T18:11:11.784639+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:59.225430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":118,"num_write":86,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'781","reported_seq":4456,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.332692+0000","last_change":"2024-09-12T17:00:20.351383+0000","last_active":"2024-09-12T18:13:23.332692+0000","last_peered":"2024-09-12T18:13:23.332692+0000","last_clean":"2024-09-12T18:13:23.332692+0000","last_became_active":"2024-09-12T17:00:20.350976+0000","last_became_peered":"2024-09-12T17:00:20.350976+0000","last_unstale":"2024-09-12T18:13:23.332692+0000","last_undegraded":"2024-09-12T18:13:23.332692+0000","last_fullsized":"2024-09-12T18:13:23.332692+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:56.750542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'112","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.755851+0000","last_change":"2024-09-12T17:00:22.357875+0000","last_active":"2024-09-12T18:10:22.755851+0000","last_peered":"2024-09-12T18:10:22.755851+0000","last_clean":"2024-09-12T18:10:22.755851+0000","last_became_active":"2024-09-12T17:00:22.357215+0000","last_became_peered":"2024-09-12T17:00:22.357215+0000","last_unstale":"2024-09-12T18:10:22.755851+0000","last_undegraded":"2024-09-12T18:10:22.755851+0000","last_fullsized":"2024-09-12T18:10:22.755851+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:29.171521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":135,"num_write":263,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'292","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.921553+0000","last_change":"2024-09-12T17:00:14.340729+0000","last_active":"2024-09-12T18:12:01.921553+0000","last_peered":"2024-09-12T18:12:01.921553+0000","last_clean":"2024-09-12T18:12:01.921553+0000","last_became_active":"2024-09-12T17:00:14.340459+0000","last_became_peered":"2024-09-12T17:00:14.340459+0000","last_unstale":"2024-09-12T18:12:01.921553+0000","last_undegraded":"2024-09-12T18:12:01.921553+0000","last_fullsized":"2024-09-12T18:12:01.921553+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:27.507845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1297,"num_read_kb":1099,"num_write":462,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'284","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.589509+0000","last_change":"2024-09-12T17:00:46.721548+0000","last_active":"2024-09-12T18:13:48.589509+0000","last_peered":"2024-09-12T18:13:48.589509+0000","last_clean":"2024-09-12T18:13:48.589509+0000","last_became_active":"2024-09-12T17:00:46.721297+0000","last_became_peered":"2024-09-12T17:00:46.721297+0000","last_unstale":"2024-09-12T18:13:48.589509+0000","last_undegraded":"2024-09-12T18:13:48.589509+0000","last_fullsized":"2024-09-12T18:13:48.589509+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:14.131705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10338638,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":473,"num_read_kb":37694,"num_write":998,"num_write_kb":18010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.755136+0000","last_change":"2024-09-12T17:00:16.327719+0000","last_active":"2024-09-12T18:10:17.755136+0000","last_peered":"2024-09-12T18:10:17.755136+0000","last_clean":"2024-09-12T18:10:17.755136+0000","last_became_active":"2024-09-12T17:00:16.327461+0000","last_became_peered":"2024-09-12T17:00:16.327461+0000","last_unstale":"2024-09-12T18:10:17.755136+0000","last_undegraded":"2024-09-12T18:10:17.755136+0000","last_fullsized":"2024-09-12T18:10:17.755136+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:19.144290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'320","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:02.979920+0000","last_change":"2024-09-12T17:00:18.329265+0000","last_active":"2024-09-12T18:13:02.979920+0000","last_peered":"2024-09-12T18:13:02.979920+0000","last_clean":"2024-09-12T18:13:02.979920+0000","last_became_active":"2024-09-12T17:00:18.328990+0000","last_became_peered":"2024-09-12T17:00:18.328990+0000","last_unstale":"2024-09-12T18:13:02.979920+0000","last_undegraded":"2024-09-12T18:13:02.979920+0000","last_fullsized":"2024-09-12T18:13:02.979920+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:43.048916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50183,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":511,"num_read_kb":967,"num_write":402,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.619737+0000","last_change":"2024-09-12T17:00:20.350160+0000","last_active":"2024-09-12T18:10:26.619737+0000","last_peered":"2024-09-12T18:10:26.619737+0000","last_clean":"2024-09-12T18:10:26.619737+0000","last_became_active":"2024-09-12T17:00:20.349643+0000","last_became_peered":"2024-09-12T17:00:20.349643+0000","last_unstale":"2024-09-12T18:10:26.619737+0000","last_undegraded":"2024-09-12T18:10:26.619737+0000","last_fullsized":"2024-09-12T18:10:26.619737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:12.715810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'119","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.422359+0000","last_change":"2024-09-12T17:00:22.355955+0000","last_active":"2024-09-12T18:11:59.422359+0000","last_peered":"2024-09-12T18:11:59.422359+0000","last_clean":"2024-09-12T18:11:59.422359+0000","last_became_active":"2024-09-12T17:00:22.355658+0000","last_became_peered":"2024-09-12T17:00:22.355658+0000","last_unstale":"2024-09-12T18:11:59.422359+0000","last_undegraded":"2024-09-12T18:11:59.422359+0000","last_fullsized":"2024-09-12T18:11:59.422359+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:47.710679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":157,"num_read_kb":152,"num_write":284,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'216","reported_seq":827,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:15.752295+0000","last_change":"2024-09-12T17:00:14.334900+0000","last_active":"2024-09-12T18:10:15.752295+0000","last_peered":"2024-09-12T18:10:15.752295+0000","last_clean":"2024-09-12T18:10:15.752295+0000","last_became_active":"2024-09-12T17:00:14.334620+0000","last_became_peered":"2024-09-12T17:00:14.334620+0000","last_unstale":"2024-09-12T18:10:15.752295+0000","last_undegraded":"2024-09-12T18:10:15.752295+0000","last_fullsized":"2024-09-12T18:10:15.752295+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:57.025216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":978,"num_read_kb":833,"num_write":353,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'322","reported_seq":1001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:13.318345+0000","last_change":"2024-09-12T17:00:12.318288+0000","last_active":"2024-09-12T18:10:13.318345+0000","last_peered":"2024-09-12T18:10:13.318345+0000","last_clean":"2024-09-12T18:10:13.318345+0000","last_became_active":"2024-09-12T17:00:12.317850+0000","last_became_peered":"2024-09-12T17:00:12.317850+0000","last_unstale":"2024-09-12T18:10:13.318345+0000","last_undegraded":"2024-09-12T18:10:13.318345+0000","last_fullsized":"2024-09-12T18:10:13.318345+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:24.624921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12901529,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":538,"num_read_kb":19368,"num_write":1045,"num_write_kb":17051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.953668+0000","last_change":"2024-09-12T17:00:16.329861+0000","last_active":"2024-09-12T18:10:17.953668+0000","last_peered":"2024-09-12T18:10:17.953668+0000","last_clean":"2024-09-12T18:10:17.953668+0000","last_became_active":"2024-09-12T17:00:16.329505+0000","last_became_peered":"2024-09-12T17:00:16.329505+0000","last_unstale":"2024-09-12T18:10:17.953668+0000","last_undegraded":"2024-09-12T18:10:17.953668+0000","last_fullsized":"2024-09-12T18:10:17.953668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:10.041738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'261","reported_seq":849,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:51.636926+0000","last_change":"2024-09-12T17:00:18.330870+0000","last_active":"2024-09-12T18:12:51.636926+0000","last_peered":"2024-09-12T18:12:51.636926+0000","last_clean":"2024-09-12T18:12:51.636926+0000","last_became_active":"2024-09-12T17:00:18.330548+0000","last_became_peered":"2024-09-12T17:00:18.330548+0000","last_unstale":"2024-09-12T18:12:51.636926+0000","last_undegraded":"2024-09-12T18:12:51.636926+0000","last_fullsized":"2024-09-12T18:12:51.636926+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:29.885447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51585,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":432,"num_read_kb":919,"num_write":346,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.744654+0000","last_change":"2024-09-12T17:00:20.347403+0000","last_active":"2024-09-12T18:10:37.744654+0000","last_peered":"2024-09-12T18:10:37.744654+0000","last_clean":"2024-09-12T18:10:37.744654+0000","last_became_active":"2024-09-12T17:00:20.347122+0000","last_became_peered":"2024-09-12T17:00:20.347122+0000","last_unstale":"2024-09-12T18:10:37.744654+0000","last_undegraded":"2024-09-12T18:10:37.744654+0000","last_fullsized":"2024-09-12T18:10:37.744654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:45.526521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'144","reported_seq":681,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.843667+0000","last_change":"2024-09-12T17:00:22.588688+0000","last_active":"2024-09-12T18:10:26.843667+0000","last_peered":"2024-09-12T18:10:26.843667+0000","last_clean":"2024-09-12T18:10:26.843667+0000","last_became_active":"2024-09-12T17:00:22.588367+0000","last_became_peered":"2024-09-12T17:00:22.588367+0000","last_unstale":"2024-09-12T18:10:26.843667+0000","last_undegraded":"2024-09-12T18:10:26.843667+0000","last_fullsized":"2024-09-12T18:10:26.843667+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:33.524563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":299,"num_read_kb":277,"num_write":353,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'86","reported_seq":667,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844124+0000","last_change":"2024-09-12T17:00:14.338550+0000","last_active":"2024-09-12T18:10:31.844124+0000","last_peered":"2024-09-12T18:10:31.844124+0000","last_clean":"2024-09-12T18:10:31.844124+0000","last_became_active":"2024-09-12T17:00:14.338251+0000","last_became_peered":"2024-09-12T17:00:14.338251+0000","last_unstale":"2024-09-12T18:10:31.844124+0000","last_undegraded":"2024-09-12T18:10:31.844124+0000","last_fullsized":"2024-09-12T18:10:31.844124+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:22.563527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":335,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'318","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.843064+0000","last_change":"2024-09-12T17:00:12.319168+0000","last_active":"2024-09-12T18:10:21.843064+0000","last_peered":"2024-09-12T18:10:21.843064+0000","last_clean":"2024-09-12T18:10:21.843064+0000","last_became_active":"2024-09-12T17:00:12.318883+0000","last_became_peered":"2024-09-12T17:00:12.318883+0000","last_unstale":"2024-09-12T18:10:21.843064+0000","last_undegraded":"2024-09-12T18:10:21.843064+0000","last_fullsized":"2024-09-12T18:10:21.843064+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:05.539963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1748566,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":632,"num_read_kb":40775,"num_write":1122,"num_write_kb":14251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"36'5","reported_seq":988,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:22.950870+0000","last_change":"2024-09-12T17:00:16.326343+0000","last_active":"2024-09-12T18:13:22.950870+0000","last_peered":"2024-09-12T18:13:22.950870+0000","last_clean":"2024-09-12T18:13:22.950870+0000","last_became_active":"2024-09-12T17:00:16.326067+0000","last_became_peered":"2024-09-12T17:00:16.326067+0000","last_unstale":"2024-09-12T18:13:22.950870+0000","last_undegraded":"2024-09-12T18:13:22.950870+0000","last_fullsized":"2024-09-12T18:13:22.950870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:58.899112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'265","reported_seq":822,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:51.862183+0000","last_change":"2024-09-12T17:00:18.326987+0000","last_active":"2024-09-12T18:12:51.862183+0000","last_peered":"2024-09-12T18:12:51.862183+0000","last_clean":"2024-09-12T18:12:51.862183+0000","last_became_active":"2024-09-12T17:00:18.326438+0000","last_became_peered":"2024-09-12T17:00:18.326438+0000","last_unstale":"2024-09-12T18:12:51.862183+0000","last_undegraded":"2024-09-12T18:12:51.862183+0000","last_fullsized":"2024-09-12T18:12:51.862183+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:02.146729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59502,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":432,"num_read_kb":968,"num_write":366,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.753168+0000","last_change":"2024-09-12T17:00:20.349597+0000","last_active":"2024-09-12T18:10:20.753168+0000","last_peered":"2024-09-12T18:10:20.753168+0000","last_clean":"2024-09-12T18:10:20.753168+0000","last_became_active":"2024-09-12T17:00:20.349324+0000","last_became_peered":"2024-09-12T17:00:20.349324+0000","last_unstale":"2024-09-12T18:10:20.753168+0000","last_undegraded":"2024-09-12T18:10:20.753168+0000","last_fullsized":"2024-09-12T18:10:20.753168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:28.300340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'171","reported_seq":1639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.329193+0000","last_change":"2024-09-12T17:00:22.354055+0000","last_active":"2024-09-12T18:11:59.329193+0000","last_peered":"2024-09-12T18:11:59.329193+0000","last_clean":"2024-09-12T18:11:59.329193+0000","last_became_active":"2024-09-12T17:00:22.353287+0000","last_became_peered":"2024-09-12T17:00:22.353287+0000","last_unstale":"2024-09-12T18:11:59.329193+0000","last_undegraded":"2024-09-12T18:11:59.329193+0000","last_fullsized":"2024-09-12T18:11:59.329193+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:04.187431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1233,"num_read_kb":1225,"num_write":392,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'366","reported_seq":1049,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.753093+0000","last_change":"2024-09-12T17:00:14.323586+0000","last_active":"2024-09-12T18:10:20.753093+0000","last_peered":"2024-09-12T18:10:20.753093+0000","last_clean":"2024-09-12T18:10:20.753093+0000","last_became_active":"2024-09-12T17:00:14.323113+0000","last_became_peered":"2024-09-12T17:00:14.323113+0000","last_unstale":"2024-09-12T18:10:20.753093+0000","last_undegraded":"2024-09-12T18:10:20.753093+0000","last_fullsized":"2024-09-12T18:10:20.753093+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:22.883267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1619,"num_read_kb":1299,"num_write":554,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'260","reported_seq":923,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:01.623714+0000","last_change":"2024-09-12T17:00:12.312702+0000","last_active":"2024-09-12T18:11:01.623714+0000","last_peered":"2024-09-12T18:11:01.623714+0000","last_clean":"2024-09-12T18:11:01.623714+0000","last_became_active":"2024-09-12T17:00:12.312456+0000","last_became_peered":"2024-09-12T17:00:12.312456+0000","last_unstale":"2024-09-12T18:11:01.623714+0000","last_undegraded":"2024-09-12T18:11:01.623714+0000","last_fullsized":"2024-09-12T18:11:01.623714+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:20.588667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716514,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":442,"num_read_kb":30859,"num_write":938,"num_write_kb":23841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:38.919143+0000","last_change":"2024-09-12T17:00:16.326062+0000","last_active":"2024-09-12T18:10:38.919143+0000","last_peered":"2024-09-12T18:10:38.919143+0000","last_clean":"2024-09-12T18:10:38.919143+0000","last_became_active":"2024-09-12T17:00:16.325535+0000","last_became_peered":"2024-09-12T17:00:16.325535+0000","last_unstale":"2024-09-12T18:10:38.919143+0000","last_undegraded":"2024-09-12T18:10:38.919143+0000","last_fullsized":"2024-09-12T18:10:38.919143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:32.939447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'301","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:50.776088+0000","last_change":"2024-09-12T17:00:18.326450+0000","last_active":"2024-09-12T18:12:50.776088+0000","last_peered":"2024-09-12T18:12:50.776088+0000","last_clean":"2024-09-12T18:12:50.776088+0000","last_became_active":"2024-09-12T17:00:18.326140+0000","last_became_peered":"2024-09-12T17:00:18.326140+0000","last_unstale":"2024-09-12T18:12:50.776088+0000","last_undegraded":"2024-09-12T18:12:50.776088+0000","last_fullsized":"2024-09-12T18:12:50.776088+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:38.985728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56862,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":502,"num_read_kb":1029,"num_write":400,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619169+0000","last_change":"2024-09-12T17:00:20.354653+0000","last_active":"2024-09-12T18:10:21.619169+0000","last_peered":"2024-09-12T18:10:21.619169+0000","last_clean":"2024-09-12T18:10:21.619169+0000","last_became_active":"2024-09-12T17:00:20.353962+0000","last_became_peered":"2024-09-12T17:00:20.353962+0000","last_unstale":"2024-09-12T18:10:21.619169+0000","last_undegraded":"2024-09-12T18:10:21.619169+0000","last_fullsized":"2024-09-12T18:10:21.619169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:46.119505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'120","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:21.908306+0000","last_change":"2024-09-12T17:00:22.353191+0000","last_active":"2024-09-12T18:13:21.908306+0000","last_peered":"2024-09-12T18:13:21.908306+0000","last_clean":"2024-09-12T18:13:21.908306+0000","last_became_active":"2024-09-12T17:00:22.352779+0000","last_became_peered":"2024-09-12T17:00:22.352779+0000","last_unstale":"2024-09-12T18:13:21.908306+0000","last_undegraded":"2024-09-12T18:13:21.908306+0000","last_fullsized":"2024-09-12T18:13:21.908306+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:10.560331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":133,"num_write":289,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'171","reported_seq":772,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:33.912004+0000","last_change":"2024-09-12T17:00:14.315744+0000","last_active":"2024-09-12T18:09:33.912004+0000","last_peered":"2024-09-12T18:09:33.912004+0000","last_clean":"2024-09-12T18:09:33.912004+0000","last_became_active":"2024-09-12T17:00:14.315424+0000","last_became_peered":"2024-09-12T17:00:14.315424+0000","last_unstale":"2024-09-12T18:09:33.912004+0000","last_undegraded":"2024-09-12T18:09:33.912004+0000","last_fullsized":"2024-09-12T18:09:33.912004+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:21.991890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":753,"num_read_kb":612,"num_write":278,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'265","reported_seq":1004,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:02.748584+0000","last_change":"2024-09-12T17:00:12.310622+0000","last_active":"2024-09-12T18:11:02.748584+0000","last_peered":"2024-09-12T18:11:02.748584+0000","last_clean":"2024-09-12T18:11:02.748584+0000","last_became_active":"2024-09-12T17:00:12.310322+0000","last_became_peered":"2024-09-12T17:00:12.310322+0000","last_unstale":"2024-09-12T18:11:02.748584+0000","last_undegraded":"2024-09-12T18:11:02.748584+0000","last_fullsized":"2024-09-12T18:11:02.748584+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:55.608530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9702271,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":504,"num_read_kb":27239,"num_write":985,"num_write_kb":25993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'258","reported_seq":883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:07.952184+0000","last_change":"2024-09-12T17:00:46.407147+0000","last_active":"2024-09-12T18:10:07.952184+0000","last_peered":"2024-09-12T18:10:07.952184+0000","last_clean":"2024-09-12T18:10:07.952184+0000","last_became_active":"2024-09-12T17:00:46.406809+0000","last_became_peered":"2024-09-12T17:00:46.406809+0000","last_unstale":"2024-09-12T18:10:07.952184+0000","last_undegraded":"2024-09-12T18:10:07.952184+0000","last_fullsized":"2024-09-12T18:10:07.952184+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:36.394344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1147,"num_read_kb":935,"num_write":403,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"264'268","reported_seq":974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.581040+0000","last_change":"2024-09-12T17:00:12.312943+0000","last_active":"2024-09-12T18:13:48.581040+0000","last_peered":"2024-09-12T18:13:48.581040+0000","last_clean":"2024-09-12T18:13:48.581040+0000","last_became_active":"2024-09-12T17:00:12.312579+0000","last_became_peered":"2024-09-12T17:00:12.312579+0000","last_unstale":"2024-09-12T18:13:48.581040+0000","last_undegraded":"2024-09-12T18:13:48.581040+0000","last_fullsized":"2024-09-12T18:13:48.581040+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:00.686097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1361008,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":660,"num_read_kb":733,"num_write":902,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'458","reported_seq":1235,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:37.947629+0000","last_change":"2024-09-12T17:00:14.327470+0000","last_active":"2024-09-12T18:09:37.947629+0000","last_peered":"2024-09-12T18:09:37.947629+0000","last_clean":"2024-09-12T18:09:37.947629+0000","last_became_active":"2024-09-12T17:00:14.327158+0000","last_became_peered":"2024-09-12T17:00:14.327158+0000","last_unstale":"2024-09-12T18:09:37.947629+0000","last_undegraded":"2024-09-12T18:09:37.947629+0000","last_fullsized":"2024-09-12T18:09:37.947629+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:08.515532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2228,"num_read_kb":1913,"num_write":817,"num_write_kb":525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'264","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:07.980665+0000","last_change":"2024-09-12T17:00:12.318140+0000","last_active":"2024-09-12T18:13:07.980665+0000","last_peered":"2024-09-12T18:13:07.980665+0000","last_clean":"2024-09-12T18:13:07.980665+0000","last_became_active":"2024-09-12T17:00:12.317893+0000","last_became_peered":"2024-09-12T17:00:12.317893+0000","last_unstale":"2024-09-12T18:13:07.980665+0000","last_undegraded":"2024-09-12T18:13:07.980665+0000","last_fullsized":"2024-09-12T18:13:07.980665+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:32.821778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":562519,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":426,"num_read_kb":13770,"num_write":950,"num_write_kb":25077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'105","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:33.911941+0000","last_change":"2024-09-12T17:00:14.323700+0000","last_active":"2024-09-12T18:09:33.911941+0000","last_peered":"2024-09-12T18:09:33.911941+0000","last_clean":"2024-09-12T18:09:33.911941+0000","last_became_active":"2024-09-12T17:00:14.323394+0000","last_became_peered":"2024-09-12T17:00:14.323394+0000","last_unstale":"2024-09-12T18:09:33.911941+0000","last_undegraded":"2024-09-12T18:09:33.911941+0000","last_fullsized":"2024-09-12T18:09:33.911941+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:59.080164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":480,"num_read_kb":401,"num_write":159,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'381","reported_seq":1139,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:21.625924+0000","last_change":"2024-09-12T17:00:12.315248+0000","last_active":"2024-09-12T18:11:21.625924+0000","last_peered":"2024-09-12T18:11:21.625924+0000","last_clean":"2024-09-12T18:11:21.625924+0000","last_became_active":"2024-09-12T17:00:12.314938+0000","last_became_peered":"2024-09-12T17:00:12.314938+0000","last_unstale":"2024-09-12T18:11:21.625924+0000","last_undegraded":"2024-09-12T18:11:21.625924+0000","last_fullsized":"2024-09-12T18:11:21.625924+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:26.555386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7272567,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":766,"num_read_kb":44492,"num_write":1327,"num_write_kb":38820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'333","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:16.849080+0000","last_change":"2024-09-12T17:00:14.334325+0000","last_active":"2024-09-12T18:11:16.849080+0000","last_peered":"2024-09-12T18:11:16.849080+0000","last_clean":"2024-09-12T18:11:16.849080+0000","last_became_active":"2024-09-12T17:00:14.333821+0000","last_became_peered":"2024-09-12T17:00:14.333821+0000","last_unstale":"2024-09-12T18:11:16.849080+0000","last_undegraded":"2024-09-12T18:11:16.849080+0000","last_fullsized":"2024-09-12T18:11:16.849080+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:38.122605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1469,"num_read_kb":1192,"num_write":564,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'262","reported_seq":915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:12.652661+0000","last_change":"2024-09-12T17:00:12.317044+0000","last_active":"2024-09-12T18:13:12.652661+0000","last_peered":"2024-09-12T18:13:12.652661+0000","last_clean":"2024-09-12T18:13:12.652661+0000","last_became_active":"2024-09-12T17:00:12.316672+0000","last_became_peered":"2024-09-12T17:00:12.316672+0000","last_unstale":"2024-09-12T18:13:12.652661+0000","last_undegraded":"2024-09-12T18:13:12.652661+0000","last_fullsized":"2024-09-12T18:13:12.652661+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:33.188507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13956928,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":420,"num_read_kb":22931,"num_write":895,"num_write_kb":33827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'55","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:05.760226+0000","last_change":"2024-09-12T17:00:14.324630+0000","last_active":"2024-09-12T18:11:05.760226+0000","last_peered":"2024-09-12T18:11:05.760226+0000","last_clean":"2024-09-12T18:11:05.760226+0000","last_became_active":"2024-09-12T17:00:14.324051+0000","last_became_peered":"2024-09-12T17:00:14.324051+0000","last_unstale":"2024-09-12T18:11:05.760226+0000","last_undegraded":"2024-09-12T18:11:05.760226+0000","last_fullsized":"2024-09-12T18:11:05.760226+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:00.419356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":201,"num_write":77,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'310","reported_seq":985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.920774+0000","last_change":"2024-09-12T17:00:12.314909+0000","last_active":"2024-09-12T18:13:48.920774+0000","last_peered":"2024-09-12T18:13:48.920774+0000","last_clean":"2024-09-12T18:13:48.920774+0000","last_became_active":"2024-09-12T17:00:12.314059+0000","last_became_peered":"2024-09-12T17:00:12.314059+0000","last_unstale":"2024-09-12T18:13:48.920774+0000","last_undegraded":"2024-09-12T18:13:48.920774+0000","last_fullsized":"2024-09-12T18:13:48.920774+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:36.683937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9064183,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":475,"num_read_kb":67840,"num_write":999,"num_write_kb":38572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'162","reported_seq":748,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:06.847823+0000","last_change":"2024-09-12T17:00:14.338773+0000","last_active":"2024-09-12T18:11:06.847823+0000","last_peered":"2024-09-12T18:11:06.847823+0000","last_clean":"2024-09-12T18:11:06.847823+0000","last_became_active":"2024-09-12T17:00:14.338503+0000","last_became_peered":"2024-09-12T17:00:14.338503+0000","last_unstale":"2024-09-12T18:11:06.847823+0000","last_undegraded":"2024-09-12T18:11:06.847823+0000","last_fullsized":"2024-09-12T18:11:06.847823+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:37.093331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":567,"num_write":272,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'256","reported_seq":864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:32.735364+0000","last_change":"2024-09-12T17:00:12.312243+0000","last_active":"2024-09-12T18:09:32.735364+0000","last_peered":"2024-09-12T18:09:32.735364+0000","last_clean":"2024-09-12T18:09:32.735364+0000","last_became_active":"2024-09-12T17:00:12.311933+0000","last_became_peered":"2024-09-12T17:00:12.311933+0000","last_unstale":"2024-09-12T18:09:32.735364+0000","last_undegraded":"2024-09-12T18:09:32.735364+0000","last_fullsized":"2024-09-12T18:09:32.735364+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:08:37.097651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7602949,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":354,"num_read_kb":17784,"num_write":928,"num_write_kb":43947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'289","reported_seq":1002,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.749263+0000","last_change":"2024-09-12T17:00:14.319474+0000","last_active":"2024-09-12T18:11:07.749263+0000","last_peered":"2024-09-12T18:11:07.749263+0000","last_clean":"2024-09-12T18:11:07.749263+0000","last_became_active":"2024-09-12T17:00:14.319152+0000","last_became_peered":"2024-09-12T17:00:14.319152+0000","last_unstale":"2024-09-12T18:11:07.749263+0000","last_undegraded":"2024-09-12T18:11:07.749263+0000","last_fullsized":"2024-09-12T18:11:07.749263+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:25.091276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1506,"num_read_kb":1343,"num_write":479,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'371","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:31.837441+0000","last_change":"2024-09-12T17:00:12.321281+0000","last_active":"2024-09-12T18:09:31.837441+0000","last_peered":"2024-09-12T18:09:31.837441+0000","last_clean":"2024-09-12T18:09:31.837441+0000","last_became_active":"2024-09-12T17:00:12.320948+0000","last_became_peered":"2024-09-12T17:00:12.320948+0000","last_unstale":"2024-09-12T18:09:31.837441+0000","last_undegraded":"2024-09-12T18:09:31.837441+0000","last_fullsized":"2024-09-12T18:09:31.837441+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:58.027696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6346303,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":552,"num_read_kb":23095,"num_write":1328,"num_write_kb":45480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'356","reported_seq":1089,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:16.618637+0000","last_change":"2024-09-12T17:00:14.332105+0000","last_active":"2024-09-12T18:10:16.618637+0000","last_peered":"2024-09-12T18:10:16.618637+0000","last_clean":"2024-09-12T18:10:16.618637+0000","last_became_active":"2024-09-12T17:00:14.331839+0000","last_became_peered":"2024-09-12T17:00:14.331839+0000","last_unstale":"2024-09-12T18:10:16.618637+0000","last_undegraded":"2024-09-12T18:10:16.618637+0000","last_fullsized":"2024-09-12T18:10:16.618637+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:36.033074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1691,"num_read_kb":1457,"num_write":527,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'347","reported_seq":989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:47.949200+0000","last_change":"2024-09-12T17:00:12.320366+0000","last_active":"2024-09-12T18:09:47.949200+0000","last_peered":"2024-09-12T18:09:47.949200+0000","last_clean":"2024-09-12T18:09:47.949200+0000","last_became_active":"2024-09-12T17:00:12.320094+0000","last_became_peered":"2024-09-12T17:00:12.320094+0000","last_unstale":"2024-09-12T18:09:47.949200+0000","last_undegraded":"2024-09-12T18:09:47.949200+0000","last_fullsized":"2024-09-12T18:09:47.949200+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:12.089633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12780512,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":563,"num_read_kb":22255,"num_write":1147,"num_write_kb":35121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'76","reported_seq":651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:18.486632+0000","last_change":"2024-09-12T17:00:14.335295+0000","last_active":"2024-09-12T18:10:18.486632+0000","last_peered":"2024-09-12T18:10:18.486632+0000","last_clean":"2024-09-12T18:10:18.486632+0000","last_became_active":"2024-09-12T17:00:14.334965+0000","last_became_peered":"2024-09-12T17:00:14.334965+0000","last_unstale":"2024-09-12T18:10:18.486632+0000","last_undegraded":"2024-09-12T18:10:18.486632+0000","last_fullsized":"2024-09-12T18:10:18.486632+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:26.399490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":336,"num_read_kb":283,"num_write":118,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'277","reported_seq":913,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:56.840050+0000","last_change":"2024-09-12T17:00:12.321716+0000","last_active":"2024-09-12T18:09:56.840050+0000","last_peered":"2024-09-12T18:09:56.840050+0000","last_clean":"2024-09-12T18:09:56.840050+0000","last_became_active":"2024-09-12T17:00:12.321156+0000","last_became_peered":"2024-09-12T17:00:12.321156+0000","last_unstale":"2024-09-12T18:09:56.840050+0000","last_undegraded":"2024-09-12T18:09:56.840050+0000","last_fullsized":"2024-09-12T18:09:56.840050+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:46.457048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6484933,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":458,"num_read_kb":18612,"num_write":978,"num_write_kb":25817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'177","reported_seq":795,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:08.697578+0000","last_change":"2024-09-12T17:00:14.323205+0000","last_active":"2024-09-12T18:10:08.697578+0000","last_peered":"2024-09-12T18:10:08.697578+0000","last_clean":"2024-09-12T18:10:08.697578+0000","last_became_active":"2024-09-12T17:00:14.322880+0000","last_became_peered":"2024-09-12T17:00:14.322880+0000","last_unstale":"2024-09-12T18:10:08.697578+0000","last_undegraded":"2024-09-12T18:10:08.697578+0000","last_fullsized":"2024-09-12T18:10:08.697578+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:18.369079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":741,"num_read_kb":611,"num_write":268,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'322","reported_seq":977,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.959939+0000","last_change":"2024-09-12T17:00:12.315023+0000","last_active":"2024-09-12T18:10:22.959939+0000","last_peered":"2024-09-12T18:10:22.959939+0000","last_clean":"2024-09-12T18:10:22.959939+0000","last_became_active":"2024-09-12T17:00:12.314707+0000","last_became_peered":"2024-09-12T17:00:12.314707+0000","last_unstale":"2024-09-12T18:10:22.959939+0000","last_undegraded":"2024-09-12T18:10:22.959939+0000","last_fullsized":"2024-09-12T18:10:22.959939+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:40.531969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6899968,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":496,"num_read_kb":37010,"num_write":1236,"num_write_kb":41769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'170","reported_seq":824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:00.750238+0000","last_change":"2024-09-12T17:00:14.325013+0000","last_active":"2024-09-12T18:10:00.750238+0000","last_peered":"2024-09-12T18:10:00.750238+0000","last_clean":"2024-09-12T18:10:00.750238+0000","last_became_active":"2024-09-12T17:00:14.324709+0000","last_became_peered":"2024-09-12T17:00:14.324709+0000","last_unstale":"2024-09-12T18:10:00.750238+0000","last_undegraded":"2024-09-12T18:10:00.750238+0000","last_fullsized":"2024-09-12T18:10:00.750238+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:55.903766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":785,"num_read_kb":657,"num_write":242,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'240","reported_seq":878,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:56.616357+0000","last_change":"2024-09-12T17:00:12.308878+0000","last_active":"2024-09-12T18:09:56.616357+0000","last_peered":"2024-09-12T18:09:56.616357+0000","last_clean":"2024-09-12T18:09:56.616357+0000","last_became_active":"2024-09-12T17:00:12.307159+0000","last_became_peered":"2024-09-12T17:00:12.307159+0000","last_unstale":"2024-09-12T18:09:56.616357+0000","last_undegraded":"2024-09-12T18:09:56.616357+0000","last_fullsized":"2024-09-12T18:09:56.616357+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:24.309768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2472218,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":372,"num_read_kb":7357,"num_write":892,"num_write_kb":31388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'4088","reported_seq":4668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:02.752498+0000","last_change":"2024-09-12T17:00:14.328088+0000","last_active":"2024-09-12T18:10:02.752498+0000","last_peered":"2024-09-12T18:10:02.752498+0000","last_clean":"2024-09-12T18:10:02.752498+0000","last_became_active":"2024-09-12T17:00:14.327792+0000","last_became_peered":"2024-09-12T17:00:14.327792+0000","last_unstale":"2024-09-12T18:10:02.752498+0000","last_undegraded":"2024-09-12T18:10:02.752498+0000","last_fullsized":"2024-09-12T18:10:02.752498+0000","mapping_epoch":26,"log_start":"264'4000","ondisk_log_start":"264'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:59.961621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16430,"num_read_kb":13786,"num_write":6128,"num_write_kb":3057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'284","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:57.738819+0000","last_change":"2024-09-12T17:00:12.311570+0000","last_active":"2024-09-12T18:09:57.738819+0000","last_peered":"2024-09-12T18:09:57.738819+0000","last_clean":"2024-09-12T18:09:57.738819+0000","last_became_active":"2024-09-12T17:00:12.311273+0000","last_became_peered":"2024-09-12T17:00:12.311273+0000","last_unstale":"2024-09-12T18:09:57.738819+0000","last_undegraded":"2024-09-12T18:09:57.738819+0000","last_fullsized":"2024-09-12T18:09:57.738819+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:26.620649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11038339,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":433,"num_read_kb":37128,"num_write":1024,"num_write_kb":49312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'265","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:01.616891+0000","last_change":"2024-09-12T17:00:14.318745+0000","last_active":"2024-09-12T18:10:01.616891+0000","last_peered":"2024-09-12T18:10:01.616891+0000","last_clean":"2024-09-12T18:10:01.616891+0000","last_became_active":"2024-09-12T17:00:14.318470+0000","last_became_peered":"2024-09-12T17:00:14.318470+0000","last_unstale":"2024-09-12T18:10:01.616891+0000","last_undegraded":"2024-09-12T18:10:01.616891+0000","last_fullsized":"2024-09-12T18:10:01.616891+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:04.138809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1277,"num_read_kb":1058,"num_write":468,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'287","reported_seq":1002,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.754212+0000","last_change":"2024-09-12T17:00:12.314662+0000","last_active":"2024-09-12T18:10:12.754212+0000","last_peered":"2024-09-12T18:10:12.754212+0000","last_clean":"2024-09-12T18:10:12.754212+0000","last_became_active":"2024-09-12T17:00:12.314371+0000","last_became_peered":"2024-09-12T17:00:12.314371+0000","last_unstale":"2024-09-12T18:10:12.754212+0000","last_undegraded":"2024-09-12T18:10:12.754212+0000","last_fullsized":"2024-09-12T18:10:12.754212+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:12.607432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2707189,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":498,"num_read_kb":6257,"num_write":1042,"num_write_kb":25577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'129","reported_seq":702,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:01.840698+0000","last_change":"2024-09-12T17:00:14.339614+0000","last_active":"2024-09-12T18:10:01.840698+0000","last_peered":"2024-09-12T18:10:01.840698+0000","last_clean":"2024-09-12T18:10:01.840698+0000","last_became_active":"2024-09-12T17:00:14.339316+0000","last_became_peered":"2024-09-12T17:00:14.339316+0000","last_unstale":"2024-09-12T18:10:01.840698+0000","last_undegraded":"2024-09-12T18:10:01.840698+0000","last_fullsized":"2024-09-12T18:10:01.840698+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:43.906333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":538,"num_read_kb":439,"num_write":190,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'280","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.566378+0000","last_change":"2024-09-12T17:00:12.310461+0000","last_active":"2024-09-12T18:13:48.566378+0000","last_peered":"2024-09-12T18:13:48.566378+0000","last_clean":"2024-09-12T18:13:48.566378+0000","last_became_active":"2024-09-12T17:00:12.310157+0000","last_became_peered":"2024-09-12T17:00:12.310157+0000","last_unstale":"2024-09-12T18:13:48.566378+0000","last_undegraded":"2024-09-12T18:13:48.566378+0000","last_fullsized":"2024-09-12T18:13:48.566378+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:09.011822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2813958,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":422,"num_read_kb":8306,"num_write":1057,"num_write_kb":29458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'208","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:52.751018+0000","last_change":"2024-09-12T17:00:46.406709+0000","last_active":"2024-09-12T18:09:52.751018+0000","last_peered":"2024-09-12T18:09:52.751018+0000","last_clean":"2024-09-12T18:09:52.751018+0000","last_became_active":"2024-09-12T17:00:46.406426+0000","last_became_peered":"2024-09-12T17:00:46.406426+0000","last_unstale":"2024-09-12T18:09:52.751018+0000","last_undegraded":"2024-09-12T18:09:52.751018+0000","last_fullsized":"2024-09-12T18:09:52.751018+0000","mapping_epoch":37,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:27.163775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":857,"num_read_kb":696,"num_write":294,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'239","reported_seq":846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.953042+0000","last_change":"2024-09-12T17:00:12.314652+0000","last_active":"2024-09-12T18:10:12.953042+0000","last_peered":"2024-09-12T18:10:12.953042+0000","last_clean":"2024-09-12T18:10:12.953042+0000","last_became_active":"2024-09-12T17:00:12.314251+0000","last_became_peered":"2024-09-12T17:00:12.314251+0000","last_unstale":"2024-09-12T18:10:12.953042+0000","last_undegraded":"2024-09-12T18:10:12.953042+0000","last_fullsized":"2024-09-12T18:10:12.953042+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:21.957765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5395730,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":339,"num_read_kb":8717,"num_write":907,"num_write_kb":22240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'257","reported_seq":1061,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.952879+0000","last_change":"2024-09-12T17:00:12.318997+0000","last_active":"2024-09-12T18:10:12.952879+0000","last_peered":"2024-09-12T18:10:12.952879+0000","last_clean":"2024-09-12T18:10:12.952879+0000","last_became_active":"2024-09-12T17:00:12.318408+0000","last_became_peered":"2024-09-12T17:00:12.318408+0000","last_unstale":"2024-09-12T18:10:12.952879+0000","last_undegraded":"2024-09-12T18:10:12.952879+0000","last_fullsized":"2024-09-12T18:10:12.952879+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:22.821486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5248793,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":798,"num_read_kb":6455,"num_write":984,"num_write_kb":20037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'90","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:41.621619+0000","last_change":"2024-09-12T17:00:14.334754+0000","last_active":"2024-09-12T18:10:41.621619+0000","last_peered":"2024-09-12T18:10:41.621619+0000","last_clean":"2024-09-12T18:10:41.621619+0000","last_became_active":"2024-09-12T17:00:14.334494+0000","last_became_peered":"2024-09-12T17:00:14.334494+0000","last_unstale":"2024-09-12T18:10:41.621619+0000","last_undegraded":"2024-09-12T18:10:41.621619+0000","last_fullsized":"2024-09-12T18:10:41.621619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:56.905718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":377,"num_read_kb":312,"num_write":145,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'313","reported_seq":950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.879094+0000","last_change":"2024-09-12T17:00:12.315356+0000","last_active":"2024-09-12T18:13:48.879094+0000","last_peered":"2024-09-12T18:13:48.879094+0000","last_clean":"2024-09-12T18:13:48.879094+0000","last_became_active":"2024-09-12T17:00:12.314988+0000","last_became_peered":"2024-09-12T17:00:12.314988+0000","last_unstale":"2024-09-12T18:13:48.879094+0000","last_undegraded":"2024-09-12T18:13:48.879094+0000","last_fullsized":"2024-09-12T18:13:48.879094+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:34.349627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352348,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":427,"num_read_kb":45801,"num_write":996,"num_write_kb":31559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'220","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954550+0000","last_change":"2024-09-12T17:00:14.333403+0000","last_active":"2024-09-12T18:10:22.954550+0000","last_peered":"2024-09-12T18:10:22.954550+0000","last_clean":"2024-09-12T18:10:22.954550+0000","last_became_active":"2024-09-12T17:00:14.333107+0000","last_became_peered":"2024-09-12T17:00:14.333107+0000","last_unstale":"2024-09-12T18:10:22.954550+0000","last_undegraded":"2024-09-12T18:10:22.954550+0000","last_fullsized":"2024-09-12T18:10:22.954550+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:26.316619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":970,"num_read_kb":803,"num_write":364,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5638,"num_read_kb":3956,"num_write":1906,"num_write_kb":804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1077,"ondisk_log_size":1077,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":16256,"num_read_kb":15929,"num_write":16738,"num_write_kb":4889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1664,"ondisk_log_size":1664,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":530,"ondisk_log_size":530,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1864610,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":18668,"num_read_kb":36144,"num_write":15719,"num_write_kb":11922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2965504,"data_stored":2482896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2053,"ondisk_log_size":2053,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2425,"num_read_kb":2890,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102836,"num_read_kb":85763,"num_write":37242,"num_write_kb":18813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3654,"ondisk_log_size":3654,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":457793760,"num_objects":4182,"num_object_clones":0,"num_object_copies":8364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4182,"num_whiteouts":0,"num_read":32389,"num_read_kb":1844161,"num_write":67660,"num_write_kb":1970689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":955830272,"data_stored":925329253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4185,"ondisk_log_size":4185,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":52066681,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":133,"num_read_kb":154912,"num_write":159,"num_write_kb":116389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98902016,"data_stored":98890482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":58307678,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":133,"num_read_kb":158387,"num_write":159,"num_write_kb":116389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":117719040,"data_stored":117711178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424510333,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":155752,"kb_used_data":106520,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94216088,"statfs":{"total":96636764160,"available":96477274112,"internally_reserved":0,"allocated":109076480,"data_stored":105026341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510336,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":241088,"kb_used_data":133616,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94130752,"statfs":{"total":96636764160,"available":96389890048,"internally_reserved":0,"allocated":136822784,"data_stored":132283647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543035,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":408228,"kb_used_data":170196,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":93963612,"statfs":{"total":96636764160,"available":96218738688,"internally_reserved":0,"allocated":174280704,"data_stored":168243840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":243726794},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543037,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":353796,"kb_used_data":133812,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94018044,"statfs":{"total":96636764160,"available":96274477056,"internally_reserved":0,"allocated":137023488,"data_stored":132465467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225245638},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543037,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":264308,"kb_used_data":165156,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94107532,"statfs":{"total":96636764160,"available":96366112768,"internally_reserved":0,"allocated":169119744,"data_stored":162881901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543037,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":462228,"kb_used_data":206148,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":93909612,"statfs":{"total":96636764160,"available":96163442688,"internally_reserved":0,"allocated":211095552,"data_stored":204497890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262207943},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543035,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":358224,"kb_used_data":150720,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94013616,"statfs":{"total":96636764160,"available":96269942784,"internally_reserved":0,"allocated":154337280,"data_stored":147909516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":212466117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575738,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":251808,"kb_used_data":194256,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94120032,"statfs":{"total":96636764160,"available":96378912768,"internally_reserved":0,"allocated":198918144,"data_stored":192285280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":120287232,"data_stored":115422877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":52461568,"data_stored":50989354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65630208,"data_stored":63760671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":162619392,"data_stored":157595782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":177336320,"data_stored":172183802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":130138112,"data_stored":125504544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":119406592,"data_stored":116366388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":127950848,"data_stored":123505835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":336341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":127094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":95998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":569344,"data_stored":486137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":77711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":679936,"data_stored":574850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":266159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":518606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":4704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21024768,"data_stored":21021979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12632064,"data_stored":12631334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18415616,"data_stored":18413368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7389184,"data_stored":7388454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":23654400,"data_stored":23653035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17362944,"data_stored":17361579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25858048,"data_stored":25852281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":14733312,"data_stored":14730523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4247552,"data_stored":4245939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:13:51.997 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T18:13:51.997 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:13:52.351 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:13:52.363 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-12T18:13:52.365 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":2477,"stamp":"2024-09-12T18:13:50.630404+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":570641228,"num_objects":4560,"num_object_clones":0,"num_object_copies":9120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4560,"num_whiteouts":0,"num_read":178556,"num_read_kb":2302209,"num_write":139726,"num_write_kb":2241551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13454,"ondisk_log_size":13454,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2495432,"kb_used_data":1260424,"kb_used_omap":12,"kb_used_meta":1234867,"kb_avail":752479288,"statfs":{"total":773094113280,"available":770538790912,"internally_reserved":0,"allocated":1290674176,"data_stored":1245593882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1264504368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-44087978,"num_objects":-294,"num_object_clones":0,"num_object_copies":-588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-294,"num_whiteouts":0,"num_read":345,"num_read_kb":436,"num_write":318,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005590"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:07.943317+0000","last_change":"2024-09-12T17:39:05.922525+0000","last_active":"2024-09-12T18:09:07.943317+0000","last_peered":"2024-09-12T18:09:07.943317+0000","last_clean":"2024-09-12T18:09:07.943317+0000","last_became_active":"2024-09-12T17:39:05.922265+0000","last_became_peered":"2024-09-12T17:39:05.922265+0000","last_unstale":"2024-09-12T18:09:07.943317+0000","last_undegraded":"2024-09-12T18:09:07.943317+0000","last_fullsized":"2024-09-12T18:09:07.943317+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:50.266071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'7","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.956905+0000","last_change":"2024-09-12T17:20:34.559305+0000","last_active":"2024-09-12T18:10:37.956905+0000","last_peered":"2024-09-12T18:10:37.956905+0000","last_clean":"2024-09-12T18:10:37.956905+0000","last_became_active":"2024-09-12T17:20:34.559027+0000","last_became_peered":"2024-09-12T17:20:34.559027+0000","last_unstale":"2024-09-12T18:10:37.956905+0000","last_undegraded":"2024-09-12T18:10:37.956905+0000","last_fullsized":"2024-09-12T18:10:37.956905+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:57.688429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"261'5","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844168+0000","last_change":"2024-09-12T17:20:30.533512+0000","last_active":"2024-09-12T18:10:31.844168+0000","last_peered":"2024-09-12T18:10:31.844168+0000","last_clean":"2024-09-12T18:10:31.844168+0000","last_became_active":"2024-09-12T17:20:30.533235+0000","last_became_peered":"2024-09-12T17:20:30.533235+0000","last_unstale":"2024-09-12T18:10:31.844168+0000","last_undegraded":"2024-09-12T18:10:31.844168+0000","last_fullsized":"2024-09-12T18:10:31.844168+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:11.739116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4098,"num_write":10,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'40","reported_seq":175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619269+0000","last_change":"2024-09-12T17:16:11.492013+0000","last_active":"2024-09-12T18:10:21.619269+0000","last_peered":"2024-09-12T18:10:21.619269+0000","last_clean":"2024-09-12T18:10:21.619269+0000","last_became_active":"2024-09-12T17:16:11.491724+0000","last_became_peered":"2024-09-12T17:16:11.491724+0000","last_unstale":"2024-09-12T18:10:21.619269+0000","last_undegraded":"2024-09-12T18:10:21.619269+0000","last_fullsized":"2024-09-12T18:10:21.619269+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:52.666913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":153,"num_write":69,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:08.691783+0000","last_change":"2024-09-12T17:39:05.929786+0000","last_active":"2024-09-12T18:09:08.691783+0000","last_peered":"2024-09-12T18:09:08.691783+0000","last_clean":"2024-09-12T18:09:08.691783+0000","last_became_active":"2024-09-12T17:39:05.929533+0000","last_became_peered":"2024-09-12T17:39:05.929533+0000","last_unstale":"2024-09-12T18:09:08.691783+0000","last_undegraded":"2024-09-12T18:09:08.691783+0000","last_fullsized":"2024-09-12T18:09:08.691783+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:13.745522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"261'8","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:35.755523+0000","last_change":"2024-09-12T17:20:34.559278+0000","last_active":"2024-09-12T18:10:35.755523+0000","last_peered":"2024-09-12T18:10:35.755523+0000","last_clean":"2024-09-12T18:10:35.755523+0000","last_became_active":"2024-09-12T17:20:34.558970+0000","last_became_peered":"2024-09-12T17:20:34.558970+0000","last_unstale":"2024-09-12T18:10:35.755523+0000","last_undegraded":"2024-09-12T18:10:35.755523+0000","last_fullsized":"2024-09-12T18:10:35.755523+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:15.197078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8194,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.601484+0000","last_change":"2024-09-12T17:20:30.539641+0000","last_active":"2024-09-12T18:13:48.601484+0000","last_peered":"2024-09-12T18:13:48.601484+0000","last_clean":"2024-09-12T18:13:48.601484+0000","last_became_active":"2024-09-12T17:20:30.539358+0000","last_became_peered":"2024-09-12T17:20:30.539358+0000","last_unstale":"2024-09-12T18:13:48.601484+0000","last_undegraded":"2024-09-12T18:13:48.601484+0000","last_fullsized":"2024-09-12T18:13:48.601484+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:09.857477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8242,"num_write":10,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'68","reported_seq":250,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:23.699050+0000","last_change":"2024-09-12T17:16:11.491901+0000","last_active":"2024-09-12T18:10:23.699050+0000","last_peered":"2024-09-12T18:10:23.699050+0000","last_clean":"2024-09-12T18:10:23.699050+0000","last_became_active":"2024-09-12T17:16:11.491610+0000","last_became_peered":"2024-09-12T17:16:11.491610+0000","last_unstale":"2024-09-12T18:10:23.699050+0000","last_undegraded":"2024-09-12T18:10:23.699050+0000","last_fullsized":"2024-09-12T18:10:23.699050+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:14.980006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":357,"num_read_kb":265,"num_write":116,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.743901+0000","last_change":"2024-09-12T17:39:05.922376+0000","last_active":"2024-09-12T18:10:32.743901+0000","last_peered":"2024-09-12T18:10:32.743901+0000","last_clean":"2024-09-12T18:10:32.743901+0000","last_became_active":"2024-09-12T17:39:05.921846+0000","last_became_peered":"2024-09-12T17:39:05.921846+0000","last_unstale":"2024-09-12T18:10:32.743901+0000","last_undegraded":"2024-09-12T18:10:32.743901+0000","last_fullsized":"2024-09-12T18:10:32.743901+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:48.115093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"261'8","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.621019+0000","last_change":"2024-09-12T17:20:34.615861+0000","last_active":"2024-09-12T18:10:36.621019+0000","last_peered":"2024-09-12T18:10:36.621019+0000","last_clean":"2024-09-12T18:10:36.621019+0000","last_became_active":"2024-09-12T17:20:34.615550+0000","last_became_peered":"2024-09-12T17:20:34.615550+0000","last_unstale":"2024-09-12T18:10:36.621019+0000","last_undegraded":"2024-09-12T18:10:36.621019+0000","last_fullsized":"2024-09-12T18:10:36.621019+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:16.087575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":6148,"num_write":8,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'8","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:43.700956+0000","last_change":"2024-09-12T17:20:30.535465+0000","last_active":"2024-09-12T18:10:43.700956+0000","last_peered":"2024-09-12T18:10:43.700956+0000","last_clean":"2024-09-12T18:10:43.700956+0000","last_became_active":"2024-09-12T17:20:30.535182+0000","last_became_peered":"2024-09-12T17:20:30.535182+0000","last_unstale":"2024-09-12T18:10:43.700956+0000","last_undegraded":"2024-09-12T18:10:43.700956+0000","last_fullsized":"2024-09-12T18:10:43.700956+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:33.062178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":13,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'51","reported_seq":202,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.624811+0000","last_change":"2024-09-12T17:16:11.493397+0000","last_active":"2024-09-12T18:11:11.624811+0000","last_peered":"2024-09-12T18:11:11.624811+0000","last_clean":"2024-09-12T18:11:11.624811+0000","last_became_active":"2024-09-12T17:16:11.493043+0000","last_became_peered":"2024-09-12T17:16:11.493043+0000","last_unstale":"2024-09-12T18:11:11.624811+0000","last_undegraded":"2024-09-12T18:11:11.624811+0000","last_fullsized":"2024-09-12T18:11:11.624811+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:13.681249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":193,"num_write":93,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.844692+0000","last_change":"2024-09-12T17:39:05.931399+0000","last_active":"2024-09-12T18:10:36.844692+0000","last_peered":"2024-09-12T18:10:36.844692+0000","last_clean":"2024-09-12T18:10:36.844692+0000","last_became_active":"2024-09-12T17:39:05.931122+0000","last_became_peered":"2024-09-12T17:39:05.931122+0000","last_unstale":"2024-09-12T18:10:36.844692+0000","last_undegraded":"2024-09-12T18:10:36.844692+0000","last_fullsized":"2024-09-12T18:10:36.844692+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:02.508518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'5","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:46.845829+0000","last_change":"2024-09-12T17:20:34.613048+0000","last_active":"2024-09-12T18:10:46.845829+0000","last_peered":"2024-09-12T18:10:46.845829+0000","last_clean":"2024-09-12T18:10:46.845829+0000","last_became_active":"2024-09-12T17:20:34.612720+0000","last_became_peered":"2024-09-12T17:20:34.612720+0000","last_unstale":"2024-09-12T18:10:46.845829+0000","last_undegraded":"2024-09-12T18:10:46.845829+0000","last_fullsized":"2024-09-12T18:10:46.845829+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:30.901799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":14336,"num_write":10,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'7","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:30.754899+0000","last_change":"2024-09-12T17:20:30.534475+0000","last_active":"2024-09-12T18:10:30.754899+0000","last_peered":"2024-09-12T18:10:30.754899+0000","last_clean":"2024-09-12T18:10:30.754899+0000","last_became_active":"2024-09-12T17:20:30.534068+0000","last_became_peered":"2024-09-12T17:20:30.534068+0000","last_unstale":"2024-09-12T18:10:30.754899+0000","last_undegraded":"2024-09-12T18:10:30.754899+0000","last_fullsized":"2024-09-12T18:10:30.754899+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:16.971800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":5122,"num_write":17,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'25","reported_seq":124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.848415+0000","last_change":"2024-09-12T17:16:11.490345+0000","last_active":"2024-09-12T18:11:11.848415+0000","last_peered":"2024-09-12T18:11:11.848415+0000","last_clean":"2024-09-12T18:11:11.848415+0000","last_became_active":"2024-09-12T17:16:11.489860+0000","last_became_peered":"2024-09-12T17:16:11.489860+0000","last_unstale":"2024-09-12T18:11:11.848415+0000","last_undegraded":"2024-09-12T18:11:11.848415+0000","last_fullsized":"2024-09-12T18:11:11.848415+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:28:30.353456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.848437+0000","last_change":"2024-09-12T17:39:05.931395+0000","last_active":"2024-09-12T18:11:11.848437+0000","last_peered":"2024-09-12T18:11:11.848437+0000","last_clean":"2024-09-12T18:11:11.848437+0000","last_became_active":"2024-09-12T17:39:05.931089+0000","last_became_peered":"2024-09-12T17:39:05.931089+0000","last_unstale":"2024-09-12T18:11:11.848437+0000","last_undegraded":"2024-09-12T18:11:11.848437+0000","last_fullsized":"2024-09-12T18:11:11.848437+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:40.976622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"264'1","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:07.943295+0000","last_change":"2024-09-12T17:20:34.557572+0000","last_active":"2024-09-12T18:09:07.943295+0000","last_peered":"2024-09-12T18:09:07.943295+0000","last_clean":"2024-09-12T18:09:07.943295+0000","last_became_active":"2024-09-12T17:20:34.557008+0000","last_became_peered":"2024-09-12T17:20:34.557008+0000","last_unstale":"2024-09-12T18:09:07.943295+0000","last_undegraded":"2024-09-12T18:09:07.943295+0000","last_fullsized":"2024-09-12T18:09:07.943295+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:29.589642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'7","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:16.625332+0000","last_change":"2024-09-12T17:20:30.538674+0000","last_active":"2024-09-12T18:11:16.625332+0000","last_peered":"2024-09-12T18:11:16.625332+0000","last_clean":"2024-09-12T18:11:16.625332+0000","last_became_active":"2024-09-12T17:20:30.538361+0000","last_became_peered":"2024-09-12T17:20:30.538361+0000","last_unstale":"2024-09-12T18:11:16.625332+0000","last_undegraded":"2024-09-12T18:11:16.625332+0000","last_fullsized":"2024-09-12T18:11:16.625332+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:34.525214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4098,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'48","reported_seq":182,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.848386+0000","last_change":"2024-09-12T17:16:11.488078+0000","last_active":"2024-09-12T18:11:11.848386+0000","last_peered":"2024-09-12T18:11:11.848386+0000","last_clean":"2024-09-12T18:11:11.848386+0000","last_became_active":"2024-09-12T17:16:11.487771+0000","last_became_peered":"2024-09-12T17:16:11.487771+0000","last_unstale":"2024-09-12T18:11:11.848386+0000","last_undegraded":"2024-09-12T18:11:11.848386+0000","last_fullsized":"2024-09-12T18:11:11.848386+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:38.032910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":161,"num_write":84,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:23.917612+0000","last_change":"2024-09-12T17:39:05.921998+0000","last_active":"2024-09-12T18:10:23.917612+0000","last_peered":"2024-09-12T18:10:23.917612+0000","last_clean":"2024-09-12T18:10:23.917612+0000","last_became_active":"2024-09-12T17:39:05.921661+0000","last_became_peered":"2024-09-12T17:39:05.921661+0000","last_unstale":"2024-09-12T18:10:23.917612+0000","last_undegraded":"2024-09-12T18:10:23.917612+0000","last_fullsized":"2024-09-12T18:10:23.917612+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:09.613996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:22.751338+0000","last_change":"2024-09-12T17:20:34.555394+0000","last_active":"2024-09-12T18:11:22.751338+0000","last_peered":"2024-09-12T18:11:22.751338+0000","last_clean":"2024-09-12T18:11:22.751338+0000","last_became_active":"2024-09-12T17:20:34.555047+0000","last_became_peered":"2024-09-12T17:20:34.555047+0000","last_unstale":"2024-09-12T18:11:22.751338+0000","last_undegraded":"2024-09-12T18:11:22.751338+0000","last_fullsized":"2024-09-12T18:11:22.751338+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:29.139249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'2","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.742462+0000","last_change":"2024-09-12T17:20:30.528356+0000","last_active":"2024-09-12T18:09:05.742462+0000","last_peered":"2024-09-12T18:09:05.742462+0000","last_clean":"2024-09-12T18:09:05.742462+0000","last_became_active":"2024-09-12T17:20:30.528029+0000","last_became_peered":"2024-09-12T17:20:30.528029+0000","last_unstale":"2024-09-12T18:09:05.742462+0000","last_undegraded":"2024-09-12T18:09:05.742462+0000","last_fullsized":"2024-09-12T18:09:05.742462+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:17.569528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'34","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:12.750037+0000","last_change":"2024-09-12T17:16:11.491282+0000","last_active":"2024-09-12T18:11:12.750037+0000","last_peered":"2024-09-12T18:11:12.750037+0000","last_clean":"2024-09-12T18:11:12.750037+0000","last_became_active":"2024-09-12T17:16:11.490952+0000","last_became_peered":"2024-09-12T17:16:11.490952+0000","last_unstale":"2024-09-12T18:11:12.750037+0000","last_undegraded":"2024-09-12T18:11:12.750037+0000","last_fullsized":"2024-09-12T18:11:12.750037+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:58.052602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":115,"num_write":60,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:07.744407+0000","last_change":"2024-09-12T17:39:05.929242+0000","last_active":"2024-09-12T18:09:07.744407+0000","last_peered":"2024-09-12T18:09:07.744407+0000","last_clean":"2024-09-12T18:09:07.744407+0000","last_became_active":"2024-09-12T17:39:05.928959+0000","last_became_peered":"2024-09-12T17:39:05.928959+0000","last_unstale":"2024-09-12T18:09:07.744407+0000","last_undegraded":"2024-09-12T18:09:07.744407+0000","last_fullsized":"2024-09-12T18:09:07.744407+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:49.943631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.744728+0000","last_change":"2024-09-12T17:20:34.552499+0000","last_active":"2024-09-12T18:10:37.744728+0000","last_peered":"2024-09-12T18:10:37.744728+0000","last_clean":"2024-09-12T18:10:37.744728+0000","last_became_active":"2024-09-12T17:20:34.552180+0000","last_became_peered":"2024-09-12T17:20:34.552180+0000","last_unstale":"2024-09-12T18:10:37.744728+0000","last_undegraded":"2024-09-12T18:10:37.744728+0000","last_fullsized":"2024-09-12T18:10:37.744728+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:03.689040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:30.754825+0000","last_change":"2024-09-12T17:20:30.535560+0000","last_active":"2024-09-12T18:10:30.754825+0000","last_peered":"2024-09-12T18:10:30.754825+0000","last_clean":"2024-09-12T18:10:30.754825+0000","last_became_active":"2024-09-12T17:20:30.535001+0000","last_became_peered":"2024-09-12T17:20:30.535001+0000","last_unstale":"2024-09-12T18:10:30.754825+0000","last_undegraded":"2024-09-12T18:10:30.754825+0000","last_fullsized":"2024-09-12T18:10:30.754825+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:47.724576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'14","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:36.614251+0000","last_change":"2024-09-12T17:16:11.480542+0000","last_active":"2024-09-12T18:09:36.614251+0000","last_peered":"2024-09-12T18:09:36.614251+0000","last_clean":"2024-09-12T18:09:36.614251+0000","last_became_active":"2024-09-12T17:16:11.477940+0000","last_became_peered":"2024-09-12T17:16:11.477940+0000","last_unstale":"2024-09-12T18:09:36.614251+0000","last_undegraded":"2024-09-12T18:09:36.614251+0000","last_fullsized":"2024-09-12T18:09:36.614251+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:48.061800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":35,"num_write":34,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:07.744444+0000","last_change":"2024-09-12T17:39:05.930937+0000","last_active":"2024-09-12T18:09:07.744444+0000","last_peered":"2024-09-12T18:09:07.744444+0000","last_clean":"2024-09-12T18:09:07.744444+0000","last_became_active":"2024-09-12T17:39:05.930694+0000","last_became_peered":"2024-09-12T17:39:05.930694+0000","last_unstale":"2024-09-12T18:09:07.744444+0000","last_undegraded":"2024-09-12T18:09:07.744444+0000","last_fullsized":"2024-09-12T18:09:07.744444+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:15.777013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"261'4","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.844714+0000","last_change":"2024-09-12T17:20:34.553025+0000","last_active":"2024-09-12T18:10:36.844714+0000","last_peered":"2024-09-12T18:10:36.844714+0000","last_clean":"2024-09-12T18:10:36.844714+0000","last_became_active":"2024-09-12T17:20:34.552726+0000","last_became_peered":"2024-09-12T17:20:34.552726+0000","last_unstale":"2024-09-12T18:10:36.844714+0000","last_undegraded":"2024-09-12T18:10:36.844714+0000","last_fullsized":"2024-09-12T18:10:36.844714+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:22.335524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'2","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.620340+0000","last_change":"2024-09-12T17:20:30.539217+0000","last_active":"2024-09-12T18:10:31.620340+0000","last_peered":"2024-09-12T18:10:31.620340+0000","last_clean":"2024-09-12T18:10:31.620340+0000","last_became_active":"2024-09-12T17:20:30.538942+0000","last_became_peered":"2024-09-12T17:20:30.538942+0000","last_unstale":"2024-09-12T18:10:31.620340+0000","last_undegraded":"2024-09-12T18:10:31.620340+0000","last_fullsized":"2024-09-12T18:10:31.620340+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:53.625617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'32","reported_seq":144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:23.910689+0000","last_change":"2024-09-12T17:16:11.488019+0000","last_active":"2024-09-12T18:09:23.910689+0000","last_peered":"2024-09-12T18:09:23.910689+0000","last_clean":"2024-09-12T18:09:23.910689+0000","last_became_active":"2024-09-12T17:16:11.487242+0000","last_became_peered":"2024-09-12T17:16:11.487242+0000","last_unstale":"2024-09-12T18:09:23.910689+0000","last_undegraded":"2024-09-12T18:09:23.910689+0000","last_fullsized":"2024-09-12T18:09:23.910689+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:20.980571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":114,"num_write":62,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:28.911251+0000","last_change":"2024-09-12T17:39:05.927350+0000","last_active":"2024-09-12T18:09:28.911251+0000","last_peered":"2024-09-12T18:09:28.911251+0000","last_clean":"2024-09-12T18:09:28.911251+0000","last_became_active":"2024-09-12T17:39:05.924899+0000","last_became_peered":"2024-09-12T17:39:05.924899+0000","last_unstale":"2024-09-12T18:09:28.911251+0000","last_undegraded":"2024-09-12T18:09:28.911251+0000","last_fullsized":"2024-09-12T18:09:28.911251+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:09.168419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'3","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:21.849703+0000","last_change":"2024-09-12T17:20:34.610704+0000","last_active":"2024-09-12T18:11:21.849703+0000","last_peered":"2024-09-12T18:11:21.849703+0000","last_clean":"2024-09-12T18:11:21.849703+0000","last_became_active":"2024-09-12T17:20:34.610374+0000","last_became_peered":"2024-09-12T17:20:34.610374+0000","last_unstale":"2024-09-12T18:11:21.849703+0000","last_undegraded":"2024-09-12T18:11:21.849703+0000","last_fullsized":"2024-09-12T18:11:21.849703+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:34.456941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1632939,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":1142,"num_write":8,"num_write_kb":1595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"264'2","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:42.948454+0000","last_change":"2024-09-12T17:20:30.526974+0000","last_active":"2024-09-12T18:09:42.948454+0000","last_peered":"2024-09-12T18:09:42.948454+0000","last_clean":"2024-09-12T18:09:42.948454+0000","last_became_active":"2024-09-12T17:20:30.526672+0000","last_became_peered":"2024-09-12T17:20:30.526672+0000","last_unstale":"2024-09-12T18:09:42.948454+0000","last_undegraded":"2024-09-12T18:09:42.948454+0000","last_fullsized":"2024-09-12T18:09:42.948454+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:59.866468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'19","reported_seq":109,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:21.612655+0000","last_change":"2024-09-12T17:16:11.481645+0000","last_active":"2024-09-12T18:09:21.612655+0000","last_peered":"2024-09-12T18:09:21.612655+0000","last_clean":"2024-09-12T18:09:21.612655+0000","last_became_active":"2024-09-12T17:16:11.481351+0000","last_became_peered":"2024-09-12T17:16:11.481351+0000","last_unstale":"2024-09-12T18:09:21.612655+0000","last_undegraded":"2024-09-12T18:09:21.612655+0000","last_fullsized":"2024-09-12T18:09:21.612655+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:59.636662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":68,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:28.693677+0000","last_change":"2024-09-12T17:39:05.928807+0000","last_active":"2024-09-12T18:09:28.693677+0000","last_peered":"2024-09-12T18:09:28.693677+0000","last_clean":"2024-09-12T18:09:28.693677+0000","last_became_active":"2024-09-12T17:39:05.928497+0000","last_became_peered":"2024-09-12T17:39:05.928497+0000","last_unstale":"2024-09-12T18:09:28.693677+0000","last_undegraded":"2024-09-12T18:09:28.693677+0000","last_fullsized":"2024-09-12T18:09:28.693677+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:21.617561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'1","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:46.838997+0000","last_change":"2024-09-12T17:20:34.610626+0000","last_active":"2024-09-12T18:09:46.838997+0000","last_peered":"2024-09-12T18:09:46.838997+0000","last_clean":"2024-09-12T18:09:46.838997+0000","last_became_active":"2024-09-12T17:20:34.610260+0000","last_became_peered":"2024-09-12T17:20:34.610260+0000","last_unstale":"2024-09-12T18:09:46.838997+0000","last_undegraded":"2024-09-12T18:09:46.838997+0000","last_fullsized":"2024-09-12T18:09:46.838997+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:16.730940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'12","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:17.764735+0000","last_change":"2024-09-12T17:20:30.527312+0000","last_active":"2024-09-12T18:11:17.764735+0000","last_peered":"2024-09-12T18:11:17.764735+0000","last_clean":"2024-09-12T18:11:17.764735+0000","last_became_active":"2024-09-12T17:20:30.527032+0000","last_became_peered":"2024-09-12T17:20:30.527032+0000","last_unstale":"2024-09-12T18:11:17.764735+0000","last_undegraded":"2024-09-12T18:11:17.764735+0000","last_fullsized":"2024-09-12T18:11:17.764735+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:12.370876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":13314,"num_write":22,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"0'0","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:21.836307+0000","last_change":"2024-09-12T17:16:11.494751+0000","last_active":"2024-09-12T18:09:21.836307+0000","last_peered":"2024-09-12T18:09:21.836307+0000","last_clean":"2024-09-12T18:09:21.836307+0000","last_became_active":"2024-09-12T17:16:11.494493+0000","last_became_peered":"2024-09-12T17:16:11.494493+0000","last_unstale":"2024-09-12T18:09:21.836307+0000","last_undegraded":"2024-09-12T18:09:21.836307+0000","last_fullsized":"2024-09-12T18:09:21.836307+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:52.903537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:27.747165+0000","last_change":"2024-09-12T17:39:05.926661+0000","last_active":"2024-09-12T18:09:27.747165+0000","last_peered":"2024-09-12T18:09:27.747165+0000","last_clean":"2024-09-12T18:09:27.747165+0000","last_became_active":"2024-09-12T17:39:05.926388+0000","last_became_peered":"2024-09-12T17:39:05.926388+0000","last_unstale":"2024-09-12T18:09:27.747165+0000","last_undegraded":"2024-09-12T18:09:27.747165+0000","last_fullsized":"2024-09-12T18:09:27.747165+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:08.792424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"261'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:21.849742+0000","last_change":"2024-09-12T17:20:34.615918+0000","last_active":"2024-09-12T18:11:21.849742+0000","last_peered":"2024-09-12T18:11:21.849742+0000","last_clean":"2024-09-12T18:11:21.849742+0000","last_became_active":"2024-09-12T17:20:34.615468+0000","last_became_peered":"2024-09-12T17:20:34.615468+0000","last_unstale":"2024-09-12T18:11:21.849742+0000","last_undegraded":"2024-09-12T18:11:21.849742+0000","last_fullsized":"2024-09-12T18:11:21.849742+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:26.561082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:18.704540+0000","last_change":"2024-09-12T17:20:30.533763+0000","last_active":"2024-09-12T18:11:18.704540+0000","last_peered":"2024-09-12T18:11:18.704540+0000","last_clean":"2024-09-12T18:11:18.704540+0000","last_became_active":"2024-09-12T17:20:30.533436+0000","last_became_peered":"2024-09-12T17:20:30.533436+0000","last_unstale":"2024-09-12T18:11:18.704540+0000","last_undegraded":"2024-09-12T18:11:18.704540+0000","last_fullsized":"2024-09-12T18:11:18.704540+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:28.574849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'18","reported_seq":106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:23.693173+0000","last_change":"2024-09-12T17:16:11.489669+0000","last_active":"2024-09-12T18:09:23.693173+0000","last_peered":"2024-09-12T18:09:23.693173+0000","last_clean":"2024-09-12T18:09:23.693173+0000","last_became_active":"2024-09-12T17:16:11.488588+0000","last_became_peered":"2024-09-12T17:16:11.488588+0000","last_unstale":"2024-09-12T18:09:23.693173+0000","last_undegraded":"2024-09-12T18:09:23.693173+0000","last_fullsized":"2024-09-12T18:09:23.693173+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:28.499624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:27.946007+0000","last_change":"2024-09-12T17:39:05.923338+0000","last_active":"2024-09-12T18:09:27.946007+0000","last_peered":"2024-09-12T18:09:27.946007+0000","last_clean":"2024-09-12T18:09:27.946007+0000","last_became_active":"2024-09-12T17:39:05.922973+0000","last_became_peered":"2024-09-12T17:39:05.922973+0000","last_unstale":"2024-09-12T18:09:27.946007+0000","last_undegraded":"2024-09-12T18:09:27.946007+0000","last_fullsized":"2024-09-12T18:09:27.946007+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:17.786298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:20.762674+0000","last_change":"2024-09-12T17:20:34.555891+0000","last_active":"2024-09-12T18:11:20.762674+0000","last_peered":"2024-09-12T18:11:20.762674+0000","last_clean":"2024-09-12T18:11:20.762674+0000","last_became_active":"2024-09-12T17:20:34.554893+0000","last_became_peered":"2024-09-12T17:20:34.554893+0000","last_unstale":"2024-09-12T18:11:20.762674+0000","last_undegraded":"2024-09-12T18:11:20.762674+0000","last_fullsized":"2024-09-12T18:11:20.762674+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:56.253377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'5","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:16.625434+0000","last_change":"2024-09-12T17:20:30.536540+0000","last_active":"2024-09-12T18:11:16.625434+0000","last_peered":"2024-09-12T18:11:16.625434+0000","last_clean":"2024-09-12T18:11:16.625434+0000","last_became_active":"2024-09-12T17:20:30.535226+0000","last_became_peered":"2024-09-12T17:20:30.535226+0000","last_unstale":"2024-09-12T18:11:16.625434+0000","last_undegraded":"2024-09-12T18:11:16.625434+0000","last_fullsized":"2024-09-12T18:11:16.625434+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:28:25.047253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":4098,"num_write":5,"num_write_kb":3074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'26","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:02.752551+0000","last_change":"2024-09-12T17:16:11.491564+0000","last_active":"2024-09-12T18:10:02.752551+0000","last_peered":"2024-09-12T18:10:02.752551+0000","last_clean":"2024-09-12T18:10:02.752551+0000","last_became_active":"2024-09-12T17:16:11.491240+0000","last_became_peered":"2024-09-12T17:16:11.491240+0000","last_unstale":"2024-09-12T18:10:02.752551+0000","last_undegraded":"2024-09-12T18:10:02.752551+0000","last_fullsized":"2024-09-12T18:10:02.752551+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:43.068567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":97,"num_write":43,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844211+0000","last_change":"2024-09-12T17:39:05.932135+0000","last_active":"2024-09-12T18:10:31.844211+0000","last_peered":"2024-09-12T18:10:31.844211+0000","last_clean":"2024-09-12T18:10:31.844211+0000","last_became_active":"2024-09-12T17:39:05.931841+0000","last_became_peered":"2024-09-12T17:39:05.931841+0000","last_unstale":"2024-09-12T18:10:31.844211+0000","last_undegraded":"2024-09-12T18:10:31.844211+0000","last_fullsized":"2024-09-12T18:10:31.844211+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:08.525616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:33.911887+0000","last_change":"2024-09-12T17:20:34.560852+0000","last_active":"2024-09-12T18:09:33.911887+0000","last_peered":"2024-09-12T18:09:33.911887+0000","last_clean":"2024-09-12T18:09:33.911887+0000","last_became_active":"2024-09-12T17:20:34.560497+0000","last_became_peered":"2024-09-12T17:20:34.560497+0000","last_unstale":"2024-09-12T18:09:33.911887+0000","last_undegraded":"2024-09-12T18:09:33.911887+0000","last_fullsized":"2024-09-12T18:09:33.911887+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:07.183237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"261'7","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:30.746005+0000","last_change":"2024-09-12T17:20:30.535717+0000","last_active":"2024-09-12T18:09:30.746005+0000","last_peered":"2024-09-12T18:09:30.746005+0000","last_clean":"2024-09-12T18:09:30.746005+0000","last_became_active":"2024-09-12T17:20:30.535358+0000","last_became_peered":"2024-09-12T17:20:30.535358+0000","last_unstale":"2024-09-12T18:09:30.746005+0000","last_undegraded":"2024-09-12T18:09:30.746005+0000","last_fullsized":"2024-09-12T18:09:30.746005+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:14.210209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":15362,"num_write":12,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'12","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:52.751072+0000","last_change":"2024-09-12T17:16:11.490206+0000","last_active":"2024-09-12T18:09:52.751072+0000","last_peered":"2024-09-12T18:09:52.751072+0000","last_clean":"2024-09-12T18:09:52.751072+0000","last_became_active":"2024-09-12T17:16:11.489897+0000","last_became_peered":"2024-09-12T17:16:11.489897+0000","last_unstale":"2024-09-12T18:09:52.751072+0000","last_undegraded":"2024-09-12T18:09:52.751072+0000","last_fullsized":"2024-09-12T18:09:52.751072+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:03.772651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.620396+0000","last_change":"2024-09-12T17:39:05.927618+0000","last_active":"2024-09-12T18:10:31.620396+0000","last_peered":"2024-09-12T18:10:31.620396+0000","last_clean":"2024-09-12T18:10:31.620396+0000","last_became_active":"2024-09-12T17:39:05.926766+0000","last_became_peered":"2024-09-12T17:39:05.926766+0000","last_unstale":"2024-09-12T18:10:31.620396+0000","last_undegraded":"2024-09-12T18:10:31.620396+0000","last_fullsized":"2024-09-12T18:10:31.620396+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:41.020632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"264'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.926650+0000","last_change":"2024-09-12T17:20:34.559252+0000","last_active":"2024-09-12T18:11:53.926650+0000","last_peered":"2024-09-12T18:11:53.926650+0000","last_clean":"2024-09-12T18:11:53.926650+0000","last_became_active":"2024-09-12T17:20:34.558970+0000","last_became_peered":"2024-09-12T17:20:34.558970+0000","last_unstale":"2024-09-12T18:11:53.926650+0000","last_undegraded":"2024-09-12T18:11:53.926650+0000","last_fullsized":"2024-09-12T18:11:53.926650+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:58.158311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'2","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:31.837338+0000","last_change":"2024-09-12T17:20:30.536062+0000","last_active":"2024-09-12T18:09:31.837338+0000","last_peered":"2024-09-12T18:09:31.837338+0000","last_clean":"2024-09-12T18:09:31.837338+0000","last_became_active":"2024-09-12T17:20:30.535761+0000","last_became_peered":"2024-09-12T17:20:30.535761+0000","last_unstale":"2024-09-12T18:09:31.837338+0000","last_undegraded":"2024-09-12T18:09:31.837338+0000","last_fullsized":"2024-09-12T18:09:31.837338+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:41.021041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4197517,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":8196,"num_write":2,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'42","reported_seq":175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:51.615812+0000","last_change":"2024-09-12T17:16:11.488259+0000","last_active":"2024-09-12T18:09:51.615812+0000","last_peered":"2024-09-12T18:09:51.615812+0000","last_clean":"2024-09-12T18:09:51.615812+0000","last_became_active":"2024-09-12T17:16:11.487923+0000","last_became_peered":"2024-09-12T17:16:11.487923+0000","last_unstale":"2024-09-12T18:09:51.615812+0000","last_undegraded":"2024-09-12T18:09:51.615812+0000","last_fullsized":"2024-09-12T18:09:51.615812+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:17.535117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":152,"num_write":79,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:36.614300+0000","last_change":"2024-09-12T17:39:05.921610+0000","last_active":"2024-09-12T18:09:36.614300+0000","last_peered":"2024-09-12T18:09:36.614300+0000","last_clean":"2024-09-12T18:09:36.614300+0000","last_became_active":"2024-09-12T17:39:05.921257+0000","last_became_peered":"2024-09-12T17:39:05.921257+0000","last_unstale":"2024-09-12T18:09:36.614300+0000","last_undegraded":"2024-09-12T18:09:36.614300+0000","last_fullsized":"2024-09-12T18:09:36.614300+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:57.829484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:36.837884+0000","last_change":"2024-09-12T17:20:34.554048+0000","last_active":"2024-09-12T18:09:36.837884+0000","last_peered":"2024-09-12T18:09:36.837884+0000","last_clean":"2024-09-12T18:09:36.837884+0000","last_became_active":"2024-09-12T17:20:34.553659+0000","last_became_peered":"2024-09-12T17:20:34.553659+0000","last_unstale":"2024-09-12T18:09:36.837884+0000","last_undegraded":"2024-09-12T18:09:36.837884+0000","last_fullsized":"2024-09-12T18:09:36.837884+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:41.787619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51635,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":52,"num_write":2,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:32.735296+0000","last_change":"2024-09-12T17:20:30.535174+0000","last_active":"2024-09-12T18:09:32.735296+0000","last_peered":"2024-09-12T18:09:32.735296+0000","last_clean":"2024-09-12T18:09:32.735296+0000","last_became_active":"2024-09-12T17:20:30.534878+0000","last_became_peered":"2024-09-12T17:20:30.534878+0000","last_unstale":"2024-09-12T18:09:32.735296+0000","last_undegraded":"2024-09-12T18:09:32.735296+0000","last_fullsized":"2024-09-12T18:09:32.735296+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:22.315962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'92","reported_seq":343,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:50.748679+0000","last_change":"2024-09-12T17:16:11.489329+0000","last_active":"2024-09-12T18:09:50.748679+0000","last_peered":"2024-09-12T18:09:50.748679+0000","last_clean":"2024-09-12T18:09:50.748679+0000","last_became_active":"2024-09-12T17:16:11.489044+0000","last_became_peered":"2024-09-12T17:16:11.489044+0000","last_unstale":"2024-09-12T18:09:50.748679+0000","last_undegraded":"2024-09-12T18:09:50.748679+0000","last_fullsized":"2024-09-12T18:09:50.748679+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:09.438571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":552,"num_read_kb":376,"num_write":139,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844194+0000","last_change":"2024-09-12T17:39:05.932942+0000","last_active":"2024-09-12T18:10:31.844194+0000","last_peered":"2024-09-12T18:10:31.844194+0000","last_clean":"2024-09-12T18:10:31.844194+0000","last_became_active":"2024-09-12T17:39:05.932617+0000","last_became_peered":"2024-09-12T17:39:05.932617+0000","last_unstale":"2024-09-12T18:10:31.844194+0000","last_undegraded":"2024-09-12T18:10:31.844194+0000","last_fullsized":"2024-09-12T18:10:31.844194+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:47.846584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"261'5","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:37.736113+0000","last_change":"2024-09-12T17:20:34.559301+0000","last_active":"2024-09-12T18:09:37.736113+0000","last_peered":"2024-09-12T18:09:37.736113+0000","last_clean":"2024-09-12T18:09:37.736113+0000","last_became_active":"2024-09-12T17:20:34.559024+0000","last_became_peered":"2024-09-12T17:20:34.559024+0000","last_unstale":"2024-09-12T18:09:37.736113+0000","last_undegraded":"2024-09-12T18:09:37.736113+0000","last_fullsized":"2024-09-12T18:09:37.736113+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:19.256473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'5","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:32.946858+0000","last_change":"2024-09-12T17:20:30.534604+0000","last_active":"2024-09-12T18:09:32.946858+0000","last_peered":"2024-09-12T18:09:32.946858+0000","last_clean":"2024-09-12T18:09:32.946858+0000","last_became_active":"2024-09-12T17:20:30.534298+0000","last_became_peered":"2024-09-12T17:20:30.534298+0000","last_unstale":"2024-09-12T18:09:32.946858+0000","last_undegraded":"2024-09-12T18:09:32.946858+0000","last_fullsized":"2024-09-12T18:09:32.946858+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:07.258749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'39","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:51.839494+0000","last_change":"2024-09-12T17:16:11.489376+0000","last_active":"2024-09-12T18:09:51.839494+0000","last_peered":"2024-09-12T18:09:51.839494+0000","last_clean":"2024-09-12T18:09:51.839494+0000","last_became_active":"2024-09-12T17:16:11.489085+0000","last_became_peered":"2024-09-12T17:16:11.489085+0000","last_unstale":"2024-09-12T18:09:51.839494+0000","last_undegraded":"2024-09-12T18:09:51.839494+0000","last_fullsized":"2024-09-12T18:09:51.839494+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:34.809544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":137,"num_write":73,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:33.694207+0000","last_change":"2024-09-12T17:39:05.928701+0000","last_active":"2024-09-12T18:09:33.694207+0000","last_peered":"2024-09-12T18:09:33.694207+0000","last_clean":"2024-09-12T18:09:33.694207+0000","last_became_active":"2024-09-12T17:39:05.928320+0000","last_became_peered":"2024-09-12T17:39:05.928320+0000","last_unstale":"2024-09-12T18:09:33.694207+0000","last_undegraded":"2024-09-12T18:09:33.694207+0000","last_fullsized":"2024-09-12T18:09:33.694207+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:56.483652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"261'5","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:06.841342+0000","last_change":"2024-09-12T17:20:34.553728+0000","last_active":"2024-09-12T18:10:06.841342+0000","last_peered":"2024-09-12T18:10:06.841342+0000","last_clean":"2024-09-12T18:10:06.841342+0000","last_became_active":"2024-09-12T17:20:34.553407+0000","last_became_peered":"2024-09-12T17:20:34.553407+0000","last_unstale":"2024-09-12T18:10:06.841342+0000","last_undegraded":"2024-09-12T18:10:06.841342+0000","last_fullsized":"2024-09-12T18:10:06.841342+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:51.963850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'4","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:02.752571+0000","last_change":"2024-09-12T17:20:30.525002+0000","last_active":"2024-09-12T18:10:02.752571+0000","last_peered":"2024-09-12T18:10:02.752571+0000","last_clean":"2024-09-12T18:10:02.752571+0000","last_became_active":"2024-09-12T17:20:30.524670+0000","last_became_peered":"2024-09-12T17:20:30.524670+0000","last_unstale":"2024-09-12T18:10:02.752571+0000","last_undegraded":"2024-09-12T18:10:02.752571+0000","last_fullsized":"2024-09-12T18:10:02.752571+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:48.793238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8972971,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":4667,"num_write":9,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'33","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.843088+0000","last_change":"2024-09-12T17:16:11.487281+0000","last_active":"2024-09-12T18:10:21.843088+0000","last_peered":"2024-09-12T18:10:21.843088+0000","last_clean":"2024-09-12T18:10:21.843088+0000","last_became_active":"2024-09-12T17:16:11.486986+0000","last_became_peered":"2024-09-12T17:16:11.486986+0000","last_unstale":"2024-09-12T18:10:21.843088+0000","last_undegraded":"2024-09-12T18:10:21.843088+0000","last_fullsized":"2024-09-12T18:10:21.843088+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:58.383837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":108,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.758368+0000","last_change":"2024-09-12T17:39:05.927856+0000","last_active":"2024-09-12T18:10:37.758368+0000","last_peered":"2024-09-12T18:10:37.758368+0000","last_clean":"2024-09-12T18:10:37.758368+0000","last_became_active":"2024-09-12T17:39:05.927578+0000","last_became_peered":"2024-09-12T17:39:05.927578+0000","last_unstale":"2024-09-12T18:10:37.758368+0000","last_undegraded":"2024-09-12T18:10:37.758368+0000","last_fullsized":"2024-09-12T18:10:37.758368+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:21.888828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:06.841313+0000","last_change":"2024-09-12T17:20:34.552899+0000","last_active":"2024-09-12T18:10:06.841313+0000","last_peered":"2024-09-12T18:10:06.841313+0000","last_clean":"2024-09-12T18:10:06.841313+0000","last_became_active":"2024-09-12T17:20:34.552569+0000","last_became_peered":"2024-09-12T17:20:34.552569+0000","last_unstale":"2024-09-12T18:10:06.841313+0000","last_undegraded":"2024-09-12T18:10:06.841313+0000","last_fullsized":"2024-09-12T18:10:06.841313+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:59.485671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:03.697087+0000","last_change":"2024-09-12T17:20:30.538454+0000","last_active":"2024-09-12T18:10:03.697087+0000","last_peered":"2024-09-12T18:10:03.697087+0000","last_clean":"2024-09-12T18:10:03.697087+0000","last_became_active":"2024-09-12T17:20:30.538157+0000","last_became_peered":"2024-09-12T17:20:30.538157+0000","last_unstale":"2024-09-12T18:10:03.697087+0000","last_undegraded":"2024-09-12T18:10:03.697087+0000","last_fullsized":"2024-09-12T18:10:03.697087+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:21.990887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'29","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.953012+0000","last_change":"2024-09-12T17:16:11.488323+0000","last_active":"2024-09-12T18:10:12.953012+0000","last_peered":"2024-09-12T18:10:12.953012+0000","last_clean":"2024-09-12T18:10:12.953012+0000","last_became_active":"2024-09-12T17:16:11.487998+0000","last_became_peered":"2024-09-12T17:16:11.487998+0000","last_unstale":"2024-09-12T18:10:12.953012+0000","last_undegraded":"2024-09-12T18:10:12.953012+0000","last_fullsized":"2024-09-12T18:10:12.953012+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:46.362889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:37.753323+0000","last_change":"2024-09-12T17:39:05.921302+0000","last_active":"2024-09-12T18:11:37.753323+0000","last_peered":"2024-09-12T18:11:37.753323+0000","last_clean":"2024-09-12T18:11:37.753323+0000","last_became_active":"2024-09-12T17:39:05.921008+0000","last_became_peered":"2024-09-12T17:39:05.921008+0000","last_unstale":"2024-09-12T18:11:37.753323+0000","last_undegraded":"2024-09-12T18:11:37.753323+0000","last_fullsized":"2024-09-12T18:11:37.753323+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:44.290086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:28.933628+0000","last_change":"2024-09-12T17:20:34.616039+0000","last_active":"2024-09-12T18:12:28.933628+0000","last_peered":"2024-09-12T18:12:28.933628+0000","last_clean":"2024-09-12T18:12:28.933628+0000","last_became_active":"2024-09-12T17:20:34.615689+0000","last_became_peered":"2024-09-12T17:20:34.615689+0000","last_unstale":"2024-09-12T18:12:28.933628+0000","last_undegraded":"2024-09-12T18:12:28.933628+0000","last_fullsized":"2024-09-12T18:12:28.933628+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:14.341361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'3","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:01.616967+0000","last_change":"2024-09-12T17:20:30.540013+0000","last_active":"2024-09-12T18:10:01.616967+0000","last_peered":"2024-09-12T18:10:01.616967+0000","last_clean":"2024-09-12T18:10:01.616967+0000","last_became_active":"2024-09-12T17:20:30.536917+0000","last_became_peered":"2024-09-12T17:20:30.536917+0000","last_unstale":"2024-09-12T18:10:01.616967+0000","last_undegraded":"2024-09-12T18:10:01.616967+0000","last_fullsized":"2024-09-12T18:10:01.616967+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:21.908709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'41","reported_seq":168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.740858+0000","last_change":"2024-09-12T17:16:11.488593+0000","last_active":"2024-09-12T18:10:12.740858+0000","last_peered":"2024-09-12T18:10:12.740858+0000","last_clean":"2024-09-12T18:10:12.740858+0000","last_became_active":"2024-09-12T17:16:11.488252+0000","last_became_peered":"2024-09-12T17:16:11.488252+0000","last_unstale":"2024-09-12T18:10:12.740858+0000","last_undegraded":"2024-09-12T18:10:12.740858+0000","last_fullsized":"2024-09-12T18:10:12.740858+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:41.338780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":141,"num_write":74,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:37.767690+0000","last_change":"2024-09-12T17:39:05.926009+0000","last_active":"2024-09-12T18:11:37.767690+0000","last_peered":"2024-09-12T18:11:37.767690+0000","last_clean":"2024-09-12T18:11:37.767690+0000","last_became_active":"2024-09-12T17:39:05.925589+0000","last_became_peered":"2024-09-12T17:39:05.925589+0000","last_unstale":"2024-09-12T18:11:37.767690+0000","last_undegraded":"2024-09-12T18:11:37.767690+0000","last_fullsized":"2024-09-12T18:11:37.767690+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:14.643645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'10","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:06.841353+0000","last_change":"2024-09-12T17:20:34.560582+0000","last_active":"2024-09-12T18:10:06.841353+0000","last_peered":"2024-09-12T18:10:06.841353+0000","last_clean":"2024-09-12T18:10:06.841353+0000","last_became_active":"2024-09-12T17:20:34.560319+0000","last_became_peered":"2024-09-12T17:20:34.560319+0000","last_unstale":"2024-09-12T18:10:06.841353+0000","last_undegraded":"2024-09-12T18:10:06.841353+0000","last_fullsized":"2024-09-12T18:10:06.841353+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:25.756495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":15462,"num_write":15,"num_write_kb":7218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'2","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:28.933593+0000","last_change":"2024-09-12T17:20:30.531674+0000","last_active":"2024-09-12T18:12:28.933593+0000","last_peered":"2024-09-12T18:12:28.933593+0000","last_clean":"2024-09-12T18:12:28.933593+0000","last_became_active":"2024-09-12T17:20:30.531384+0000","last_became_peered":"2024-09-12T17:20:30.531384+0000","last_unstale":"2024-09-12T18:12:28.933593+0000","last_undegraded":"2024-09-12T18:12:28.933593+0000","last_fullsized":"2024-09-12T18:12:28.933593+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:07.405605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'7","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:13.698059+0000","last_change":"2024-09-12T17:16:11.486387+0000","last_active":"2024-09-12T18:10:13.698059+0000","last_peered":"2024-09-12T18:10:13.698059+0000","last_clean":"2024-09-12T18:10:13.698059+0000","last_became_active":"2024-09-12T17:16:11.486098+0000","last_became_peered":"2024-09-12T17:16:11.486098+0000","last_unstale":"2024-09-12T18:10:13.698059+0000","last_undegraded":"2024-09-12T18:10:13.698059+0000","last_fullsized":"2024-09-12T18:10:13.698059+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:46.177478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.844775+0000","last_change":"2024-09-12T17:39:05.926486+0000","last_active":"2024-09-12T18:10:36.844775+0000","last_peered":"2024-09-12T18:10:36.844775+0000","last_clean":"2024-09-12T18:10:36.844775+0000","last_became_active":"2024-09-12T17:39:05.925637+0000","last_became_peered":"2024-09-12T17:39:05.925637+0000","last_unstale":"2024-09-12T18:10:36.844775+0000","last_undegraded":"2024-09-12T18:10:36.844775+0000","last_fullsized":"2024-09-12T18:10:36.844775+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:55.840960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:25.753841+0000","last_change":"2024-09-12T17:20:47.596669+0000","last_active":"2024-09-12T18:10:25.753841+0000","last_peered":"2024-09-12T18:10:25.753841+0000","last_clean":"2024-09-12T18:10:25.753841+0000","last_became_active":"2024-09-12T17:20:47.581310+0000","last_became_peered":"2024-09-12T17:20:47.581310+0000","last_unstale":"2024-09-12T18:10:25.753841+0000","last_undegraded":"2024-09-12T18:10:25.753841+0000","last_fullsized":"2024-09-12T18:10:25.753841+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:11.897529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619107+0000","last_change":"2024-09-12T17:20:30.536180+0000","last_active":"2024-09-12T18:10:21.619107+0000","last_peered":"2024-09-12T18:10:21.619107+0000","last_clean":"2024-09-12T18:10:21.619107+0000","last_became_active":"2024-09-12T17:20:30.535668+0000","last_became_peered":"2024-09-12T17:20:30.535668+0000","last_unstale":"2024-09-12T18:10:21.619107+0000","last_undegraded":"2024-09-12T18:10:21.619107+0000","last_fullsized":"2024-09-12T18:10:21.619107+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:31.430438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'13","reported_seq":92,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:11.618041+0000","last_change":"2024-09-12T17:16:11.484443+0000","last_active":"2024-09-12T18:10:11.618041+0000","last_peered":"2024-09-12T18:10:11.618041+0000","last_clean":"2024-09-12T18:10:11.618041+0000","last_became_active":"2024-09-12T17:16:11.484154+0000","last_became_peered":"2024-09-12T17:16:11.484154+0000","last_unstale":"2024-09-12T18:10:11.618041+0000","last_undegraded":"2024-09-12T18:10:11.618041+0000","last_fullsized":"2024-09-12T18:10:11.618041+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:54.824715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":37,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:42.759255+0000","last_change":"2024-09-12T17:39:05.928118+0000","last_active":"2024-09-12T18:10:42.759255+0000","last_peered":"2024-09-12T18:10:42.759255+0000","last_clean":"2024-09-12T18:10:42.759255+0000","last_became_active":"2024-09-12T17:39:05.927841+0000","last_became_peered":"2024-09-12T17:39:05.927841+0000","last_unstale":"2024-09-12T18:10:42.759255+0000","last_undegraded":"2024-09-12T18:10:42.759255+0000","last_fullsized":"2024-09-12T18:10:42.759255+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:37.026584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.756629+0000","last_change":"2024-09-12T17:20:34.611017+0000","last_active":"2024-09-12T18:10:27.756629+0000","last_peered":"2024-09-12T18:10:27.756629+0000","last_clean":"2024-09-12T18:10:27.756629+0000","last_became_active":"2024-09-12T17:20:34.610737+0000","last_became_peered":"2024-09-12T17:20:34.610737+0000","last_unstale":"2024-09-12T18:10:27.756629+0000","last_undegraded":"2024-09-12T18:10:27.756629+0000","last_fullsized":"2024-09-12T18:10:27.756629+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:07.818994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:23.917473+0000","last_change":"2024-09-12T17:20:30.529241+0000","last_active":"2024-09-12T18:10:23.917473+0000","last_peered":"2024-09-12T18:10:23.917473+0000","last_clean":"2024-09-12T18:10:23.917473+0000","last_became_active":"2024-09-12T17:20:30.528902+0000","last_became_peered":"2024-09-12T17:20:30.528902+0000","last_unstale":"2024-09-12T18:10:23.917473+0000","last_undegraded":"2024-09-12T18:10:23.917473+0000","last_fullsized":"2024-09-12T18:10:23.917473+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:59.483184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'31","reported_seq":148,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.757491+0000","last_change":"2024-09-12T17:16:11.489013+0000","last_active":"2024-09-12T18:10:32.757491+0000","last_peered":"2024-09-12T18:10:32.757491+0000","last_clean":"2024-09-12T18:10:32.757491+0000","last_became_active":"2024-09-12T17:16:11.488722+0000","last_became_peered":"2024-09-12T17:16:11.488722+0000","last_unstale":"2024-09-12T18:10:32.757491+0000","last_undegraded":"2024-09-12T18:10:32.757491+0000","last_fullsized":"2024-09-12T18:10:32.757491+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:19.504993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":116,"num_write":54,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.758386+0000","last_change":"2024-09-12T17:39:05.929421+0000","last_active":"2024-09-12T18:10:37.758386+0000","last_peered":"2024-09-12T18:10:37.758386+0000","last_clean":"2024-09-12T18:10:37.758386+0000","last_became_active":"2024-09-12T17:39:05.929156+0000","last_became_peered":"2024-09-12T17:39:05.929156+0000","last_unstale":"2024-09-12T18:10:37.758386+0000","last_undegraded":"2024-09-12T18:10:37.758386+0000","last_fullsized":"2024-09-12T18:10:37.758386+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:37.940351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:03.915183+0000","last_change":"2024-09-12T17:20:34.559128+0000","last_active":"2024-09-12T18:10:03.915183+0000","last_peered":"2024-09-12T18:10:03.915183+0000","last_clean":"2024-09-12T18:10:03.915183+0000","last_became_active":"2024-09-12T17:20:34.558826+0000","last_became_peered":"2024-09-12T17:20:34.558826+0000","last_unstale":"2024-09-12T18:10:03.915183+0000","last_undegraded":"2024-09-12T18:10:03.915183+0000","last_fullsized":"2024-09-12T18:10:03.915183+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:41.318428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.620862+0000","last_change":"2024-09-12T17:20:30.537479+0000","last_active":"2024-09-12T18:10:36.620862+0000","last_peered":"2024-09-12T18:10:36.620862+0000","last_clean":"2024-09-12T18:10:36.620862+0000","last_became_active":"2024-09-12T17:20:30.537204+0000","last_became_peered":"2024-09-12T17:20:30.537204+0000","last_unstale":"2024-09-12T18:10:36.620862+0000","last_undegraded":"2024-09-12T18:10:36.620862+0000","last_fullsized":"2024-09-12T18:10:36.620862+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:58.505650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'43","reported_seq":176,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.842925+0000","last_change":"2024-09-12T17:16:11.487416+0000","last_active":"2024-09-12T18:10:21.842925+0000","last_peered":"2024-09-12T18:10:21.842925+0000","last_clean":"2024-09-12T18:10:21.842925+0000","last_became_active":"2024-09-12T17:16:11.487129+0000","last_became_peered":"2024-09-12T17:16:11.487129+0000","last_unstale":"2024-09-12T18:10:21.842925+0000","last_undegraded":"2024-09-12T18:10:21.842925+0000","last_fullsized":"2024-09-12T18:10:21.842925+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:13.494114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":153,"num_write":79,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.620937+0000","last_change":"2024-09-12T17:39:05.926264+0000","last_active":"2024-09-12T18:10:36.620937+0000","last_peered":"2024-09-12T18:10:36.620937+0000","last_clean":"2024-09-12T18:10:36.620937+0000","last_became_active":"2024-09-12T17:39:05.925950+0000","last_became_peered":"2024-09-12T17:39:05.925950+0000","last_unstale":"2024-09-12T18:10:36.620937+0000","last_undegraded":"2024-09-12T18:10:36.620937+0000","last_fullsized":"2024-09-12T18:10:36.620937+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:25.942839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.758339+0000","last_change":"2024-09-12T17:20:34.555836+0000","last_active":"2024-09-12T18:10:37.758339+0000","last_peered":"2024-09-12T18:10:37.758339+0000","last_clean":"2024-09-12T18:10:37.758339+0000","last_became_active":"2024-09-12T17:20:34.555493+0000","last_became_peered":"2024-09-12T17:20:34.555493+0000","last_unstale":"2024-09-12T18:10:37.758339+0000","last_undegraded":"2024-09-12T18:10:37.758339+0000","last_fullsized":"2024-09-12T18:10:37.758339+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:04.010344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'3","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:00.750159+0000","last_change":"2024-09-12T17:20:30.534904+0000","last_active":"2024-09-12T18:10:00.750159+0000","last_peered":"2024-09-12T18:10:00.750159+0000","last_clean":"2024-09-12T18:10:00.750159+0000","last_became_active":"2024-09-12T17:20:30.534448+0000","last_became_peered":"2024-09-12T17:20:30.534448+0000","last_unstale":"2024-09-12T18:10:00.750159+0000","last_undegraded":"2024-09-12T18:10:00.750159+0000","last_fullsized":"2024-09-12T18:10:00.750159+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:56.106715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48422,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4144,"num_write":3,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'9","reported_seq":87,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.742416+0000","last_change":"2024-09-12T17:16:11.488846+0000","last_active":"2024-09-12T18:10:22.742416+0000","last_peered":"2024-09-12T18:10:22.742416+0000","last_clean":"2024-09-12T18:10:22.742416+0000","last_became_active":"2024-09-12T17:16:11.488433+0000","last_became_peered":"2024-09-12T17:16:11.488433+0000","last_unstale":"2024-09-12T18:10:22.742416+0000","last_undegraded":"2024-09-12T18:10:22.742416+0000","last_fullsized":"2024-09-12T18:10:22.742416+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:14.398588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":34,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.755896+0000","last_change":"2024-09-12T17:39:05.927566+0000","last_active":"2024-09-12T18:10:22.755896+0000","last_peered":"2024-09-12T18:10:22.755896+0000","last_clean":"2024-09-12T18:10:22.755896+0000","last_became_active":"2024-09-12T17:39:05.925525+0000","last_became_peered":"2024-09-12T17:39:05.925525+0000","last_unstale":"2024-09-12T18:10:22.755896+0000","last_undegraded":"2024-09-12T18:10:22.755896+0000","last_fullsized":"2024-09-12T18:10:22.755896+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:27.269945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'2","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:51.622647+0000","last_change":"2024-09-12T17:20:34.559275+0000","last_active":"2024-09-12T18:10:51.622647+0000","last_peered":"2024-09-12T18:10:51.622647+0000","last_clean":"2024-09-12T18:10:51.622647+0000","last_became_active":"2024-09-12T17:20:34.558946+0000","last_became_peered":"2024-09-12T17:20:34.558946+0000","last_unstale":"2024-09-12T18:10:51.622647+0000","last_undegraded":"2024-09-12T18:10:51.622647+0000","last_fullsized":"2024-09-12T18:10:51.622647+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:44.945949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'4","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.757518+0000","last_change":"2024-09-12T17:20:30.528368+0000","last_active":"2024-09-12T18:10:32.757518+0000","last_peered":"2024-09-12T18:10:32.757518+0000","last_clean":"2024-09-12T18:10:32.757518+0000","last_became_active":"2024-09-12T17:20:30.528078+0000","last_became_peered":"2024-09-12T17:20:30.528078+0000","last_unstale":"2024-09-12T18:10:32.757518+0000","last_undegraded":"2024-09-12T18:10:32.757518+0000","last_fullsized":"2024-09-12T18:10:32.757518+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:37.188849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'44","reported_seq":182,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619260+0000","last_change":"2024-09-12T17:16:11.481733+0000","last_active":"2024-09-12T18:10:21.619260+0000","last_peered":"2024-09-12T18:10:21.619260+0000","last_clean":"2024-09-12T18:10:21.619260+0000","last_became_active":"2024-09-12T17:16:11.481431+0000","last_became_peered":"2024-09-12T17:16:11.481431+0000","last_unstale":"2024-09-12T18:10:21.619260+0000","last_undegraded":"2024-09-12T18:10:21.619260+0000","last_fullsized":"2024-09-12T18:10:21.619260+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:47.517502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":166,"num_write":69,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954425+0000","last_change":"2024-09-12T17:39:05.919499+0000","last_active":"2024-09-12T18:10:22.954425+0000","last_peered":"2024-09-12T18:10:22.954425+0000","last_clean":"2024-09-12T18:10:22.954425+0000","last_became_active":"2024-09-12T17:39:05.919207+0000","last_became_peered":"2024-09-12T17:39:05.919207+0000","last_unstale":"2024-09-12T18:10:22.954425+0000","last_undegraded":"2024-09-12T18:10:22.954425+0000","last_fullsized":"2024-09-12T18:10:22.954425+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:26.247547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'8","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.620919+0000","last_change":"2024-09-12T17:20:34.613162+0000","last_active":"2024-09-12T18:10:36.620919+0000","last_peered":"2024-09-12T18:10:36.620919+0000","last_clean":"2024-09-12T18:10:36.620919+0000","last_became_active":"2024-09-12T17:20:34.612840+0000","last_became_peered":"2024-09-12T17:20:34.612840+0000","last_unstale":"2024-09-12T18:10:36.620919+0000","last_undegraded":"2024-09-12T18:10:36.620919+0000","last_fullsized":"2024-09-12T18:10:36.620919+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:07.359408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":23554,"num_write":8,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:43.700925+0000","last_change":"2024-09-12T17:20:30.539195+0000","last_active":"2024-09-12T18:10:43.700925+0000","last_peered":"2024-09-12T18:10:43.700925+0000","last_clean":"2024-09-12T18:10:43.700925+0000","last_became_active":"2024-09-12T17:20:30.538913+0000","last_became_peered":"2024-09-12T17:20:30.538913+0000","last_unstale":"2024-09-12T18:10:43.700925+0000","last_undegraded":"2024-09-12T18:10:43.700925+0000","last_fullsized":"2024-09-12T18:10:43.700925+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:30.309214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'103","reported_seq":385,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.742516+0000","last_change":"2024-09-12T17:16:11.489384+0000","last_active":"2024-09-12T18:10:22.742516+0000","last_peered":"2024-09-12T18:10:22.742516+0000","last_clean":"2024-09-12T18:10:22.742516+0000","last_became_active":"2024-09-12T17:16:11.489087+0000","last_became_peered":"2024-09-12T17:16:11.489087+0000","last_unstale":"2024-09-12T18:10:22.742516+0000","last_undegraded":"2024-09-12T18:10:22.742516+0000","last_fullsized":"2024-09-12T18:10:22.742516+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:44.577138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":629,"num_read_kb":433,"num_write":144,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.922659+0000","last_change":"2024-09-12T17:39:05.921957+0000","last_active":"2024-09-12T18:11:13.922659+0000","last_peered":"2024-09-12T18:11:13.922659+0000","last_clean":"2024-09-12T18:11:13.922659+0000","last_became_active":"2024-09-12T17:39:05.921608+0000","last_became_peered":"2024-09-12T17:39:05.921608+0000","last_unstale":"2024-09-12T18:11:13.922659+0000","last_undegraded":"2024-09-12T18:11:13.922659+0000","last_fullsized":"2024-09-12T18:11:13.922659+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:54.960277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.756818+0000","last_change":"2024-09-12T17:20:34.611054+0000","last_active":"2024-09-12T18:10:27.756818+0000","last_peered":"2024-09-12T18:10:27.756818+0000","last_clean":"2024-09-12T18:10:27.756818+0000","last_became_active":"2024-09-12T17:20:34.610719+0000","last_became_peered":"2024-09-12T17:20:34.610719+0000","last_unstale":"2024-09-12T18:10:27.756818+0000","last_undegraded":"2024-09-12T18:10:27.756818+0000","last_fullsized":"2024-09-12T18:10:27.756818+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:24.284192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954530+0000","last_change":"2024-09-12T17:20:30.535657+0000","last_active":"2024-09-12T18:10:22.954530+0000","last_peered":"2024-09-12T18:10:22.954530+0000","last_clean":"2024-09-12T18:10:22.954530+0000","last_became_active":"2024-09-12T17:20:30.535382+0000","last_became_peered":"2024-09-12T17:20:30.535382+0000","last_unstale":"2024-09-12T18:10:22.954530+0000","last_undegraded":"2024-09-12T18:10:22.954530+0000","last_fullsized":"2024-09-12T18:10:22.954530+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:06.602123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'27","reported_seq":132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.757540+0000","last_change":"2024-09-12T17:16:11.487072+0000","last_active":"2024-09-12T18:10:32.757540+0000","last_peered":"2024-09-12T18:10:32.757540+0000","last_clean":"2024-09-12T18:10:32.757540+0000","last_became_active":"2024-09-12T17:16:11.486799+0000","last_became_peered":"2024-09-12T17:16:11.486799+0000","last_unstale":"2024-09-12T18:10:32.757540+0000","last_undegraded":"2024-09-12T18:10:32.757540+0000","last_fullsized":"2024-09-12T18:10:32.757540+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:25.256158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":89,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.753105+0000","last_change":"2024-09-12T17:39:05.923468+0000","last_active":"2024-09-12T18:10:20.753105+0000","last_peered":"2024-09-12T18:10:20.753105+0000","last_clean":"2024-09-12T18:10:20.753105+0000","last_became_active":"2024-09-12T17:39:05.923192+0000","last_became_peered":"2024-09-12T17:39:05.923192+0000","last_unstale":"2024-09-12T18:10:20.753105+0000","last_undegraded":"2024-09-12T18:10:20.753105+0000","last_fullsized":"2024-09-12T18:10:20.753105+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:18.451237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'2","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:25.753945+0000","last_change":"2024-09-12T17:20:34.555545+0000","last_active":"2024-09-12T18:10:25.753945+0000","last_peered":"2024-09-12T18:10:25.753945+0000","last_clean":"2024-09-12T18:10:25.753945+0000","last_became_active":"2024-09-12T17:20:34.555267+0000","last_became_peered":"2024-09-12T17:20:34.555267+0000","last_unstale":"2024-09-12T18:10:25.753945+0000","last_undegraded":"2024-09-12T18:10:25.753945+0000","last_fullsized":"2024-09-12T18:10:25.753945+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:48.447926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'3","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.756008+0000","last_change":"2024-09-12T17:20:30.531341+0000","last_active":"2024-09-12T18:10:22.756008+0000","last_peered":"2024-09-12T18:10:22.756008+0000","last_clean":"2024-09-12T18:10:22.756008+0000","last_became_active":"2024-09-12T17:20:30.530998+0000","last_became_peered":"2024-09-12T17:20:30.530998+0000","last_unstale":"2024-09-12T18:10:22.756008+0000","last_undegraded":"2024-09-12T18:10:22.756008+0000","last_fullsized":"2024-09-12T18:10:22.756008+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:28.087866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'20","reported_seq":119,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:23.917537+0000","last_change":"2024-09-12T17:16:11.487744+0000","last_active":"2024-09-12T18:10:23.917537+0000","last_peered":"2024-09-12T18:10:23.917537+0000","last_clean":"2024-09-12T18:10:23.917537+0000","last_became_active":"2024-09-12T17:16:11.487439+0000","last_became_peered":"2024-09-12T17:16:11.487439+0000","last_unstale":"2024-09-12T18:10:23.917537+0000","last_undegraded":"2024-09-12T18:10:23.917537+0000","last_fullsized":"2024-09-12T18:10:23.917537+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:01.381415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":36,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:38.706396+0000","last_change":"2024-09-12T17:39:05.923711+0000","last_active":"2024-09-12T18:11:38.706396+0000","last_peered":"2024-09-12T18:11:38.706396+0000","last_clean":"2024-09-12T18:11:38.706396+0000","last_became_active":"2024-09-12T17:39:05.923420+0000","last_became_peered":"2024-09-12T17:39:05.923420+0000","last_unstale":"2024-09-12T18:11:38.706396+0000","last_undegraded":"2024-09-12T18:11:38.706396+0000","last_fullsized":"2024-09-12T18:11:38.706396+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:30.324051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'5","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:38.934756+0000","last_change":"2024-09-12T17:20:34.558121+0000","last_active":"2024-09-12T18:12:38.934756+0000","last_peered":"2024-09-12T18:12:38.934756+0000","last_clean":"2024-09-12T18:12:38.934756+0000","last_became_active":"2024-09-12T17:20:34.557794+0000","last_became_peered":"2024-09-12T17:20:34.557794+0000","last_unstale":"2024-09-12T18:12:38.934756+0000","last_undegraded":"2024-09-12T18:12:38.934756+0000","last_fullsized":"2024-09-12T18:12:38.934756+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:35.789851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'6","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:42.759117+0000","last_change":"2024-09-12T17:20:30.538275+0000","last_active":"2024-09-12T18:10:42.759117+0000","last_peered":"2024-09-12T18:10:42.759117+0000","last_clean":"2024-09-12T18:10:42.759117+0000","last_became_active":"2024-09-12T17:20:30.537970+0000","last_became_peered":"2024-09-12T17:20:30.537970+0000","last_unstale":"2024-09-12T18:10:42.759117+0000","last_undegraded":"2024-09-12T18:10:42.759117+0000","last_fullsized":"2024-09-12T18:10:42.759117+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:25.105193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":19458,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'24","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954441+0000","last_change":"2024-09-12T17:16:11.487378+0000","last_active":"2024-09-12T18:10:22.954441+0000","last_peered":"2024-09-12T18:10:22.954441+0000","last_clean":"2024-09-12T18:10:22.954441+0000","last_became_active":"2024-09-12T17:16:11.486298+0000","last_became_peered":"2024-09-12T17:16:11.486298+0000","last_unstale":"2024-09-12T18:10:22.954441+0000","last_undegraded":"2024-09-12T18:10:22.954441+0000","last_fullsized":"2024-09-12T18:10:22.954441+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:22.173224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:36.627544+0000","last_change":"2024-09-12T17:39:05.921428+0000","last_active":"2024-09-12T18:11:36.627544+0000","last_peered":"2024-09-12T18:11:36.627544+0000","last_clean":"2024-09-12T18:11:36.627544+0000","last_became_active":"2024-09-12T17:39:05.921085+0000","last_became_peered":"2024-09-12T17:39:05.921085+0000","last_unstale":"2024-09-12T18:11:36.627544+0000","last_undegraded":"2024-09-12T18:11:36.627544+0000","last_fullsized":"2024-09-12T18:11:36.627544+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:12.796863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'4","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:47.958321+0000","last_change":"2024-09-12T17:20:34.559242+0000","last_active":"2024-09-12T18:10:47.958321+0000","last_peered":"2024-09-12T18:10:47.958321+0000","last_clean":"2024-09-12T18:10:47.958321+0000","last_became_active":"2024-09-12T17:20:34.558963+0000","last_became_peered":"2024-09-12T17:20:34.558963+0000","last_unstale":"2024-09-12T18:10:47.958321+0000","last_undegraded":"2024-09-12T18:10:47.958321+0000","last_fullsized":"2024-09-12T18:10:47.958321+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:24.912978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.757457+0000","last_change":"2024-09-12T17:20:30.524694+0000","last_active":"2024-09-12T18:10:32.757457+0000","last_peered":"2024-09-12T18:10:32.757457+0000","last_clean":"2024-09-12T18:10:32.757457+0000","last_became_active":"2024-09-12T17:20:30.524377+0000","last_became_peered":"2024-09-12T17:20:30.524377+0000","last_unstale":"2024-09-12T18:10:32.757457+0000","last_undegraded":"2024-09-12T18:10:32.757457+0000","last_fullsized":"2024-09-12T18:10:32.757457+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:30.709529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'59","reported_seq":225,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.753135+0000","last_change":"2024-09-12T17:16:11.491864+0000","last_active":"2024-09-12T18:10:20.753135+0000","last_peered":"2024-09-12T18:10:20.753135+0000","last_clean":"2024-09-12T18:10:20.753135+0000","last_became_active":"2024-09-12T17:16:11.491512+0000","last_became_peered":"2024-09-12T17:16:11.491512+0000","last_unstale":"2024-09-12T18:10:20.753135+0000","last_undegraded":"2024-09-12T18:10:20.753135+0000","last_fullsized":"2024-09-12T18:10:20.753135+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:58.986968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":313,"num_read_kb":225,"num_write":101,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619193+0000","last_change":"2024-09-12T17:39:05.926334+0000","last_active":"2024-09-12T18:10:21.619193+0000","last_peered":"2024-09-12T18:10:21.619193+0000","last_clean":"2024-09-12T18:10:21.619193+0000","last_became_active":"2024-09-12T17:39:05.926029+0000","last_became_peered":"2024-09-12T17:39:05.926029+0000","last_unstale":"2024-09-12T18:10:21.619193+0000","last_undegraded":"2024-09-12T18:10:21.619193+0000","last_fullsized":"2024-09-12T18:10:21.619193+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:44.569050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"261'2","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.744693+0000","last_change":"2024-09-12T17:20:34.555632+0000","last_active":"2024-09-12T18:10:37.744693+0000","last_peered":"2024-09-12T18:10:37.744693+0000","last_clean":"2024-09-12T18:10:37.744693+0000","last_became_active":"2024-09-12T17:20:34.555137+0000","last_became_peered":"2024-09-12T17:20:34.555137+0000","last_unstale":"2024-09-12T18:10:37.744693+0000","last_undegraded":"2024-09-12T18:10:37.744693+0000","last_fullsized":"2024-09-12T18:10:37.744693+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:44.659171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'1","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:33.918629+0000","last_change":"2024-09-12T17:20:30.531528+0000","last_active":"2024-09-12T18:10:33.918629+0000","last_peered":"2024-09-12T18:10:33.918629+0000","last_clean":"2024-09-12T18:10:33.918629+0000","last_became_active":"2024-09-12T17:20:30.531232+0000","last_became_peered":"2024-09-12T17:20:30.531232+0000","last_unstale":"2024-09-12T18:10:33.918629+0000","last_undegraded":"2024-09-12T18:10:33.918629+0000","last_fullsized":"2024-09-12T18:10:33.918629+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:17.702865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'13","reported_seq":98,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.742450+0000","last_change":"2024-09-12T17:16:11.491691+0000","last_active":"2024-09-12T18:10:22.742450+0000","last_peered":"2024-09-12T18:10:22.742450+0000","last_clean":"2024-09-12T18:10:22.742450+0000","last_became_active":"2024-09-12T17:16:11.491334+0000","last_became_peered":"2024-09-12T17:16:11.491334+0000","last_unstale":"2024-09-12T18:10:22.742450+0000","last_undegraded":"2024-09-12T18:10:22.742450+0000","last_fullsized":"2024-09-12T18:10:22.742450+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:26.856534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":49,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.756721+0000","last_change":"2024-09-12T17:39:05.930558+0000","last_active":"2024-09-12T18:10:27.756721+0000","last_peered":"2024-09-12T18:10:27.756721+0000","last_clean":"2024-09-12T18:10:27.756721+0000","last_became_active":"2024-09-12T17:39:05.930326+0000","last_became_peered":"2024-09-12T17:39:05.930326+0000","last_unstale":"2024-09-12T18:10:27.756721+0000","last_undegraded":"2024-09-12T18:10:27.756721+0000","last_fullsized":"2024-09-12T18:10:27.756721+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:01.120642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'5","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:35.755466+0000","last_change":"2024-09-12T17:20:34.556804+0000","last_active":"2024-09-12T18:10:35.755466+0000","last_peered":"2024-09-12T18:10:35.755466+0000","last_clean":"2024-09-12T18:10:35.755466+0000","last_became_active":"2024-09-12T17:20:34.554832+0000","last_became_peered":"2024-09-12T17:20:34.554832+0000","last_unstale":"2024-09-12T18:10:35.755466+0000","last_undegraded":"2024-09-12T18:10:35.755466+0000","last_fullsized":"2024-09-12T18:10:35.755466+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:59.545466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":15,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'2","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.743952+0000","last_change":"2024-09-12T17:20:30.528814+0000","last_active":"2024-09-12T18:10:32.743952+0000","last_peered":"2024-09-12T18:10:32.743952+0000","last_clean":"2024-09-12T18:10:32.743952+0000","last_became_active":"2024-09-12T17:20:30.528541+0000","last_became_peered":"2024-09-12T17:20:30.528541+0000","last_unstale":"2024-09-12T18:10:32.743952+0000","last_undegraded":"2024-09-12T18:10:32.743952+0000","last_fullsized":"2024-09-12T18:10:32.743952+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:39.437987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'21","reported_seq":117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.755820+0000","last_change":"2024-09-12T17:16:11.487563+0000","last_active":"2024-09-12T18:10:22.755820+0000","last_peered":"2024-09-12T18:10:22.755820+0000","last_clean":"2024-09-12T18:10:22.755820+0000","last_became_active":"2024-09-12T17:16:11.487238+0000","last_became_peered":"2024-09-12T17:16:11.487238+0000","last_unstale":"2024-09-12T18:10:22.755820+0000","last_undegraded":"2024-09-12T18:10:22.755820+0000","last_fullsized":"2024-09-12T18:10:22.755820+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:39.870434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":71,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'303","reported_seq":940,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.261952+0000","last_change":"2024-09-12T17:00:12.304380+0000","last_active":"2024-09-12T18:11:11.261952+0000","last_peered":"2024-09-12T18:11:11.261952+0000","last_clean":"2024-09-12T18:11:11.261952+0000","last_became_active":"2024-09-12T17:00:12.304074+0000","last_became_peered":"2024-09-12T17:00:12.304074+0000","last_unstale":"2024-09-12T18:11:11.261952+0000","last_undegraded":"2024-09-12T18:11:11.261952+0000","last_fullsized":"2024-09-12T18:11:11.261952+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:10:33.200742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1686994,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":473,"num_read_kb":3821,"num_write":1093,"num_write_kb":12701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'137","reported_seq":747,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.953601+0000","last_change":"2024-09-12T17:00:14.328728+0000","last_active":"2024-09-12T18:10:17.953601+0000","last_peered":"2024-09-12T18:10:17.953601+0000","last_clean":"2024-09-12T18:10:17.953601+0000","last_became_active":"2024-09-12T17:00:14.328464+0000","last_became_peered":"2024-09-12T17:00:14.328464+0000","last_unstale":"2024-09-12T18:10:17.953601+0000","last_undegraded":"2024-09-12T18:10:17.953601+0000","last_fullsized":"2024-09-12T18:10:17.953601+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:22.736868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":594,"num_read_kb":496,"num_write":221,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'298","reported_seq":932,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.864070+0000","last_change":"2024-09-12T17:00:12.303038+0000","last_active":"2024-09-12T18:13:48.864070+0000","last_peered":"2024-09-12T18:13:48.864070+0000","last_clean":"2024-09-12T18:13:48.864070+0000","last_became_active":"2024-09-12T17:00:12.302750+0000","last_became_peered":"2024-09-12T17:00:12.302750+0000","last_unstale":"2024-09-12T18:13:48.864070+0000","last_undegraded":"2024-09-12T18:13:48.864070+0000","last_fullsized":"2024-09-12T18:13:48.864070+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:48.905725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262421,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":398,"num_read_kb":57739,"num_write":1002,"num_write_kb":55497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'222","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:21.909979+0000","last_change":"2024-09-12T17:00:14.336471+0000","last_active":"2024-09-12T18:13:21.909979+0000","last_peered":"2024-09-12T18:13:21.909979+0000","last_clean":"2024-09-12T18:13:21.909979+0000","last_became_active":"2024-09-12T17:00:14.336238+0000","last_became_peered":"2024-09-12T17:00:14.336238+0000","last_unstale":"2024-09-12T18:13:21.909979+0000","last_undegraded":"2024-09-12T18:13:21.909979+0000","last_fullsized":"2024-09-12T18:13:21.909979+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:33.594656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":973,"num_read_kb":793,"num_write":333,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'282","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:01.623680+0000","last_change":"2024-09-12T17:00:12.309414+0000","last_active":"2024-09-12T18:11:01.623680+0000","last_peered":"2024-09-12T18:11:01.623680+0000","last_clean":"2024-09-12T18:11:01.623680+0000","last_became_active":"2024-09-12T17:00:12.309132+0000","last_became_peered":"2024-09-12T17:00:12.309132+0000","last_unstale":"2024-09-12T18:11:01.623680+0000","last_undegraded":"2024-09-12T18:11:01.623680+0000","last_fullsized":"2024-09-12T18:11:01.623680+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:14.849278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14712901,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":469,"num_read_kb":32498,"num_write":1072,"num_write_kb":31975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'254","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:15.752313+0000","last_change":"2024-09-12T17:00:14.324328+0000","last_active":"2024-09-12T18:10:15.752313+0000","last_peered":"2024-09-12T18:10:15.752313+0000","last_clean":"2024-09-12T18:10:15.752313+0000","last_became_active":"2024-09-12T17:00:14.323358+0000","last_became_peered":"2024-09-12T17:00:14.323358+0000","last_unstale":"2024-09-12T18:10:15.752313+0000","last_undegraded":"2024-09-12T18:10:15.752313+0000","last_fullsized":"2024-09-12T18:10:15.752313+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:08.155945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1058,"num_read_kb":862,"num_write":363,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'244","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.955171+0000","last_change":"2024-09-12T17:00:12.321038+0000","last_active":"2024-09-12T18:10:27.955171+0000","last_peered":"2024-09-12T18:10:27.955171+0000","last_clean":"2024-09-12T18:10:27.955171+0000","last_became_active":"2024-09-12T17:00:12.320515+0000","last_became_peered":"2024-09-12T17:00:12.320515+0000","last_unstale":"2024-09-12T18:10:27.955171+0000","last_undegraded":"2024-09-12T18:10:27.955171+0000","last_fullsized":"2024-09-12T18:10:27.955171+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:58.500452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3181254,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":370,"num_read_kb":6790,"num_write":936,"num_write_kb":19852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'120","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:24.988567+0000","last_change":"2024-09-12T17:00:14.335557+0000","last_active":"2024-09-12T18:10:24.988567+0000","last_peered":"2024-09-12T18:10:24.988567+0000","last_clean":"2024-09-12T18:10:24.988567+0000","last_became_active":"2024-09-12T17:00:14.335297+0000","last_became_peered":"2024-09-12T17:00:14.335297+0000","last_unstale":"2024-09-12T18:10:24.988567+0000","last_undegraded":"2024-09-12T18:10:24.988567+0000","last_fullsized":"2024-09-12T18:10:24.988567+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:16.622130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":395,"num_write":174,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'267","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.110434+0000","last_change":"2024-09-12T17:00:12.313071+0000","last_active":"2024-09-12T18:11:11.110434+0000","last_peered":"2024-09-12T18:11:11.110434+0000","last_clean":"2024-09-12T18:11:11.110434+0000","last_became_active":"2024-09-12T17:00:12.312762+0000","last_became_peered":"2024-09-12T17:00:12.312762+0000","last_unstale":"2024-09-12T18:11:11.110434+0000","last_undegraded":"2024-09-12T18:11:11.110434+0000","last_fullsized":"2024-09-12T18:11:11.110434+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:00.055270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5075509,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":429,"num_read_kb":9220,"num_write":985,"num_write_kb":31558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'219","reported_seq":883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.743184+0000","last_change":"2024-09-12T17:00:14.322764+0000","last_active":"2024-09-12T18:10:27.743184+0000","last_peered":"2024-09-12T18:10:27.743184+0000","last_clean":"2024-09-12T18:10:27.743184+0000","last_became_active":"2024-09-12T17:00:14.321640+0000","last_became_peered":"2024-09-12T17:00:14.321640+0000","last_unstale":"2024-09-12T18:10:27.743184+0000","last_undegraded":"2024-09-12T18:10:27.743184+0000","last_fullsized":"2024-09-12T18:10:27.743184+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:15.723927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1016,"num_read_kb":865,"num_write":355,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'295","reported_seq":945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:17.499050+0000","last_change":"2024-09-12T17:00:12.320191+0000","last_active":"2024-09-12T18:13:17.499050+0000","last_peered":"2024-09-12T18:13:17.499050+0000","last_clean":"2024-09-12T18:13:17.499050+0000","last_became_active":"2024-09-12T17:00:12.319917+0000","last_became_peered":"2024-09-12T17:00:12.319917+0000","last_unstale":"2024-09-12T18:13:17.499050+0000","last_undegraded":"2024-09-12T18:13:17.499050+0000","last_fullsized":"2024-09-12T18:13:17.499050+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:05.028474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5225273,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":433,"num_read_kb":38212,"num_write":990,"num_write_kb":26572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'175","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:05.760285+0000","last_change":"2024-09-12T17:00:14.333352+0000","last_active":"2024-09-12T18:11:05.760285+0000","last_peered":"2024-09-12T18:11:05.760285+0000","last_clean":"2024-09-12T18:11:05.760285+0000","last_became_active":"2024-09-12T17:00:14.332940+0000","last_became_peered":"2024-09-12T17:00:14.332940+0000","last_unstale":"2024-09-12T18:11:05.760285+0000","last_undegraded":"2024-09-12T18:11:05.760285+0000","last_fullsized":"2024-09-12T18:11:05.760285+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:50.722062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":715,"num_read_kb":606,"num_write":241,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'264","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:16.757602+0000","last_change":"2024-09-12T17:00:12.305312+0000","last_active":"2024-09-12T18:13:16.757602+0000","last_peered":"2024-09-12T18:13:16.757602+0000","last_clean":"2024-09-12T18:13:16.757602+0000","last_became_active":"2024-09-12T17:00:12.304504+0000","last_became_peered":"2024-09-12T17:00:12.304504+0000","last_unstale":"2024-09-12T18:13:16.757602+0000","last_undegraded":"2024-09-12T18:13:16.757602+0000","last_fullsized":"2024-09-12T18:13:16.757602+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:07.619706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7430088,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":476,"num_read_kb":24452,"num_write":1034,"num_write_kb":21520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'176","reported_seq":772,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.961391+0000","last_change":"2024-09-12T17:00:14.332604+0000","last_active":"2024-09-12T18:11:07.961391+0000","last_peered":"2024-09-12T18:11:07.961391+0000","last_clean":"2024-09-12T18:11:07.961391+0000","last_became_active":"2024-09-12T17:00:14.332360+0000","last_became_peered":"2024-09-12T17:00:14.332360+0000","last_unstale":"2024-09-12T18:11:07.961391+0000","last_undegraded":"2024-09-12T18:11:07.961391+0000","last_fullsized":"2024-09-12T18:11:07.961391+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:55.182932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":738,"num_read_kb":599,"num_write":278,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'296","reported_seq":1001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:11.841796+0000","last_change":"2024-09-12T17:00:12.322666+0000","last_active":"2024-09-12T18:10:11.841796+0000","last_peered":"2024-09-12T18:10:11.841796+0000","last_clean":"2024-09-12T18:10:11.841796+0000","last_became_active":"2024-09-12T17:00:12.322419+0000","last_became_peered":"2024-09-12T17:00:12.322419+0000","last_unstale":"2024-09-12T18:10:11.841796+0000","last_undegraded":"2024-09-12T18:10:11.841796+0000","last_fullsized":"2024-09-12T18:10:11.841796+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:12.248593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1062757,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":594,"num_read_kb":7776,"num_write":1063,"num_write_kb":24985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'60","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:03.703001+0000","last_change":"2024-09-12T17:00:14.334885+0000","last_active":"2024-09-12T18:11:03.703001+0000","last_peered":"2024-09-12T18:11:03.703001+0000","last_clean":"2024-09-12T18:11:03.703001+0000","last_became_active":"2024-09-12T17:00:14.334586+0000","last_became_peered":"2024-09-12T17:00:14.334586+0000","last_unstale":"2024-09-12T18:11:03.703001+0000","last_undegraded":"2024-09-12T18:11:03.703001+0000","last_fullsized":"2024-09-12T18:11:03.703001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:29.087177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":225,"num_write":86,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'142","reported_seq":765,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:15.752206+0000","last_change":"2024-09-12T17:00:14.323537+0000","last_active":"2024-09-12T18:10:15.752206+0000","last_peered":"2024-09-12T18:10:15.752206+0000","last_clean":"2024-09-12T18:10:15.752206+0000","last_became_active":"2024-09-12T17:00:14.322771+0000","last_became_peered":"2024-09-12T17:00:14.322771+0000","last_unstale":"2024-09-12T18:10:15.752206+0000","last_undegraded":"2024-09-12T18:10:15.752206+0000","last_fullsized":"2024-09-12T18:10:15.752206+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:13.873569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":650,"num_read_kb":543,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'318","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.757582+0000","last_change":"2024-09-12T17:00:46.407269+0000","last_active":"2024-09-12T18:10:32.757582+0000","last_peered":"2024-09-12T18:10:32.757582+0000","last_clean":"2024-09-12T18:10:32.757582+0000","last_became_active":"2024-09-12T17:00:46.406911+0000","last_became_peered":"2024-09-12T17:00:46.406911+0000","last_unstale":"2024-09-12T18:10:32.757582+0000","last_undegraded":"2024-09-12T18:10:32.757582+0000","last_fullsized":"2024-09-12T18:10:32.757582+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:22.337640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14233470,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":693,"num_read_kb":51923,"num_write":1262,"num_write_kb":31895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'117","reported_seq":724,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.755079+0000","last_change":"2024-09-12T17:00:14.336399+0000","last_active":"2024-09-12T18:10:17.755079+0000","last_peered":"2024-09-12T18:10:17.755079+0000","last_clean":"2024-09-12T18:10:17.755079+0000","last_became_active":"2024-09-12T17:00:14.336161+0000","last_became_peered":"2024-09-12T17:00:14.336161+0000","last_unstale":"2024-09-12T18:10:17.755079+0000","last_undegraded":"2024-09-12T18:10:17.755079+0000","last_fullsized":"2024-09-12T18:10:17.755079+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:57.473607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":545,"num_read_kb":462,"num_write":195,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'271","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.741666+0000","last_change":"2024-09-12T17:00:12.310880+0000","last_active":"2024-09-12T18:10:17.741666+0000","last_peered":"2024-09-12T18:10:17.741666+0000","last_clean":"2024-09-12T18:10:17.741666+0000","last_became_active":"2024-09-12T17:00:12.310589+0000","last_became_peered":"2024-09-12T17:00:12.310589+0000","last_unstale":"2024-09-12T18:10:17.741666+0000","last_undegraded":"2024-09-12T18:10:17.741666+0000","last_fullsized":"2024-09-12T18:10:17.741666+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:43.821237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6903652,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":529,"num_read_kb":8321,"num_write":937,"num_write_kb":31830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'144","reported_seq":725,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.964476+0000","last_change":"2024-09-12T17:00:14.325153+0000","last_active":"2024-09-12T18:12:02.964476+0000","last_peered":"2024-09-12T18:12:02.964476+0000","last_clean":"2024-09-12T18:12:02.964476+0000","last_became_active":"2024-09-12T17:00:14.324889+0000","last_became_peered":"2024-09-12T17:00:14.324889+0000","last_unstale":"2024-09-12T18:12:02.964476+0000","last_undegraded":"2024-09-12T18:12:02.964476+0000","last_fullsized":"2024-09-12T18:12:02.964476+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:11.915771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":586,"num_read_kb":478,"num_write":211,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'274","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.741645+0000","last_change":"2024-09-12T17:00:12.315972+0000","last_active":"2024-09-12T18:10:17.741645+0000","last_peered":"2024-09-12T18:10:17.741645+0000","last_clean":"2024-09-12T18:10:17.741645+0000","last_became_active":"2024-09-12T17:00:12.315652+0000","last_became_peered":"2024-09-12T17:00:12.315652+0000","last_unstale":"2024-09-12T18:10:17.741645+0000","last_undegraded":"2024-09-12T18:10:17.741645+0000","last_fullsized":"2024-09-12T18:10:17.741645+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:33.033611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12167588,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":445,"num_read_kb":21524,"num_write":1030,"num_write_kb":35144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'78","reported_seq":629,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:18.698535+0000","last_change":"2024-09-12T17:00:14.335255+0000","last_active":"2024-09-12T18:10:18.698535+0000","last_peered":"2024-09-12T18:10:18.698535+0000","last_clean":"2024-09-12T18:10:18.698535+0000","last_became_active":"2024-09-12T17:00:14.335009+0000","last_became_peered":"2024-09-12T17:00:14.335009+0000","last_unstale":"2024-09-12T18:10:18.698535+0000","last_undegraded":"2024-09-12T18:10:18.698535+0000","last_fullsized":"2024-09-12T18:10:18.698535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:36.037057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":353,"num_read_kb":297,"num_write":121,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'284","reported_seq":945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.110941+0000","last_change":"2024-09-12T17:00:12.313118+0000","last_active":"2024-09-12T18:11:11.110941+0000","last_peered":"2024-09-12T18:11:11.110941+0000","last_clean":"2024-09-12T18:11:11.110941+0000","last_became_active":"2024-09-12T17:00:12.312828+0000","last_became_peered":"2024-09-12T17:00:12.312828+0000","last_unstale":"2024-09-12T18:11:11.110941+0000","last_undegraded":"2024-09-12T18:11:11.110941+0000","last_fullsized":"2024-09-12T18:11:11.110941+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:31.791812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22704252,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":470,"num_read_kb":47218,"num_write":1097,"num_write_kb":32154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'190","reported_seq":830,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:18.698566+0000","last_change":"2024-09-12T17:00:14.328021+0000","last_active":"2024-09-12T18:10:18.698566+0000","last_peered":"2024-09-12T18:10:18.698566+0000","last_clean":"2024-09-12T18:10:18.698566+0000","last_became_active":"2024-09-12T17:00:14.327744+0000","last_became_peered":"2024-09-12T17:00:14.327744+0000","last_unstale":"2024-09-12T18:10:18.698566+0000","last_undegraded":"2024-09-12T18:10:18.698566+0000","last_fullsized":"2024-09-12T18:10:18.698566+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:10.529599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":833,"num_read_kb":695,"num_write":274,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'251","reported_seq":1034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.234870+0000","last_change":"2024-09-12T17:00:12.319914+0000","last_active":"2024-09-12T18:10:20.234870+0000","last_peered":"2024-09-12T18:10:20.234870+0000","last_clean":"2024-09-12T18:10:20.234870+0000","last_became_active":"2024-09-12T17:00:12.319649+0000","last_became_peered":"2024-09-12T17:00:12.319649+0000","last_unstale":"2024-09-12T18:10:20.234870+0000","last_undegraded":"2024-09-12T18:10:20.234870+0000","last_fullsized":"2024-09-12T18:10:20.234870+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:03.094320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15976363,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":678,"num_read_kb":130250,"num_write":882,"num_write_kb":66985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'137","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.753208+0000","last_change":"2024-09-12T17:00:14.329425+0000","last_active":"2024-09-12T18:10:20.753208+0000","last_peered":"2024-09-12T18:10:20.753208+0000","last_clean":"2024-09-12T18:10:20.753208+0000","last_became_active":"2024-09-12T17:00:14.329107+0000","last_became_peered":"2024-09-12T17:00:14.329107+0000","last_unstale":"2024-09-12T18:10:20.753208+0000","last_undegraded":"2024-09-12T18:10:20.753208+0000","last_fullsized":"2024-09-12T18:10:20.753208+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:18.916868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":644,"num_read_kb":539,"num_write":215,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'300","reported_seq":1037,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.620317+0000","last_change":"2024-09-12T17:00:12.308630+0000","last_active":"2024-09-12T18:10:31.620317+0000","last_peered":"2024-09-12T18:10:31.620317+0000","last_clean":"2024-09-12T18:10:31.620317+0000","last_became_active":"2024-09-12T17:00:12.307906+0000","last_became_peered":"2024-09-12T17:00:12.307906+0000","last_unstale":"2024-09-12T18:10:31.620317+0000","last_undegraded":"2024-09-12T18:10:31.620317+0000","last_fullsized":"2024-09-12T18:10:31.620317+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:48.118605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1577780,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":645,"num_read_kb":3845,"num_write":1020,"num_write_kb":30178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'131","reported_seq":641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.108183+0000","last_change":"2024-09-12T17:00:22.355877+0000","last_active":"2024-09-12T18:12:03.108183+0000","last_peered":"2024-09-12T18:12:03.108183+0000","last_clean":"2024-09-12T18:12:03.108183+0000","last_became_active":"2024-09-12T17:00:22.355591+0000","last_became_peered":"2024-09-12T17:00:22.355591+0000","last_unstale":"2024-09-12T18:12:03.108183+0000","last_undegraded":"2024-09-12T18:12:03.108183+0000","last_fullsized":"2024-09-12T18:12:03.108183+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:28:58.673978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1447,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":175,"num_read_kb":172,"num_write":326,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'85","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.843638+0000","last_change":"2024-09-12T17:00:14.336449+0000","last_active":"2024-09-12T18:10:26.843638+0000","last_peered":"2024-09-12T18:10:26.843638+0000","last_clean":"2024-09-12T18:10:26.843638+0000","last_became_active":"2024-09-12T17:00:14.336144+0000","last_became_peered":"2024-09-12T17:00:14.336144+0000","last_unstale":"2024-09-12T18:10:26.843638+0000","last_undegraded":"2024-09-12T18:10:26.843638+0000","last_fullsized":"2024-09-12T18:10:26.843638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:36.033113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":388,"num_read_kb":332,"num_write":123,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'295","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.603834+0000","last_change":"2024-09-12T17:00:46.721301+0000","last_active":"2024-09-12T18:13:48.603834+0000","last_peered":"2024-09-12T18:13:48.603834+0000","last_clean":"2024-09-12T18:13:48.603834+0000","last_became_active":"2024-09-12T17:00:46.720989+0000","last_became_peered":"2024-09-12T17:00:46.720989+0000","last_unstale":"2024-09-12T18:13:48.603834+0000","last_undegraded":"2024-09-12T18:13:48.603834+0000","last_fullsized":"2024-09-12T18:13:48.603834+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:03.810826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4241249,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":444,"num_read_kb":63990,"num_write":1012,"num_write_kb":41211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954509+0000","last_change":"2024-09-12T17:00:16.326154+0000","last_active":"2024-09-12T18:10:22.954509+0000","last_peered":"2024-09-12T18:10:22.954509+0000","last_clean":"2024-09-12T18:10:22.954509+0000","last_became_active":"2024-09-12T17:00:16.325868+0000","last_became_peered":"2024-09-12T17:00:16.325868+0000","last_unstale":"2024-09-12T18:10:22.954509+0000","last_undegraded":"2024-09-12T18:10:22.954509+0000","last_fullsized":"2024-09-12T18:10:22.954509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:07.781526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'334","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:51.637120+0000","last_change":"2024-09-12T17:00:18.329828+0000","last_active":"2024-09-12T18:12:51.637120+0000","last_peered":"2024-09-12T18:12:51.637120+0000","last_clean":"2024-09-12T18:12:51.637120+0000","last_became_active":"2024-09-12T17:00:18.329515+0000","last_became_peered":"2024-09-12T17:00:18.329515+0000","last_unstale":"2024-09-12T18:12:51.637120+0000","last_undegraded":"2024-09-12T18:12:51.637120+0000","last_fullsized":"2024-09-12T18:12:51.637120+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:07.586238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57242,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":538,"num_read_kb":1038,"num_write":424,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.756841+0000","last_change":"2024-09-12T17:00:20.349019+0000","last_active":"2024-09-12T18:10:27.756841+0000","last_peered":"2024-09-12T18:10:27.756841+0000","last_clean":"2024-09-12T18:10:27.756841+0000","last_became_active":"2024-09-12T17:00:20.348524+0000","last_became_peered":"2024-09-12T17:00:20.348524+0000","last_unstale":"2024-09-12T18:10:27.756841+0000","last_undegraded":"2024-09-12T18:10:27.756841+0000","last_fullsized":"2024-09-12T18:10:27.756841+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:34.615435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'165","reported_seq":725,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:42.957515+0000","last_change":"2024-09-12T17:00:22.357994+0000","last_active":"2024-09-12T18:10:42.957515+0000","last_peered":"2024-09-12T18:10:42.957515+0000","last_clean":"2024-09-12T18:10:42.957515+0000","last_became_active":"2024-09-12T17:00:22.357688+0000","last_became_peered":"2024-09-12T17:00:22.357688+0000","last_unstale":"2024-09-12T18:10:42.957515+0000","last_undegraded":"2024-09-12T18:10:42.957515+0000","last_fullsized":"2024-09-12T18:10:42.957515+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:48.716325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":624,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":254,"num_read_kb":249,"num_write":335,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'314","reported_seq":940,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954488+0000","last_change":"2024-09-12T17:00:14.327416+0000","last_active":"2024-09-12T18:10:22.954488+0000","last_peered":"2024-09-12T18:10:22.954488+0000","last_clean":"2024-09-12T18:10:22.954488+0000","last_became_active":"2024-09-12T17:00:14.327170+0000","last_became_peered":"2024-09-12T17:00:14.327170+0000","last_unstale":"2024-09-12T18:10:22.954488+0000","last_undegraded":"2024-09-12T18:10:22.954488+0000","last_fullsized":"2024-09-12T18:10:22.954488+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:31.084615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1382,"num_read_kb":1112,"num_write":506,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'321","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:11.618016+0000","last_change":"2024-09-12T17:00:12.304639+0000","last_active":"2024-09-12T18:10:11.618016+0000","last_peered":"2024-09-12T18:10:11.618016+0000","last_clean":"2024-09-12T18:10:11.618016+0000","last_became_active":"2024-09-12T17:00:12.304357+0000","last_became_peered":"2024-09-12T17:00:12.304357+0000","last_unstale":"2024-09-12T18:10:11.618016+0000","last_undegraded":"2024-09-12T18:10:11.618016+0000","last_fullsized":"2024-09-12T18:10:11.618016+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:22.101694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14850658,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":585,"num_read_kb":22986,"num_write":1100,"num_write_kb":36092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.843647+0000","last_change":"2024-09-12T17:00:16.323972+0000","last_active":"2024-09-12T18:10:26.843647+0000","last_peered":"2024-09-12T18:10:26.843647+0000","last_clean":"2024-09-12T18:10:26.843647+0000","last_became_active":"2024-09-12T17:00:16.323601+0000","last_became_peered":"2024-09-12T17:00:16.323601+0000","last_unstale":"2024-09-12T18:10:26.843647+0000","last_undegraded":"2024-09-12T18:10:26.843647+0000","last_fullsized":"2024-09-12T18:10:26.843647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:58.961774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'106","reported_seq":646,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.602728+0000","last_change":"2024-09-12T17:00:18.328151+0000","last_active":"2024-09-12T18:11:11.602728+0000","last_peered":"2024-09-12T18:11:11.602728+0000","last_clean":"2024-09-12T18:11:11.602728+0000","last_became_active":"2024-09-12T17:00:18.327744+0000","last_became_peered":"2024-09-12T17:00:18.327744+0000","last_unstale":"2024-09-12T18:11:11.602728+0000","last_undegraded":"2024-09-12T18:11:11.602728+0000","last_fullsized":"2024-09-12T18:11:11.602728+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:37.786807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":113,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:25.753957+0000","last_change":"2024-09-12T17:00:20.348202+0000","last_active":"2024-09-12T18:10:25.753957+0000","last_peered":"2024-09-12T18:10:25.753957+0000","last_clean":"2024-09-12T18:10:25.753957+0000","last_became_active":"2024-09-12T17:00:20.347865+0000","last_became_peered":"2024-09-12T17:00:20.347865+0000","last_unstale":"2024-09-12T18:10:25.753957+0000","last_undegraded":"2024-09-12T18:10:25.753957+0000","last_fullsized":"2024-09-12T18:10:25.753957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:50.254374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'111","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619154+0000","last_change":"2024-09-12T17:00:22.353337+0000","last_active":"2024-09-12T18:10:21.619154+0000","last_peered":"2024-09-12T18:10:21.619154+0000","last_clean":"2024-09-12T18:10:21.619154+0000","last_became_active":"2024-09-12T17:00:22.352912+0000","last_became_peered":"2024-09-12T17:00:22.352912+0000","last_unstale":"2024-09-12T18:10:21.619154+0000","last_undegraded":"2024-09-12T18:10:21.619154+0000","last_fullsized":"2024-09-12T18:10:21.619154+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:40.097046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":708,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":149,"num_read_kb":144,"num_write":248,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'179","reported_seq":806,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619226+0000","last_change":"2024-09-12T17:00:14.337811+0000","last_active":"2024-09-12T18:10:21.619226+0000","last_peered":"2024-09-12T18:10:21.619226+0000","last_clean":"2024-09-12T18:10:21.619226+0000","last_became_active":"2024-09-12T17:00:14.337515+0000","last_became_peered":"2024-09-12T17:00:14.337515+0000","last_unstale":"2024-09-12T18:10:21.619226+0000","last_undegraded":"2024-09-12T18:10:21.619226+0000","last_fullsized":"2024-09-12T18:10:21.619226+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:45.954756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":863,"num_read_kb":715,"num_write":299,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'304","reported_seq":965,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.671210+0000","last_change":"2024-09-12T17:00:12.308357+0000","last_active":"2024-09-12T18:10:17.671210+0000","last_peered":"2024-09-12T18:10:17.671210+0000","last_clean":"2024-09-12T18:10:17.671210+0000","last_became_active":"2024-09-12T17:00:12.308065+0000","last_became_peered":"2024-09-12T17:00:12.308065+0000","last_unstale":"2024-09-12T18:10:17.671210+0000","last_undegraded":"2024-09-12T18:10:17.671210+0000","last_fullsized":"2024-09-12T18:10:17.671210+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:01.954058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1304272,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":441,"num_read_kb":43207,"num_write":1105,"num_write_kb":32106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.843124+0000","last_change":"2024-09-12T17:00:16.326520+0000","last_active":"2024-09-12T18:10:21.843124+0000","last_peered":"2024-09-12T18:10:21.843124+0000","last_clean":"2024-09-12T18:10:21.843124+0000","last_became_active":"2024-09-12T17:00:16.326073+0000","last_became_peered":"2024-09-12T17:00:16.326073+0000","last_unstale":"2024-09-12T18:10:21.843124+0000","last_undegraded":"2024-09-12T18:10:21.843124+0000","last_fullsized":"2024-09-12T18:10:21.843124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:41.659835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'139","reported_seq":693,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.703133+0000","last_change":"2024-09-12T17:00:18.327751+0000","last_active":"2024-09-12T18:11:11.703133+0000","last_peered":"2024-09-12T18:11:11.703133+0000","last_clean":"2024-09-12T18:11:11.703133+0000","last_became_active":"2024-09-12T17:00:18.327448+0000","last_became_peered":"2024-09-12T17:00:18.327448+0000","last_unstale":"2024-09-12T18:11:11.703133+0000","last_undegraded":"2024-09-12T18:11:11.703133+0000","last_fullsized":"2024-09-12T18:11:11.703133+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:36.026074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":172,"num_read_kb":164,"num_write":118,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'763","reported_seq":2562,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.300067+0000","last_change":"2024-09-12T17:00:20.351615+0000","last_active":"2024-09-12T18:13:23.300067+0000","last_peered":"2024-09-12T18:13:23.300067+0000","last_clean":"2024-09-12T18:13:23.300067+0000","last_became_active":"2024-09-12T17:00:20.351202+0000","last_became_peered":"2024-09-12T17:00:20.351202+0000","last_unstale":"2024-09-12T18:13:23.300067+0000","last_undegraded":"2024-09-12T18:13:23.300067+0000","last_fullsized":"2024-09-12T18:13:23.300067+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:43.494236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'205","reported_seq":1031,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.168160+0000","last_change":"2024-09-12T17:00:22.588416+0000","last_active":"2024-09-12T18:12:03.168160+0000","last_peered":"2024-09-12T18:12:03.168160+0000","last_clean":"2024-09-12T18:12:03.168160+0000","last_became_active":"2024-09-12T17:00:22.588111+0000","last_became_peered":"2024-09-12T17:00:22.588111+0000","last_unstale":"2024-09-12T18:12:03.168160+0000","last_undegraded":"2024-09-12T18:12:03.168160+0000","last_fullsized":"2024-09-12T18:12:03.168160+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:50.047140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":621,"num_read_kb":619,"num_write":443,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'162","reported_seq":797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.843103+0000","last_change":"2024-09-12T17:00:14.332706+0000","last_active":"2024-09-12T18:10:21.843103+0000","last_peered":"2024-09-12T18:10:21.843103+0000","last_clean":"2024-09-12T18:10:21.843103+0000","last_became_active":"2024-09-12T17:00:14.332424+0000","last_became_peered":"2024-09-12T17:00:14.332424+0000","last_unstale":"2024-09-12T18:10:21.843103+0000","last_undegraded":"2024-09-12T18:10:21.843103+0000","last_fullsized":"2024-09-12T18:10:21.843103+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:36.277637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":720,"num_read_kb":605,"num_write":258,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'291","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.740789+0000","last_change":"2024-09-12T17:00:12.310686+0000","last_active":"2024-09-12T18:10:12.740789+0000","last_peered":"2024-09-12T18:10:12.740789+0000","last_clean":"2024-09-12T18:10:12.740789+0000","last_became_active":"2024-09-12T17:00:12.310337+0000","last_became_peered":"2024-09-12T17:00:12.310337+0000","last_unstale":"2024-09-12T18:10:12.740789+0000","last_undegraded":"2024-09-12T18:10:12.740789+0000","last_fullsized":"2024-09-12T18:10:12.740789+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:54.402983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5640791,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":490,"num_read_kb":13227,"num_write":1060,"num_write_kb":37058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954568+0000","last_change":"2024-09-12T17:00:16.325390+0000","last_active":"2024-09-12T18:10:22.954568+0000","last_peered":"2024-09-12T18:10:22.954568+0000","last_clean":"2024-09-12T18:10:22.954568+0000","last_became_active":"2024-09-12T17:00:16.325141+0000","last_became_peered":"2024-09-12T17:00:16.325141+0000","last_unstale":"2024-09-12T18:10:22.954568+0000","last_undegraded":"2024-09-12T18:10:22.954568+0000","last_fullsized":"2024-09-12T18:10:22.954568+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:43.724058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'304","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:47.778635+0000","last_change":"2024-09-12T17:00:18.430347+0000","last_active":"2024-09-12T18:12:47.778635+0000","last_peered":"2024-09-12T18:12:47.778635+0000","last_clean":"2024-09-12T18:12:47.778635+0000","last_became_active":"2024-09-12T17:00:18.430046+0000","last_became_peered":"2024-09-12T17:00:18.430046+0000","last_unstale":"2024-09-12T18:12:47.778635+0000","last_undegraded":"2024-09-12T18:12:47.778635+0000","last_fullsized":"2024-09-12T18:12:47.778635+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:57.355912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62169,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":1042,"num_write":394,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'768","reported_seq":2857,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.310309+0000","last_change":"2024-09-12T17:00:20.354448+0000","last_active":"2024-09-12T18:13:23.310309+0000","last_peered":"2024-09-12T18:13:23.310309+0000","last_clean":"2024-09-12T18:13:23.310309+0000","last_became_active":"2024-09-12T17:00:20.353914+0000","last_became_peered":"2024-09-12T17:00:20.353914+0000","last_unstale":"2024-09-12T18:13:23.310309+0000","last_undegraded":"2024-09-12T18:13:23.310309+0000","last_fullsized":"2024-09-12T18:13:23.310309+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:46.082984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'89","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:37.947552+0000","last_change":"2024-09-12T17:00:14.325929+0000","last_active":"2024-09-12T18:09:37.947552+0000","last_peered":"2024-09-12T18:09:37.947552+0000","last_clean":"2024-09-12T18:09:37.947552+0000","last_became_active":"2024-09-12T17:00:14.325669+0000","last_became_peered":"2024-09-12T17:00:14.325669+0000","last_unstale":"2024-09-12T18:09:37.947552+0000","last_undegraded":"2024-09-12T18:09:37.947552+0000","last_fullsized":"2024-09-12T18:09:37.947552+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:13.770284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":392,"num_read_kb":330,"num_write":131,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'290","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.754262+0000","last_change":"2024-09-12T17:00:12.315298+0000","last_active":"2024-09-12T18:10:12.754262+0000","last_peered":"2024-09-12T18:10:12.754262+0000","last_clean":"2024-09-12T18:10:12.754262+0000","last_became_active":"2024-09-12T17:00:12.315015+0000","last_became_peered":"2024-09-12T17:00:12.315015+0000","last_unstale":"2024-09-12T18:10:12.754262+0000","last_undegraded":"2024-09-12T18:10:12.754262+0000","last_fullsized":"2024-09-12T18:10:12.754262+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:05.029334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7831419,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":401,"num_read_kb":13972,"num_write":1058,"num_write_kb":21819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:37.748595+0000","last_change":"2024-09-12T17:00:16.323002+0000","last_active":"2024-09-12T18:09:37.748595+0000","last_peered":"2024-09-12T18:09:37.748595+0000","last_clean":"2024-09-12T18:09:37.748595+0000","last_became_active":"2024-09-12T17:00:16.322693+0000","last_became_peered":"2024-09-12T17:00:16.322693+0000","last_unstale":"2024-09-12T18:09:37.748595+0000","last_undegraded":"2024-09-12T18:09:37.748595+0000","last_fullsized":"2024-09-12T18:09:37.748595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:02.469282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'390","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.970788+0000","last_change":"2024-09-12T17:00:18.429427+0000","last_active":"2024-09-12T18:12:02.970788+0000","last_peered":"2024-09-12T18:12:02.970788+0000","last_clean":"2024-09-12T18:12:02.970788+0000","last_became_active":"2024-09-12T17:00:18.429137+0000","last_became_peered":"2024-09-12T17:00:18.429137+0000","last_unstale":"2024-09-12T18:12:02.970788+0000","last_undegraded":"2024-09-12T18:12:02.970788+0000","last_fullsized":"2024-09-12T18:12:02.970788+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:07.774572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60365,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":643,"num_read_kb":1198,"num_write":502,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:08.915747+0000","last_change":"2024-09-12T17:00:20.348773+0000","last_active":"2024-09-12T18:10:08.915747+0000","last_peered":"2024-09-12T18:10:08.915747+0000","last_clean":"2024-09-12T18:10:08.915747+0000","last_became_active":"2024-09-12T17:00:20.348507+0000","last_became_peered":"2024-09-12T17:00:20.348507+0000","last_unstale":"2024-09-12T18:10:08.915747+0000","last_undegraded":"2024-09-12T18:10:08.915747+0000","last_fullsized":"2024-09-12T18:10:08.915747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:15:32.541811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'560","reported_seq":1385,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.026506+0000","last_change":"2024-09-12T17:00:22.358717+0000","last_active":"2024-09-12T18:13:23.026506+0000","last_peered":"2024-09-12T18:13:23.026506+0000","last_clean":"2024-09-12T18:13:23.026506+0000","last_became_active":"2024-09-12T17:00:22.358335+0000","last_became_peered":"2024-09-12T17:00:22.358335+0000","last_unstale":"2024-09-12T18:13:23.026506+0000","last_undegraded":"2024-09-12T18:13:23.026506+0000","last_fullsized":"2024-09-12T18:13:23.026506+0000","mapping_epoch":34,"log_start":"264'500","ondisk_log_start":"264'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:28.398620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1357,"num_read_kb":1346,"num_write":1162,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'63","reported_seq":629,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:02.633138+0000","last_change":"2024-09-12T17:00:14.336132+0000","last_active":"2024-09-12T18:10:02.633138+0000","last_peered":"2024-09-12T18:10:02.633138+0000","last_clean":"2024-09-12T18:10:02.633138+0000","last_became_active":"2024-09-12T17:00:14.335783+0000","last_became_peered":"2024-09-12T17:00:14.335783+0000","last_unstale":"2024-09-12T18:10:02.633138+0000","last_undegraded":"2024-09-12T18:10:02.633138+0000","last_fullsized":"2024-09-12T18:10:02.633138+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:05.231999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":238,"num_write":99,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'353","reported_seq":1084,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.099603+0000","last_change":"2024-09-12T17:00:12.307583+0000","last_active":"2024-09-12T18:11:11.099603+0000","last_peered":"2024-09-12T18:11:11.099603+0000","last_clean":"2024-09-12T18:11:11.099603+0000","last_became_active":"2024-09-12T17:00:12.307222+0000","last_became_peered":"2024-09-12T17:00:12.307222+0000","last_unstale":"2024-09-12T18:11:11.099603+0000","last_undegraded":"2024-09-12T18:11:11.099603+0000","last_fullsized":"2024-09-12T18:11:11.099603+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:19.672373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10140548,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":799,"num_read_kb":14510,"num_write":1323,"num_write_kb":34813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:38.694721+0000","last_change":"2024-09-12T17:00:16.323257+0000","last_active":"2024-09-12T18:09:38.694721+0000","last_peered":"2024-09-12T18:09:38.694721+0000","last_clean":"2024-09-12T18:09:38.694721+0000","last_became_active":"2024-09-12T17:00:16.322917+0000","last_became_peered":"2024-09-12T17:00:16.322917+0000","last_unstale":"2024-09-12T18:09:38.694721+0000","last_undegraded":"2024-09-12T18:09:38.694721+0000","last_fullsized":"2024-09-12T18:09:38.694721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:45.972956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'263","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.857790+0000","last_change":"2024-09-12T17:00:18.327458+0000","last_active":"2024-09-12T18:12:21.857790+0000","last_peered":"2024-09-12T18:12:21.857790+0000","last_clean":"2024-09-12T18:12:21.857790+0000","last_became_active":"2024-09-12T17:00:18.326791+0000","last_became_peered":"2024-09-12T17:00:18.326791+0000","last_unstale":"2024-09-12T18:12:21.857790+0000","last_undegraded":"2024-09-12T18:12:21.857790+0000","last_fullsized":"2024-09-12T18:12:21.857790+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:25.837684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44513,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":415,"num_read_kb":856,"num_write":332,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:51.839530+0000","last_change":"2024-09-12T17:00:20.354443+0000","last_active":"2024-09-12T18:09:51.839530+0000","last_peered":"2024-09-12T18:09:51.839530+0000","last_clean":"2024-09-12T18:09:51.839530+0000","last_became_active":"2024-09-12T17:00:20.353959+0000","last_became_peered":"2024-09-12T17:00:20.353959+0000","last_unstale":"2024-09-12T18:09:51.839530+0000","last_undegraded":"2024-09-12T18:09:51.839530+0000","last_fullsized":"2024-09-12T18:09:51.839530+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:48.338493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'2407","reported_seq":4230,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:12.155626+0000","last_change":"2024-09-12T17:00:22.356576+0000","last_active":"2024-09-12T18:13:12.155626+0000","last_peered":"2024-09-12T18:13:12.155626+0000","last_clean":"2024-09-12T18:13:12.155626+0000","last_became_active":"2024-09-12T17:00:22.355651+0000","last_became_peered":"2024-09-12T17:00:22.355651+0000","last_unstale":"2024-09-12T18:13:12.155626+0000","last_undegraded":"2024-09-12T18:13:12.155626+0000","last_fullsized":"2024-09-12T18:13:12.155626+0000","mapping_epoch":34,"log_start":"264'2300","ondisk_log_start":"264'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":2300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:33.472074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6022,"num_read_kb":6027,"num_write":4838,"num_write_kb":1790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'196","reported_seq":775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:47.737352+0000","last_change":"2024-09-12T17:00:14.322357+0000","last_active":"2024-09-12T18:09:47.737352+0000","last_peered":"2024-09-12T18:09:47.737352+0000","last_clean":"2024-09-12T18:09:47.737352+0000","last_became_active":"2024-09-12T17:00:14.321270+0000","last_became_peered":"2024-09-12T17:00:14.321270+0000","last_unstale":"2024-09-12T18:09:47.737352+0000","last_undegraded":"2024-09-12T18:09:47.737352+0000","last_fullsized":"2024-09-12T18:09:47.737352+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:12.413462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":834,"num_read_kb":668,"num_write":296,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'253","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:57.751764+0000","last_change":"2024-09-12T17:00:12.313574+0000","last_active":"2024-09-12T18:09:57.751764+0000","last_peered":"2024-09-12T18:09:57.751764+0000","last_clean":"2024-09-12T18:09:57.751764+0000","last_became_active":"2024-09-12T17:00:12.313262+0000","last_became_peered":"2024-09-12T17:00:12.313262+0000","last_unstale":"2024-09-12T18:09:57.751764+0000","last_undegraded":"2024-09-12T18:09:57.751764+0000","last_fullsized":"2024-09-12T18:09:57.751764+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:31.359986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5803248,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":389,"num_read_kb":16364,"num_write":921,"num_write_kb":27335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:03.697059+0000","last_change":"2024-09-12T17:00:16.321983+0000","last_active":"2024-09-12T18:10:03.697059+0000","last_peered":"2024-09-12T18:10:03.697059+0000","last_clean":"2024-09-12T18:10:03.697059+0000","last_became_active":"2024-09-12T17:00:16.321641+0000","last_became_peered":"2024-09-12T17:00:16.321641+0000","last_unstale":"2024-09-12T18:10:03.697059+0000","last_undegraded":"2024-09-12T18:10:03.697059+0000","last_fullsized":"2024-09-12T18:10:03.697059+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:37.927815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'333","reported_seq":933,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.769289+0000","last_change":"2024-09-12T17:00:18.331983+0000","last_active":"2024-09-12T18:11:47.769289+0000","last_peered":"2024-09-12T18:11:47.769289+0000","last_clean":"2024-09-12T18:11:47.769289+0000","last_became_active":"2024-09-12T17:00:18.331707+0000","last_became_peered":"2024-09-12T17:00:18.331707+0000","last_unstale":"2024-09-12T18:11:47.769289+0000","last_undegraded":"2024-09-12T18:11:47.769289+0000","last_fullsized":"2024-09-12T18:11:47.769289+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:34.769849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":539,"num_read_kb":1080,"num_write":430,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'762","reported_seq":2724,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.300062+0000","last_change":"2024-09-12T17:00:20.348555+0000","last_active":"2024-09-12T18:13:23.300062+0000","last_peered":"2024-09-12T18:13:23.300062+0000","last_clean":"2024-09-12T18:13:23.300062+0000","last_became_active":"2024-09-12T17:00:20.348227+0000","last_became_peered":"2024-09-12T17:00:20.348227+0000","last_unstale":"2024-09-12T18:13:23.300062+0000","last_undegraded":"2024-09-12T18:13:23.300062+0000","last_fullsized":"2024-09-12T18:13:23.300062+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:53.853058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'115","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:21.824797+0000","last_change":"2024-09-12T17:00:22.353551+0000","last_active":"2024-09-12T18:13:21.824797+0000","last_peered":"2024-09-12T18:13:21.824797+0000","last_clean":"2024-09-12T18:13:21.824797+0000","last_became_active":"2024-09-12T17:00:22.353172+0000","last_became_peered":"2024-09-12T17:00:22.353172+0000","last_unstale":"2024-09-12T18:13:21.824797+0000","last_undegraded":"2024-09-12T18:13:21.824797+0000","last_fullsized":"2024-09-12T18:13:21.824797+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:21.794645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":136,"num_write":299,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'230","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:01.616940+0000","last_change":"2024-09-12T17:00:14.325124+0000","last_active":"2024-09-12T18:10:01.616940+0000","last_peered":"2024-09-12T18:10:01.616940+0000","last_clean":"2024-09-12T18:10:01.616940+0000","last_became_active":"2024-09-12T17:00:14.324823+0000","last_became_peered":"2024-09-12T17:00:14.324823+0000","last_unstale":"2024-09-12T18:10:01.616940+0000","last_undegraded":"2024-09-12T18:10:01.616940+0000","last_fullsized":"2024-09-12T18:10:01.616940+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:32.044281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1013,"num_read_kb":830,"num_write":393,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'330","reported_seq":1018,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.111454+0000","last_change":"2024-09-12T17:00:12.320393+0000","last_active":"2024-09-12T18:11:11.111454+0000","last_peered":"2024-09-12T18:11:11.111454+0000","last_clean":"2024-09-12T18:11:11.111454+0000","last_became_active":"2024-09-12T17:00:12.318599+0000","last_became_peered":"2024-09-12T17:00:12.318599+0000","last_unstale":"2024-09-12T18:11:11.111454+0000","last_undegraded":"2024-09-12T18:11:11.111454+0000","last_fullsized":"2024-09-12T18:11:11.111454+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:50.621777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15341102,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":618,"num_read_kb":44820,"num_write":1100,"num_write_kb":32428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.695712+0000","last_change":"2024-09-12T17:00:16.328658+0000","last_active":"2024-09-12T18:09:48.695712+0000","last_peered":"2024-09-12T18:09:48.695712+0000","last_clean":"2024-09-12T18:09:48.695712+0000","last_became_active":"2024-09-12T17:00:16.328352+0000","last_became_peered":"2024-09-12T17:00:16.328352+0000","last_unstale":"2024-09-12T18:09:48.695712+0000","last_undegraded":"2024-09-12T18:09:48.695712+0000","last_fullsized":"2024-09-12T18:09:48.695712+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:37.939908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'469","reported_seq":1117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:22.995145+0000","last_change":"2024-09-12T17:00:18.330361+0000","last_active":"2024-09-12T18:13:22.995145+0000","last_peered":"2024-09-12T18:13:22.995145+0000","last_clean":"2024-09-12T18:13:22.995145+0000","last_became_active":"2024-09-12T17:00:18.329414+0000","last_became_peered":"2024-09-12T17:00:18.329414+0000","last_unstale":"2024-09-12T18:13:22.995145+0000","last_undegraded":"2024-09-12T18:13:22.995145+0000","last_fullsized":"2024-09-12T18:13:22.995145+0000","mapping_epoch":30,"log_start":"264'400","ondisk_log_start":"264'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:30.562657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112362,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":817,"num_read_kb":1813,"num_write":672,"num_write_kb":559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:43.695251+0000","last_change":"2024-09-12T17:00:20.352541+0000","last_active":"2024-09-12T18:09:43.695251+0000","last_peered":"2024-09-12T18:09:43.695251+0000","last_clean":"2024-09-12T18:09:43.695251+0000","last_became_active":"2024-09-12T17:00:20.352249+0000","last_became_peered":"2024-09-12T17:00:20.352249+0000","last_unstale":"2024-09-12T18:09:43.695251+0000","last_undegraded":"2024-09-12T18:09:43.695251+0000","last_fullsized":"2024-09-12T18:09:43.695251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:48.788159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'178","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:21.825345+0000","last_change":"2024-09-12T17:00:22.356296+0000","last_active":"2024-09-12T18:13:21.825345+0000","last_peered":"2024-09-12T18:13:21.825345+0000","last_clean":"2024-09-12T18:13:21.825345+0000","last_became_active":"2024-09-12T17:00:22.355850+0000","last_became_peered":"2024-09-12T17:00:22.355850+0000","last_unstale":"2024-09-12T18:13:21.825345+0000","last_undegraded":"2024-09-12T18:13:21.825345+0000","last_fullsized":"2024-09-12T18:13:21.825345+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:23.406645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":278,"num_read_kb":264,"num_write":436,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'144","reported_seq":751,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:00.750221+0000","last_change":"2024-09-12T17:00:14.334908+0000","last_active":"2024-09-12T18:10:00.750221+0000","last_peered":"2024-09-12T18:10:00.750221+0000","last_clean":"2024-09-12T18:10:00.750221+0000","last_became_active":"2024-09-12T17:00:14.334594+0000","last_became_peered":"2024-09-12T17:00:14.334594+0000","last_unstale":"2024-09-12T18:10:00.750221+0000","last_undegraded":"2024-09-12T18:10:00.750221+0000","last_fullsized":"2024-09-12T18:10:00.750221+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:18.668081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":624,"num_read_kb":516,"num_write":207,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'275","reported_seq":910,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:56.840088+0000","last_change":"2024-09-12T17:00:12.314796+0000","last_active":"2024-09-12T18:09:56.840088+0000","last_peered":"2024-09-12T18:09:56.840088+0000","last_clean":"2024-09-12T18:09:56.840088+0000","last_became_active":"2024-09-12T17:00:12.314509+0000","last_became_peered":"2024-09-12T17:00:12.314509+0000","last_unstale":"2024-09-12T18:09:56.840088+0000","last_undegraded":"2024-09-12T18:09:56.840088+0000","last_fullsized":"2024-09-12T18:09:56.840088+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:46.851692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2230784,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":373,"num_read_kb":51555,"num_write":969,"num_write_kb":32245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:03.697102+0000","last_change":"2024-09-12T17:00:16.319604+0000","last_active":"2024-09-12T18:10:03.697102+0000","last_peered":"2024-09-12T18:10:03.697102+0000","last_clean":"2024-09-12T18:10:03.697102+0000","last_became_active":"2024-09-12T17:00:16.319269+0000","last_became_peered":"2024-09-12T17:00:16.319269+0000","last_unstale":"2024-09-12T18:10:03.697102+0000","last_undegraded":"2024-09-12T18:10:03.697102+0000","last_fullsized":"2024-09-12T18:10:03.697102+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:36.474369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'290","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:20.771635+0000","last_change":"2024-09-12T17:00:18.331052+0000","last_active":"2024-09-12T18:12:20.771635+0000","last_peered":"2024-09-12T18:12:20.771635+0000","last_clean":"2024-09-12T18:12:20.771635+0000","last_became_active":"2024-09-12T17:00:18.330634+0000","last_became_peered":"2024-09-12T17:00:18.330634+0000","last_unstale":"2024-09-12T18:12:20.771635+0000","last_undegraded":"2024-09-12T18:12:20.771635+0000","last_fullsized":"2024-09-12T18:12:20.771635+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:16.080984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48618,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":482,"num_read_kb":940,"num_write":426,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.619832+0000","last_change":"2024-09-12T17:00:20.351332+0000","last_active":"2024-09-12T18:10:26.619832+0000","last_peered":"2024-09-12T18:10:26.619832+0000","last_clean":"2024-09-12T18:10:26.619832+0000","last_became_active":"2024-09-12T17:00:20.351001+0000","last_became_peered":"2024-09-12T17:00:20.351001+0000","last_unstale":"2024-09-12T18:10:26.619832+0000","last_undegraded":"2024-09-12T18:10:26.619832+0000","last_fullsized":"2024-09-12T18:10:26.619832+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:04.653097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'120","reported_seq":621,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:31.859249+0000","last_change":"2024-09-12T17:00:22.357302+0000","last_active":"2024-09-12T18:12:31.859249+0000","last_peered":"2024-09-12T18:12:31.859249+0000","last_clean":"2024-09-12T18:12:31.859249+0000","last_became_active":"2024-09-12T17:00:22.357001+0000","last_became_peered":"2024-09-12T17:00:22.357001+0000","last_unstale":"2024-09-12T18:12:31.859249+0000","last_undegraded":"2024-09-12T18:12:31.859249+0000","last_fullsized":"2024-09-12T18:12:31.859249+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:15.408471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":156,"num_write":307,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'263","reported_seq":888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:00.750266+0000","last_change":"2024-09-12T17:00:14.321295+0000","last_active":"2024-09-12T18:10:00.750266+0000","last_peered":"2024-09-12T18:10:00.750266+0000","last_clean":"2024-09-12T18:10:00.750266+0000","last_became_active":"2024-09-12T17:00:14.320928+0000","last_became_peered":"2024-09-12T17:00:14.320928+0000","last_unstale":"2024-09-12T18:10:00.750266+0000","last_undegraded":"2024-09-12T18:10:00.750266+0000","last_fullsized":"2024-09-12T18:10:00.750266+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:10.035416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1139,"num_read_kb":929,"num_write":426,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'288","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:21.087995+0000","last_change":"2024-09-12T17:00:12.309266+0000","last_active":"2024-09-12T18:13:21.087995+0000","last_peered":"2024-09-12T18:13:21.087995+0000","last_clean":"2024-09-12T18:13:21.087995+0000","last_became_active":"2024-09-12T17:00:12.308967+0000","last_became_peered":"2024-09-12T17:00:12.308967+0000","last_unstale":"2024-09-12T18:13:21.087995+0000","last_undegraded":"2024-09-12T18:13:21.087995+0000","last_fullsized":"2024-09-12T18:13:21.087995+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:08.219861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17328515,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":460,"num_read_kb":120658,"num_write":1027,"num_write_kb":55796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:03.915218+0000","last_change":"2024-09-12T17:00:16.329927+0000","last_active":"2024-09-12T18:10:03.915218+0000","last_peered":"2024-09-12T18:10:03.915218+0000","last_clean":"2024-09-12T18:10:03.915218+0000","last_became_active":"2024-09-12T17:00:16.329596+0000","last_became_peered":"2024-09-12T17:00:16.329596+0000","last_unstale":"2024-09-12T18:10:03.915218+0000","last_undegraded":"2024-09-12T18:10:03.915218+0000","last_fullsized":"2024-09-12T18:10:03.915218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:12.864819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'340","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.024314+0000","last_change":"2024-09-12T17:00:18.332460+0000","last_active":"2024-09-12T18:13:23.024314+0000","last_peered":"2024-09-12T18:13:23.024314+0000","last_clean":"2024-09-12T18:13:23.024314+0000","last_became_active":"2024-09-12T17:00:18.331483+0000","last_became_peered":"2024-09-12T17:00:18.331483+0000","last_unstale":"2024-09-12T18:13:23.024314+0000","last_undegraded":"2024-09-12T18:13:23.024314+0000","last_fullsized":"2024-09-12T18:13:23.024314+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:15:12.963116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65937,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":560,"num_read_kb":1138,"num_write":450,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'737","reported_seq":4702,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.188075+0000","last_change":"2024-09-12T17:00:20.352350+0000","last_active":"2024-09-12T18:13:48.188075+0000","last_peered":"2024-09-12T18:13:48.188075+0000","last_clean":"2024-09-12T18:13:48.188075+0000","last_became_active":"2024-09-12T17:00:20.352022+0000","last_became_peered":"2024-09-12T17:00:20.352022+0000","last_unstale":"2024-09-12T18:13:48.188075+0000","last_undegraded":"2024-09-12T18:13:48.188075+0000","last_fullsized":"2024-09-12T18:13:48.188075+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:52.501993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'82","reported_seq":594,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.524395+0000","last_change":"2024-09-12T17:00:22.350570+0000","last_active":"2024-09-12T18:12:00.524395+0000","last_peered":"2024-09-12T18:12:00.524395+0000","last_clean":"2024-09-12T18:12:00.524395+0000","last_became_active":"2024-09-12T17:00:22.350283+0000","last_became_peered":"2024-09-12T17:00:22.350283+0000","last_unstale":"2024-09-12T18:12:00.524395+0000","last_undegraded":"2024-09-12T18:12:00.524395+0000","last_fullsized":"2024-09-12T18:12:00.524395+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:18.622278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":129,"num_read_kb":121,"num_write":196,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'24","reported_seq":569,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:09.884675+0000","last_change":"2024-09-12T17:00:14.326073+0000","last_active":"2024-09-12T18:10:09.884675+0000","last_peered":"2024-09-12T18:10:09.884675+0000","last_clean":"2024-09-12T18:10:09.884675+0000","last_became_active":"2024-09-12T17:00:14.325788+0000","last_became_peered":"2024-09-12T17:00:14.325788+0000","last_unstale":"2024-09-12T18:10:09.884675+0000","last_undegraded":"2024-09-12T18:10:09.884675+0000","last_fullsized":"2024-09-12T18:10:09.884675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:24.940646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":96,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'260","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:35.746667+0000","last_change":"2024-09-12T17:00:12.309670+0000","last_active":"2024-09-12T18:09:35.746667+0000","last_peered":"2024-09-12T18:09:35.746667+0000","last_clean":"2024-09-12T18:09:35.746667+0000","last_became_active":"2024-09-12T17:00:12.309388+0000","last_became_peered":"2024-09-12T17:00:12.309388+0000","last_unstale":"2024-09-12T18:09:35.746667+0000","last_undegraded":"2024-09-12T18:09:35.746667+0000","last_fullsized":"2024-09-12T18:09:35.746667+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:00.188061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6128646,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":479,"num_read_kb":20467,"num_write":1037,"num_write_kb":21258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1468,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:47.955497+0000","last_change":"2024-09-12T17:00:16.330362+0000","last_active":"2024-09-12T18:13:47.955497+0000","last_peered":"2024-09-12T18:13:47.955497+0000","last_clean":"2024-09-12T18:13:47.955497+0000","last_became_active":"2024-09-12T17:00:16.330035+0000","last_became_peered":"2024-09-12T17:00:16.330035+0000","last_unstale":"2024-09-12T18:13:47.955497+0000","last_undegraded":"2024-09-12T18:13:47.955497+0000","last_fullsized":"2024-09-12T18:13:47.955497+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:23.800125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":963,"num_read_kb":963,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'102","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.018578+0000","last_change":"2024-09-12T17:00:18.429647+0000","last_active":"2024-09-12T18:11:11.018578+0000","last_peered":"2024-09-12T18:11:11.018578+0000","last_clean":"2024-09-12T18:11:11.018578+0000","last_became_active":"2024-09-12T17:00:18.429253+0000","last_became_peered":"2024-09-12T17:00:18.429253+0000","last_unstale":"2024-09-12T18:11:11.018578+0000","last_undegraded":"2024-09-12T18:11:11.018578+0000","last_fullsized":"2024-09-12T18:11:11.018578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:37.177018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'781","reported_seq":2530,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.332686+0000","last_change":"2024-09-12T17:00:20.353257+0000","last_active":"2024-09-12T18:13:23.332686+0000","last_peered":"2024-09-12T18:13:23.332686+0000","last_clean":"2024-09-12T18:13:23.332686+0000","last_became_active":"2024-09-12T17:00:20.352792+0000","last_became_peered":"2024-09-12T17:00:20.352792+0000","last_unstale":"2024-09-12T18:13:23.332686+0000","last_undegraded":"2024-09-12T18:13:23.332686+0000","last_fullsized":"2024-09-12T18:13:23.332686+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:31.802808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'111","reported_seq":615,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.521752+0000","last_change":"2024-09-12T17:00:22.352596+0000","last_active":"2024-09-12T18:12:00.521752+0000","last_peered":"2024-09-12T18:12:00.521752+0000","last_clean":"2024-09-12T18:12:00.521752+0000","last_became_active":"2024-09-12T17:00:22.352182+0000","last_became_peered":"2024-09-12T17:00:22.352182+0000","last_unstale":"2024-09-12T18:12:00.521752+0000","last_undegraded":"2024-09-12T18:12:00.521752+0000","last_fullsized":"2024-09-12T18:12:00.521752+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:18.301972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":119,"num_write":244,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'121","reported_seq":766,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:13.916333+0000","last_change":"2024-09-12T17:00:14.329674+0000","last_active":"2024-09-12T18:10:13.916333+0000","last_peered":"2024-09-12T18:10:13.916333+0000","last_clean":"2024-09-12T18:10:13.916333+0000","last_became_active":"2024-09-12T17:00:14.329394+0000","last_became_peered":"2024-09-12T17:00:14.329394+0000","last_unstale":"2024-09-12T18:10:13.916333+0000","last_undegraded":"2024-09-12T18:10:13.916333+0000","last_fullsized":"2024-09-12T18:10:13.916333+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:56.581515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":562,"num_read_kb":483,"num_write":177,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'357","reported_seq":1046,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:38.341797+0000","last_change":"2024-09-12T17:00:12.314422+0000","last_active":"2024-09-12T18:09:38.341797+0000","last_peered":"2024-09-12T18:09:38.341797+0000","last_clean":"2024-09-12T18:09:38.341797+0000","last_became_active":"2024-09-12T17:00:12.314142+0000","last_became_peered":"2024-09-12T17:00:12.314142+0000","last_unstale":"2024-09-12T18:09:38.341797+0000","last_undegraded":"2024-09-12T18:09:38.341797+0000","last_fullsized":"2024-09-12T18:09:38.341797+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:28.691515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8321153,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":749,"num_read_kb":14993,"num_write":1087,"num_write_kb":29270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:00.750294+0000","last_change":"2024-09-12T17:00:16.328779+0000","last_active":"2024-09-12T18:10:00.750294+0000","last_peered":"2024-09-12T18:10:00.750294+0000","last_clean":"2024-09-12T18:10:00.750294+0000","last_became_active":"2024-09-12T17:00:16.328306+0000","last_became_peered":"2024-09-12T17:00:16.328306+0000","last_unstale":"2024-09-12T18:10:00.750294+0000","last_undegraded":"2024-09-12T18:10:00.750294+0000","last_fullsized":"2024-09-12T18:10:00.750294+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:34.580723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'383","reported_seq":1011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:17.973195+0000","last_change":"2024-09-12T17:00:18.328815+0000","last_active":"2024-09-12T18:12:17.973195+0000","last_peered":"2024-09-12T18:12:17.973195+0000","last_clean":"2024-09-12T18:12:17.973195+0000","last_became_active":"2024-09-12T17:00:18.328500+0000","last_became_peered":"2024-09-12T17:00:18.328500+0000","last_unstale":"2024-09-12T18:12:17.973195+0000","last_undegraded":"2024-09-12T18:12:17.973195+0000","last_fullsized":"2024-09-12T18:12:17.973195+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:13.655611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54759,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":607,"num_read_kb":1130,"num_write":474,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:07.740171+0000","last_change":"2024-09-12T17:00:20.350311+0000","last_active":"2024-09-12T18:10:07.740171+0000","last_peered":"2024-09-12T18:10:07.740171+0000","last_clean":"2024-09-12T18:10:07.740171+0000","last_became_active":"2024-09-12T17:00:20.350003+0000","last_became_peered":"2024-09-12T17:00:20.350003+0000","last_unstale":"2024-09-12T18:10:07.740171+0000","last_undegraded":"2024-09-12T18:10:07.740171+0000","last_fullsized":"2024-09-12T18:10:07.740171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:27.609870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'130","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.096280+0000","last_change":"2024-09-12T17:00:22.354899+0000","last_active":"2024-09-12T18:12:03.096280+0000","last_peered":"2024-09-12T18:12:03.096280+0000","last_clean":"2024-09-12T18:12:03.096280+0000","last_became_active":"2024-09-12T17:00:22.354601+0000","last_became_peered":"2024-09-12T17:00:22.354601+0000","last_unstale":"2024-09-12T18:12:03.096280+0000","last_undegraded":"2024-09-12T18:12:03.096280+0000","last_fullsized":"2024-09-12T18:12:03.096280+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:04.146875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":184,"num_read_kb":175,"num_write":297,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'262","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:17.750658+0000","last_change":"2024-09-12T17:00:14.329597+0000","last_active":"2024-09-12T18:11:17.750658+0000","last_peered":"2024-09-12T18:11:17.750658+0000","last_clean":"2024-09-12T18:11:17.750658+0000","last_became_active":"2024-09-12T17:00:14.329297+0000","last_became_peered":"2024-09-12T17:00:14.329297+0000","last_unstale":"2024-09-12T18:11:17.750658+0000","last_undegraded":"2024-09-12T18:11:17.750658+0000","last_fullsized":"2024-09-12T18:11:17.750658+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:20.710892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1103,"num_read_kb":898,"num_write":417,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.754092+0000","last_change":"2024-09-12T16:59:54.636782+0000","last_active":"2024-09-12T18:10:12.754092+0000","last_peered":"2024-09-12T18:10:12.754092+0000","last_clean":"2024-09-12T18:10:12.754092+0000","last_became_active":"2024-09-12T16:59:54.636487+0000","last_became_peered":"2024-09-12T16:59:54.636487+0000","last_unstale":"2024-09-12T18:10:12.754092+0000","last_undegraded":"2024-09-12T18:10:12.754092+0000","last_fullsized":"2024-09-12T18:10:12.754092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:53.619137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:53.619137+0000","last_clean_scrub_stamp":"2024-09-12T16:59:53.619137+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:25.991554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":530,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:52.959116+0000","last_change":"2024-09-12T17:00:02.680922+0000","last_active":"2024-09-12T18:10:52.959116+0000","last_peered":"2024-09-12T18:10:52.959116+0000","last_clean":"2024-09-12T18:10:52.959116+0000","last_became_active":"2024-09-12T17:00:00.669728+0000","last_became_peered":"2024-09-12T17:00:00.669728+0000","last_unstale":"2024-09-12T18:10:52.959116+0000","last_undegraded":"2024-09-12T18:10:52.959116+0000","last_fullsized":"2024-09-12T18:10:52.959116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:04.614720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058116500000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'328","reported_seq":1015,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.570675+0000","last_change":"2024-09-12T17:00:46.405193+0000","last_active":"2024-09-12T18:13:48.570675+0000","last_peered":"2024-09-12T18:13:48.570675+0000","last_clean":"2024-09-12T18:13:48.570675+0000","last_became_active":"2024-09-12T17:00:46.404905+0000","last_became_peered":"2024-09-12T17:00:46.404905+0000","last_unstale":"2024-09-12T18:13:48.570675+0000","last_undegraded":"2024-09-12T18:13:48.570675+0000","last_fullsized":"2024-09-12T18:13:48.570675+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:32.250482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6794004,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":613,"num_read_kb":82700,"num_write":1206,"num_write_kb":21344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.763082+0000","last_change":"2024-09-12T17:00:16.321475+0000","last_active":"2024-09-12T18:11:07.763082+0000","last_peered":"2024-09-12T18:11:07.763082+0000","last_clean":"2024-09-12T18:11:07.763082+0000","last_became_active":"2024-09-12T17:00:16.321151+0000","last_became_peered":"2024-09-12T17:00:16.321151+0000","last_unstale":"2024-09-12T18:11:07.763082+0000","last_undegraded":"2024-09-12T18:11:07.763082+0000","last_fullsized":"2024-09-12T18:11:07.763082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:40.509096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'739","reported_seq":1442,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.012263+0000","last_change":"2024-09-12T17:00:18.330396+0000","last_active":"2024-09-12T18:13:23.012263+0000","last_peered":"2024-09-12T18:13:23.012263+0000","last_clean":"2024-09-12T18:13:23.012263+0000","last_became_active":"2024-09-12T17:00:18.330037+0000","last_became_peered":"2024-09-12T17:00:18.330037+0000","last_unstale":"2024-09-12T18:13:23.012263+0000","last_undegraded":"2024-09-12T18:13:23.012263+0000","last_fullsized":"2024-09-12T18:13:23.012263+0000","mapping_epoch":30,"log_start":"264'700","ondisk_log_start":"264'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:20.891636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187511,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1448,"num_read_kb":3071,"num_write":1416,"num_write_kb":1268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:41.614845+0000","last_change":"2024-09-12T17:00:20.349669+0000","last_active":"2024-09-12T18:09:41.614845+0000","last_peered":"2024-09-12T18:09:41.614845+0000","last_clean":"2024-09-12T18:09:41.614845+0000","last_became_active":"2024-09-12T17:00:20.349363+0000","last_became_peered":"2024-09-12T17:00:20.349363+0000","last_unstale":"2024-09-12T18:09:41.614845+0000","last_undegraded":"2024-09-12T18:09:41.614845+0000","last_fullsized":"2024-09-12T18:09:41.614845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:59.536610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'187","reported_seq":888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.997884+0000","last_change":"2024-09-12T17:00:22.354974+0000","last_active":"2024-09-12T18:12:00.997884+0000","last_peered":"2024-09-12T18:12:00.997884+0000","last_clean":"2024-09-12T18:12:00.997884+0000","last_became_active":"2024-09-12T17:00:22.354654+0000","last_became_peered":"2024-09-12T17:00:22.354654+0000","last_unstale":"2024-09-12T18:12:00.997884+0000","last_undegraded":"2024-09-12T18:12:00.997884+0000","last_fullsized":"2024-09-12T18:12:00.997884+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:31.363438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":450,"num_read_kb":449,"num_write":373,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'132","reported_seq":742,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:59.044067+0000","last_change":"2024-09-12T17:00:14.319895+0000","last_active":"2024-09-12T18:09:59.044067+0000","last_peered":"2024-09-12T18:09:59.044067+0000","last_clean":"2024-09-12T18:09:59.044067+0000","last_became_active":"2024-09-12T17:00:14.319539+0000","last_became_peered":"2024-09-12T17:00:14.319539+0000","last_unstale":"2024-09-12T18:09:59.044067+0000","last_undegraded":"2024-09-12T18:09:59.044067+0000","last_fullsized":"2024-09-12T18:09:59.044067+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:30.605432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":596,"num_read_kb":500,"num_write":197,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.755045+0000","last_change":"2024-09-12T17:00:02.996796+0000","last_active":"2024-09-12T18:10:17.755045+0000","last_peered":"2024-09-12T18:10:17.755045+0000","last_clean":"2024-09-12T18:10:17.755045+0000","last_became_active":"2024-09-12T17:00:00.671211+0000","last_became_peered":"2024-09-12T17:00:00.671211+0000","last_unstale":"2024-09-12T18:10:17.755045+0000","last_undegraded":"2024-09-12T18:10:17.755045+0000","last_fullsized":"2024-09-12T18:10:17.755045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:37.005108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000441562,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'251","reported_seq":935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:01.623620+0000","last_change":"2024-09-12T17:00:12.306702+0000","last_active":"2024-09-12T18:11:01.623620+0000","last_peered":"2024-09-12T18:11:01.623620+0000","last_clean":"2024-09-12T18:11:01.623620+0000","last_became_active":"2024-09-12T17:00:12.306408+0000","last_became_peered":"2024-09-12T17:00:12.306408+0000","last_unstale":"2024-09-12T18:11:01.623620+0000","last_undegraded":"2024-09-12T18:11:01.623620+0000","last_fullsized":"2024-09-12T18:11:01.623620+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:21.843306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1530728,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":446,"num_read_kb":8959,"num_write":905,"num_write_kb":13821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:37.947663+0000","last_change":"2024-09-12T17:00:16.326370+0000","last_active":"2024-09-12T18:09:37.947663+0000","last_peered":"2024-09-12T18:09:37.947663+0000","last_clean":"2024-09-12T18:09:37.947663+0000","last_became_active":"2024-09-12T17:00:16.325914+0000","last_became_peered":"2024-09-12T17:00:16.325914+0000","last_unstale":"2024-09-12T18:09:37.947663+0000","last_undegraded":"2024-09-12T18:09:37.947663+0000","last_fullsized":"2024-09-12T18:09:37.947663+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:00.425804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1353","reported_seq":3187,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.847360+0000","last_change":"2024-09-12T17:00:18.331031+0000","last_active":"2024-09-12T18:13:48.847360+0000","last_peered":"2024-09-12T18:13:48.847360+0000","last_clean":"2024-09-12T18:13:48.847360+0000","last_became_active":"2024-09-12T17:00:18.330715+0000","last_became_peered":"2024-09-12T17:00:18.330715+0000","last_unstale":"2024-09-12T18:13:48.847360+0000","last_undegraded":"2024-09-12T18:13:48.847360+0000","last_fullsized":"2024-09-12T18:13:48.847360+0000","mapping_epoch":30,"log_start":"264'1300","ondisk_log_start":"264'1300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":1300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:19.772064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165470,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2166,"num_read_kb":4126,"num_write":1264,"num_write_kb":1076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:27.766397+0000","last_change":"2024-09-12T17:00:20.352790+0000","last_active":"2024-09-12T18:11:27.766397+0000","last_peered":"2024-09-12T18:11:27.766397+0000","last_clean":"2024-09-12T18:11:27.766397+0000","last_became_active":"2024-09-12T17:00:20.352287+0000","last_became_peered":"2024-09-12T17:00:20.352287+0000","last_unstale":"2024-09-12T18:11:27.766397+0000","last_undegraded":"2024-09-12T18:11:27.766397+0000","last_fullsized":"2024-09-12T18:11:27.766397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:15.288688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'96","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.928594+0000","last_change":"2024-09-12T17:00:22.587542+0000","last_active":"2024-09-12T18:12:08.928594+0000","last_peered":"2024-09-12T18:12:08.928594+0000","last_clean":"2024-09-12T18:12:08.928594+0000","last_became_active":"2024-09-12T17:00:22.587206+0000","last_became_peered":"2024-09-12T17:00:22.587206+0000","last_unstale":"2024-09-12T18:12:08.928594+0000","last_undegraded":"2024-09-12T18:12:08.928594+0000","last_fullsized":"2024-09-12T18:12:08.928594+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:21.704751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":151,"num_write":236,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'4068","reported_seq":4652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:33.912025+0000","last_change":"2024-09-12T17:00:14.331924+0000","last_active":"2024-09-12T18:09:33.912025+0000","last_peered":"2024-09-12T18:09:33.912025+0000","last_clean":"2024-09-12T18:09:33.912025+0000","last_became_active":"2024-09-12T17:00:14.331560+0000","last_became_peered":"2024-09-12T17:00:14.331560+0000","last_unstale":"2024-09-12T18:09:33.912025+0000","last_undegraded":"2024-09-12T18:09:33.912025+0000","last_fullsized":"2024-09-12T18:09:33.912025+0000","mapping_epoch":26,"log_start":"264'4000","ondisk_log_start":"264'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":3000,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:08.452289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16331,"num_read_kb":13702,"num_write":6093,"num_write_kb":3038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":529,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:53.701863+0000","last_change":"2024-09-12T17:00:02.677610+0000","last_active":"2024-09-12T18:10:53.701863+0000","last_peered":"2024-09-12T18:10:53.701863+0000","last_clean":"2024-09-12T18:10:53.701863+0000","last_became_active":"2024-09-12T17:00:01.173083+0000","last_became_peered":"2024-09-12T17:00:01.173083+0000","last_unstale":"2024-09-12T18:10:53.701863+0000","last_undegraded":"2024-09-12T18:10:53.701863+0000","last_fullsized":"2024-09-12T18:10:53.701863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:35.997474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056135799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'292","reported_seq":949,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.909053+0000","last_change":"2024-09-12T17:00:12.309409+0000","last_active":"2024-09-12T18:13:48.909053+0000","last_peered":"2024-09-12T18:13:48.909053+0000","last_clean":"2024-09-12T18:13:48.909053+0000","last_became_active":"2024-09-12T17:00:12.309100+0000","last_became_peered":"2024-09-12T17:00:12.309100+0000","last_unstale":"2024-09-12T18:13:48.909053+0000","last_undegraded":"2024-09-12T18:13:48.909053+0000","last_fullsized":"2024-09-12T18:13:48.909053+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:25.648067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850464,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":454,"num_read_kb":31712,"num_write":1024,"num_write_kb":22323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:38.694803+0000","last_change":"2024-09-12T17:00:16.325113+0000","last_active":"2024-09-12T18:09:38.694803+0000","last_peered":"2024-09-12T18:09:38.694803+0000","last_clean":"2024-09-12T18:09:38.694803+0000","last_became_active":"2024-09-12T17:00:16.324792+0000","last_became_peered":"2024-09-12T17:00:16.324792+0000","last_unstale":"2024-09-12T18:09:38.694803+0000","last_undegraded":"2024-09-12T18:09:38.694803+0000","last_fullsized":"2024-09-12T18:09:38.694803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:38.734680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'290","reported_seq":1723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.201178+0000","last_change":"2024-09-12T17:00:18.430289+0000","last_active":"2024-09-12T18:13:23.201178+0000","last_peered":"2024-09-12T18:13:23.201178+0000","last_clean":"2024-09-12T18:13:23.201178+0000","last_became_active":"2024-09-12T17:00:18.429997+0000","last_became_peered":"2024-09-12T17:00:18.429997+0000","last_unstale":"2024-09-12T18:13:23.201178+0000","last_undegraded":"2024-09-12T18:13:23.201178+0000","last_fullsized":"2024-09-12T18:13:23.201178+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:55.412482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":262,"num_read_kb":252,"num_write":239,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.624787+0000","last_change":"2024-09-12T17:00:20.353031+0000","last_active":"2024-09-12T18:11:11.624787+0000","last_peered":"2024-09-12T18:11:11.624787+0000","last_clean":"2024-09-12T18:11:11.624787+0000","last_became_active":"2024-09-12T17:00:20.350197+0000","last_became_peered":"2024-09-12T17:00:20.350197+0000","last_unstale":"2024-09-12T18:11:11.624787+0000","last_undegraded":"2024-09-12T18:11:11.624787+0000","last_fullsized":"2024-09-12T18:11:11.624787+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:17.466054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'275","reported_seq":881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.253630+0000","last_change":"2024-09-12T17:00:22.357898+0000","last_active":"2024-09-12T18:12:03.253630+0000","last_peered":"2024-09-12T18:12:03.253630+0000","last_clean":"2024-09-12T18:12:03.253630+0000","last_became_active":"2024-09-12T17:00:22.357583+0000","last_became_peered":"2024-09-12T17:00:22.357583+0000","last_unstale":"2024-09-12T18:12:03.253630+0000","last_undegraded":"2024-09-12T18:12:03.253630+0000","last_fullsized":"2024-09-12T18:12:03.253630+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:16.279162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":565,"num_read_kb":582,"num_write":607,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'184","reported_seq":770,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:03.921621+0000","last_change":"2024-09-12T17:00:14.325136+0000","last_active":"2024-09-12T18:11:03.921621+0000","last_peered":"2024-09-12T18:11:03.921621+0000","last_clean":"2024-09-12T18:11:03.921621+0000","last_became_active":"2024-09-12T17:00:14.324830+0000","last_became_peered":"2024-09-12T17:00:14.324830+0000","last_unstale":"2024-09-12T18:11:03.921621+0000","last_undegraded":"2024-09-12T18:11:03.921621+0000","last_fullsized":"2024-09-12T18:11:03.921621+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:00.282511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":771,"num_read_kb":626,"num_write":320,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:52.959075+0000","last_change":"2024-09-12T17:00:02.681561+0000","last_active":"2024-09-12T18:10:52.959075+0000","last_peered":"2024-09-12T18:10:52.959075+0000","last_clean":"2024-09-12T18:10:52.959075+0000","last_became_active":"2024-09-12T17:00:00.668696+0000","last_became_peered":"2024-09-12T17:00:00.668696+0000","last_unstale":"2024-09-12T18:10:52.959075+0000","last_undegraded":"2024-09-12T18:10:52.959075+0000","last_fullsized":"2024-09-12T18:10:52.959075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:34.470591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012259720000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'277","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:05.760259+0000","last_change":"2024-09-12T17:00:12.316101+0000","last_active":"2024-09-12T18:11:05.760259+0000","last_peered":"2024-09-12T18:11:05.760259+0000","last_clean":"2024-09-12T18:11:05.760259+0000","last_became_active":"2024-09-12T17:00:12.315813+0000","last_became_peered":"2024-09-12T17:00:12.315813+0000","last_unstale":"2024-09-12T18:11:05.760259+0000","last_undegraded":"2024-09-12T18:11:05.760259+0000","last_fullsized":"2024-09-12T18:11:05.760259+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:20.815493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6901853,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":392,"num_read_kb":35449,"num_write":993,"num_write_kb":30387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:26.626503+0000","last_change":"2024-09-12T17:00:16.325100+0000","last_active":"2024-09-12T18:11:26.626503+0000","last_peered":"2024-09-12T18:11:26.626503+0000","last_clean":"2024-09-12T18:11:26.626503+0000","last_became_active":"2024-09-12T17:00:16.324683+0000","last_became_peered":"2024-09-12T17:00:16.324683+0000","last_unstale":"2024-09-12T18:11:26.626503+0000","last_undegraded":"2024-09-12T18:11:26.626503+0000","last_fullsized":"2024-09-12T18:11:26.626503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:22.409202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'157","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.925935+0000","last_change":"2024-09-12T17:00:18.327666+0000","last_active":"2024-09-12T18:12:01.925935+0000","last_peered":"2024-09-12T18:12:01.925935+0000","last_clean":"2024-09-12T18:12:01.925935+0000","last_became_active":"2024-09-12T17:00:18.327205+0000","last_became_peered":"2024-09-12T17:00:18.327205+0000","last_unstale":"2024-09-12T18:12:01.925935+0000","last_undegraded":"2024-09-12T18:12:01.925935+0000","last_fullsized":"2024-09-12T18:12:01.925935+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:47.691766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":197,"num_read_kb":191,"num_write":142,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:42.736815+0000","last_change":"2024-09-12T17:00:20.356502+0000","last_active":"2024-09-12T18:09:42.736815+0000","last_peered":"2024-09-12T18:09:42.736815+0000","last_clean":"2024-09-12T18:09:42.736815+0000","last_became_active":"2024-09-12T17:00:20.356122+0000","last_became_peered":"2024-09-12T17:00:20.356122+0000","last_unstale":"2024-09-12T18:09:42.736815+0000","last_undegraded":"2024-09-12T18:09:42.736815+0000","last_fullsized":"2024-09-12T18:09:42.736815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:23.096424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'120","reported_seq":673,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:50.327979+0000","last_change":"2024-09-12T17:00:22.359257+0000","last_active":"2024-09-12T18:09:50.327979+0000","last_peered":"2024-09-12T18:09:50.327979+0000","last_clean":"2024-09-12T18:09:50.327979+0000","last_became_active":"2024-09-12T17:00:22.358888+0000","last_became_peered":"2024-09-12T17:00:22.358888+0000","last_unstale":"2024-09-12T18:09:50.327979+0000","last_undegraded":"2024-09-12T18:09:50.327979+0000","last_fullsized":"2024-09-12T18:09:50.327979+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:22.887398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":246,"num_write":283,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'172","reported_seq":804,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:03.921583+0000","last_change":"2024-09-12T17:00:14.331104+0000","last_active":"2024-09-12T18:11:03.921583+0000","last_peered":"2024-09-12T18:11:03.921583+0000","last_clean":"2024-09-12T18:11:03.921583+0000","last_became_active":"2024-09-12T17:00:14.330844+0000","last_became_peered":"2024-09-12T17:00:14.330844+0000","last_unstale":"2024-09-12T18:11:03.921583+0000","last_undegraded":"2024-09-12T18:11:03.921583+0000","last_fullsized":"2024-09-12T18:11:03.921583+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:40.344941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":795,"num_read_kb":654,"num_write":268,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'337","reported_seq":1017,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:17.963142+0000","last_change":"2024-09-12T17:00:12.318919+0000","last_active":"2024-09-12T18:11:17.963142+0000","last_peered":"2024-09-12T18:11:17.963142+0000","last_clean":"2024-09-12T18:11:17.963142+0000","last_became_active":"2024-09-12T17:00:12.318621+0000","last_became_peered":"2024-09-12T17:00:12.318621+0000","last_unstale":"2024-09-12T18:11:17.963142+0000","last_undegraded":"2024-09-12T18:11:17.963142+0000","last_fullsized":"2024-09-12T18:11:17.963142+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:47.056781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9640734,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":531,"num_read_kb":4542,"num_write":1271,"num_write_kb":25874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":534,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:53.920647+0000","last_change":"2024-09-12T17:00:02.683370+0000","last_active":"2024-09-12T18:10:53.920647+0000","last_peered":"2024-09-12T18:10:53.920647+0000","last_clean":"2024-09-12T18:10:53.920647+0000","last_became_active":"2024-09-12T17:00:00.667379+0000","last_became_peered":"2024-09-12T17:00:00.667379+0000","last_unstale":"2024-09-12T18:10:53.920647+0000","last_undegraded":"2024-09-12T18:10:53.920647+0000","last_fullsized":"2024-09-12T18:10:53.920647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:23.577096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056755300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:06.624201+0000","last_change":"2024-09-12T17:00:16.323271+0000","last_active":"2024-09-12T18:11:06.624201+0000","last_peered":"2024-09-12T18:11:06.624201+0000","last_clean":"2024-09-12T18:11:06.624201+0000","last_became_active":"2024-09-12T17:00:16.322854+0000","last_became_peered":"2024-09-12T17:00:16.322854+0000","last_unstale":"2024-09-12T18:11:06.624201+0000","last_undegraded":"2024-09-12T18:11:06.624201+0000","last_fullsized":"2024-09-12T18:11:06.624201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:28.816131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'654","reported_seq":1345,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.004591+0000","last_change":"2024-09-12T17:00:18.333420+0000","last_active":"2024-09-12T18:13:23.004591+0000","last_peered":"2024-09-12T18:13:23.004591+0000","last_clean":"2024-09-12T18:13:23.004591+0000","last_became_active":"2024-09-12T17:00:18.333147+0000","last_became_peered":"2024-09-12T17:00:18.333147+0000","last_unstale":"2024-09-12T18:13:23.004591+0000","last_undegraded":"2024-09-12T18:13:23.004591+0000","last_fullsized":"2024-09-12T18:13:23.004591+0000","mapping_epoch":30,"log_start":"264'600","ondisk_log_start":"264'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":600,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:53.163746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117831,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1744,"num_read_kb":2835,"num_write":2306,"num_write_kb":2105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:10.760988+0000","last_change":"2024-09-12T17:00:20.355077+0000","last_active":"2024-09-12T18:11:10.760988+0000","last_peered":"2024-09-12T18:11:10.760988+0000","last_clean":"2024-09-12T18:11:10.760988+0000","last_became_active":"2024-09-12T17:00:20.354771+0000","last_became_peered":"2024-09-12T17:00:20.354771+0000","last_unstale":"2024-09-12T18:11:10.760988+0000","last_undegraded":"2024-09-12T18:11:10.760988+0000","last_fullsized":"2024-09-12T18:11:10.760988+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:56.739823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'217","reported_seq":740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.100251+0000","last_change":"2024-09-12T17:00:22.588915+0000","last_active":"2024-09-12T18:12:01.100251+0000","last_peered":"2024-09-12T18:12:01.100251+0000","last_clean":"2024-09-12T18:12:01.100251+0000","last_became_active":"2024-09-12T17:00:22.588561+0000","last_became_peered":"2024-09-12T17:00:22.588561+0000","last_unstale":"2024-09-12T18:12:01.100251+0000","last_undegraded":"2024-09-12T18:12:01.100251+0000","last_fullsized":"2024-09-12T18:12:01.100251+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:58.487409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":223,"num_read_kb":213,"num_write":499,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'180","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:06.624221+0000","last_change":"2024-09-12T17:00:14.327539+0000","last_active":"2024-09-12T18:11:06.624221+0000","last_peered":"2024-09-12T18:11:06.624221+0000","last_clean":"2024-09-12T18:11:06.624221+0000","last_became_active":"2024-09-12T17:00:14.327268+0000","last_became_peered":"2024-09-12T17:00:14.327268+0000","last_unstale":"2024-09-12T18:11:06.624221+0000","last_undegraded":"2024-09-12T18:11:06.624221+0000","last_fullsized":"2024-09-12T18:11:06.624221+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:36.093079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":852,"num_read_kb":727,"num_write":266,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'323","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.838166+0000","last_change":"2024-09-12T17:00:12.310211+0000","last_active":"2024-09-12T18:13:48.838166+0000","last_peered":"2024-09-12T18:13:48.838166+0000","last_clean":"2024-09-12T18:13:48.838166+0000","last_became_active":"2024-09-12T17:00:12.309896+0000","last_became_peered":"2024-09-12T17:00:12.309896+0000","last_unstale":"2024-09-12T18:13:48.838166+0000","last_undegraded":"2024-09-12T18:13:48.838166+0000","last_fullsized":"2024-09-12T18:13:48.838166+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:33.087927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5569873,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":573,"num_read_kb":32728,"num_write":1222,"num_write_kb":26986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.763102+0000","last_change":"2024-09-12T17:00:02.996744+0000","last_active":"2024-09-12T18:11:07.763102+0000","last_peered":"2024-09-12T18:11:07.763102+0000","last_clean":"2024-09-12T18:11:07.763102+0000","last_became_active":"2024-09-12T17:00:00.670355+0000","last_became_peered":"2024-09-12T17:00:00.670355+0000","last_unstale":"2024-09-12T18:11:07.763102+0000","last_undegraded":"2024-09-12T18:11:07.763102+0000","last_fullsized":"2024-09-12T18:11:07.763102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:16.719229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042464500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.749307+0000","last_change":"2024-09-12T17:00:16.323451+0000","last_active":"2024-09-12T18:11:07.749307+0000","last_peered":"2024-09-12T18:11:07.749307+0000","last_clean":"2024-09-12T18:11:07.749307+0000","last_became_active":"2024-09-12T17:00:16.323157+0000","last_became_peered":"2024-09-12T17:00:16.323157+0000","last_unstale":"2024-09-12T18:11:07.749307+0000","last_undegraded":"2024-09-12T18:11:07.749307+0000","last_fullsized":"2024-09-12T18:11:07.749307+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:42.424080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'213","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.796757+0000","last_change":"2024-09-12T17:00:18.429323+0000","last_active":"2024-09-12T18:11:11.796757+0000","last_peered":"2024-09-12T18:11:11.796757+0000","last_clean":"2024-09-12T18:11:11.796757+0000","last_became_active":"2024-09-12T17:00:18.428978+0000","last_became_peered":"2024-09-12T17:00:18.428978+0000","last_unstale":"2024-09-12T18:11:11.796757+0000","last_undegraded":"2024-09-12T18:11:11.796757+0000","last_fullsized":"2024-09-12T18:11:11.796757+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:03.066210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":266,"num_read_kb":257,"num_write":182,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'767","reported_seq":2983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.299783+0000","last_change":"2024-09-12T17:00:20.345525+0000","last_active":"2024-09-12T18:13:23.299783+0000","last_peered":"2024-09-12T18:13:23.299783+0000","last_clean":"2024-09-12T18:13:23.299783+0000","last_became_active":"2024-09-12T17:00:20.345236+0000","last_became_peered":"2024-09-12T17:00:20.345236+0000","last_unstale":"2024-09-12T18:13:23.299783+0000","last_undegraded":"2024-09-12T18:13:23.299783+0000","last_fullsized":"2024-09-12T18:13:23.299783+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:26.183021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'111","reported_seq":634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:31.859446+0000","last_change":"2024-09-12T17:00:22.587755+0000","last_active":"2024-09-12T18:12:31.859446+0000","last_peered":"2024-09-12T18:12:31.859446+0000","last_clean":"2024-09-12T18:12:31.859446+0000","last_became_active":"2024-09-12T17:00:22.587443+0000","last_became_peered":"2024-09-12T17:00:22.587443+0000","last_unstale":"2024-09-12T18:12:31.859446+0000","last_undegraded":"2024-09-12T18:12:31.859446+0000","last_fullsized":"2024-09-12T18:12:31.859446+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:05.679814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":705,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":239,"num_read_kb":213,"num_write":277,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'317","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.843564+0000","last_change":"2024-09-12T17:00:14.333428+0000","last_active":"2024-09-12T18:10:26.843564+0000","last_peered":"2024-09-12T18:10:26.843564+0000","last_clean":"2024-09-12T18:10:26.843564+0000","last_became_active":"2024-09-12T17:00:14.333128+0000","last_became_peered":"2024-09-12T17:00:14.333128+0000","last_unstale":"2024-09-12T18:10:26.843564+0000","last_undegraded":"2024-09-12T18:10:26.843564+0000","last_fullsized":"2024-09-12T18:10:26.843564+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:34.464037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1338,"num_read_kb":1083,"num_write":472,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'295","reported_seq":950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.967580+0000","last_change":"2024-09-12T17:00:12.316074+0000","last_active":"2024-09-12T18:10:22.967580+0000","last_peered":"2024-09-12T18:10:22.967580+0000","last_clean":"2024-09-12T18:10:22.967580+0000","last_became_active":"2024-09-12T17:00:12.315812+0000","last_became_peered":"2024-09-12T17:00:12.315812+0000","last_unstale":"2024-09-12T18:10:22.967580+0000","last_undegraded":"2024-09-12T18:10:22.967580+0000","last_fullsized":"2024-09-12T18:10:22.967580+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:36.960724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8925376,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":491,"num_read_kb":23161,"num_write":1061,"num_write_kb":14173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:33.924599+0000","last_change":"2024-09-12T17:00:02.683419+0000","last_active":"2024-09-12T18:11:33.924599+0000","last_peered":"2024-09-12T18:11:33.924599+0000","last_clean":"2024-09-12T18:11:33.924599+0000","last_became_active":"2024-09-12T17:00:00.669898+0000","last_became_peered":"2024-09-12T17:00:00.669898+0000","last_unstale":"2024-09-12T18:11:33.924599+0000","last_undegraded":"2024-09-12T18:11:33.924599+0000","last_fullsized":"2024-09-12T18:11:33.924599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:32.053145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060387199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:05.760206+0000","last_change":"2024-09-12T17:00:16.327641+0000","last_active":"2024-09-12T18:11:05.760206+0000","last_peered":"2024-09-12T18:11:05.760206+0000","last_clean":"2024-09-12T18:11:05.760206+0000","last_became_active":"2024-09-12T17:00:16.327270+0000","last_became_peered":"2024-09-12T17:00:16.327270+0000","last_unstale":"2024-09-12T18:11:05.760206+0000","last_undegraded":"2024-09-12T18:11:05.760206+0000","last_fullsized":"2024-09-12T18:11:05.760206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:48.314834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'129","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.726748+0000","last_change":"2024-09-12T17:00:18.328546+0000","last_active":"2024-09-12T18:11:11.726748+0000","last_peered":"2024-09-12T18:11:11.726748+0000","last_clean":"2024-09-12T18:11:11.726748+0000","last_became_active":"2024-09-12T17:00:18.327994+0000","last_became_peered":"2024-09-12T17:00:18.327994+0000","last_unstale":"2024-09-12T18:11:11.726748+0000","last_undegraded":"2024-09-12T18:11:11.726748+0000","last_fullsized":"2024-09-12T18:11:11.726748+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:08.620648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":161,"num_write":110,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'771","reported_seq":2833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.310287+0000","last_change":"2024-09-12T17:00:20.354844+0000","last_active":"2024-09-12T18:13:23.310287+0000","last_peered":"2024-09-12T18:13:23.310287+0000","last_clean":"2024-09-12T18:13:23.310287+0000","last_became_active":"2024-09-12T17:00:20.354519+0000","last_became_peered":"2024-09-12T17:00:20.354519+0000","last_unstale":"2024-09-12T18:13:23.310287+0000","last_undegraded":"2024-09-12T18:13:23.310287+0000","last_fullsized":"2024-09-12T18:13:23.310287+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:52.962681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'283","reported_seq":819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.915298+0000","last_change":"2024-09-12T17:00:22.356453+0000","last_active":"2024-09-12T18:12:01.915298+0000","last_peered":"2024-09-12T18:12:01.915298+0000","last_clean":"2024-09-12T18:12:01.915298+0000","last_became_active":"2024-09-12T17:00:22.356132+0000","last_became_peered":"2024-09-12T17:00:22.356132+0000","last_unstale":"2024-09-12T18:12:01.915298+0000","last_undegraded":"2024-09-12T18:12:01.915298+0000","last_fullsized":"2024-09-12T18:12:01.915298+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:55.124427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":378,"num_read_kb":377,"num_write":631,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'145","reported_seq":762,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:05.760147+0000","last_change":"2024-09-12T17:00:14.330712+0000","last_active":"2024-09-12T18:11:05.760147+0000","last_peered":"2024-09-12T18:11:05.760147+0000","last_clean":"2024-09-12T18:11:05.760147+0000","last_became_active":"2024-09-12T17:00:14.330433+0000","last_became_peered":"2024-09-12T17:00:14.330433+0000","last_unstale":"2024-09-12T18:11:05.760147+0000","last_undegraded":"2024-09-12T18:11:05.760147+0000","last_fullsized":"2024-09-12T18:11:05.760147+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:23.434335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":651,"num_read_kb":539,"num_write":208,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'310","reported_seq":1077,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:36.642376+0000","last_change":"2024-09-12T17:00:12.308249+0000","last_active":"2024-09-12T18:09:36.642376+0000","last_peered":"2024-09-12T18:09:36.642376+0000","last_clean":"2024-09-12T18:09:36.642376+0000","last_became_active":"2024-09-12T17:00:12.307371+0000","last_became_peered":"2024-09-12T17:00:12.307371+0000","last_unstale":"2024-09-12T18:09:36.642376+0000","last_undegraded":"2024-09-12T18:09:36.642376+0000","last_fullsized":"2024-09-12T18:09:36.642376+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:08.255196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5888395,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":775,"num_read_kb":7035,"num_write":1133,"num_write_kb":32501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:32.752719+0000","last_change":"2024-09-12T17:00:02.674920+0000","last_active":"2024-09-12T18:11:32.752719+0000","last_peered":"2024-09-12T18:11:32.752719+0000","last_clean":"2024-09-12T18:11:32.752719+0000","last_became_active":"2024-09-12T17:00:00.670451+0000","last_became_peered":"2024-09-12T17:00:00.670451+0000","last_unstale":"2024-09-12T18:11:32.752719+0000","last_undegraded":"2024-09-12T18:11:32.752719+0000","last_fullsized":"2024-09-12T18:11:32.752719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:42.274336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046867000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.843580+0000","last_change":"2024-09-12T17:00:16.326975+0000","last_active":"2024-09-12T18:10:26.843580+0000","last_peered":"2024-09-12T18:10:26.843580+0000","last_clean":"2024-09-12T18:10:26.843580+0000","last_became_active":"2024-09-12T17:00:16.326163+0000","last_became_peered":"2024-09-12T17:00:16.326163+0000","last_unstale":"2024-09-12T18:10:26.843580+0000","last_undegraded":"2024-09-12T18:10:26.843580+0000","last_fullsized":"2024-09-12T18:10:26.843580+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:07.452685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'774","reported_seq":1498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.001066+0000","last_change":"2024-09-12T17:00:18.429419+0000","last_active":"2024-09-12T18:13:23.001066+0000","last_peered":"2024-09-12T18:13:23.001066+0000","last_clean":"2024-09-12T18:13:23.001066+0000","last_became_active":"2024-09-12T17:00:18.429131+0000","last_became_peered":"2024-09-12T17:00:18.429131+0000","last_unstale":"2024-09-12T18:13:23.001066+0000","last_undegraded":"2024-09-12T18:13:23.001066+0000","last_fullsized":"2024-09-12T18:13:23.001066+0000","mapping_epoch":30,"log_start":"264'700","ondisk_log_start":"264'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:04:14.159447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194231,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1370,"num_read_kb":3063,"num_write":1130,"num_write_kb":945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.848361+0000","last_change":"2024-09-12T17:00:20.350091+0000","last_active":"2024-09-12T18:11:11.848361+0000","last_peered":"2024-09-12T18:11:11.848361+0000","last_clean":"2024-09-12T18:11:11.848361+0000","last_became_active":"2024-09-12T17:00:20.349800+0000","last_became_peered":"2024-09-12T17:00:20.349800+0000","last_unstale":"2024-09-12T18:11:11.848361+0000","last_undegraded":"2024-09-12T18:11:11.848361+0000","last_fullsized":"2024-09-12T18:11:11.848361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:28:56.661972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'139","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:07.952151+0000","last_change":"2024-09-12T17:00:22.361129+0000","last_active":"2024-09-12T18:10:07.952151+0000","last_peered":"2024-09-12T18:10:07.952151+0000","last_clean":"2024-09-12T18:10:07.952151+0000","last_became_active":"2024-09-12T17:00:22.360730+0000","last_became_peered":"2024-09-12T17:00:22.360730+0000","last_unstale":"2024-09-12T18:10:07.952151+0000","last_undegraded":"2024-09-12T18:10:07.952151+0000","last_fullsized":"2024-09-12T18:10:07.952151+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:53.958932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":172,"num_read_kb":170,"num_write":343,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'181","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.194693+0000","last_change":"2024-09-12T17:00:22.354855+0000","last_active":"2024-09-12T18:12:03.194693+0000","last_peered":"2024-09-12T18:12:03.194693+0000","last_clean":"2024-09-12T18:12:03.194693+0000","last_became_active":"2024-09-12T17:00:22.354464+0000","last_became_peered":"2024-09-12T17:00:22.354464+0000","last_unstale":"2024-09-12T18:12:03.194693+0000","last_undegraded":"2024-09-12T18:12:03.194693+0000","last_fullsized":"2024-09-12T18:12:03.194693+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:18.356184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":465,"num_read_kb":419,"num_write":437,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'369","reported_seq":1045,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:15.752357+0000","last_change":"2024-09-12T17:00:14.330391+0000","last_active":"2024-09-12T18:10:15.752357+0000","last_peered":"2024-09-12T18:10:15.752357+0000","last_clean":"2024-09-12T18:10:15.752357+0000","last_became_active":"2024-09-12T17:00:14.329093+0000","last_became_peered":"2024-09-12T17:00:14.329093+0000","last_unstale":"2024-09-12T18:10:15.752357+0000","last_undegraded":"2024-09-12T18:10:15.752357+0000","last_fullsized":"2024-09-12T18:10:15.752357+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:02.679602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1637,"num_read_kb":1326,"num_write":585,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'292","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:15.272447+0000","last_change":"2024-09-12T17:00:12.307582+0000","last_active":"2024-09-12T18:13:15.272447+0000","last_peered":"2024-09-12T18:13:15.272447+0000","last_clean":"2024-09-12T18:13:15.272447+0000","last_became_active":"2024-09-12T17:00:12.307309+0000","last_became_peered":"2024-09-12T17:00:12.307309+0000","last_unstale":"2024-09-12T18:13:15.272447+0000","last_undegraded":"2024-09-12T18:13:15.272447+0000","last_fullsized":"2024-09-12T18:13:15.272447+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:28.009676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7766719,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":648,"num_read_kb":21828,"num_write":1203,"num_write_kb":15847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:18.916856+0000","last_change":"2024-09-12T17:00:16.325960+0000","last_active":"2024-09-12T18:10:18.916856+0000","last_peered":"2024-09-12T18:10:18.916856+0000","last_clean":"2024-09-12T18:10:18.916856+0000","last_became_active":"2024-09-12T17:00:16.325555+0000","last_became_peered":"2024-09-12T17:00:16.325555+0000","last_unstale":"2024-09-12T18:10:18.916856+0000","last_undegraded":"2024-09-12T18:10:18.916856+0000","last_fullsized":"2024-09-12T18:10:18.916856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:08:46.715410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'294","reported_seq":878,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:41.860734+0000","last_change":"2024-09-12T17:00:18.328249+0000","last_active":"2024-09-12T18:12:41.860734+0000","last_peered":"2024-09-12T18:12:41.860734+0000","last_clean":"2024-09-12T18:12:41.860734+0000","last_became_active":"2024-09-12T17:00:18.327374+0000","last_became_peered":"2024-09-12T17:00:18.327374+0000","last_unstale":"2024-09-12T18:12:41.860734+0000","last_undegraded":"2024-09-12T18:12:41.860734+0000","last_fullsized":"2024-09-12T18:12:41.860734+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:36.522799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56561,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":484,"num_read_kb":1007,"num_write":392,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.842898+0000","last_change":"2024-09-12T17:00:20.353374+0000","last_active":"2024-09-12T18:10:21.842898+0000","last_peered":"2024-09-12T18:10:21.842898+0000","last_clean":"2024-09-12T18:10:21.842898+0000","last_became_active":"2024-09-12T17:00:20.352801+0000","last_became_peered":"2024-09-12T17:00:20.352801+0000","last_unstale":"2024-09-12T18:10:21.842898+0000","last_undegraded":"2024-09-12T18:10:21.842898+0000","last_fullsized":"2024-09-12T18:10:21.842898+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:10.323586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'192","reported_seq":718,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844219+0000","last_change":"2024-09-12T17:00:22.354964+0000","last_active":"2024-09-12T18:10:31.844219+0000","last_peered":"2024-09-12T18:10:31.844219+0000","last_clean":"2024-09-12T18:10:31.844219+0000","last_became_active":"2024-09-12T17:00:22.354651+0000","last_became_peered":"2024-09-12T17:00:22.354651+0000","last_unstale":"2024-09-12T18:10:31.844219+0000","last_undegraded":"2024-09-12T18:10:31.844219+0000","last_fullsized":"2024-09-12T18:10:31.844219+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:50.025969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":300,"num_read_kb":268,"num_write":394,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'230","reported_seq":866,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:13.916251+0000","last_change":"2024-09-12T17:00:14.322018+0000","last_active":"2024-09-12T18:10:13.916251+0000","last_peered":"2024-09-12T18:10:13.916251+0000","last_clean":"2024-09-12T18:10:13.916251+0000","last_became_active":"2024-09-12T17:00:14.320955+0000","last_became_peered":"2024-09-12T17:00:14.320955+0000","last_unstale":"2024-09-12T18:10:13.916251+0000","last_undegraded":"2024-09-12T18:10:13.916251+0000","last_fullsized":"2024-09-12T18:10:13.916251+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:51.522285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1027,"num_read_kb":855,"num_write":338,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'334","reported_seq":977,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.755206+0000","last_change":"2024-09-12T17:00:12.316146+0000","last_active":"2024-09-12T18:10:17.755206+0000","last_peered":"2024-09-12T18:10:17.755206+0000","last_clean":"2024-09-12T18:10:17.755206+0000","last_became_active":"2024-09-12T17:00:12.315834+0000","last_became_peered":"2024-09-12T17:00:12.315834+0000","last_unstale":"2024-09-12T18:10:17.755206+0000","last_undegraded":"2024-09-12T18:10:17.755206+0000","last_fullsized":"2024-09-12T18:10:17.755206+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:21.977408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7879099,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":483,"num_read_kb":44669,"num_write":1191,"num_write_kb":42862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:16.842404+0000","last_change":"2024-09-12T17:00:16.327598+0000","last_active":"2024-09-12T18:10:16.842404+0000","last_peered":"2024-09-12T18:10:16.842404+0000","last_clean":"2024-09-12T18:10:16.842404+0000","last_became_active":"2024-09-12T17:00:16.327292+0000","last_became_peered":"2024-09-12T17:00:16.327292+0000","last_unstale":"2024-09-12T18:10:16.842404+0000","last_undegraded":"2024-09-12T18:10:16.842404+0000","last_fullsized":"2024-09-12T18:10:16.842404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:28.781328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'50","reported_seq":574,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:00.089541+0000","last_change":"2024-09-12T17:00:18.331826+0000","last_active":"2024-09-12T18:11:00.089541+0000","last_peered":"2024-09-12T18:11:00.089541+0000","last_clean":"2024-09-12T18:11:00.089541+0000","last_became_active":"2024-09-12T17:00:18.331495+0000","last_became_peered":"2024-09-12T17:00:18.331495+0000","last_unstale":"2024-09-12T18:11:00.089541+0000","last_undegraded":"2024-09-12T18:11:00.089541+0000","last_fullsized":"2024-09-12T18:11:00.089541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:10.249483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.755874+0000","last_change":"2024-09-12T17:00:20.348626+0000","last_active":"2024-09-12T18:10:22.755874+0000","last_peered":"2024-09-12T18:10:22.755874+0000","last_clean":"2024-09-12T18:10:22.755874+0000","last_became_active":"2024-09-12T17:00:20.348274+0000","last_became_peered":"2024-09-12T17:00:20.348274+0000","last_unstale":"2024-09-12T18:10:22.755874+0000","last_undegraded":"2024-09-12T18:10:22.755874+0000","last_fullsized":"2024-09-12T18:10:22.755874+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:44.279723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'244","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.928095+0000","last_change":"2024-09-12T17:00:22.350497+0000","last_active":"2024-09-12T18:12:01.928095+0000","last_peered":"2024-09-12T18:12:01.928095+0000","last_clean":"2024-09-12T18:12:01.928095+0000","last_became_active":"2024-09-12T17:00:22.350195+0000","last_became_peered":"2024-09-12T17:00:22.350195+0000","last_unstale":"2024-09-12T18:12:01.928095+0000","last_undegraded":"2024-09-12T18:12:01.928095+0000","last_fullsized":"2024-09-12T18:12:01.928095+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:00.704663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":636,"num_read_kb":568,"num_write":560,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'163","reported_seq":757,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:16.842370+0000","last_change":"2024-09-12T17:00:14.334938+0000","last_active":"2024-09-12T18:10:16.842370+0000","last_peered":"2024-09-12T18:10:16.842370+0000","last_clean":"2024-09-12T18:10:16.842370+0000","last_became_active":"2024-09-12T17:00:14.334652+0000","last_became_peered":"2024-09-12T17:00:14.334652+0000","last_unstale":"2024-09-12T18:10:16.842370+0000","last_undegraded":"2024-09-12T18:10:16.842370+0000","last_fullsized":"2024-09-12T18:10:16.842370+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:28.183092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":705,"num_read_kb":585,"num_write":252,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'322","reported_seq":1000,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.953719+0000","last_change":"2024-09-12T17:00:12.312907+0000","last_active":"2024-09-12T18:10:17.953719+0000","last_peered":"2024-09-12T18:10:17.953719+0000","last_clean":"2024-09-12T18:10:17.953719+0000","last_became_active":"2024-09-12T17:00:12.312629+0000","last_became_peered":"2024-09-12T17:00:12.312629+0000","last_unstale":"2024-09-12T18:10:17.953719+0000","last_undegraded":"2024-09-12T18:10:17.953719+0000","last_fullsized":"2024-09-12T18:10:17.953719+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:48.636890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5500381,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":591,"num_read_kb":31722,"num_write":1444,"num_write_kb":32347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.755061+0000","last_change":"2024-09-12T17:00:16.327231+0000","last_active":"2024-09-12T18:10:17.755061+0000","last_peered":"2024-09-12T18:10:17.755061+0000","last_clean":"2024-09-12T18:10:17.755061+0000","last_became_active":"2024-09-12T17:00:16.326905+0000","last_became_peered":"2024-09-12T17:00:16.326905+0000","last_unstale":"2024-09-12T18:10:17.755061+0000","last_undegraded":"2024-09-12T18:10:17.755061+0000","last_fullsized":"2024-09-12T18:10:17.755061+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:18.823688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'341","reported_seq":940,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:41.860773+0000","last_change":"2024-09-12T17:00:18.330035+0000","last_active":"2024-09-12T18:12:41.860773+0000","last_peered":"2024-09-12T18:12:41.860773+0000","last_clean":"2024-09-12T18:12:41.860773+0000","last_became_active":"2024-09-12T17:00:18.329759+0000","last_became_peered":"2024-09-12T17:00:18.329759+0000","last_unstale":"2024-09-12T18:12:41.860773+0000","last_undegraded":"2024-09-12T18:12:41.860773+0000","last_fullsized":"2024-09-12T18:12:41.860773+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:49.034586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59603,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":554,"num_read_kb":1118,"num_write":444,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.742473+0000","last_change":"2024-09-12T17:00:20.355975+0000","last_active":"2024-09-12T18:10:22.742473+0000","last_peered":"2024-09-12T18:10:22.742473+0000","last_clean":"2024-09-12T18:10:22.742473+0000","last_became_active":"2024-09-12T17:00:20.355629+0000","last_became_peered":"2024-09-12T17:00:20.355629+0000","last_unstale":"2024-09-12T18:10:22.742473+0000","last_undegraded":"2024-09-12T18:10:22.742473+0000","last_fullsized":"2024-09-12T18:10:22.742473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:01.719912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'125","reported_seq":653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954454+0000","last_change":"2024-09-12T17:00:22.360360+0000","last_active":"2024-09-12T18:10:22.954454+0000","last_peered":"2024-09-12T18:10:22.954454+0000","last_clean":"2024-09-12T18:10:22.954454+0000","last_became_active":"2024-09-12T17:00:22.360051+0000","last_became_peered":"2024-09-12T17:00:22.360051+0000","last_unstale":"2024-09-12T18:10:22.954454+0000","last_undegraded":"2024-09-12T18:10:22.954454+0000","last_fullsized":"2024-09-12T18:10:22.954454+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:14:23.925876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":246,"num_read_kb":229,"num_write":325,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'696","reported_seq":1442,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:16.842347+0000","last_change":"2024-09-12T17:00:14.338751+0000","last_active":"2024-09-12T18:10:16.842347+0000","last_peered":"2024-09-12T18:10:16.842347+0000","last_clean":"2024-09-12T18:10:16.842347+0000","last_became_active":"2024-09-12T17:00:14.338453+0000","last_became_peered":"2024-09-12T17:00:14.338453+0000","last_unstale":"2024-09-12T18:10:16.842347+0000","last_undegraded":"2024-09-12T18:10:16.842347+0000","last_fullsized":"2024-09-12T18:10:16.842347+0000","mapping_epoch":26,"log_start":"264'600","ondisk_log_start":"264'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:37.142336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3211,"num_read_kb":2592,"num_write":1218,"num_write_kb":764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'297","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:25.715567+0000","last_change":"2024-09-12T17:00:46.407184+0000","last_active":"2024-09-12T18:10:25.715567+0000","last_peered":"2024-09-12T18:10:25.715567+0000","last_clean":"2024-09-12T18:10:25.715567+0000","last_became_active":"2024-09-12T17:00:46.406811+0000","last_became_peered":"2024-09-12T17:00:46.406811+0000","last_unstale":"2024-09-12T18:10:25.715567+0000","last_undegraded":"2024-09-12T18:10:25.715567+0000","last_fullsized":"2024-09-12T18:10:25.715567+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:48.447890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1257210,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":393,"num_read_kb":7185,"num_write":981,"num_write_kb":23441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.741569+0000","last_change":"2024-09-12T17:00:16.328869+0000","last_active":"2024-09-12T18:10:17.741569+0000","last_peered":"2024-09-12T18:10:17.741569+0000","last_clean":"2024-09-12T18:10:17.741569+0000","last_became_active":"2024-09-12T17:00:16.328571+0000","last_became_peered":"2024-09-12T17:00:16.328571+0000","last_unstale":"2024-09-12T18:10:17.741569+0000","last_undegraded":"2024-09-12T18:10:17.741569+0000","last_fullsized":"2024-09-12T18:10:17.741569+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:55.238346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'303","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:37.776945+0000","last_change":"2024-09-12T17:00:18.332118+0000","last_active":"2024-09-12T18:12:37.776945+0000","last_peered":"2024-09-12T18:12:37.776945+0000","last_clean":"2024-09-12T18:12:37.776945+0000","last_became_active":"2024-09-12T17:00:18.331634+0000","last_became_peered":"2024-09-12T17:00:18.331634+0000","last_unstale":"2024-09-12T18:12:37.776945+0000","last_undegraded":"2024-09-12T18:12:37.776945+0000","last_fullsized":"2024-09-12T18:12:37.776945+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:30.095230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63213,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":486,"num_read_kb":1055,"num_write":402,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619176+0000","last_change":"2024-09-12T17:00:20.347184+0000","last_active":"2024-09-12T18:10:21.619176+0000","last_peered":"2024-09-12T18:10:21.619176+0000","last_clean":"2024-09-12T18:10:21.619176+0000","last_became_active":"2024-09-12T17:00:20.346778+0000","last_became_peered":"2024-09-12T17:00:20.346778+0000","last_unstale":"2024-09-12T18:10:21.619176+0000","last_undegraded":"2024-09-12T18:10:21.619176+0000","last_fullsized":"2024-09-12T18:10:21.619176+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:00.409774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'4226","reported_seq":4832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.749351+0000","last_change":"2024-09-12T17:00:14.327640+0000","last_active":"2024-09-12T18:11:07.749351+0000","last_peered":"2024-09-12T18:11:07.749351+0000","last_clean":"2024-09-12T18:11:07.749351+0000","last_became_active":"2024-09-12T17:00:14.327366+0000","last_became_peered":"2024-09-12T17:00:14.327366+0000","last_unstale":"2024-09-12T18:11:07.749351+0000","last_undegraded":"2024-09-12T18:11:07.749351+0000","last_fullsized":"2024-09-12T18:11:07.749351+0000","mapping_epoch":26,"log_start":"264'4200","ondisk_log_start":"264'4200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":3000,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:10.766155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16999,"num_read_kb":14230,"num_write":6368,"num_write_kb":3177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'277","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:16.842327+0000","last_change":"2024-09-12T17:00:12.316740+0000","last_active":"2024-09-12T18:10:16.842327+0000","last_peered":"2024-09-12T18:10:16.842327+0000","last_clean":"2024-09-12T18:10:16.842327+0000","last_became_active":"2024-09-12T17:00:12.316401+0000","last_became_peered":"2024-09-12T17:00:12.316401+0000","last_unstale":"2024-09-12T18:10:16.842327+0000","last_undegraded":"2024-09-12T18:10:16.842327+0000","last_fullsized":"2024-09-12T18:10:16.842327+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:45.699943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12039717,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":390,"num_read_kb":29248,"num_write":1035,"num_write_kb":37912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.620995+0000","last_change":"2024-09-12T17:00:16.318371+0000","last_active":"2024-09-12T18:10:36.620995+0000","last_peered":"2024-09-12T18:10:36.620995+0000","last_clean":"2024-09-12T18:10:36.620995+0000","last_became_active":"2024-09-12T17:00:16.317972+0000","last_became_peered":"2024-09-12T17:00:16.317972+0000","last_unstale":"2024-09-12T18:10:36.620995+0000","last_undegraded":"2024-09-12T18:10:36.620995+0000","last_fullsized":"2024-09-12T18:10:36.620995+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:29.831275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'525","reported_seq":1169,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.555577+0000","last_change":"2024-09-12T17:00:18.327876+0000","last_active":"2024-09-12T18:13:48.555577+0000","last_peered":"2024-09-12T18:13:48.555577+0000","last_clean":"2024-09-12T18:13:48.555577+0000","last_became_active":"2024-09-12T17:00:18.327593+0000","last_became_peered":"2024-09-12T17:00:18.327593+0000","last_unstale":"2024-09-12T18:13:48.555577+0000","last_undegraded":"2024-09-12T18:13:48.555577+0000","last_fullsized":"2024-09-12T18:13:48.555577+0000","mapping_epoch":30,"log_start":"264'500","ondisk_log_start":"264'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:04.110712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117469,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":949,"num_read_kb":2249,"num_write":826,"num_write_kb":734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954467+0000","last_change":"2024-09-12T17:00:20.350747+0000","last_active":"2024-09-12T18:10:22.954467+0000","last_peered":"2024-09-12T18:10:22.954467+0000","last_clean":"2024-09-12T18:10:22.954467+0000","last_became_active":"2024-09-12T17:00:20.350413+0000","last_became_peered":"2024-09-12T17:00:20.350413+0000","last_unstale":"2024-09-12T18:10:22.954467+0000","last_undegraded":"2024-09-12T18:10:22.954467+0000","last_fullsized":"2024-09-12T18:10:22.954467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:40.936332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'144","reported_seq":644,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.842975+0000","last_change":"2024-09-12T17:00:22.589129+0000","last_active":"2024-09-12T18:10:21.842975+0000","last_peered":"2024-09-12T18:10:21.842975+0000","last_clean":"2024-09-12T18:10:21.842975+0000","last_became_active":"2024-09-12T17:00:22.588456+0000","last_became_peered":"2024-09-12T17:00:22.588456+0000","last_unstale":"2024-09-12T18:10:21.842975+0000","last_undegraded":"2024-09-12T18:10:21.842975+0000","last_fullsized":"2024-09-12T18:10:21.842975+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:28.680701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":212,"num_write":324,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'222","reported_seq":887,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.620980+0000","last_change":"2024-09-12T17:00:14.332252+0000","last_active":"2024-09-12T18:10:36.620980+0000","last_peered":"2024-09-12T18:10:36.620980+0000","last_clean":"2024-09-12T18:10:36.620980+0000","last_became_active":"2024-09-12T17:00:14.328921+0000","last_became_peered":"2024-09-12T17:00:14.328921+0000","last_unstale":"2024-09-12T18:10:36.620980+0000","last_undegraded":"2024-09-12T18:10:36.620980+0000","last_fullsized":"2024-09-12T18:10:36.620980+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:14.125302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":992,"num_read_kb":851,"num_write":318,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'318","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.928031+0000","last_change":"2024-09-12T17:00:12.311889+0000","last_active":"2024-09-12T18:13:48.928031+0000","last_peered":"2024-09-12T18:13:48.928031+0000","last_clean":"2024-09-12T18:13:48.928031+0000","last_became_active":"2024-09-12T17:00:12.311606+0000","last_became_peered":"2024-09-12T17:00:12.311606+0000","last_unstale":"2024-09-12T18:13:48.928031+0000","last_undegraded":"2024-09-12T18:13:48.928031+0000","last_fullsized":"2024-09-12T18:13:48.928031+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:22.040208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049198,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":437,"num_read_kb":10884,"num_write":1090,"num_write_kb":34953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.749361+0000","last_change":"2024-09-12T17:00:16.327834+0000","last_active":"2024-09-12T18:11:07.749361+0000","last_peered":"2024-09-12T18:11:07.749361+0000","last_clean":"2024-09-12T18:11:07.749361+0000","last_became_active":"2024-09-12T17:00:16.327527+0000","last_became_peered":"2024-09-12T17:00:16.327527+0000","last_unstale":"2024-09-12T18:11:07.749361+0000","last_undegraded":"2024-09-12T18:11:07.749361+0000","last_fullsized":"2024-09-12T18:11:07.749361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:26.325669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'333","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:47.778601+0000","last_change":"2024-09-12T17:00:18.327394+0000","last_active":"2024-09-12T18:12:47.778601+0000","last_peered":"2024-09-12T18:12:47.778601+0000","last_clean":"2024-09-12T18:12:47.778601+0000","last_became_active":"2024-09-12T17:00:18.326984+0000","last_became_peered":"2024-09-12T17:00:18.326984+0000","last_unstale":"2024-09-12T18:12:47.778601+0000","last_undegraded":"2024-09-12T18:12:47.778601+0000","last_fullsized":"2024-09-12T18:12:47.778601+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:47.996940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57552,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":549,"num_read_kb":1064,"num_write":458,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:23.917579+0000","last_change":"2024-09-12T17:00:20.348230+0000","last_active":"2024-09-12T18:10:23.917579+0000","last_peered":"2024-09-12T18:10:23.917579+0000","last_clean":"2024-09-12T18:10:23.917579+0000","last_became_active":"2024-09-12T17:00:20.347873+0000","last_became_peered":"2024-09-12T17:00:20.347873+0000","last_unstale":"2024-09-12T18:10:23.917579+0000","last_undegraded":"2024-09-12T18:10:23.917579+0000","last_fullsized":"2024-09-12T18:10:23.917579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:20.554953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'167","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.557258+0000","last_change":"2024-09-12T17:00:22.351181+0000","last_active":"2024-09-12T18:11:58.557258+0000","last_peered":"2024-09-12T18:11:58.557258+0000","last_clean":"2024-09-12T18:11:58.557258+0000","last_became_active":"2024-09-12T17:00:22.350856+0000","last_became_peered":"2024-09-12T17:00:22.350856+0000","last_unstale":"2024-09-12T18:11:58.557258+0000","last_undegraded":"2024-09-12T18:11:58.557258+0000","last_fullsized":"2024-09-12T18:11:58.557258+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:47.546741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1852,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":274,"num_read_kb":259,"num_write":495,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'116","reported_seq":702,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:16.842438+0000","last_change":"2024-09-12T17:00:14.337578+0000","last_active":"2024-09-12T18:10:16.842438+0000","last_peered":"2024-09-12T18:10:16.842438+0000","last_clean":"2024-09-12T18:10:16.842438+0000","last_became_active":"2024-09-12T17:00:14.336495+0000","last_became_peered":"2024-09-12T17:00:14.336495+0000","last_unstale":"2024-09-12T18:10:16.842438+0000","last_undegraded":"2024-09-12T18:10:16.842438+0000","last_fullsized":"2024-09-12T18:10:16.842438+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:35.177783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":523,"num_read_kb":437,"num_write":169,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'295","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:14.335860+0000","last_change":"2024-09-12T17:00:12.318854+0000","last_active":"2024-09-12T18:13:14.335860+0000","last_peered":"2024-09-12T18:13:14.335860+0000","last_clean":"2024-09-12T18:13:14.335860+0000","last_became_active":"2024-09-12T17:00:12.318234+0000","last_became_peered":"2024-09-12T17:00:12.318234+0000","last_unstale":"2024-09-12T18:13:14.335860+0000","last_undegraded":"2024-09-12T18:13:14.335860+0000","last_fullsized":"2024-09-12T18:13:14.335860+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:50.822617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12656318,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":393,"num_read_kb":38331,"num_write":1055,"num_write_kb":59769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"36'3","reported_seq":987,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:22.951577+0000","last_change":"2024-09-12T17:00:16.327679+0000","last_active":"2024-09-12T18:13:22.951577+0000","last_peered":"2024-09-12T18:13:22.951577+0000","last_clean":"2024-09-12T18:13:22.951577+0000","last_became_active":"2024-09-12T17:00:16.327396+0000","last_became_peered":"2024-09-12T17:00:16.327396+0000","last_unstale":"2024-09-12T18:13:22.951577+0000","last_undegraded":"2024-09-12T18:13:22.951577+0000","last_fullsized":"2024-09-12T18:13:22.951577+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:03.799735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'289","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:16.865306+0000","last_change":"2024-09-12T17:00:18.429503+0000","last_active":"2024-09-12T18:13:16.865306+0000","last_peered":"2024-09-12T18:13:16.865306+0000","last_clean":"2024-09-12T18:13:16.865306+0000","last_became_active":"2024-09-12T17:00:18.429149+0000","last_became_peered":"2024-09-12T17:00:18.429149+0000","last_unstale":"2024-09-12T18:13:16.865306+0000","last_undegraded":"2024-09-12T18:13:16.865306+0000","last_fullsized":"2024-09-12T18:13:16.865306+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:42.541128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61118,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":1019,"num_write":394,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:38.919197+0000","last_change":"2024-09-12T17:00:20.350078+0000","last_active":"2024-09-12T18:10:38.919197+0000","last_peered":"2024-09-12T18:10:38.919197+0000","last_clean":"2024-09-12T18:10:38.919197+0000","last_became_active":"2024-09-12T17:00:20.349769+0000","last_became_peered":"2024-09-12T17:00:20.349769+0000","last_unstale":"2024-09-12T18:10:38.919197+0000","last_undegraded":"2024-09-12T18:10:38.919197+0000","last_fullsized":"2024-09-12T18:10:38.919197+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:01.586846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'102","reported_seq":597,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.025748+0000","last_change":"2024-09-12T17:00:22.359344+0000","last_active":"2024-09-12T18:13:23.025748+0000","last_peered":"2024-09-12T18:13:23.025748+0000","last_clean":"2024-09-12T18:13:23.025748+0000","last_became_active":"2024-09-12T17:00:22.358484+0000","last_became_peered":"2024-09-12T17:00:22.358484+0000","last_unstale":"2024-09-12T18:13:23.025748+0000","last_undegraded":"2024-09-12T18:13:23.025748+0000","last_fullsized":"2024-09-12T18:13:23.025748+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:18.149297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":123,"num_write":242,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'161","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:13.698084+0000","last_change":"2024-09-12T17:00:14.330553+0000","last_active":"2024-09-12T18:10:13.698084+0000","last_peered":"2024-09-12T18:10:13.698084+0000","last_clean":"2024-09-12T18:10:13.698084+0000","last_became_active":"2024-09-12T17:00:14.330238+0000","last_became_peered":"2024-09-12T17:00:14.330238+0000","last_unstale":"2024-09-12T18:10:13.698084+0000","last_undegraded":"2024-09-12T18:10:13.698084+0000","last_fullsized":"2024-09-12T18:10:13.698084+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:59.558428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":737,"num_read_kb":617,"num_write":248,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'266","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:11.618055+0000","last_change":"2024-09-12T17:00:12.305559+0000","last_active":"2024-09-12T18:10:11.618055+0000","last_peered":"2024-09-12T18:10:11.618055+0000","last_clean":"2024-09-12T18:10:11.618055+0000","last_became_active":"2024-09-12T17:00:12.305259+0000","last_became_peered":"2024-09-12T17:00:12.305259+0000","last_unstale":"2024-09-12T18:10:11.618055+0000","last_undegraded":"2024-09-12T18:10:11.618055+0000","last_fullsized":"2024-09-12T18:10:11.618055+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:27.124942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1413041,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":401,"num_read_kb":5192,"num_write":964,"num_write_kb":36405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:18.916910+0000","last_change":"2024-09-12T17:00:16.327913+0000","last_active":"2024-09-12T18:10:18.916910+0000","last_peered":"2024-09-12T18:10:18.916910+0000","last_clean":"2024-09-12T18:10:18.916910+0000","last_became_active":"2024-09-12T17:00:16.327626+0000","last_became_peered":"2024-09-12T17:00:16.327626+0000","last_unstale":"2024-09-12T18:10:18.916910+0000","last_undegraded":"2024-09-12T18:10:18.916910+0000","last_fullsized":"2024-09-12T18:10:18.916910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:33.847646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'109","reported_seq":655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.784639+0000","last_change":"2024-09-12T17:00:18.429917+0000","last_active":"2024-09-12T18:11:11.784639+0000","last_peered":"2024-09-12T18:11:11.784639+0000","last_clean":"2024-09-12T18:11:11.784639+0000","last_became_active":"2024-09-12T17:00:18.429481+0000","last_became_peered":"2024-09-12T17:00:18.429481+0000","last_unstale":"2024-09-12T18:11:11.784639+0000","last_undegraded":"2024-09-12T18:11:11.784639+0000","last_fullsized":"2024-09-12T18:11:11.784639+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:59.225430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":118,"num_write":86,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'781","reported_seq":4456,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.332692+0000","last_change":"2024-09-12T17:00:20.351383+0000","last_active":"2024-09-12T18:13:23.332692+0000","last_peered":"2024-09-12T18:13:23.332692+0000","last_clean":"2024-09-12T18:13:23.332692+0000","last_became_active":"2024-09-12T17:00:20.350976+0000","last_became_peered":"2024-09-12T17:00:20.350976+0000","last_unstale":"2024-09-12T18:13:23.332692+0000","last_undegraded":"2024-09-12T18:13:23.332692+0000","last_fullsized":"2024-09-12T18:13:23.332692+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:56.750542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'112","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.755851+0000","last_change":"2024-09-12T17:00:22.357875+0000","last_active":"2024-09-12T18:10:22.755851+0000","last_peered":"2024-09-12T18:10:22.755851+0000","last_clean":"2024-09-12T18:10:22.755851+0000","last_became_active":"2024-09-12T17:00:22.357215+0000","last_became_peered":"2024-09-12T17:00:22.357215+0000","last_unstale":"2024-09-12T18:10:22.755851+0000","last_undegraded":"2024-09-12T18:10:22.755851+0000","last_fullsized":"2024-09-12T18:10:22.755851+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:29.171521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":135,"num_write":263,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'292","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.921553+0000","last_change":"2024-09-12T17:00:14.340729+0000","last_active":"2024-09-12T18:12:01.921553+0000","last_peered":"2024-09-12T18:12:01.921553+0000","last_clean":"2024-09-12T18:12:01.921553+0000","last_became_active":"2024-09-12T17:00:14.340459+0000","last_became_peered":"2024-09-12T17:00:14.340459+0000","last_unstale":"2024-09-12T18:12:01.921553+0000","last_undegraded":"2024-09-12T18:12:01.921553+0000","last_fullsized":"2024-09-12T18:12:01.921553+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:27.507845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1297,"num_read_kb":1099,"num_write":462,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'284","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.589509+0000","last_change":"2024-09-12T17:00:46.721548+0000","last_active":"2024-09-12T18:13:48.589509+0000","last_peered":"2024-09-12T18:13:48.589509+0000","last_clean":"2024-09-12T18:13:48.589509+0000","last_became_active":"2024-09-12T17:00:46.721297+0000","last_became_peered":"2024-09-12T17:00:46.721297+0000","last_unstale":"2024-09-12T18:13:48.589509+0000","last_undegraded":"2024-09-12T18:13:48.589509+0000","last_fullsized":"2024-09-12T18:13:48.589509+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:14.131705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10338638,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":473,"num_read_kb":37694,"num_write":998,"num_write_kb":18010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.755136+0000","last_change":"2024-09-12T17:00:16.327719+0000","last_active":"2024-09-12T18:10:17.755136+0000","last_peered":"2024-09-12T18:10:17.755136+0000","last_clean":"2024-09-12T18:10:17.755136+0000","last_became_active":"2024-09-12T17:00:16.327461+0000","last_became_peered":"2024-09-12T17:00:16.327461+0000","last_unstale":"2024-09-12T18:10:17.755136+0000","last_undegraded":"2024-09-12T18:10:17.755136+0000","last_fullsized":"2024-09-12T18:10:17.755136+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:19.144290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'320","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:02.979920+0000","last_change":"2024-09-12T17:00:18.329265+0000","last_active":"2024-09-12T18:13:02.979920+0000","last_peered":"2024-09-12T18:13:02.979920+0000","last_clean":"2024-09-12T18:13:02.979920+0000","last_became_active":"2024-09-12T17:00:18.328990+0000","last_became_peered":"2024-09-12T17:00:18.328990+0000","last_unstale":"2024-09-12T18:13:02.979920+0000","last_undegraded":"2024-09-12T18:13:02.979920+0000","last_fullsized":"2024-09-12T18:13:02.979920+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:43.048916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50183,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":511,"num_read_kb":967,"num_write":402,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.619737+0000","last_change":"2024-09-12T17:00:20.350160+0000","last_active":"2024-09-12T18:10:26.619737+0000","last_peered":"2024-09-12T18:10:26.619737+0000","last_clean":"2024-09-12T18:10:26.619737+0000","last_became_active":"2024-09-12T17:00:20.349643+0000","last_became_peered":"2024-09-12T17:00:20.349643+0000","last_unstale":"2024-09-12T18:10:26.619737+0000","last_undegraded":"2024-09-12T18:10:26.619737+0000","last_fullsized":"2024-09-12T18:10:26.619737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:12.715810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'119","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.422359+0000","last_change":"2024-09-12T17:00:22.355955+0000","last_active":"2024-09-12T18:11:59.422359+0000","last_peered":"2024-09-12T18:11:59.422359+0000","last_clean":"2024-09-12T18:11:59.422359+0000","last_became_active":"2024-09-12T17:00:22.355658+0000","last_became_peered":"2024-09-12T17:00:22.355658+0000","last_unstale":"2024-09-12T18:11:59.422359+0000","last_undegraded":"2024-09-12T18:11:59.422359+0000","last_fullsized":"2024-09-12T18:11:59.422359+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:47.710679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":157,"num_read_kb":152,"num_write":284,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'216","reported_seq":827,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:15.752295+0000","last_change":"2024-09-12T17:00:14.334900+0000","last_active":"2024-09-12T18:10:15.752295+0000","last_peered":"2024-09-12T18:10:15.752295+0000","last_clean":"2024-09-12T18:10:15.752295+0000","last_became_active":"2024-09-12T17:00:14.334620+0000","last_became_peered":"2024-09-12T17:00:14.334620+0000","last_unstale":"2024-09-12T18:10:15.752295+0000","last_undegraded":"2024-09-12T18:10:15.752295+0000","last_fullsized":"2024-09-12T18:10:15.752295+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:57.025216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":978,"num_read_kb":833,"num_write":353,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'322","reported_seq":1001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:13.318345+0000","last_change":"2024-09-12T17:00:12.318288+0000","last_active":"2024-09-12T18:10:13.318345+0000","last_peered":"2024-09-12T18:10:13.318345+0000","last_clean":"2024-09-12T18:10:13.318345+0000","last_became_active":"2024-09-12T17:00:12.317850+0000","last_became_peered":"2024-09-12T17:00:12.317850+0000","last_unstale":"2024-09-12T18:10:13.318345+0000","last_undegraded":"2024-09-12T18:10:13.318345+0000","last_fullsized":"2024-09-12T18:10:13.318345+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:24.624921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12901529,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":538,"num_read_kb":19368,"num_write":1045,"num_write_kb":17051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.953668+0000","last_change":"2024-09-12T17:00:16.329861+0000","last_active":"2024-09-12T18:10:17.953668+0000","last_peered":"2024-09-12T18:10:17.953668+0000","last_clean":"2024-09-12T18:10:17.953668+0000","last_became_active":"2024-09-12T17:00:16.329505+0000","last_became_peered":"2024-09-12T17:00:16.329505+0000","last_unstale":"2024-09-12T18:10:17.953668+0000","last_undegraded":"2024-09-12T18:10:17.953668+0000","last_fullsized":"2024-09-12T18:10:17.953668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:10.041738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'261","reported_seq":849,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:51.636926+0000","last_change":"2024-09-12T17:00:18.330870+0000","last_active":"2024-09-12T18:12:51.636926+0000","last_peered":"2024-09-12T18:12:51.636926+0000","last_clean":"2024-09-12T18:12:51.636926+0000","last_became_active":"2024-09-12T17:00:18.330548+0000","last_became_peered":"2024-09-12T17:00:18.330548+0000","last_unstale":"2024-09-12T18:12:51.636926+0000","last_undegraded":"2024-09-12T18:12:51.636926+0000","last_fullsized":"2024-09-12T18:12:51.636926+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:29.885447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51585,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":432,"num_read_kb":919,"num_write":346,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.744654+0000","last_change":"2024-09-12T17:00:20.347403+0000","last_active":"2024-09-12T18:10:37.744654+0000","last_peered":"2024-09-12T18:10:37.744654+0000","last_clean":"2024-09-12T18:10:37.744654+0000","last_became_active":"2024-09-12T17:00:20.347122+0000","last_became_peered":"2024-09-12T17:00:20.347122+0000","last_unstale":"2024-09-12T18:10:37.744654+0000","last_undegraded":"2024-09-12T18:10:37.744654+0000","last_fullsized":"2024-09-12T18:10:37.744654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:45.526521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'144","reported_seq":681,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.843667+0000","last_change":"2024-09-12T17:00:22.588688+0000","last_active":"2024-09-12T18:10:26.843667+0000","last_peered":"2024-09-12T18:10:26.843667+0000","last_clean":"2024-09-12T18:10:26.843667+0000","last_became_active":"2024-09-12T17:00:22.588367+0000","last_became_peered":"2024-09-12T17:00:22.588367+0000","last_unstale":"2024-09-12T18:10:26.843667+0000","last_undegraded":"2024-09-12T18:10:26.843667+0000","last_fullsized":"2024-09-12T18:10:26.843667+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:33.524563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":299,"num_read_kb":277,"num_write":353,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'86","reported_seq":667,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844124+0000","last_change":"2024-09-12T17:00:14.338550+0000","last_active":"2024-09-12T18:10:31.844124+0000","last_peered":"2024-09-12T18:10:31.844124+0000","last_clean":"2024-09-12T18:10:31.844124+0000","last_became_active":"2024-09-12T17:00:14.338251+0000","last_became_peered":"2024-09-12T17:00:14.338251+0000","last_unstale":"2024-09-12T18:10:31.844124+0000","last_undegraded":"2024-09-12T18:10:31.844124+0000","last_fullsized":"2024-09-12T18:10:31.844124+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:22.563527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":335,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'318","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.843064+0000","last_change":"2024-09-12T17:00:12.319168+0000","last_active":"2024-09-12T18:10:21.843064+0000","last_peered":"2024-09-12T18:10:21.843064+0000","last_clean":"2024-09-12T18:10:21.843064+0000","last_became_active":"2024-09-12T17:00:12.318883+0000","last_became_peered":"2024-09-12T17:00:12.318883+0000","last_unstale":"2024-09-12T18:10:21.843064+0000","last_undegraded":"2024-09-12T18:10:21.843064+0000","last_fullsized":"2024-09-12T18:10:21.843064+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:05.539963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1748566,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":632,"num_read_kb":40775,"num_write":1122,"num_write_kb":14251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"36'5","reported_seq":988,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:22.950870+0000","last_change":"2024-09-12T17:00:16.326343+0000","last_active":"2024-09-12T18:13:22.950870+0000","last_peered":"2024-09-12T18:13:22.950870+0000","last_clean":"2024-09-12T18:13:22.950870+0000","last_became_active":"2024-09-12T17:00:16.326067+0000","last_became_peered":"2024-09-12T17:00:16.326067+0000","last_unstale":"2024-09-12T18:13:22.950870+0000","last_undegraded":"2024-09-12T18:13:22.950870+0000","last_fullsized":"2024-09-12T18:13:22.950870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:58.899112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'265","reported_seq":822,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:51.862183+0000","last_change":"2024-09-12T17:00:18.326987+0000","last_active":"2024-09-12T18:12:51.862183+0000","last_peered":"2024-09-12T18:12:51.862183+0000","last_clean":"2024-09-12T18:12:51.862183+0000","last_became_active":"2024-09-12T17:00:18.326438+0000","last_became_peered":"2024-09-12T17:00:18.326438+0000","last_unstale":"2024-09-12T18:12:51.862183+0000","last_undegraded":"2024-09-12T18:12:51.862183+0000","last_fullsized":"2024-09-12T18:12:51.862183+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:02.146729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59502,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":432,"num_read_kb":968,"num_write":366,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.753168+0000","last_change":"2024-09-12T17:00:20.349597+0000","last_active":"2024-09-12T18:10:20.753168+0000","last_peered":"2024-09-12T18:10:20.753168+0000","last_clean":"2024-09-12T18:10:20.753168+0000","last_became_active":"2024-09-12T17:00:20.349324+0000","last_became_peered":"2024-09-12T17:00:20.349324+0000","last_unstale":"2024-09-12T18:10:20.753168+0000","last_undegraded":"2024-09-12T18:10:20.753168+0000","last_fullsized":"2024-09-12T18:10:20.753168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:28.300340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'171","reported_seq":1639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.329193+0000","last_change":"2024-09-12T17:00:22.354055+0000","last_active":"2024-09-12T18:11:59.329193+0000","last_peered":"2024-09-12T18:11:59.329193+0000","last_clean":"2024-09-12T18:11:59.329193+0000","last_became_active":"2024-09-12T17:00:22.353287+0000","last_became_peered":"2024-09-12T17:00:22.353287+0000","last_unstale":"2024-09-12T18:11:59.329193+0000","last_undegraded":"2024-09-12T18:11:59.329193+0000","last_fullsized":"2024-09-12T18:11:59.329193+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:04.187431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1233,"num_read_kb":1225,"num_write":392,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'366","reported_seq":1049,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.753093+0000","last_change":"2024-09-12T17:00:14.323586+0000","last_active":"2024-09-12T18:10:20.753093+0000","last_peered":"2024-09-12T18:10:20.753093+0000","last_clean":"2024-09-12T18:10:20.753093+0000","last_became_active":"2024-09-12T17:00:14.323113+0000","last_became_peered":"2024-09-12T17:00:14.323113+0000","last_unstale":"2024-09-12T18:10:20.753093+0000","last_undegraded":"2024-09-12T18:10:20.753093+0000","last_fullsized":"2024-09-12T18:10:20.753093+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:22.883267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1619,"num_read_kb":1299,"num_write":554,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'260","reported_seq":923,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:01.623714+0000","last_change":"2024-09-12T17:00:12.312702+0000","last_active":"2024-09-12T18:11:01.623714+0000","last_peered":"2024-09-12T18:11:01.623714+0000","last_clean":"2024-09-12T18:11:01.623714+0000","last_became_active":"2024-09-12T17:00:12.312456+0000","last_became_peered":"2024-09-12T17:00:12.312456+0000","last_unstale":"2024-09-12T18:11:01.623714+0000","last_undegraded":"2024-09-12T18:11:01.623714+0000","last_fullsized":"2024-09-12T18:11:01.623714+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:20.588667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716514,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":442,"num_read_kb":30859,"num_write":938,"num_write_kb":23841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:38.919143+0000","last_change":"2024-09-12T17:00:16.326062+0000","last_active":"2024-09-12T18:10:38.919143+0000","last_peered":"2024-09-12T18:10:38.919143+0000","last_clean":"2024-09-12T18:10:38.919143+0000","last_became_active":"2024-09-12T17:00:16.325535+0000","last_became_peered":"2024-09-12T17:00:16.325535+0000","last_unstale":"2024-09-12T18:10:38.919143+0000","last_undegraded":"2024-09-12T18:10:38.919143+0000","last_fullsized":"2024-09-12T18:10:38.919143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:32.939447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'301","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:50.776088+0000","last_change":"2024-09-12T17:00:18.326450+0000","last_active":"2024-09-12T18:12:50.776088+0000","last_peered":"2024-09-12T18:12:50.776088+0000","last_clean":"2024-09-12T18:12:50.776088+0000","last_became_active":"2024-09-12T17:00:18.326140+0000","last_became_peered":"2024-09-12T17:00:18.326140+0000","last_unstale":"2024-09-12T18:12:50.776088+0000","last_undegraded":"2024-09-12T18:12:50.776088+0000","last_fullsized":"2024-09-12T18:12:50.776088+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:38.985728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56862,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":502,"num_read_kb":1029,"num_write":400,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619169+0000","last_change":"2024-09-12T17:00:20.354653+0000","last_active":"2024-09-12T18:10:21.619169+0000","last_peered":"2024-09-12T18:10:21.619169+0000","last_clean":"2024-09-12T18:10:21.619169+0000","last_became_active":"2024-09-12T17:00:20.353962+0000","last_became_peered":"2024-09-12T17:00:20.353962+0000","last_unstale":"2024-09-12T18:10:21.619169+0000","last_undegraded":"2024-09-12T18:10:21.619169+0000","last_fullsized":"2024-09-12T18:10:21.619169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:46.119505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'120","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:21.908306+0000","last_change":"2024-09-12T17:00:22.353191+0000","last_active":"2024-09-12T18:13:21.908306+0000","last_peered":"2024-09-12T18:13:21.908306+0000","last_clean":"2024-09-12T18:13:21.908306+0000","last_became_active":"2024-09-12T17:00:22.352779+0000","last_became_peered":"2024-09-12T17:00:22.352779+0000","last_unstale":"2024-09-12T18:13:21.908306+0000","last_undegraded":"2024-09-12T18:13:21.908306+0000","last_fullsized":"2024-09-12T18:13:21.908306+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:10.560331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":133,"num_write":289,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'171","reported_seq":772,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:33.912004+0000","last_change":"2024-09-12T17:00:14.315744+0000","last_active":"2024-09-12T18:09:33.912004+0000","last_peered":"2024-09-12T18:09:33.912004+0000","last_clean":"2024-09-12T18:09:33.912004+0000","last_became_active":"2024-09-12T17:00:14.315424+0000","last_became_peered":"2024-09-12T17:00:14.315424+0000","last_unstale":"2024-09-12T18:09:33.912004+0000","last_undegraded":"2024-09-12T18:09:33.912004+0000","last_fullsized":"2024-09-12T18:09:33.912004+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:21.991890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":753,"num_read_kb":612,"num_write":278,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'265","reported_seq":1004,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:02.748584+0000","last_change":"2024-09-12T17:00:12.310622+0000","last_active":"2024-09-12T18:11:02.748584+0000","last_peered":"2024-09-12T18:11:02.748584+0000","last_clean":"2024-09-12T18:11:02.748584+0000","last_became_active":"2024-09-12T17:00:12.310322+0000","last_became_peered":"2024-09-12T17:00:12.310322+0000","last_unstale":"2024-09-12T18:11:02.748584+0000","last_undegraded":"2024-09-12T18:11:02.748584+0000","last_fullsized":"2024-09-12T18:11:02.748584+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:55.608530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9702271,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":504,"num_read_kb":27239,"num_write":985,"num_write_kb":25993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'258","reported_seq":883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:07.952184+0000","last_change":"2024-09-12T17:00:46.407147+0000","last_active":"2024-09-12T18:10:07.952184+0000","last_peered":"2024-09-12T18:10:07.952184+0000","last_clean":"2024-09-12T18:10:07.952184+0000","last_became_active":"2024-09-12T17:00:46.406809+0000","last_became_peered":"2024-09-12T17:00:46.406809+0000","last_unstale":"2024-09-12T18:10:07.952184+0000","last_undegraded":"2024-09-12T18:10:07.952184+0000","last_fullsized":"2024-09-12T18:10:07.952184+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:36.394344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1147,"num_read_kb":935,"num_write":403,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"264'268","reported_seq":974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.581040+0000","last_change":"2024-09-12T17:00:12.312943+0000","last_active":"2024-09-12T18:13:48.581040+0000","last_peered":"2024-09-12T18:13:48.581040+0000","last_clean":"2024-09-12T18:13:48.581040+0000","last_became_active":"2024-09-12T17:00:12.312579+0000","last_became_peered":"2024-09-12T17:00:12.312579+0000","last_unstale":"2024-09-12T18:13:48.581040+0000","last_undegraded":"2024-09-12T18:13:48.581040+0000","last_fullsized":"2024-09-12T18:13:48.581040+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:00.686097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1361008,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":660,"num_read_kb":733,"num_write":902,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'458","reported_seq":1235,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:37.947629+0000","last_change":"2024-09-12T17:00:14.327470+0000","last_active":"2024-09-12T18:09:37.947629+0000","last_peered":"2024-09-12T18:09:37.947629+0000","last_clean":"2024-09-12T18:09:37.947629+0000","last_became_active":"2024-09-12T17:00:14.327158+0000","last_became_peered":"2024-09-12T17:00:14.327158+0000","last_unstale":"2024-09-12T18:09:37.947629+0000","last_undegraded":"2024-09-12T18:09:37.947629+0000","last_fullsized":"2024-09-12T18:09:37.947629+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:08.515532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2228,"num_read_kb":1913,"num_write":817,"num_write_kb":525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'264","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:07.980665+0000","last_change":"2024-09-12T17:00:12.318140+0000","last_active":"2024-09-12T18:13:07.980665+0000","last_peered":"2024-09-12T18:13:07.980665+0000","last_clean":"2024-09-12T18:13:07.980665+0000","last_became_active":"2024-09-12T17:00:12.317893+0000","last_became_peered":"2024-09-12T17:00:12.317893+0000","last_unstale":"2024-09-12T18:13:07.980665+0000","last_undegraded":"2024-09-12T18:13:07.980665+0000","last_fullsized":"2024-09-12T18:13:07.980665+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:32.821778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":562519,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":426,"num_read_kb":13770,"num_write":950,"num_write_kb":25077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'105","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:33.911941+0000","last_change":"2024-09-12T17:00:14.323700+0000","last_active":"2024-09-12T18:09:33.911941+0000","last_peered":"2024-09-12T18:09:33.911941+0000","last_clean":"2024-09-12T18:09:33.911941+0000","last_became_active":"2024-09-12T17:00:14.323394+0000","last_became_peered":"2024-09-12T17:00:14.323394+0000","last_unstale":"2024-09-12T18:09:33.911941+0000","last_undegraded":"2024-09-12T18:09:33.911941+0000","last_fullsized":"2024-09-12T18:09:33.911941+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:59.080164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":480,"num_read_kb":401,"num_write":159,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'381","reported_seq":1139,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:21.625924+0000","last_change":"2024-09-12T17:00:12.315248+0000","last_active":"2024-09-12T18:11:21.625924+0000","last_peered":"2024-09-12T18:11:21.625924+0000","last_clean":"2024-09-12T18:11:21.625924+0000","last_became_active":"2024-09-12T17:00:12.314938+0000","last_became_peered":"2024-09-12T17:00:12.314938+0000","last_unstale":"2024-09-12T18:11:21.625924+0000","last_undegraded":"2024-09-12T18:11:21.625924+0000","last_fullsized":"2024-09-12T18:11:21.625924+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:26.555386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7272567,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":766,"num_read_kb":44492,"num_write":1327,"num_write_kb":38820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'333","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:16.849080+0000","last_change":"2024-09-12T17:00:14.334325+0000","last_active":"2024-09-12T18:11:16.849080+0000","last_peered":"2024-09-12T18:11:16.849080+0000","last_clean":"2024-09-12T18:11:16.849080+0000","last_became_active":"2024-09-12T17:00:14.333821+0000","last_became_peered":"2024-09-12T17:00:14.333821+0000","last_unstale":"2024-09-12T18:11:16.849080+0000","last_undegraded":"2024-09-12T18:11:16.849080+0000","last_fullsized":"2024-09-12T18:11:16.849080+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:38.122605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1469,"num_read_kb":1192,"num_write":564,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'262","reported_seq":915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:12.652661+0000","last_change":"2024-09-12T17:00:12.317044+0000","last_active":"2024-09-12T18:13:12.652661+0000","last_peered":"2024-09-12T18:13:12.652661+0000","last_clean":"2024-09-12T18:13:12.652661+0000","last_became_active":"2024-09-12T17:00:12.316672+0000","last_became_peered":"2024-09-12T17:00:12.316672+0000","last_unstale":"2024-09-12T18:13:12.652661+0000","last_undegraded":"2024-09-12T18:13:12.652661+0000","last_fullsized":"2024-09-12T18:13:12.652661+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:33.188507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13956928,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":420,"num_read_kb":22931,"num_write":895,"num_write_kb":33827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'55","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:05.760226+0000","last_change":"2024-09-12T17:00:14.324630+0000","last_active":"2024-09-12T18:11:05.760226+0000","last_peered":"2024-09-12T18:11:05.760226+0000","last_clean":"2024-09-12T18:11:05.760226+0000","last_became_active":"2024-09-12T17:00:14.324051+0000","last_became_peered":"2024-09-12T17:00:14.324051+0000","last_unstale":"2024-09-12T18:11:05.760226+0000","last_undegraded":"2024-09-12T18:11:05.760226+0000","last_fullsized":"2024-09-12T18:11:05.760226+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:00.419356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":201,"num_write":77,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'310","reported_seq":985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.920774+0000","last_change":"2024-09-12T17:00:12.314909+0000","last_active":"2024-09-12T18:13:48.920774+0000","last_peered":"2024-09-12T18:13:48.920774+0000","last_clean":"2024-09-12T18:13:48.920774+0000","last_became_active":"2024-09-12T17:00:12.314059+0000","last_became_peered":"2024-09-12T17:00:12.314059+0000","last_unstale":"2024-09-12T18:13:48.920774+0000","last_undegraded":"2024-09-12T18:13:48.920774+0000","last_fullsized":"2024-09-12T18:13:48.920774+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:36.683937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9064183,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":475,"num_read_kb":67840,"num_write":999,"num_write_kb":38572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'162","reported_seq":748,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:06.847823+0000","last_change":"2024-09-12T17:00:14.338773+0000","last_active":"2024-09-12T18:11:06.847823+0000","last_peered":"2024-09-12T18:11:06.847823+0000","last_clean":"2024-09-12T18:11:06.847823+0000","last_became_active":"2024-09-12T17:00:14.338503+0000","last_became_peered":"2024-09-12T17:00:14.338503+0000","last_unstale":"2024-09-12T18:11:06.847823+0000","last_undegraded":"2024-09-12T18:11:06.847823+0000","last_fullsized":"2024-09-12T18:11:06.847823+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:37.093331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":567,"num_write":272,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'256","reported_seq":864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:32.735364+0000","last_change":"2024-09-12T17:00:12.312243+0000","last_active":"2024-09-12T18:09:32.735364+0000","last_peered":"2024-09-12T18:09:32.735364+0000","last_clean":"2024-09-12T18:09:32.735364+0000","last_became_active":"2024-09-12T17:00:12.311933+0000","last_became_peered":"2024-09-12T17:00:12.311933+0000","last_unstale":"2024-09-12T18:09:32.735364+0000","last_undegraded":"2024-09-12T18:09:32.735364+0000","last_fullsized":"2024-09-12T18:09:32.735364+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:08:37.097651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7602949,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":354,"num_read_kb":17784,"num_write":928,"num_write_kb":43947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'289","reported_seq":1002,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.749263+0000","last_change":"2024-09-12T17:00:14.319474+0000","last_active":"2024-09-12T18:11:07.749263+0000","last_peered":"2024-09-12T18:11:07.749263+0000","last_clean":"2024-09-12T18:11:07.749263+0000","last_became_active":"2024-09-12T17:00:14.319152+0000","last_became_peered":"2024-09-12T17:00:14.319152+0000","last_unstale":"2024-09-12T18:11:07.749263+0000","last_undegraded":"2024-09-12T18:11:07.749263+0000","last_fullsized":"2024-09-12T18:11:07.749263+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:25.091276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1506,"num_read_kb":1343,"num_write":479,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'371","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:31.837441+0000","last_change":"2024-09-12T17:00:12.321281+0000","last_active":"2024-09-12T18:09:31.837441+0000","last_peered":"2024-09-12T18:09:31.837441+0000","last_clean":"2024-09-12T18:09:31.837441+0000","last_became_active":"2024-09-12T17:00:12.320948+0000","last_became_peered":"2024-09-12T17:00:12.320948+0000","last_unstale":"2024-09-12T18:09:31.837441+0000","last_undegraded":"2024-09-12T18:09:31.837441+0000","last_fullsized":"2024-09-12T18:09:31.837441+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:58.027696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6346303,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":552,"num_read_kb":23095,"num_write":1328,"num_write_kb":45480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'356","reported_seq":1089,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:16.618637+0000","last_change":"2024-09-12T17:00:14.332105+0000","last_active":"2024-09-12T18:10:16.618637+0000","last_peered":"2024-09-12T18:10:16.618637+0000","last_clean":"2024-09-12T18:10:16.618637+0000","last_became_active":"2024-09-12T17:00:14.331839+0000","last_became_peered":"2024-09-12T17:00:14.331839+0000","last_unstale":"2024-09-12T18:10:16.618637+0000","last_undegraded":"2024-09-12T18:10:16.618637+0000","last_fullsized":"2024-09-12T18:10:16.618637+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:36.033074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1691,"num_read_kb":1457,"num_write":527,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'347","reported_seq":989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:47.949200+0000","last_change":"2024-09-12T17:00:12.320366+0000","last_active":"2024-09-12T18:09:47.949200+0000","last_peered":"2024-09-12T18:09:47.949200+0000","last_clean":"2024-09-12T18:09:47.949200+0000","last_became_active":"2024-09-12T17:00:12.320094+0000","last_became_peered":"2024-09-12T17:00:12.320094+0000","last_unstale":"2024-09-12T18:09:47.949200+0000","last_undegraded":"2024-09-12T18:09:47.949200+0000","last_fullsized":"2024-09-12T18:09:47.949200+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:12.089633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12780512,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":563,"num_read_kb":22255,"num_write":1147,"num_write_kb":35121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'76","reported_seq":651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:18.486632+0000","last_change":"2024-09-12T17:00:14.335295+0000","last_active":"2024-09-12T18:10:18.486632+0000","last_peered":"2024-09-12T18:10:18.486632+0000","last_clean":"2024-09-12T18:10:18.486632+0000","last_became_active":"2024-09-12T17:00:14.334965+0000","last_became_peered":"2024-09-12T17:00:14.334965+0000","last_unstale":"2024-09-12T18:10:18.486632+0000","last_undegraded":"2024-09-12T18:10:18.486632+0000","last_fullsized":"2024-09-12T18:10:18.486632+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:26.399490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":336,"num_read_kb":283,"num_write":118,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'277","reported_seq":913,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:56.840050+0000","last_change":"2024-09-12T17:00:12.321716+0000","last_active":"2024-09-12T18:09:56.840050+0000","last_peered":"2024-09-12T18:09:56.840050+0000","last_clean":"2024-09-12T18:09:56.840050+0000","last_became_active":"2024-09-12T17:00:12.321156+0000","last_became_peered":"2024-09-12T17:00:12.321156+0000","last_unstale":"2024-09-12T18:09:56.840050+0000","last_undegraded":"2024-09-12T18:09:56.840050+0000","last_fullsized":"2024-09-12T18:09:56.840050+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:46.457048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6484933,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":458,"num_read_kb":18612,"num_write":978,"num_write_kb":25817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'177","reported_seq":795,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:08.697578+0000","last_change":"2024-09-12T17:00:14.323205+0000","last_active":"2024-09-12T18:10:08.697578+0000","last_peered":"2024-09-12T18:10:08.697578+0000","last_clean":"2024-09-12T18:10:08.697578+0000","last_became_active":"2024-09-12T17:00:14.322880+0000","last_became_peered":"2024-09-12T17:00:14.322880+0000","last_unstale":"2024-09-12T18:10:08.697578+0000","last_undegraded":"2024-09-12T18:10:08.697578+0000","last_fullsized":"2024-09-12T18:10:08.697578+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:18.369079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":741,"num_read_kb":611,"num_write":268,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'322","reported_seq":977,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.959939+0000","last_change":"2024-09-12T17:00:12.315023+0000","last_active":"2024-09-12T18:10:22.959939+0000","last_peered":"2024-09-12T18:10:22.959939+0000","last_clean":"2024-09-12T18:10:22.959939+0000","last_became_active":"2024-09-12T17:00:12.314707+0000","last_became_peered":"2024-09-12T17:00:12.314707+0000","last_unstale":"2024-09-12T18:10:22.959939+0000","last_undegraded":"2024-09-12T18:10:22.959939+0000","last_fullsized":"2024-09-12T18:10:22.959939+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:40.531969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6899968,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":496,"num_read_kb":37010,"num_write":1236,"num_write_kb":41769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'170","reported_seq":824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:00.750238+0000","last_change":"2024-09-12T17:00:14.325013+0000","last_active":"2024-09-12T18:10:00.750238+0000","last_peered":"2024-09-12T18:10:00.750238+0000","last_clean":"2024-09-12T18:10:00.750238+0000","last_became_active":"2024-09-12T17:00:14.324709+0000","last_became_peered":"2024-09-12T17:00:14.324709+0000","last_unstale":"2024-09-12T18:10:00.750238+0000","last_undegraded":"2024-09-12T18:10:00.750238+0000","last_fullsized":"2024-09-12T18:10:00.750238+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:55.903766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":785,"num_read_kb":657,"num_write":242,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'240","reported_seq":878,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:56.616357+0000","last_change":"2024-09-12T17:00:12.308878+0000","last_active":"2024-09-12T18:09:56.616357+0000","last_peered":"2024-09-12T18:09:56.616357+0000","last_clean":"2024-09-12T18:09:56.616357+0000","last_became_active":"2024-09-12T17:00:12.307159+0000","last_became_peered":"2024-09-12T17:00:12.307159+0000","last_unstale":"2024-09-12T18:09:56.616357+0000","last_undegraded":"2024-09-12T18:09:56.616357+0000","last_fullsized":"2024-09-12T18:09:56.616357+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:24.309768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2472218,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":372,"num_read_kb":7357,"num_write":892,"num_write_kb":31388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'4088","reported_seq":4668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:02.752498+0000","last_change":"2024-09-12T17:00:14.328088+0000","last_active":"2024-09-12T18:10:02.752498+0000","last_peered":"2024-09-12T18:10:02.752498+0000","last_clean":"2024-09-12T18:10:02.752498+0000","last_became_active":"2024-09-12T17:00:14.327792+0000","last_became_peered":"2024-09-12T17:00:14.327792+0000","last_unstale":"2024-09-12T18:10:02.752498+0000","last_undegraded":"2024-09-12T18:10:02.752498+0000","last_fullsized":"2024-09-12T18:10:02.752498+0000","mapping_epoch":26,"log_start":"264'4000","ondisk_log_start":"264'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:59.961621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16430,"num_read_kb":13786,"num_write":6128,"num_write_kb":3057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'284","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:57.738819+0000","last_change":"2024-09-12T17:00:12.311570+0000","last_active":"2024-09-12T18:09:57.738819+0000","last_peered":"2024-09-12T18:09:57.738819+0000","last_clean":"2024-09-12T18:09:57.738819+0000","last_became_active":"2024-09-12T17:00:12.311273+0000","last_became_peered":"2024-09-12T17:00:12.311273+0000","last_unstale":"2024-09-12T18:09:57.738819+0000","last_undegraded":"2024-09-12T18:09:57.738819+0000","last_fullsized":"2024-09-12T18:09:57.738819+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:26.620649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11038339,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":433,"num_read_kb":37128,"num_write":1024,"num_write_kb":49312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'265","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:01.616891+0000","last_change":"2024-09-12T17:00:14.318745+0000","last_active":"2024-09-12T18:10:01.616891+0000","last_peered":"2024-09-12T18:10:01.616891+0000","last_clean":"2024-09-12T18:10:01.616891+0000","last_became_active":"2024-09-12T17:00:14.318470+0000","last_became_peered":"2024-09-12T17:00:14.318470+0000","last_unstale":"2024-09-12T18:10:01.616891+0000","last_undegraded":"2024-09-12T18:10:01.616891+0000","last_fullsized":"2024-09-12T18:10:01.616891+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:04.138809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1277,"num_read_kb":1058,"num_write":468,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'287","reported_seq":1002,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.754212+0000","last_change":"2024-09-12T17:00:12.314662+0000","last_active":"2024-09-12T18:10:12.754212+0000","last_peered":"2024-09-12T18:10:12.754212+0000","last_clean":"2024-09-12T18:10:12.754212+0000","last_became_active":"2024-09-12T17:00:12.314371+0000","last_became_peered":"2024-09-12T17:00:12.314371+0000","last_unstale":"2024-09-12T18:10:12.754212+0000","last_undegraded":"2024-09-12T18:10:12.754212+0000","last_fullsized":"2024-09-12T18:10:12.754212+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:12.607432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2707189,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":498,"num_read_kb":6257,"num_write":1042,"num_write_kb":25577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'129","reported_seq":702,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:01.840698+0000","last_change":"2024-09-12T17:00:14.339614+0000","last_active":"2024-09-12T18:10:01.840698+0000","last_peered":"2024-09-12T18:10:01.840698+0000","last_clean":"2024-09-12T18:10:01.840698+0000","last_became_active":"2024-09-12T17:00:14.339316+0000","last_became_peered":"2024-09-12T17:00:14.339316+0000","last_unstale":"2024-09-12T18:10:01.840698+0000","last_undegraded":"2024-09-12T18:10:01.840698+0000","last_fullsized":"2024-09-12T18:10:01.840698+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:43.906333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":538,"num_read_kb":439,"num_write":190,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'280","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.566378+0000","last_change":"2024-09-12T17:00:12.310461+0000","last_active":"2024-09-12T18:13:48.566378+0000","last_peered":"2024-09-12T18:13:48.566378+0000","last_clean":"2024-09-12T18:13:48.566378+0000","last_became_active":"2024-09-12T17:00:12.310157+0000","last_became_peered":"2024-09-12T17:00:12.310157+0000","last_unstale":"2024-09-12T18:13:48.566378+0000","last_undegraded":"2024-09-12T18:13:48.566378+0000","last_fullsized":"2024-09-12T18:13:48.566378+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:09.011822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2813958,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":422,"num_read_kb":8306,"num_write":1057,"num_write_kb":29458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'208","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:52.751018+0000","last_change":"2024-09-12T17:00:46.406709+0000","last_active":"2024-09-12T18:09:52.751018+0000","last_peered":"2024-09-12T18:09:52.751018+0000","last_clean":"2024-09-12T18:09:52.751018+0000","last_became_active":"2024-09-12T17:00:46.406426+0000","last_became_peered":"2024-09-12T17:00:46.406426+0000","last_unstale":"2024-09-12T18:09:52.751018+0000","last_undegraded":"2024-09-12T18:09:52.751018+0000","last_fullsized":"2024-09-12T18:09:52.751018+0000","mapping_epoch":37,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:27.163775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":857,"num_read_kb":696,"num_write":294,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'239","reported_seq":846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.953042+0000","last_change":"2024-09-12T17:00:12.314652+0000","last_active":"2024-09-12T18:10:12.953042+0000","last_peered":"2024-09-12T18:10:12.953042+0000","last_clean":"2024-09-12T18:10:12.953042+0000","last_became_active":"2024-09-12T17:00:12.314251+0000","last_became_peered":"2024-09-12T17:00:12.314251+0000","last_unstale":"2024-09-12T18:10:12.953042+0000","last_undegraded":"2024-09-12T18:10:12.953042+0000","last_fullsized":"2024-09-12T18:10:12.953042+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:21.957765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5395730,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":339,"num_read_kb":8717,"num_write":907,"num_write_kb":22240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'257","reported_seq":1061,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.952879+0000","last_change":"2024-09-12T17:00:12.318997+0000","last_active":"2024-09-12T18:10:12.952879+0000","last_peered":"2024-09-12T18:10:12.952879+0000","last_clean":"2024-09-12T18:10:12.952879+0000","last_became_active":"2024-09-12T17:00:12.318408+0000","last_became_peered":"2024-09-12T17:00:12.318408+0000","last_unstale":"2024-09-12T18:10:12.952879+0000","last_undegraded":"2024-09-12T18:10:12.952879+0000","last_fullsized":"2024-09-12T18:10:12.952879+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:22.821486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5248793,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":798,"num_read_kb":6455,"num_write":984,"num_write_kb":20037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'90","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:41.621619+0000","last_change":"2024-09-12T17:00:14.334754+0000","last_active":"2024-09-12T18:10:41.621619+0000","last_peered":"2024-09-12T18:10:41.621619+0000","last_clean":"2024-09-12T18:10:41.621619+0000","last_became_active":"2024-09-12T17:00:14.334494+0000","last_became_peered":"2024-09-12T17:00:14.334494+0000","last_unstale":"2024-09-12T18:10:41.621619+0000","last_undegraded":"2024-09-12T18:10:41.621619+0000","last_fullsized":"2024-09-12T18:10:41.621619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:56.905718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":377,"num_read_kb":312,"num_write":145,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'313","reported_seq":950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.879094+0000","last_change":"2024-09-12T17:00:12.315356+0000","last_active":"2024-09-12T18:13:48.879094+0000","last_peered":"2024-09-12T18:13:48.879094+0000","last_clean":"2024-09-12T18:13:48.879094+0000","last_became_active":"2024-09-12T17:00:12.314988+0000","last_became_peered":"2024-09-12T17:00:12.314988+0000","last_unstale":"2024-09-12T18:13:48.879094+0000","last_undegraded":"2024-09-12T18:13:48.879094+0000","last_fullsized":"2024-09-12T18:13:48.879094+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:34.349627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352348,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":427,"num_read_kb":45801,"num_write":996,"num_write_kb":31559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'220","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954550+0000","last_change":"2024-09-12T17:00:14.333403+0000","last_active":"2024-09-12T18:10:22.954550+0000","last_peered":"2024-09-12T18:10:22.954550+0000","last_clean":"2024-09-12T18:10:22.954550+0000","last_became_active":"2024-09-12T17:00:14.333107+0000","last_became_peered":"2024-09-12T17:00:14.333107+0000","last_unstale":"2024-09-12T18:10:22.954550+0000","last_undegraded":"2024-09-12T18:10:22.954550+0000","last_fullsized":"2024-09-12T18:10:22.954550+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:26.316619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":970,"num_read_kb":803,"num_write":364,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5638,"num_read_kb":3956,"num_write":1906,"num_write_kb":804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1077,"ondisk_log_size":1077,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":16256,"num_read_kb":15929,"num_write":16738,"num_write_kb":4889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1664,"ondisk_log_size":1664,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":530,"ondisk_log_size":530,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1864610,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":18668,"num_read_kb":36144,"num_write":15719,"num_write_kb":11922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2965504,"data_stored":2482896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2053,"ondisk_log_size":2053,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2425,"num_read_kb":2890,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102836,"num_read_kb":85763,"num_write":37242,"num_write_kb":18813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3654,"ondisk_log_size":3654,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":457793760,"num_objects":4182,"num_object_clones":0,"num_object_copies":8364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4182,"num_whiteouts":0,"num_read":32389,"num_read_kb":1844161,"num_write":67660,"num_write_kb":1970689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":955830272,"data_stored":925329253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4185,"ondisk_log_size":4185,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":52066681,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":133,"num_read_kb":154912,"num_write":159,"num_write_kb":116389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98902016,"data_stored":98890482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":58307678,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":133,"num_read_kb":158387,"num_write":159,"num_write_kb":116389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":117719040,"data_stored":117711178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424510333,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":155752,"kb_used_data":106520,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94216088,"statfs":{"total":96636764160,"available":96477274112,"internally_reserved":0,"allocated":109076480,"data_stored":105026341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510336,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":241088,"kb_used_data":133616,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94130752,"statfs":{"total":96636764160,"available":96389890048,"internally_reserved":0,"allocated":136822784,"data_stored":132283647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543035,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":408228,"kb_used_data":170196,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":93963612,"statfs":{"total":96636764160,"available":96218738688,"internally_reserved":0,"allocated":174280704,"data_stored":168243840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":243726794},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543037,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":353796,"kb_used_data":133812,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94018044,"statfs":{"total":96636764160,"available":96274477056,"internally_reserved":0,"allocated":137023488,"data_stored":132465467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225245638},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543037,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":264308,"kb_used_data":165156,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94107532,"statfs":{"total":96636764160,"available":96366112768,"internally_reserved":0,"allocated":169119744,"data_stored":162881901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543037,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":462228,"kb_used_data":206148,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":93909612,"statfs":{"total":96636764160,"available":96163442688,"internally_reserved":0,"allocated":211095552,"data_stored":204497890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262207943},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543035,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":358224,"kb_used_data":150720,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94013616,"statfs":{"total":96636764160,"available":96269942784,"internally_reserved":0,"allocated":154337280,"data_stored":147909516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":212466117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575738,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":251808,"kb_used_data":194256,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94120032,"statfs":{"total":96636764160,"available":96378912768,"internally_reserved":0,"allocated":198918144,"data_stored":192285280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":120287232,"data_stored":115422877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":52461568,"data_stored":50989354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65630208,"data_stored":63760671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":162619392,"data_stored":157595782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":177336320,"data_stored":172183802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":130138112,"data_stored":125504544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":119406592,"data_stored":116366388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":127950848,"data_stored":123505835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":336341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":127094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":95998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":569344,"data_stored":486137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":77711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":679936,"data_stored":574850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":266159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":518606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":4704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21024768,"data_stored":21021979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12632064,"data_stored":12631334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18415616,"data_stored":18413368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7389184,"data_stored":7388454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":23654400,"data_stored":23653035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17362944,"data_stored":17361579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25858048,"data_stored":25852281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":14733312,"data_stored":14730523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4247552,"data_stored":4245939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:13:52.379 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:13:52.717 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:13:52.718 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":264,"fsid":"f8d042e3-46c6-4732-b8bf-7d74a00649d2","created":"2024-09-12T16:59:40.498539+0000","modified":"2024-09-12T17:39:06.904902+0000","last_up_change":"2024-09-12T16:59:52.614375+0000","last_in_change":"2024-09-12T16:59:42.830687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":15,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T16:59:52.794947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T16:59:58.778829+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T17:00:10.507812+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T17:00:12.630755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T17:00:14.477594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T17:00:16.583175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T17:00:18.333263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T17:00:20.422532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-12T17:16:10.238198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"253","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-12T17:20:28.530449+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"256","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-12T17:20:33.527532+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"259","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-12T17:39:04.343318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"264","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed210eed-1d40-4a45-9952-9a2eee0378d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1841182576},{"type":"v1","addr":"172.21.15.67:6809","nonce":1841182576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1841182576},{"type":"v1","addr":"172.21.15.67:6811","nonce":1841182576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1841182576},{"type":"v1","addr":"172.21.15.67:6815","nonce":1841182576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1841182576},{"type":"v1","addr":"172.21.15.67:6813","nonce":1841182576}]},"public_addr":"172.21.15.67:6809/1841182576","cluster_addr":"172.21.15.67:6811/1841182576","heartbeat_back_addr":"172.21.15.67:6815/1841182576","heartbeat_front_addr":"172.21.15.67:6813/1841182576","state":["exists","up"]},{"osd":1,"uuid":"3d34c926-d130-468a-a2bd-b91f2a9c7b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3249659332},{"type":"v1","addr":"172.21.15.67:6825","nonce":3249659332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3249659332},{"type":"v1","addr":"172.21.15.67:6827","nonce":3249659332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3249659332},{"type":"v1","addr":"172.21.15.67:6831","nonce":3249659332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3249659332},{"type":"v1","addr":"172.21.15.67:6829","nonce":3249659332}]},"public_addr":"172.21.15.67:6825/3249659332","cluster_addr":"172.21.15.67:6827/3249659332","heartbeat_back_addr":"172.21.15.67:6831/3249659332","heartbeat_front_addr":"172.21.15.67:6829/3249659332","state":["exists","up"]},{"osd":2,"uuid":"a15d20cc-c7ce-4a34-a951-7eb21007584b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3672311065},{"type":"v1","addr":"172.21.15.67:6801","nonce":3672311065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3672311065},{"type":"v1","addr":"172.21.15.67:6803","nonce":3672311065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3672311065},{"type":"v1","addr":"172.21.15.67:6807","nonce":3672311065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3672311065},{"type":"v1","addr":"172.21.15.67:6805","nonce":3672311065}]},"public_addr":"172.21.15.67:6801/3672311065","cluster_addr":"172.21.15.67:6803/3672311065","heartbeat_back_addr":"172.21.15.67:6807/3672311065","heartbeat_front_addr":"172.21.15.67:6805/3672311065","state":["exists","up"]},{"osd":3,"uuid":"aa1724ee-690d-412a-9d7a-5c6a65af21ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":2780246260},{"type":"v1","addr":"172.21.15.67:6817","nonce":2780246260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2780246260},{"type":"v1","addr":"172.21.15.67:6819","nonce":2780246260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":2780246260},{"type":"v1","addr":"172.21.15.67:6823","nonce":2780246260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2780246260},{"type":"v1","addr":"172.21.15.67:6821","nonce":2780246260}]},"public_addr":"172.21.15.67:6817/2780246260","cluster_addr":"172.21.15.67:6819/2780246260","heartbeat_back_addr":"172.21.15.67:6823/2780246260","heartbeat_front_addr":"172.21.15.67:6821/2780246260","state":["exists","up"]},{"osd":4,"uuid":"26bb95af-b5c4-49f1-a45d-c1a10c8cad2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2751121967},{"type":"v1","addr":"172.21.15.118:6801","nonce":2751121967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2751121967},{"type":"v1","addr":"172.21.15.118:6803","nonce":2751121967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2751121967},{"type":"v1","addr":"172.21.15.118:6807","nonce":2751121967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2751121967},{"type":"v1","addr":"172.21.15.118:6805","nonce":2751121967}]},"public_addr":"172.21.15.118:6801/2751121967","cluster_addr":"172.21.15.118:6803/2751121967","heartbeat_back_addr":"172.21.15.118:6807/2751121967","heartbeat_front_addr":"172.21.15.118:6805/2751121967","state":["exists","up"]},{"osd":5,"uuid":"d2ec20b3-3ce2-499a-b900-9ca8bd5aab44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1825660705},{"type":"v1","addr":"172.21.15.118:6809","nonce":1825660705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1825660705},{"type":"v1","addr":"172.21.15.118:6811","nonce":1825660705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1825660705},{"type":"v1","addr":"172.21.15.118:6815","nonce":1825660705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1825660705},{"type":"v1","addr":"172.21.15.118:6813","nonce":1825660705}]},"public_addr":"172.21.15.118:6809/1825660705","cluster_addr":"172.21.15.118:6811/1825660705","heartbeat_back_addr":"172.21.15.118:6815/1825660705","heartbeat_front_addr":"172.21.15.118:6813/1825660705","state":["exists","up"]},{"osd":6,"uuid":"a361798f-b5c5-4cfa-9009-10d1175d266a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1070975205},{"type":"v1","addr":"172.21.15.118:6825","nonce":1070975205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1070975205},{"type":"v1","addr":"172.21.15.118:6827","nonce":1070975205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1070975205},{"type":"v1","addr":"172.21.15.118:6831","nonce":1070975205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1070975205},{"type":"v1","addr":"172.21.15.118:6829","nonce":1070975205}]},"public_addr":"172.21.15.118:6825/1070975205","cluster_addr":"172.21.15.118:6827/1070975205","heartbeat_back_addr":"172.21.15.118:6831/1070975205","heartbeat_front_addr":"172.21.15.118:6829/1070975205","state":["exists","up"]},{"osd":7,"uuid":"e88fb194-92ac-49d9-9fc7-f5d91416d32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1969396610},{"type":"v1","addr":"172.21.15.118:6817","nonce":1969396610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1969396610},{"type":"v1","addr":"172.21.15.118:6819","nonce":1969396610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1969396610},{"type":"v1","addr":"172.21.15.118:6823","nonce":1969396610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1969396610},{"type":"v1","addr":"172.21.15.118:6821","nonce":1969396610}]},"public_addr":"172.21.15.118:6817/1969396610","cluster_addr":"172.21.15.118:6819/1969396610","heartbeat_back_addr":"172.21.15.118:6823/1969396610","heartbeat_front_addr":"172.21.15.118:6821/1969396610","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:49.385155+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:49.692172+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:49.637563+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:48.916217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:48.951069+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:49.611038+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:49.273915+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:59:49.675897+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.26","mappings":[{"from":1,"to":5}]},{"pgid":"4.28","mappings":[{"from":3,"to":2}]},{"pgid":"67.9","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:13:53.734 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T18:13:53.734 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:13:53.890 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T18:13:53.890 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:13:53.891 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T18:13:53.901 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T18:13:54.213 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T18:13:54.226 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T18:13:54.227 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:13:54.369 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T18:13:54.370 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:13:54.370 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T18:13:54.380 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T18:13:54.696 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T18:13:54.709 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T18:13:54.709 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:13:54.851 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T18:13:54.851 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:13:54.851 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T18:13:54.863 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T18:13:55.177 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T18:13:55.193 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T18:13:55.194 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:13:55.336 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T18:13:55.337 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:13:55.337 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T18:13:55.347 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T18:13:55.661 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T18:13:55.674 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T18:13:55.675 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:13:55.817 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T18:13:55.817 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:13:55.817 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T18:13:55.828 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T18:13:56.151 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T18:13:56.165 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T18:13:56.165 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:13:56.310 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T18:13:56.310 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:13:56.310 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T18:13:56.321 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T18:13:56.636 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T18:13:56.649 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T18:13:56.649 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:13:56.791 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T18:13:56.791 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:13:56.791 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T18:13:56.803 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T18:13:57.124 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T18:13:57.137 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T18:13:57.137 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:13:57.281 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T18:13:57.281 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:13:57.281 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T18:13:57.292 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T18:13:57.609 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T18:13:57.623 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:13:57.970 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:13:57.983 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-12T18:13:57.985 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":2480,"stamp":"2024-09-12T18:13:56.633042+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":79100730,"num_objects":719,"num_object_clones":0,"num_object_copies":1438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":719,"num_whiteouts":0,"num_read":182830,"num_read_kb":2305911,"num_write":143792,"num_write_kb":2241608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13020,"ondisk_log_size":13020,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1432896,"kb_used_data":181128,"kb_used_omap":12,"kb_used_meta":1250163,"kb_avail":753541824,"statfs":{"total":773094113280,"available":771626827776,"internally_reserved":0,"allocated":185475072,"data_stored":172246076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1280167472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-535628476,"num_objects":-4135,"num_object_clones":0,"num_object_copies":-8270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4135,"num_whiteouts":0,"num_read":4619,"num_read_kb":4138,"num_write":4384,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005223"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:07.943317+0000","last_change":"2024-09-12T17:39:05.922525+0000","last_active":"2024-09-12T18:09:07.943317+0000","last_peered":"2024-09-12T18:09:07.943317+0000","last_clean":"2024-09-12T18:09:07.943317+0000","last_became_active":"2024-09-12T17:39:05.922265+0000","last_became_peered":"2024-09-12T17:39:05.922265+0000","last_unstale":"2024-09-12T18:09:07.943317+0000","last_undegraded":"2024-09-12T18:09:07.943317+0000","last_fullsized":"2024-09-12T18:09:07.943317+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:50.266071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'9","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.516351+0000","last_change":"2024-09-12T17:20:34.559305+0000","last_active":"2024-09-12T18:13:48.516351+0000","last_peered":"2024-09-12T18:13:48.516351+0000","last_clean":"2024-09-12T18:13:48.516351+0000","last_became_active":"2024-09-12T17:20:34.559027+0000","last_became_peered":"2024-09-12T17:20:34.559027+0000","last_unstale":"2024-09-12T18:13:48.516351+0000","last_undegraded":"2024-09-12T18:13:48.516351+0000","last_fullsized":"2024-09-12T18:13:48.516351+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:57.688429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10240,"num_write":14,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"261'5","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844168+0000","last_change":"2024-09-12T17:20:30.533512+0000","last_active":"2024-09-12T18:10:31.844168+0000","last_peered":"2024-09-12T18:10:31.844168+0000","last_clean":"2024-09-12T18:10:31.844168+0000","last_became_active":"2024-09-12T17:20:30.533235+0000","last_became_peered":"2024-09-12T17:20:30.533235+0000","last_unstale":"2024-09-12T18:10:31.844168+0000","last_undegraded":"2024-09-12T18:10:31.844168+0000","last_fullsized":"2024-09-12T18:10:31.844168+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:11.739116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4098,"num_write":10,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'40","reported_seq":175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619269+0000","last_change":"2024-09-12T17:16:11.492013+0000","last_active":"2024-09-12T18:10:21.619269+0000","last_peered":"2024-09-12T18:10:21.619269+0000","last_clean":"2024-09-12T18:10:21.619269+0000","last_became_active":"2024-09-12T17:16:11.491724+0000","last_became_peered":"2024-09-12T17:16:11.491724+0000","last_unstale":"2024-09-12T18:10:21.619269+0000","last_undegraded":"2024-09-12T18:10:21.619269+0000","last_fullsized":"2024-09-12T18:10:21.619269+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:52.666913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":153,"num_write":69,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:08.691783+0000","last_change":"2024-09-12T17:39:05.929786+0000","last_active":"2024-09-12T18:09:08.691783+0000","last_peered":"2024-09-12T18:09:08.691783+0000","last_clean":"2024-09-12T18:09:08.691783+0000","last_became_active":"2024-09-12T17:39:05.929533+0000","last_became_peered":"2024-09-12T17:39:05.929533+0000","last_unstale":"2024-09-12T18:09:08.691783+0000","last_undegraded":"2024-09-12T18:09:08.691783+0000","last_fullsized":"2024-09-12T18:09:08.691783+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:13.745522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"261'8","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:35.755523+0000","last_change":"2024-09-12T17:20:34.559278+0000","last_active":"2024-09-12T18:10:35.755523+0000","last_peered":"2024-09-12T18:10:35.755523+0000","last_clean":"2024-09-12T18:10:35.755523+0000","last_became_active":"2024-09-12T17:20:34.558970+0000","last_became_peered":"2024-09-12T17:20:34.558970+0000","last_unstale":"2024-09-12T18:10:35.755523+0000","last_undegraded":"2024-09-12T18:10:35.755523+0000","last_fullsized":"2024-09-12T18:10:35.755523+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:15.197078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8194,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.601484+0000","last_change":"2024-09-12T17:20:30.539641+0000","last_active":"2024-09-12T18:13:48.601484+0000","last_peered":"2024-09-12T18:13:48.601484+0000","last_clean":"2024-09-12T18:13:48.601484+0000","last_became_active":"2024-09-12T17:20:30.539358+0000","last_became_peered":"2024-09-12T17:20:30.539358+0000","last_unstale":"2024-09-12T18:13:48.601484+0000","last_undegraded":"2024-09-12T18:13:48.601484+0000","last_fullsized":"2024-09-12T18:13:48.601484+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:09.857477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8242,"num_write":10,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'68","reported_seq":250,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:23.699050+0000","last_change":"2024-09-12T17:16:11.491901+0000","last_active":"2024-09-12T18:10:23.699050+0000","last_peered":"2024-09-12T18:10:23.699050+0000","last_clean":"2024-09-12T18:10:23.699050+0000","last_became_active":"2024-09-12T17:16:11.491610+0000","last_became_peered":"2024-09-12T17:16:11.491610+0000","last_unstale":"2024-09-12T18:10:23.699050+0000","last_undegraded":"2024-09-12T18:10:23.699050+0000","last_fullsized":"2024-09-12T18:10:23.699050+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:14.980006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":357,"num_read_kb":265,"num_write":116,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.743901+0000","last_change":"2024-09-12T17:39:05.922376+0000","last_active":"2024-09-12T18:10:32.743901+0000","last_peered":"2024-09-12T18:10:32.743901+0000","last_clean":"2024-09-12T18:10:32.743901+0000","last_became_active":"2024-09-12T17:39:05.921846+0000","last_became_peered":"2024-09-12T17:39:05.921846+0000","last_unstale":"2024-09-12T18:10:32.743901+0000","last_undegraded":"2024-09-12T18:10:32.743901+0000","last_fullsized":"2024-09-12T18:10:32.743901+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:48.115093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"261'8","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.621019+0000","last_change":"2024-09-12T17:20:34.615861+0000","last_active":"2024-09-12T18:10:36.621019+0000","last_peered":"2024-09-12T18:10:36.621019+0000","last_clean":"2024-09-12T18:10:36.621019+0000","last_became_active":"2024-09-12T17:20:34.615550+0000","last_became_peered":"2024-09-12T17:20:34.615550+0000","last_unstale":"2024-09-12T18:10:36.621019+0000","last_undegraded":"2024-09-12T18:10:36.621019+0000","last_fullsized":"2024-09-12T18:10:36.621019+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:16.087575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":6148,"num_write":8,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'9","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:43.714000+0000","last_change":"2024-09-12T17:20:30.535465+0000","last_active":"2024-09-12T18:12:43.714000+0000","last_peered":"2024-09-12T18:12:43.714000+0000","last_clean":"2024-09-12T18:12:43.714000+0000","last_became_active":"2024-09-12T17:20:30.535182+0000","last_became_peered":"2024-09-12T17:20:30.535182+0000","last_unstale":"2024-09-12T18:12:43.714000+0000","last_undegraded":"2024-09-12T18:12:43.714000+0000","last_fullsized":"2024-09-12T18:12:43.714000+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:33.062178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":17410,"num_write":14,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'51","reported_seq":202,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.624811+0000","last_change":"2024-09-12T17:16:11.493397+0000","last_active":"2024-09-12T18:11:11.624811+0000","last_peered":"2024-09-12T18:11:11.624811+0000","last_clean":"2024-09-12T18:11:11.624811+0000","last_became_active":"2024-09-12T17:16:11.493043+0000","last_became_peered":"2024-09-12T17:16:11.493043+0000","last_unstale":"2024-09-12T18:11:11.624811+0000","last_undegraded":"2024-09-12T18:11:11.624811+0000","last_fullsized":"2024-09-12T18:11:11.624811+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:13.681249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":193,"num_write":93,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.844692+0000","last_change":"2024-09-12T17:39:05.931399+0000","last_active":"2024-09-12T18:10:36.844692+0000","last_peered":"2024-09-12T18:10:36.844692+0000","last_clean":"2024-09-12T18:10:36.844692+0000","last_became_active":"2024-09-12T17:39:05.931122+0000","last_became_peered":"2024-09-12T17:39:05.931122+0000","last_unstale":"2024-09-12T18:10:36.844692+0000","last_undegraded":"2024-09-12T18:10:36.844692+0000","last_fullsized":"2024-09-12T18:10:36.844692+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:02.508518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'9","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.942169+0000","last_change":"2024-09-12T17:20:34.613048+0000","last_active":"2024-09-12T18:13:48.942169+0000","last_peered":"2024-09-12T18:13:48.942169+0000","last_clean":"2024-09-12T18:13:48.942169+0000","last_became_active":"2024-09-12T17:20:34.612720+0000","last_became_peered":"2024-09-12T17:20:34.612720+0000","last_unstale":"2024-09-12T18:13:48.942169+0000","last_undegraded":"2024-09-12T18:13:48.942169+0000","last_fullsized":"2024-09-12T18:13:48.942169+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:30.901799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":14336,"num_write":14,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'8","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:35.773779+0000","last_change":"2024-09-12T17:20:30.534475+0000","last_active":"2024-09-12T18:12:35.773779+0000","last_peered":"2024-09-12T18:12:35.773779+0000","last_clean":"2024-09-12T18:12:35.773779+0000","last_became_active":"2024-09-12T17:20:30.534068+0000","last_became_peered":"2024-09-12T17:20:30.534068+0000","last_unstale":"2024-09-12T18:12:35.773779+0000","last_undegraded":"2024-09-12T18:12:35.773779+0000","last_fullsized":"2024-09-12T18:12:35.773779+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:16.971800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'25","reported_seq":124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.848415+0000","last_change":"2024-09-12T17:16:11.490345+0000","last_active":"2024-09-12T18:11:11.848415+0000","last_peered":"2024-09-12T18:11:11.848415+0000","last_clean":"2024-09-12T18:11:11.848415+0000","last_became_active":"2024-09-12T17:16:11.489860+0000","last_became_peered":"2024-09-12T17:16:11.489860+0000","last_unstale":"2024-09-12T18:11:11.848415+0000","last_undegraded":"2024-09-12T18:11:11.848415+0000","last_fullsized":"2024-09-12T18:11:11.848415+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:28:30.353456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.848437+0000","last_change":"2024-09-12T17:39:05.931395+0000","last_active":"2024-09-12T18:11:11.848437+0000","last_peered":"2024-09-12T18:11:11.848437+0000","last_clean":"2024-09-12T18:11:11.848437+0000","last_became_active":"2024-09-12T17:39:05.931089+0000","last_became_peered":"2024-09-12T17:39:05.931089+0000","last_unstale":"2024-09-12T18:11:11.848437+0000","last_undegraded":"2024-09-12T18:11:11.848437+0000","last_fullsized":"2024-09-12T18:11:11.848437+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:40.976622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"264'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:32.965368+0000","last_change":"2024-09-12T17:20:34.557572+0000","last_active":"2024-09-12T18:11:32.965368+0000","last_peered":"2024-09-12T18:11:32.965368+0000","last_clean":"2024-09-12T18:11:32.965368+0000","last_became_active":"2024-09-12T17:20:34.557008+0000","last_became_peered":"2024-09-12T17:20:34.557008+0000","last_unstale":"2024-09-12T18:11:32.965368+0000","last_undegraded":"2024-09-12T18:11:32.965368+0000","last_fullsized":"2024-09-12T18:11:32.965368+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:29.589642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'7","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:16.625332+0000","last_change":"2024-09-12T17:20:30.538674+0000","last_active":"2024-09-12T18:11:16.625332+0000","last_peered":"2024-09-12T18:11:16.625332+0000","last_clean":"2024-09-12T18:11:16.625332+0000","last_became_active":"2024-09-12T17:20:30.538361+0000","last_became_peered":"2024-09-12T17:20:30.538361+0000","last_unstale":"2024-09-12T18:11:16.625332+0000","last_undegraded":"2024-09-12T18:11:16.625332+0000","last_fullsized":"2024-09-12T18:11:16.625332+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:34.525214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4098,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'48","reported_seq":182,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.848386+0000","last_change":"2024-09-12T17:16:11.488078+0000","last_active":"2024-09-12T18:11:11.848386+0000","last_peered":"2024-09-12T18:11:11.848386+0000","last_clean":"2024-09-12T18:11:11.848386+0000","last_became_active":"2024-09-12T17:16:11.487771+0000","last_became_peered":"2024-09-12T17:16:11.487771+0000","last_unstale":"2024-09-12T18:11:11.848386+0000","last_undegraded":"2024-09-12T18:11:11.848386+0000","last_fullsized":"2024-09-12T18:11:11.848386+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:38.032910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":161,"num_write":84,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:23.917612+0000","last_change":"2024-09-12T17:39:05.921998+0000","last_active":"2024-09-12T18:10:23.917612+0000","last_peered":"2024-09-12T18:10:23.917612+0000","last_clean":"2024-09-12T18:10:23.917612+0000","last_became_active":"2024-09-12T17:39:05.921661+0000","last_became_peered":"2024-09-12T17:39:05.921661+0000","last_unstale":"2024-09-12T18:10:23.917612+0000","last_undegraded":"2024-09-12T18:10:23.917612+0000","last_fullsized":"2024-09-12T18:10:23.917612+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:09.613996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'3","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:47.771536+0000","last_change":"2024-09-12T17:20:34.555394+0000","last_active":"2024-09-12T18:13:47.771536+0000","last_peered":"2024-09-12T18:13:47.771536+0000","last_clean":"2024-09-12T18:13:47.771536+0000","last_became_active":"2024-09-12T17:20:34.555047+0000","last_became_peered":"2024-09-12T17:20:34.555047+0000","last_unstale":"2024-09-12T18:13:47.771536+0000","last_undegraded":"2024-09-12T18:13:47.771536+0000","last_fullsized":"2024-09-12T18:13:47.771536+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:29.139249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'4","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.385159+0000","last_change":"2024-09-12T17:20:30.528356+0000","last_active":"2024-09-12T18:13:49.385159+0000","last_peered":"2024-09-12T18:13:49.385159+0000","last_clean":"2024-09-12T18:13:49.385159+0000","last_became_active":"2024-09-12T17:20:30.528029+0000","last_became_peered":"2024-09-12T17:20:30.528029+0000","last_unstale":"2024-09-12T18:13:49.385159+0000","last_undegraded":"2024-09-12T18:13:49.385159+0000","last_fullsized":"2024-09-12T18:13:49.385159+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:17.569528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'34","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:12.750037+0000","last_change":"2024-09-12T17:16:11.491282+0000","last_active":"2024-09-12T18:11:12.750037+0000","last_peered":"2024-09-12T18:11:12.750037+0000","last_clean":"2024-09-12T18:11:12.750037+0000","last_became_active":"2024-09-12T17:16:11.490952+0000","last_became_peered":"2024-09-12T17:16:11.490952+0000","last_unstale":"2024-09-12T18:11:12.750037+0000","last_undegraded":"2024-09-12T18:11:12.750037+0000","last_fullsized":"2024-09-12T18:11:12.750037+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:58.052602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":115,"num_write":60,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:07.744407+0000","last_change":"2024-09-12T17:39:05.929242+0000","last_active":"2024-09-12T18:09:07.744407+0000","last_peered":"2024-09-12T18:09:07.744407+0000","last_clean":"2024-09-12T18:09:07.744407+0000","last_became_active":"2024-09-12T17:39:05.928959+0000","last_became_peered":"2024-09-12T17:39:05.928959+0000","last_unstale":"2024-09-12T18:09:07.744407+0000","last_undegraded":"2024-09-12T18:09:07.744407+0000","last_fullsized":"2024-09-12T18:09:07.744407+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:49.943631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.744728+0000","last_change":"2024-09-12T17:20:34.552499+0000","last_active":"2024-09-12T18:10:37.744728+0000","last_peered":"2024-09-12T18:10:37.744728+0000","last_clean":"2024-09-12T18:10:37.744728+0000","last_became_active":"2024-09-12T17:20:34.552180+0000","last_became_peered":"2024-09-12T17:20:34.552180+0000","last_unstale":"2024-09-12T18:10:37.744728+0000","last_undegraded":"2024-09-12T18:10:37.744728+0000","last_fullsized":"2024-09-12T18:10:37.744728+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:03.689040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:30.754825+0000","last_change":"2024-09-12T17:20:30.535560+0000","last_active":"2024-09-12T18:10:30.754825+0000","last_peered":"2024-09-12T18:10:30.754825+0000","last_clean":"2024-09-12T18:10:30.754825+0000","last_became_active":"2024-09-12T17:20:30.535001+0000","last_became_peered":"2024-09-12T17:20:30.535001+0000","last_unstale":"2024-09-12T18:10:30.754825+0000","last_undegraded":"2024-09-12T18:10:30.754825+0000","last_fullsized":"2024-09-12T18:10:30.754825+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:47.724576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'14","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:36.614251+0000","last_change":"2024-09-12T17:16:11.480542+0000","last_active":"2024-09-12T18:09:36.614251+0000","last_peered":"2024-09-12T18:09:36.614251+0000","last_clean":"2024-09-12T18:09:36.614251+0000","last_became_active":"2024-09-12T17:16:11.477940+0000","last_became_peered":"2024-09-12T17:16:11.477940+0000","last_unstale":"2024-09-12T18:09:36.614251+0000","last_undegraded":"2024-09-12T18:09:36.614251+0000","last_fullsized":"2024-09-12T18:09:36.614251+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:48.061800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":35,"num_write":34,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:07.744444+0000","last_change":"2024-09-12T17:39:05.930937+0000","last_active":"2024-09-12T18:09:07.744444+0000","last_peered":"2024-09-12T18:09:07.744444+0000","last_clean":"2024-09-12T18:09:07.744444+0000","last_became_active":"2024-09-12T17:39:05.930694+0000","last_became_peered":"2024-09-12T17:39:05.930694+0000","last_unstale":"2024-09-12T18:09:07.744444+0000","last_undegraded":"2024-09-12T18:09:07.744444+0000","last_fullsized":"2024-09-12T18:09:07.744444+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:15.777013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"261'4","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.844714+0000","last_change":"2024-09-12T17:20:34.553025+0000","last_active":"2024-09-12T18:10:36.844714+0000","last_peered":"2024-09-12T18:10:36.844714+0000","last_clean":"2024-09-12T18:10:36.844714+0000","last_became_active":"2024-09-12T17:20:34.552726+0000","last_became_peered":"2024-09-12T17:20:34.552726+0000","last_unstale":"2024-09-12T18:10:36.844714+0000","last_undegraded":"2024-09-12T18:10:36.844714+0000","last_fullsized":"2024-09-12T18:10:36.844714+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:22.335524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:01.638377+0000","last_change":"2024-09-12T17:20:30.539217+0000","last_active":"2024-09-12T18:13:01.638377+0000","last_peered":"2024-09-12T18:13:01.638377+0000","last_clean":"2024-09-12T18:13:01.638377+0000","last_became_active":"2024-09-12T17:20:30.538942+0000","last_became_peered":"2024-09-12T17:20:30.538942+0000","last_unstale":"2024-09-12T18:13:01.638377+0000","last_undegraded":"2024-09-12T18:13:01.638377+0000","last_fullsized":"2024-09-12T18:13:01.638377+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:53.625617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'32","reported_seq":144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:23.910689+0000","last_change":"2024-09-12T17:16:11.488019+0000","last_active":"2024-09-12T18:09:23.910689+0000","last_peered":"2024-09-12T18:09:23.910689+0000","last_clean":"2024-09-12T18:09:23.910689+0000","last_became_active":"2024-09-12T17:16:11.487242+0000","last_became_peered":"2024-09-12T17:16:11.487242+0000","last_unstale":"2024-09-12T18:09:23.910689+0000","last_undegraded":"2024-09-12T18:09:23.910689+0000","last_fullsized":"2024-09-12T18:09:23.910689+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:20.980571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":114,"num_write":62,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:28.911251+0000","last_change":"2024-09-12T17:39:05.927350+0000","last_active":"2024-09-12T18:09:28.911251+0000","last_peered":"2024-09-12T18:09:28.911251+0000","last_clean":"2024-09-12T18:09:28.911251+0000","last_became_active":"2024-09-12T17:39:05.924899+0000","last_became_peered":"2024-09-12T17:39:05.924899+0000","last_unstale":"2024-09-12T18:09:28.911251+0000","last_undegraded":"2024-09-12T18:09:28.911251+0000","last_fullsized":"2024-09-12T18:09:28.911251+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:09.168419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'5","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.808588+0000","last_change":"2024-09-12T17:20:34.610704+0000","last_active":"2024-09-12T18:13:48.808588+0000","last_peered":"2024-09-12T18:13:48.808588+0000","last_clean":"2024-09-12T18:13:48.808588+0000","last_became_active":"2024-09-12T17:20:34.610374+0000","last_became_peered":"2024-09-12T17:20:34.610374+0000","last_unstale":"2024-09-12T18:13:48.808588+0000","last_undegraded":"2024-09-12T18:13:48.808588+0000","last_fullsized":"2024-09-12T18:13:48.808588+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:34.456941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1142,"num_write":10,"num_write_kb":1595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"264'3","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.970813+0000","last_change":"2024-09-12T17:20:30.526974+0000","last_active":"2024-09-12T18:12:02.970813+0000","last_peered":"2024-09-12T18:12:02.970813+0000","last_clean":"2024-09-12T18:12:02.970813+0000","last_became_active":"2024-09-12T17:20:30.526672+0000","last_became_peered":"2024-09-12T17:20:30.526672+0000","last_unstale":"2024-09-12T18:12:02.970813+0000","last_undegraded":"2024-09-12T18:12:02.970813+0000","last_fullsized":"2024-09-12T18:12:02.970813+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:59.866468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'19","reported_seq":109,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:21.612655+0000","last_change":"2024-09-12T17:16:11.481645+0000","last_active":"2024-09-12T18:09:21.612655+0000","last_peered":"2024-09-12T18:09:21.612655+0000","last_clean":"2024-09-12T18:09:21.612655+0000","last_became_active":"2024-09-12T17:16:11.481351+0000","last_became_peered":"2024-09-12T17:16:11.481351+0000","last_unstale":"2024-09-12T18:09:21.612655+0000","last_undegraded":"2024-09-12T18:09:21.612655+0000","last_fullsized":"2024-09-12T18:09:21.612655+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:59.636662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":68,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:28.693677+0000","last_change":"2024-09-12T17:39:05.928807+0000","last_active":"2024-09-12T18:09:28.693677+0000","last_peered":"2024-09-12T18:09:28.693677+0000","last_clean":"2024-09-12T18:09:28.693677+0000","last_became_active":"2024-09-12T17:39:05.928497+0000","last_became_peered":"2024-09-12T17:39:05.928497+0000","last_unstale":"2024-09-12T18:09:28.693677+0000","last_undegraded":"2024-09-12T18:09:28.693677+0000","last_fullsized":"2024-09-12T18:09:28.693677+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:21.617561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:06.855515+0000","last_change":"2024-09-12T17:20:34.610626+0000","last_active":"2024-09-12T18:12:06.855515+0000","last_peered":"2024-09-12T18:12:06.855515+0000","last_clean":"2024-09-12T18:12:06.855515+0000","last_became_active":"2024-09-12T17:20:34.610260+0000","last_became_peered":"2024-09-12T17:20:34.610260+0000","last_unstale":"2024-09-12T18:12:06.855515+0000","last_undegraded":"2024-09-12T18:12:06.855515+0000","last_fullsized":"2024-09-12T18:12:06.855515+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:16.730940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'14","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.438735+0000","last_change":"2024-09-12T17:20:30.527312+0000","last_active":"2024-09-12T18:13:48.438735+0000","last_peered":"2024-09-12T18:13:48.438735+0000","last_clean":"2024-09-12T18:13:48.438735+0000","last_became_active":"2024-09-12T17:20:30.527032+0000","last_became_peered":"2024-09-12T17:20:30.527032+0000","last_unstale":"2024-09-12T18:13:48.438735+0000","last_undegraded":"2024-09-12T18:13:48.438735+0000","last_fullsized":"2024-09-12T18:13:48.438735+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:12.370876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":13314,"num_write":24,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"0'0","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:21.836307+0000","last_change":"2024-09-12T17:16:11.494751+0000","last_active":"2024-09-12T18:09:21.836307+0000","last_peered":"2024-09-12T18:09:21.836307+0000","last_clean":"2024-09-12T18:09:21.836307+0000","last_became_active":"2024-09-12T17:16:11.494493+0000","last_became_peered":"2024-09-12T17:16:11.494493+0000","last_unstale":"2024-09-12T18:09:21.836307+0000","last_undegraded":"2024-09-12T18:09:21.836307+0000","last_fullsized":"2024-09-12T18:09:21.836307+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:52.903537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:27.747165+0000","last_change":"2024-09-12T17:39:05.926661+0000","last_active":"2024-09-12T18:09:27.747165+0000","last_peered":"2024-09-12T18:09:27.747165+0000","last_clean":"2024-09-12T18:09:27.747165+0000","last_became_active":"2024-09-12T17:39:05.926388+0000","last_became_peered":"2024-09-12T17:39:05.926388+0000","last_unstale":"2024-09-12T18:09:27.747165+0000","last_undegraded":"2024-09-12T18:09:27.747165+0000","last_fullsized":"2024-09-12T18:09:27.747165+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:08.792424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"261'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:21.849742+0000","last_change":"2024-09-12T17:20:34.615918+0000","last_active":"2024-09-12T18:11:21.849742+0000","last_peered":"2024-09-12T18:11:21.849742+0000","last_clean":"2024-09-12T18:11:21.849742+0000","last_became_active":"2024-09-12T17:20:34.615468+0000","last_became_peered":"2024-09-12T17:20:34.615468+0000","last_unstale":"2024-09-12T18:11:21.849742+0000","last_undegraded":"2024-09-12T18:11:21.849742+0000","last_fullsized":"2024-09-12T18:11:21.849742+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:26.561082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:18.704540+0000","last_change":"2024-09-12T17:20:30.533763+0000","last_active":"2024-09-12T18:11:18.704540+0000","last_peered":"2024-09-12T18:11:18.704540+0000","last_clean":"2024-09-12T18:11:18.704540+0000","last_became_active":"2024-09-12T17:20:30.533436+0000","last_became_peered":"2024-09-12T17:20:30.533436+0000","last_unstale":"2024-09-12T18:11:18.704540+0000","last_undegraded":"2024-09-12T18:11:18.704540+0000","last_fullsized":"2024-09-12T18:11:18.704540+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:28.574849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'18","reported_seq":106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:23.693173+0000","last_change":"2024-09-12T17:16:11.489669+0000","last_active":"2024-09-12T18:09:23.693173+0000","last_peered":"2024-09-12T18:09:23.693173+0000","last_clean":"2024-09-12T18:09:23.693173+0000","last_became_active":"2024-09-12T17:16:11.488588+0000","last_became_peered":"2024-09-12T17:16:11.488588+0000","last_unstale":"2024-09-12T18:09:23.693173+0000","last_undegraded":"2024-09-12T18:09:23.693173+0000","last_fullsized":"2024-09-12T18:09:23.693173+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:28.499624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:27.946007+0000","last_change":"2024-09-12T17:39:05.923338+0000","last_active":"2024-09-12T18:09:27.946007+0000","last_peered":"2024-09-12T18:09:27.946007+0000","last_clean":"2024-09-12T18:09:27.946007+0000","last_became_active":"2024-09-12T17:39:05.922973+0000","last_became_peered":"2024-09-12T17:39:05.922973+0000","last_unstale":"2024-09-12T18:09:27.946007+0000","last_undegraded":"2024-09-12T18:09:27.946007+0000","last_fullsized":"2024-09-12T18:09:27.946007+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:17.786298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:20.762674+0000","last_change":"2024-09-12T17:20:34.555891+0000","last_active":"2024-09-12T18:11:20.762674+0000","last_peered":"2024-09-12T18:11:20.762674+0000","last_clean":"2024-09-12T18:11:20.762674+0000","last_became_active":"2024-09-12T17:20:34.554893+0000","last_became_peered":"2024-09-12T17:20:34.554893+0000","last_unstale":"2024-09-12T18:11:20.762674+0000","last_undegraded":"2024-09-12T18:11:20.762674+0000","last_fullsized":"2024-09-12T18:11:20.762674+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:56.253377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'6","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:41.643873+0000","last_change":"2024-09-12T17:20:30.536540+0000","last_active":"2024-09-12T18:13:41.643873+0000","last_peered":"2024-09-12T18:13:41.643873+0000","last_clean":"2024-09-12T18:13:41.643873+0000","last_became_active":"2024-09-12T17:20:30.535226+0000","last_became_peered":"2024-09-12T17:20:30.535226+0000","last_unstale":"2024-09-12T18:13:41.643873+0000","last_undegraded":"2024-09-12T18:13:41.643873+0000","last_fullsized":"2024-09-12T18:13:41.643873+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:28:25.047253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":6,"num_write_kb":3074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'26","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:02.752551+0000","last_change":"2024-09-12T17:16:11.491564+0000","last_active":"2024-09-12T18:10:02.752551+0000","last_peered":"2024-09-12T18:10:02.752551+0000","last_clean":"2024-09-12T18:10:02.752551+0000","last_became_active":"2024-09-12T17:16:11.491240+0000","last_became_peered":"2024-09-12T17:16:11.491240+0000","last_unstale":"2024-09-12T18:10:02.752551+0000","last_undegraded":"2024-09-12T18:10:02.752551+0000","last_fullsized":"2024-09-12T18:10:02.752551+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:43.068567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":97,"num_write":43,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844211+0000","last_change":"2024-09-12T17:39:05.932135+0000","last_active":"2024-09-12T18:10:31.844211+0000","last_peered":"2024-09-12T18:10:31.844211+0000","last_clean":"2024-09-12T18:10:31.844211+0000","last_became_active":"2024-09-12T17:39:05.931841+0000","last_became_peered":"2024-09-12T17:39:05.931841+0000","last_unstale":"2024-09-12T18:10:31.844211+0000","last_undegraded":"2024-09-12T18:10:31.844211+0000","last_fullsized":"2024-09-12T18:10:31.844211+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:08.525616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:33.911887+0000","last_change":"2024-09-12T17:20:34.560852+0000","last_active":"2024-09-12T18:09:33.911887+0000","last_peered":"2024-09-12T18:09:33.911887+0000","last_clean":"2024-09-12T18:09:33.911887+0000","last_became_active":"2024-09-12T17:20:34.560497+0000","last_became_peered":"2024-09-12T17:20:34.560497+0000","last_unstale":"2024-09-12T18:09:33.911887+0000","last_undegraded":"2024-09-12T18:09:33.911887+0000","last_fullsized":"2024-09-12T18:09:33.911887+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:07.183237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"261'7","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:30.746005+0000","last_change":"2024-09-12T17:20:30.535717+0000","last_active":"2024-09-12T18:09:30.746005+0000","last_peered":"2024-09-12T18:09:30.746005+0000","last_clean":"2024-09-12T18:09:30.746005+0000","last_became_active":"2024-09-12T17:20:30.535358+0000","last_became_peered":"2024-09-12T17:20:30.535358+0000","last_unstale":"2024-09-12T18:09:30.746005+0000","last_undegraded":"2024-09-12T18:09:30.746005+0000","last_fullsized":"2024-09-12T18:09:30.746005+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:14.210209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":15362,"num_write":12,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'12","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:52.751072+0000","last_change":"2024-09-12T17:16:11.490206+0000","last_active":"2024-09-12T18:09:52.751072+0000","last_peered":"2024-09-12T18:09:52.751072+0000","last_clean":"2024-09-12T18:09:52.751072+0000","last_became_active":"2024-09-12T17:16:11.489897+0000","last_became_peered":"2024-09-12T17:16:11.489897+0000","last_unstale":"2024-09-12T18:09:52.751072+0000","last_undegraded":"2024-09-12T18:09:52.751072+0000","last_fullsized":"2024-09-12T18:09:52.751072+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:03.772651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.620396+0000","last_change":"2024-09-12T17:39:05.927618+0000","last_active":"2024-09-12T18:10:31.620396+0000","last_peered":"2024-09-12T18:10:31.620396+0000","last_clean":"2024-09-12T18:10:31.620396+0000","last_became_active":"2024-09-12T17:39:05.926766+0000","last_became_peered":"2024-09-12T17:39:05.926766+0000","last_unstale":"2024-09-12T18:10:31.620396+0000","last_undegraded":"2024-09-12T18:10:31.620396+0000","last_fullsized":"2024-09-12T18:10:31.620396+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:41.020632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"264'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.926650+0000","last_change":"2024-09-12T17:20:34.559252+0000","last_active":"2024-09-12T18:11:53.926650+0000","last_peered":"2024-09-12T18:11:53.926650+0000","last_clean":"2024-09-12T18:11:53.926650+0000","last_became_active":"2024-09-12T17:20:34.558970+0000","last_became_peered":"2024-09-12T17:20:34.558970+0000","last_unstale":"2024-09-12T18:11:53.926650+0000","last_undegraded":"2024-09-12T18:11:53.926650+0000","last_fullsized":"2024-09-12T18:11:53.926650+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:58.158311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'4","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.362018+0000","last_change":"2024-09-12T17:20:30.536062+0000","last_active":"2024-09-12T18:13:48.362018+0000","last_peered":"2024-09-12T18:13:48.362018+0000","last_clean":"2024-09-12T18:13:48.362018+0000","last_became_active":"2024-09-12T17:20:30.535761+0000","last_became_peered":"2024-09-12T17:20:30.535761+0000","last_unstale":"2024-09-12T18:13:48.362018+0000","last_undegraded":"2024-09-12T18:13:48.362018+0000","last_fullsized":"2024-09-12T18:13:48.362018+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:41.021041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8196,"num_write":4,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'42","reported_seq":175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:51.615812+0000","last_change":"2024-09-12T17:16:11.488259+0000","last_active":"2024-09-12T18:09:51.615812+0000","last_peered":"2024-09-12T18:09:51.615812+0000","last_clean":"2024-09-12T18:09:51.615812+0000","last_became_active":"2024-09-12T17:16:11.487923+0000","last_became_peered":"2024-09-12T17:16:11.487923+0000","last_unstale":"2024-09-12T18:09:51.615812+0000","last_undegraded":"2024-09-12T18:09:51.615812+0000","last_fullsized":"2024-09-12T18:09:51.615812+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:17.535117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":152,"num_write":79,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:36.614300+0000","last_change":"2024-09-12T17:39:05.921610+0000","last_active":"2024-09-12T18:09:36.614300+0000","last_peered":"2024-09-12T18:09:36.614300+0000","last_clean":"2024-09-12T18:09:36.614300+0000","last_became_active":"2024-09-12T17:39:05.921257+0000","last_became_peered":"2024-09-12T17:39:05.921257+0000","last_unstale":"2024-09-12T18:09:36.614300+0000","last_undegraded":"2024-09-12T18:09:36.614300+0000","last_fullsized":"2024-09-12T18:09:36.614300+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:57.829484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'4","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.311850+0000","last_change":"2024-09-12T17:20:34.554048+0000","last_active":"2024-09-12T18:13:49.311850+0000","last_peered":"2024-09-12T18:13:49.311850+0000","last_clean":"2024-09-12T18:13:49.311850+0000","last_became_active":"2024-09-12T17:20:34.553659+0000","last_became_peered":"2024-09-12T17:20:34.553659+0000","last_unstale":"2024-09-12T18:13:49.311850+0000","last_undegraded":"2024-09-12T18:13:49.311850+0000","last_fullsized":"2024-09-12T18:13:49.311850+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:41.787619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":52,"num_write":4,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:32.735296+0000","last_change":"2024-09-12T17:20:30.535174+0000","last_active":"2024-09-12T18:09:32.735296+0000","last_peered":"2024-09-12T18:09:32.735296+0000","last_clean":"2024-09-12T18:09:32.735296+0000","last_became_active":"2024-09-12T17:20:30.534878+0000","last_became_peered":"2024-09-12T17:20:30.534878+0000","last_unstale":"2024-09-12T18:09:32.735296+0000","last_undegraded":"2024-09-12T18:09:32.735296+0000","last_fullsized":"2024-09-12T18:09:32.735296+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:22.315962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'92","reported_seq":343,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:50.748679+0000","last_change":"2024-09-12T17:16:11.489329+0000","last_active":"2024-09-12T18:09:50.748679+0000","last_peered":"2024-09-12T18:09:50.748679+0000","last_clean":"2024-09-12T18:09:50.748679+0000","last_became_active":"2024-09-12T17:16:11.489044+0000","last_became_peered":"2024-09-12T17:16:11.489044+0000","last_unstale":"2024-09-12T18:09:50.748679+0000","last_undegraded":"2024-09-12T18:09:50.748679+0000","last_fullsized":"2024-09-12T18:09:50.748679+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:09.438571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":552,"num_read_kb":376,"num_write":139,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844194+0000","last_change":"2024-09-12T17:39:05.932942+0000","last_active":"2024-09-12T18:10:31.844194+0000","last_peered":"2024-09-12T18:10:31.844194+0000","last_clean":"2024-09-12T18:10:31.844194+0000","last_became_active":"2024-09-12T17:39:05.932617+0000","last_became_peered":"2024-09-12T17:39:05.932617+0000","last_unstale":"2024-09-12T18:10:31.844194+0000","last_undegraded":"2024-09-12T18:10:31.844194+0000","last_fullsized":"2024-09-12T18:10:31.844194+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:47.846584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"261'5","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:37.736113+0000","last_change":"2024-09-12T17:20:34.559301+0000","last_active":"2024-09-12T18:09:37.736113+0000","last_peered":"2024-09-12T18:09:37.736113+0000","last_clean":"2024-09-12T18:09:37.736113+0000","last_became_active":"2024-09-12T17:20:34.559024+0000","last_became_peered":"2024-09-12T17:20:34.559024+0000","last_unstale":"2024-09-12T18:09:37.736113+0000","last_undegraded":"2024-09-12T18:09:37.736113+0000","last_fullsized":"2024-09-12T18:09:37.736113+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:19.256473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'6","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.968766+0000","last_change":"2024-09-12T17:20:30.534604+0000","last_active":"2024-09-12T18:11:52.968766+0000","last_peered":"2024-09-12T18:11:52.968766+0000","last_clean":"2024-09-12T18:11:52.968766+0000","last_became_active":"2024-09-12T17:20:30.534298+0000","last_became_peered":"2024-09-12T17:20:30.534298+0000","last_unstale":"2024-09-12T18:11:52.968766+0000","last_undegraded":"2024-09-12T18:11:52.968766+0000","last_fullsized":"2024-09-12T18:11:52.968766+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:07.258749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'39","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:51.839494+0000","last_change":"2024-09-12T17:16:11.489376+0000","last_active":"2024-09-12T18:09:51.839494+0000","last_peered":"2024-09-12T18:09:51.839494+0000","last_clean":"2024-09-12T18:09:51.839494+0000","last_became_active":"2024-09-12T17:16:11.489085+0000","last_became_peered":"2024-09-12T17:16:11.489085+0000","last_unstale":"2024-09-12T18:09:51.839494+0000","last_undegraded":"2024-09-12T18:09:51.839494+0000","last_fullsized":"2024-09-12T18:09:51.839494+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:34.809544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":137,"num_write":73,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:33.694207+0000","last_change":"2024-09-12T17:39:05.928701+0000","last_active":"2024-09-12T18:09:33.694207+0000","last_peered":"2024-09-12T18:09:33.694207+0000","last_clean":"2024-09-12T18:09:33.694207+0000","last_became_active":"2024-09-12T17:39:05.928320+0000","last_became_peered":"2024-09-12T17:39:05.928320+0000","last_unstale":"2024-09-12T18:09:33.694207+0000","last_undegraded":"2024-09-12T18:09:33.694207+0000","last_fullsized":"2024-09-12T18:09:33.694207+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:56.483652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"261'5","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:06.841342+0000","last_change":"2024-09-12T17:20:34.553728+0000","last_active":"2024-09-12T18:10:06.841342+0000","last_peered":"2024-09-12T18:10:06.841342+0000","last_clean":"2024-09-12T18:10:06.841342+0000","last_became_active":"2024-09-12T17:20:34.553407+0000","last_became_peered":"2024-09-12T17:20:34.553407+0000","last_unstale":"2024-09-12T18:10:06.841342+0000","last_undegraded":"2024-09-12T18:10:06.841342+0000","last_fullsized":"2024-09-12T18:10:06.841342+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:51.963850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'7","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.440197+0000","last_change":"2024-09-12T17:20:30.525002+0000","last_active":"2024-09-12T18:13:48.440197+0000","last_peered":"2024-09-12T18:13:48.440197+0000","last_clean":"2024-09-12T18:13:48.440197+0000","last_became_active":"2024-09-12T17:20:30.524670+0000","last_became_peered":"2024-09-12T17:20:30.524670+0000","last_unstale":"2024-09-12T18:13:48.440197+0000","last_undegraded":"2024-09-12T18:13:48.440197+0000","last_fullsized":"2024-09-12T18:13:48.440197+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:48.793238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4667,"num_write":12,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'33","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.843088+0000","last_change":"2024-09-12T17:16:11.487281+0000","last_active":"2024-09-12T18:10:21.843088+0000","last_peered":"2024-09-12T18:10:21.843088+0000","last_clean":"2024-09-12T18:10:21.843088+0000","last_became_active":"2024-09-12T17:16:11.486986+0000","last_became_peered":"2024-09-12T17:16:11.486986+0000","last_unstale":"2024-09-12T18:10:21.843088+0000","last_undegraded":"2024-09-12T18:10:21.843088+0000","last_fullsized":"2024-09-12T18:10:21.843088+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:58.383837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":108,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.758368+0000","last_change":"2024-09-12T17:39:05.927856+0000","last_active":"2024-09-12T18:10:37.758368+0000","last_peered":"2024-09-12T18:10:37.758368+0000","last_clean":"2024-09-12T18:10:37.758368+0000","last_became_active":"2024-09-12T17:39:05.927578+0000","last_became_peered":"2024-09-12T17:39:05.927578+0000","last_unstale":"2024-09-12T18:10:37.758368+0000","last_undegraded":"2024-09-12T18:10:37.758368+0000","last_fullsized":"2024-09-12T18:10:37.758368+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:21.888828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:06.841313+0000","last_change":"2024-09-12T17:20:34.552899+0000","last_active":"2024-09-12T18:10:06.841313+0000","last_peered":"2024-09-12T18:10:06.841313+0000","last_clean":"2024-09-12T18:10:06.841313+0000","last_became_active":"2024-09-12T17:20:34.552569+0000","last_became_peered":"2024-09-12T17:20:34.552569+0000","last_unstale":"2024-09-12T18:10:06.841313+0000","last_undegraded":"2024-09-12T18:10:06.841313+0000","last_fullsized":"2024-09-12T18:10:06.841313+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:59.485671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:03.697087+0000","last_change":"2024-09-12T17:20:30.538454+0000","last_active":"2024-09-12T18:10:03.697087+0000","last_peered":"2024-09-12T18:10:03.697087+0000","last_clean":"2024-09-12T18:10:03.697087+0000","last_became_active":"2024-09-12T17:20:30.538157+0000","last_became_peered":"2024-09-12T17:20:30.538157+0000","last_unstale":"2024-09-12T18:10:03.697087+0000","last_undegraded":"2024-09-12T18:10:03.697087+0000","last_fullsized":"2024-09-12T18:10:03.697087+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:21.990887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'29","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.953012+0000","last_change":"2024-09-12T17:16:11.488323+0000","last_active":"2024-09-12T18:10:12.953012+0000","last_peered":"2024-09-12T18:10:12.953012+0000","last_clean":"2024-09-12T18:10:12.953012+0000","last_became_active":"2024-09-12T17:16:11.487998+0000","last_became_peered":"2024-09-12T17:16:11.487998+0000","last_unstale":"2024-09-12T18:10:12.953012+0000","last_undegraded":"2024-09-12T18:10:12.953012+0000","last_fullsized":"2024-09-12T18:10:12.953012+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:46.362889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:37.753323+0000","last_change":"2024-09-12T17:39:05.921302+0000","last_active":"2024-09-12T18:11:37.753323+0000","last_peered":"2024-09-12T18:11:37.753323+0000","last_clean":"2024-09-12T18:11:37.753323+0000","last_became_active":"2024-09-12T17:39:05.921008+0000","last_became_peered":"2024-09-12T17:39:05.921008+0000","last_unstale":"2024-09-12T18:11:37.753323+0000","last_undegraded":"2024-09-12T18:11:37.753323+0000","last_fullsized":"2024-09-12T18:11:37.753323+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:44.290086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:28.933628+0000","last_change":"2024-09-12T17:20:34.616039+0000","last_active":"2024-09-12T18:12:28.933628+0000","last_peered":"2024-09-12T18:12:28.933628+0000","last_clean":"2024-09-12T18:12:28.933628+0000","last_became_active":"2024-09-12T17:20:34.615689+0000","last_became_peered":"2024-09-12T17:20:34.615689+0000","last_unstale":"2024-09-12T18:12:28.933628+0000","last_undegraded":"2024-09-12T18:12:28.933628+0000","last_fullsized":"2024-09-12T18:12:28.933628+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:14.341361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'4","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:16.632452+0000","last_change":"2024-09-12T17:20:30.540013+0000","last_active":"2024-09-12T18:12:16.632452+0000","last_peered":"2024-09-12T18:12:16.632452+0000","last_clean":"2024-09-12T18:12:16.632452+0000","last_became_active":"2024-09-12T17:20:30.536917+0000","last_became_peered":"2024-09-12T17:20:30.536917+0000","last_unstale":"2024-09-12T18:12:16.632452+0000","last_undegraded":"2024-09-12T18:12:16.632452+0000","last_fullsized":"2024-09-12T18:12:16.632452+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:21.908709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'41","reported_seq":168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.740858+0000","last_change":"2024-09-12T17:16:11.488593+0000","last_active":"2024-09-12T18:10:12.740858+0000","last_peered":"2024-09-12T18:10:12.740858+0000","last_clean":"2024-09-12T18:10:12.740858+0000","last_became_active":"2024-09-12T17:16:11.488252+0000","last_became_peered":"2024-09-12T17:16:11.488252+0000","last_unstale":"2024-09-12T18:10:12.740858+0000","last_undegraded":"2024-09-12T18:10:12.740858+0000","last_fullsized":"2024-09-12T18:10:12.740858+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:41.338780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":141,"num_write":74,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:37.767690+0000","last_change":"2024-09-12T17:39:05.926009+0000","last_active":"2024-09-12T18:11:37.767690+0000","last_peered":"2024-09-12T18:11:37.767690+0000","last_clean":"2024-09-12T18:11:37.767690+0000","last_became_active":"2024-09-12T17:39:05.925589+0000","last_became_peered":"2024-09-12T17:39:05.925589+0000","last_unstale":"2024-09-12T18:11:37.767690+0000","last_undegraded":"2024-09-12T18:11:37.767690+0000","last_fullsized":"2024-09-12T18:11:37.767690+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:14.643645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'11","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.857904+0000","last_change":"2024-09-12T17:20:34.560582+0000","last_active":"2024-09-12T18:12:21.857904+0000","last_peered":"2024-09-12T18:12:21.857904+0000","last_clean":"2024-09-12T18:12:21.857904+0000","last_became_active":"2024-09-12T17:20:34.560319+0000","last_became_peered":"2024-09-12T17:20:34.560319+0000","last_unstale":"2024-09-12T18:12:21.857904+0000","last_undegraded":"2024-09-12T18:12:21.857904+0000","last_fullsized":"2024-09-12T18:12:21.857904+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:25.756495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15462,"num_write":16,"num_write_kb":7218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'2","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:28.933593+0000","last_change":"2024-09-12T17:20:30.531674+0000","last_active":"2024-09-12T18:12:28.933593+0000","last_peered":"2024-09-12T18:12:28.933593+0000","last_clean":"2024-09-12T18:12:28.933593+0000","last_became_active":"2024-09-12T17:20:30.531384+0000","last_became_peered":"2024-09-12T17:20:30.531384+0000","last_unstale":"2024-09-12T18:12:28.933593+0000","last_undegraded":"2024-09-12T18:12:28.933593+0000","last_fullsized":"2024-09-12T18:12:28.933593+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:07.405605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'7","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:13.698059+0000","last_change":"2024-09-12T17:16:11.486387+0000","last_active":"2024-09-12T18:10:13.698059+0000","last_peered":"2024-09-12T18:10:13.698059+0000","last_clean":"2024-09-12T18:10:13.698059+0000","last_became_active":"2024-09-12T17:16:11.486098+0000","last_became_peered":"2024-09-12T17:16:11.486098+0000","last_unstale":"2024-09-12T18:10:13.698059+0000","last_undegraded":"2024-09-12T18:10:13.698059+0000","last_fullsized":"2024-09-12T18:10:13.698059+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:46.177478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.844775+0000","last_change":"2024-09-12T17:39:05.926486+0000","last_active":"2024-09-12T18:10:36.844775+0000","last_peered":"2024-09-12T18:10:36.844775+0000","last_clean":"2024-09-12T18:10:36.844775+0000","last_became_active":"2024-09-12T17:39:05.925637+0000","last_became_peered":"2024-09-12T17:39:05.925637+0000","last_unstale":"2024-09-12T18:10:36.844775+0000","last_undegraded":"2024-09-12T18:10:36.844775+0000","last_fullsized":"2024-09-12T18:10:36.844775+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:55.840960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:25.753841+0000","last_change":"2024-09-12T17:20:47.596669+0000","last_active":"2024-09-12T18:10:25.753841+0000","last_peered":"2024-09-12T18:10:25.753841+0000","last_clean":"2024-09-12T18:10:25.753841+0000","last_became_active":"2024-09-12T17:20:47.581310+0000","last_became_peered":"2024-09-12T17:20:47.581310+0000","last_unstale":"2024-09-12T18:10:25.753841+0000","last_undegraded":"2024-09-12T18:10:25.753841+0000","last_fullsized":"2024-09-12T18:10:25.753841+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:11.897529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619107+0000","last_change":"2024-09-12T17:20:30.536180+0000","last_active":"2024-09-12T18:10:21.619107+0000","last_peered":"2024-09-12T18:10:21.619107+0000","last_clean":"2024-09-12T18:10:21.619107+0000","last_became_active":"2024-09-12T17:20:30.535668+0000","last_became_peered":"2024-09-12T17:20:30.535668+0000","last_unstale":"2024-09-12T18:10:21.619107+0000","last_undegraded":"2024-09-12T18:10:21.619107+0000","last_fullsized":"2024-09-12T18:10:21.619107+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:31.430438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'13","reported_seq":92,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:11.618041+0000","last_change":"2024-09-12T17:16:11.484443+0000","last_active":"2024-09-12T18:10:11.618041+0000","last_peered":"2024-09-12T18:10:11.618041+0000","last_clean":"2024-09-12T18:10:11.618041+0000","last_became_active":"2024-09-12T17:16:11.484154+0000","last_became_peered":"2024-09-12T17:16:11.484154+0000","last_unstale":"2024-09-12T18:10:11.618041+0000","last_undegraded":"2024-09-12T18:10:11.618041+0000","last_fullsized":"2024-09-12T18:10:11.618041+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:54.824715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":37,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:42.759255+0000","last_change":"2024-09-12T17:39:05.928118+0000","last_active":"2024-09-12T18:10:42.759255+0000","last_peered":"2024-09-12T18:10:42.759255+0000","last_clean":"2024-09-12T18:10:42.759255+0000","last_became_active":"2024-09-12T17:39:05.927841+0000","last_became_peered":"2024-09-12T17:39:05.927841+0000","last_unstale":"2024-09-12T18:10:42.759255+0000","last_undegraded":"2024-09-12T18:10:42.759255+0000","last_fullsized":"2024-09-12T18:10:42.759255+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:37.026584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.756629+0000","last_change":"2024-09-12T17:20:34.611017+0000","last_active":"2024-09-12T18:10:27.756629+0000","last_peered":"2024-09-12T18:10:27.756629+0000","last_clean":"2024-09-12T18:10:27.756629+0000","last_became_active":"2024-09-12T17:20:34.610737+0000","last_became_peered":"2024-09-12T17:20:34.610737+0000","last_unstale":"2024-09-12T18:10:27.756629+0000","last_undegraded":"2024-09-12T18:10:27.756629+0000","last_fullsized":"2024-09-12T18:10:27.756629+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:07.818994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:23.917473+0000","last_change":"2024-09-12T17:20:30.529241+0000","last_active":"2024-09-12T18:10:23.917473+0000","last_peered":"2024-09-12T18:10:23.917473+0000","last_clean":"2024-09-12T18:10:23.917473+0000","last_became_active":"2024-09-12T17:20:30.528902+0000","last_became_peered":"2024-09-12T17:20:30.528902+0000","last_unstale":"2024-09-12T18:10:23.917473+0000","last_undegraded":"2024-09-12T18:10:23.917473+0000","last_fullsized":"2024-09-12T18:10:23.917473+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:59.483184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'31","reported_seq":148,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.757491+0000","last_change":"2024-09-12T17:16:11.489013+0000","last_active":"2024-09-12T18:10:32.757491+0000","last_peered":"2024-09-12T18:10:32.757491+0000","last_clean":"2024-09-12T18:10:32.757491+0000","last_became_active":"2024-09-12T17:16:11.488722+0000","last_became_peered":"2024-09-12T17:16:11.488722+0000","last_unstale":"2024-09-12T18:10:32.757491+0000","last_undegraded":"2024-09-12T18:10:32.757491+0000","last_fullsized":"2024-09-12T18:10:32.757491+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:19.504993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":116,"num_write":54,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.758386+0000","last_change":"2024-09-12T17:39:05.929421+0000","last_active":"2024-09-12T18:10:37.758386+0000","last_peered":"2024-09-12T18:10:37.758386+0000","last_clean":"2024-09-12T18:10:37.758386+0000","last_became_active":"2024-09-12T17:39:05.929156+0000","last_became_peered":"2024-09-12T17:39:05.929156+0000","last_unstale":"2024-09-12T18:10:37.758386+0000","last_undegraded":"2024-09-12T18:10:37.758386+0000","last_fullsized":"2024-09-12T18:10:37.758386+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:37.940351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:03.915183+0000","last_change":"2024-09-12T17:20:34.559128+0000","last_active":"2024-09-12T18:10:03.915183+0000","last_peered":"2024-09-12T18:10:03.915183+0000","last_clean":"2024-09-12T18:10:03.915183+0000","last_became_active":"2024-09-12T17:20:34.558826+0000","last_became_peered":"2024-09-12T17:20:34.558826+0000","last_unstale":"2024-09-12T18:10:03.915183+0000","last_undegraded":"2024-09-12T18:10:03.915183+0000","last_fullsized":"2024-09-12T18:10:03.915183+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:41.318428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.620862+0000","last_change":"2024-09-12T17:20:30.537479+0000","last_active":"2024-09-12T18:10:36.620862+0000","last_peered":"2024-09-12T18:10:36.620862+0000","last_clean":"2024-09-12T18:10:36.620862+0000","last_became_active":"2024-09-12T17:20:30.537204+0000","last_became_peered":"2024-09-12T17:20:30.537204+0000","last_unstale":"2024-09-12T18:10:36.620862+0000","last_undegraded":"2024-09-12T18:10:36.620862+0000","last_fullsized":"2024-09-12T18:10:36.620862+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:58.505650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'43","reported_seq":176,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.842925+0000","last_change":"2024-09-12T17:16:11.487416+0000","last_active":"2024-09-12T18:10:21.842925+0000","last_peered":"2024-09-12T18:10:21.842925+0000","last_clean":"2024-09-12T18:10:21.842925+0000","last_became_active":"2024-09-12T17:16:11.487129+0000","last_became_peered":"2024-09-12T17:16:11.487129+0000","last_unstale":"2024-09-12T18:10:21.842925+0000","last_undegraded":"2024-09-12T18:10:21.842925+0000","last_fullsized":"2024-09-12T18:10:21.842925+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:13.494114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":153,"num_write":79,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.620937+0000","last_change":"2024-09-12T17:39:05.926264+0000","last_active":"2024-09-12T18:10:36.620937+0000","last_peered":"2024-09-12T18:10:36.620937+0000","last_clean":"2024-09-12T18:10:36.620937+0000","last_became_active":"2024-09-12T17:39:05.925950+0000","last_became_peered":"2024-09-12T17:39:05.925950+0000","last_unstale":"2024-09-12T18:10:36.620937+0000","last_undegraded":"2024-09-12T18:10:36.620937+0000","last_fullsized":"2024-09-12T18:10:36.620937+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:25.942839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'3","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:47.778540+0000","last_change":"2024-09-12T17:20:34.555836+0000","last_active":"2024-09-12T18:12:47.778540+0000","last_peered":"2024-09-12T18:12:47.778540+0000","last_clean":"2024-09-12T18:12:47.778540+0000","last_became_active":"2024-09-12T17:20:34.555493+0000","last_became_peered":"2024-09-12T17:20:34.555493+0000","last_unstale":"2024-09-12T18:12:47.778540+0000","last_undegraded":"2024-09-12T18:12:47.778540+0000","last_fullsized":"2024-09-12T18:12:47.778540+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:04.010344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'4","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:15.770814+0000","last_change":"2024-09-12T17:20:30.534904+0000","last_active":"2024-09-12T18:12:15.770814+0000","last_peered":"2024-09-12T18:12:15.770814+0000","last_clean":"2024-09-12T18:12:15.770814+0000","last_became_active":"2024-09-12T17:20:30.534448+0000","last_became_peered":"2024-09-12T17:20:30.534448+0000","last_unstale":"2024-09-12T18:12:15.770814+0000","last_undegraded":"2024-09-12T18:12:15.770814+0000","last_fullsized":"2024-09-12T18:12:15.770814+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:56.106715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":4,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'9","reported_seq":87,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.742416+0000","last_change":"2024-09-12T17:16:11.488846+0000","last_active":"2024-09-12T18:10:22.742416+0000","last_peered":"2024-09-12T18:10:22.742416+0000","last_clean":"2024-09-12T18:10:22.742416+0000","last_became_active":"2024-09-12T17:16:11.488433+0000","last_became_peered":"2024-09-12T17:16:11.488433+0000","last_unstale":"2024-09-12T18:10:22.742416+0000","last_undegraded":"2024-09-12T18:10:22.742416+0000","last_fullsized":"2024-09-12T18:10:22.742416+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:14.398588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":34,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.755896+0000","last_change":"2024-09-12T17:39:05.927566+0000","last_active":"2024-09-12T18:10:22.755896+0000","last_peered":"2024-09-12T18:10:22.755896+0000","last_clean":"2024-09-12T18:10:22.755896+0000","last_became_active":"2024-09-12T17:39:05.925525+0000","last_became_peered":"2024-09-12T17:39:05.925525+0000","last_unstale":"2024-09-12T18:10:22.755896+0000","last_undegraded":"2024-09-12T18:10:22.755896+0000","last_fullsized":"2024-09-12T18:10:22.755896+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:27.269945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:56.637772+0000","last_change":"2024-09-12T17:20:34.559275+0000","last_active":"2024-09-12T18:12:56.637772+0000","last_peered":"2024-09-12T18:12:56.637772+0000","last_clean":"2024-09-12T18:12:56.637772+0000","last_became_active":"2024-09-12T17:20:34.558946+0000","last_became_peered":"2024-09-12T17:20:34.558946+0000","last_unstale":"2024-09-12T18:12:56.637772+0000","last_undegraded":"2024-09-12T18:12:56.637772+0000","last_fullsized":"2024-09-12T18:12:56.637772+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:44.945949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'4","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.757518+0000","last_change":"2024-09-12T17:20:30.528368+0000","last_active":"2024-09-12T18:10:32.757518+0000","last_peered":"2024-09-12T18:10:32.757518+0000","last_clean":"2024-09-12T18:10:32.757518+0000","last_became_active":"2024-09-12T17:20:30.528078+0000","last_became_peered":"2024-09-12T17:20:30.528078+0000","last_unstale":"2024-09-12T18:10:32.757518+0000","last_undegraded":"2024-09-12T18:10:32.757518+0000","last_fullsized":"2024-09-12T18:10:32.757518+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:37.188849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'44","reported_seq":182,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619260+0000","last_change":"2024-09-12T17:16:11.481733+0000","last_active":"2024-09-12T18:10:21.619260+0000","last_peered":"2024-09-12T18:10:21.619260+0000","last_clean":"2024-09-12T18:10:21.619260+0000","last_became_active":"2024-09-12T17:16:11.481431+0000","last_became_peered":"2024-09-12T17:16:11.481431+0000","last_unstale":"2024-09-12T18:10:21.619260+0000","last_undegraded":"2024-09-12T18:10:21.619260+0000","last_fullsized":"2024-09-12T18:10:21.619260+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:47.517502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":166,"num_write":69,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954425+0000","last_change":"2024-09-12T17:39:05.919499+0000","last_active":"2024-09-12T18:10:22.954425+0000","last_peered":"2024-09-12T18:10:22.954425+0000","last_clean":"2024-09-12T18:10:22.954425+0000","last_became_active":"2024-09-12T17:39:05.919207+0000","last_became_peered":"2024-09-12T17:39:05.919207+0000","last_unstale":"2024-09-12T18:10:22.954425+0000","last_undegraded":"2024-09-12T18:10:22.954425+0000","last_fullsized":"2024-09-12T18:10:22.954425+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:26.247547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'10","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.517672+0000","last_change":"2024-09-12T17:20:34.613162+0000","last_active":"2024-09-12T18:13:48.517672+0000","last_peered":"2024-09-12T18:13:48.517672+0000","last_clean":"2024-09-12T18:13:48.517672+0000","last_became_active":"2024-09-12T17:20:34.612840+0000","last_became_peered":"2024-09-12T17:20:34.612840+0000","last_unstale":"2024-09-12T18:13:48.517672+0000","last_undegraded":"2024-09-12T18:13:48.517672+0000","last_fullsized":"2024-09-12T18:13:48.517672+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:07.359408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":10,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:43.700925+0000","last_change":"2024-09-12T17:20:30.539195+0000","last_active":"2024-09-12T18:10:43.700925+0000","last_peered":"2024-09-12T18:10:43.700925+0000","last_clean":"2024-09-12T18:10:43.700925+0000","last_became_active":"2024-09-12T17:20:30.538913+0000","last_became_peered":"2024-09-12T17:20:30.538913+0000","last_unstale":"2024-09-12T18:10:43.700925+0000","last_undegraded":"2024-09-12T18:10:43.700925+0000","last_fullsized":"2024-09-12T18:10:43.700925+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:30.309214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'103","reported_seq":385,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.742516+0000","last_change":"2024-09-12T17:16:11.489384+0000","last_active":"2024-09-12T18:10:22.742516+0000","last_peered":"2024-09-12T18:10:22.742516+0000","last_clean":"2024-09-12T18:10:22.742516+0000","last_became_active":"2024-09-12T17:16:11.489087+0000","last_became_peered":"2024-09-12T17:16:11.489087+0000","last_unstale":"2024-09-12T18:10:22.742516+0000","last_undegraded":"2024-09-12T18:10:22.742516+0000","last_fullsized":"2024-09-12T18:10:22.742516+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:44.577138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":629,"num_read_kb":433,"num_write":144,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.922659+0000","last_change":"2024-09-12T17:39:05.921957+0000","last_active":"2024-09-12T18:11:13.922659+0000","last_peered":"2024-09-12T18:11:13.922659+0000","last_clean":"2024-09-12T18:11:13.922659+0000","last_became_active":"2024-09-12T17:39:05.921608+0000","last_became_peered":"2024-09-12T17:39:05.921608+0000","last_unstale":"2024-09-12T18:11:13.922659+0000","last_undegraded":"2024-09-12T18:11:13.922659+0000","last_fullsized":"2024-09-12T18:11:13.922659+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:54.960277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.756818+0000","last_change":"2024-09-12T17:20:34.611054+0000","last_active":"2024-09-12T18:10:27.756818+0000","last_peered":"2024-09-12T18:10:27.756818+0000","last_clean":"2024-09-12T18:10:27.756818+0000","last_became_active":"2024-09-12T17:20:34.610719+0000","last_became_peered":"2024-09-12T17:20:34.610719+0000","last_unstale":"2024-09-12T18:10:27.756818+0000","last_undegraded":"2024-09-12T18:10:27.756818+0000","last_fullsized":"2024-09-12T18:10:27.756818+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:24.284192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954530+0000","last_change":"2024-09-12T17:20:30.535657+0000","last_active":"2024-09-12T18:10:22.954530+0000","last_peered":"2024-09-12T18:10:22.954530+0000","last_clean":"2024-09-12T18:10:22.954530+0000","last_became_active":"2024-09-12T17:20:30.535382+0000","last_became_peered":"2024-09-12T17:20:30.535382+0000","last_unstale":"2024-09-12T18:10:22.954530+0000","last_undegraded":"2024-09-12T18:10:22.954530+0000","last_fullsized":"2024-09-12T18:10:22.954530+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:06.602123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'27","reported_seq":132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.757540+0000","last_change":"2024-09-12T17:16:11.487072+0000","last_active":"2024-09-12T18:10:32.757540+0000","last_peered":"2024-09-12T18:10:32.757540+0000","last_clean":"2024-09-12T18:10:32.757540+0000","last_became_active":"2024-09-12T17:16:11.486799+0000","last_became_peered":"2024-09-12T17:16:11.486799+0000","last_unstale":"2024-09-12T18:10:32.757540+0000","last_undegraded":"2024-09-12T18:10:32.757540+0000","last_fullsized":"2024-09-12T18:10:32.757540+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:25.256158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":89,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.753105+0000","last_change":"2024-09-12T17:39:05.923468+0000","last_active":"2024-09-12T18:10:20.753105+0000","last_peered":"2024-09-12T18:10:20.753105+0000","last_clean":"2024-09-12T18:10:20.753105+0000","last_became_active":"2024-09-12T17:39:05.923192+0000","last_became_peered":"2024-09-12T17:39:05.923192+0000","last_unstale":"2024-09-12T18:10:20.753105+0000","last_undegraded":"2024-09-12T18:10:20.753105+0000","last_fullsized":"2024-09-12T18:10:20.753105+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:18.451237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'4","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.514438+0000","last_change":"2024-09-12T17:20:34.555545+0000","last_active":"2024-09-12T18:13:48.514438+0000","last_peered":"2024-09-12T18:13:48.514438+0000","last_clean":"2024-09-12T18:13:48.514438+0000","last_became_active":"2024-09-12T17:20:34.555267+0000","last_became_peered":"2024-09-12T17:20:34.555267+0000","last_unstale":"2024-09-12T18:13:48.514438+0000","last_undegraded":"2024-09-12T18:13:48.514438+0000","last_fullsized":"2024-09-12T18:13:48.514438+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:48.447926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'4","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:32.776088+0000","last_change":"2024-09-12T17:20:30.531341+0000","last_active":"2024-09-12T18:12:32.776088+0000","last_peered":"2024-09-12T18:12:32.776088+0000","last_clean":"2024-09-12T18:12:32.776088+0000","last_became_active":"2024-09-12T17:20:30.530998+0000","last_became_peered":"2024-09-12T17:20:30.530998+0000","last_unstale":"2024-09-12T18:12:32.776088+0000","last_undegraded":"2024-09-12T18:12:32.776088+0000","last_fullsized":"2024-09-12T18:12:32.776088+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:28.087866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'20","reported_seq":119,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:23.917537+0000","last_change":"2024-09-12T17:16:11.487744+0000","last_active":"2024-09-12T18:10:23.917537+0000","last_peered":"2024-09-12T18:10:23.917537+0000","last_clean":"2024-09-12T18:10:23.917537+0000","last_became_active":"2024-09-12T17:16:11.487439+0000","last_became_peered":"2024-09-12T17:16:11.487439+0000","last_unstale":"2024-09-12T18:10:23.917537+0000","last_undegraded":"2024-09-12T18:10:23.917537+0000","last_fullsized":"2024-09-12T18:10:23.917537+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:01.381415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":36,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:38.706396+0000","last_change":"2024-09-12T17:39:05.923711+0000","last_active":"2024-09-12T18:11:38.706396+0000","last_peered":"2024-09-12T18:11:38.706396+0000","last_clean":"2024-09-12T18:11:38.706396+0000","last_became_active":"2024-09-12T17:39:05.923420+0000","last_became_peered":"2024-09-12T17:39:05.923420+0000","last_unstale":"2024-09-12T18:11:38.706396+0000","last_undegraded":"2024-09-12T18:11:38.706396+0000","last_fullsized":"2024-09-12T18:11:38.706396+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:30.324051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'5","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:38.934756+0000","last_change":"2024-09-12T17:20:34.558121+0000","last_active":"2024-09-12T18:12:38.934756+0000","last_peered":"2024-09-12T18:12:38.934756+0000","last_clean":"2024-09-12T18:12:38.934756+0000","last_became_active":"2024-09-12T17:20:34.557794+0000","last_became_peered":"2024-09-12T17:20:34.557794+0000","last_unstale":"2024-09-12T18:12:38.934756+0000","last_undegraded":"2024-09-12T18:12:38.934756+0000","last_fullsized":"2024-09-12T18:12:38.934756+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:35.789851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'8","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.351546+0000","last_change":"2024-09-12T17:20:30.538275+0000","last_active":"2024-09-12T18:13:49.351546+0000","last_peered":"2024-09-12T18:13:49.351546+0000","last_clean":"2024-09-12T18:13:49.351546+0000","last_became_active":"2024-09-12T17:20:30.537970+0000","last_became_peered":"2024-09-12T17:20:30.537970+0000","last_unstale":"2024-09-12T18:13:49.351546+0000","last_undegraded":"2024-09-12T18:13:49.351546+0000","last_fullsized":"2024-09-12T18:13:49.351546+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:25.105193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":19458,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'24","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954441+0000","last_change":"2024-09-12T17:16:11.487378+0000","last_active":"2024-09-12T18:10:22.954441+0000","last_peered":"2024-09-12T18:10:22.954441+0000","last_clean":"2024-09-12T18:10:22.954441+0000","last_became_active":"2024-09-12T17:16:11.486298+0000","last_became_peered":"2024-09-12T17:16:11.486298+0000","last_unstale":"2024-09-12T18:10:22.954441+0000","last_undegraded":"2024-09-12T18:10:22.954441+0000","last_fullsized":"2024-09-12T18:10:22.954441+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:22.173224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:36.627544+0000","last_change":"2024-09-12T17:39:05.921428+0000","last_active":"2024-09-12T18:11:36.627544+0000","last_peered":"2024-09-12T18:11:36.627544+0000","last_clean":"2024-09-12T18:11:36.627544+0000","last_became_active":"2024-09-12T17:39:05.921085+0000","last_became_peered":"2024-09-12T17:39:05.921085+0000","last_unstale":"2024-09-12T18:11:36.627544+0000","last_undegraded":"2024-09-12T18:11:36.627544+0000","last_fullsized":"2024-09-12T18:11:36.627544+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:12.796863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'6","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.515124+0000","last_change":"2024-09-12T17:20:34.559242+0000","last_active":"2024-09-12T18:13:48.515124+0000","last_peered":"2024-09-12T18:13:48.515124+0000","last_clean":"2024-09-12T18:13:48.515124+0000","last_became_active":"2024-09-12T17:20:34.558963+0000","last_became_peered":"2024-09-12T17:20:34.558963+0000","last_unstale":"2024-09-12T18:13:48.515124+0000","last_undegraded":"2024-09-12T18:13:48.515124+0000","last_fullsized":"2024-09-12T18:13:48.515124+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:24.912978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.757457+0000","last_change":"2024-09-12T17:20:30.524694+0000","last_active":"2024-09-12T18:10:32.757457+0000","last_peered":"2024-09-12T18:10:32.757457+0000","last_clean":"2024-09-12T18:10:32.757457+0000","last_became_active":"2024-09-12T17:20:30.524377+0000","last_became_peered":"2024-09-12T17:20:30.524377+0000","last_unstale":"2024-09-12T18:10:32.757457+0000","last_undegraded":"2024-09-12T18:10:32.757457+0000","last_fullsized":"2024-09-12T18:10:32.757457+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:30.709529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'59","reported_seq":225,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.753135+0000","last_change":"2024-09-12T17:16:11.491864+0000","last_active":"2024-09-12T18:10:20.753135+0000","last_peered":"2024-09-12T18:10:20.753135+0000","last_clean":"2024-09-12T18:10:20.753135+0000","last_became_active":"2024-09-12T17:16:11.491512+0000","last_became_peered":"2024-09-12T17:16:11.491512+0000","last_unstale":"2024-09-12T18:10:20.753135+0000","last_undegraded":"2024-09-12T18:10:20.753135+0000","last_fullsized":"2024-09-12T18:10:20.753135+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:58.986968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":313,"num_read_kb":225,"num_write":101,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619193+0000","last_change":"2024-09-12T17:39:05.926334+0000","last_active":"2024-09-12T18:10:21.619193+0000","last_peered":"2024-09-12T18:10:21.619193+0000","last_clean":"2024-09-12T18:10:21.619193+0000","last_became_active":"2024-09-12T17:39:05.926029+0000","last_became_peered":"2024-09-12T17:39:05.926029+0000","last_unstale":"2024-09-12T18:10:21.619193+0000","last_undegraded":"2024-09-12T18:10:21.619193+0000","last_fullsized":"2024-09-12T18:10:21.619193+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:44.569050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"261'2","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.744693+0000","last_change":"2024-09-12T17:20:34.555632+0000","last_active":"2024-09-12T18:10:37.744693+0000","last_peered":"2024-09-12T18:10:37.744693+0000","last_clean":"2024-09-12T18:10:37.744693+0000","last_became_active":"2024-09-12T17:20:34.555137+0000","last_became_peered":"2024-09-12T17:20:34.555137+0000","last_unstale":"2024-09-12T18:10:37.744693+0000","last_undegraded":"2024-09-12T18:10:37.744693+0000","last_fullsized":"2024-09-12T18:10:37.744693+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:44.659171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'2","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:38.934811+0000","last_change":"2024-09-12T17:20:30.531528+0000","last_active":"2024-09-12T18:12:38.934811+0000","last_peered":"2024-09-12T18:12:38.934811+0000","last_clean":"2024-09-12T18:12:38.934811+0000","last_became_active":"2024-09-12T17:20:30.531232+0000","last_became_peered":"2024-09-12T17:20:30.531232+0000","last_unstale":"2024-09-12T18:12:38.934811+0000","last_undegraded":"2024-09-12T18:12:38.934811+0000","last_fullsized":"2024-09-12T18:12:38.934811+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:17.702865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'13","reported_seq":98,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.742450+0000","last_change":"2024-09-12T17:16:11.491691+0000","last_active":"2024-09-12T18:10:22.742450+0000","last_peered":"2024-09-12T18:10:22.742450+0000","last_clean":"2024-09-12T18:10:22.742450+0000","last_became_active":"2024-09-12T17:16:11.491334+0000","last_became_peered":"2024-09-12T17:16:11.491334+0000","last_unstale":"2024-09-12T18:10:22.742450+0000","last_undegraded":"2024-09-12T18:10:22.742450+0000","last_fullsized":"2024-09-12T18:10:22.742450+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:26.856534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":49,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.756721+0000","last_change":"2024-09-12T17:39:05.930558+0000","last_active":"2024-09-12T18:10:27.756721+0000","last_peered":"2024-09-12T18:10:27.756721+0000","last_clean":"2024-09-12T18:10:27.756721+0000","last_became_active":"2024-09-12T17:39:05.930326+0000","last_became_peered":"2024-09-12T17:39:05.930326+0000","last_unstale":"2024-09-12T18:10:27.756721+0000","last_undegraded":"2024-09-12T18:10:27.756721+0000","last_fullsized":"2024-09-12T18:10:27.756721+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:01.120642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'6","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:40.774570+0000","last_change":"2024-09-12T17:20:34.556804+0000","last_active":"2024-09-12T18:12:40.774570+0000","last_peered":"2024-09-12T18:12:40.774570+0000","last_clean":"2024-09-12T18:12:40.774570+0000","last_became_active":"2024-09-12T17:20:34.554832+0000","last_became_peered":"2024-09-12T17:20:34.554832+0000","last_unstale":"2024-09-12T18:12:40.774570+0000","last_undegraded":"2024-09-12T18:12:40.774570+0000","last_fullsized":"2024-09-12T18:12:40.774570+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:59.545466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'4","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.360460+0000","last_change":"2024-09-12T17:20:30.528814+0000","last_active":"2024-09-12T18:13:48.360460+0000","last_peered":"2024-09-12T18:13:48.360460+0000","last_clean":"2024-09-12T18:13:48.360460+0000","last_became_active":"2024-09-12T17:20:30.528541+0000","last_became_peered":"2024-09-12T17:20:30.528541+0000","last_unstale":"2024-09-12T18:13:48.360460+0000","last_undegraded":"2024-09-12T18:13:48.360460+0000","last_fullsized":"2024-09-12T18:13:48.360460+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:39.437987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'21","reported_seq":117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.755820+0000","last_change":"2024-09-12T17:16:11.487563+0000","last_active":"2024-09-12T18:10:22.755820+0000","last_peered":"2024-09-12T18:10:22.755820+0000","last_clean":"2024-09-12T18:10:22.755820+0000","last_became_active":"2024-09-12T17:16:11.487238+0000","last_became_peered":"2024-09-12T17:16:11.487238+0000","last_unstale":"2024-09-12T18:10:22.755820+0000","last_undegraded":"2024-09-12T18:10:22.755820+0000","last_fullsized":"2024-09-12T18:10:22.755820+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:39.870434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":71,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'372","reported_seq":1009,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.441003+0000","last_change":"2024-09-12T17:00:12.304380+0000","last_active":"2024-09-12T18:13:49.441003+0000","last_peered":"2024-09-12T18:13:49.441003+0000","last_clean":"2024-09-12T18:13:49.441003+0000","last_became_active":"2024-09-12T17:00:12.304074+0000","last_became_peered":"2024-09-12T17:00:12.304074+0000","last_unstale":"2024-09-12T18:13:49.441003+0000","last_undegraded":"2024-09-12T18:13:49.441003+0000","last_fullsized":"2024-09-12T18:13:49.441003+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:10:33.200742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":637523,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":542,"num_read_kb":3821,"num_write":1162,"num_write_kb":12701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'137","reported_seq":747,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.953601+0000","last_change":"2024-09-12T17:00:14.328728+0000","last_active":"2024-09-12T18:10:17.953601+0000","last_peered":"2024-09-12T18:10:17.953601+0000","last_clean":"2024-09-12T18:10:17.953601+0000","last_became_active":"2024-09-12T17:00:14.328464+0000","last_became_peered":"2024-09-12T17:00:14.328464+0000","last_unstale":"2024-09-12T18:10:17.953601+0000","last_undegraded":"2024-09-12T18:10:17.953601+0000","last_fullsized":"2024-09-12T18:10:17.953601+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:22.736868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":594,"num_read_kb":496,"num_write":221,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'323","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.497357+0000","last_change":"2024-09-12T17:00:12.303038+0000","last_active":"2024-09-12T18:13:49.497357+0000","last_peered":"2024-09-12T18:13:49.497357+0000","last_clean":"2024-09-12T18:13:49.497357+0000","last_became_active":"2024-09-12T17:00:12.302750+0000","last_became_peered":"2024-09-12T17:00:12.302750+0000","last_unstale":"2024-09-12T18:13:49.497357+0000","last_undegraded":"2024-09-12T18:13:49.497357+0000","last_fullsized":"2024-09-12T18:13:49.497357+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:48.905725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":423,"num_read_kb":57739,"num_write":1027,"num_write_kb":55497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'222","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:21.909979+0000","last_change":"2024-09-12T17:00:14.336471+0000","last_active":"2024-09-12T18:13:21.909979+0000","last_peered":"2024-09-12T18:13:21.909979+0000","last_clean":"2024-09-12T18:13:21.909979+0000","last_became_active":"2024-09-12T17:00:14.336238+0000","last_became_peered":"2024-09-12T17:00:14.336238+0000","last_unstale":"2024-09-12T18:13:21.909979+0000","last_undegraded":"2024-09-12T18:13:21.909979+0000","last_fullsized":"2024-09-12T18:13:21.909979+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:33.594656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":973,"num_read_kb":793,"num_write":333,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'342","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.512923+0000","last_change":"2024-09-12T17:00:12.309414+0000","last_active":"2024-09-12T18:13:49.512923+0000","last_peered":"2024-09-12T18:13:49.512923+0000","last_clean":"2024-09-12T18:13:49.512923+0000","last_became_active":"2024-09-12T17:00:12.309132+0000","last_became_peered":"2024-09-12T17:00:12.309132+0000","last_unstale":"2024-09-12T18:13:49.512923+0000","last_undegraded":"2024-09-12T18:13:49.512923+0000","last_fullsized":"2024-09-12T18:13:49.512923+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:14.849278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":529,"num_read_kb":32498,"num_write":1132,"num_write_kb":31975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'254","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:15.752313+0000","last_change":"2024-09-12T17:00:14.324328+0000","last_active":"2024-09-12T18:10:15.752313+0000","last_peered":"2024-09-12T18:10:15.752313+0000","last_clean":"2024-09-12T18:10:15.752313+0000","last_became_active":"2024-09-12T17:00:14.323358+0000","last_became_peered":"2024-09-12T17:00:14.323358+0000","last_unstale":"2024-09-12T18:10:15.752313+0000","last_undegraded":"2024-09-12T18:10:15.752313+0000","last_fullsized":"2024-09-12T18:10:15.752313+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:08.155945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1058,"num_read_kb":862,"num_write":363,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'306","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.496761+0000","last_change":"2024-09-12T17:00:12.321038+0000","last_active":"2024-09-12T18:13:49.496761+0000","last_peered":"2024-09-12T18:13:49.496761+0000","last_clean":"2024-09-12T18:13:49.496761+0000","last_became_active":"2024-09-12T17:00:12.320515+0000","last_became_peered":"2024-09-12T17:00:12.320515+0000","last_unstale":"2024-09-12T18:13:49.496761+0000","last_undegraded":"2024-09-12T18:13:49.496761+0000","last_fullsized":"2024-09-12T18:13:49.496761+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:58.500452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1784539,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":432,"num_read_kb":6790,"num_write":998,"num_write_kb":19852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'120","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:24.988567+0000","last_change":"2024-09-12T17:00:14.335557+0000","last_active":"2024-09-12T18:10:24.988567+0000","last_peered":"2024-09-12T18:10:24.988567+0000","last_clean":"2024-09-12T18:10:24.988567+0000","last_became_active":"2024-09-12T17:00:14.335297+0000","last_became_peered":"2024-09-12T17:00:14.335297+0000","last_unstale":"2024-09-12T18:10:24.988567+0000","last_undegraded":"2024-09-12T18:10:24.988567+0000","last_fullsized":"2024-09-12T18:10:24.988567+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:16.622130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":395,"num_write":174,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'325","reported_seq":961,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.498582+0000","last_change":"2024-09-12T17:00:12.313071+0000","last_active":"2024-09-12T18:13:49.498582+0000","last_peered":"2024-09-12T18:13:49.498582+0000","last_clean":"2024-09-12T18:13:49.498582+0000","last_became_active":"2024-09-12T17:00:12.312762+0000","last_became_peered":"2024-09-12T17:00:12.312762+0000","last_unstale":"2024-09-12T18:13:49.498582+0000","last_undegraded":"2024-09-12T18:13:49.498582+0000","last_fullsized":"2024-09-12T18:13:49.498582+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:00.055270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4593537,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":487,"num_read_kb":9220,"num_write":1043,"num_write_kb":31558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'219","reported_seq":883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.743184+0000","last_change":"2024-09-12T17:00:14.322764+0000","last_active":"2024-09-12T18:10:27.743184+0000","last_peered":"2024-09-12T18:10:27.743184+0000","last_clean":"2024-09-12T18:10:27.743184+0000","last_became_active":"2024-09-12T17:00:14.321640+0000","last_became_peered":"2024-09-12T17:00:14.321640+0000","last_unstale":"2024-09-12T18:10:27.743184+0000","last_undegraded":"2024-09-12T18:10:27.743184+0000","last_fullsized":"2024-09-12T18:10:27.743184+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:15.723927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1016,"num_read_kb":865,"num_write":355,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'365","reported_seq":1015,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.491363+0000","last_change":"2024-09-12T17:00:12.320191+0000","last_active":"2024-09-12T18:13:49.491363+0000","last_peered":"2024-09-12T18:13:49.491363+0000","last_clean":"2024-09-12T18:13:49.491363+0000","last_became_active":"2024-09-12T17:00:12.319917+0000","last_became_peered":"2024-09-12T17:00:12.319917+0000","last_unstale":"2024-09-12T18:13:49.491363+0000","last_undegraded":"2024-09-12T18:13:49.491363+0000","last_fullsized":"2024-09-12T18:13:49.491363+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:05.028474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432807,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":38218,"num_write":1060,"num_write_kb":26572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'175","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:05.760285+0000","last_change":"2024-09-12T17:00:14.333352+0000","last_active":"2024-09-12T18:11:05.760285+0000","last_peered":"2024-09-12T18:11:05.760285+0000","last_clean":"2024-09-12T18:11:05.760285+0000","last_became_active":"2024-09-12T17:00:14.332940+0000","last_became_peered":"2024-09-12T17:00:14.332940+0000","last_unstale":"2024-09-12T18:11:05.760285+0000","last_undegraded":"2024-09-12T18:11:05.760285+0000","last_fullsized":"2024-09-12T18:11:05.760285+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:50.722062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":715,"num_read_kb":606,"num_write":241,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'321","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.431126+0000","last_change":"2024-09-12T17:00:12.305312+0000","last_active":"2024-09-12T18:13:49.431126+0000","last_peered":"2024-09-12T18:13:49.431126+0000","last_clean":"2024-09-12T18:13:49.431126+0000","last_became_active":"2024-09-12T17:00:12.304504+0000","last_became_peered":"2024-09-12T17:00:12.304504+0000","last_unstale":"2024-09-12T18:13:49.431126+0000","last_undegraded":"2024-09-12T18:13:49.431126+0000","last_fullsized":"2024-09-12T18:13:49.431126+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:07.619706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1691575,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":533,"num_read_kb":24452,"num_write":1091,"num_write_kb":21520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'176","reported_seq":772,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.961391+0000","last_change":"2024-09-12T17:00:14.332604+0000","last_active":"2024-09-12T18:11:07.961391+0000","last_peered":"2024-09-12T18:11:07.961391+0000","last_clean":"2024-09-12T18:11:07.961391+0000","last_became_active":"2024-09-12T17:00:14.332360+0000","last_became_peered":"2024-09-12T17:00:14.332360+0000","last_unstale":"2024-09-12T18:11:07.961391+0000","last_undegraded":"2024-09-12T18:11:07.961391+0000","last_fullsized":"2024-09-12T18:11:07.961391+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:55.182932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":738,"num_read_kb":599,"num_write":278,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'363","reported_seq":1068,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.499305+0000","last_change":"2024-09-12T17:00:12.322666+0000","last_active":"2024-09-12T18:13:49.499305+0000","last_peered":"2024-09-12T18:13:49.499305+0000","last_clean":"2024-09-12T18:13:49.499305+0000","last_became_active":"2024-09-12T17:00:12.322419+0000","last_became_peered":"2024-09-12T17:00:12.322419+0000","last_unstale":"2024-09-12T18:13:49.499305+0000","last_undegraded":"2024-09-12T18:13:49.499305+0000","last_fullsized":"2024-09-12T18:13:49.499305+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:12.248593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786486,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":661,"num_read_kb":7776,"num_write":1130,"num_write_kb":24985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'60","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:03.703001+0000","last_change":"2024-09-12T17:00:14.334885+0000","last_active":"2024-09-12T18:11:03.703001+0000","last_peered":"2024-09-12T18:11:03.703001+0000","last_clean":"2024-09-12T18:11:03.703001+0000","last_became_active":"2024-09-12T17:00:14.334586+0000","last_became_peered":"2024-09-12T17:00:14.334586+0000","last_unstale":"2024-09-12T18:11:03.703001+0000","last_undegraded":"2024-09-12T18:11:03.703001+0000","last_fullsized":"2024-09-12T18:11:03.703001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:29.087177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":225,"num_write":86,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'142","reported_seq":765,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:15.752206+0000","last_change":"2024-09-12T17:00:14.323537+0000","last_active":"2024-09-12T18:10:15.752206+0000","last_peered":"2024-09-12T18:10:15.752206+0000","last_clean":"2024-09-12T18:10:15.752206+0000","last_became_active":"2024-09-12T17:00:14.322771+0000","last_became_peered":"2024-09-12T17:00:14.322771+0000","last_unstale":"2024-09-12T18:10:15.752206+0000","last_undegraded":"2024-09-12T18:10:15.752206+0000","last_fullsized":"2024-09-12T18:10:15.752206+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:13.873569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":650,"num_read_kb":543,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'374","reported_seq":1132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.505290+0000","last_change":"2024-09-12T17:00:46.407269+0000","last_active":"2024-09-12T18:13:49.505290+0000","last_peered":"2024-09-12T18:13:49.505290+0000","last_clean":"2024-09-12T18:13:49.505290+0000","last_became_active":"2024-09-12T17:00:46.406911+0000","last_became_peered":"2024-09-12T17:00:46.406911+0000","last_unstale":"2024-09-12T18:13:49.505290+0000","last_undegraded":"2024-09-12T18:13:49.505290+0000","last_fullsized":"2024-09-12T18:13:49.505290+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:22.337640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029268,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":749,"num_read_kb":51923,"num_write":1318,"num_write_kb":31895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'117","reported_seq":724,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.755079+0000","last_change":"2024-09-12T17:00:14.336399+0000","last_active":"2024-09-12T18:10:17.755079+0000","last_peered":"2024-09-12T18:10:17.755079+0000","last_clean":"2024-09-12T18:10:17.755079+0000","last_became_active":"2024-09-12T17:00:14.336161+0000","last_became_peered":"2024-09-12T17:00:14.336161+0000","last_unstale":"2024-09-12T18:10:17.755079+0000","last_undegraded":"2024-09-12T18:10:17.755079+0000","last_fullsized":"2024-09-12T18:10:17.755079+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:57.473607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":545,"num_read_kb":462,"num_write":195,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'336","reported_seq":1022,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.496450+0000","last_change":"2024-09-12T17:00:12.310880+0000","last_active":"2024-09-12T18:13:49.496450+0000","last_peered":"2024-09-12T18:13:49.496450+0000","last_clean":"2024-09-12T18:13:49.496450+0000","last_became_active":"2024-09-12T17:00:12.310589+0000","last_became_peered":"2024-09-12T17:00:12.310589+0000","last_unstale":"2024-09-12T18:13:49.496450+0000","last_undegraded":"2024-09-12T18:13:49.496450+0000","last_fullsized":"2024-09-12T18:13:49.496450+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:43.821237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":594,"num_read_kb":8321,"num_write":1002,"num_write_kb":31830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'144","reported_seq":725,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.964476+0000","last_change":"2024-09-12T17:00:14.325153+0000","last_active":"2024-09-12T18:12:02.964476+0000","last_peered":"2024-09-12T18:12:02.964476+0000","last_clean":"2024-09-12T18:12:02.964476+0000","last_became_active":"2024-09-12T17:00:14.324889+0000","last_became_peered":"2024-09-12T17:00:14.324889+0000","last_unstale":"2024-09-12T18:12:02.964476+0000","last_undegraded":"2024-09-12T18:12:02.964476+0000","last_fullsized":"2024-09-12T18:12:02.964476+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:11.915771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":586,"num_read_kb":478,"num_write":211,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'332","reported_seq":961,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.523725+0000","last_change":"2024-09-12T17:00:12.315972+0000","last_active":"2024-09-12T18:13:49.523725+0000","last_peered":"2024-09-12T18:13:49.523725+0000","last_clean":"2024-09-12T18:13:49.523725+0000","last_became_active":"2024-09-12T17:00:12.315652+0000","last_became_peered":"2024-09-12T17:00:12.315652+0000","last_unstale":"2024-09-12T18:13:49.523725+0000","last_undegraded":"2024-09-12T18:13:49.523725+0000","last_fullsized":"2024-09-12T18:13:49.523725+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:33.033611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":305880,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":503,"num_read_kb":21524,"num_write":1088,"num_write_kb":35144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'78","reported_seq":629,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:18.698535+0000","last_change":"2024-09-12T17:00:14.335255+0000","last_active":"2024-09-12T18:10:18.698535+0000","last_peered":"2024-09-12T18:10:18.698535+0000","last_clean":"2024-09-12T18:10:18.698535+0000","last_became_active":"2024-09-12T17:00:14.335009+0000","last_became_peered":"2024-09-12T17:00:14.335009+0000","last_unstale":"2024-09-12T18:10:18.698535+0000","last_undegraded":"2024-09-12T18:10:18.698535+0000","last_fullsized":"2024-09-12T18:10:18.698535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:36.037057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":353,"num_read_kb":297,"num_write":121,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'355","reported_seq":1016,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.503219+0000","last_change":"2024-09-12T17:00:12.313118+0000","last_active":"2024-09-12T18:13:49.503219+0000","last_peered":"2024-09-12T18:13:49.503219+0000","last_clean":"2024-09-12T18:13:49.503219+0000","last_became_active":"2024-09-12T17:00:12.312828+0000","last_became_peered":"2024-09-12T17:00:12.312828+0000","last_unstale":"2024-09-12T18:13:49.503219+0000","last_undegraded":"2024-09-12T18:13:49.503219+0000","last_fullsized":"2024-09-12T18:13:49.503219+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:31.791812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850167,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":541,"num_read_kb":47220,"num_write":1168,"num_write_kb":32154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'190","reported_seq":830,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:18.698566+0000","last_change":"2024-09-12T17:00:14.328021+0000","last_active":"2024-09-12T18:10:18.698566+0000","last_peered":"2024-09-12T18:10:18.698566+0000","last_clean":"2024-09-12T18:10:18.698566+0000","last_became_active":"2024-09-12T17:00:14.327744+0000","last_became_peered":"2024-09-12T17:00:14.327744+0000","last_unstale":"2024-09-12T18:10:18.698566+0000","last_undegraded":"2024-09-12T18:10:18.698566+0000","last_fullsized":"2024-09-12T18:10:18.698566+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:10.529599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":833,"num_read_kb":695,"num_write":274,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'310","reported_seq":1093,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.484267+0000","last_change":"2024-09-12T17:00:12.319914+0000","last_active":"2024-09-12T18:13:49.484267+0000","last_peered":"2024-09-12T18:13:49.484267+0000","last_clean":"2024-09-12T18:13:49.484267+0000","last_became_active":"2024-09-12T17:00:12.319649+0000","last_became_peered":"2024-09-12T17:00:12.319649+0000","last_unstale":"2024-09-12T18:13:49.484267+0000","last_undegraded":"2024-09-12T18:13:49.484267+0000","last_fullsized":"2024-09-12T18:13:49.484267+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:03.094320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655853,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":737,"num_read_kb":130250,"num_write":941,"num_write_kb":66985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'137","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.753208+0000","last_change":"2024-09-12T17:00:14.329425+0000","last_active":"2024-09-12T18:10:20.753208+0000","last_peered":"2024-09-12T18:10:20.753208+0000","last_clean":"2024-09-12T18:10:20.753208+0000","last_became_active":"2024-09-12T17:00:14.329107+0000","last_became_peered":"2024-09-12T17:00:14.329107+0000","last_unstale":"2024-09-12T18:10:20.753208+0000","last_undegraded":"2024-09-12T18:10:20.753208+0000","last_fullsized":"2024-09-12T18:10:20.753208+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:18.916868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":644,"num_read_kb":539,"num_write":215,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'367","reported_seq":1104,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.498901+0000","last_change":"2024-09-12T17:00:12.308630+0000","last_active":"2024-09-12T18:13:49.498901+0000","last_peered":"2024-09-12T18:13:49.498901+0000","last_clean":"2024-09-12T18:13:49.498901+0000","last_became_active":"2024-09-12T17:00:12.307906+0000","last_became_peered":"2024-09-12T17:00:12.307906+0000","last_unstale":"2024-09-12T18:13:49.498901+0000","last_undegraded":"2024-09-12T18:13:49.498901+0000","last_fullsized":"2024-09-12T18:13:49.498901+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:48.118605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524322,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":712,"num_read_kb":3845,"num_write":1087,"num_write_kb":30178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'131","reported_seq":641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.108183+0000","last_change":"2024-09-12T17:00:22.355877+0000","last_active":"2024-09-12T18:12:03.108183+0000","last_peered":"2024-09-12T18:12:03.108183+0000","last_clean":"2024-09-12T18:12:03.108183+0000","last_became_active":"2024-09-12T17:00:22.355591+0000","last_became_peered":"2024-09-12T17:00:22.355591+0000","last_unstale":"2024-09-12T18:12:03.108183+0000","last_undegraded":"2024-09-12T18:12:03.108183+0000","last_fullsized":"2024-09-12T18:12:03.108183+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:28:58.673978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1447,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":175,"num_read_kb":172,"num_write":326,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'85","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.843638+0000","last_change":"2024-09-12T17:00:14.336449+0000","last_active":"2024-09-12T18:10:26.843638+0000","last_peered":"2024-09-12T18:10:26.843638+0000","last_clean":"2024-09-12T18:10:26.843638+0000","last_became_active":"2024-09-12T17:00:14.336144+0000","last_became_peered":"2024-09-12T17:00:14.336144+0000","last_unstale":"2024-09-12T18:10:26.843638+0000","last_undegraded":"2024-09-12T18:10:26.843638+0000","last_fullsized":"2024-09-12T18:10:26.843638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:36.033113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":388,"num_read_kb":332,"num_write":123,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'338","reported_seq":959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.495354+0000","last_change":"2024-09-12T17:00:46.721301+0000","last_active":"2024-09-12T18:13:49.495354+0000","last_peered":"2024-09-12T18:13:49.495354+0000","last_clean":"2024-09-12T18:13:49.495354+0000","last_became_active":"2024-09-12T17:00:46.720989+0000","last_became_peered":"2024-09-12T17:00:46.720989+0000","last_unstale":"2024-09-12T18:13:49.495354+0000","last_undegraded":"2024-09-12T18:13:49.495354+0000","last_fullsized":"2024-09-12T18:13:49.495354+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:03.810826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":487,"num_read_kb":63990,"num_write":1055,"num_write_kb":41211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954509+0000","last_change":"2024-09-12T17:00:16.326154+0000","last_active":"2024-09-12T18:10:22.954509+0000","last_peered":"2024-09-12T18:10:22.954509+0000","last_clean":"2024-09-12T18:10:22.954509+0000","last_became_active":"2024-09-12T17:00:16.325868+0000","last_became_peered":"2024-09-12T17:00:16.325868+0000","last_unstale":"2024-09-12T18:10:22.954509+0000","last_undegraded":"2024-09-12T18:10:22.954509+0000","last_fullsized":"2024-09-12T18:10:22.954509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:07.781526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'339","reported_seq":966,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.973087+0000","last_change":"2024-09-12T17:00:18.329828+0000","last_active":"2024-09-12T18:13:48.973087+0000","last_peered":"2024-09-12T18:13:48.973087+0000","last_clean":"2024-09-12T18:13:48.973087+0000","last_became_active":"2024-09-12T17:00:18.329515+0000","last_became_peered":"2024-09-12T17:00:18.329515+0000","last_unstale":"2024-09-12T18:13:48.973087+0000","last_undegraded":"2024-09-12T18:13:48.973087+0000","last_fullsized":"2024-09-12T18:13:48.973087+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:07.586238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49756,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":1157,"num_write":430,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.756841+0000","last_change":"2024-09-12T17:00:20.349019+0000","last_active":"2024-09-12T18:10:27.756841+0000","last_peered":"2024-09-12T18:10:27.756841+0000","last_clean":"2024-09-12T18:10:27.756841+0000","last_became_active":"2024-09-12T17:00:20.348524+0000","last_became_peered":"2024-09-12T17:00:20.348524+0000","last_unstale":"2024-09-12T18:10:27.756841+0000","last_undegraded":"2024-09-12T18:10:27.756841+0000","last_fullsized":"2024-09-12T18:10:27.756841+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:34.615435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'165","reported_seq":725,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:42.957515+0000","last_change":"2024-09-12T17:00:22.357994+0000","last_active":"2024-09-12T18:10:42.957515+0000","last_peered":"2024-09-12T18:10:42.957515+0000","last_clean":"2024-09-12T18:10:42.957515+0000","last_became_active":"2024-09-12T17:00:22.357688+0000","last_became_peered":"2024-09-12T17:00:22.357688+0000","last_unstale":"2024-09-12T18:10:42.957515+0000","last_undegraded":"2024-09-12T18:10:42.957515+0000","last_fullsized":"2024-09-12T18:10:42.957515+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:48.716325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":624,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":254,"num_read_kb":249,"num_write":335,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'314","reported_seq":940,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954488+0000","last_change":"2024-09-12T17:00:14.327416+0000","last_active":"2024-09-12T18:10:22.954488+0000","last_peered":"2024-09-12T18:10:22.954488+0000","last_clean":"2024-09-12T18:10:22.954488+0000","last_became_active":"2024-09-12T17:00:14.327170+0000","last_became_peered":"2024-09-12T17:00:14.327170+0000","last_unstale":"2024-09-12T18:10:22.954488+0000","last_undegraded":"2024-09-12T18:10:22.954488+0000","last_fullsized":"2024-09-12T18:10:22.954488+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:31.084615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1382,"num_read_kb":1112,"num_write":506,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'392","reported_seq":1085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.524236+0000","last_change":"2024-09-12T17:00:12.304639+0000","last_active":"2024-09-12T18:13:49.524236+0000","last_peered":"2024-09-12T18:13:49.524236+0000","last_clean":"2024-09-12T18:13:49.524236+0000","last_became_active":"2024-09-12T17:00:12.304357+0000","last_became_peered":"2024-09-12T17:00:12.304357+0000","last_unstale":"2024-09-12T18:13:49.524236+0000","last_undegraded":"2024-09-12T18:13:49.524236+0000","last_fullsized":"2024-09-12T18:13:49.524236+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:22.101694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2934950,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":656,"num_read_kb":22996,"num_write":1171,"num_write_kb":36092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.843647+0000","last_change":"2024-09-12T17:00:16.323972+0000","last_active":"2024-09-12T18:10:26.843647+0000","last_peered":"2024-09-12T18:10:26.843647+0000","last_clean":"2024-09-12T18:10:26.843647+0000","last_became_active":"2024-09-12T17:00:16.323601+0000","last_became_peered":"2024-09-12T17:00:16.323601+0000","last_unstale":"2024-09-12T18:10:26.843647+0000","last_undegraded":"2024-09-12T18:10:26.843647+0000","last_fullsized":"2024-09-12T18:10:26.843647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:58.961774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'106","reported_seq":646,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.602728+0000","last_change":"2024-09-12T17:00:18.328151+0000","last_active":"2024-09-12T18:11:11.602728+0000","last_peered":"2024-09-12T18:11:11.602728+0000","last_clean":"2024-09-12T18:11:11.602728+0000","last_became_active":"2024-09-12T17:00:18.327744+0000","last_became_peered":"2024-09-12T17:00:18.327744+0000","last_unstale":"2024-09-12T18:11:11.602728+0000","last_undegraded":"2024-09-12T18:11:11.602728+0000","last_fullsized":"2024-09-12T18:11:11.602728+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:37.786807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":113,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:25.753957+0000","last_change":"2024-09-12T17:00:20.348202+0000","last_active":"2024-09-12T18:10:25.753957+0000","last_peered":"2024-09-12T18:10:25.753957+0000","last_clean":"2024-09-12T18:10:25.753957+0000","last_became_active":"2024-09-12T17:00:20.347865+0000","last_became_peered":"2024-09-12T17:00:20.347865+0000","last_unstale":"2024-09-12T18:10:25.753957+0000","last_undegraded":"2024-09-12T18:10:25.753957+0000","last_fullsized":"2024-09-12T18:10:25.753957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:50.254374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'111","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619154+0000","last_change":"2024-09-12T17:00:22.353337+0000","last_active":"2024-09-12T18:10:21.619154+0000","last_peered":"2024-09-12T18:10:21.619154+0000","last_clean":"2024-09-12T18:10:21.619154+0000","last_became_active":"2024-09-12T17:00:22.352912+0000","last_became_peered":"2024-09-12T17:00:22.352912+0000","last_unstale":"2024-09-12T18:10:21.619154+0000","last_undegraded":"2024-09-12T18:10:21.619154+0000","last_fullsized":"2024-09-12T18:10:21.619154+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:40.097046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":708,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":149,"num_read_kb":144,"num_write":248,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'179","reported_seq":806,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619226+0000","last_change":"2024-09-12T17:00:14.337811+0000","last_active":"2024-09-12T18:10:21.619226+0000","last_peered":"2024-09-12T18:10:21.619226+0000","last_clean":"2024-09-12T18:10:21.619226+0000","last_became_active":"2024-09-12T17:00:14.337515+0000","last_became_peered":"2024-09-12T17:00:14.337515+0000","last_unstale":"2024-09-12T18:10:21.619226+0000","last_undegraded":"2024-09-12T18:10:21.619226+0000","last_fullsized":"2024-09-12T18:10:21.619226+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:45.954756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":863,"num_read_kb":715,"num_write":299,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'365","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.513098+0000","last_change":"2024-09-12T17:00:12.308357+0000","last_active":"2024-09-12T18:13:49.513098+0000","last_peered":"2024-09-12T18:13:49.513098+0000","last_clean":"2024-09-12T18:13:49.513098+0000","last_became_active":"2024-09-12T17:00:12.308065+0000","last_became_peered":"2024-09-12T17:00:12.308065+0000","last_unstale":"2024-09-12T18:13:49.513098+0000","last_undegraded":"2024-09-12T18:13:49.513098+0000","last_fullsized":"2024-09-12T18:13:49.513098+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:01.954058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":976913,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":502,"num_read_kb":43207,"num_write":1166,"num_write_kb":32106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.843124+0000","last_change":"2024-09-12T17:00:16.326520+0000","last_active":"2024-09-12T18:10:21.843124+0000","last_peered":"2024-09-12T18:10:21.843124+0000","last_clean":"2024-09-12T18:10:21.843124+0000","last_became_active":"2024-09-12T17:00:16.326073+0000","last_became_peered":"2024-09-12T17:00:16.326073+0000","last_unstale":"2024-09-12T18:10:21.843124+0000","last_undegraded":"2024-09-12T18:10:21.843124+0000","last_fullsized":"2024-09-12T18:10:21.843124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:41.659835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'139","reported_seq":693,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.703133+0000","last_change":"2024-09-12T17:00:18.327751+0000","last_active":"2024-09-12T18:11:11.703133+0000","last_peered":"2024-09-12T18:11:11.703133+0000","last_clean":"2024-09-12T18:11:11.703133+0000","last_became_active":"2024-09-12T17:00:18.327448+0000","last_became_peered":"2024-09-12T17:00:18.327448+0000","last_unstale":"2024-09-12T18:11:11.703133+0000","last_undegraded":"2024-09-12T18:11:11.703133+0000","last_fullsized":"2024-09-12T18:11:11.703133+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:36.026074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":172,"num_read_kb":164,"num_write":118,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'767","reported_seq":2566,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.621806+0000","last_change":"2024-09-12T17:00:20.351615+0000","last_active":"2024-09-12T18:13:48.621806+0000","last_peered":"2024-09-12T18:13:48.621806+0000","last_clean":"2024-09-12T18:13:48.621806+0000","last_became_active":"2024-09-12T17:00:20.351202+0000","last_became_peered":"2024-09-12T17:00:20.351202+0000","last_unstale":"2024-09-12T18:13:48.621806+0000","last_undegraded":"2024-09-12T18:13:48.621806+0000","last_fullsized":"2024-09-12T18:13:48.621806+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:43.494236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'205","reported_seq":1031,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.168160+0000","last_change":"2024-09-12T17:00:22.588416+0000","last_active":"2024-09-12T18:12:03.168160+0000","last_peered":"2024-09-12T18:12:03.168160+0000","last_clean":"2024-09-12T18:12:03.168160+0000","last_became_active":"2024-09-12T17:00:22.588111+0000","last_became_peered":"2024-09-12T17:00:22.588111+0000","last_unstale":"2024-09-12T18:12:03.168160+0000","last_undegraded":"2024-09-12T18:12:03.168160+0000","last_fullsized":"2024-09-12T18:12:03.168160+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:50.047140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":621,"num_read_kb":619,"num_write":443,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'162","reported_seq":797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.843103+0000","last_change":"2024-09-12T17:00:14.332706+0000","last_active":"2024-09-12T18:10:21.843103+0000","last_peered":"2024-09-12T18:10:21.843103+0000","last_clean":"2024-09-12T18:10:21.843103+0000","last_became_active":"2024-09-12T17:00:14.332424+0000","last_became_peered":"2024-09-12T17:00:14.332424+0000","last_unstale":"2024-09-12T18:10:21.843103+0000","last_undegraded":"2024-09-12T18:10:21.843103+0000","last_fullsized":"2024-09-12T18:10:21.843103+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:36.277637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":720,"num_read_kb":605,"num_write":258,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'353","reported_seq":1015,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.491184+0000","last_change":"2024-09-12T17:00:12.310686+0000","last_active":"2024-09-12T18:13:49.491184+0000","last_peered":"2024-09-12T18:13:49.491184+0000","last_clean":"2024-09-12T18:13:49.491184+0000","last_became_active":"2024-09-12T17:00:12.310337+0000","last_became_peered":"2024-09-12T17:00:12.310337+0000","last_unstale":"2024-09-12T18:13:49.491184+0000","last_undegraded":"2024-09-12T18:13:49.491184+0000","last_fullsized":"2024-09-12T18:13:49.491184+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:54.402983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":552,"num_read_kb":13230,"num_write":1122,"num_write_kb":37058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954568+0000","last_change":"2024-09-12T17:00:16.325390+0000","last_active":"2024-09-12T18:10:22.954568+0000","last_peered":"2024-09-12T18:10:22.954568+0000","last_clean":"2024-09-12T18:10:22.954568+0000","last_became_active":"2024-09-12T17:00:16.325141+0000","last_became_peered":"2024-09-12T17:00:16.325141+0000","last_unstale":"2024-09-12T18:10:22.954568+0000","last_undegraded":"2024-09-12T18:10:22.954568+0000","last_fullsized":"2024-09-12T18:10:22.954568+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:43.724058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'309","reported_seq":887,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.755371+0000","last_change":"2024-09-12T17:00:18.430347+0000","last_active":"2024-09-12T18:13:48.755371+0000","last_peered":"2024-09-12T18:13:48.755371+0000","last_clean":"2024-09-12T18:13:48.755371+0000","last_became_active":"2024-09-12T17:00:18.430046+0000","last_became_peered":"2024-09-12T17:00:18.430046+0000","last_unstale":"2024-09-12T18:13:48.755371+0000","last_undegraded":"2024-09-12T18:13:48.755371+0000","last_fullsized":"2024-09-12T18:13:48.755371+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:57.355912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53213,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":492,"num_read_kb":1165,"num_write":400,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'772","reported_seq":2861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.820972+0000","last_change":"2024-09-12T17:00:20.354448+0000","last_active":"2024-09-12T18:13:48.820972+0000","last_peered":"2024-09-12T18:13:48.820972+0000","last_clean":"2024-09-12T18:13:48.820972+0000","last_became_active":"2024-09-12T17:00:20.353914+0000","last_became_peered":"2024-09-12T17:00:20.353914+0000","last_unstale":"2024-09-12T18:13:48.820972+0000","last_undegraded":"2024-09-12T18:13:48.820972+0000","last_fullsized":"2024-09-12T18:13:48.820972+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:46.082984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'89","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:37.947552+0000","last_change":"2024-09-12T17:00:14.325929+0000","last_active":"2024-09-12T18:09:37.947552+0000","last_peered":"2024-09-12T18:09:37.947552+0000","last_clean":"2024-09-12T18:09:37.947552+0000","last_became_active":"2024-09-12T17:00:14.325669+0000","last_became_peered":"2024-09-12T17:00:14.325669+0000","last_unstale":"2024-09-12T18:09:37.947552+0000","last_undegraded":"2024-09-12T18:09:37.947552+0000","last_fullsized":"2024-09-12T18:09:37.947552+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:13.770284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":392,"num_read_kb":330,"num_write":131,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'354","reported_seq":965,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.516479+0000","last_change":"2024-09-12T17:00:12.315298+0000","last_active":"2024-09-12T18:13:49.516479+0000","last_peered":"2024-09-12T18:13:49.516479+0000","last_clean":"2024-09-12T18:13:49.516479+0000","last_became_active":"2024-09-12T17:00:12.315015+0000","last_became_peered":"2024-09-12T17:00:12.315015+0000","last_unstale":"2024-09-12T18:13:49.516479+0000","last_undegraded":"2024-09-12T18:13:49.516479+0000","last_fullsized":"2024-09-12T18:13:49.516479+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:05.029334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311686,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":465,"num_read_kb":13974,"num_write":1122,"num_write_kb":21819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:37.748595+0000","last_change":"2024-09-12T17:00:16.323002+0000","last_active":"2024-09-12T18:09:37.748595+0000","last_peered":"2024-09-12T18:09:37.748595+0000","last_clean":"2024-09-12T18:09:37.748595+0000","last_became_active":"2024-09-12T17:00:16.322693+0000","last_became_peered":"2024-09-12T17:00:16.322693+0000","last_unstale":"2024-09-12T18:09:37.748595+0000","last_undegraded":"2024-09-12T18:09:37.748595+0000","last_fullsized":"2024-09-12T18:09:37.748595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:02.469282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'395","reported_seq":1037,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.141195+0000","last_change":"2024-09-12T17:00:18.429427+0000","last_active":"2024-09-12T18:13:49.141195+0000","last_peered":"2024-09-12T18:13:49.141195+0000","last_clean":"2024-09-12T18:13:49.141195+0000","last_became_active":"2024-09-12T17:00:18.429137+0000","last_became_peered":"2024-09-12T17:00:18.429137+0000","last_unstale":"2024-09-12T18:13:49.141195+0000","last_undegraded":"2024-09-12T18:13:49.141195+0000","last_fullsized":"2024-09-12T18:13:49.141195+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:07.774572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47718,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":656,"num_read_kb":1335,"num_write":508,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:08.915747+0000","last_change":"2024-09-12T17:00:20.348773+0000","last_active":"2024-09-12T18:10:08.915747+0000","last_peered":"2024-09-12T18:10:08.915747+0000","last_clean":"2024-09-12T18:10:08.915747+0000","last_became_active":"2024-09-12T17:00:20.348507+0000","last_became_peered":"2024-09-12T17:00:20.348507+0000","last_unstale":"2024-09-12T18:10:08.915747+0000","last_undegraded":"2024-09-12T18:10:08.915747+0000","last_fullsized":"2024-09-12T18:10:08.915747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:15:32.541811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'560","reported_seq":1385,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.026506+0000","last_change":"2024-09-12T17:00:22.358717+0000","last_active":"2024-09-12T18:13:23.026506+0000","last_peered":"2024-09-12T18:13:23.026506+0000","last_clean":"2024-09-12T18:13:23.026506+0000","last_became_active":"2024-09-12T17:00:22.358335+0000","last_became_peered":"2024-09-12T17:00:22.358335+0000","last_unstale":"2024-09-12T18:13:23.026506+0000","last_undegraded":"2024-09-12T18:13:23.026506+0000","last_fullsized":"2024-09-12T18:13:23.026506+0000","mapping_epoch":34,"log_start":"264'500","ondisk_log_start":"264'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:28.398620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1357,"num_read_kb":1346,"num_write":1162,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'63","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:45.766390+0000","last_change":"2024-09-12T17:00:14.336132+0000","last_active":"2024-09-12T18:11:45.766390+0000","last_peered":"2024-09-12T18:11:45.766390+0000","last_clean":"2024-09-12T18:11:45.766390+0000","last_became_active":"2024-09-12T17:00:14.335783+0000","last_became_peered":"2024-09-12T17:00:14.335783+0000","last_unstale":"2024-09-12T18:11:45.766390+0000","last_undegraded":"2024-09-12T18:11:45.766390+0000","last_fullsized":"2024-09-12T18:11:45.766390+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:05.231999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":238,"num_write":99,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'407","reported_seq":1138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.471623+0000","last_change":"2024-09-12T17:00:12.307583+0000","last_active":"2024-09-12T18:13:49.471623+0000","last_peered":"2024-09-12T18:13:49.471623+0000","last_clean":"2024-09-12T18:13:49.471623+0000","last_became_active":"2024-09-12T17:00:12.307222+0000","last_became_peered":"2024-09-12T17:00:12.307222+0000","last_unstale":"2024-09-12T18:13:49.471623+0000","last_undegraded":"2024-09-12T18:13:49.471623+0000","last_fullsized":"2024-09-12T18:13:49.471623+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:19.672373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":853,"num_read_kb":14510,"num_write":1377,"num_write_kb":34813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:38.694721+0000","last_change":"2024-09-12T17:00:16.323257+0000","last_active":"2024-09-12T18:09:38.694721+0000","last_peered":"2024-09-12T18:09:38.694721+0000","last_clean":"2024-09-12T18:09:38.694721+0000","last_became_active":"2024-09-12T17:00:16.322917+0000","last_became_peered":"2024-09-12T17:00:16.322917+0000","last_unstale":"2024-09-12T18:09:38.694721+0000","last_undegraded":"2024-09-12T18:09:38.694721+0000","last_fullsized":"2024-09-12T18:09:38.694721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:45.972956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'268","reported_seq":849,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.352762+0000","last_change":"2024-09-12T17:00:18.327458+0000","last_active":"2024-09-12T18:13:48.352762+0000","last_peered":"2024-09-12T18:13:48.352762+0000","last_clean":"2024-09-12T18:13:48.352762+0000","last_became_active":"2024-09-12T17:00:18.326791+0000","last_became_peered":"2024-09-12T17:00:18.326791+0000","last_unstale":"2024-09-12T18:13:48.352762+0000","last_undegraded":"2024-09-12T18:13:48.352762+0000","last_fullsized":"2024-09-12T18:13:48.352762+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:25.837684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43451,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":428,"num_read_kb":949,"num_write":338,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:51.839530+0000","last_change":"2024-09-12T17:00:20.354443+0000","last_active":"2024-09-12T18:09:51.839530+0000","last_peered":"2024-09-12T18:09:51.839530+0000","last_clean":"2024-09-12T18:09:51.839530+0000","last_became_active":"2024-09-12T17:00:20.353959+0000","last_became_peered":"2024-09-12T17:00:20.353959+0000","last_unstale":"2024-09-12T18:09:51.839530+0000","last_undegraded":"2024-09-12T18:09:51.839530+0000","last_fullsized":"2024-09-12T18:09:51.839530+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:48.338493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'2407","reported_seq":4230,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:12.155626+0000","last_change":"2024-09-12T17:00:22.356576+0000","last_active":"2024-09-12T18:13:12.155626+0000","last_peered":"2024-09-12T18:13:12.155626+0000","last_clean":"2024-09-12T18:13:12.155626+0000","last_became_active":"2024-09-12T17:00:22.355651+0000","last_became_peered":"2024-09-12T17:00:22.355651+0000","last_unstale":"2024-09-12T18:13:12.155626+0000","last_undegraded":"2024-09-12T18:13:12.155626+0000","last_fullsized":"2024-09-12T18:13:12.155626+0000","mapping_epoch":34,"log_start":"264'2300","ondisk_log_start":"264'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":2300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:33.472074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6022,"num_read_kb":6027,"num_write":4838,"num_write_kb":1790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'196","reported_seq":775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:47.737352+0000","last_change":"2024-09-12T17:00:14.322357+0000","last_active":"2024-09-12T18:09:47.737352+0000","last_peered":"2024-09-12T18:09:47.737352+0000","last_clean":"2024-09-12T18:09:47.737352+0000","last_became_active":"2024-09-12T17:00:14.321270+0000","last_became_peered":"2024-09-12T17:00:14.321270+0000","last_unstale":"2024-09-12T18:09:47.737352+0000","last_undegraded":"2024-09-12T18:09:47.737352+0000","last_fullsized":"2024-09-12T18:09:47.737352+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:12.413462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":834,"num_read_kb":668,"num_write":296,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'318","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.494046+0000","last_change":"2024-09-12T17:00:12.313574+0000","last_active":"2024-09-12T18:13:49.494046+0000","last_peered":"2024-09-12T18:13:49.494046+0000","last_clean":"2024-09-12T18:13:49.494046+0000","last_became_active":"2024-09-12T17:00:12.313262+0000","last_became_peered":"2024-09-12T17:00:12.313262+0000","last_unstale":"2024-09-12T18:13:49.494046+0000","last_undegraded":"2024-09-12T18:13:49.494046+0000","last_fullsized":"2024-09-12T18:13:49.494046+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:31.359986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":514296,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":454,"num_read_kb":16364,"num_write":986,"num_write_kb":27335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:03.697059+0000","last_change":"2024-09-12T17:00:16.321983+0000","last_active":"2024-09-12T18:10:03.697059+0000","last_peered":"2024-09-12T18:10:03.697059+0000","last_clean":"2024-09-12T18:10:03.697059+0000","last_became_active":"2024-09-12T17:00:16.321641+0000","last_became_peered":"2024-09-12T17:00:16.321641+0000","last_unstale":"2024-09-12T18:10:03.697059+0000","last_undegraded":"2024-09-12T18:10:03.697059+0000","last_fullsized":"2024-09-12T18:10:03.697059+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:37.927815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'338","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.221469+0000","last_change":"2024-09-12T17:00:18.331983+0000","last_active":"2024-09-12T18:13:49.221469+0000","last_peered":"2024-09-12T18:13:49.221469+0000","last_clean":"2024-09-12T18:13:49.221469+0000","last_became_active":"2024-09-12T17:00:18.331707+0000","last_became_peered":"2024-09-12T17:00:18.331707+0000","last_unstale":"2024-09-12T18:13:49.221469+0000","last_undegraded":"2024-09-12T18:13:49.221469+0000","last_fullsized":"2024-09-12T18:13:49.221469+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:34.769849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47689,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":552,"num_read_kb":1215,"num_write":436,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'765","reported_seq":2727,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.197196+0000","last_change":"2024-09-12T17:00:20.348555+0000","last_active":"2024-09-12T18:13:48.197196+0000","last_peered":"2024-09-12T18:13:48.197196+0000","last_clean":"2024-09-12T18:13:48.197196+0000","last_became_active":"2024-09-12T17:00:20.348227+0000","last_became_peered":"2024-09-12T17:00:20.348227+0000","last_unstale":"2024-09-12T18:13:48.197196+0000","last_undegraded":"2024-09-12T18:13:48.197196+0000","last_fullsized":"2024-09-12T18:13:48.197196+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:53.853058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'115","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:21.824797+0000","last_change":"2024-09-12T17:00:22.353551+0000","last_active":"2024-09-12T18:13:21.824797+0000","last_peered":"2024-09-12T18:13:21.824797+0000","last_clean":"2024-09-12T18:13:21.824797+0000","last_became_active":"2024-09-12T17:00:22.353172+0000","last_became_peered":"2024-09-12T17:00:22.353172+0000","last_unstale":"2024-09-12T18:13:21.824797+0000","last_undegraded":"2024-09-12T18:13:21.824797+0000","last_fullsized":"2024-09-12T18:13:21.824797+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:21.794645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":136,"num_write":299,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'230","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:01.616940+0000","last_change":"2024-09-12T17:00:14.325124+0000","last_active":"2024-09-12T18:10:01.616940+0000","last_peered":"2024-09-12T18:10:01.616940+0000","last_clean":"2024-09-12T18:10:01.616940+0000","last_became_active":"2024-09-12T17:00:14.324823+0000","last_became_peered":"2024-09-12T17:00:14.324823+0000","last_unstale":"2024-09-12T18:10:01.616940+0000","last_undegraded":"2024-09-12T18:10:01.616940+0000","last_fullsized":"2024-09-12T18:10:01.616940+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:32.044281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1013,"num_read_kb":830,"num_write":393,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'399","reported_seq":1087,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.468528+0000","last_change":"2024-09-12T17:00:12.320393+0000","last_active":"2024-09-12T18:13:49.468528+0000","last_peered":"2024-09-12T18:13:49.468528+0000","last_clean":"2024-09-12T18:13:49.468528+0000","last_became_active":"2024-09-12T17:00:12.318599+0000","last_became_peered":"2024-09-12T17:00:12.318599+0000","last_unstale":"2024-09-12T18:13:49.468528+0000","last_undegraded":"2024-09-12T18:13:49.468528+0000","last_fullsized":"2024-09-12T18:13:49.468528+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:50.621777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850207,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":687,"num_read_kb":44825,"num_write":1169,"num_write_kb":32428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.695712+0000","last_change":"2024-09-12T17:00:16.328658+0000","last_active":"2024-09-12T18:09:48.695712+0000","last_peered":"2024-09-12T18:09:48.695712+0000","last_clean":"2024-09-12T18:09:48.695712+0000","last_became_active":"2024-09-12T17:00:16.328352+0000","last_became_peered":"2024-09-12T17:00:16.328352+0000","last_unstale":"2024-09-12T18:09:48.695712+0000","last_undegraded":"2024-09-12T18:09:48.695712+0000","last_fullsized":"2024-09-12T18:09:48.695712+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:37.939908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'478","reported_seq":1135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.307352+0000","last_change":"2024-09-12T17:00:18.330361+0000","last_active":"2024-09-12T18:13:49.307352+0000","last_peered":"2024-09-12T18:13:49.307352+0000","last_clean":"2024-09-12T18:13:49.307352+0000","last_became_active":"2024-09-12T17:00:18.329414+0000","last_became_peered":"2024-09-12T17:00:18.329414+0000","last_unstale":"2024-09-12T18:13:49.307352+0000","last_undegraded":"2024-09-12T18:13:49.307352+0000","last_fullsized":"2024-09-12T18:13:49.307352+0000","mapping_epoch":30,"log_start":"264'400","ondisk_log_start":"264'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:30.562657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60099,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":839,"num_read_kb":2047,"num_write":682,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:43.695251+0000","last_change":"2024-09-12T17:00:20.352541+0000","last_active":"2024-09-12T18:09:43.695251+0000","last_peered":"2024-09-12T18:09:43.695251+0000","last_clean":"2024-09-12T18:09:43.695251+0000","last_became_active":"2024-09-12T17:00:20.352249+0000","last_became_peered":"2024-09-12T17:00:20.352249+0000","last_unstale":"2024-09-12T18:09:43.695251+0000","last_undegraded":"2024-09-12T18:09:43.695251+0000","last_fullsized":"2024-09-12T18:09:43.695251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:48.788159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'178","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:21.825345+0000","last_change":"2024-09-12T17:00:22.356296+0000","last_active":"2024-09-12T18:13:21.825345+0000","last_peered":"2024-09-12T18:13:21.825345+0000","last_clean":"2024-09-12T18:13:21.825345+0000","last_became_active":"2024-09-12T17:00:22.355850+0000","last_became_peered":"2024-09-12T17:00:22.355850+0000","last_unstale":"2024-09-12T18:13:21.825345+0000","last_undegraded":"2024-09-12T18:13:21.825345+0000","last_fullsized":"2024-09-12T18:13:21.825345+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:23.406645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":278,"num_read_kb":264,"num_write":436,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'144","reported_seq":751,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:00.750221+0000","last_change":"2024-09-12T17:00:14.334908+0000","last_active":"2024-09-12T18:10:00.750221+0000","last_peered":"2024-09-12T18:10:00.750221+0000","last_clean":"2024-09-12T18:10:00.750221+0000","last_became_active":"2024-09-12T17:00:14.334594+0000","last_became_peered":"2024-09-12T17:00:14.334594+0000","last_unstale":"2024-09-12T18:10:00.750221+0000","last_undegraded":"2024-09-12T18:10:00.750221+0000","last_fullsized":"2024-09-12T18:10:00.750221+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:18.668081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":624,"num_read_kb":516,"num_write":207,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'341","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.462937+0000","last_change":"2024-09-12T17:00:12.314796+0000","last_active":"2024-09-12T18:13:49.462937+0000","last_peered":"2024-09-12T18:13:49.462937+0000","last_clean":"2024-09-12T18:13:49.462937+0000","last_became_active":"2024-09-12T17:00:12.314509+0000","last_became_peered":"2024-09-12T17:00:12.314509+0000","last_unstale":"2024-09-12T18:13:49.462937+0000","last_undegraded":"2024-09-12T18:13:49.462937+0000","last_fullsized":"2024-09-12T18:13:49.462937+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:46.851692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2180125,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":439,"num_read_kb":51555,"num_write":1035,"num_write_kb":32245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:03.697102+0000","last_change":"2024-09-12T17:00:16.319604+0000","last_active":"2024-09-12T18:10:03.697102+0000","last_peered":"2024-09-12T18:10:03.697102+0000","last_clean":"2024-09-12T18:10:03.697102+0000","last_became_active":"2024-09-12T17:00:16.319269+0000","last_became_peered":"2024-09-12T17:00:16.319269+0000","last_unstale":"2024-09-12T18:10:03.697102+0000","last_undegraded":"2024-09-12T18:10:03.697102+0000","last_fullsized":"2024-09-12T18:10:03.697102+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:36.474369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'295","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.509288+0000","last_change":"2024-09-12T17:00:18.331052+0000","last_active":"2024-09-12T18:13:48.509288+0000","last_peered":"2024-09-12T18:13:48.509288+0000","last_clean":"2024-09-12T18:13:48.509288+0000","last_became_active":"2024-09-12T17:00:18.330634+0000","last_became_peered":"2024-09-12T17:00:18.330634+0000","last_unstale":"2024-09-12T18:13:48.509288+0000","last_undegraded":"2024-09-12T18:13:48.509288+0000","last_fullsized":"2024-09-12T18:13:48.509288+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:16.080984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48221,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":495,"num_read_kb":1035,"num_write":432,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.619832+0000","last_change":"2024-09-12T17:00:20.351332+0000","last_active":"2024-09-12T18:10:26.619832+0000","last_peered":"2024-09-12T18:10:26.619832+0000","last_clean":"2024-09-12T18:10:26.619832+0000","last_became_active":"2024-09-12T17:00:20.351001+0000","last_became_peered":"2024-09-12T17:00:20.351001+0000","last_unstale":"2024-09-12T18:10:26.619832+0000","last_undegraded":"2024-09-12T18:10:26.619832+0000","last_fullsized":"2024-09-12T18:10:26.619832+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:04.653097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'120","reported_seq":621,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:31.859249+0000","last_change":"2024-09-12T17:00:22.357302+0000","last_active":"2024-09-12T18:12:31.859249+0000","last_peered":"2024-09-12T18:12:31.859249+0000","last_clean":"2024-09-12T18:12:31.859249+0000","last_became_active":"2024-09-12T17:00:22.357001+0000","last_became_peered":"2024-09-12T17:00:22.357001+0000","last_unstale":"2024-09-12T18:12:31.859249+0000","last_undegraded":"2024-09-12T18:12:31.859249+0000","last_fullsized":"2024-09-12T18:12:31.859249+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:15.408471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":156,"num_write":307,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'263","reported_seq":888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:00.750266+0000","last_change":"2024-09-12T17:00:14.321295+0000","last_active":"2024-09-12T18:10:00.750266+0000","last_peered":"2024-09-12T18:10:00.750266+0000","last_clean":"2024-09-12T18:10:00.750266+0000","last_became_active":"2024-09-12T17:00:14.320928+0000","last_became_peered":"2024-09-12T17:00:14.320928+0000","last_unstale":"2024-09-12T18:10:00.750266+0000","last_undegraded":"2024-09-12T18:10:00.750266+0000","last_fullsized":"2024-09-12T18:10:00.750266+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:10.035416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1139,"num_read_kb":929,"num_write":426,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'356","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.495974+0000","last_change":"2024-09-12T17:00:12.309266+0000","last_active":"2024-09-12T18:13:49.495974+0000","last_peered":"2024-09-12T18:13:49.495974+0000","last_clean":"2024-09-12T18:13:49.495974+0000","last_became_active":"2024-09-12T17:00:12.308967+0000","last_became_peered":"2024-09-12T17:00:12.308967+0000","last_unstale":"2024-09-12T18:13:49.495974+0000","last_undegraded":"2024-09-12T18:13:49.495974+0000","last_fullsized":"2024-09-12T18:13:49.495974+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:08.219861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549696,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":120658,"num_write":1095,"num_write_kb":55796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:03.915218+0000","last_change":"2024-09-12T17:00:16.329927+0000","last_active":"2024-09-12T18:10:03.915218+0000","last_peered":"2024-09-12T18:10:03.915218+0000","last_clean":"2024-09-12T18:10:03.915218+0000","last_became_active":"2024-09-12T17:00:16.329596+0000","last_became_peered":"2024-09-12T17:00:16.329596+0000","last_unstale":"2024-09-12T18:10:03.915218+0000","last_undegraded":"2024-09-12T18:10:03.915218+0000","last_fullsized":"2024-09-12T18:10:03.915218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:12.864819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'344","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.526745+0000","last_change":"2024-09-12T17:00:18.332460+0000","last_active":"2024-09-12T18:13:49.526745+0000","last_peered":"2024-09-12T18:13:49.526745+0000","last_clean":"2024-09-12T18:13:49.526745+0000","last_became_active":"2024-09-12T17:00:18.331483+0000","last_became_peered":"2024-09-12T17:00:18.331483+0000","last_unstale":"2024-09-12T18:13:49.526745+0000","last_undegraded":"2024-09-12T18:13:49.526745+0000","last_fullsized":"2024-09-12T18:13:49.526745+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:15:12.963116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48847,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":573,"num_read_kb":1293,"num_write":456,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'739","reported_seq":4704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.278097+0000","last_change":"2024-09-12T17:00:20.352350+0000","last_active":"2024-09-12T18:13:49.278097+0000","last_peered":"2024-09-12T18:13:49.278097+0000","last_clean":"2024-09-12T18:13:49.278097+0000","last_became_active":"2024-09-12T17:00:20.352022+0000","last_became_peered":"2024-09-12T17:00:20.352022+0000","last_unstale":"2024-09-12T18:13:49.278097+0000","last_undegraded":"2024-09-12T18:13:49.278097+0000","last_fullsized":"2024-09-12T18:13:49.278097+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:52.501993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'82","reported_seq":594,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.524395+0000","last_change":"2024-09-12T17:00:22.350570+0000","last_active":"2024-09-12T18:12:00.524395+0000","last_peered":"2024-09-12T18:12:00.524395+0000","last_clean":"2024-09-12T18:12:00.524395+0000","last_became_active":"2024-09-12T17:00:22.350283+0000","last_became_peered":"2024-09-12T17:00:22.350283+0000","last_unstale":"2024-09-12T18:12:00.524395+0000","last_undegraded":"2024-09-12T18:12:00.524395+0000","last_fullsized":"2024-09-12T18:12:00.524395+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:18.622278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":129,"num_read_kb":121,"num_write":196,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'24","reported_seq":569,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:09.884675+0000","last_change":"2024-09-12T17:00:14.326073+0000","last_active":"2024-09-12T18:10:09.884675+0000","last_peered":"2024-09-12T18:10:09.884675+0000","last_clean":"2024-09-12T18:10:09.884675+0000","last_became_active":"2024-09-12T17:00:14.325788+0000","last_became_peered":"2024-09-12T17:00:14.325788+0000","last_unstale":"2024-09-12T18:10:09.884675+0000","last_undegraded":"2024-09-12T18:10:09.884675+0000","last_fullsized":"2024-09-12T18:10:09.884675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:24.940646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":96,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'329","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.484005+0000","last_change":"2024-09-12T17:00:12.309670+0000","last_active":"2024-09-12T18:13:49.484005+0000","last_peered":"2024-09-12T18:13:49.484005+0000","last_clean":"2024-09-12T18:13:49.484005+0000","last_became_active":"2024-09-12T17:00:12.309388+0000","last_became_peered":"2024-09-12T17:00:12.309388+0000","last_unstale":"2024-09-12T18:13:49.484005+0000","last_undegraded":"2024-09-12T18:13:49.484005+0000","last_fullsized":"2024-09-12T18:13:49.484005+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:00.188061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3573814,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":548,"num_read_kb":20473,"num_write":1106,"num_write_kb":21258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1469,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:47.966218+0000","last_change":"2024-09-12T17:00:16.330362+0000","last_active":"2024-09-12T18:13:47.966218+0000","last_peered":"2024-09-12T18:13:47.966218+0000","last_clean":"2024-09-12T18:13:47.966218+0000","last_became_active":"2024-09-12T17:00:16.330035+0000","last_became_peered":"2024-09-12T17:00:16.330035+0000","last_unstale":"2024-09-12T18:13:47.966218+0000","last_undegraded":"2024-09-12T18:13:47.966218+0000","last_fullsized":"2024-09-12T18:13:47.966218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:23.800125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'102","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.018578+0000","last_change":"2024-09-12T17:00:18.429647+0000","last_active":"2024-09-12T18:11:11.018578+0000","last_peered":"2024-09-12T18:11:11.018578+0000","last_clean":"2024-09-12T18:11:11.018578+0000","last_became_active":"2024-09-12T17:00:18.429253+0000","last_became_peered":"2024-09-12T17:00:18.429253+0000","last_unstale":"2024-09-12T18:11:11.018578+0000","last_undegraded":"2024-09-12T18:11:11.018578+0000","last_fullsized":"2024-09-12T18:11:11.018578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:37.177018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'784","reported_seq":2533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.190299+0000","last_change":"2024-09-12T17:00:20.353257+0000","last_active":"2024-09-12T18:13:48.190299+0000","last_peered":"2024-09-12T18:13:48.190299+0000","last_clean":"2024-09-12T18:13:48.190299+0000","last_became_active":"2024-09-12T17:00:20.352792+0000","last_became_peered":"2024-09-12T17:00:20.352792+0000","last_unstale":"2024-09-12T18:13:48.190299+0000","last_undegraded":"2024-09-12T18:13:48.190299+0000","last_fullsized":"2024-09-12T18:13:48.190299+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:31.802808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'111","reported_seq":615,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.521752+0000","last_change":"2024-09-12T17:00:22.352596+0000","last_active":"2024-09-12T18:12:00.521752+0000","last_peered":"2024-09-12T18:12:00.521752+0000","last_clean":"2024-09-12T18:12:00.521752+0000","last_became_active":"2024-09-12T17:00:22.352182+0000","last_became_peered":"2024-09-12T17:00:22.352182+0000","last_unstale":"2024-09-12T18:12:00.521752+0000","last_undegraded":"2024-09-12T18:12:00.521752+0000","last_fullsized":"2024-09-12T18:12:00.521752+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:18.301972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":119,"num_write":244,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'121","reported_seq":766,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:13.916333+0000","last_change":"2024-09-12T17:00:14.329674+0000","last_active":"2024-09-12T18:10:13.916333+0000","last_peered":"2024-09-12T18:10:13.916333+0000","last_clean":"2024-09-12T18:10:13.916333+0000","last_became_active":"2024-09-12T17:00:14.329394+0000","last_became_peered":"2024-09-12T17:00:14.329394+0000","last_unstale":"2024-09-12T18:10:13.916333+0000","last_undegraded":"2024-09-12T18:10:13.916333+0000","last_fullsized":"2024-09-12T18:10:13.916333+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:56.581515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":562,"num_read_kb":483,"num_write":177,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'415","reported_seq":1105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.467598+0000","last_change":"2024-09-12T17:00:12.314422+0000","last_active":"2024-09-12T18:13:49.467598+0000","last_peered":"2024-09-12T18:13:49.467598+0000","last_clean":"2024-09-12T18:13:49.467598+0000","last_became_active":"2024-09-12T17:00:12.314142+0000","last_became_peered":"2024-09-12T17:00:12.314142+0000","last_unstale":"2024-09-12T18:13:49.467598+0000","last_undegraded":"2024-09-12T18:13:49.467598+0000","last_fullsized":"2024-09-12T18:13:49.467598+0000","mapping_epoch":24,"log_start":"264'400","ondisk_log_start":"264'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:28.691515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306453,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":807,"num_read_kb":14993,"num_write":1145,"num_write_kb":29270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:00.750294+0000","last_change":"2024-09-12T17:00:16.328779+0000","last_active":"2024-09-12T18:10:00.750294+0000","last_peered":"2024-09-12T18:10:00.750294+0000","last_clean":"2024-09-12T18:10:00.750294+0000","last_became_active":"2024-09-12T17:00:16.328306+0000","last_became_peered":"2024-09-12T17:00:16.328306+0000","last_unstale":"2024-09-12T18:10:00.750294+0000","last_undegraded":"2024-09-12T18:10:00.750294+0000","last_fullsized":"2024-09-12T18:10:00.750294+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:34.580723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'388","reported_seq":1021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.013468+0000","last_change":"2024-09-12T17:00:18.328815+0000","last_active":"2024-09-12T18:13:49.013468+0000","last_peered":"2024-09-12T18:13:49.013468+0000","last_clean":"2024-09-12T18:13:49.013468+0000","last_became_active":"2024-09-12T17:00:18.328500+0000","last_became_peered":"2024-09-12T17:00:18.328500+0000","last_unstale":"2024-09-12T18:13:49.013468+0000","last_undegraded":"2024-09-12T18:13:49.013468+0000","last_fullsized":"2024-09-12T18:13:49.013468+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:13.655611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46864,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":620,"num_read_kb":1249,"num_write":480,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:07.740171+0000","last_change":"2024-09-12T17:00:20.350311+0000","last_active":"2024-09-12T18:10:07.740171+0000","last_peered":"2024-09-12T18:10:07.740171+0000","last_clean":"2024-09-12T18:10:07.740171+0000","last_became_active":"2024-09-12T17:00:20.350003+0000","last_became_peered":"2024-09-12T17:00:20.350003+0000","last_unstale":"2024-09-12T18:10:07.740171+0000","last_undegraded":"2024-09-12T18:10:07.740171+0000","last_fullsized":"2024-09-12T18:10:07.740171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:27.609870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'130","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.096280+0000","last_change":"2024-09-12T17:00:22.354899+0000","last_active":"2024-09-12T18:12:03.096280+0000","last_peered":"2024-09-12T18:12:03.096280+0000","last_clean":"2024-09-12T18:12:03.096280+0000","last_became_active":"2024-09-12T17:00:22.354601+0000","last_became_peered":"2024-09-12T17:00:22.354601+0000","last_unstale":"2024-09-12T18:12:03.096280+0000","last_undegraded":"2024-09-12T18:12:03.096280+0000","last_fullsized":"2024-09-12T18:12:03.096280+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:04.146875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":184,"num_read_kb":175,"num_write":297,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'262","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:17.750658+0000","last_change":"2024-09-12T17:00:14.329597+0000","last_active":"2024-09-12T18:11:17.750658+0000","last_peered":"2024-09-12T18:11:17.750658+0000","last_clean":"2024-09-12T18:11:17.750658+0000","last_became_active":"2024-09-12T17:00:14.329297+0000","last_became_peered":"2024-09-12T17:00:14.329297+0000","last_unstale":"2024-09-12T18:11:17.750658+0000","last_undegraded":"2024-09-12T18:11:17.750658+0000","last_fullsized":"2024-09-12T18:11:17.750658+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:20.710892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1103,"num_read_kb":898,"num_write":417,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.754092+0000","last_change":"2024-09-12T16:59:54.636782+0000","last_active":"2024-09-12T18:10:12.754092+0000","last_peered":"2024-09-12T18:10:12.754092+0000","last_clean":"2024-09-12T18:10:12.754092+0000","last_became_active":"2024-09-12T16:59:54.636487+0000","last_became_peered":"2024-09-12T16:59:54.636487+0000","last_unstale":"2024-09-12T18:10:12.754092+0000","last_undegraded":"2024-09-12T18:10:12.754092+0000","last_fullsized":"2024-09-12T18:10:12.754092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:53.619137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:53.619137+0000","last_clean_scrub_stamp":"2024-09-12T16:59:53.619137+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:25.991554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":530,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:52.959116+0000","last_change":"2024-09-12T17:00:02.680922+0000","last_active":"2024-09-12T18:10:52.959116+0000","last_peered":"2024-09-12T18:10:52.959116+0000","last_clean":"2024-09-12T18:10:52.959116+0000","last_became_active":"2024-09-12T17:00:00.669728+0000","last_became_peered":"2024-09-12T17:00:00.669728+0000","last_unstale":"2024-09-12T18:10:52.959116+0000","last_undegraded":"2024-09-12T18:10:52.959116+0000","last_fullsized":"2024-09-12T18:10:52.959116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:04.614720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058116500000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'377","reported_seq":1064,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.513419+0000","last_change":"2024-09-12T17:00:46.405193+0000","last_active":"2024-09-12T18:13:49.513419+0000","last_peered":"2024-09-12T18:13:49.513419+0000","last_clean":"2024-09-12T18:13:49.513419+0000","last_became_active":"2024-09-12T17:00:46.404905+0000","last_became_peered":"2024-09-12T17:00:46.404905+0000","last_unstale":"2024-09-12T18:13:49.513419+0000","last_undegraded":"2024-09-12T18:13:49.513419+0000","last_fullsized":"2024-09-12T18:13:49.513419+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:32.250482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524314,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":662,"num_read_kb":82700,"num_write":1255,"num_write_kb":21344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.763082+0000","last_change":"2024-09-12T17:00:16.321475+0000","last_active":"2024-09-12T18:11:07.763082+0000","last_peered":"2024-09-12T18:11:07.763082+0000","last_clean":"2024-09-12T18:11:07.763082+0000","last_became_active":"2024-09-12T17:00:16.321151+0000","last_became_peered":"2024-09-12T17:00:16.321151+0000","last_unstale":"2024-09-12T18:11:07.763082+0000","last_undegraded":"2024-09-12T18:11:07.763082+0000","last_fullsized":"2024-09-12T18:11:07.763082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:40.509096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'754","reported_seq":1472,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.448973+0000","last_change":"2024-09-12T17:00:18.330396+0000","last_active":"2024-09-12T18:13:49.448973+0000","last_peered":"2024-09-12T18:13:49.448973+0000","last_clean":"2024-09-12T18:13:49.448973+0000","last_became_active":"2024-09-12T17:00:18.330037+0000","last_became_peered":"2024-09-12T17:00:18.330037+0000","last_unstale":"2024-09-12T18:13:49.448973+0000","last_undegraded":"2024-09-12T18:13:49.448973+0000","last_fullsized":"2024-09-12T18:13:49.448973+0000","mapping_epoch":30,"log_start":"264'700","ondisk_log_start":"264'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:20.891636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153681,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1487,"num_read_kb":3466,"num_write":1434,"num_write_kb":1274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:41.614845+0000","last_change":"2024-09-12T17:00:20.349669+0000","last_active":"2024-09-12T18:09:41.614845+0000","last_peered":"2024-09-12T18:09:41.614845+0000","last_clean":"2024-09-12T18:09:41.614845+0000","last_became_active":"2024-09-12T17:00:20.349363+0000","last_became_peered":"2024-09-12T17:00:20.349363+0000","last_unstale":"2024-09-12T18:09:41.614845+0000","last_undegraded":"2024-09-12T18:09:41.614845+0000","last_fullsized":"2024-09-12T18:09:41.614845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:59.536610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'187","reported_seq":888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.997884+0000","last_change":"2024-09-12T17:00:22.354974+0000","last_active":"2024-09-12T18:12:00.997884+0000","last_peered":"2024-09-12T18:12:00.997884+0000","last_clean":"2024-09-12T18:12:00.997884+0000","last_became_active":"2024-09-12T17:00:22.354654+0000","last_became_peered":"2024-09-12T17:00:22.354654+0000","last_unstale":"2024-09-12T18:12:00.997884+0000","last_undegraded":"2024-09-12T18:12:00.997884+0000","last_fullsized":"2024-09-12T18:12:00.997884+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:31.363438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":450,"num_read_kb":449,"num_write":373,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'132","reported_seq":742,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:59.044067+0000","last_change":"2024-09-12T17:00:14.319895+0000","last_active":"2024-09-12T18:09:59.044067+0000","last_peered":"2024-09-12T18:09:59.044067+0000","last_clean":"2024-09-12T18:09:59.044067+0000","last_became_active":"2024-09-12T17:00:14.319539+0000","last_became_peered":"2024-09-12T17:00:14.319539+0000","last_unstale":"2024-09-12T18:09:59.044067+0000","last_undegraded":"2024-09-12T18:09:59.044067+0000","last_fullsized":"2024-09-12T18:09:59.044067+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:30.605432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":596,"num_read_kb":500,"num_write":197,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.755045+0000","last_change":"2024-09-12T17:00:02.996796+0000","last_active":"2024-09-12T18:10:17.755045+0000","last_peered":"2024-09-12T18:10:17.755045+0000","last_clean":"2024-09-12T18:10:17.755045+0000","last_became_active":"2024-09-12T17:00:00.671211+0000","last_became_peered":"2024-09-12T17:00:00.671211+0000","last_unstale":"2024-09-12T18:10:17.755045+0000","last_undegraded":"2024-09-12T18:10:17.755045+0000","last_fullsized":"2024-09-12T18:10:17.755045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:37.005108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000441562,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'323","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.504339+0000","last_change":"2024-09-12T17:00:12.306702+0000","last_active":"2024-09-12T18:13:49.504339+0000","last_peered":"2024-09-12T18:13:49.504339+0000","last_clean":"2024-09-12T18:13:49.504339+0000","last_became_active":"2024-09-12T17:00:12.306408+0000","last_became_peered":"2024-09-12T17:00:12.306408+0000","last_unstale":"2024-09-12T18:13:49.504339+0000","last_undegraded":"2024-09-12T18:13:49.504339+0000","last_fullsized":"2024-09-12T18:13:49.504339+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:21.843306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1499227,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":518,"num_read_kb":8959,"num_write":977,"num_write_kb":13821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:37.947663+0000","last_change":"2024-09-12T17:00:16.326370+0000","last_active":"2024-09-12T18:09:37.947663+0000","last_peered":"2024-09-12T18:09:37.947663+0000","last_clean":"2024-09-12T18:09:37.947663+0000","last_became_active":"2024-09-12T17:00:16.325914+0000","last_became_peered":"2024-09-12T17:00:16.325914+0000","last_unstale":"2024-09-12T18:09:37.947663+0000","last_undegraded":"2024-09-12T18:09:37.947663+0000","last_fullsized":"2024-09-12T18:09:37.947663+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:00.425804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1358","reported_seq":3197,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.054070+0000","last_change":"2024-09-12T17:00:18.331031+0000","last_active":"2024-09-12T18:13:49.054070+0000","last_peered":"2024-09-12T18:13:49.054070+0000","last_clean":"2024-09-12T18:13:49.054070+0000","last_became_active":"2024-09-12T17:00:18.330715+0000","last_became_peered":"2024-09-12T17:00:18.330715+0000","last_unstale":"2024-09-12T18:13:49.054070+0000","last_undegraded":"2024-09-12T18:13:49.054070+0000","last_fullsized":"2024-09-12T18:13:49.054070+0000","mapping_epoch":30,"log_start":"264'1300","ondisk_log_start":"264'1300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":1300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:19.772064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154155,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2179,"num_read_kb":4259,"num_write":1270,"num_write_kb":1078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:27.766397+0000","last_change":"2024-09-12T17:00:20.352790+0000","last_active":"2024-09-12T18:11:27.766397+0000","last_peered":"2024-09-12T18:11:27.766397+0000","last_clean":"2024-09-12T18:11:27.766397+0000","last_became_active":"2024-09-12T17:00:20.352287+0000","last_became_peered":"2024-09-12T17:00:20.352287+0000","last_unstale":"2024-09-12T18:11:27.766397+0000","last_undegraded":"2024-09-12T18:11:27.766397+0000","last_fullsized":"2024-09-12T18:11:27.766397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:15.288688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'96","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.928594+0000","last_change":"2024-09-12T17:00:22.587542+0000","last_active":"2024-09-12T18:12:08.928594+0000","last_peered":"2024-09-12T18:12:08.928594+0000","last_clean":"2024-09-12T18:12:08.928594+0000","last_became_active":"2024-09-12T17:00:22.587206+0000","last_became_peered":"2024-09-12T17:00:22.587206+0000","last_unstale":"2024-09-12T18:12:08.928594+0000","last_undegraded":"2024-09-12T18:12:08.928594+0000","last_fullsized":"2024-09-12T18:12:08.928594+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:21.704751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":151,"num_write":236,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'4068","reported_seq":4653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:43.925685+0000","last_change":"2024-09-12T17:00:14.331924+0000","last_active":"2024-09-12T18:11:43.925685+0000","last_peered":"2024-09-12T18:11:43.925685+0000","last_clean":"2024-09-12T18:11:43.925685+0000","last_became_active":"2024-09-12T17:00:14.331560+0000","last_became_peered":"2024-09-12T17:00:14.331560+0000","last_unstale":"2024-09-12T18:11:43.925685+0000","last_undegraded":"2024-09-12T18:11:43.925685+0000","last_fullsized":"2024-09-12T18:11:43.925685+0000","mapping_epoch":26,"log_start":"264'4000","ondisk_log_start":"264'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":3000,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:08.452289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16331,"num_read_kb":13702,"num_write":6093,"num_write_kb":3038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":529,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:53.701863+0000","last_change":"2024-09-12T17:00:02.677610+0000","last_active":"2024-09-12T18:10:53.701863+0000","last_peered":"2024-09-12T18:10:53.701863+0000","last_clean":"2024-09-12T18:10:53.701863+0000","last_became_active":"2024-09-12T17:00:01.173083+0000","last_became_peered":"2024-09-12T17:00:01.173083+0000","last_unstale":"2024-09-12T18:10:53.701863+0000","last_undegraded":"2024-09-12T18:10:53.701863+0000","last_fullsized":"2024-09-12T18:10:53.701863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:35.997474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056135799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'319","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.512752+0000","last_change":"2024-09-12T17:00:12.309409+0000","last_active":"2024-09-12T18:13:49.512752+0000","last_peered":"2024-09-12T18:13:49.512752+0000","last_clean":"2024-09-12T18:13:49.512752+0000","last_became_active":"2024-09-12T17:00:12.309100+0000","last_became_peered":"2024-09-12T17:00:12.309100+0000","last_unstale":"2024-09-12T18:13:49.512752+0000","last_undegraded":"2024-09-12T18:13:49.512752+0000","last_fullsized":"2024-09-12T18:13:49.512752+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:25.648067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655862,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":481,"num_read_kb":31712,"num_write":1051,"num_write_kb":22323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:38.694803+0000","last_change":"2024-09-12T17:00:16.325113+0000","last_active":"2024-09-12T18:09:38.694803+0000","last_peered":"2024-09-12T18:09:38.694803+0000","last_clean":"2024-09-12T18:09:38.694803+0000","last_became_active":"2024-09-12T17:00:16.324792+0000","last_became_peered":"2024-09-12T17:00:16.324792+0000","last_unstale":"2024-09-12T18:09:38.694803+0000","last_undegraded":"2024-09-12T18:09:38.694803+0000","last_fullsized":"2024-09-12T18:09:38.694803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:38.734680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'290","reported_seq":1723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.201178+0000","last_change":"2024-09-12T17:00:18.430289+0000","last_active":"2024-09-12T18:13:23.201178+0000","last_peered":"2024-09-12T18:13:23.201178+0000","last_clean":"2024-09-12T18:13:23.201178+0000","last_became_active":"2024-09-12T17:00:18.429997+0000","last_became_peered":"2024-09-12T17:00:18.429997+0000","last_unstale":"2024-09-12T18:13:23.201178+0000","last_undegraded":"2024-09-12T18:13:23.201178+0000","last_fullsized":"2024-09-12T18:13:23.201178+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:55.412482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":262,"num_read_kb":252,"num_write":239,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.624787+0000","last_change":"2024-09-12T17:00:20.353031+0000","last_active":"2024-09-12T18:11:11.624787+0000","last_peered":"2024-09-12T18:11:11.624787+0000","last_clean":"2024-09-12T18:11:11.624787+0000","last_became_active":"2024-09-12T17:00:20.350197+0000","last_became_peered":"2024-09-12T17:00:20.350197+0000","last_unstale":"2024-09-12T18:11:11.624787+0000","last_undegraded":"2024-09-12T18:11:11.624787+0000","last_fullsized":"2024-09-12T18:11:11.624787+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:17.466054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'275","reported_seq":881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.253630+0000","last_change":"2024-09-12T17:00:22.357898+0000","last_active":"2024-09-12T18:12:03.253630+0000","last_peered":"2024-09-12T18:12:03.253630+0000","last_clean":"2024-09-12T18:12:03.253630+0000","last_became_active":"2024-09-12T17:00:22.357583+0000","last_became_peered":"2024-09-12T17:00:22.357583+0000","last_unstale":"2024-09-12T18:12:03.253630+0000","last_undegraded":"2024-09-12T18:12:03.253630+0000","last_fullsized":"2024-09-12T18:12:03.253630+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:16.279162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":565,"num_read_kb":582,"num_write":607,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'184","reported_seq":770,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:03.921621+0000","last_change":"2024-09-12T17:00:14.325136+0000","last_active":"2024-09-12T18:11:03.921621+0000","last_peered":"2024-09-12T18:11:03.921621+0000","last_clean":"2024-09-12T18:11:03.921621+0000","last_became_active":"2024-09-12T17:00:14.324830+0000","last_became_peered":"2024-09-12T17:00:14.324830+0000","last_unstale":"2024-09-12T18:11:03.921621+0000","last_undegraded":"2024-09-12T18:11:03.921621+0000","last_fullsized":"2024-09-12T18:11:03.921621+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:00.282511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":771,"num_read_kb":626,"num_write":320,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:52.959075+0000","last_change":"2024-09-12T17:00:02.681561+0000","last_active":"2024-09-12T18:10:52.959075+0000","last_peered":"2024-09-12T18:10:52.959075+0000","last_clean":"2024-09-12T18:10:52.959075+0000","last_became_active":"2024-09-12T17:00:00.668696+0000","last_became_peered":"2024-09-12T17:00:00.668696+0000","last_unstale":"2024-09-12T18:10:52.959075+0000","last_undegraded":"2024-09-12T18:10:52.959075+0000","last_fullsized":"2024-09-12T18:10:52.959075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:34.470591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012259720000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'357","reported_seq":1001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.507143+0000","last_change":"2024-09-12T17:00:12.316101+0000","last_active":"2024-09-12T18:13:49.507143+0000","last_peered":"2024-09-12T18:13:49.507143+0000","last_clean":"2024-09-12T18:13:49.507143+0000","last_became_active":"2024-09-12T17:00:12.315813+0000","last_became_peered":"2024-09-12T17:00:12.315813+0000","last_unstale":"2024-09-12T18:13:49.507143+0000","last_undegraded":"2024-09-12T18:13:49.507143+0000","last_fullsized":"2024-09-12T18:13:49.507143+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:20.815493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":472,"num_read_kb":35449,"num_write":1073,"num_write_kb":30387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:26.626503+0000","last_change":"2024-09-12T17:00:16.325100+0000","last_active":"2024-09-12T18:11:26.626503+0000","last_peered":"2024-09-12T18:11:26.626503+0000","last_clean":"2024-09-12T18:11:26.626503+0000","last_became_active":"2024-09-12T17:00:16.324683+0000","last_became_peered":"2024-09-12T17:00:16.324683+0000","last_unstale":"2024-09-12T18:11:26.626503+0000","last_undegraded":"2024-09-12T18:11:26.626503+0000","last_fullsized":"2024-09-12T18:11:26.626503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:22.409202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'157","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.925935+0000","last_change":"2024-09-12T17:00:18.327666+0000","last_active":"2024-09-12T18:12:01.925935+0000","last_peered":"2024-09-12T18:12:01.925935+0000","last_clean":"2024-09-12T18:12:01.925935+0000","last_became_active":"2024-09-12T17:00:18.327205+0000","last_became_peered":"2024-09-12T17:00:18.327205+0000","last_unstale":"2024-09-12T18:12:01.925935+0000","last_undegraded":"2024-09-12T18:12:01.925935+0000","last_fullsized":"2024-09-12T18:12:01.925935+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:47.691766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":197,"num_read_kb":191,"num_write":142,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:42.736815+0000","last_change":"2024-09-12T17:00:20.356502+0000","last_active":"2024-09-12T18:09:42.736815+0000","last_peered":"2024-09-12T18:09:42.736815+0000","last_clean":"2024-09-12T18:09:42.736815+0000","last_became_active":"2024-09-12T17:00:20.356122+0000","last_became_peered":"2024-09-12T17:00:20.356122+0000","last_unstale":"2024-09-12T18:09:42.736815+0000","last_undegraded":"2024-09-12T18:09:42.736815+0000","last_fullsized":"2024-09-12T18:09:42.736815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:23.096424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'120","reported_seq":673,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:50.327979+0000","last_change":"2024-09-12T17:00:22.359257+0000","last_active":"2024-09-12T18:09:50.327979+0000","last_peered":"2024-09-12T18:09:50.327979+0000","last_clean":"2024-09-12T18:09:50.327979+0000","last_became_active":"2024-09-12T17:00:22.358888+0000","last_became_peered":"2024-09-12T17:00:22.358888+0000","last_unstale":"2024-09-12T18:09:50.327979+0000","last_undegraded":"2024-09-12T18:09:50.327979+0000","last_fullsized":"2024-09-12T18:09:50.327979+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:22.887398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":246,"num_write":283,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'172","reported_seq":804,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:03.921583+0000","last_change":"2024-09-12T17:00:14.331104+0000","last_active":"2024-09-12T18:11:03.921583+0000","last_peered":"2024-09-12T18:11:03.921583+0000","last_clean":"2024-09-12T18:11:03.921583+0000","last_became_active":"2024-09-12T17:00:14.330844+0000","last_became_peered":"2024-09-12T17:00:14.330844+0000","last_unstale":"2024-09-12T18:11:03.921583+0000","last_undegraded":"2024-09-12T18:11:03.921583+0000","last_fullsized":"2024-09-12T18:11:03.921583+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:40.344941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":795,"num_read_kb":654,"num_write":268,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'398","reported_seq":1078,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.516008+0000","last_change":"2024-09-12T17:00:12.318919+0000","last_active":"2024-09-12T18:13:49.516008+0000","last_peered":"2024-09-12T18:13:49.516008+0000","last_clean":"2024-09-12T18:13:49.516008+0000","last_became_active":"2024-09-12T17:00:12.318621+0000","last_became_peered":"2024-09-12T17:00:12.318621+0000","last_unstale":"2024-09-12T18:13:49.516008+0000","last_undegraded":"2024-09-12T18:13:49.516008+0000","last_fullsized":"2024-09-12T18:13:49.516008+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:47.056781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":592,"num_read_kb":4542,"num_write":1332,"num_write_kb":25874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":534,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:53.920647+0000","last_change":"2024-09-12T17:00:02.683370+0000","last_active":"2024-09-12T18:10:53.920647+0000","last_peered":"2024-09-12T18:10:53.920647+0000","last_clean":"2024-09-12T18:10:53.920647+0000","last_became_active":"2024-09-12T17:00:00.667379+0000","last_became_peered":"2024-09-12T17:00:00.667379+0000","last_unstale":"2024-09-12T18:10:53.920647+0000","last_undegraded":"2024-09-12T18:10:53.920647+0000","last_fullsized":"2024-09-12T18:10:53.920647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:23.577096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056755300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:06.624201+0000","last_change":"2024-09-12T17:00:16.323271+0000","last_active":"2024-09-12T18:11:06.624201+0000","last_peered":"2024-09-12T18:11:06.624201+0000","last_clean":"2024-09-12T18:11:06.624201+0000","last_became_active":"2024-09-12T17:00:16.322854+0000","last_became_peered":"2024-09-12T17:00:16.322854+0000","last_unstale":"2024-09-12T18:11:06.624201+0000","last_undegraded":"2024-09-12T18:11:06.624201+0000","last_fullsized":"2024-09-12T18:11:06.624201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:28.816131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'664","reported_seq":1365,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.485776+0000","last_change":"2024-09-12T17:00:18.333420+0000","last_active":"2024-09-12T18:13:49.485776+0000","last_peered":"2024-09-12T18:13:49.485776+0000","last_clean":"2024-09-12T18:13:49.485776+0000","last_became_active":"2024-09-12T17:00:18.333147+0000","last_became_peered":"2024-09-12T17:00:18.333147+0000","last_unstale":"2024-09-12T18:13:49.485776+0000","last_undegraded":"2024-09-12T18:13:49.485776+0000","last_fullsized":"2024-09-12T18:13:49.485776+0000","mapping_epoch":30,"log_start":"264'600","ondisk_log_start":"264'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":600,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:53.163746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95805,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1770,"num_read_kb":3099,"num_write":2318,"num_write_kb":2109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:10.760988+0000","last_change":"2024-09-12T17:00:20.355077+0000","last_active":"2024-09-12T18:11:10.760988+0000","last_peered":"2024-09-12T18:11:10.760988+0000","last_clean":"2024-09-12T18:11:10.760988+0000","last_became_active":"2024-09-12T17:00:20.354771+0000","last_became_peered":"2024-09-12T17:00:20.354771+0000","last_unstale":"2024-09-12T18:11:10.760988+0000","last_undegraded":"2024-09-12T18:11:10.760988+0000","last_fullsized":"2024-09-12T18:11:10.760988+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:56.739823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'217","reported_seq":740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.100251+0000","last_change":"2024-09-12T17:00:22.588915+0000","last_active":"2024-09-12T18:12:01.100251+0000","last_peered":"2024-09-12T18:12:01.100251+0000","last_clean":"2024-09-12T18:12:01.100251+0000","last_became_active":"2024-09-12T17:00:22.588561+0000","last_became_peered":"2024-09-12T17:00:22.588561+0000","last_unstale":"2024-09-12T18:12:01.100251+0000","last_undegraded":"2024-09-12T18:12:01.100251+0000","last_fullsized":"2024-09-12T18:12:01.100251+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:58.487409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":223,"num_read_kb":213,"num_write":499,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'180","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:06.624221+0000","last_change":"2024-09-12T17:00:14.327539+0000","last_active":"2024-09-12T18:11:06.624221+0000","last_peered":"2024-09-12T18:11:06.624221+0000","last_clean":"2024-09-12T18:11:06.624221+0000","last_became_active":"2024-09-12T17:00:14.327268+0000","last_became_peered":"2024-09-12T17:00:14.327268+0000","last_unstale":"2024-09-12T18:11:06.624221+0000","last_undegraded":"2024-09-12T18:11:06.624221+0000","last_fullsized":"2024-09-12T18:11:06.624221+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:36.093079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":852,"num_read_kb":727,"num_write":266,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'345","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.506525+0000","last_change":"2024-09-12T17:00:12.310211+0000","last_active":"2024-09-12T18:13:49.506525+0000","last_peered":"2024-09-12T18:13:49.506525+0000","last_clean":"2024-09-12T18:13:49.506525+0000","last_became_active":"2024-09-12T17:00:12.309896+0000","last_became_peered":"2024-09-12T17:00:12.309896+0000","last_unstale":"2024-09-12T18:13:49.506525+0000","last_undegraded":"2024-09-12T18:13:49.506525+0000","last_fullsized":"2024-09-12T18:13:49.506525+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:33.087927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":595,"num_read_kb":32728,"num_write":1244,"num_write_kb":26986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.763102+0000","last_change":"2024-09-12T17:00:02.996744+0000","last_active":"2024-09-12T18:11:07.763102+0000","last_peered":"2024-09-12T18:11:07.763102+0000","last_clean":"2024-09-12T18:11:07.763102+0000","last_became_active":"2024-09-12T17:00:00.670355+0000","last_became_peered":"2024-09-12T17:00:00.670355+0000","last_unstale":"2024-09-12T18:11:07.763102+0000","last_undegraded":"2024-09-12T18:11:07.763102+0000","last_fullsized":"2024-09-12T18:11:07.763102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:16.719229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042464500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.749307+0000","last_change":"2024-09-12T17:00:16.323451+0000","last_active":"2024-09-12T18:11:07.749307+0000","last_peered":"2024-09-12T18:11:07.749307+0000","last_clean":"2024-09-12T18:11:07.749307+0000","last_became_active":"2024-09-12T17:00:16.323157+0000","last_became_peered":"2024-09-12T17:00:16.323157+0000","last_unstale":"2024-09-12T18:11:07.749307+0000","last_undegraded":"2024-09-12T18:11:07.749307+0000","last_fullsized":"2024-09-12T18:11:07.749307+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:42.424080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'213","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.796757+0000","last_change":"2024-09-12T17:00:18.429323+0000","last_active":"2024-09-12T18:11:11.796757+0000","last_peered":"2024-09-12T18:11:11.796757+0000","last_clean":"2024-09-12T18:11:11.796757+0000","last_became_active":"2024-09-12T17:00:18.428978+0000","last_became_peered":"2024-09-12T17:00:18.428978+0000","last_unstale":"2024-09-12T18:11:11.796757+0000","last_undegraded":"2024-09-12T18:11:11.796757+0000","last_fullsized":"2024-09-12T18:11:11.796757+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:03.066210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":266,"num_read_kb":257,"num_write":182,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'773","reported_seq":2989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.174296+0000","last_change":"2024-09-12T17:00:20.345525+0000","last_active":"2024-09-12T18:13:49.174296+0000","last_peered":"2024-09-12T18:13:49.174296+0000","last_clean":"2024-09-12T18:13:49.174296+0000","last_became_active":"2024-09-12T17:00:20.345236+0000","last_became_peered":"2024-09-12T17:00:20.345236+0000","last_unstale":"2024-09-12T18:13:49.174296+0000","last_undegraded":"2024-09-12T18:13:49.174296+0000","last_fullsized":"2024-09-12T18:13:49.174296+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:26.183021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'111","reported_seq":634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:31.859446+0000","last_change":"2024-09-12T17:00:22.587755+0000","last_active":"2024-09-12T18:12:31.859446+0000","last_peered":"2024-09-12T18:12:31.859446+0000","last_clean":"2024-09-12T18:12:31.859446+0000","last_became_active":"2024-09-12T17:00:22.587443+0000","last_became_peered":"2024-09-12T17:00:22.587443+0000","last_unstale":"2024-09-12T18:12:31.859446+0000","last_undegraded":"2024-09-12T18:12:31.859446+0000","last_fullsized":"2024-09-12T18:12:31.859446+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:05.679814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":705,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":239,"num_read_kb":213,"num_write":277,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'317","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.843564+0000","last_change":"2024-09-12T17:00:14.333428+0000","last_active":"2024-09-12T18:10:26.843564+0000","last_peered":"2024-09-12T18:10:26.843564+0000","last_clean":"2024-09-12T18:10:26.843564+0000","last_became_active":"2024-09-12T17:00:14.333128+0000","last_became_peered":"2024-09-12T17:00:14.333128+0000","last_unstale":"2024-09-12T18:10:26.843564+0000","last_undegraded":"2024-09-12T18:10:26.843564+0000","last_fullsized":"2024-09-12T18:10:26.843564+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:34.464037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1338,"num_read_kb":1083,"num_write":472,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'366","reported_seq":1022,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.458051+0000","last_change":"2024-09-12T17:00:12.316074+0000","last_active":"2024-09-12T18:13:49.458051+0000","last_peered":"2024-09-12T18:13:49.458051+0000","last_clean":"2024-09-12T18:13:49.458051+0000","last_became_active":"2024-09-12T17:00:12.315812+0000","last_became_peered":"2024-09-12T17:00:12.315812+0000","last_unstale":"2024-09-12T18:13:49.458051+0000","last_undegraded":"2024-09-12T18:13:49.458051+0000","last_fullsized":"2024-09-12T18:13:49.458051+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:36.960724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1826072,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":562,"num_read_kb":23161,"num_write":1132,"num_write_kb":14173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:33.924599+0000","last_change":"2024-09-12T17:00:02.683419+0000","last_active":"2024-09-12T18:11:33.924599+0000","last_peered":"2024-09-12T18:11:33.924599+0000","last_clean":"2024-09-12T18:11:33.924599+0000","last_became_active":"2024-09-12T17:00:00.669898+0000","last_became_peered":"2024-09-12T17:00:00.669898+0000","last_unstale":"2024-09-12T18:11:33.924599+0000","last_undegraded":"2024-09-12T18:11:33.924599+0000","last_fullsized":"2024-09-12T18:11:33.924599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:32.053145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060387199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:05.760206+0000","last_change":"2024-09-12T17:00:16.327641+0000","last_active":"2024-09-12T18:11:05.760206+0000","last_peered":"2024-09-12T18:11:05.760206+0000","last_clean":"2024-09-12T18:11:05.760206+0000","last_became_active":"2024-09-12T17:00:16.327270+0000","last_became_peered":"2024-09-12T17:00:16.327270+0000","last_unstale":"2024-09-12T18:11:05.760206+0000","last_undegraded":"2024-09-12T18:11:05.760206+0000","last_fullsized":"2024-09-12T18:11:05.760206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:48.314834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'129","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.726748+0000","last_change":"2024-09-12T17:00:18.328546+0000","last_active":"2024-09-12T18:11:11.726748+0000","last_peered":"2024-09-12T18:11:11.726748+0000","last_clean":"2024-09-12T18:11:11.726748+0000","last_became_active":"2024-09-12T17:00:18.327994+0000","last_became_peered":"2024-09-12T17:00:18.327994+0000","last_unstale":"2024-09-12T18:11:11.726748+0000","last_undegraded":"2024-09-12T18:11:11.726748+0000","last_fullsized":"2024-09-12T18:11:11.726748+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:08.620648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":161,"num_write":110,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'775","reported_seq":2837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.820968+0000","last_change":"2024-09-12T17:00:20.354844+0000","last_active":"2024-09-12T18:13:48.820968+0000","last_peered":"2024-09-12T18:13:48.820968+0000","last_clean":"2024-09-12T18:13:48.820968+0000","last_became_active":"2024-09-12T17:00:20.354519+0000","last_became_peered":"2024-09-12T17:00:20.354519+0000","last_unstale":"2024-09-12T18:13:48.820968+0000","last_undegraded":"2024-09-12T18:13:48.820968+0000","last_fullsized":"2024-09-12T18:13:48.820968+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:52.962681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'283","reported_seq":819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.915298+0000","last_change":"2024-09-12T17:00:22.356453+0000","last_active":"2024-09-12T18:12:01.915298+0000","last_peered":"2024-09-12T18:12:01.915298+0000","last_clean":"2024-09-12T18:12:01.915298+0000","last_became_active":"2024-09-12T17:00:22.356132+0000","last_became_peered":"2024-09-12T17:00:22.356132+0000","last_unstale":"2024-09-12T18:12:01.915298+0000","last_undegraded":"2024-09-12T18:12:01.915298+0000","last_fullsized":"2024-09-12T18:12:01.915298+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:55.124427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":378,"num_read_kb":377,"num_write":631,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'145","reported_seq":762,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:05.760147+0000","last_change":"2024-09-12T17:00:14.330712+0000","last_active":"2024-09-12T18:11:05.760147+0000","last_peered":"2024-09-12T18:11:05.760147+0000","last_clean":"2024-09-12T18:11:05.760147+0000","last_became_active":"2024-09-12T17:00:14.330433+0000","last_became_peered":"2024-09-12T17:00:14.330433+0000","last_unstale":"2024-09-12T18:11:05.760147+0000","last_undegraded":"2024-09-12T18:11:05.760147+0000","last_fullsized":"2024-09-12T18:11:05.760147+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:23.434335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":651,"num_read_kb":539,"num_write":208,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'370","reported_seq":1138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.500731+0000","last_change":"2024-09-12T17:00:12.308249+0000","last_active":"2024-09-12T18:13:49.500731+0000","last_peered":"2024-09-12T18:13:49.500731+0000","last_clean":"2024-09-12T18:13:49.500731+0000","last_became_active":"2024-09-12T17:00:12.307371+0000","last_became_peered":"2024-09-12T17:00:12.307371+0000","last_unstale":"2024-09-12T18:13:49.500731+0000","last_undegraded":"2024-09-12T18:13:49.500731+0000","last_fullsized":"2024-09-12T18:13:49.500731+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:08.255196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262175,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":835,"num_read_kb":7035,"num_write":1193,"num_write_kb":32501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:32.752719+0000","last_change":"2024-09-12T17:00:02.674920+0000","last_active":"2024-09-12T18:11:32.752719+0000","last_peered":"2024-09-12T18:11:32.752719+0000","last_clean":"2024-09-12T18:11:32.752719+0000","last_became_active":"2024-09-12T17:00:00.670451+0000","last_became_peered":"2024-09-12T17:00:00.670451+0000","last_unstale":"2024-09-12T18:11:32.752719+0000","last_undegraded":"2024-09-12T18:11:32.752719+0000","last_fullsized":"2024-09-12T18:11:32.752719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:59:59.651916+0000","last_clean_scrub_stamp":"2024-09-12T16:59:59.651916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:42.274336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046867000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.843580+0000","last_change":"2024-09-12T17:00:16.326975+0000","last_active":"2024-09-12T18:10:26.843580+0000","last_peered":"2024-09-12T18:10:26.843580+0000","last_clean":"2024-09-12T18:10:26.843580+0000","last_became_active":"2024-09-12T17:00:16.326163+0000","last_became_peered":"2024-09-12T17:00:16.326163+0000","last_unstale":"2024-09-12T18:10:26.843580+0000","last_undegraded":"2024-09-12T18:10:26.843580+0000","last_fullsized":"2024-09-12T18:10:26.843580+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:07.452685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'789","reported_seq":1528,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.935550+0000","last_change":"2024-09-12T17:00:18.429419+0000","last_active":"2024-09-12T18:13:48.935550+0000","last_peered":"2024-09-12T18:13:48.935550+0000","last_clean":"2024-09-12T18:13:48.935550+0000","last_became_active":"2024-09-12T17:00:18.429131+0000","last_became_peered":"2024-09-12T17:00:18.429131+0000","last_unstale":"2024-09-12T18:13:48.935550+0000","last_undegraded":"2024-09-12T18:13:48.935550+0000","last_fullsized":"2024-09-12T18:13:48.935550+0000","mapping_epoch":30,"log_start":"264'700","ondisk_log_start":"264'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:04:14.159447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164213,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1409,"num_read_kb":3444,"num_write":1148,"num_write_kb":951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.848361+0000","last_change":"2024-09-12T17:00:20.350091+0000","last_active":"2024-09-12T18:11:11.848361+0000","last_peered":"2024-09-12T18:11:11.848361+0000","last_clean":"2024-09-12T18:11:11.848361+0000","last_became_active":"2024-09-12T17:00:20.349800+0000","last_became_peered":"2024-09-12T17:00:20.349800+0000","last_unstale":"2024-09-12T18:11:11.848361+0000","last_undegraded":"2024-09-12T18:11:11.848361+0000","last_fullsized":"2024-09-12T18:11:11.848361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:28:56.661972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'139","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:07.952151+0000","last_change":"2024-09-12T17:00:22.361129+0000","last_active":"2024-09-12T18:10:07.952151+0000","last_peered":"2024-09-12T18:10:07.952151+0000","last_clean":"2024-09-12T18:10:07.952151+0000","last_became_active":"2024-09-12T17:00:22.360730+0000","last_became_peered":"2024-09-12T17:00:22.360730+0000","last_unstale":"2024-09-12T18:10:07.952151+0000","last_undegraded":"2024-09-12T18:10:07.952151+0000","last_fullsized":"2024-09-12T18:10:07.952151+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:53.958932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":172,"num_read_kb":170,"num_write":343,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'181","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.194693+0000","last_change":"2024-09-12T17:00:22.354855+0000","last_active":"2024-09-12T18:12:03.194693+0000","last_peered":"2024-09-12T18:12:03.194693+0000","last_clean":"2024-09-12T18:12:03.194693+0000","last_became_active":"2024-09-12T17:00:22.354464+0000","last_became_peered":"2024-09-12T17:00:22.354464+0000","last_unstale":"2024-09-12T18:12:03.194693+0000","last_undegraded":"2024-09-12T18:12:03.194693+0000","last_fullsized":"2024-09-12T18:12:03.194693+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:18.356184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":465,"num_read_kb":419,"num_write":437,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'369","reported_seq":1045,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:15.752357+0000","last_change":"2024-09-12T17:00:14.330391+0000","last_active":"2024-09-12T18:10:15.752357+0000","last_peered":"2024-09-12T18:10:15.752357+0000","last_clean":"2024-09-12T18:10:15.752357+0000","last_became_active":"2024-09-12T17:00:14.329093+0000","last_became_peered":"2024-09-12T17:00:14.329093+0000","last_unstale":"2024-09-12T18:10:15.752357+0000","last_undegraded":"2024-09-12T18:10:15.752357+0000","last_fullsized":"2024-09-12T18:10:15.752357+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:02.679602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1637,"num_read_kb":1326,"num_write":585,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'361","reported_seq":1102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.516665+0000","last_change":"2024-09-12T17:00:12.307582+0000","last_active":"2024-09-12T18:13:49.516665+0000","last_peered":"2024-09-12T18:13:49.516665+0000","last_clean":"2024-09-12T18:13:49.516665+0000","last_became_active":"2024-09-12T17:00:12.307309+0000","last_became_peered":"2024-09-12T17:00:12.307309+0000","last_unstale":"2024-09-12T18:13:49.516665+0000","last_undegraded":"2024-09-12T18:13:49.516665+0000","last_fullsized":"2024-09-12T18:13:49.516665+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:28.009676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":717,"num_read_kb":21828,"num_write":1272,"num_write_kb":15847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:18.916856+0000","last_change":"2024-09-12T17:00:16.325960+0000","last_active":"2024-09-12T18:10:18.916856+0000","last_peered":"2024-09-12T18:10:18.916856+0000","last_clean":"2024-09-12T18:10:18.916856+0000","last_became_active":"2024-09-12T17:00:16.325555+0000","last_became_peered":"2024-09-12T17:00:16.325555+0000","last_unstale":"2024-09-12T18:10:18.916856+0000","last_undegraded":"2024-09-12T18:10:18.916856+0000","last_fullsized":"2024-09-12T18:10:18.916856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:08:46.715410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'299","reported_seq":888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.175507+0000","last_change":"2024-09-12T17:00:18.328249+0000","last_active":"2024-09-12T18:13:49.175507+0000","last_peered":"2024-09-12T18:13:49.175507+0000","last_clean":"2024-09-12T18:13:49.175507+0000","last_became_active":"2024-09-12T17:00:18.327374+0000","last_became_peered":"2024-09-12T17:00:18.327374+0000","last_unstale":"2024-09-12T18:13:49.175507+0000","last_undegraded":"2024-09-12T18:13:49.175507+0000","last_fullsized":"2024-09-12T18:13:49.175507+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:36.522799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49267,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":497,"num_read_kb":1124,"num_write":398,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.842898+0000","last_change":"2024-09-12T17:00:20.353374+0000","last_active":"2024-09-12T18:10:21.842898+0000","last_peered":"2024-09-12T18:10:21.842898+0000","last_clean":"2024-09-12T18:10:21.842898+0000","last_became_active":"2024-09-12T17:00:20.352801+0000","last_became_peered":"2024-09-12T17:00:20.352801+0000","last_unstale":"2024-09-12T18:10:21.842898+0000","last_undegraded":"2024-09-12T18:10:21.842898+0000","last_fullsized":"2024-09-12T18:10:21.842898+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:10.323586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'192","reported_seq":718,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844219+0000","last_change":"2024-09-12T17:00:22.354964+0000","last_active":"2024-09-12T18:10:31.844219+0000","last_peered":"2024-09-12T18:10:31.844219+0000","last_clean":"2024-09-12T18:10:31.844219+0000","last_became_active":"2024-09-12T17:00:22.354651+0000","last_became_peered":"2024-09-12T17:00:22.354651+0000","last_unstale":"2024-09-12T18:10:31.844219+0000","last_undegraded":"2024-09-12T18:10:31.844219+0000","last_fullsized":"2024-09-12T18:10:31.844219+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:50.025969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":300,"num_read_kb":268,"num_write":394,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'230","reported_seq":866,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:13.916251+0000","last_change":"2024-09-12T17:00:14.322018+0000","last_active":"2024-09-12T18:10:13.916251+0000","last_peered":"2024-09-12T18:10:13.916251+0000","last_clean":"2024-09-12T18:10:13.916251+0000","last_became_active":"2024-09-12T17:00:14.320955+0000","last_became_peered":"2024-09-12T17:00:14.320955+0000","last_unstale":"2024-09-12T18:10:13.916251+0000","last_undegraded":"2024-09-12T18:10:13.916251+0000","last_fullsized":"2024-09-12T18:10:13.916251+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:51.522285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1027,"num_read_kb":855,"num_write":338,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'400","reported_seq":1043,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.499589+0000","last_change":"2024-09-12T17:00:12.316146+0000","last_active":"2024-09-12T18:13:49.499589+0000","last_peered":"2024-09-12T18:13:49.499589+0000","last_clean":"2024-09-12T18:13:49.499589+0000","last_became_active":"2024-09-12T17:00:12.315834+0000","last_became_peered":"2024-09-12T17:00:12.315834+0000","last_unstale":"2024-09-12T18:13:49.499589+0000","last_undegraded":"2024-09-12T18:13:49.499589+0000","last_fullsized":"2024-09-12T18:13:49.499589+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:21.977408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3436700,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":549,"num_read_kb":44669,"num_write":1257,"num_write_kb":42862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:16.842404+0000","last_change":"2024-09-12T17:00:16.327598+0000","last_active":"2024-09-12T18:10:16.842404+0000","last_peered":"2024-09-12T18:10:16.842404+0000","last_clean":"2024-09-12T18:10:16.842404+0000","last_became_active":"2024-09-12T17:00:16.327292+0000","last_became_peered":"2024-09-12T17:00:16.327292+0000","last_unstale":"2024-09-12T18:10:16.842404+0000","last_undegraded":"2024-09-12T18:10:16.842404+0000","last_fullsized":"2024-09-12T18:10:16.842404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:28.781328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'50","reported_seq":574,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:00.089541+0000","last_change":"2024-09-12T17:00:18.331826+0000","last_active":"2024-09-12T18:11:00.089541+0000","last_peered":"2024-09-12T18:11:00.089541+0000","last_clean":"2024-09-12T18:11:00.089541+0000","last_became_active":"2024-09-12T17:00:18.331495+0000","last_became_peered":"2024-09-12T17:00:18.331495+0000","last_unstale":"2024-09-12T18:11:00.089541+0000","last_undegraded":"2024-09-12T18:11:00.089541+0000","last_fullsized":"2024-09-12T18:11:00.089541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:10.249483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.755874+0000","last_change":"2024-09-12T17:00:20.348626+0000","last_active":"2024-09-12T18:10:22.755874+0000","last_peered":"2024-09-12T18:10:22.755874+0000","last_clean":"2024-09-12T18:10:22.755874+0000","last_became_active":"2024-09-12T17:00:20.348274+0000","last_became_peered":"2024-09-12T17:00:20.348274+0000","last_unstale":"2024-09-12T18:10:22.755874+0000","last_undegraded":"2024-09-12T18:10:22.755874+0000","last_fullsized":"2024-09-12T18:10:22.755874+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:44.279723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'244","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.928095+0000","last_change":"2024-09-12T17:00:22.350497+0000","last_active":"2024-09-12T18:12:01.928095+0000","last_peered":"2024-09-12T18:12:01.928095+0000","last_clean":"2024-09-12T18:12:01.928095+0000","last_became_active":"2024-09-12T17:00:22.350195+0000","last_became_peered":"2024-09-12T17:00:22.350195+0000","last_unstale":"2024-09-12T18:12:01.928095+0000","last_undegraded":"2024-09-12T18:12:01.928095+0000","last_fullsized":"2024-09-12T18:12:01.928095+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:00.704663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":636,"num_read_kb":568,"num_write":560,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'163","reported_seq":757,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:16.842370+0000","last_change":"2024-09-12T17:00:14.334938+0000","last_active":"2024-09-12T18:10:16.842370+0000","last_peered":"2024-09-12T18:10:16.842370+0000","last_clean":"2024-09-12T18:10:16.842370+0000","last_became_active":"2024-09-12T17:00:14.334652+0000","last_became_peered":"2024-09-12T17:00:14.334652+0000","last_unstale":"2024-09-12T18:10:16.842370+0000","last_undegraded":"2024-09-12T18:10:16.842370+0000","last_fullsized":"2024-09-12T18:10:16.842370+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:28.183092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":705,"num_read_kb":585,"num_write":252,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'365","reported_seq":1043,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.513497+0000","last_change":"2024-09-12T17:00:12.312907+0000","last_active":"2024-09-12T18:13:49.513497+0000","last_peered":"2024-09-12T18:13:49.513497+0000","last_clean":"2024-09-12T18:13:49.513497+0000","last_became_active":"2024-09-12T17:00:12.312629+0000","last_became_peered":"2024-09-12T17:00:12.312629+0000","last_unstale":"2024-09-12T18:13:49.513497+0000","last_undegraded":"2024-09-12T18:13:49.513497+0000","last_fullsized":"2024-09-12T18:13:49.513497+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:48.636890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524362,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":634,"num_read_kb":31722,"num_write":1487,"num_write_kb":32347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.755061+0000","last_change":"2024-09-12T17:00:16.327231+0000","last_active":"2024-09-12T18:10:17.755061+0000","last_peered":"2024-09-12T18:10:17.755061+0000","last_clean":"2024-09-12T18:10:17.755061+0000","last_became_active":"2024-09-12T17:00:16.326905+0000","last_became_peered":"2024-09-12T17:00:16.326905+0000","last_unstale":"2024-09-12T18:10:17.755061+0000","last_undegraded":"2024-09-12T18:10:17.755061+0000","last_fullsized":"2024-09-12T18:10:17.755061+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:18.823688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'346","reported_seq":950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.718326+0000","last_change":"2024-09-12T17:00:18.330035+0000","last_active":"2024-09-12T18:13:48.718326+0000","last_peered":"2024-09-12T18:13:48.718326+0000","last_clean":"2024-09-12T18:13:48.718326+0000","last_became_active":"2024-09-12T17:00:18.329759+0000","last_became_peered":"2024-09-12T17:00:18.329759+0000","last_unstale":"2024-09-12T18:13:48.718326+0000","last_undegraded":"2024-09-12T18:13:48.718326+0000","last_fullsized":"2024-09-12T18:13:48.718326+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:49.034586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50102,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":567,"num_read_kb":1243,"num_write":450,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.742473+0000","last_change":"2024-09-12T17:00:20.355975+0000","last_active":"2024-09-12T18:10:22.742473+0000","last_peered":"2024-09-12T18:10:22.742473+0000","last_clean":"2024-09-12T18:10:22.742473+0000","last_became_active":"2024-09-12T17:00:20.355629+0000","last_became_peered":"2024-09-12T17:00:20.355629+0000","last_unstale":"2024-09-12T18:10:22.742473+0000","last_undegraded":"2024-09-12T18:10:22.742473+0000","last_fullsized":"2024-09-12T18:10:22.742473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:01.719912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'125","reported_seq":653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954454+0000","last_change":"2024-09-12T17:00:22.360360+0000","last_active":"2024-09-12T18:10:22.954454+0000","last_peered":"2024-09-12T18:10:22.954454+0000","last_clean":"2024-09-12T18:10:22.954454+0000","last_became_active":"2024-09-12T17:00:22.360051+0000","last_became_peered":"2024-09-12T17:00:22.360051+0000","last_unstale":"2024-09-12T18:10:22.954454+0000","last_undegraded":"2024-09-12T18:10:22.954454+0000","last_fullsized":"2024-09-12T18:10:22.954454+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:14:23.925876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":246,"num_read_kb":229,"num_write":325,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'696","reported_seq":1442,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:16.842347+0000","last_change":"2024-09-12T17:00:14.338751+0000","last_active":"2024-09-12T18:10:16.842347+0000","last_peered":"2024-09-12T18:10:16.842347+0000","last_clean":"2024-09-12T18:10:16.842347+0000","last_became_active":"2024-09-12T17:00:14.338453+0000","last_became_peered":"2024-09-12T17:00:14.338453+0000","last_unstale":"2024-09-12T18:10:16.842347+0000","last_undegraded":"2024-09-12T18:10:16.842347+0000","last_fullsized":"2024-09-12T18:10:16.842347+0000","mapping_epoch":26,"log_start":"264'600","ondisk_log_start":"264'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:37.142336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3211,"num_read_kb":2592,"num_write":1218,"num_write_kb":764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'370","reported_seq":1011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.503003+0000","last_change":"2024-09-12T17:00:46.407184+0000","last_active":"2024-09-12T18:13:49.503003+0000","last_peered":"2024-09-12T18:13:49.503003+0000","last_clean":"2024-09-12T18:13:49.503003+0000","last_became_active":"2024-09-12T17:00:46.406811+0000","last_became_peered":"2024-09-12T17:00:46.406811+0000","last_unstale":"2024-09-12T18:13:49.503003+0000","last_undegraded":"2024-09-12T18:13:49.503003+0000","last_fullsized":"2024-09-12T18:13:49.503003+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:48.447890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170356,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":466,"num_read_kb":7187,"num_write":1054,"num_write_kb":23441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.741569+0000","last_change":"2024-09-12T17:00:16.328869+0000","last_active":"2024-09-12T18:10:17.741569+0000","last_peered":"2024-09-12T18:10:17.741569+0000","last_clean":"2024-09-12T18:10:17.741569+0000","last_became_active":"2024-09-12T17:00:16.328571+0000","last_became_peered":"2024-09-12T17:00:16.328571+0000","last_unstale":"2024-09-12T18:10:17.741569+0000","last_undegraded":"2024-09-12T18:10:17.741569+0000","last_fullsized":"2024-09-12T18:10:17.741569+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:55.238346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'308","reported_seq":887,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.596783+0000","last_change":"2024-09-12T17:00:18.332118+0000","last_active":"2024-09-12T18:13:48.596783+0000","last_peered":"2024-09-12T18:13:48.596783+0000","last_clean":"2024-09-12T18:13:48.596783+0000","last_became_active":"2024-09-12T17:00:18.331634+0000","last_became_peered":"2024-09-12T17:00:18.331634+0000","last_unstale":"2024-09-12T18:13:48.596783+0000","last_undegraded":"2024-09-12T18:13:48.596783+0000","last_fullsized":"2024-09-12T18:13:48.596783+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:30.095230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":499,"num_read_kb":1194,"num_write":408,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619176+0000","last_change":"2024-09-12T17:00:20.347184+0000","last_active":"2024-09-12T18:10:21.619176+0000","last_peered":"2024-09-12T18:10:21.619176+0000","last_clean":"2024-09-12T18:10:21.619176+0000","last_became_active":"2024-09-12T17:00:20.346778+0000","last_became_peered":"2024-09-12T17:00:20.346778+0000","last_unstale":"2024-09-12T18:10:21.619176+0000","last_undegraded":"2024-09-12T18:10:21.619176+0000","last_fullsized":"2024-09-12T18:10:21.619176+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:00.409774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'4226","reported_seq":4832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.749351+0000","last_change":"2024-09-12T17:00:14.327640+0000","last_active":"2024-09-12T18:11:07.749351+0000","last_peered":"2024-09-12T18:11:07.749351+0000","last_clean":"2024-09-12T18:11:07.749351+0000","last_became_active":"2024-09-12T17:00:14.327366+0000","last_became_peered":"2024-09-12T17:00:14.327366+0000","last_unstale":"2024-09-12T18:11:07.749351+0000","last_undegraded":"2024-09-12T18:11:07.749351+0000","last_fullsized":"2024-09-12T18:11:07.749351+0000","mapping_epoch":26,"log_start":"264'4200","ondisk_log_start":"264'4200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":3000,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:10.766155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16999,"num_read_kb":14230,"num_write":6368,"num_write_kb":3177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'344","reported_seq":967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.493789+0000","last_change":"2024-09-12T17:00:12.316740+0000","last_active":"2024-09-12T18:13:49.493789+0000","last_peered":"2024-09-12T18:13:49.493789+0000","last_clean":"2024-09-12T18:13:49.493789+0000","last_became_active":"2024-09-12T17:00:12.316401+0000","last_became_peered":"2024-09-12T17:00:12.316401+0000","last_unstale":"2024-09-12T18:13:49.493789+0000","last_undegraded":"2024-09-12T18:13:49.493789+0000","last_fullsized":"2024-09-12T18:13:49.493789+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:45.699943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2180110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":457,"num_read_kb":29254,"num_write":1102,"num_write_kb":37912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.620995+0000","last_change":"2024-09-12T17:00:16.318371+0000","last_active":"2024-09-12T18:10:36.620995+0000","last_peered":"2024-09-12T18:10:36.620995+0000","last_clean":"2024-09-12T18:10:36.620995+0000","last_became_active":"2024-09-12T17:00:16.317972+0000","last_became_peered":"2024-09-12T17:00:16.317972+0000","last_unstale":"2024-09-12T18:10:36.620995+0000","last_undegraded":"2024-09-12T18:10:36.620995+0000","last_fullsized":"2024-09-12T18:10:36.620995+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:29.831275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'529","reported_seq":1178,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.412475+0000","last_change":"2024-09-12T17:00:18.327876+0000","last_active":"2024-09-12T18:13:49.412475+0000","last_peered":"2024-09-12T18:13:49.412475+0000","last_clean":"2024-09-12T18:13:49.412475+0000","last_became_active":"2024-09-12T17:00:18.327593+0000","last_became_peered":"2024-09-12T17:00:18.327593+0000","last_unstale":"2024-09-12T18:13:49.412475+0000","last_undegraded":"2024-09-12T18:13:49.412475+0000","last_fullsized":"2024-09-12T18:13:49.412475+0000","mapping_epoch":30,"log_start":"264'500","ondisk_log_start":"264'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:04.110712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111195,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":962,"num_read_kb":2364,"num_write":832,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954467+0000","last_change":"2024-09-12T17:00:20.350747+0000","last_active":"2024-09-12T18:10:22.954467+0000","last_peered":"2024-09-12T18:10:22.954467+0000","last_clean":"2024-09-12T18:10:22.954467+0000","last_became_active":"2024-09-12T17:00:20.350413+0000","last_became_peered":"2024-09-12T17:00:20.350413+0000","last_unstale":"2024-09-12T18:10:22.954467+0000","last_undegraded":"2024-09-12T18:10:22.954467+0000","last_fullsized":"2024-09-12T18:10:22.954467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:40.936332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'144","reported_seq":644,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.842975+0000","last_change":"2024-09-12T17:00:22.589129+0000","last_active":"2024-09-12T18:10:21.842975+0000","last_peered":"2024-09-12T18:10:21.842975+0000","last_clean":"2024-09-12T18:10:21.842975+0000","last_became_active":"2024-09-12T17:00:22.588456+0000","last_became_peered":"2024-09-12T17:00:22.588456+0000","last_unstale":"2024-09-12T18:10:21.842975+0000","last_undegraded":"2024-09-12T18:10:21.842975+0000","last_fullsized":"2024-09-12T18:10:21.842975+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:28.680701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":212,"num_write":324,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'222","reported_seq":887,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.620980+0000","last_change":"2024-09-12T17:00:14.332252+0000","last_active":"2024-09-12T18:10:36.620980+0000","last_peered":"2024-09-12T18:10:36.620980+0000","last_clean":"2024-09-12T18:10:36.620980+0000","last_became_active":"2024-09-12T17:00:14.328921+0000","last_became_peered":"2024-09-12T17:00:14.328921+0000","last_unstale":"2024-09-12T18:10:36.620980+0000","last_undegraded":"2024-09-12T18:10:36.620980+0000","last_fullsized":"2024-09-12T18:10:36.620980+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:14.125302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":992,"num_read_kb":851,"num_write":318,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'351","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.502690+0000","last_change":"2024-09-12T17:00:12.311889+0000","last_active":"2024-09-12T18:13:49.502690+0000","last_peered":"2024-09-12T18:13:49.502690+0000","last_clean":"2024-09-12T18:13:49.502690+0000","last_became_active":"2024-09-12T17:00:12.311606+0000","last_became_peered":"2024-09-12T17:00:12.311606+0000","last_unstale":"2024-09-12T18:13:49.502690+0000","last_undegraded":"2024-09-12T18:13:49.502690+0000","last_fullsized":"2024-09-12T18:13:49.502690+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:22.040208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":470,"num_read_kb":10885,"num_write":1123,"num_write_kb":34953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.749361+0000","last_change":"2024-09-12T17:00:16.327834+0000","last_active":"2024-09-12T18:11:07.749361+0000","last_peered":"2024-09-12T18:11:07.749361+0000","last_clean":"2024-09-12T18:11:07.749361+0000","last_became_active":"2024-09-12T17:00:16.327527+0000","last_became_peered":"2024-09-12T17:00:16.327527+0000","last_unstale":"2024-09-12T18:11:07.749361+0000","last_undegraded":"2024-09-12T18:11:07.749361+0000","last_fullsized":"2024-09-12T18:11:07.749361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:26.325669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'338","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.630526+0000","last_change":"2024-09-12T17:00:18.327394+0000","last_active":"2024-09-12T18:13:48.630526+0000","last_peered":"2024-09-12T18:13:48.630526+0000","last_clean":"2024-09-12T18:13:48.630526+0000","last_became_active":"2024-09-12T17:00:18.326984+0000","last_became_peered":"2024-09-12T17:00:18.326984+0000","last_unstale":"2024-09-12T18:13:48.630526+0000","last_undegraded":"2024-09-12T18:13:48.630526+0000","last_fullsized":"2024-09-12T18:13:48.630526+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:47.996940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46916,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":562,"num_read_kb":1193,"num_write":464,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:23.917579+0000","last_change":"2024-09-12T17:00:20.348230+0000","last_active":"2024-09-12T18:10:23.917579+0000","last_peered":"2024-09-12T18:10:23.917579+0000","last_clean":"2024-09-12T18:10:23.917579+0000","last_became_active":"2024-09-12T17:00:20.347873+0000","last_became_peered":"2024-09-12T17:00:20.347873+0000","last_unstale":"2024-09-12T18:10:23.917579+0000","last_undegraded":"2024-09-12T18:10:23.917579+0000","last_fullsized":"2024-09-12T18:10:23.917579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:20.554953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'167","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.557258+0000","last_change":"2024-09-12T17:00:22.351181+0000","last_active":"2024-09-12T18:11:58.557258+0000","last_peered":"2024-09-12T18:11:58.557258+0000","last_clean":"2024-09-12T18:11:58.557258+0000","last_became_active":"2024-09-12T17:00:22.350856+0000","last_became_peered":"2024-09-12T17:00:22.350856+0000","last_unstale":"2024-09-12T18:11:58.557258+0000","last_undegraded":"2024-09-12T18:11:58.557258+0000","last_fullsized":"2024-09-12T18:11:58.557258+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:47.546741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1852,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":274,"num_read_kb":259,"num_write":495,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'116","reported_seq":702,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:16.842438+0000","last_change":"2024-09-12T17:00:14.337578+0000","last_active":"2024-09-12T18:10:16.842438+0000","last_peered":"2024-09-12T18:10:16.842438+0000","last_clean":"2024-09-12T18:10:16.842438+0000","last_became_active":"2024-09-12T17:00:14.336495+0000","last_became_peered":"2024-09-12T17:00:14.336495+0000","last_unstale":"2024-09-12T18:10:16.842438+0000","last_undegraded":"2024-09-12T18:10:16.842438+0000","last_fullsized":"2024-09-12T18:10:16.842438+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:35.177783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":523,"num_read_kb":437,"num_write":169,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'377","reported_seq":1003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.508937+0000","last_change":"2024-09-12T17:00:12.318854+0000","last_active":"2024-09-12T18:13:49.508937+0000","last_peered":"2024-09-12T18:13:49.508937+0000","last_clean":"2024-09-12T18:13:49.508937+0000","last_became_active":"2024-09-12T17:00:12.318234+0000","last_became_peered":"2024-09-12T17:00:12.318234+0000","last_unstale":"2024-09-12T18:13:49.508937+0000","last_undegraded":"2024-09-12T18:13:49.508937+0000","last_fullsized":"2024-09-12T18:13:49.508937+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:50.822617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":38331,"num_write":1137,"num_write_kb":59769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"36'3","reported_seq":989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:47.955863+0000","last_change":"2024-09-12T17:00:16.327679+0000","last_active":"2024-09-12T18:13:47.955863+0000","last_peered":"2024-09-12T18:13:47.955863+0000","last_clean":"2024-09-12T18:13:47.955863+0000","last_became_active":"2024-09-12T17:00:16.327396+0000","last_became_peered":"2024-09-12T17:00:16.327396+0000","last_unstale":"2024-09-12T18:13:47.955863+0000","last_undegraded":"2024-09-12T18:13:47.955863+0000","last_fullsized":"2024-09-12T18:13:47.955863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:03.799735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'294","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.345203+0000","last_change":"2024-09-12T17:00:18.429503+0000","last_active":"2024-09-12T18:13:49.345203+0000","last_peered":"2024-09-12T18:13:49.345203+0000","last_clean":"2024-09-12T18:13:49.345203+0000","last_became_active":"2024-09-12T17:00:18.429149+0000","last_became_peered":"2024-09-12T17:00:18.429149+0000","last_unstale":"2024-09-12T18:13:49.345203+0000","last_undegraded":"2024-09-12T18:13:49.345203+0000","last_fullsized":"2024-09-12T18:13:49.345203+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:42.541128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47739,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":501,"num_read_kb":1160,"num_write":400,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:38.919197+0000","last_change":"2024-09-12T17:00:20.350078+0000","last_active":"2024-09-12T18:10:38.919197+0000","last_peered":"2024-09-12T18:10:38.919197+0000","last_clean":"2024-09-12T18:10:38.919197+0000","last_became_active":"2024-09-12T17:00:20.349769+0000","last_became_peered":"2024-09-12T17:00:20.349769+0000","last_unstale":"2024-09-12T18:10:38.919197+0000","last_undegraded":"2024-09-12T18:10:38.919197+0000","last_fullsized":"2024-09-12T18:10:38.919197+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:01.586846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'102","reported_seq":597,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.025748+0000","last_change":"2024-09-12T17:00:22.359344+0000","last_active":"2024-09-12T18:13:23.025748+0000","last_peered":"2024-09-12T18:13:23.025748+0000","last_clean":"2024-09-12T18:13:23.025748+0000","last_became_active":"2024-09-12T17:00:22.358484+0000","last_became_peered":"2024-09-12T17:00:22.358484+0000","last_unstale":"2024-09-12T18:13:23.025748+0000","last_undegraded":"2024-09-12T18:13:23.025748+0000","last_fullsized":"2024-09-12T18:13:23.025748+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:18.149297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":123,"num_write":242,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'161","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:13.698084+0000","last_change":"2024-09-12T17:00:14.330553+0000","last_active":"2024-09-12T18:10:13.698084+0000","last_peered":"2024-09-12T18:10:13.698084+0000","last_clean":"2024-09-12T18:10:13.698084+0000","last_became_active":"2024-09-12T17:00:14.330238+0000","last_became_peered":"2024-09-12T17:00:14.330238+0000","last_unstale":"2024-09-12T18:10:13.698084+0000","last_undegraded":"2024-09-12T18:10:13.698084+0000","last_fullsized":"2024-09-12T18:10:13.698084+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:59.558428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":737,"num_read_kb":617,"num_write":248,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'329","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.493774+0000","last_change":"2024-09-12T17:00:12.305559+0000","last_active":"2024-09-12T18:13:49.493774+0000","last_peered":"2024-09-12T18:13:49.493774+0000","last_clean":"2024-09-12T18:13:49.493774+0000","last_became_active":"2024-09-12T17:00:12.305259+0000","last_became_peered":"2024-09-12T17:00:12.305259+0000","last_unstale":"2024-09-12T18:13:49.493774+0000","last_undegraded":"2024-09-12T18:13:49.493774+0000","last_fullsized":"2024-09-12T18:13:49.493774+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:27.124942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048621,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":464,"num_read_kb":5194,"num_write":1027,"num_write_kb":36405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:18.916910+0000","last_change":"2024-09-12T17:00:16.327913+0000","last_active":"2024-09-12T18:10:18.916910+0000","last_peered":"2024-09-12T18:10:18.916910+0000","last_clean":"2024-09-12T18:10:18.916910+0000","last_became_active":"2024-09-12T17:00:16.327626+0000","last_became_peered":"2024-09-12T17:00:16.327626+0000","last_unstale":"2024-09-12T18:10:18.916910+0000","last_undegraded":"2024-09-12T18:10:18.916910+0000","last_fullsized":"2024-09-12T18:10:18.916910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:33.847646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'109","reported_seq":655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.784639+0000","last_change":"2024-09-12T17:00:18.429917+0000","last_active":"2024-09-12T18:11:11.784639+0000","last_peered":"2024-09-12T18:11:11.784639+0000","last_clean":"2024-09-12T18:11:11.784639+0000","last_became_active":"2024-09-12T17:00:18.429481+0000","last_became_peered":"2024-09-12T17:00:18.429481+0000","last_unstale":"2024-09-12T18:11:11.784639+0000","last_undegraded":"2024-09-12T18:11:11.784639+0000","last_fullsized":"2024-09-12T18:11:11.784639+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:59.225430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":118,"num_write":86,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'784","reported_seq":4459,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.185297+0000","last_change":"2024-09-12T17:00:20.351383+0000","last_active":"2024-09-12T18:13:48.185297+0000","last_peered":"2024-09-12T18:13:48.185297+0000","last_clean":"2024-09-12T18:13:48.185297+0000","last_became_active":"2024-09-12T17:00:20.350976+0000","last_became_peered":"2024-09-12T17:00:20.350976+0000","last_unstale":"2024-09-12T18:13:48.185297+0000","last_undegraded":"2024-09-12T18:13:48.185297+0000","last_fullsized":"2024-09-12T18:13:48.185297+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:56.750542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'112","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.755851+0000","last_change":"2024-09-12T17:00:22.357875+0000","last_active":"2024-09-12T18:10:22.755851+0000","last_peered":"2024-09-12T18:10:22.755851+0000","last_clean":"2024-09-12T18:10:22.755851+0000","last_became_active":"2024-09-12T17:00:22.357215+0000","last_became_peered":"2024-09-12T17:00:22.357215+0000","last_unstale":"2024-09-12T18:10:22.755851+0000","last_undegraded":"2024-09-12T18:10:22.755851+0000","last_fullsized":"2024-09-12T18:10:22.755851+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:29.171521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":135,"num_write":263,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'292","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.921553+0000","last_change":"2024-09-12T17:00:14.340729+0000","last_active":"2024-09-12T18:12:01.921553+0000","last_peered":"2024-09-12T18:12:01.921553+0000","last_clean":"2024-09-12T18:12:01.921553+0000","last_became_active":"2024-09-12T17:00:14.340459+0000","last_became_peered":"2024-09-12T17:00:14.340459+0000","last_unstale":"2024-09-12T18:12:01.921553+0000","last_undegraded":"2024-09-12T18:12:01.921553+0000","last_fullsized":"2024-09-12T18:12:01.921553+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:27.507845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1297,"num_read_kb":1099,"num_write":462,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'338","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.507842+0000","last_change":"2024-09-12T17:00:46.721548+0000","last_active":"2024-09-12T18:13:49.507842+0000","last_peered":"2024-09-12T18:13:49.507842+0000","last_clean":"2024-09-12T18:13:49.507842+0000","last_became_active":"2024-09-12T17:00:46.721297+0000","last_became_peered":"2024-09-12T17:00:46.721297+0000","last_unstale":"2024-09-12T18:13:49.507842+0000","last_undegraded":"2024-09-12T18:13:49.507842+0000","last_fullsized":"2024-09-12T18:13:49.507842+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:14.131705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6112458,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":37702,"num_write":1052,"num_write_kb":18010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.755136+0000","last_change":"2024-09-12T17:00:16.327719+0000","last_active":"2024-09-12T18:10:17.755136+0000","last_peered":"2024-09-12T18:10:17.755136+0000","last_clean":"2024-09-12T18:10:17.755136+0000","last_became_active":"2024-09-12T17:00:16.327461+0000","last_became_peered":"2024-09-12T17:00:16.327461+0000","last_unstale":"2024-09-12T18:10:17.755136+0000","last_undegraded":"2024-09-12T18:10:17.755136+0000","last_fullsized":"2024-09-12T18:10:17.755136+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:19.144290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'325","reported_seq":932,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.284070+0000","last_change":"2024-09-12T17:00:18.329265+0000","last_active":"2024-09-12T18:13:48.284070+0000","last_peered":"2024-09-12T18:13:48.284070+0000","last_clean":"2024-09-12T18:13:48.284070+0000","last_became_active":"2024-09-12T17:00:18.328990+0000","last_became_peered":"2024-09-12T17:00:18.328990+0000","last_unstale":"2024-09-12T18:13:48.284070+0000","last_undegraded":"2024-09-12T18:13:48.284070+0000","last_fullsized":"2024-09-12T18:13:48.284070+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:43.048916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43471,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":524,"num_read_kb":1084,"num_write":408,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.619737+0000","last_change":"2024-09-12T17:00:20.350160+0000","last_active":"2024-09-12T18:10:26.619737+0000","last_peered":"2024-09-12T18:10:26.619737+0000","last_clean":"2024-09-12T18:10:26.619737+0000","last_became_active":"2024-09-12T17:00:20.349643+0000","last_became_peered":"2024-09-12T17:00:20.349643+0000","last_unstale":"2024-09-12T18:10:26.619737+0000","last_undegraded":"2024-09-12T18:10:26.619737+0000","last_fullsized":"2024-09-12T18:10:26.619737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:12.715810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'119","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.422359+0000","last_change":"2024-09-12T17:00:22.355955+0000","last_active":"2024-09-12T18:11:59.422359+0000","last_peered":"2024-09-12T18:11:59.422359+0000","last_clean":"2024-09-12T18:11:59.422359+0000","last_became_active":"2024-09-12T17:00:22.355658+0000","last_became_peered":"2024-09-12T17:00:22.355658+0000","last_unstale":"2024-09-12T18:11:59.422359+0000","last_undegraded":"2024-09-12T18:11:59.422359+0000","last_fullsized":"2024-09-12T18:11:59.422359+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:47.710679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":157,"num_read_kb":152,"num_write":284,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'216","reported_seq":827,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:15.752295+0000","last_change":"2024-09-12T17:00:14.334900+0000","last_active":"2024-09-12T18:10:15.752295+0000","last_peered":"2024-09-12T18:10:15.752295+0000","last_clean":"2024-09-12T18:10:15.752295+0000","last_became_active":"2024-09-12T17:00:14.334620+0000","last_became_peered":"2024-09-12T17:00:14.334620+0000","last_unstale":"2024-09-12T18:10:15.752295+0000","last_undegraded":"2024-09-12T18:10:15.752295+0000","last_fullsized":"2024-09-12T18:10:15.752295+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:57.025216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":978,"num_read_kb":833,"num_write":353,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'398","reported_seq":1077,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.505571+0000","last_change":"2024-09-12T17:00:12.318288+0000","last_active":"2024-09-12T18:13:49.505571+0000","last_peered":"2024-09-12T18:13:49.505571+0000","last_clean":"2024-09-12T18:13:49.505571+0000","last_became_active":"2024-09-12T17:00:12.317850+0000","last_became_peered":"2024-09-12T17:00:12.317850+0000","last_unstale":"2024-09-12T18:13:49.505571+0000","last_undegraded":"2024-09-12T18:13:49.505571+0000","last_fullsized":"2024-09-12T18:13:49.505571+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:24.624921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2375003,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":614,"num_read_kb":19368,"num_write":1121,"num_write_kb":17051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.953668+0000","last_change":"2024-09-12T17:00:16.329861+0000","last_active":"2024-09-12T18:10:17.953668+0000","last_peered":"2024-09-12T18:10:17.953668+0000","last_clean":"2024-09-12T18:10:17.953668+0000","last_became_active":"2024-09-12T17:00:16.329505+0000","last_became_peered":"2024-09-12T17:00:16.329505+0000","last_unstale":"2024-09-12T18:10:17.953668+0000","last_undegraded":"2024-09-12T18:10:17.953668+0000","last_fullsized":"2024-09-12T18:10:17.953668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:10.041738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'266","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.318601+0000","last_change":"2024-09-12T17:00:18.330870+0000","last_active":"2024-09-12T18:13:48.318601+0000","last_peered":"2024-09-12T18:13:48.318601+0000","last_clean":"2024-09-12T18:13:48.318601+0000","last_became_active":"2024-09-12T17:00:18.330548+0000","last_became_peered":"2024-09-12T17:00:18.330548+0000","last_unstale":"2024-09-12T18:13:48.318601+0000","last_undegraded":"2024-09-12T18:13:48.318601+0000","last_fullsized":"2024-09-12T18:13:48.318601+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:29.885447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":1014,"num_write":352,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.744654+0000","last_change":"2024-09-12T17:00:20.347403+0000","last_active":"2024-09-12T18:10:37.744654+0000","last_peered":"2024-09-12T18:10:37.744654+0000","last_clean":"2024-09-12T18:10:37.744654+0000","last_became_active":"2024-09-12T17:00:20.347122+0000","last_became_peered":"2024-09-12T17:00:20.347122+0000","last_unstale":"2024-09-12T18:10:37.744654+0000","last_undegraded":"2024-09-12T18:10:37.744654+0000","last_fullsized":"2024-09-12T18:10:37.744654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:45.526521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'144","reported_seq":681,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.843667+0000","last_change":"2024-09-12T17:00:22.588688+0000","last_active":"2024-09-12T18:10:26.843667+0000","last_peered":"2024-09-12T18:10:26.843667+0000","last_clean":"2024-09-12T18:10:26.843667+0000","last_became_active":"2024-09-12T17:00:22.588367+0000","last_became_peered":"2024-09-12T17:00:22.588367+0000","last_unstale":"2024-09-12T18:10:26.843667+0000","last_undegraded":"2024-09-12T18:10:26.843667+0000","last_fullsized":"2024-09-12T18:10:26.843667+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:33.524563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":299,"num_read_kb":277,"num_write":353,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'86","reported_seq":667,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844124+0000","last_change":"2024-09-12T17:00:14.338550+0000","last_active":"2024-09-12T18:10:31.844124+0000","last_peered":"2024-09-12T18:10:31.844124+0000","last_clean":"2024-09-12T18:10:31.844124+0000","last_became_active":"2024-09-12T17:00:14.338251+0000","last_became_peered":"2024-09-12T17:00:14.338251+0000","last_unstale":"2024-09-12T18:10:31.844124+0000","last_undegraded":"2024-09-12T18:10:31.844124+0000","last_fullsized":"2024-09-12T18:10:31.844124+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:22.563527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":335,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'385","reported_seq":1081,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.512981+0000","last_change":"2024-09-12T17:00:12.319168+0000","last_active":"2024-09-12T18:13:49.512981+0000","last_peered":"2024-09-12T18:13:49.512981+0000","last_clean":"2024-09-12T18:13:49.512981+0000","last_became_active":"2024-09-12T17:00:12.318883+0000","last_became_peered":"2024-09-12T17:00:12.318883+0000","last_unstale":"2024-09-12T18:13:49.512981+0000","last_undegraded":"2024-09-12T18:13:49.512981+0000","last_fullsized":"2024-09-12T18:13:49.512981+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:05.539963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":699,"num_read_kb":40775,"num_write":1189,"num_write_kb":14251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"36'5","reported_seq":990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:47.955149+0000","last_change":"2024-09-12T17:00:16.326343+0000","last_active":"2024-09-12T18:13:47.955149+0000","last_peered":"2024-09-12T18:13:47.955149+0000","last_clean":"2024-09-12T18:13:47.955149+0000","last_became_active":"2024-09-12T17:00:16.326067+0000","last_became_peered":"2024-09-12T17:00:16.326067+0000","last_unstale":"2024-09-12T18:13:47.955149+0000","last_undegraded":"2024-09-12T18:13:47.955149+0000","last_fullsized":"2024-09-12T18:13:47.955149+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:58.899112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'270","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.267977+0000","last_change":"2024-09-12T17:00:18.326987+0000","last_active":"2024-09-12T18:13:49.267977+0000","last_peered":"2024-09-12T18:13:49.267977+0000","last_clean":"2024-09-12T18:13:49.267977+0000","last_became_active":"2024-09-12T17:00:18.326438+0000","last_became_peered":"2024-09-12T17:00:18.326438+0000","last_unstale":"2024-09-12T18:13:49.267977+0000","last_undegraded":"2024-09-12T18:13:49.267977+0000","last_fullsized":"2024-09-12T18:13:49.267977+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:02.146729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47056,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":445,"num_read_kb":1107,"num_write":372,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.753168+0000","last_change":"2024-09-12T17:00:20.349597+0000","last_active":"2024-09-12T18:10:20.753168+0000","last_peered":"2024-09-12T18:10:20.753168+0000","last_clean":"2024-09-12T18:10:20.753168+0000","last_became_active":"2024-09-12T17:00:20.349324+0000","last_became_peered":"2024-09-12T17:00:20.349324+0000","last_unstale":"2024-09-12T18:10:20.753168+0000","last_undegraded":"2024-09-12T18:10:20.753168+0000","last_fullsized":"2024-09-12T18:10:20.753168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:28.300340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'171","reported_seq":1639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.329193+0000","last_change":"2024-09-12T17:00:22.354055+0000","last_active":"2024-09-12T18:11:59.329193+0000","last_peered":"2024-09-12T18:11:59.329193+0000","last_clean":"2024-09-12T18:11:59.329193+0000","last_became_active":"2024-09-12T17:00:22.353287+0000","last_became_peered":"2024-09-12T17:00:22.353287+0000","last_unstale":"2024-09-12T18:11:59.329193+0000","last_undegraded":"2024-09-12T18:11:59.329193+0000","last_fullsized":"2024-09-12T18:11:59.329193+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:04.187431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1233,"num_read_kb":1225,"num_write":392,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'366","reported_seq":1049,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.753093+0000","last_change":"2024-09-12T17:00:14.323586+0000","last_active":"2024-09-12T18:10:20.753093+0000","last_peered":"2024-09-12T18:10:20.753093+0000","last_clean":"2024-09-12T18:10:20.753093+0000","last_became_active":"2024-09-12T17:00:14.323113+0000","last_became_peered":"2024-09-12T17:00:14.323113+0000","last_unstale":"2024-09-12T18:10:20.753093+0000","last_undegraded":"2024-09-12T18:10:20.753093+0000","last_fullsized":"2024-09-12T18:10:20.753093+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:22.883267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1619,"num_read_kb":1299,"num_write":554,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'322","reported_seq":985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.421974+0000","last_change":"2024-09-12T17:00:12.312702+0000","last_active":"2024-09-12T18:13:49.421974+0000","last_peered":"2024-09-12T18:13:49.421974+0000","last_clean":"2024-09-12T18:13:49.421974+0000","last_became_active":"2024-09-12T17:00:12.312456+0000","last_became_peered":"2024-09-12T17:00:12.312456+0000","last_unstale":"2024-09-12T18:13:49.421974+0000","last_undegraded":"2024-09-12T18:13:49.421974+0000","last_fullsized":"2024-09-12T18:13:49.421974+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:20.588667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":504,"num_read_kb":30861,"num_write":1000,"num_write_kb":23841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:38.919143+0000","last_change":"2024-09-12T17:00:16.326062+0000","last_active":"2024-09-12T18:10:38.919143+0000","last_peered":"2024-09-12T18:10:38.919143+0000","last_clean":"2024-09-12T18:10:38.919143+0000","last_became_active":"2024-09-12T17:00:16.325535+0000","last_became_peered":"2024-09-12T17:00:16.325535+0000","last_unstale":"2024-09-12T18:10:38.919143+0000","last_undegraded":"2024-09-12T18:10:38.919143+0000","last_fullsized":"2024-09-12T18:10:38.919143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:32.939447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'306","reported_seq":907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.378762+0000","last_change":"2024-09-12T17:00:18.326450+0000","last_active":"2024-09-12T18:13:49.378762+0000","last_peered":"2024-09-12T18:13:49.378762+0000","last_clean":"2024-09-12T18:13:49.378762+0000","last_became_active":"2024-09-12T17:00:18.326140+0000","last_became_peered":"2024-09-12T17:00:18.326140+0000","last_unstale":"2024-09-12T18:13:49.378762+0000","last_undegraded":"2024-09-12T18:13:49.378762+0000","last_fullsized":"2024-09-12T18:13:49.378762+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:38.985728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49596,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":515,"num_read_kb":1146,"num_write":406,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619169+0000","last_change":"2024-09-12T17:00:20.354653+0000","last_active":"2024-09-12T18:10:21.619169+0000","last_peered":"2024-09-12T18:10:21.619169+0000","last_clean":"2024-09-12T18:10:21.619169+0000","last_became_active":"2024-09-12T17:00:20.353962+0000","last_became_peered":"2024-09-12T17:00:20.353962+0000","last_unstale":"2024-09-12T18:10:21.619169+0000","last_undegraded":"2024-09-12T18:10:21.619169+0000","last_fullsized":"2024-09-12T18:10:21.619169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:46.119505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'120","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:21.908306+0000","last_change":"2024-09-12T17:00:22.353191+0000","last_active":"2024-09-12T18:13:21.908306+0000","last_peered":"2024-09-12T18:13:21.908306+0000","last_clean":"2024-09-12T18:13:21.908306+0000","last_became_active":"2024-09-12T17:00:22.352779+0000","last_became_peered":"2024-09-12T17:00:22.352779+0000","last_unstale":"2024-09-12T18:13:21.908306+0000","last_undegraded":"2024-09-12T18:13:21.908306+0000","last_fullsized":"2024-09-12T18:13:21.908306+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:10.560331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":133,"num_write":289,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'171","reported_seq":773,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:43.925672+0000","last_change":"2024-09-12T17:00:14.315744+0000","last_active":"2024-09-12T18:11:43.925672+0000","last_peered":"2024-09-12T18:11:43.925672+0000","last_clean":"2024-09-12T18:11:43.925672+0000","last_became_active":"2024-09-12T17:00:14.315424+0000","last_became_peered":"2024-09-12T17:00:14.315424+0000","last_unstale":"2024-09-12T18:11:43.925672+0000","last_undegraded":"2024-09-12T18:11:43.925672+0000","last_fullsized":"2024-09-12T18:11:43.925672+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:21.991890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":753,"num_read_kb":612,"num_write":278,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'332","reported_seq":1071,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.506646+0000","last_change":"2024-09-12T17:00:12.310622+0000","last_active":"2024-09-12T18:13:49.506646+0000","last_peered":"2024-09-12T18:13:49.506646+0000","last_clean":"2024-09-12T18:13:49.506646+0000","last_became_active":"2024-09-12T17:00:12.310322+0000","last_became_peered":"2024-09-12T17:00:12.310322+0000","last_unstale":"2024-09-12T18:13:49.506646+0000","last_undegraded":"2024-09-12T18:13:49.506646+0000","last_fullsized":"2024-09-12T18:13:49.506646+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:55.608530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262194,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":571,"num_read_kb":27239,"num_write":1052,"num_write_kb":25993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'258","reported_seq":883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:07.952184+0000","last_change":"2024-09-12T17:00:46.407147+0000","last_active":"2024-09-12T18:10:07.952184+0000","last_peered":"2024-09-12T18:10:07.952184+0000","last_clean":"2024-09-12T18:10:07.952184+0000","last_became_active":"2024-09-12T17:00:46.406809+0000","last_became_peered":"2024-09-12T17:00:46.406809+0000","last_unstale":"2024-09-12T18:10:07.952184+0000","last_undegraded":"2024-09-12T18:10:07.952184+0000","last_fullsized":"2024-09-12T18:10:07.952184+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:36.394344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1147,"num_read_kb":935,"num_write":403,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"264'307","reported_seq":1013,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.458513+0000","last_change":"2024-09-12T17:00:12.312943+0000","last_active":"2024-09-12T18:13:49.458513+0000","last_peered":"2024-09-12T18:13:49.458513+0000","last_clean":"2024-09-12T18:13:49.458513+0000","last_became_active":"2024-09-12T17:00:12.312579+0000","last_became_peered":"2024-09-12T17:00:12.312579+0000","last_unstale":"2024-09-12T18:13:49.458513+0000","last_undegraded":"2024-09-12T18:13:49.458513+0000","last_fullsized":"2024-09-12T18:13:49.458513+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:00.686097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262157,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":699,"num_read_kb":738,"num_write":941,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'458","reported_seq":1235,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:37.947629+0000","last_change":"2024-09-12T17:00:14.327470+0000","last_active":"2024-09-12T18:09:37.947629+0000","last_peered":"2024-09-12T18:09:37.947629+0000","last_clean":"2024-09-12T18:09:37.947629+0000","last_became_active":"2024-09-12T17:00:14.327158+0000","last_became_peered":"2024-09-12T17:00:14.327158+0000","last_unstale":"2024-09-12T18:09:37.947629+0000","last_undegraded":"2024-09-12T18:09:37.947629+0000","last_fullsized":"2024-09-12T18:09:37.947629+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:08.515532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2228,"num_read_kb":1913,"num_write":817,"num_write_kb":525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'336","reported_seq":974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.491331+0000","last_change":"2024-09-12T17:00:12.318140+0000","last_active":"2024-09-12T18:13:49.491331+0000","last_peered":"2024-09-12T18:13:49.491331+0000","last_clean":"2024-09-12T18:13:49.491331+0000","last_became_active":"2024-09-12T17:00:12.317893+0000","last_became_peered":"2024-09-12T17:00:12.317893+0000","last_unstale":"2024-09-12T18:13:49.491331+0000","last_undegraded":"2024-09-12T18:13:49.491331+0000","last_fullsized":"2024-09-12T18:13:49.491331+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:32.821778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524314,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":498,"num_read_kb":13770,"num_write":1022,"num_write_kb":25077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'105","reported_seq":708,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:43.925626+0000","last_change":"2024-09-12T17:00:14.323700+0000","last_active":"2024-09-12T18:11:43.925626+0000","last_peered":"2024-09-12T18:11:43.925626+0000","last_clean":"2024-09-12T18:11:43.925626+0000","last_became_active":"2024-09-12T17:00:14.323394+0000","last_became_peered":"2024-09-12T17:00:14.323394+0000","last_unstale":"2024-09-12T18:11:43.925626+0000","last_undegraded":"2024-09-12T18:11:43.925626+0000","last_fullsized":"2024-09-12T18:11:43.925626+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:59.080164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":480,"num_read_kb":401,"num_write":159,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'461","reported_seq":1219,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.524226+0000","last_change":"2024-09-12T17:00:12.315248+0000","last_active":"2024-09-12T18:13:49.524226+0000","last_peered":"2024-09-12T18:13:49.524226+0000","last_clean":"2024-09-12T18:13:49.524226+0000","last_became_active":"2024-09-12T17:00:12.314938+0000","last_became_peered":"2024-09-12T17:00:12.314938+0000","last_unstale":"2024-09-12T18:13:49.524226+0000","last_undegraded":"2024-09-12T18:13:49.524226+0000","last_fullsized":"2024-09-12T18:13:49.524226+0000","mapping_epoch":24,"log_start":"264'400","ondisk_log_start":"264'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:26.555386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550360,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":846,"num_read_kb":44498,"num_write":1407,"num_write_kb":38820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'333","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:16.849080+0000","last_change":"2024-09-12T17:00:14.334325+0000","last_active":"2024-09-12T18:11:16.849080+0000","last_peered":"2024-09-12T18:11:16.849080+0000","last_clean":"2024-09-12T18:11:16.849080+0000","last_became_active":"2024-09-12T17:00:14.333821+0000","last_became_peered":"2024-09-12T17:00:14.333821+0000","last_unstale":"2024-09-12T18:11:16.849080+0000","last_undegraded":"2024-09-12T18:11:16.849080+0000","last_fullsized":"2024-09-12T18:11:16.849080+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:38.122605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1469,"num_read_kb":1192,"num_write":564,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'328","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.524317+0000","last_change":"2024-09-12T17:00:12.317044+0000","last_active":"2024-09-12T18:13:49.524317+0000","last_peered":"2024-09-12T18:13:49.524317+0000","last_clean":"2024-09-12T18:13:49.524317+0000","last_became_active":"2024-09-12T17:00:12.316672+0000","last_became_peered":"2024-09-12T17:00:12.316672+0000","last_unstale":"2024-09-12T18:13:49.524317+0000","last_undegraded":"2024-09-12T18:13:49.524317+0000","last_fullsized":"2024-09-12T18:13:49.524317+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:33.188507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655849,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":486,"num_read_kb":22933,"num_write":961,"num_write_kb":33827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'55","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:05.760226+0000","last_change":"2024-09-12T17:00:14.324630+0000","last_active":"2024-09-12T18:11:05.760226+0000","last_peered":"2024-09-12T18:11:05.760226+0000","last_clean":"2024-09-12T18:11:05.760226+0000","last_became_active":"2024-09-12T17:00:14.324051+0000","last_became_peered":"2024-09-12T17:00:14.324051+0000","last_unstale":"2024-09-12T18:11:05.760226+0000","last_undegraded":"2024-09-12T18:11:05.760226+0000","last_fullsized":"2024-09-12T18:11:05.760226+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:00.419356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":201,"num_write":77,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'339","reported_seq":1015,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.522125+0000","last_change":"2024-09-12T17:00:12.314909+0000","last_active":"2024-09-12T18:13:49.522125+0000","last_peered":"2024-09-12T18:13:49.522125+0000","last_clean":"2024-09-12T18:13:49.522125+0000","last_became_active":"2024-09-12T17:00:12.314059+0000","last_became_peered":"2024-09-12T17:00:12.314059+0000","last_unstale":"2024-09-12T18:13:49.522125+0000","last_undegraded":"2024-09-12T18:13:49.522125+0000","last_fullsized":"2024-09-12T18:13:49.522125+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:36.683937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288647,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":67840,"num_write":1028,"num_write_kb":38572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'162","reported_seq":748,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:06.847823+0000","last_change":"2024-09-12T17:00:14.338773+0000","last_active":"2024-09-12T18:11:06.847823+0000","last_peered":"2024-09-12T18:11:06.847823+0000","last_clean":"2024-09-12T18:11:06.847823+0000","last_became_active":"2024-09-12T17:00:14.338503+0000","last_became_peered":"2024-09-12T17:00:14.338503+0000","last_unstale":"2024-09-12T18:11:06.847823+0000","last_undegraded":"2024-09-12T18:11:06.847823+0000","last_fullsized":"2024-09-12T18:11:06.847823+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:37.093331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":567,"num_write":272,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'317","reported_seq":926,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.520038+0000","last_change":"2024-09-12T17:00:12.312243+0000","last_active":"2024-09-12T18:13:49.520038+0000","last_peered":"2024-09-12T18:13:49.520038+0000","last_clean":"2024-09-12T18:13:49.520038+0000","last_became_active":"2024-09-12T17:00:12.311933+0000","last_became_peered":"2024-09-12T17:00:12.311933+0000","last_unstale":"2024-09-12T18:13:49.520038+0000","last_undegraded":"2024-09-12T18:13:49.520038+0000","last_fullsized":"2024-09-12T18:13:49.520038+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:08:37.097651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262214,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":415,"num_read_kb":17784,"num_write":989,"num_write_kb":43947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'289","reported_seq":1002,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.749263+0000","last_change":"2024-09-12T17:00:14.319474+0000","last_active":"2024-09-12T18:11:07.749263+0000","last_peered":"2024-09-12T18:11:07.749263+0000","last_clean":"2024-09-12T18:11:07.749263+0000","last_became_active":"2024-09-12T17:00:14.319152+0000","last_became_peered":"2024-09-12T17:00:14.319152+0000","last_unstale":"2024-09-12T18:11:07.749263+0000","last_undegraded":"2024-09-12T18:11:07.749263+0000","last_fullsized":"2024-09-12T18:11:07.749263+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:25.091276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1506,"num_read_kb":1343,"num_write":479,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'446","reported_seq":1109,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.435344+0000","last_change":"2024-09-12T17:00:12.321281+0000","last_active":"2024-09-12T18:13:49.435344+0000","last_peered":"2024-09-12T18:13:49.435344+0000","last_clean":"2024-09-12T18:13:49.435344+0000","last_became_active":"2024-09-12T17:00:12.320948+0000","last_became_peered":"2024-09-12T17:00:12.320948+0000","last_unstale":"2024-09-12T18:13:49.435344+0000","last_undegraded":"2024-09-12T18:13:49.435344+0000","last_fullsized":"2024-09-12T18:13:49.435344+0000","mapping_epoch":24,"log_start":"264'400","ondisk_log_start":"264'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:58.027696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":626,"num_read_kb":23095,"num_write":1402,"num_write_kb":45480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'356","reported_seq":1089,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:16.618637+0000","last_change":"2024-09-12T17:00:14.332105+0000","last_active":"2024-09-12T18:10:16.618637+0000","last_peered":"2024-09-12T18:10:16.618637+0000","last_clean":"2024-09-12T18:10:16.618637+0000","last_became_active":"2024-09-12T17:00:14.331839+0000","last_became_peered":"2024-09-12T17:00:14.331839+0000","last_unstale":"2024-09-12T18:10:16.618637+0000","last_undegraded":"2024-09-12T18:10:16.618637+0000","last_fullsized":"2024-09-12T18:10:16.618637+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:36.033074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1691,"num_read_kb":1457,"num_write":527,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'416","reported_seq":1058,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.506377+0000","last_change":"2024-09-12T17:00:12.320366+0000","last_active":"2024-09-12T18:13:49.506377+0000","last_peered":"2024-09-12T18:13:49.506377+0000","last_clean":"2024-09-12T18:13:49.506377+0000","last_became_active":"2024-09-12T17:00:12.320094+0000","last_became_peered":"2024-09-12T17:00:12.320094+0000","last_unstale":"2024-09-12T18:13:49.506377+0000","last_undegraded":"2024-09-12T18:13:49.506377+0000","last_fullsized":"2024-09-12T18:13:49.506377+0000","mapping_epoch":24,"log_start":"264'400","ondisk_log_start":"264'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:12.089633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194332,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":632,"num_read_kb":22255,"num_write":1216,"num_write_kb":35121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'76","reported_seq":651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:18.486632+0000","last_change":"2024-09-12T17:00:14.335295+0000","last_active":"2024-09-12T18:10:18.486632+0000","last_peered":"2024-09-12T18:10:18.486632+0000","last_clean":"2024-09-12T18:10:18.486632+0000","last_became_active":"2024-09-12T17:00:14.334965+0000","last_became_peered":"2024-09-12T17:00:14.334965+0000","last_unstale":"2024-09-12T18:10:18.486632+0000","last_undegraded":"2024-09-12T18:10:18.486632+0000","last_fullsized":"2024-09-12T18:10:18.486632+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:26.399490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":336,"num_read_kb":283,"num_write":118,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'335","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.498631+0000","last_change":"2024-09-12T17:00:12.321716+0000","last_active":"2024-09-12T18:13:49.498631+0000","last_peered":"2024-09-12T18:13:49.498631+0000","last_clean":"2024-09-12T18:13:49.498631+0000","last_became_active":"2024-09-12T17:00:12.321156+0000","last_became_peered":"2024-09-12T17:00:12.321156+0000","last_unstale":"2024-09-12T18:13:49.498631+0000","last_undegraded":"2024-09-12T18:13:49.498631+0000","last_fullsized":"2024-09-12T18:13:49.498631+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:46.457048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170120,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":18612,"num_write":1036,"num_write_kb":25817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'177","reported_seq":795,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:08.697578+0000","last_change":"2024-09-12T17:00:14.323205+0000","last_active":"2024-09-12T18:10:08.697578+0000","last_peered":"2024-09-12T18:10:08.697578+0000","last_clean":"2024-09-12T18:10:08.697578+0000","last_became_active":"2024-09-12T17:00:14.322880+0000","last_became_peered":"2024-09-12T17:00:14.322880+0000","last_unstale":"2024-09-12T18:10:08.697578+0000","last_undegraded":"2024-09-12T18:10:08.697578+0000","last_fullsized":"2024-09-12T18:10:08.697578+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:18.369079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":741,"num_read_kb":611,"num_write":268,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'386","reported_seq":1041,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.517817+0000","last_change":"2024-09-12T17:00:12.315023+0000","last_active":"2024-09-12T18:13:49.517817+0000","last_peered":"2024-09-12T18:13:49.517817+0000","last_clean":"2024-09-12T18:13:49.517817+0000","last_became_active":"2024-09-12T17:00:12.314707+0000","last_became_peered":"2024-09-12T17:00:12.314707+0000","last_unstale":"2024-09-12T18:13:49.517817+0000","last_undegraded":"2024-09-12T18:13:49.517817+0000","last_fullsized":"2024-09-12T18:13:49.517817+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:40.531969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590083,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":560,"num_read_kb":37012,"num_write":1300,"num_write_kb":41769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'170","reported_seq":824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:00.750238+0000","last_change":"2024-09-12T17:00:14.325013+0000","last_active":"2024-09-12T18:10:00.750238+0000","last_peered":"2024-09-12T18:10:00.750238+0000","last_clean":"2024-09-12T18:10:00.750238+0000","last_became_active":"2024-09-12T17:00:14.324709+0000","last_became_peered":"2024-09-12T17:00:14.324709+0000","last_unstale":"2024-09-12T18:10:00.750238+0000","last_undegraded":"2024-09-12T18:10:00.750238+0000","last_fullsized":"2024-09-12T18:10:00.750238+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:55.903766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":785,"num_read_kb":657,"num_write":242,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'297","reported_seq":935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.454412+0000","last_change":"2024-09-12T17:00:12.308878+0000","last_active":"2024-09-12T18:13:49.454412+0000","last_peered":"2024-09-12T18:13:49.454412+0000","last_clean":"2024-09-12T18:13:49.454412+0000","last_became_active":"2024-09-12T17:00:12.307159+0000","last_became_peered":"2024-09-12T17:00:12.307159+0000","last_unstale":"2024-09-12T18:13:49.454412+0000","last_undegraded":"2024-09-12T18:13:49.454412+0000","last_fullsized":"2024-09-12T18:13:49.454412+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:24.309768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":429,"num_read_kb":7363,"num_write":949,"num_write_kb":31388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'4088","reported_seq":4668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:02.752498+0000","last_change":"2024-09-12T17:00:14.328088+0000","last_active":"2024-09-12T18:10:02.752498+0000","last_peered":"2024-09-12T18:10:02.752498+0000","last_clean":"2024-09-12T18:10:02.752498+0000","last_became_active":"2024-09-12T17:00:14.327792+0000","last_became_peered":"2024-09-12T17:00:14.327792+0000","last_unstale":"2024-09-12T18:10:02.752498+0000","last_undegraded":"2024-09-12T18:10:02.752498+0000","last_fullsized":"2024-09-12T18:10:02.752498+0000","mapping_epoch":26,"log_start":"264'4000","ondisk_log_start":"264'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:59.961621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16430,"num_read_kb":13786,"num_write":6128,"num_write_kb":3057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'353","reported_seq":1006,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.506923+0000","last_change":"2024-09-12T17:00:12.311570+0000","last_active":"2024-09-12T18:13:49.506923+0000","last_peered":"2024-09-12T18:13:49.506923+0000","last_clean":"2024-09-12T18:13:49.506923+0000","last_became_active":"2024-09-12T17:00:12.311273+0000","last_became_peered":"2024-09-12T17:00:12.311273+0000","last_unstale":"2024-09-12T18:13:49.506923+0000","last_undegraded":"2024-09-12T18:13:49.506923+0000","last_fullsized":"2024-09-12T18:13:49.506923+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:26.620649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":481304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":502,"num_read_kb":37128,"num_write":1093,"num_write_kb":49312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'265","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:01.616891+0000","last_change":"2024-09-12T17:00:14.318745+0000","last_active":"2024-09-12T18:10:01.616891+0000","last_peered":"2024-09-12T18:10:01.616891+0000","last_clean":"2024-09-12T18:10:01.616891+0000","last_became_active":"2024-09-12T17:00:14.318470+0000","last_became_peered":"2024-09-12T17:00:14.318470+0000","last_unstale":"2024-09-12T18:10:01.616891+0000","last_undegraded":"2024-09-12T18:10:01.616891+0000","last_fullsized":"2024-09-12T18:10:01.616891+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:04.138809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1277,"num_read_kb":1058,"num_write":468,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'348","reported_seq":1063,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.467349+0000","last_change":"2024-09-12T17:00:12.314662+0000","last_active":"2024-09-12T18:13:49.467349+0000","last_peered":"2024-09-12T18:13:49.467349+0000","last_clean":"2024-09-12T18:13:49.467349+0000","last_became_active":"2024-09-12T17:00:12.314371+0000","last_became_peered":"2024-09-12T17:00:12.314371+0000","last_unstale":"2024-09-12T18:13:49.467349+0000","last_undegraded":"2024-09-12T18:13:49.467349+0000","last_fullsized":"2024-09-12T18:13:49.467349+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:12.607432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655829,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":559,"num_read_kb":6257,"num_write":1103,"num_write_kb":25577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'129","reported_seq":702,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:01.840698+0000","last_change":"2024-09-12T17:00:14.339614+0000","last_active":"2024-09-12T18:10:01.840698+0000","last_peered":"2024-09-12T18:10:01.840698+0000","last_clean":"2024-09-12T18:10:01.840698+0000","last_became_active":"2024-09-12T17:00:14.339316+0000","last_became_peered":"2024-09-12T17:00:14.339316+0000","last_unstale":"2024-09-12T18:10:01.840698+0000","last_undegraded":"2024-09-12T18:10:01.840698+0000","last_fullsized":"2024-09-12T18:10:01.840698+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:43.906333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":538,"num_read_kb":439,"num_write":190,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'317","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.482136+0000","last_change":"2024-09-12T17:00:12.310461+0000","last_active":"2024-09-12T18:13:49.482136+0000","last_peered":"2024-09-12T18:13:49.482136+0000","last_clean":"2024-09-12T18:13:49.482136+0000","last_became_active":"2024-09-12T17:00:12.310157+0000","last_became_peered":"2024-09-12T17:00:12.310157+0000","last_unstale":"2024-09-12T18:13:49.482136+0000","last_undegraded":"2024-09-12T18:13:49.482136+0000","last_fullsized":"2024-09-12T18:13:49.482136+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:09.011822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1093042,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":459,"num_read_kb":8306,"num_write":1094,"num_write_kb":29458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'208","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:52.751018+0000","last_change":"2024-09-12T17:00:46.406709+0000","last_active":"2024-09-12T18:09:52.751018+0000","last_peered":"2024-09-12T18:09:52.751018+0000","last_clean":"2024-09-12T18:09:52.751018+0000","last_became_active":"2024-09-12T17:00:46.406426+0000","last_became_peered":"2024-09-12T17:00:46.406426+0000","last_unstale":"2024-09-12T18:09:52.751018+0000","last_undegraded":"2024-09-12T18:09:52.751018+0000","last_fullsized":"2024-09-12T18:09:52.751018+0000","mapping_epoch":37,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:27.163775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":857,"num_read_kb":696,"num_write":294,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'303","reported_seq":910,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.493943+0000","last_change":"2024-09-12T17:00:12.314652+0000","last_active":"2024-09-12T18:13:49.493943+0000","last_peered":"2024-09-12T18:13:49.493943+0000","last_clean":"2024-09-12T18:13:49.493943+0000","last_became_active":"2024-09-12T17:00:12.314251+0000","last_became_peered":"2024-09-12T17:00:12.314251+0000","last_unstale":"2024-09-12T18:13:49.493943+0000","last_undegraded":"2024-09-12T18:13:49.493943+0000","last_fullsized":"2024-09-12T18:13:49.493943+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:21.957765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":403,"num_read_kb":8717,"num_write":971,"num_write_kb":22240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'312","reported_seq":1116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.491970+0000","last_change":"2024-09-12T17:00:12.318997+0000","last_active":"2024-09-12T18:13:49.491970+0000","last_peered":"2024-09-12T18:13:49.491970+0000","last_clean":"2024-09-12T18:13:49.491970+0000","last_became_active":"2024-09-12T17:00:12.318408+0000","last_became_peered":"2024-09-12T17:00:12.318408+0000","last_unstale":"2024-09-12T18:13:49.491970+0000","last_undegraded":"2024-09-12T18:13:49.491970+0000","last_fullsized":"2024-09-12T18:13:49.491970+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:22.821486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":853,"num_read_kb":6455,"num_write":1039,"num_write_kb":20037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'90","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:41.621619+0000","last_change":"2024-09-12T17:00:14.334754+0000","last_active":"2024-09-12T18:10:41.621619+0000","last_peered":"2024-09-12T18:10:41.621619+0000","last_clean":"2024-09-12T18:10:41.621619+0000","last_became_active":"2024-09-12T17:00:14.334494+0000","last_became_peered":"2024-09-12T17:00:14.334494+0000","last_unstale":"2024-09-12T18:10:41.621619+0000","last_undegraded":"2024-09-12T18:10:41.621619+0000","last_fullsized":"2024-09-12T18:10:41.621619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:56.905718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":377,"num_read_kb":312,"num_write":145,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'348","reported_seq":985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.502737+0000","last_change":"2024-09-12T17:00:12.315356+0000","last_active":"2024-09-12T18:13:49.502737+0000","last_peered":"2024-09-12T18:13:49.502737+0000","last_clean":"2024-09-12T18:13:49.502737+0000","last_became_active":"2024-09-12T17:00:12.314988+0000","last_became_peered":"2024-09-12T17:00:12.314988+0000","last_unstale":"2024-09-12T18:13:49.502737+0000","last_undegraded":"2024-09-12T18:13:49.502737+0000","last_fullsized":"2024-09-12T18:13:49.502737+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:11.283697+0000","last_clean_scrub_stamp":"2024-09-12T17:00:11.283697+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:34.349627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":45801,"num_write":1031,"num_write_kb":31559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'220","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954550+0000","last_change":"2024-09-12T17:00:14.333403+0000","last_active":"2024-09-12T18:10:22.954550+0000","last_peered":"2024-09-12T18:10:22.954550+0000","last_clean":"2024-09-12T18:10:22.954550+0000","last_became_active":"2024-09-12T17:00:14.333107+0000","last_became_peered":"2024-09-12T17:00:14.333107+0000","last_unstale":"2024-09-12T18:10:22.954550+0000","last_undegraded":"2024-09-12T18:10:22.954550+0000","last_fullsized":"2024-09-12T18:10:22.954550+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:26.316619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":970,"num_read_kb":803,"num_write":364,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5638,"num_read_kb":3956,"num_write":1906,"num_write_kb":804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1077,"ondisk_log_size":1077,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":16256,"num_read_kb":15929,"num_write":16738,"num_write_kb":4889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1664,"ondisk_log_size":1664,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":559,"ondisk_log_size":559,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1559950,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":19041,"num_read_kb":39761,"num_write":15891,"num_write_kb":11979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2195,"ondisk_log_size":2195,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2432,"num_read_kb":2899,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102836,"num_read_kb":85763,"num_write":37242,"num_write_kb":18813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3654,"ondisk_log_size":3654,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":76932281,"num_objects":387,"num_object_clones":0,"num_object_copies":774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":387,"num_whiteouts":0,"num_read":36237,"num_read_kb":1844237,"num_write":71508,"num_write_kb":1970689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":155025408,"data_stored":153864562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3534,"ondisk_log_size":3534,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":154912,"num_write":182,"num_write_kb":116389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":158387,"num_write":182,"num_write_kb":116389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424510334,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72012,"kb_used_data":22628,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94299828,"statfs":{"total":96636764160,"available":96563023872,"internally_reserved":0,"allocated":23171072,"data_stored":21619631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510337,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119708,"kb_used_data":8032,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94252132,"statfs":{"total":96636764160,"available":96514183168,"internally_reserved":0,"allocated":8224768,"data_stored":6647389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543036,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":253484,"kb_used_data":27780,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94118356,"statfs":{"total":96636764160,"available":96377196544,"internally_reserved":0,"allocated":28446720,"data_stored":26727116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":230947274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543038,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254428,"kb_used_data":16112,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94117412,"statfs":{"total":96636764160,"available":96376229888,"internally_reserved":0,"allocated":16498688,"data_stored":14904367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":243726790},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543038,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":128808,"kb_used_data":25264,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94243032,"statfs":{"total":96636764160,"available":96504864768,"internally_reserved":0,"allocated":25870336,"data_stored":24131043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543038,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275976,"kb_used_data":32128,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94095864,"statfs":{"total":96636764160,"available":96354164736,"internally_reserved":0,"allocated":32899072,"data_stored":31197660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":249428423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543036,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":230276,"kb_used_data":18260,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94141564,"statfs":{"total":96636764160,"available":96400961536,"internally_reserved":0,"allocated":18698240,"data_stored":17001849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":216725957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575740,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98204,"kb_used_data":30924,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94273636,"statfs":{"total":96636764160,"available":96536203264,"internally_reserved":0,"allocated":31666176,"data_stored":30017021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14422016,"data_stored":14261258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4595712,"data_stored":4499422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19558400,"data_stored":19471135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29220864,"data_stored":29046128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28045312,"data_stored":27867248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22167552,"data_stored":21980545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12857344,"data_stored":12753756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24158208,"data_stored":23985070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":4704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:13:58.014 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.014 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.014 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.015 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.015 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.015 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.015 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.016 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.016 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.016 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.016 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.017 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.017 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.017 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.017 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.017 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.018 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.018 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.018 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.018 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.019 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.019 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.019 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.020 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.020 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.020 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.020 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.020 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.021 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.021 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.021 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.021 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.022 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.022 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.022 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.022 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.023 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.023 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.023 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.023 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.024 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.024 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.024 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.024 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.025 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.025 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.025 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.025 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.026 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.026 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.026 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.026 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.026 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.027 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.027 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.027 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.027 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.028 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.028 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.028 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.028 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.028 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.029 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.029 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.029 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.029 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.029 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.029 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.030 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.030 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.030 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.030 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.030 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.031 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.031 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.031 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.031 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.032 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.032 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.032 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.032 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.032 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.033 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.033 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.033 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.033 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.034 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.034 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.034 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.034 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.034 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.035 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.035 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.035 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.035 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.036 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.036 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.036 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.036 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.037 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.037 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.037 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.037 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.038 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.038 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.038 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.038 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.038 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.038 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.039 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.039 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.039 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.039 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.039 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.039 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.039 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.039 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.040 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.040 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.040 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.040 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.040 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.040 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.040 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.040 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.040 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.041 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.041 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.041 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.041 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.041 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.041 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.041 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.041 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.041 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.042 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.042 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.042 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.042 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.042 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.042 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.042 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.042 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.042 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.043 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.043 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.043 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.043 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.043 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.043 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.043 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.043 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.043 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.044 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.044 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.044 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.044 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.044 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.044 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.044 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.044 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.044 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.045 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.045 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.045 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.045 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.045 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.045 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.045 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.045 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.046 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.046 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.046 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.046 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.046 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.046 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.046 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.046 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.047 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.047 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.047 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.047 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.047 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.047 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.047 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.047 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.047 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.048 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.048 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.048 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.048 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.048 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.048 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.048 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.048 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.049 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.049 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.049 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.049 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.049 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.049 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.049 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.049 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.049 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.050 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.050 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.050 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.050 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.050 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.050 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.050 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.050 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.050 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.051 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.051 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.051 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.051 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.051 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.051 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.051 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.051 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.051 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.052 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.052 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.052 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.052 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.052 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.052 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.052 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.052 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T16:59:53.619137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=59, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.053 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T16:59:59.651916+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=59, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.053 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.053 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.053 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.053 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.053 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.053 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.053 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T16:59:59.651916+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=59, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.053 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.054 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.054 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.054 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.054 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.054 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.054 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T16:59:59.651916+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=59, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.054 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.054 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.054 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.055 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.055 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.055 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.055 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T16:59:59.651916+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=59, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.055 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.055 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.055 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.055 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.055 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.056 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.056 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.056 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T16:59:59.651916+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=59, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.056 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.056 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.056 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.056 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.056 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.056 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.057 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T16:59:59.651916+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=59, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.057 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.057 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.057 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.057 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.057 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.057 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.057 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T16:59:59.651916+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=59, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.057 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.060 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.060 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.061 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.061 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.061 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.061 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T16:59:59.651916+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=59, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.061 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.061 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.061 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.061 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.061 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.062 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.062 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.062 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.062 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.062 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.062 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.062 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.062 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.062 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.063 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.063 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.063 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.063 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.063 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.063 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.063 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.063 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.063 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.064 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.064 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.064 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.064 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.064 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.064 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.064 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.064 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.065 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.065 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.065 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.065 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.065 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.065 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.065 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.065 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.065 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.066 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.066 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.066 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.066 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.066 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.066 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.066 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.066 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.066 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.067 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.067 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.067 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.067 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.067 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.067 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.067 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.067 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.067 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.068 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.068 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.068 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.068 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.068 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.068 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.068 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.068 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.069 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.069 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.069 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.069 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.069 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.069 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.069 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.069 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.069 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.070 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.070 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.070 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.070 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.070 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.070 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.070 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.070 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.070 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.071 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.071 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.071 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.071 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.071 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.071 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.071 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.071 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.071 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.072 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.072 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.072 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.072 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.072 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.072 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.072 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.072 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.072 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.073 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.073 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.073 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.073 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.073 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.073 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.073 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.073 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.073 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T17:00:11.283697+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.074 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:13:58.074 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:14:18.075 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:14:18.432 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:14:18.443 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-12T18:14:18.447 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":2490,"stamp":"2024-09-12T18:14:16.642681+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":79100730,"num_objects":719,"num_object_clones":0,"num_object_copies":1438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":719,"num_whiteouts":0,"num_read":182830,"num_read_kb":2305911,"num_write":143792,"num_write_kb":2241608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":36807,"num_omap_keys":139,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12942,"ondisk_log_size":12942,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1461960,"kb_used_data":181128,"kb_used_omap":12,"kb_used_meta":1280691,"kb_avail":753512760,"statfs":{"total":773094113280,"available":771597066240,"internally_reserved":0,"allocated":185475072,"data_stored":172246076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1311428144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":36807,"num_omap_keys":139,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006195"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:37.966205+0000","last_change":"2024-09-12T17:39:05.922525+0000","last_active":"2024-09-12T18:11:37.966205+0000","last_peered":"2024-09-12T18:11:37.966205+0000","last_clean":"2024-09-12T18:11:37.966205+0000","last_became_active":"2024-09-12T17:39:05.922265+0000","last_became_peered":"2024-09-12T17:39:05.922265+0000","last_unstale":"2024-09-12T18:11:37.966205+0000","last_undegraded":"2024-09-12T18:11:37.966205+0000","last_fullsized":"2024-09-12T18:11:37.966205+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'9","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.516351+0000","last_change":"2024-09-12T17:20:34.559305+0000","last_active":"2024-09-12T18:13:48.516351+0000","last_peered":"2024-09-12T18:13:48.516351+0000","last_clean":"2024-09-12T18:13:48.516351+0000","last_became_active":"2024-09-12T17:20:34.559027+0000","last_became_peered":"2024-09-12T17:20:34.559027+0000","last_unstale":"2024-09-12T18:13:48.516351+0000","last_undegraded":"2024-09-12T18:13:48.516351+0000","last_fullsized":"2024-09-12T18:13:48.516351+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:57.688429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10240,"num_write":14,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"261'5","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844168+0000","last_change":"2024-09-12T17:20:30.533512+0000","last_active":"2024-09-12T18:10:31.844168+0000","last_peered":"2024-09-12T18:10:31.844168+0000","last_clean":"2024-09-12T18:10:31.844168+0000","last_became_active":"2024-09-12T17:20:30.533235+0000","last_became_peered":"2024-09-12T17:20:30.533235+0000","last_unstale":"2024-09-12T18:10:31.844168+0000","last_undegraded":"2024-09-12T18:10:31.844168+0000","last_fullsized":"2024-09-12T18:10:31.844168+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:11.739116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4098,"num_write":10,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'40","reported_seq":175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619269+0000","last_change":"2024-09-12T17:16:11.492013+0000","last_active":"2024-09-12T18:10:21.619269+0000","last_peered":"2024-09-12T18:10:21.619269+0000","last_clean":"2024-09-12T18:10:21.619269+0000","last_became_active":"2024-09-12T17:16:11.491724+0000","last_became_peered":"2024-09-12T17:16:11.491724+0000","last_unstale":"2024-09-12T18:10:21.619269+0000","last_undegraded":"2024-09-12T18:10:21.619269+0000","last_fullsized":"2024-09-12T18:10:21.619269+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:52.666913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":153,"num_write":69,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:38.706351+0000","last_change":"2024-09-12T17:39:05.929786+0000","last_active":"2024-09-12T18:11:38.706351+0000","last_peered":"2024-09-12T18:11:38.706351+0000","last_clean":"2024-09-12T18:11:38.706351+0000","last_became_active":"2024-09-12T17:39:05.929533+0000","last_became_peered":"2024-09-12T17:39:05.929533+0000","last_unstale":"2024-09-12T18:11:38.706351+0000","last_undegraded":"2024-09-12T18:11:38.706351+0000","last_fullsized":"2024-09-12T18:11:38.706351+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"261'8","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:35.755523+0000","last_change":"2024-09-12T17:20:34.559278+0000","last_active":"2024-09-12T18:10:35.755523+0000","last_peered":"2024-09-12T18:10:35.755523+0000","last_clean":"2024-09-12T18:10:35.755523+0000","last_became_active":"2024-09-12T17:20:34.558970+0000","last_became_peered":"2024-09-12T17:20:34.558970+0000","last_unstale":"2024-09-12T18:10:35.755523+0000","last_undegraded":"2024-09-12T18:10:35.755523+0000","last_fullsized":"2024-09-12T18:10:35.755523+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:15.197078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8194,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.601484+0000","last_change":"2024-09-12T17:20:30.539641+0000","last_active":"2024-09-12T18:13:48.601484+0000","last_peered":"2024-09-12T18:13:48.601484+0000","last_clean":"2024-09-12T18:13:48.601484+0000","last_became_active":"2024-09-12T17:20:30.539358+0000","last_became_peered":"2024-09-12T17:20:30.539358+0000","last_unstale":"2024-09-12T18:13:48.601484+0000","last_undegraded":"2024-09-12T18:13:48.601484+0000","last_fullsized":"2024-09-12T18:13:48.601484+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:09.857477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8242,"num_write":10,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'68","reported_seq":250,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:23.699050+0000","last_change":"2024-09-12T17:16:11.491901+0000","last_active":"2024-09-12T18:10:23.699050+0000","last_peered":"2024-09-12T18:10:23.699050+0000","last_clean":"2024-09-12T18:10:23.699050+0000","last_became_active":"2024-09-12T17:16:11.491610+0000","last_became_peered":"2024-09-12T17:16:11.491610+0000","last_unstale":"2024-09-12T18:10:23.699050+0000","last_undegraded":"2024-09-12T18:10:23.699050+0000","last_fullsized":"2024-09-12T18:10:23.699050+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:14.980006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":357,"num_read_kb":265,"num_write":116,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.743901+0000","last_change":"2024-09-12T17:39:05.922376+0000","last_active":"2024-09-12T18:10:32.743901+0000","last_peered":"2024-09-12T18:10:32.743901+0000","last_clean":"2024-09-12T18:10:32.743901+0000","last_became_active":"2024-09-12T17:39:05.921846+0000","last_became_peered":"2024-09-12T17:39:05.921846+0000","last_unstale":"2024-09-12T18:10:32.743901+0000","last_undegraded":"2024-09-12T18:10:32.743901+0000","last_fullsized":"2024-09-12T18:10:32.743901+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:48.115093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"261'8","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.621019+0000","last_change":"2024-09-12T17:20:34.615861+0000","last_active":"2024-09-12T18:10:36.621019+0000","last_peered":"2024-09-12T18:10:36.621019+0000","last_clean":"2024-09-12T18:10:36.621019+0000","last_became_active":"2024-09-12T17:20:34.615550+0000","last_became_peered":"2024-09-12T17:20:34.615550+0000","last_unstale":"2024-09-12T18:10:36.621019+0000","last_undegraded":"2024-09-12T18:10:36.621019+0000","last_fullsized":"2024-09-12T18:10:36.621019+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:16.087575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":6148,"num_write":8,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'9","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:43.714000+0000","last_change":"2024-09-12T17:20:30.535465+0000","last_active":"2024-09-12T18:12:43.714000+0000","last_peered":"2024-09-12T18:12:43.714000+0000","last_clean":"2024-09-12T18:12:43.714000+0000","last_became_active":"2024-09-12T17:20:30.535182+0000","last_became_peered":"2024-09-12T17:20:30.535182+0000","last_unstale":"2024-09-12T18:12:43.714000+0000","last_undegraded":"2024-09-12T18:12:43.714000+0000","last_fullsized":"2024-09-12T18:12:43.714000+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:33.062178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":17410,"num_write":14,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'51","reported_seq":202,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.624811+0000","last_change":"2024-09-12T17:16:11.493397+0000","last_active":"2024-09-12T18:11:11.624811+0000","last_peered":"2024-09-12T18:11:11.624811+0000","last_clean":"2024-09-12T18:11:11.624811+0000","last_became_active":"2024-09-12T17:16:11.493043+0000","last_became_peered":"2024-09-12T17:16:11.493043+0000","last_unstale":"2024-09-12T18:11:11.624811+0000","last_undegraded":"2024-09-12T18:11:11.624811+0000","last_fullsized":"2024-09-12T18:11:11.624811+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:13.681249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":193,"num_write":93,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.844692+0000","last_change":"2024-09-12T17:39:05.931399+0000","last_active":"2024-09-12T18:10:36.844692+0000","last_peered":"2024-09-12T18:10:36.844692+0000","last_clean":"2024-09-12T18:10:36.844692+0000","last_became_active":"2024-09-12T17:39:05.931122+0000","last_became_peered":"2024-09-12T17:39:05.931122+0000","last_unstale":"2024-09-12T18:10:36.844692+0000","last_undegraded":"2024-09-12T18:10:36.844692+0000","last_fullsized":"2024-09-12T18:10:36.844692+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:02.508518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'9","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.942169+0000","last_change":"2024-09-12T17:20:34.613048+0000","last_active":"2024-09-12T18:13:48.942169+0000","last_peered":"2024-09-12T18:13:48.942169+0000","last_clean":"2024-09-12T18:13:48.942169+0000","last_became_active":"2024-09-12T17:20:34.612720+0000","last_became_peered":"2024-09-12T17:20:34.612720+0000","last_unstale":"2024-09-12T18:13:48.942169+0000","last_undegraded":"2024-09-12T18:13:48.942169+0000","last_fullsized":"2024-09-12T18:13:48.942169+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:30.901799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":14336,"num_write":14,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'8","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:35.773779+0000","last_change":"2024-09-12T17:20:30.534475+0000","last_active":"2024-09-12T18:12:35.773779+0000","last_peered":"2024-09-12T18:12:35.773779+0000","last_clean":"2024-09-12T18:12:35.773779+0000","last_became_active":"2024-09-12T17:20:30.534068+0000","last_became_peered":"2024-09-12T17:20:30.534068+0000","last_unstale":"2024-09-12T18:12:35.773779+0000","last_undegraded":"2024-09-12T18:12:35.773779+0000","last_fullsized":"2024-09-12T18:12:35.773779+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:16.971800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'25","reported_seq":124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.848415+0000","last_change":"2024-09-12T17:16:11.490345+0000","last_active":"2024-09-12T18:11:11.848415+0000","last_peered":"2024-09-12T18:11:11.848415+0000","last_clean":"2024-09-12T18:11:11.848415+0000","last_became_active":"2024-09-12T17:16:11.489860+0000","last_became_peered":"2024-09-12T17:16:11.489860+0000","last_unstale":"2024-09-12T18:11:11.848415+0000","last_undegraded":"2024-09-12T18:11:11.848415+0000","last_fullsized":"2024-09-12T18:11:11.848415+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:28:30.353456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.848437+0000","last_change":"2024-09-12T17:39:05.931395+0000","last_active":"2024-09-12T18:11:11.848437+0000","last_peered":"2024-09-12T18:11:11.848437+0000","last_clean":"2024-09-12T18:11:11.848437+0000","last_became_active":"2024-09-12T17:39:05.931089+0000","last_became_peered":"2024-09-12T17:39:05.931089+0000","last_unstale":"2024-09-12T18:11:11.848437+0000","last_undegraded":"2024-09-12T18:11:11.848437+0000","last_fullsized":"2024-09-12T18:11:11.848437+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:40.976622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"264'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.514642+0000","last_change":"2024-09-12T17:20:34.557572+0000","last_active":"2024-09-12T18:13:48.514642+0000","last_peered":"2024-09-12T18:13:48.514642+0000","last_clean":"2024-09-12T18:13:48.514642+0000","last_became_active":"2024-09-12T17:20:34.557008+0000","last_became_peered":"2024-09-12T17:20:34.557008+0000","last_unstale":"2024-09-12T18:13:48.514642+0000","last_undegraded":"2024-09-12T18:13:48.514642+0000","last_fullsized":"2024-09-12T18:13:48.514642+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'7","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:16.625332+0000","last_change":"2024-09-12T17:20:30.538674+0000","last_active":"2024-09-12T18:11:16.625332+0000","last_peered":"2024-09-12T18:11:16.625332+0000","last_clean":"2024-09-12T18:11:16.625332+0000","last_became_active":"2024-09-12T17:20:30.538361+0000","last_became_peered":"2024-09-12T17:20:30.538361+0000","last_unstale":"2024-09-12T18:11:16.625332+0000","last_undegraded":"2024-09-12T18:11:16.625332+0000","last_fullsized":"2024-09-12T18:11:16.625332+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:34.525214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4098,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'48","reported_seq":182,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.848386+0000","last_change":"2024-09-12T17:16:11.488078+0000","last_active":"2024-09-12T18:11:11.848386+0000","last_peered":"2024-09-12T18:11:11.848386+0000","last_clean":"2024-09-12T18:11:11.848386+0000","last_became_active":"2024-09-12T17:16:11.487771+0000","last_became_peered":"2024-09-12T17:16:11.487771+0000","last_unstale":"2024-09-12T18:11:11.848386+0000","last_undegraded":"2024-09-12T18:11:11.848386+0000","last_fullsized":"2024-09-12T18:11:11.848386+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:38.032910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":161,"num_write":84,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:23.917612+0000","last_change":"2024-09-12T17:39:05.921998+0000","last_active":"2024-09-12T18:10:23.917612+0000","last_peered":"2024-09-12T18:10:23.917612+0000","last_clean":"2024-09-12T18:10:23.917612+0000","last_became_active":"2024-09-12T17:39:05.921661+0000","last_became_peered":"2024-09-12T17:39:05.921661+0000","last_unstale":"2024-09-12T18:10:23.917612+0000","last_undegraded":"2024-09-12T18:10:23.917612+0000","last_fullsized":"2024-09-12T18:10:23.917612+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:09.613996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'3","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:47.771536+0000","last_change":"2024-09-12T17:20:34.555394+0000","last_active":"2024-09-12T18:13:47.771536+0000","last_peered":"2024-09-12T18:13:47.771536+0000","last_clean":"2024-09-12T18:13:47.771536+0000","last_became_active":"2024-09-12T17:20:34.555047+0000","last_became_peered":"2024-09-12T17:20:34.555047+0000","last_unstale":"2024-09-12T18:13:47.771536+0000","last_undegraded":"2024-09-12T18:13:47.771536+0000","last_fullsized":"2024-09-12T18:13:47.771536+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:29.139249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'4","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.385159+0000","last_change":"2024-09-12T17:20:30.528356+0000","last_active":"2024-09-12T18:13:49.385159+0000","last_peered":"2024-09-12T18:13:49.385159+0000","last_clean":"2024-09-12T18:13:49.385159+0000","last_became_active":"2024-09-12T17:20:30.528029+0000","last_became_peered":"2024-09-12T17:20:30.528029+0000","last_unstale":"2024-09-12T18:13:49.385159+0000","last_undegraded":"2024-09-12T18:13:49.385159+0000","last_fullsized":"2024-09-12T18:13:49.385159+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:17.569528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'34","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:12.750037+0000","last_change":"2024-09-12T17:16:11.491282+0000","last_active":"2024-09-12T18:11:12.750037+0000","last_peered":"2024-09-12T18:11:12.750037+0000","last_clean":"2024-09-12T18:11:12.750037+0000","last_became_active":"2024-09-12T17:16:11.490952+0000","last_became_peered":"2024-09-12T17:16:11.490952+0000","last_unstale":"2024-09-12T18:11:12.750037+0000","last_undegraded":"2024-09-12T18:11:12.750037+0000","last_fullsized":"2024-09-12T18:11:12.750037+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:58.052602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":115,"num_write":60,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:37.767778+0000","last_change":"2024-09-12T17:39:05.929242+0000","last_active":"2024-09-12T18:11:37.767778+0000","last_peered":"2024-09-12T18:11:37.767778+0000","last_clean":"2024-09-12T18:11:37.767778+0000","last_became_active":"2024-09-12T17:39:05.928959+0000","last_became_peered":"2024-09-12T17:39:05.928959+0000","last_unstale":"2024-09-12T18:11:37.767778+0000","last_undegraded":"2024-09-12T18:11:37.767778+0000","last_fullsized":"2024-09-12T18:11:37.767778+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.744728+0000","last_change":"2024-09-12T17:20:34.552499+0000","last_active":"2024-09-12T18:10:37.744728+0000","last_peered":"2024-09-12T18:10:37.744728+0000","last_clean":"2024-09-12T18:10:37.744728+0000","last_became_active":"2024-09-12T17:20:34.552180+0000","last_became_peered":"2024-09-12T17:20:34.552180+0000","last_unstale":"2024-09-12T18:10:37.744728+0000","last_undegraded":"2024-09-12T18:10:37.744728+0000","last_fullsized":"2024-09-12T18:10:37.744728+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:03.689040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:30.754825+0000","last_change":"2024-09-12T17:20:30.535560+0000","last_active":"2024-09-12T18:10:30.754825+0000","last_peered":"2024-09-12T18:10:30.754825+0000","last_clean":"2024-09-12T18:10:30.754825+0000","last_became_active":"2024-09-12T17:20:30.535001+0000","last_became_peered":"2024-09-12T17:20:30.535001+0000","last_unstale":"2024-09-12T18:10:30.754825+0000","last_undegraded":"2024-09-12T18:10:30.754825+0000","last_fullsized":"2024-09-12T18:10:30.754825+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:47.724576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'14","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:36.614251+0000","last_change":"2024-09-12T17:16:11.480542+0000","last_active":"2024-09-12T18:09:36.614251+0000","last_peered":"2024-09-12T18:09:36.614251+0000","last_clean":"2024-09-12T18:09:36.614251+0000","last_became_active":"2024-09-12T17:16:11.477940+0000","last_became_peered":"2024-09-12T17:16:11.477940+0000","last_unstale":"2024-09-12T18:09:36.614251+0000","last_undegraded":"2024-09-12T18:09:36.614251+0000","last_fullsized":"2024-09-12T18:09:36.614251+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:48.061800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":35,"num_write":34,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:37.767810+0000","last_change":"2024-09-12T17:39:05.930937+0000","last_active":"2024-09-12T18:11:37.767810+0000","last_peered":"2024-09-12T18:11:37.767810+0000","last_clean":"2024-09-12T18:11:37.767810+0000","last_became_active":"2024-09-12T17:39:05.930694+0000","last_became_peered":"2024-09-12T17:39:05.930694+0000","last_unstale":"2024-09-12T18:11:37.767810+0000","last_undegraded":"2024-09-12T18:11:37.767810+0000","last_fullsized":"2024-09-12T18:11:37.767810+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"261'4","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.844714+0000","last_change":"2024-09-12T17:20:34.553025+0000","last_active":"2024-09-12T18:10:36.844714+0000","last_peered":"2024-09-12T18:10:36.844714+0000","last_clean":"2024-09-12T18:10:36.844714+0000","last_became_active":"2024-09-12T17:20:34.552726+0000","last_became_peered":"2024-09-12T17:20:34.552726+0000","last_unstale":"2024-09-12T18:10:36.844714+0000","last_undegraded":"2024-09-12T18:10:36.844714+0000","last_fullsized":"2024-09-12T18:10:36.844714+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:22.335524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:01.638377+0000","last_change":"2024-09-12T17:20:30.539217+0000","last_active":"2024-09-12T18:13:01.638377+0000","last_peered":"2024-09-12T18:13:01.638377+0000","last_clean":"2024-09-12T18:13:01.638377+0000","last_became_active":"2024-09-12T17:20:30.538942+0000","last_became_peered":"2024-09-12T17:20:30.538942+0000","last_unstale":"2024-09-12T18:13:01.638377+0000","last_undegraded":"2024-09-12T18:13:01.638377+0000","last_fullsized":"2024-09-12T18:13:01.638377+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:53.625617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'32","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.926125+0000","last_change":"2024-09-12T17:16:11.488019+0000","last_active":"2024-09-12T18:11:48.926125+0000","last_peered":"2024-09-12T18:11:48.926125+0000","last_clean":"2024-09-12T18:11:48.926125+0000","last_became_active":"2024-09-12T17:16:11.487242+0000","last_became_peered":"2024-09-12T17:16:11.487242+0000","last_unstale":"2024-09-12T18:11:48.926125+0000","last_undegraded":"2024-09-12T18:11:48.926125+0000","last_fullsized":"2024-09-12T18:11:48.926125+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":114,"num_write":62,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.926163+0000","last_change":"2024-09-12T17:39:05.927350+0000","last_active":"2024-09-12T18:11:48.926163+0000","last_peered":"2024-09-12T18:11:48.926163+0000","last_clean":"2024-09-12T18:11:48.926163+0000","last_became_active":"2024-09-12T17:39:05.924899+0000","last_became_peered":"2024-09-12T17:39:05.924899+0000","last_unstale":"2024-09-12T18:11:48.926163+0000","last_undegraded":"2024-09-12T18:11:48.926163+0000","last_fullsized":"2024-09-12T18:11:48.926163+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'5","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.808588+0000","last_change":"2024-09-12T17:20:34.610704+0000","last_active":"2024-09-12T18:13:48.808588+0000","last_peered":"2024-09-12T18:13:48.808588+0000","last_clean":"2024-09-12T18:13:48.808588+0000","last_became_active":"2024-09-12T17:20:34.610374+0000","last_became_peered":"2024-09-12T17:20:34.610374+0000","last_unstale":"2024-09-12T18:13:48.808588+0000","last_undegraded":"2024-09-12T18:13:48.808588+0000","last_fullsized":"2024-09-12T18:13:48.808588+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:34.456941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1142,"num_write":10,"num_write_kb":1595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"264'3","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.970813+0000","last_change":"2024-09-12T17:20:30.526974+0000","last_active":"2024-09-12T18:12:02.970813+0000","last_peered":"2024-09-12T18:12:02.970813+0000","last_clean":"2024-09-12T18:12:02.970813+0000","last_became_active":"2024-09-12T17:20:30.526672+0000","last_became_peered":"2024-09-12T17:20:30.526672+0000","last_unstale":"2024-09-12T18:12:02.970813+0000","last_undegraded":"2024-09-12T18:12:02.970813+0000","last_fullsized":"2024-09-12T18:12:02.970813+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:59.866468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'19","reported_seq":110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:46.628646+0000","last_change":"2024-09-12T17:16:11.481645+0000","last_active":"2024-09-12T18:11:46.628646+0000","last_peered":"2024-09-12T18:11:46.628646+0000","last_clean":"2024-09-12T18:11:46.628646+0000","last_became_active":"2024-09-12T17:16:11.481351+0000","last_became_peered":"2024-09-12T17:16:11.481351+0000","last_unstale":"2024-09-12T18:11:46.628646+0000","last_undegraded":"2024-09-12T18:11:46.628646+0000","last_fullsized":"2024-09-12T18:11:46.628646+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":68,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.707373+0000","last_change":"2024-09-12T17:39:05.928807+0000","last_active":"2024-09-12T18:11:48.707373+0000","last_peered":"2024-09-12T18:11:48.707373+0000","last_clean":"2024-09-12T18:11:48.707373+0000","last_became_active":"2024-09-12T17:39:05.928497+0000","last_became_peered":"2024-09-12T17:39:05.928497+0000","last_unstale":"2024-09-12T18:11:48.707373+0000","last_undegraded":"2024-09-12T18:11:48.707373+0000","last_fullsized":"2024-09-12T18:11:48.707373+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:06.855515+0000","last_change":"2024-09-12T17:20:34.610626+0000","last_active":"2024-09-12T18:12:06.855515+0000","last_peered":"2024-09-12T18:12:06.855515+0000","last_clean":"2024-09-12T18:12:06.855515+0000","last_became_active":"2024-09-12T17:20:34.610260+0000","last_became_peered":"2024-09-12T17:20:34.610260+0000","last_unstale":"2024-09-12T18:12:06.855515+0000","last_undegraded":"2024-09-12T18:12:06.855515+0000","last_fullsized":"2024-09-12T18:12:06.855515+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:16.730940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'14","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.438735+0000","last_change":"2024-09-12T17:20:30.527312+0000","last_active":"2024-09-12T18:13:48.438735+0000","last_peered":"2024-09-12T18:13:48.438735+0000","last_clean":"2024-09-12T18:13:48.438735+0000","last_became_active":"2024-09-12T17:20:30.527032+0000","last_became_peered":"2024-09-12T17:20:30.527032+0000","last_unstale":"2024-09-12T18:13:48.438735+0000","last_undegraded":"2024-09-12T18:13:48.438735+0000","last_fullsized":"2024-09-12T18:13:48.438735+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:12.370876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":13314,"num_write":24,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"0'0","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:46.852770+0000","last_change":"2024-09-12T17:16:11.494751+0000","last_active":"2024-09-12T18:11:46.852770+0000","last_peered":"2024-09-12T18:11:46.852770+0000","last_clean":"2024-09-12T18:11:46.852770+0000","last_became_active":"2024-09-12T17:16:11.494493+0000","last_became_peered":"2024-09-12T17:16:11.494493+0000","last_unstale":"2024-09-12T18:11:46.852770+0000","last_undegraded":"2024-09-12T18:11:46.852770+0000","last_fullsized":"2024-09-12T18:11:46.852770+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.769254+0000","last_change":"2024-09-12T17:39:05.926661+0000","last_active":"2024-09-12T18:11:47.769254+0000","last_peered":"2024-09-12T18:11:47.769254+0000","last_clean":"2024-09-12T18:11:47.769254+0000","last_became_active":"2024-09-12T17:39:05.926388+0000","last_became_peered":"2024-09-12T17:39:05.926388+0000","last_unstale":"2024-09-12T18:11:47.769254+0000","last_undegraded":"2024-09-12T18:11:47.769254+0000","last_fullsized":"2024-09-12T18:11:47.769254+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"261'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:21.849742+0000","last_change":"2024-09-12T17:20:34.615918+0000","last_active":"2024-09-12T18:11:21.849742+0000","last_peered":"2024-09-12T18:11:21.849742+0000","last_clean":"2024-09-12T18:11:21.849742+0000","last_became_active":"2024-09-12T17:20:34.615468+0000","last_became_peered":"2024-09-12T17:20:34.615468+0000","last_unstale":"2024-09-12T18:11:21.849742+0000","last_undegraded":"2024-09-12T18:11:21.849742+0000","last_fullsized":"2024-09-12T18:11:21.849742+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:26.561082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:18.704540+0000","last_change":"2024-09-12T17:20:30.533763+0000","last_active":"2024-09-12T18:11:18.704540+0000","last_peered":"2024-09-12T18:11:18.704540+0000","last_clean":"2024-09-12T18:11:18.704540+0000","last_became_active":"2024-09-12T17:20:30.533436+0000","last_became_peered":"2024-09-12T17:20:30.533436+0000","last_unstale":"2024-09-12T18:11:18.704540+0000","last_undegraded":"2024-09-12T18:11:18.704540+0000","last_fullsized":"2024-09-12T18:11:18.704540+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:28.574849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'18","reported_seq":107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.707408+0000","last_change":"2024-09-12T17:16:11.489669+0000","last_active":"2024-09-12T18:11:48.707408+0000","last_peered":"2024-09-12T18:11:48.707408+0000","last_clean":"2024-09-12T18:11:48.707408+0000","last_became_active":"2024-09-12T17:16:11.488588+0000","last_became_peered":"2024-09-12T17:16:11.488588+0000","last_unstale":"2024-09-12T18:11:48.707408+0000","last_undegraded":"2024-09-12T18:11:48.707408+0000","last_fullsized":"2024-09-12T18:11:48.707408+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.967852+0000","last_change":"2024-09-12T17:39:05.923338+0000","last_active":"2024-09-12T18:11:47.967852+0000","last_peered":"2024-09-12T18:11:47.967852+0000","last_clean":"2024-09-12T18:11:47.967852+0000","last_became_active":"2024-09-12T17:39:05.922973+0000","last_became_peered":"2024-09-12T17:39:05.922973+0000","last_unstale":"2024-09-12T18:11:47.967852+0000","last_undegraded":"2024-09-12T18:11:47.967852+0000","last_fullsized":"2024-09-12T18:11:47.967852+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:20.762674+0000","last_change":"2024-09-12T17:20:34.555891+0000","last_active":"2024-09-12T18:11:20.762674+0000","last_peered":"2024-09-12T18:11:20.762674+0000","last_clean":"2024-09-12T18:11:20.762674+0000","last_became_active":"2024-09-12T17:20:34.554893+0000","last_became_peered":"2024-09-12T17:20:34.554893+0000","last_unstale":"2024-09-12T18:11:20.762674+0000","last_undegraded":"2024-09-12T18:11:20.762674+0000","last_fullsized":"2024-09-12T18:11:20.762674+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:56.253377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'6","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:41.643873+0000","last_change":"2024-09-12T17:20:30.536540+0000","last_active":"2024-09-12T18:13:41.643873+0000","last_peered":"2024-09-12T18:13:41.643873+0000","last_clean":"2024-09-12T18:13:41.643873+0000","last_became_active":"2024-09-12T17:20:30.535226+0000","last_became_peered":"2024-09-12T17:20:30.535226+0000","last_unstale":"2024-09-12T18:13:41.643873+0000","last_undegraded":"2024-09-12T18:13:41.643873+0000","last_fullsized":"2024-09-12T18:13:41.643873+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:28:25.047253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":6,"num_write_kb":3074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'26","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:02.752551+0000","last_change":"2024-09-12T17:16:11.491564+0000","last_active":"2024-09-12T18:10:02.752551+0000","last_peered":"2024-09-12T18:10:02.752551+0000","last_clean":"2024-09-12T18:10:02.752551+0000","last_became_active":"2024-09-12T17:16:11.491240+0000","last_became_peered":"2024-09-12T17:16:11.491240+0000","last_unstale":"2024-09-12T18:10:02.752551+0000","last_undegraded":"2024-09-12T18:10:02.752551+0000","last_fullsized":"2024-09-12T18:10:02.752551+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:43.068567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":97,"num_write":43,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844211+0000","last_change":"2024-09-12T17:39:05.932135+0000","last_active":"2024-09-12T18:10:31.844211+0000","last_peered":"2024-09-12T18:10:31.844211+0000","last_clean":"2024-09-12T18:10:31.844211+0000","last_became_active":"2024-09-12T17:39:05.931841+0000","last_became_peered":"2024-09-12T17:39:05.931841+0000","last_unstale":"2024-09-12T18:10:31.844211+0000","last_undegraded":"2024-09-12T18:10:31.844211+0000","last_fullsized":"2024-09-12T18:10:31.844211+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:08.525616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.926685+0000","last_change":"2024-09-12T17:20:34.560852+0000","last_active":"2024-09-12T18:11:53.926685+0000","last_peered":"2024-09-12T18:11:53.926685+0000","last_clean":"2024-09-12T18:11:53.926685+0000","last_became_active":"2024-09-12T17:20:34.560497+0000","last_became_peered":"2024-09-12T17:20:34.560497+0000","last_unstale":"2024-09-12T18:11:53.926685+0000","last_undegraded":"2024-09-12T18:11:53.926685+0000","last_fullsized":"2024-09-12T18:11:53.926685+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"261'7","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.767049+0000","last_change":"2024-09-12T17:20:30.535717+0000","last_active":"2024-09-12T18:11:50.767049+0000","last_peered":"2024-09-12T18:11:50.767049+0000","last_clean":"2024-09-12T18:11:50.767049+0000","last_became_active":"2024-09-12T17:20:30.535358+0000","last_became_peered":"2024-09-12T17:20:30.535358+0000","last_unstale":"2024-09-12T18:11:50.767049+0000","last_undegraded":"2024-09-12T18:11:50.767049+0000","last_fullsized":"2024-09-12T18:11:50.767049+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":15362,"num_write":12,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'12","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:52.751072+0000","last_change":"2024-09-12T17:16:11.490206+0000","last_active":"2024-09-12T18:09:52.751072+0000","last_peered":"2024-09-12T18:09:52.751072+0000","last_clean":"2024-09-12T18:09:52.751072+0000","last_became_active":"2024-09-12T17:16:11.489897+0000","last_became_peered":"2024-09-12T17:16:11.489897+0000","last_unstale":"2024-09-12T18:09:52.751072+0000","last_undegraded":"2024-09-12T18:09:52.751072+0000","last_fullsized":"2024-09-12T18:09:52.751072+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:03.772651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.620396+0000","last_change":"2024-09-12T17:39:05.927618+0000","last_active":"2024-09-12T18:10:31.620396+0000","last_peered":"2024-09-12T18:10:31.620396+0000","last_clean":"2024-09-12T18:10:31.620396+0000","last_became_active":"2024-09-12T17:39:05.926766+0000","last_became_peered":"2024-09-12T17:39:05.926766+0000","last_unstale":"2024-09-12T18:10:31.620396+0000","last_undegraded":"2024-09-12T18:10:31.620396+0000","last_fullsized":"2024-09-12T18:10:31.620396+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:41.020632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"264'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.515423+0000","last_change":"2024-09-12T17:20:34.559252+0000","last_active":"2024-09-12T18:13:48.515423+0000","last_peered":"2024-09-12T18:13:48.515423+0000","last_clean":"2024-09-12T18:13:48.515423+0000","last_became_active":"2024-09-12T17:20:34.558970+0000","last_became_peered":"2024-09-12T17:20:34.558970+0000","last_unstale":"2024-09-12T18:13:48.515423+0000","last_undegraded":"2024-09-12T18:13:48.515423+0000","last_fullsized":"2024-09-12T18:13:48.515423+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'4","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.517417+0000","last_change":"2024-09-12T17:20:30.536062+0000","last_active":"2024-09-12T18:13:48.517417+0000","last_peered":"2024-09-12T18:13:48.517417+0000","last_clean":"2024-09-12T18:13:48.517417+0000","last_became_active":"2024-09-12T17:20:30.535761+0000","last_became_peered":"2024-09-12T17:20:30.535761+0000","last_unstale":"2024-09-12T18:13:48.517417+0000","last_undegraded":"2024-09-12T18:13:48.517417+0000","last_fullsized":"2024-09-12T18:13:48.517417+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8196,"num_write":4,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'42","reported_seq":175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:51.615812+0000","last_change":"2024-09-12T17:16:11.488259+0000","last_active":"2024-09-12T18:09:51.615812+0000","last_peered":"2024-09-12T18:09:51.615812+0000","last_clean":"2024-09-12T18:09:51.615812+0000","last_became_active":"2024-09-12T17:16:11.487923+0000","last_became_peered":"2024-09-12T17:16:11.487923+0000","last_unstale":"2024-09-12T18:09:51.615812+0000","last_undegraded":"2024-09-12T18:09:51.615812+0000","last_fullsized":"2024-09-12T18:09:51.615812+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:17.535117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":152,"num_write":79,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:36.614300+0000","last_change":"2024-09-12T17:39:05.921610+0000","last_active":"2024-09-12T18:09:36.614300+0000","last_peered":"2024-09-12T18:09:36.614300+0000","last_clean":"2024-09-12T18:09:36.614300+0000","last_became_active":"2024-09-12T17:39:05.921257+0000","last_became_peered":"2024-09-12T17:39:05.921257+0000","last_unstale":"2024-09-12T18:09:36.614300+0000","last_undegraded":"2024-09-12T18:09:36.614300+0000","last_fullsized":"2024-09-12T18:09:36.614300+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:57.829484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'4","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.311850+0000","last_change":"2024-09-12T17:20:34.554048+0000","last_active":"2024-09-12T18:13:49.311850+0000","last_peered":"2024-09-12T18:13:49.311850+0000","last_clean":"2024-09-12T18:13:49.311850+0000","last_became_active":"2024-09-12T17:20:34.553659+0000","last_became_peered":"2024-09-12T17:20:34.553659+0000","last_unstale":"2024-09-12T18:13:49.311850+0000","last_undegraded":"2024-09-12T18:13:49.311850+0000","last_fullsized":"2024-09-12T18:13:49.311850+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:41.787619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":52,"num_write":4,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.755292+0000","last_change":"2024-09-12T17:20:30.535174+0000","last_active":"2024-09-12T18:11:52.755292+0000","last_peered":"2024-09-12T18:11:52.755292+0000","last_clean":"2024-09-12T18:11:52.755292+0000","last_became_active":"2024-09-12T17:20:30.534878+0000","last_became_peered":"2024-09-12T17:20:30.534878+0000","last_unstale":"2024-09-12T18:11:52.755292+0000","last_undegraded":"2024-09-12T18:11:52.755292+0000","last_fullsized":"2024-09-12T18:11:52.755292+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'92","reported_seq":343,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:50.748679+0000","last_change":"2024-09-12T17:16:11.489329+0000","last_active":"2024-09-12T18:09:50.748679+0000","last_peered":"2024-09-12T18:09:50.748679+0000","last_clean":"2024-09-12T18:09:50.748679+0000","last_became_active":"2024-09-12T17:16:11.489044+0000","last_became_peered":"2024-09-12T17:16:11.489044+0000","last_unstale":"2024-09-12T18:09:50.748679+0000","last_undegraded":"2024-09-12T18:09:50.748679+0000","last_fullsized":"2024-09-12T18:09:50.748679+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:09.438571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":552,"num_read_kb":376,"num_write":139,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844194+0000","last_change":"2024-09-12T17:39:05.932942+0000","last_active":"2024-09-12T18:10:31.844194+0000","last_peered":"2024-09-12T18:10:31.844194+0000","last_clean":"2024-09-12T18:10:31.844194+0000","last_became_active":"2024-09-12T17:39:05.932617+0000","last_became_peered":"2024-09-12T17:39:05.932617+0000","last_unstale":"2024-09-12T18:10:31.844194+0000","last_undegraded":"2024-09-12T18:10:31.844194+0000","last_fullsized":"2024-09-12T18:10:31.844194+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:47.846584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"261'5","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:37.736113+0000","last_change":"2024-09-12T17:20:34.559301+0000","last_active":"2024-09-12T18:09:37.736113+0000","last_peered":"2024-09-12T18:09:37.736113+0000","last_clean":"2024-09-12T18:09:37.736113+0000","last_became_active":"2024-09-12T17:20:34.559024+0000","last_became_peered":"2024-09-12T17:20:34.559024+0000","last_unstale":"2024-09-12T18:09:37.736113+0000","last_undegraded":"2024-09-12T18:09:37.736113+0000","last_fullsized":"2024-09-12T18:09:37.736113+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:19.256473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'6","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.228609+0000","last_change":"2024-09-12T17:20:30.534604+0000","last_active":"2024-09-12T18:13:49.228609+0000","last_peered":"2024-09-12T18:13:49.228609+0000","last_clean":"2024-09-12T18:13:49.228609+0000","last_became_active":"2024-09-12T17:20:30.534298+0000","last_became_peered":"2024-09-12T17:20:30.534298+0000","last_unstale":"2024-09-12T18:13:49.228609+0000","last_undegraded":"2024-09-12T18:13:49.228609+0000","last_fullsized":"2024-09-12T18:13:49.228609+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'39","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:51.839494+0000","last_change":"2024-09-12T17:16:11.489376+0000","last_active":"2024-09-12T18:09:51.839494+0000","last_peered":"2024-09-12T18:09:51.839494+0000","last_clean":"2024-09-12T18:09:51.839494+0000","last_became_active":"2024-09-12T17:16:11.489085+0000","last_became_peered":"2024-09-12T17:16:11.489085+0000","last_unstale":"2024-09-12T18:09:51.839494+0000","last_undegraded":"2024-09-12T18:09:51.839494+0000","last_fullsized":"2024-09-12T18:09:51.839494+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:34.809544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":137,"num_write":73,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:43.706885+0000","last_change":"2024-09-12T17:39:05.928701+0000","last_active":"2024-09-12T18:11:43.706885+0000","last_peered":"2024-09-12T18:11:43.706885+0000","last_clean":"2024-09-12T18:11:43.706885+0000","last_became_active":"2024-09-12T17:39:05.928320+0000","last_became_peered":"2024-09-12T17:39:05.928320+0000","last_unstale":"2024-09-12T18:11:43.706885+0000","last_undegraded":"2024-09-12T18:11:43.706885+0000","last_fullsized":"2024-09-12T18:11:43.706885+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"261'5","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:06.841342+0000","last_change":"2024-09-12T17:20:34.553728+0000","last_active":"2024-09-12T18:10:06.841342+0000","last_peered":"2024-09-12T18:10:06.841342+0000","last_clean":"2024-09-12T18:10:06.841342+0000","last_became_active":"2024-09-12T17:20:34.553407+0000","last_became_peered":"2024-09-12T17:20:34.553407+0000","last_unstale":"2024-09-12T18:10:06.841342+0000","last_undegraded":"2024-09-12T18:10:06.841342+0000","last_fullsized":"2024-09-12T18:10:06.841342+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:51.963850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'7","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.440197+0000","last_change":"2024-09-12T17:20:30.525002+0000","last_active":"2024-09-12T18:13:48.440197+0000","last_peered":"2024-09-12T18:13:48.440197+0000","last_clean":"2024-09-12T18:13:48.440197+0000","last_became_active":"2024-09-12T17:20:30.524670+0000","last_became_peered":"2024-09-12T17:20:30.524670+0000","last_unstale":"2024-09-12T18:13:48.440197+0000","last_undegraded":"2024-09-12T18:13:48.440197+0000","last_fullsized":"2024-09-12T18:13:48.440197+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:48.793238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4667,"num_write":12,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'33","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.843088+0000","last_change":"2024-09-12T17:16:11.487281+0000","last_active":"2024-09-12T18:10:21.843088+0000","last_peered":"2024-09-12T18:10:21.843088+0000","last_clean":"2024-09-12T18:10:21.843088+0000","last_became_active":"2024-09-12T17:16:11.486986+0000","last_became_peered":"2024-09-12T17:16:11.486986+0000","last_unstale":"2024-09-12T18:10:21.843088+0000","last_undegraded":"2024-09-12T18:10:21.843088+0000","last_fullsized":"2024-09-12T18:10:21.843088+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:58.383837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":108,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.758368+0000","last_change":"2024-09-12T17:39:05.927856+0000","last_active":"2024-09-12T18:10:37.758368+0000","last_peered":"2024-09-12T18:10:37.758368+0000","last_clean":"2024-09-12T18:10:37.758368+0000","last_became_active":"2024-09-12T17:39:05.927578+0000","last_became_peered":"2024-09-12T17:39:05.927578+0000","last_unstale":"2024-09-12T18:10:37.758368+0000","last_undegraded":"2024-09-12T18:10:37.758368+0000","last_fullsized":"2024-09-12T18:10:37.758368+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:21.888828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:06.841313+0000","last_change":"2024-09-12T17:20:34.552899+0000","last_active":"2024-09-12T18:10:06.841313+0000","last_peered":"2024-09-12T18:10:06.841313+0000","last_clean":"2024-09-12T18:10:06.841313+0000","last_became_active":"2024-09-12T17:20:34.552569+0000","last_became_peered":"2024-09-12T17:20:34.552569+0000","last_unstale":"2024-09-12T18:10:06.841313+0000","last_undegraded":"2024-09-12T18:10:06.841313+0000","last_fullsized":"2024-09-12T18:10:06.841313+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:59.485671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:03.697087+0000","last_change":"2024-09-12T17:20:30.538454+0000","last_active":"2024-09-12T18:10:03.697087+0000","last_peered":"2024-09-12T18:10:03.697087+0000","last_clean":"2024-09-12T18:10:03.697087+0000","last_became_active":"2024-09-12T17:20:30.538157+0000","last_became_peered":"2024-09-12T17:20:30.538157+0000","last_unstale":"2024-09-12T18:10:03.697087+0000","last_undegraded":"2024-09-12T18:10:03.697087+0000","last_fullsized":"2024-09-12T18:10:03.697087+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:21.990887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'29","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.953012+0000","last_change":"2024-09-12T17:16:11.488323+0000","last_active":"2024-09-12T18:10:12.953012+0000","last_peered":"2024-09-12T18:10:12.953012+0000","last_clean":"2024-09-12T18:10:12.953012+0000","last_became_active":"2024-09-12T17:16:11.487998+0000","last_became_peered":"2024-09-12T17:16:11.487998+0000","last_unstale":"2024-09-12T18:10:12.953012+0000","last_undegraded":"2024-09-12T18:10:12.953012+0000","last_fullsized":"2024-09-12T18:10:12.953012+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:46.362889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:37.753323+0000","last_change":"2024-09-12T17:39:05.921302+0000","last_active":"2024-09-12T18:11:37.753323+0000","last_peered":"2024-09-12T18:11:37.753323+0000","last_clean":"2024-09-12T18:11:37.753323+0000","last_became_active":"2024-09-12T17:39:05.921008+0000","last_became_peered":"2024-09-12T17:39:05.921008+0000","last_unstale":"2024-09-12T18:11:37.753323+0000","last_undegraded":"2024-09-12T18:11:37.753323+0000","last_fullsized":"2024-09-12T18:11:37.753323+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:44.290086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:28.933628+0000","last_change":"2024-09-12T17:20:34.616039+0000","last_active":"2024-09-12T18:12:28.933628+0000","last_peered":"2024-09-12T18:12:28.933628+0000","last_clean":"2024-09-12T18:12:28.933628+0000","last_became_active":"2024-09-12T17:20:34.615689+0000","last_became_peered":"2024-09-12T17:20:34.615689+0000","last_unstale":"2024-09-12T18:12:28.933628+0000","last_undegraded":"2024-09-12T18:12:28.933628+0000","last_fullsized":"2024-09-12T18:12:28.933628+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:14.341361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'4","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:16.632452+0000","last_change":"2024-09-12T17:20:30.540013+0000","last_active":"2024-09-12T18:12:16.632452+0000","last_peered":"2024-09-12T18:12:16.632452+0000","last_clean":"2024-09-12T18:12:16.632452+0000","last_became_active":"2024-09-12T17:20:30.536917+0000","last_became_peered":"2024-09-12T17:20:30.536917+0000","last_unstale":"2024-09-12T18:12:16.632452+0000","last_undegraded":"2024-09-12T18:12:16.632452+0000","last_fullsized":"2024-09-12T18:12:16.632452+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:21.908709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'41","reported_seq":168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:12.740858+0000","last_change":"2024-09-12T17:16:11.488593+0000","last_active":"2024-09-12T18:10:12.740858+0000","last_peered":"2024-09-12T18:10:12.740858+0000","last_clean":"2024-09-12T18:10:12.740858+0000","last_became_active":"2024-09-12T17:16:11.488252+0000","last_became_peered":"2024-09-12T17:16:11.488252+0000","last_unstale":"2024-09-12T18:10:12.740858+0000","last_undegraded":"2024-09-12T18:10:12.740858+0000","last_fullsized":"2024-09-12T18:10:12.740858+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:41.338780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":141,"num_write":74,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:37.767690+0000","last_change":"2024-09-12T17:39:05.926009+0000","last_active":"2024-09-12T18:11:37.767690+0000","last_peered":"2024-09-12T18:11:37.767690+0000","last_clean":"2024-09-12T18:11:37.767690+0000","last_became_active":"2024-09-12T17:39:05.925589+0000","last_became_peered":"2024-09-12T17:39:05.925589+0000","last_unstale":"2024-09-12T18:11:37.767690+0000","last_undegraded":"2024-09-12T18:11:37.767690+0000","last_fullsized":"2024-09-12T18:11:37.767690+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:14.643645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'11","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.857904+0000","last_change":"2024-09-12T17:20:34.560582+0000","last_active":"2024-09-12T18:12:21.857904+0000","last_peered":"2024-09-12T18:12:21.857904+0000","last_clean":"2024-09-12T18:12:21.857904+0000","last_became_active":"2024-09-12T17:20:34.560319+0000","last_became_peered":"2024-09-12T17:20:34.560319+0000","last_unstale":"2024-09-12T18:12:21.857904+0000","last_undegraded":"2024-09-12T18:12:21.857904+0000","last_fullsized":"2024-09-12T18:12:21.857904+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:25.756495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15462,"num_write":16,"num_write_kb":7218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'2","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:28.933593+0000","last_change":"2024-09-12T17:20:30.531674+0000","last_active":"2024-09-12T18:12:28.933593+0000","last_peered":"2024-09-12T18:12:28.933593+0000","last_clean":"2024-09-12T18:12:28.933593+0000","last_became_active":"2024-09-12T17:20:30.531384+0000","last_became_peered":"2024-09-12T17:20:30.531384+0000","last_unstale":"2024-09-12T18:12:28.933593+0000","last_undegraded":"2024-09-12T18:12:28.933593+0000","last_fullsized":"2024-09-12T18:12:28.933593+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:07.405605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'7","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:13.698059+0000","last_change":"2024-09-12T17:16:11.486387+0000","last_active":"2024-09-12T18:10:13.698059+0000","last_peered":"2024-09-12T18:10:13.698059+0000","last_clean":"2024-09-12T18:10:13.698059+0000","last_became_active":"2024-09-12T17:16:11.486098+0000","last_became_peered":"2024-09-12T17:16:11.486098+0000","last_unstale":"2024-09-12T18:10:13.698059+0000","last_undegraded":"2024-09-12T18:10:13.698059+0000","last_fullsized":"2024-09-12T18:10:13.698059+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:46.177478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.844775+0000","last_change":"2024-09-12T17:39:05.926486+0000","last_active":"2024-09-12T18:10:36.844775+0000","last_peered":"2024-09-12T18:10:36.844775+0000","last_clean":"2024-09-12T18:10:36.844775+0000","last_became_active":"2024-09-12T17:39:05.925637+0000","last_became_peered":"2024-09-12T17:39:05.925637+0000","last_unstale":"2024-09-12T18:10:36.844775+0000","last_undegraded":"2024-09-12T18:10:36.844775+0000","last_fullsized":"2024-09-12T18:10:36.844775+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:55.840960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:25.753841+0000","last_change":"2024-09-12T17:20:47.596669+0000","last_active":"2024-09-12T18:10:25.753841+0000","last_peered":"2024-09-12T18:10:25.753841+0000","last_clean":"2024-09-12T18:10:25.753841+0000","last_became_active":"2024-09-12T17:20:47.581310+0000","last_became_peered":"2024-09-12T17:20:47.581310+0000","last_unstale":"2024-09-12T18:10:25.753841+0000","last_undegraded":"2024-09-12T18:10:25.753841+0000","last_fullsized":"2024-09-12T18:10:25.753841+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:11.897529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619107+0000","last_change":"2024-09-12T17:20:30.536180+0000","last_active":"2024-09-12T18:10:21.619107+0000","last_peered":"2024-09-12T18:10:21.619107+0000","last_clean":"2024-09-12T18:10:21.619107+0000","last_became_active":"2024-09-12T17:20:30.535668+0000","last_became_peered":"2024-09-12T17:20:30.535668+0000","last_unstale":"2024-09-12T18:10:21.619107+0000","last_undegraded":"2024-09-12T18:10:21.619107+0000","last_fullsized":"2024-09-12T18:10:21.619107+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:31.430438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'13","reported_seq":92,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:11.618041+0000","last_change":"2024-09-12T17:16:11.484443+0000","last_active":"2024-09-12T18:10:11.618041+0000","last_peered":"2024-09-12T18:10:11.618041+0000","last_clean":"2024-09-12T18:10:11.618041+0000","last_became_active":"2024-09-12T17:16:11.484154+0000","last_became_peered":"2024-09-12T17:16:11.484154+0000","last_unstale":"2024-09-12T18:10:11.618041+0000","last_undegraded":"2024-09-12T18:10:11.618041+0000","last_fullsized":"2024-09-12T18:10:11.618041+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:54.824715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":37,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:42.759255+0000","last_change":"2024-09-12T17:39:05.928118+0000","last_active":"2024-09-12T18:10:42.759255+0000","last_peered":"2024-09-12T18:10:42.759255+0000","last_clean":"2024-09-12T18:10:42.759255+0000","last_became_active":"2024-09-12T17:39:05.927841+0000","last_became_peered":"2024-09-12T17:39:05.927841+0000","last_unstale":"2024-09-12T18:10:42.759255+0000","last_undegraded":"2024-09-12T18:10:42.759255+0000","last_fullsized":"2024-09-12T18:10:42.759255+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:37.026584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.756629+0000","last_change":"2024-09-12T17:20:34.611017+0000","last_active":"2024-09-12T18:10:27.756629+0000","last_peered":"2024-09-12T18:10:27.756629+0000","last_clean":"2024-09-12T18:10:27.756629+0000","last_became_active":"2024-09-12T17:20:34.610737+0000","last_became_peered":"2024-09-12T17:20:34.610737+0000","last_unstale":"2024-09-12T18:10:27.756629+0000","last_undegraded":"2024-09-12T18:10:27.756629+0000","last_fullsized":"2024-09-12T18:10:27.756629+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:07.818994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:23.917473+0000","last_change":"2024-09-12T17:20:30.529241+0000","last_active":"2024-09-12T18:10:23.917473+0000","last_peered":"2024-09-12T18:10:23.917473+0000","last_clean":"2024-09-12T18:10:23.917473+0000","last_became_active":"2024-09-12T17:20:30.528902+0000","last_became_peered":"2024-09-12T17:20:30.528902+0000","last_unstale":"2024-09-12T18:10:23.917473+0000","last_undegraded":"2024-09-12T18:10:23.917473+0000","last_fullsized":"2024-09-12T18:10:23.917473+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:59.483184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'31","reported_seq":148,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.757491+0000","last_change":"2024-09-12T17:16:11.489013+0000","last_active":"2024-09-12T18:10:32.757491+0000","last_peered":"2024-09-12T18:10:32.757491+0000","last_clean":"2024-09-12T18:10:32.757491+0000","last_became_active":"2024-09-12T17:16:11.488722+0000","last_became_peered":"2024-09-12T17:16:11.488722+0000","last_unstale":"2024-09-12T18:10:32.757491+0000","last_undegraded":"2024-09-12T18:10:32.757491+0000","last_fullsized":"2024-09-12T18:10:32.757491+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:19.504993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":116,"num_write":54,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.758386+0000","last_change":"2024-09-12T17:39:05.929421+0000","last_active":"2024-09-12T18:10:37.758386+0000","last_peered":"2024-09-12T18:10:37.758386+0000","last_clean":"2024-09-12T18:10:37.758386+0000","last_became_active":"2024-09-12T17:39:05.929156+0000","last_became_peered":"2024-09-12T17:39:05.929156+0000","last_unstale":"2024-09-12T18:10:37.758386+0000","last_undegraded":"2024-09-12T18:10:37.758386+0000","last_fullsized":"2024-09-12T18:10:37.758386+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:37.940351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:03.915183+0000","last_change":"2024-09-12T17:20:34.559128+0000","last_active":"2024-09-12T18:10:03.915183+0000","last_peered":"2024-09-12T18:10:03.915183+0000","last_clean":"2024-09-12T18:10:03.915183+0000","last_became_active":"2024-09-12T17:20:34.558826+0000","last_became_peered":"2024-09-12T17:20:34.558826+0000","last_unstale":"2024-09-12T18:10:03.915183+0000","last_undegraded":"2024-09-12T18:10:03.915183+0000","last_fullsized":"2024-09-12T18:10:03.915183+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:41.318428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.620862+0000","last_change":"2024-09-12T17:20:30.537479+0000","last_active":"2024-09-12T18:10:36.620862+0000","last_peered":"2024-09-12T18:10:36.620862+0000","last_clean":"2024-09-12T18:10:36.620862+0000","last_became_active":"2024-09-12T17:20:30.537204+0000","last_became_peered":"2024-09-12T17:20:30.537204+0000","last_unstale":"2024-09-12T18:10:36.620862+0000","last_undegraded":"2024-09-12T18:10:36.620862+0000","last_fullsized":"2024-09-12T18:10:36.620862+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:58.505650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'43","reported_seq":176,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.842925+0000","last_change":"2024-09-12T17:16:11.487416+0000","last_active":"2024-09-12T18:10:21.842925+0000","last_peered":"2024-09-12T18:10:21.842925+0000","last_clean":"2024-09-12T18:10:21.842925+0000","last_became_active":"2024-09-12T17:16:11.487129+0000","last_became_peered":"2024-09-12T17:16:11.487129+0000","last_unstale":"2024-09-12T18:10:21.842925+0000","last_undegraded":"2024-09-12T18:10:21.842925+0000","last_fullsized":"2024-09-12T18:10:21.842925+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:13.494114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":153,"num_write":79,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.620937+0000","last_change":"2024-09-12T17:39:05.926264+0000","last_active":"2024-09-12T18:10:36.620937+0000","last_peered":"2024-09-12T18:10:36.620937+0000","last_clean":"2024-09-12T18:10:36.620937+0000","last_became_active":"2024-09-12T17:39:05.925950+0000","last_became_peered":"2024-09-12T17:39:05.925950+0000","last_unstale":"2024-09-12T18:10:36.620937+0000","last_undegraded":"2024-09-12T18:10:36.620937+0000","last_fullsized":"2024-09-12T18:10:36.620937+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:25.942839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'3","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:47.778540+0000","last_change":"2024-09-12T17:20:34.555836+0000","last_active":"2024-09-12T18:12:47.778540+0000","last_peered":"2024-09-12T18:12:47.778540+0000","last_clean":"2024-09-12T18:12:47.778540+0000","last_became_active":"2024-09-12T17:20:34.555493+0000","last_became_peered":"2024-09-12T17:20:34.555493+0000","last_unstale":"2024-09-12T18:12:47.778540+0000","last_undegraded":"2024-09-12T18:12:47.778540+0000","last_fullsized":"2024-09-12T18:12:47.778540+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:04.010344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'4","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:15.770814+0000","last_change":"2024-09-12T17:20:30.534904+0000","last_active":"2024-09-12T18:12:15.770814+0000","last_peered":"2024-09-12T18:12:15.770814+0000","last_clean":"2024-09-12T18:12:15.770814+0000","last_became_active":"2024-09-12T17:20:30.534448+0000","last_became_peered":"2024-09-12T17:20:30.534448+0000","last_unstale":"2024-09-12T18:12:15.770814+0000","last_undegraded":"2024-09-12T18:12:15.770814+0000","last_fullsized":"2024-09-12T18:12:15.770814+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:56.106715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":4,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'9","reported_seq":87,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.742416+0000","last_change":"2024-09-12T17:16:11.488846+0000","last_active":"2024-09-12T18:10:22.742416+0000","last_peered":"2024-09-12T18:10:22.742416+0000","last_clean":"2024-09-12T18:10:22.742416+0000","last_became_active":"2024-09-12T17:16:11.488433+0000","last_became_peered":"2024-09-12T17:16:11.488433+0000","last_unstale":"2024-09-12T18:10:22.742416+0000","last_undegraded":"2024-09-12T18:10:22.742416+0000","last_fullsized":"2024-09-12T18:10:22.742416+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:14.398588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":34,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.755896+0000","last_change":"2024-09-12T17:39:05.927566+0000","last_active":"2024-09-12T18:10:22.755896+0000","last_peered":"2024-09-12T18:10:22.755896+0000","last_clean":"2024-09-12T18:10:22.755896+0000","last_became_active":"2024-09-12T17:39:05.925525+0000","last_became_peered":"2024-09-12T17:39:05.925525+0000","last_unstale":"2024-09-12T18:10:22.755896+0000","last_undegraded":"2024-09-12T18:10:22.755896+0000","last_fullsized":"2024-09-12T18:10:22.755896+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:27.269945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:56.637772+0000","last_change":"2024-09-12T17:20:34.559275+0000","last_active":"2024-09-12T18:12:56.637772+0000","last_peered":"2024-09-12T18:12:56.637772+0000","last_clean":"2024-09-12T18:12:56.637772+0000","last_became_active":"2024-09-12T17:20:34.558946+0000","last_became_peered":"2024-09-12T17:20:34.558946+0000","last_unstale":"2024-09-12T18:12:56.637772+0000","last_undegraded":"2024-09-12T18:12:56.637772+0000","last_fullsized":"2024-09-12T18:12:56.637772+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:44.945949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'4","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.757518+0000","last_change":"2024-09-12T17:20:30.528368+0000","last_active":"2024-09-12T18:10:32.757518+0000","last_peered":"2024-09-12T18:10:32.757518+0000","last_clean":"2024-09-12T18:10:32.757518+0000","last_became_active":"2024-09-12T17:20:30.528078+0000","last_became_peered":"2024-09-12T17:20:30.528078+0000","last_unstale":"2024-09-12T18:10:32.757518+0000","last_undegraded":"2024-09-12T18:10:32.757518+0000","last_fullsized":"2024-09-12T18:10:32.757518+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:37.188849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'44","reported_seq":182,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619260+0000","last_change":"2024-09-12T17:16:11.481733+0000","last_active":"2024-09-12T18:10:21.619260+0000","last_peered":"2024-09-12T18:10:21.619260+0000","last_clean":"2024-09-12T18:10:21.619260+0000","last_became_active":"2024-09-12T17:16:11.481431+0000","last_became_peered":"2024-09-12T17:16:11.481431+0000","last_unstale":"2024-09-12T18:10:21.619260+0000","last_undegraded":"2024-09-12T18:10:21.619260+0000","last_fullsized":"2024-09-12T18:10:21.619260+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:47.517502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":166,"num_write":69,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954425+0000","last_change":"2024-09-12T17:39:05.919499+0000","last_active":"2024-09-12T18:10:22.954425+0000","last_peered":"2024-09-12T18:10:22.954425+0000","last_clean":"2024-09-12T18:10:22.954425+0000","last_became_active":"2024-09-12T17:39:05.919207+0000","last_became_peered":"2024-09-12T17:39:05.919207+0000","last_unstale":"2024-09-12T18:10:22.954425+0000","last_undegraded":"2024-09-12T18:10:22.954425+0000","last_fullsized":"2024-09-12T18:10:22.954425+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:26.247547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'10","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.517672+0000","last_change":"2024-09-12T17:20:34.613162+0000","last_active":"2024-09-12T18:13:48.517672+0000","last_peered":"2024-09-12T18:13:48.517672+0000","last_clean":"2024-09-12T18:13:48.517672+0000","last_became_active":"2024-09-12T17:20:34.612840+0000","last_became_peered":"2024-09-12T17:20:34.612840+0000","last_unstale":"2024-09-12T18:13:48.517672+0000","last_undegraded":"2024-09-12T18:13:48.517672+0000","last_fullsized":"2024-09-12T18:13:48.517672+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:07.359408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":10,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:43.700925+0000","last_change":"2024-09-12T17:20:30.539195+0000","last_active":"2024-09-12T18:10:43.700925+0000","last_peered":"2024-09-12T18:10:43.700925+0000","last_clean":"2024-09-12T18:10:43.700925+0000","last_became_active":"2024-09-12T17:20:30.538913+0000","last_became_peered":"2024-09-12T17:20:30.538913+0000","last_unstale":"2024-09-12T18:10:43.700925+0000","last_undegraded":"2024-09-12T18:10:43.700925+0000","last_fullsized":"2024-09-12T18:10:43.700925+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:30.309214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'103","reported_seq":385,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.742516+0000","last_change":"2024-09-12T17:16:11.489384+0000","last_active":"2024-09-12T18:10:22.742516+0000","last_peered":"2024-09-12T18:10:22.742516+0000","last_clean":"2024-09-12T18:10:22.742516+0000","last_became_active":"2024-09-12T17:16:11.489087+0000","last_became_peered":"2024-09-12T17:16:11.489087+0000","last_unstale":"2024-09-12T18:10:22.742516+0000","last_undegraded":"2024-09-12T18:10:22.742516+0000","last_fullsized":"2024-09-12T18:10:22.742516+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:44.577138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":629,"num_read_kb":433,"num_write":144,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.922659+0000","last_change":"2024-09-12T17:39:05.921957+0000","last_active":"2024-09-12T18:11:13.922659+0000","last_peered":"2024-09-12T18:11:13.922659+0000","last_clean":"2024-09-12T18:11:13.922659+0000","last_became_active":"2024-09-12T17:39:05.921608+0000","last_became_peered":"2024-09-12T17:39:05.921608+0000","last_unstale":"2024-09-12T18:11:13.922659+0000","last_undegraded":"2024-09-12T18:11:13.922659+0000","last_fullsized":"2024-09-12T18:11:13.922659+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:54.960277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.756818+0000","last_change":"2024-09-12T17:20:34.611054+0000","last_active":"2024-09-12T18:10:27.756818+0000","last_peered":"2024-09-12T18:10:27.756818+0000","last_clean":"2024-09-12T18:10:27.756818+0000","last_became_active":"2024-09-12T17:20:34.610719+0000","last_became_peered":"2024-09-12T17:20:34.610719+0000","last_unstale":"2024-09-12T18:10:27.756818+0000","last_undegraded":"2024-09-12T18:10:27.756818+0000","last_fullsized":"2024-09-12T18:10:27.756818+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:24.284192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954530+0000","last_change":"2024-09-12T17:20:30.535657+0000","last_active":"2024-09-12T18:10:22.954530+0000","last_peered":"2024-09-12T18:10:22.954530+0000","last_clean":"2024-09-12T18:10:22.954530+0000","last_became_active":"2024-09-12T17:20:30.535382+0000","last_became_peered":"2024-09-12T17:20:30.535382+0000","last_unstale":"2024-09-12T18:10:22.954530+0000","last_undegraded":"2024-09-12T18:10:22.954530+0000","last_fullsized":"2024-09-12T18:10:22.954530+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:06.602123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'27","reported_seq":132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.757540+0000","last_change":"2024-09-12T17:16:11.487072+0000","last_active":"2024-09-12T18:10:32.757540+0000","last_peered":"2024-09-12T18:10:32.757540+0000","last_clean":"2024-09-12T18:10:32.757540+0000","last_became_active":"2024-09-12T17:16:11.486799+0000","last_became_peered":"2024-09-12T17:16:11.486799+0000","last_unstale":"2024-09-12T18:10:32.757540+0000","last_undegraded":"2024-09-12T18:10:32.757540+0000","last_fullsized":"2024-09-12T18:10:32.757540+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:25.256158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":89,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.753105+0000","last_change":"2024-09-12T17:39:05.923468+0000","last_active":"2024-09-12T18:10:20.753105+0000","last_peered":"2024-09-12T18:10:20.753105+0000","last_clean":"2024-09-12T18:10:20.753105+0000","last_became_active":"2024-09-12T17:39:05.923192+0000","last_became_peered":"2024-09-12T17:39:05.923192+0000","last_unstale":"2024-09-12T18:10:20.753105+0000","last_undegraded":"2024-09-12T18:10:20.753105+0000","last_fullsized":"2024-09-12T18:10:20.753105+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:18.451237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'4","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.514438+0000","last_change":"2024-09-12T17:20:34.555545+0000","last_active":"2024-09-12T18:13:48.514438+0000","last_peered":"2024-09-12T18:13:48.514438+0000","last_clean":"2024-09-12T18:13:48.514438+0000","last_became_active":"2024-09-12T17:20:34.555267+0000","last_became_peered":"2024-09-12T17:20:34.555267+0000","last_unstale":"2024-09-12T18:13:48.514438+0000","last_undegraded":"2024-09-12T18:13:48.514438+0000","last_fullsized":"2024-09-12T18:13:48.514438+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:48.447926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'4","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:32.776088+0000","last_change":"2024-09-12T17:20:30.531341+0000","last_active":"2024-09-12T18:12:32.776088+0000","last_peered":"2024-09-12T18:12:32.776088+0000","last_clean":"2024-09-12T18:12:32.776088+0000","last_became_active":"2024-09-12T17:20:30.530998+0000","last_became_peered":"2024-09-12T17:20:30.530998+0000","last_unstale":"2024-09-12T18:12:32.776088+0000","last_undegraded":"2024-09-12T18:12:32.776088+0000","last_fullsized":"2024-09-12T18:12:32.776088+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:28.087866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'20","reported_seq":119,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:23.917537+0000","last_change":"2024-09-12T17:16:11.487744+0000","last_active":"2024-09-12T18:10:23.917537+0000","last_peered":"2024-09-12T18:10:23.917537+0000","last_clean":"2024-09-12T18:10:23.917537+0000","last_became_active":"2024-09-12T17:16:11.487439+0000","last_became_peered":"2024-09-12T17:16:11.487439+0000","last_unstale":"2024-09-12T18:10:23.917537+0000","last_undegraded":"2024-09-12T18:10:23.917537+0000","last_fullsized":"2024-09-12T18:10:23.917537+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:01.381415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":36,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:38.706396+0000","last_change":"2024-09-12T17:39:05.923711+0000","last_active":"2024-09-12T18:11:38.706396+0000","last_peered":"2024-09-12T18:11:38.706396+0000","last_clean":"2024-09-12T18:11:38.706396+0000","last_became_active":"2024-09-12T17:39:05.923420+0000","last_became_peered":"2024-09-12T17:39:05.923420+0000","last_unstale":"2024-09-12T18:11:38.706396+0000","last_undegraded":"2024-09-12T18:11:38.706396+0000","last_fullsized":"2024-09-12T18:11:38.706396+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:30.324051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'5","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:38.934756+0000","last_change":"2024-09-12T17:20:34.558121+0000","last_active":"2024-09-12T18:12:38.934756+0000","last_peered":"2024-09-12T18:12:38.934756+0000","last_clean":"2024-09-12T18:12:38.934756+0000","last_became_active":"2024-09-12T17:20:34.557794+0000","last_became_peered":"2024-09-12T17:20:34.557794+0000","last_unstale":"2024-09-12T18:12:38.934756+0000","last_undegraded":"2024-09-12T18:12:38.934756+0000","last_fullsized":"2024-09-12T18:12:38.934756+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:35.789851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'8","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.351546+0000","last_change":"2024-09-12T17:20:30.538275+0000","last_active":"2024-09-12T18:13:49.351546+0000","last_peered":"2024-09-12T18:13:49.351546+0000","last_clean":"2024-09-12T18:13:49.351546+0000","last_became_active":"2024-09-12T17:20:30.537970+0000","last_became_peered":"2024-09-12T17:20:30.537970+0000","last_unstale":"2024-09-12T18:13:49.351546+0000","last_undegraded":"2024-09-12T18:13:49.351546+0000","last_fullsized":"2024-09-12T18:13:49.351546+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:25.105193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":19458,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'24","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954441+0000","last_change":"2024-09-12T17:16:11.487378+0000","last_active":"2024-09-12T18:10:22.954441+0000","last_peered":"2024-09-12T18:10:22.954441+0000","last_clean":"2024-09-12T18:10:22.954441+0000","last_became_active":"2024-09-12T17:16:11.486298+0000","last_became_peered":"2024-09-12T17:16:11.486298+0000","last_unstale":"2024-09-12T18:10:22.954441+0000","last_undegraded":"2024-09-12T18:10:22.954441+0000","last_fullsized":"2024-09-12T18:10:22.954441+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:22.173224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:36.627544+0000","last_change":"2024-09-12T17:39:05.921428+0000","last_active":"2024-09-12T18:11:36.627544+0000","last_peered":"2024-09-12T18:11:36.627544+0000","last_clean":"2024-09-12T18:11:36.627544+0000","last_became_active":"2024-09-12T17:39:05.921085+0000","last_became_peered":"2024-09-12T17:39:05.921085+0000","last_unstale":"2024-09-12T18:11:36.627544+0000","last_undegraded":"2024-09-12T18:11:36.627544+0000","last_fullsized":"2024-09-12T18:11:36.627544+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:12.796863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'6","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.515124+0000","last_change":"2024-09-12T17:20:34.559242+0000","last_active":"2024-09-12T18:13:48.515124+0000","last_peered":"2024-09-12T18:13:48.515124+0000","last_clean":"2024-09-12T18:13:48.515124+0000","last_became_active":"2024-09-12T17:20:34.558963+0000","last_became_peered":"2024-09-12T17:20:34.558963+0000","last_unstale":"2024-09-12T18:13:48.515124+0000","last_undegraded":"2024-09-12T18:13:48.515124+0000","last_fullsized":"2024-09-12T18:13:48.515124+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:24.912978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.757457+0000","last_change":"2024-09-12T17:20:30.524694+0000","last_active":"2024-09-12T18:10:32.757457+0000","last_peered":"2024-09-12T18:10:32.757457+0000","last_clean":"2024-09-12T18:10:32.757457+0000","last_became_active":"2024-09-12T17:20:30.524377+0000","last_became_peered":"2024-09-12T17:20:30.524377+0000","last_unstale":"2024-09-12T18:10:32.757457+0000","last_undegraded":"2024-09-12T18:10:32.757457+0000","last_fullsized":"2024-09-12T18:10:32.757457+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:30.709529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'59","reported_seq":225,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.753135+0000","last_change":"2024-09-12T17:16:11.491864+0000","last_active":"2024-09-12T18:10:20.753135+0000","last_peered":"2024-09-12T18:10:20.753135+0000","last_clean":"2024-09-12T18:10:20.753135+0000","last_became_active":"2024-09-12T17:16:11.491512+0000","last_became_peered":"2024-09-12T17:16:11.491512+0000","last_unstale":"2024-09-12T18:10:20.753135+0000","last_undegraded":"2024-09-12T18:10:20.753135+0000","last_fullsized":"2024-09-12T18:10:20.753135+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:58.986968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":313,"num_read_kb":225,"num_write":101,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619193+0000","last_change":"2024-09-12T17:39:05.926334+0000","last_active":"2024-09-12T18:10:21.619193+0000","last_peered":"2024-09-12T18:10:21.619193+0000","last_clean":"2024-09-12T18:10:21.619193+0000","last_became_active":"2024-09-12T17:39:05.926029+0000","last_became_peered":"2024-09-12T17:39:05.926029+0000","last_unstale":"2024-09-12T18:10:21.619193+0000","last_undegraded":"2024-09-12T18:10:21.619193+0000","last_fullsized":"2024-09-12T18:10:21.619193+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:44.569050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"261'2","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.744693+0000","last_change":"2024-09-12T17:20:34.555632+0000","last_active":"2024-09-12T18:10:37.744693+0000","last_peered":"2024-09-12T18:10:37.744693+0000","last_clean":"2024-09-12T18:10:37.744693+0000","last_became_active":"2024-09-12T17:20:34.555137+0000","last_became_peered":"2024-09-12T17:20:34.555137+0000","last_unstale":"2024-09-12T18:10:37.744693+0000","last_undegraded":"2024-09-12T18:10:37.744693+0000","last_fullsized":"2024-09-12T18:10:37.744693+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:44.659171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'2","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:38.934811+0000","last_change":"2024-09-12T17:20:30.531528+0000","last_active":"2024-09-12T18:12:38.934811+0000","last_peered":"2024-09-12T18:12:38.934811+0000","last_clean":"2024-09-12T18:12:38.934811+0000","last_became_active":"2024-09-12T17:20:30.531232+0000","last_became_peered":"2024-09-12T17:20:30.531232+0000","last_unstale":"2024-09-12T18:12:38.934811+0000","last_undegraded":"2024-09-12T18:12:38.934811+0000","last_fullsized":"2024-09-12T18:12:38.934811+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:17.702865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'13","reported_seq":98,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.742450+0000","last_change":"2024-09-12T17:16:11.491691+0000","last_active":"2024-09-12T18:10:22.742450+0000","last_peered":"2024-09-12T18:10:22.742450+0000","last_clean":"2024-09-12T18:10:22.742450+0000","last_became_active":"2024-09-12T17:16:11.491334+0000","last_became_peered":"2024-09-12T17:16:11.491334+0000","last_unstale":"2024-09-12T18:10:22.742450+0000","last_undegraded":"2024-09-12T18:10:22.742450+0000","last_fullsized":"2024-09-12T18:10:22.742450+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:26.856534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":49,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.756721+0000","last_change":"2024-09-12T17:39:05.930558+0000","last_active":"2024-09-12T18:10:27.756721+0000","last_peered":"2024-09-12T18:10:27.756721+0000","last_clean":"2024-09-12T18:10:27.756721+0000","last_became_active":"2024-09-12T17:39:05.930326+0000","last_became_peered":"2024-09-12T17:39:05.930326+0000","last_unstale":"2024-09-12T18:10:27.756721+0000","last_undegraded":"2024-09-12T18:10:27.756721+0000","last_fullsized":"2024-09-12T18:10:27.756721+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:01.120642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'6","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:40.774570+0000","last_change":"2024-09-12T17:20:34.556804+0000","last_active":"2024-09-12T18:12:40.774570+0000","last_peered":"2024-09-12T18:12:40.774570+0000","last_clean":"2024-09-12T18:12:40.774570+0000","last_became_active":"2024-09-12T17:20:34.554832+0000","last_became_peered":"2024-09-12T17:20:34.554832+0000","last_unstale":"2024-09-12T18:12:40.774570+0000","last_undegraded":"2024-09-12T18:12:40.774570+0000","last_fullsized":"2024-09-12T18:12:40.774570+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:59.545466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'4","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.360460+0000","last_change":"2024-09-12T17:20:30.528814+0000","last_active":"2024-09-12T18:13:48.360460+0000","last_peered":"2024-09-12T18:13:48.360460+0000","last_clean":"2024-09-12T18:13:48.360460+0000","last_became_active":"2024-09-12T17:20:30.528541+0000","last_became_peered":"2024-09-12T17:20:30.528541+0000","last_unstale":"2024-09-12T18:13:48.360460+0000","last_undegraded":"2024-09-12T18:13:48.360460+0000","last_fullsized":"2024-09-12T18:13:48.360460+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:39.437987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'21","reported_seq":117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.755820+0000","last_change":"2024-09-12T17:16:11.487563+0000","last_active":"2024-09-12T18:10:22.755820+0000","last_peered":"2024-09-12T18:10:22.755820+0000","last_clean":"2024-09-12T18:10:22.755820+0000","last_became_active":"2024-09-12T17:16:11.487238+0000","last_became_peered":"2024-09-12T17:16:11.487238+0000","last_unstale":"2024-09-12T18:10:22.755820+0000","last_undegraded":"2024-09-12T18:10:22.755820+0000","last_fullsized":"2024-09-12T18:10:22.755820+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:39.870434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":71,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'378","reported_seq":1023,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.165354+0000","last_change":"2024-09-12T18:14:11.165354+0000","last_active":"2024-09-12T18:14:11.165354+0000","last_peered":"2024-09-12T18:14:11.165354+0000","last_clean":"2024-09-12T18:14:11.165354+0000","last_became_active":"2024-09-12T17:00:12.304074+0000","last_became_peered":"2024-09-12T17:00:12.304074+0000","last_unstale":"2024-09-12T18:14:11.165354+0000","last_undegraded":"2024-09-12T18:14:11.165354+0000","last_fullsized":"2024-09-12T18:14:11.165354+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'378","last_scrub_stamp":"2024-09-12T18:14:11.165222+0000","last_deep_scrub":"264'378","last_deep_scrub_stamp":"2024-09-12T18:14:11.165222+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.165222+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:54.479677+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":637523,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":542,"num_read_kb":3821,"num_write":1162,"num_write_kb":12701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'137","reported_seq":747,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.953601+0000","last_change":"2024-09-12T17:00:14.328728+0000","last_active":"2024-09-12T18:10:17.953601+0000","last_peered":"2024-09-12T18:10:17.953601+0000","last_clean":"2024-09-12T18:10:17.953601+0000","last_became_active":"2024-09-12T17:00:14.328464+0000","last_became_peered":"2024-09-12T17:00:14.328464+0000","last_unstale":"2024-09-12T18:10:17.953601+0000","last_undegraded":"2024-09-12T18:10:17.953601+0000","last_fullsized":"2024-09-12T18:10:17.953601+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:22.736868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":594,"num_read_kb":496,"num_write":221,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'326","reported_seq":968,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.050905+0000","last_change":"2024-09-12T18:14:02.050905+0000","last_active":"2024-09-12T18:14:02.050905+0000","last_peered":"2024-09-12T18:14:02.050905+0000","last_clean":"2024-09-12T18:14:02.050905+0000","last_became_active":"2024-09-12T17:00:12.302750+0000","last_became_peered":"2024-09-12T17:00:12.302750+0000","last_unstale":"2024-09-12T18:14:02.050905+0000","last_undegraded":"2024-09-12T18:14:02.050905+0000","last_fullsized":"2024-09-12T18:14:02.050905+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-12T18:14:02.050783+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-12T18:14:02.050783+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.050783+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:42.750663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":423,"num_read_kb":57739,"num_write":1027,"num_write_kb":55497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'222","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:21.909979+0000","last_change":"2024-09-12T17:00:14.336471+0000","last_active":"2024-09-12T18:13:21.909979+0000","last_peered":"2024-09-12T18:13:21.909979+0000","last_clean":"2024-09-12T18:13:21.909979+0000","last_became_active":"2024-09-12T17:00:14.336238+0000","last_became_peered":"2024-09-12T17:00:14.336238+0000","last_unstale":"2024-09-12T18:13:21.909979+0000","last_undegraded":"2024-09-12T18:13:21.909979+0000","last_fullsized":"2024-09-12T18:13:21.909979+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:33.594656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":973,"num_read_kb":793,"num_write":333,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'344","reported_seq":1017,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.017303+0000","last_change":"2024-09-12T18:14:02.017303+0000","last_active":"2024-09-12T18:14:02.017303+0000","last_peered":"2024-09-12T18:14:02.017303+0000","last_clean":"2024-09-12T18:14:02.017303+0000","last_became_active":"2024-09-12T17:00:12.309132+0000","last_became_peered":"2024-09-12T17:00:12.309132+0000","last_unstale":"2024-09-12T18:14:02.017303+0000","last_undegraded":"2024-09-12T18:14:02.017303+0000","last_fullsized":"2024-09-12T18:14:02.017303+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'344","last_scrub_stamp":"2024-09-12T18:14:02.017215+0000","last_deep_scrub":"264'344","last_deep_scrub_stamp":"2024-09-12T18:14:02.017215+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.017215+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:38.479748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":529,"num_read_kb":32498,"num_write":1132,"num_write_kb":31975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'256","reported_seq":887,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:14.837837+0000","last_change":"2024-09-12T18:14:14.837837+0000","last_active":"2024-09-12T18:14:14.837837+0000","last_peered":"2024-09-12T18:14:14.837837+0000","last_clean":"2024-09-12T18:14:14.837837+0000","last_became_active":"2024-09-12T17:00:14.323358+0000","last_became_peered":"2024-09-12T17:00:14.323358+0000","last_unstale":"2024-09-12T18:14:14.837837+0000","last_undegraded":"2024-09-12T18:14:14.837837+0000","last_fullsized":"2024-09-12T18:14:14.837837+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'256","last_scrub_stamp":"2024-09-12T18:14:14.837731+0000","last_deep_scrub":"264'256","last_deep_scrub_stamp":"2024-09-12T18:14:14.837731+0000","last_clean_scrub_stamp":"2024-09-12T18:14:14.837731+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:31.651864+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1058,"num_read_kb":862,"num_write":363,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":938,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'313","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.579151+0000","last_change":"2024-09-12T18:14:09.579151+0000","last_active":"2024-09-12T18:14:09.579151+0000","last_peered":"2024-09-12T18:14:09.579151+0000","last_clean":"2024-09-12T18:14:09.579151+0000","last_became_active":"2024-09-12T17:00:12.320515+0000","last_became_peered":"2024-09-12T17:00:12.320515+0000","last_unstale":"2024-09-12T18:14:09.579151+0000","last_undegraded":"2024-09-12T18:14:09.579151+0000","last_fullsized":"2024-09-12T18:14:09.579151+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'313","last_scrub_stamp":"2024-09-12T18:14:09.579047+0000","last_deep_scrub":"264'313","last_deep_scrub_stamp":"2024-09-12T18:14:09.579047+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.579047+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:04.911796+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1784539,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":432,"num_read_kb":6790,"num_write":998,"num_write_kb":19852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'120","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:24.988567+0000","last_change":"2024-09-12T17:00:14.335557+0000","last_active":"2024-09-12T18:10:24.988567+0000","last_peered":"2024-09-12T18:10:24.988567+0000","last_clean":"2024-09-12T18:10:24.988567+0000","last_became_active":"2024-09-12T17:00:14.335297+0000","last_became_peered":"2024-09-12T17:00:14.335297+0000","last_unstale":"2024-09-12T18:10:24.988567+0000","last_undegraded":"2024-09-12T18:10:24.988567+0000","last_fullsized":"2024-09-12T18:10:24.988567+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:16.622130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":395,"num_write":174,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'333","reported_seq":977,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.237214+0000","last_change":"2024-09-12T18:14:09.237214+0000","last_active":"2024-09-12T18:14:09.237214+0000","last_peered":"2024-09-12T18:14:09.237214+0000","last_clean":"2024-09-12T18:14:09.237214+0000","last_became_active":"2024-09-12T17:00:12.312762+0000","last_became_peered":"2024-09-12T17:00:12.312762+0000","last_unstale":"2024-09-12T18:14:09.237214+0000","last_undegraded":"2024-09-12T18:14:09.237214+0000","last_fullsized":"2024-09-12T18:14:09.237214+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'333","last_scrub_stamp":"2024-09-12T18:14:09.237040+0000","last_deep_scrub":"264'333","last_deep_scrub_stamp":"2024-09-12T18:14:09.237040+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.237040+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:39.532704+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4593537,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":487,"num_read_kb":9220,"num_write":1043,"num_write_kb":31558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'219","reported_seq":891,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.103167+0000","last_change":"2024-09-12T18:14:10.103167+0000","last_active":"2024-09-12T18:14:10.103167+0000","last_peered":"2024-09-12T18:14:10.103167+0000","last_clean":"2024-09-12T18:14:10.103167+0000","last_became_active":"2024-09-12T17:00:14.321640+0000","last_became_peered":"2024-09-12T17:00:14.321640+0000","last_unstale":"2024-09-12T18:14:10.103167+0000","last_undegraded":"2024-09-12T18:14:10.103167+0000","last_fullsized":"2024-09-12T18:14:10.103167+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'219","last_scrub_stamp":"2024-09-12T18:14:10.103080+0000","last_deep_scrub":"264'219","last_deep_scrub_stamp":"2024-09-12T18:14:10.103080+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.103080+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:24.808735+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1016,"num_read_kb":865,"num_write":355,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'370","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.554790+0000","last_change":"2024-09-12T18:14:06.554790+0000","last_active":"2024-09-12T18:14:06.554790+0000","last_peered":"2024-09-12T18:14:06.554790+0000","last_clean":"2024-09-12T18:14:06.554790+0000","last_became_active":"2024-09-12T17:00:12.319917+0000","last_became_peered":"2024-09-12T17:00:12.319917+0000","last_unstale":"2024-09-12T18:14:06.554790+0000","last_undegraded":"2024-09-12T18:14:06.554790+0000","last_fullsized":"2024-09-12T18:14:06.554790+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'370","last_scrub_stamp":"2024-09-12T18:14:06.554684+0000","last_deep_scrub":"264'370","last_deep_scrub_stamp":"2024-09-12T18:14:06.554684+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.554684+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:37.956148+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432807,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":38218,"num_write":1060,"num_write_kb":26572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'175","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:05.760285+0000","last_change":"2024-09-12T17:00:14.333352+0000","last_active":"2024-09-12T18:11:05.760285+0000","last_peered":"2024-09-12T18:11:05.760285+0000","last_clean":"2024-09-12T18:11:05.760285+0000","last_became_active":"2024-09-12T17:00:14.332940+0000","last_became_peered":"2024-09-12T17:00:14.332940+0000","last_unstale":"2024-09-12T18:11:05.760285+0000","last_undegraded":"2024-09-12T18:11:05.760285+0000","last_fullsized":"2024-09-12T18:11:05.760285+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:50.722062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":715,"num_read_kb":606,"num_write":241,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'326","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.241830+0000","last_change":"2024-09-12T18:14:08.241830+0000","last_active":"2024-09-12T18:14:08.241830+0000","last_peered":"2024-09-12T18:14:08.241830+0000","last_clean":"2024-09-12T18:14:08.241830+0000","last_became_active":"2024-09-12T17:00:12.304504+0000","last_became_peered":"2024-09-12T17:00:12.304504+0000","last_unstale":"2024-09-12T18:14:08.241830+0000","last_undegraded":"2024-09-12T18:14:08.241830+0000","last_fullsized":"2024-09-12T18:14:08.241830+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-12T18:14:08.241703+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-12T18:14:08.241703+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.241703+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:13.525047+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1691575,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":533,"num_read_kb":24452,"num_write":1091,"num_write_kb":21520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'176","reported_seq":772,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.961391+0000","last_change":"2024-09-12T17:00:14.332604+0000","last_active":"2024-09-12T18:11:07.961391+0000","last_peered":"2024-09-12T18:11:07.961391+0000","last_clean":"2024-09-12T18:11:07.961391+0000","last_became_active":"2024-09-12T17:00:14.332360+0000","last_became_peered":"2024-09-12T17:00:14.332360+0000","last_unstale":"2024-09-12T18:11:07.961391+0000","last_undegraded":"2024-09-12T18:11:07.961391+0000","last_fullsized":"2024-09-12T18:11:07.961391+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:55.182932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":738,"num_read_kb":599,"num_write":278,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'372","reported_seq":1085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.002649+0000","last_change":"2024-09-12T18:14:04.002649+0000","last_active":"2024-09-12T18:14:04.002649+0000","last_peered":"2024-09-12T18:14:04.002649+0000","last_clean":"2024-09-12T18:14:04.002649+0000","last_became_active":"2024-09-12T17:00:12.322419+0000","last_became_peered":"2024-09-12T17:00:12.322419+0000","last_unstale":"2024-09-12T18:14:04.002649+0000","last_undegraded":"2024-09-12T18:14:04.002649+0000","last_fullsized":"2024-09-12T18:14:04.002649+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-12T18:14:04.002546+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-12T18:14:04.002546+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.002546+0000","objects_scrubbed":9,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:39.056847+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786486,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":661,"num_read_kb":7776,"num_write":1130,"num_write_kb":24985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'60","reported_seq":626,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.168328+0000","last_change":"2024-09-12T18:14:09.168328+0000","last_active":"2024-09-12T18:14:09.168328+0000","last_peered":"2024-09-12T18:14:09.168328+0000","last_clean":"2024-09-12T18:14:09.168328+0000","last_became_active":"2024-09-12T17:00:14.334586+0000","last_became_peered":"2024-09-12T17:00:14.334586+0000","last_unstale":"2024-09-12T18:14:09.168328+0000","last_undegraded":"2024-09-12T18:14:09.168328+0000","last_fullsized":"2024-09-12T18:14:09.168328+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'60","last_scrub_stamp":"2024-09-12T18:14:09.168221+0000","last_deep_scrub":"264'60","last_deep_scrub_stamp":"2024-09-12T18:14:09.168221+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.168221+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:35.472486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":225,"num_write":86,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'142","reported_seq":773,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.785983+0000","last_change":"2024-09-12T18:14:13.785983+0000","last_active":"2024-09-12T18:14:13.785983+0000","last_peered":"2024-09-12T18:14:13.785983+0000","last_clean":"2024-09-12T18:14:13.785983+0000","last_became_active":"2024-09-12T17:00:14.322771+0000","last_became_peered":"2024-09-12T17:00:14.322771+0000","last_unstale":"2024-09-12T18:14:13.785983+0000","last_undegraded":"2024-09-12T18:14:13.785983+0000","last_fullsized":"2024-09-12T18:14:13.785983+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-12T18:14:13.785902+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-12T18:14:13.785902+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.785902+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:49.161921+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":650,"num_read_kb":543,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'382","reported_seq":1148,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.206812+0000","last_change":"2024-09-12T18:14:07.206812+0000","last_active":"2024-09-12T18:14:07.206812+0000","last_peered":"2024-09-12T18:14:07.206812+0000","last_clean":"2024-09-12T18:14:07.206812+0000","last_became_active":"2024-09-12T17:00:46.406911+0000","last_became_peered":"2024-09-12T17:00:46.406911+0000","last_unstale":"2024-09-12T18:14:07.206812+0000","last_undegraded":"2024-09-12T18:14:07.206812+0000","last_fullsized":"2024-09-12T18:14:07.206812+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'382","last_scrub_stamp":"2024-09-12T18:14:07.206704+0000","last_deep_scrub":"264'382","last_deep_scrub_stamp":"2024-09-12T18:14:07.206704+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.206704+0000","objects_scrubbed":8,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:11.551940+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029268,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":749,"num_read_kb":51923,"num_write":1318,"num_write_kb":31895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'117","reported_seq":724,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.755079+0000","last_change":"2024-09-12T17:00:14.336399+0000","last_active":"2024-09-12T18:10:17.755079+0000","last_peered":"2024-09-12T18:10:17.755079+0000","last_clean":"2024-09-12T18:10:17.755079+0000","last_became_active":"2024-09-12T17:00:14.336161+0000","last_became_peered":"2024-09-12T17:00:14.336161+0000","last_unstale":"2024-09-12T18:10:17.755079+0000","last_undegraded":"2024-09-12T18:10:17.755079+0000","last_fullsized":"2024-09-12T18:10:17.755079+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:57.473607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":545,"num_read_kb":462,"num_write":195,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'338","reported_seq":1032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.047468+0000","last_change":"2024-09-12T18:14:05.047468+0000","last_active":"2024-09-12T18:14:05.047468+0000","last_peered":"2024-09-12T18:14:05.047468+0000","last_clean":"2024-09-12T18:14:05.047468+0000","last_became_active":"2024-09-12T17:00:12.310589+0000","last_became_peered":"2024-09-12T17:00:12.310589+0000","last_unstale":"2024-09-12T18:14:05.047468+0000","last_undegraded":"2024-09-12T18:14:05.047468+0000","last_fullsized":"2024-09-12T18:14:05.047468+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'338","last_scrub_stamp":"2024-09-12T18:14:05.047367+0000","last_deep_scrub":"264'338","last_deep_scrub_stamp":"2024-09-12T18:14:05.047367+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.047367+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:13.046999+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":594,"num_read_kb":8321,"num_write":1002,"num_write_kb":31830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'144","reported_seq":725,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.964476+0000","last_change":"2024-09-12T17:00:14.325153+0000","last_active":"2024-09-12T18:12:02.964476+0000","last_peered":"2024-09-12T18:12:02.964476+0000","last_clean":"2024-09-12T18:12:02.964476+0000","last_became_active":"2024-09-12T17:00:14.324889+0000","last_became_peered":"2024-09-12T17:00:14.324889+0000","last_unstale":"2024-09-12T18:12:02.964476+0000","last_undegraded":"2024-09-12T18:12:02.964476+0000","last_fullsized":"2024-09-12T18:12:02.964476+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:11.915771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":586,"num_read_kb":478,"num_write":211,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'340","reported_seq":977,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.055592+0000","last_change":"2024-09-12T18:14:02.055592+0000","last_active":"2024-09-12T18:14:02.055592+0000","last_peered":"2024-09-12T18:14:02.055592+0000","last_clean":"2024-09-12T18:14:02.055592+0000","last_became_active":"2024-09-12T17:00:12.315652+0000","last_became_peered":"2024-09-12T17:00:12.315652+0000","last_unstale":"2024-09-12T18:14:02.055592+0000","last_undegraded":"2024-09-12T18:14:02.055592+0000","last_fullsized":"2024-09-12T18:14:02.055592+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'340","last_scrub_stamp":"2024-09-12T18:14:02.055446+0000","last_deep_scrub":"264'340","last_deep_scrub_stamp":"2024-09-12T18:14:02.055446+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.055446+0000","objects_scrubbed":8,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:28.138157+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":305880,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":503,"num_read_kb":21524,"num_write":1088,"num_write_kb":35144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'78","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.064701+0000","last_change":"2024-09-12T18:14:02.064701+0000","last_active":"2024-09-12T18:14:02.064701+0000","last_peered":"2024-09-12T18:14:02.064701+0000","last_clean":"2024-09-12T18:14:02.064701+0000","last_became_active":"2024-09-12T17:00:14.335009+0000","last_became_peered":"2024-09-12T17:00:14.335009+0000","last_unstale":"2024-09-12T18:14:02.064701+0000","last_undegraded":"2024-09-12T18:14:02.064701+0000","last_fullsized":"2024-09-12T18:14:02.064701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'78","last_scrub_stamp":"2024-09-12T18:14:02.064622+0000","last_deep_scrub":"264'78","last_deep_scrub_stamp":"2024-09-12T18:14:02.064622+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.064622+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:00.192294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":353,"num_read_kb":297,"num_write":121,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'359","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.824638+0000","last_change":"2024-09-12T18:14:00.824638+0000","last_active":"2024-09-12T18:14:00.824638+0000","last_peered":"2024-09-12T18:14:00.824638+0000","last_clean":"2024-09-12T18:14:00.824638+0000","last_became_active":"2024-09-12T17:00:12.312828+0000","last_became_peered":"2024-09-12T17:00:12.312828+0000","last_unstale":"2024-09-12T18:14:00.824638+0000","last_undegraded":"2024-09-12T18:14:00.824638+0000","last_fullsized":"2024-09-12T18:14:00.824638+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'359","last_scrub_stamp":"2024-09-12T18:14:00.824537+0000","last_deep_scrub":"264'359","last_deep_scrub_stamp":"2024-09-12T18:14:00.824537+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.824537+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:37.459215+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850167,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":541,"num_read_kb":47220,"num_write":1168,"num_write_kb":32154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'190","reported_seq":838,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.125836+0000","last_change":"2024-09-12T18:14:05.125836+0000","last_active":"2024-09-12T18:14:05.125836+0000","last_peered":"2024-09-12T18:14:05.125836+0000","last_clean":"2024-09-12T18:14:05.125836+0000","last_became_active":"2024-09-12T17:00:14.327744+0000","last_became_peered":"2024-09-12T17:00:14.327744+0000","last_unstale":"2024-09-12T18:14:05.125836+0000","last_undegraded":"2024-09-12T18:14:05.125836+0000","last_fullsized":"2024-09-12T18:14:05.125836+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-09-12T18:14:05.125736+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-09-12T18:14:05.125736+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.125736+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:47.673107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":833,"num_read_kb":695,"num_write":274,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'317","reported_seq":1108,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.929610+0000","last_change":"2024-09-12T18:14:06.929610+0000","last_active":"2024-09-12T18:14:06.929610+0000","last_peered":"2024-09-12T18:14:06.929610+0000","last_clean":"2024-09-12T18:14:06.929610+0000","last_became_active":"2024-09-12T17:00:12.319649+0000","last_became_peered":"2024-09-12T17:00:12.319649+0000","last_unstale":"2024-09-12T18:14:06.929610+0000","last_undegraded":"2024-09-12T18:14:06.929610+0000","last_fullsized":"2024-09-12T18:14:06.929610+0000","mapping_epoch":24,"log_start":"264'301","ondisk_log_start":"264'301","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'317","last_scrub_stamp":"2024-09-12T18:14:06.929469+0000","last_deep_scrub":"264'317","last_deep_scrub_stamp":"2024-09-12T18:14:06.929469+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.929469+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":301,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:28.114201+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655853,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":737,"num_read_kb":130250,"num_write":941,"num_write_kb":66985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'137","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.753208+0000","last_change":"2024-09-12T17:00:14.329425+0000","last_active":"2024-09-12T18:10:20.753208+0000","last_peered":"2024-09-12T18:10:20.753208+0000","last_clean":"2024-09-12T18:10:20.753208+0000","last_became_active":"2024-09-12T17:00:14.329107+0000","last_became_peered":"2024-09-12T17:00:14.329107+0000","last_unstale":"2024-09-12T18:10:20.753208+0000","last_undegraded":"2024-09-12T18:10:20.753208+0000","last_fullsized":"2024-09-12T18:10:20.753208+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:18.916868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":644,"num_read_kb":539,"num_write":215,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'373","reported_seq":1118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.057944+0000","last_change":"2024-09-12T18:14:01.057944+0000","last_active":"2024-09-12T18:14:01.057944+0000","last_peered":"2024-09-12T18:14:01.057944+0000","last_clean":"2024-09-12T18:14:01.057944+0000","last_became_active":"2024-09-12T17:00:12.307906+0000","last_became_peered":"2024-09-12T17:00:12.307906+0000","last_unstale":"2024-09-12T18:14:01.057944+0000","last_undegraded":"2024-09-12T18:14:01.057944+0000","last_fullsized":"2024-09-12T18:14:01.057944+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-09-12T18:14:01.057824+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-09-12T18:14:01.057824+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.057824+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:19.783672+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524322,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":712,"num_read_kb":3845,"num_write":1087,"num_write_kb":30178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'131","reported_seq":641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.108183+0000","last_change":"2024-09-12T17:00:22.355877+0000","last_active":"2024-09-12T18:12:03.108183+0000","last_peered":"2024-09-12T18:12:03.108183+0000","last_clean":"2024-09-12T18:12:03.108183+0000","last_became_active":"2024-09-12T17:00:22.355591+0000","last_became_peered":"2024-09-12T17:00:22.355591+0000","last_unstale":"2024-09-12T18:12:03.108183+0000","last_undegraded":"2024-09-12T18:12:03.108183+0000","last_fullsized":"2024-09-12T18:12:03.108183+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:28:58.673978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1447,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":175,"num_read_kb":172,"num_write":326,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'85","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.936607+0000","last_change":"2024-09-12T18:14:05.936607+0000","last_active":"2024-09-12T18:14:05.936607+0000","last_peered":"2024-09-12T18:14:05.936607+0000","last_clean":"2024-09-12T18:14:05.936607+0000","last_became_active":"2024-09-12T17:00:14.336144+0000","last_became_peered":"2024-09-12T17:00:14.336144+0000","last_unstale":"2024-09-12T18:14:05.936607+0000","last_undegraded":"2024-09-12T18:14:05.936607+0000","last_fullsized":"2024-09-12T18:14:05.936607+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'85","last_scrub_stamp":"2024-09-12T18:14:05.936499+0000","last_deep_scrub":"264'85","last_deep_scrub_stamp":"2024-09-12T18:14:05.936499+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.936499+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:14.421673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":388,"num_read_kb":332,"num_write":123,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'341","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:57.152269+0000","last_change":"2024-09-12T18:13:57.152269+0000","last_active":"2024-09-12T18:13:57.152269+0000","last_peered":"2024-09-12T18:13:57.152269+0000","last_clean":"2024-09-12T18:13:57.152269+0000","last_became_active":"2024-09-12T17:00:46.720989+0000","last_became_peered":"2024-09-12T17:00:46.720989+0000","last_unstale":"2024-09-12T18:13:57.152269+0000","last_undegraded":"2024-09-12T18:13:57.152269+0000","last_fullsized":"2024-09-12T18:13:57.152269+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'341","last_scrub_stamp":"2024-09-12T18:13:57.152177+0000","last_deep_scrub":"264'341","last_deep_scrub_stamp":"2024-09-12T18:13:57.152177+0000","last_clean_scrub_stamp":"2024-09-12T18:13:57.152177+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:22.890906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":487,"num_read_kb":63990,"num_write":1055,"num_write_kb":41211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954509+0000","last_change":"2024-09-12T17:00:16.326154+0000","last_active":"2024-09-12T18:10:22.954509+0000","last_peered":"2024-09-12T18:10:22.954509+0000","last_clean":"2024-09-12T18:10:22.954509+0000","last_became_active":"2024-09-12T17:00:16.325868+0000","last_became_peered":"2024-09-12T17:00:16.325868+0000","last_unstale":"2024-09-12T18:10:22.954509+0000","last_undegraded":"2024-09-12T18:10:22.954509+0000","last_fullsized":"2024-09-12T18:10:22.954509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:07.781526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'339","reported_seq":966,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.973087+0000","last_change":"2024-09-12T17:00:18.329828+0000","last_active":"2024-09-12T18:13:48.973087+0000","last_peered":"2024-09-12T18:13:48.973087+0000","last_clean":"2024-09-12T18:13:48.973087+0000","last_became_active":"2024-09-12T17:00:18.329515+0000","last_became_peered":"2024-09-12T17:00:18.329515+0000","last_unstale":"2024-09-12T18:13:48.973087+0000","last_undegraded":"2024-09-12T18:13:48.973087+0000","last_fullsized":"2024-09-12T18:13:48.973087+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:07.586238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49756,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":1157,"num_write":430,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.756841+0000","last_change":"2024-09-12T17:00:20.349019+0000","last_active":"2024-09-12T18:10:27.756841+0000","last_peered":"2024-09-12T18:10:27.756841+0000","last_clean":"2024-09-12T18:10:27.756841+0000","last_became_active":"2024-09-12T17:00:20.348524+0000","last_became_peered":"2024-09-12T17:00:20.348524+0000","last_unstale":"2024-09-12T18:10:27.756841+0000","last_undegraded":"2024-09-12T18:10:27.756841+0000","last_fullsized":"2024-09-12T18:10:27.756841+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:34.615435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'165","reported_seq":725,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:42.957515+0000","last_change":"2024-09-12T17:00:22.357994+0000","last_active":"2024-09-12T18:10:42.957515+0000","last_peered":"2024-09-12T18:10:42.957515+0000","last_clean":"2024-09-12T18:10:42.957515+0000","last_became_active":"2024-09-12T17:00:22.357688+0000","last_became_peered":"2024-09-12T17:00:22.357688+0000","last_unstale":"2024-09-12T18:10:42.957515+0000","last_undegraded":"2024-09-12T18:10:42.957515+0000","last_fullsized":"2024-09-12T18:10:42.957515+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:48.716325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":624,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":254,"num_read_kb":249,"num_write":335,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'315","reported_seq":949,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.537417+0000","last_change":"2024-09-12T18:14:10.537417+0000","last_active":"2024-09-12T18:14:10.537417+0000","last_peered":"2024-09-12T18:14:10.537417+0000","last_clean":"2024-09-12T18:14:10.537417+0000","last_became_active":"2024-09-12T17:00:14.327170+0000","last_became_peered":"2024-09-12T17:00:14.327170+0000","last_unstale":"2024-09-12T18:14:10.537417+0000","last_undegraded":"2024-09-12T18:14:10.537417+0000","last_fullsized":"2024-09-12T18:14:10.537417+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'315","last_scrub_stamp":"2024-09-12T18:14:10.537320+0000","last_deep_scrub":"264'315","last_deep_scrub_stamp":"2024-09-12T18:14:10.537320+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.537320+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:19.286520+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1382,"num_read_kb":1112,"num_write":506,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'400","reported_seq":1101,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:55.046377+0000","last_change":"2024-09-12T18:13:55.046377+0000","last_active":"2024-09-12T18:13:55.046377+0000","last_peered":"2024-09-12T18:13:55.046377+0000","last_clean":"2024-09-12T18:13:55.046377+0000","last_became_active":"2024-09-12T17:00:12.304357+0000","last_became_peered":"2024-09-12T17:00:12.304357+0000","last_unstale":"2024-09-12T18:13:55.046377+0000","last_undegraded":"2024-09-12T18:13:55.046377+0000","last_fullsized":"2024-09-12T18:13:55.046377+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'400","last_scrub_stamp":"2024-09-12T18:13:55.046290+0000","last_deep_scrub":"264'400","last_deep_scrub_stamp":"2024-09-12T18:13:55.046290+0000","last_clean_scrub_stamp":"2024-09-12T18:13:55.046290+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:33.859962+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2934950,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":656,"num_read_kb":22996,"num_write":1171,"num_write_kb":36092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.843647+0000","last_change":"2024-09-12T17:00:16.323972+0000","last_active":"2024-09-12T18:10:26.843647+0000","last_peered":"2024-09-12T18:10:26.843647+0000","last_clean":"2024-09-12T18:10:26.843647+0000","last_became_active":"2024-09-12T17:00:16.323601+0000","last_became_peered":"2024-09-12T17:00:16.323601+0000","last_unstale":"2024-09-12T18:10:26.843647+0000","last_undegraded":"2024-09-12T18:10:26.843647+0000","last_fullsized":"2024-09-12T18:10:26.843647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:58.961774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'106","reported_seq":646,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.602728+0000","last_change":"2024-09-12T17:00:18.328151+0000","last_active":"2024-09-12T18:11:11.602728+0000","last_peered":"2024-09-12T18:11:11.602728+0000","last_clean":"2024-09-12T18:11:11.602728+0000","last_became_active":"2024-09-12T17:00:18.327744+0000","last_became_peered":"2024-09-12T17:00:18.327744+0000","last_unstale":"2024-09-12T18:11:11.602728+0000","last_undegraded":"2024-09-12T18:11:11.602728+0000","last_fullsized":"2024-09-12T18:11:11.602728+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:37.786807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":113,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:25.753957+0000","last_change":"2024-09-12T17:00:20.348202+0000","last_active":"2024-09-12T18:10:25.753957+0000","last_peered":"2024-09-12T18:10:25.753957+0000","last_clean":"2024-09-12T18:10:25.753957+0000","last_became_active":"2024-09-12T17:00:20.347865+0000","last_became_peered":"2024-09-12T17:00:20.347865+0000","last_unstale":"2024-09-12T18:10:25.753957+0000","last_undegraded":"2024-09-12T18:10:25.753957+0000","last_fullsized":"2024-09-12T18:10:25.753957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:50.254374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'111","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619154+0000","last_change":"2024-09-12T17:00:22.353337+0000","last_active":"2024-09-12T18:10:21.619154+0000","last_peered":"2024-09-12T18:10:21.619154+0000","last_clean":"2024-09-12T18:10:21.619154+0000","last_became_active":"2024-09-12T17:00:22.352912+0000","last_became_peered":"2024-09-12T17:00:22.352912+0000","last_unstale":"2024-09-12T18:10:21.619154+0000","last_undegraded":"2024-09-12T18:10:21.619154+0000","last_fullsized":"2024-09-12T18:10:21.619154+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:40.097046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":708,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":149,"num_read_kb":144,"num_write":248,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'179","reported_seq":814,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.134414+0000","last_change":"2024-09-12T18:14:07.134414+0000","last_active":"2024-09-12T18:14:07.134414+0000","last_peered":"2024-09-12T18:14:07.134414+0000","last_clean":"2024-09-12T18:14:07.134414+0000","last_became_active":"2024-09-12T17:00:14.337515+0000","last_became_peered":"2024-09-12T17:00:14.337515+0000","last_unstale":"2024-09-12T18:14:07.134414+0000","last_undegraded":"2024-09-12T18:14:07.134414+0000","last_fullsized":"2024-09-12T18:14:07.134414+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-09-12T18:14:07.134319+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-09-12T18:14:07.134319+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.134319+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:44.674793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":863,"num_read_kb":715,"num_write":299,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'372","reported_seq":1041,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.233108+0000","last_change":"2024-09-12T18:14:02.233108+0000","last_active":"2024-09-12T18:14:02.233108+0000","last_peered":"2024-09-12T18:14:02.233108+0000","last_clean":"2024-09-12T18:14:02.233108+0000","last_became_active":"2024-09-12T17:00:12.308065+0000","last_became_peered":"2024-09-12T17:00:12.308065+0000","last_unstale":"2024-09-12T18:14:02.233108+0000","last_undegraded":"2024-09-12T18:14:02.233108+0000","last_fullsized":"2024-09-12T18:14:02.233108+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-12T18:14:02.232968+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-12T18:14:02.232968+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.232968+0000","objects_scrubbed":7,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:48.335339+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":976913,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":502,"num_read_kb":43207,"num_write":1166,"num_write_kb":32106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.843124+0000","last_change":"2024-09-12T17:00:16.326520+0000","last_active":"2024-09-12T18:10:21.843124+0000","last_peered":"2024-09-12T18:10:21.843124+0000","last_clean":"2024-09-12T18:10:21.843124+0000","last_became_active":"2024-09-12T17:00:16.326073+0000","last_became_peered":"2024-09-12T17:00:16.326073+0000","last_unstale":"2024-09-12T18:10:21.843124+0000","last_undegraded":"2024-09-12T18:10:21.843124+0000","last_fullsized":"2024-09-12T18:10:21.843124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:41.659835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'145","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.127850+0000","last_change":"2024-09-12T18:14:12.127850+0000","last_active":"2024-09-12T18:14:12.127850+0000","last_peered":"2024-09-12T18:14:12.127850+0000","last_clean":"2024-09-12T18:14:12.127850+0000","last_became_active":"2024-09-12T17:00:18.327448+0000","last_became_peered":"2024-09-12T17:00:18.327448+0000","last_unstale":"2024-09-12T18:14:12.127850+0000","last_undegraded":"2024-09-12T18:14:12.127850+0000","last_fullsized":"2024-09-12T18:14:12.127850+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'145","last_scrub_stamp":"2024-09-12T18:14:12.127741+0000","last_deep_scrub":"264'145","last_deep_scrub_stamp":"2024-09-12T18:14:12.127741+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.127741+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:09.199604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":172,"num_read_kb":164,"num_write":118,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'767","reported_seq":2566,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.621806+0000","last_change":"2024-09-12T17:00:20.351615+0000","last_active":"2024-09-12T18:13:48.621806+0000","last_peered":"2024-09-12T18:13:48.621806+0000","last_clean":"2024-09-12T18:13:48.621806+0000","last_became_active":"2024-09-12T17:00:20.351202+0000","last_became_peered":"2024-09-12T17:00:20.351202+0000","last_unstale":"2024-09-12T18:13:48.621806+0000","last_undegraded":"2024-09-12T18:13:48.621806+0000","last_fullsized":"2024-09-12T18:13:48.621806+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:43.494236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'205","reported_seq":1031,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.168160+0000","last_change":"2024-09-12T17:00:22.588416+0000","last_active":"2024-09-12T18:12:03.168160+0000","last_peered":"2024-09-12T18:12:03.168160+0000","last_clean":"2024-09-12T18:12:03.168160+0000","last_became_active":"2024-09-12T17:00:22.588111+0000","last_became_peered":"2024-09-12T17:00:22.588111+0000","last_unstale":"2024-09-12T18:12:03.168160+0000","last_undegraded":"2024-09-12T18:12:03.168160+0000","last_fullsized":"2024-09-12T18:12:03.168160+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:50.047140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":621,"num_read_kb":619,"num_write":443,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'162","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.947891+0000","last_change":"2024-09-12T18:14:10.947891+0000","last_active":"2024-09-12T18:14:10.947891+0000","last_peered":"2024-09-12T18:14:10.947891+0000","last_clean":"2024-09-12T18:14:10.947891+0000","last_became_active":"2024-09-12T17:00:14.332424+0000","last_became_peered":"2024-09-12T17:00:14.332424+0000","last_unstale":"2024-09-12T18:14:10.947891+0000","last_undegraded":"2024-09-12T18:14:10.947891+0000","last_fullsized":"2024-09-12T18:14:10.947891+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'162","last_scrub_stamp":"2024-09-12T18:14:10.947786+0000","last_deep_scrub":"264'162","last_deep_scrub_stamp":"2024-09-12T18:14:10.947786+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.947786+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:36.780975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":720,"num_read_kb":605,"num_write":258,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'356","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.062122+0000","last_change":"2024-09-12T18:13:58.062122+0000","last_active":"2024-09-12T18:13:58.062122+0000","last_peered":"2024-09-12T18:13:58.062122+0000","last_clean":"2024-09-12T18:13:58.062122+0000","last_became_active":"2024-09-12T17:00:12.310337+0000","last_became_peered":"2024-09-12T17:00:12.310337+0000","last_unstale":"2024-09-12T18:13:58.062122+0000","last_undegraded":"2024-09-12T18:13:58.062122+0000","last_fullsized":"2024-09-12T18:13:58.062122+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-12T18:13:58.062029+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-12T18:13:58.062029+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.062029+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:33.366460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":552,"num_read_kb":13230,"num_write":1122,"num_write_kb":37058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954568+0000","last_change":"2024-09-12T17:00:16.325390+0000","last_active":"2024-09-12T18:10:22.954568+0000","last_peered":"2024-09-12T18:10:22.954568+0000","last_clean":"2024-09-12T18:10:22.954568+0000","last_became_active":"2024-09-12T17:00:16.325141+0000","last_became_peered":"2024-09-12T17:00:16.325141+0000","last_unstale":"2024-09-12T18:10:22.954568+0000","last_undegraded":"2024-09-12T18:10:22.954568+0000","last_fullsized":"2024-09-12T18:10:22.954568+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:43.724058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'309","reported_seq":887,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.755371+0000","last_change":"2024-09-12T17:00:18.430347+0000","last_active":"2024-09-12T18:13:48.755371+0000","last_peered":"2024-09-12T18:13:48.755371+0000","last_clean":"2024-09-12T18:13:48.755371+0000","last_became_active":"2024-09-12T17:00:18.430046+0000","last_became_peered":"2024-09-12T17:00:18.430046+0000","last_unstale":"2024-09-12T18:13:48.755371+0000","last_undegraded":"2024-09-12T18:13:48.755371+0000","last_fullsized":"2024-09-12T18:13:48.755371+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:57.355912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53213,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":492,"num_read_kb":1165,"num_write":400,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'772","reported_seq":2861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.820972+0000","last_change":"2024-09-12T17:00:20.354448+0000","last_active":"2024-09-12T18:13:48.820972+0000","last_peered":"2024-09-12T18:13:48.820972+0000","last_clean":"2024-09-12T18:13:48.820972+0000","last_became_active":"2024-09-12T17:00:20.353914+0000","last_became_peered":"2024-09-12T17:00:20.353914+0000","last_unstale":"2024-09-12T18:13:48.820972+0000","last_undegraded":"2024-09-12T18:13:48.820972+0000","last_fullsized":"2024-09-12T18:13:48.820972+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:46.082984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'89","reported_seq":685,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.529816+0000","last_change":"2024-09-12T18:14:11.529816+0000","last_active":"2024-09-12T18:14:11.529816+0000","last_peered":"2024-09-12T18:14:11.529816+0000","last_clean":"2024-09-12T18:14:11.529816+0000","last_became_active":"2024-09-12T17:00:14.325669+0000","last_became_peered":"2024-09-12T17:00:14.325669+0000","last_unstale":"2024-09-12T18:14:11.529816+0000","last_undegraded":"2024-09-12T18:14:11.529816+0000","last_fullsized":"2024-09-12T18:14:11.529816+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'89","last_scrub_stamp":"2024-09-12T18:14:11.529715+0000","last_deep_scrub":"264'89","last_deep_scrub_stamp":"2024-09-12T18:14:11.529715+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.529715+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:01.485599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":392,"num_read_kb":330,"num_write":131,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'362","reported_seq":981,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.168944+0000","last_change":"2024-09-12T18:14:00.168944+0000","last_active":"2024-09-12T18:14:00.168944+0000","last_peered":"2024-09-12T18:14:00.168944+0000","last_clean":"2024-09-12T18:14:00.168944+0000","last_became_active":"2024-09-12T17:00:12.315015+0000","last_became_peered":"2024-09-12T17:00:12.315015+0000","last_unstale":"2024-09-12T18:14:00.168944+0000","last_undegraded":"2024-09-12T18:14:00.168944+0000","last_fullsized":"2024-09-12T18:14:00.168944+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'362","last_scrub_stamp":"2024-09-12T18:14:00.168837+0000","last_deep_scrub":"264'362","last_deep_scrub_stamp":"2024-09-12T18:14:00.168837+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.168837+0000","objects_scrubbed":8,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:13.982975+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311686,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":465,"num_read_kb":13974,"num_write":1122,"num_write_kb":21819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.769322+0000","last_change":"2024-09-12T17:00:16.323002+0000","last_active":"2024-09-12T18:11:47.769322+0000","last_peered":"2024-09-12T18:11:47.769322+0000","last_clean":"2024-09-12T18:11:47.769322+0000","last_became_active":"2024-09-12T17:00:16.322693+0000","last_became_peered":"2024-09-12T17:00:16.322693+0000","last_unstale":"2024-09-12T18:11:47.769322+0000","last_undegraded":"2024-09-12T18:11:47.769322+0000","last_fullsized":"2024-09-12T18:11:47.769322+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'395","reported_seq":1038,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.142114+0000","last_change":"2024-09-12T17:00:18.429427+0000","last_active":"2024-09-12T18:13:49.142114+0000","last_peered":"2024-09-12T18:13:49.142114+0000","last_clean":"2024-09-12T18:13:49.142114+0000","last_became_active":"2024-09-12T17:00:18.429137+0000","last_became_peered":"2024-09-12T17:00:18.429137+0000","last_unstale":"2024-09-12T18:13:49.142114+0000","last_undegraded":"2024-09-12T18:13:49.142114+0000","last_fullsized":"2024-09-12T18:13:49.142114+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47718,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":656,"num_read_kb":1335,"num_write":508,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:08.915747+0000","last_change":"2024-09-12T17:00:20.348773+0000","last_active":"2024-09-12T18:10:08.915747+0000","last_peered":"2024-09-12T18:10:08.915747+0000","last_clean":"2024-09-12T18:10:08.915747+0000","last_became_active":"2024-09-12T17:00:20.348507+0000","last_became_peered":"2024-09-12T17:00:20.348507+0000","last_unstale":"2024-09-12T18:10:08.915747+0000","last_undegraded":"2024-09-12T18:10:08.915747+0000","last_fullsized":"2024-09-12T18:10:08.915747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:15:32.541811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'560","reported_seq":1385,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.026506+0000","last_change":"2024-09-12T17:00:22.358717+0000","last_active":"2024-09-12T18:13:23.026506+0000","last_peered":"2024-09-12T18:13:23.026506+0000","last_clean":"2024-09-12T18:13:23.026506+0000","last_became_active":"2024-09-12T17:00:22.358335+0000","last_became_peered":"2024-09-12T17:00:22.358335+0000","last_unstale":"2024-09-12T18:13:23.026506+0000","last_undegraded":"2024-09-12T18:13:23.026506+0000","last_fullsized":"2024-09-12T18:13:23.026506+0000","mapping_epoch":34,"log_start":"264'500","ondisk_log_start":"264'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:28.398620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1357,"num_read_kb":1346,"num_write":1162,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'63","reported_seq":638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.872058+0000","last_change":"2024-09-12T18:14:02.872058+0000","last_active":"2024-09-12T18:14:02.872058+0000","last_peered":"2024-09-12T18:14:02.872058+0000","last_clean":"2024-09-12T18:14:02.872058+0000","last_became_active":"2024-09-12T17:00:14.335783+0000","last_became_peered":"2024-09-12T17:00:14.335783+0000","last_unstale":"2024-09-12T18:14:02.872058+0000","last_undegraded":"2024-09-12T18:14:02.872058+0000","last_fullsized":"2024-09-12T18:14:02.872058+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'63","last_scrub_stamp":"2024-09-12T18:14:02.871975+0000","last_deep_scrub":"264'63","last_deep_scrub_stamp":"2024-09-12T18:14:02.871975+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.871975+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:08.824516+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":238,"num_write":99,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'411","reported_seq":1150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.203613+0000","last_change":"2024-09-12T18:14:01.203613+0000","last_active":"2024-09-12T18:14:01.203613+0000","last_peered":"2024-09-12T18:14:01.203613+0000","last_clean":"2024-09-12T18:14:01.203613+0000","last_became_active":"2024-09-12T17:00:12.307222+0000","last_became_peered":"2024-09-12T17:00:12.307222+0000","last_unstale":"2024-09-12T18:14:01.203613+0000","last_undegraded":"2024-09-12T18:14:01.203613+0000","last_fullsized":"2024-09-12T18:14:01.203613+0000","mapping_epoch":24,"log_start":"264'400","ondisk_log_start":"264'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'411","last_scrub_stamp":"2024-09-12T18:14:01.203510+0000","last_deep_scrub":"264'411","last_deep_scrub_stamp":"2024-09-12T18:14:01.203510+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.203510+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:03.740833+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":853,"num_read_kb":14510,"num_write":1377,"num_write_kb":34813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.081210+0000","last_change":"2024-09-12T18:14:03.081210+0000","last_active":"2024-09-12T18:14:03.081210+0000","last_peered":"2024-09-12T18:14:03.081210+0000","last_clean":"2024-09-12T18:14:03.081210+0000","last_became_active":"2024-09-12T17:00:16.322917+0000","last_became_peered":"2024-09-12T17:00:16.322917+0000","last_unstale":"2024-09-12T18:14:03.081210+0000","last_undegraded":"2024-09-12T18:14:03.081210+0000","last_fullsized":"2024-09-12T18:14:03.081210+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:03.081128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:03.081128+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.081128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:19.186349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'268","reported_seq":849,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.352762+0000","last_change":"2024-09-12T17:00:18.327458+0000","last_active":"2024-09-12T18:13:48.352762+0000","last_peered":"2024-09-12T18:13:48.352762+0000","last_clean":"2024-09-12T18:13:48.352762+0000","last_became_active":"2024-09-12T17:00:18.326791+0000","last_became_peered":"2024-09-12T17:00:18.326791+0000","last_unstale":"2024-09-12T18:13:48.352762+0000","last_undegraded":"2024-09-12T18:13:48.352762+0000","last_fullsized":"2024-09-12T18:13:48.352762+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:25.837684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43451,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":428,"num_read_kb":949,"num_write":338,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.854678+0000","last_change":"2024-09-12T17:00:20.354443+0000","last_active":"2024-09-12T18:12:01.854678+0000","last_peered":"2024-09-12T18:12:01.854678+0000","last_clean":"2024-09-12T18:12:01.854678+0000","last_became_active":"2024-09-12T17:00:20.353959+0000","last_became_peered":"2024-09-12T17:00:20.353959+0000","last_unstale":"2024-09-12T18:12:01.854678+0000","last_undegraded":"2024-09-12T18:12:01.854678+0000","last_fullsized":"2024-09-12T18:12:01.854678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'2407","reported_seq":4230,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:12.155626+0000","last_change":"2024-09-12T17:00:22.356576+0000","last_active":"2024-09-12T18:13:12.155626+0000","last_peered":"2024-09-12T18:13:12.155626+0000","last_clean":"2024-09-12T18:13:12.155626+0000","last_became_active":"2024-09-12T17:00:22.355651+0000","last_became_peered":"2024-09-12T17:00:22.355651+0000","last_unstale":"2024-09-12T18:13:12.155626+0000","last_undegraded":"2024-09-12T18:13:12.155626+0000","last_fullsized":"2024-09-12T18:13:12.155626+0000","mapping_epoch":34,"log_start":"264'2300","ondisk_log_start":"264'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":2300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:33.472074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6022,"num_read_kb":6027,"num_write":4838,"num_write_kb":1790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'196","reported_seq":784,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.998772+0000","last_change":"2024-09-12T18:14:06.998699+0000","last_active":"2024-09-12T18:14:06.998772+0000","last_peered":"2024-09-12T18:14:06.998772+0000","last_clean":"2024-09-12T18:14:06.998772+0000","last_became_active":"2024-09-12T17:00:14.321270+0000","last_became_peered":"2024-09-12T17:00:14.321270+0000","last_unstale":"2024-09-12T18:14:06.998772+0000","last_undegraded":"2024-09-12T18:14:06.998772+0000","last_fullsized":"2024-09-12T18:14:06.998772+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'196","last_scrub_stamp":"2024-09-12T18:14:06.998613+0000","last_deep_scrub":"264'196","last_deep_scrub_stamp":"2024-09-12T18:14:06.998613+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.998613+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:01.248687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":834,"num_read_kb":668,"num_write":296,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'325","reported_seq":972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.185362+0000","last_change":"2024-09-12T18:14:04.185362+0000","last_active":"2024-09-12T18:14:04.185362+0000","last_peered":"2024-09-12T18:14:04.185362+0000","last_clean":"2024-09-12T18:14:04.185362+0000","last_became_active":"2024-09-12T17:00:12.313262+0000","last_became_peered":"2024-09-12T17:00:12.313262+0000","last_unstale":"2024-09-12T18:14:04.185362+0000","last_undegraded":"2024-09-12T18:14:04.185362+0000","last_fullsized":"2024-09-12T18:14:04.185362+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'325","last_scrub_stamp":"2024-09-12T18:14:04.185253+0000","last_deep_scrub":"264'325","last_deep_scrub_stamp":"2024-09-12T18:14:04.185253+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.185253+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:59.905385+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":514296,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":454,"num_read_kb":16364,"num_write":986,"num_write_kb":27335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.184651+0000","last_change":"2024-09-12T18:14:07.184651+0000","last_active":"2024-09-12T18:14:07.184651+0000","last_peered":"2024-09-12T18:14:07.184651+0000","last_clean":"2024-09-12T18:14:07.184651+0000","last_became_active":"2024-09-12T17:00:16.321641+0000","last_became_peered":"2024-09-12T17:00:16.321641+0000","last_unstale":"2024-09-12T18:14:07.184651+0000","last_undegraded":"2024-09-12T18:14:07.184651+0000","last_fullsized":"2024-09-12T18:14:07.184651+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:07.184519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:07.184519+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.184519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:04.109723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'338","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.222331+0000","last_change":"2024-09-12T17:00:18.331983+0000","last_active":"2024-09-12T18:13:49.222331+0000","last_peered":"2024-09-12T18:13:49.222331+0000","last_clean":"2024-09-12T18:13:49.222331+0000","last_became_active":"2024-09-12T17:00:18.331707+0000","last_became_peered":"2024-09-12T17:00:18.331707+0000","last_unstale":"2024-09-12T18:13:49.222331+0000","last_undegraded":"2024-09-12T18:13:49.222331+0000","last_fullsized":"2024-09-12T18:13:49.222331+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47689,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":552,"num_read_kb":1215,"num_write":436,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'765","reported_seq":2728,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.537553+0000","last_change":"2024-09-12T17:00:20.348555+0000","last_active":"2024-09-12T18:13:49.537553+0000","last_peered":"2024-09-12T18:13:49.537553+0000","last_clean":"2024-09-12T18:13:49.537553+0000","last_became_active":"2024-09-12T17:00:20.348227+0000","last_became_peered":"2024-09-12T17:00:20.348227+0000","last_unstale":"2024-09-12T18:13:49.537553+0000","last_undegraded":"2024-09-12T18:13:49.537553+0000","last_fullsized":"2024-09-12T18:13:49.537553+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'115","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:21.913148+0000","last_change":"2024-09-12T17:00:22.353551+0000","last_active":"2024-09-12T18:13:21.913148+0000","last_peered":"2024-09-12T18:13:21.913148+0000","last_clean":"2024-09-12T18:13:21.913148+0000","last_became_active":"2024-09-12T17:00:22.353172+0000","last_became_peered":"2024-09-12T17:00:22.353172+0000","last_unstale":"2024-09-12T18:13:21.913148+0000","last_undegraded":"2024-09-12T18:13:21.913148+0000","last_fullsized":"2024-09-12T18:13:21.913148+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":136,"num_write":299,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'231","reported_seq":893,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.156892+0000","last_change":"2024-09-12T18:14:08.156892+0000","last_active":"2024-09-12T18:14:08.156892+0000","last_peered":"2024-09-12T18:14:08.156892+0000","last_clean":"2024-09-12T18:14:08.156892+0000","last_became_active":"2024-09-12T17:00:14.324823+0000","last_became_peered":"2024-09-12T17:00:14.324823+0000","last_unstale":"2024-09-12T18:14:08.156892+0000","last_undegraded":"2024-09-12T18:14:08.156892+0000","last_fullsized":"2024-09-12T18:14:08.156892+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'231","last_scrub_stamp":"2024-09-12T18:14:08.156786+0000","last_deep_scrub":"264'231","last_deep_scrub_stamp":"2024-09-12T18:14:08.156786+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.156786+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:05.486389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1013,"num_read_kb":830,"num_write":393,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'409","reported_seq":1105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.506441+0000","last_change":"2024-09-12T18:14:00.506441+0000","last_active":"2024-09-12T18:14:00.506441+0000","last_peered":"2024-09-12T18:14:00.506441+0000","last_clean":"2024-09-12T18:14:00.506441+0000","last_became_active":"2024-09-12T17:00:12.318599+0000","last_became_peered":"2024-09-12T17:00:12.318599+0000","last_unstale":"2024-09-12T18:14:00.506441+0000","last_undegraded":"2024-09-12T18:14:00.506441+0000","last_fullsized":"2024-09-12T18:14:00.506441+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'409","last_scrub_stamp":"2024-09-12T18:14:00.506341+0000","last_deep_scrub":"264'409","last_deep_scrub_stamp":"2024-09-12T18:14:00.506341+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.506341+0000","objects_scrubbed":10,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:44.930843+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850207,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":687,"num_read_kb":44825,"num_write":1169,"num_write_kb":32428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.143934+0000","last_change":"2024-09-12T18:14:08.143874+0000","last_active":"2024-09-12T18:14:08.143934+0000","last_peered":"2024-09-12T18:14:08.143934+0000","last_clean":"2024-09-12T18:14:08.143934+0000","last_became_active":"2024-09-12T17:00:16.328352+0000","last_became_peered":"2024-09-12T17:00:16.328352+0000","last_unstale":"2024-09-12T18:14:08.143934+0000","last_undegraded":"2024-09-12T18:14:08.143934+0000","last_fullsized":"2024-09-12T18:14:08.143934+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:08.143773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:08.143773+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.143773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:58.048888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'478","reported_seq":1136,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.308135+0000","last_change":"2024-09-12T17:00:18.330361+0000","last_active":"2024-09-12T18:13:49.308135+0000","last_peered":"2024-09-12T18:13:49.308135+0000","last_clean":"2024-09-12T18:13:49.308135+0000","last_became_active":"2024-09-12T17:00:18.329414+0000","last_became_peered":"2024-09-12T17:00:18.329414+0000","last_unstale":"2024-09-12T18:13:49.308135+0000","last_undegraded":"2024-09-12T18:13:49.308135+0000","last_fullsized":"2024-09-12T18:13:49.308135+0000","mapping_epoch":30,"log_start":"264'400","ondisk_log_start":"264'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60099,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":839,"num_read_kb":2047,"num_write":682,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.106469+0000","last_change":"2024-09-12T18:14:13.106469+0000","last_active":"2024-09-12T18:14:13.106469+0000","last_peered":"2024-09-12T18:14:13.106469+0000","last_clean":"2024-09-12T18:14:13.106469+0000","last_became_active":"2024-09-12T17:00:20.352249+0000","last_became_peered":"2024-09-12T17:00:20.352249+0000","last_unstale":"2024-09-12T18:14:13.106469+0000","last_undegraded":"2024-09-12T18:14:13.106469+0000","last_fullsized":"2024-09-12T18:14:13.106469+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:13.106375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:13.106375+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.106375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:50.311270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'178","reported_seq":712,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:21.918849+0000","last_change":"2024-09-12T17:00:22.356296+0000","last_active":"2024-09-12T18:13:21.918849+0000","last_peered":"2024-09-12T18:13:21.918849+0000","last_clean":"2024-09-12T18:13:21.918849+0000","last_became_active":"2024-09-12T17:00:22.355850+0000","last_became_peered":"2024-09-12T17:00:22.355850+0000","last_unstale":"2024-09-12T18:13:21.918849+0000","last_undegraded":"2024-09-12T18:13:21.918849+0000","last_fullsized":"2024-09-12T18:13:21.918849+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":278,"num_read_kb":264,"num_write":436,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'144","reported_seq":759,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.917096+0000","last_change":"2024-09-12T18:14:03.917096+0000","last_active":"2024-09-12T18:14:03.917096+0000","last_peered":"2024-09-12T18:14:03.917096+0000","last_clean":"2024-09-12T18:14:03.917096+0000","last_became_active":"2024-09-12T17:00:14.334594+0000","last_became_peered":"2024-09-12T17:00:14.334594+0000","last_unstale":"2024-09-12T18:14:03.917096+0000","last_undegraded":"2024-09-12T18:14:03.917096+0000","last_fullsized":"2024-09-12T18:14:03.917096+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'144","last_scrub_stamp":"2024-09-12T18:14:03.917002+0000","last_deep_scrub":"264'144","last_deep_scrub_stamp":"2024-09-12T18:14:03.917002+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.917002+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:28.774783+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":624,"num_read_kb":516,"num_write":207,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'348","reported_seq":991,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:56.926852+0000","last_change":"2024-09-12T18:13:56.926852+0000","last_active":"2024-09-12T18:13:56.926852+0000","last_peered":"2024-09-12T18:13:56.926852+0000","last_clean":"2024-09-12T18:13:56.926852+0000","last_became_active":"2024-09-12T17:00:12.314509+0000","last_became_peered":"2024-09-12T17:00:12.314509+0000","last_unstale":"2024-09-12T18:13:56.926852+0000","last_undegraded":"2024-09-12T18:13:56.926852+0000","last_fullsized":"2024-09-12T18:13:56.926852+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'348","last_scrub_stamp":"2024-09-12T18:13:56.926498+0000","last_deep_scrub":"264'348","last_deep_scrub_stamp":"2024-09-12T18:13:56.926498+0000","last_clean_scrub_stamp":"2024-09-12T18:13:56.926498+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:36.730340+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2180125,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":439,"num_read_kb":51555,"num_write":1035,"num_write_kb":32245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.184661+0000","last_change":"2024-09-12T18:14:10.184661+0000","last_active":"2024-09-12T18:14:10.184661+0000","last_peered":"2024-09-12T18:14:10.184661+0000","last_clean":"2024-09-12T18:14:10.184661+0000","last_became_active":"2024-09-12T17:00:16.319269+0000","last_became_peered":"2024-09-12T17:00:16.319269+0000","last_unstale":"2024-09-12T18:14:10.184661+0000","last_undegraded":"2024-09-12T18:14:10.184661+0000","last_fullsized":"2024-09-12T18:14:10.184661+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:10.184575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:10.184575+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.184575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:10.584698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'295","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.509288+0000","last_change":"2024-09-12T17:00:18.331052+0000","last_active":"2024-09-12T18:13:48.509288+0000","last_peered":"2024-09-12T18:13:48.509288+0000","last_clean":"2024-09-12T18:13:48.509288+0000","last_became_active":"2024-09-12T17:00:18.330634+0000","last_became_peered":"2024-09-12T17:00:18.330634+0000","last_unstale":"2024-09-12T18:13:48.509288+0000","last_undegraded":"2024-09-12T18:13:48.509288+0000","last_fullsized":"2024-09-12T18:13:48.509288+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:16.080984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48221,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":495,"num_read_kb":1035,"num_write":432,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.619832+0000","last_change":"2024-09-12T17:00:20.351332+0000","last_active":"2024-09-12T18:10:26.619832+0000","last_peered":"2024-09-12T18:10:26.619832+0000","last_clean":"2024-09-12T18:10:26.619832+0000","last_became_active":"2024-09-12T17:00:20.351001+0000","last_became_peered":"2024-09-12T17:00:20.351001+0000","last_unstale":"2024-09-12T18:10:26.619832+0000","last_undegraded":"2024-09-12T18:10:26.619832+0000","last_fullsized":"2024-09-12T18:10:26.619832+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:04.653097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'120","reported_seq":621,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:31.859249+0000","last_change":"2024-09-12T17:00:22.357302+0000","last_active":"2024-09-12T18:12:31.859249+0000","last_peered":"2024-09-12T18:12:31.859249+0000","last_clean":"2024-09-12T18:12:31.859249+0000","last_became_active":"2024-09-12T17:00:22.357001+0000","last_became_peered":"2024-09-12T17:00:22.357001+0000","last_unstale":"2024-09-12T18:12:31.859249+0000","last_undegraded":"2024-09-12T18:12:31.859249+0000","last_fullsized":"2024-09-12T18:12:31.859249+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:15.408471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":156,"num_write":307,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'263","reported_seq":896,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.957402+0000","last_change":"2024-09-12T18:14:04.957402+0000","last_active":"2024-09-12T18:14:04.957402+0000","last_peered":"2024-09-12T18:14:04.957402+0000","last_clean":"2024-09-12T18:14:04.957402+0000","last_became_active":"2024-09-12T17:00:14.320928+0000","last_became_peered":"2024-09-12T17:00:14.320928+0000","last_unstale":"2024-09-12T18:14:04.957402+0000","last_undegraded":"2024-09-12T18:14:04.957402+0000","last_fullsized":"2024-09-12T18:14:04.957402+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'263","last_scrub_stamp":"2024-09-12T18:14:04.957288+0000","last_deep_scrub":"264'263","last_deep_scrub_stamp":"2024-09-12T18:14:04.957288+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.957288+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:04.198862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1139,"num_read_kb":929,"num_write":426,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'361","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.038411+0000","last_change":"2024-09-12T18:14:00.038340+0000","last_active":"2024-09-12T18:14:00.038411+0000","last_peered":"2024-09-12T18:14:00.038411+0000","last_clean":"2024-09-12T18:14:00.038411+0000","last_became_active":"2024-09-12T17:00:12.308967+0000","last_became_peered":"2024-09-12T17:00:12.308967+0000","last_unstale":"2024-09-12T18:14:00.038411+0000","last_undegraded":"2024-09-12T18:14:00.038411+0000","last_fullsized":"2024-09-12T18:14:00.038411+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'361","last_scrub_stamp":"2024-09-12T18:14:00.038240+0000","last_deep_scrub":"264'361","last_deep_scrub_stamp":"2024-09-12T18:14:00.038240+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.038240+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:42.694292+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549696,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":120658,"num_write":1095,"num_write_kb":55796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.118839+0000","last_change":"2024-09-12T18:14:10.118839+0000","last_active":"2024-09-12T18:14:10.118839+0000","last_peered":"2024-09-12T18:14:10.118839+0000","last_clean":"2024-09-12T18:14:10.118839+0000","last_became_active":"2024-09-12T17:00:16.329596+0000","last_became_peered":"2024-09-12T17:00:16.329596+0000","last_unstale":"2024-09-12T18:14:10.118839+0000","last_undegraded":"2024-09-12T18:14:10.118839+0000","last_fullsized":"2024-09-12T18:14:10.118839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:10.118740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:10.118740+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.118740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:07.683997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'350","reported_seq":967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.163418+0000","last_change":"2024-09-12T18:14:11.163418+0000","last_active":"2024-09-12T18:14:11.163418+0000","last_peered":"2024-09-12T18:14:11.163418+0000","last_clean":"2024-09-12T18:14:11.163418+0000","last_became_active":"2024-09-12T17:00:18.331483+0000","last_became_peered":"2024-09-12T17:00:18.331483+0000","last_unstale":"2024-09-12T18:14:11.163418+0000","last_undegraded":"2024-09-12T18:14:11.163418+0000","last_fullsized":"2024-09-12T18:14:11.163418+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-12T18:14:11.163297+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-12T18:14:11.163297+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.163297+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:56.385197+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48847,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":573,"num_read_kb":1293,"num_write":456,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'739","reported_seq":4704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.278097+0000","last_change":"2024-09-12T17:00:20.352350+0000","last_active":"2024-09-12T18:13:49.278097+0000","last_peered":"2024-09-12T18:13:49.278097+0000","last_clean":"2024-09-12T18:13:49.278097+0000","last_became_active":"2024-09-12T17:00:20.352022+0000","last_became_peered":"2024-09-12T17:00:20.352022+0000","last_unstale":"2024-09-12T18:13:49.278097+0000","last_undegraded":"2024-09-12T18:13:49.278097+0000","last_fullsized":"2024-09-12T18:13:49.278097+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:52.501993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'82","reported_seq":594,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.524395+0000","last_change":"2024-09-12T17:00:22.350570+0000","last_active":"2024-09-12T18:12:00.524395+0000","last_peered":"2024-09-12T18:12:00.524395+0000","last_clean":"2024-09-12T18:12:00.524395+0000","last_became_active":"2024-09-12T17:00:22.350283+0000","last_became_peered":"2024-09-12T17:00:22.350283+0000","last_unstale":"2024-09-12T18:12:00.524395+0000","last_undegraded":"2024-09-12T18:12:00.524395+0000","last_fullsized":"2024-09-12T18:12:00.524395+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:18.622278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":129,"num_read_kb":121,"num_write":196,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'24","reported_seq":577,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.926204+0000","last_change":"2024-09-12T18:14:05.926204+0000","last_active":"2024-09-12T18:14:05.926204+0000","last_peered":"2024-09-12T18:14:05.926204+0000","last_clean":"2024-09-12T18:14:05.926204+0000","last_became_active":"2024-09-12T17:00:14.325788+0000","last_became_peered":"2024-09-12T17:00:14.325788+0000","last_unstale":"2024-09-12T18:14:05.926204+0000","last_undegraded":"2024-09-12T18:14:05.926204+0000","last_fullsized":"2024-09-12T18:14:05.926204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-09-12T18:14:05.926108+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-09-12T18:14:05.926108+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.926108+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:59.672862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":96,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'334","reported_seq":1039,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.798217+0000","last_change":"2024-09-12T18:13:59.798217+0000","last_active":"2024-09-12T18:13:59.798217+0000","last_peered":"2024-09-12T18:13:59.798217+0000","last_clean":"2024-09-12T18:13:59.798217+0000","last_became_active":"2024-09-12T17:00:12.309388+0000","last_became_peered":"2024-09-12T17:00:12.309388+0000","last_unstale":"2024-09-12T18:13:59.798217+0000","last_undegraded":"2024-09-12T18:13:59.798217+0000","last_fullsized":"2024-09-12T18:13:59.798217+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'334","last_scrub_stamp":"2024-09-12T18:13:59.798123+0000","last_deep_scrub":"264'334","last_deep_scrub_stamp":"2024-09-12T18:13:59.798123+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.798123+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:12.466059+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3573814,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":548,"num_read_kb":20473,"num_write":1106,"num_write_kb":21258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1469,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:47.966218+0000","last_change":"2024-09-12T17:00:16.330362+0000","last_active":"2024-09-12T18:13:47.966218+0000","last_peered":"2024-09-12T18:13:47.966218+0000","last_clean":"2024-09-12T18:13:47.966218+0000","last_became_active":"2024-09-12T17:00:16.330035+0000","last_became_peered":"2024-09-12T17:00:16.330035+0000","last_unstale":"2024-09-12T18:13:47.966218+0000","last_undegraded":"2024-09-12T18:13:47.966218+0000","last_fullsized":"2024-09-12T18:13:47.966218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:23.800125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'102","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.018578+0000","last_change":"2024-09-12T17:00:18.429647+0000","last_active":"2024-09-12T18:11:11.018578+0000","last_peered":"2024-09-12T18:11:11.018578+0000","last_clean":"2024-09-12T18:11:11.018578+0000","last_became_active":"2024-09-12T17:00:18.429253+0000","last_became_peered":"2024-09-12T17:00:18.429253+0000","last_unstale":"2024-09-12T18:11:11.018578+0000","last_undegraded":"2024-09-12T18:11:11.018578+0000","last_fullsized":"2024-09-12T18:11:11.018578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:37.177018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'784","reported_seq":2533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.190299+0000","last_change":"2024-09-12T17:00:20.353257+0000","last_active":"2024-09-12T18:13:48.190299+0000","last_peered":"2024-09-12T18:13:48.190299+0000","last_clean":"2024-09-12T18:13:48.190299+0000","last_became_active":"2024-09-12T17:00:20.352792+0000","last_became_peered":"2024-09-12T17:00:20.352792+0000","last_unstale":"2024-09-12T18:13:48.190299+0000","last_undegraded":"2024-09-12T18:13:48.190299+0000","last_fullsized":"2024-09-12T18:13:48.190299+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:31.802808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'111","reported_seq":615,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.521752+0000","last_change":"2024-09-12T17:00:22.352596+0000","last_active":"2024-09-12T18:12:00.521752+0000","last_peered":"2024-09-12T18:12:00.521752+0000","last_clean":"2024-09-12T18:12:00.521752+0000","last_became_active":"2024-09-12T17:00:22.352182+0000","last_became_peered":"2024-09-12T17:00:22.352182+0000","last_unstale":"2024-09-12T18:12:00.521752+0000","last_undegraded":"2024-09-12T18:12:00.521752+0000","last_fullsized":"2024-09-12T18:12:00.521752+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:18.301972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":119,"num_write":244,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'121","reported_seq":774,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.105357+0000","last_change":"2024-09-12T18:14:06.105357+0000","last_active":"2024-09-12T18:14:06.105357+0000","last_peered":"2024-09-12T18:14:06.105357+0000","last_clean":"2024-09-12T18:14:06.105357+0000","last_became_active":"2024-09-12T17:00:14.329394+0000","last_became_peered":"2024-09-12T17:00:14.329394+0000","last_unstale":"2024-09-12T18:14:06.105357+0000","last_undegraded":"2024-09-12T18:14:06.105357+0000","last_fullsized":"2024-09-12T18:14:06.105357+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'121","last_scrub_stamp":"2024-09-12T18:14:06.105271+0000","last_deep_scrub":"264'121","last_deep_scrub_stamp":"2024-09-12T18:14:06.105271+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.105271+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:06.164775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":562,"num_read_kb":483,"num_write":177,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'420","reported_seq":1118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.979078+0000","last_change":"2024-09-12T18:13:59.979078+0000","last_active":"2024-09-12T18:13:59.979078+0000","last_peered":"2024-09-12T18:13:59.979078+0000","last_clean":"2024-09-12T18:13:59.979078+0000","last_became_active":"2024-09-12T17:00:12.314142+0000","last_became_peered":"2024-09-12T17:00:12.314142+0000","last_unstale":"2024-09-12T18:13:59.979078+0000","last_undegraded":"2024-09-12T18:13:59.979078+0000","last_fullsized":"2024-09-12T18:13:59.979078+0000","mapping_epoch":24,"log_start":"264'400","ondisk_log_start":"264'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'420","last_scrub_stamp":"2024-09-12T18:13:59.978965+0000","last_deep_scrub":"264'420","last_deep_scrub_stamp":"2024-09-12T18:13:59.978965+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.978965+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:13.441168+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306453,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":807,"num_read_kb":14993,"num_write":1145,"num_write_kb":29270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:00.750294+0000","last_change":"2024-09-12T17:00:16.328779+0000","last_active":"2024-09-12T18:10:00.750294+0000","last_peered":"2024-09-12T18:10:00.750294+0000","last_clean":"2024-09-12T18:10:00.750294+0000","last_became_active":"2024-09-12T17:00:16.328306+0000","last_became_peered":"2024-09-12T17:00:16.328306+0000","last_unstale":"2024-09-12T18:10:00.750294+0000","last_undegraded":"2024-09-12T18:10:00.750294+0000","last_fullsized":"2024-09-12T18:10:00.750294+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:34.580723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'388","reported_seq":1021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.013468+0000","last_change":"2024-09-12T17:00:18.328815+0000","last_active":"2024-09-12T18:13:49.013468+0000","last_peered":"2024-09-12T18:13:49.013468+0000","last_clean":"2024-09-12T18:13:49.013468+0000","last_became_active":"2024-09-12T17:00:18.328500+0000","last_became_peered":"2024-09-12T17:00:18.328500+0000","last_unstale":"2024-09-12T18:13:49.013468+0000","last_undegraded":"2024-09-12T18:13:49.013468+0000","last_fullsized":"2024-09-12T18:13:49.013468+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:13.655611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46864,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":620,"num_read_kb":1249,"num_write":480,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:07.740171+0000","last_change":"2024-09-12T17:00:20.350311+0000","last_active":"2024-09-12T18:10:07.740171+0000","last_peered":"2024-09-12T18:10:07.740171+0000","last_clean":"2024-09-12T18:10:07.740171+0000","last_became_active":"2024-09-12T17:00:20.350003+0000","last_became_peered":"2024-09-12T17:00:20.350003+0000","last_unstale":"2024-09-12T18:10:07.740171+0000","last_undegraded":"2024-09-12T18:10:07.740171+0000","last_fullsized":"2024-09-12T18:10:07.740171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:27.609870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'130","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.096280+0000","last_change":"2024-09-12T17:00:22.354899+0000","last_active":"2024-09-12T18:12:03.096280+0000","last_peered":"2024-09-12T18:12:03.096280+0000","last_clean":"2024-09-12T18:12:03.096280+0000","last_became_active":"2024-09-12T17:00:22.354601+0000","last_became_peered":"2024-09-12T17:00:22.354601+0000","last_unstale":"2024-09-12T18:12:03.096280+0000","last_undegraded":"2024-09-12T18:12:03.096280+0000","last_fullsized":"2024-09-12T18:12:03.096280+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:04.146875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":184,"num_read_kb":175,"num_write":297,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'263","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.038272+0000","last_change":"2024-09-12T18:14:06.038272+0000","last_active":"2024-09-12T18:14:06.038272+0000","last_peered":"2024-09-12T18:14:06.038272+0000","last_clean":"2024-09-12T18:14:06.038272+0000","last_became_active":"2024-09-12T17:00:14.329297+0000","last_became_peered":"2024-09-12T17:00:14.329297+0000","last_unstale":"2024-09-12T18:14:06.038272+0000","last_undegraded":"2024-09-12T18:14:06.038272+0000","last_fullsized":"2024-09-12T18:14:06.038272+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'263","last_scrub_stamp":"2024-09-12T18:14:06.038186+0000","last_deep_scrub":"264'263","last_deep_scrub_stamp":"2024-09-12T18:14:06.038186+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.038186+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:05.593867+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1103,"num_read_kb":898,"num_write":417,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.163457+0000","last_change":"2024-09-12T18:13:58.163398+0000","last_active":"2024-09-12T18:13:58.163457+0000","last_peered":"2024-09-12T18:13:58.163457+0000","last_clean":"2024-09-12T18:13:58.163457+0000","last_became_active":"2024-09-12T16:59:54.636487+0000","last_became_peered":"2024-09-12T16:59:54.636487+0000","last_unstale":"2024-09-12T18:13:58.163457+0000","last_undegraded":"2024-09-12T18:13:58.163457+0000","last_fullsized":"2024-09-12T18:13:58.163457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-12T18:13:58.163290+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-12T18:13:58.163290+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.163290+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:28.159963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":539,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.475103+0000","last_change":"2024-09-12T18:13:58.475103+0000","last_active":"2024-09-12T18:13:58.475103+0000","last_peered":"2024-09-12T18:13:58.475103+0000","last_clean":"2024-09-12T18:13:58.475103+0000","last_became_active":"2024-09-12T17:00:00.669728+0000","last_became_peered":"2024-09-12T17:00:00.669728+0000","last_unstale":"2024-09-12T18:13:58.475103+0000","last_undegraded":"2024-09-12T18:13:58.475103+0000","last_fullsized":"2024-09-12T18:13:58.475103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:13:58.475005+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:13:58.475005+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.475005+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:02.835560+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00058116500000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'384","reported_seq":1079,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.120325+0000","last_change":"2024-09-12T18:13:58.120325+0000","last_active":"2024-09-12T18:13:58.120325+0000","last_peered":"2024-09-12T18:13:58.120325+0000","last_clean":"2024-09-12T18:13:58.120325+0000","last_became_active":"2024-09-12T17:00:46.404905+0000","last_became_peered":"2024-09-12T17:00:46.404905+0000","last_unstale":"2024-09-12T18:13:58.120325+0000","last_undegraded":"2024-09-12T18:13:58.120325+0000","last_fullsized":"2024-09-12T18:13:58.120325+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'384","last_scrub_stamp":"2024-09-12T18:13:58.120248+0000","last_deep_scrub":"264'384","last_deep_scrub_stamp":"2024-09-12T18:13:58.120248+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.120248+0000","objects_scrubbed":7,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:48.874148+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524314,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":662,"num_read_kb":82700,"num_write":1255,"num_write_kb":21344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.763082+0000","last_change":"2024-09-12T17:00:16.321475+0000","last_active":"2024-09-12T18:11:07.763082+0000","last_peered":"2024-09-12T18:11:07.763082+0000","last_clean":"2024-09-12T18:11:07.763082+0000","last_became_active":"2024-09-12T17:00:16.321151+0000","last_became_peered":"2024-09-12T17:00:16.321151+0000","last_unstale":"2024-09-12T18:11:07.763082+0000","last_undegraded":"2024-09-12T18:11:07.763082+0000","last_fullsized":"2024-09-12T18:11:07.763082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:40.509096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'754","reported_seq":1473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.449821+0000","last_change":"2024-09-12T17:00:18.330396+0000","last_active":"2024-09-12T18:13:49.449821+0000","last_peered":"2024-09-12T18:13:49.449821+0000","last_clean":"2024-09-12T18:13:49.449821+0000","last_became_active":"2024-09-12T17:00:18.330037+0000","last_became_peered":"2024-09-12T17:00:18.330037+0000","last_unstale":"2024-09-12T18:13:49.449821+0000","last_undegraded":"2024-09-12T18:13:49.449821+0000","last_fullsized":"2024-09-12T18:13:49.449821+0000","mapping_epoch":30,"log_start":"264'700","ondisk_log_start":"264'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153681,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1487,"num_read_kb":3466,"num_write":1434,"num_write_kb":1274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.629206+0000","last_change":"2024-09-12T17:00:20.349669+0000","last_active":"2024-09-12T18:11:51.629206+0000","last_peered":"2024-09-12T18:11:51.629206+0000","last_clean":"2024-09-12T18:11:51.629206+0000","last_became_active":"2024-09-12T17:00:20.349363+0000","last_became_peered":"2024-09-12T17:00:20.349363+0000","last_unstale":"2024-09-12T18:11:51.629206+0000","last_undegraded":"2024-09-12T18:11:51.629206+0000","last_fullsized":"2024-09-12T18:11:51.629206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'187","reported_seq":889,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.991659+0000","last_change":"2024-09-12T17:00:22.354974+0000","last_active":"2024-09-12T18:12:02.991659+0000","last_peered":"2024-09-12T18:12:02.991659+0000","last_clean":"2024-09-12T18:12:02.991659+0000","last_became_active":"2024-09-12T17:00:22.354654+0000","last_became_peered":"2024-09-12T17:00:22.354654+0000","last_unstale":"2024-09-12T18:12:02.991659+0000","last_undegraded":"2024-09-12T18:12:02.991659+0000","last_fullsized":"2024-09-12T18:12:02.991659+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":450,"num_read_kb":449,"num_write":373,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'132","reported_seq":751,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.085111+0000","last_change":"2024-09-12T18:14:05.085111+0000","last_active":"2024-09-12T18:14:05.085111+0000","last_peered":"2024-09-12T18:14:05.085111+0000","last_clean":"2024-09-12T18:14:05.085111+0000","last_became_active":"2024-09-12T17:00:14.319539+0000","last_became_peered":"2024-09-12T17:00:14.319539+0000","last_unstale":"2024-09-12T18:14:05.085111+0000","last_undegraded":"2024-09-12T18:14:05.085111+0000","last_fullsized":"2024-09-12T18:14:05.085111+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'132","last_scrub_stamp":"2024-09-12T18:14:05.085020+0000","last_deep_scrub":"264'132","last_deep_scrub_stamp":"2024-09-12T18:14:05.085020+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.085020+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:53.322244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":596,"num_read_kb":500,"num_write":197,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.182258+0000","last_change":"2024-09-12T18:13:59.182258+0000","last_active":"2024-09-12T18:13:59.182258+0000","last_peered":"2024-09-12T18:13:59.182258+0000","last_clean":"2024-09-12T18:13:59.182258+0000","last_became_active":"2024-09-12T17:00:00.671211+0000","last_became_peered":"2024-09-12T17:00:00.671211+0000","last_unstale":"2024-09-12T18:13:59.182258+0000","last_undegraded":"2024-09-12T18:13:59.182258+0000","last_fullsized":"2024-09-12T18:13:59.182258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:59.182180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:59.182180+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.182180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:05.491469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000441562,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'332","reported_seq":1024,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.150556+0000","last_change":"2024-09-12T18:13:58.150556+0000","last_active":"2024-09-12T18:13:58.150556+0000","last_peered":"2024-09-12T18:13:58.150556+0000","last_clean":"2024-09-12T18:13:58.150556+0000","last_became_active":"2024-09-12T17:00:12.306408+0000","last_became_peered":"2024-09-12T17:00:12.306408+0000","last_unstale":"2024-09-12T18:13:58.150556+0000","last_undegraded":"2024-09-12T18:13:58.150556+0000","last_fullsized":"2024-09-12T18:13:58.150556+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-12T18:13:58.150468+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-12T18:13:58.150468+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.150468+0000","objects_scrubbed":9,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:01.376992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1499227,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":518,"num_read_kb":8959,"num_write":977,"num_write_kb":13821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.967975+0000","last_change":"2024-09-12T17:00:16.326370+0000","last_active":"2024-09-12T18:11:47.967975+0000","last_peered":"2024-09-12T18:11:47.967975+0000","last_clean":"2024-09-12T18:11:47.967975+0000","last_became_active":"2024-09-12T17:00:16.325914+0000","last_became_peered":"2024-09-12T17:00:16.325914+0000","last_unstale":"2024-09-12T18:11:47.967975+0000","last_undegraded":"2024-09-12T18:11:47.967975+0000","last_fullsized":"2024-09-12T18:11:47.967975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1365","reported_seq":3212,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.182612+0000","last_change":"2024-09-12T18:14:13.182612+0000","last_active":"2024-09-12T18:14:13.182612+0000","last_peered":"2024-09-12T18:14:13.182612+0000","last_clean":"2024-09-12T18:14:13.182612+0000","last_became_active":"2024-09-12T17:00:18.330715+0000","last_became_peered":"2024-09-12T17:00:18.330715+0000","last_unstale":"2024-09-12T18:14:13.182612+0000","last_undegraded":"2024-09-12T18:14:13.182612+0000","last_fullsized":"2024-09-12T18:14:13.182612+0000","mapping_epoch":30,"log_start":"264'1300","ondisk_log_start":"264'1300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1365","last_scrub_stamp":"2024-09-12T18:14:13.182494+0000","last_deep_scrub":"264'1365","last_deep_scrub_stamp":"2024-09-12T18:14:13.182494+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.182494+0000","objects_scrubbed":11,"log_size":65,"log_dups_size":1300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:53.314146+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154155,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2179,"num_read_kb":4259,"num_write":1270,"num_write_kb":1078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:27.766397+0000","last_change":"2024-09-12T17:00:20.352790+0000","last_active":"2024-09-12T18:11:27.766397+0000","last_peered":"2024-09-12T18:11:27.766397+0000","last_clean":"2024-09-12T18:11:27.766397+0000","last_became_active":"2024-09-12T17:00:20.352287+0000","last_became_peered":"2024-09-12T17:00:20.352287+0000","last_unstale":"2024-09-12T18:11:27.766397+0000","last_undegraded":"2024-09-12T18:11:27.766397+0000","last_fullsized":"2024-09-12T18:11:27.766397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:15.288688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'96","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.928594+0000","last_change":"2024-09-12T17:00:22.587542+0000","last_active":"2024-09-12T18:12:08.928594+0000","last_peered":"2024-09-12T18:12:08.928594+0000","last_clean":"2024-09-12T18:12:08.928594+0000","last_became_active":"2024-09-12T17:00:22.587206+0000","last_became_peered":"2024-09-12T17:00:22.587206+0000","last_unstale":"2024-09-12T18:12:08.928594+0000","last_undegraded":"2024-09-12T18:12:08.928594+0000","last_fullsized":"2024-09-12T18:12:08.928594+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:21.704751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":151,"num_write":236,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'4068","reported_seq":4661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.108609+0000","last_change":"2024-09-12T18:14:05.108609+0000","last_active":"2024-09-12T18:14:05.108609+0000","last_peered":"2024-09-12T18:14:05.108609+0000","last_clean":"2024-09-12T18:14:05.108609+0000","last_became_active":"2024-09-12T17:00:14.331560+0000","last_became_peered":"2024-09-12T17:00:14.331560+0000","last_unstale":"2024-09-12T18:14:05.108609+0000","last_undegraded":"2024-09-12T18:14:05.108609+0000","last_fullsized":"2024-09-12T18:14:05.108609+0000","mapping_epoch":26,"log_start":"264'4000","ondisk_log_start":"264'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4068","last_scrub_stamp":"2024-09-12T18:14:05.108524+0000","last_deep_scrub":"264'4068","last_deep_scrub_stamp":"2024-09-12T18:14:05.108524+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.108524+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":3000,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:03.977064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16331,"num_read_kb":13702,"num_write":6093,"num_write_kb":3038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":537,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:56.176811+0000","last_change":"2024-09-12T18:13:56.176811+0000","last_active":"2024-09-12T18:13:56.176811+0000","last_peered":"2024-09-12T18:13:56.176811+0000","last_clean":"2024-09-12T18:13:56.176811+0000","last_became_active":"2024-09-12T17:00:01.173083+0000","last_became_peered":"2024-09-12T17:00:01.173083+0000","last_unstale":"2024-09-12T18:13:56.176811+0000","last_undegraded":"2024-09-12T18:13:56.176811+0000","last_fullsized":"2024-09-12T18:13:56.176811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:56.176741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:56.176741+0000","last_clean_scrub_stamp":"2024-09-12T18:13:56.176741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:36.851800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056135799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'326","reported_seq":991,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:57.001192+0000","last_change":"2024-09-12T18:13:57.001192+0000","last_active":"2024-09-12T18:13:57.001192+0000","last_peered":"2024-09-12T18:13:57.001192+0000","last_clean":"2024-09-12T18:13:57.001192+0000","last_became_active":"2024-09-12T17:00:12.309100+0000","last_became_peered":"2024-09-12T17:00:12.309100+0000","last_unstale":"2024-09-12T18:13:57.001192+0000","last_undegraded":"2024-09-12T18:13:57.001192+0000","last_fullsized":"2024-09-12T18:13:57.001192+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-12T18:13:57.001116+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-12T18:13:57.001116+0000","last_clean_scrub_stamp":"2024-09-12T18:13:57.001116+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:44.466787+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655862,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":481,"num_read_kb":31712,"num_write":1051,"num_write_kb":22323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.116004+0000","last_change":"2024-09-12T18:14:04.116004+0000","last_active":"2024-09-12T18:14:04.116004+0000","last_peered":"2024-09-12T18:14:04.116004+0000","last_clean":"2024-09-12T18:14:04.116004+0000","last_became_active":"2024-09-12T17:00:16.324792+0000","last_became_peered":"2024-09-12T17:00:16.324792+0000","last_unstale":"2024-09-12T18:14:04.116004+0000","last_undegraded":"2024-09-12T18:14:04.116004+0000","last_fullsized":"2024-09-12T18:14:04.116004+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:04.115917+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:04.115917+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.115917+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:04.636526+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'290","reported_seq":1723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.201178+0000","last_change":"2024-09-12T17:00:18.430289+0000","last_active":"2024-09-12T18:13:23.201178+0000","last_peered":"2024-09-12T18:13:23.201178+0000","last_clean":"2024-09-12T18:13:23.201178+0000","last_became_active":"2024-09-12T17:00:18.429997+0000","last_became_peered":"2024-09-12T17:00:18.429997+0000","last_unstale":"2024-09-12T18:13:23.201178+0000","last_undegraded":"2024-09-12T18:13:23.201178+0000","last_fullsized":"2024-09-12T18:13:23.201178+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:55.412482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":262,"num_read_kb":252,"num_write":239,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.624787+0000","last_change":"2024-09-12T17:00:20.353031+0000","last_active":"2024-09-12T18:11:11.624787+0000","last_peered":"2024-09-12T18:11:11.624787+0000","last_clean":"2024-09-12T18:11:11.624787+0000","last_became_active":"2024-09-12T17:00:20.350197+0000","last_became_peered":"2024-09-12T17:00:20.350197+0000","last_unstale":"2024-09-12T18:11:11.624787+0000","last_undegraded":"2024-09-12T18:11:11.624787+0000","last_fullsized":"2024-09-12T18:11:11.624787+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:17.466054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'275","reported_seq":881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.253630+0000","last_change":"2024-09-12T17:00:22.357898+0000","last_active":"2024-09-12T18:12:03.253630+0000","last_peered":"2024-09-12T18:12:03.253630+0000","last_clean":"2024-09-12T18:12:03.253630+0000","last_became_active":"2024-09-12T17:00:22.357583+0000","last_became_peered":"2024-09-12T17:00:22.357583+0000","last_unstale":"2024-09-12T18:12:03.253630+0000","last_undegraded":"2024-09-12T18:12:03.253630+0000","last_fullsized":"2024-09-12T18:12:03.253630+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:16.279162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":565,"num_read_kb":582,"num_write":607,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'184","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.051253+0000","last_change":"2024-09-12T18:14:03.051253+0000","last_active":"2024-09-12T18:14:03.051253+0000","last_peered":"2024-09-12T18:14:03.051253+0000","last_clean":"2024-09-12T18:14:03.051253+0000","last_became_active":"2024-09-12T17:00:14.324830+0000","last_became_peered":"2024-09-12T17:00:14.324830+0000","last_unstale":"2024-09-12T18:14:03.051253+0000","last_undegraded":"2024-09-12T18:14:03.051253+0000","last_fullsized":"2024-09-12T18:14:03.051253+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'184","last_scrub_stamp":"2024-09-12T18:14:03.051167+0000","last_deep_scrub":"264'184","last_deep_scrub_stamp":"2024-09-12T18:14:03.051167+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.051167+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:33.058051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":771,"num_read_kb":626,"num_write":320,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":540,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:57.445513+0000","last_change":"2024-09-12T18:13:57.445513+0000","last_active":"2024-09-12T18:13:57.445513+0000","last_peered":"2024-09-12T18:13:57.445513+0000","last_clean":"2024-09-12T18:13:57.445513+0000","last_became_active":"2024-09-12T17:00:00.668696+0000","last_became_peered":"2024-09-12T17:00:00.668696+0000","last_unstale":"2024-09-12T18:13:57.445513+0000","last_undegraded":"2024-09-12T18:13:57.445513+0000","last_fullsized":"2024-09-12T18:13:57.445513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:13:57.445431+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:13:57.445431+0000","last_clean_scrub_stamp":"2024-09-12T18:13:57.445431+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:24.702957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0012259720000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'362","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:56.795679+0000","last_change":"2024-09-12T18:13:56.795679+0000","last_active":"2024-09-12T18:13:56.795679+0000","last_peered":"2024-09-12T18:13:56.795679+0000","last_clean":"2024-09-12T18:13:56.795679+0000","last_became_active":"2024-09-12T17:00:12.315813+0000","last_became_peered":"2024-09-12T17:00:12.315813+0000","last_unstale":"2024-09-12T18:13:56.795679+0000","last_undegraded":"2024-09-12T18:13:56.795679+0000","last_fullsized":"2024-09-12T18:13:56.795679+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'362","last_scrub_stamp":"2024-09-12T18:13:56.795572+0000","last_deep_scrub":"264'362","last_deep_scrub_stamp":"2024-09-12T18:13:56.795572+0000","last_clean_scrub_stamp":"2024-09-12T18:13:56.795572+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:52:27.168227+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":472,"num_read_kb":35449,"num_write":1073,"num_write_kb":30387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:26.626503+0000","last_change":"2024-09-12T17:00:16.325100+0000","last_active":"2024-09-12T18:11:26.626503+0000","last_peered":"2024-09-12T18:11:26.626503+0000","last_clean":"2024-09-12T18:11:26.626503+0000","last_became_active":"2024-09-12T17:00:16.324683+0000","last_became_peered":"2024-09-12T17:00:16.324683+0000","last_unstale":"2024-09-12T18:11:26.626503+0000","last_undegraded":"2024-09-12T18:11:26.626503+0000","last_fullsized":"2024-09-12T18:11:26.626503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:22.409202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'157","reported_seq":718,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.210923+0000","last_change":"2024-09-12T17:00:18.327666+0000","last_active":"2024-09-12T18:13:23.210923+0000","last_peered":"2024-09-12T18:13:23.210923+0000","last_clean":"2024-09-12T18:13:23.210923+0000","last_became_active":"2024-09-12T17:00:18.327205+0000","last_became_peered":"2024-09-12T17:00:18.327205+0000","last_unstale":"2024-09-12T18:13:23.210923+0000","last_undegraded":"2024-09-12T18:13:23.210923+0000","last_fullsized":"2024-09-12T18:13:23.210923+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":197,"num_read_kb":191,"num_write":142,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.755352+0000","last_change":"2024-09-12T17:00:20.356502+0000","last_active":"2024-09-12T18:11:52.755352+0000","last_peered":"2024-09-12T18:11:52.755352+0000","last_clean":"2024-09-12T18:11:52.755352+0000","last_became_active":"2024-09-12T17:00:20.356122+0000","last_became_peered":"2024-09-12T17:00:20.356122+0000","last_unstale":"2024-09-12T18:11:52.755352+0000","last_undegraded":"2024-09-12T18:11:52.755352+0000","last_fullsized":"2024-09-12T18:11:52.755352+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'120","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.968672+0000","last_change":"2024-09-12T17:00:22.359257+0000","last_active":"2024-09-12T18:11:52.968672+0000","last_peered":"2024-09-12T18:11:52.968672+0000","last_clean":"2024-09-12T18:11:52.968672+0000","last_became_active":"2024-09-12T17:00:22.358888+0000","last_became_peered":"2024-09-12T17:00:22.358888+0000","last_unstale":"2024-09-12T18:11:52.968672+0000","last_undegraded":"2024-09-12T18:11:52.968672+0000","last_fullsized":"2024-09-12T18:11:52.968672+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":246,"num_write":283,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'172","reported_seq":812,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.091204+0000","last_change":"2024-09-12T18:14:04.091204+0000","last_active":"2024-09-12T18:14:04.091204+0000","last_peered":"2024-09-12T18:14:04.091204+0000","last_clean":"2024-09-12T18:14:04.091204+0000","last_became_active":"2024-09-12T17:00:14.330844+0000","last_became_peered":"2024-09-12T17:00:14.330844+0000","last_unstale":"2024-09-12T18:14:04.091204+0000","last_undegraded":"2024-09-12T18:14:04.091204+0000","last_fullsized":"2024-09-12T18:14:04.091204+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'172","last_scrub_stamp":"2024-09-12T18:14:04.091118+0000","last_deep_scrub":"264'172","last_deep_scrub_stamp":"2024-09-12T18:14:04.091118+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.091118+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:28.552302+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":795,"num_read_kb":654,"num_write":268,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'407","reported_seq":1095,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.459613+0000","last_change":"2024-09-12T18:13:59.459613+0000","last_active":"2024-09-12T18:13:59.459613+0000","last_peered":"2024-09-12T18:13:59.459613+0000","last_clean":"2024-09-12T18:13:59.459613+0000","last_became_active":"2024-09-12T17:00:12.318621+0000","last_became_peered":"2024-09-12T17:00:12.318621+0000","last_unstale":"2024-09-12T18:13:59.459613+0000","last_undegraded":"2024-09-12T18:13:59.459613+0000","last_fullsized":"2024-09-12T18:13:59.459613+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'407","last_scrub_stamp":"2024-09-12T18:13:59.459505+0000","last_deep_scrub":"264'407","last_deep_scrub_stamp":"2024-09-12T18:13:59.459505+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.459505+0000","objects_scrubbed":9,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:47.655177+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":592,"num_read_kb":4542,"num_write":1332,"num_write_kb":25874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:55.019040+0000","last_change":"2024-09-12T18:13:55.019040+0000","last_active":"2024-09-12T18:13:55.019040+0000","last_peered":"2024-09-12T18:13:55.019040+0000","last_clean":"2024-09-12T18:13:55.019040+0000","last_became_active":"2024-09-12T17:00:00.667379+0000","last_became_peered":"2024-09-12T17:00:00.667379+0000","last_unstale":"2024-09-12T18:13:55.019040+0000","last_undegraded":"2024-09-12T18:13:55.019040+0000","last_fullsized":"2024-09-12T18:13:55.019040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:55.018974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:55.018974+0000","last_clean_scrub_stamp":"2024-09-12T18:13:55.018974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:11.110303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056755300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:06.624201+0000","last_change":"2024-09-12T17:00:16.323271+0000","last_active":"2024-09-12T18:11:06.624201+0000","last_peered":"2024-09-12T18:11:06.624201+0000","last_clean":"2024-09-12T18:11:06.624201+0000","last_became_active":"2024-09-12T17:00:16.322854+0000","last_became_peered":"2024-09-12T17:00:16.322854+0000","last_unstale":"2024-09-12T18:11:06.624201+0000","last_undegraded":"2024-09-12T18:11:06.624201+0000","last_fullsized":"2024-09-12T18:11:06.624201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:28.816131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'664","reported_seq":1365,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.485776+0000","last_change":"2024-09-12T17:00:18.333420+0000","last_active":"2024-09-12T18:13:49.485776+0000","last_peered":"2024-09-12T18:13:49.485776+0000","last_clean":"2024-09-12T18:13:49.485776+0000","last_became_active":"2024-09-12T17:00:18.333147+0000","last_became_peered":"2024-09-12T17:00:18.333147+0000","last_unstale":"2024-09-12T18:13:49.485776+0000","last_undegraded":"2024-09-12T18:13:49.485776+0000","last_fullsized":"2024-09-12T18:13:49.485776+0000","mapping_epoch":30,"log_start":"264'600","ondisk_log_start":"264'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":600,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:53.163746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95805,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1770,"num_read_kb":3099,"num_write":2318,"num_write_kb":2109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:10.760988+0000","last_change":"2024-09-12T17:00:20.355077+0000","last_active":"2024-09-12T18:11:10.760988+0000","last_peered":"2024-09-12T18:11:10.760988+0000","last_clean":"2024-09-12T18:11:10.760988+0000","last_became_active":"2024-09-12T17:00:20.354771+0000","last_became_peered":"2024-09-12T17:00:20.354771+0000","last_unstale":"2024-09-12T18:11:10.760988+0000","last_undegraded":"2024-09-12T18:11:10.760988+0000","last_fullsized":"2024-09-12T18:11:10.760988+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:56.739823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'217","reported_seq":740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.100251+0000","last_change":"2024-09-12T17:00:22.588915+0000","last_active":"2024-09-12T18:12:01.100251+0000","last_peered":"2024-09-12T18:12:01.100251+0000","last_clean":"2024-09-12T18:12:01.100251+0000","last_became_active":"2024-09-12T17:00:22.588561+0000","last_became_peered":"2024-09-12T17:00:22.588561+0000","last_unstale":"2024-09-12T18:12:01.100251+0000","last_undegraded":"2024-09-12T18:12:01.100251+0000","last_fullsized":"2024-09-12T18:12:01.100251+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:58.487409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":223,"num_read_kb":213,"num_write":499,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'180","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.112249+0000","last_change":"2024-09-12T18:14:06.112249+0000","last_active":"2024-09-12T18:14:06.112249+0000","last_peered":"2024-09-12T18:14:06.112249+0000","last_clean":"2024-09-12T18:14:06.112249+0000","last_became_active":"2024-09-12T17:00:14.327268+0000","last_became_peered":"2024-09-12T17:00:14.327268+0000","last_unstale":"2024-09-12T18:14:06.112249+0000","last_undegraded":"2024-09-12T18:14:06.112249+0000","last_fullsized":"2024-09-12T18:14:06.112249+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'180","last_scrub_stamp":"2024-09-12T18:14:06.112165+0000","last_deep_scrub":"264'180","last_deep_scrub_stamp":"2024-09-12T18:14:06.112165+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.112165+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:05.334938+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":852,"num_read_kb":727,"num_write":266,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'349","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.024128+0000","last_change":"2024-09-12T18:13:58.024128+0000","last_active":"2024-09-12T18:13:58.024128+0000","last_peered":"2024-09-12T18:13:58.024128+0000","last_clean":"2024-09-12T18:13:58.024128+0000","last_became_active":"2024-09-12T17:00:12.309896+0000","last_became_peered":"2024-09-12T17:00:12.309896+0000","last_unstale":"2024-09-12T18:13:58.024128+0000","last_undegraded":"2024-09-12T18:13:58.024128+0000","last_fullsized":"2024-09-12T18:13:58.024128+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'349","last_scrub_stamp":"2024-09-12T18:13:58.024056+0000","last_deep_scrub":"264'349","last_deep_scrub_stamp":"2024-09-12T18:13:58.024056+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.024056+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:20.085472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":595,"num_read_kb":32728,"num_write":1244,"num_write_kb":26986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":532,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.217713+0000","last_change":"2024-09-12T18:14:03.217713+0000","last_active":"2024-09-12T18:14:03.217713+0000","last_peered":"2024-09-12T18:14:03.217713+0000","last_clean":"2024-09-12T18:14:03.217713+0000","last_became_active":"2024-09-12T17:00:00.670355+0000","last_became_peered":"2024-09-12T17:00:00.670355+0000","last_unstale":"2024-09-12T18:14:03.217713+0000","last_undegraded":"2024-09-12T18:14:03.217713+0000","last_fullsized":"2024-09-12T18:14:03.217713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:03.217597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:03.217597+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.217597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:02.459061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042464500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.141505+0000","last_change":"2024-09-12T18:14:11.141505+0000","last_active":"2024-09-12T18:14:11.141505+0000","last_peered":"2024-09-12T18:14:11.141505+0000","last_clean":"2024-09-12T18:14:11.141505+0000","last_became_active":"2024-09-12T17:00:16.323157+0000","last_became_peered":"2024-09-12T17:00:16.323157+0000","last_unstale":"2024-09-12T18:14:11.141505+0000","last_undegraded":"2024-09-12T18:14:11.141505+0000","last_fullsized":"2024-09-12T18:14:11.141505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:11.141420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:11.141420+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.141420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:34.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'213","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.796757+0000","last_change":"2024-09-12T17:00:18.429323+0000","last_active":"2024-09-12T18:11:11.796757+0000","last_peered":"2024-09-12T18:11:11.796757+0000","last_clean":"2024-09-12T18:11:11.796757+0000","last_became_active":"2024-09-12T17:00:18.428978+0000","last_became_peered":"2024-09-12T17:00:18.428978+0000","last_unstale":"2024-09-12T18:11:11.796757+0000","last_undegraded":"2024-09-12T18:11:11.796757+0000","last_fullsized":"2024-09-12T18:11:11.796757+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:03.066210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":266,"num_read_kb":257,"num_write":182,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'773","reported_seq":2989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.174296+0000","last_change":"2024-09-12T17:00:20.345525+0000","last_active":"2024-09-12T18:13:49.174296+0000","last_peered":"2024-09-12T18:13:49.174296+0000","last_clean":"2024-09-12T18:13:49.174296+0000","last_became_active":"2024-09-12T17:00:20.345236+0000","last_became_peered":"2024-09-12T17:00:20.345236+0000","last_unstale":"2024-09-12T18:13:49.174296+0000","last_undegraded":"2024-09-12T18:13:49.174296+0000","last_fullsized":"2024-09-12T18:13:49.174296+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:26.183021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'111","reported_seq":634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:31.859446+0000","last_change":"2024-09-12T17:00:22.587755+0000","last_active":"2024-09-12T18:12:31.859446+0000","last_peered":"2024-09-12T18:12:31.859446+0000","last_clean":"2024-09-12T18:12:31.859446+0000","last_became_active":"2024-09-12T17:00:22.587443+0000","last_became_peered":"2024-09-12T17:00:22.587443+0000","last_unstale":"2024-09-12T18:12:31.859446+0000","last_undegraded":"2024-09-12T18:12:31.859446+0000","last_fullsized":"2024-09-12T18:12:31.859446+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:05.679814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":705,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":239,"num_read_kb":213,"num_write":277,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'317","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.843564+0000","last_change":"2024-09-12T17:00:14.333428+0000","last_active":"2024-09-12T18:10:26.843564+0000","last_peered":"2024-09-12T18:10:26.843564+0000","last_clean":"2024-09-12T18:10:26.843564+0000","last_became_active":"2024-09-12T17:00:14.333128+0000","last_became_peered":"2024-09-12T17:00:14.333128+0000","last_unstale":"2024-09-12T18:10:26.843564+0000","last_undegraded":"2024-09-12T18:10:26.843564+0000","last_fullsized":"2024-09-12T18:10:26.843564+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:34.464037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1338,"num_read_kb":1083,"num_write":472,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'372","reported_seq":1036,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:55.895288+0000","last_change":"2024-09-12T18:13:55.895288+0000","last_active":"2024-09-12T18:13:55.895288+0000","last_peered":"2024-09-12T18:13:55.895288+0000","last_clean":"2024-09-12T18:13:55.895288+0000","last_became_active":"2024-09-12T17:00:12.315812+0000","last_became_peered":"2024-09-12T17:00:12.315812+0000","last_unstale":"2024-09-12T18:13:55.895288+0000","last_undegraded":"2024-09-12T18:13:55.895288+0000","last_fullsized":"2024-09-12T18:13:55.895288+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-12T18:13:55.895167+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-12T18:13:55.895167+0000","last_clean_scrub_stamp":"2024-09-12T18:13:55.895167+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:05.686531+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1826072,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":562,"num_read_kb":23161,"num_write":1132,"num_write_kb":14173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":541,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:56.006554+0000","last_change":"2024-09-12T18:13:56.006554+0000","last_active":"2024-09-12T18:13:56.006554+0000","last_peered":"2024-09-12T18:13:56.006554+0000","last_clean":"2024-09-12T18:13:56.006554+0000","last_became_active":"2024-09-12T17:00:00.669898+0000","last_became_peered":"2024-09-12T17:00:00.669898+0000","last_unstale":"2024-09-12T18:13:56.006554+0000","last_undegraded":"2024-09-12T18:13:56.006554+0000","last_fullsized":"2024-09-12T18:13:56.006554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:56.006481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:56.006481+0000","last_clean_scrub_stamp":"2024-09-12T18:13:56.006481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:45.117992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060387199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:05.760206+0000","last_change":"2024-09-12T17:00:16.327641+0000","last_active":"2024-09-12T18:11:05.760206+0000","last_peered":"2024-09-12T18:11:05.760206+0000","last_clean":"2024-09-12T18:11:05.760206+0000","last_became_active":"2024-09-12T17:00:16.327270+0000","last_became_peered":"2024-09-12T17:00:16.327270+0000","last_unstale":"2024-09-12T18:11:05.760206+0000","last_undegraded":"2024-09-12T18:11:05.760206+0000","last_fullsized":"2024-09-12T18:11:05.760206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:48.314834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'129","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.726748+0000","last_change":"2024-09-12T17:00:18.328546+0000","last_active":"2024-09-12T18:11:11.726748+0000","last_peered":"2024-09-12T18:11:11.726748+0000","last_clean":"2024-09-12T18:11:11.726748+0000","last_became_active":"2024-09-12T17:00:18.327994+0000","last_became_peered":"2024-09-12T17:00:18.327994+0000","last_unstale":"2024-09-12T18:11:11.726748+0000","last_undegraded":"2024-09-12T18:11:11.726748+0000","last_fullsized":"2024-09-12T18:11:11.726748+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:08.620648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":161,"num_write":110,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'775","reported_seq":2837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.820968+0000","last_change":"2024-09-12T17:00:20.354844+0000","last_active":"2024-09-12T18:13:48.820968+0000","last_peered":"2024-09-12T18:13:48.820968+0000","last_clean":"2024-09-12T18:13:48.820968+0000","last_became_active":"2024-09-12T17:00:20.354519+0000","last_became_peered":"2024-09-12T17:00:20.354519+0000","last_unstale":"2024-09-12T18:13:48.820968+0000","last_undegraded":"2024-09-12T18:13:48.820968+0000","last_fullsized":"2024-09-12T18:13:48.820968+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:52.962681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'283","reported_seq":819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.915298+0000","last_change":"2024-09-12T17:00:22.356453+0000","last_active":"2024-09-12T18:12:01.915298+0000","last_peered":"2024-09-12T18:12:01.915298+0000","last_clean":"2024-09-12T18:12:01.915298+0000","last_became_active":"2024-09-12T17:00:22.356132+0000","last_became_peered":"2024-09-12T17:00:22.356132+0000","last_unstale":"2024-09-12T18:12:01.915298+0000","last_undegraded":"2024-09-12T18:12:01.915298+0000","last_fullsized":"2024-09-12T18:12:01.915298+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:55.124427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":378,"num_read_kb":377,"num_write":631,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'145","reported_seq":770,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.854434+0000","last_change":"2024-09-12T18:14:01.854434+0000","last_active":"2024-09-12T18:14:01.854434+0000","last_peered":"2024-09-12T18:14:01.854434+0000","last_clean":"2024-09-12T18:14:01.854434+0000","last_became_active":"2024-09-12T17:00:14.330433+0000","last_became_peered":"2024-09-12T17:00:14.330433+0000","last_unstale":"2024-09-12T18:14:01.854434+0000","last_undegraded":"2024-09-12T18:14:01.854434+0000","last_fullsized":"2024-09-12T18:14:01.854434+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'145","last_scrub_stamp":"2024-09-12T18:14:01.854354+0000","last_deep_scrub":"264'145","last_deep_scrub_stamp":"2024-09-12T18:14:01.854354+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.854354+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:27.445208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":651,"num_read_kb":539,"num_write":208,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'378","reported_seq":1154,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:57.123146+0000","last_change":"2024-09-12T18:13:57.123146+0000","last_active":"2024-09-12T18:13:57.123146+0000","last_peered":"2024-09-12T18:13:57.123146+0000","last_clean":"2024-09-12T18:13:57.123146+0000","last_became_active":"2024-09-12T17:00:12.307371+0000","last_became_peered":"2024-09-12T17:00:12.307371+0000","last_unstale":"2024-09-12T18:13:57.123146+0000","last_undegraded":"2024-09-12T18:13:57.123146+0000","last_fullsized":"2024-09-12T18:13:57.123146+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'378","last_scrub_stamp":"2024-09-12T18:13:57.123003+0000","last_deep_scrub":"264'378","last_deep_scrub_stamp":"2024-09-12T18:13:57.123003+0000","last_clean_scrub_stamp":"2024-09-12T18:13:57.123003+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:45.220960+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262175,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":835,"num_read_kb":7035,"num_write":1193,"num_write_kb":32501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.077086+0000","last_change":"2024-09-12T18:13:59.077086+0000","last_active":"2024-09-12T18:13:59.077086+0000","last_peered":"2024-09-12T18:13:59.077086+0000","last_clean":"2024-09-12T18:13:59.077086+0000","last_became_active":"2024-09-12T17:00:00.670451+0000","last_became_peered":"2024-09-12T17:00:00.670451+0000","last_unstale":"2024-09-12T18:13:59.077086+0000","last_undegraded":"2024-09-12T18:13:59.077086+0000","last_fullsized":"2024-09-12T18:13:59.077086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:59.077001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:59.077001+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.077001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:10.341382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046867000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.843580+0000","last_change":"2024-09-12T17:00:16.326975+0000","last_active":"2024-09-12T18:10:26.843580+0000","last_peered":"2024-09-12T18:10:26.843580+0000","last_clean":"2024-09-12T18:10:26.843580+0000","last_became_active":"2024-09-12T17:00:16.326163+0000","last_became_peered":"2024-09-12T17:00:16.326163+0000","last_unstale":"2024-09-12T18:10:26.843580+0000","last_undegraded":"2024-09-12T18:10:26.843580+0000","last_fullsized":"2024-09-12T18:10:26.843580+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:07.452685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'789","reported_seq":1528,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.935550+0000","last_change":"2024-09-12T17:00:18.429419+0000","last_active":"2024-09-12T18:13:48.935550+0000","last_peered":"2024-09-12T18:13:48.935550+0000","last_clean":"2024-09-12T18:13:48.935550+0000","last_became_active":"2024-09-12T17:00:18.429131+0000","last_became_peered":"2024-09-12T17:00:18.429131+0000","last_unstale":"2024-09-12T18:13:48.935550+0000","last_undegraded":"2024-09-12T18:13:48.935550+0000","last_fullsized":"2024-09-12T18:13:48.935550+0000","mapping_epoch":30,"log_start":"264'700","ondisk_log_start":"264'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:04:14.159447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164213,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1409,"num_read_kb":3444,"num_write":1148,"num_write_kb":951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.848361+0000","last_change":"2024-09-12T17:00:20.350091+0000","last_active":"2024-09-12T18:11:11.848361+0000","last_peered":"2024-09-12T18:11:11.848361+0000","last_clean":"2024-09-12T18:11:11.848361+0000","last_became_active":"2024-09-12T17:00:20.349800+0000","last_became_peered":"2024-09-12T17:00:20.349800+0000","last_unstale":"2024-09-12T18:11:11.848361+0000","last_undegraded":"2024-09-12T18:11:11.848361+0000","last_fullsized":"2024-09-12T18:11:11.848361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:28:56.661972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'139","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:07.952151+0000","last_change":"2024-09-12T17:00:22.361129+0000","last_active":"2024-09-12T18:10:07.952151+0000","last_peered":"2024-09-12T18:10:07.952151+0000","last_clean":"2024-09-12T18:10:07.952151+0000","last_became_active":"2024-09-12T17:00:22.360730+0000","last_became_peered":"2024-09-12T17:00:22.360730+0000","last_unstale":"2024-09-12T18:10:07.952151+0000","last_undegraded":"2024-09-12T18:10:07.952151+0000","last_fullsized":"2024-09-12T18:10:07.952151+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:53.958932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":172,"num_read_kb":170,"num_write":343,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'181","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.194693+0000","last_change":"2024-09-12T17:00:22.354855+0000","last_active":"2024-09-12T18:12:03.194693+0000","last_peered":"2024-09-12T18:12:03.194693+0000","last_clean":"2024-09-12T18:12:03.194693+0000","last_became_active":"2024-09-12T17:00:22.354464+0000","last_became_peered":"2024-09-12T17:00:22.354464+0000","last_unstale":"2024-09-12T18:12:03.194693+0000","last_undegraded":"2024-09-12T18:12:03.194693+0000","last_fullsized":"2024-09-12T18:12:03.194693+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:18.356184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":465,"num_read_kb":419,"num_write":437,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'369","reported_seq":1053,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.917244+0000","last_change":"2024-09-12T18:14:06.917244+0000","last_active":"2024-09-12T18:14:06.917244+0000","last_peered":"2024-09-12T18:14:06.917244+0000","last_clean":"2024-09-12T18:14:06.917244+0000","last_became_active":"2024-09-12T17:00:14.329093+0000","last_became_peered":"2024-09-12T17:00:14.329093+0000","last_unstale":"2024-09-12T18:14:06.917244+0000","last_undegraded":"2024-09-12T18:14:06.917244+0000","last_fullsized":"2024-09-12T18:14:06.917244+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'369","last_scrub_stamp":"2024-09-12T18:14:06.917142+0000","last_deep_scrub":"264'369","last_deep_scrub_stamp":"2024-09-12T18:14:06.917142+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.917142+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:31.654357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1637,"num_read_kb":1326,"num_write":585,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'363","reported_seq":1112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.822164+0000","last_change":"2024-09-12T18:13:58.822164+0000","last_active":"2024-09-12T18:13:58.822164+0000","last_peered":"2024-09-12T18:13:58.822164+0000","last_clean":"2024-09-12T18:13:58.822164+0000","last_became_active":"2024-09-12T17:00:12.307309+0000","last_became_peered":"2024-09-12T17:00:12.307309+0000","last_unstale":"2024-09-12T18:13:58.822164+0000","last_undegraded":"2024-09-12T18:13:58.822164+0000","last_fullsized":"2024-09-12T18:13:58.822164+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'363","last_scrub_stamp":"2024-09-12T18:13:58.822062+0000","last_deep_scrub":"264'363","last_deep_scrub_stamp":"2024-09-12T18:13:58.822062+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.822062+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:04.753595+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":717,"num_read_kb":21828,"num_write":1272,"num_write_kb":15847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.138218+0000","last_change":"2024-09-12T18:14:11.138218+0000","last_active":"2024-09-12T18:14:11.138218+0000","last_peered":"2024-09-12T18:14:11.138218+0000","last_clean":"2024-09-12T18:14:11.138218+0000","last_became_active":"2024-09-12T17:00:16.325555+0000","last_became_peered":"2024-09-12T17:00:16.325555+0000","last_unstale":"2024-09-12T18:14:11.138218+0000","last_undegraded":"2024-09-12T18:14:11.138218+0000","last_fullsized":"2024-09-12T18:14:11.138218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:11.138123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:11.138123+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.138123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:08.175044+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'299","reported_seq":888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.175507+0000","last_change":"2024-09-12T17:00:18.328249+0000","last_active":"2024-09-12T18:13:49.175507+0000","last_peered":"2024-09-12T18:13:49.175507+0000","last_clean":"2024-09-12T18:13:49.175507+0000","last_became_active":"2024-09-12T17:00:18.327374+0000","last_became_peered":"2024-09-12T17:00:18.327374+0000","last_unstale":"2024-09-12T18:13:49.175507+0000","last_undegraded":"2024-09-12T18:13:49.175507+0000","last_fullsized":"2024-09-12T18:13:49.175507+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:36.522799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49267,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":497,"num_read_kb":1124,"num_write":398,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.842898+0000","last_change":"2024-09-12T17:00:20.353374+0000","last_active":"2024-09-12T18:10:21.842898+0000","last_peered":"2024-09-12T18:10:21.842898+0000","last_clean":"2024-09-12T18:10:21.842898+0000","last_became_active":"2024-09-12T17:00:20.352801+0000","last_became_peered":"2024-09-12T17:00:20.352801+0000","last_unstale":"2024-09-12T18:10:21.842898+0000","last_undegraded":"2024-09-12T18:10:21.842898+0000","last_fullsized":"2024-09-12T18:10:21.842898+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:10.323586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'192","reported_seq":718,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844219+0000","last_change":"2024-09-12T17:00:22.354964+0000","last_active":"2024-09-12T18:10:31.844219+0000","last_peered":"2024-09-12T18:10:31.844219+0000","last_clean":"2024-09-12T18:10:31.844219+0000","last_became_active":"2024-09-12T17:00:22.354651+0000","last_became_peered":"2024-09-12T17:00:22.354651+0000","last_unstale":"2024-09-12T18:10:31.844219+0000","last_undegraded":"2024-09-12T18:10:31.844219+0000","last_fullsized":"2024-09-12T18:10:31.844219+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:50.025969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":300,"num_read_kb":268,"num_write":394,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'230","reported_seq":874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.134035+0000","last_change":"2024-09-12T18:14:07.134035+0000","last_active":"2024-09-12T18:14:07.134035+0000","last_peered":"2024-09-12T18:14:07.134035+0000","last_clean":"2024-09-12T18:14:07.134035+0000","last_became_active":"2024-09-12T17:00:14.320955+0000","last_became_peered":"2024-09-12T17:00:14.320955+0000","last_unstale":"2024-09-12T18:14:07.134035+0000","last_undegraded":"2024-09-12T18:14:07.134035+0000","last_fullsized":"2024-09-12T18:14:07.134035+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'230","last_scrub_stamp":"2024-09-12T18:14:07.133902+0000","last_deep_scrub":"264'230","last_deep_scrub_stamp":"2024-09-12T18:14:07.133902+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.133902+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:28.413454+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1027,"num_read_kb":855,"num_write":338,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'407","reported_seq":1058,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.175316+0000","last_change":"2024-09-12T18:14:05.175316+0000","last_active":"2024-09-12T18:14:05.175316+0000","last_peered":"2024-09-12T18:14:05.175316+0000","last_clean":"2024-09-12T18:14:05.175316+0000","last_became_active":"2024-09-12T17:00:12.315834+0000","last_became_peered":"2024-09-12T17:00:12.315834+0000","last_unstale":"2024-09-12T18:14:05.175316+0000","last_undegraded":"2024-09-12T18:14:05.175316+0000","last_fullsized":"2024-09-12T18:14:05.175316+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'407","last_scrub_stamp":"2024-09-12T18:14:05.175171+0000","last_deep_scrub":"264'407","last_deep_scrub_stamp":"2024-09-12T18:14:05.175171+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.175171+0000","objects_scrubbed":7,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:55.926091+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3436700,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":549,"num_read_kb":44669,"num_write":1257,"num_write_kb":42862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:16.842404+0000","last_change":"2024-09-12T17:00:16.327598+0000","last_active":"2024-09-12T18:10:16.842404+0000","last_peered":"2024-09-12T18:10:16.842404+0000","last_clean":"2024-09-12T18:10:16.842404+0000","last_became_active":"2024-09-12T17:00:16.327292+0000","last_became_peered":"2024-09-12T17:00:16.327292+0000","last_unstale":"2024-09-12T18:10:16.842404+0000","last_undegraded":"2024-09-12T18:10:16.842404+0000","last_fullsized":"2024-09-12T18:10:16.842404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:28.781328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'50","reported_seq":574,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:00.089541+0000","last_change":"2024-09-12T17:00:18.331826+0000","last_active":"2024-09-12T18:11:00.089541+0000","last_peered":"2024-09-12T18:11:00.089541+0000","last_clean":"2024-09-12T18:11:00.089541+0000","last_became_active":"2024-09-12T17:00:18.331495+0000","last_became_peered":"2024-09-12T17:00:18.331495+0000","last_unstale":"2024-09-12T18:11:00.089541+0000","last_undegraded":"2024-09-12T18:11:00.089541+0000","last_fullsized":"2024-09-12T18:11:00.089541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:10.249483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.755874+0000","last_change":"2024-09-12T17:00:20.348626+0000","last_active":"2024-09-12T18:10:22.755874+0000","last_peered":"2024-09-12T18:10:22.755874+0000","last_clean":"2024-09-12T18:10:22.755874+0000","last_became_active":"2024-09-12T17:00:20.348274+0000","last_became_peered":"2024-09-12T17:00:20.348274+0000","last_unstale":"2024-09-12T18:10:22.755874+0000","last_undegraded":"2024-09-12T18:10:22.755874+0000","last_fullsized":"2024-09-12T18:10:22.755874+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:44.279723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'244","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.928095+0000","last_change":"2024-09-12T17:00:22.350497+0000","last_active":"2024-09-12T18:12:01.928095+0000","last_peered":"2024-09-12T18:12:01.928095+0000","last_clean":"2024-09-12T18:12:01.928095+0000","last_became_active":"2024-09-12T17:00:22.350195+0000","last_became_peered":"2024-09-12T17:00:22.350195+0000","last_unstale":"2024-09-12T18:12:01.928095+0000","last_undegraded":"2024-09-12T18:12:01.928095+0000","last_fullsized":"2024-09-12T18:12:01.928095+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:00.704663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":636,"num_read_kb":568,"num_write":560,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'163","reported_seq":765,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.985868+0000","last_change":"2024-09-12T18:14:04.985868+0000","last_active":"2024-09-12T18:14:04.985868+0000","last_peered":"2024-09-12T18:14:04.985868+0000","last_clean":"2024-09-12T18:14:04.985868+0000","last_became_active":"2024-09-12T17:00:14.334652+0000","last_became_peered":"2024-09-12T17:00:14.334652+0000","last_unstale":"2024-09-12T18:14:04.985868+0000","last_undegraded":"2024-09-12T18:14:04.985868+0000","last_fullsized":"2024-09-12T18:14:04.985868+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'163","last_scrub_stamp":"2024-09-12T18:14:04.985772+0000","last_deep_scrub":"264'163","last_deep_scrub_stamp":"2024-09-12T18:14:04.985772+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.985772+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:29.223174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":705,"num_read_kb":585,"num_write":252,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'373","reported_seq":1059,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.509915+0000","last_change":"2024-09-12T18:14:01.509915+0000","last_active":"2024-09-12T18:14:01.509915+0000","last_peered":"2024-09-12T18:14:01.509915+0000","last_clean":"2024-09-12T18:14:01.509915+0000","last_became_active":"2024-09-12T17:00:12.312629+0000","last_became_peered":"2024-09-12T17:00:12.312629+0000","last_unstale":"2024-09-12T18:14:01.509915+0000","last_undegraded":"2024-09-12T18:14:01.509915+0000","last_fullsized":"2024-09-12T18:14:01.509915+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-09-12T18:14:01.509785+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-09-12T18:14:01.509785+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.509785+0000","objects_scrubbed":8,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:46.142118+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524362,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":634,"num_read_kb":31722,"num_write":1487,"num_write_kb":32347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.755061+0000","last_change":"2024-09-12T17:00:16.327231+0000","last_active":"2024-09-12T18:10:17.755061+0000","last_peered":"2024-09-12T18:10:17.755061+0000","last_clean":"2024-09-12T18:10:17.755061+0000","last_became_active":"2024-09-12T17:00:16.326905+0000","last_became_peered":"2024-09-12T17:00:16.326905+0000","last_unstale":"2024-09-12T18:10:17.755061+0000","last_undegraded":"2024-09-12T18:10:17.755061+0000","last_fullsized":"2024-09-12T18:10:17.755061+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:18.823688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'346","reported_seq":950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.718326+0000","last_change":"2024-09-12T17:00:18.330035+0000","last_active":"2024-09-12T18:13:48.718326+0000","last_peered":"2024-09-12T18:13:48.718326+0000","last_clean":"2024-09-12T18:13:48.718326+0000","last_became_active":"2024-09-12T17:00:18.329759+0000","last_became_peered":"2024-09-12T17:00:18.329759+0000","last_unstale":"2024-09-12T18:13:48.718326+0000","last_undegraded":"2024-09-12T18:13:48.718326+0000","last_fullsized":"2024-09-12T18:13:48.718326+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:49.034586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50102,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":567,"num_read_kb":1243,"num_write":450,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.742473+0000","last_change":"2024-09-12T17:00:20.355975+0000","last_active":"2024-09-12T18:10:22.742473+0000","last_peered":"2024-09-12T18:10:22.742473+0000","last_clean":"2024-09-12T18:10:22.742473+0000","last_became_active":"2024-09-12T17:00:20.355629+0000","last_became_peered":"2024-09-12T17:00:20.355629+0000","last_unstale":"2024-09-12T18:10:22.742473+0000","last_undegraded":"2024-09-12T18:10:22.742473+0000","last_fullsized":"2024-09-12T18:10:22.742473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:01.719912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'125","reported_seq":653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954454+0000","last_change":"2024-09-12T17:00:22.360360+0000","last_active":"2024-09-12T18:10:22.954454+0000","last_peered":"2024-09-12T18:10:22.954454+0000","last_clean":"2024-09-12T18:10:22.954454+0000","last_became_active":"2024-09-12T17:00:22.360051+0000","last_became_peered":"2024-09-12T17:00:22.360051+0000","last_unstale":"2024-09-12T18:10:22.954454+0000","last_undegraded":"2024-09-12T18:10:22.954454+0000","last_fullsized":"2024-09-12T18:10:22.954454+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:14:23.925876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":246,"num_read_kb":229,"num_write":325,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'696","reported_seq":1442,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:16.842347+0000","last_change":"2024-09-12T17:00:14.338751+0000","last_active":"2024-09-12T18:10:16.842347+0000","last_peered":"2024-09-12T18:10:16.842347+0000","last_clean":"2024-09-12T18:10:16.842347+0000","last_became_active":"2024-09-12T17:00:14.338453+0000","last_became_peered":"2024-09-12T17:00:14.338453+0000","last_unstale":"2024-09-12T18:10:16.842347+0000","last_undegraded":"2024-09-12T18:10:16.842347+0000","last_fullsized":"2024-09-12T18:10:16.842347+0000","mapping_epoch":26,"log_start":"264'600","ondisk_log_start":"264'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:37.142336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3211,"num_read_kb":2592,"num_write":1218,"num_write_kb":764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'376","reported_seq":1025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:56.083789+0000","last_change":"2024-09-12T18:13:56.083789+0000","last_active":"2024-09-12T18:13:56.083789+0000","last_peered":"2024-09-12T18:13:56.083789+0000","last_clean":"2024-09-12T18:13:56.083789+0000","last_became_active":"2024-09-12T17:00:46.406811+0000","last_became_peered":"2024-09-12T17:00:46.406811+0000","last_unstale":"2024-09-12T18:13:56.083789+0000","last_undegraded":"2024-09-12T18:13:56.083789+0000","last_fullsized":"2024-09-12T18:13:56.083789+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'376","last_scrub_stamp":"2024-09-12T18:13:56.083721+0000","last_deep_scrub":"264'376","last_deep_scrub_stamp":"2024-09-12T18:13:56.083721+0000","last_clean_scrub_stamp":"2024-09-12T18:13:56.083721+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:20.371898+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170356,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":466,"num_read_kb":7187,"num_write":1054,"num_write_kb":23441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.157320+0000","last_change":"2024-09-12T18:14:12.157320+0000","last_active":"2024-09-12T18:14:12.157320+0000","last_peered":"2024-09-12T18:14:12.157320+0000","last_clean":"2024-09-12T18:14:12.157320+0000","last_became_active":"2024-09-12T17:00:16.328571+0000","last_became_peered":"2024-09-12T17:00:16.328571+0000","last_unstale":"2024-09-12T18:14:12.157320+0000","last_undegraded":"2024-09-12T18:14:12.157320+0000","last_fullsized":"2024-09-12T18:14:12.157320+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:12.157228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:12.157228+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.157228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:38.775538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'308","reported_seq":887,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.596783+0000","last_change":"2024-09-12T17:00:18.332118+0000","last_active":"2024-09-12T18:13:48.596783+0000","last_peered":"2024-09-12T18:13:48.596783+0000","last_clean":"2024-09-12T18:13:48.596783+0000","last_became_active":"2024-09-12T17:00:18.331634+0000","last_became_peered":"2024-09-12T17:00:18.331634+0000","last_unstale":"2024-09-12T18:13:48.596783+0000","last_undegraded":"2024-09-12T18:13:48.596783+0000","last_fullsized":"2024-09-12T18:13:48.596783+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:30.095230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":499,"num_read_kb":1194,"num_write":408,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619176+0000","last_change":"2024-09-12T17:00:20.347184+0000","last_active":"2024-09-12T18:10:21.619176+0000","last_peered":"2024-09-12T18:10:21.619176+0000","last_clean":"2024-09-12T18:10:21.619176+0000","last_became_active":"2024-09-12T17:00:20.346778+0000","last_became_peered":"2024-09-12T17:00:20.346778+0000","last_unstale":"2024-09-12T18:10:21.619176+0000","last_undegraded":"2024-09-12T18:10:21.619176+0000","last_fullsized":"2024-09-12T18:10:21.619176+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:00.409774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'4226","reported_seq":4840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.048608+0000","last_change":"2024-09-12T18:14:08.048608+0000","last_active":"2024-09-12T18:14:08.048608+0000","last_peered":"2024-09-12T18:14:08.048608+0000","last_clean":"2024-09-12T18:14:08.048608+0000","last_became_active":"2024-09-12T17:00:14.327366+0000","last_became_peered":"2024-09-12T17:00:14.327366+0000","last_unstale":"2024-09-12T18:14:08.048608+0000","last_undegraded":"2024-09-12T18:14:08.048608+0000","last_fullsized":"2024-09-12T18:14:08.048608+0000","mapping_epoch":26,"log_start":"264'4200","ondisk_log_start":"264'4200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4226","last_scrub_stamp":"2024-09-12T18:14:08.048490+0000","last_deep_scrub":"264'4226","last_deep_scrub_stamp":"2024-09-12T18:14:08.048490+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.048490+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":3000,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:16.172312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16999,"num_read_kb":14230,"num_write":6368,"num_write_kb":3177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'348","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.036725+0000","last_change":"2024-09-12T18:14:03.036725+0000","last_active":"2024-09-12T18:14:03.036725+0000","last_peered":"2024-09-12T18:14:03.036725+0000","last_clean":"2024-09-12T18:14:03.036725+0000","last_became_active":"2024-09-12T17:00:12.316401+0000","last_became_peered":"2024-09-12T17:00:12.316401+0000","last_unstale":"2024-09-12T18:14:03.036725+0000","last_undegraded":"2024-09-12T18:14:03.036725+0000","last_fullsized":"2024-09-12T18:14:03.036725+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'348","last_scrub_stamp":"2024-09-12T18:14:03.036602+0000","last_deep_scrub":"264'348","last_deep_scrub_stamp":"2024-09-12T18:14:03.036602+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.036602+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:12.222915+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2180110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":457,"num_read_kb":29254,"num_write":1102,"num_write_kb":37912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.620995+0000","last_change":"2024-09-12T17:00:16.318371+0000","last_active":"2024-09-12T18:10:36.620995+0000","last_peered":"2024-09-12T18:10:36.620995+0000","last_clean":"2024-09-12T18:10:36.620995+0000","last_became_active":"2024-09-12T17:00:16.317972+0000","last_became_peered":"2024-09-12T17:00:16.317972+0000","last_unstale":"2024-09-12T18:10:36.620995+0000","last_undegraded":"2024-09-12T18:10:36.620995+0000","last_fullsized":"2024-09-12T18:10:36.620995+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:29.831275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'529","reported_seq":1178,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.412475+0000","last_change":"2024-09-12T17:00:18.327876+0000","last_active":"2024-09-12T18:13:49.412475+0000","last_peered":"2024-09-12T18:13:49.412475+0000","last_clean":"2024-09-12T18:13:49.412475+0000","last_became_active":"2024-09-12T17:00:18.327593+0000","last_became_peered":"2024-09-12T17:00:18.327593+0000","last_unstale":"2024-09-12T18:13:49.412475+0000","last_undegraded":"2024-09-12T18:13:49.412475+0000","last_fullsized":"2024-09-12T18:13:49.412475+0000","mapping_epoch":30,"log_start":"264'500","ondisk_log_start":"264'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:04.110712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111195,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":962,"num_read_kb":2364,"num_write":832,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954467+0000","last_change":"2024-09-12T17:00:20.350747+0000","last_active":"2024-09-12T18:10:22.954467+0000","last_peered":"2024-09-12T18:10:22.954467+0000","last_clean":"2024-09-12T18:10:22.954467+0000","last_became_active":"2024-09-12T17:00:20.350413+0000","last_became_peered":"2024-09-12T17:00:20.350413+0000","last_unstale":"2024-09-12T18:10:22.954467+0000","last_undegraded":"2024-09-12T18:10:22.954467+0000","last_fullsized":"2024-09-12T18:10:22.954467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:40.936332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'144","reported_seq":644,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.842975+0000","last_change":"2024-09-12T17:00:22.589129+0000","last_active":"2024-09-12T18:10:21.842975+0000","last_peered":"2024-09-12T18:10:21.842975+0000","last_clean":"2024-09-12T18:10:21.842975+0000","last_became_active":"2024-09-12T17:00:22.588456+0000","last_became_peered":"2024-09-12T17:00:22.588456+0000","last_unstale":"2024-09-12T18:10:21.842975+0000","last_undegraded":"2024-09-12T18:10:21.842975+0000","last_fullsized":"2024-09-12T18:10:21.842975+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:28.680701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":212,"num_write":324,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'223","reported_seq":896,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.188720+0000","last_change":"2024-09-12T18:14:11.188720+0000","last_active":"2024-09-12T18:14:11.188720+0000","last_peered":"2024-09-12T18:14:11.188720+0000","last_clean":"2024-09-12T18:14:11.188720+0000","last_became_active":"2024-09-12T17:00:14.328921+0000","last_became_peered":"2024-09-12T17:00:14.328921+0000","last_unstale":"2024-09-12T18:14:11.188720+0000","last_undegraded":"2024-09-12T18:14:11.188720+0000","last_fullsized":"2024-09-12T18:14:11.188720+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'223","last_scrub_stamp":"2024-09-12T18:14:11.188633+0000","last_deep_scrub":"264'223","last_deep_scrub_stamp":"2024-09-12T18:14:11.188633+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.188633+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:41.061991+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":992,"num_read_kb":851,"num_write":318,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2873,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'356","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.076062+0000","last_change":"2024-09-12T18:13:59.076062+0000","last_active":"2024-09-12T18:13:59.076062+0000","last_peered":"2024-09-12T18:13:59.076062+0000","last_clean":"2024-09-12T18:13:59.076062+0000","last_became_active":"2024-09-12T17:00:12.311606+0000","last_became_peered":"2024-09-12T17:00:12.311606+0000","last_unstale":"2024-09-12T18:13:59.076062+0000","last_undegraded":"2024-09-12T18:13:59.076062+0000","last_fullsized":"2024-09-12T18:13:59.076062+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-12T18:13:59.075963+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-12T18:13:59.075963+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.075963+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:20.684366+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":470,"num_read_kb":10885,"num_write":1123,"num_write_kb":34953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.749361+0000","last_change":"2024-09-12T17:00:16.327834+0000","last_active":"2024-09-12T18:11:07.749361+0000","last_peered":"2024-09-12T18:11:07.749361+0000","last_clean":"2024-09-12T18:11:07.749361+0000","last_became_active":"2024-09-12T17:00:16.327527+0000","last_became_peered":"2024-09-12T17:00:16.327527+0000","last_unstale":"2024-09-12T18:11:07.749361+0000","last_undegraded":"2024-09-12T18:11:07.749361+0000","last_fullsized":"2024-09-12T18:11:07.749361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:26.325669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'338","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.630526+0000","last_change":"2024-09-12T17:00:18.327394+0000","last_active":"2024-09-12T18:13:48.630526+0000","last_peered":"2024-09-12T18:13:48.630526+0000","last_clean":"2024-09-12T18:13:48.630526+0000","last_became_active":"2024-09-12T17:00:18.326984+0000","last_became_peered":"2024-09-12T17:00:18.326984+0000","last_unstale":"2024-09-12T18:13:48.630526+0000","last_undegraded":"2024-09-12T18:13:48.630526+0000","last_fullsized":"2024-09-12T18:13:48.630526+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:47.996940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46916,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":562,"num_read_kb":1193,"num_write":464,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:23.917579+0000","last_change":"2024-09-12T17:00:20.348230+0000","last_active":"2024-09-12T18:10:23.917579+0000","last_peered":"2024-09-12T18:10:23.917579+0000","last_clean":"2024-09-12T18:10:23.917579+0000","last_became_active":"2024-09-12T17:00:20.347873+0000","last_became_peered":"2024-09-12T17:00:20.347873+0000","last_unstale":"2024-09-12T18:10:23.917579+0000","last_undegraded":"2024-09-12T18:10:23.917579+0000","last_fullsized":"2024-09-12T18:10:23.917579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:20.554953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'167","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.557258+0000","last_change":"2024-09-12T17:00:22.351181+0000","last_active":"2024-09-12T18:11:58.557258+0000","last_peered":"2024-09-12T18:11:58.557258+0000","last_clean":"2024-09-12T18:11:58.557258+0000","last_became_active":"2024-09-12T17:00:22.350856+0000","last_became_peered":"2024-09-12T17:00:22.350856+0000","last_unstale":"2024-09-12T18:11:58.557258+0000","last_undegraded":"2024-09-12T18:11:58.557258+0000","last_fullsized":"2024-09-12T18:11:58.557258+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:47.546741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1852,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":274,"num_read_kb":259,"num_write":495,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'116","reported_seq":710,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.895593+0000","last_change":"2024-09-12T18:14:08.895593+0000","last_active":"2024-09-12T18:14:08.895593+0000","last_peered":"2024-09-12T18:14:08.895593+0000","last_clean":"2024-09-12T18:14:08.895593+0000","last_became_active":"2024-09-12T17:00:14.336495+0000","last_became_peered":"2024-09-12T17:00:14.336495+0000","last_unstale":"2024-09-12T18:14:08.895593+0000","last_undegraded":"2024-09-12T18:14:08.895593+0000","last_fullsized":"2024-09-12T18:14:08.895593+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'116","last_scrub_stamp":"2024-09-12T18:14:08.895502+0000","last_deep_scrub":"264'116","last_deep_scrub_stamp":"2024-09-12T18:14:08.895502+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.895502+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:41.615371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":523,"num_read_kb":437,"num_write":169,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'380","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:57.835221+0000","last_change":"2024-09-12T18:13:57.835221+0000","last_active":"2024-09-12T18:13:57.835221+0000","last_peered":"2024-09-12T18:13:57.835221+0000","last_clean":"2024-09-12T18:13:57.835221+0000","last_became_active":"2024-09-12T17:00:12.318234+0000","last_became_peered":"2024-09-12T17:00:12.318234+0000","last_unstale":"2024-09-12T18:13:57.835221+0000","last_undegraded":"2024-09-12T18:13:57.835221+0000","last_fullsized":"2024-09-12T18:13:57.835221+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'380","last_scrub_stamp":"2024-09-12T18:13:57.835115+0000","last_deep_scrub":"264'380","last_deep_scrub_stamp":"2024-09-12T18:13:57.835115+0000","last_clean_scrub_stamp":"2024-09-12T18:13:57.835115+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:01.043683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":38331,"num_write":1137,"num_write_kb":59769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"36'3","reported_seq":989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:47.955863+0000","last_change":"2024-09-12T17:00:16.327679+0000","last_active":"2024-09-12T18:13:47.955863+0000","last_peered":"2024-09-12T18:13:47.955863+0000","last_clean":"2024-09-12T18:13:47.955863+0000","last_became_active":"2024-09-12T17:00:16.327396+0000","last_became_peered":"2024-09-12T17:00:16.327396+0000","last_unstale":"2024-09-12T18:13:47.955863+0000","last_undegraded":"2024-09-12T18:13:47.955863+0000","last_fullsized":"2024-09-12T18:13:47.955863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:03.799735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'294","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.345203+0000","last_change":"2024-09-12T17:00:18.429503+0000","last_active":"2024-09-12T18:13:49.345203+0000","last_peered":"2024-09-12T18:13:49.345203+0000","last_clean":"2024-09-12T18:13:49.345203+0000","last_became_active":"2024-09-12T17:00:18.429149+0000","last_became_peered":"2024-09-12T17:00:18.429149+0000","last_unstale":"2024-09-12T18:13:49.345203+0000","last_undegraded":"2024-09-12T18:13:49.345203+0000","last_fullsized":"2024-09-12T18:13:49.345203+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:42.541128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47739,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":501,"num_read_kb":1160,"num_write":400,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:38.919197+0000","last_change":"2024-09-12T17:00:20.350078+0000","last_active":"2024-09-12T18:10:38.919197+0000","last_peered":"2024-09-12T18:10:38.919197+0000","last_clean":"2024-09-12T18:10:38.919197+0000","last_became_active":"2024-09-12T17:00:20.349769+0000","last_became_peered":"2024-09-12T17:00:20.349769+0000","last_unstale":"2024-09-12T18:10:38.919197+0000","last_undegraded":"2024-09-12T18:10:38.919197+0000","last_fullsized":"2024-09-12T18:10:38.919197+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:01.586846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'102","reported_seq":597,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.025748+0000","last_change":"2024-09-12T17:00:22.359344+0000","last_active":"2024-09-12T18:13:23.025748+0000","last_peered":"2024-09-12T18:13:23.025748+0000","last_clean":"2024-09-12T18:13:23.025748+0000","last_became_active":"2024-09-12T17:00:22.358484+0000","last_became_peered":"2024-09-12T17:00:22.358484+0000","last_unstale":"2024-09-12T18:13:23.025748+0000","last_undegraded":"2024-09-12T18:13:23.025748+0000","last_fullsized":"2024-09-12T18:13:23.025748+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:18.149297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":123,"num_write":242,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'161","reported_seq":804,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.049101+0000","last_change":"2024-09-12T18:14:01.049101+0000","last_active":"2024-09-12T18:14:01.049101+0000","last_peered":"2024-09-12T18:14:01.049101+0000","last_clean":"2024-09-12T18:14:01.049101+0000","last_became_active":"2024-09-12T17:00:14.330238+0000","last_became_peered":"2024-09-12T17:00:14.330238+0000","last_unstale":"2024-09-12T18:14:01.049101+0000","last_undegraded":"2024-09-12T18:14:01.049101+0000","last_fullsized":"2024-09-12T18:14:01.049101+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'161","last_scrub_stamp":"2024-09-12T18:14:01.049004+0000","last_deep_scrub":"264'161","last_deep_scrub_stamp":"2024-09-12T18:14:01.049004+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.049004+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:26.718335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":737,"num_read_kb":617,"num_write":248,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'339","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.091004+0000","last_change":"2024-09-12T18:14:00.091004+0000","last_active":"2024-09-12T18:14:00.091004+0000","last_peered":"2024-09-12T18:14:00.091004+0000","last_clean":"2024-09-12T18:14:00.091004+0000","last_became_active":"2024-09-12T17:00:12.305259+0000","last_became_peered":"2024-09-12T17:00:12.305259+0000","last_unstale":"2024-09-12T18:14:00.091004+0000","last_undegraded":"2024-09-12T18:14:00.091004+0000","last_fullsized":"2024-09-12T18:14:00.091004+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'339","last_scrub_stamp":"2024-09-12T18:14:00.090882+0000","last_deep_scrub":"264'339","last_deep_scrub_stamp":"2024-09-12T18:14:00.090882+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.090882+0000","objects_scrubbed":10,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:32.121245+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048621,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":464,"num_read_kb":5194,"num_write":1027,"num_write_kb":36405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.132722+0000","last_change":"2024-09-12T18:14:12.132722+0000","last_active":"2024-09-12T18:14:12.132722+0000","last_peered":"2024-09-12T18:14:12.132722+0000","last_clean":"2024-09-12T18:14:12.132722+0000","last_became_active":"2024-09-12T17:00:16.327626+0000","last_became_peered":"2024-09-12T17:00:16.327626+0000","last_unstale":"2024-09-12T18:14:12.132722+0000","last_undegraded":"2024-09-12T18:14:12.132722+0000","last_fullsized":"2024-09-12T18:14:12.132722+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:12.132627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:12.132627+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.132627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:23.273859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'109","reported_seq":655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.784639+0000","last_change":"2024-09-12T17:00:18.429917+0000","last_active":"2024-09-12T18:11:11.784639+0000","last_peered":"2024-09-12T18:11:11.784639+0000","last_clean":"2024-09-12T18:11:11.784639+0000","last_became_active":"2024-09-12T17:00:18.429481+0000","last_became_peered":"2024-09-12T17:00:18.429481+0000","last_unstale":"2024-09-12T18:11:11.784639+0000","last_undegraded":"2024-09-12T18:11:11.784639+0000","last_fullsized":"2024-09-12T18:11:11.784639+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:59.225430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":118,"num_write":86,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'784","reported_seq":4459,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.185297+0000","last_change":"2024-09-12T17:00:20.351383+0000","last_active":"2024-09-12T18:13:48.185297+0000","last_peered":"2024-09-12T18:13:48.185297+0000","last_clean":"2024-09-12T18:13:48.185297+0000","last_became_active":"2024-09-12T17:00:20.350976+0000","last_became_peered":"2024-09-12T17:00:20.350976+0000","last_unstale":"2024-09-12T18:13:48.185297+0000","last_undegraded":"2024-09-12T18:13:48.185297+0000","last_fullsized":"2024-09-12T18:13:48.185297+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:56.750542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'112","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.755851+0000","last_change":"2024-09-12T17:00:22.357875+0000","last_active":"2024-09-12T18:10:22.755851+0000","last_peered":"2024-09-12T18:10:22.755851+0000","last_clean":"2024-09-12T18:10:22.755851+0000","last_became_active":"2024-09-12T17:00:22.357215+0000","last_became_peered":"2024-09-12T17:00:22.357215+0000","last_unstale":"2024-09-12T18:10:22.755851+0000","last_undegraded":"2024-09-12T18:10:22.755851+0000","last_fullsized":"2024-09-12T18:10:22.755851+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:29.171521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":135,"num_write":263,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'292","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.869491+0000","last_change":"2024-09-12T18:14:08.869491+0000","last_active":"2024-09-12T18:14:08.869491+0000","last_peered":"2024-09-12T18:14:08.869491+0000","last_clean":"2024-09-12T18:14:08.869491+0000","last_became_active":"2024-09-12T17:00:14.340459+0000","last_became_peered":"2024-09-12T17:00:14.340459+0000","last_unstale":"2024-09-12T18:14:08.869491+0000","last_undegraded":"2024-09-12T18:14:08.869491+0000","last_fullsized":"2024-09-12T18:14:08.869491+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'292","last_scrub_stamp":"2024-09-12T18:14:08.869378+0000","last_deep_scrub":"264'292","last_deep_scrub_stamp":"2024-09-12T18:14:08.869378+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.869378+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:58.673982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1297,"num_read_kb":1099,"num_write":462,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'344","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.153522+0000","last_change":"2024-09-12T18:14:06.153522+0000","last_active":"2024-09-12T18:14:06.153522+0000","last_peered":"2024-09-12T18:14:06.153522+0000","last_clean":"2024-09-12T18:14:06.153522+0000","last_became_active":"2024-09-12T17:00:46.721297+0000","last_became_peered":"2024-09-12T17:00:46.721297+0000","last_unstale":"2024-09-12T18:14:06.153522+0000","last_undegraded":"2024-09-12T18:14:06.153522+0000","last_fullsized":"2024-09-12T18:14:06.153522+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'344","last_scrub_stamp":"2024-09-12T18:14:06.153427+0000","last_deep_scrub":"264'344","last_deep_scrub_stamp":"2024-09-12T18:14:06.153427+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.153427+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:53.191230+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6112458,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":37702,"num_write":1052,"num_write_kb":18010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.755136+0000","last_change":"2024-09-12T17:00:16.327719+0000","last_active":"2024-09-12T18:10:17.755136+0000","last_peered":"2024-09-12T18:10:17.755136+0000","last_clean":"2024-09-12T18:10:17.755136+0000","last_became_active":"2024-09-12T17:00:16.327461+0000","last_became_peered":"2024-09-12T17:00:16.327461+0000","last_unstale":"2024-09-12T18:10:17.755136+0000","last_undegraded":"2024-09-12T18:10:17.755136+0000","last_fullsized":"2024-09-12T18:10:17.755136+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:19.144290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'325","reported_seq":932,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.284070+0000","last_change":"2024-09-12T17:00:18.329265+0000","last_active":"2024-09-12T18:13:48.284070+0000","last_peered":"2024-09-12T18:13:48.284070+0000","last_clean":"2024-09-12T18:13:48.284070+0000","last_became_active":"2024-09-12T17:00:18.328990+0000","last_became_peered":"2024-09-12T17:00:18.328990+0000","last_unstale":"2024-09-12T18:13:48.284070+0000","last_undegraded":"2024-09-12T18:13:48.284070+0000","last_fullsized":"2024-09-12T18:13:48.284070+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:43.048916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43471,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":524,"num_read_kb":1084,"num_write":408,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.619737+0000","last_change":"2024-09-12T17:00:20.350160+0000","last_active":"2024-09-12T18:10:26.619737+0000","last_peered":"2024-09-12T18:10:26.619737+0000","last_clean":"2024-09-12T18:10:26.619737+0000","last_became_active":"2024-09-12T17:00:20.349643+0000","last_became_peered":"2024-09-12T17:00:20.349643+0000","last_unstale":"2024-09-12T18:10:26.619737+0000","last_undegraded":"2024-09-12T18:10:26.619737+0000","last_fullsized":"2024-09-12T18:10:26.619737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:12.715810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'119","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.422359+0000","last_change":"2024-09-12T17:00:22.355955+0000","last_active":"2024-09-12T18:11:59.422359+0000","last_peered":"2024-09-12T18:11:59.422359+0000","last_clean":"2024-09-12T18:11:59.422359+0000","last_became_active":"2024-09-12T17:00:22.355658+0000","last_became_peered":"2024-09-12T17:00:22.355658+0000","last_unstale":"2024-09-12T18:11:59.422359+0000","last_undegraded":"2024-09-12T18:11:59.422359+0000","last_fullsized":"2024-09-12T18:11:59.422359+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:47.710679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":157,"num_read_kb":152,"num_write":284,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'216","reported_seq":835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.847049+0000","last_change":"2024-09-12T18:14:09.847049+0000","last_active":"2024-09-12T18:14:09.847049+0000","last_peered":"2024-09-12T18:14:09.847049+0000","last_clean":"2024-09-12T18:14:09.847049+0000","last_became_active":"2024-09-12T17:00:14.334620+0000","last_became_peered":"2024-09-12T17:00:14.334620+0000","last_unstale":"2024-09-12T18:14:09.847049+0000","last_undegraded":"2024-09-12T18:14:09.847049+0000","last_fullsized":"2024-09-12T18:14:09.847049+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'216","last_scrub_stamp":"2024-09-12T18:14:09.846963+0000","last_deep_scrub":"264'216","last_deep_scrub_stamp":"2024-09-12T18:14:09.846963+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.846963+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:54.849970+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":978,"num_read_kb":833,"num_write":353,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'413","reported_seq":1100,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.537609+0000","last_change":"2024-09-12T18:14:02.537609+0000","last_active":"2024-09-12T18:14:02.537609+0000","last_peered":"2024-09-12T18:14:02.537609+0000","last_clean":"2024-09-12T18:14:02.537609+0000","last_became_active":"2024-09-12T17:00:12.317850+0000","last_became_peered":"2024-09-12T17:00:12.317850+0000","last_unstale":"2024-09-12T18:14:02.537609+0000","last_undegraded":"2024-09-12T18:14:02.537609+0000","last_fullsized":"2024-09-12T18:14:02.537609+0000","mapping_epoch":24,"log_start":"264'398","ondisk_log_start":"264'398","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'413","last_scrub_stamp":"2024-09-12T18:14:02.537459+0000","last_deep_scrub":"264'413","last_deep_scrub_stamp":"2024-09-12T18:14:02.537459+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.537459+0000","objects_scrubbed":15,"log_size":15,"log_dups_size":398,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:34.535056+0000","scrub_duration":65,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2375003,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":614,"num_read_kb":19368,"num_write":1121,"num_write_kb":17051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:17.953668+0000","last_change":"2024-09-12T17:00:16.329861+0000","last_active":"2024-09-12T18:10:17.953668+0000","last_peered":"2024-09-12T18:10:17.953668+0000","last_clean":"2024-09-12T18:10:17.953668+0000","last_became_active":"2024-09-12T17:00:16.329505+0000","last_became_peered":"2024-09-12T17:00:16.329505+0000","last_unstale":"2024-09-12T18:10:17.953668+0000","last_undegraded":"2024-09-12T18:10:17.953668+0000","last_fullsized":"2024-09-12T18:10:17.953668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:10.041738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'266","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.318601+0000","last_change":"2024-09-12T17:00:18.330870+0000","last_active":"2024-09-12T18:13:48.318601+0000","last_peered":"2024-09-12T18:13:48.318601+0000","last_clean":"2024-09-12T18:13:48.318601+0000","last_became_active":"2024-09-12T17:00:18.330548+0000","last_became_peered":"2024-09-12T17:00:18.330548+0000","last_unstale":"2024-09-12T18:13:48.318601+0000","last_undegraded":"2024-09-12T18:13:48.318601+0000","last_fullsized":"2024-09-12T18:13:48.318601+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:29.885447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":1014,"num_write":352,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.744654+0000","last_change":"2024-09-12T17:00:20.347403+0000","last_active":"2024-09-12T18:10:37.744654+0000","last_peered":"2024-09-12T18:10:37.744654+0000","last_clean":"2024-09-12T18:10:37.744654+0000","last_became_active":"2024-09-12T17:00:20.347122+0000","last_became_peered":"2024-09-12T17:00:20.347122+0000","last_unstale":"2024-09-12T18:10:37.744654+0000","last_undegraded":"2024-09-12T18:10:37.744654+0000","last_fullsized":"2024-09-12T18:10:37.744654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:45.526521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'144","reported_seq":681,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:26.843667+0000","last_change":"2024-09-12T17:00:22.588688+0000","last_active":"2024-09-12T18:10:26.843667+0000","last_peered":"2024-09-12T18:10:26.843667+0000","last_clean":"2024-09-12T18:10:26.843667+0000","last_became_active":"2024-09-12T17:00:22.588367+0000","last_became_peered":"2024-09-12T17:00:22.588367+0000","last_unstale":"2024-09-12T18:10:26.843667+0000","last_undegraded":"2024-09-12T18:10:26.843667+0000","last_fullsized":"2024-09-12T18:10:26.843667+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:33.524563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":299,"num_read_kb":277,"num_write":353,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'86","reported_seq":675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.888792+0000","last_change":"2024-09-12T18:14:07.888792+0000","last_active":"2024-09-12T18:14:07.888792+0000","last_peered":"2024-09-12T18:14:07.888792+0000","last_clean":"2024-09-12T18:14:07.888792+0000","last_became_active":"2024-09-12T17:00:14.338251+0000","last_became_peered":"2024-09-12T17:00:14.338251+0000","last_unstale":"2024-09-12T18:14:07.888792+0000","last_undegraded":"2024-09-12T18:14:07.888792+0000","last_fullsized":"2024-09-12T18:14:07.888792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'86","last_scrub_stamp":"2024-09-12T18:14:07.888692+0000","last_deep_scrub":"264'86","last_deep_scrub_stamp":"2024-09-12T18:14:07.888692+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.888692+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:33.432525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":335,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'391","reported_seq":1095,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:57.942881+0000","last_change":"2024-09-12T18:13:57.942881+0000","last_active":"2024-09-12T18:13:57.942881+0000","last_peered":"2024-09-12T18:13:57.942881+0000","last_clean":"2024-09-12T18:13:57.942881+0000","last_became_active":"2024-09-12T17:00:12.318883+0000","last_became_peered":"2024-09-12T17:00:12.318883+0000","last_unstale":"2024-09-12T18:13:57.942881+0000","last_undegraded":"2024-09-12T18:13:57.942881+0000","last_fullsized":"2024-09-12T18:13:57.942881+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'391","last_scrub_stamp":"2024-09-12T18:13:57.942799+0000","last_deep_scrub":"264'391","last_deep_scrub_stamp":"2024-09-12T18:13:57.942799+0000","last_clean_scrub_stamp":"2024-09-12T18:13:57.942799+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:44.840115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":699,"num_read_kb":40775,"num_write":1189,"num_write_kb":14251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"36'5","reported_seq":990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:47.955149+0000","last_change":"2024-09-12T17:00:16.326343+0000","last_active":"2024-09-12T18:13:47.955149+0000","last_peered":"2024-09-12T18:13:47.955149+0000","last_clean":"2024-09-12T18:13:47.955149+0000","last_became_active":"2024-09-12T17:00:16.326067+0000","last_became_peered":"2024-09-12T17:00:16.326067+0000","last_unstale":"2024-09-12T18:13:47.955149+0000","last_undegraded":"2024-09-12T18:13:47.955149+0000","last_fullsized":"2024-09-12T18:13:47.955149+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:58.899112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'270","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.267977+0000","last_change":"2024-09-12T17:00:18.326987+0000","last_active":"2024-09-12T18:13:49.267977+0000","last_peered":"2024-09-12T18:13:49.267977+0000","last_clean":"2024-09-12T18:13:49.267977+0000","last_became_active":"2024-09-12T17:00:18.326438+0000","last_became_peered":"2024-09-12T17:00:18.326438+0000","last_unstale":"2024-09-12T18:13:49.267977+0000","last_undegraded":"2024-09-12T18:13:49.267977+0000","last_fullsized":"2024-09-12T18:13:49.267977+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:02.146729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47056,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":445,"num_read_kb":1107,"num_write":372,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:20.753168+0000","last_change":"2024-09-12T17:00:20.349597+0000","last_active":"2024-09-12T18:10:20.753168+0000","last_peered":"2024-09-12T18:10:20.753168+0000","last_clean":"2024-09-12T18:10:20.753168+0000","last_became_active":"2024-09-12T17:00:20.349324+0000","last_became_peered":"2024-09-12T17:00:20.349324+0000","last_unstale":"2024-09-12T18:10:20.753168+0000","last_undegraded":"2024-09-12T18:10:20.753168+0000","last_fullsized":"2024-09-12T18:10:20.753168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:28.300340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'171","reported_seq":1639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.329193+0000","last_change":"2024-09-12T17:00:22.354055+0000","last_active":"2024-09-12T18:11:59.329193+0000","last_peered":"2024-09-12T18:11:59.329193+0000","last_clean":"2024-09-12T18:11:59.329193+0000","last_became_active":"2024-09-12T17:00:22.353287+0000","last_became_peered":"2024-09-12T17:00:22.353287+0000","last_unstale":"2024-09-12T18:11:59.329193+0000","last_undegraded":"2024-09-12T18:11:59.329193+0000","last_fullsized":"2024-09-12T18:11:59.329193+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:04.187431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1233,"num_read_kb":1225,"num_write":392,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'366","reported_seq":1057,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.880426+0000","last_change":"2024-09-12T18:14:07.880426+0000","last_active":"2024-09-12T18:14:07.880426+0000","last_peered":"2024-09-12T18:14:07.880426+0000","last_clean":"2024-09-12T18:14:07.880426+0000","last_became_active":"2024-09-12T17:00:14.323113+0000","last_became_peered":"2024-09-12T17:00:14.323113+0000","last_unstale":"2024-09-12T18:14:07.880426+0000","last_undegraded":"2024-09-12T18:14:07.880426+0000","last_fullsized":"2024-09-12T18:14:07.880426+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'366","last_scrub_stamp":"2024-09-12T18:14:07.880341+0000","last_deep_scrub":"264'366","last_deep_scrub_stamp":"2024-09-12T18:14:07.880341+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.880341+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:43.555460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1619,"num_read_kb":1299,"num_write":554,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'327","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.130977+0000","last_change":"2024-09-12T18:13:59.130977+0000","last_active":"2024-09-12T18:13:59.130977+0000","last_peered":"2024-09-12T18:13:59.130977+0000","last_clean":"2024-09-12T18:13:59.130977+0000","last_became_active":"2024-09-12T17:00:12.312456+0000","last_became_peered":"2024-09-12T17:00:12.312456+0000","last_unstale":"2024-09-12T18:13:59.130977+0000","last_undegraded":"2024-09-12T18:13:59.130977+0000","last_fullsized":"2024-09-12T18:13:59.130977+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'327","last_scrub_stamp":"2024-09-12T18:13:59.130866+0000","last_deep_scrub":"264'327","last_deep_scrub_stamp":"2024-09-12T18:13:59.130866+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.130866+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:10.045907+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":504,"num_read_kb":30861,"num_write":1000,"num_write_kb":23841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:38.919143+0000","last_change":"2024-09-12T17:00:16.326062+0000","last_active":"2024-09-12T18:10:38.919143+0000","last_peered":"2024-09-12T18:10:38.919143+0000","last_clean":"2024-09-12T18:10:38.919143+0000","last_became_active":"2024-09-12T17:00:16.325535+0000","last_became_peered":"2024-09-12T17:00:16.325535+0000","last_unstale":"2024-09-12T18:10:38.919143+0000","last_undegraded":"2024-09-12T18:10:38.919143+0000","last_fullsized":"2024-09-12T18:10:38.919143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:15.307703+0000","last_clean_scrub_stamp":"2024-09-12T17:00:15.307703+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:32.939447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'306","reported_seq":907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.378762+0000","last_change":"2024-09-12T17:00:18.326450+0000","last_active":"2024-09-12T18:13:49.378762+0000","last_peered":"2024-09-12T18:13:49.378762+0000","last_clean":"2024-09-12T18:13:49.378762+0000","last_became_active":"2024-09-12T17:00:18.326140+0000","last_became_peered":"2024-09-12T17:00:18.326140+0000","last_unstale":"2024-09-12T18:13:49.378762+0000","last_undegraded":"2024-09-12T18:13:49.378762+0000","last_fullsized":"2024-09-12T18:13:49.378762+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:17.311023+0000","last_clean_scrub_stamp":"2024-09-12T17:00:17.311023+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:38.985728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49596,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":515,"num_read_kb":1146,"num_write":406,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619169+0000","last_change":"2024-09-12T17:00:20.354653+0000","last_active":"2024-09-12T18:10:21.619169+0000","last_peered":"2024-09-12T18:10:21.619169+0000","last_clean":"2024-09-12T18:10:21.619169+0000","last_became_active":"2024-09-12T17:00:20.353962+0000","last_became_peered":"2024-09-12T17:00:20.353962+0000","last_unstale":"2024-09-12T18:10:21.619169+0000","last_undegraded":"2024-09-12T18:10:21.619169+0000","last_fullsized":"2024-09-12T18:10:21.619169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:19.321135+0000","last_clean_scrub_stamp":"2024-09-12T17:00:19.321135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:46.119505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'120","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:21.908306+0000","last_change":"2024-09-12T17:00:22.353191+0000","last_active":"2024-09-12T18:13:21.908306+0000","last_peered":"2024-09-12T18:13:21.908306+0000","last_clean":"2024-09-12T18:13:21.908306+0000","last_became_active":"2024-09-12T17:00:22.352779+0000","last_became_peered":"2024-09-12T17:00:22.352779+0000","last_unstale":"2024-09-12T18:13:21.908306+0000","last_undegraded":"2024-09-12T18:13:21.908306+0000","last_fullsized":"2024-09-12T18:13:21.908306+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:10.560331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":133,"num_write":289,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'171","reported_seq":781,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.089074+0000","last_change":"2024-09-12T18:14:09.089074+0000","last_active":"2024-09-12T18:14:09.089074+0000","last_peered":"2024-09-12T18:14:09.089074+0000","last_clean":"2024-09-12T18:14:09.089074+0000","last_became_active":"2024-09-12T17:00:14.315424+0000","last_became_peered":"2024-09-12T17:00:14.315424+0000","last_unstale":"2024-09-12T18:14:09.089074+0000","last_undegraded":"2024-09-12T18:14:09.089074+0000","last_fullsized":"2024-09-12T18:14:09.089074+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-09-12T18:14:09.088983+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-09-12T18:14:09.088983+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.088983+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:18.442009+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":753,"num_read_kb":612,"num_write":278,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'338","reported_seq":1085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.042155+0000","last_change":"2024-09-12T18:14:03.042155+0000","last_active":"2024-09-12T18:14:03.042155+0000","last_peered":"2024-09-12T18:14:03.042155+0000","last_clean":"2024-09-12T18:14:03.042155+0000","last_became_active":"2024-09-12T17:00:12.310322+0000","last_became_peered":"2024-09-12T17:00:12.310322+0000","last_unstale":"2024-09-12T18:14:03.042155+0000","last_undegraded":"2024-09-12T18:14:03.042155+0000","last_fullsized":"2024-09-12T18:14:03.042155+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'338","last_scrub_stamp":"2024-09-12T18:14:03.041984+0000","last_deep_scrub":"264'338","last_deep_scrub_stamp":"2024-09-12T18:14:03.041984+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.041984+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:17.456643+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262194,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":571,"num_read_kb":27239,"num_write":1052,"num_write_kb":25993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'258","reported_seq":883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:07.952184+0000","last_change":"2024-09-12T17:00:46.407147+0000","last_active":"2024-09-12T18:10:07.952184+0000","last_peered":"2024-09-12T18:10:07.952184+0000","last_clean":"2024-09-12T18:10:07.952184+0000","last_became_active":"2024-09-12T17:00:46.406809+0000","last_became_peered":"2024-09-12T17:00:46.406809+0000","last_unstale":"2024-09-12T18:10:07.952184+0000","last_undegraded":"2024-09-12T18:10:07.952184+0000","last_fullsized":"2024-09-12T18:10:07.952184+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:36.394344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1147,"num_read_kb":935,"num_write":403,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"264'313","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.087595+0000","last_change":"2024-09-12T18:13:59.087595+0000","last_active":"2024-09-12T18:13:59.087595+0000","last_peered":"2024-09-12T18:13:59.087595+0000","last_clean":"2024-09-12T18:13:59.087595+0000","last_became_active":"2024-09-12T17:00:12.312579+0000","last_became_peered":"2024-09-12T17:00:12.312579+0000","last_unstale":"2024-09-12T18:13:59.087595+0000","last_undegraded":"2024-09-12T18:13:59.087595+0000","last_fullsized":"2024-09-12T18:13:59.087595+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'313","last_scrub_stamp":"2024-09-12T18:13:59.087493+0000","last_deep_scrub":"264'313","last_deep_scrub_stamp":"2024-09-12T18:13:59.087493+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.087493+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:39.390471+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262157,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":699,"num_read_kb":738,"num_write":941,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'458","reported_seq":1244,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.496883+0000","last_change":"2024-09-12T18:14:12.496883+0000","last_active":"2024-09-12T18:14:12.496883+0000","last_peered":"2024-09-12T18:14:12.496883+0000","last_clean":"2024-09-12T18:14:12.496883+0000","last_became_active":"2024-09-12T17:00:14.327158+0000","last_became_peered":"2024-09-12T17:00:14.327158+0000","last_unstale":"2024-09-12T18:14:12.496883+0000","last_undegraded":"2024-09-12T18:14:12.496883+0000","last_fullsized":"2024-09-12T18:14:12.496883+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'458","last_scrub_stamp":"2024-09-12T18:14:12.496744+0000","last_deep_scrub":"264'458","last_deep_scrub_stamp":"2024-09-12T18:14:12.496744+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.496744+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:27.723536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2228,"num_read_kb":1913,"num_write":817,"num_write_kb":525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'343","reported_seq":989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.509257+0000","last_change":"2024-09-12T18:14:03.509257+0000","last_active":"2024-09-12T18:14:03.509257+0000","last_peered":"2024-09-12T18:14:03.509257+0000","last_clean":"2024-09-12T18:14:03.509257+0000","last_became_active":"2024-09-12T17:00:12.317893+0000","last_became_peered":"2024-09-12T17:00:12.317893+0000","last_unstale":"2024-09-12T18:14:03.509257+0000","last_undegraded":"2024-09-12T18:14:03.509257+0000","last_fullsized":"2024-09-12T18:14:03.509257+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'343","last_scrub_stamp":"2024-09-12T18:14:03.509147+0000","last_deep_scrub":"264'343","last_deep_scrub_stamp":"2024-09-12T18:14:03.509147+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.509147+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:19.174816+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524314,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":498,"num_read_kb":13770,"num_write":1022,"num_write_kb":25077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'105","reported_seq":716,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.096105+0000","last_change":"2024-09-12T18:14:08.096105+0000","last_active":"2024-09-12T18:14:08.096105+0000","last_peered":"2024-09-12T18:14:08.096105+0000","last_clean":"2024-09-12T18:14:08.096105+0000","last_became_active":"2024-09-12T17:00:14.323394+0000","last_became_peered":"2024-09-12T17:00:14.323394+0000","last_unstale":"2024-09-12T18:14:08.096105+0000","last_undegraded":"2024-09-12T18:14:08.096105+0000","last_fullsized":"2024-09-12T18:14:08.096105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-12T18:14:08.096018+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-12T18:14:08.096018+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.096018+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:14.501315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":480,"num_read_kb":401,"num_write":159,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'469","reported_seq":1235,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.048486+0000","last_change":"2024-09-12T18:14:04.048486+0000","last_active":"2024-09-12T18:14:04.048486+0000","last_peered":"2024-09-12T18:14:04.048486+0000","last_clean":"2024-09-12T18:14:04.048486+0000","last_became_active":"2024-09-12T17:00:12.314938+0000","last_became_peered":"2024-09-12T17:00:12.314938+0000","last_unstale":"2024-09-12T18:14:04.048486+0000","last_undegraded":"2024-09-12T18:14:04.048486+0000","last_fullsized":"2024-09-12T18:14:04.048486+0000","mapping_epoch":24,"log_start":"264'400","ondisk_log_start":"264'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'469","last_scrub_stamp":"2024-09-12T18:14:04.048381+0000","last_deep_scrub":"264'469","last_deep_scrub_stamp":"2024-09-12T18:14:04.048381+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.048381+0000","objects_scrubbed":8,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:13.231997+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550360,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":846,"num_read_kb":44498,"num_write":1407,"num_write_kb":38820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'333","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:16.849080+0000","last_change":"2024-09-12T17:00:14.334325+0000","last_active":"2024-09-12T18:11:16.849080+0000","last_peered":"2024-09-12T18:11:16.849080+0000","last_clean":"2024-09-12T18:11:16.849080+0000","last_became_active":"2024-09-12T17:00:14.333821+0000","last_became_peered":"2024-09-12T17:00:14.333821+0000","last_unstale":"2024-09-12T18:11:16.849080+0000","last_undegraded":"2024-09-12T18:11:16.849080+0000","last_fullsized":"2024-09-12T18:11:16.849080+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:38.122605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1469,"num_read_kb":1192,"num_write":564,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'335","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.946774+0000","last_change":"2024-09-12T18:13:58.946774+0000","last_active":"2024-09-12T18:13:58.946774+0000","last_peered":"2024-09-12T18:13:58.946774+0000","last_clean":"2024-09-12T18:13:58.946774+0000","last_became_active":"2024-09-12T17:00:12.316672+0000","last_became_peered":"2024-09-12T17:00:12.316672+0000","last_unstale":"2024-09-12T18:13:58.946774+0000","last_undegraded":"2024-09-12T18:13:58.946774+0000","last_fullsized":"2024-09-12T18:13:58.946774+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-12T18:13:58.946616+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-12T18:13:58.946616+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.946616+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:36.236852+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655849,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":486,"num_read_kb":22933,"num_write":961,"num_write_kb":33827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'55","reported_seq":632,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.802515+0000","last_change":"2024-09-12T18:14:10.802515+0000","last_active":"2024-09-12T18:14:10.802515+0000","last_peered":"2024-09-12T18:14:10.802515+0000","last_clean":"2024-09-12T18:14:10.802515+0000","last_became_active":"2024-09-12T17:00:14.324051+0000","last_became_peered":"2024-09-12T17:00:14.324051+0000","last_unstale":"2024-09-12T18:14:10.802515+0000","last_undegraded":"2024-09-12T18:14:10.802515+0000","last_fullsized":"2024-09-12T18:14:10.802515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'55","last_scrub_stamp":"2024-09-12T18:14:10.802432+0000","last_deep_scrub":"264'55","last_deep_scrub_stamp":"2024-09-12T18:14:10.802432+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.802432+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:33.726378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":201,"num_write":77,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'343","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.030703+0000","last_change":"2024-09-12T18:14:00.030703+0000","last_active":"2024-09-12T18:14:00.030703+0000","last_peered":"2024-09-12T18:14:00.030703+0000","last_clean":"2024-09-12T18:14:00.030703+0000","last_became_active":"2024-09-12T17:00:12.314059+0000","last_became_peered":"2024-09-12T17:00:12.314059+0000","last_unstale":"2024-09-12T18:14:00.030703+0000","last_undegraded":"2024-09-12T18:14:00.030703+0000","last_fullsized":"2024-09-12T18:14:00.030703+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'343","last_scrub_stamp":"2024-09-12T18:14:00.030596+0000","last_deep_scrub":"264'343","last_deep_scrub_stamp":"2024-09-12T18:14:00.030596+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.030596+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:28.562910+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288647,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":67840,"num_write":1028,"num_write_kb":38572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'162","reported_seq":756,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.921850+0000","last_change":"2024-09-12T18:14:09.921850+0000","last_active":"2024-09-12T18:14:09.921850+0000","last_peered":"2024-09-12T18:14:09.921850+0000","last_clean":"2024-09-12T18:14:09.921850+0000","last_became_active":"2024-09-12T17:00:14.338503+0000","last_became_peered":"2024-09-12T17:00:14.338503+0000","last_unstale":"2024-09-12T18:14:09.921850+0000","last_undegraded":"2024-09-12T18:14:09.921850+0000","last_fullsized":"2024-09-12T18:14:09.921850+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'162","last_scrub_stamp":"2024-09-12T18:14:09.921753+0000","last_deep_scrub":"264'162","last_deep_scrub_stamp":"2024-09-12T18:14:09.921753+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.921753+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:14.082713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":567,"num_write":272,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'324","reported_seq":941,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.091077+0000","last_change":"2024-09-12T18:14:04.091077+0000","last_active":"2024-09-12T18:14:04.091077+0000","last_peered":"2024-09-12T18:14:04.091077+0000","last_clean":"2024-09-12T18:14:04.091077+0000","last_became_active":"2024-09-12T17:00:12.311933+0000","last_became_peered":"2024-09-12T17:00:12.311933+0000","last_unstale":"2024-09-12T18:14:04.091077+0000","last_undegraded":"2024-09-12T18:14:04.091077+0000","last_fullsized":"2024-09-12T18:14:04.091077+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-12T18:14:04.090966+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-12T18:14:04.090966+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.090966+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:50.074590+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262214,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":415,"num_read_kb":17784,"num_write":989,"num_write_kb":43947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'289","reported_seq":1010,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.097397+0000","last_change":"2024-09-12T18:14:09.097397+0000","last_active":"2024-09-12T18:14:09.097397+0000","last_peered":"2024-09-12T18:14:09.097397+0000","last_clean":"2024-09-12T18:14:09.097397+0000","last_became_active":"2024-09-12T17:00:14.319152+0000","last_became_peered":"2024-09-12T17:00:14.319152+0000","last_unstale":"2024-09-12T18:14:09.097397+0000","last_undegraded":"2024-09-12T18:14:09.097397+0000","last_fullsized":"2024-09-12T18:14:09.097397+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'289","last_scrub_stamp":"2024-09-12T18:14:09.097302+0000","last_deep_scrub":"264'289","last_deep_scrub_stamp":"2024-09-12T18:14:09.097302+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.097302+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:34.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1506,"num_read_kb":1343,"num_write":479,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'453","reported_seq":1124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.986981+0000","last_change":"2024-09-12T18:14:00.986981+0000","last_active":"2024-09-12T18:14:00.986981+0000","last_peered":"2024-09-12T18:14:00.986981+0000","last_clean":"2024-09-12T18:14:00.986981+0000","last_became_active":"2024-09-12T17:00:12.320948+0000","last_became_peered":"2024-09-12T17:00:12.320948+0000","last_unstale":"2024-09-12T18:14:00.986981+0000","last_undegraded":"2024-09-12T18:14:00.986981+0000","last_fullsized":"2024-09-12T18:14:00.986981+0000","mapping_epoch":24,"log_start":"264'400","ondisk_log_start":"264'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'453","last_scrub_stamp":"2024-09-12T18:14:00.986868+0000","last_deep_scrub":"264'453","last_deep_scrub_stamp":"2024-09-12T18:14:00.986868+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.986868+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:58.110493+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":626,"num_read_kb":23095,"num_write":1402,"num_write_kb":45480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'357","reported_seq":1098,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.184780+0000","last_change":"2024-09-12T18:14:10.184780+0000","last_active":"2024-09-12T18:14:10.184780+0000","last_peered":"2024-09-12T18:14:10.184780+0000","last_clean":"2024-09-12T18:14:10.184780+0000","last_became_active":"2024-09-12T17:00:14.331839+0000","last_became_peered":"2024-09-12T17:00:14.331839+0000","last_unstale":"2024-09-12T18:14:10.184780+0000","last_undegraded":"2024-09-12T18:14:10.184780+0000","last_fullsized":"2024-09-12T18:14:10.184780+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'357","last_scrub_stamp":"2024-09-12T18:14:10.184647+0000","last_deep_scrub":"264'357","last_deep_scrub_stamp":"2024-09-12T18:14:10.184647+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.184647+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:43.341571+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1691,"num_read_kb":1457,"num_write":527,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25753,"num_omap_keys":101,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'425","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.546147+0000","last_change":"2024-09-12T18:14:04.546047+0000","last_active":"2024-09-12T18:14:04.546147+0000","last_peered":"2024-09-12T18:14:04.546147+0000","last_clean":"2024-09-12T18:14:04.546147+0000","last_became_active":"2024-09-12T17:00:12.320094+0000","last_became_peered":"2024-09-12T17:00:12.320094+0000","last_unstale":"2024-09-12T18:14:04.546147+0000","last_undegraded":"2024-09-12T18:14:04.546147+0000","last_fullsized":"2024-09-12T18:14:04.546147+0000","mapping_epoch":24,"log_start":"264'400","ondisk_log_start":"264'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'425","last_scrub_stamp":"2024-09-12T18:14:04.545897+0000","last_deep_scrub":"264'425","last_deep_scrub_stamp":"2024-09-12T18:14:04.545897+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.545897+0000","objects_scrubbed":9,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:36.134235+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194332,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":632,"num_read_kb":22255,"num_write":1216,"num_write_kb":35121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'77","reported_seq":660,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.798944+0000","last_change":"2024-09-12T18:14:12.798944+0000","last_active":"2024-09-12T18:14:12.798944+0000","last_peered":"2024-09-12T18:14:12.798944+0000","last_clean":"2024-09-12T18:14:12.798944+0000","last_became_active":"2024-09-12T17:00:14.334965+0000","last_became_peered":"2024-09-12T17:00:14.334965+0000","last_unstale":"2024-09-12T18:14:12.798944+0000","last_undegraded":"2024-09-12T18:14:12.798944+0000","last_fullsized":"2024-09-12T18:14:12.798944+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'77","last_scrub_stamp":"2024-09-12T18:14:12.798856+0000","last_deep_scrub":"264'77","last_deep_scrub_stamp":"2024-09-12T18:14:12.798856+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.798856+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:20.717929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":336,"num_read_kb":283,"num_write":118,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'338","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.017906+0000","last_change":"2024-09-12T18:14:02.017906+0000","last_active":"2024-09-12T18:14:02.017906+0000","last_peered":"2024-09-12T18:14:02.017906+0000","last_clean":"2024-09-12T18:14:02.017906+0000","last_became_active":"2024-09-12T17:00:12.321156+0000","last_became_peered":"2024-09-12T17:00:12.321156+0000","last_unstale":"2024-09-12T18:14:02.017906+0000","last_undegraded":"2024-09-12T18:14:02.017906+0000","last_fullsized":"2024-09-12T18:14:02.017906+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'338","last_scrub_stamp":"2024-09-12T18:14:02.017773+0000","last_deep_scrub":"264'338","last_deep_scrub_stamp":"2024-09-12T18:14:02.017773+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.017773+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:36.638383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170120,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":18612,"num_write":1036,"num_write_kb":25817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'177","reported_seq":795,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:08.697578+0000","last_change":"2024-09-12T17:00:14.323205+0000","last_active":"2024-09-12T18:10:08.697578+0000","last_peered":"2024-09-12T18:10:08.697578+0000","last_clean":"2024-09-12T18:10:08.697578+0000","last_became_active":"2024-09-12T17:00:14.322880+0000","last_became_peered":"2024-09-12T17:00:14.322880+0000","last_unstale":"2024-09-12T18:10:08.697578+0000","last_undegraded":"2024-09-12T18:10:08.697578+0000","last_fullsized":"2024-09-12T18:10:08.697578+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:18.369079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":741,"num_read_kb":611,"num_write":268,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'393","reported_seq":1056,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.556462+0000","last_change":"2024-09-12T18:14:05.556462+0000","last_active":"2024-09-12T18:14:05.556462+0000","last_peered":"2024-09-12T18:14:05.556462+0000","last_clean":"2024-09-12T18:14:05.556462+0000","last_became_active":"2024-09-12T17:00:12.314707+0000","last_became_peered":"2024-09-12T17:00:12.314707+0000","last_unstale":"2024-09-12T18:14:05.556462+0000","last_undegraded":"2024-09-12T18:14:05.556462+0000","last_fullsized":"2024-09-12T18:14:05.556462+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'393","last_scrub_stamp":"2024-09-12T18:14:05.556338+0000","last_deep_scrub":"264'393","last_deep_scrub_stamp":"2024-09-12T18:14:05.556338+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.556338+0000","objects_scrubbed":7,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:07.321823+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590083,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":560,"num_read_kb":37012,"num_write":1300,"num_write_kb":41769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'170","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.829591+0000","last_change":"2024-09-12T18:14:11.829591+0000","last_active":"2024-09-12T18:14:11.829591+0000","last_peered":"2024-09-12T18:14:11.829591+0000","last_clean":"2024-09-12T18:14:11.829591+0000","last_became_active":"2024-09-12T17:00:14.324709+0000","last_became_peered":"2024-09-12T17:00:14.324709+0000","last_unstale":"2024-09-12T18:14:11.829591+0000","last_undegraded":"2024-09-12T18:14:11.829591+0000","last_fullsized":"2024-09-12T18:14:11.829591+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'170","last_scrub_stamp":"2024-09-12T18:14:11.829476+0000","last_deep_scrub":"264'170","last_deep_scrub_stamp":"2024-09-12T18:14:11.829476+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.829476+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:36.346842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":785,"num_read_kb":657,"num_write":242,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'303","reported_seq":949,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.020070+0000","last_change":"2024-09-12T18:14:03.020070+0000","last_active":"2024-09-12T18:14:03.020070+0000","last_peered":"2024-09-12T18:14:03.020070+0000","last_clean":"2024-09-12T18:14:03.020070+0000","last_became_active":"2024-09-12T17:00:12.307159+0000","last_became_peered":"2024-09-12T17:00:12.307159+0000","last_unstale":"2024-09-12T18:14:03.020070+0000","last_undegraded":"2024-09-12T18:14:03.020070+0000","last_fullsized":"2024-09-12T18:14:03.020070+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'303","last_scrub_stamp":"2024-09-12T18:14:03.019965+0000","last_deep_scrub":"264'303","last_deep_scrub_stamp":"2024-09-12T18:14:03.019965+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.019965+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:43.348169+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":429,"num_read_kb":7363,"num_write":949,"num_write_kb":31388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'4088","reported_seq":4676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.194617+0000","last_change":"2024-09-12T18:14:12.194617+0000","last_active":"2024-09-12T18:14:12.194617+0000","last_peered":"2024-09-12T18:14:12.194617+0000","last_clean":"2024-09-12T18:14:12.194617+0000","last_became_active":"2024-09-12T17:00:14.327792+0000","last_became_peered":"2024-09-12T17:00:14.327792+0000","last_unstale":"2024-09-12T18:14:12.194617+0000","last_undegraded":"2024-09-12T18:14:12.194617+0000","last_fullsized":"2024-09-12T18:14:12.194617+0000","mapping_epoch":26,"log_start":"264'4000","ondisk_log_start":"264'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4088","last_scrub_stamp":"2024-09-12T18:14:12.194534+0000","last_deep_scrub":"264'4088","last_deep_scrub_stamp":"2024-09-12T18:14:12.194534+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.194534+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:07.058121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16430,"num_read_kb":13786,"num_write":6128,"num_write_kb":3057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'357","reported_seq":1018,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.049352+0000","last_change":"2024-09-12T18:14:01.049352+0000","last_active":"2024-09-12T18:14:01.049352+0000","last_peered":"2024-09-12T18:14:01.049352+0000","last_clean":"2024-09-12T18:14:01.049352+0000","last_became_active":"2024-09-12T17:00:12.311273+0000","last_became_peered":"2024-09-12T17:00:12.311273+0000","last_unstale":"2024-09-12T18:14:01.049352+0000","last_undegraded":"2024-09-12T18:14:01.049352+0000","last_fullsized":"2024-09-12T18:14:01.049352+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'357","last_scrub_stamp":"2024-09-12T18:14:01.049257+0000","last_deep_scrub":"264'357","last_deep_scrub_stamp":"2024-09-12T18:14:01.049257+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.049257+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:56.629359+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":481304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":502,"num_read_kb":37128,"num_write":1093,"num_write_kb":49312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'266","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.144997+0000","last_change":"2024-09-12T18:14:09.144997+0000","last_active":"2024-09-12T18:14:09.144997+0000","last_peered":"2024-09-12T18:14:09.144997+0000","last_clean":"2024-09-12T18:14:09.144997+0000","last_became_active":"2024-09-12T17:00:14.318470+0000","last_became_peered":"2024-09-12T17:00:14.318470+0000","last_unstale":"2024-09-12T18:14:09.144997+0000","last_undegraded":"2024-09-12T18:14:09.144997+0000","last_fullsized":"2024-09-12T18:14:09.144997+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'266","last_scrub_stamp":"2024-09-12T18:14:09.144908+0000","last_deep_scrub":"264'266","last_deep_scrub_stamp":"2024-09-12T18:14:09.144908+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.144908+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:18.716492+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1277,"num_read_kb":1058,"num_write":468,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'351","reported_seq":1074,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.181495+0000","last_change":"2024-09-12T18:14:06.181495+0000","last_active":"2024-09-12T18:14:06.181495+0000","last_peered":"2024-09-12T18:14:06.181495+0000","last_clean":"2024-09-12T18:14:06.181495+0000","last_became_active":"2024-09-12T17:00:12.314371+0000","last_became_peered":"2024-09-12T17:00:12.314371+0000","last_unstale":"2024-09-12T18:14:06.181495+0000","last_undegraded":"2024-09-12T18:14:06.181495+0000","last_fullsized":"2024-09-12T18:14:06.181495+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'351","last_scrub_stamp":"2024-09-12T18:14:06.181390+0000","last_deep_scrub":"264'351","last_deep_scrub_stamp":"2024-09-12T18:14:06.181390+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.181390+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:08.888322+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655829,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":559,"num_read_kb":6257,"num_write":1103,"num_write_kb":25577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'129","reported_seq":702,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:01.840698+0000","last_change":"2024-09-12T17:00:14.339614+0000","last_active":"2024-09-12T18:10:01.840698+0000","last_peered":"2024-09-12T18:10:01.840698+0000","last_clean":"2024-09-12T18:10:01.840698+0000","last_became_active":"2024-09-12T17:00:14.339316+0000","last_became_peered":"2024-09-12T17:00:14.339316+0000","last_unstale":"2024-09-12T18:10:01.840698+0000","last_undegraded":"2024-09-12T18:10:01.840698+0000","last_fullsized":"2024-09-12T18:10:01.840698+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:43.906333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":538,"num_read_kb":439,"num_write":190,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'325","reported_seq":964,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.097022+0000","last_change":"2024-09-12T18:14:00.097022+0000","last_active":"2024-09-12T18:14:00.097022+0000","last_peered":"2024-09-12T18:14:00.097022+0000","last_clean":"2024-09-12T18:14:00.097022+0000","last_became_active":"2024-09-12T17:00:12.310157+0000","last_became_peered":"2024-09-12T17:00:12.310157+0000","last_unstale":"2024-09-12T18:14:00.097022+0000","last_undegraded":"2024-09-12T18:14:00.097022+0000","last_fullsized":"2024-09-12T18:14:00.097022+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'325","last_scrub_stamp":"2024-09-12T18:14:00.096895+0000","last_deep_scrub":"264'325","last_deep_scrub_stamp":"2024-09-12T18:14:00.096895+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.096895+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:51.639756+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1093042,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":459,"num_read_kb":8306,"num_write":1094,"num_write_kb":29458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'209","reported_seq":818,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.203502+0000","last_change":"2024-09-12T18:14:10.203419+0000","last_active":"2024-09-12T18:14:10.203502+0000","last_peered":"2024-09-12T18:14:10.203502+0000","last_clean":"2024-09-12T18:14:10.203502+0000","last_became_active":"2024-09-12T17:00:46.406426+0000","last_became_peered":"2024-09-12T17:00:46.406426+0000","last_unstale":"2024-09-12T18:14:10.203502+0000","last_undegraded":"2024-09-12T18:14:10.203502+0000","last_fullsized":"2024-09-12T18:14:10.203502+0000","mapping_epoch":37,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'209","last_scrub_stamp":"2024-09-12T18:14:10.203299+0000","last_deep_scrub":"264'209","last_deep_scrub_stamp":"2024-09-12T18:14:10.203299+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.203299+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:01.928198+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":857,"num_read_kb":696,"num_write":294,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":272,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'306","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.595386+0000","last_change":"2024-09-12T18:14:07.595386+0000","last_active":"2024-09-12T18:14:07.595386+0000","last_peered":"2024-09-12T18:14:07.595386+0000","last_clean":"2024-09-12T18:14:07.595386+0000","last_became_active":"2024-09-12T17:00:12.314251+0000","last_became_peered":"2024-09-12T17:00:12.314251+0000","last_unstale":"2024-09-12T18:14:07.595386+0000","last_undegraded":"2024-09-12T18:14:07.595386+0000","last_fullsized":"2024-09-12T18:14:07.595386+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'306","last_scrub_stamp":"2024-09-12T18:14:07.595274+0000","last_deep_scrub":"264'306","last_deep_scrub_stamp":"2024-09-12T18:14:07.595274+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.595274+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:45.280471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":403,"num_read_kb":8717,"num_write":971,"num_write_kb":22240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'314","reported_seq":1126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.571713+0000","last_change":"2024-09-12T18:14:08.571713+0000","last_active":"2024-09-12T18:14:08.571713+0000","last_peered":"2024-09-12T18:14:08.571713+0000","last_clean":"2024-09-12T18:14:08.571713+0000","last_became_active":"2024-09-12T17:00:12.318408+0000","last_became_peered":"2024-09-12T17:00:12.318408+0000","last_unstale":"2024-09-12T18:14:08.571713+0000","last_undegraded":"2024-09-12T18:14:08.571713+0000","last_fullsized":"2024-09-12T18:14:08.571713+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'314","last_scrub_stamp":"2024-09-12T18:14:08.571615+0000","last_deep_scrub":"264'314","last_deep_scrub_stamp":"2024-09-12T18:14:08.571615+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.571615+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:11.147120+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":853,"num_read_kb":6455,"num_write":1039,"num_write_kb":20037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'90","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:41.621619+0000","last_change":"2024-09-12T17:00:14.334754+0000","last_active":"2024-09-12T18:10:41.621619+0000","last_peered":"2024-09-12T18:10:41.621619+0000","last_clean":"2024-09-12T18:10:41.621619+0000","last_became_active":"2024-09-12T17:00:14.334494+0000","last_became_peered":"2024-09-12T17:00:14.334494+0000","last_unstale":"2024-09-12T18:10:41.621619+0000","last_undegraded":"2024-09-12T18:10:41.621619+0000","last_fullsized":"2024-09-12T18:10:41.621619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:56.905718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":377,"num_read_kb":312,"num_write":145,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'354","reported_seq":999,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.047528+0000","last_change":"2024-09-12T18:14:01.047528+0000","last_active":"2024-09-12T18:14:01.047528+0000","last_peered":"2024-09-12T18:14:01.047528+0000","last_clean":"2024-09-12T18:14:01.047528+0000","last_became_active":"2024-09-12T17:00:12.314988+0000","last_became_peered":"2024-09-12T17:00:12.314988+0000","last_unstale":"2024-09-12T18:14:01.047528+0000","last_undegraded":"2024-09-12T18:14:01.047528+0000","last_fullsized":"2024-09-12T18:14:01.047528+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'354","last_scrub_stamp":"2024-09-12T18:14:01.047428+0000","last_deep_scrub":"264'354","last_deep_scrub_stamp":"2024-09-12T18:14:01.047428+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.047428+0000","objects_scrubbed":6,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:54.071159+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":45801,"num_write":1031,"num_write_kb":31559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'220","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:22.954550+0000","last_change":"2024-09-12T17:00:14.333403+0000","last_active":"2024-09-12T18:10:22.954550+0000","last_peered":"2024-09-12T18:10:22.954550+0000","last_clean":"2024-09-12T18:10:22.954550+0000","last_became_active":"2024-09-12T17:00:14.333107+0000","last_became_peered":"2024-09-12T17:00:14.333107+0000","last_unstale":"2024-09-12T18:10:22.954550+0000","last_undegraded":"2024-09-12T18:10:22.954550+0000","last_fullsized":"2024-09-12T18:10:22.954550+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:13.301499+0000","last_clean_scrub_stamp":"2024-09-12T17:00:13.301499+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:26.316619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":970,"num_read_kb":803,"num_write":364,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5638,"num_read_kb":3956,"num_write":1906,"num_write_kb":804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1077,"ondisk_log_size":1077,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":16256,"num_read_kb":15929,"num_write":16738,"num_write_kb":4889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1664,"ondisk_log_size":1664,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":559,"ondisk_log_size":559,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1559950,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":19041,"num_read_kb":39761,"num_write":15891,"num_write_kb":11979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2214,"ondisk_log_size":2214,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2432,"num_read_kb":2899,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102836,"num_read_kb":85763,"num_write":37242,"num_write_kb":18813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30569,"num_omap_keys":121,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3664,"ondisk_log_size":3664,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":76932281,"num_objects":387,"num_object_clones":0,"num_object_copies":774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":387,"num_whiteouts":0,"num_read":36237,"num_read_kb":1844237,"num_write":71508,"num_write_kb":1970689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":155025408,"data_stored":153864562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3422,"ondisk_log_size":3422,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":154912,"num_write":182,"num_write_kb":116389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":158387,"num_write":182,"num_write_kb":116389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424510338,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76020,"kb_used_data":22628,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94295820,"statfs":{"total":96636764160,"available":96558919680,"internally_reserved":0,"allocated":23171072,"data_stored":21619631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510341,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119664,"kb_used_data":8032,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94252176,"statfs":{"total":96636764160,"available":96514228224,"internally_reserved":0,"allocated":8224768,"data_stored":6647389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543040,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257492,"kb_used_data":27780,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94114348,"statfs":{"total":96636764160,"available":96373092352,"internally_reserved":0,"allocated":28446720,"data_stored":26727116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235207114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543042,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":258304,"kb_used_data":16112,"kb_used_omap":1,"kb_used_meta":242174,"kb_avail":94113536,"statfs":{"total":96636764160,"available":96372260864,"internally_reserved":0,"allocated":16498688,"data_stored":14904367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":247986630},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543042,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146624,"kb_used_data":25264,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94225216,"statfs":{"total":96636764160,"available":96486621184,"internally_reserved":0,"allocated":25870336,"data_stored":24131043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543042,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275728,"kb_used_data":32128,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94096112,"statfs":{"total":96636764160,"available":96354418688,"internally_reserved":0,"allocated":32899072,"data_stored":31197660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":249428423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543040,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229924,"kb_used_data":18260,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94141916,"statfs":{"total":96636764160,"available":96401321984,"internally_reserved":0,"allocated":18698240,"data_stored":17001849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":216725957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575744,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98204,"kb_used_data":30924,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94273636,"statfs":{"total":96636764160,"available":96536203264,"internally_reserved":0,"allocated":31666176,"data_stored":30017021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14422016,"data_stored":14261258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4595712,"data_stored":4499422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19558400,"data_stored":19471135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29220864,"data_stored":29046128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28045312,"data_stored":27867248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22167552,"data_stored":21980545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12857344,"data_stored":12753756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24158208,"data_stored":23985070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":4704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:14:18.525 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.526 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.526 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.526 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.526 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.526 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.526 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.527 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.527 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.527 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.527 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.527 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.527 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.527 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.527 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.527 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.528 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.528 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.528 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.528 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.528 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.528 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.528 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.528 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.528 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.529 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.529 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.529 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.529 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.529 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.529 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.529 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.529 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.530 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.530 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.530 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.530 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.530 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.530 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.530 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.530 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.530 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.531 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.531 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.531 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.531 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.531 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.531 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.531 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.531 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.531 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.532 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.532 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.532 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.532 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.532 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.532 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.532 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.532 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.532 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.533 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.533 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.533 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.533 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.533 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.533 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.533 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.533 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.533 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.534 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.534 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.534 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.534 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.534 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.534 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.534 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.534 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.534 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.535 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.535 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.535 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.535 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.535 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.535 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.535 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.535 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.535 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.536 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.536 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.536 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.536 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.536 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.536 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.536 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.536 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.536 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.537 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.537 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.537 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.537 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.537 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.537 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.537 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.537 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.537 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.538 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.538 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.538 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.538 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.538 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.538 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.538 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.538 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.538 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.539 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.539 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.539 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.539 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.539 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.539 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.539 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.539 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.539 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.540 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.540 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.540 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.540 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.540 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.540 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.540 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.540 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.541 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.541 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.541 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.541 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.541 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.541 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.541 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.542 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.542 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.542 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.542 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.542 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.542 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.542 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.542 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.543 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.543 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.543 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.543 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.543 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.543 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.543 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.543 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.543 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.544 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.544 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.544 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.544 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.544 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.544 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.544 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.545 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.545 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.545 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.545 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.545 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.545 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.545 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.546 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.546 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.546 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.546 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.546 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.546 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.546 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.546 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.546 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.547 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.547 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.547 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.547 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.547 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.547 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.547 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.548 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.548 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.548 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.548 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.548 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.548 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.548 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.548 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.549 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.549 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.549 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.549 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.549 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.549 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.549 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.549 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.549 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.550 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.550 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.550 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.550 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.550 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.550 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.550 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.550 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.551 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.551 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.551 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.551 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.551 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.551 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.551 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.551 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.551 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.552 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.552 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.552 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.552 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.552 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.552 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.552 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.552 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.553 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.553 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.553 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.553 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.553 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.553 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.553 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.553 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.554 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.554 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.554 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.554 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.554 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.554 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.554 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.554 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.554 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.555 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.555 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.555 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.555 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.555 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T17:00:15.307703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.555 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:00:17.311023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.555 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:00:19.321135+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.555 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.556 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.556 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.556 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.556 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.556 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.556 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T17:00:13.301499+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:18.557 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:14:38.561 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:14:38.915 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:14:38.926 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-12T18:14:38.929 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":2501,"stamp":"2024-09-12T18:14:38.653062+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":79100730,"num_objects":719,"num_object_clones":0,"num_object_copies":1438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":719,"num_whiteouts":0,"num_read":182830,"num_read_kb":2305911,"num_write":143792,"num_write_kb":2241608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":736924,"num_omap_keys":1779,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12922,"ondisk_log_size":12922,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1449480,"kb_used_data":181128,"kb_used_omap":12,"kb_used_meta":1268211,"kb_avail":753525240,"statfs":{"total":773094113280,"available":771609845760,"internally_reserved":0,"allocated":185475072,"data_stored":172246076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1298648624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":127561,"num_omap_keys":314,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005576"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:37.966205+0000","last_change":"2024-09-12T17:39:05.922525+0000","last_active":"2024-09-12T18:11:37.966205+0000","last_peered":"2024-09-12T18:11:37.966205+0000","last_clean":"2024-09-12T18:11:37.966205+0000","last_became_active":"2024-09-12T17:39:05.922265+0000","last_became_peered":"2024-09-12T17:39:05.922265+0000","last_unstale":"2024-09-12T18:11:37.966205+0000","last_undegraded":"2024-09-12T18:11:37.966205+0000","last_fullsized":"2024-09-12T18:11:37.966205+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'9","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.516351+0000","last_change":"2024-09-12T17:20:34.559305+0000","last_active":"2024-09-12T18:13:48.516351+0000","last_peered":"2024-09-12T18:13:48.516351+0000","last_clean":"2024-09-12T18:13:48.516351+0000","last_became_active":"2024-09-12T17:20:34.559027+0000","last_became_peered":"2024-09-12T17:20:34.559027+0000","last_unstale":"2024-09-12T18:13:48.516351+0000","last_undegraded":"2024-09-12T18:13:48.516351+0000","last_fullsized":"2024-09-12T18:13:48.516351+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:57.688429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10240,"num_write":14,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"261'5","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844168+0000","last_change":"2024-09-12T17:20:30.533512+0000","last_active":"2024-09-12T18:10:31.844168+0000","last_peered":"2024-09-12T18:10:31.844168+0000","last_clean":"2024-09-12T18:10:31.844168+0000","last_became_active":"2024-09-12T17:20:30.533235+0000","last_became_peered":"2024-09-12T17:20:30.533235+0000","last_unstale":"2024-09-12T18:10:31.844168+0000","last_undegraded":"2024-09-12T18:10:31.844168+0000","last_fullsized":"2024-09-12T18:10:31.844168+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:11.739116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4098,"num_write":10,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'40","reported_seq":176,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:26.633945+0000","last_change":"2024-09-12T17:16:11.492013+0000","last_active":"2024-09-12T18:12:26.633945+0000","last_peered":"2024-09-12T18:12:26.633945+0000","last_clean":"2024-09-12T18:12:26.633945+0000","last_became_active":"2024-09-12T17:16:11.491724+0000","last_became_peered":"2024-09-12T17:16:11.491724+0000","last_unstale":"2024-09-12T18:12:26.633945+0000","last_undegraded":"2024-09-12T18:12:26.633945+0000","last_fullsized":"2024-09-12T18:12:26.633945+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":153,"num_write":69,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:26.082849+0000","last_change":"2024-09-12T18:14:26.082849+0000","last_active":"2024-09-12T18:14:26.082849+0000","last_peered":"2024-09-12T18:14:26.082849+0000","last_clean":"2024-09-12T18:14:26.082849+0000","last_became_active":"2024-09-12T17:39:05.929533+0000","last_became_peered":"2024-09-12T17:39:05.929533+0000","last_unstale":"2024-09-12T18:14:26.082849+0000","last_undegraded":"2024-09-12T18:14:26.082849+0000","last_fullsized":"2024-09-12T18:14:26.082849+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:26.082750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:26.082750+0000","last_clean_scrub_stamp":"2024-09-12T18:14:26.082750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:34.051588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"261'8","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:35.755523+0000","last_change":"2024-09-12T17:20:34.559278+0000","last_active":"2024-09-12T18:10:35.755523+0000","last_peered":"2024-09-12T18:10:35.755523+0000","last_clean":"2024-09-12T18:10:35.755523+0000","last_became_active":"2024-09-12T17:20:34.558970+0000","last_became_peered":"2024-09-12T17:20:34.558970+0000","last_unstale":"2024-09-12T18:10:35.755523+0000","last_undegraded":"2024-09-12T18:10:35.755523+0000","last_fullsized":"2024-09-12T18:10:35.755523+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:15.197078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8194,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:28.199935+0000","last_change":"2024-09-12T18:14:28.199935+0000","last_active":"2024-09-12T18:14:28.199935+0000","last_peered":"2024-09-12T18:14:28.199935+0000","last_clean":"2024-09-12T18:14:28.199935+0000","last_became_active":"2024-09-12T17:20:30.539358+0000","last_became_peered":"2024-09-12T17:20:30.539358+0000","last_unstale":"2024-09-12T18:14:28.199935+0000","last_undegraded":"2024-09-12T18:14:28.199935+0000","last_fullsized":"2024-09-12T18:14:28.199935+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T18:14:28.199850+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T18:14:28.199850+0000","last_clean_scrub_stamp":"2024-09-12T18:14:28.199850+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:29.477097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8242,"num_write":10,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'68","reported_seq":259,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.118963+0000","last_change":"2024-09-12T18:14:17.118895+0000","last_active":"2024-09-12T18:14:17.118963+0000","last_peered":"2024-09-12T18:14:17.118963+0000","last_clean":"2024-09-12T18:14:17.118963+0000","last_became_active":"2024-09-12T17:16:11.491610+0000","last_became_peered":"2024-09-12T17:16:11.491610+0000","last_unstale":"2024-09-12T18:14:17.118963+0000","last_undegraded":"2024-09-12T18:14:17.118963+0000","last_fullsized":"2024-09-12T18:14:17.118963+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'68","last_scrub_stamp":"2024-09-12T18:14:17.118797+0000","last_deep_scrub":"264'68","last_deep_scrub_stamp":"2024-09-12T18:14:17.118797+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.118797+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:50.247233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":357,"num_read_kb":265,"num_write":116,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:35.263486+0000","last_change":"2024-09-12T18:14:35.263486+0000","last_active":"2024-09-12T18:14:35.263486+0000","last_peered":"2024-09-12T18:14:35.263486+0000","last_clean":"2024-09-12T18:14:35.263486+0000","last_became_active":"2024-09-12T17:39:05.921846+0000","last_became_peered":"2024-09-12T17:39:05.921846+0000","last_unstale":"2024-09-12T18:14:35.263486+0000","last_undegraded":"2024-09-12T18:14:35.263486+0000","last_fullsized":"2024-09-12T18:14:35.263486+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:35.263401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:35.263401+0000","last_clean_scrub_stamp":"2024-09-12T18:14:35.263401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:24.277742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"261'8","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.621019+0000","last_change":"2024-09-12T17:20:34.615861+0000","last_active":"2024-09-12T18:10:36.621019+0000","last_peered":"2024-09-12T18:10:36.621019+0000","last_clean":"2024-09-12T18:10:36.621019+0000","last_became_active":"2024-09-12T17:20:34.615550+0000","last_became_peered":"2024-09-12T17:20:34.615550+0000","last_unstale":"2024-09-12T18:10:36.621019+0000","last_undegraded":"2024-09-12T18:10:36.621019+0000","last_fullsized":"2024-09-12T18:10:36.621019+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:16.087575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":6148,"num_write":8,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'9","reported_seq":80,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:20.059934+0000","last_change":"2024-09-12T18:14:20.059934+0000","last_active":"2024-09-12T18:14:20.059934+0000","last_peered":"2024-09-12T18:14:20.059934+0000","last_clean":"2024-09-12T18:14:20.059934+0000","last_became_active":"2024-09-12T17:20:30.535182+0000","last_became_peered":"2024-09-12T17:20:30.535182+0000","last_unstale":"2024-09-12T18:14:20.059934+0000","last_undegraded":"2024-09-12T18:14:20.059934+0000","last_fullsized":"2024-09-12T18:14:20.059934+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-12T18:14:20.059838+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-12T18:14:20.059838+0000","last_clean_scrub_stamp":"2024-09-12T18:14:20.059838+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:29.555332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":17410,"num_write":14,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'51","reported_seq":202,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.624811+0000","last_change":"2024-09-12T17:16:11.493397+0000","last_active":"2024-09-12T18:11:11.624811+0000","last_peered":"2024-09-12T18:11:11.624811+0000","last_clean":"2024-09-12T18:11:11.624811+0000","last_became_active":"2024-09-12T17:16:11.493043+0000","last_became_peered":"2024-09-12T17:16:11.493043+0000","last_unstale":"2024-09-12T18:11:11.624811+0000","last_undegraded":"2024-09-12T18:11:11.624811+0000","last_fullsized":"2024-09-12T18:11:11.624811+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:13.681249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":193,"num_write":93,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.844692+0000","last_change":"2024-09-12T17:39:05.931399+0000","last_active":"2024-09-12T18:10:36.844692+0000","last_peered":"2024-09-12T18:10:36.844692+0000","last_clean":"2024-09-12T18:10:36.844692+0000","last_became_active":"2024-09-12T17:39:05.931122+0000","last_became_peered":"2024-09-12T17:39:05.931122+0000","last_unstale":"2024-09-12T18:10:36.844692+0000","last_undegraded":"2024-09-12T18:10:36.844692+0000","last_fullsized":"2024-09-12T18:10:36.844692+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:02.508518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'9","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.942169+0000","last_change":"2024-09-12T17:20:34.613048+0000","last_active":"2024-09-12T18:13:48.942169+0000","last_peered":"2024-09-12T18:13:48.942169+0000","last_clean":"2024-09-12T18:13:48.942169+0000","last_became_active":"2024-09-12T17:20:34.612720+0000","last_became_peered":"2024-09-12T17:20:34.612720+0000","last_unstale":"2024-09-12T18:13:48.942169+0000","last_undegraded":"2024-09-12T18:13:48.942169+0000","last_fullsized":"2024-09-12T18:13:48.942169+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:30.901799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":14336,"num_write":14,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'8","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:35.773779+0000","last_change":"2024-09-12T17:20:30.534475+0000","last_active":"2024-09-12T18:12:35.773779+0000","last_peered":"2024-09-12T18:12:35.773779+0000","last_clean":"2024-09-12T18:12:35.773779+0000","last_became_active":"2024-09-12T17:20:30.534068+0000","last_became_peered":"2024-09-12T17:20:30.534068+0000","last_unstale":"2024-09-12T18:12:35.773779+0000","last_undegraded":"2024-09-12T18:12:35.773779+0000","last_fullsized":"2024-09-12T18:12:35.773779+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:16.971800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'25","reported_seq":124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.848415+0000","last_change":"2024-09-12T17:16:11.490345+0000","last_active":"2024-09-12T18:11:11.848415+0000","last_peered":"2024-09-12T18:11:11.848415+0000","last_clean":"2024-09-12T18:11:11.848415+0000","last_became_active":"2024-09-12T17:16:11.489860+0000","last_became_peered":"2024-09-12T17:16:11.489860+0000","last_unstale":"2024-09-12T18:11:11.848415+0000","last_undegraded":"2024-09-12T18:11:11.848415+0000","last_fullsized":"2024-09-12T18:11:11.848415+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:28:30.353456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.848437+0000","last_change":"2024-09-12T17:39:05.931395+0000","last_active":"2024-09-12T18:11:11.848437+0000","last_peered":"2024-09-12T18:11:11.848437+0000","last_clean":"2024-09-12T18:11:11.848437+0000","last_became_active":"2024-09-12T17:39:05.931089+0000","last_became_peered":"2024-09-12T17:39:05.931089+0000","last_unstale":"2024-09-12T18:11:11.848437+0000","last_undegraded":"2024-09-12T18:11:11.848437+0000","last_fullsized":"2024-09-12T18:11:11.848437+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:40.976622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"264'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.514642+0000","last_change":"2024-09-12T17:20:34.557572+0000","last_active":"2024-09-12T18:13:48.514642+0000","last_peered":"2024-09-12T18:13:48.514642+0000","last_clean":"2024-09-12T18:13:48.514642+0000","last_became_active":"2024-09-12T17:20:34.557008+0000","last_became_peered":"2024-09-12T17:20:34.557008+0000","last_unstale":"2024-09-12T18:13:48.514642+0000","last_undegraded":"2024-09-12T18:13:48.514642+0000","last_fullsized":"2024-09-12T18:13:48.514642+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'7","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:16.625332+0000","last_change":"2024-09-12T17:20:30.538674+0000","last_active":"2024-09-12T18:11:16.625332+0000","last_peered":"2024-09-12T18:11:16.625332+0000","last_clean":"2024-09-12T18:11:16.625332+0000","last_became_active":"2024-09-12T17:20:30.538361+0000","last_became_peered":"2024-09-12T17:20:30.538361+0000","last_unstale":"2024-09-12T18:11:16.625332+0000","last_undegraded":"2024-09-12T18:11:16.625332+0000","last_fullsized":"2024-09-12T18:11:16.625332+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:34.525214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4098,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'48","reported_seq":182,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:11.848386+0000","last_change":"2024-09-12T17:16:11.488078+0000","last_active":"2024-09-12T18:11:11.848386+0000","last_peered":"2024-09-12T18:11:11.848386+0000","last_clean":"2024-09-12T18:11:11.848386+0000","last_became_active":"2024-09-12T17:16:11.487771+0000","last_became_peered":"2024-09-12T17:16:11.487771+0000","last_unstale":"2024-09-12T18:11:11.848386+0000","last_undegraded":"2024-09-12T18:11:11.848386+0000","last_fullsized":"2024-09-12T18:11:11.848386+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:38.032910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":161,"num_write":84,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:28.933609+0000","last_change":"2024-09-12T17:39:05.921998+0000","last_active":"2024-09-12T18:12:28.933609+0000","last_peered":"2024-09-12T18:12:28.933609+0000","last_clean":"2024-09-12T18:12:28.933609+0000","last_became_active":"2024-09-12T17:39:05.921661+0000","last_became_peered":"2024-09-12T17:39:05.921661+0000","last_unstale":"2024-09-12T18:12:28.933609+0000","last_undegraded":"2024-09-12T18:12:28.933609+0000","last_fullsized":"2024-09-12T18:12:28.933609+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'3","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:33.284489+0000","last_change":"2024-09-12T18:14:33.284489+0000","last_active":"2024-09-12T18:14:33.284489+0000","last_peered":"2024-09-12T18:14:33.284489+0000","last_clean":"2024-09-12T18:14:33.284489+0000","last_became_active":"2024-09-12T17:20:34.555047+0000","last_became_peered":"2024-09-12T17:20:34.555047+0000","last_unstale":"2024-09-12T18:14:33.284489+0000","last_undegraded":"2024-09-12T18:14:33.284489+0000","last_fullsized":"2024-09-12T18:14:33.284489+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:14:33.284407+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:14:33.284407+0000","last_clean_scrub_stamp":"2024-09-12T18:14:33.284407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:39.812819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'4","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.385159+0000","last_change":"2024-09-12T17:20:30.528356+0000","last_active":"2024-09-12T18:13:49.385159+0000","last_peered":"2024-09-12T18:13:49.385159+0000","last_clean":"2024-09-12T18:13:49.385159+0000","last_became_active":"2024-09-12T17:20:30.528029+0000","last_became_peered":"2024-09-12T17:20:30.528029+0000","last_unstale":"2024-09-12T18:13:49.385159+0000","last_undegraded":"2024-09-12T18:13:49.385159+0000","last_fullsized":"2024-09-12T18:13:49.385159+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:17.569528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'34","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:25.251913+0000","last_change":"2024-09-12T18:14:25.251913+0000","last_active":"2024-09-12T18:14:25.251913+0000","last_peered":"2024-09-12T18:14:25.251913+0000","last_clean":"2024-09-12T18:14:25.251913+0000","last_became_active":"2024-09-12T17:16:11.490952+0000","last_became_peered":"2024-09-12T17:16:11.490952+0000","last_unstale":"2024-09-12T18:14:25.251913+0000","last_undegraded":"2024-09-12T18:14:25.251913+0000","last_fullsized":"2024-09-12T18:14:25.251913+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-09-12T18:14:25.251827+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-09-12T18:14:25.251827+0000","last_clean_scrub_stamp":"2024-09-12T18:14:25.251827+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:49.122335+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":115,"num_write":60,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:37.767778+0000","last_change":"2024-09-12T17:39:05.929242+0000","last_active":"2024-09-12T18:11:37.767778+0000","last_peered":"2024-09-12T18:11:37.767778+0000","last_clean":"2024-09-12T18:11:37.767778+0000","last_became_active":"2024-09-12T17:39:05.928959+0000","last_became_peered":"2024-09-12T17:39:05.928959+0000","last_unstale":"2024-09-12T18:11:37.767778+0000","last_undegraded":"2024-09-12T18:11:37.767778+0000","last_fullsized":"2024-09-12T18:11:37.767778+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:32.263068+0000","last_change":"2024-09-12T18:14:32.263068+0000","last_active":"2024-09-12T18:14:32.263068+0000","last_peered":"2024-09-12T18:14:32.263068+0000","last_clean":"2024-09-12T18:14:32.263068+0000","last_became_active":"2024-09-12T17:20:34.552180+0000","last_became_peered":"2024-09-12T17:20:34.552180+0000","last_unstale":"2024-09-12T18:14:32.263068+0000","last_undegraded":"2024-09-12T18:14:32.263068+0000","last_fullsized":"2024-09-12T18:14:32.263068+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:32.262977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:32.262977+0000","last_clean_scrub_stamp":"2024-09-12T18:14:32.262977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:29.463521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:30.754825+0000","last_change":"2024-09-12T17:20:30.535560+0000","last_active":"2024-09-12T18:10:30.754825+0000","last_peered":"2024-09-12T18:10:30.754825+0000","last_clean":"2024-09-12T18:10:30.754825+0000","last_became_active":"2024-09-12T17:20:30.535001+0000","last_became_peered":"2024-09-12T17:20:30.535001+0000","last_unstale":"2024-09-12T18:10:30.754825+0000","last_undegraded":"2024-09-12T18:10:30.754825+0000","last_fullsized":"2024-09-12T18:10:30.754825+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:47.724576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'14","reported_seq":91,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.630281+0000","last_change":"2024-09-12T17:16:11.480542+0000","last_active":"2024-09-12T18:12:01.630281+0000","last_peered":"2024-09-12T18:12:01.630281+0000","last_clean":"2024-09-12T18:12:01.630281+0000","last_became_active":"2024-09-12T17:16:11.477940+0000","last_became_peered":"2024-09-12T17:16:11.477940+0000","last_unstale":"2024-09-12T18:12:01.630281+0000","last_undegraded":"2024-09-12T18:12:01.630281+0000","last_fullsized":"2024-09-12T18:12:01.630281+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":35,"num_write":34,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:37.767810+0000","last_change":"2024-09-12T17:39:05.930937+0000","last_active":"2024-09-12T18:11:37.767810+0000","last_peered":"2024-09-12T18:11:37.767810+0000","last_clean":"2024-09-12T18:11:37.767810+0000","last_became_active":"2024-09-12T17:39:05.930694+0000","last_became_peered":"2024-09-12T17:39:05.930694+0000","last_unstale":"2024-09-12T18:11:37.767810+0000","last_undegraded":"2024-09-12T18:11:37.767810+0000","last_fullsized":"2024-09-12T18:11:37.767810+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"261'4","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.844714+0000","last_change":"2024-09-12T17:20:34.553025+0000","last_active":"2024-09-12T18:10:36.844714+0000","last_peered":"2024-09-12T18:10:36.844714+0000","last_clean":"2024-09-12T18:10:36.844714+0000","last_became_active":"2024-09-12T17:20:34.552726+0000","last_became_peered":"2024-09-12T17:20:34.552726+0000","last_unstale":"2024-09-12T18:10:36.844714+0000","last_undegraded":"2024-09-12T18:10:36.844714+0000","last_fullsized":"2024-09-12T18:10:36.844714+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:22.335524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:01.638377+0000","last_change":"2024-09-12T17:20:30.539217+0000","last_active":"2024-09-12T18:13:01.638377+0000","last_peered":"2024-09-12T18:13:01.638377+0000","last_clean":"2024-09-12T18:13:01.638377+0000","last_became_active":"2024-09-12T17:20:30.538942+0000","last_became_peered":"2024-09-12T17:20:30.538942+0000","last_unstale":"2024-09-12T18:13:01.638377+0000","last_undegraded":"2024-09-12T18:13:01.638377+0000","last_fullsized":"2024-09-12T18:13:01.638377+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:53.625617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'32","reported_seq":153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:25.248962+0000","last_change":"2024-09-12T18:14:25.248962+0000","last_active":"2024-09-12T18:14:25.248962+0000","last_peered":"2024-09-12T18:14:25.248962+0000","last_clean":"2024-09-12T18:14:25.248962+0000","last_became_active":"2024-09-12T17:16:11.487242+0000","last_became_peered":"2024-09-12T17:16:11.487242+0000","last_unstale":"2024-09-12T18:14:25.248962+0000","last_undegraded":"2024-09-12T18:14:25.248962+0000","last_fullsized":"2024-09-12T18:14:25.248962+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'32","last_scrub_stamp":"2024-09-12T18:14:25.248876+0000","last_deep_scrub":"264'32","last_deep_scrub_stamp":"2024-09-12T18:14:25.248876+0000","last_clean_scrub_stamp":"2024-09-12T18:14:25.248876+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:35.934364+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":114,"num_write":62,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.926163+0000","last_change":"2024-09-12T17:39:05.927350+0000","last_active":"2024-09-12T18:11:48.926163+0000","last_peered":"2024-09-12T18:11:48.926163+0000","last_clean":"2024-09-12T18:11:48.926163+0000","last_became_active":"2024-09-12T17:39:05.924899+0000","last_became_peered":"2024-09-12T17:39:05.924899+0000","last_unstale":"2024-09-12T18:11:48.926163+0000","last_undegraded":"2024-09-12T18:11:48.926163+0000","last_fullsized":"2024-09-12T18:11:48.926163+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'5","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.808588+0000","last_change":"2024-09-12T17:20:34.610704+0000","last_active":"2024-09-12T18:13:48.808588+0000","last_peered":"2024-09-12T18:13:48.808588+0000","last_clean":"2024-09-12T18:13:48.808588+0000","last_became_active":"2024-09-12T17:20:34.610374+0000","last_became_peered":"2024-09-12T17:20:34.610374+0000","last_unstale":"2024-09-12T18:13:48.808588+0000","last_undegraded":"2024-09-12T18:13:48.808588+0000","last_fullsized":"2024-09-12T18:13:48.808588+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:34.456941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1142,"num_write":10,"num_write_kb":1595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"264'3","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.761945+0000","last_change":"2024-09-12T17:20:30.526974+0000","last_active":"2024-09-12T18:13:48.761945+0000","last_peered":"2024-09-12T18:13:48.761945+0000","last_clean":"2024-09-12T18:13:48.761945+0000","last_became_active":"2024-09-12T17:20:30.526672+0000","last_became_peered":"2024-09-12T17:20:30.526672+0000","last_unstale":"2024-09-12T18:13:48.761945+0000","last_undegraded":"2024-09-12T18:13:48.761945+0000","last_fullsized":"2024-09-12T18:13:48.761945+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'19","reported_seq":110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:46.628646+0000","last_change":"2024-09-12T17:16:11.481645+0000","last_active":"2024-09-12T18:11:46.628646+0000","last_peered":"2024-09-12T18:11:46.628646+0000","last_clean":"2024-09-12T18:11:46.628646+0000","last_became_active":"2024-09-12T17:16:11.481351+0000","last_became_peered":"2024-09-12T17:16:11.481351+0000","last_unstale":"2024-09-12T18:11:46.628646+0000","last_undegraded":"2024-09-12T18:11:46.628646+0000","last_fullsized":"2024-09-12T18:11:46.628646+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":68,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:24.093216+0000","last_change":"2024-09-12T18:14:24.093216+0000","last_active":"2024-09-12T18:14:24.093216+0000","last_peered":"2024-09-12T18:14:24.093216+0000","last_clean":"2024-09-12T18:14:24.093216+0000","last_became_active":"2024-09-12T17:39:05.928497+0000","last_became_peered":"2024-09-12T17:39:05.928497+0000","last_unstale":"2024-09-12T18:14:24.093216+0000","last_undegraded":"2024-09-12T18:14:24.093216+0000","last_fullsized":"2024-09-12T18:14:24.093216+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:24.093130+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:24.093130+0000","last_clean_scrub_stamp":"2024-09-12T18:14:24.093130+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:34.010186+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.980168+0000","last_change":"2024-09-12T17:20:34.610626+0000","last_active":"2024-09-12T18:13:48.980168+0000","last_peered":"2024-09-12T18:13:48.980168+0000","last_clean":"2024-09-12T18:13:48.980168+0000","last_became_active":"2024-09-12T17:20:34.610260+0000","last_became_peered":"2024-09-12T17:20:34.610260+0000","last_unstale":"2024-09-12T18:13:48.980168+0000","last_undegraded":"2024-09-12T18:13:48.980168+0000","last_fullsized":"2024-09-12T18:13:48.980168+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'14","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.438735+0000","last_change":"2024-09-12T17:20:30.527312+0000","last_active":"2024-09-12T18:13:48.438735+0000","last_peered":"2024-09-12T18:13:48.438735+0000","last_clean":"2024-09-12T18:13:48.438735+0000","last_became_active":"2024-09-12T17:20:30.527032+0000","last_became_peered":"2024-09-12T17:20:30.527032+0000","last_unstale":"2024-09-12T18:13:48.438735+0000","last_undegraded":"2024-09-12T18:13:48.438735+0000","last_fullsized":"2024-09-12T18:13:48.438735+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:12.370876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":13314,"num_write":24,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"0'0","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:46.852770+0000","last_change":"2024-09-12T17:16:11.494751+0000","last_active":"2024-09-12T18:11:46.852770+0000","last_peered":"2024-09-12T18:11:46.852770+0000","last_clean":"2024-09-12T18:11:46.852770+0000","last_became_active":"2024-09-12T17:16:11.494493+0000","last_became_peered":"2024-09-12T17:16:11.494493+0000","last_unstale":"2024-09-12T18:11:46.852770+0000","last_undegraded":"2024-09-12T18:11:46.852770+0000","last_fullsized":"2024-09-12T18:11:46.852770+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.769254+0000","last_change":"2024-09-12T17:39:05.926661+0000","last_active":"2024-09-12T18:11:47.769254+0000","last_peered":"2024-09-12T18:11:47.769254+0000","last_clean":"2024-09-12T18:11:47.769254+0000","last_became_active":"2024-09-12T17:39:05.926388+0000","last_became_peered":"2024-09-12T17:39:05.926388+0000","last_unstale":"2024-09-12T18:11:47.769254+0000","last_undegraded":"2024-09-12T18:11:47.769254+0000","last_fullsized":"2024-09-12T18:11:47.769254+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"261'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:21.849742+0000","last_change":"2024-09-12T17:20:34.615918+0000","last_active":"2024-09-12T18:11:21.849742+0000","last_peered":"2024-09-12T18:11:21.849742+0000","last_clean":"2024-09-12T18:11:21.849742+0000","last_became_active":"2024-09-12T17:20:34.615468+0000","last_became_peered":"2024-09-12T17:20:34.615468+0000","last_unstale":"2024-09-12T18:11:21.849742+0000","last_undegraded":"2024-09-12T18:11:21.849742+0000","last_fullsized":"2024-09-12T18:11:21.849742+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:26.561082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:19.104971+0000","last_change":"2024-09-12T18:14:19.104971+0000","last_active":"2024-09-12T18:14:19.104971+0000","last_peered":"2024-09-12T18:14:19.104971+0000","last_clean":"2024-09-12T18:14:19.104971+0000","last_became_active":"2024-09-12T17:20:30.533436+0000","last_became_peered":"2024-09-12T17:20:30.533436+0000","last_unstale":"2024-09-12T18:14:19.104971+0000","last_undegraded":"2024-09-12T18:14:19.104971+0000","last_fullsized":"2024-09-12T18:14:19.104971+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:19.104877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:19.104877+0000","last_clean_scrub_stamp":"2024-09-12T18:14:19.104877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:57.618987+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'18","reported_seq":115,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:16.123968+0000","last_change":"2024-09-12T18:14:16.123968+0000","last_active":"2024-09-12T18:14:16.123968+0000","last_peered":"2024-09-12T18:14:16.123968+0000","last_clean":"2024-09-12T18:14:16.123968+0000","last_became_active":"2024-09-12T17:16:11.488588+0000","last_became_peered":"2024-09-12T17:16:11.488588+0000","last_unstale":"2024-09-12T18:14:16.123968+0000","last_undegraded":"2024-09-12T18:14:16.123968+0000","last_fullsized":"2024-09-12T18:14:16.123968+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'18","last_scrub_stamp":"2024-09-12T18:14:16.123879+0000","last_deep_scrub":"264'18","last_deep_scrub_stamp":"2024-09-12T18:14:16.123879+0000","last_clean_scrub_stamp":"2024-09-12T18:14:16.123879+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:29.796727+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.967852+0000","last_change":"2024-09-12T17:39:05.923338+0000","last_active":"2024-09-12T18:11:47.967852+0000","last_peered":"2024-09-12T18:11:47.967852+0000","last_clean":"2024-09-12T18:11:47.967852+0000","last_became_active":"2024-09-12T17:39:05.922973+0000","last_became_peered":"2024-09-12T17:39:05.922973+0000","last_unstale":"2024-09-12T18:11:47.967852+0000","last_undegraded":"2024-09-12T18:11:47.967852+0000","last_fullsized":"2024-09-12T18:11:47.967852+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:20.762674+0000","last_change":"2024-09-12T17:20:34.555891+0000","last_active":"2024-09-12T18:11:20.762674+0000","last_peered":"2024-09-12T18:11:20.762674+0000","last_clean":"2024-09-12T18:11:20.762674+0000","last_became_active":"2024-09-12T17:20:34.554893+0000","last_became_peered":"2024-09-12T17:20:34.554893+0000","last_unstale":"2024-09-12T18:11:20.762674+0000","last_undegraded":"2024-09-12T18:11:20.762674+0000","last_fullsized":"2024-09-12T18:11:20.762674+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:56.253377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'6","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:41.643873+0000","last_change":"2024-09-12T17:20:30.536540+0000","last_active":"2024-09-12T18:13:41.643873+0000","last_peered":"2024-09-12T18:13:41.643873+0000","last_clean":"2024-09-12T18:13:41.643873+0000","last_became_active":"2024-09-12T17:20:30.535226+0000","last_became_peered":"2024-09-12T17:20:30.535226+0000","last_unstale":"2024-09-12T18:13:41.643873+0000","last_undegraded":"2024-09-12T18:13:41.643873+0000","last_fullsized":"2024-09-12T18:13:41.643873+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:28:25.047253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":6,"num_write_kb":3074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'26","reported_seq":136,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:37.368381+0000","last_change":"2024-09-12T18:14:37.368381+0000","last_active":"2024-09-12T18:14:37.368381+0000","last_peered":"2024-09-12T18:14:37.368381+0000","last_clean":"2024-09-12T18:14:37.368381+0000","last_became_active":"2024-09-12T17:16:11.491240+0000","last_became_peered":"2024-09-12T17:16:11.491240+0000","last_unstale":"2024-09-12T18:14:37.368381+0000","last_undegraded":"2024-09-12T18:14:37.368381+0000","last_fullsized":"2024-09-12T18:14:37.368381+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'26","last_scrub_stamp":"2024-09-12T18:14:37.368275+0000","last_deep_scrub":"264'26","last_deep_scrub_stamp":"2024-09-12T18:14:37.368275+0000","last_clean_scrub_stamp":"2024-09-12T18:14:37.368275+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:28.300827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":97,"num_write":43,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844211+0000","last_change":"2024-09-12T17:39:05.932135+0000","last_active":"2024-09-12T18:10:31.844211+0000","last_peered":"2024-09-12T18:10:31.844211+0000","last_clean":"2024-09-12T18:10:31.844211+0000","last_became_active":"2024-09-12T17:39:05.931841+0000","last_became_peered":"2024-09-12T17:39:05.931841+0000","last_unstale":"2024-09-12T18:10:31.844211+0000","last_undegraded":"2024-09-12T18:10:31.844211+0000","last_fullsized":"2024-09-12T18:10:31.844211+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:08.525616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.926685+0000","last_change":"2024-09-12T17:20:34.560852+0000","last_active":"2024-09-12T18:11:53.926685+0000","last_peered":"2024-09-12T18:11:53.926685+0000","last_clean":"2024-09-12T18:11:53.926685+0000","last_became_active":"2024-09-12T17:20:34.560497+0000","last_became_peered":"2024-09-12T17:20:34.560497+0000","last_unstale":"2024-09-12T18:11:53.926685+0000","last_undegraded":"2024-09-12T18:11:53.926685+0000","last_fullsized":"2024-09-12T18:11:53.926685+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"261'7","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.767049+0000","last_change":"2024-09-12T17:20:30.535717+0000","last_active":"2024-09-12T18:11:50.767049+0000","last_peered":"2024-09-12T18:11:50.767049+0000","last_clean":"2024-09-12T18:11:50.767049+0000","last_became_active":"2024-09-12T17:20:30.535358+0000","last_became_peered":"2024-09-12T17:20:30.535358+0000","last_unstale":"2024-09-12T18:11:50.767049+0000","last_undegraded":"2024-09-12T18:11:50.767049+0000","last_fullsized":"2024-09-12T18:11:50.767049+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":15362,"num_write":12,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'12","reported_seq":99,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:35.440402+0000","last_change":"2024-09-12T18:14:35.440402+0000","last_active":"2024-09-12T18:14:35.440402+0000","last_peered":"2024-09-12T18:14:35.440402+0000","last_clean":"2024-09-12T18:14:35.440402+0000","last_became_active":"2024-09-12T17:16:11.489897+0000","last_became_peered":"2024-09-12T17:16:11.489897+0000","last_unstale":"2024-09-12T18:14:35.440402+0000","last_undegraded":"2024-09-12T18:14:35.440402+0000","last_fullsized":"2024-09-12T18:14:35.440402+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-09-12T18:14:35.440323+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-09-12T18:14:35.440323+0000","last_clean_scrub_stamp":"2024-09-12T18:14:35.440323+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:01.721656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.620396+0000","last_change":"2024-09-12T17:39:05.927618+0000","last_active":"2024-09-12T18:10:31.620396+0000","last_peered":"2024-09-12T18:10:31.620396+0000","last_clean":"2024-09-12T18:10:31.620396+0000","last_became_active":"2024-09-12T17:39:05.926766+0000","last_became_peered":"2024-09-12T17:39:05.926766+0000","last_unstale":"2024-09-12T18:10:31.620396+0000","last_undegraded":"2024-09-12T18:10:31.620396+0000","last_fullsized":"2024-09-12T18:10:31.620396+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:41.020632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"264'2","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:33.279759+0000","last_change":"2024-09-12T18:14:33.279759+0000","last_active":"2024-09-12T18:14:33.279759+0000","last_peered":"2024-09-12T18:14:33.279759+0000","last_clean":"2024-09-12T18:14:33.279759+0000","last_became_active":"2024-09-12T17:20:34.558970+0000","last_became_peered":"2024-09-12T17:20:34.558970+0000","last_unstale":"2024-09-12T18:14:33.279759+0000","last_undegraded":"2024-09-12T18:14:33.279759+0000","last_fullsized":"2024-09-12T18:14:33.279759+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:33.279662+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:33.279662+0000","last_clean_scrub_stamp":"2024-09-12T18:14:33.279662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:33.229244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'4","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.517417+0000","last_change":"2024-09-12T17:20:30.536062+0000","last_active":"2024-09-12T18:13:48.517417+0000","last_peered":"2024-09-12T18:13:48.517417+0000","last_clean":"2024-09-12T18:13:48.517417+0000","last_became_active":"2024-09-12T17:20:30.535761+0000","last_became_peered":"2024-09-12T17:20:30.535761+0000","last_unstale":"2024-09-12T18:13:48.517417+0000","last_undegraded":"2024-09-12T18:13:48.517417+0000","last_fullsized":"2024-09-12T18:13:48.517417+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8196,"num_write":4,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'42","reported_seq":176,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:11.631584+0000","last_change":"2024-09-12T17:16:11.488259+0000","last_active":"2024-09-12T18:12:11.631584+0000","last_peered":"2024-09-12T18:12:11.631584+0000","last_clean":"2024-09-12T18:12:11.631584+0000","last_became_active":"2024-09-12T17:16:11.487923+0000","last_became_peered":"2024-09-12T17:16:11.487923+0000","last_unstale":"2024-09-12T18:12:11.631584+0000","last_undegraded":"2024-09-12T18:12:11.631584+0000","last_fullsized":"2024-09-12T18:12:11.631584+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":152,"num_write":79,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.629760+0000","last_change":"2024-09-12T17:39:05.921610+0000","last_active":"2024-09-12T18:11:56.629760+0000","last_peered":"2024-09-12T18:11:56.629760+0000","last_clean":"2024-09-12T18:11:56.629760+0000","last_became_active":"2024-09-12T17:39:05.921257+0000","last_became_peered":"2024-09-12T17:39:05.921257+0000","last_unstale":"2024-09-12T18:11:56.629760+0000","last_undegraded":"2024-09-12T18:11:56.629760+0000","last_fullsized":"2024-09-12T18:11:56.629760+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'4","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.350420+0000","last_change":"2024-09-12T17:20:34.554048+0000","last_active":"2024-09-12T18:13:49.350420+0000","last_peered":"2024-09-12T18:13:49.350420+0000","last_clean":"2024-09-12T18:13:49.350420+0000","last_became_active":"2024-09-12T17:20:34.553659+0000","last_became_peered":"2024-09-12T17:20:34.553659+0000","last_unstale":"2024-09-12T18:13:49.350420+0000","last_undegraded":"2024-09-12T18:13:49.350420+0000","last_fullsized":"2024-09-12T18:13:49.350420+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":52,"num_write":4,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:29.308211+0000","last_change":"2024-09-12T18:14:29.308211+0000","last_active":"2024-09-12T18:14:29.308211+0000","last_peered":"2024-09-12T18:14:29.308211+0000","last_clean":"2024-09-12T18:14:29.308211+0000","last_became_active":"2024-09-12T17:20:30.534878+0000","last_became_peered":"2024-09-12T17:20:30.534878+0000","last_unstale":"2024-09-12T18:14:29.308211+0000","last_undegraded":"2024-09-12T18:14:29.308211+0000","last_fullsized":"2024-09-12T18:14:29.308211+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:29.308129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:29.308129+0000","last_clean_scrub_stamp":"2024-09-12T18:14:29.308129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:55.168954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'92","reported_seq":344,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:10.769995+0000","last_change":"2024-09-12T17:16:11.489329+0000","last_active":"2024-09-12T18:12:10.769995+0000","last_peered":"2024-09-12T18:12:10.769995+0000","last_clean":"2024-09-12T18:12:10.769995+0000","last_became_active":"2024-09-12T17:16:11.489044+0000","last_became_peered":"2024-09-12T17:16:11.489044+0000","last_unstale":"2024-09-12T18:12:10.769995+0000","last_undegraded":"2024-09-12T18:12:10.769995+0000","last_fullsized":"2024-09-12T18:12:10.769995+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":552,"num_read_kb":376,"num_write":139,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844194+0000","last_change":"2024-09-12T17:39:05.932942+0000","last_active":"2024-09-12T18:10:31.844194+0000","last_peered":"2024-09-12T18:10:31.844194+0000","last_clean":"2024-09-12T18:10:31.844194+0000","last_became_active":"2024-09-12T17:39:05.932617+0000","last_became_peered":"2024-09-12T17:39:05.932617+0000","last_unstale":"2024-09-12T18:10:31.844194+0000","last_undegraded":"2024-09-12T18:10:31.844194+0000","last_fullsized":"2024-09-12T18:10:31.844194+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:47.846584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"261'5","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:31.300183+0000","last_change":"2024-09-12T18:14:31.300183+0000","last_active":"2024-09-12T18:14:31.300183+0000","last_peered":"2024-09-12T18:14:31.300183+0000","last_clean":"2024-09-12T18:14:31.300183+0000","last_became_active":"2024-09-12T17:20:34.559024+0000","last_became_peered":"2024-09-12T17:20:34.559024+0000","last_unstale":"2024-09-12T18:14:31.300183+0000","last_undegraded":"2024-09-12T18:14:31.300183+0000","last_fullsized":"2024-09-12T18:14:31.300183+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T18:14:31.300097+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T18:14:31.300097+0000","last_clean_scrub_stamp":"2024-09-12T18:14:31.300097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:19.729710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'6","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.228609+0000","last_change":"2024-09-12T17:20:30.534604+0000","last_active":"2024-09-12T18:13:49.228609+0000","last_peered":"2024-09-12T18:13:49.228609+0000","last_clean":"2024-09-12T18:13:49.228609+0000","last_became_active":"2024-09-12T17:20:30.534298+0000","last_became_peered":"2024-09-12T17:20:30.534298+0000","last_unstale":"2024-09-12T18:13:49.228609+0000","last_undegraded":"2024-09-12T18:13:49.228609+0000","last_fullsized":"2024-09-12T18:13:49.228609+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'39","reported_seq":163,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:11.856282+0000","last_change":"2024-09-12T17:16:11.489376+0000","last_active":"2024-09-12T18:12:11.856282+0000","last_peered":"2024-09-12T18:12:11.856282+0000","last_clean":"2024-09-12T18:12:11.856282+0000","last_became_active":"2024-09-12T17:16:11.489085+0000","last_became_peered":"2024-09-12T17:16:11.489085+0000","last_unstale":"2024-09-12T18:12:11.856282+0000","last_undegraded":"2024-09-12T18:12:11.856282+0000","last_fullsized":"2024-09-12T18:12:11.856282+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":137,"num_write":73,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:21.066230+0000","last_change":"2024-09-12T18:14:21.066230+0000","last_active":"2024-09-12T18:14:21.066230+0000","last_peered":"2024-09-12T18:14:21.066230+0000","last_clean":"2024-09-12T18:14:21.066230+0000","last_became_active":"2024-09-12T17:39:05.928320+0000","last_became_peered":"2024-09-12T17:39:05.928320+0000","last_unstale":"2024-09-12T18:14:21.066230+0000","last_undegraded":"2024-09-12T18:14:21.066230+0000","last_fullsized":"2024-09-12T18:14:21.066230+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:21.066130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:21.066130+0000","last_clean_scrub_stamp":"2024-09-12T18:14:21.066130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:24.159619+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"261'5","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.857883+0000","last_change":"2024-09-12T17:20:34.553728+0000","last_active":"2024-09-12T18:12:21.857883+0000","last_peered":"2024-09-12T18:12:21.857883+0000","last_clean":"2024-09-12T18:12:21.857883+0000","last_became_active":"2024-09-12T17:20:34.553407+0000","last_became_peered":"2024-09-12T17:20:34.553407+0000","last_unstale":"2024-09-12T18:12:21.857883+0000","last_undegraded":"2024-09-12T18:12:21.857883+0000","last_fullsized":"2024-09-12T18:12:21.857883+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'7","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.385881+0000","last_change":"2024-09-12T17:20:30.525002+0000","last_active":"2024-09-12T18:13:49.385881+0000","last_peered":"2024-09-12T18:13:49.385881+0000","last_clean":"2024-09-12T18:13:49.385881+0000","last_became_active":"2024-09-12T17:20:30.524670+0000","last_became_peered":"2024-09-12T17:20:30.524670+0000","last_unstale":"2024-09-12T18:13:49.385881+0000","last_undegraded":"2024-09-12T18:13:49.385881+0000","last_fullsized":"2024-09-12T18:13:49.385881+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4667,"num_write":12,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'33","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.843088+0000","last_change":"2024-09-12T17:16:11.487281+0000","last_active":"2024-09-12T18:10:21.843088+0000","last_peered":"2024-09-12T18:10:21.843088+0000","last_clean":"2024-09-12T18:10:21.843088+0000","last_became_active":"2024-09-12T17:16:11.486986+0000","last_became_peered":"2024-09-12T17:16:11.486986+0000","last_unstale":"2024-09-12T18:10:21.843088+0000","last_undegraded":"2024-09-12T18:10:21.843088+0000","last_fullsized":"2024-09-12T18:10:21.843088+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:58.383837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":108,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.758368+0000","last_change":"2024-09-12T17:39:05.927856+0000","last_active":"2024-09-12T18:10:37.758368+0000","last_peered":"2024-09-12T18:10:37.758368+0000","last_clean":"2024-09-12T18:10:37.758368+0000","last_became_active":"2024-09-12T17:39:05.927578+0000","last_became_peered":"2024-09-12T17:39:05.927578+0000","last_unstale":"2024-09-12T18:10:37.758368+0000","last_undegraded":"2024-09-12T18:10:37.758368+0000","last_fullsized":"2024-09-12T18:10:37.758368+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:21.888828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.857830+0000","last_change":"2024-09-12T17:20:34.552899+0000","last_active":"2024-09-12T18:12:21.857830+0000","last_peered":"2024-09-12T18:12:21.857830+0000","last_clean":"2024-09-12T18:12:21.857830+0000","last_became_active":"2024-09-12T17:20:34.552569+0000","last_became_peered":"2024-09-12T17:20:34.552569+0000","last_unstale":"2024-09-12T18:12:21.857830+0000","last_undegraded":"2024-09-12T18:12:21.857830+0000","last_fullsized":"2024-09-12T18:12:21.857830+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:22.115770+0000","last_change":"2024-09-12T18:14:22.115718+0000","last_active":"2024-09-12T18:14:22.115770+0000","last_peered":"2024-09-12T18:14:22.115770+0000","last_clean":"2024-09-12T18:14:22.115770+0000","last_became_active":"2024-09-12T17:20:30.538157+0000","last_became_peered":"2024-09-12T17:20:30.538157+0000","last_unstale":"2024-09-12T18:14:22.115770+0000","last_undegraded":"2024-09-12T18:14:22.115770+0000","last_fullsized":"2024-09-12T18:14:22.115770+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:22.115629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:22.115629+0000","last_clean_scrub_stamp":"2024-09-12T18:14:22.115629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:25.621456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'29","reported_seq":146,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:36.380810+0000","last_change":"2024-09-12T18:14:36.380810+0000","last_active":"2024-09-12T18:14:36.380810+0000","last_peered":"2024-09-12T18:14:36.380810+0000","last_clean":"2024-09-12T18:14:36.380810+0000","last_became_active":"2024-09-12T17:16:11.487998+0000","last_became_peered":"2024-09-12T17:16:11.487998+0000","last_unstale":"2024-09-12T18:14:36.380810+0000","last_undegraded":"2024-09-12T18:14:36.380810+0000","last_fullsized":"2024-09-12T18:14:36.380810+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-12T18:14:36.380714+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-12T18:14:36.380714+0000","last_clean_scrub_stamp":"2024-09-12T18:14:36.380714+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:45.043463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:34.241251+0000","last_change":"2024-09-12T18:14:34.241251+0000","last_active":"2024-09-12T18:14:34.241251+0000","last_peered":"2024-09-12T18:14:34.241251+0000","last_clean":"2024-09-12T18:14:34.241251+0000","last_became_active":"2024-09-12T17:39:05.921008+0000","last_became_peered":"2024-09-12T17:39:05.921008+0000","last_unstale":"2024-09-12T18:14:34.241251+0000","last_undegraded":"2024-09-12T18:14:34.241251+0000","last_fullsized":"2024-09-12T18:14:34.241251+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:34.241154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:34.241154+0000","last_clean_scrub_stamp":"2024-09-12T18:14:34.241154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:44.562900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'2","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:32.305227+0000","last_change":"2024-09-12T18:14:32.305227+0000","last_active":"2024-09-12T18:14:32.305227+0000","last_peered":"2024-09-12T18:14:32.305227+0000","last_clean":"2024-09-12T18:14:32.305227+0000","last_became_active":"2024-09-12T17:20:34.615689+0000","last_became_peered":"2024-09-12T17:20:34.615689+0000","last_unstale":"2024-09-12T18:14:32.305227+0000","last_undegraded":"2024-09-12T18:14:32.305227+0000","last_fullsized":"2024-09-12T18:14:32.305227+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:32.305124+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:32.305124+0000","last_clean_scrub_stamp":"2024-09-12T18:14:32.305124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:47.888594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'4","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:49.227863+0000","last_change":"2024-09-12T17:20:30.540013+0000","last_active":"2024-09-12T18:13:49.227863+0000","last_peered":"2024-09-12T18:13:49.227863+0000","last_clean":"2024-09-12T18:13:49.227863+0000","last_became_active":"2024-09-12T17:20:30.536917+0000","last_became_peered":"2024-09-12T17:20:30.536917+0000","last_unstale":"2024-09-12T18:13:49.227863+0000","last_undegraded":"2024-09-12T18:13:49.227863+0000","last_fullsized":"2024-09-12T18:13:49.227863+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'41","reported_seq":176,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:24.202169+0000","last_change":"2024-09-12T18:14:24.202169+0000","last_active":"2024-09-12T18:14:24.202169+0000","last_peered":"2024-09-12T18:14:24.202169+0000","last_clean":"2024-09-12T18:14:24.202169+0000","last_became_active":"2024-09-12T17:16:11.488252+0000","last_became_peered":"2024-09-12T17:16:11.488252+0000","last_unstale":"2024-09-12T18:14:24.202169+0000","last_undegraded":"2024-09-12T18:14:24.202169+0000","last_fullsized":"2024-09-12T18:14:24.202169+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-09-12T18:14:24.202082+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-09-12T18:14:24.202082+0000","last_clean_scrub_stamp":"2024-09-12T18:14:24.202082+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:26.021742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":141,"num_write":74,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:37.767690+0000","last_change":"2024-09-12T17:39:05.926009+0000","last_active":"2024-09-12T18:11:37.767690+0000","last_peered":"2024-09-12T18:11:37.767690+0000","last_clean":"2024-09-12T18:11:37.767690+0000","last_became_active":"2024-09-12T17:39:05.925589+0000","last_became_peered":"2024-09-12T17:39:05.925589+0000","last_unstale":"2024-09-12T18:11:37.767690+0000","last_undegraded":"2024-09-12T18:11:37.767690+0000","last_fullsized":"2024-09-12T18:11:37.767690+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:14.643645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'11","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.852402+0000","last_change":"2024-09-12T17:20:34.560582+0000","last_active":"2024-09-12T18:13:48.852402+0000","last_peered":"2024-09-12T18:13:48.852402+0000","last_clean":"2024-09-12T18:13:48.852402+0000","last_became_active":"2024-09-12T17:20:34.560319+0000","last_became_peered":"2024-09-12T17:20:34.560319+0000","last_unstale":"2024-09-12T18:13:48.852402+0000","last_undegraded":"2024-09-12T18:13:48.852402+0000","last_fullsized":"2024-09-12T18:13:48.852402+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15462,"num_write":16,"num_write_kb":7218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'2","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:27.217277+0000","last_change":"2024-09-12T18:14:27.217277+0000","last_active":"2024-09-12T18:14:27.217277+0000","last_peered":"2024-09-12T18:14:27.217277+0000","last_clean":"2024-09-12T18:14:27.217277+0000","last_became_active":"2024-09-12T17:20:30.531384+0000","last_became_peered":"2024-09-12T17:20:30.531384+0000","last_unstale":"2024-09-12T18:14:27.217277+0000","last_undegraded":"2024-09-12T18:14:27.217277+0000","last_fullsized":"2024-09-12T18:14:27.217277+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:27.217186+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:27.217186+0000","last_clean_scrub_stamp":"2024-09-12T18:14:27.217186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:29.758742+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'7","reported_seq":84,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:14.091620+0000","last_change":"2024-09-12T18:14:14.091620+0000","last_active":"2024-09-12T18:14:14.091620+0000","last_peered":"2024-09-12T18:14:14.091620+0000","last_clean":"2024-09-12T18:14:14.091620+0000","last_became_active":"2024-09-12T17:16:11.486098+0000","last_became_peered":"2024-09-12T17:16:11.486098+0000","last_unstale":"2024-09-12T18:14:14.091620+0000","last_undegraded":"2024-09-12T18:14:14.091620+0000","last_fullsized":"2024-09-12T18:14:14.091620+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-12T18:14:14.091515+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-12T18:14:14.091515+0000","last_clean_scrub_stamp":"2024-09-12T18:14:14.091515+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:08.093165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.844775+0000","last_change":"2024-09-12T17:39:05.926486+0000","last_active":"2024-09-12T18:10:36.844775+0000","last_peered":"2024-09-12T18:10:36.844775+0000","last_clean":"2024-09-12T18:10:36.844775+0000","last_became_active":"2024-09-12T17:39:05.925637+0000","last_became_peered":"2024-09-12T17:39:05.925637+0000","last_unstale":"2024-09-12T18:10:36.844775+0000","last_undegraded":"2024-09-12T18:10:36.844775+0000","last_fullsized":"2024-09-12T18:10:36.844775+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:55.840960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:25.753841+0000","last_change":"2024-09-12T17:20:47.596669+0000","last_active":"2024-09-12T18:10:25.753841+0000","last_peered":"2024-09-12T18:10:25.753841+0000","last_clean":"2024-09-12T18:10:25.753841+0000","last_became_active":"2024-09-12T17:20:47.581310+0000","last_became_peered":"2024-09-12T17:20:47.581310+0000","last_unstale":"2024-09-12T18:10:25.753841+0000","last_undegraded":"2024-09-12T18:10:25.753841+0000","last_fullsized":"2024-09-12T18:10:25.753841+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:11.897529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.619107+0000","last_change":"2024-09-12T17:20:30.536180+0000","last_active":"2024-09-12T18:10:21.619107+0000","last_peered":"2024-09-12T18:10:21.619107+0000","last_clean":"2024-09-12T18:10:21.619107+0000","last_became_active":"2024-09-12T17:20:30.535668+0000","last_became_peered":"2024-09-12T17:20:30.535668+0000","last_unstale":"2024-09-12T18:10:21.619107+0000","last_undegraded":"2024-09-12T18:10:21.619107+0000","last_fullsized":"2024-09-12T18:10:21.619107+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:31.430438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'13","reported_seq":100,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:36.270373+0000","last_change":"2024-09-12T18:14:36.270373+0000","last_active":"2024-09-12T18:14:36.270373+0000","last_peered":"2024-09-12T18:14:36.270373+0000","last_clean":"2024-09-12T18:14:36.270373+0000","last_became_active":"2024-09-12T17:16:11.484154+0000","last_became_peered":"2024-09-12T17:16:11.484154+0000","last_unstale":"2024-09-12T18:14:36.270373+0000","last_undegraded":"2024-09-12T18:14:36.270373+0000","last_fullsized":"2024-09-12T18:14:36.270373+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-09-12T18:14:36.270284+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-09-12T18:14:36.270284+0000","last_clean_scrub_stamp":"2024-09-12T18:14:36.270284+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:17.752999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":37,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:42.759255+0000","last_change":"2024-09-12T17:39:05.928118+0000","last_active":"2024-09-12T18:10:42.759255+0000","last_peered":"2024-09-12T18:10:42.759255+0000","last_clean":"2024-09-12T18:10:42.759255+0000","last_became_active":"2024-09-12T17:39:05.927841+0000","last_became_peered":"2024-09-12T17:39:05.927841+0000","last_unstale":"2024-09-12T18:10:42.759255+0000","last_undegraded":"2024-09-12T18:10:42.759255+0000","last_fullsized":"2024-09-12T18:10:42.759255+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:37.026584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.756629+0000","last_change":"2024-09-12T17:20:34.611017+0000","last_active":"2024-09-12T18:10:27.756629+0000","last_peered":"2024-09-12T18:10:27.756629+0000","last_clean":"2024-09-12T18:10:27.756629+0000","last_became_active":"2024-09-12T17:20:34.610737+0000","last_became_peered":"2024-09-12T17:20:34.610737+0000","last_unstale":"2024-09-12T18:10:27.756629+0000","last_undegraded":"2024-09-12T18:10:27.756629+0000","last_fullsized":"2024-09-12T18:10:27.756629+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:07.818994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:29.239633+0000","last_change":"2024-09-12T18:14:29.239633+0000","last_active":"2024-09-12T18:14:29.239633+0000","last_peered":"2024-09-12T18:14:29.239633+0000","last_clean":"2024-09-12T18:14:29.239633+0000","last_became_active":"2024-09-12T17:20:30.528902+0000","last_became_peered":"2024-09-12T17:20:30.528902+0000","last_unstale":"2024-09-12T18:14:29.239633+0000","last_undegraded":"2024-09-12T18:14:29.239633+0000","last_fullsized":"2024-09-12T18:14:29.239633+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:29.239538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:29.239538+0000","last_clean_scrub_stamp":"2024-09-12T18:14:29.239538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:02.578918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'31","reported_seq":156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:34.425711+0000","last_change":"2024-09-12T18:14:34.425711+0000","last_active":"2024-09-12T18:14:34.425711+0000","last_peered":"2024-09-12T18:14:34.425711+0000","last_clean":"2024-09-12T18:14:34.425711+0000","last_became_active":"2024-09-12T17:16:11.488722+0000","last_became_peered":"2024-09-12T17:16:11.488722+0000","last_unstale":"2024-09-12T18:14:34.425711+0000","last_undegraded":"2024-09-12T18:14:34.425711+0000","last_fullsized":"2024-09-12T18:14:34.425711+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-09-12T18:14:34.425586+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-09-12T18:14:34.425586+0000","last_clean_scrub_stamp":"2024-09-12T18:14:34.425586+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:50.212908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":116,"num_write":54,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:37.758386+0000","last_change":"2024-09-12T17:39:05.929421+0000","last_active":"2024-09-12T18:10:37.758386+0000","last_peered":"2024-09-12T18:10:37.758386+0000","last_clean":"2024-09-12T18:10:37.758386+0000","last_became_active":"2024-09-12T17:39:05.929156+0000","last_became_peered":"2024-09-12T17:39:05.929156+0000","last_unstale":"2024-09-12T18:10:37.758386+0000","last_undegraded":"2024-09-12T18:10:37.758386+0000","last_fullsized":"2024-09-12T18:10:37.758386+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:37.940351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:31.278454+0000","last_change":"2024-09-12T18:14:31.278387+0000","last_active":"2024-09-12T18:14:31.278454+0000","last_peered":"2024-09-12T18:14:31.278454+0000","last_clean":"2024-09-12T18:14:31.278454+0000","last_became_active":"2024-09-12T17:20:34.558826+0000","last_became_peered":"2024-09-12T17:20:34.558826+0000","last_unstale":"2024-09-12T18:14:31.278454+0000","last_undegraded":"2024-09-12T18:14:31.278454+0000","last_fullsized":"2024-09-12T18:14:31.278454+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:31.278298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:31.278298+0000","last_clean_scrub_stamp":"2024-09-12T18:14:31.278298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:47.464949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.620862+0000","last_change":"2024-09-12T17:20:30.537479+0000","last_active":"2024-09-12T18:10:36.620862+0000","last_peered":"2024-09-12T18:10:36.620862+0000","last_clean":"2024-09-12T18:10:36.620862+0000","last_became_active":"2024-09-12T17:20:30.537204+0000","last_became_peered":"2024-09-12T17:20:30.537204+0000","last_unstale":"2024-09-12T18:10:36.620862+0000","last_undegraded":"2024-09-12T18:10:36.620862+0000","last_fullsized":"2024-09-12T18:10:36.620862+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:58.505650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'43","reported_seq":176,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:21.842925+0000","last_change":"2024-09-12T17:16:11.487416+0000","last_active":"2024-09-12T18:10:21.842925+0000","last_peered":"2024-09-12T18:10:21.842925+0000","last_clean":"2024-09-12T18:10:21.842925+0000","last_became_active":"2024-09-12T17:16:11.487129+0000","last_became_peered":"2024-09-12T17:16:11.487129+0000","last_unstale":"2024-09-12T18:10:21.842925+0000","last_undegraded":"2024-09-12T18:10:21.842925+0000","last_fullsized":"2024-09-12T18:10:21.842925+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:10.456322+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.456322+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:13.494114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":153,"num_write":79,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:36.620937+0000","last_change":"2024-09-12T17:39:05.926264+0000","last_active":"2024-09-12T18:10:36.620937+0000","last_peered":"2024-09-12T18:10:36.620937+0000","last_clean":"2024-09-12T18:10:36.620937+0000","last_became_active":"2024-09-12T17:39:05.925950+0000","last_became_peered":"2024-09-12T17:39:05.925950+0000","last_unstale":"2024-09-12T18:10:36.620937+0000","last_undegraded":"2024-09-12T18:10:36.620937+0000","last_fullsized":"2024-09-12T18:10:36.620937+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:25.942839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'3","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:47.778540+0000","last_change":"2024-09-12T17:20:34.555836+0000","last_active":"2024-09-12T18:12:47.778540+0000","last_peered":"2024-09-12T18:12:47.778540+0000","last_clean":"2024-09-12T18:12:47.778540+0000","last_became_active":"2024-09-12T17:20:34.555493+0000","last_became_peered":"2024-09-12T17:20:34.555493+0000","last_unstale":"2024-09-12T18:12:47.778540+0000","last_undegraded":"2024-09-12T18:12:47.778540+0000","last_fullsized":"2024-09-12T18:12:47.778540+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:04.010344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'4","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:34.850257+0000","last_change":"2024-09-12T18:14:34.850257+0000","last_active":"2024-09-12T18:14:34.850257+0000","last_peered":"2024-09-12T18:14:34.850257+0000","last_clean":"2024-09-12T18:14:34.850257+0000","last_became_active":"2024-09-12T17:20:30.534448+0000","last_became_peered":"2024-09-12T17:20:30.534448+0000","last_unstale":"2024-09-12T18:14:34.850257+0000","last_undegraded":"2024-09-12T18:14:34.850257+0000","last_fullsized":"2024-09-12T18:14:34.850257+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:14:34.850163+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:14:34.850163+0000","last_clean_scrub_stamp":"2024-09-12T18:14:34.850163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:53.203155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":4,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'9","reported_seq":95,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:26.284565+0000","last_change":"2024-09-12T18:14:26.284565+0000","last_active":"2024-09-12T18:14:26.284565+0000","last_peered":"2024-09-12T18:14:26.284565+0000","last_clean":"2024-09-12T18:14:26.284565+0000","last_became_active":"2024-09-12T17:16:11.488433+0000","last_became_peered":"2024-09-12T17:16:11.488433+0000","last_unstale":"2024-09-12T18:14:26.284565+0000","last_undegraded":"2024-09-12T18:14:26.284565+0000","last_fullsized":"2024-09-12T18:14:26.284565+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-12T18:14:26.284480+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-12T18:14:26.284480+0000","last_clean_scrub_stamp":"2024-09-12T18:14:26.284480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:22.408672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":34,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:27.775204+0000","last_change":"2024-09-12T17:39:05.927566+0000","last_active":"2024-09-12T18:12:27.775204+0000","last_peered":"2024-09-12T18:12:27.775204+0000","last_clean":"2024-09-12T18:12:27.775204+0000","last_became_active":"2024-09-12T17:39:05.925525+0000","last_became_peered":"2024-09-12T17:39:05.925525+0000","last_unstale":"2024-09-12T18:12:27.775204+0000","last_undegraded":"2024-09-12T18:12:27.775204+0000","last_fullsized":"2024-09-12T18:12:27.775204+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:56.637772+0000","last_change":"2024-09-12T17:20:34.559275+0000","last_active":"2024-09-12T18:12:56.637772+0000","last_peered":"2024-09-12T18:12:56.637772+0000","last_clean":"2024-09-12T18:12:56.637772+0000","last_became_active":"2024-09-12T17:20:34.558946+0000","last_became_peered":"2024-09-12T17:20:34.558946+0000","last_unstale":"2024-09-12T18:12:56.637772+0000","last_undegraded":"2024-09-12T18:12:56.637772+0000","last_fullsized":"2024-09-12T18:12:56.637772+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:44.945949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'4","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.757518+0000","last_change":"2024-09-12T17:20:30.528368+0000","last_active":"2024-09-12T18:10:32.757518+0000","last_peered":"2024-09-12T18:10:32.757518+0000","last_clean":"2024-09-12T18:10:32.757518+0000","last_became_active":"2024-09-12T17:20:30.528078+0000","last_became_peered":"2024-09-12T17:20:30.528078+0000","last_unstale":"2024-09-12T18:10:32.757518+0000","last_undegraded":"2024-09-12T18:10:32.757518+0000","last_fullsized":"2024-09-12T18:10:32.757518+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:37.188849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'44","reported_seq":190,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:34.229864+0000","last_change":"2024-09-12T18:14:34.229864+0000","last_active":"2024-09-12T18:14:34.229864+0000","last_peered":"2024-09-12T18:14:34.229864+0000","last_clean":"2024-09-12T18:14:34.229864+0000","last_became_active":"2024-09-12T17:16:11.481431+0000","last_became_peered":"2024-09-12T17:16:11.481431+0000","last_unstale":"2024-09-12T18:14:34.229864+0000","last_undegraded":"2024-09-12T18:14:34.229864+0000","last_fullsized":"2024-09-12T18:14:34.229864+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'44","last_scrub_stamp":"2024-09-12T18:14:34.229758+0000","last_deep_scrub":"264'44","last_deep_scrub_stamp":"2024-09-12T18:14:34.229758+0000","last_clean_scrub_stamp":"2024-09-12T18:14:34.229758+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:49.892480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":166,"num_write":69,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:27.974632+0000","last_change":"2024-09-12T17:39:05.919499+0000","last_active":"2024-09-12T18:12:27.974632+0000","last_peered":"2024-09-12T18:12:27.974632+0000","last_clean":"2024-09-12T18:12:27.974632+0000","last_became_active":"2024-09-12T17:39:05.919207+0000","last_became_peered":"2024-09-12T17:39:05.919207+0000","last_unstale":"2024-09-12T18:12:27.974632+0000","last_undegraded":"2024-09-12T18:12:27.974632+0000","last_fullsized":"2024-09-12T18:12:27.974632+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'10","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.517672+0000","last_change":"2024-09-12T17:20:34.613162+0000","last_active":"2024-09-12T18:13:48.517672+0000","last_peered":"2024-09-12T18:13:48.517672+0000","last_clean":"2024-09-12T18:13:48.517672+0000","last_became_active":"2024-09-12T17:20:34.612840+0000","last_became_peered":"2024-09-12T17:20:34.612840+0000","last_unstale":"2024-09-12T18:13:48.517672+0000","last_undegraded":"2024-09-12T18:13:48.517672+0000","last_fullsized":"2024-09-12T18:13:48.517672+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:07.359408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":10,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:18.083073+0000","last_change":"2024-09-12T18:14:18.083073+0000","last_active":"2024-09-12T18:14:18.083073+0000","last_peered":"2024-09-12T18:14:18.083073+0000","last_clean":"2024-09-12T18:14:18.083073+0000","last_became_active":"2024-09-12T17:20:30.538913+0000","last_became_peered":"2024-09-12T17:20:30.538913+0000","last_unstale":"2024-09-12T18:14:18.083073+0000","last_undegraded":"2024-09-12T18:14:18.083073+0000","last_fullsized":"2024-09-12T18:14:18.083073+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:14:18.082969+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:14:18.082969+0000","last_clean_scrub_stamp":"2024-09-12T18:14:18.082969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:58.687456+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'104","reported_seq":394,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:23.231584+0000","last_change":"2024-09-12T18:14:23.231584+0000","last_active":"2024-09-12T18:14:23.231584+0000","last_peered":"2024-09-12T18:14:23.231584+0000","last_clean":"2024-09-12T18:14:23.231584+0000","last_became_active":"2024-09-12T17:16:11.489087+0000","last_became_peered":"2024-09-12T17:16:11.489087+0000","last_unstale":"2024-09-12T18:14:23.231584+0000","last_undegraded":"2024-09-12T18:14:23.231584+0000","last_fullsized":"2024-09-12T18:14:23.231584+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'104","last_scrub_stamp":"2024-09-12T18:14:23.231495+0000","last_deep_scrub":"264'104","last_deep_scrub_stamp":"2024-09-12T18:14:23.231495+0000","last_clean_scrub_stamp":"2024-09-12T18:14:23.231495+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:36.283901+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":629,"num_read_kb":433,"num_write":144,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4660,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.922659+0000","last_change":"2024-09-12T17:39:05.921957+0000","last_active":"2024-09-12T18:11:13.922659+0000","last_peered":"2024-09-12T18:11:13.922659+0000","last_clean":"2024-09-12T18:11:13.922659+0000","last_became_active":"2024-09-12T17:39:05.921608+0000","last_became_peered":"2024-09-12T17:39:05.921608+0000","last_unstale":"2024-09-12T18:11:13.922659+0000","last_undegraded":"2024-09-12T18:11:13.922659+0000","last_fullsized":"2024-09-12T18:11:13.922659+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:54.960277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:27.756818+0000","last_change":"2024-09-12T17:20:34.611054+0000","last_active":"2024-09-12T18:10:27.756818+0000","last_peered":"2024-09-12T18:10:27.756818+0000","last_clean":"2024-09-12T18:10:27.756818+0000","last_became_active":"2024-09-12T17:20:34.610719+0000","last_became_peered":"2024-09-12T17:20:34.610719+0000","last_unstale":"2024-09-12T18:10:27.756818+0000","last_undegraded":"2024-09-12T18:10:27.756818+0000","last_fullsized":"2024-09-12T18:10:27.756818+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:24.284192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:37.367714+0000","last_change":"2024-09-12T18:14:37.367714+0000","last_active":"2024-09-12T18:14:37.367714+0000","last_peered":"2024-09-12T18:14:37.367714+0000","last_clean":"2024-09-12T18:14:37.367714+0000","last_became_active":"2024-09-12T17:20:30.535382+0000","last_became_peered":"2024-09-12T17:20:30.535382+0000","last_unstale":"2024-09-12T18:14:37.367714+0000","last_undegraded":"2024-09-12T18:14:37.367714+0000","last_fullsized":"2024-09-12T18:14:37.367714+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:37.367623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:37.367623+0000","last_clean_scrub_stamp":"2024-09-12T18:14:37.367623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:26.522841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'27","reported_seq":140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:32.432673+0000","last_change":"2024-09-12T18:14:32.432673+0000","last_active":"2024-09-12T18:14:32.432673+0000","last_peered":"2024-09-12T18:14:32.432673+0000","last_clean":"2024-09-12T18:14:32.432673+0000","last_became_active":"2024-09-12T17:16:11.486799+0000","last_became_peered":"2024-09-12T17:16:11.486799+0000","last_unstale":"2024-09-12T18:14:32.432673+0000","last_undegraded":"2024-09-12T18:14:32.432673+0000","last_fullsized":"2024-09-12T18:14:32.432673+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'27","last_scrub_stamp":"2024-09-12T18:14:32.432578+0000","last_deep_scrub":"264'27","last_deep_scrub_stamp":"2024-09-12T18:14:32.432578+0000","last_clean_scrub_stamp":"2024-09-12T18:14:32.432578+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:59.284922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":89,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:25.772314+0000","last_change":"2024-09-12T17:39:05.923468+0000","last_active":"2024-09-12T18:12:25.772314+0000","last_peered":"2024-09-12T18:12:25.772314+0000","last_clean":"2024-09-12T18:12:25.772314+0000","last_became_active":"2024-09-12T17:39:05.923192+0000","last_became_peered":"2024-09-12T17:39:05.923192+0000","last_unstale":"2024-09-12T18:12:25.772314+0000","last_undegraded":"2024-09-12T18:12:25.772314+0000","last_fullsized":"2024-09-12T18:12:25.772314+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'4","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.514438+0000","last_change":"2024-09-12T17:20:34.555545+0000","last_active":"2024-09-12T18:13:48.514438+0000","last_peered":"2024-09-12T18:13:48.514438+0000","last_clean":"2024-09-12T18:13:48.514438+0000","last_became_active":"2024-09-12T17:20:34.555267+0000","last_became_peered":"2024-09-12T17:20:34.555267+0000","last_unstale":"2024-09-12T18:13:48.514438+0000","last_undegraded":"2024-09-12T18:13:48.514438+0000","last_fullsized":"2024-09-12T18:13:48.514438+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:48.447926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'4","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:32.776088+0000","last_change":"2024-09-12T17:20:30.531341+0000","last_active":"2024-09-12T18:12:32.776088+0000","last_peered":"2024-09-12T18:12:32.776088+0000","last_clean":"2024-09-12T18:12:32.776088+0000","last_became_active":"2024-09-12T17:20:30.530998+0000","last_became_peered":"2024-09-12T17:20:30.530998+0000","last_unstale":"2024-09-12T18:12:32.776088+0000","last_undegraded":"2024-09-12T18:12:32.776088+0000","last_fullsized":"2024-09-12T18:12:32.776088+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:28.087866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'20","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:24.246054+0000","last_change":"2024-09-12T18:14:24.245978+0000","last_active":"2024-09-12T18:14:24.246054+0000","last_peered":"2024-09-12T18:14:24.246054+0000","last_clean":"2024-09-12T18:14:24.246054+0000","last_became_active":"2024-09-12T17:16:11.487439+0000","last_became_peered":"2024-09-12T17:16:11.487439+0000","last_unstale":"2024-09-12T18:14:24.246054+0000","last_undegraded":"2024-09-12T18:14:24.246054+0000","last_fullsized":"2024-09-12T18:14:24.246054+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'20","last_scrub_stamp":"2024-09-12T18:14:24.245894+0000","last_deep_scrub":"264'20","last_deep_scrub_stamp":"2024-09-12T18:14:24.245894+0000","last_clean_scrub_stamp":"2024-09-12T18:14:24.245894+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:04.547184+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":36,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:23.090856+0000","last_change":"2024-09-12T18:14:23.090856+0000","last_active":"2024-09-12T18:14:23.090856+0000","last_peered":"2024-09-12T18:14:23.090856+0000","last_clean":"2024-09-12T18:14:23.090856+0000","last_became_active":"2024-09-12T17:39:05.923420+0000","last_became_peered":"2024-09-12T17:39:05.923420+0000","last_unstale":"2024-09-12T18:14:23.090856+0000","last_undegraded":"2024-09-12T18:14:23.090856+0000","last_fullsized":"2024-09-12T18:14:23.090856+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:23.090758+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:23.090758+0000","last_clean_scrub_stamp":"2024-09-12T18:14:23.090758+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:00.038610+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'5","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:30.280444+0000","last_change":"2024-09-12T18:14:30.280444+0000","last_active":"2024-09-12T18:14:30.280444+0000","last_peered":"2024-09-12T18:14:30.280444+0000","last_clean":"2024-09-12T18:14:30.280444+0000","last_became_active":"2024-09-12T17:20:34.557794+0000","last_became_peered":"2024-09-12T17:20:34.557794+0000","last_unstale":"2024-09-12T18:14:30.280444+0000","last_undegraded":"2024-09-12T18:14:30.280444+0000","last_fullsized":"2024-09-12T18:14:30.280444+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T18:14:30.280351+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T18:14:30.280351+0000","last_clean_scrub_stamp":"2024-09-12T18:14:30.280351+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:41.102626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'8","reported_seq":78,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:36.402174+0000","last_change":"2024-09-12T18:14:36.402174+0000","last_active":"2024-09-12T18:14:36.402174+0000","last_peered":"2024-09-12T18:14:36.402174+0000","last_clean":"2024-09-12T18:14:36.402174+0000","last_became_active":"2024-09-12T17:20:30.537970+0000","last_became_peered":"2024-09-12T17:20:30.537970+0000","last_unstale":"2024-09-12T18:14:36.402174+0000","last_undegraded":"2024-09-12T18:14:36.402174+0000","last_fullsized":"2024-09-12T18:14:36.402174+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T18:14:36.402087+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T18:14:36.402087+0000","last_clean_scrub_stamp":"2024-09-12T18:14:36.402087+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:23.401779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":19458,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'24","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:35.418107+0000","last_change":"2024-09-12T18:14:35.418107+0000","last_active":"2024-09-12T18:14:35.418107+0000","last_peered":"2024-09-12T18:14:35.418107+0000","last_clean":"2024-09-12T18:14:35.418107+0000","last_became_active":"2024-09-12T17:16:11.486298+0000","last_became_peered":"2024-09-12T17:16:11.486298+0000","last_unstale":"2024-09-12T18:14:35.418107+0000","last_undegraded":"2024-09-12T18:14:35.418107+0000","last_fullsized":"2024-09-12T18:14:35.418107+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-09-12T18:14:35.418021+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-09-12T18:14:35.418021+0000","last_clean_scrub_stamp":"2024-09-12T18:14:35.418021+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:02.258321+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:36.627544+0000","last_change":"2024-09-12T17:39:05.921428+0000","last_active":"2024-09-12T18:11:36.627544+0000","last_peered":"2024-09-12T18:11:36.627544+0000","last_clean":"2024-09-12T18:11:36.627544+0000","last_became_active":"2024-09-12T17:39:05.921085+0000","last_became_peered":"2024-09-12T17:39:05.921085+0000","last_unstale":"2024-09-12T18:11:36.627544+0000","last_undegraded":"2024-09-12T18:11:36.627544+0000","last_fullsized":"2024-09-12T18:11:36.627544+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:12.796863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'6","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:48.515124+0000","last_change":"2024-09-12T17:20:34.559242+0000","last_active":"2024-09-12T18:13:48.515124+0000","last_peered":"2024-09-12T18:13:48.515124+0000","last_clean":"2024-09-12T18:13:48.515124+0000","last_became_active":"2024-09-12T17:20:34.558963+0000","last_became_peered":"2024-09-12T17:20:34.558963+0000","last_unstale":"2024-09-12T18:13:48.515124+0000","last_undegraded":"2024-09-12T18:13:48.515124+0000","last_fullsized":"2024-09-12T18:13:48.515124+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:24.912978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:32.757457+0000","last_change":"2024-09-12T17:20:30.524694+0000","last_active":"2024-09-12T18:10:32.757457+0000","last_peered":"2024-09-12T18:10:32.757457+0000","last_clean":"2024-09-12T18:10:32.757457+0000","last_became_active":"2024-09-12T17:20:30.524377+0000","last_became_peered":"2024-09-12T17:20:30.524377+0000","last_unstale":"2024-09-12T18:10:32.757457+0000","last_undegraded":"2024-09-12T18:10:32.757457+0000","last_fullsized":"2024-09-12T18:10:32.757457+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:29.507345+0000","last_clean_scrub_stamp":"2024-09-12T17:20:29.507345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:30.709529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'59","reported_seq":234,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:33.881013+0000","last_change":"2024-09-12T18:14:33.881013+0000","last_active":"2024-09-12T18:14:33.881013+0000","last_peered":"2024-09-12T18:14:33.881013+0000","last_clean":"2024-09-12T18:14:33.881013+0000","last_became_active":"2024-09-12T17:16:11.491512+0000","last_became_peered":"2024-09-12T17:16:11.491512+0000","last_unstale":"2024-09-12T18:14:33.881013+0000","last_undegraded":"2024-09-12T18:14:33.881013+0000","last_fullsized":"2024-09-12T18:14:33.881013+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'59","last_scrub_stamp":"2024-09-12T18:14:33.880931+0000","last_deep_scrub":"264'59","last_deep_scrub_stamp":"2024-09-12T18:14:33.880931+0000","last_clean_scrub_stamp":"2024-09-12T18:14:33.880931+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:13.951597+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":313,"num_read_kb":225,"num_write":101,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:26.633857+0000","last_change":"2024-09-12T17:39:05.926334+0000","last_active":"2024-09-12T18:12:26.633857+0000","last_peered":"2024-09-12T18:12:26.633857+0000","last_clean":"2024-09-12T18:12:26.633857+0000","last_became_active":"2024-09-12T17:39:05.926029+0000","last_became_peered":"2024-09-12T17:39:05.926029+0000","last_unstale":"2024-09-12T18:12:26.633857+0000","last_undegraded":"2024-09-12T18:12:26.633857+0000","last_fullsized":"2024-09-12T18:12:26.633857+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"261'2","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:30.313225+0000","last_change":"2024-09-12T18:14:30.313225+0000","last_active":"2024-09-12T18:14:30.313225+0000","last_peered":"2024-09-12T18:14:30.313225+0000","last_clean":"2024-09-12T18:14:30.313225+0000","last_became_active":"2024-09-12T17:20:34.555137+0000","last_became_peered":"2024-09-12T17:20:34.555137+0000","last_unstale":"2024-09-12T18:14:30.313225+0000","last_undegraded":"2024-09-12T18:14:30.313225+0000","last_fullsized":"2024-09-12T18:14:30.313225+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:14:30.313134+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:14:30.313134+0000","last_clean_scrub_stamp":"2024-09-12T18:14:30.313134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:54.305578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'2","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:26.209890+0000","last_change":"2024-09-12T18:14:26.209890+0000","last_active":"2024-09-12T18:14:26.209890+0000","last_peered":"2024-09-12T18:14:26.209890+0000","last_clean":"2024-09-12T18:14:26.209890+0000","last_became_active":"2024-09-12T17:20:30.531232+0000","last_became_peered":"2024-09-12T17:20:30.531232+0000","last_unstale":"2024-09-12T18:14:26.209890+0000","last_undegraded":"2024-09-12T18:14:26.209890+0000","last_fullsized":"2024-09-12T18:14:26.209890+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:26.209790+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:26.209790+0000","last_clean_scrub_stamp":"2024-09-12T18:14:26.209790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:26.231944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'13","reported_seq":107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:27.238728+0000","last_change":"2024-09-12T18:14:27.238658+0000","last_active":"2024-09-12T18:14:27.238728+0000","last_peered":"2024-09-12T18:14:27.238728+0000","last_clean":"2024-09-12T18:14:27.238728+0000","last_became_active":"2024-09-12T17:16:11.491334+0000","last_became_peered":"2024-09-12T17:16:11.491334+0000","last_unstale":"2024-09-12T18:14:27.238728+0000","last_undegraded":"2024-09-12T18:14:27.238728+0000","last_fullsized":"2024-09-12T18:14:27.238728+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-09-12T18:14:27.238574+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-09-12T18:14:27.238574+0000","last_clean_scrub_stamp":"2024-09-12T18:14:27.238574+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:25.141678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":49,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:32.776042+0000","last_change":"2024-09-12T17:39:05.930558+0000","last_active":"2024-09-12T18:12:32.776042+0000","last_peered":"2024-09-12T18:12:32.776042+0000","last_clean":"2024-09-12T18:12:32.776042+0000","last_became_active":"2024-09-12T17:39:05.930326+0000","last_became_peered":"2024-09-12T17:39:05.930326+0000","last_unstale":"2024-09-12T18:12:32.776042+0000","last_undegraded":"2024-09-12T18:12:32.776042+0000","last_fullsized":"2024-09-12T18:12:32.776042+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'6","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:40.774570+0000","last_change":"2024-09-12T17:20:34.556804+0000","last_active":"2024-09-12T18:12:40.774570+0000","last_peered":"2024-09-12T18:12:40.774570+0000","last_clean":"2024-09-12T18:12:40.774570+0000","last_became_active":"2024-09-12T17:20:34.554832+0000","last_became_peered":"2024-09-12T17:20:34.554832+0000","last_unstale":"2024-09-12T18:12:40.774570+0000","last_undegraded":"2024-09-12T18:12:40.774570+0000","last_fullsized":"2024-09-12T18:12:40.774570+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:59.545466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'4","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:28.273120+0000","last_change":"2024-09-12T18:14:28.273120+0000","last_active":"2024-09-12T18:14:28.273120+0000","last_peered":"2024-09-12T18:14:28.273120+0000","last_clean":"2024-09-12T18:14:28.273120+0000","last_became_active":"2024-09-12T17:20:30.528541+0000","last_became_peered":"2024-09-12T17:20:30.528541+0000","last_unstale":"2024-09-12T18:14:28.273120+0000","last_undegraded":"2024-09-12T18:14:28.273120+0000","last_fullsized":"2024-09-12T18:14:28.273120+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:14:28.273000+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:14:28.273000+0000","last_clean_scrub_stamp":"2024-09-12T18:14:28.273000+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:19.677685+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'21","reported_seq":126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:33.429668+0000","last_change":"2024-09-12T18:14:33.429668+0000","last_active":"2024-09-12T18:14:33.429668+0000","last_peered":"2024-09-12T18:14:33.429668+0000","last_clean":"2024-09-12T18:14:33.429668+0000","last_became_active":"2024-09-12T17:16:11.487238+0000","last_became_peered":"2024-09-12T17:16:11.487238+0000","last_unstale":"2024-09-12T18:14:33.429668+0000","last_undegraded":"2024-09-12T18:14:33.429668+0000","last_fullsized":"2024-09-12T18:14:33.429668+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'21","last_scrub_stamp":"2024-09-12T18:14:33.429572+0000","last_deep_scrub":"264'21","last_deep_scrub_stamp":"2024-09-12T18:14:33.429572+0000","last_clean_scrub_stamp":"2024-09-12T18:14:33.429572+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:19.091582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":71,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'378","reported_seq":1023,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.165354+0000","last_change":"2024-09-12T18:14:11.165354+0000","last_active":"2024-09-12T18:14:11.165354+0000","last_peered":"2024-09-12T18:14:11.165354+0000","last_clean":"2024-09-12T18:14:11.165354+0000","last_became_active":"2024-09-12T17:00:12.304074+0000","last_became_peered":"2024-09-12T17:00:12.304074+0000","last_unstale":"2024-09-12T18:14:11.165354+0000","last_undegraded":"2024-09-12T18:14:11.165354+0000","last_fullsized":"2024-09-12T18:14:11.165354+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'378","last_scrub_stamp":"2024-09-12T18:14:11.165222+0000","last_deep_scrub":"264'378","last_deep_scrub_stamp":"2024-09-12T18:14:11.165222+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.165222+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:54.479677+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":637523,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":542,"num_read_kb":3821,"num_write":1162,"num_write_kb":12701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'137","reported_seq":755,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.416875+0000","last_change":"2024-09-12T18:14:17.416875+0000","last_active":"2024-09-12T18:14:17.416875+0000","last_peered":"2024-09-12T18:14:17.416875+0000","last_clean":"2024-09-12T18:14:17.416875+0000","last_became_active":"2024-09-12T17:00:14.328464+0000","last_became_peered":"2024-09-12T17:00:14.328464+0000","last_unstale":"2024-09-12T18:14:17.416875+0000","last_undegraded":"2024-09-12T18:14:17.416875+0000","last_fullsized":"2024-09-12T18:14:17.416875+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'137","last_scrub_stamp":"2024-09-12T18:14:17.416794+0000","last_deep_scrub":"264'137","last_deep_scrub_stamp":"2024-09-12T18:14:17.416794+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.416794+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:19.839739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":594,"num_read_kb":496,"num_write":221,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'326","reported_seq":968,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.050905+0000","last_change":"2024-09-12T18:14:02.050905+0000","last_active":"2024-09-12T18:14:02.050905+0000","last_peered":"2024-09-12T18:14:02.050905+0000","last_clean":"2024-09-12T18:14:02.050905+0000","last_became_active":"2024-09-12T17:00:12.302750+0000","last_became_peered":"2024-09-12T17:00:12.302750+0000","last_unstale":"2024-09-12T18:14:02.050905+0000","last_undegraded":"2024-09-12T18:14:02.050905+0000","last_fullsized":"2024-09-12T18:14:02.050905+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-12T18:14:02.050783+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-12T18:14:02.050783+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.050783+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:42.750663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":423,"num_read_kb":57739,"num_write":1027,"num_write_kb":55497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'223","reported_seq":857,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:14.259553+0000","last_change":"2024-09-12T18:14:14.259553+0000","last_active":"2024-09-12T18:14:14.259553+0000","last_peered":"2024-09-12T18:14:14.259553+0000","last_clean":"2024-09-12T18:14:14.259553+0000","last_became_active":"2024-09-12T17:00:14.336238+0000","last_became_peered":"2024-09-12T17:00:14.336238+0000","last_unstale":"2024-09-12T18:14:14.259553+0000","last_undegraded":"2024-09-12T18:14:14.259553+0000","last_fullsized":"2024-09-12T18:14:14.259553+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'223","last_scrub_stamp":"2024-09-12T18:14:14.259469+0000","last_deep_scrub":"264'223","last_deep_scrub_stamp":"2024-09-12T18:14:14.259469+0000","last_clean_scrub_stamp":"2024-09-12T18:14:14.259469+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:43.717710+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":973,"num_read_kb":793,"num_write":333,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8081,"num_omap_keys":32,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'344","reported_seq":1017,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.017303+0000","last_change":"2024-09-12T18:14:02.017303+0000","last_active":"2024-09-12T18:14:02.017303+0000","last_peered":"2024-09-12T18:14:02.017303+0000","last_clean":"2024-09-12T18:14:02.017303+0000","last_became_active":"2024-09-12T17:00:12.309132+0000","last_became_peered":"2024-09-12T17:00:12.309132+0000","last_unstale":"2024-09-12T18:14:02.017303+0000","last_undegraded":"2024-09-12T18:14:02.017303+0000","last_fullsized":"2024-09-12T18:14:02.017303+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'344","last_scrub_stamp":"2024-09-12T18:14:02.017215+0000","last_deep_scrub":"264'344","last_deep_scrub_stamp":"2024-09-12T18:14:02.017215+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.017215+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:38.479748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":529,"num_read_kb":32498,"num_write":1132,"num_write_kb":31975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'256","reported_seq":887,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:14.837837+0000","last_change":"2024-09-12T18:14:14.837837+0000","last_active":"2024-09-12T18:14:14.837837+0000","last_peered":"2024-09-12T18:14:14.837837+0000","last_clean":"2024-09-12T18:14:14.837837+0000","last_became_active":"2024-09-12T17:00:14.323358+0000","last_became_peered":"2024-09-12T17:00:14.323358+0000","last_unstale":"2024-09-12T18:14:14.837837+0000","last_undegraded":"2024-09-12T18:14:14.837837+0000","last_fullsized":"2024-09-12T18:14:14.837837+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'256","last_scrub_stamp":"2024-09-12T18:14:14.837731+0000","last_deep_scrub":"264'256","last_deep_scrub_stamp":"2024-09-12T18:14:14.837731+0000","last_clean_scrub_stamp":"2024-09-12T18:14:14.837731+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:31.651864+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1058,"num_read_kb":862,"num_write":363,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":938,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'313","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.579212+0000","last_change":"2024-09-12T18:14:09.579151+0000","last_active":"2024-09-12T18:14:09.579212+0000","last_peered":"2024-09-12T18:14:09.579212+0000","last_clean":"2024-09-12T18:14:09.579212+0000","last_became_active":"2024-09-12T17:00:12.320515+0000","last_became_peered":"2024-09-12T17:00:12.320515+0000","last_unstale":"2024-09-12T18:14:09.579212+0000","last_undegraded":"2024-09-12T18:14:09.579212+0000","last_fullsized":"2024-09-12T18:14:09.579212+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'313","last_scrub_stamp":"2024-09-12T18:14:09.579047+0000","last_deep_scrub":"264'313","last_deep_scrub_stamp":"2024-09-12T18:14:09.579047+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.579047+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:04.911796+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1784539,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":432,"num_read_kb":6790,"num_write":998,"num_write_kb":19852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'120","reported_seq":709,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.170289+0000","last_change":"2024-09-12T18:14:13.170289+0000","last_active":"2024-09-12T18:14:13.170289+0000","last_peered":"2024-09-12T18:14:13.170289+0000","last_clean":"2024-09-12T18:14:13.170289+0000","last_became_active":"2024-09-12T17:00:14.335297+0000","last_became_peered":"2024-09-12T17:00:14.335297+0000","last_unstale":"2024-09-12T18:14:13.170289+0000","last_undegraded":"2024-09-12T18:14:13.170289+0000","last_fullsized":"2024-09-12T18:14:13.170289+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-09-12T18:14:13.170184+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-09-12T18:14:13.170184+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.170184+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:20.955398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":395,"num_write":174,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'333","reported_seq":977,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.237214+0000","last_change":"2024-09-12T18:14:09.237214+0000","last_active":"2024-09-12T18:14:09.237214+0000","last_peered":"2024-09-12T18:14:09.237214+0000","last_clean":"2024-09-12T18:14:09.237214+0000","last_became_active":"2024-09-12T17:00:12.312762+0000","last_became_peered":"2024-09-12T17:00:12.312762+0000","last_unstale":"2024-09-12T18:14:09.237214+0000","last_undegraded":"2024-09-12T18:14:09.237214+0000","last_fullsized":"2024-09-12T18:14:09.237214+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'333","last_scrub_stamp":"2024-09-12T18:14:09.237040+0000","last_deep_scrub":"264'333","last_deep_scrub_stamp":"2024-09-12T18:14:09.237040+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.237040+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:39.532704+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4593537,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":487,"num_read_kb":9220,"num_write":1043,"num_write_kb":31558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'219","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.103243+0000","last_change":"2024-09-12T18:14:10.103167+0000","last_active":"2024-09-12T18:14:10.103243+0000","last_peered":"2024-09-12T18:14:10.103243+0000","last_clean":"2024-09-12T18:14:10.103243+0000","last_became_active":"2024-09-12T17:00:14.321640+0000","last_became_peered":"2024-09-12T17:00:14.321640+0000","last_unstale":"2024-09-12T18:14:10.103243+0000","last_undegraded":"2024-09-12T18:14:10.103243+0000","last_fullsized":"2024-09-12T18:14:10.103243+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'219","last_scrub_stamp":"2024-09-12T18:14:10.103080+0000","last_deep_scrub":"264'219","last_deep_scrub_stamp":"2024-09-12T18:14:10.103080+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.103080+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:24.808735+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1016,"num_read_kb":865,"num_write":355,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'370","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.554790+0000","last_change":"2024-09-12T18:14:06.554790+0000","last_active":"2024-09-12T18:14:06.554790+0000","last_peered":"2024-09-12T18:14:06.554790+0000","last_clean":"2024-09-12T18:14:06.554790+0000","last_became_active":"2024-09-12T17:00:12.319917+0000","last_became_peered":"2024-09-12T17:00:12.319917+0000","last_unstale":"2024-09-12T18:14:06.554790+0000","last_undegraded":"2024-09-12T18:14:06.554790+0000","last_fullsized":"2024-09-12T18:14:06.554790+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'370","last_scrub_stamp":"2024-09-12T18:14:06.554684+0000","last_deep_scrub":"264'370","last_deep_scrub_stamp":"2024-09-12T18:14:06.554684+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.554684+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:37.956148+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432807,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":38218,"num_write":1060,"num_write_kb":26572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'175","reported_seq":804,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.835721+0000","last_change":"2024-09-12T18:14:17.835721+0000","last_active":"2024-09-12T18:14:17.835721+0000","last_peered":"2024-09-12T18:14:17.835721+0000","last_clean":"2024-09-12T18:14:17.835721+0000","last_became_active":"2024-09-12T17:00:14.332940+0000","last_became_peered":"2024-09-12T17:00:14.332940+0000","last_unstale":"2024-09-12T18:14:17.835721+0000","last_undegraded":"2024-09-12T18:14:17.835721+0000","last_fullsized":"2024-09-12T18:14:17.835721+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'175","last_scrub_stamp":"2024-09-12T18:14:17.835625+0000","last_deep_scrub":"264'175","last_deep_scrub_stamp":"2024-09-12T18:14:17.835625+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.835625+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:25.113287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":715,"num_read_kb":606,"num_write":241,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'326","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.241830+0000","last_change":"2024-09-12T18:14:08.241830+0000","last_active":"2024-09-12T18:14:08.241830+0000","last_peered":"2024-09-12T18:14:08.241830+0000","last_clean":"2024-09-12T18:14:08.241830+0000","last_became_active":"2024-09-12T17:00:12.304504+0000","last_became_peered":"2024-09-12T17:00:12.304504+0000","last_unstale":"2024-09-12T18:14:08.241830+0000","last_undegraded":"2024-09-12T18:14:08.241830+0000","last_fullsized":"2024-09-12T18:14:08.241830+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-12T18:14:08.241703+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-12T18:14:08.241703+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.241703+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:13.525047+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1691575,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":533,"num_read_kb":24452,"num_write":1091,"num_write_kb":21520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'176","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:16.416775+0000","last_change":"2024-09-12T18:14:16.416775+0000","last_active":"2024-09-12T18:14:16.416775+0000","last_peered":"2024-09-12T18:14:16.416775+0000","last_clean":"2024-09-12T18:14:16.416775+0000","last_became_active":"2024-09-12T17:00:14.332360+0000","last_became_peered":"2024-09-12T17:00:14.332360+0000","last_unstale":"2024-09-12T18:14:16.416775+0000","last_undegraded":"2024-09-12T18:14:16.416775+0000","last_fullsized":"2024-09-12T18:14:16.416775+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'176","last_scrub_stamp":"2024-09-12T18:14:16.416668+0000","last_deep_scrub":"264'176","last_deep_scrub_stamp":"2024-09-12T18:14:16.416668+0000","last_clean_scrub_stamp":"2024-09-12T18:14:16.416668+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:39.911259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":738,"num_read_kb":599,"num_write":278,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'372","reported_seq":1085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.002649+0000","last_change":"2024-09-12T18:14:04.002649+0000","last_active":"2024-09-12T18:14:04.002649+0000","last_peered":"2024-09-12T18:14:04.002649+0000","last_clean":"2024-09-12T18:14:04.002649+0000","last_became_active":"2024-09-12T17:00:12.322419+0000","last_became_peered":"2024-09-12T17:00:12.322419+0000","last_unstale":"2024-09-12T18:14:04.002649+0000","last_undegraded":"2024-09-12T18:14:04.002649+0000","last_fullsized":"2024-09-12T18:14:04.002649+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-12T18:14:04.002546+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-12T18:14:04.002546+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.002546+0000","objects_scrubbed":9,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:39.056847+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786486,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":661,"num_read_kb":7776,"num_write":1130,"num_write_kb":24985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'60","reported_seq":626,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.168328+0000","last_change":"2024-09-12T18:14:09.168328+0000","last_active":"2024-09-12T18:14:09.168328+0000","last_peered":"2024-09-12T18:14:09.168328+0000","last_clean":"2024-09-12T18:14:09.168328+0000","last_became_active":"2024-09-12T17:00:14.334586+0000","last_became_peered":"2024-09-12T17:00:14.334586+0000","last_unstale":"2024-09-12T18:14:09.168328+0000","last_undegraded":"2024-09-12T18:14:09.168328+0000","last_fullsized":"2024-09-12T18:14:09.168328+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'60","last_scrub_stamp":"2024-09-12T18:14:09.168221+0000","last_deep_scrub":"264'60","last_deep_scrub_stamp":"2024-09-12T18:14:09.168221+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.168221+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:35.472486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":225,"num_write":86,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'142","reported_seq":773,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.785983+0000","last_change":"2024-09-12T18:14:13.785983+0000","last_active":"2024-09-12T18:14:13.785983+0000","last_peered":"2024-09-12T18:14:13.785983+0000","last_clean":"2024-09-12T18:14:13.785983+0000","last_became_active":"2024-09-12T17:00:14.322771+0000","last_became_peered":"2024-09-12T17:00:14.322771+0000","last_unstale":"2024-09-12T18:14:13.785983+0000","last_undegraded":"2024-09-12T18:14:13.785983+0000","last_fullsized":"2024-09-12T18:14:13.785983+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-12T18:14:13.785902+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-12T18:14:13.785902+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.785902+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:49.161921+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":650,"num_read_kb":543,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'382","reported_seq":1148,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.206812+0000","last_change":"2024-09-12T18:14:07.206812+0000","last_active":"2024-09-12T18:14:07.206812+0000","last_peered":"2024-09-12T18:14:07.206812+0000","last_clean":"2024-09-12T18:14:07.206812+0000","last_became_active":"2024-09-12T17:00:46.406911+0000","last_became_peered":"2024-09-12T17:00:46.406911+0000","last_unstale":"2024-09-12T18:14:07.206812+0000","last_undegraded":"2024-09-12T18:14:07.206812+0000","last_fullsized":"2024-09-12T18:14:07.206812+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'382","last_scrub_stamp":"2024-09-12T18:14:07.206704+0000","last_deep_scrub":"264'382","last_deep_scrub_stamp":"2024-09-12T18:14:07.206704+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.206704+0000","objects_scrubbed":8,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:11.551940+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029268,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":749,"num_read_kb":51923,"num_write":1318,"num_write_kb":31895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'117","reported_seq":732,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.222152+0000","last_change":"2024-09-12T18:14:13.222152+0000","last_active":"2024-09-12T18:14:13.222152+0000","last_peered":"2024-09-12T18:14:13.222152+0000","last_clean":"2024-09-12T18:14:13.222152+0000","last_became_active":"2024-09-12T17:00:14.336161+0000","last_became_peered":"2024-09-12T17:00:14.336161+0000","last_unstale":"2024-09-12T18:14:13.222152+0000","last_undegraded":"2024-09-12T18:14:13.222152+0000","last_fullsized":"2024-09-12T18:14:13.222152+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'117","last_scrub_stamp":"2024-09-12T18:14:13.222053+0000","last_deep_scrub":"264'117","last_deep_scrub_stamp":"2024-09-12T18:14:13.222053+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.222053+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:25.097396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":545,"num_read_kb":462,"num_write":195,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'338","reported_seq":1032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.047468+0000","last_change":"2024-09-12T18:14:05.047468+0000","last_active":"2024-09-12T18:14:05.047468+0000","last_peered":"2024-09-12T18:14:05.047468+0000","last_clean":"2024-09-12T18:14:05.047468+0000","last_became_active":"2024-09-12T17:00:12.310589+0000","last_became_peered":"2024-09-12T17:00:12.310589+0000","last_unstale":"2024-09-12T18:14:05.047468+0000","last_undegraded":"2024-09-12T18:14:05.047468+0000","last_fullsized":"2024-09-12T18:14:05.047468+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'338","last_scrub_stamp":"2024-09-12T18:14:05.047367+0000","last_deep_scrub":"264'338","last_deep_scrub_stamp":"2024-09-12T18:14:05.047367+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.047367+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:13.046999+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":594,"num_read_kb":8321,"num_write":1002,"num_write_kb":31830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'144","reported_seq":733,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:14.480010+0000","last_change":"2024-09-12T18:14:14.480010+0000","last_active":"2024-09-12T18:14:14.480010+0000","last_peered":"2024-09-12T18:14:14.480010+0000","last_clean":"2024-09-12T18:14:14.480010+0000","last_became_active":"2024-09-12T17:00:14.324889+0000","last_became_peered":"2024-09-12T17:00:14.324889+0000","last_unstale":"2024-09-12T18:14:14.480010+0000","last_undegraded":"2024-09-12T18:14:14.480010+0000","last_fullsized":"2024-09-12T18:14:14.480010+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'144","last_scrub_stamp":"2024-09-12T18:14:14.479922+0000","last_deep_scrub":"264'144","last_deep_scrub_stamp":"2024-09-12T18:14:14.479922+0000","last_clean_scrub_stamp":"2024-09-12T18:14:14.479922+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:54.095428+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":586,"num_read_kb":478,"num_write":211,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'340","reported_seq":977,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.055592+0000","last_change":"2024-09-12T18:14:02.055592+0000","last_active":"2024-09-12T18:14:02.055592+0000","last_peered":"2024-09-12T18:14:02.055592+0000","last_clean":"2024-09-12T18:14:02.055592+0000","last_became_active":"2024-09-12T17:00:12.315652+0000","last_became_peered":"2024-09-12T17:00:12.315652+0000","last_unstale":"2024-09-12T18:14:02.055592+0000","last_undegraded":"2024-09-12T18:14:02.055592+0000","last_fullsized":"2024-09-12T18:14:02.055592+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'340","last_scrub_stamp":"2024-09-12T18:14:02.055446+0000","last_deep_scrub":"264'340","last_deep_scrub_stamp":"2024-09-12T18:14:02.055446+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.055446+0000","objects_scrubbed":8,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:28.138157+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":305880,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":503,"num_read_kb":21524,"num_write":1088,"num_write_kb":35144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'78","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.064701+0000","last_change":"2024-09-12T18:14:02.064701+0000","last_active":"2024-09-12T18:14:02.064701+0000","last_peered":"2024-09-12T18:14:02.064701+0000","last_clean":"2024-09-12T18:14:02.064701+0000","last_became_active":"2024-09-12T17:00:14.335009+0000","last_became_peered":"2024-09-12T17:00:14.335009+0000","last_unstale":"2024-09-12T18:14:02.064701+0000","last_undegraded":"2024-09-12T18:14:02.064701+0000","last_fullsized":"2024-09-12T18:14:02.064701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'78","last_scrub_stamp":"2024-09-12T18:14:02.064622+0000","last_deep_scrub":"264'78","last_deep_scrub_stamp":"2024-09-12T18:14:02.064622+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.064622+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:00.192294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":353,"num_read_kb":297,"num_write":121,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'359","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.824638+0000","last_change":"2024-09-12T18:14:00.824638+0000","last_active":"2024-09-12T18:14:00.824638+0000","last_peered":"2024-09-12T18:14:00.824638+0000","last_clean":"2024-09-12T18:14:00.824638+0000","last_became_active":"2024-09-12T17:00:12.312828+0000","last_became_peered":"2024-09-12T17:00:12.312828+0000","last_unstale":"2024-09-12T18:14:00.824638+0000","last_undegraded":"2024-09-12T18:14:00.824638+0000","last_fullsized":"2024-09-12T18:14:00.824638+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'359","last_scrub_stamp":"2024-09-12T18:14:00.824537+0000","last_deep_scrub":"264'359","last_deep_scrub_stamp":"2024-09-12T18:14:00.824537+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.824537+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:37.459215+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850167,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":541,"num_read_kb":47220,"num_write":1168,"num_write_kb":32154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'190","reported_seq":838,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.125836+0000","last_change":"2024-09-12T18:14:05.125836+0000","last_active":"2024-09-12T18:14:05.125836+0000","last_peered":"2024-09-12T18:14:05.125836+0000","last_clean":"2024-09-12T18:14:05.125836+0000","last_became_active":"2024-09-12T17:00:14.327744+0000","last_became_peered":"2024-09-12T17:00:14.327744+0000","last_unstale":"2024-09-12T18:14:05.125836+0000","last_undegraded":"2024-09-12T18:14:05.125836+0000","last_fullsized":"2024-09-12T18:14:05.125836+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-09-12T18:14:05.125736+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-09-12T18:14:05.125736+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.125736+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:47.673107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":833,"num_read_kb":695,"num_write":274,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'317","reported_seq":1108,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.929610+0000","last_change":"2024-09-12T18:14:06.929610+0000","last_active":"2024-09-12T18:14:06.929610+0000","last_peered":"2024-09-12T18:14:06.929610+0000","last_clean":"2024-09-12T18:14:06.929610+0000","last_became_active":"2024-09-12T17:00:12.319649+0000","last_became_peered":"2024-09-12T17:00:12.319649+0000","last_unstale":"2024-09-12T18:14:06.929610+0000","last_undegraded":"2024-09-12T18:14:06.929610+0000","last_fullsized":"2024-09-12T18:14:06.929610+0000","mapping_epoch":24,"log_start":"264'301","ondisk_log_start":"264'301","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'317","last_scrub_stamp":"2024-09-12T18:14:06.929469+0000","last_deep_scrub":"264'317","last_deep_scrub_stamp":"2024-09-12T18:14:06.929469+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.929469+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":301,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:28.114201+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655853,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":737,"num_read_kb":130250,"num_write":941,"num_write_kb":66985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'137","reported_seq":769,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:15.817698+0000","last_change":"2024-09-12T18:14:15.817698+0000","last_active":"2024-09-12T18:14:15.817698+0000","last_peered":"2024-09-12T18:14:15.817698+0000","last_clean":"2024-09-12T18:14:15.817698+0000","last_became_active":"2024-09-12T17:00:14.329107+0000","last_became_peered":"2024-09-12T17:00:14.329107+0000","last_unstale":"2024-09-12T18:14:15.817698+0000","last_undegraded":"2024-09-12T18:14:15.817698+0000","last_fullsized":"2024-09-12T18:14:15.817698+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'137","last_scrub_stamp":"2024-09-12T18:14:15.817595+0000","last_deep_scrub":"264'137","last_deep_scrub_stamp":"2024-09-12T18:14:15.817595+0000","last_clean_scrub_stamp":"2024-09-12T18:14:15.817595+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:52.489558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":644,"num_read_kb":539,"num_write":215,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'373","reported_seq":1118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.057944+0000","last_change":"2024-09-12T18:14:01.057944+0000","last_active":"2024-09-12T18:14:01.057944+0000","last_peered":"2024-09-12T18:14:01.057944+0000","last_clean":"2024-09-12T18:14:01.057944+0000","last_became_active":"2024-09-12T17:00:12.307906+0000","last_became_peered":"2024-09-12T17:00:12.307906+0000","last_unstale":"2024-09-12T18:14:01.057944+0000","last_undegraded":"2024-09-12T18:14:01.057944+0000","last_fullsized":"2024-09-12T18:14:01.057944+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-09-12T18:14:01.057824+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-09-12T18:14:01.057824+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.057824+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:19.783672+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524322,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":712,"num_read_kb":3845,"num_write":1087,"num_write_kb":30178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'136","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:31.865736+0000","last_change":"2024-09-12T18:14:31.865736+0000","last_active":"2024-09-12T18:14:31.865736+0000","last_peered":"2024-09-12T18:14:31.865736+0000","last_clean":"2024-09-12T18:14:31.865736+0000","last_became_active":"2024-09-12T17:00:22.355591+0000","last_became_peered":"2024-09-12T17:00:22.355591+0000","last_unstale":"2024-09-12T18:14:31.865736+0000","last_undegraded":"2024-09-12T18:14:31.865736+0000","last_fullsized":"2024-09-12T18:14:31.865736+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'136","last_scrub_stamp":"2024-09-12T18:14:31.865640+0000","last_deep_scrub":"264'136","last_deep_scrub_stamp":"2024-09-12T18:14:31.865640+0000","last_clean_scrub_stamp":"2024-09-12T18:14:31.865640+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:08.827157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1447,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":175,"num_read_kb":172,"num_write":326,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'85","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.936607+0000","last_change":"2024-09-12T18:14:05.936607+0000","last_active":"2024-09-12T18:14:05.936607+0000","last_peered":"2024-09-12T18:14:05.936607+0000","last_clean":"2024-09-12T18:14:05.936607+0000","last_became_active":"2024-09-12T17:00:14.336144+0000","last_became_peered":"2024-09-12T17:00:14.336144+0000","last_unstale":"2024-09-12T18:14:05.936607+0000","last_undegraded":"2024-09-12T18:14:05.936607+0000","last_fullsized":"2024-09-12T18:14:05.936607+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'85","last_scrub_stamp":"2024-09-12T18:14:05.936499+0000","last_deep_scrub":"264'85","last_deep_scrub_stamp":"2024-09-12T18:14:05.936499+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.936499+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:14.421673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":388,"num_read_kb":332,"num_write":123,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'341","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:57.152269+0000","last_change":"2024-09-12T18:13:57.152269+0000","last_active":"2024-09-12T18:13:57.152269+0000","last_peered":"2024-09-12T18:13:57.152269+0000","last_clean":"2024-09-12T18:13:57.152269+0000","last_became_active":"2024-09-12T17:00:46.720989+0000","last_became_peered":"2024-09-12T17:00:46.720989+0000","last_unstale":"2024-09-12T18:13:57.152269+0000","last_undegraded":"2024-09-12T18:13:57.152269+0000","last_fullsized":"2024-09-12T18:13:57.152269+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'341","last_scrub_stamp":"2024-09-12T18:13:57.152177+0000","last_deep_scrub":"264'341","last_deep_scrub_stamp":"2024-09-12T18:13:57.152177+0000","last_clean_scrub_stamp":"2024-09-12T18:13:57.152177+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:22.890906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":487,"num_read_kb":63990,"num_write":1055,"num_write_kb":41211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:20.415162+0000","last_change":"2024-09-12T18:14:20.415162+0000","last_active":"2024-09-12T18:14:20.415162+0000","last_peered":"2024-09-12T18:14:20.415162+0000","last_clean":"2024-09-12T18:14:20.415162+0000","last_became_active":"2024-09-12T17:00:16.325868+0000","last_became_peered":"2024-09-12T17:00:16.325868+0000","last_unstale":"2024-09-12T18:14:20.415162+0000","last_undegraded":"2024-09-12T18:14:20.415162+0000","last_fullsized":"2024-09-12T18:14:20.415162+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:20.415070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:20.415070+0000","last_clean_scrub_stamp":"2024-09-12T18:14:20.415070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:45.386194+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'344","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:20.260679+0000","last_change":"2024-09-12T18:14:20.260679+0000","last_active":"2024-09-12T18:14:20.260679+0000","last_peered":"2024-09-12T18:14:20.260679+0000","last_clean":"2024-09-12T18:14:20.260679+0000","last_became_active":"2024-09-12T17:00:18.329515+0000","last_became_peered":"2024-09-12T17:00:18.329515+0000","last_unstale":"2024-09-12T18:14:20.260679+0000","last_undegraded":"2024-09-12T18:14:20.260679+0000","last_fullsized":"2024-09-12T18:14:20.260679+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'344","last_scrub_stamp":"2024-09-12T18:14:20.260565+0000","last_deep_scrub":"264'344","last_deep_scrub_stamp":"2024-09-12T18:14:20.260565+0000","last_clean_scrub_stamp":"2024-09-12T18:14:20.260565+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:58.070253+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49756,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":1157,"num_write":430,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:30.405393+0000","last_change":"2024-09-12T18:14:30.405393+0000","last_active":"2024-09-12T18:14:30.405393+0000","last_peered":"2024-09-12T18:14:30.405393+0000","last_clean":"2024-09-12T18:14:30.405393+0000","last_became_active":"2024-09-12T17:00:20.348524+0000","last_became_peered":"2024-09-12T17:00:20.348524+0000","last_unstale":"2024-09-12T18:14:30.405393+0000","last_undegraded":"2024-09-12T18:14:30.405393+0000","last_fullsized":"2024-09-12T18:14:30.405393+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:30.405300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:30.405300+0000","last_clean_scrub_stamp":"2024-09-12T18:14:30.405300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:52.715411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'169","reported_seq":737,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:33.450318+0000","last_change":"2024-09-12T18:14:33.450318+0000","last_active":"2024-09-12T18:14:33.450318+0000","last_peered":"2024-09-12T18:14:33.450318+0000","last_clean":"2024-09-12T18:14:33.450318+0000","last_became_active":"2024-09-12T17:00:22.357688+0000","last_became_peered":"2024-09-12T17:00:22.357688+0000","last_unstale":"2024-09-12T18:14:33.450318+0000","last_undegraded":"2024-09-12T18:14:33.450318+0000","last_fullsized":"2024-09-12T18:14:33.450318+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'169","last_scrub_stamp":"2024-09-12T18:14:33.450214+0000","last_deep_scrub":"264'169","last_deep_scrub_stamp":"2024-09-12T18:14:33.450214+0000","last_clean_scrub_stamp":"2024-09-12T18:14:33.450214+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:13.393504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":624,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":254,"num_read_kb":249,"num_write":335,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'315","reported_seq":949,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.537417+0000","last_change":"2024-09-12T18:14:10.537417+0000","last_active":"2024-09-12T18:14:10.537417+0000","last_peered":"2024-09-12T18:14:10.537417+0000","last_clean":"2024-09-12T18:14:10.537417+0000","last_became_active":"2024-09-12T17:00:14.327170+0000","last_became_peered":"2024-09-12T17:00:14.327170+0000","last_unstale":"2024-09-12T18:14:10.537417+0000","last_undegraded":"2024-09-12T18:14:10.537417+0000","last_fullsized":"2024-09-12T18:14:10.537417+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'315","last_scrub_stamp":"2024-09-12T18:14:10.537320+0000","last_deep_scrub":"264'315","last_deep_scrub_stamp":"2024-09-12T18:14:10.537320+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.537320+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:19.286520+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1382,"num_read_kb":1112,"num_write":506,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'400","reported_seq":1101,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:55.046377+0000","last_change":"2024-09-12T18:13:55.046377+0000","last_active":"2024-09-12T18:13:55.046377+0000","last_peered":"2024-09-12T18:13:55.046377+0000","last_clean":"2024-09-12T18:13:55.046377+0000","last_became_active":"2024-09-12T17:00:12.304357+0000","last_became_peered":"2024-09-12T17:00:12.304357+0000","last_unstale":"2024-09-12T18:13:55.046377+0000","last_undegraded":"2024-09-12T18:13:55.046377+0000","last_fullsized":"2024-09-12T18:13:55.046377+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'400","last_scrub_stamp":"2024-09-12T18:13:55.046290+0000","last_deep_scrub":"264'400","last_deep_scrub_stamp":"2024-09-12T18:13:55.046290+0000","last_clean_scrub_stamp":"2024-09-12T18:13:55.046290+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:33.859962+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2934950,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":656,"num_read_kb":22996,"num_write":1171,"num_write_kb":36092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:18.939964+0000","last_change":"2024-09-12T18:14:18.939964+0000","last_active":"2024-09-12T18:14:18.939964+0000","last_peered":"2024-09-12T18:14:18.939964+0000","last_clean":"2024-09-12T18:14:18.939964+0000","last_became_active":"2024-09-12T17:00:16.323601+0000","last_became_peered":"2024-09-12T17:00:16.323601+0000","last_unstale":"2024-09-12T18:14:18.939964+0000","last_undegraded":"2024-09-12T18:14:18.939964+0000","last_fullsized":"2024-09-12T18:14:18.939964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:18.939871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:18.939871+0000","last_clean_scrub_stamp":"2024-09-12T18:14:18.939871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:47.955364+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'109","reported_seq":657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:23.910609+0000","last_change":"2024-09-12T18:14:23.910609+0000","last_active":"2024-09-12T18:14:23.910609+0000","last_peered":"2024-09-12T18:14:23.910609+0000","last_clean":"2024-09-12T18:14:23.910609+0000","last_became_active":"2024-09-12T17:00:18.327744+0000","last_became_peered":"2024-09-12T17:00:18.327744+0000","last_unstale":"2024-09-12T18:14:23.910609+0000","last_undegraded":"2024-09-12T18:14:23.910609+0000","last_fullsized":"2024-09-12T18:14:23.910609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'109","last_scrub_stamp":"2024-09-12T18:14:23.910502+0000","last_deep_scrub":"264'109","last_deep_scrub_stamp":"2024-09-12T18:14:23.910502+0000","last_clean_scrub_stamp":"2024-09-12T18:14:23.910502+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:25.648635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":113,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:27.792528+0000","last_change":"2024-09-12T18:14:27.792528+0000","last_active":"2024-09-12T18:14:27.792528+0000","last_peered":"2024-09-12T18:14:27.792528+0000","last_clean":"2024-09-12T18:14:27.792528+0000","last_became_active":"2024-09-12T17:00:20.347865+0000","last_became_peered":"2024-09-12T17:00:20.347865+0000","last_unstale":"2024-09-12T18:14:27.792528+0000","last_undegraded":"2024-09-12T18:14:27.792528+0000","last_fullsized":"2024-09-12T18:14:27.792528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:27.792437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:27.792437+0000","last_clean_scrub_stamp":"2024-09-12T18:14:27.792437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:34.829366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'117","reported_seq":641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:33.264633+0000","last_change":"2024-09-12T18:14:33.264633+0000","last_active":"2024-09-12T18:14:33.264633+0000","last_peered":"2024-09-12T18:14:33.264633+0000","last_clean":"2024-09-12T18:14:33.264633+0000","last_became_active":"2024-09-12T17:00:22.352912+0000","last_became_peered":"2024-09-12T17:00:22.352912+0000","last_unstale":"2024-09-12T18:14:33.264633+0000","last_undegraded":"2024-09-12T18:14:33.264633+0000","last_fullsized":"2024-09-12T18:14:33.264633+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'117","last_scrub_stamp":"2024-09-12T18:14:33.264533+0000","last_deep_scrub":"264'117","last_deep_scrub_stamp":"2024-09-12T18:14:33.264533+0000","last_clean_scrub_stamp":"2024-09-12T18:14:33.264533+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:21.531030+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":708,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":149,"num_read_kb":144,"num_write":248,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'179","reported_seq":814,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.134414+0000","last_change":"2024-09-12T18:14:07.134414+0000","last_active":"2024-09-12T18:14:07.134414+0000","last_peered":"2024-09-12T18:14:07.134414+0000","last_clean":"2024-09-12T18:14:07.134414+0000","last_became_active":"2024-09-12T17:00:14.337515+0000","last_became_peered":"2024-09-12T17:00:14.337515+0000","last_unstale":"2024-09-12T18:14:07.134414+0000","last_undegraded":"2024-09-12T18:14:07.134414+0000","last_fullsized":"2024-09-12T18:14:07.134414+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-09-12T18:14:07.134319+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-09-12T18:14:07.134319+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.134319+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:44.674793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":863,"num_read_kb":715,"num_write":299,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'372","reported_seq":1041,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.233108+0000","last_change":"2024-09-12T18:14:02.233108+0000","last_active":"2024-09-12T18:14:02.233108+0000","last_peered":"2024-09-12T18:14:02.233108+0000","last_clean":"2024-09-12T18:14:02.233108+0000","last_became_active":"2024-09-12T17:00:12.308065+0000","last_became_peered":"2024-09-12T17:00:12.308065+0000","last_unstale":"2024-09-12T18:14:02.233108+0000","last_undegraded":"2024-09-12T18:14:02.233108+0000","last_fullsized":"2024-09-12T18:14:02.233108+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-12T18:14:02.232968+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-12T18:14:02.232968+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.232968+0000","objects_scrubbed":7,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:48.335339+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":976913,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":502,"num_read_kb":43207,"num_write":1166,"num_write_kb":32106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.974613+0000","last_change":"2024-09-12T18:14:17.974613+0000","last_active":"2024-09-12T18:14:17.974613+0000","last_peered":"2024-09-12T18:14:17.974613+0000","last_clean":"2024-09-12T18:14:17.974613+0000","last_became_active":"2024-09-12T17:00:16.326073+0000","last_became_peered":"2024-09-12T17:00:16.326073+0000","last_unstale":"2024-09-12T18:14:17.974613+0000","last_undegraded":"2024-09-12T18:14:17.974613+0000","last_fullsized":"2024-09-12T18:14:17.974613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:17.974523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:17.974523+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.974523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:10.061813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'145","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.127850+0000","last_change":"2024-09-12T18:14:12.127850+0000","last_active":"2024-09-12T18:14:12.127850+0000","last_peered":"2024-09-12T18:14:12.127850+0000","last_clean":"2024-09-12T18:14:12.127850+0000","last_became_active":"2024-09-12T17:00:18.327448+0000","last_became_peered":"2024-09-12T17:00:18.327448+0000","last_unstale":"2024-09-12T18:14:12.127850+0000","last_undegraded":"2024-09-12T18:14:12.127850+0000","last_fullsized":"2024-09-12T18:14:12.127850+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'145","last_scrub_stamp":"2024-09-12T18:14:12.127741+0000","last_deep_scrub":"264'145","last_deep_scrub_stamp":"2024-09-12T18:14:12.127741+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.127741+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:09.199604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":172,"num_read_kb":164,"num_write":118,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'768","reported_seq":2575,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:27.465904+0000","last_change":"2024-09-12T18:14:27.465904+0000","last_active":"2024-09-12T18:14:27.465904+0000","last_peered":"2024-09-12T18:14:27.465904+0000","last_clean":"2024-09-12T18:14:27.465904+0000","last_became_active":"2024-09-12T17:00:20.351202+0000","last_became_peered":"2024-09-12T17:00:20.351202+0000","last_unstale":"2024-09-12T18:14:27.465904+0000","last_undegraded":"2024-09-12T18:14:27.465904+0000","last_fullsized":"2024-09-12T18:14:27.465904+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'768","last_scrub_stamp":"2024-09-12T18:14:27.465814+0000","last_deep_scrub":"264'768","last_deep_scrub_stamp":"2024-09-12T18:14:27.465814+0000","last_clean_scrub_stamp":"2024-09-12T18:14:27.465814+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:30.913051+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'208","reported_seq":1042,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:32.886927+0000","last_change":"2024-09-12T18:14:32.886927+0000","last_active":"2024-09-12T18:14:32.886927+0000","last_peered":"2024-09-12T18:14:32.886927+0000","last_clean":"2024-09-12T18:14:32.886927+0000","last_became_active":"2024-09-12T17:00:22.588111+0000","last_became_peered":"2024-09-12T17:00:22.588111+0000","last_unstale":"2024-09-12T18:14:32.886927+0000","last_undegraded":"2024-09-12T18:14:32.886927+0000","last_fullsized":"2024-09-12T18:14:32.886927+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'208","last_scrub_stamp":"2024-09-12T18:14:32.886828+0000","last_deep_scrub":"264'208","last_deep_scrub_stamp":"2024-09-12T18:14:32.886828+0000","last_clean_scrub_stamp":"2024-09-12T18:14:32.886828+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:45.836812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":621,"num_read_kb":619,"num_write":443,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'162","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.947891+0000","last_change":"2024-09-12T18:14:10.947891+0000","last_active":"2024-09-12T18:14:10.947891+0000","last_peered":"2024-09-12T18:14:10.947891+0000","last_clean":"2024-09-12T18:14:10.947891+0000","last_became_active":"2024-09-12T17:00:14.332424+0000","last_became_peered":"2024-09-12T17:00:14.332424+0000","last_unstale":"2024-09-12T18:14:10.947891+0000","last_undegraded":"2024-09-12T18:14:10.947891+0000","last_fullsized":"2024-09-12T18:14:10.947891+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'162","last_scrub_stamp":"2024-09-12T18:14:10.947786+0000","last_deep_scrub":"264'162","last_deep_scrub_stamp":"2024-09-12T18:14:10.947786+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.947786+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:36.780975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":720,"num_read_kb":605,"num_write":258,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'356","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.062122+0000","last_change":"2024-09-12T18:13:58.062122+0000","last_active":"2024-09-12T18:13:58.062122+0000","last_peered":"2024-09-12T18:13:58.062122+0000","last_clean":"2024-09-12T18:13:58.062122+0000","last_became_active":"2024-09-12T17:00:12.310337+0000","last_became_peered":"2024-09-12T17:00:12.310337+0000","last_unstale":"2024-09-12T18:13:58.062122+0000","last_undegraded":"2024-09-12T18:13:58.062122+0000","last_fullsized":"2024-09-12T18:13:58.062122+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-12T18:13:58.062029+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-12T18:13:58.062029+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.062029+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:33.366460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":552,"num_read_kb":13230,"num_write":1122,"num_write_kb":37058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:21.453349+0000","last_change":"2024-09-12T18:14:21.453349+0000","last_active":"2024-09-12T18:14:21.453349+0000","last_peered":"2024-09-12T18:14:21.453349+0000","last_clean":"2024-09-12T18:14:21.453349+0000","last_became_active":"2024-09-12T17:00:16.325141+0000","last_became_peered":"2024-09-12T17:00:16.325141+0000","last_unstale":"2024-09-12T18:14:21.453349+0000","last_undegraded":"2024-09-12T18:14:21.453349+0000","last_fullsized":"2024-09-12T18:14:21.453349+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:21.453254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:21.453254+0000","last_clean_scrub_stamp":"2024-09-12T18:14:21.453254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:29.853021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'313","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:24.501551+0000","last_change":"2024-09-12T18:14:24.501551+0000","last_active":"2024-09-12T18:14:24.501551+0000","last_peered":"2024-09-12T18:14:24.501551+0000","last_clean":"2024-09-12T18:14:24.501551+0000","last_became_active":"2024-09-12T17:00:18.430046+0000","last_became_peered":"2024-09-12T17:00:18.430046+0000","last_unstale":"2024-09-12T18:14:24.501551+0000","last_undegraded":"2024-09-12T18:14:24.501551+0000","last_fullsized":"2024-09-12T18:14:24.501551+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'313","last_scrub_stamp":"2024-09-12T18:14:24.501448+0000","last_deep_scrub":"264'313","last_deep_scrub_stamp":"2024-09-12T18:14:24.501448+0000","last_clean_scrub_stamp":"2024-09-12T18:14:24.501448+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:24.952495+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53213,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":492,"num_read_kb":1165,"num_write":400,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'773","reported_seq":2870,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:30.796203+0000","last_change":"2024-09-12T18:14:30.796203+0000","last_active":"2024-09-12T18:14:30.796203+0000","last_peered":"2024-09-12T18:14:30.796203+0000","last_clean":"2024-09-12T18:14:30.796203+0000","last_became_active":"2024-09-12T17:00:20.353914+0000","last_became_peered":"2024-09-12T17:00:20.353914+0000","last_unstale":"2024-09-12T18:14:30.796203+0000","last_undegraded":"2024-09-12T18:14:30.796203+0000","last_fullsized":"2024-09-12T18:14:30.796203+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'773","last_scrub_stamp":"2024-09-12T18:14:30.796110+0000","last_deep_scrub":"264'773","last_deep_scrub_stamp":"2024-09-12T18:14:30.796110+0000","last_clean_scrub_stamp":"2024-09-12T18:14:30.796110+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:10.267813+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'89","reported_seq":685,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.529816+0000","last_change":"2024-09-12T18:14:11.529816+0000","last_active":"2024-09-12T18:14:11.529816+0000","last_peered":"2024-09-12T18:14:11.529816+0000","last_clean":"2024-09-12T18:14:11.529816+0000","last_became_active":"2024-09-12T17:00:14.325669+0000","last_became_peered":"2024-09-12T17:00:14.325669+0000","last_unstale":"2024-09-12T18:14:11.529816+0000","last_undegraded":"2024-09-12T18:14:11.529816+0000","last_fullsized":"2024-09-12T18:14:11.529816+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'89","last_scrub_stamp":"2024-09-12T18:14:11.529715+0000","last_deep_scrub":"264'89","last_deep_scrub_stamp":"2024-09-12T18:14:11.529715+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.529715+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:01.485599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":392,"num_read_kb":330,"num_write":131,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'362","reported_seq":981,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.168944+0000","last_change":"2024-09-12T18:14:00.168944+0000","last_active":"2024-09-12T18:14:00.168944+0000","last_peered":"2024-09-12T18:14:00.168944+0000","last_clean":"2024-09-12T18:14:00.168944+0000","last_became_active":"2024-09-12T17:00:12.315015+0000","last_became_peered":"2024-09-12T17:00:12.315015+0000","last_unstale":"2024-09-12T18:14:00.168944+0000","last_undegraded":"2024-09-12T18:14:00.168944+0000","last_fullsized":"2024-09-12T18:14:00.168944+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'362","last_scrub_stamp":"2024-09-12T18:14:00.168837+0000","last_deep_scrub":"264'362","last_deep_scrub_stamp":"2024-09-12T18:14:00.168837+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.168837+0000","objects_scrubbed":8,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:13.982975+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311686,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":465,"num_read_kb":13974,"num_write":1122,"num_write_kb":21819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:15.291075+0000","last_change":"2024-09-12T18:14:15.291075+0000","last_active":"2024-09-12T18:14:15.291075+0000","last_peered":"2024-09-12T18:14:15.291075+0000","last_clean":"2024-09-12T18:14:15.291075+0000","last_became_active":"2024-09-12T17:00:16.322693+0000","last_became_peered":"2024-09-12T17:00:16.322693+0000","last_unstale":"2024-09-12T18:14:15.291075+0000","last_undegraded":"2024-09-12T18:14:15.291075+0000","last_fullsized":"2024-09-12T18:14:15.291075+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:15.290984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:15.290984+0000","last_clean_scrub_stamp":"2024-09-12T18:14:15.290984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:22.877472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'404","reported_seq":1055,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:24.461519+0000","last_change":"2024-09-12T18:14:24.461519+0000","last_active":"2024-09-12T18:14:24.461519+0000","last_peered":"2024-09-12T18:14:24.461519+0000","last_clean":"2024-09-12T18:14:24.461519+0000","last_became_active":"2024-09-12T17:00:18.429137+0000","last_became_peered":"2024-09-12T17:00:18.429137+0000","last_unstale":"2024-09-12T18:14:24.461519+0000","last_undegraded":"2024-09-12T18:14:24.461519+0000","last_fullsized":"2024-09-12T18:14:24.461519+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'404","last_scrub_stamp":"2024-09-12T18:14:24.461416+0000","last_deep_scrub":"264'404","last_deep_scrub_stamp":"2024-09-12T18:14:24.461416+0000","last_clean_scrub_stamp":"2024-09-12T18:14:24.461416+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:11.439801+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47718,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":656,"num_read_kb":1335,"num_write":508,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:16.245833+0000","last_change":"2024-09-12T18:14:16.245833+0000","last_active":"2024-09-12T18:14:16.245833+0000","last_peered":"2024-09-12T18:14:16.245833+0000","last_clean":"2024-09-12T18:14:16.245833+0000","last_became_active":"2024-09-12T17:00:20.348507+0000","last_became_peered":"2024-09-12T17:00:20.348507+0000","last_unstale":"2024-09-12T18:14:16.245833+0000","last_undegraded":"2024-09-12T18:14:16.245833+0000","last_fullsized":"2024-09-12T18:14:16.245833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:16.245739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:16.245739+0000","last_clean_scrub_stamp":"2024-09-12T18:14:16.245739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:46.217319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'563","reported_seq":1396,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:30.435968+0000","last_change":"2024-09-12T18:14:30.435968+0000","last_active":"2024-09-12T18:14:30.435968+0000","last_peered":"2024-09-12T18:14:30.435968+0000","last_clean":"2024-09-12T18:14:30.435968+0000","last_became_active":"2024-09-12T17:00:22.358335+0000","last_became_peered":"2024-09-12T17:00:22.358335+0000","last_unstale":"2024-09-12T18:14:30.435968+0000","last_undegraded":"2024-09-12T18:14:30.435968+0000","last_fullsized":"2024-09-12T18:14:30.435968+0000","mapping_epoch":34,"log_start":"264'500","ondisk_log_start":"264'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'563","last_scrub_stamp":"2024-09-12T18:14:30.435874+0000","last_deep_scrub":"264'563","last_deep_scrub_stamp":"2024-09-12T18:14:30.435874+0000","last_clean_scrub_stamp":"2024-09-12T18:14:30.435874+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:20.170885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1357,"num_read_kb":1346,"num_write":1162,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'63","reported_seq":638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.872058+0000","last_change":"2024-09-12T18:14:02.872058+0000","last_active":"2024-09-12T18:14:02.872058+0000","last_peered":"2024-09-12T18:14:02.872058+0000","last_clean":"2024-09-12T18:14:02.872058+0000","last_became_active":"2024-09-12T17:00:14.335783+0000","last_became_peered":"2024-09-12T17:00:14.335783+0000","last_unstale":"2024-09-12T18:14:02.872058+0000","last_undegraded":"2024-09-12T18:14:02.872058+0000","last_fullsized":"2024-09-12T18:14:02.872058+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'63","last_scrub_stamp":"2024-09-12T18:14:02.871975+0000","last_deep_scrub":"264'63","last_deep_scrub_stamp":"2024-09-12T18:14:02.871975+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.871975+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:08.824516+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":238,"num_write":99,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'411","reported_seq":1151,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.203673+0000","last_change":"2024-09-12T18:14:01.203613+0000","last_active":"2024-09-12T18:14:01.203673+0000","last_peered":"2024-09-12T18:14:01.203673+0000","last_clean":"2024-09-12T18:14:01.203673+0000","last_became_active":"2024-09-12T17:00:12.307222+0000","last_became_peered":"2024-09-12T17:00:12.307222+0000","last_unstale":"2024-09-12T18:14:01.203673+0000","last_undegraded":"2024-09-12T18:14:01.203673+0000","last_fullsized":"2024-09-12T18:14:01.203673+0000","mapping_epoch":24,"log_start":"264'400","ondisk_log_start":"264'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'411","last_scrub_stamp":"2024-09-12T18:14:01.203510+0000","last_deep_scrub":"264'411","last_deep_scrub_stamp":"2024-09-12T18:14:01.203510+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.203510+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:03.740833+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":853,"num_read_kb":14510,"num_write":1377,"num_write_kb":34813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.081210+0000","last_change":"2024-09-12T18:14:03.081210+0000","last_active":"2024-09-12T18:14:03.081210+0000","last_peered":"2024-09-12T18:14:03.081210+0000","last_clean":"2024-09-12T18:14:03.081210+0000","last_became_active":"2024-09-12T17:00:16.322917+0000","last_became_peered":"2024-09-12T17:00:16.322917+0000","last_unstale":"2024-09-12T18:14:03.081210+0000","last_undegraded":"2024-09-12T18:14:03.081210+0000","last_fullsized":"2024-09-12T18:14:03.081210+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:03.081128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:03.081128+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.081128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:19.186349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'273","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:19.963269+0000","last_change":"2024-09-12T18:14:19.963185+0000","last_active":"2024-09-12T18:14:19.963269+0000","last_peered":"2024-09-12T18:14:19.963269+0000","last_clean":"2024-09-12T18:14:19.963269+0000","last_became_active":"2024-09-12T17:00:18.326791+0000","last_became_peered":"2024-09-12T17:00:18.326791+0000","last_unstale":"2024-09-12T18:14:19.963269+0000","last_undegraded":"2024-09-12T18:14:19.963269+0000","last_fullsized":"2024-09-12T18:14:19.963269+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'273","last_scrub_stamp":"2024-09-12T18:14:19.963085+0000","last_deep_scrub":"264'273","last_deep_scrub_stamp":"2024-09-12T18:14:19.963085+0000","last_clean_scrub_stamp":"2024-09-12T18:14:19.963085+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:52.889955+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43451,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":428,"num_read_kb":949,"num_write":338,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:29.805723+0000","last_change":"2024-09-12T18:14:29.805723+0000","last_active":"2024-09-12T18:14:29.805723+0000","last_peered":"2024-09-12T18:14:29.805723+0000","last_clean":"2024-09-12T18:14:29.805723+0000","last_became_active":"2024-09-12T17:00:20.353959+0000","last_became_peered":"2024-09-12T17:00:20.353959+0000","last_unstale":"2024-09-12T18:14:29.805723+0000","last_undegraded":"2024-09-12T18:14:29.805723+0000","last_fullsized":"2024-09-12T18:14:29.805723+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:29.805634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:29.805634+0000","last_clean_scrub_stamp":"2024-09-12T18:14:29.805634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:49.384223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'2409","reported_seq":4240,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:19.233622+0000","last_change":"2024-09-12T18:14:19.233622+0000","last_active":"2024-09-12T18:14:19.233622+0000","last_peered":"2024-09-12T18:14:19.233622+0000","last_clean":"2024-09-12T18:14:19.233622+0000","last_became_active":"2024-09-12T17:00:22.355651+0000","last_became_peered":"2024-09-12T17:00:22.355651+0000","last_unstale":"2024-09-12T18:14:19.233622+0000","last_undegraded":"2024-09-12T18:14:19.233622+0000","last_fullsized":"2024-09-12T18:14:19.233622+0000","mapping_epoch":34,"log_start":"264'2300","ondisk_log_start":"264'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2409","last_scrub_stamp":"2024-09-12T18:14:19.233517+0000","last_deep_scrub":"264'2409","last_deep_scrub_stamp":"2024-09-12T18:14:19.233517+0000","last_clean_scrub_stamp":"2024-09-12T18:14:19.233517+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":2300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:52:18.529817+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6022,"num_read_kb":6027,"num_write":4838,"num_write_kb":1790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'196","reported_seq":784,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.998772+0000","last_change":"2024-09-12T18:14:06.998699+0000","last_active":"2024-09-12T18:14:06.998772+0000","last_peered":"2024-09-12T18:14:06.998772+0000","last_clean":"2024-09-12T18:14:06.998772+0000","last_became_active":"2024-09-12T17:00:14.321270+0000","last_became_peered":"2024-09-12T17:00:14.321270+0000","last_unstale":"2024-09-12T18:14:06.998772+0000","last_undegraded":"2024-09-12T18:14:06.998772+0000","last_fullsized":"2024-09-12T18:14:06.998772+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'196","last_scrub_stamp":"2024-09-12T18:14:06.998613+0000","last_deep_scrub":"264'196","last_deep_scrub_stamp":"2024-09-12T18:14:06.998613+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.998613+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:01.248687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":834,"num_read_kb":668,"num_write":296,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'325","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.185437+0000","last_change":"2024-09-12T18:14:04.185362+0000","last_active":"2024-09-12T18:14:04.185437+0000","last_peered":"2024-09-12T18:14:04.185437+0000","last_clean":"2024-09-12T18:14:04.185437+0000","last_became_active":"2024-09-12T17:00:12.313262+0000","last_became_peered":"2024-09-12T17:00:12.313262+0000","last_unstale":"2024-09-12T18:14:04.185437+0000","last_undegraded":"2024-09-12T18:14:04.185437+0000","last_fullsized":"2024-09-12T18:14:04.185437+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'325","last_scrub_stamp":"2024-09-12T18:14:04.185253+0000","last_deep_scrub":"264'325","last_deep_scrub_stamp":"2024-09-12T18:14:04.185253+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.185253+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:59.905385+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":514296,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":454,"num_read_kb":16364,"num_write":986,"num_write_kb":27335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.184742+0000","last_change":"2024-09-12T18:14:07.184651+0000","last_active":"2024-09-12T18:14:07.184742+0000","last_peered":"2024-09-12T18:14:07.184742+0000","last_clean":"2024-09-12T18:14:07.184742+0000","last_became_active":"2024-09-12T17:00:16.321641+0000","last_became_peered":"2024-09-12T17:00:16.321641+0000","last_unstale":"2024-09-12T18:14:07.184742+0000","last_undegraded":"2024-09-12T18:14:07.184742+0000","last_fullsized":"2024-09-12T18:14:07.184742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:07.184519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:07.184519+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.184519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:04.109723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'345","reported_seq":959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:21.432871+0000","last_change":"2024-09-12T18:14:21.432871+0000","last_active":"2024-09-12T18:14:21.432871+0000","last_peered":"2024-09-12T18:14:21.432871+0000","last_clean":"2024-09-12T18:14:21.432871+0000","last_became_active":"2024-09-12T17:00:18.331707+0000","last_became_peered":"2024-09-12T17:00:18.331707+0000","last_unstale":"2024-09-12T18:14:21.432871+0000","last_undegraded":"2024-09-12T18:14:21.432871+0000","last_fullsized":"2024-09-12T18:14:21.432871+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'345","last_scrub_stamp":"2024-09-12T18:14:21.432771+0000","last_deep_scrub":"264'345","last_deep_scrub_stamp":"2024-09-12T18:14:21.432771+0000","last_clean_scrub_stamp":"2024-09-12T18:14:21.432771+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:36.257707+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47689,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":552,"num_read_kb":1215,"num_write":436,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'766","reported_seq":2737,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:27.262444+0000","last_change":"2024-09-12T18:14:27.262444+0000","last_active":"2024-09-12T18:14:27.262444+0000","last_peered":"2024-09-12T18:14:27.262444+0000","last_clean":"2024-09-12T18:14:27.262444+0000","last_became_active":"2024-09-12T17:00:20.348227+0000","last_became_peered":"2024-09-12T17:00:20.348227+0000","last_unstale":"2024-09-12T18:14:27.262444+0000","last_undegraded":"2024-09-12T18:14:27.262444+0000","last_fullsized":"2024-09-12T18:14:27.262444+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'766","last_scrub_stamp":"2024-09-12T18:14:27.262358+0000","last_deep_scrub":"264'766","last_deep_scrub_stamp":"2024-09-12T18:14:27.262358+0000","last_clean_scrub_stamp":"2024-09-12T18:14:27.262358+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:48.519225+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'116","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:28.274619+0000","last_change":"2024-09-12T18:14:28.274619+0000","last_active":"2024-09-12T18:14:28.274619+0000","last_peered":"2024-09-12T18:14:28.274619+0000","last_clean":"2024-09-12T18:14:28.274619+0000","last_became_active":"2024-09-12T17:00:22.353172+0000","last_became_peered":"2024-09-12T17:00:22.353172+0000","last_unstale":"2024-09-12T18:14:28.274619+0000","last_undegraded":"2024-09-12T18:14:28.274619+0000","last_fullsized":"2024-09-12T18:14:28.274619+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'116","last_scrub_stamp":"2024-09-12T18:14:28.274507+0000","last_deep_scrub":"264'116","last_deep_scrub_stamp":"2024-09-12T18:14:28.274507+0000","last_clean_scrub_stamp":"2024-09-12T18:14:28.274507+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:11.779233+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":136,"num_write":299,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'231","reported_seq":894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.156956+0000","last_change":"2024-09-12T18:14:08.156892+0000","last_active":"2024-09-12T18:14:08.156956+0000","last_peered":"2024-09-12T18:14:08.156956+0000","last_clean":"2024-09-12T18:14:08.156956+0000","last_became_active":"2024-09-12T17:00:14.324823+0000","last_became_peered":"2024-09-12T17:00:14.324823+0000","last_unstale":"2024-09-12T18:14:08.156956+0000","last_undegraded":"2024-09-12T18:14:08.156956+0000","last_fullsized":"2024-09-12T18:14:08.156956+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'231","last_scrub_stamp":"2024-09-12T18:14:08.156786+0000","last_deep_scrub":"264'231","last_deep_scrub_stamp":"2024-09-12T18:14:08.156786+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.156786+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:05.486389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1013,"num_read_kb":830,"num_write":393,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'409","reported_seq":1106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.506501+0000","last_change":"2024-09-12T18:14:00.506441+0000","last_active":"2024-09-12T18:14:00.506501+0000","last_peered":"2024-09-12T18:14:00.506501+0000","last_clean":"2024-09-12T18:14:00.506501+0000","last_became_active":"2024-09-12T17:00:12.318599+0000","last_became_peered":"2024-09-12T17:00:12.318599+0000","last_unstale":"2024-09-12T18:14:00.506501+0000","last_undegraded":"2024-09-12T18:14:00.506501+0000","last_fullsized":"2024-09-12T18:14:00.506501+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'409","last_scrub_stamp":"2024-09-12T18:14:00.506341+0000","last_deep_scrub":"264'409","last_deep_scrub_stamp":"2024-09-12T18:14:00.506341+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.506341+0000","objects_scrubbed":10,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:44.930843+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850207,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":687,"num_read_kb":44825,"num_write":1169,"num_write_kb":32428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.143934+0000","last_change":"2024-09-12T18:14:08.143874+0000","last_active":"2024-09-12T18:14:08.143934+0000","last_peered":"2024-09-12T18:14:08.143934+0000","last_clean":"2024-09-12T18:14:08.143934+0000","last_became_active":"2024-09-12T17:00:16.328352+0000","last_became_peered":"2024-09-12T17:00:16.328352+0000","last_unstale":"2024-09-12T18:14:08.143934+0000","last_undegraded":"2024-09-12T18:14:08.143934+0000","last_fullsized":"2024-09-12T18:14:08.143934+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:08.143773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:08.143773+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.143773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:58.048888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'482","reported_seq":1148,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:19.289062+0000","last_change":"2024-09-12T18:14:19.289062+0000","last_active":"2024-09-12T18:14:19.289062+0000","last_peered":"2024-09-12T18:14:19.289062+0000","last_clean":"2024-09-12T18:14:19.289062+0000","last_became_active":"2024-09-12T17:00:18.329414+0000","last_became_peered":"2024-09-12T17:00:18.329414+0000","last_unstale":"2024-09-12T18:14:19.289062+0000","last_undegraded":"2024-09-12T18:14:19.289062+0000","last_fullsized":"2024-09-12T18:14:19.289062+0000","mapping_epoch":30,"log_start":"264'400","ondisk_log_start":"264'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'482","last_scrub_stamp":"2024-09-12T18:14:19.288972+0000","last_deep_scrub":"264'482","last_deep_scrub_stamp":"2024-09-12T18:14:19.288972+0000","last_clean_scrub_stamp":"2024-09-12T18:14:19.288972+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:03.670071+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60099,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":839,"num_read_kb":2047,"num_write":682,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.106469+0000","last_change":"2024-09-12T18:14:13.106469+0000","last_active":"2024-09-12T18:14:13.106469+0000","last_peered":"2024-09-12T18:14:13.106469+0000","last_clean":"2024-09-12T18:14:13.106469+0000","last_became_active":"2024-09-12T17:00:20.352249+0000","last_became_peered":"2024-09-12T17:00:20.352249+0000","last_unstale":"2024-09-12T18:14:13.106469+0000","last_undegraded":"2024-09-12T18:14:13.106469+0000","last_fullsized":"2024-09-12T18:14:13.106469+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:13.106375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:13.106375+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.106375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:50.311270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'179","reported_seq":721,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:22.241611+0000","last_change":"2024-09-12T18:14:22.241611+0000","last_active":"2024-09-12T18:14:22.241611+0000","last_peered":"2024-09-12T18:14:22.241611+0000","last_clean":"2024-09-12T18:14:22.241611+0000","last_became_active":"2024-09-12T17:00:22.355850+0000","last_became_peered":"2024-09-12T17:00:22.355850+0000","last_unstale":"2024-09-12T18:14:22.241611+0000","last_undegraded":"2024-09-12T18:14:22.241611+0000","last_fullsized":"2024-09-12T18:14:22.241611+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-09-12T18:14:22.241519+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-09-12T18:14:22.241519+0000","last_clean_scrub_stamp":"2024-09-12T18:14:22.241519+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:24.072903+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":278,"num_read_kb":264,"num_write":436,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'144","reported_seq":760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.917152+0000","last_change":"2024-09-12T18:14:03.917096+0000","last_active":"2024-09-12T18:14:03.917152+0000","last_peered":"2024-09-12T18:14:03.917152+0000","last_clean":"2024-09-12T18:14:03.917152+0000","last_became_active":"2024-09-12T17:00:14.334594+0000","last_became_peered":"2024-09-12T17:00:14.334594+0000","last_unstale":"2024-09-12T18:14:03.917152+0000","last_undegraded":"2024-09-12T18:14:03.917152+0000","last_fullsized":"2024-09-12T18:14:03.917152+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'144","last_scrub_stamp":"2024-09-12T18:14:03.917002+0000","last_deep_scrub":"264'144","last_deep_scrub_stamp":"2024-09-12T18:14:03.917002+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.917002+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:28.774783+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":624,"num_read_kb":516,"num_write":207,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'348","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:56.926940+0000","last_change":"2024-09-12T18:13:56.926852+0000","last_active":"2024-09-12T18:13:56.926940+0000","last_peered":"2024-09-12T18:13:56.926940+0000","last_clean":"2024-09-12T18:13:56.926940+0000","last_became_active":"2024-09-12T17:00:12.314509+0000","last_became_peered":"2024-09-12T17:00:12.314509+0000","last_unstale":"2024-09-12T18:13:56.926940+0000","last_undegraded":"2024-09-12T18:13:56.926940+0000","last_fullsized":"2024-09-12T18:13:56.926940+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'348","last_scrub_stamp":"2024-09-12T18:13:56.926498+0000","last_deep_scrub":"264'348","last_deep_scrub_stamp":"2024-09-12T18:13:56.926498+0000","last_clean_scrub_stamp":"2024-09-12T18:13:56.926498+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:36.730340+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2180125,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":439,"num_read_kb":51555,"num_write":1035,"num_write_kb":32245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.184733+0000","last_change":"2024-09-12T18:14:10.184661+0000","last_active":"2024-09-12T18:14:10.184733+0000","last_peered":"2024-09-12T18:14:10.184733+0000","last_clean":"2024-09-12T18:14:10.184733+0000","last_became_active":"2024-09-12T17:00:16.319269+0000","last_became_peered":"2024-09-12T17:00:16.319269+0000","last_unstale":"2024-09-12T18:14:10.184733+0000","last_undegraded":"2024-09-12T18:14:10.184733+0000","last_fullsized":"2024-09-12T18:14:10.184733+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:10.184575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:10.184575+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.184575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:10.584698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'302","reported_seq":908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:21.891284+0000","last_change":"2024-09-12T18:14:21.891215+0000","last_active":"2024-09-12T18:14:21.891284+0000","last_peered":"2024-09-12T18:14:21.891284+0000","last_clean":"2024-09-12T18:14:21.891284+0000","last_became_active":"2024-09-12T17:00:18.330634+0000","last_became_peered":"2024-09-12T17:00:18.330634+0000","last_unstale":"2024-09-12T18:14:21.891284+0000","last_undegraded":"2024-09-12T18:14:21.891284+0000","last_fullsized":"2024-09-12T18:14:21.891284+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'302","last_scrub_stamp":"2024-09-12T18:14:21.891090+0000","last_deep_scrub":"264'302","last_deep_scrub_stamp":"2024-09-12T18:14:21.891090+0000","last_clean_scrub_stamp":"2024-09-12T18:14:21.891090+0000","objects_scrubbed":7,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:21.260428+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48221,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":495,"num_read_kb":1035,"num_write":432,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:24.194175+0000","last_change":"2024-09-12T18:14:24.194175+0000","last_active":"2024-09-12T18:14:24.194175+0000","last_peered":"2024-09-12T18:14:24.194175+0000","last_clean":"2024-09-12T18:14:24.194175+0000","last_became_active":"2024-09-12T17:00:20.351001+0000","last_became_peered":"2024-09-12T17:00:20.351001+0000","last_unstale":"2024-09-12T18:14:24.194175+0000","last_undegraded":"2024-09-12T18:14:24.194175+0000","last_fullsized":"2024-09-12T18:14:24.194175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:24.194064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:24.194064+0000","last_clean_scrub_stamp":"2024-09-12T18:14:24.194064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:58.960227+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'125","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:31.843679+0000","last_change":"2024-09-12T18:14:31.843577+0000","last_active":"2024-09-12T18:14:31.843679+0000","last_peered":"2024-09-12T18:14:31.843679+0000","last_clean":"2024-09-12T18:14:31.843679+0000","last_became_active":"2024-09-12T17:00:22.357001+0000","last_became_peered":"2024-09-12T17:00:22.357001+0000","last_unstale":"2024-09-12T18:14:31.843679+0000","last_undegraded":"2024-09-12T18:14:31.843679+0000","last_fullsized":"2024-09-12T18:14:31.843679+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'125","last_scrub_stamp":"2024-09-12T18:14:31.843463+0000","last_deep_scrub":"264'125","last_deep_scrub_stamp":"2024-09-12T18:14:31.843463+0000","last_clean_scrub_stamp":"2024-09-12T18:14:31.843463+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:17.402238+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":156,"num_write":307,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'263","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.957494+0000","last_change":"2024-09-12T18:14:04.957402+0000","last_active":"2024-09-12T18:14:04.957494+0000","last_peered":"2024-09-12T18:14:04.957494+0000","last_clean":"2024-09-12T18:14:04.957494+0000","last_became_active":"2024-09-12T17:00:14.320928+0000","last_became_peered":"2024-09-12T17:00:14.320928+0000","last_unstale":"2024-09-12T18:14:04.957494+0000","last_undegraded":"2024-09-12T18:14:04.957494+0000","last_fullsized":"2024-09-12T18:14:04.957494+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'263","last_scrub_stamp":"2024-09-12T18:14:04.957288+0000","last_deep_scrub":"264'263","last_deep_scrub_stamp":"2024-09-12T18:14:04.957288+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.957288+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:04.198862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1139,"num_read_kb":929,"num_write":426,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'361","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.038411+0000","last_change":"2024-09-12T18:14:00.038340+0000","last_active":"2024-09-12T18:14:00.038411+0000","last_peered":"2024-09-12T18:14:00.038411+0000","last_clean":"2024-09-12T18:14:00.038411+0000","last_became_active":"2024-09-12T17:00:12.308967+0000","last_became_peered":"2024-09-12T17:00:12.308967+0000","last_unstale":"2024-09-12T18:14:00.038411+0000","last_undegraded":"2024-09-12T18:14:00.038411+0000","last_fullsized":"2024-09-12T18:14:00.038411+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'361","last_scrub_stamp":"2024-09-12T18:14:00.038240+0000","last_deep_scrub":"264'361","last_deep_scrub_stamp":"2024-09-12T18:14:00.038240+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.038240+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:42.694292+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549696,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":120658,"num_write":1095,"num_write_kb":55796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.118915+0000","last_change":"2024-09-12T18:14:10.118839+0000","last_active":"2024-09-12T18:14:10.118915+0000","last_peered":"2024-09-12T18:14:10.118915+0000","last_clean":"2024-09-12T18:14:10.118915+0000","last_became_active":"2024-09-12T17:00:16.329596+0000","last_became_peered":"2024-09-12T17:00:16.329596+0000","last_unstale":"2024-09-12T18:14:10.118915+0000","last_undegraded":"2024-09-12T18:14:10.118915+0000","last_fullsized":"2024-09-12T18:14:10.118915+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:10.118740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:10.118740+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.118740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:07.683997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'350","reported_seq":967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.163418+0000","last_change":"2024-09-12T18:14:11.163418+0000","last_active":"2024-09-12T18:14:11.163418+0000","last_peered":"2024-09-12T18:14:11.163418+0000","last_clean":"2024-09-12T18:14:11.163418+0000","last_became_active":"2024-09-12T17:00:18.331483+0000","last_became_peered":"2024-09-12T17:00:18.331483+0000","last_unstale":"2024-09-12T18:14:11.163418+0000","last_undegraded":"2024-09-12T18:14:11.163418+0000","last_fullsized":"2024-09-12T18:14:11.163418+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-12T18:14:11.163297+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-12T18:14:11.163297+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.163297+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:56.385197+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48847,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":573,"num_read_kb":1293,"num_write":456,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'739","reported_seq":4713,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:15.120851+0000","last_change":"2024-09-12T18:14:15.120778+0000","last_active":"2024-09-12T18:14:15.120851+0000","last_peered":"2024-09-12T18:14:15.120851+0000","last_clean":"2024-09-12T18:14:15.120851+0000","last_became_active":"2024-09-12T17:00:20.352022+0000","last_became_peered":"2024-09-12T17:00:20.352022+0000","last_unstale":"2024-09-12T18:14:15.120851+0000","last_undegraded":"2024-09-12T18:14:15.120851+0000","last_fullsized":"2024-09-12T18:14:15.120851+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'739","last_scrub_stamp":"2024-09-12T18:14:15.120687+0000","last_deep_scrub":"264'739","last_deep_scrub_stamp":"2024-09-12T18:14:15.120687+0000","last_clean_scrub_stamp":"2024-09-12T18:14:15.120687+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:39.722836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'85","reported_seq":605,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:20.223190+0000","last_change":"2024-09-12T18:14:20.223190+0000","last_active":"2024-09-12T18:14:20.223190+0000","last_peered":"2024-09-12T18:14:20.223190+0000","last_clean":"2024-09-12T18:14:20.223190+0000","last_became_active":"2024-09-12T17:00:22.350283+0000","last_became_peered":"2024-09-12T17:00:22.350283+0000","last_unstale":"2024-09-12T18:14:20.223190+0000","last_undegraded":"2024-09-12T18:14:20.223190+0000","last_fullsized":"2024-09-12T18:14:20.223190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'85","last_scrub_stamp":"2024-09-12T18:14:20.223082+0000","last_deep_scrub":"264'85","last_deep_scrub_stamp":"2024-09-12T18:14:20.223082+0000","last_clean_scrub_stamp":"2024-09-12T18:14:20.223082+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:54.745956+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":129,"num_read_kb":121,"num_write":196,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'24","reported_seq":578,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.926271+0000","last_change":"2024-09-12T18:14:05.926204+0000","last_active":"2024-09-12T18:14:05.926271+0000","last_peered":"2024-09-12T18:14:05.926271+0000","last_clean":"2024-09-12T18:14:05.926271+0000","last_became_active":"2024-09-12T17:00:14.325788+0000","last_became_peered":"2024-09-12T17:00:14.325788+0000","last_unstale":"2024-09-12T18:14:05.926271+0000","last_undegraded":"2024-09-12T18:14:05.926271+0000","last_fullsized":"2024-09-12T18:14:05.926271+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-09-12T18:14:05.926108+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-09-12T18:14:05.926108+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.926108+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:59.672862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":96,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'334","reported_seq":1039,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.798217+0000","last_change":"2024-09-12T18:13:59.798217+0000","last_active":"2024-09-12T18:13:59.798217+0000","last_peered":"2024-09-12T18:13:59.798217+0000","last_clean":"2024-09-12T18:13:59.798217+0000","last_became_active":"2024-09-12T17:00:12.309388+0000","last_became_peered":"2024-09-12T17:00:12.309388+0000","last_unstale":"2024-09-12T18:13:59.798217+0000","last_undegraded":"2024-09-12T18:13:59.798217+0000","last_fullsized":"2024-09-12T18:13:59.798217+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'334","last_scrub_stamp":"2024-09-12T18:13:59.798123+0000","last_deep_scrub":"264'334","last_deep_scrub_stamp":"2024-09-12T18:13:59.798123+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.798123+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:12.466059+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3573814,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":548,"num_read_kb":20473,"num_write":1106,"num_write_kb":21258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:19.375270+0000","last_change":"2024-09-12T18:14:19.375270+0000","last_active":"2024-09-12T18:14:19.375270+0000","last_peered":"2024-09-12T18:14:19.375270+0000","last_clean":"2024-09-12T18:14:19.375270+0000","last_became_active":"2024-09-12T17:00:16.330035+0000","last_became_peered":"2024-09-12T17:00:16.330035+0000","last_unstale":"2024-09-12T18:14:19.375270+0000","last_undegraded":"2024-09-12T18:14:19.375270+0000","last_fullsized":"2024-09-12T18:14:19.375270+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:14:19.375155+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:14:19.375155+0000","last_clean_scrub_stamp":"2024-09-12T18:14:19.375155+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:02.164761+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'107","reported_seq":651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:21.964109+0000","last_change":"2024-09-12T18:14:21.964031+0000","last_active":"2024-09-12T18:14:21.964109+0000","last_peered":"2024-09-12T18:14:21.964109+0000","last_clean":"2024-09-12T18:14:21.964109+0000","last_became_active":"2024-09-12T17:00:18.429253+0000","last_became_peered":"2024-09-12T17:00:18.429253+0000","last_unstale":"2024-09-12T18:14:21.964109+0000","last_undegraded":"2024-09-12T18:14:21.964109+0000","last_fullsized":"2024-09-12T18:14:21.964109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-09-12T18:14:21.963939+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-09-12T18:14:21.963939+0000","last_clean_scrub_stamp":"2024-09-12T18:14:21.963939+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:34.121435+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'784","reported_seq":2542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:16.232299+0000","last_change":"2024-09-12T18:14:16.232241+0000","last_active":"2024-09-12T18:14:16.232299+0000","last_peered":"2024-09-12T18:14:16.232299+0000","last_clean":"2024-09-12T18:14:16.232299+0000","last_became_active":"2024-09-12T17:00:20.352792+0000","last_became_peered":"2024-09-12T17:00:20.352792+0000","last_unstale":"2024-09-12T18:14:16.232299+0000","last_undegraded":"2024-09-12T18:14:16.232299+0000","last_fullsized":"2024-09-12T18:14:16.232299+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'784","last_scrub_stamp":"2024-09-12T18:14:16.232145+0000","last_deep_scrub":"264'784","last_deep_scrub_stamp":"2024-09-12T18:14:16.232145+0000","last_clean_scrub_stamp":"2024-09-12T18:14:16.232145+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:01.862114+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'112","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:29.870180+0000","last_change":"2024-09-12T18:14:29.870180+0000","last_active":"2024-09-12T18:14:29.870180+0000","last_peered":"2024-09-12T18:14:29.870180+0000","last_clean":"2024-09-12T18:14:29.870180+0000","last_became_active":"2024-09-12T17:00:22.352182+0000","last_became_peered":"2024-09-12T17:00:22.352182+0000","last_unstale":"2024-09-12T18:14:29.870180+0000","last_undegraded":"2024-09-12T18:14:29.870180+0000","last_fullsized":"2024-09-12T18:14:29.870180+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-09-12T18:14:29.870096+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-09-12T18:14:29.870096+0000","last_clean_scrub_stamp":"2024-09-12T18:14:29.870096+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:28.046772+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":119,"num_write":244,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'121","reported_seq":774,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.105357+0000","last_change":"2024-09-12T18:14:06.105357+0000","last_active":"2024-09-12T18:14:06.105357+0000","last_peered":"2024-09-12T18:14:06.105357+0000","last_clean":"2024-09-12T18:14:06.105357+0000","last_became_active":"2024-09-12T17:00:14.329394+0000","last_became_peered":"2024-09-12T17:00:14.329394+0000","last_unstale":"2024-09-12T18:14:06.105357+0000","last_undegraded":"2024-09-12T18:14:06.105357+0000","last_fullsized":"2024-09-12T18:14:06.105357+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'121","last_scrub_stamp":"2024-09-12T18:14:06.105271+0000","last_deep_scrub":"264'121","last_deep_scrub_stamp":"2024-09-12T18:14:06.105271+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.105271+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:06.164775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":562,"num_read_kb":483,"num_write":177,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'420","reported_seq":1118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.979078+0000","last_change":"2024-09-12T18:13:59.979078+0000","last_active":"2024-09-12T18:13:59.979078+0000","last_peered":"2024-09-12T18:13:59.979078+0000","last_clean":"2024-09-12T18:13:59.979078+0000","last_became_active":"2024-09-12T17:00:12.314142+0000","last_became_peered":"2024-09-12T17:00:12.314142+0000","last_unstale":"2024-09-12T18:13:59.979078+0000","last_undegraded":"2024-09-12T18:13:59.979078+0000","last_fullsized":"2024-09-12T18:13:59.979078+0000","mapping_epoch":24,"log_start":"264'400","ondisk_log_start":"264'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'420","last_scrub_stamp":"2024-09-12T18:13:59.978965+0000","last_deep_scrub":"264'420","last_deep_scrub_stamp":"2024-09-12T18:13:59.978965+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.978965+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:13.441168+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306453,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":807,"num_read_kb":14993,"num_write":1145,"num_write_kb":29270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:18.797551+0000","last_change":"2024-09-12T18:14:18.797485+0000","last_active":"2024-09-12T18:14:18.797551+0000","last_peered":"2024-09-12T18:14:18.797551+0000","last_clean":"2024-09-12T18:14:18.797551+0000","last_became_active":"2024-09-12T17:00:16.328306+0000","last_became_peered":"2024-09-12T17:00:16.328306+0000","last_unstale":"2024-09-12T18:14:18.797551+0000","last_undegraded":"2024-09-12T18:14:18.797551+0000","last_fullsized":"2024-09-12T18:14:18.797551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:18.797397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:18.797397+0000","last_clean_scrub_stamp":"2024-09-12T18:14:18.797397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:18.136486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'396","reported_seq":1038,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:25.475237+0000","last_change":"2024-09-12T18:14:25.475175+0000","last_active":"2024-09-12T18:14:25.475237+0000","last_peered":"2024-09-12T18:14:25.475237+0000","last_clean":"2024-09-12T18:14:25.475237+0000","last_became_active":"2024-09-12T17:00:18.328500+0000","last_became_peered":"2024-09-12T17:00:18.328500+0000","last_unstale":"2024-09-12T18:14:25.475237+0000","last_undegraded":"2024-09-12T18:14:25.475237+0000","last_fullsized":"2024-09-12T18:14:25.475237+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'396","last_scrub_stamp":"2024-09-12T18:14:25.475080+0000","last_deep_scrub":"264'396","last_deep_scrub_stamp":"2024-09-12T18:14:25.475080+0000","last_clean_scrub_stamp":"2024-09-12T18:14:25.475080+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:49.731826+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46864,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":620,"num_read_kb":1249,"num_write":480,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:15.221543+0000","last_change":"2024-09-12T18:14:15.221487+0000","last_active":"2024-09-12T18:14:15.221543+0000","last_peered":"2024-09-12T18:14:15.221543+0000","last_clean":"2024-09-12T18:14:15.221543+0000","last_became_active":"2024-09-12T17:00:20.350003+0000","last_became_peered":"2024-09-12T17:00:20.350003+0000","last_unstale":"2024-09-12T18:14:15.221543+0000","last_undegraded":"2024-09-12T18:14:15.221543+0000","last_fullsized":"2024-09-12T18:14:15.221543+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:15.221371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:15.221371+0000","last_clean_scrub_stamp":"2024-09-12T18:14:15.221371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:14.433881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'132","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:21.202488+0000","last_change":"2024-09-12T18:14:21.202488+0000","last_active":"2024-09-12T18:14:21.202488+0000","last_peered":"2024-09-12T18:14:21.202488+0000","last_clean":"2024-09-12T18:14:21.202488+0000","last_became_active":"2024-09-12T17:00:22.354601+0000","last_became_peered":"2024-09-12T17:00:22.354601+0000","last_unstale":"2024-09-12T18:14:21.202488+0000","last_undegraded":"2024-09-12T18:14:21.202488+0000","last_fullsized":"2024-09-12T18:14:21.202488+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'132","last_scrub_stamp":"2024-09-12T18:14:21.202400+0000","last_deep_scrub":"264'132","last_deep_scrub_stamp":"2024-09-12T18:14:21.202400+0000","last_clean_scrub_stamp":"2024-09-12T18:14:21.202400+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:03.285432+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":184,"num_read_kb":175,"num_write":297,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'263","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.038272+0000","last_change":"2024-09-12T18:14:06.038272+0000","last_active":"2024-09-12T18:14:06.038272+0000","last_peered":"2024-09-12T18:14:06.038272+0000","last_clean":"2024-09-12T18:14:06.038272+0000","last_became_active":"2024-09-12T17:00:14.329297+0000","last_became_peered":"2024-09-12T17:00:14.329297+0000","last_unstale":"2024-09-12T18:14:06.038272+0000","last_undegraded":"2024-09-12T18:14:06.038272+0000","last_fullsized":"2024-09-12T18:14:06.038272+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'263","last_scrub_stamp":"2024-09-12T18:14:06.038186+0000","last_deep_scrub":"264'263","last_deep_scrub_stamp":"2024-09-12T18:14:06.038186+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.038186+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:05.593867+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1103,"num_read_kb":898,"num_write":417,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.163457+0000","last_change":"2024-09-12T18:13:58.163398+0000","last_active":"2024-09-12T18:13:58.163457+0000","last_peered":"2024-09-12T18:13:58.163457+0000","last_clean":"2024-09-12T18:13:58.163457+0000","last_became_active":"2024-09-12T16:59:54.636487+0000","last_became_peered":"2024-09-12T16:59:54.636487+0000","last_unstale":"2024-09-12T18:13:58.163457+0000","last_undegraded":"2024-09-12T18:13:58.163457+0000","last_fullsized":"2024-09-12T18:13:58.163457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-12T18:13:58.163290+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-12T18:13:58.163290+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.163290+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:28.159963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":539,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.475103+0000","last_change":"2024-09-12T18:13:58.475103+0000","last_active":"2024-09-12T18:13:58.475103+0000","last_peered":"2024-09-12T18:13:58.475103+0000","last_clean":"2024-09-12T18:13:58.475103+0000","last_became_active":"2024-09-12T17:00:00.669728+0000","last_became_peered":"2024-09-12T17:00:00.669728+0000","last_unstale":"2024-09-12T18:13:58.475103+0000","last_undegraded":"2024-09-12T18:13:58.475103+0000","last_fullsized":"2024-09-12T18:13:58.475103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:13:58.475005+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:13:58.475005+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.475005+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:02.835560+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00058116500000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'384","reported_seq":1079,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.120325+0000","last_change":"2024-09-12T18:13:58.120325+0000","last_active":"2024-09-12T18:13:58.120325+0000","last_peered":"2024-09-12T18:13:58.120325+0000","last_clean":"2024-09-12T18:13:58.120325+0000","last_became_active":"2024-09-12T17:00:46.404905+0000","last_became_peered":"2024-09-12T17:00:46.404905+0000","last_unstale":"2024-09-12T18:13:58.120325+0000","last_undegraded":"2024-09-12T18:13:58.120325+0000","last_fullsized":"2024-09-12T18:13:58.120325+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'384","last_scrub_stamp":"2024-09-12T18:13:58.120248+0000","last_deep_scrub":"264'384","last_deep_scrub_stamp":"2024-09-12T18:13:58.120248+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.120248+0000","objects_scrubbed":7,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:48.874148+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524314,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":662,"num_read_kb":82700,"num_write":1255,"num_write_kb":21344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:16.314317+0000","last_change":"2024-09-12T18:14:16.314317+0000","last_active":"2024-09-12T18:14:16.314317+0000","last_peered":"2024-09-12T18:14:16.314317+0000","last_clean":"2024-09-12T18:14:16.314317+0000","last_became_active":"2024-09-12T17:00:16.321151+0000","last_became_peered":"2024-09-12T17:00:16.321151+0000","last_unstale":"2024-09-12T18:14:16.314317+0000","last_undegraded":"2024-09-12T18:14:16.314317+0000","last_fullsized":"2024-09-12T18:14:16.314317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:16.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:16.314230+0000","last_clean_scrub_stamp":"2024-09-12T18:14:16.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:30.567163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'761","reported_seq":1488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:23.500341+0000","last_change":"2024-09-12T18:14:23.500341+0000","last_active":"2024-09-12T18:14:23.500341+0000","last_peered":"2024-09-12T18:14:23.500341+0000","last_clean":"2024-09-12T18:14:23.500341+0000","last_became_active":"2024-09-12T17:00:18.330037+0000","last_became_peered":"2024-09-12T17:00:18.330037+0000","last_unstale":"2024-09-12T18:14:23.500341+0000","last_undegraded":"2024-09-12T18:14:23.500341+0000","last_fullsized":"2024-09-12T18:14:23.500341+0000","mapping_epoch":30,"log_start":"264'700","ondisk_log_start":"264'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'761","last_scrub_stamp":"2024-09-12T18:14:23.500228+0000","last_deep_scrub":"264'761","last_deep_scrub_stamp":"2024-09-12T18:14:23.500228+0000","last_clean_scrub_stamp":"2024-09-12T18:14:23.500228+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:19.444656+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153681,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1487,"num_read_kb":3466,"num_write":1434,"num_write_kb":1274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106952,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:23.229062+0000","last_change":"2024-09-12T18:14:23.229062+0000","last_active":"2024-09-12T18:14:23.229062+0000","last_peered":"2024-09-12T18:14:23.229062+0000","last_clean":"2024-09-12T18:14:23.229062+0000","last_became_active":"2024-09-12T17:00:20.349363+0000","last_became_peered":"2024-09-12T17:00:20.349363+0000","last_unstale":"2024-09-12T18:14:23.229062+0000","last_undegraded":"2024-09-12T18:14:23.229062+0000","last_fullsized":"2024-09-12T18:14:23.229062+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:23.228974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:23.228974+0000","last_clean_scrub_stamp":"2024-09-12T18:14:23.228974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:43.524040+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'190","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:21.241770+0000","last_change":"2024-09-12T18:14:21.241770+0000","last_active":"2024-09-12T18:14:21.241770+0000","last_peered":"2024-09-12T18:14:21.241770+0000","last_clean":"2024-09-12T18:14:21.241770+0000","last_became_active":"2024-09-12T17:00:22.354654+0000","last_became_peered":"2024-09-12T17:00:22.354654+0000","last_unstale":"2024-09-12T18:14:21.241770+0000","last_undegraded":"2024-09-12T18:14:21.241770+0000","last_fullsized":"2024-09-12T18:14:21.241770+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-09-12T18:14:21.241675+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-09-12T18:14:21.241675+0000","last_clean_scrub_stamp":"2024-09-12T18:14:21.241675+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:19.848903+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":450,"num_read_kb":449,"num_write":373,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'132","reported_seq":751,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.085111+0000","last_change":"2024-09-12T18:14:05.085111+0000","last_active":"2024-09-12T18:14:05.085111+0000","last_peered":"2024-09-12T18:14:05.085111+0000","last_clean":"2024-09-12T18:14:05.085111+0000","last_became_active":"2024-09-12T17:00:14.319539+0000","last_became_peered":"2024-09-12T17:00:14.319539+0000","last_unstale":"2024-09-12T18:14:05.085111+0000","last_undegraded":"2024-09-12T18:14:05.085111+0000","last_fullsized":"2024-09-12T18:14:05.085111+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'132","last_scrub_stamp":"2024-09-12T18:14:05.085020+0000","last_deep_scrub":"264'132","last_deep_scrub_stamp":"2024-09-12T18:14:05.085020+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.085020+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:53.322244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":596,"num_read_kb":500,"num_write":197,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":534,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.182307+0000","last_change":"2024-09-12T18:13:59.182258+0000","last_active":"2024-09-12T18:13:59.182307+0000","last_peered":"2024-09-12T18:13:59.182307+0000","last_clean":"2024-09-12T18:13:59.182307+0000","last_became_active":"2024-09-12T17:00:00.671211+0000","last_became_peered":"2024-09-12T17:00:00.671211+0000","last_unstale":"2024-09-12T18:13:59.182307+0000","last_undegraded":"2024-09-12T18:13:59.182307+0000","last_fullsized":"2024-09-12T18:13:59.182307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:59.182180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:59.182180+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.182180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:05.491469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000441562,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'332","reported_seq":1024,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.150556+0000","last_change":"2024-09-12T18:13:58.150556+0000","last_active":"2024-09-12T18:13:58.150556+0000","last_peered":"2024-09-12T18:13:58.150556+0000","last_clean":"2024-09-12T18:13:58.150556+0000","last_became_active":"2024-09-12T17:00:12.306408+0000","last_became_peered":"2024-09-12T17:00:12.306408+0000","last_unstale":"2024-09-12T18:13:58.150556+0000","last_undegraded":"2024-09-12T18:13:58.150556+0000","last_fullsized":"2024-09-12T18:13:58.150556+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-12T18:13:58.150468+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-12T18:13:58.150468+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.150468+0000","objects_scrubbed":9,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:01.376992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1499227,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":518,"num_read_kb":8959,"num_write":977,"num_write_kb":13821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:18.418807+0000","last_change":"2024-09-12T18:14:18.418807+0000","last_active":"2024-09-12T18:14:18.418807+0000","last_peered":"2024-09-12T18:14:18.418807+0000","last_clean":"2024-09-12T18:14:18.418807+0000","last_became_active":"2024-09-12T17:00:16.325914+0000","last_became_peered":"2024-09-12T17:00:16.325914+0000","last_unstale":"2024-09-12T18:14:18.418807+0000","last_undegraded":"2024-09-12T18:14:18.418807+0000","last_fullsized":"2024-09-12T18:14:18.418807+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:18.418708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:18.418708+0000","last_clean_scrub_stamp":"2024-09-12T18:14:18.418708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:50.212483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1365","reported_seq":3212,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.182612+0000","last_change":"2024-09-12T18:14:13.182612+0000","last_active":"2024-09-12T18:14:13.182612+0000","last_peered":"2024-09-12T18:14:13.182612+0000","last_clean":"2024-09-12T18:14:13.182612+0000","last_became_active":"2024-09-12T17:00:18.330715+0000","last_became_peered":"2024-09-12T17:00:18.330715+0000","last_unstale":"2024-09-12T18:14:13.182612+0000","last_undegraded":"2024-09-12T18:14:13.182612+0000","last_fullsized":"2024-09-12T18:14:13.182612+0000","mapping_epoch":30,"log_start":"264'1300","ondisk_log_start":"264'1300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1365","last_scrub_stamp":"2024-09-12T18:14:13.182494+0000","last_deep_scrub":"264'1365","last_deep_scrub_stamp":"2024-09-12T18:14:13.182494+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.182494+0000","objects_scrubbed":11,"log_size":65,"log_dups_size":1300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:53.314146+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154155,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2179,"num_read_kb":4259,"num_write":1270,"num_write_kb":1078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:25.510127+0000","last_change":"2024-09-12T18:14:25.510127+0000","last_active":"2024-09-12T18:14:25.510127+0000","last_peered":"2024-09-12T18:14:25.510127+0000","last_clean":"2024-09-12T18:14:25.510127+0000","last_became_active":"2024-09-12T17:00:20.352287+0000","last_became_peered":"2024-09-12T17:00:20.352287+0000","last_unstale":"2024-09-12T18:14:25.510127+0000","last_undegraded":"2024-09-12T18:14:25.510127+0000","last_fullsized":"2024-09-12T18:14:25.510127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:25.510040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:25.510040+0000","last_clean_scrub_stamp":"2024-09-12T18:14:25.510040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:10.632047+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'97","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:23.206434+0000","last_change":"2024-09-12T18:14:23.206434+0000","last_active":"2024-09-12T18:14:23.206434+0000","last_peered":"2024-09-12T18:14:23.206434+0000","last_clean":"2024-09-12T18:14:23.206434+0000","last_became_active":"2024-09-12T17:00:22.587206+0000","last_became_peered":"2024-09-12T17:00:22.587206+0000","last_unstale":"2024-09-12T18:14:23.206434+0000","last_undegraded":"2024-09-12T18:14:23.206434+0000","last_fullsized":"2024-09-12T18:14:23.206434+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'97","last_scrub_stamp":"2024-09-12T18:14:23.206343+0000","last_deep_scrub":"264'97","last_deep_scrub_stamp":"2024-09-12T18:14:23.206343+0000","last_clean_scrub_stamp":"2024-09-12T18:14:23.206343+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:31.456728+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":151,"num_write":236,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'4068","reported_seq":4661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.108609+0000","last_change":"2024-09-12T18:14:05.108609+0000","last_active":"2024-09-12T18:14:05.108609+0000","last_peered":"2024-09-12T18:14:05.108609+0000","last_clean":"2024-09-12T18:14:05.108609+0000","last_became_active":"2024-09-12T17:00:14.331560+0000","last_became_peered":"2024-09-12T17:00:14.331560+0000","last_unstale":"2024-09-12T18:14:05.108609+0000","last_undegraded":"2024-09-12T18:14:05.108609+0000","last_fullsized":"2024-09-12T18:14:05.108609+0000","mapping_epoch":26,"log_start":"264'4000","ondisk_log_start":"264'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4068","last_scrub_stamp":"2024-09-12T18:14:05.108524+0000","last_deep_scrub":"264'4068","last_deep_scrub_stamp":"2024-09-12T18:14:05.108524+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.108524+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":3000,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:03.977064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16331,"num_read_kb":13702,"num_write":6093,"num_write_kb":3038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":537,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:56.176811+0000","last_change":"2024-09-12T18:13:56.176811+0000","last_active":"2024-09-12T18:13:56.176811+0000","last_peered":"2024-09-12T18:13:56.176811+0000","last_clean":"2024-09-12T18:13:56.176811+0000","last_became_active":"2024-09-12T17:00:01.173083+0000","last_became_peered":"2024-09-12T17:00:01.173083+0000","last_unstale":"2024-09-12T18:13:56.176811+0000","last_undegraded":"2024-09-12T18:13:56.176811+0000","last_fullsized":"2024-09-12T18:13:56.176811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:56.176741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:56.176741+0000","last_clean_scrub_stamp":"2024-09-12T18:13:56.176741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:36.851800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056135799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'326","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:57.001242+0000","last_change":"2024-09-12T18:13:57.001192+0000","last_active":"2024-09-12T18:13:57.001242+0000","last_peered":"2024-09-12T18:13:57.001242+0000","last_clean":"2024-09-12T18:13:57.001242+0000","last_became_active":"2024-09-12T17:00:12.309100+0000","last_became_peered":"2024-09-12T17:00:12.309100+0000","last_unstale":"2024-09-12T18:13:57.001242+0000","last_undegraded":"2024-09-12T18:13:57.001242+0000","last_fullsized":"2024-09-12T18:13:57.001242+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-12T18:13:57.001116+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-12T18:13:57.001116+0000","last_clean_scrub_stamp":"2024-09-12T18:13:57.001116+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:44.466787+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655862,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":481,"num_read_kb":31712,"num_write":1051,"num_write_kb":22323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.116004+0000","last_change":"2024-09-12T18:14:04.116004+0000","last_active":"2024-09-12T18:14:04.116004+0000","last_peered":"2024-09-12T18:14:04.116004+0000","last_clean":"2024-09-12T18:14:04.116004+0000","last_became_active":"2024-09-12T17:00:16.324792+0000","last_became_peered":"2024-09-12T17:00:16.324792+0000","last_unstale":"2024-09-12T18:14:04.116004+0000","last_undegraded":"2024-09-12T18:14:04.116004+0000","last_fullsized":"2024-09-12T18:14:04.116004+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:04.115917+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:04.115917+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.115917+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:04.636526+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'299","reported_seq":1740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:19.441642+0000","last_change":"2024-09-12T18:14:19.441642+0000","last_active":"2024-09-12T18:14:19.441642+0000","last_peered":"2024-09-12T18:14:19.441642+0000","last_clean":"2024-09-12T18:14:19.441642+0000","last_became_active":"2024-09-12T17:00:18.429997+0000","last_became_peered":"2024-09-12T17:00:18.429997+0000","last_unstale":"2024-09-12T18:14:19.441642+0000","last_undegraded":"2024-09-12T18:14:19.441642+0000","last_fullsized":"2024-09-12T18:14:19.441642+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'299","last_scrub_stamp":"2024-09-12T18:14:19.441455+0000","last_deep_scrub":"264'299","last_deep_scrub_stamp":"2024-09-12T18:14:19.441455+0000","last_clean_scrub_stamp":"2024-09-12T18:14:19.441455+0000","objects_scrubbed":9,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:24.826400+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":262,"num_read_kb":252,"num_write":239,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:22.266431+0000","last_change":"2024-09-12T18:14:22.266431+0000","last_active":"2024-09-12T18:14:22.266431+0000","last_peered":"2024-09-12T18:14:22.266431+0000","last_clean":"2024-09-12T18:14:22.266431+0000","last_became_active":"2024-09-12T17:00:20.350197+0000","last_became_peered":"2024-09-12T17:00:20.350197+0000","last_unstale":"2024-09-12T18:14:22.266431+0000","last_undegraded":"2024-09-12T18:14:22.266431+0000","last_fullsized":"2024-09-12T18:14:22.266431+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:22.266345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:22.266345+0000","last_clean_scrub_stamp":"2024-09-12T18:14:22.266345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:16.231319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'277","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:32.850418+0000","last_change":"2024-09-12T18:14:32.850348+0000","last_active":"2024-09-12T18:14:32.850418+0000","last_peered":"2024-09-12T18:14:32.850418+0000","last_clean":"2024-09-12T18:14:32.850418+0000","last_became_active":"2024-09-12T17:00:22.357583+0000","last_became_peered":"2024-09-12T17:00:22.357583+0000","last_unstale":"2024-09-12T18:14:32.850418+0000","last_undegraded":"2024-09-12T18:14:32.850418+0000","last_fullsized":"2024-09-12T18:14:32.850418+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'277","last_scrub_stamp":"2024-09-12T18:14:32.850262+0000","last_deep_scrub":"264'277","last_deep_scrub_stamp":"2024-09-12T18:14:32.850262+0000","last_clean_scrub_stamp":"2024-09-12T18:14:32.850262+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:29.426297+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":565,"num_read_kb":582,"num_write":607,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'184","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.051253+0000","last_change":"2024-09-12T18:14:03.051253+0000","last_active":"2024-09-12T18:14:03.051253+0000","last_peered":"2024-09-12T18:14:03.051253+0000","last_clean":"2024-09-12T18:14:03.051253+0000","last_became_active":"2024-09-12T17:00:14.324830+0000","last_became_peered":"2024-09-12T17:00:14.324830+0000","last_unstale":"2024-09-12T18:14:03.051253+0000","last_undegraded":"2024-09-12T18:14:03.051253+0000","last_fullsized":"2024-09-12T18:14:03.051253+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'184","last_scrub_stamp":"2024-09-12T18:14:03.051167+0000","last_deep_scrub":"264'184","last_deep_scrub_stamp":"2024-09-12T18:14:03.051167+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.051167+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:33.058051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":771,"num_read_kb":626,"num_write":320,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":540,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:57.445513+0000","last_change":"2024-09-12T18:13:57.445513+0000","last_active":"2024-09-12T18:13:57.445513+0000","last_peered":"2024-09-12T18:13:57.445513+0000","last_clean":"2024-09-12T18:13:57.445513+0000","last_became_active":"2024-09-12T17:00:00.668696+0000","last_became_peered":"2024-09-12T17:00:00.668696+0000","last_unstale":"2024-09-12T18:13:57.445513+0000","last_undegraded":"2024-09-12T18:13:57.445513+0000","last_fullsized":"2024-09-12T18:13:57.445513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:13:57.445431+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:13:57.445431+0000","last_clean_scrub_stamp":"2024-09-12T18:13:57.445431+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:24.702957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0012259720000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'362","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:56.795679+0000","last_change":"2024-09-12T18:13:56.795679+0000","last_active":"2024-09-12T18:13:56.795679+0000","last_peered":"2024-09-12T18:13:56.795679+0000","last_clean":"2024-09-12T18:13:56.795679+0000","last_became_active":"2024-09-12T17:00:12.315813+0000","last_became_peered":"2024-09-12T17:00:12.315813+0000","last_unstale":"2024-09-12T18:13:56.795679+0000","last_undegraded":"2024-09-12T18:13:56.795679+0000","last_fullsized":"2024-09-12T18:13:56.795679+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'362","last_scrub_stamp":"2024-09-12T18:13:56.795572+0000","last_deep_scrub":"264'362","last_deep_scrub_stamp":"2024-09-12T18:13:56.795572+0000","last_clean_scrub_stamp":"2024-09-12T18:13:56.795572+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:52:27.168227+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":472,"num_read_kb":35449,"num_write":1073,"num_write_kb":30387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:15.228724+0000","last_change":"2024-09-12T18:14:15.228724+0000","last_active":"2024-09-12T18:14:15.228724+0000","last_peered":"2024-09-12T18:14:15.228724+0000","last_clean":"2024-09-12T18:14:15.228724+0000","last_became_active":"2024-09-12T17:00:16.324683+0000","last_became_peered":"2024-09-12T17:00:16.324683+0000","last_unstale":"2024-09-12T18:14:15.228724+0000","last_undegraded":"2024-09-12T18:14:15.228724+0000","last_fullsized":"2024-09-12T18:14:15.228724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:15.228628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:15.228628+0000","last_clean_scrub_stamp":"2024-09-12T18:14:15.228628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:17.787871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'164","reported_seq":733,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:20.962483+0000","last_change":"2024-09-12T18:14:20.962483+0000","last_active":"2024-09-12T18:14:20.962483+0000","last_peered":"2024-09-12T18:14:20.962483+0000","last_clean":"2024-09-12T18:14:20.962483+0000","last_became_active":"2024-09-12T17:00:18.327205+0000","last_became_peered":"2024-09-12T17:00:18.327205+0000","last_unstale":"2024-09-12T18:14:20.962483+0000","last_undegraded":"2024-09-12T18:14:20.962483+0000","last_fullsized":"2024-09-12T18:14:20.962483+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'164","last_scrub_stamp":"2024-09-12T18:14:20.962389+0000","last_deep_scrub":"264'164","last_deep_scrub_stamp":"2024-09-12T18:14:20.962389+0000","last_clean_scrub_stamp":"2024-09-12T18:14:20.962389+0000","objects_scrubbed":7,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:39.507861+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":197,"num_read_kb":191,"num_write":142,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:14.202546+0000","last_change":"2024-09-12T18:14:14.202546+0000","last_active":"2024-09-12T18:14:14.202546+0000","last_peered":"2024-09-12T18:14:14.202546+0000","last_clean":"2024-09-12T18:14:14.202546+0000","last_became_active":"2024-09-12T17:00:20.356122+0000","last_became_peered":"2024-09-12T17:00:20.356122+0000","last_unstale":"2024-09-12T18:14:14.202546+0000","last_undegraded":"2024-09-12T18:14:14.202546+0000","last_fullsized":"2024-09-12T18:14:14.202546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:14.202464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:14.202464+0000","last_clean_scrub_stamp":"2024-09-12T18:14:14.202464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:50.205142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'120","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:29.475382+0000","last_change":"2024-09-12T18:14:29.475382+0000","last_active":"2024-09-12T18:14:29.475382+0000","last_peered":"2024-09-12T18:14:29.475382+0000","last_clean":"2024-09-12T18:14:29.475382+0000","last_became_active":"2024-09-12T17:00:22.358888+0000","last_became_peered":"2024-09-12T17:00:22.358888+0000","last_unstale":"2024-09-12T18:14:29.475382+0000","last_undegraded":"2024-09-12T18:14:29.475382+0000","last_fullsized":"2024-09-12T18:14:29.475382+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-09-12T18:14:29.475292+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-09-12T18:14:29.475292+0000","last_clean_scrub_stamp":"2024-09-12T18:14:29.475292+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:54.381227+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":246,"num_write":283,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'172","reported_seq":812,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.091204+0000","last_change":"2024-09-12T18:14:04.091204+0000","last_active":"2024-09-12T18:14:04.091204+0000","last_peered":"2024-09-12T18:14:04.091204+0000","last_clean":"2024-09-12T18:14:04.091204+0000","last_became_active":"2024-09-12T17:00:14.330844+0000","last_became_peered":"2024-09-12T17:00:14.330844+0000","last_unstale":"2024-09-12T18:14:04.091204+0000","last_undegraded":"2024-09-12T18:14:04.091204+0000","last_fullsized":"2024-09-12T18:14:04.091204+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'172","last_scrub_stamp":"2024-09-12T18:14:04.091118+0000","last_deep_scrub":"264'172","last_deep_scrub_stamp":"2024-09-12T18:14:04.091118+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.091118+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:28.552302+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":795,"num_read_kb":654,"num_write":268,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'407","reported_seq":1095,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.459613+0000","last_change":"2024-09-12T18:13:59.459613+0000","last_active":"2024-09-12T18:13:59.459613+0000","last_peered":"2024-09-12T18:13:59.459613+0000","last_clean":"2024-09-12T18:13:59.459613+0000","last_became_active":"2024-09-12T17:00:12.318621+0000","last_became_peered":"2024-09-12T17:00:12.318621+0000","last_unstale":"2024-09-12T18:13:59.459613+0000","last_undegraded":"2024-09-12T18:13:59.459613+0000","last_fullsized":"2024-09-12T18:13:59.459613+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'407","last_scrub_stamp":"2024-09-12T18:13:59.459505+0000","last_deep_scrub":"264'407","last_deep_scrub_stamp":"2024-09-12T18:13:59.459505+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.459505+0000","objects_scrubbed":9,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:47.655177+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":592,"num_read_kb":4542,"num_write":1332,"num_write_kb":25874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:55.019040+0000","last_change":"2024-09-12T18:13:55.019040+0000","last_active":"2024-09-12T18:13:55.019040+0000","last_peered":"2024-09-12T18:13:55.019040+0000","last_clean":"2024-09-12T18:13:55.019040+0000","last_became_active":"2024-09-12T17:00:00.667379+0000","last_became_peered":"2024-09-12T17:00:00.667379+0000","last_unstale":"2024-09-12T18:13:55.019040+0000","last_undegraded":"2024-09-12T18:13:55.019040+0000","last_fullsized":"2024-09-12T18:13:55.019040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:55.018974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:55.018974+0000","last_clean_scrub_stamp":"2024-09-12T18:13:55.018974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:11.110303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056755300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:14.189720+0000","last_change":"2024-09-12T18:14:14.189720+0000","last_active":"2024-09-12T18:14:14.189720+0000","last_peered":"2024-09-12T18:14:14.189720+0000","last_clean":"2024-09-12T18:14:14.189720+0000","last_became_active":"2024-09-12T17:00:16.322854+0000","last_became_peered":"2024-09-12T17:00:16.322854+0000","last_unstale":"2024-09-12T18:14:14.189720+0000","last_undegraded":"2024-09-12T18:14:14.189720+0000","last_fullsized":"2024-09-12T18:14:14.189720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:14.189619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:14.189619+0000","last_clean_scrub_stamp":"2024-09-12T18:14:14.189619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:20.726776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'672","reported_seq":1381,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.229453+0000","last_change":"2024-09-12T18:14:17.229453+0000","last_active":"2024-09-12T18:14:17.229453+0000","last_peered":"2024-09-12T18:14:17.229453+0000","last_clean":"2024-09-12T18:14:17.229453+0000","last_became_active":"2024-09-12T17:00:18.333147+0000","last_became_peered":"2024-09-12T17:00:18.333147+0000","last_unstale":"2024-09-12T18:14:17.229453+0000","last_undegraded":"2024-09-12T18:14:17.229453+0000","last_fullsized":"2024-09-12T18:14:17.229453+0000","mapping_epoch":30,"log_start":"264'600","ondisk_log_start":"264'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'672","last_scrub_stamp":"2024-09-12T18:14:17.229332+0000","last_deep_scrub":"264'672","last_deep_scrub_stamp":"2024-09-12T18:14:17.229332+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.229332+0000","objects_scrubbed":10,"log_size":72,"log_dups_size":600,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:36.017250+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95805,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1770,"num_read_kb":3099,"num_write":2318,"num_write_kb":2109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":508234,"num_omap_keys":1154,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:26.825540+0000","last_change":"2024-09-12T18:14:26.825540+0000","last_active":"2024-09-12T18:14:26.825540+0000","last_peered":"2024-09-12T18:14:26.825540+0000","last_clean":"2024-09-12T18:14:26.825540+0000","last_became_active":"2024-09-12T17:00:20.354771+0000","last_became_peered":"2024-09-12T17:00:20.354771+0000","last_unstale":"2024-09-12T18:14:26.825540+0000","last_undegraded":"2024-09-12T18:14:26.825540+0000","last_fullsized":"2024-09-12T18:14:26.825540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:26.825453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:26.825453+0000","last_clean_scrub_stamp":"2024-09-12T18:14:26.825453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:49.316587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'223","reported_seq":755,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:30.227091+0000","last_change":"2024-09-12T18:14:30.227029+0000","last_active":"2024-09-12T18:14:30.227091+0000","last_peered":"2024-09-12T18:14:30.227091+0000","last_clean":"2024-09-12T18:14:30.227091+0000","last_became_active":"2024-09-12T17:00:22.588561+0000","last_became_peered":"2024-09-12T17:00:22.588561+0000","last_unstale":"2024-09-12T18:14:30.227091+0000","last_undegraded":"2024-09-12T18:14:30.227091+0000","last_fullsized":"2024-09-12T18:14:30.227091+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'223","last_scrub_stamp":"2024-09-12T18:14:30.226917+0000","last_deep_scrub":"264'223","last_deep_scrub_stamp":"2024-09-12T18:14:30.226917+0000","last_clean_scrub_stamp":"2024-09-12T18:14:30.226917+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:05.358685+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":223,"num_read_kb":213,"num_write":499,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'180","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.112249+0000","last_change":"2024-09-12T18:14:06.112249+0000","last_active":"2024-09-12T18:14:06.112249+0000","last_peered":"2024-09-12T18:14:06.112249+0000","last_clean":"2024-09-12T18:14:06.112249+0000","last_became_active":"2024-09-12T17:00:14.327268+0000","last_became_peered":"2024-09-12T17:00:14.327268+0000","last_unstale":"2024-09-12T18:14:06.112249+0000","last_undegraded":"2024-09-12T18:14:06.112249+0000","last_fullsized":"2024-09-12T18:14:06.112249+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'180","last_scrub_stamp":"2024-09-12T18:14:06.112165+0000","last_deep_scrub":"264'180","last_deep_scrub_stamp":"2024-09-12T18:14:06.112165+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.112165+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:05.334938+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":852,"num_read_kb":727,"num_write":266,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'349","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.024128+0000","last_change":"2024-09-12T18:13:58.024128+0000","last_active":"2024-09-12T18:13:58.024128+0000","last_peered":"2024-09-12T18:13:58.024128+0000","last_clean":"2024-09-12T18:13:58.024128+0000","last_became_active":"2024-09-12T17:00:12.309896+0000","last_became_peered":"2024-09-12T17:00:12.309896+0000","last_unstale":"2024-09-12T18:13:58.024128+0000","last_undegraded":"2024-09-12T18:13:58.024128+0000","last_fullsized":"2024-09-12T18:13:58.024128+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'349","last_scrub_stamp":"2024-09-12T18:13:58.024056+0000","last_deep_scrub":"264'349","last_deep_scrub_stamp":"2024-09-12T18:13:58.024056+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.024056+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:20.085472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":595,"num_read_kb":32728,"num_write":1244,"num_write_kb":26986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":532,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.217713+0000","last_change":"2024-09-12T18:14:03.217713+0000","last_active":"2024-09-12T18:14:03.217713+0000","last_peered":"2024-09-12T18:14:03.217713+0000","last_clean":"2024-09-12T18:14:03.217713+0000","last_became_active":"2024-09-12T17:00:00.670355+0000","last_became_peered":"2024-09-12T17:00:00.670355+0000","last_unstale":"2024-09-12T18:14:03.217713+0000","last_undegraded":"2024-09-12T18:14:03.217713+0000","last_fullsized":"2024-09-12T18:14:03.217713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:03.217597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:03.217597+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.217597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:02.459061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042464500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.141505+0000","last_change":"2024-09-12T18:14:11.141505+0000","last_active":"2024-09-12T18:14:11.141505+0000","last_peered":"2024-09-12T18:14:11.141505+0000","last_clean":"2024-09-12T18:14:11.141505+0000","last_became_active":"2024-09-12T17:00:16.323157+0000","last_became_peered":"2024-09-12T17:00:16.323157+0000","last_unstale":"2024-09-12T18:14:11.141505+0000","last_undegraded":"2024-09-12T18:14:11.141505+0000","last_fullsized":"2024-09-12T18:14:11.141505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:11.141420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:11.141420+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.141420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:34.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'221","reported_seq":824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:18.286377+0000","last_change":"2024-09-12T18:14:18.286377+0000","last_active":"2024-09-12T18:14:18.286377+0000","last_peered":"2024-09-12T18:14:18.286377+0000","last_clean":"2024-09-12T18:14:18.286377+0000","last_became_active":"2024-09-12T17:00:18.428978+0000","last_became_peered":"2024-09-12T17:00:18.428978+0000","last_unstale":"2024-09-12T18:14:18.286377+0000","last_undegraded":"2024-09-12T18:14:18.286377+0000","last_fullsized":"2024-09-12T18:14:18.286377+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'221","last_scrub_stamp":"2024-09-12T18:14:18.286284+0000","last_deep_scrub":"264'221","last_deep_scrub_stamp":"2024-09-12T18:14:18.286284+0000","last_clean_scrub_stamp":"2024-09-12T18:14:18.286284+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:23.180371+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":266,"num_read_kb":257,"num_write":182,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'774","reported_seq":2999,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:27.420218+0000","last_change":"2024-09-12T18:14:27.420147+0000","last_active":"2024-09-12T18:14:27.420218+0000","last_peered":"2024-09-12T18:14:27.420218+0000","last_clean":"2024-09-12T18:14:27.420218+0000","last_became_active":"2024-09-12T17:00:20.345236+0000","last_became_peered":"2024-09-12T17:00:20.345236+0000","last_unstale":"2024-09-12T18:14:27.420218+0000","last_undegraded":"2024-09-12T18:14:27.420218+0000","last_fullsized":"2024-09-12T18:14:27.420218+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'774","last_scrub_stamp":"2024-09-12T18:14:27.420059+0000","last_deep_scrub":"264'774","last_deep_scrub_stamp":"2024-09-12T18:14:27.420059+0000","last_clean_scrub_stamp":"2024-09-12T18:14:27.420059+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:29.706528+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'116","reported_seq":647,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:33.848671+0000","last_change":"2024-09-12T18:14:33.848671+0000","last_active":"2024-09-12T18:14:33.848671+0000","last_peered":"2024-09-12T18:14:33.848671+0000","last_clean":"2024-09-12T18:14:33.848671+0000","last_became_active":"2024-09-12T17:00:22.587443+0000","last_became_peered":"2024-09-12T17:00:22.587443+0000","last_unstale":"2024-09-12T18:14:33.848671+0000","last_undegraded":"2024-09-12T18:14:33.848671+0000","last_fullsized":"2024-09-12T18:14:33.848671+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'116","last_scrub_stamp":"2024-09-12T18:14:33.848579+0000","last_deep_scrub":"264'116","last_deep_scrub_stamp":"2024-09-12T18:14:33.848579+0000","last_clean_scrub_stamp":"2024-09-12T18:14:33.848579+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:41.972139+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":705,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":239,"num_read_kb":213,"num_write":277,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'317","reported_seq":980,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.992329+0000","last_change":"2024-09-12T18:14:13.992204+0000","last_active":"2024-09-12T18:14:13.992329+0000","last_peered":"2024-09-12T18:14:13.992329+0000","last_clean":"2024-09-12T18:14:13.992329+0000","last_became_active":"2024-09-12T17:00:14.333128+0000","last_became_peered":"2024-09-12T17:00:14.333128+0000","last_unstale":"2024-09-12T18:14:13.992329+0000","last_undegraded":"2024-09-12T18:14:13.992329+0000","last_fullsized":"2024-09-12T18:14:13.992329+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'317","last_scrub_stamp":"2024-09-12T18:14:13.992099+0000","last_deep_scrub":"264'317","last_deep_scrub_stamp":"2024-09-12T18:14:13.992099+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.992099+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:18.628811+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1338,"num_read_kb":1083,"num_write":472,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'372","reported_seq":1036,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:55.895288+0000","last_change":"2024-09-12T18:13:55.895288+0000","last_active":"2024-09-12T18:13:55.895288+0000","last_peered":"2024-09-12T18:13:55.895288+0000","last_clean":"2024-09-12T18:13:55.895288+0000","last_became_active":"2024-09-12T17:00:12.315812+0000","last_became_peered":"2024-09-12T17:00:12.315812+0000","last_unstale":"2024-09-12T18:13:55.895288+0000","last_undegraded":"2024-09-12T18:13:55.895288+0000","last_fullsized":"2024-09-12T18:13:55.895288+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-12T18:13:55.895167+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-12T18:13:55.895167+0000","last_clean_scrub_stamp":"2024-09-12T18:13:55.895167+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:05.686531+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1826072,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":562,"num_read_kb":23161,"num_write":1132,"num_write_kb":14173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":541,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:56.006554+0000","last_change":"2024-09-12T18:13:56.006554+0000","last_active":"2024-09-12T18:13:56.006554+0000","last_peered":"2024-09-12T18:13:56.006554+0000","last_clean":"2024-09-12T18:13:56.006554+0000","last_became_active":"2024-09-12T17:00:00.669898+0000","last_became_peered":"2024-09-12T17:00:00.669898+0000","last_unstale":"2024-09-12T18:13:56.006554+0000","last_undegraded":"2024-09-12T18:13:56.006554+0000","last_fullsized":"2024-09-12T18:13:56.006554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:56.006481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:56.006481+0000","last_clean_scrub_stamp":"2024-09-12T18:13:56.006481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:45.117992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060387199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:16.803917+0000","last_change":"2024-09-12T18:14:16.803917+0000","last_active":"2024-09-12T18:14:16.803917+0000","last_peered":"2024-09-12T18:14:16.803917+0000","last_clean":"2024-09-12T18:14:16.803917+0000","last_became_active":"2024-09-12T17:00:16.327270+0000","last_became_peered":"2024-09-12T17:00:16.327270+0000","last_unstale":"2024-09-12T18:14:16.803917+0000","last_undegraded":"2024-09-12T18:14:16.803917+0000","last_fullsized":"2024-09-12T18:14:16.803917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:16.803829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:16.803829+0000","last_clean_scrub_stamp":"2024-09-12T18:14:16.803829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:52.947001+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'134","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:22.888626+0000","last_change":"2024-09-12T18:14:22.888626+0000","last_active":"2024-09-12T18:14:22.888626+0000","last_peered":"2024-09-12T18:14:22.888626+0000","last_clean":"2024-09-12T18:14:22.888626+0000","last_became_active":"2024-09-12T17:00:18.327994+0000","last_became_peered":"2024-09-12T17:00:18.327994+0000","last_unstale":"2024-09-12T18:14:22.888626+0000","last_undegraded":"2024-09-12T18:14:22.888626+0000","last_fullsized":"2024-09-12T18:14:22.888626+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'134","last_scrub_stamp":"2024-09-12T18:14:22.888539+0000","last_deep_scrub":"264'134","last_deep_scrub_stamp":"2024-09-12T18:14:22.888539+0000","last_clean_scrub_stamp":"2024-09-12T18:14:22.888539+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:47.733685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":161,"num_write":110,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'776","reported_seq":2846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:27.816004+0000","last_change":"2024-09-12T18:14:27.816004+0000","last_active":"2024-09-12T18:14:27.816004+0000","last_peered":"2024-09-12T18:14:27.816004+0000","last_clean":"2024-09-12T18:14:27.816004+0000","last_became_active":"2024-09-12T17:00:20.354519+0000","last_became_peered":"2024-09-12T17:00:20.354519+0000","last_unstale":"2024-09-12T18:14:27.816004+0000","last_undegraded":"2024-09-12T18:14:27.816004+0000","last_fullsized":"2024-09-12T18:14:27.816004+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'776","last_scrub_stamp":"2024-09-12T18:14:27.815915+0000","last_deep_scrub":"264'776","last_deep_scrub_stamp":"2024-09-12T18:14:27.815915+0000","last_clean_scrub_stamp":"2024-09-12T18:14:27.815915+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:28.199095+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'288","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:29.268163+0000","last_change":"2024-09-12T18:14:29.268109+0000","last_active":"2024-09-12T18:14:29.268163+0000","last_peered":"2024-09-12T18:14:29.268163+0000","last_clean":"2024-09-12T18:14:29.268163+0000","last_became_active":"2024-09-12T17:00:22.356132+0000","last_became_peered":"2024-09-12T17:00:22.356132+0000","last_unstale":"2024-09-12T18:14:29.268163+0000","last_undegraded":"2024-09-12T18:14:29.268163+0000","last_fullsized":"2024-09-12T18:14:29.268163+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'288","last_scrub_stamp":"2024-09-12T18:14:29.268013+0000","last_deep_scrub":"264'288","last_deep_scrub_stamp":"2024-09-12T18:14:29.268013+0000","last_clean_scrub_stamp":"2024-09-12T18:14:29.268013+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:42.537942+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":378,"num_read_kb":377,"num_write":631,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'145","reported_seq":770,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.854434+0000","last_change":"2024-09-12T18:14:01.854434+0000","last_active":"2024-09-12T18:14:01.854434+0000","last_peered":"2024-09-12T18:14:01.854434+0000","last_clean":"2024-09-12T18:14:01.854434+0000","last_became_active":"2024-09-12T17:00:14.330433+0000","last_became_peered":"2024-09-12T17:00:14.330433+0000","last_unstale":"2024-09-12T18:14:01.854434+0000","last_undegraded":"2024-09-12T18:14:01.854434+0000","last_fullsized":"2024-09-12T18:14:01.854434+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'145","last_scrub_stamp":"2024-09-12T18:14:01.854354+0000","last_deep_scrub":"264'145","last_deep_scrub_stamp":"2024-09-12T18:14:01.854354+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.854354+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:27.445208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":651,"num_read_kb":539,"num_write":208,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'378","reported_seq":1154,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:57.123146+0000","last_change":"2024-09-12T18:13:57.123146+0000","last_active":"2024-09-12T18:13:57.123146+0000","last_peered":"2024-09-12T18:13:57.123146+0000","last_clean":"2024-09-12T18:13:57.123146+0000","last_became_active":"2024-09-12T17:00:12.307371+0000","last_became_peered":"2024-09-12T17:00:12.307371+0000","last_unstale":"2024-09-12T18:13:57.123146+0000","last_undegraded":"2024-09-12T18:13:57.123146+0000","last_fullsized":"2024-09-12T18:13:57.123146+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'378","last_scrub_stamp":"2024-09-12T18:13:57.123003+0000","last_deep_scrub":"264'378","last_deep_scrub_stamp":"2024-09-12T18:13:57.123003+0000","last_clean_scrub_stamp":"2024-09-12T18:13:57.123003+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:45.220960+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262175,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":835,"num_read_kb":7035,"num_write":1193,"num_write_kb":32501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.077086+0000","last_change":"2024-09-12T18:13:59.077086+0000","last_active":"2024-09-12T18:13:59.077086+0000","last_peered":"2024-09-12T18:13:59.077086+0000","last_clean":"2024-09-12T18:13:59.077086+0000","last_became_active":"2024-09-12T17:00:00.670451+0000","last_became_peered":"2024-09-12T17:00:00.670451+0000","last_unstale":"2024-09-12T18:13:59.077086+0000","last_undegraded":"2024-09-12T18:13:59.077086+0000","last_fullsized":"2024-09-12T18:13:59.077086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:59.077001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:59.077001+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.077001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:10.341382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046867000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:15.985804+0000","last_change":"2024-09-12T18:14:15.985731+0000","last_active":"2024-09-12T18:14:15.985804+0000","last_peered":"2024-09-12T18:14:15.985804+0000","last_clean":"2024-09-12T18:14:15.985804+0000","last_became_active":"2024-09-12T17:00:16.326163+0000","last_became_peered":"2024-09-12T17:00:16.326163+0000","last_unstale":"2024-09-12T18:14:15.985804+0000","last_undegraded":"2024-09-12T18:14:15.985804+0000","last_fullsized":"2024-09-12T18:14:15.985804+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:15.985631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:15.985631+0000","last_clean_scrub_stamp":"2024-09-12T18:14:15.985631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:27.774285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'797","reported_seq":1544,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:20.448119+0000","last_change":"2024-09-12T18:14:20.448119+0000","last_active":"2024-09-12T18:14:20.448119+0000","last_peered":"2024-09-12T18:14:20.448119+0000","last_clean":"2024-09-12T18:14:20.448119+0000","last_became_active":"2024-09-12T17:00:18.429131+0000","last_became_peered":"2024-09-12T17:00:18.429131+0000","last_unstale":"2024-09-12T18:14:20.448119+0000","last_undegraded":"2024-09-12T18:14:20.448119+0000","last_fullsized":"2024-09-12T18:14:20.448119+0000","mapping_epoch":30,"log_start":"264'700","ondisk_log_start":"264'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'797","last_scrub_stamp":"2024-09-12T18:14:20.448016+0000","last_deep_scrub":"264'797","last_deep_scrub_stamp":"2024-09-12T18:14:20.448016+0000","last_clean_scrub_stamp":"2024-09-12T18:14:20.448016+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:50.131210+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164213,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1409,"num_read_kb":3444,"num_write":1148,"num_write_kb":951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:26.808799+0000","last_change":"2024-09-12T18:14:26.808799+0000","last_active":"2024-09-12T18:14:26.808799+0000","last_peered":"2024-09-12T18:14:26.808799+0000","last_clean":"2024-09-12T18:14:26.808799+0000","last_became_active":"2024-09-12T17:00:20.349800+0000","last_became_peered":"2024-09-12T17:00:20.349800+0000","last_unstale":"2024-09-12T18:14:26.808799+0000","last_undegraded":"2024-09-12T18:14:26.808799+0000","last_fullsized":"2024-09-12T18:14:26.808799+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:26.808709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:26.808709+0000","last_clean_scrub_stamp":"2024-09-12T18:14:26.808709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:43.261138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'141","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:31.473663+0000","last_change":"2024-09-12T18:14:31.473606+0000","last_active":"2024-09-12T18:14:31.473663+0000","last_peered":"2024-09-12T18:14:31.473663+0000","last_clean":"2024-09-12T18:14:31.473663+0000","last_became_active":"2024-09-12T17:00:22.360730+0000","last_became_peered":"2024-09-12T17:00:22.360730+0000","last_unstale":"2024-09-12T18:14:31.473663+0000","last_undegraded":"2024-09-12T18:14:31.473663+0000","last_fullsized":"2024-09-12T18:14:31.473663+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'141","last_scrub_stamp":"2024-09-12T18:14:31.473523+0000","last_deep_scrub":"264'141","last_deep_scrub_stamp":"2024-09-12T18:14:31.473523+0000","last_clean_scrub_stamp":"2024-09-12T18:14:31.473523+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:48.973215+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":172,"num_read_kb":170,"num_write":343,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'182","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:32.224139+0000","last_change":"2024-09-12T18:14:32.224139+0000","last_active":"2024-09-12T18:14:32.224139+0000","last_peered":"2024-09-12T18:14:32.224139+0000","last_clean":"2024-09-12T18:14:32.224139+0000","last_became_active":"2024-09-12T17:00:22.354464+0000","last_became_peered":"2024-09-12T17:00:22.354464+0000","last_unstale":"2024-09-12T18:14:32.224139+0000","last_undegraded":"2024-09-12T18:14:32.224139+0000","last_fullsized":"2024-09-12T18:14:32.224139+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'182","last_scrub_stamp":"2024-09-12T18:14:32.224051+0000","last_deep_scrub":"264'182","last_deep_scrub_stamp":"2024-09-12T18:14:32.224051+0000","last_clean_scrub_stamp":"2024-09-12T18:14:32.224051+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:37.381218+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":465,"num_read_kb":419,"num_write":437,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'369","reported_seq":1053,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.917244+0000","last_change":"2024-09-12T18:14:06.917244+0000","last_active":"2024-09-12T18:14:06.917244+0000","last_peered":"2024-09-12T18:14:06.917244+0000","last_clean":"2024-09-12T18:14:06.917244+0000","last_became_active":"2024-09-12T17:00:14.329093+0000","last_became_peered":"2024-09-12T17:00:14.329093+0000","last_unstale":"2024-09-12T18:14:06.917244+0000","last_undegraded":"2024-09-12T18:14:06.917244+0000","last_fullsized":"2024-09-12T18:14:06.917244+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'369","last_scrub_stamp":"2024-09-12T18:14:06.917142+0000","last_deep_scrub":"264'369","last_deep_scrub_stamp":"2024-09-12T18:14:06.917142+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.917142+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:31.654357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1637,"num_read_kb":1326,"num_write":585,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'363","reported_seq":1112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.822164+0000","last_change":"2024-09-12T18:13:58.822164+0000","last_active":"2024-09-12T18:13:58.822164+0000","last_peered":"2024-09-12T18:13:58.822164+0000","last_clean":"2024-09-12T18:13:58.822164+0000","last_became_active":"2024-09-12T17:00:12.307309+0000","last_became_peered":"2024-09-12T17:00:12.307309+0000","last_unstale":"2024-09-12T18:13:58.822164+0000","last_undegraded":"2024-09-12T18:13:58.822164+0000","last_fullsized":"2024-09-12T18:13:58.822164+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'363","last_scrub_stamp":"2024-09-12T18:13:58.822062+0000","last_deep_scrub":"264'363","last_deep_scrub_stamp":"2024-09-12T18:13:58.822062+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.822062+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:04.753595+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":717,"num_read_kb":21828,"num_write":1272,"num_write_kb":15847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.138218+0000","last_change":"2024-09-12T18:14:11.138218+0000","last_active":"2024-09-12T18:14:11.138218+0000","last_peered":"2024-09-12T18:14:11.138218+0000","last_clean":"2024-09-12T18:14:11.138218+0000","last_became_active":"2024-09-12T17:00:16.325555+0000","last_became_peered":"2024-09-12T17:00:16.325555+0000","last_unstale":"2024-09-12T18:14:11.138218+0000","last_undegraded":"2024-09-12T18:14:11.138218+0000","last_fullsized":"2024-09-12T18:14:11.138218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:11.138123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:11.138123+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.138123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:08.175044+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'305","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:22.926768+0000","last_change":"2024-09-12T18:14:22.926768+0000","last_active":"2024-09-12T18:14:22.926768+0000","last_peered":"2024-09-12T18:14:22.926768+0000","last_clean":"2024-09-12T18:14:22.926768+0000","last_became_active":"2024-09-12T17:00:18.327374+0000","last_became_peered":"2024-09-12T17:00:18.327374+0000","last_unstale":"2024-09-12T18:14:22.926768+0000","last_undegraded":"2024-09-12T18:14:22.926768+0000","last_fullsized":"2024-09-12T18:14:22.926768+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'305","last_scrub_stamp":"2024-09-12T18:14:22.926675+0000","last_deep_scrub":"264'305","last_deep_scrub_stamp":"2024-09-12T18:14:22.926675+0000","last_clean_scrub_stamp":"2024-09-12T18:14:22.926675+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:42.780150+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49267,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":497,"num_read_kb":1124,"num_write":398,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:28.842618+0000","last_change":"2024-09-12T18:14:28.842618+0000","last_active":"2024-09-12T18:14:28.842618+0000","last_peered":"2024-09-12T18:14:28.842618+0000","last_clean":"2024-09-12T18:14:28.842618+0000","last_became_active":"2024-09-12T17:00:20.352801+0000","last_became_peered":"2024-09-12T17:00:20.352801+0000","last_unstale":"2024-09-12T18:14:28.842618+0000","last_undegraded":"2024-09-12T18:14:28.842618+0000","last_fullsized":"2024-09-12T18:14:28.842618+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:28.842514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:28.842514+0000","last_clean_scrub_stamp":"2024-09-12T18:14:28.842514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:29.305914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'192","reported_seq":719,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:12:31.859401+0000","last_change":"2024-09-12T17:00:22.354964+0000","last_active":"2024-09-12T18:12:31.859401+0000","last_peered":"2024-09-12T18:12:31.859401+0000","last_clean":"2024-09-12T18:12:31.859401+0000","last_became_active":"2024-09-12T17:00:22.354651+0000","last_became_peered":"2024-09-12T17:00:22.354651+0000","last_unstale":"2024-09-12T18:12:31.859401+0000","last_undegraded":"2024-09-12T18:12:31.859401+0000","last_fullsized":"2024-09-12T18:12:31.859401+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:00:21.333142+0000","last_clean_scrub_stamp":"2024-09-12T17:00:21.333142+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":300,"num_read_kb":268,"num_write":394,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'230","reported_seq":874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.134035+0000","last_change":"2024-09-12T18:14:07.134035+0000","last_active":"2024-09-12T18:14:07.134035+0000","last_peered":"2024-09-12T18:14:07.134035+0000","last_clean":"2024-09-12T18:14:07.134035+0000","last_became_active":"2024-09-12T17:00:14.320955+0000","last_became_peered":"2024-09-12T17:00:14.320955+0000","last_unstale":"2024-09-12T18:14:07.134035+0000","last_undegraded":"2024-09-12T18:14:07.134035+0000","last_fullsized":"2024-09-12T18:14:07.134035+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'230","last_scrub_stamp":"2024-09-12T18:14:07.133902+0000","last_deep_scrub":"264'230","last_deep_scrub_stamp":"2024-09-12T18:14:07.133902+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.133902+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:28.413454+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1027,"num_read_kb":855,"num_write":338,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'407","reported_seq":1058,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.175316+0000","last_change":"2024-09-12T18:14:05.175316+0000","last_active":"2024-09-12T18:14:05.175316+0000","last_peered":"2024-09-12T18:14:05.175316+0000","last_clean":"2024-09-12T18:14:05.175316+0000","last_became_active":"2024-09-12T17:00:12.315834+0000","last_became_peered":"2024-09-12T17:00:12.315834+0000","last_unstale":"2024-09-12T18:14:05.175316+0000","last_undegraded":"2024-09-12T18:14:05.175316+0000","last_fullsized":"2024-09-12T18:14:05.175316+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'407","last_scrub_stamp":"2024-09-12T18:14:05.175171+0000","last_deep_scrub":"264'407","last_deep_scrub_stamp":"2024-09-12T18:14:05.175171+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.175171+0000","objects_scrubbed":7,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:55.926091+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3436700,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":549,"num_read_kb":44669,"num_write":1257,"num_write_kb":42862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.016058+0000","last_change":"2024-09-12T18:14:17.016058+0000","last_active":"2024-09-12T18:14:17.016058+0000","last_peered":"2024-09-12T18:14:17.016058+0000","last_clean":"2024-09-12T18:14:17.016058+0000","last_became_active":"2024-09-12T17:00:16.327292+0000","last_became_peered":"2024-09-12T17:00:16.327292+0000","last_unstale":"2024-09-12T18:14:17.016058+0000","last_undegraded":"2024-09-12T18:14:17.016058+0000","last_fullsized":"2024-09-12T18:14:17.016058+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:17.015961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:17.015961+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.015961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:59.576782+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'53","reported_seq":585,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:18.251671+0000","last_change":"2024-09-12T18:14:18.251671+0000","last_active":"2024-09-12T18:14:18.251671+0000","last_peered":"2024-09-12T18:14:18.251671+0000","last_clean":"2024-09-12T18:14:18.251671+0000","last_became_active":"2024-09-12T17:00:18.331495+0000","last_became_peered":"2024-09-12T17:00:18.331495+0000","last_unstale":"2024-09-12T18:14:18.251671+0000","last_undegraded":"2024-09-12T18:14:18.251671+0000","last_fullsized":"2024-09-12T18:14:18.251671+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'53","last_scrub_stamp":"2024-09-12T18:14:18.251554+0000","last_deep_scrub":"264'53","last_deep_scrub_stamp":"2024-09-12T18:14:18.251554+0000","last_clean_scrub_stamp":"2024-09-12T18:14:18.251554+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:07.081303+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:26.504133+0000","last_change":"2024-09-12T18:14:26.504133+0000","last_active":"2024-09-12T18:14:26.504133+0000","last_peered":"2024-09-12T18:14:26.504133+0000","last_clean":"2024-09-12T18:14:26.504133+0000","last_became_active":"2024-09-12T17:00:20.348274+0000","last_became_peered":"2024-09-12T17:00:20.348274+0000","last_unstale":"2024-09-12T18:14:26.504133+0000","last_undegraded":"2024-09-12T18:14:26.504133+0000","last_fullsized":"2024-09-12T18:14:26.504133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:26.504052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:26.504052+0000","last_clean_scrub_stamp":"2024-09-12T18:14:26.504052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:11.642165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'245","reported_seq":850,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:31.207196+0000","last_change":"2024-09-12T18:14:31.207196+0000","last_active":"2024-09-12T18:14:31.207196+0000","last_peered":"2024-09-12T18:14:31.207196+0000","last_clean":"2024-09-12T18:14:31.207196+0000","last_became_active":"2024-09-12T17:00:22.350195+0000","last_became_peered":"2024-09-12T17:00:22.350195+0000","last_unstale":"2024-09-12T18:14:31.207196+0000","last_undegraded":"2024-09-12T18:14:31.207196+0000","last_fullsized":"2024-09-12T18:14:31.207196+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'245","last_scrub_stamp":"2024-09-12T18:14:31.207106+0000","last_deep_scrub":"264'245","last_deep_scrub_stamp":"2024-09-12T18:14:31.207106+0000","last_clean_scrub_stamp":"2024-09-12T18:14:31.207106+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:42.226323+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":636,"num_read_kb":568,"num_write":560,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'163","reported_seq":765,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.985868+0000","last_change":"2024-09-12T18:14:04.985868+0000","last_active":"2024-09-12T18:14:04.985868+0000","last_peered":"2024-09-12T18:14:04.985868+0000","last_clean":"2024-09-12T18:14:04.985868+0000","last_became_active":"2024-09-12T17:00:14.334652+0000","last_became_peered":"2024-09-12T17:00:14.334652+0000","last_unstale":"2024-09-12T18:14:04.985868+0000","last_undegraded":"2024-09-12T18:14:04.985868+0000","last_fullsized":"2024-09-12T18:14:04.985868+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'163","last_scrub_stamp":"2024-09-12T18:14:04.985772+0000","last_deep_scrub":"264'163","last_deep_scrub_stamp":"2024-09-12T18:14:04.985772+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.985772+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:29.223174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":705,"num_read_kb":585,"num_write":252,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'373","reported_seq":1059,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.509915+0000","last_change":"2024-09-12T18:14:01.509915+0000","last_active":"2024-09-12T18:14:01.509915+0000","last_peered":"2024-09-12T18:14:01.509915+0000","last_clean":"2024-09-12T18:14:01.509915+0000","last_became_active":"2024-09-12T17:00:12.312629+0000","last_became_peered":"2024-09-12T17:00:12.312629+0000","last_unstale":"2024-09-12T18:14:01.509915+0000","last_undegraded":"2024-09-12T18:14:01.509915+0000","last_fullsized":"2024-09-12T18:14:01.509915+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-09-12T18:14:01.509785+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-09-12T18:14:01.509785+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.509785+0000","objects_scrubbed":8,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:46.142118+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524362,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":634,"num_read_kb":31722,"num_write":1487,"num_write_kb":32347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.348472+0000","last_change":"2024-09-12T18:14:17.348472+0000","last_active":"2024-09-12T18:14:17.348472+0000","last_peered":"2024-09-12T18:14:17.348472+0000","last_clean":"2024-09-12T18:14:17.348472+0000","last_became_active":"2024-09-12T17:00:16.326905+0000","last_became_peered":"2024-09-12T17:00:16.326905+0000","last_unstale":"2024-09-12T18:14:17.348472+0000","last_undegraded":"2024-09-12T18:14:17.348472+0000","last_fullsized":"2024-09-12T18:14:17.348472+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:17.348362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:17.348362+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.348362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:36.617419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'351","reported_seq":963,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:23.897991+0000","last_change":"2024-09-12T18:14:23.897991+0000","last_active":"2024-09-12T18:14:23.897991+0000","last_peered":"2024-09-12T18:14:23.897991+0000","last_clean":"2024-09-12T18:14:23.897991+0000","last_became_active":"2024-09-12T17:00:18.329759+0000","last_became_peered":"2024-09-12T17:00:18.329759+0000","last_unstale":"2024-09-12T18:14:23.897991+0000","last_undegraded":"2024-09-12T18:14:23.897991+0000","last_fullsized":"2024-09-12T18:14:23.897991+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'351","last_scrub_stamp":"2024-09-12T18:14:23.897880+0000","last_deep_scrub":"264'351","last_deep_scrub_stamp":"2024-09-12T18:14:23.897880+0000","last_clean_scrub_stamp":"2024-09-12T18:14:23.897880+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:36.146294+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50102,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":567,"num_read_kb":1243,"num_write":450,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.200766+0000","last_change":"2024-09-12T18:14:17.200766+0000","last_active":"2024-09-12T18:14:17.200766+0000","last_peered":"2024-09-12T18:14:17.200766+0000","last_clean":"2024-09-12T18:14:17.200766+0000","last_became_active":"2024-09-12T17:00:20.355629+0000","last_became_peered":"2024-09-12T17:00:20.355629+0000","last_unstale":"2024-09-12T18:14:17.200766+0000","last_undegraded":"2024-09-12T18:14:17.200766+0000","last_fullsized":"2024-09-12T18:14:17.200766+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:17.200666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:17.200666+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.200666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:30.930203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'128","reported_seq":664,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:34.428185+0000","last_change":"2024-09-12T18:14:34.428185+0000","last_active":"2024-09-12T18:14:34.428185+0000","last_peered":"2024-09-12T18:14:34.428185+0000","last_clean":"2024-09-12T18:14:34.428185+0000","last_became_active":"2024-09-12T17:00:22.360051+0000","last_became_peered":"2024-09-12T17:00:22.360051+0000","last_unstale":"2024-09-12T18:14:34.428185+0000","last_undegraded":"2024-09-12T18:14:34.428185+0000","last_fullsized":"2024-09-12T18:14:34.428185+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'128","last_scrub_stamp":"2024-09-12T18:14:34.428091+0000","last_deep_scrub":"264'128","last_deep_scrub_stamp":"2024-09-12T18:14:34.428091+0000","last_clean_scrub_stamp":"2024-09-12T18:14:34.428091+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:03.389025+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":246,"num_read_kb":229,"num_write":325,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'696","reported_seq":1450,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:14.942370+0000","last_change":"2024-09-12T18:14:14.942370+0000","last_active":"2024-09-12T18:14:14.942370+0000","last_peered":"2024-09-12T18:14:14.942370+0000","last_clean":"2024-09-12T18:14:14.942370+0000","last_became_active":"2024-09-12T17:00:14.338453+0000","last_became_peered":"2024-09-12T17:00:14.338453+0000","last_unstale":"2024-09-12T18:14:14.942370+0000","last_undegraded":"2024-09-12T18:14:14.942370+0000","last_fullsized":"2024-09-12T18:14:14.942370+0000","mapping_epoch":26,"log_start":"264'600","ondisk_log_start":"264'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'696","last_scrub_stamp":"2024-09-12T18:14:14.942287+0000","last_deep_scrub":"264'696","last_deep_scrub_stamp":"2024-09-12T18:14:14.942287+0000","last_clean_scrub_stamp":"2024-09-12T18:14:14.942287+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:43.385941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3211,"num_read_kb":2592,"num_write":1218,"num_write_kb":764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'376","reported_seq":1025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:56.083789+0000","last_change":"2024-09-12T18:13:56.083789+0000","last_active":"2024-09-12T18:13:56.083789+0000","last_peered":"2024-09-12T18:13:56.083789+0000","last_clean":"2024-09-12T18:13:56.083789+0000","last_became_active":"2024-09-12T17:00:46.406811+0000","last_became_peered":"2024-09-12T17:00:46.406811+0000","last_unstale":"2024-09-12T18:13:56.083789+0000","last_undegraded":"2024-09-12T18:13:56.083789+0000","last_fullsized":"2024-09-12T18:13:56.083789+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'376","last_scrub_stamp":"2024-09-12T18:13:56.083721+0000","last_deep_scrub":"264'376","last_deep_scrub_stamp":"2024-09-12T18:13:56.083721+0000","last_clean_scrub_stamp":"2024-09-12T18:13:56.083721+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:20.371898+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170356,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":466,"num_read_kb":7187,"num_write":1054,"num_write_kb":23441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.157320+0000","last_change":"2024-09-12T18:14:12.157320+0000","last_active":"2024-09-12T18:14:12.157320+0000","last_peered":"2024-09-12T18:14:12.157320+0000","last_clean":"2024-09-12T18:14:12.157320+0000","last_became_active":"2024-09-12T17:00:16.328571+0000","last_became_peered":"2024-09-12T17:00:16.328571+0000","last_unstale":"2024-09-12T18:14:12.157320+0000","last_undegraded":"2024-09-12T18:14:12.157320+0000","last_fullsized":"2024-09-12T18:14:12.157320+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:12.157228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:12.157228+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.157228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:38.775538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'312","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:22.468352+0000","last_change":"2024-09-12T18:14:22.468352+0000","last_active":"2024-09-12T18:14:22.468352+0000","last_peered":"2024-09-12T18:14:22.468352+0000","last_clean":"2024-09-12T18:14:22.468352+0000","last_became_active":"2024-09-12T17:00:18.331634+0000","last_became_peered":"2024-09-12T17:00:18.331634+0000","last_unstale":"2024-09-12T18:14:22.468352+0000","last_undegraded":"2024-09-12T18:14:22.468352+0000","last_fullsized":"2024-09-12T18:14:22.468352+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'312","last_scrub_stamp":"2024-09-12T18:14:22.468254+0000","last_deep_scrub":"264'312","last_deep_scrub_stamp":"2024-09-12T18:14:22.468254+0000","last_clean_scrub_stamp":"2024-09-12T18:14:22.468254+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:28.071156+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":499,"num_read_kb":1194,"num_write":408,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:25.207484+0000","last_change":"2024-09-12T18:14:25.207484+0000","last_active":"2024-09-12T18:14:25.207484+0000","last_peered":"2024-09-12T18:14:25.207484+0000","last_clean":"2024-09-12T18:14:25.207484+0000","last_became_active":"2024-09-12T17:00:20.346778+0000","last_became_peered":"2024-09-12T17:00:20.346778+0000","last_unstale":"2024-09-12T18:14:25.207484+0000","last_undegraded":"2024-09-12T18:14:25.207484+0000","last_fullsized":"2024-09-12T18:14:25.207484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:25.207363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:25.207363+0000","last_clean_scrub_stamp":"2024-09-12T18:14:25.207363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:04.441076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'4226","reported_seq":4840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.048608+0000","last_change":"2024-09-12T18:14:08.048608+0000","last_active":"2024-09-12T18:14:08.048608+0000","last_peered":"2024-09-12T18:14:08.048608+0000","last_clean":"2024-09-12T18:14:08.048608+0000","last_became_active":"2024-09-12T17:00:14.327366+0000","last_became_peered":"2024-09-12T17:00:14.327366+0000","last_unstale":"2024-09-12T18:14:08.048608+0000","last_undegraded":"2024-09-12T18:14:08.048608+0000","last_fullsized":"2024-09-12T18:14:08.048608+0000","mapping_epoch":26,"log_start":"264'4200","ondisk_log_start":"264'4200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4226","last_scrub_stamp":"2024-09-12T18:14:08.048490+0000","last_deep_scrub":"264'4226","last_deep_scrub_stamp":"2024-09-12T18:14:08.048490+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.048490+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":3000,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:16.172312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16999,"num_read_kb":14230,"num_write":6368,"num_write_kb":3177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'348","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.036725+0000","last_change":"2024-09-12T18:14:03.036725+0000","last_active":"2024-09-12T18:14:03.036725+0000","last_peered":"2024-09-12T18:14:03.036725+0000","last_clean":"2024-09-12T18:14:03.036725+0000","last_became_active":"2024-09-12T17:00:12.316401+0000","last_became_peered":"2024-09-12T17:00:12.316401+0000","last_unstale":"2024-09-12T18:14:03.036725+0000","last_undegraded":"2024-09-12T18:14:03.036725+0000","last_fullsized":"2024-09-12T18:14:03.036725+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'348","last_scrub_stamp":"2024-09-12T18:14:03.036602+0000","last_deep_scrub":"264'348","last_deep_scrub_stamp":"2024-09-12T18:14:03.036602+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.036602+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:12.222915+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2180110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":457,"num_read_kb":29254,"num_write":1102,"num_write_kb":37912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:16.256651+0000","last_change":"2024-09-12T18:14:16.256577+0000","last_active":"2024-09-12T18:14:16.256651+0000","last_peered":"2024-09-12T18:14:16.256651+0000","last_clean":"2024-09-12T18:14:16.256651+0000","last_became_active":"2024-09-12T17:00:16.317972+0000","last_became_peered":"2024-09-12T17:00:16.317972+0000","last_unstale":"2024-09-12T18:14:16.256651+0000","last_undegraded":"2024-09-12T18:14:16.256651+0000","last_fullsized":"2024-09-12T18:14:16.256651+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:16.256492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:16.256492+0000","last_clean_scrub_stamp":"2024-09-12T18:14:16.256492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:46.624196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'533","reported_seq":1190,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:14.184880+0000","last_change":"2024-09-12T18:14:14.184880+0000","last_active":"2024-09-12T18:14:14.184880+0000","last_peered":"2024-09-12T18:14:14.184880+0000","last_clean":"2024-09-12T18:14:14.184880+0000","last_became_active":"2024-09-12T17:00:18.327593+0000","last_became_peered":"2024-09-12T17:00:18.327593+0000","last_unstale":"2024-09-12T18:14:14.184880+0000","last_undegraded":"2024-09-12T18:14:14.184880+0000","last_fullsized":"2024-09-12T18:14:14.184880+0000","mapping_epoch":30,"log_start":"264'500","ondisk_log_start":"264'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'533","last_scrub_stamp":"2024-09-12T18:14:14.184757+0000","last_deep_scrub":"264'533","last_deep_scrub_stamp":"2024-09-12T18:14:14.184757+0000","last_clean_scrub_stamp":"2024-09-12T18:14:14.184757+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:06.682388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111195,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":962,"num_read_kb":2364,"num_write":832,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:28.465976+0000","last_change":"2024-09-12T18:14:28.465976+0000","last_active":"2024-09-12T18:14:28.465976+0000","last_peered":"2024-09-12T18:14:28.465976+0000","last_clean":"2024-09-12T18:14:28.465976+0000","last_became_active":"2024-09-12T17:00:20.350413+0000","last_became_peered":"2024-09-12T17:00:20.350413+0000","last_unstale":"2024-09-12T18:14:28.465976+0000","last_undegraded":"2024-09-12T18:14:28.465976+0000","last_fullsized":"2024-09-12T18:14:28.465976+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:28.465868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:28.465868+0000","last_clean_scrub_stamp":"2024-09-12T18:14:28.465868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:07.999497+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'146","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:34.840206+0000","last_change":"2024-09-12T18:14:34.840206+0000","last_active":"2024-09-12T18:14:34.840206+0000","last_peered":"2024-09-12T18:14:34.840206+0000","last_clean":"2024-09-12T18:14:34.840206+0000","last_became_active":"2024-09-12T17:00:22.588456+0000","last_became_peered":"2024-09-12T17:00:22.588456+0000","last_unstale":"2024-09-12T18:14:34.840206+0000","last_undegraded":"2024-09-12T18:14:34.840206+0000","last_fullsized":"2024-09-12T18:14:34.840206+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'146","last_scrub_stamp":"2024-09-12T18:14:34.840097+0000","last_deep_scrub":"264'146","last_deep_scrub_stamp":"2024-09-12T18:14:34.840097+0000","last_clean_scrub_stamp":"2024-09-12T18:14:34.840097+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:53.081305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":212,"num_write":324,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'223","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.188777+0000","last_change":"2024-09-12T18:14:11.188720+0000","last_active":"2024-09-12T18:14:11.188777+0000","last_peered":"2024-09-12T18:14:11.188777+0000","last_clean":"2024-09-12T18:14:11.188777+0000","last_became_active":"2024-09-12T17:00:14.328921+0000","last_became_peered":"2024-09-12T17:00:14.328921+0000","last_unstale":"2024-09-12T18:14:11.188777+0000","last_undegraded":"2024-09-12T18:14:11.188777+0000","last_fullsized":"2024-09-12T18:14:11.188777+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'223","last_scrub_stamp":"2024-09-12T18:14:11.188633+0000","last_deep_scrub":"264'223","last_deep_scrub_stamp":"2024-09-12T18:14:11.188633+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.188633+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:41.061991+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":992,"num_read_kb":851,"num_write":318,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2873,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'356","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.076062+0000","last_change":"2024-09-12T18:13:59.076062+0000","last_active":"2024-09-12T18:13:59.076062+0000","last_peered":"2024-09-12T18:13:59.076062+0000","last_clean":"2024-09-12T18:13:59.076062+0000","last_became_active":"2024-09-12T17:00:12.311606+0000","last_became_peered":"2024-09-12T17:00:12.311606+0000","last_unstale":"2024-09-12T18:13:59.076062+0000","last_undegraded":"2024-09-12T18:13:59.076062+0000","last_fullsized":"2024-09-12T18:13:59.076062+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-12T18:13:59.075963+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-12T18:13:59.075963+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.075963+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:20.684366+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":470,"num_read_kb":10885,"num_write":1123,"num_write_kb":34953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.163200+0000","last_change":"2024-09-12T18:14:13.163200+0000","last_active":"2024-09-12T18:14:13.163200+0000","last_peered":"2024-09-12T18:14:13.163200+0000","last_clean":"2024-09-12T18:14:13.163200+0000","last_became_active":"2024-09-12T17:00:16.327527+0000","last_became_peered":"2024-09-12T17:00:16.327527+0000","last_unstale":"2024-09-12T18:14:13.163200+0000","last_undegraded":"2024-09-12T18:14:13.163200+0000","last_fullsized":"2024-09-12T18:14:13.163200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:13.163092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:13.163092+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.163092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:37.590475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'346","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:23.499116+0000","last_change":"2024-09-12T18:14:23.499116+0000","last_active":"2024-09-12T18:14:23.499116+0000","last_peered":"2024-09-12T18:14:23.499116+0000","last_clean":"2024-09-12T18:14:23.499116+0000","last_became_active":"2024-09-12T17:00:18.326984+0000","last_became_peered":"2024-09-12T17:00:18.326984+0000","last_unstale":"2024-09-12T18:14:23.499116+0000","last_undegraded":"2024-09-12T18:14:23.499116+0000","last_fullsized":"2024-09-12T18:14:23.499116+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'346","last_scrub_stamp":"2024-09-12T18:14:23.498991+0000","last_deep_scrub":"264'346","last_deep_scrub_stamp":"2024-09-12T18:14:23.498991+0000","last_clean_scrub_stamp":"2024-09-12T18:14:23.498991+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:17.424447+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46916,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":562,"num_read_kb":1193,"num_write":464,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:15.220117+0000","last_change":"2024-09-12T18:14:15.220117+0000","last_active":"2024-09-12T18:14:15.220117+0000","last_peered":"2024-09-12T18:14:15.220117+0000","last_clean":"2024-09-12T18:14:15.220117+0000","last_became_active":"2024-09-12T17:00:20.347873+0000","last_became_peered":"2024-09-12T17:00:20.347873+0000","last_unstale":"2024-09-12T18:14:15.220117+0000","last_undegraded":"2024-09-12T18:14:15.220117+0000","last_fullsized":"2024-09-12T18:14:15.220117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:15.220030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:15.220030+0000","last_clean_scrub_stamp":"2024-09-12T18:14:15.220030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:54.298378+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'174","reported_seq":697,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:20.229981+0000","last_change":"2024-09-12T18:14:20.229981+0000","last_active":"2024-09-12T18:14:20.229981+0000","last_peered":"2024-09-12T18:14:20.229981+0000","last_clean":"2024-09-12T18:14:20.229981+0000","last_became_active":"2024-09-12T17:00:22.350856+0000","last_became_peered":"2024-09-12T17:00:22.350856+0000","last_unstale":"2024-09-12T18:14:20.229981+0000","last_undegraded":"2024-09-12T18:14:20.229981+0000","last_fullsized":"2024-09-12T18:14:20.229981+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'174","last_scrub_stamp":"2024-09-12T18:14:20.229862+0000","last_deep_scrub":"264'174","last_deep_scrub_stamp":"2024-09-12T18:14:20.229862+0000","last_clean_scrub_stamp":"2024-09-12T18:14:20.229862+0000","objects_scrubbed":7,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:22.189198+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1852,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":274,"num_read_kb":259,"num_write":495,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'116","reported_seq":710,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.895593+0000","last_change":"2024-09-12T18:14:08.895593+0000","last_active":"2024-09-12T18:14:08.895593+0000","last_peered":"2024-09-12T18:14:08.895593+0000","last_clean":"2024-09-12T18:14:08.895593+0000","last_became_active":"2024-09-12T17:00:14.336495+0000","last_became_peered":"2024-09-12T17:00:14.336495+0000","last_unstale":"2024-09-12T18:14:08.895593+0000","last_undegraded":"2024-09-12T18:14:08.895593+0000","last_fullsized":"2024-09-12T18:14:08.895593+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'116","last_scrub_stamp":"2024-09-12T18:14:08.895502+0000","last_deep_scrub":"264'116","last_deep_scrub_stamp":"2024-09-12T18:14:08.895502+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.895502+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:41.615371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":523,"num_read_kb":437,"num_write":169,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'380","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:57.835221+0000","last_change":"2024-09-12T18:13:57.835221+0000","last_active":"2024-09-12T18:13:57.835221+0000","last_peered":"2024-09-12T18:13:57.835221+0000","last_clean":"2024-09-12T18:13:57.835221+0000","last_became_active":"2024-09-12T17:00:12.318234+0000","last_became_peered":"2024-09-12T17:00:12.318234+0000","last_unstale":"2024-09-12T18:13:57.835221+0000","last_undegraded":"2024-09-12T18:13:57.835221+0000","last_fullsized":"2024-09-12T18:13:57.835221+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'380","last_scrub_stamp":"2024-09-12T18:13:57.835115+0000","last_deep_scrub":"264'380","last_deep_scrub_stamp":"2024-09-12T18:13:57.835115+0000","last_clean_scrub_stamp":"2024-09-12T18:13:57.835115+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:01.043683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":38331,"num_write":1137,"num_write_kb":59769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"264'4","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:20.851412+0000","last_change":"2024-09-12T18:14:20.851412+0000","last_active":"2024-09-12T18:14:20.851412+0000","last_peered":"2024-09-12T18:14:20.851412+0000","last_clean":"2024-09-12T18:14:20.851412+0000","last_became_active":"2024-09-12T17:00:16.327396+0000","last_became_peered":"2024-09-12T17:00:16.327396+0000","last_unstale":"2024-09-12T18:14:20.851412+0000","last_undegraded":"2024-09-12T18:14:20.851412+0000","last_fullsized":"2024-09-12T18:14:20.851412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:14:20.851324+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:14:20.851324+0000","last_clean_scrub_stamp":"2024-09-12T18:14:20.851324+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:03.722330+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'299","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:25.839746+0000","last_change":"2024-09-12T18:14:25.839746+0000","last_active":"2024-09-12T18:14:25.839746+0000","last_peered":"2024-09-12T18:14:25.839746+0000","last_clean":"2024-09-12T18:14:25.839746+0000","last_became_active":"2024-09-12T17:00:18.429149+0000","last_became_peered":"2024-09-12T17:00:18.429149+0000","last_unstale":"2024-09-12T18:14:25.839746+0000","last_undegraded":"2024-09-12T18:14:25.839746+0000","last_fullsized":"2024-09-12T18:14:25.839746+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'299","last_scrub_stamp":"2024-09-12T18:14:25.839646+0000","last_deep_scrub":"264'299","last_deep_scrub_stamp":"2024-09-12T18:14:25.839646+0000","last_clean_scrub_stamp":"2024-09-12T18:14:25.839646+0000","objects_scrubbed":5,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:52.286245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47739,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":501,"num_read_kb":1160,"num_write":400,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:19.244905+0000","last_change":"2024-09-12T18:14:19.244905+0000","last_active":"2024-09-12T18:14:19.244905+0000","last_peered":"2024-09-12T18:14:19.244905+0000","last_clean":"2024-09-12T18:14:19.244905+0000","last_became_active":"2024-09-12T17:00:20.349769+0000","last_became_peered":"2024-09-12T17:00:20.349769+0000","last_unstale":"2024-09-12T18:14:19.244905+0000","last_undegraded":"2024-09-12T18:14:19.244905+0000","last_fullsized":"2024-09-12T18:14:19.244905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:19.244803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:19.244803+0000","last_clean_scrub_stamp":"2024-09-12T18:14:19.244803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:26.784678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'105","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:32.485174+0000","last_change":"2024-09-12T18:14:32.485174+0000","last_active":"2024-09-12T18:14:32.485174+0000","last_peered":"2024-09-12T18:14:32.485174+0000","last_clean":"2024-09-12T18:14:32.485174+0000","last_became_active":"2024-09-12T17:00:22.358484+0000","last_became_peered":"2024-09-12T17:00:22.358484+0000","last_unstale":"2024-09-12T18:14:32.485174+0000","last_undegraded":"2024-09-12T18:14:32.485174+0000","last_fullsized":"2024-09-12T18:14:32.485174+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-12T18:14:32.485068+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-12T18:14:32.485068+0000","last_clean_scrub_stamp":"2024-09-12T18:14:32.485068+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:18.435476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":123,"num_write":242,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'161","reported_seq":804,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.049101+0000","last_change":"2024-09-12T18:14:01.049101+0000","last_active":"2024-09-12T18:14:01.049101+0000","last_peered":"2024-09-12T18:14:01.049101+0000","last_clean":"2024-09-12T18:14:01.049101+0000","last_became_active":"2024-09-12T17:00:14.330238+0000","last_became_peered":"2024-09-12T17:00:14.330238+0000","last_unstale":"2024-09-12T18:14:01.049101+0000","last_undegraded":"2024-09-12T18:14:01.049101+0000","last_fullsized":"2024-09-12T18:14:01.049101+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'161","last_scrub_stamp":"2024-09-12T18:14:01.049004+0000","last_deep_scrub":"264'161","last_deep_scrub_stamp":"2024-09-12T18:14:01.049004+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.049004+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:26.718335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":737,"num_read_kb":617,"num_write":248,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'339","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.091004+0000","last_change":"2024-09-12T18:14:00.091004+0000","last_active":"2024-09-12T18:14:00.091004+0000","last_peered":"2024-09-12T18:14:00.091004+0000","last_clean":"2024-09-12T18:14:00.091004+0000","last_became_active":"2024-09-12T17:00:12.305259+0000","last_became_peered":"2024-09-12T17:00:12.305259+0000","last_unstale":"2024-09-12T18:14:00.091004+0000","last_undegraded":"2024-09-12T18:14:00.091004+0000","last_fullsized":"2024-09-12T18:14:00.091004+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'339","last_scrub_stamp":"2024-09-12T18:14:00.090882+0000","last_deep_scrub":"264'339","last_deep_scrub_stamp":"2024-09-12T18:14:00.090882+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.090882+0000","objects_scrubbed":10,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:32.121245+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048621,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":464,"num_read_kb":5194,"num_write":1027,"num_write_kb":36405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.132722+0000","last_change":"2024-09-12T18:14:12.132722+0000","last_active":"2024-09-12T18:14:12.132722+0000","last_peered":"2024-09-12T18:14:12.132722+0000","last_clean":"2024-09-12T18:14:12.132722+0000","last_became_active":"2024-09-12T17:00:16.327626+0000","last_became_peered":"2024-09-12T17:00:16.327626+0000","last_unstale":"2024-09-12T18:14:12.132722+0000","last_undegraded":"2024-09-12T18:14:12.132722+0000","last_fullsized":"2024-09-12T18:14:12.132722+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:12.132627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:12.132627+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.132627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:23.273859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'115","reported_seq":670,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:25.861617+0000","last_change":"2024-09-12T18:14:25.861482+0000","last_active":"2024-09-12T18:14:25.861617+0000","last_peered":"2024-09-12T18:14:25.861617+0000","last_clean":"2024-09-12T18:14:25.861617+0000","last_became_active":"2024-09-12T17:00:18.429481+0000","last_became_peered":"2024-09-12T17:00:18.429481+0000","last_unstale":"2024-09-12T18:14:25.861617+0000","last_undegraded":"2024-09-12T18:14:25.861617+0000","last_fullsized":"2024-09-12T18:14:25.861617+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'115","last_scrub_stamp":"2024-09-12T18:14:25.861371+0000","last_deep_scrub":"264'115","last_deep_scrub_stamp":"2024-09-12T18:14:25.861371+0000","last_clean_scrub_stamp":"2024-09-12T18:14:25.861371+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:38.446625+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":118,"num_write":86,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'785","reported_seq":4468,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:22.270060+0000","last_change":"2024-09-12T18:14:22.270060+0000","last_active":"2024-09-12T18:14:22.270060+0000","last_peered":"2024-09-12T18:14:22.270060+0000","last_clean":"2024-09-12T18:14:22.270060+0000","last_became_active":"2024-09-12T17:00:20.350976+0000","last_became_peered":"2024-09-12T17:00:20.350976+0000","last_unstale":"2024-09-12T18:14:22.270060+0000","last_undegraded":"2024-09-12T18:14:22.270060+0000","last_fullsized":"2024-09-12T18:14:22.270060+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'785","last_scrub_stamp":"2024-09-12T18:14:22.269972+0000","last_deep_scrub":"264'785","last_deep_scrub_stamp":"2024-09-12T18:14:22.269972+0000","last_clean_scrub_stamp":"2024-09-12T18:14:22.269972+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:14.983222+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'114","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:28.470100+0000","last_change":"2024-09-12T18:14:28.470100+0000","last_active":"2024-09-12T18:14:28.470100+0000","last_peered":"2024-09-12T18:14:28.470100+0000","last_clean":"2024-09-12T18:14:28.470100+0000","last_became_active":"2024-09-12T17:00:22.357215+0000","last_became_peered":"2024-09-12T17:00:22.357215+0000","last_unstale":"2024-09-12T18:14:28.470100+0000","last_undegraded":"2024-09-12T18:14:28.470100+0000","last_fullsized":"2024-09-12T18:14:28.470100+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'114","last_scrub_stamp":"2024-09-12T18:14:28.470019+0000","last_deep_scrub":"264'114","last_deep_scrub_stamp":"2024-09-12T18:14:28.470019+0000","last_clean_scrub_stamp":"2024-09-12T18:14:28.470019+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:46.805507+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":135,"num_write":263,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'292","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.869491+0000","last_change":"2024-09-12T18:14:08.869491+0000","last_active":"2024-09-12T18:14:08.869491+0000","last_peered":"2024-09-12T18:14:08.869491+0000","last_clean":"2024-09-12T18:14:08.869491+0000","last_became_active":"2024-09-12T17:00:14.340459+0000","last_became_peered":"2024-09-12T17:00:14.340459+0000","last_unstale":"2024-09-12T18:14:08.869491+0000","last_undegraded":"2024-09-12T18:14:08.869491+0000","last_fullsized":"2024-09-12T18:14:08.869491+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'292","last_scrub_stamp":"2024-09-12T18:14:08.869378+0000","last_deep_scrub":"264'292","last_deep_scrub_stamp":"2024-09-12T18:14:08.869378+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.869378+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:58.673982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1297,"num_read_kb":1099,"num_write":462,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'344","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.153522+0000","last_change":"2024-09-12T18:14:06.153522+0000","last_active":"2024-09-12T18:14:06.153522+0000","last_peered":"2024-09-12T18:14:06.153522+0000","last_clean":"2024-09-12T18:14:06.153522+0000","last_became_active":"2024-09-12T17:00:46.721297+0000","last_became_peered":"2024-09-12T17:00:46.721297+0000","last_unstale":"2024-09-12T18:14:06.153522+0000","last_undegraded":"2024-09-12T18:14:06.153522+0000","last_fullsized":"2024-09-12T18:14:06.153522+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'344","last_scrub_stamp":"2024-09-12T18:14:06.153427+0000","last_deep_scrub":"264'344","last_deep_scrub_stamp":"2024-09-12T18:14:06.153427+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.153427+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:53.191230+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6112458,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":37702,"num_write":1052,"num_write_kb":18010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:18.393474+0000","last_change":"2024-09-12T18:14:18.393474+0000","last_active":"2024-09-12T18:14:18.393474+0000","last_peered":"2024-09-12T18:14:18.393474+0000","last_clean":"2024-09-12T18:14:18.393474+0000","last_became_active":"2024-09-12T17:00:16.327461+0000","last_became_peered":"2024-09-12T17:00:16.327461+0000","last_unstale":"2024-09-12T18:14:18.393474+0000","last_undegraded":"2024-09-12T18:14:18.393474+0000","last_fullsized":"2024-09-12T18:14:18.393474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:18.393385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:18.393385+0000","last_clean_scrub_stamp":"2024-09-12T18:14:18.393385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:26.549592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'332","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:26.464308+0000","last_change":"2024-09-12T18:14:26.464308+0000","last_active":"2024-09-12T18:14:26.464308+0000","last_peered":"2024-09-12T18:14:26.464308+0000","last_clean":"2024-09-12T18:14:26.464308+0000","last_became_active":"2024-09-12T17:00:18.328990+0000","last_became_peered":"2024-09-12T17:00:18.328990+0000","last_unstale":"2024-09-12T18:14:26.464308+0000","last_undegraded":"2024-09-12T18:14:26.464308+0000","last_fullsized":"2024-09-12T18:14:26.464308+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-12T18:14:26.464180+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-12T18:14:26.464180+0000","last_clean_scrub_stamp":"2024-09-12T18:14:26.464180+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:25.731195+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43471,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":524,"num_read_kb":1084,"num_write":408,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:26.256946+0000","last_change":"2024-09-12T18:14:26.256946+0000","last_active":"2024-09-12T18:14:26.256946+0000","last_peered":"2024-09-12T18:14:26.256946+0000","last_clean":"2024-09-12T18:14:26.256946+0000","last_became_active":"2024-09-12T17:00:20.349643+0000","last_became_peered":"2024-09-12T17:00:20.349643+0000","last_unstale":"2024-09-12T18:14:26.256946+0000","last_undegraded":"2024-09-12T18:14:26.256946+0000","last_fullsized":"2024-09-12T18:14:26.256946+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:26.256855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:26.256855+0000","last_clean_scrub_stamp":"2024-09-12T18:14:26.256855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:17.447555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'123","reported_seq":628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:29.425115+0000","last_change":"2024-09-12T18:14:29.425115+0000","last_active":"2024-09-12T18:14:29.425115+0000","last_peered":"2024-09-12T18:14:29.425115+0000","last_clean":"2024-09-12T18:14:29.425115+0000","last_became_active":"2024-09-12T17:00:22.355658+0000","last_became_peered":"2024-09-12T17:00:22.355658+0000","last_unstale":"2024-09-12T18:14:29.425115+0000","last_undegraded":"2024-09-12T18:14:29.425115+0000","last_fullsized":"2024-09-12T18:14:29.425115+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'123","last_scrub_stamp":"2024-09-12T18:14:29.424986+0000","last_deep_scrub":"264'123","last_deep_scrub_stamp":"2024-09-12T18:14:29.424986+0000","last_clean_scrub_stamp":"2024-09-12T18:14:29.424986+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:12.603589+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":157,"num_read_kb":152,"num_write":284,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'216","reported_seq":835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.847049+0000","last_change":"2024-09-12T18:14:09.847049+0000","last_active":"2024-09-12T18:14:09.847049+0000","last_peered":"2024-09-12T18:14:09.847049+0000","last_clean":"2024-09-12T18:14:09.847049+0000","last_became_active":"2024-09-12T17:00:14.334620+0000","last_became_peered":"2024-09-12T17:00:14.334620+0000","last_unstale":"2024-09-12T18:14:09.847049+0000","last_undegraded":"2024-09-12T18:14:09.847049+0000","last_fullsized":"2024-09-12T18:14:09.847049+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'216","last_scrub_stamp":"2024-09-12T18:14:09.846963+0000","last_deep_scrub":"264'216","last_deep_scrub_stamp":"2024-09-12T18:14:09.846963+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.846963+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:54.849970+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":978,"num_read_kb":833,"num_write":353,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'413","reported_seq":1100,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.537609+0000","last_change":"2024-09-12T18:14:02.537609+0000","last_active":"2024-09-12T18:14:02.537609+0000","last_peered":"2024-09-12T18:14:02.537609+0000","last_clean":"2024-09-12T18:14:02.537609+0000","last_became_active":"2024-09-12T17:00:12.317850+0000","last_became_peered":"2024-09-12T17:00:12.317850+0000","last_unstale":"2024-09-12T18:14:02.537609+0000","last_undegraded":"2024-09-12T18:14:02.537609+0000","last_fullsized":"2024-09-12T18:14:02.537609+0000","mapping_epoch":24,"log_start":"264'398","ondisk_log_start":"264'398","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'413","last_scrub_stamp":"2024-09-12T18:14:02.537459+0000","last_deep_scrub":"264'413","last_deep_scrub_stamp":"2024-09-12T18:14:02.537459+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.537459+0000","objects_scrubbed":15,"log_size":15,"log_dups_size":398,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:34.535056+0000","scrub_duration":65,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2375003,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":614,"num_read_kb":19368,"num_write":1121,"num_write_kb":17051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:22.495978+0000","last_change":"2024-09-12T18:14:22.495978+0000","last_active":"2024-09-12T18:14:22.495978+0000","last_peered":"2024-09-12T18:14:22.495978+0000","last_clean":"2024-09-12T18:14:22.495978+0000","last_became_active":"2024-09-12T17:00:16.329505+0000","last_became_peered":"2024-09-12T17:00:16.329505+0000","last_unstale":"2024-09-12T18:14:22.495978+0000","last_undegraded":"2024-09-12T18:14:22.495978+0000","last_fullsized":"2024-09-12T18:14:22.495978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:22.495890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:22.495890+0000","last_clean_scrub_stamp":"2024-09-12T18:14:22.495890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:14.555384+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'270","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:21.218975+0000","last_change":"2024-09-12T18:14:21.218975+0000","last_active":"2024-09-12T18:14:21.218975+0000","last_peered":"2024-09-12T18:14:21.218975+0000","last_clean":"2024-09-12T18:14:21.218975+0000","last_became_active":"2024-09-12T17:00:18.330548+0000","last_became_peered":"2024-09-12T17:00:18.330548+0000","last_unstale":"2024-09-12T18:14:21.218975+0000","last_undegraded":"2024-09-12T18:14:21.218975+0000","last_fullsized":"2024-09-12T18:14:21.218975+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'270","last_scrub_stamp":"2024-09-12T18:14:21.218862+0000","last_deep_scrub":"264'270","last_deep_scrub_stamp":"2024-09-12T18:14:21.218862+0000","last_clean_scrub_stamp":"2024-09-12T18:14:21.218862+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:44.952083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":1014,"num_write":352,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:18.240467+0000","last_change":"2024-09-12T18:14:18.240467+0000","last_active":"2024-09-12T18:14:18.240467+0000","last_peered":"2024-09-12T18:14:18.240467+0000","last_clean":"2024-09-12T18:14:18.240467+0000","last_became_active":"2024-09-12T17:00:20.347122+0000","last_became_peered":"2024-09-12T17:00:20.347122+0000","last_unstale":"2024-09-12T18:14:18.240467+0000","last_undegraded":"2024-09-12T18:14:18.240467+0000","last_fullsized":"2024-09-12T18:14:18.240467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:18.240377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:18.240377+0000","last_clean_scrub_stamp":"2024-09-12T18:14:18.240377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:46.226638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'145","reported_seq":690,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:35.870927+0000","last_change":"2024-09-12T18:14:35.870927+0000","last_active":"2024-09-12T18:14:35.870927+0000","last_peered":"2024-09-12T18:14:35.870927+0000","last_clean":"2024-09-12T18:14:35.870927+0000","last_became_active":"2024-09-12T17:00:22.588367+0000","last_became_peered":"2024-09-12T17:00:22.588367+0000","last_unstale":"2024-09-12T18:14:35.870927+0000","last_undegraded":"2024-09-12T18:14:35.870927+0000","last_fullsized":"2024-09-12T18:14:35.870927+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'145","last_scrub_stamp":"2024-09-12T18:14:35.870811+0000","last_deep_scrub":"264'145","last_deep_scrub_stamp":"2024-09-12T18:14:35.870811+0000","last_clean_scrub_stamp":"2024-09-12T18:14:35.870811+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:53.068368+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":299,"num_read_kb":277,"num_write":353,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'86","reported_seq":675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.888792+0000","last_change":"2024-09-12T18:14:07.888792+0000","last_active":"2024-09-12T18:14:07.888792+0000","last_peered":"2024-09-12T18:14:07.888792+0000","last_clean":"2024-09-12T18:14:07.888792+0000","last_became_active":"2024-09-12T17:00:14.338251+0000","last_became_peered":"2024-09-12T17:00:14.338251+0000","last_unstale":"2024-09-12T18:14:07.888792+0000","last_undegraded":"2024-09-12T18:14:07.888792+0000","last_fullsized":"2024-09-12T18:14:07.888792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'86","last_scrub_stamp":"2024-09-12T18:14:07.888692+0000","last_deep_scrub":"264'86","last_deep_scrub_stamp":"2024-09-12T18:14:07.888692+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.888692+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:33.432525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":335,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'391","reported_seq":1096,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:57.942934+0000","last_change":"2024-09-12T18:13:57.942881+0000","last_active":"2024-09-12T18:13:57.942934+0000","last_peered":"2024-09-12T18:13:57.942934+0000","last_clean":"2024-09-12T18:13:57.942934+0000","last_became_active":"2024-09-12T17:00:12.318883+0000","last_became_peered":"2024-09-12T17:00:12.318883+0000","last_unstale":"2024-09-12T18:13:57.942934+0000","last_undegraded":"2024-09-12T18:13:57.942934+0000","last_fullsized":"2024-09-12T18:13:57.942934+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'391","last_scrub_stamp":"2024-09-12T18:13:57.942799+0000","last_deep_scrub":"264'391","last_deep_scrub_stamp":"2024-09-12T18:13:57.942799+0000","last_clean_scrub_stamp":"2024-09-12T18:13:57.942799+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:44.840115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":699,"num_read_kb":40775,"num_write":1189,"num_write_kb":14251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"264'6","reported_seq":999,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:19.820125+0000","last_change":"2024-09-12T18:14:19.820125+0000","last_active":"2024-09-12T18:14:19.820125+0000","last_peered":"2024-09-12T18:14:19.820125+0000","last_clean":"2024-09-12T18:14:19.820125+0000","last_became_active":"2024-09-12T17:00:16.326067+0000","last_became_peered":"2024-09-12T17:00:16.326067+0000","last_unstale":"2024-09-12T18:14:19.820125+0000","last_undegraded":"2024-09-12T18:14:19.820125+0000","last_fullsized":"2024-09-12T18:14:19.820125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T18:14:19.820043+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T18:14:19.820043+0000","last_clean_scrub_stamp":"2024-09-12T18:14:19.820043+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:04.795534+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'272","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:24.873557+0000","last_change":"2024-09-12T18:14:24.873557+0000","last_active":"2024-09-12T18:14:24.873557+0000","last_peered":"2024-09-12T18:14:24.873557+0000","last_clean":"2024-09-12T18:14:24.873557+0000","last_became_active":"2024-09-12T17:00:18.326438+0000","last_became_peered":"2024-09-12T17:00:18.326438+0000","last_unstale":"2024-09-12T18:14:24.873557+0000","last_undegraded":"2024-09-12T18:14:24.873557+0000","last_fullsized":"2024-09-12T18:14:24.873557+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'272","last_scrub_stamp":"2024-09-12T18:14:24.873468+0000","last_deep_scrub":"264'272","last_deep_scrub_stamp":"2024-09-12T18:14:24.873468+0000","last_clean_scrub_stamp":"2024-09-12T18:14:24.873468+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:00.691806+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47056,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":445,"num_read_kb":1107,"num_write":372,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:28.835263+0000","last_change":"2024-09-12T18:14:28.835263+0000","last_active":"2024-09-12T18:14:28.835263+0000","last_peered":"2024-09-12T18:14:28.835263+0000","last_clean":"2024-09-12T18:14:28.835263+0000","last_became_active":"2024-09-12T17:00:20.349324+0000","last_became_peered":"2024-09-12T17:00:20.349324+0000","last_unstale":"2024-09-12T18:14:28.835263+0000","last_undegraded":"2024-09-12T18:14:28.835263+0000","last_fullsized":"2024-09-12T18:14:28.835263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:28.835178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:28.835178+0000","last_clean_scrub_stamp":"2024-09-12T18:14:28.835178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:52.122317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'177","reported_seq":1653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:31.440897+0000","last_change":"2024-09-12T18:14:31.440897+0000","last_active":"2024-09-12T18:14:31.440897+0000","last_peered":"2024-09-12T18:14:31.440897+0000","last_clean":"2024-09-12T18:14:31.440897+0000","last_became_active":"2024-09-12T17:00:22.353287+0000","last_became_peered":"2024-09-12T17:00:22.353287+0000","last_unstale":"2024-09-12T18:14:31.440897+0000","last_undegraded":"2024-09-12T18:14:31.440897+0000","last_fullsized":"2024-09-12T18:14:31.440897+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-12T18:14:31.440775+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-12T18:14:31.440775+0000","last_clean_scrub_stamp":"2024-09-12T18:14:31.440775+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:20.637002+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1233,"num_read_kb":1225,"num_write":392,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'366","reported_seq":1057,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.880426+0000","last_change":"2024-09-12T18:14:07.880426+0000","last_active":"2024-09-12T18:14:07.880426+0000","last_peered":"2024-09-12T18:14:07.880426+0000","last_clean":"2024-09-12T18:14:07.880426+0000","last_became_active":"2024-09-12T17:00:14.323113+0000","last_became_peered":"2024-09-12T17:00:14.323113+0000","last_unstale":"2024-09-12T18:14:07.880426+0000","last_undegraded":"2024-09-12T18:14:07.880426+0000","last_fullsized":"2024-09-12T18:14:07.880426+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'366","last_scrub_stamp":"2024-09-12T18:14:07.880341+0000","last_deep_scrub":"264'366","last_deep_scrub_stamp":"2024-09-12T18:14:07.880341+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.880341+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:43.555460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1619,"num_read_kb":1299,"num_write":554,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'327","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.130977+0000","last_change":"2024-09-12T18:13:59.130977+0000","last_active":"2024-09-12T18:13:59.130977+0000","last_peered":"2024-09-12T18:13:59.130977+0000","last_clean":"2024-09-12T18:13:59.130977+0000","last_became_active":"2024-09-12T17:00:12.312456+0000","last_became_peered":"2024-09-12T17:00:12.312456+0000","last_unstale":"2024-09-12T18:13:59.130977+0000","last_undegraded":"2024-09-12T18:13:59.130977+0000","last_fullsized":"2024-09-12T18:13:59.130977+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'327","last_scrub_stamp":"2024-09-12T18:13:59.130866+0000","last_deep_scrub":"264'327","last_deep_scrub_stamp":"2024-09-12T18:13:59.130866+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.130866+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:10.045907+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":504,"num_read_kb":30861,"num_write":1000,"num_write_kb":23841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.250108+0000","last_change":"2024-09-12T18:14:17.250108+0000","last_active":"2024-09-12T18:14:17.250108+0000","last_peered":"2024-09-12T18:14:17.250108+0000","last_clean":"2024-09-12T18:14:17.250108+0000","last_became_active":"2024-09-12T17:00:16.325535+0000","last_became_peered":"2024-09-12T17:00:16.325535+0000","last_unstale":"2024-09-12T18:14:17.250108+0000","last_undegraded":"2024-09-12T18:14:17.250108+0000","last_fullsized":"2024-09-12T18:14:17.250108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:17.250027+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:17.250027+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.250027+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:25.737427+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'310","reported_seq":919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:24.895228+0000","last_change":"2024-09-12T18:14:24.895228+0000","last_active":"2024-09-12T18:14:24.895228+0000","last_peered":"2024-09-12T18:14:24.895228+0000","last_clean":"2024-09-12T18:14:24.895228+0000","last_became_active":"2024-09-12T17:00:18.326140+0000","last_became_peered":"2024-09-12T17:00:18.326140+0000","last_unstale":"2024-09-12T18:14:24.895228+0000","last_undegraded":"2024-09-12T18:14:24.895228+0000","last_fullsized":"2024-09-12T18:14:24.895228+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'310","last_scrub_stamp":"2024-09-12T18:14:24.895132+0000","last_deep_scrub":"264'310","last_deep_scrub_stamp":"2024-09-12T18:14:24.895132+0000","last_clean_scrub_stamp":"2024-09-12T18:14:24.895132+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:02.426451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49596,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":515,"num_read_kb":1146,"num_write":406,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:35.239181+0000","last_change":"2024-09-12T18:14:35.239181+0000","last_active":"2024-09-12T18:14:35.239181+0000","last_peered":"2024-09-12T18:14:35.239181+0000","last_clean":"2024-09-12T18:14:35.239181+0000","last_became_active":"2024-09-12T17:00:20.353962+0000","last_became_peered":"2024-09-12T17:00:20.353962+0000","last_unstale":"2024-09-12T18:14:35.239181+0000","last_undegraded":"2024-09-12T18:14:35.239181+0000","last_fullsized":"2024-09-12T18:14:35.239181+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:35.239094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:35.239094+0000","last_clean_scrub_stamp":"2024-09-12T18:14:35.239094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:53.542493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'124","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:30.865230+0000","last_change":"2024-09-12T18:14:30.865230+0000","last_active":"2024-09-12T18:14:30.865230+0000","last_peered":"2024-09-12T18:14:30.865230+0000","last_clean":"2024-09-12T18:14:30.865230+0000","last_became_active":"2024-09-12T17:00:22.352779+0000","last_became_peered":"2024-09-12T17:00:22.352779+0000","last_unstale":"2024-09-12T18:14:30.865230+0000","last_undegraded":"2024-09-12T18:14:30.865230+0000","last_fullsized":"2024-09-12T18:14:30.865230+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-09-12T18:14:30.865135+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-09-12T18:14:30.865135+0000","last_clean_scrub_stamp":"2024-09-12T18:14:30.865135+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:45.511909+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":133,"num_write":289,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'171","reported_seq":781,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.089074+0000","last_change":"2024-09-12T18:14:09.089074+0000","last_active":"2024-09-12T18:14:09.089074+0000","last_peered":"2024-09-12T18:14:09.089074+0000","last_clean":"2024-09-12T18:14:09.089074+0000","last_became_active":"2024-09-12T17:00:14.315424+0000","last_became_peered":"2024-09-12T17:00:14.315424+0000","last_unstale":"2024-09-12T18:14:09.089074+0000","last_undegraded":"2024-09-12T18:14:09.089074+0000","last_fullsized":"2024-09-12T18:14:09.089074+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-09-12T18:14:09.088983+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-09-12T18:14:09.088983+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.088983+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:18.442009+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":753,"num_read_kb":612,"num_write":278,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'338","reported_seq":1085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.042155+0000","last_change":"2024-09-12T18:14:03.042155+0000","last_active":"2024-09-12T18:14:03.042155+0000","last_peered":"2024-09-12T18:14:03.042155+0000","last_clean":"2024-09-12T18:14:03.042155+0000","last_became_active":"2024-09-12T17:00:12.310322+0000","last_became_peered":"2024-09-12T17:00:12.310322+0000","last_unstale":"2024-09-12T18:14:03.042155+0000","last_undegraded":"2024-09-12T18:14:03.042155+0000","last_fullsized":"2024-09-12T18:14:03.042155+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'338","last_scrub_stamp":"2024-09-12T18:14:03.041984+0000","last_deep_scrub":"264'338","last_deep_scrub_stamp":"2024-09-12T18:14:03.041984+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.041984+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:17.456643+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262194,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":571,"num_read_kb":27239,"num_write":1052,"num_write_kb":25993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'259","reported_seq":893,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.476961+0000","last_change":"2024-09-12T18:14:13.476902+0000","last_active":"2024-09-12T18:14:13.476961+0000","last_peered":"2024-09-12T18:14:13.476961+0000","last_clean":"2024-09-12T18:14:13.476961+0000","last_became_active":"2024-09-12T17:00:46.406809+0000","last_became_peered":"2024-09-12T17:00:46.406809+0000","last_unstale":"2024-09-12T18:14:13.476961+0000","last_undegraded":"2024-09-12T18:14:13.476961+0000","last_fullsized":"2024-09-12T18:14:13.476961+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'259","last_scrub_stamp":"2024-09-12T18:14:13.476817+0000","last_deep_scrub":"264'259","last_deep_scrub_stamp":"2024-09-12T18:14:13.476817+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.476817+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:26.137002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1147,"num_read_kb":935,"num_write":403,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"264'313","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.087595+0000","last_change":"2024-09-12T18:13:59.087595+0000","last_active":"2024-09-12T18:13:59.087595+0000","last_peered":"2024-09-12T18:13:59.087595+0000","last_clean":"2024-09-12T18:13:59.087595+0000","last_became_active":"2024-09-12T17:00:12.312579+0000","last_became_peered":"2024-09-12T17:00:12.312579+0000","last_unstale":"2024-09-12T18:13:59.087595+0000","last_undegraded":"2024-09-12T18:13:59.087595+0000","last_fullsized":"2024-09-12T18:13:59.087595+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'313","last_scrub_stamp":"2024-09-12T18:13:59.087493+0000","last_deep_scrub":"264'313","last_deep_scrub_stamp":"2024-09-12T18:13:59.087493+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.087493+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:39.390471+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262157,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":699,"num_read_kb":738,"num_write":941,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'458","reported_seq":1244,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.496883+0000","last_change":"2024-09-12T18:14:12.496883+0000","last_active":"2024-09-12T18:14:12.496883+0000","last_peered":"2024-09-12T18:14:12.496883+0000","last_clean":"2024-09-12T18:14:12.496883+0000","last_became_active":"2024-09-12T17:00:14.327158+0000","last_became_peered":"2024-09-12T17:00:14.327158+0000","last_unstale":"2024-09-12T18:14:12.496883+0000","last_undegraded":"2024-09-12T18:14:12.496883+0000","last_fullsized":"2024-09-12T18:14:12.496883+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'458","last_scrub_stamp":"2024-09-12T18:14:12.496744+0000","last_deep_scrub":"264'458","last_deep_scrub_stamp":"2024-09-12T18:14:12.496744+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.496744+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:27.723536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2228,"num_read_kb":1913,"num_write":817,"num_write_kb":525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'343","reported_seq":989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.509257+0000","last_change":"2024-09-12T18:14:03.509257+0000","last_active":"2024-09-12T18:14:03.509257+0000","last_peered":"2024-09-12T18:14:03.509257+0000","last_clean":"2024-09-12T18:14:03.509257+0000","last_became_active":"2024-09-12T17:00:12.317893+0000","last_became_peered":"2024-09-12T17:00:12.317893+0000","last_unstale":"2024-09-12T18:14:03.509257+0000","last_undegraded":"2024-09-12T18:14:03.509257+0000","last_fullsized":"2024-09-12T18:14:03.509257+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'343","last_scrub_stamp":"2024-09-12T18:14:03.509147+0000","last_deep_scrub":"264'343","last_deep_scrub_stamp":"2024-09-12T18:14:03.509147+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.509147+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:19.174816+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524314,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":498,"num_read_kb":13770,"num_write":1022,"num_write_kb":25077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'105","reported_seq":716,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.096105+0000","last_change":"2024-09-12T18:14:08.096105+0000","last_active":"2024-09-12T18:14:08.096105+0000","last_peered":"2024-09-12T18:14:08.096105+0000","last_clean":"2024-09-12T18:14:08.096105+0000","last_became_active":"2024-09-12T17:00:14.323394+0000","last_became_peered":"2024-09-12T17:00:14.323394+0000","last_unstale":"2024-09-12T18:14:08.096105+0000","last_undegraded":"2024-09-12T18:14:08.096105+0000","last_fullsized":"2024-09-12T18:14:08.096105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-12T18:14:08.096018+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-12T18:14:08.096018+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.096018+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:14.501315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":480,"num_read_kb":401,"num_write":159,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'469","reported_seq":1235,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.048486+0000","last_change":"2024-09-12T18:14:04.048486+0000","last_active":"2024-09-12T18:14:04.048486+0000","last_peered":"2024-09-12T18:14:04.048486+0000","last_clean":"2024-09-12T18:14:04.048486+0000","last_became_active":"2024-09-12T17:00:12.314938+0000","last_became_peered":"2024-09-12T17:00:12.314938+0000","last_unstale":"2024-09-12T18:14:04.048486+0000","last_undegraded":"2024-09-12T18:14:04.048486+0000","last_fullsized":"2024-09-12T18:14:04.048486+0000","mapping_epoch":24,"log_start":"264'400","ondisk_log_start":"264'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'469","last_scrub_stamp":"2024-09-12T18:14:04.048381+0000","last_deep_scrub":"264'469","last_deep_scrub_stamp":"2024-09-12T18:14:04.048381+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.048381+0000","objects_scrubbed":8,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:13.231997+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550360,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":846,"num_read_kb":44498,"num_write":1407,"num_write_kb":38820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'334","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.931359+0000","last_change":"2024-09-12T18:14:11.931359+0000","last_active":"2024-09-12T18:14:11.931359+0000","last_peered":"2024-09-12T18:14:11.931359+0000","last_clean":"2024-09-12T18:14:11.931359+0000","last_became_active":"2024-09-12T17:00:14.333821+0000","last_became_peered":"2024-09-12T17:00:14.333821+0000","last_unstale":"2024-09-12T18:14:11.931359+0000","last_undegraded":"2024-09-12T18:14:11.931359+0000","last_fullsized":"2024-09-12T18:14:11.931359+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'334","last_scrub_stamp":"2024-09-12T18:14:11.931271+0000","last_deep_scrub":"264'334","last_deep_scrub_stamp":"2024-09-12T18:14:11.931271+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.931271+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:34.893438+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1469,"num_read_kb":1192,"num_write":564,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4003,"num_omap_keys":18,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'335","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.946774+0000","last_change":"2024-09-12T18:13:58.946774+0000","last_active":"2024-09-12T18:13:58.946774+0000","last_peered":"2024-09-12T18:13:58.946774+0000","last_clean":"2024-09-12T18:13:58.946774+0000","last_became_active":"2024-09-12T17:00:12.316672+0000","last_became_peered":"2024-09-12T17:00:12.316672+0000","last_unstale":"2024-09-12T18:13:58.946774+0000","last_undegraded":"2024-09-12T18:13:58.946774+0000","last_fullsized":"2024-09-12T18:13:58.946774+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-12T18:13:58.946616+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-12T18:13:58.946616+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.946616+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:36.236852+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655849,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":486,"num_read_kb":22933,"num_write":961,"num_write_kb":33827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'55","reported_seq":632,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.802515+0000","last_change":"2024-09-12T18:14:10.802515+0000","last_active":"2024-09-12T18:14:10.802515+0000","last_peered":"2024-09-12T18:14:10.802515+0000","last_clean":"2024-09-12T18:14:10.802515+0000","last_became_active":"2024-09-12T17:00:14.324051+0000","last_became_peered":"2024-09-12T17:00:14.324051+0000","last_unstale":"2024-09-12T18:14:10.802515+0000","last_undegraded":"2024-09-12T18:14:10.802515+0000","last_fullsized":"2024-09-12T18:14:10.802515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'55","last_scrub_stamp":"2024-09-12T18:14:10.802432+0000","last_deep_scrub":"264'55","last_deep_scrub_stamp":"2024-09-12T18:14:10.802432+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.802432+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:33.726378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":201,"num_write":77,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'343","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.030703+0000","last_change":"2024-09-12T18:14:00.030703+0000","last_active":"2024-09-12T18:14:00.030703+0000","last_peered":"2024-09-12T18:14:00.030703+0000","last_clean":"2024-09-12T18:14:00.030703+0000","last_became_active":"2024-09-12T17:00:12.314059+0000","last_became_peered":"2024-09-12T17:00:12.314059+0000","last_unstale":"2024-09-12T18:14:00.030703+0000","last_undegraded":"2024-09-12T18:14:00.030703+0000","last_fullsized":"2024-09-12T18:14:00.030703+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'343","last_scrub_stamp":"2024-09-12T18:14:00.030596+0000","last_deep_scrub":"264'343","last_deep_scrub_stamp":"2024-09-12T18:14:00.030596+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.030596+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:28.562910+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288647,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":67840,"num_write":1028,"num_write_kb":38572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'162","reported_seq":756,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.921850+0000","last_change":"2024-09-12T18:14:09.921850+0000","last_active":"2024-09-12T18:14:09.921850+0000","last_peered":"2024-09-12T18:14:09.921850+0000","last_clean":"2024-09-12T18:14:09.921850+0000","last_became_active":"2024-09-12T17:00:14.338503+0000","last_became_peered":"2024-09-12T17:00:14.338503+0000","last_unstale":"2024-09-12T18:14:09.921850+0000","last_undegraded":"2024-09-12T18:14:09.921850+0000","last_fullsized":"2024-09-12T18:14:09.921850+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'162","last_scrub_stamp":"2024-09-12T18:14:09.921753+0000","last_deep_scrub":"264'162","last_deep_scrub_stamp":"2024-09-12T18:14:09.921753+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.921753+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:14.082713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":567,"num_write":272,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'324","reported_seq":941,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.091077+0000","last_change":"2024-09-12T18:14:04.091077+0000","last_active":"2024-09-12T18:14:04.091077+0000","last_peered":"2024-09-12T18:14:04.091077+0000","last_clean":"2024-09-12T18:14:04.091077+0000","last_became_active":"2024-09-12T17:00:12.311933+0000","last_became_peered":"2024-09-12T17:00:12.311933+0000","last_unstale":"2024-09-12T18:14:04.091077+0000","last_undegraded":"2024-09-12T18:14:04.091077+0000","last_fullsized":"2024-09-12T18:14:04.091077+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-12T18:14:04.090966+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-12T18:14:04.090966+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.090966+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:50.074590+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262214,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":415,"num_read_kb":17784,"num_write":989,"num_write_kb":43947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'289","reported_seq":1010,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.097397+0000","last_change":"2024-09-12T18:14:09.097397+0000","last_active":"2024-09-12T18:14:09.097397+0000","last_peered":"2024-09-12T18:14:09.097397+0000","last_clean":"2024-09-12T18:14:09.097397+0000","last_became_active":"2024-09-12T17:00:14.319152+0000","last_became_peered":"2024-09-12T17:00:14.319152+0000","last_unstale":"2024-09-12T18:14:09.097397+0000","last_undegraded":"2024-09-12T18:14:09.097397+0000","last_fullsized":"2024-09-12T18:14:09.097397+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'289","last_scrub_stamp":"2024-09-12T18:14:09.097302+0000","last_deep_scrub":"264'289","last_deep_scrub_stamp":"2024-09-12T18:14:09.097302+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.097302+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:34.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1506,"num_read_kb":1343,"num_write":479,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'453","reported_seq":1124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.986981+0000","last_change":"2024-09-12T18:14:00.986981+0000","last_active":"2024-09-12T18:14:00.986981+0000","last_peered":"2024-09-12T18:14:00.986981+0000","last_clean":"2024-09-12T18:14:00.986981+0000","last_became_active":"2024-09-12T17:00:12.320948+0000","last_became_peered":"2024-09-12T17:00:12.320948+0000","last_unstale":"2024-09-12T18:14:00.986981+0000","last_undegraded":"2024-09-12T18:14:00.986981+0000","last_fullsized":"2024-09-12T18:14:00.986981+0000","mapping_epoch":24,"log_start":"264'400","ondisk_log_start":"264'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'453","last_scrub_stamp":"2024-09-12T18:14:00.986868+0000","last_deep_scrub":"264'453","last_deep_scrub_stamp":"2024-09-12T18:14:00.986868+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.986868+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:58.110493+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":626,"num_read_kb":23095,"num_write":1402,"num_write_kb":45480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'357","reported_seq":1098,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.184780+0000","last_change":"2024-09-12T18:14:10.184780+0000","last_active":"2024-09-12T18:14:10.184780+0000","last_peered":"2024-09-12T18:14:10.184780+0000","last_clean":"2024-09-12T18:14:10.184780+0000","last_became_active":"2024-09-12T17:00:14.331839+0000","last_became_peered":"2024-09-12T17:00:14.331839+0000","last_unstale":"2024-09-12T18:14:10.184780+0000","last_undegraded":"2024-09-12T18:14:10.184780+0000","last_fullsized":"2024-09-12T18:14:10.184780+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'357","last_scrub_stamp":"2024-09-12T18:14:10.184647+0000","last_deep_scrub":"264'357","last_deep_scrub_stamp":"2024-09-12T18:14:10.184647+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.184647+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:43.341571+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1691,"num_read_kb":1457,"num_write":527,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25753,"num_omap_keys":101,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'425","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.546147+0000","last_change":"2024-09-12T18:14:04.546047+0000","last_active":"2024-09-12T18:14:04.546147+0000","last_peered":"2024-09-12T18:14:04.546147+0000","last_clean":"2024-09-12T18:14:04.546147+0000","last_became_active":"2024-09-12T17:00:12.320094+0000","last_became_peered":"2024-09-12T17:00:12.320094+0000","last_unstale":"2024-09-12T18:14:04.546147+0000","last_undegraded":"2024-09-12T18:14:04.546147+0000","last_fullsized":"2024-09-12T18:14:04.546147+0000","mapping_epoch":24,"log_start":"264'400","ondisk_log_start":"264'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'425","last_scrub_stamp":"2024-09-12T18:14:04.545897+0000","last_deep_scrub":"264'425","last_deep_scrub_stamp":"2024-09-12T18:14:04.545897+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.545897+0000","objects_scrubbed":9,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:36.134235+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194332,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":632,"num_read_kb":22255,"num_write":1216,"num_write_kb":35121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'77","reported_seq":660,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.798944+0000","last_change":"2024-09-12T18:14:12.798944+0000","last_active":"2024-09-12T18:14:12.798944+0000","last_peered":"2024-09-12T18:14:12.798944+0000","last_clean":"2024-09-12T18:14:12.798944+0000","last_became_active":"2024-09-12T17:00:14.334965+0000","last_became_peered":"2024-09-12T17:00:14.334965+0000","last_unstale":"2024-09-12T18:14:12.798944+0000","last_undegraded":"2024-09-12T18:14:12.798944+0000","last_fullsized":"2024-09-12T18:14:12.798944+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'77","last_scrub_stamp":"2024-09-12T18:14:12.798856+0000","last_deep_scrub":"264'77","last_deep_scrub_stamp":"2024-09-12T18:14:12.798856+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.798856+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:20.717929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":336,"num_read_kb":283,"num_write":118,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'338","reported_seq":983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.017968+0000","last_change":"2024-09-12T18:14:02.017906+0000","last_active":"2024-09-12T18:14:02.017968+0000","last_peered":"2024-09-12T18:14:02.017968+0000","last_clean":"2024-09-12T18:14:02.017968+0000","last_became_active":"2024-09-12T17:00:12.321156+0000","last_became_peered":"2024-09-12T17:00:12.321156+0000","last_unstale":"2024-09-12T18:14:02.017968+0000","last_undegraded":"2024-09-12T18:14:02.017968+0000","last_fullsized":"2024-09-12T18:14:02.017968+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'338","last_scrub_stamp":"2024-09-12T18:14:02.017773+0000","last_deep_scrub":"264'338","last_deep_scrub_stamp":"2024-09-12T18:14:02.017773+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.017773+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:36.638383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170120,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":18612,"num_write":1036,"num_write_kb":25817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'177","reported_seq":803,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:25.089835+0000","last_change":"2024-09-12T18:14:25.089835+0000","last_active":"2024-09-12T18:14:25.089835+0000","last_peered":"2024-09-12T18:14:25.089835+0000","last_clean":"2024-09-12T18:14:25.089835+0000","last_became_active":"2024-09-12T17:00:14.322880+0000","last_became_peered":"2024-09-12T17:00:14.322880+0000","last_unstale":"2024-09-12T18:14:25.089835+0000","last_undegraded":"2024-09-12T18:14:25.089835+0000","last_fullsized":"2024-09-12T18:14:25.089835+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-12T18:14:25.089729+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-12T18:14:25.089729+0000","last_clean_scrub_stamp":"2024-09-12T18:14:25.089729+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:52.513915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":741,"num_read_kb":611,"num_write":268,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'393","reported_seq":1057,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.556524+0000","last_change":"2024-09-12T18:14:05.556462+0000","last_active":"2024-09-12T18:14:05.556524+0000","last_peered":"2024-09-12T18:14:05.556524+0000","last_clean":"2024-09-12T18:14:05.556524+0000","last_became_active":"2024-09-12T17:00:12.314707+0000","last_became_peered":"2024-09-12T17:00:12.314707+0000","last_unstale":"2024-09-12T18:14:05.556524+0000","last_undegraded":"2024-09-12T18:14:05.556524+0000","last_fullsized":"2024-09-12T18:14:05.556524+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'393","last_scrub_stamp":"2024-09-12T18:14:05.556338+0000","last_deep_scrub":"264'393","last_deep_scrub_stamp":"2024-09-12T18:14:05.556338+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.556338+0000","objects_scrubbed":7,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:07.321823+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590083,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":560,"num_read_kb":37012,"num_write":1300,"num_write_kb":41769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'170","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.829676+0000","last_change":"2024-09-12T18:14:11.829591+0000","last_active":"2024-09-12T18:14:11.829676+0000","last_peered":"2024-09-12T18:14:11.829676+0000","last_clean":"2024-09-12T18:14:11.829676+0000","last_became_active":"2024-09-12T17:00:14.324709+0000","last_became_peered":"2024-09-12T17:00:14.324709+0000","last_unstale":"2024-09-12T18:14:11.829676+0000","last_undegraded":"2024-09-12T18:14:11.829676+0000","last_fullsized":"2024-09-12T18:14:11.829676+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'170","last_scrub_stamp":"2024-09-12T18:14:11.829476+0000","last_deep_scrub":"264'170","last_deep_scrub_stamp":"2024-09-12T18:14:11.829476+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.829476+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:36.346842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":785,"num_read_kb":657,"num_write":242,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'303","reported_seq":950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.020131+0000","last_change":"2024-09-12T18:14:03.020070+0000","last_active":"2024-09-12T18:14:03.020131+0000","last_peered":"2024-09-12T18:14:03.020131+0000","last_clean":"2024-09-12T18:14:03.020131+0000","last_became_active":"2024-09-12T17:00:12.307159+0000","last_became_peered":"2024-09-12T17:00:12.307159+0000","last_unstale":"2024-09-12T18:14:03.020131+0000","last_undegraded":"2024-09-12T18:14:03.020131+0000","last_fullsized":"2024-09-12T18:14:03.020131+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'303","last_scrub_stamp":"2024-09-12T18:14:03.019965+0000","last_deep_scrub":"264'303","last_deep_scrub_stamp":"2024-09-12T18:14:03.019965+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.019965+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:43.348169+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":429,"num_read_kb":7363,"num_write":949,"num_write_kb":31388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'4088","reported_seq":4677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.194674+0000","last_change":"2024-09-12T18:14:12.194617+0000","last_active":"2024-09-12T18:14:12.194674+0000","last_peered":"2024-09-12T18:14:12.194674+0000","last_clean":"2024-09-12T18:14:12.194674+0000","last_became_active":"2024-09-12T17:00:14.327792+0000","last_became_peered":"2024-09-12T17:00:14.327792+0000","last_unstale":"2024-09-12T18:14:12.194674+0000","last_undegraded":"2024-09-12T18:14:12.194674+0000","last_fullsized":"2024-09-12T18:14:12.194674+0000","mapping_epoch":26,"log_start":"264'4000","ondisk_log_start":"264'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4088","last_scrub_stamp":"2024-09-12T18:14:12.194534+0000","last_deep_scrub":"264'4088","last_deep_scrub_stamp":"2024-09-12T18:14:12.194534+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.194534+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:07.058121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16430,"num_read_kb":13786,"num_write":6128,"num_write_kb":3057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'357","reported_seq":1019,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.049409+0000","last_change":"2024-09-12T18:14:01.049352+0000","last_active":"2024-09-12T18:14:01.049409+0000","last_peered":"2024-09-12T18:14:01.049409+0000","last_clean":"2024-09-12T18:14:01.049409+0000","last_became_active":"2024-09-12T17:00:12.311273+0000","last_became_peered":"2024-09-12T17:00:12.311273+0000","last_unstale":"2024-09-12T18:14:01.049409+0000","last_undegraded":"2024-09-12T18:14:01.049409+0000","last_fullsized":"2024-09-12T18:14:01.049409+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'357","last_scrub_stamp":"2024-09-12T18:14:01.049257+0000","last_deep_scrub":"264'357","last_deep_scrub_stamp":"2024-09-12T18:14:01.049257+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.049257+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:56.629359+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":481304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":502,"num_read_kb":37128,"num_write":1093,"num_write_kb":49312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'266","reported_seq":928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.145064+0000","last_change":"2024-09-12T18:14:09.144997+0000","last_active":"2024-09-12T18:14:09.145064+0000","last_peered":"2024-09-12T18:14:09.145064+0000","last_clean":"2024-09-12T18:14:09.145064+0000","last_became_active":"2024-09-12T17:00:14.318470+0000","last_became_peered":"2024-09-12T17:00:14.318470+0000","last_unstale":"2024-09-12T18:14:09.145064+0000","last_undegraded":"2024-09-12T18:14:09.145064+0000","last_fullsized":"2024-09-12T18:14:09.145064+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'266","last_scrub_stamp":"2024-09-12T18:14:09.144908+0000","last_deep_scrub":"264'266","last_deep_scrub_stamp":"2024-09-12T18:14:09.144908+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.144908+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:18.716492+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1277,"num_read_kb":1058,"num_write":468,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'351","reported_seq":1074,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.181495+0000","last_change":"2024-09-12T18:14:06.181495+0000","last_active":"2024-09-12T18:14:06.181495+0000","last_peered":"2024-09-12T18:14:06.181495+0000","last_clean":"2024-09-12T18:14:06.181495+0000","last_became_active":"2024-09-12T17:00:12.314371+0000","last_became_peered":"2024-09-12T17:00:12.314371+0000","last_unstale":"2024-09-12T18:14:06.181495+0000","last_undegraded":"2024-09-12T18:14:06.181495+0000","last_fullsized":"2024-09-12T18:14:06.181495+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'351","last_scrub_stamp":"2024-09-12T18:14:06.181390+0000","last_deep_scrub":"264'351","last_deep_scrub_stamp":"2024-09-12T18:14:06.181390+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.181390+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:08.888322+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655829,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":559,"num_read_kb":6257,"num_write":1103,"num_write_kb":25577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'129","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.963386+0000","last_change":"2024-09-12T18:14:12.963272+0000","last_active":"2024-09-12T18:14:12.963386+0000","last_peered":"2024-09-12T18:14:12.963386+0000","last_clean":"2024-09-12T18:14:12.963386+0000","last_became_active":"2024-09-12T17:00:14.339316+0000","last_became_peered":"2024-09-12T17:00:14.339316+0000","last_unstale":"2024-09-12T18:14:12.963386+0000","last_undegraded":"2024-09-12T18:14:12.963386+0000","last_fullsized":"2024-09-12T18:14:12.963386+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'129","last_scrub_stamp":"2024-09-12T18:14:12.963173+0000","last_deep_scrub":"264'129","last_deep_scrub_stamp":"2024-09-12T18:14:12.963173+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.963173+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:55.742662+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":538,"num_read_kb":439,"num_write":190,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'325","reported_seq":964,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.097022+0000","last_change":"2024-09-12T18:14:00.097022+0000","last_active":"2024-09-12T18:14:00.097022+0000","last_peered":"2024-09-12T18:14:00.097022+0000","last_clean":"2024-09-12T18:14:00.097022+0000","last_became_active":"2024-09-12T17:00:12.310157+0000","last_became_peered":"2024-09-12T17:00:12.310157+0000","last_unstale":"2024-09-12T18:14:00.097022+0000","last_undegraded":"2024-09-12T18:14:00.097022+0000","last_fullsized":"2024-09-12T18:14:00.097022+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'325","last_scrub_stamp":"2024-09-12T18:14:00.096895+0000","last_deep_scrub":"264'325","last_deep_scrub_stamp":"2024-09-12T18:14:00.096895+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.096895+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:51.639756+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1093042,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":459,"num_read_kb":8306,"num_write":1094,"num_write_kb":29458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'209","reported_seq":818,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.203502+0000","last_change":"2024-09-12T18:14:10.203419+0000","last_active":"2024-09-12T18:14:10.203502+0000","last_peered":"2024-09-12T18:14:10.203502+0000","last_clean":"2024-09-12T18:14:10.203502+0000","last_became_active":"2024-09-12T17:00:46.406426+0000","last_became_peered":"2024-09-12T17:00:46.406426+0000","last_unstale":"2024-09-12T18:14:10.203502+0000","last_undegraded":"2024-09-12T18:14:10.203502+0000","last_fullsized":"2024-09-12T18:14:10.203502+0000","mapping_epoch":37,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'209","last_scrub_stamp":"2024-09-12T18:14:10.203299+0000","last_deep_scrub":"264'209","last_deep_scrub_stamp":"2024-09-12T18:14:10.203299+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.203299+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:01.928198+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":857,"num_read_kb":696,"num_write":294,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":272,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'306","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.595386+0000","last_change":"2024-09-12T18:14:07.595386+0000","last_active":"2024-09-12T18:14:07.595386+0000","last_peered":"2024-09-12T18:14:07.595386+0000","last_clean":"2024-09-12T18:14:07.595386+0000","last_became_active":"2024-09-12T17:00:12.314251+0000","last_became_peered":"2024-09-12T17:00:12.314251+0000","last_unstale":"2024-09-12T18:14:07.595386+0000","last_undegraded":"2024-09-12T18:14:07.595386+0000","last_fullsized":"2024-09-12T18:14:07.595386+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'306","last_scrub_stamp":"2024-09-12T18:14:07.595274+0000","last_deep_scrub":"264'306","last_deep_scrub_stamp":"2024-09-12T18:14:07.595274+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.595274+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:45.280471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":403,"num_read_kb":8717,"num_write":971,"num_write_kb":22240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'314","reported_seq":1126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.571713+0000","last_change":"2024-09-12T18:14:08.571713+0000","last_active":"2024-09-12T18:14:08.571713+0000","last_peered":"2024-09-12T18:14:08.571713+0000","last_clean":"2024-09-12T18:14:08.571713+0000","last_became_active":"2024-09-12T17:00:12.318408+0000","last_became_peered":"2024-09-12T17:00:12.318408+0000","last_unstale":"2024-09-12T18:14:08.571713+0000","last_undegraded":"2024-09-12T18:14:08.571713+0000","last_fullsized":"2024-09-12T18:14:08.571713+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'314","last_scrub_stamp":"2024-09-12T18:14:08.571615+0000","last_deep_scrub":"264'314","last_deep_scrub_stamp":"2024-09-12T18:14:08.571615+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.571615+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:11.147120+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":853,"num_read_kb":6455,"num_write":1039,"num_write_kb":20037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'90","reported_seq":673,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.213953+0000","last_change":"2024-09-12T18:14:12.213953+0000","last_active":"2024-09-12T18:14:12.213953+0000","last_peered":"2024-09-12T18:14:12.213953+0000","last_clean":"2024-09-12T18:14:12.213953+0000","last_became_active":"2024-09-12T17:00:14.334494+0000","last_became_peered":"2024-09-12T17:00:14.334494+0000","last_unstale":"2024-09-12T18:14:12.213953+0000","last_undegraded":"2024-09-12T18:14:12.213953+0000","last_fullsized":"2024-09-12T18:14:12.213953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'90","last_scrub_stamp":"2024-09-12T18:14:12.213853+0000","last_deep_scrub":"264'90","last_deep_scrub_stamp":"2024-09-12T18:14:12.213853+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.213853+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:27.439976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":377,"num_read_kb":312,"num_write":145,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'354","reported_seq":999,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.047528+0000","last_change":"2024-09-12T18:14:01.047528+0000","last_active":"2024-09-12T18:14:01.047528+0000","last_peered":"2024-09-12T18:14:01.047528+0000","last_clean":"2024-09-12T18:14:01.047528+0000","last_became_active":"2024-09-12T17:00:12.314988+0000","last_became_peered":"2024-09-12T17:00:12.314988+0000","last_unstale":"2024-09-12T18:14:01.047528+0000","last_undegraded":"2024-09-12T18:14:01.047528+0000","last_fullsized":"2024-09-12T18:14:01.047528+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'354","last_scrub_stamp":"2024-09-12T18:14:01.047428+0000","last_deep_scrub":"264'354","last_deep_scrub_stamp":"2024-09-12T18:14:01.047428+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.047428+0000","objects_scrubbed":6,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:54.071159+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":45801,"num_write":1031,"num_write_kb":31559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'222","reported_seq":885,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:15.436011+0000","last_change":"2024-09-12T18:14:15.436011+0000","last_active":"2024-09-12T18:14:15.436011+0000","last_peered":"2024-09-12T18:14:15.436011+0000","last_clean":"2024-09-12T18:14:15.436011+0000","last_became_active":"2024-09-12T17:00:14.333107+0000","last_became_peered":"2024-09-12T17:00:14.333107+0000","last_unstale":"2024-09-12T18:14:15.436011+0000","last_undegraded":"2024-09-12T18:14:15.436011+0000","last_fullsized":"2024-09-12T18:14:15.436011+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'222","last_scrub_stamp":"2024-09-12T18:14:15.435914+0000","last_deep_scrub":"264'222","last_deep_scrub_stamp":"2024-09-12T18:14:15.435914+0000","last_clean_scrub_stamp":"2024-09-12T18:14:15.435914+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:16.388139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":970,"num_read_kb":803,"num_write":364,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5638,"num_read_kb":3956,"num_write":1906,"num_write_kb":804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4660,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1078,"ondisk_log_size":1078,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":16256,"num_read_kb":15929,"num_write":16738,"num_write_kb":4889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2934,"num_omap_keys":19,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1758,"ondisk_log_size":1758,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":565,"ondisk_log_size":565,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1559950,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":19041,"num_read_kb":39761,"num_write":15891,"num_write_kb":11979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685112,"num_omap_keys":1570,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2081,"ondisk_log_size":2081,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2432,"num_read_kb":2899,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102836,"num_read_kb":85763,"num_write":37242,"num_write_kb":18813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43842,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3669,"ondisk_log_size":3669,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":76932281,"num_objects":387,"num_object_clones":0,"num_object_copies":774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":387,"num_whiteouts":0,"num_read":36237,"num_read_kb":1844237,"num_write":71508,"num_write_kb":1970689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":155025408,"data_stored":153864562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3422,"ondisk_log_size":3422,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":154912,"num_write":182,"num_write_kb":116389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":158387,"num_write":182,"num_write_kb":116389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424510343,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76020,"kb_used_data":22628,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94295820,"statfs":{"total":96636764160,"available":96558919680,"internally_reserved":0,"allocated":23171072,"data_stored":21619631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510345,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119664,"kb_used_data":8032,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94252176,"statfs":{"total":96636764160,"available":96514228224,"internally_reserved":0,"allocated":8224768,"data_stored":6647389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543045,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257492,"kb_used_data":27780,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94114348,"statfs":{"total":96636764160,"available":96373092352,"internally_reserved":0,"allocated":28446720,"data_stored":26727116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235207114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543047,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":241664,"kb_used_data":16112,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94130176,"statfs":{"total":96636764160,"available":96389300224,"internally_reserved":0,"allocated":16498688,"data_stored":14904367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":230947270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543047,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150784,"kb_used_data":25264,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94221056,"statfs":{"total":96636764160,"available":96482361344,"internally_reserved":0,"allocated":25870336,"data_stored":24131043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128514501},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543047,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275728,"kb_used_data":32128,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94096112,"statfs":{"total":96636764160,"available":96354418688,"internally_reserved":0,"allocated":32899072,"data_stored":31197660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":249428423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543045,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229924,"kb_used_data":18260,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94141916,"statfs":{"total":96636764160,"available":96401321984,"internally_reserved":0,"allocated":18698240,"data_stored":17001849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":216725957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575748,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98204,"kb_used_data":30924,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94273636,"statfs":{"total":96636764160,"available":96536203264,"internally_reserved":0,"allocated":31666176,"data_stored":30017021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14422016,"data_stored":14261258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4595712,"data_stored":4499422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19558400,"data_stored":19471135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29220864,"data_stored":29046128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28045312,"data_stored":27867248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22167552,"data_stored":21980545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12857344,"data_stored":12753756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24158208,"data_stored":23985070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":4704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:14:38.944 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.944 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.944 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.945 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.945 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.945 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.945 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.945 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.945 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.945 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.945 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.946 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.946 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.946 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.946 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.946 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.946 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.946 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.946 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.947 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.947 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.947 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.947 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.947 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.947 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.947 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.947 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.947 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.947 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.948 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.948 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.948 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.948 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.948 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.948 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.948 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.948 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.949 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.949 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.949 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.949 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.949 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.949 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.949 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.949 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.950 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.950 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.950 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.950 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.950 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.950 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.950 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.950 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.951 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.951 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.951 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.951 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.951 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.951 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.951 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.951 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.952 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.952 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:16:10.456322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.952 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.952 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.952 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.952 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.952 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.952 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.953 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.953 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.953 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.953 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.953 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.953 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.953 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.953 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.954 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:20:29.507345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.954 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.954 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.954 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.956 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:00:21.333142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=0, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:38.957 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:14:58.959 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:14:59.315 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:14:59.326 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-12T18:14:59.329 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":2511,"stamp":"2024-09-12T18:14:58.662636+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":79100730,"num_objects":719,"num_object_clones":0,"num_object_copies":1438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":719,"num_whiteouts":0,"num_read":182830,"num_read_kb":2305911,"num_write":143792,"num_write_kb":2241608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":741888,"num_omap_keys":1796,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12928,"ondisk_log_size":12928,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1449480,"kb_used_data":181128,"kb_used_omap":12,"kb_used_meta":1268211,"kb_avail":753525240,"statfs":{"total":773094113280,"available":771609845760,"internally_reserved":0,"allocated":185475072,"data_stored":172246076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1298648624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":752,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005721"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:45.404401+0000","last_change":"2024-09-12T18:14:45.404401+0000","last_active":"2024-09-12T18:14:45.404401+0000","last_peered":"2024-09-12T18:14:45.404401+0000","last_clean":"2024-09-12T18:14:45.404401+0000","last_became_active":"2024-09-12T17:39:05.922265+0000","last_became_peered":"2024-09-12T17:39:05.922265+0000","last_unstale":"2024-09-12T18:14:45.404401+0000","last_undegraded":"2024-09-12T18:14:45.404401+0000","last_fullsized":"2024-09-12T18:14:45.404401+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:45.404313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:45.404313+0000","last_clean_scrub_stamp":"2024-09-12T18:14:45.404313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:50.489912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'9","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:42.413873+0000","last_change":"2024-09-12T18:14:42.413873+0000","last_active":"2024-09-12T18:14:42.413873+0000","last_peered":"2024-09-12T18:14:42.413873+0000","last_clean":"2024-09-12T18:14:42.413873+0000","last_became_active":"2024-09-12T17:20:34.559027+0000","last_became_peered":"2024-09-12T17:20:34.559027+0000","last_unstale":"2024-09-12T18:14:42.413873+0000","last_undegraded":"2024-09-12T18:14:42.413873+0000","last_fullsized":"2024-09-12T18:14:42.413873+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-12T18:14:42.413793+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-12T18:14:42.413793+0000","last_clean_scrub_stamp":"2024-09-12T18:14:42.413793+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:08.699266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10240,"num_write":14,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"261'5","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:45.823876+0000","last_change":"2024-09-12T18:14:45.823876+0000","last_active":"2024-09-12T18:14:45.823876+0000","last_peered":"2024-09-12T18:14:45.823876+0000","last_clean":"2024-09-12T18:14:45.823876+0000","last_became_active":"2024-09-12T17:20:30.533235+0000","last_became_peered":"2024-09-12T17:20:30.533235+0000","last_unstale":"2024-09-12T18:14:45.823876+0000","last_undegraded":"2024-09-12T18:14:45.823876+0000","last_fullsized":"2024-09-12T18:14:45.823876+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T18:14:45.823766+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T18:14:45.823766+0000","last_clean_scrub_stamp":"2024-09-12T18:14:45.823766+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:56.080267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4098,"num_write":10,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'40","reported_seq":184,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:40.299788+0000","last_change":"2024-09-12T18:14:40.299788+0000","last_active":"2024-09-12T18:14:40.299788+0000","last_peered":"2024-09-12T18:14:40.299788+0000","last_clean":"2024-09-12T18:14:40.299788+0000","last_became_active":"2024-09-12T17:16:11.491724+0000","last_became_peered":"2024-09-12T17:16:11.491724+0000","last_unstale":"2024-09-12T18:14:40.299788+0000","last_undegraded":"2024-09-12T18:14:40.299788+0000","last_fullsized":"2024-09-12T18:14:40.299788+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-09-12T18:14:40.299689+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-09-12T18:14:40.299689+0000","last_clean_scrub_stamp":"2024-09-12T18:14:40.299689+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:48.075858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":153,"num_write":69,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:26.082849+0000","last_change":"2024-09-12T18:14:26.082849+0000","last_active":"2024-09-12T18:14:26.082849+0000","last_peered":"2024-09-12T18:14:26.082849+0000","last_clean":"2024-09-12T18:14:26.082849+0000","last_became_active":"2024-09-12T17:39:05.929533+0000","last_became_peered":"2024-09-12T17:39:05.929533+0000","last_unstale":"2024-09-12T18:14:26.082849+0000","last_undegraded":"2024-09-12T18:14:26.082849+0000","last_fullsized":"2024-09-12T18:14:26.082849+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:26.082750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:26.082750+0000","last_clean_scrub_stamp":"2024-09-12T18:14:26.082750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:34.051588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"261'8","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:43.871636+0000","last_change":"2024-09-12T18:14:43.871636+0000","last_active":"2024-09-12T18:14:43.871636+0000","last_peered":"2024-09-12T18:14:43.871636+0000","last_clean":"2024-09-12T18:14:43.871636+0000","last_became_active":"2024-09-12T17:20:34.558970+0000","last_became_peered":"2024-09-12T17:20:34.558970+0000","last_unstale":"2024-09-12T18:14:43.871636+0000","last_undegraded":"2024-09-12T18:14:43.871636+0000","last_fullsized":"2024-09-12T18:14:43.871636+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-12T18:14:43.871539+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-12T18:14:43.871539+0000","last_clean_scrub_stamp":"2024-09-12T18:14:43.871539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:47.381399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8194,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:28.199935+0000","last_change":"2024-09-12T18:14:28.199935+0000","last_active":"2024-09-12T18:14:28.199935+0000","last_peered":"2024-09-12T18:14:28.199935+0000","last_clean":"2024-09-12T18:14:28.199935+0000","last_became_active":"2024-09-12T17:20:30.539358+0000","last_became_peered":"2024-09-12T17:20:30.539358+0000","last_unstale":"2024-09-12T18:14:28.199935+0000","last_undegraded":"2024-09-12T18:14:28.199935+0000","last_fullsized":"2024-09-12T18:14:28.199935+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T18:14:28.199850+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T18:14:28.199850+0000","last_clean_scrub_stamp":"2024-09-12T18:14:28.199850+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:29.477097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8242,"num_write":10,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'68","reported_seq":259,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.118963+0000","last_change":"2024-09-12T18:14:17.118895+0000","last_active":"2024-09-12T18:14:17.118963+0000","last_peered":"2024-09-12T18:14:17.118963+0000","last_clean":"2024-09-12T18:14:17.118963+0000","last_became_active":"2024-09-12T17:16:11.491610+0000","last_became_peered":"2024-09-12T17:16:11.491610+0000","last_unstale":"2024-09-12T18:14:17.118963+0000","last_undegraded":"2024-09-12T18:14:17.118963+0000","last_fullsized":"2024-09-12T18:14:17.118963+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'68","last_scrub_stamp":"2024-09-12T18:14:17.118797+0000","last_deep_scrub":"264'68","last_deep_scrub_stamp":"2024-09-12T18:14:17.118797+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.118797+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:50.247233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":357,"num_read_kb":265,"num_write":116,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:35.263486+0000","last_change":"2024-09-12T18:14:35.263486+0000","last_active":"2024-09-12T18:14:35.263486+0000","last_peered":"2024-09-12T18:14:35.263486+0000","last_clean":"2024-09-12T18:14:35.263486+0000","last_became_active":"2024-09-12T17:39:05.921846+0000","last_became_peered":"2024-09-12T17:39:05.921846+0000","last_unstale":"2024-09-12T18:14:35.263486+0000","last_undegraded":"2024-09-12T18:14:35.263486+0000","last_fullsized":"2024-09-12T18:14:35.263486+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:35.263401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:35.263401+0000","last_clean_scrub_stamp":"2024-09-12T18:14:35.263401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:24.277742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"261'8","reported_seq":75,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:50.228939+0000","last_change":"2024-09-12T18:14:50.228939+0000","last_active":"2024-09-12T18:14:50.228939+0000","last_peered":"2024-09-12T18:14:50.228939+0000","last_clean":"2024-09-12T18:14:50.228939+0000","last_became_active":"2024-09-12T17:20:34.615550+0000","last_became_peered":"2024-09-12T17:20:34.615550+0000","last_unstale":"2024-09-12T18:14:50.228939+0000","last_undegraded":"2024-09-12T18:14:50.228939+0000","last_fullsized":"2024-09-12T18:14:50.228939+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-12T18:14:50.228839+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-12T18:14:50.228839+0000","last_clean_scrub_stamp":"2024-09-12T18:14:50.228839+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:15.108359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":6148,"num_write":8,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'9","reported_seq":81,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:20.060061+0000","last_change":"2024-09-12T18:14:20.059934+0000","last_active":"2024-09-12T18:14:20.060061+0000","last_peered":"2024-09-12T18:14:20.060061+0000","last_clean":"2024-09-12T18:14:20.060061+0000","last_became_active":"2024-09-12T17:20:30.535182+0000","last_became_peered":"2024-09-12T17:20:30.535182+0000","last_unstale":"2024-09-12T18:14:20.060061+0000","last_undegraded":"2024-09-12T18:14:20.060061+0000","last_fullsized":"2024-09-12T18:14:20.060061+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-12T18:14:20.059838+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-12T18:14:20.059838+0000","last_clean_scrub_stamp":"2024-09-12T18:14:20.059838+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:29.555332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":17410,"num_write":14,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'51","reported_seq":210,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:41.286980+0000","last_change":"2024-09-12T18:14:41.286980+0000","last_active":"2024-09-12T18:14:41.286980+0000","last_peered":"2024-09-12T18:14:41.286980+0000","last_clean":"2024-09-12T18:14:41.286980+0000","last_became_active":"2024-09-12T17:16:11.493043+0000","last_became_peered":"2024-09-12T17:16:11.493043+0000","last_unstale":"2024-09-12T18:14:41.286980+0000","last_undegraded":"2024-09-12T18:14:41.286980+0000","last_fullsized":"2024-09-12T18:14:41.286980+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'51","last_scrub_stamp":"2024-09-12T18:14:41.286882+0000","last_deep_scrub":"264'51","last_deep_scrub_stamp":"2024-09-12T18:14:41.286882+0000","last_clean_scrub_stamp":"2024-09-12T18:14:41.286882+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:14.044443+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":193,"num_write":93,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:54.846974+0000","last_change":"2024-09-12T18:14:54.846974+0000","last_active":"2024-09-12T18:14:54.846974+0000","last_peered":"2024-09-12T18:14:54.846974+0000","last_clean":"2024-09-12T18:14:54.846974+0000","last_became_active":"2024-09-12T17:39:05.931122+0000","last_became_peered":"2024-09-12T17:39:05.931122+0000","last_unstale":"2024-09-12T18:14:54.846974+0000","last_undegraded":"2024-09-12T18:14:54.846974+0000","last_fullsized":"2024-09-12T18:14:54.846974+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:54.846873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:54.846873+0000","last_clean_scrub_stamp":"2024-09-12T18:14:54.846873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:28.937600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'9","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:53.880734+0000","last_change":"2024-09-12T18:14:53.880734+0000","last_active":"2024-09-12T18:14:53.880734+0000","last_peered":"2024-09-12T18:14:53.880734+0000","last_clean":"2024-09-12T18:14:53.880734+0000","last_became_active":"2024-09-12T17:20:34.612720+0000","last_became_peered":"2024-09-12T17:20:34.612720+0000","last_unstale":"2024-09-12T18:14:53.880734+0000","last_undegraded":"2024-09-12T18:14:53.880734+0000","last_fullsized":"2024-09-12T18:14:53.880734+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-12T18:14:53.880619+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-12T18:14:53.880619+0000","last_clean_scrub_stamp":"2024-09-12T18:14:53.880619+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:52.674845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":14336,"num_write":14,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'8","reported_seq":78,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:38.893965+0000","last_change":"2024-09-12T18:14:38.893899+0000","last_active":"2024-09-12T18:14:38.893965+0000","last_peered":"2024-09-12T18:14:38.893965+0000","last_clean":"2024-09-12T18:14:38.893965+0000","last_became_active":"2024-09-12T17:20:30.534068+0000","last_became_peered":"2024-09-12T17:20:30.534068+0000","last_unstale":"2024-09-12T18:14:38.893965+0000","last_undegraded":"2024-09-12T18:14:38.893965+0000","last_fullsized":"2024-09-12T18:14:38.893965+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T18:14:38.893812+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T18:14:38.893812+0000","last_clean_scrub_stamp":"2024-09-12T18:14:38.893812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:22.228878+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'25","reported_seq":132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:41.857869+0000","last_change":"2024-09-12T18:14:41.857869+0000","last_active":"2024-09-12T18:14:41.857869+0000","last_peered":"2024-09-12T18:14:41.857869+0000","last_clean":"2024-09-12T18:14:41.857869+0000","last_became_active":"2024-09-12T17:16:11.489860+0000","last_became_peered":"2024-09-12T17:16:11.489860+0000","last_unstale":"2024-09-12T18:14:41.857869+0000","last_undegraded":"2024-09-12T18:14:41.857869+0000","last_fullsized":"2024-09-12T18:14:41.857869+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'25","last_scrub_stamp":"2024-09-12T18:14:41.857750+0000","last_deep_scrub":"264'25","last_deep_scrub_stamp":"2024-09-12T18:14:41.857750+0000","last_clean_scrub_stamp":"2024-09-12T18:14:41.857750+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:36.971513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:56.843036+0000","last_change":"2024-09-12T18:14:56.843036+0000","last_active":"2024-09-12T18:14:56.843036+0000","last_peered":"2024-09-12T18:14:56.843036+0000","last_clean":"2024-09-12T18:14:56.843036+0000","last_became_active":"2024-09-12T17:39:05.931089+0000","last_became_peered":"2024-09-12T17:39:05.931089+0000","last_unstale":"2024-09-12T18:14:56.843036+0000","last_undegraded":"2024-09-12T18:14:56.843036+0000","last_fullsized":"2024-09-12T18:14:56.843036+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:56.842944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:56.842944+0000","last_clean_scrub_stamp":"2024-09-12T18:14:56.842944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:03.812081+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"264'2","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:38.357246+0000","last_change":"2024-09-12T18:14:38.357246+0000","last_active":"2024-09-12T18:14:38.357246+0000","last_peered":"2024-09-12T18:14:38.357246+0000","last_clean":"2024-09-12T18:14:38.357246+0000","last_became_active":"2024-09-12T17:20:34.557008+0000","last_became_peered":"2024-09-12T17:20:34.557008+0000","last_unstale":"2024-09-12T18:14:38.357246+0000","last_undegraded":"2024-09-12T18:14:38.357246+0000","last_fullsized":"2024-09-12T18:14:38.357246+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:38.357161+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:38.357161+0000","last_clean_scrub_stamp":"2024-09-12T18:14:38.357161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:21.973922+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'7","reported_seq":73,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:47.217738+0000","last_change":"2024-09-12T18:14:47.217738+0000","last_active":"2024-09-12T18:14:47.217738+0000","last_peered":"2024-09-12T18:14:47.217738+0000","last_clean":"2024-09-12T18:14:47.217738+0000","last_became_active":"2024-09-12T17:20:30.538361+0000","last_became_peered":"2024-09-12T17:20:30.538361+0000","last_unstale":"2024-09-12T18:14:47.217738+0000","last_undegraded":"2024-09-12T18:14:47.217738+0000","last_fullsized":"2024-09-12T18:14:47.217738+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'7","last_scrub_stamp":"2024-09-12T18:14:47.217649+0000","last_deep_scrub":"261'7","last_deep_scrub_stamp":"2024-09-12T18:14:47.217649+0000","last_clean_scrub_stamp":"2024-09-12T18:14:47.217649+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:54.284299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4098,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'48","reported_seq":190,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:40.877415+0000","last_change":"2024-09-12T18:14:40.877415+0000","last_active":"2024-09-12T18:14:40.877415+0000","last_peered":"2024-09-12T18:14:40.877415+0000","last_clean":"2024-09-12T18:14:40.877415+0000","last_became_active":"2024-09-12T17:16:11.487771+0000","last_became_peered":"2024-09-12T17:16:11.487771+0000","last_unstale":"2024-09-12T18:14:40.877415+0000","last_undegraded":"2024-09-12T18:14:40.877415+0000","last_fullsized":"2024-09-12T18:14:40.877415+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'48","last_scrub_stamp":"2024-09-12T18:14:40.877325+0000","last_deep_scrub":"264'48","last_deep_scrub_stamp":"2024-09-12T18:14:40.877325+0000","last_clean_scrub_stamp":"2024-09-12T18:14:40.877325+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:39.342368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":161,"num_write":84,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:35.286275+0000","last_change":"2024-09-12T18:14:35.286275+0000","last_active":"2024-09-12T18:14:35.286275+0000","last_peered":"2024-09-12T18:14:35.286275+0000","last_clean":"2024-09-12T18:14:35.286275+0000","last_became_active":"2024-09-12T17:39:05.921661+0000","last_became_peered":"2024-09-12T17:39:05.921661+0000","last_unstale":"2024-09-12T18:14:35.286275+0000","last_undegraded":"2024-09-12T18:14:35.286275+0000","last_fullsized":"2024-09-12T18:14:35.286275+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:35.286189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:35.286189+0000","last_clean_scrub_stamp":"2024-09-12T18:14:35.286189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:53.675989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'3","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:33.284489+0000","last_change":"2024-09-12T18:14:33.284489+0000","last_active":"2024-09-12T18:14:33.284489+0000","last_peered":"2024-09-12T18:14:33.284489+0000","last_clean":"2024-09-12T18:14:33.284489+0000","last_became_active":"2024-09-12T17:20:34.555047+0000","last_became_peered":"2024-09-12T17:20:34.555047+0000","last_unstale":"2024-09-12T18:14:33.284489+0000","last_undegraded":"2024-09-12T18:14:33.284489+0000","last_fullsized":"2024-09-12T18:14:33.284489+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:14:33.284407+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:14:33.284407+0000","last_clean_scrub_stamp":"2024-09-12T18:14:33.284407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:39.812819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'4","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:36.890680+0000","last_change":"2024-09-12T18:14:36.890680+0000","last_active":"2024-09-12T18:14:36.890680+0000","last_peered":"2024-09-12T18:14:36.890680+0000","last_clean":"2024-09-12T18:14:36.890680+0000","last_became_active":"2024-09-12T17:20:30.528029+0000","last_became_peered":"2024-09-12T17:20:30.528029+0000","last_unstale":"2024-09-12T18:14:36.890680+0000","last_undegraded":"2024-09-12T18:14:36.890680+0000","last_fullsized":"2024-09-12T18:14:36.890680+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:14:36.890596+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:14:36.890596+0000","last_clean_scrub_stamp":"2024-09-12T18:14:36.890596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:47.450753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'34","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:25.251913+0000","last_change":"2024-09-12T18:14:25.251913+0000","last_active":"2024-09-12T18:14:25.251913+0000","last_peered":"2024-09-12T18:14:25.251913+0000","last_clean":"2024-09-12T18:14:25.251913+0000","last_became_active":"2024-09-12T17:16:11.490952+0000","last_became_peered":"2024-09-12T17:16:11.490952+0000","last_unstale":"2024-09-12T18:14:25.251913+0000","last_undegraded":"2024-09-12T18:14:25.251913+0000","last_fullsized":"2024-09-12T18:14:25.251913+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-09-12T18:14:25.251827+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-09-12T18:14:25.251827+0000","last_clean_scrub_stamp":"2024-09-12T18:14:25.251827+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:49.122335+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":115,"num_write":60,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'2","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:53.380859+0000","last_change":"2024-09-12T18:14:53.380859+0000","last_active":"2024-09-12T18:14:53.380859+0000","last_peered":"2024-09-12T18:14:53.380859+0000","last_clean":"2024-09-12T18:14:53.380859+0000","last_became_active":"2024-09-12T17:39:05.928959+0000","last_became_peered":"2024-09-12T17:39:05.928959+0000","last_unstale":"2024-09-12T18:14:53.380859+0000","last_undegraded":"2024-09-12T18:14:53.380859+0000","last_fullsized":"2024-09-12T18:14:53.380859+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:53.380765+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:53.380765+0000","last_clean_scrub_stamp":"2024-09-12T18:14:53.380765+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:34.272875+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:32.263068+0000","last_change":"2024-09-12T18:14:32.263068+0000","last_active":"2024-09-12T18:14:32.263068+0000","last_peered":"2024-09-12T18:14:32.263068+0000","last_clean":"2024-09-12T18:14:32.263068+0000","last_became_active":"2024-09-12T17:20:34.552180+0000","last_became_peered":"2024-09-12T17:20:34.552180+0000","last_unstale":"2024-09-12T18:14:32.263068+0000","last_undegraded":"2024-09-12T18:14:32.263068+0000","last_fullsized":"2024-09-12T18:14:32.263068+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:32.262977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:32.262977+0000","last_clean_scrub_stamp":"2024-09-12T18:14:32.262977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:29.463521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:44.825732+0000","last_change":"2024-09-12T18:14:44.825732+0000","last_active":"2024-09-12T18:14:44.825732+0000","last_peered":"2024-09-12T18:14:44.825732+0000","last_clean":"2024-09-12T18:14:44.825732+0000","last_became_active":"2024-09-12T17:20:30.535001+0000","last_became_peered":"2024-09-12T17:20:30.535001+0000","last_unstale":"2024-09-12T18:14:44.825732+0000","last_undegraded":"2024-09-12T18:14:44.825732+0000","last_fullsized":"2024-09-12T18:14:44.825732+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:44.825629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:44.825629+0000","last_clean_scrub_stamp":"2024-09-12T18:14:44.825629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:16.612630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'14","reported_seq":99,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:39.320748+0000","last_change":"2024-09-12T18:14:39.320748+0000","last_active":"2024-09-12T18:14:39.320748+0000","last_peered":"2024-09-12T18:14:39.320748+0000","last_clean":"2024-09-12T18:14:39.320748+0000","last_became_active":"2024-09-12T17:16:11.477940+0000","last_became_peered":"2024-09-12T17:16:11.477940+0000","last_unstale":"2024-09-12T18:14:39.320748+0000","last_undegraded":"2024-09-12T18:14:39.320748+0000","last_fullsized":"2024-09-12T18:14:39.320748+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'14","last_scrub_stamp":"2024-09-12T18:14:39.320655+0000","last_deep_scrub":"264'14","last_deep_scrub_stamp":"2024-09-12T18:14:39.320655+0000","last_clean_scrub_stamp":"2024-09-12T18:14:39.320655+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:44.563002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":35,"num_write":34,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:54.360880+0000","last_change":"2024-09-12T18:14:54.360880+0000","last_active":"2024-09-12T18:14:54.360880+0000","last_peered":"2024-09-12T18:14:54.360880+0000","last_clean":"2024-09-12T18:14:54.360880+0000","last_became_active":"2024-09-12T17:39:05.930694+0000","last_became_peered":"2024-09-12T17:39:05.930694+0000","last_unstale":"2024-09-12T18:14:54.360880+0000","last_undegraded":"2024-09-12T18:14:54.360880+0000","last_fullsized":"2024-09-12T18:14:54.360880+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:54.360785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:54.360785+0000","last_clean_scrub_stamp":"2024-09-12T18:14:54.360785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:26.422302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"261'4","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:51.860116+0000","last_change":"2024-09-12T18:14:51.860116+0000","last_active":"2024-09-12T18:14:51.860116+0000","last_peered":"2024-09-12T18:14:51.860116+0000","last_clean":"2024-09-12T18:14:51.860116+0000","last_became_active":"2024-09-12T17:20:34.552726+0000","last_became_peered":"2024-09-12T17:20:34.552726+0000","last_unstale":"2024-09-12T18:14:51.860116+0000","last_undegraded":"2024-09-12T18:14:51.860116+0000","last_fullsized":"2024-09-12T18:14:51.860116+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-12T18:14:51.860023+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-12T18:14:51.860023+0000","last_clean_scrub_stamp":"2024-09-12T18:14:51.860023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:22.961646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'3","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:45.297314+0000","last_change":"2024-09-12T18:14:45.297314+0000","last_active":"2024-09-12T18:14:45.297314+0000","last_peered":"2024-09-12T18:14:45.297314+0000","last_clean":"2024-09-12T18:14:45.297314+0000","last_became_active":"2024-09-12T17:20:30.538942+0000","last_became_peered":"2024-09-12T17:20:30.538942+0000","last_unstale":"2024-09-12T18:14:45.297314+0000","last_undegraded":"2024-09-12T18:14:45.297314+0000","last_fullsized":"2024-09-12T18:14:45.297314+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:14:45.297210+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:14:45.297210+0000","last_clean_scrub_stamp":"2024-09-12T18:14:45.297210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:07.187278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'32","reported_seq":153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:25.248962+0000","last_change":"2024-09-12T18:14:25.248962+0000","last_active":"2024-09-12T18:14:25.248962+0000","last_peered":"2024-09-12T18:14:25.248962+0000","last_clean":"2024-09-12T18:14:25.248962+0000","last_became_active":"2024-09-12T17:16:11.487242+0000","last_became_peered":"2024-09-12T17:16:11.487242+0000","last_unstale":"2024-09-12T18:14:25.248962+0000","last_undegraded":"2024-09-12T18:14:25.248962+0000","last_fullsized":"2024-09-12T18:14:25.248962+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'32","last_scrub_stamp":"2024-09-12T18:14:25.248876+0000","last_deep_scrub":"264'32","last_deep_scrub_stamp":"2024-09-12T18:14:25.248876+0000","last_clean_scrub_stamp":"2024-09-12T18:14:25.248876+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:35.934364+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":114,"num_write":62,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:34.302331+0000","last_change":"2024-09-12T18:14:34.302331+0000","last_active":"2024-09-12T18:14:34.302331+0000","last_peered":"2024-09-12T18:14:34.302331+0000","last_clean":"2024-09-12T18:14:34.302331+0000","last_became_active":"2024-09-12T17:39:05.924899+0000","last_became_peered":"2024-09-12T17:39:05.924899+0000","last_unstale":"2024-09-12T18:14:34.302331+0000","last_undegraded":"2024-09-12T18:14:34.302331+0000","last_fullsized":"2024-09-12T18:14:34.302331+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:34.302228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:34.302228+0000","last_clean_scrub_stamp":"2024-09-12T18:14:34.302228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:52.230167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'5","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:50.882572+0000","last_change":"2024-09-12T18:14:50.882572+0000","last_active":"2024-09-12T18:14:50.882572+0000","last_peered":"2024-09-12T18:14:50.882572+0000","last_clean":"2024-09-12T18:14:50.882572+0000","last_became_active":"2024-09-12T17:20:34.610374+0000","last_became_peered":"2024-09-12T17:20:34.610374+0000","last_unstale":"2024-09-12T18:14:50.882572+0000","last_undegraded":"2024-09-12T18:14:50.882572+0000","last_fullsized":"2024-09-12T18:14:50.882572+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T18:14:50.882462+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T18:14:50.882462+0000","last_clean_scrub_stamp":"2024-09-12T18:14:50.882462+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:07.231078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1142,"num_write":10,"num_write_kb":1595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"264'3","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:40.354820+0000","last_change":"2024-09-12T18:14:40.354820+0000","last_active":"2024-09-12T18:14:40.354820+0000","last_peered":"2024-09-12T18:14:40.354820+0000","last_clean":"2024-09-12T18:14:40.354820+0000","last_became_active":"2024-09-12T17:20:30.526672+0000","last_became_peered":"2024-09-12T17:20:30.526672+0000","last_unstale":"2024-09-12T18:14:40.354820+0000","last_undegraded":"2024-09-12T18:14:40.354820+0000","last_fullsized":"2024-09-12T18:14:40.354820+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:14:40.354725+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:14:40.354725+0000","last_clean_scrub_stamp":"2024-09-12T18:14:40.354725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:13.858857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'19","reported_seq":118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:38.329697+0000","last_change":"2024-09-12T18:14:38.329697+0000","last_active":"2024-09-12T18:14:38.329697+0000","last_peered":"2024-09-12T18:14:38.329697+0000","last_clean":"2024-09-12T18:14:38.329697+0000","last_became_active":"2024-09-12T17:16:11.481351+0000","last_became_peered":"2024-09-12T17:16:11.481351+0000","last_unstale":"2024-09-12T18:14:38.329697+0000","last_undegraded":"2024-09-12T18:14:38.329697+0000","last_fullsized":"2024-09-12T18:14:38.329697+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'19","last_scrub_stamp":"2024-09-12T18:14:38.329609+0000","last_deep_scrub":"264'19","last_deep_scrub_stamp":"2024-09-12T18:14:38.329609+0000","last_clean_scrub_stamp":"2024-09-12T18:14:38.329609+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:02.772844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":68,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:24.093216+0000","last_change":"2024-09-12T18:14:24.093216+0000","last_active":"2024-09-12T18:14:24.093216+0000","last_peered":"2024-09-12T18:14:24.093216+0000","last_clean":"2024-09-12T18:14:24.093216+0000","last_became_active":"2024-09-12T17:39:05.928497+0000","last_became_peered":"2024-09-12T17:39:05.928497+0000","last_unstale":"2024-09-12T18:14:24.093216+0000","last_undegraded":"2024-09-12T18:14:24.093216+0000","last_fullsized":"2024-09-12T18:14:24.093216+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:24.093130+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:24.093130+0000","last_clean_scrub_stamp":"2024-09-12T18:14:24.093130+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:34.010186+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'2","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:49.923740+0000","last_change":"2024-09-12T18:14:49.923740+0000","last_active":"2024-09-12T18:14:49.923740+0000","last_peered":"2024-09-12T18:14:49.923740+0000","last_clean":"2024-09-12T18:14:49.923740+0000","last_became_active":"2024-09-12T17:20:34.610260+0000","last_became_peered":"2024-09-12T17:20:34.610260+0000","last_unstale":"2024-09-12T18:14:49.923740+0000","last_undegraded":"2024-09-12T18:14:49.923740+0000","last_fullsized":"2024-09-12T18:14:49.923740+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:49.923643+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:49.923643+0000","last_clean_scrub_stamp":"2024-09-12T18:14:49.923643+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:49.938332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'14","reported_seq":84,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:42.400411+0000","last_change":"2024-09-12T18:14:42.400411+0000","last_active":"2024-09-12T18:14:42.400411+0000","last_peered":"2024-09-12T18:14:42.400411+0000","last_clean":"2024-09-12T18:14:42.400411+0000","last_became_active":"2024-09-12T17:20:30.527032+0000","last_became_peered":"2024-09-12T17:20:30.527032+0000","last_unstale":"2024-09-12T18:14:42.400411+0000","last_undegraded":"2024-09-12T18:14:42.400411+0000","last_fullsized":"2024-09-12T18:14:42.400411+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'14","last_scrub_stamp":"2024-09-12T18:14:42.400318+0000","last_deep_scrub":"264'14","last_deep_scrub_stamp":"2024-09-12T18:14:42.400318+0000","last_clean_scrub_stamp":"2024-09-12T18:14:42.400318+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:59.512457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":13314,"num_write":24,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"0'0","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:39.875082+0000","last_change":"2024-09-12T18:14:39.875082+0000","last_active":"2024-09-12T18:14:39.875082+0000","last_peered":"2024-09-12T18:14:39.875082+0000","last_clean":"2024-09-12T18:14:39.875082+0000","last_became_active":"2024-09-12T17:16:11.494493+0000","last_became_peered":"2024-09-12T17:16:11.494493+0000","last_unstale":"2024-09-12T18:14:39.875082+0000","last_undegraded":"2024-09-12T18:14:39.875082+0000","last_fullsized":"2024-09-12T18:14:39.875082+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:39.874988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:39.874988+0000","last_clean_scrub_stamp":"2024-09-12T18:14:39.874988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:32.983646+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:52.393869+0000","last_change":"2024-09-12T18:14:52.393869+0000","last_active":"2024-09-12T18:14:52.393869+0000","last_peered":"2024-09-12T18:14:52.393869+0000","last_clean":"2024-09-12T18:14:52.393869+0000","last_became_active":"2024-09-12T17:39:05.926388+0000","last_became_peered":"2024-09-12T17:39:05.926388+0000","last_unstale":"2024-09-12T18:14:52.393869+0000","last_undegraded":"2024-09-12T18:14:52.393869+0000","last_fullsized":"2024-09-12T18:14:52.393869+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:52.393776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:52.393776+0000","last_clean_scrub_stamp":"2024-09-12T18:14:52.393776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:46.750583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"261'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:11:21.849742+0000","last_change":"2024-09-12T17:20:34.615918+0000","last_active":"2024-09-12T18:11:21.849742+0000","last_peered":"2024-09-12T18:11:21.849742+0000","last_clean":"2024-09-12T18:11:21.849742+0000","last_became_active":"2024-09-12T17:20:34.615468+0000","last_became_peered":"2024-09-12T17:20:34.615468+0000","last_unstale":"2024-09-12T18:11:21.849742+0000","last_undegraded":"2024-09-12T18:11:21.849742+0000","last_fullsized":"2024-09-12T18:11:21.849742+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:20:33.535111+0000","last_clean_scrub_stamp":"2024-09-12T17:20:33.535111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:26.561082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:19.104971+0000","last_change":"2024-09-12T18:14:19.104971+0000","last_active":"2024-09-12T18:14:19.104971+0000","last_peered":"2024-09-12T18:14:19.104971+0000","last_clean":"2024-09-12T18:14:19.104971+0000","last_became_active":"2024-09-12T17:20:30.533436+0000","last_became_peered":"2024-09-12T17:20:30.533436+0000","last_unstale":"2024-09-12T18:14:19.104971+0000","last_undegraded":"2024-09-12T18:14:19.104971+0000","last_fullsized":"2024-09-12T18:14:19.104971+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:19.104877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:19.104877+0000","last_clean_scrub_stamp":"2024-09-12T18:14:19.104877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:57.618987+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'18","reported_seq":115,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:16.123968+0000","last_change":"2024-09-12T18:14:16.123968+0000","last_active":"2024-09-12T18:14:16.123968+0000","last_peered":"2024-09-12T18:14:16.123968+0000","last_clean":"2024-09-12T18:14:16.123968+0000","last_became_active":"2024-09-12T17:16:11.488588+0000","last_became_peered":"2024-09-12T17:16:11.488588+0000","last_unstale":"2024-09-12T18:14:16.123968+0000","last_undegraded":"2024-09-12T18:14:16.123968+0000","last_fullsized":"2024-09-12T18:14:16.123968+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'18","last_scrub_stamp":"2024-09-12T18:14:16.123879+0000","last_deep_scrub":"264'18","last_deep_scrub_stamp":"2024-09-12T18:14:16.123879+0000","last_clean_scrub_stamp":"2024-09-12T18:14:16.123879+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:29.796727+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:43.458781+0000","last_change":"2024-09-12T18:14:43.458781+0000","last_active":"2024-09-12T18:14:43.458781+0000","last_peered":"2024-09-12T18:14:43.458781+0000","last_clean":"2024-09-12T18:14:43.458781+0000","last_became_active":"2024-09-12T17:39:05.922973+0000","last_became_peered":"2024-09-12T17:39:05.922973+0000","last_unstale":"2024-09-12T18:14:43.458781+0000","last_undegraded":"2024-09-12T18:14:43.458781+0000","last_fullsized":"2024-09-12T18:14:43.458781+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:43.458685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:43.458685+0000","last_clean_scrub_stamp":"2024-09-12T18:14:43.458685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:09.244788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:42.864282+0000","last_change":"2024-09-12T18:14:42.864282+0000","last_active":"2024-09-12T18:14:42.864282+0000","last_peered":"2024-09-12T18:14:42.864282+0000","last_clean":"2024-09-12T18:14:42.864282+0000","last_became_active":"2024-09-12T17:20:34.554893+0000","last_became_peered":"2024-09-12T17:20:34.554893+0000","last_unstale":"2024-09-12T18:14:42.864282+0000","last_undegraded":"2024-09-12T18:14:42.864282+0000","last_fullsized":"2024-09-12T18:14:42.864282+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:42.864188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:42.864188+0000","last_clean_scrub_stamp":"2024-09-12T18:14:42.864188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:32.276778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'6","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:44.329140+0000","last_change":"2024-09-12T18:14:44.329140+0000","last_active":"2024-09-12T18:14:44.329140+0000","last_peered":"2024-09-12T18:14:44.329140+0000","last_clean":"2024-09-12T18:14:44.329140+0000","last_became_active":"2024-09-12T17:20:30.535226+0000","last_became_peered":"2024-09-12T17:20:30.535226+0000","last_unstale":"2024-09-12T18:14:44.329140+0000","last_undegraded":"2024-09-12T18:14:44.329140+0000","last_fullsized":"2024-09-12T18:14:44.329140+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T18:14:44.329026+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T18:14:44.329026+0000","last_clean_scrub_stamp":"2024-09-12T18:14:44.329026+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:49.983790+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":6,"num_write_kb":3074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'26","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:37.368433+0000","last_change":"2024-09-12T18:14:37.368381+0000","last_active":"2024-09-12T18:14:37.368433+0000","last_peered":"2024-09-12T18:14:37.368433+0000","last_clean":"2024-09-12T18:14:37.368433+0000","last_became_active":"2024-09-12T17:16:11.491240+0000","last_became_peered":"2024-09-12T17:16:11.491240+0000","last_unstale":"2024-09-12T18:14:37.368433+0000","last_undegraded":"2024-09-12T18:14:37.368433+0000","last_fullsized":"2024-09-12T18:14:37.368433+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'26","last_scrub_stamp":"2024-09-12T18:14:37.368275+0000","last_deep_scrub":"264'26","last_deep_scrub_stamp":"2024-09-12T18:14:37.368275+0000","last_clean_scrub_stamp":"2024-09-12T18:14:37.368275+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:28.300827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":97,"num_write":43,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:10:31.844211+0000","last_change":"2024-09-12T17:39:05.932135+0000","last_active":"2024-09-12T18:10:31.844211+0000","last_peered":"2024-09-12T18:10:31.844211+0000","last_clean":"2024-09-12T18:10:31.844211+0000","last_became_active":"2024-09-12T17:39:05.931841+0000","last_became_peered":"2024-09-12T17:39:05.931841+0000","last_unstale":"2024-09-12T18:10:31.844211+0000","last_undegraded":"2024-09-12T18:10:31.844211+0000","last_fullsized":"2024-09-12T18:10:31.844211+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:39:04.900972+0000","last_clean_scrub_stamp":"2024-09-12T17:39:04.900972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:08.525616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:37.351090+0000","last_change":"2024-09-12T18:14:37.351090+0000","last_active":"2024-09-12T18:14:37.351090+0000","last_peered":"2024-09-12T18:14:37.351090+0000","last_clean":"2024-09-12T18:14:37.351090+0000","last_became_active":"2024-09-12T17:20:34.560497+0000","last_became_peered":"2024-09-12T17:20:34.560497+0000","last_unstale":"2024-09-12T18:14:37.351090+0000","last_undegraded":"2024-09-12T18:14:37.351090+0000","last_fullsized":"2024-09-12T18:14:37.351090+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:37.350984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:37.350984+0000","last_clean_scrub_stamp":"2024-09-12T18:14:37.350984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:49.013668+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"261'7","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:35.900552+0000","last_change":"2024-09-12T18:14:35.900552+0000","last_active":"2024-09-12T18:14:35.900552+0000","last_peered":"2024-09-12T18:14:35.900552+0000","last_clean":"2024-09-12T18:14:35.900552+0000","last_became_active":"2024-09-12T17:20:30.535358+0000","last_became_peered":"2024-09-12T17:20:30.535358+0000","last_unstale":"2024-09-12T18:14:35.900552+0000","last_undegraded":"2024-09-12T18:14:35.900552+0000","last_fullsized":"2024-09-12T18:14:35.900552+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'7","last_scrub_stamp":"2024-09-12T18:14:35.900447+0000","last_deep_scrub":"261'7","last_deep_scrub_stamp":"2024-09-12T18:14:35.900447+0000","last_clean_scrub_stamp":"2024-09-12T18:14:35.900447+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:42.300227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":15362,"num_write":12,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'12","reported_seq":99,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:35.440402+0000","last_change":"2024-09-12T18:14:35.440402+0000","last_active":"2024-09-12T18:14:35.440402+0000","last_peered":"2024-09-12T18:14:35.440402+0000","last_clean":"2024-09-12T18:14:35.440402+0000","last_became_active":"2024-09-12T17:16:11.489897+0000","last_became_peered":"2024-09-12T17:16:11.489897+0000","last_unstale":"2024-09-12T18:14:35.440402+0000","last_undegraded":"2024-09-12T18:14:35.440402+0000","last_fullsized":"2024-09-12T18:14:35.440402+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-09-12T18:14:35.440323+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-09-12T18:14:35.440323+0000","last_clean_scrub_stamp":"2024-09-12T18:14:35.440323+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:01.721656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:55.338067+0000","last_change":"2024-09-12T18:14:55.338067+0000","last_active":"2024-09-12T18:14:55.338067+0000","last_peered":"2024-09-12T18:14:55.338067+0000","last_clean":"2024-09-12T18:14:55.338067+0000","last_became_active":"2024-09-12T17:39:05.926766+0000","last_became_peered":"2024-09-12T17:39:05.926766+0000","last_unstale":"2024-09-12T18:14:55.338067+0000","last_undegraded":"2024-09-12T18:14:55.338067+0000","last_fullsized":"2024-09-12T18:14:55.338067+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:55.337964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:55.337964+0000","last_clean_scrub_stamp":"2024-09-12T18:14:55.337964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:56.775425+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"264'2","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:33.279759+0000","last_change":"2024-09-12T18:14:33.279759+0000","last_active":"2024-09-12T18:14:33.279759+0000","last_peered":"2024-09-12T18:14:33.279759+0000","last_clean":"2024-09-12T18:14:33.279759+0000","last_became_active":"2024-09-12T17:20:34.558970+0000","last_became_peered":"2024-09-12T17:20:34.558970+0000","last_unstale":"2024-09-12T18:14:33.279759+0000","last_undegraded":"2024-09-12T18:14:33.279759+0000","last_fullsized":"2024-09-12T18:14:33.279759+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:33.279662+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:33.279662+0000","last_clean_scrub_stamp":"2024-09-12T18:14:33.279662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:33.229244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'4","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:42.893159+0000","last_change":"2024-09-12T18:14:42.893159+0000","last_active":"2024-09-12T18:14:42.893159+0000","last_peered":"2024-09-12T18:14:42.893159+0000","last_clean":"2024-09-12T18:14:42.893159+0000","last_became_active":"2024-09-12T17:20:30.535761+0000","last_became_peered":"2024-09-12T17:20:30.535761+0000","last_unstale":"2024-09-12T18:14:42.893159+0000","last_undegraded":"2024-09-12T18:14:42.893159+0000","last_fullsized":"2024-09-12T18:14:42.893159+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:14:42.893065+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:14:42.893065+0000","last_clean_scrub_stamp":"2024-09-12T18:14:42.893065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:04.991142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8196,"num_write":4,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'42","reported_seq":184,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:37.282667+0000","last_change":"2024-09-12T18:14:37.282667+0000","last_active":"2024-09-12T18:14:37.282667+0000","last_peered":"2024-09-12T18:14:37.282667+0000","last_clean":"2024-09-12T18:14:37.282667+0000","last_became_active":"2024-09-12T17:16:11.487923+0000","last_became_peered":"2024-09-12T17:16:11.487923+0000","last_unstale":"2024-09-12T18:14:37.282667+0000","last_undegraded":"2024-09-12T18:14:37.282667+0000","last_fullsized":"2024-09-12T18:14:37.282667+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'42","last_scrub_stamp":"2024-09-12T18:14:37.282577+0000","last_deep_scrub":"264'42","last_deep_scrub_stamp":"2024-09-12T18:14:37.282577+0000","last_clean_scrub_stamp":"2024-09-12T18:14:37.282577+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:37.971018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":152,"num_write":79,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:54.339140+0000","last_change":"2024-09-12T18:14:54.339140+0000","last_active":"2024-09-12T18:14:54.339140+0000","last_peered":"2024-09-12T18:14:54.339140+0000","last_clean":"2024-09-12T18:14:54.339140+0000","last_became_active":"2024-09-12T17:39:05.921257+0000","last_became_peered":"2024-09-12T17:39:05.921257+0000","last_unstale":"2024-09-12T18:14:54.339140+0000","last_undegraded":"2024-09-12T18:14:54.339140+0000","last_fullsized":"2024-09-12T18:14:54.339140+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:54.339048+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:54.339048+0000","last_clean_scrub_stamp":"2024-09-12T18:14:54.339048+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:25.869485+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'4","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:48.912380+0000","last_change":"2024-09-12T18:14:48.912380+0000","last_active":"2024-09-12T18:14:48.912380+0000","last_peered":"2024-09-12T18:14:48.912380+0000","last_clean":"2024-09-12T18:14:48.912380+0000","last_became_active":"2024-09-12T17:20:34.553659+0000","last_became_peered":"2024-09-12T17:20:34.553659+0000","last_unstale":"2024-09-12T18:14:48.912380+0000","last_undegraded":"2024-09-12T18:14:48.912380+0000","last_fullsized":"2024-09-12T18:14:48.912380+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:14:48.912283+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:14:48.912283+0000","last_clean_scrub_stamp":"2024-09-12T18:14:48.912283+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:36.145195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":52,"num_write":4,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:29.308211+0000","last_change":"2024-09-12T18:14:29.308211+0000","last_active":"2024-09-12T18:14:29.308211+0000","last_peered":"2024-09-12T18:14:29.308211+0000","last_clean":"2024-09-12T18:14:29.308211+0000","last_became_active":"2024-09-12T17:20:30.534878+0000","last_became_peered":"2024-09-12T17:20:30.534878+0000","last_unstale":"2024-09-12T18:14:29.308211+0000","last_undegraded":"2024-09-12T18:14:29.308211+0000","last_fullsized":"2024-09-12T18:14:29.308211+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:29.308129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:29.308129+0000","last_clean_scrub_stamp":"2024-09-12T18:14:29.308129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:55.168954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'93","reported_seq":353,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:37.847533+0000","last_change":"2024-09-12T18:14:37.847533+0000","last_active":"2024-09-12T18:14:37.847533+0000","last_peered":"2024-09-12T18:14:37.847533+0000","last_clean":"2024-09-12T18:14:37.847533+0000","last_became_active":"2024-09-12T17:16:11.489044+0000","last_became_peered":"2024-09-12T17:16:11.489044+0000","last_unstale":"2024-09-12T18:14:37.847533+0000","last_undegraded":"2024-09-12T18:14:37.847533+0000","last_fullsized":"2024-09-12T18:14:37.847533+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'93","last_scrub_stamp":"2024-09-12T18:14:37.847447+0000","last_deep_scrub":"264'93","last_deep_scrub_stamp":"2024-09-12T18:14:37.847447+0000","last_clean_scrub_stamp":"2024-09-12T18:14:37.847447+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:13.908555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":552,"num_read_kb":376,"num_write":139,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4212,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'2","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:52.872374+0000","last_change":"2024-09-12T18:14:52.872374+0000","last_active":"2024-09-12T18:14:52.872374+0000","last_peered":"2024-09-12T18:14:52.872374+0000","last_clean":"2024-09-12T18:14:52.872374+0000","last_became_active":"2024-09-12T17:39:05.932617+0000","last_became_peered":"2024-09-12T17:39:05.932617+0000","last_unstale":"2024-09-12T18:14:52.872374+0000","last_undegraded":"2024-09-12T18:14:52.872374+0000","last_fullsized":"2024-09-12T18:14:52.872374+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:52.872274+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:52.872274+0000","last_clean_scrub_stamp":"2024-09-12T18:14:52.872274+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:59.039413+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"261'5","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:31.300183+0000","last_change":"2024-09-12T18:14:31.300183+0000","last_active":"2024-09-12T18:14:31.300183+0000","last_peered":"2024-09-12T18:14:31.300183+0000","last_clean":"2024-09-12T18:14:31.300183+0000","last_became_active":"2024-09-12T17:20:34.559024+0000","last_became_peered":"2024-09-12T17:20:34.559024+0000","last_unstale":"2024-09-12T18:14:31.300183+0000","last_undegraded":"2024-09-12T18:14:31.300183+0000","last_fullsized":"2024-09-12T18:14:31.300183+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T18:14:31.300097+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T18:14:31.300097+0000","last_clean_scrub_stamp":"2024-09-12T18:14:31.300097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:19.729710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'6","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:39.334151+0000","last_change":"2024-09-12T18:14:39.334151+0000","last_active":"2024-09-12T18:14:39.334151+0000","last_peered":"2024-09-12T18:14:39.334151+0000","last_clean":"2024-09-12T18:14:39.334151+0000","last_became_active":"2024-09-12T17:20:30.534298+0000","last_became_peered":"2024-09-12T17:20:30.534298+0000","last_unstale":"2024-09-12T18:14:39.334151+0000","last_undegraded":"2024-09-12T18:14:39.334151+0000","last_fullsized":"2024-09-12T18:14:39.334151+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T18:14:39.334067+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T18:14:39.334067+0000","last_clean_scrub_stamp":"2024-09-12T18:14:39.334067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:24.059173+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'39","reported_seq":171,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:43.849572+0000","last_change":"2024-09-12T18:14:43.849572+0000","last_active":"2024-09-12T18:14:43.849572+0000","last_peered":"2024-09-12T18:14:43.849572+0000","last_clean":"2024-09-12T18:14:43.849572+0000","last_became_active":"2024-09-12T17:16:11.489085+0000","last_became_peered":"2024-09-12T17:16:11.489085+0000","last_unstale":"2024-09-12T18:14:43.849572+0000","last_undegraded":"2024-09-12T18:14:43.849572+0000","last_fullsized":"2024-09-12T18:14:43.849572+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'39","last_scrub_stamp":"2024-09-12T18:14:43.849477+0000","last_deep_scrub":"264'39","last_deep_scrub_stamp":"2024-09-12T18:14:43.849477+0000","last_clean_scrub_stamp":"2024-09-12T18:14:43.849477+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:18.464822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":137,"num_write":73,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:21.066230+0000","last_change":"2024-09-12T18:14:21.066230+0000","last_active":"2024-09-12T18:14:21.066230+0000","last_peered":"2024-09-12T18:14:21.066230+0000","last_clean":"2024-09-12T18:14:21.066230+0000","last_became_active":"2024-09-12T17:39:05.928320+0000","last_became_peered":"2024-09-12T17:39:05.928320+0000","last_unstale":"2024-09-12T18:14:21.066230+0000","last_undegraded":"2024-09-12T18:14:21.066230+0000","last_fullsized":"2024-09-12T18:14:21.066230+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:21.066130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:21.066130+0000","last_clean_scrub_stamp":"2024-09-12T18:14:21.066130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:24.159619+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"261'5","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:44.862931+0000","last_change":"2024-09-12T18:14:44.862931+0000","last_active":"2024-09-12T18:14:44.862931+0000","last_peered":"2024-09-12T18:14:44.862931+0000","last_clean":"2024-09-12T18:14:44.862931+0000","last_became_active":"2024-09-12T17:20:34.553407+0000","last_became_peered":"2024-09-12T17:20:34.553407+0000","last_unstale":"2024-09-12T18:14:44.862931+0000","last_undegraded":"2024-09-12T18:14:44.862931+0000","last_fullsized":"2024-09-12T18:14:44.862931+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T18:14:44.862835+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T18:14:44.862835+0000","last_clean_scrub_stamp":"2024-09-12T18:14:44.862835+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:25.637914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'7","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:41.404873+0000","last_change":"2024-09-12T18:14:41.404873+0000","last_active":"2024-09-12T18:14:41.404873+0000","last_peered":"2024-09-12T18:14:41.404873+0000","last_clean":"2024-09-12T18:14:41.404873+0000","last_became_active":"2024-09-12T17:20:30.524670+0000","last_became_peered":"2024-09-12T17:20:30.524670+0000","last_unstale":"2024-09-12T18:14:41.404873+0000","last_undegraded":"2024-09-12T18:14:41.404873+0000","last_fullsized":"2024-09-12T18:14:41.404873+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-12T18:14:41.404779+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-12T18:14:41.404779+0000","last_clean_scrub_stamp":"2024-09-12T18:14:41.404779+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:13.064906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4667,"num_write":12,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'33","reported_seq":154,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:38.862439+0000","last_change":"2024-09-12T18:14:38.862388+0000","last_active":"2024-09-12T18:14:38.862439+0000","last_peered":"2024-09-12T18:14:38.862439+0000","last_clean":"2024-09-12T18:14:38.862439+0000","last_became_active":"2024-09-12T17:16:11.486986+0000","last_became_peered":"2024-09-12T17:16:11.486986+0000","last_unstale":"2024-09-12T18:14:38.862439+0000","last_undegraded":"2024-09-12T18:14:38.862439+0000","last_fullsized":"2024-09-12T18:14:38.862439+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-09-12T18:14:38.862316+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-09-12T18:14:38.862316+0000","last_clean_scrub_stamp":"2024-09-12T18:14:38.862316+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:42.639458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":108,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:49.375189+0000","last_change":"2024-09-12T18:14:49.375189+0000","last_active":"2024-09-12T18:14:49.375189+0000","last_peered":"2024-09-12T18:14:49.375189+0000","last_clean":"2024-09-12T18:14:49.375189+0000","last_became_active":"2024-09-12T17:39:05.927578+0000","last_became_peered":"2024-09-12T17:39:05.927578+0000","last_unstale":"2024-09-12T18:14:49.375189+0000","last_undegraded":"2024-09-12T18:14:49.375189+0000","last_fullsized":"2024-09-12T18:14:49.375189+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:49.375098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:49.375098+0000","last_clean_scrub_stamp":"2024-09-12T18:14:49.375098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:07.026617+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:47.904643+0000","last_change":"2024-09-12T18:14:47.904643+0000","last_active":"2024-09-12T18:14:47.904643+0000","last_peered":"2024-09-12T18:14:47.904643+0000","last_clean":"2024-09-12T18:14:47.904643+0000","last_became_active":"2024-09-12T17:20:34.552569+0000","last_became_peered":"2024-09-12T17:20:34.552569+0000","last_unstale":"2024-09-12T18:14:47.904643+0000","last_undegraded":"2024-09-12T18:14:47.904643+0000","last_fullsized":"2024-09-12T18:14:47.904643+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:47.904542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:47.904542+0000","last_clean_scrub_stamp":"2024-09-12T18:14:47.904542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:43.342578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:22.115770+0000","last_change":"2024-09-12T18:14:22.115718+0000","last_active":"2024-09-12T18:14:22.115770+0000","last_peered":"2024-09-12T18:14:22.115770+0000","last_clean":"2024-09-12T18:14:22.115770+0000","last_became_active":"2024-09-12T17:20:30.538157+0000","last_became_peered":"2024-09-12T17:20:30.538157+0000","last_unstale":"2024-09-12T18:14:22.115770+0000","last_undegraded":"2024-09-12T18:14:22.115770+0000","last_fullsized":"2024-09-12T18:14:22.115770+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:22.115629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:22.115629+0000","last_clean_scrub_stamp":"2024-09-12T18:14:22.115629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:25.621456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'29","reported_seq":147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:36.380873+0000","last_change":"2024-09-12T18:14:36.380810+0000","last_active":"2024-09-12T18:14:36.380873+0000","last_peered":"2024-09-12T18:14:36.380873+0000","last_clean":"2024-09-12T18:14:36.380873+0000","last_became_active":"2024-09-12T17:16:11.487998+0000","last_became_peered":"2024-09-12T17:16:11.487998+0000","last_unstale":"2024-09-12T18:14:36.380873+0000","last_undegraded":"2024-09-12T18:14:36.380873+0000","last_fullsized":"2024-09-12T18:14:36.380873+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-12T18:14:36.380714+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-12T18:14:36.380714+0000","last_clean_scrub_stamp":"2024-09-12T18:14:36.380714+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:45.043463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:34.241251+0000","last_change":"2024-09-12T18:14:34.241251+0000","last_active":"2024-09-12T18:14:34.241251+0000","last_peered":"2024-09-12T18:14:34.241251+0000","last_clean":"2024-09-12T18:14:34.241251+0000","last_became_active":"2024-09-12T17:39:05.921008+0000","last_became_peered":"2024-09-12T17:39:05.921008+0000","last_unstale":"2024-09-12T18:14:34.241251+0000","last_undegraded":"2024-09-12T18:14:34.241251+0000","last_fullsized":"2024-09-12T18:14:34.241251+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:34.241154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:34.241154+0000","last_clean_scrub_stamp":"2024-09-12T18:14:34.241154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:44.562900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'2","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:32.305309+0000","last_change":"2024-09-12T18:14:32.305227+0000","last_active":"2024-09-12T18:14:32.305309+0000","last_peered":"2024-09-12T18:14:32.305309+0000","last_clean":"2024-09-12T18:14:32.305309+0000","last_became_active":"2024-09-12T17:20:34.615689+0000","last_became_peered":"2024-09-12T17:20:34.615689+0000","last_unstale":"2024-09-12T18:14:32.305309+0000","last_undegraded":"2024-09-12T18:14:32.305309+0000","last_fullsized":"2024-09-12T18:14:32.305309+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:32.305124+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:32.305124+0000","last_clean_scrub_stamp":"2024-09-12T18:14:32.305124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:47.888594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'4","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:46.254076+0000","last_change":"2024-09-12T18:14:46.254076+0000","last_active":"2024-09-12T18:14:46.254076+0000","last_peered":"2024-09-12T18:14:46.254076+0000","last_clean":"2024-09-12T18:14:46.254076+0000","last_became_active":"2024-09-12T17:20:30.536917+0000","last_became_peered":"2024-09-12T17:20:30.536917+0000","last_unstale":"2024-09-12T18:14:46.254076+0000","last_undegraded":"2024-09-12T18:14:46.254076+0000","last_fullsized":"2024-09-12T18:14:46.254076+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:14:46.253987+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:14:46.253987+0000","last_clean_scrub_stamp":"2024-09-12T18:14:46.253987+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:46.239759+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'41","reported_seq":177,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:24.202227+0000","last_change":"2024-09-12T18:14:24.202169+0000","last_active":"2024-09-12T18:14:24.202227+0000","last_peered":"2024-09-12T18:14:24.202227+0000","last_clean":"2024-09-12T18:14:24.202227+0000","last_became_active":"2024-09-12T17:16:11.488252+0000","last_became_peered":"2024-09-12T17:16:11.488252+0000","last_unstale":"2024-09-12T18:14:24.202227+0000","last_undegraded":"2024-09-12T18:14:24.202227+0000","last_fullsized":"2024-09-12T18:14:24.202227+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-09-12T18:14:24.202082+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-09-12T18:14:24.202082+0000","last_clean_scrub_stamp":"2024-09-12T18:14:24.202082+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:26.021742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":141,"num_write":74,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:48.413887+0000","last_change":"2024-09-12T18:14:48.413887+0000","last_active":"2024-09-12T18:14:48.413887+0000","last_peered":"2024-09-12T18:14:48.413887+0000","last_clean":"2024-09-12T18:14:48.413887+0000","last_became_active":"2024-09-12T17:39:05.925589+0000","last_became_peered":"2024-09-12T17:39:05.925589+0000","last_unstale":"2024-09-12T18:14:48.413887+0000","last_undegraded":"2024-09-12T18:14:48.413887+0000","last_fullsized":"2024-09-12T18:14:48.413887+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:48.413803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:48.413803+0000","last_clean_scrub_stamp":"2024-09-12T18:14:48.413803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:09.395540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'11","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:46.871913+0000","last_change":"2024-09-12T18:14:46.871913+0000","last_active":"2024-09-12T18:14:46.871913+0000","last_peered":"2024-09-12T18:14:46.871913+0000","last_clean":"2024-09-12T18:14:46.871913+0000","last_became_active":"2024-09-12T17:20:34.560319+0000","last_became_peered":"2024-09-12T17:20:34.560319+0000","last_unstale":"2024-09-12T18:14:46.871913+0000","last_undegraded":"2024-09-12T18:14:46.871913+0000","last_fullsized":"2024-09-12T18:14:46.871913+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-09-12T18:14:46.871809+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-09-12T18:14:46.871809+0000","last_clean_scrub_stamp":"2024-09-12T18:14:46.871809+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:09.420084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15462,"num_write":16,"num_write_kb":7218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'2","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:27.217351+0000","last_change":"2024-09-12T18:14:27.217277+0000","last_active":"2024-09-12T18:14:27.217351+0000","last_peered":"2024-09-12T18:14:27.217351+0000","last_clean":"2024-09-12T18:14:27.217351+0000","last_became_active":"2024-09-12T17:20:30.531384+0000","last_became_peered":"2024-09-12T17:20:30.531384+0000","last_unstale":"2024-09-12T18:14:27.217351+0000","last_undegraded":"2024-09-12T18:14:27.217351+0000","last_fullsized":"2024-09-12T18:14:27.217351+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:27.217186+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:27.217186+0000","last_clean_scrub_stamp":"2024-09-12T18:14:27.217186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:29.758742+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'7","reported_seq":85,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:14.091723+0000","last_change":"2024-09-12T18:14:14.091620+0000","last_active":"2024-09-12T18:14:14.091723+0000","last_peered":"2024-09-12T18:14:14.091723+0000","last_clean":"2024-09-12T18:14:14.091723+0000","last_became_active":"2024-09-12T17:16:11.486098+0000","last_became_peered":"2024-09-12T17:16:11.486098+0000","last_unstale":"2024-09-12T18:14:14.091723+0000","last_undegraded":"2024-09-12T18:14:14.091723+0000","last_fullsized":"2024-09-12T18:14:14.091723+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-12T18:14:14.091515+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-12T18:14:14.091515+0000","last_clean_scrub_stamp":"2024-09-12T18:14:14.091515+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:08.093165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:55.803446+0000","last_change":"2024-09-12T18:14:55.803446+0000","last_active":"2024-09-12T18:14:55.803446+0000","last_peered":"2024-09-12T18:14:55.803446+0000","last_clean":"2024-09-12T18:14:55.803446+0000","last_became_active":"2024-09-12T17:39:05.925637+0000","last_became_peered":"2024-09-12T17:39:05.925637+0000","last_unstale":"2024-09-12T18:14:55.803446+0000","last_undegraded":"2024-09-12T18:14:55.803446+0000","last_fullsized":"2024-09-12T18:14:55.803446+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:55.803351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:55.803351+0000","last_clean_scrub_stamp":"2024-09-12T18:14:55.803351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:11.955698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:39.851322+0000","last_change":"2024-09-12T18:14:39.851260+0000","last_active":"2024-09-12T18:14:39.851322+0000","last_peered":"2024-09-12T18:14:39.851322+0000","last_clean":"2024-09-12T18:14:39.851322+0000","last_became_active":"2024-09-12T17:20:47.581310+0000","last_became_peered":"2024-09-12T17:20:47.581310+0000","last_unstale":"2024-09-12T18:14:39.851322+0000","last_undegraded":"2024-09-12T18:14:39.851322+0000","last_fullsized":"2024-09-12T18:14:39.851322+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:14:39.851164+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:14:39.851164+0000","last_clean_scrub_stamp":"2024-09-12T18:14:39.851164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:09.889327+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:42.287196+0000","last_change":"2024-09-12T18:14:42.287196+0000","last_active":"2024-09-12T18:14:42.287196+0000","last_peered":"2024-09-12T18:14:42.287196+0000","last_clean":"2024-09-12T18:14:42.287196+0000","last_became_active":"2024-09-12T17:20:30.535668+0000","last_became_peered":"2024-09-12T17:20:30.535668+0000","last_unstale":"2024-09-12T18:14:42.287196+0000","last_undegraded":"2024-09-12T18:14:42.287196+0000","last_fullsized":"2024-09-12T18:14:42.287196+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:42.287102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:42.287102+0000","last_clean_scrub_stamp":"2024-09-12T18:14:42.287102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:02.558237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'13","reported_seq":101,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:36.270432+0000","last_change":"2024-09-12T18:14:36.270373+0000","last_active":"2024-09-12T18:14:36.270432+0000","last_peered":"2024-09-12T18:14:36.270432+0000","last_clean":"2024-09-12T18:14:36.270432+0000","last_became_active":"2024-09-12T17:16:11.484154+0000","last_became_peered":"2024-09-12T17:16:11.484154+0000","last_unstale":"2024-09-12T18:14:36.270432+0000","last_undegraded":"2024-09-12T18:14:36.270432+0000","last_fullsized":"2024-09-12T18:14:36.270432+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-09-12T18:14:36.270284+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-09-12T18:14:36.270284+0000","last_clean_scrub_stamp":"2024-09-12T18:14:36.270284+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:17.752999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":37,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:51.367200+0000","last_change":"2024-09-12T18:14:51.367200+0000","last_active":"2024-09-12T18:14:51.367200+0000","last_peered":"2024-09-12T18:14:51.367200+0000","last_clean":"2024-09-12T18:14:51.367200+0000","last_became_active":"2024-09-12T17:39:05.927841+0000","last_became_peered":"2024-09-12T17:39:05.927841+0000","last_unstale":"2024-09-12T18:14:51.367200+0000","last_undegraded":"2024-09-12T18:14:51.367200+0000","last_fullsized":"2024-09-12T18:14:51.367200+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:51.367107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:51.367107+0000","last_clean_scrub_stamp":"2024-09-12T18:14:51.367107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:44.506543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:45.434694+0000","last_change":"2024-09-12T18:14:45.434614+0000","last_active":"2024-09-12T18:14:45.434694+0000","last_peered":"2024-09-12T18:14:45.434694+0000","last_clean":"2024-09-12T18:14:45.434694+0000","last_became_active":"2024-09-12T17:20:34.610737+0000","last_became_peered":"2024-09-12T17:20:34.610737+0000","last_unstale":"2024-09-12T18:14:45.434694+0000","last_undegraded":"2024-09-12T18:14:45.434694+0000","last_fullsized":"2024-09-12T18:14:45.434694+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:45.434497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:45.434497+0000","last_clean_scrub_stamp":"2024-09-12T18:14:45.434497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:02.452977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:29.239711+0000","last_change":"2024-09-12T18:14:29.239633+0000","last_active":"2024-09-12T18:14:29.239711+0000","last_peered":"2024-09-12T18:14:29.239711+0000","last_clean":"2024-09-12T18:14:29.239711+0000","last_became_active":"2024-09-12T17:20:30.528902+0000","last_became_peered":"2024-09-12T17:20:30.528902+0000","last_unstale":"2024-09-12T18:14:29.239711+0000","last_undegraded":"2024-09-12T18:14:29.239711+0000","last_fullsized":"2024-09-12T18:14:29.239711+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:29.239538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:29.239538+0000","last_clean_scrub_stamp":"2024-09-12T18:14:29.239538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:02.578918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'31","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:34.425839+0000","last_change":"2024-09-12T18:14:34.425711+0000","last_active":"2024-09-12T18:14:34.425839+0000","last_peered":"2024-09-12T18:14:34.425839+0000","last_clean":"2024-09-12T18:14:34.425839+0000","last_became_active":"2024-09-12T17:16:11.488722+0000","last_became_peered":"2024-09-12T17:16:11.488722+0000","last_unstale":"2024-09-12T18:14:34.425839+0000","last_undegraded":"2024-09-12T18:14:34.425839+0000","last_fullsized":"2024-09-12T18:14:34.425839+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-09-12T18:14:34.425586+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-09-12T18:14:34.425586+0000","last_clean_scrub_stamp":"2024-09-12T18:14:34.425586+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:50.212908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":116,"num_write":54,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:50.369027+0000","last_change":"2024-09-12T18:14:50.369027+0000","last_active":"2024-09-12T18:14:50.369027+0000","last_peered":"2024-09-12T18:14:50.369027+0000","last_clean":"2024-09-12T18:14:50.369027+0000","last_became_active":"2024-09-12T17:39:05.929156+0000","last_became_peered":"2024-09-12T17:39:05.929156+0000","last_unstale":"2024-09-12T18:14:50.369027+0000","last_undegraded":"2024-09-12T18:14:50.369027+0000","last_fullsized":"2024-09-12T18:14:50.369027+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:50.368946+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:50.368946+0000","last_clean_scrub_stamp":"2024-09-12T18:14:50.368946+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:51.105409+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:31.278454+0000","last_change":"2024-09-12T18:14:31.278387+0000","last_active":"2024-09-12T18:14:31.278454+0000","last_peered":"2024-09-12T18:14:31.278454+0000","last_clean":"2024-09-12T18:14:31.278454+0000","last_became_active":"2024-09-12T17:20:34.558826+0000","last_became_peered":"2024-09-12T17:20:34.558826+0000","last_unstale":"2024-09-12T18:14:31.278454+0000","last_undegraded":"2024-09-12T18:14:31.278454+0000","last_fullsized":"2024-09-12T18:14:31.278454+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:31.278298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:31.278298+0000","last_clean_scrub_stamp":"2024-09-12T18:14:31.278298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:47.464949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:43.323471+0000","last_change":"2024-09-12T18:14:43.323393+0000","last_active":"2024-09-12T18:14:43.323471+0000","last_peered":"2024-09-12T18:14:43.323471+0000","last_clean":"2024-09-12T18:14:43.323471+0000","last_became_active":"2024-09-12T17:20:30.537204+0000","last_became_peered":"2024-09-12T17:20:30.537204+0000","last_unstale":"2024-09-12T18:14:43.323471+0000","last_undegraded":"2024-09-12T18:14:43.323471+0000","last_fullsized":"2024-09-12T18:14:43.323471+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:43.323302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:43.323302+0000","last_clean_scrub_stamp":"2024-09-12T18:14:43.323302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:26.631887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'43","reported_seq":185,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:37.891111+0000","last_change":"2024-09-12T18:14:37.891004+0000","last_active":"2024-09-12T18:14:37.891111+0000","last_peered":"2024-09-12T18:14:37.891111+0000","last_clean":"2024-09-12T18:14:37.891111+0000","last_became_active":"2024-09-12T17:16:11.487129+0000","last_became_peered":"2024-09-12T17:16:11.487129+0000","last_unstale":"2024-09-12T18:14:37.891111+0000","last_undegraded":"2024-09-12T18:14:37.891111+0000","last_fullsized":"2024-09-12T18:14:37.891111+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'43","last_scrub_stamp":"2024-09-12T18:14:37.890908+0000","last_deep_scrub":"264'43","last_deep_scrub_stamp":"2024-09-12T18:14:37.890908+0000","last_clean_scrub_stamp":"2024-09-12T18:14:37.890908+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:40.642284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":153,"num_write":79,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:53.327891+0000","last_change":"2024-09-12T18:14:53.327891+0000","last_active":"2024-09-12T18:14:53.327891+0000","last_peered":"2024-09-12T18:14:53.327891+0000","last_clean":"2024-09-12T18:14:53.327891+0000","last_became_active":"2024-09-12T17:39:05.925950+0000","last_became_peered":"2024-09-12T17:39:05.925950+0000","last_unstale":"2024-09-12T18:14:53.327891+0000","last_undegraded":"2024-09-12T18:14:53.327891+0000","last_fullsized":"2024-09-12T18:14:53.327891+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:53.327775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:53.327775+0000","last_clean_scrub_stamp":"2024-09-12T18:14:53.327775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:58.117697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'3","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:44.440305+0000","last_change":"2024-09-12T18:14:44.440225+0000","last_active":"2024-09-12T18:14:44.440305+0000","last_peered":"2024-09-12T18:14:44.440305+0000","last_clean":"2024-09-12T18:14:44.440305+0000","last_became_active":"2024-09-12T17:20:34.555493+0000","last_became_peered":"2024-09-12T17:20:34.555493+0000","last_unstale":"2024-09-12T18:14:44.440305+0000","last_undegraded":"2024-09-12T18:14:44.440305+0000","last_fullsized":"2024-09-12T18:14:44.440305+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:14:44.440141+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:14:44.440141+0000","last_clean_scrub_stamp":"2024-09-12T18:14:44.440141+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:12.342437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'4","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:34.850257+0000","last_change":"2024-09-12T18:14:34.850257+0000","last_active":"2024-09-12T18:14:34.850257+0000","last_peered":"2024-09-12T18:14:34.850257+0000","last_clean":"2024-09-12T18:14:34.850257+0000","last_became_active":"2024-09-12T17:20:30.534448+0000","last_became_peered":"2024-09-12T17:20:30.534448+0000","last_unstale":"2024-09-12T18:14:34.850257+0000","last_undegraded":"2024-09-12T18:14:34.850257+0000","last_fullsized":"2024-09-12T18:14:34.850257+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:14:34.850163+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:14:34.850163+0000","last_clean_scrub_stamp":"2024-09-12T18:14:34.850163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:53.203155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":4,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'9","reported_seq":96,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:26.284636+0000","last_change":"2024-09-12T18:14:26.284565+0000","last_active":"2024-09-12T18:14:26.284636+0000","last_peered":"2024-09-12T18:14:26.284636+0000","last_clean":"2024-09-12T18:14:26.284636+0000","last_became_active":"2024-09-12T17:16:11.488433+0000","last_became_peered":"2024-09-12T17:16:11.488433+0000","last_unstale":"2024-09-12T18:14:26.284636+0000","last_undegraded":"2024-09-12T18:14:26.284636+0000","last_fullsized":"2024-09-12T18:14:26.284636+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-12T18:14:26.284480+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-12T18:14:26.284480+0000","last_clean_scrub_stamp":"2024-09-12T18:14:26.284480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:22.408672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":34,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:46.388775+0000","last_change":"2024-09-12T18:14:46.388775+0000","last_active":"2024-09-12T18:14:46.388775+0000","last_peered":"2024-09-12T18:14:46.388775+0000","last_clean":"2024-09-12T18:14:46.388775+0000","last_became_active":"2024-09-12T17:39:05.925525+0000","last_became_peered":"2024-09-12T17:39:05.925525+0000","last_unstale":"2024-09-12T18:14:46.388775+0000","last_undegraded":"2024-09-12T18:14:46.388775+0000","last_fullsized":"2024-09-12T18:14:46.388775+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:46.388678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:46.388678+0000","last_clean_scrub_stamp":"2024-09-12T18:14:46.388678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:01.994329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'3","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:49.214653+0000","last_change":"2024-09-12T18:14:49.214653+0000","last_active":"2024-09-12T18:14:49.214653+0000","last_peered":"2024-09-12T18:14:49.214653+0000","last_clean":"2024-09-12T18:14:49.214653+0000","last_became_active":"2024-09-12T17:20:34.558946+0000","last_became_peered":"2024-09-12T17:20:34.558946+0000","last_unstale":"2024-09-12T18:14:49.214653+0000","last_undegraded":"2024-09-12T18:14:49.214653+0000","last_fullsized":"2024-09-12T18:14:49.214653+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:14:49.214545+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:14:49.214545+0000","last_clean_scrub_stamp":"2024-09-12T18:14:49.214545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:23.070738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'4","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:40.412399+0000","last_change":"2024-09-12T18:14:40.412289+0000","last_active":"2024-09-12T18:14:40.412399+0000","last_peered":"2024-09-12T18:14:40.412399+0000","last_clean":"2024-09-12T18:14:40.412399+0000","last_became_active":"2024-09-12T17:20:30.528078+0000","last_became_peered":"2024-09-12T17:20:30.528078+0000","last_unstale":"2024-09-12T18:14:40.412399+0000","last_undegraded":"2024-09-12T18:14:40.412399+0000","last_fullsized":"2024-09-12T18:14:40.412399+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-12T18:14:40.412190+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-12T18:14:40.412190+0000","last_clean_scrub_stamp":"2024-09-12T18:14:40.412190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:02.399699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'44","reported_seq":191,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:34.229927+0000","last_change":"2024-09-12T18:14:34.229864+0000","last_active":"2024-09-12T18:14:34.229927+0000","last_peered":"2024-09-12T18:14:34.229927+0000","last_clean":"2024-09-12T18:14:34.229927+0000","last_became_active":"2024-09-12T17:16:11.481431+0000","last_became_peered":"2024-09-12T17:16:11.481431+0000","last_unstale":"2024-09-12T18:14:34.229927+0000","last_undegraded":"2024-09-12T18:14:34.229927+0000","last_fullsized":"2024-09-12T18:14:34.229927+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'44","last_scrub_stamp":"2024-09-12T18:14:34.229758+0000","last_deep_scrub":"264'44","last_deep_scrub_stamp":"2024-09-12T18:14:34.229758+0000","last_clean_scrub_stamp":"2024-09-12T18:14:34.229758+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:49.892480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":166,"num_write":69,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:44.454092+0000","last_change":"2024-09-12T18:14:44.454092+0000","last_active":"2024-09-12T18:14:44.454092+0000","last_peered":"2024-09-12T18:14:44.454092+0000","last_clean":"2024-09-12T18:14:44.454092+0000","last_became_active":"2024-09-12T17:39:05.919207+0000","last_became_peered":"2024-09-12T17:39:05.919207+0000","last_unstale":"2024-09-12T18:14:44.454092+0000","last_undegraded":"2024-09-12T18:14:44.454092+0000","last_fullsized":"2024-09-12T18:14:44.454092+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:44.453999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:44.453999+0000","last_clean_scrub_stamp":"2024-09-12T18:14:44.453999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:48.797179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'10","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:48.229715+0000","last_change":"2024-09-12T18:14:48.229715+0000","last_active":"2024-09-12T18:14:48.229715+0000","last_peered":"2024-09-12T18:14:48.229715+0000","last_clean":"2024-09-12T18:14:48.229715+0000","last_became_active":"2024-09-12T17:20:34.612840+0000","last_became_peered":"2024-09-12T17:20:34.612840+0000","last_unstale":"2024-09-12T18:14:48.229715+0000","last_undegraded":"2024-09-12T18:14:48.229715+0000","last_fullsized":"2024-09-12T18:14:48.229715+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'10","last_scrub_stamp":"2024-09-12T18:14:48.229631+0000","last_deep_scrub":"264'10","last_deep_scrub_stamp":"2024-09-12T18:14:48.229631+0000","last_clean_scrub_stamp":"2024-09-12T18:14:48.229631+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:08.632463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":10,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:18.083168+0000","last_change":"2024-09-12T18:14:18.083073+0000","last_active":"2024-09-12T18:14:18.083168+0000","last_peered":"2024-09-12T18:14:18.083168+0000","last_clean":"2024-09-12T18:14:18.083168+0000","last_became_active":"2024-09-12T17:20:30.538913+0000","last_became_peered":"2024-09-12T17:20:30.538913+0000","last_unstale":"2024-09-12T18:14:18.083168+0000","last_undegraded":"2024-09-12T18:14:18.083168+0000","last_fullsized":"2024-09-12T18:14:18.083168+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:14:18.082969+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:14:18.082969+0000","last_clean_scrub_stamp":"2024-09-12T18:14:18.082969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:58.687456+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'104","reported_seq":395,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:23.231659+0000","last_change":"2024-09-12T18:14:23.231584+0000","last_active":"2024-09-12T18:14:23.231659+0000","last_peered":"2024-09-12T18:14:23.231659+0000","last_clean":"2024-09-12T18:14:23.231659+0000","last_became_active":"2024-09-12T17:16:11.489087+0000","last_became_peered":"2024-09-12T17:16:11.489087+0000","last_unstale":"2024-09-12T18:14:23.231659+0000","last_undegraded":"2024-09-12T18:14:23.231659+0000","last_fullsized":"2024-09-12T18:14:23.231659+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'104","last_scrub_stamp":"2024-09-12T18:14:23.231495+0000","last_deep_scrub":"264'104","last_deep_scrub_stamp":"2024-09-12T18:14:23.231495+0000","last_clean_scrub_stamp":"2024-09-12T18:14:23.231495+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:36.283901+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":629,"num_read_kb":433,"num_write":144,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4660,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:36.333854+0000","last_change":"2024-09-12T18:14:36.333854+0000","last_active":"2024-09-12T18:14:36.333854+0000","last_peered":"2024-09-12T18:14:36.333854+0000","last_clean":"2024-09-12T18:14:36.333854+0000","last_became_active":"2024-09-12T17:39:05.921608+0000","last_became_peered":"2024-09-12T17:39:05.921608+0000","last_unstale":"2024-09-12T18:14:36.333854+0000","last_undegraded":"2024-09-12T18:14:36.333854+0000","last_fullsized":"2024-09-12T18:14:36.333854+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:36.333723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:36.333723+0000","last_clean_scrub_stamp":"2024-09-12T18:14:36.333723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:01.154535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:43.436473+0000","last_change":"2024-09-12T18:14:43.436400+0000","last_active":"2024-09-12T18:14:43.436473+0000","last_peered":"2024-09-12T18:14:43.436473+0000","last_clean":"2024-09-12T18:14:43.436473+0000","last_became_active":"2024-09-12T17:20:34.610719+0000","last_became_peered":"2024-09-12T17:20:34.610719+0000","last_unstale":"2024-09-12T18:14:43.436473+0000","last_undegraded":"2024-09-12T18:14:43.436473+0000","last_fullsized":"2024-09-12T18:14:43.436473+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:43.436302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:43.436302+0000","last_clean_scrub_stamp":"2024-09-12T18:14:43.436302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:16.519635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:37.367785+0000","last_change":"2024-09-12T18:14:37.367714+0000","last_active":"2024-09-12T18:14:37.367785+0000","last_peered":"2024-09-12T18:14:37.367785+0000","last_clean":"2024-09-12T18:14:37.367785+0000","last_became_active":"2024-09-12T17:20:30.535382+0000","last_became_peered":"2024-09-12T17:20:30.535382+0000","last_unstale":"2024-09-12T18:14:37.367785+0000","last_undegraded":"2024-09-12T18:14:37.367785+0000","last_fullsized":"2024-09-12T18:14:37.367785+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:37.367623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:37.367623+0000","last_clean_scrub_stamp":"2024-09-12T18:14:37.367623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:26.522841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'27","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:32.432734+0000","last_change":"2024-09-12T18:14:32.432673+0000","last_active":"2024-09-12T18:14:32.432734+0000","last_peered":"2024-09-12T18:14:32.432734+0000","last_clean":"2024-09-12T18:14:32.432734+0000","last_became_active":"2024-09-12T17:16:11.486799+0000","last_became_peered":"2024-09-12T17:16:11.486799+0000","last_unstale":"2024-09-12T18:14:32.432734+0000","last_undegraded":"2024-09-12T18:14:32.432734+0000","last_fullsized":"2024-09-12T18:14:32.432734+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'27","last_scrub_stamp":"2024-09-12T18:14:32.432578+0000","last_deep_scrub":"264'27","last_deep_scrub_stamp":"2024-09-12T18:14:32.432578+0000","last_clean_scrub_stamp":"2024-09-12T18:14:32.432578+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:59.284922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":89,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:45.863517+0000","last_change":"2024-09-12T18:14:45.863517+0000","last_active":"2024-09-12T18:14:45.863517+0000","last_peered":"2024-09-12T18:14:45.863517+0000","last_clean":"2024-09-12T18:14:45.863517+0000","last_became_active":"2024-09-12T17:39:05.923192+0000","last_became_peered":"2024-09-12T17:39:05.923192+0000","last_unstale":"2024-09-12T18:14:45.863517+0000","last_undegraded":"2024-09-12T18:14:45.863517+0000","last_fullsized":"2024-09-12T18:14:45.863517+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:45.863435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:45.863435+0000","last_clean_scrub_stamp":"2024-09-12T18:14:45.863435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:04.742866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'4","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:40.816615+0000","last_change":"2024-09-12T18:14:40.816539+0000","last_active":"2024-09-12T18:14:40.816615+0000","last_peered":"2024-09-12T18:14:40.816615+0000","last_clean":"2024-09-12T18:14:40.816615+0000","last_became_active":"2024-09-12T17:20:34.555267+0000","last_became_peered":"2024-09-12T17:20:34.555267+0000","last_unstale":"2024-09-12T18:14:40.816615+0000","last_undegraded":"2024-09-12T18:14:40.816615+0000","last_fullsized":"2024-09-12T18:14:40.816615+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:14:40.816449+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:14:40.816449+0000","last_clean_scrub_stamp":"2024-09-12T18:14:40.816449+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:54.013182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'4","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:39.425729+0000","last_change":"2024-09-12T18:14:39.425671+0000","last_active":"2024-09-12T18:14:39.425729+0000","last_peered":"2024-09-12T18:14:39.425729+0000","last_clean":"2024-09-12T18:14:39.425729+0000","last_became_active":"2024-09-12T17:20:30.530998+0000","last_became_peered":"2024-09-12T17:20:30.530998+0000","last_unstale":"2024-09-12T18:14:39.425729+0000","last_undegraded":"2024-09-12T18:14:39.425729+0000","last_fullsized":"2024-09-12T18:14:39.425729+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:14:39.425587+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:14:39.425587+0000","last_clean_scrub_stamp":"2024-09-12T18:14:39.425587+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:28.412390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'20","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:24.246054+0000","last_change":"2024-09-12T18:14:24.245978+0000","last_active":"2024-09-12T18:14:24.246054+0000","last_peered":"2024-09-12T18:14:24.246054+0000","last_clean":"2024-09-12T18:14:24.246054+0000","last_became_active":"2024-09-12T17:16:11.487439+0000","last_became_peered":"2024-09-12T17:16:11.487439+0000","last_unstale":"2024-09-12T18:14:24.246054+0000","last_undegraded":"2024-09-12T18:14:24.246054+0000","last_fullsized":"2024-09-12T18:14:24.246054+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'20","last_scrub_stamp":"2024-09-12T18:14:24.245894+0000","last_deep_scrub":"264'20","last_deep_scrub_stamp":"2024-09-12T18:14:24.245894+0000","last_clean_scrub_stamp":"2024-09-12T18:14:24.245894+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:04.547184+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":36,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:23.090856+0000","last_change":"2024-09-12T18:14:23.090856+0000","last_active":"2024-09-12T18:14:23.090856+0000","last_peered":"2024-09-12T18:14:23.090856+0000","last_clean":"2024-09-12T18:14:23.090856+0000","last_became_active":"2024-09-12T17:39:05.923420+0000","last_became_peered":"2024-09-12T17:39:05.923420+0000","last_unstale":"2024-09-12T18:14:23.090856+0000","last_undegraded":"2024-09-12T18:14:23.090856+0000","last_fullsized":"2024-09-12T18:14:23.090856+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:23.090758+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:23.090758+0000","last_clean_scrub_stamp":"2024-09-12T18:14:23.090758+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:00.038610+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'5","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:30.280509+0000","last_change":"2024-09-12T18:14:30.280444+0000","last_active":"2024-09-12T18:14:30.280509+0000","last_peered":"2024-09-12T18:14:30.280509+0000","last_clean":"2024-09-12T18:14:30.280509+0000","last_became_active":"2024-09-12T17:20:34.557794+0000","last_became_peered":"2024-09-12T17:20:34.557794+0000","last_unstale":"2024-09-12T18:14:30.280509+0000","last_undegraded":"2024-09-12T18:14:30.280509+0000","last_fullsized":"2024-09-12T18:14:30.280509+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T18:14:30.280351+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T18:14:30.280351+0000","last_clean_scrub_stamp":"2024-09-12T18:14:30.280351+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:41.102626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'8","reported_seq":79,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:36.402228+0000","last_change":"2024-09-12T18:14:36.402174+0000","last_active":"2024-09-12T18:14:36.402228+0000","last_peered":"2024-09-12T18:14:36.402228+0000","last_clean":"2024-09-12T18:14:36.402228+0000","last_became_active":"2024-09-12T17:20:30.537970+0000","last_became_peered":"2024-09-12T17:20:30.537970+0000","last_unstale":"2024-09-12T18:14:36.402228+0000","last_undegraded":"2024-09-12T18:14:36.402228+0000","last_fullsized":"2024-09-12T18:14:36.402228+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T18:14:36.402087+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T18:14:36.402087+0000","last_clean_scrub_stamp":"2024-09-12T18:14:36.402087+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:23.401779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":19458,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'24","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:35.418107+0000","last_change":"2024-09-12T18:14:35.418107+0000","last_active":"2024-09-12T18:14:35.418107+0000","last_peered":"2024-09-12T18:14:35.418107+0000","last_clean":"2024-09-12T18:14:35.418107+0000","last_became_active":"2024-09-12T17:16:11.486298+0000","last_became_peered":"2024-09-12T17:16:11.486298+0000","last_unstale":"2024-09-12T18:14:35.418107+0000","last_undegraded":"2024-09-12T18:14:35.418107+0000","last_fullsized":"2024-09-12T18:14:35.418107+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-09-12T18:14:35.418021+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-09-12T18:14:35.418021+0000","last_clean_scrub_stamp":"2024-09-12T18:14:35.418021+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:02.258321+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:52.297659+0000","last_change":"2024-09-12T18:14:52.297659+0000","last_active":"2024-09-12T18:14:52.297659+0000","last_peered":"2024-09-12T18:14:52.297659+0000","last_clean":"2024-09-12T18:14:52.297659+0000","last_became_active":"2024-09-12T17:39:05.921085+0000","last_became_peered":"2024-09-12T17:39:05.921085+0000","last_unstale":"2024-09-12T18:14:52.297659+0000","last_undegraded":"2024-09-12T18:14:52.297659+0000","last_fullsized":"2024-09-12T18:14:52.297659+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:52.297565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:52.297565+0000","last_clean_scrub_stamp":"2024-09-12T18:14:52.297565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:34.374496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'6","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:41.369438+0000","last_change":"2024-09-12T18:14:41.369339+0000","last_active":"2024-09-12T18:14:41.369438+0000","last_peered":"2024-09-12T18:14:41.369438+0000","last_clean":"2024-09-12T18:14:41.369438+0000","last_became_active":"2024-09-12T17:20:34.558963+0000","last_became_peered":"2024-09-12T17:20:34.558963+0000","last_unstale":"2024-09-12T18:14:41.369438+0000","last_undegraded":"2024-09-12T18:14:41.369438+0000","last_fullsized":"2024-09-12T18:14:41.369438+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T18:14:41.369249+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T18:14:41.369249+0000","last_clean_scrub_stamp":"2024-09-12T18:14:41.369249+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:01.621732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:38.410566+0000","last_change":"2024-09-12T18:14:38.410500+0000","last_active":"2024-09-12T18:14:38.410566+0000","last_peered":"2024-09-12T18:14:38.410566+0000","last_clean":"2024-09-12T18:14:38.410566+0000","last_became_active":"2024-09-12T17:20:30.524377+0000","last_became_peered":"2024-09-12T17:20:30.524377+0000","last_unstale":"2024-09-12T18:14:38.410566+0000","last_undegraded":"2024-09-12T18:14:38.410566+0000","last_fullsized":"2024-09-12T18:14:38.410566+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:38.410409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:38.410409+0000","last_clean_scrub_stamp":"2024-09-12T18:14:38.410409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:47.654204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'59","reported_seq":234,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:33.881013+0000","last_change":"2024-09-12T18:14:33.881013+0000","last_active":"2024-09-12T18:14:33.881013+0000","last_peered":"2024-09-12T18:14:33.881013+0000","last_clean":"2024-09-12T18:14:33.881013+0000","last_became_active":"2024-09-12T17:16:11.491512+0000","last_became_peered":"2024-09-12T17:16:11.491512+0000","last_unstale":"2024-09-12T18:14:33.881013+0000","last_undegraded":"2024-09-12T18:14:33.881013+0000","last_fullsized":"2024-09-12T18:14:33.881013+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'59","last_scrub_stamp":"2024-09-12T18:14:33.880931+0000","last_deep_scrub":"264'59","last_deep_scrub_stamp":"2024-09-12T18:14:33.880931+0000","last_clean_scrub_stamp":"2024-09-12T18:14:33.880931+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:13.951597+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":313,"num_read_kb":225,"num_write":101,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:51.277220+0000","last_change":"2024-09-12T18:14:51.277220+0000","last_active":"2024-09-12T18:14:51.277220+0000","last_peered":"2024-09-12T18:14:51.277220+0000","last_clean":"2024-09-12T18:14:51.277220+0000","last_became_active":"2024-09-12T17:39:05.926029+0000","last_became_peered":"2024-09-12T17:39:05.926029+0000","last_unstale":"2024-09-12T18:14:51.277220+0000","last_undegraded":"2024-09-12T18:14:51.277220+0000","last_fullsized":"2024-09-12T18:14:51.277220+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:51.277124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:51.277124+0000","last_clean_scrub_stamp":"2024-09-12T18:14:51.277124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:13.190113+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"261'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:30.313285+0000","last_change":"2024-09-12T18:14:30.313225+0000","last_active":"2024-09-12T18:14:30.313285+0000","last_peered":"2024-09-12T18:14:30.313285+0000","last_clean":"2024-09-12T18:14:30.313285+0000","last_became_active":"2024-09-12T17:20:34.555137+0000","last_became_peered":"2024-09-12T17:20:34.555137+0000","last_unstale":"2024-09-12T18:14:30.313285+0000","last_undegraded":"2024-09-12T18:14:30.313285+0000","last_fullsized":"2024-09-12T18:14:30.313285+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:14:30.313134+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:14:30.313134+0000","last_clean_scrub_stamp":"2024-09-12T18:14:30.313134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:54.305578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'2","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:26.209969+0000","last_change":"2024-09-12T18:14:26.209890+0000","last_active":"2024-09-12T18:14:26.209969+0000","last_peered":"2024-09-12T18:14:26.209969+0000","last_clean":"2024-09-12T18:14:26.209969+0000","last_became_active":"2024-09-12T17:20:30.531232+0000","last_became_peered":"2024-09-12T17:20:30.531232+0000","last_unstale":"2024-09-12T18:14:26.209969+0000","last_undegraded":"2024-09-12T18:14:26.209969+0000","last_fullsized":"2024-09-12T18:14:26.209969+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:26.209790+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:26.209790+0000","last_clean_scrub_stamp":"2024-09-12T18:14:26.209790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:26.231944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'13","reported_seq":107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:27.238728+0000","last_change":"2024-09-12T18:14:27.238658+0000","last_active":"2024-09-12T18:14:27.238728+0000","last_peered":"2024-09-12T18:14:27.238728+0000","last_clean":"2024-09-12T18:14:27.238728+0000","last_became_active":"2024-09-12T17:16:11.491334+0000","last_became_peered":"2024-09-12T17:16:11.491334+0000","last_unstale":"2024-09-12T18:14:27.238728+0000","last_undegraded":"2024-09-12T18:14:27.238728+0000","last_fullsized":"2024-09-12T18:14:27.238728+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-09-12T18:14:27.238574+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-09-12T18:14:27.238574+0000","last_clean_scrub_stamp":"2024-09-12T18:14:27.238574+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:25.141678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":49,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:47.409991+0000","last_change":"2024-09-12T18:14:47.409991+0000","last_active":"2024-09-12T18:14:47.409991+0000","last_peered":"2024-09-12T18:14:47.409991+0000","last_clean":"2024-09-12T18:14:47.409991+0000","last_became_active":"2024-09-12T17:39:05.930326+0000","last_became_peered":"2024-09-12T17:39:05.930326+0000","last_unstale":"2024-09-12T18:14:47.409991+0000","last_undegraded":"2024-09-12T18:14:47.409991+0000","last_fullsized":"2024-09-12T18:14:47.409991+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:47.409905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:47.409905+0000","last_clean_scrub_stamp":"2024-09-12T18:14:47.409905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:54.986456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'6","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:41.859371+0000","last_change":"2024-09-12T18:14:41.859276+0000","last_active":"2024-09-12T18:14:41.859371+0000","last_peered":"2024-09-12T18:14:41.859371+0000","last_clean":"2024-09-12T18:14:41.859371+0000","last_became_active":"2024-09-12T17:20:34.554832+0000","last_became_peered":"2024-09-12T17:20:34.554832+0000","last_unstale":"2024-09-12T18:14:41.859371+0000","last_undegraded":"2024-09-12T18:14:41.859371+0000","last_fullsized":"2024-09-12T18:14:41.859371+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T18:14:41.859166+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T18:14:41.859166+0000","last_clean_scrub_stamp":"2024-09-12T18:14:41.859166+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:02.620814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'4","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:28.273212+0000","last_change":"2024-09-12T18:14:28.273120+0000","last_active":"2024-09-12T18:14:28.273212+0000","last_peered":"2024-09-12T18:14:28.273212+0000","last_clean":"2024-09-12T18:14:28.273212+0000","last_became_active":"2024-09-12T17:20:30.528541+0000","last_became_peered":"2024-09-12T17:20:30.528541+0000","last_unstale":"2024-09-12T18:14:28.273212+0000","last_undegraded":"2024-09-12T18:14:28.273212+0000","last_fullsized":"2024-09-12T18:14:28.273212+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:14:28.273000+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:14:28.273000+0000","last_clean_scrub_stamp":"2024-09-12T18:14:28.273000+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:19.677685+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'21","reported_seq":126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:33.429668+0000","last_change":"2024-09-12T18:14:33.429668+0000","last_active":"2024-09-12T18:14:33.429668+0000","last_peered":"2024-09-12T18:14:33.429668+0000","last_clean":"2024-09-12T18:14:33.429668+0000","last_became_active":"2024-09-12T17:16:11.487238+0000","last_became_peered":"2024-09-12T17:16:11.487238+0000","last_unstale":"2024-09-12T18:14:33.429668+0000","last_undegraded":"2024-09-12T18:14:33.429668+0000","last_fullsized":"2024-09-12T18:14:33.429668+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'21","last_scrub_stamp":"2024-09-12T18:14:33.429572+0000","last_deep_scrub":"264'21","last_deep_scrub_stamp":"2024-09-12T18:14:33.429572+0000","last_clean_scrub_stamp":"2024-09-12T18:14:33.429572+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:19.091582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":71,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'378","reported_seq":1023,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.165354+0000","last_change":"2024-09-12T18:14:11.165354+0000","last_active":"2024-09-12T18:14:11.165354+0000","last_peered":"2024-09-12T18:14:11.165354+0000","last_clean":"2024-09-12T18:14:11.165354+0000","last_became_active":"2024-09-12T17:00:12.304074+0000","last_became_peered":"2024-09-12T17:00:12.304074+0000","last_unstale":"2024-09-12T18:14:11.165354+0000","last_undegraded":"2024-09-12T18:14:11.165354+0000","last_fullsized":"2024-09-12T18:14:11.165354+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'378","last_scrub_stamp":"2024-09-12T18:14:11.165222+0000","last_deep_scrub":"264'378","last_deep_scrub_stamp":"2024-09-12T18:14:11.165222+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.165222+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:54.479677+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":637523,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":542,"num_read_kb":3821,"num_write":1162,"num_write_kb":12701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'137","reported_seq":755,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.416875+0000","last_change":"2024-09-12T18:14:17.416875+0000","last_active":"2024-09-12T18:14:17.416875+0000","last_peered":"2024-09-12T18:14:17.416875+0000","last_clean":"2024-09-12T18:14:17.416875+0000","last_became_active":"2024-09-12T17:00:14.328464+0000","last_became_peered":"2024-09-12T17:00:14.328464+0000","last_unstale":"2024-09-12T18:14:17.416875+0000","last_undegraded":"2024-09-12T18:14:17.416875+0000","last_fullsized":"2024-09-12T18:14:17.416875+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'137","last_scrub_stamp":"2024-09-12T18:14:17.416794+0000","last_deep_scrub":"264'137","last_deep_scrub_stamp":"2024-09-12T18:14:17.416794+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.416794+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:19.839739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":594,"num_read_kb":496,"num_write":221,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'326","reported_seq":968,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.050905+0000","last_change":"2024-09-12T18:14:02.050905+0000","last_active":"2024-09-12T18:14:02.050905+0000","last_peered":"2024-09-12T18:14:02.050905+0000","last_clean":"2024-09-12T18:14:02.050905+0000","last_became_active":"2024-09-12T17:00:12.302750+0000","last_became_peered":"2024-09-12T17:00:12.302750+0000","last_unstale":"2024-09-12T18:14:02.050905+0000","last_undegraded":"2024-09-12T18:14:02.050905+0000","last_fullsized":"2024-09-12T18:14:02.050905+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-12T18:14:02.050783+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-12T18:14:02.050783+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.050783+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:42.750663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":423,"num_read_kb":57739,"num_write":1027,"num_write_kb":55497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'223","reported_seq":857,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:14.259553+0000","last_change":"2024-09-12T18:14:14.259553+0000","last_active":"2024-09-12T18:14:14.259553+0000","last_peered":"2024-09-12T18:14:14.259553+0000","last_clean":"2024-09-12T18:14:14.259553+0000","last_became_active":"2024-09-12T17:00:14.336238+0000","last_became_peered":"2024-09-12T17:00:14.336238+0000","last_unstale":"2024-09-12T18:14:14.259553+0000","last_undegraded":"2024-09-12T18:14:14.259553+0000","last_fullsized":"2024-09-12T18:14:14.259553+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'223","last_scrub_stamp":"2024-09-12T18:14:14.259469+0000","last_deep_scrub":"264'223","last_deep_scrub_stamp":"2024-09-12T18:14:14.259469+0000","last_clean_scrub_stamp":"2024-09-12T18:14:14.259469+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:43.717710+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":973,"num_read_kb":793,"num_write":333,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8081,"num_omap_keys":32,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'344","reported_seq":1017,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.017303+0000","last_change":"2024-09-12T18:14:02.017303+0000","last_active":"2024-09-12T18:14:02.017303+0000","last_peered":"2024-09-12T18:14:02.017303+0000","last_clean":"2024-09-12T18:14:02.017303+0000","last_became_active":"2024-09-12T17:00:12.309132+0000","last_became_peered":"2024-09-12T17:00:12.309132+0000","last_unstale":"2024-09-12T18:14:02.017303+0000","last_undegraded":"2024-09-12T18:14:02.017303+0000","last_fullsized":"2024-09-12T18:14:02.017303+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'344","last_scrub_stamp":"2024-09-12T18:14:02.017215+0000","last_deep_scrub":"264'344","last_deep_scrub_stamp":"2024-09-12T18:14:02.017215+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.017215+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:38.479748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":529,"num_read_kb":32498,"num_write":1132,"num_write_kb":31975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'256","reported_seq":887,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:14.837837+0000","last_change":"2024-09-12T18:14:14.837837+0000","last_active":"2024-09-12T18:14:14.837837+0000","last_peered":"2024-09-12T18:14:14.837837+0000","last_clean":"2024-09-12T18:14:14.837837+0000","last_became_active":"2024-09-12T17:00:14.323358+0000","last_became_peered":"2024-09-12T17:00:14.323358+0000","last_unstale":"2024-09-12T18:14:14.837837+0000","last_undegraded":"2024-09-12T18:14:14.837837+0000","last_fullsized":"2024-09-12T18:14:14.837837+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'256","last_scrub_stamp":"2024-09-12T18:14:14.837731+0000","last_deep_scrub":"264'256","last_deep_scrub_stamp":"2024-09-12T18:14:14.837731+0000","last_clean_scrub_stamp":"2024-09-12T18:14:14.837731+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:31.651864+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1058,"num_read_kb":862,"num_write":363,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":938,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'313","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.579212+0000","last_change":"2024-09-12T18:14:09.579151+0000","last_active":"2024-09-12T18:14:09.579212+0000","last_peered":"2024-09-12T18:14:09.579212+0000","last_clean":"2024-09-12T18:14:09.579212+0000","last_became_active":"2024-09-12T17:00:12.320515+0000","last_became_peered":"2024-09-12T17:00:12.320515+0000","last_unstale":"2024-09-12T18:14:09.579212+0000","last_undegraded":"2024-09-12T18:14:09.579212+0000","last_fullsized":"2024-09-12T18:14:09.579212+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'313","last_scrub_stamp":"2024-09-12T18:14:09.579047+0000","last_deep_scrub":"264'313","last_deep_scrub_stamp":"2024-09-12T18:14:09.579047+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.579047+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:04.911796+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1784539,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":432,"num_read_kb":6790,"num_write":998,"num_write_kb":19852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'120","reported_seq":709,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.170289+0000","last_change":"2024-09-12T18:14:13.170289+0000","last_active":"2024-09-12T18:14:13.170289+0000","last_peered":"2024-09-12T18:14:13.170289+0000","last_clean":"2024-09-12T18:14:13.170289+0000","last_became_active":"2024-09-12T17:00:14.335297+0000","last_became_peered":"2024-09-12T17:00:14.335297+0000","last_unstale":"2024-09-12T18:14:13.170289+0000","last_undegraded":"2024-09-12T18:14:13.170289+0000","last_fullsized":"2024-09-12T18:14:13.170289+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-09-12T18:14:13.170184+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-09-12T18:14:13.170184+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.170184+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:20.955398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":395,"num_write":174,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'333","reported_seq":977,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.237214+0000","last_change":"2024-09-12T18:14:09.237214+0000","last_active":"2024-09-12T18:14:09.237214+0000","last_peered":"2024-09-12T18:14:09.237214+0000","last_clean":"2024-09-12T18:14:09.237214+0000","last_became_active":"2024-09-12T17:00:12.312762+0000","last_became_peered":"2024-09-12T17:00:12.312762+0000","last_unstale":"2024-09-12T18:14:09.237214+0000","last_undegraded":"2024-09-12T18:14:09.237214+0000","last_fullsized":"2024-09-12T18:14:09.237214+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'333","last_scrub_stamp":"2024-09-12T18:14:09.237040+0000","last_deep_scrub":"264'333","last_deep_scrub_stamp":"2024-09-12T18:14:09.237040+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.237040+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:39.532704+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4593537,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":487,"num_read_kb":9220,"num_write":1043,"num_write_kb":31558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'219","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.103243+0000","last_change":"2024-09-12T18:14:10.103167+0000","last_active":"2024-09-12T18:14:10.103243+0000","last_peered":"2024-09-12T18:14:10.103243+0000","last_clean":"2024-09-12T18:14:10.103243+0000","last_became_active":"2024-09-12T17:00:14.321640+0000","last_became_peered":"2024-09-12T17:00:14.321640+0000","last_unstale":"2024-09-12T18:14:10.103243+0000","last_undegraded":"2024-09-12T18:14:10.103243+0000","last_fullsized":"2024-09-12T18:14:10.103243+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'219","last_scrub_stamp":"2024-09-12T18:14:10.103080+0000","last_deep_scrub":"264'219","last_deep_scrub_stamp":"2024-09-12T18:14:10.103080+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.103080+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:24.808735+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1016,"num_read_kb":865,"num_write":355,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'370","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.554790+0000","last_change":"2024-09-12T18:14:06.554790+0000","last_active":"2024-09-12T18:14:06.554790+0000","last_peered":"2024-09-12T18:14:06.554790+0000","last_clean":"2024-09-12T18:14:06.554790+0000","last_became_active":"2024-09-12T17:00:12.319917+0000","last_became_peered":"2024-09-12T17:00:12.319917+0000","last_unstale":"2024-09-12T18:14:06.554790+0000","last_undegraded":"2024-09-12T18:14:06.554790+0000","last_fullsized":"2024-09-12T18:14:06.554790+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'370","last_scrub_stamp":"2024-09-12T18:14:06.554684+0000","last_deep_scrub":"264'370","last_deep_scrub_stamp":"2024-09-12T18:14:06.554684+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.554684+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:37.956148+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432807,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":38218,"num_write":1060,"num_write_kb":26572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'175","reported_seq":804,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.835721+0000","last_change":"2024-09-12T18:14:17.835721+0000","last_active":"2024-09-12T18:14:17.835721+0000","last_peered":"2024-09-12T18:14:17.835721+0000","last_clean":"2024-09-12T18:14:17.835721+0000","last_became_active":"2024-09-12T17:00:14.332940+0000","last_became_peered":"2024-09-12T17:00:14.332940+0000","last_unstale":"2024-09-12T18:14:17.835721+0000","last_undegraded":"2024-09-12T18:14:17.835721+0000","last_fullsized":"2024-09-12T18:14:17.835721+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'175","last_scrub_stamp":"2024-09-12T18:14:17.835625+0000","last_deep_scrub":"264'175","last_deep_scrub_stamp":"2024-09-12T18:14:17.835625+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.835625+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:25.113287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":715,"num_read_kb":606,"num_write":241,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'326","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.241830+0000","last_change":"2024-09-12T18:14:08.241830+0000","last_active":"2024-09-12T18:14:08.241830+0000","last_peered":"2024-09-12T18:14:08.241830+0000","last_clean":"2024-09-12T18:14:08.241830+0000","last_became_active":"2024-09-12T17:00:12.304504+0000","last_became_peered":"2024-09-12T17:00:12.304504+0000","last_unstale":"2024-09-12T18:14:08.241830+0000","last_undegraded":"2024-09-12T18:14:08.241830+0000","last_fullsized":"2024-09-12T18:14:08.241830+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-12T18:14:08.241703+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-12T18:14:08.241703+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.241703+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:13.525047+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1691575,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":533,"num_read_kb":24452,"num_write":1091,"num_write_kb":21520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'176","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:16.416775+0000","last_change":"2024-09-12T18:14:16.416775+0000","last_active":"2024-09-12T18:14:16.416775+0000","last_peered":"2024-09-12T18:14:16.416775+0000","last_clean":"2024-09-12T18:14:16.416775+0000","last_became_active":"2024-09-12T17:00:14.332360+0000","last_became_peered":"2024-09-12T17:00:14.332360+0000","last_unstale":"2024-09-12T18:14:16.416775+0000","last_undegraded":"2024-09-12T18:14:16.416775+0000","last_fullsized":"2024-09-12T18:14:16.416775+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'176","last_scrub_stamp":"2024-09-12T18:14:16.416668+0000","last_deep_scrub":"264'176","last_deep_scrub_stamp":"2024-09-12T18:14:16.416668+0000","last_clean_scrub_stamp":"2024-09-12T18:14:16.416668+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:39.911259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":738,"num_read_kb":599,"num_write":278,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'372","reported_seq":1085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.002649+0000","last_change":"2024-09-12T18:14:04.002649+0000","last_active":"2024-09-12T18:14:04.002649+0000","last_peered":"2024-09-12T18:14:04.002649+0000","last_clean":"2024-09-12T18:14:04.002649+0000","last_became_active":"2024-09-12T17:00:12.322419+0000","last_became_peered":"2024-09-12T17:00:12.322419+0000","last_unstale":"2024-09-12T18:14:04.002649+0000","last_undegraded":"2024-09-12T18:14:04.002649+0000","last_fullsized":"2024-09-12T18:14:04.002649+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-12T18:14:04.002546+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-12T18:14:04.002546+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.002546+0000","objects_scrubbed":9,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:39.056847+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786486,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":661,"num_read_kb":7776,"num_write":1130,"num_write_kb":24985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'60","reported_seq":626,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.168328+0000","last_change":"2024-09-12T18:14:09.168328+0000","last_active":"2024-09-12T18:14:09.168328+0000","last_peered":"2024-09-12T18:14:09.168328+0000","last_clean":"2024-09-12T18:14:09.168328+0000","last_became_active":"2024-09-12T17:00:14.334586+0000","last_became_peered":"2024-09-12T17:00:14.334586+0000","last_unstale":"2024-09-12T18:14:09.168328+0000","last_undegraded":"2024-09-12T18:14:09.168328+0000","last_fullsized":"2024-09-12T18:14:09.168328+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'60","last_scrub_stamp":"2024-09-12T18:14:09.168221+0000","last_deep_scrub":"264'60","last_deep_scrub_stamp":"2024-09-12T18:14:09.168221+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.168221+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:35.472486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":225,"num_write":86,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'142","reported_seq":774,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.786046+0000","last_change":"2024-09-12T18:14:13.785983+0000","last_active":"2024-09-12T18:14:13.786046+0000","last_peered":"2024-09-12T18:14:13.786046+0000","last_clean":"2024-09-12T18:14:13.786046+0000","last_became_active":"2024-09-12T17:00:14.322771+0000","last_became_peered":"2024-09-12T17:00:14.322771+0000","last_unstale":"2024-09-12T18:14:13.786046+0000","last_undegraded":"2024-09-12T18:14:13.786046+0000","last_fullsized":"2024-09-12T18:14:13.786046+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-12T18:14:13.785902+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-12T18:14:13.785902+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.785902+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:49.161921+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":650,"num_read_kb":543,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'382","reported_seq":1148,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.206812+0000","last_change":"2024-09-12T18:14:07.206812+0000","last_active":"2024-09-12T18:14:07.206812+0000","last_peered":"2024-09-12T18:14:07.206812+0000","last_clean":"2024-09-12T18:14:07.206812+0000","last_became_active":"2024-09-12T17:00:46.406911+0000","last_became_peered":"2024-09-12T17:00:46.406911+0000","last_unstale":"2024-09-12T18:14:07.206812+0000","last_undegraded":"2024-09-12T18:14:07.206812+0000","last_fullsized":"2024-09-12T18:14:07.206812+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'382","last_scrub_stamp":"2024-09-12T18:14:07.206704+0000","last_deep_scrub":"264'382","last_deep_scrub_stamp":"2024-09-12T18:14:07.206704+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.206704+0000","objects_scrubbed":8,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:11.551940+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029268,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":749,"num_read_kb":51923,"num_write":1318,"num_write_kb":31895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'117","reported_seq":733,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.222238+0000","last_change":"2024-09-12T18:14:13.222152+0000","last_active":"2024-09-12T18:14:13.222238+0000","last_peered":"2024-09-12T18:14:13.222238+0000","last_clean":"2024-09-12T18:14:13.222238+0000","last_became_active":"2024-09-12T17:00:14.336161+0000","last_became_peered":"2024-09-12T17:00:14.336161+0000","last_unstale":"2024-09-12T18:14:13.222238+0000","last_undegraded":"2024-09-12T18:14:13.222238+0000","last_fullsized":"2024-09-12T18:14:13.222238+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'117","last_scrub_stamp":"2024-09-12T18:14:13.222053+0000","last_deep_scrub":"264'117","last_deep_scrub_stamp":"2024-09-12T18:14:13.222053+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.222053+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:25.097396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":545,"num_read_kb":462,"num_write":195,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'338","reported_seq":1032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.047468+0000","last_change":"2024-09-12T18:14:05.047468+0000","last_active":"2024-09-12T18:14:05.047468+0000","last_peered":"2024-09-12T18:14:05.047468+0000","last_clean":"2024-09-12T18:14:05.047468+0000","last_became_active":"2024-09-12T17:00:12.310589+0000","last_became_peered":"2024-09-12T17:00:12.310589+0000","last_unstale":"2024-09-12T18:14:05.047468+0000","last_undegraded":"2024-09-12T18:14:05.047468+0000","last_fullsized":"2024-09-12T18:14:05.047468+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'338","last_scrub_stamp":"2024-09-12T18:14:05.047367+0000","last_deep_scrub":"264'338","last_deep_scrub_stamp":"2024-09-12T18:14:05.047367+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.047367+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:13.046999+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":594,"num_read_kb":8321,"num_write":1002,"num_write_kb":31830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'144","reported_seq":733,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:14.480010+0000","last_change":"2024-09-12T18:14:14.480010+0000","last_active":"2024-09-12T18:14:14.480010+0000","last_peered":"2024-09-12T18:14:14.480010+0000","last_clean":"2024-09-12T18:14:14.480010+0000","last_became_active":"2024-09-12T17:00:14.324889+0000","last_became_peered":"2024-09-12T17:00:14.324889+0000","last_unstale":"2024-09-12T18:14:14.480010+0000","last_undegraded":"2024-09-12T18:14:14.480010+0000","last_fullsized":"2024-09-12T18:14:14.480010+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'144","last_scrub_stamp":"2024-09-12T18:14:14.479922+0000","last_deep_scrub":"264'144","last_deep_scrub_stamp":"2024-09-12T18:14:14.479922+0000","last_clean_scrub_stamp":"2024-09-12T18:14:14.479922+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:54.095428+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":586,"num_read_kb":478,"num_write":211,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'340","reported_seq":977,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.055592+0000","last_change":"2024-09-12T18:14:02.055592+0000","last_active":"2024-09-12T18:14:02.055592+0000","last_peered":"2024-09-12T18:14:02.055592+0000","last_clean":"2024-09-12T18:14:02.055592+0000","last_became_active":"2024-09-12T17:00:12.315652+0000","last_became_peered":"2024-09-12T17:00:12.315652+0000","last_unstale":"2024-09-12T18:14:02.055592+0000","last_undegraded":"2024-09-12T18:14:02.055592+0000","last_fullsized":"2024-09-12T18:14:02.055592+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'340","last_scrub_stamp":"2024-09-12T18:14:02.055446+0000","last_deep_scrub":"264'340","last_deep_scrub_stamp":"2024-09-12T18:14:02.055446+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.055446+0000","objects_scrubbed":8,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:28.138157+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":305880,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":503,"num_read_kb":21524,"num_write":1088,"num_write_kb":35144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'78","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.064701+0000","last_change":"2024-09-12T18:14:02.064701+0000","last_active":"2024-09-12T18:14:02.064701+0000","last_peered":"2024-09-12T18:14:02.064701+0000","last_clean":"2024-09-12T18:14:02.064701+0000","last_became_active":"2024-09-12T17:00:14.335009+0000","last_became_peered":"2024-09-12T17:00:14.335009+0000","last_unstale":"2024-09-12T18:14:02.064701+0000","last_undegraded":"2024-09-12T18:14:02.064701+0000","last_fullsized":"2024-09-12T18:14:02.064701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'78","last_scrub_stamp":"2024-09-12T18:14:02.064622+0000","last_deep_scrub":"264'78","last_deep_scrub_stamp":"2024-09-12T18:14:02.064622+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.064622+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:00.192294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":353,"num_read_kb":297,"num_write":121,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'359","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.824638+0000","last_change":"2024-09-12T18:14:00.824638+0000","last_active":"2024-09-12T18:14:00.824638+0000","last_peered":"2024-09-12T18:14:00.824638+0000","last_clean":"2024-09-12T18:14:00.824638+0000","last_became_active":"2024-09-12T17:00:12.312828+0000","last_became_peered":"2024-09-12T17:00:12.312828+0000","last_unstale":"2024-09-12T18:14:00.824638+0000","last_undegraded":"2024-09-12T18:14:00.824638+0000","last_fullsized":"2024-09-12T18:14:00.824638+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'359","last_scrub_stamp":"2024-09-12T18:14:00.824537+0000","last_deep_scrub":"264'359","last_deep_scrub_stamp":"2024-09-12T18:14:00.824537+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.824537+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:37.459215+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850167,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":541,"num_read_kb":47220,"num_write":1168,"num_write_kb":32154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'190","reported_seq":838,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.125836+0000","last_change":"2024-09-12T18:14:05.125836+0000","last_active":"2024-09-12T18:14:05.125836+0000","last_peered":"2024-09-12T18:14:05.125836+0000","last_clean":"2024-09-12T18:14:05.125836+0000","last_became_active":"2024-09-12T17:00:14.327744+0000","last_became_peered":"2024-09-12T17:00:14.327744+0000","last_unstale":"2024-09-12T18:14:05.125836+0000","last_undegraded":"2024-09-12T18:14:05.125836+0000","last_fullsized":"2024-09-12T18:14:05.125836+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-09-12T18:14:05.125736+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-09-12T18:14:05.125736+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.125736+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:47.673107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":833,"num_read_kb":695,"num_write":274,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'317","reported_seq":1108,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.929610+0000","last_change":"2024-09-12T18:14:06.929610+0000","last_active":"2024-09-12T18:14:06.929610+0000","last_peered":"2024-09-12T18:14:06.929610+0000","last_clean":"2024-09-12T18:14:06.929610+0000","last_became_active":"2024-09-12T17:00:12.319649+0000","last_became_peered":"2024-09-12T17:00:12.319649+0000","last_unstale":"2024-09-12T18:14:06.929610+0000","last_undegraded":"2024-09-12T18:14:06.929610+0000","last_fullsized":"2024-09-12T18:14:06.929610+0000","mapping_epoch":24,"log_start":"264'301","ondisk_log_start":"264'301","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'317","last_scrub_stamp":"2024-09-12T18:14:06.929469+0000","last_deep_scrub":"264'317","last_deep_scrub_stamp":"2024-09-12T18:14:06.929469+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.929469+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":301,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:28.114201+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655853,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":737,"num_read_kb":130250,"num_write":941,"num_write_kb":66985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'137","reported_seq":769,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:15.817698+0000","last_change":"2024-09-12T18:14:15.817698+0000","last_active":"2024-09-12T18:14:15.817698+0000","last_peered":"2024-09-12T18:14:15.817698+0000","last_clean":"2024-09-12T18:14:15.817698+0000","last_became_active":"2024-09-12T17:00:14.329107+0000","last_became_peered":"2024-09-12T17:00:14.329107+0000","last_unstale":"2024-09-12T18:14:15.817698+0000","last_undegraded":"2024-09-12T18:14:15.817698+0000","last_fullsized":"2024-09-12T18:14:15.817698+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'137","last_scrub_stamp":"2024-09-12T18:14:15.817595+0000","last_deep_scrub":"264'137","last_deep_scrub_stamp":"2024-09-12T18:14:15.817595+0000","last_clean_scrub_stamp":"2024-09-12T18:14:15.817595+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:52.489558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":644,"num_read_kb":539,"num_write":215,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'373","reported_seq":1118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.057944+0000","last_change":"2024-09-12T18:14:01.057944+0000","last_active":"2024-09-12T18:14:01.057944+0000","last_peered":"2024-09-12T18:14:01.057944+0000","last_clean":"2024-09-12T18:14:01.057944+0000","last_became_active":"2024-09-12T17:00:12.307906+0000","last_became_peered":"2024-09-12T17:00:12.307906+0000","last_unstale":"2024-09-12T18:14:01.057944+0000","last_undegraded":"2024-09-12T18:14:01.057944+0000","last_fullsized":"2024-09-12T18:14:01.057944+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-09-12T18:14:01.057824+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-09-12T18:14:01.057824+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.057824+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:19.783672+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524322,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":712,"num_read_kb":3845,"num_write":1087,"num_write_kb":30178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'136","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:31.865736+0000","last_change":"2024-09-12T18:14:31.865736+0000","last_active":"2024-09-12T18:14:31.865736+0000","last_peered":"2024-09-12T18:14:31.865736+0000","last_clean":"2024-09-12T18:14:31.865736+0000","last_became_active":"2024-09-12T17:00:22.355591+0000","last_became_peered":"2024-09-12T17:00:22.355591+0000","last_unstale":"2024-09-12T18:14:31.865736+0000","last_undegraded":"2024-09-12T18:14:31.865736+0000","last_fullsized":"2024-09-12T18:14:31.865736+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'136","last_scrub_stamp":"2024-09-12T18:14:31.865640+0000","last_deep_scrub":"264'136","last_deep_scrub_stamp":"2024-09-12T18:14:31.865640+0000","last_clean_scrub_stamp":"2024-09-12T18:14:31.865640+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:08.827157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1447,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":175,"num_read_kb":172,"num_write":326,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'85","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.936607+0000","last_change":"2024-09-12T18:14:05.936607+0000","last_active":"2024-09-12T18:14:05.936607+0000","last_peered":"2024-09-12T18:14:05.936607+0000","last_clean":"2024-09-12T18:14:05.936607+0000","last_became_active":"2024-09-12T17:00:14.336144+0000","last_became_peered":"2024-09-12T17:00:14.336144+0000","last_unstale":"2024-09-12T18:14:05.936607+0000","last_undegraded":"2024-09-12T18:14:05.936607+0000","last_fullsized":"2024-09-12T18:14:05.936607+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'85","last_scrub_stamp":"2024-09-12T18:14:05.936499+0000","last_deep_scrub":"264'85","last_deep_scrub_stamp":"2024-09-12T18:14:05.936499+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.936499+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:14.421673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":388,"num_read_kb":332,"num_write":123,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'341","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:57.152269+0000","last_change":"2024-09-12T18:13:57.152269+0000","last_active":"2024-09-12T18:13:57.152269+0000","last_peered":"2024-09-12T18:13:57.152269+0000","last_clean":"2024-09-12T18:13:57.152269+0000","last_became_active":"2024-09-12T17:00:46.720989+0000","last_became_peered":"2024-09-12T17:00:46.720989+0000","last_unstale":"2024-09-12T18:13:57.152269+0000","last_undegraded":"2024-09-12T18:13:57.152269+0000","last_fullsized":"2024-09-12T18:13:57.152269+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'341","last_scrub_stamp":"2024-09-12T18:13:57.152177+0000","last_deep_scrub":"264'341","last_deep_scrub_stamp":"2024-09-12T18:13:57.152177+0000","last_clean_scrub_stamp":"2024-09-12T18:13:57.152177+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:22.890906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":487,"num_read_kb":63990,"num_write":1055,"num_write_kb":41211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:20.415162+0000","last_change":"2024-09-12T18:14:20.415162+0000","last_active":"2024-09-12T18:14:20.415162+0000","last_peered":"2024-09-12T18:14:20.415162+0000","last_clean":"2024-09-12T18:14:20.415162+0000","last_became_active":"2024-09-12T17:00:16.325868+0000","last_became_peered":"2024-09-12T17:00:16.325868+0000","last_unstale":"2024-09-12T18:14:20.415162+0000","last_undegraded":"2024-09-12T18:14:20.415162+0000","last_fullsized":"2024-09-12T18:14:20.415162+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:20.415070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:20.415070+0000","last_clean_scrub_stamp":"2024-09-12T18:14:20.415070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:45.386194+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'344","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:20.260679+0000","last_change":"2024-09-12T18:14:20.260679+0000","last_active":"2024-09-12T18:14:20.260679+0000","last_peered":"2024-09-12T18:14:20.260679+0000","last_clean":"2024-09-12T18:14:20.260679+0000","last_became_active":"2024-09-12T17:00:18.329515+0000","last_became_peered":"2024-09-12T17:00:18.329515+0000","last_unstale":"2024-09-12T18:14:20.260679+0000","last_undegraded":"2024-09-12T18:14:20.260679+0000","last_fullsized":"2024-09-12T18:14:20.260679+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'344","last_scrub_stamp":"2024-09-12T18:14:20.260565+0000","last_deep_scrub":"264'344","last_deep_scrub_stamp":"2024-09-12T18:14:20.260565+0000","last_clean_scrub_stamp":"2024-09-12T18:14:20.260565+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:58.070253+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49756,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":1157,"num_write":430,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:30.405393+0000","last_change":"2024-09-12T18:14:30.405393+0000","last_active":"2024-09-12T18:14:30.405393+0000","last_peered":"2024-09-12T18:14:30.405393+0000","last_clean":"2024-09-12T18:14:30.405393+0000","last_became_active":"2024-09-12T17:00:20.348524+0000","last_became_peered":"2024-09-12T17:00:20.348524+0000","last_unstale":"2024-09-12T18:14:30.405393+0000","last_undegraded":"2024-09-12T18:14:30.405393+0000","last_fullsized":"2024-09-12T18:14:30.405393+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:30.405300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:30.405300+0000","last_clean_scrub_stamp":"2024-09-12T18:14:30.405300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:52.715411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'169","reported_seq":737,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:33.450318+0000","last_change":"2024-09-12T18:14:33.450318+0000","last_active":"2024-09-12T18:14:33.450318+0000","last_peered":"2024-09-12T18:14:33.450318+0000","last_clean":"2024-09-12T18:14:33.450318+0000","last_became_active":"2024-09-12T17:00:22.357688+0000","last_became_peered":"2024-09-12T17:00:22.357688+0000","last_unstale":"2024-09-12T18:14:33.450318+0000","last_undegraded":"2024-09-12T18:14:33.450318+0000","last_fullsized":"2024-09-12T18:14:33.450318+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'169","last_scrub_stamp":"2024-09-12T18:14:33.450214+0000","last_deep_scrub":"264'169","last_deep_scrub_stamp":"2024-09-12T18:14:33.450214+0000","last_clean_scrub_stamp":"2024-09-12T18:14:33.450214+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:13.393504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":624,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":254,"num_read_kb":249,"num_write":335,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'315","reported_seq":949,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.537417+0000","last_change":"2024-09-12T18:14:10.537417+0000","last_active":"2024-09-12T18:14:10.537417+0000","last_peered":"2024-09-12T18:14:10.537417+0000","last_clean":"2024-09-12T18:14:10.537417+0000","last_became_active":"2024-09-12T17:00:14.327170+0000","last_became_peered":"2024-09-12T17:00:14.327170+0000","last_unstale":"2024-09-12T18:14:10.537417+0000","last_undegraded":"2024-09-12T18:14:10.537417+0000","last_fullsized":"2024-09-12T18:14:10.537417+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'315","last_scrub_stamp":"2024-09-12T18:14:10.537320+0000","last_deep_scrub":"264'315","last_deep_scrub_stamp":"2024-09-12T18:14:10.537320+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.537320+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:19.286520+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1382,"num_read_kb":1112,"num_write":506,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'400","reported_seq":1102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:55.046428+0000","last_change":"2024-09-12T18:13:55.046377+0000","last_active":"2024-09-12T18:13:55.046428+0000","last_peered":"2024-09-12T18:13:55.046428+0000","last_clean":"2024-09-12T18:13:55.046428+0000","last_became_active":"2024-09-12T17:00:12.304357+0000","last_became_peered":"2024-09-12T17:00:12.304357+0000","last_unstale":"2024-09-12T18:13:55.046428+0000","last_undegraded":"2024-09-12T18:13:55.046428+0000","last_fullsized":"2024-09-12T18:13:55.046428+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'400","last_scrub_stamp":"2024-09-12T18:13:55.046290+0000","last_deep_scrub":"264'400","last_deep_scrub_stamp":"2024-09-12T18:13:55.046290+0000","last_clean_scrub_stamp":"2024-09-12T18:13:55.046290+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:33.859962+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2934950,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":656,"num_read_kb":22996,"num_write":1171,"num_write_kb":36092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:18.939964+0000","last_change":"2024-09-12T18:14:18.939964+0000","last_active":"2024-09-12T18:14:18.939964+0000","last_peered":"2024-09-12T18:14:18.939964+0000","last_clean":"2024-09-12T18:14:18.939964+0000","last_became_active":"2024-09-12T17:00:16.323601+0000","last_became_peered":"2024-09-12T17:00:16.323601+0000","last_unstale":"2024-09-12T18:14:18.939964+0000","last_undegraded":"2024-09-12T18:14:18.939964+0000","last_fullsized":"2024-09-12T18:14:18.939964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:18.939871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:18.939871+0000","last_clean_scrub_stamp":"2024-09-12T18:14:18.939871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:47.955364+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'109","reported_seq":657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:23.910609+0000","last_change":"2024-09-12T18:14:23.910609+0000","last_active":"2024-09-12T18:14:23.910609+0000","last_peered":"2024-09-12T18:14:23.910609+0000","last_clean":"2024-09-12T18:14:23.910609+0000","last_became_active":"2024-09-12T17:00:18.327744+0000","last_became_peered":"2024-09-12T17:00:18.327744+0000","last_unstale":"2024-09-12T18:14:23.910609+0000","last_undegraded":"2024-09-12T18:14:23.910609+0000","last_fullsized":"2024-09-12T18:14:23.910609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'109","last_scrub_stamp":"2024-09-12T18:14:23.910502+0000","last_deep_scrub":"264'109","last_deep_scrub_stamp":"2024-09-12T18:14:23.910502+0000","last_clean_scrub_stamp":"2024-09-12T18:14:23.910502+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:25.648635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":113,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:27.792528+0000","last_change":"2024-09-12T18:14:27.792528+0000","last_active":"2024-09-12T18:14:27.792528+0000","last_peered":"2024-09-12T18:14:27.792528+0000","last_clean":"2024-09-12T18:14:27.792528+0000","last_became_active":"2024-09-12T17:00:20.347865+0000","last_became_peered":"2024-09-12T17:00:20.347865+0000","last_unstale":"2024-09-12T18:14:27.792528+0000","last_undegraded":"2024-09-12T18:14:27.792528+0000","last_fullsized":"2024-09-12T18:14:27.792528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:27.792437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:27.792437+0000","last_clean_scrub_stamp":"2024-09-12T18:14:27.792437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:34.829366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'117","reported_seq":641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:33.264633+0000","last_change":"2024-09-12T18:14:33.264633+0000","last_active":"2024-09-12T18:14:33.264633+0000","last_peered":"2024-09-12T18:14:33.264633+0000","last_clean":"2024-09-12T18:14:33.264633+0000","last_became_active":"2024-09-12T17:00:22.352912+0000","last_became_peered":"2024-09-12T17:00:22.352912+0000","last_unstale":"2024-09-12T18:14:33.264633+0000","last_undegraded":"2024-09-12T18:14:33.264633+0000","last_fullsized":"2024-09-12T18:14:33.264633+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'117","last_scrub_stamp":"2024-09-12T18:14:33.264533+0000","last_deep_scrub":"264'117","last_deep_scrub_stamp":"2024-09-12T18:14:33.264533+0000","last_clean_scrub_stamp":"2024-09-12T18:14:33.264533+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:21.531030+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":708,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":149,"num_read_kb":144,"num_write":248,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'179","reported_seq":814,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.134414+0000","last_change":"2024-09-12T18:14:07.134414+0000","last_active":"2024-09-12T18:14:07.134414+0000","last_peered":"2024-09-12T18:14:07.134414+0000","last_clean":"2024-09-12T18:14:07.134414+0000","last_became_active":"2024-09-12T17:00:14.337515+0000","last_became_peered":"2024-09-12T17:00:14.337515+0000","last_unstale":"2024-09-12T18:14:07.134414+0000","last_undegraded":"2024-09-12T18:14:07.134414+0000","last_fullsized":"2024-09-12T18:14:07.134414+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-09-12T18:14:07.134319+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-09-12T18:14:07.134319+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.134319+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:44.674793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":863,"num_read_kb":715,"num_write":299,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'372","reported_seq":1042,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.233212+0000","last_change":"2024-09-12T18:14:02.233108+0000","last_active":"2024-09-12T18:14:02.233212+0000","last_peered":"2024-09-12T18:14:02.233212+0000","last_clean":"2024-09-12T18:14:02.233212+0000","last_became_active":"2024-09-12T17:00:12.308065+0000","last_became_peered":"2024-09-12T17:00:12.308065+0000","last_unstale":"2024-09-12T18:14:02.233212+0000","last_undegraded":"2024-09-12T18:14:02.233212+0000","last_fullsized":"2024-09-12T18:14:02.233212+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-12T18:14:02.232968+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-12T18:14:02.232968+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.232968+0000","objects_scrubbed":7,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:48.335339+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":976913,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":502,"num_read_kb":43207,"num_write":1166,"num_write_kb":32106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.974613+0000","last_change":"2024-09-12T18:14:17.974613+0000","last_active":"2024-09-12T18:14:17.974613+0000","last_peered":"2024-09-12T18:14:17.974613+0000","last_clean":"2024-09-12T18:14:17.974613+0000","last_became_active":"2024-09-12T17:00:16.326073+0000","last_became_peered":"2024-09-12T17:00:16.326073+0000","last_unstale":"2024-09-12T18:14:17.974613+0000","last_undegraded":"2024-09-12T18:14:17.974613+0000","last_fullsized":"2024-09-12T18:14:17.974613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:17.974523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:17.974523+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.974523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:10.061813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'145","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.127850+0000","last_change":"2024-09-12T18:14:12.127850+0000","last_active":"2024-09-12T18:14:12.127850+0000","last_peered":"2024-09-12T18:14:12.127850+0000","last_clean":"2024-09-12T18:14:12.127850+0000","last_became_active":"2024-09-12T17:00:18.327448+0000","last_became_peered":"2024-09-12T17:00:18.327448+0000","last_unstale":"2024-09-12T18:14:12.127850+0000","last_undegraded":"2024-09-12T18:14:12.127850+0000","last_fullsized":"2024-09-12T18:14:12.127850+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'145","last_scrub_stamp":"2024-09-12T18:14:12.127741+0000","last_deep_scrub":"264'145","last_deep_scrub_stamp":"2024-09-12T18:14:12.127741+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.127741+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:09.199604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":172,"num_read_kb":164,"num_write":118,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'768","reported_seq":2575,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:27.465904+0000","last_change":"2024-09-12T18:14:27.465904+0000","last_active":"2024-09-12T18:14:27.465904+0000","last_peered":"2024-09-12T18:14:27.465904+0000","last_clean":"2024-09-12T18:14:27.465904+0000","last_became_active":"2024-09-12T17:00:20.351202+0000","last_became_peered":"2024-09-12T17:00:20.351202+0000","last_unstale":"2024-09-12T18:14:27.465904+0000","last_undegraded":"2024-09-12T18:14:27.465904+0000","last_fullsized":"2024-09-12T18:14:27.465904+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'768","last_scrub_stamp":"2024-09-12T18:14:27.465814+0000","last_deep_scrub":"264'768","last_deep_scrub_stamp":"2024-09-12T18:14:27.465814+0000","last_clean_scrub_stamp":"2024-09-12T18:14:27.465814+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:30.913051+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'208","reported_seq":1042,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:32.886927+0000","last_change":"2024-09-12T18:14:32.886927+0000","last_active":"2024-09-12T18:14:32.886927+0000","last_peered":"2024-09-12T18:14:32.886927+0000","last_clean":"2024-09-12T18:14:32.886927+0000","last_became_active":"2024-09-12T17:00:22.588111+0000","last_became_peered":"2024-09-12T17:00:22.588111+0000","last_unstale":"2024-09-12T18:14:32.886927+0000","last_undegraded":"2024-09-12T18:14:32.886927+0000","last_fullsized":"2024-09-12T18:14:32.886927+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'208","last_scrub_stamp":"2024-09-12T18:14:32.886828+0000","last_deep_scrub":"264'208","last_deep_scrub_stamp":"2024-09-12T18:14:32.886828+0000","last_clean_scrub_stamp":"2024-09-12T18:14:32.886828+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:45.836812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":621,"num_read_kb":619,"num_write":443,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'162","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.947891+0000","last_change":"2024-09-12T18:14:10.947891+0000","last_active":"2024-09-12T18:14:10.947891+0000","last_peered":"2024-09-12T18:14:10.947891+0000","last_clean":"2024-09-12T18:14:10.947891+0000","last_became_active":"2024-09-12T17:00:14.332424+0000","last_became_peered":"2024-09-12T17:00:14.332424+0000","last_unstale":"2024-09-12T18:14:10.947891+0000","last_undegraded":"2024-09-12T18:14:10.947891+0000","last_fullsized":"2024-09-12T18:14:10.947891+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'162","last_scrub_stamp":"2024-09-12T18:14:10.947786+0000","last_deep_scrub":"264'162","last_deep_scrub_stamp":"2024-09-12T18:14:10.947786+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.947786+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:36.780975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":720,"num_read_kb":605,"num_write":258,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'356","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.062180+0000","last_change":"2024-09-12T18:13:58.062122+0000","last_active":"2024-09-12T18:13:58.062180+0000","last_peered":"2024-09-12T18:13:58.062180+0000","last_clean":"2024-09-12T18:13:58.062180+0000","last_became_active":"2024-09-12T17:00:12.310337+0000","last_became_peered":"2024-09-12T17:00:12.310337+0000","last_unstale":"2024-09-12T18:13:58.062180+0000","last_undegraded":"2024-09-12T18:13:58.062180+0000","last_fullsized":"2024-09-12T18:13:58.062180+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-12T18:13:58.062029+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-12T18:13:58.062029+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.062029+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:33.366460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":552,"num_read_kb":13230,"num_write":1122,"num_write_kb":37058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:21.453349+0000","last_change":"2024-09-12T18:14:21.453349+0000","last_active":"2024-09-12T18:14:21.453349+0000","last_peered":"2024-09-12T18:14:21.453349+0000","last_clean":"2024-09-12T18:14:21.453349+0000","last_became_active":"2024-09-12T17:00:16.325141+0000","last_became_peered":"2024-09-12T17:00:16.325141+0000","last_unstale":"2024-09-12T18:14:21.453349+0000","last_undegraded":"2024-09-12T18:14:21.453349+0000","last_fullsized":"2024-09-12T18:14:21.453349+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:21.453254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:21.453254+0000","last_clean_scrub_stamp":"2024-09-12T18:14:21.453254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:29.853021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'313","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:24.501551+0000","last_change":"2024-09-12T18:14:24.501551+0000","last_active":"2024-09-12T18:14:24.501551+0000","last_peered":"2024-09-12T18:14:24.501551+0000","last_clean":"2024-09-12T18:14:24.501551+0000","last_became_active":"2024-09-12T17:00:18.430046+0000","last_became_peered":"2024-09-12T17:00:18.430046+0000","last_unstale":"2024-09-12T18:14:24.501551+0000","last_undegraded":"2024-09-12T18:14:24.501551+0000","last_fullsized":"2024-09-12T18:14:24.501551+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'313","last_scrub_stamp":"2024-09-12T18:14:24.501448+0000","last_deep_scrub":"264'313","last_deep_scrub_stamp":"2024-09-12T18:14:24.501448+0000","last_clean_scrub_stamp":"2024-09-12T18:14:24.501448+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:24.952495+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53213,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":492,"num_read_kb":1165,"num_write":400,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'773","reported_seq":2870,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:30.796203+0000","last_change":"2024-09-12T18:14:30.796203+0000","last_active":"2024-09-12T18:14:30.796203+0000","last_peered":"2024-09-12T18:14:30.796203+0000","last_clean":"2024-09-12T18:14:30.796203+0000","last_became_active":"2024-09-12T17:00:20.353914+0000","last_became_peered":"2024-09-12T17:00:20.353914+0000","last_unstale":"2024-09-12T18:14:30.796203+0000","last_undegraded":"2024-09-12T18:14:30.796203+0000","last_fullsized":"2024-09-12T18:14:30.796203+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'773","last_scrub_stamp":"2024-09-12T18:14:30.796110+0000","last_deep_scrub":"264'773","last_deep_scrub_stamp":"2024-09-12T18:14:30.796110+0000","last_clean_scrub_stamp":"2024-09-12T18:14:30.796110+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:10.267813+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'89","reported_seq":685,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.529816+0000","last_change":"2024-09-12T18:14:11.529816+0000","last_active":"2024-09-12T18:14:11.529816+0000","last_peered":"2024-09-12T18:14:11.529816+0000","last_clean":"2024-09-12T18:14:11.529816+0000","last_became_active":"2024-09-12T17:00:14.325669+0000","last_became_peered":"2024-09-12T17:00:14.325669+0000","last_unstale":"2024-09-12T18:14:11.529816+0000","last_undegraded":"2024-09-12T18:14:11.529816+0000","last_fullsized":"2024-09-12T18:14:11.529816+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'89","last_scrub_stamp":"2024-09-12T18:14:11.529715+0000","last_deep_scrub":"264'89","last_deep_scrub_stamp":"2024-09-12T18:14:11.529715+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.529715+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:01.485599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":392,"num_read_kb":330,"num_write":131,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'362","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.169003+0000","last_change":"2024-09-12T18:14:00.168944+0000","last_active":"2024-09-12T18:14:00.169003+0000","last_peered":"2024-09-12T18:14:00.169003+0000","last_clean":"2024-09-12T18:14:00.169003+0000","last_became_active":"2024-09-12T17:00:12.315015+0000","last_became_peered":"2024-09-12T17:00:12.315015+0000","last_unstale":"2024-09-12T18:14:00.169003+0000","last_undegraded":"2024-09-12T18:14:00.169003+0000","last_fullsized":"2024-09-12T18:14:00.169003+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'362","last_scrub_stamp":"2024-09-12T18:14:00.168837+0000","last_deep_scrub":"264'362","last_deep_scrub_stamp":"2024-09-12T18:14:00.168837+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.168837+0000","objects_scrubbed":8,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:13.982975+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311686,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":465,"num_read_kb":13974,"num_write":1122,"num_write_kb":21819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:15.291075+0000","last_change":"2024-09-12T18:14:15.291075+0000","last_active":"2024-09-12T18:14:15.291075+0000","last_peered":"2024-09-12T18:14:15.291075+0000","last_clean":"2024-09-12T18:14:15.291075+0000","last_became_active":"2024-09-12T17:00:16.322693+0000","last_became_peered":"2024-09-12T17:00:16.322693+0000","last_unstale":"2024-09-12T18:14:15.291075+0000","last_undegraded":"2024-09-12T18:14:15.291075+0000","last_fullsized":"2024-09-12T18:14:15.291075+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:15.290984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:15.290984+0000","last_clean_scrub_stamp":"2024-09-12T18:14:15.290984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:22.877472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'404","reported_seq":1055,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:24.461519+0000","last_change":"2024-09-12T18:14:24.461519+0000","last_active":"2024-09-12T18:14:24.461519+0000","last_peered":"2024-09-12T18:14:24.461519+0000","last_clean":"2024-09-12T18:14:24.461519+0000","last_became_active":"2024-09-12T17:00:18.429137+0000","last_became_peered":"2024-09-12T17:00:18.429137+0000","last_unstale":"2024-09-12T18:14:24.461519+0000","last_undegraded":"2024-09-12T18:14:24.461519+0000","last_fullsized":"2024-09-12T18:14:24.461519+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'404","last_scrub_stamp":"2024-09-12T18:14:24.461416+0000","last_deep_scrub":"264'404","last_deep_scrub_stamp":"2024-09-12T18:14:24.461416+0000","last_clean_scrub_stamp":"2024-09-12T18:14:24.461416+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:11.439801+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47718,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":656,"num_read_kb":1335,"num_write":508,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:16.245909+0000","last_change":"2024-09-12T18:14:16.245833+0000","last_active":"2024-09-12T18:14:16.245909+0000","last_peered":"2024-09-12T18:14:16.245909+0000","last_clean":"2024-09-12T18:14:16.245909+0000","last_became_active":"2024-09-12T17:00:20.348507+0000","last_became_peered":"2024-09-12T17:00:20.348507+0000","last_unstale":"2024-09-12T18:14:16.245909+0000","last_undegraded":"2024-09-12T18:14:16.245909+0000","last_fullsized":"2024-09-12T18:14:16.245909+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:16.245739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:16.245739+0000","last_clean_scrub_stamp":"2024-09-12T18:14:16.245739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:46.217319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'563","reported_seq":1396,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:30.435968+0000","last_change":"2024-09-12T18:14:30.435968+0000","last_active":"2024-09-12T18:14:30.435968+0000","last_peered":"2024-09-12T18:14:30.435968+0000","last_clean":"2024-09-12T18:14:30.435968+0000","last_became_active":"2024-09-12T17:00:22.358335+0000","last_became_peered":"2024-09-12T17:00:22.358335+0000","last_unstale":"2024-09-12T18:14:30.435968+0000","last_undegraded":"2024-09-12T18:14:30.435968+0000","last_fullsized":"2024-09-12T18:14:30.435968+0000","mapping_epoch":34,"log_start":"264'500","ondisk_log_start":"264'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'563","last_scrub_stamp":"2024-09-12T18:14:30.435874+0000","last_deep_scrub":"264'563","last_deep_scrub_stamp":"2024-09-12T18:14:30.435874+0000","last_clean_scrub_stamp":"2024-09-12T18:14:30.435874+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:20.170885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1357,"num_read_kb":1346,"num_write":1162,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'63","reported_seq":638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.872058+0000","last_change":"2024-09-12T18:14:02.872058+0000","last_active":"2024-09-12T18:14:02.872058+0000","last_peered":"2024-09-12T18:14:02.872058+0000","last_clean":"2024-09-12T18:14:02.872058+0000","last_became_active":"2024-09-12T17:00:14.335783+0000","last_became_peered":"2024-09-12T17:00:14.335783+0000","last_unstale":"2024-09-12T18:14:02.872058+0000","last_undegraded":"2024-09-12T18:14:02.872058+0000","last_fullsized":"2024-09-12T18:14:02.872058+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'63","last_scrub_stamp":"2024-09-12T18:14:02.871975+0000","last_deep_scrub":"264'63","last_deep_scrub_stamp":"2024-09-12T18:14:02.871975+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.871975+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:08.824516+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":238,"num_write":99,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'411","reported_seq":1151,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.203673+0000","last_change":"2024-09-12T18:14:01.203613+0000","last_active":"2024-09-12T18:14:01.203673+0000","last_peered":"2024-09-12T18:14:01.203673+0000","last_clean":"2024-09-12T18:14:01.203673+0000","last_became_active":"2024-09-12T17:00:12.307222+0000","last_became_peered":"2024-09-12T17:00:12.307222+0000","last_unstale":"2024-09-12T18:14:01.203673+0000","last_undegraded":"2024-09-12T18:14:01.203673+0000","last_fullsized":"2024-09-12T18:14:01.203673+0000","mapping_epoch":24,"log_start":"264'400","ondisk_log_start":"264'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'411","last_scrub_stamp":"2024-09-12T18:14:01.203510+0000","last_deep_scrub":"264'411","last_deep_scrub_stamp":"2024-09-12T18:14:01.203510+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.203510+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:03.740833+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":853,"num_read_kb":14510,"num_write":1377,"num_write_kb":34813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.081210+0000","last_change":"2024-09-12T18:14:03.081210+0000","last_active":"2024-09-12T18:14:03.081210+0000","last_peered":"2024-09-12T18:14:03.081210+0000","last_clean":"2024-09-12T18:14:03.081210+0000","last_became_active":"2024-09-12T17:00:16.322917+0000","last_became_peered":"2024-09-12T17:00:16.322917+0000","last_unstale":"2024-09-12T18:14:03.081210+0000","last_undegraded":"2024-09-12T18:14:03.081210+0000","last_fullsized":"2024-09-12T18:14:03.081210+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:03.081128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:03.081128+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.081128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:19.186349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'273","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:19.963269+0000","last_change":"2024-09-12T18:14:19.963185+0000","last_active":"2024-09-12T18:14:19.963269+0000","last_peered":"2024-09-12T18:14:19.963269+0000","last_clean":"2024-09-12T18:14:19.963269+0000","last_became_active":"2024-09-12T17:00:18.326791+0000","last_became_peered":"2024-09-12T17:00:18.326791+0000","last_unstale":"2024-09-12T18:14:19.963269+0000","last_undegraded":"2024-09-12T18:14:19.963269+0000","last_fullsized":"2024-09-12T18:14:19.963269+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'273","last_scrub_stamp":"2024-09-12T18:14:19.963085+0000","last_deep_scrub":"264'273","last_deep_scrub_stamp":"2024-09-12T18:14:19.963085+0000","last_clean_scrub_stamp":"2024-09-12T18:14:19.963085+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:52.889955+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43451,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":428,"num_read_kb":949,"num_write":338,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:29.805723+0000","last_change":"2024-09-12T18:14:29.805723+0000","last_active":"2024-09-12T18:14:29.805723+0000","last_peered":"2024-09-12T18:14:29.805723+0000","last_clean":"2024-09-12T18:14:29.805723+0000","last_became_active":"2024-09-12T17:00:20.353959+0000","last_became_peered":"2024-09-12T17:00:20.353959+0000","last_unstale":"2024-09-12T18:14:29.805723+0000","last_undegraded":"2024-09-12T18:14:29.805723+0000","last_fullsized":"2024-09-12T18:14:29.805723+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:29.805634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:29.805634+0000","last_clean_scrub_stamp":"2024-09-12T18:14:29.805634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:49.384223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'2409","reported_seq":4240,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:19.233622+0000","last_change":"2024-09-12T18:14:19.233622+0000","last_active":"2024-09-12T18:14:19.233622+0000","last_peered":"2024-09-12T18:14:19.233622+0000","last_clean":"2024-09-12T18:14:19.233622+0000","last_became_active":"2024-09-12T17:00:22.355651+0000","last_became_peered":"2024-09-12T17:00:22.355651+0000","last_unstale":"2024-09-12T18:14:19.233622+0000","last_undegraded":"2024-09-12T18:14:19.233622+0000","last_fullsized":"2024-09-12T18:14:19.233622+0000","mapping_epoch":34,"log_start":"264'2300","ondisk_log_start":"264'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2409","last_scrub_stamp":"2024-09-12T18:14:19.233517+0000","last_deep_scrub":"264'2409","last_deep_scrub_stamp":"2024-09-12T18:14:19.233517+0000","last_clean_scrub_stamp":"2024-09-12T18:14:19.233517+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":2300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:52:18.529817+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6022,"num_read_kb":6027,"num_write":4838,"num_write_kb":1790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'196","reported_seq":784,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.998772+0000","last_change":"2024-09-12T18:14:06.998699+0000","last_active":"2024-09-12T18:14:06.998772+0000","last_peered":"2024-09-12T18:14:06.998772+0000","last_clean":"2024-09-12T18:14:06.998772+0000","last_became_active":"2024-09-12T17:00:14.321270+0000","last_became_peered":"2024-09-12T17:00:14.321270+0000","last_unstale":"2024-09-12T18:14:06.998772+0000","last_undegraded":"2024-09-12T18:14:06.998772+0000","last_fullsized":"2024-09-12T18:14:06.998772+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'196","last_scrub_stamp":"2024-09-12T18:14:06.998613+0000","last_deep_scrub":"264'196","last_deep_scrub_stamp":"2024-09-12T18:14:06.998613+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.998613+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:01.248687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":834,"num_read_kb":668,"num_write":296,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'325","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.185437+0000","last_change":"2024-09-12T18:14:04.185362+0000","last_active":"2024-09-12T18:14:04.185437+0000","last_peered":"2024-09-12T18:14:04.185437+0000","last_clean":"2024-09-12T18:14:04.185437+0000","last_became_active":"2024-09-12T17:00:12.313262+0000","last_became_peered":"2024-09-12T17:00:12.313262+0000","last_unstale":"2024-09-12T18:14:04.185437+0000","last_undegraded":"2024-09-12T18:14:04.185437+0000","last_fullsized":"2024-09-12T18:14:04.185437+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'325","last_scrub_stamp":"2024-09-12T18:14:04.185253+0000","last_deep_scrub":"264'325","last_deep_scrub_stamp":"2024-09-12T18:14:04.185253+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.185253+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:59.905385+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":514296,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":454,"num_read_kb":16364,"num_write":986,"num_write_kb":27335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.184742+0000","last_change":"2024-09-12T18:14:07.184651+0000","last_active":"2024-09-12T18:14:07.184742+0000","last_peered":"2024-09-12T18:14:07.184742+0000","last_clean":"2024-09-12T18:14:07.184742+0000","last_became_active":"2024-09-12T17:00:16.321641+0000","last_became_peered":"2024-09-12T17:00:16.321641+0000","last_unstale":"2024-09-12T18:14:07.184742+0000","last_undegraded":"2024-09-12T18:14:07.184742+0000","last_fullsized":"2024-09-12T18:14:07.184742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:07.184519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:07.184519+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.184519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:04.109723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'345","reported_seq":959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:21.432871+0000","last_change":"2024-09-12T18:14:21.432871+0000","last_active":"2024-09-12T18:14:21.432871+0000","last_peered":"2024-09-12T18:14:21.432871+0000","last_clean":"2024-09-12T18:14:21.432871+0000","last_became_active":"2024-09-12T17:00:18.331707+0000","last_became_peered":"2024-09-12T17:00:18.331707+0000","last_unstale":"2024-09-12T18:14:21.432871+0000","last_undegraded":"2024-09-12T18:14:21.432871+0000","last_fullsized":"2024-09-12T18:14:21.432871+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'345","last_scrub_stamp":"2024-09-12T18:14:21.432771+0000","last_deep_scrub":"264'345","last_deep_scrub_stamp":"2024-09-12T18:14:21.432771+0000","last_clean_scrub_stamp":"2024-09-12T18:14:21.432771+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:36.257707+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47689,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":552,"num_read_kb":1215,"num_write":436,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'766","reported_seq":2737,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:27.262444+0000","last_change":"2024-09-12T18:14:27.262444+0000","last_active":"2024-09-12T18:14:27.262444+0000","last_peered":"2024-09-12T18:14:27.262444+0000","last_clean":"2024-09-12T18:14:27.262444+0000","last_became_active":"2024-09-12T17:00:20.348227+0000","last_became_peered":"2024-09-12T17:00:20.348227+0000","last_unstale":"2024-09-12T18:14:27.262444+0000","last_undegraded":"2024-09-12T18:14:27.262444+0000","last_fullsized":"2024-09-12T18:14:27.262444+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'766","last_scrub_stamp":"2024-09-12T18:14:27.262358+0000","last_deep_scrub":"264'766","last_deep_scrub_stamp":"2024-09-12T18:14:27.262358+0000","last_clean_scrub_stamp":"2024-09-12T18:14:27.262358+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:48.519225+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'116","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:28.274619+0000","last_change":"2024-09-12T18:14:28.274619+0000","last_active":"2024-09-12T18:14:28.274619+0000","last_peered":"2024-09-12T18:14:28.274619+0000","last_clean":"2024-09-12T18:14:28.274619+0000","last_became_active":"2024-09-12T17:00:22.353172+0000","last_became_peered":"2024-09-12T17:00:22.353172+0000","last_unstale":"2024-09-12T18:14:28.274619+0000","last_undegraded":"2024-09-12T18:14:28.274619+0000","last_fullsized":"2024-09-12T18:14:28.274619+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'116","last_scrub_stamp":"2024-09-12T18:14:28.274507+0000","last_deep_scrub":"264'116","last_deep_scrub_stamp":"2024-09-12T18:14:28.274507+0000","last_clean_scrub_stamp":"2024-09-12T18:14:28.274507+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:11.779233+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":136,"num_write":299,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'231","reported_seq":894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.156956+0000","last_change":"2024-09-12T18:14:08.156892+0000","last_active":"2024-09-12T18:14:08.156956+0000","last_peered":"2024-09-12T18:14:08.156956+0000","last_clean":"2024-09-12T18:14:08.156956+0000","last_became_active":"2024-09-12T17:00:14.324823+0000","last_became_peered":"2024-09-12T17:00:14.324823+0000","last_unstale":"2024-09-12T18:14:08.156956+0000","last_undegraded":"2024-09-12T18:14:08.156956+0000","last_fullsized":"2024-09-12T18:14:08.156956+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'231","last_scrub_stamp":"2024-09-12T18:14:08.156786+0000","last_deep_scrub":"264'231","last_deep_scrub_stamp":"2024-09-12T18:14:08.156786+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.156786+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:05.486389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1013,"num_read_kb":830,"num_write":393,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'409","reported_seq":1106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.506501+0000","last_change":"2024-09-12T18:14:00.506441+0000","last_active":"2024-09-12T18:14:00.506501+0000","last_peered":"2024-09-12T18:14:00.506501+0000","last_clean":"2024-09-12T18:14:00.506501+0000","last_became_active":"2024-09-12T17:00:12.318599+0000","last_became_peered":"2024-09-12T17:00:12.318599+0000","last_unstale":"2024-09-12T18:14:00.506501+0000","last_undegraded":"2024-09-12T18:14:00.506501+0000","last_fullsized":"2024-09-12T18:14:00.506501+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'409","last_scrub_stamp":"2024-09-12T18:14:00.506341+0000","last_deep_scrub":"264'409","last_deep_scrub_stamp":"2024-09-12T18:14:00.506341+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.506341+0000","objects_scrubbed":10,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:44.930843+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850207,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":687,"num_read_kb":44825,"num_write":1169,"num_write_kb":32428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.143934+0000","last_change":"2024-09-12T18:14:08.143874+0000","last_active":"2024-09-12T18:14:08.143934+0000","last_peered":"2024-09-12T18:14:08.143934+0000","last_clean":"2024-09-12T18:14:08.143934+0000","last_became_active":"2024-09-12T17:00:16.328352+0000","last_became_peered":"2024-09-12T17:00:16.328352+0000","last_unstale":"2024-09-12T18:14:08.143934+0000","last_undegraded":"2024-09-12T18:14:08.143934+0000","last_fullsized":"2024-09-12T18:14:08.143934+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:08.143773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:08.143773+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.143773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:58.048888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'482","reported_seq":1148,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:19.289062+0000","last_change":"2024-09-12T18:14:19.289062+0000","last_active":"2024-09-12T18:14:19.289062+0000","last_peered":"2024-09-12T18:14:19.289062+0000","last_clean":"2024-09-12T18:14:19.289062+0000","last_became_active":"2024-09-12T17:00:18.329414+0000","last_became_peered":"2024-09-12T17:00:18.329414+0000","last_unstale":"2024-09-12T18:14:19.289062+0000","last_undegraded":"2024-09-12T18:14:19.289062+0000","last_fullsized":"2024-09-12T18:14:19.289062+0000","mapping_epoch":30,"log_start":"264'400","ondisk_log_start":"264'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'482","last_scrub_stamp":"2024-09-12T18:14:19.288972+0000","last_deep_scrub":"264'482","last_deep_scrub_stamp":"2024-09-12T18:14:19.288972+0000","last_clean_scrub_stamp":"2024-09-12T18:14:19.288972+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:03.670071+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60099,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":839,"num_read_kb":2047,"num_write":682,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.106469+0000","last_change":"2024-09-12T18:14:13.106469+0000","last_active":"2024-09-12T18:14:13.106469+0000","last_peered":"2024-09-12T18:14:13.106469+0000","last_clean":"2024-09-12T18:14:13.106469+0000","last_became_active":"2024-09-12T17:00:20.352249+0000","last_became_peered":"2024-09-12T17:00:20.352249+0000","last_unstale":"2024-09-12T18:14:13.106469+0000","last_undegraded":"2024-09-12T18:14:13.106469+0000","last_fullsized":"2024-09-12T18:14:13.106469+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:13.106375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:13.106375+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.106375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:50.311270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'179","reported_seq":721,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:22.241611+0000","last_change":"2024-09-12T18:14:22.241611+0000","last_active":"2024-09-12T18:14:22.241611+0000","last_peered":"2024-09-12T18:14:22.241611+0000","last_clean":"2024-09-12T18:14:22.241611+0000","last_became_active":"2024-09-12T17:00:22.355850+0000","last_became_peered":"2024-09-12T17:00:22.355850+0000","last_unstale":"2024-09-12T18:14:22.241611+0000","last_undegraded":"2024-09-12T18:14:22.241611+0000","last_fullsized":"2024-09-12T18:14:22.241611+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-09-12T18:14:22.241519+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-09-12T18:14:22.241519+0000","last_clean_scrub_stamp":"2024-09-12T18:14:22.241519+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:24.072903+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":278,"num_read_kb":264,"num_write":436,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'144","reported_seq":760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.917152+0000","last_change":"2024-09-12T18:14:03.917096+0000","last_active":"2024-09-12T18:14:03.917152+0000","last_peered":"2024-09-12T18:14:03.917152+0000","last_clean":"2024-09-12T18:14:03.917152+0000","last_became_active":"2024-09-12T17:00:14.334594+0000","last_became_peered":"2024-09-12T17:00:14.334594+0000","last_unstale":"2024-09-12T18:14:03.917152+0000","last_undegraded":"2024-09-12T18:14:03.917152+0000","last_fullsized":"2024-09-12T18:14:03.917152+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'144","last_scrub_stamp":"2024-09-12T18:14:03.917002+0000","last_deep_scrub":"264'144","last_deep_scrub_stamp":"2024-09-12T18:14:03.917002+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.917002+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:28.774783+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":624,"num_read_kb":516,"num_write":207,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'348","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:56.926940+0000","last_change":"2024-09-12T18:13:56.926852+0000","last_active":"2024-09-12T18:13:56.926940+0000","last_peered":"2024-09-12T18:13:56.926940+0000","last_clean":"2024-09-12T18:13:56.926940+0000","last_became_active":"2024-09-12T17:00:12.314509+0000","last_became_peered":"2024-09-12T17:00:12.314509+0000","last_unstale":"2024-09-12T18:13:56.926940+0000","last_undegraded":"2024-09-12T18:13:56.926940+0000","last_fullsized":"2024-09-12T18:13:56.926940+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'348","last_scrub_stamp":"2024-09-12T18:13:56.926498+0000","last_deep_scrub":"264'348","last_deep_scrub_stamp":"2024-09-12T18:13:56.926498+0000","last_clean_scrub_stamp":"2024-09-12T18:13:56.926498+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:36.730340+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2180125,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":439,"num_read_kb":51555,"num_write":1035,"num_write_kb":32245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.184733+0000","last_change":"2024-09-12T18:14:10.184661+0000","last_active":"2024-09-12T18:14:10.184733+0000","last_peered":"2024-09-12T18:14:10.184733+0000","last_clean":"2024-09-12T18:14:10.184733+0000","last_became_active":"2024-09-12T17:00:16.319269+0000","last_became_peered":"2024-09-12T17:00:16.319269+0000","last_unstale":"2024-09-12T18:14:10.184733+0000","last_undegraded":"2024-09-12T18:14:10.184733+0000","last_fullsized":"2024-09-12T18:14:10.184733+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:10.184575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:10.184575+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.184575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:10.584698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'302","reported_seq":908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:21.891284+0000","last_change":"2024-09-12T18:14:21.891215+0000","last_active":"2024-09-12T18:14:21.891284+0000","last_peered":"2024-09-12T18:14:21.891284+0000","last_clean":"2024-09-12T18:14:21.891284+0000","last_became_active":"2024-09-12T17:00:18.330634+0000","last_became_peered":"2024-09-12T17:00:18.330634+0000","last_unstale":"2024-09-12T18:14:21.891284+0000","last_undegraded":"2024-09-12T18:14:21.891284+0000","last_fullsized":"2024-09-12T18:14:21.891284+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'302","last_scrub_stamp":"2024-09-12T18:14:21.891090+0000","last_deep_scrub":"264'302","last_deep_scrub_stamp":"2024-09-12T18:14:21.891090+0000","last_clean_scrub_stamp":"2024-09-12T18:14:21.891090+0000","objects_scrubbed":7,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:21.260428+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48221,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":495,"num_read_kb":1035,"num_write":432,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:24.194293+0000","last_change":"2024-09-12T18:14:24.194175+0000","last_active":"2024-09-12T18:14:24.194293+0000","last_peered":"2024-09-12T18:14:24.194293+0000","last_clean":"2024-09-12T18:14:24.194293+0000","last_became_active":"2024-09-12T17:00:20.351001+0000","last_became_peered":"2024-09-12T17:00:20.351001+0000","last_unstale":"2024-09-12T18:14:24.194293+0000","last_undegraded":"2024-09-12T18:14:24.194293+0000","last_fullsized":"2024-09-12T18:14:24.194293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:24.194064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:24.194064+0000","last_clean_scrub_stamp":"2024-09-12T18:14:24.194064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:58.960227+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'125","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:31.843679+0000","last_change":"2024-09-12T18:14:31.843577+0000","last_active":"2024-09-12T18:14:31.843679+0000","last_peered":"2024-09-12T18:14:31.843679+0000","last_clean":"2024-09-12T18:14:31.843679+0000","last_became_active":"2024-09-12T17:00:22.357001+0000","last_became_peered":"2024-09-12T17:00:22.357001+0000","last_unstale":"2024-09-12T18:14:31.843679+0000","last_undegraded":"2024-09-12T18:14:31.843679+0000","last_fullsized":"2024-09-12T18:14:31.843679+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'125","last_scrub_stamp":"2024-09-12T18:14:31.843463+0000","last_deep_scrub":"264'125","last_deep_scrub_stamp":"2024-09-12T18:14:31.843463+0000","last_clean_scrub_stamp":"2024-09-12T18:14:31.843463+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:17.402238+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":156,"num_write":307,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'263","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.957494+0000","last_change":"2024-09-12T18:14:04.957402+0000","last_active":"2024-09-12T18:14:04.957494+0000","last_peered":"2024-09-12T18:14:04.957494+0000","last_clean":"2024-09-12T18:14:04.957494+0000","last_became_active":"2024-09-12T17:00:14.320928+0000","last_became_peered":"2024-09-12T17:00:14.320928+0000","last_unstale":"2024-09-12T18:14:04.957494+0000","last_undegraded":"2024-09-12T18:14:04.957494+0000","last_fullsized":"2024-09-12T18:14:04.957494+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'263","last_scrub_stamp":"2024-09-12T18:14:04.957288+0000","last_deep_scrub":"264'263","last_deep_scrub_stamp":"2024-09-12T18:14:04.957288+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.957288+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:04.198862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1139,"num_read_kb":929,"num_write":426,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'361","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.038411+0000","last_change":"2024-09-12T18:14:00.038340+0000","last_active":"2024-09-12T18:14:00.038411+0000","last_peered":"2024-09-12T18:14:00.038411+0000","last_clean":"2024-09-12T18:14:00.038411+0000","last_became_active":"2024-09-12T17:00:12.308967+0000","last_became_peered":"2024-09-12T17:00:12.308967+0000","last_unstale":"2024-09-12T18:14:00.038411+0000","last_undegraded":"2024-09-12T18:14:00.038411+0000","last_fullsized":"2024-09-12T18:14:00.038411+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'361","last_scrub_stamp":"2024-09-12T18:14:00.038240+0000","last_deep_scrub":"264'361","last_deep_scrub_stamp":"2024-09-12T18:14:00.038240+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.038240+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:42.694292+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549696,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":120658,"num_write":1095,"num_write_kb":55796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.118915+0000","last_change":"2024-09-12T18:14:10.118839+0000","last_active":"2024-09-12T18:14:10.118915+0000","last_peered":"2024-09-12T18:14:10.118915+0000","last_clean":"2024-09-12T18:14:10.118915+0000","last_became_active":"2024-09-12T17:00:16.329596+0000","last_became_peered":"2024-09-12T17:00:16.329596+0000","last_unstale":"2024-09-12T18:14:10.118915+0000","last_undegraded":"2024-09-12T18:14:10.118915+0000","last_fullsized":"2024-09-12T18:14:10.118915+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:10.118740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:10.118740+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.118740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:07.683997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'350","reported_seq":968,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.163547+0000","last_change":"2024-09-12T18:14:11.163418+0000","last_active":"2024-09-12T18:14:11.163547+0000","last_peered":"2024-09-12T18:14:11.163547+0000","last_clean":"2024-09-12T18:14:11.163547+0000","last_became_active":"2024-09-12T17:00:18.331483+0000","last_became_peered":"2024-09-12T17:00:18.331483+0000","last_unstale":"2024-09-12T18:14:11.163547+0000","last_undegraded":"2024-09-12T18:14:11.163547+0000","last_fullsized":"2024-09-12T18:14:11.163547+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-12T18:14:11.163297+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-12T18:14:11.163297+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.163297+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:56.385197+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48847,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":573,"num_read_kb":1293,"num_write":456,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'739","reported_seq":4713,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:15.120851+0000","last_change":"2024-09-12T18:14:15.120778+0000","last_active":"2024-09-12T18:14:15.120851+0000","last_peered":"2024-09-12T18:14:15.120851+0000","last_clean":"2024-09-12T18:14:15.120851+0000","last_became_active":"2024-09-12T17:00:20.352022+0000","last_became_peered":"2024-09-12T17:00:20.352022+0000","last_unstale":"2024-09-12T18:14:15.120851+0000","last_undegraded":"2024-09-12T18:14:15.120851+0000","last_fullsized":"2024-09-12T18:14:15.120851+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'739","last_scrub_stamp":"2024-09-12T18:14:15.120687+0000","last_deep_scrub":"264'739","last_deep_scrub_stamp":"2024-09-12T18:14:15.120687+0000","last_clean_scrub_stamp":"2024-09-12T18:14:15.120687+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:39.722836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'85","reported_seq":605,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:20.223190+0000","last_change":"2024-09-12T18:14:20.223190+0000","last_active":"2024-09-12T18:14:20.223190+0000","last_peered":"2024-09-12T18:14:20.223190+0000","last_clean":"2024-09-12T18:14:20.223190+0000","last_became_active":"2024-09-12T17:00:22.350283+0000","last_became_peered":"2024-09-12T17:00:22.350283+0000","last_unstale":"2024-09-12T18:14:20.223190+0000","last_undegraded":"2024-09-12T18:14:20.223190+0000","last_fullsized":"2024-09-12T18:14:20.223190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'85","last_scrub_stamp":"2024-09-12T18:14:20.223082+0000","last_deep_scrub":"264'85","last_deep_scrub_stamp":"2024-09-12T18:14:20.223082+0000","last_clean_scrub_stamp":"2024-09-12T18:14:20.223082+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:54.745956+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":129,"num_read_kb":121,"num_write":196,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'24","reported_seq":578,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.926271+0000","last_change":"2024-09-12T18:14:05.926204+0000","last_active":"2024-09-12T18:14:05.926271+0000","last_peered":"2024-09-12T18:14:05.926271+0000","last_clean":"2024-09-12T18:14:05.926271+0000","last_became_active":"2024-09-12T17:00:14.325788+0000","last_became_peered":"2024-09-12T17:00:14.325788+0000","last_unstale":"2024-09-12T18:14:05.926271+0000","last_undegraded":"2024-09-12T18:14:05.926271+0000","last_fullsized":"2024-09-12T18:14:05.926271+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-09-12T18:14:05.926108+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-09-12T18:14:05.926108+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.926108+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:59.672862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":96,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'334","reported_seq":1039,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.798217+0000","last_change":"2024-09-12T18:13:59.798217+0000","last_active":"2024-09-12T18:13:59.798217+0000","last_peered":"2024-09-12T18:13:59.798217+0000","last_clean":"2024-09-12T18:13:59.798217+0000","last_became_active":"2024-09-12T17:00:12.309388+0000","last_became_peered":"2024-09-12T17:00:12.309388+0000","last_unstale":"2024-09-12T18:13:59.798217+0000","last_undegraded":"2024-09-12T18:13:59.798217+0000","last_fullsized":"2024-09-12T18:13:59.798217+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'334","last_scrub_stamp":"2024-09-12T18:13:59.798123+0000","last_deep_scrub":"264'334","last_deep_scrub_stamp":"2024-09-12T18:13:59.798123+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.798123+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:12.466059+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3573814,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":548,"num_read_kb":20473,"num_write":1106,"num_write_kb":21258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:19.375377+0000","last_change":"2024-09-12T18:14:19.375270+0000","last_active":"2024-09-12T18:14:19.375377+0000","last_peered":"2024-09-12T18:14:19.375377+0000","last_clean":"2024-09-12T18:14:19.375377+0000","last_became_active":"2024-09-12T17:00:16.330035+0000","last_became_peered":"2024-09-12T17:00:16.330035+0000","last_unstale":"2024-09-12T18:14:19.375377+0000","last_undegraded":"2024-09-12T18:14:19.375377+0000","last_fullsized":"2024-09-12T18:14:19.375377+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:14:19.375155+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:14:19.375155+0000","last_clean_scrub_stamp":"2024-09-12T18:14:19.375155+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:02.164761+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'107","reported_seq":651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:21.964109+0000","last_change":"2024-09-12T18:14:21.964031+0000","last_active":"2024-09-12T18:14:21.964109+0000","last_peered":"2024-09-12T18:14:21.964109+0000","last_clean":"2024-09-12T18:14:21.964109+0000","last_became_active":"2024-09-12T17:00:18.429253+0000","last_became_peered":"2024-09-12T17:00:18.429253+0000","last_unstale":"2024-09-12T18:14:21.964109+0000","last_undegraded":"2024-09-12T18:14:21.964109+0000","last_fullsized":"2024-09-12T18:14:21.964109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-09-12T18:14:21.963939+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-09-12T18:14:21.963939+0000","last_clean_scrub_stamp":"2024-09-12T18:14:21.963939+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:34.121435+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'784","reported_seq":2542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:16.232299+0000","last_change":"2024-09-12T18:14:16.232241+0000","last_active":"2024-09-12T18:14:16.232299+0000","last_peered":"2024-09-12T18:14:16.232299+0000","last_clean":"2024-09-12T18:14:16.232299+0000","last_became_active":"2024-09-12T17:00:20.352792+0000","last_became_peered":"2024-09-12T17:00:20.352792+0000","last_unstale":"2024-09-12T18:14:16.232299+0000","last_undegraded":"2024-09-12T18:14:16.232299+0000","last_fullsized":"2024-09-12T18:14:16.232299+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'784","last_scrub_stamp":"2024-09-12T18:14:16.232145+0000","last_deep_scrub":"264'784","last_deep_scrub_stamp":"2024-09-12T18:14:16.232145+0000","last_clean_scrub_stamp":"2024-09-12T18:14:16.232145+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:01.862114+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'112","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:29.870180+0000","last_change":"2024-09-12T18:14:29.870180+0000","last_active":"2024-09-12T18:14:29.870180+0000","last_peered":"2024-09-12T18:14:29.870180+0000","last_clean":"2024-09-12T18:14:29.870180+0000","last_became_active":"2024-09-12T17:00:22.352182+0000","last_became_peered":"2024-09-12T17:00:22.352182+0000","last_unstale":"2024-09-12T18:14:29.870180+0000","last_undegraded":"2024-09-12T18:14:29.870180+0000","last_fullsized":"2024-09-12T18:14:29.870180+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-09-12T18:14:29.870096+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-09-12T18:14:29.870096+0000","last_clean_scrub_stamp":"2024-09-12T18:14:29.870096+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:28.046772+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":119,"num_write":244,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'121","reported_seq":775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.105426+0000","last_change":"2024-09-12T18:14:06.105357+0000","last_active":"2024-09-12T18:14:06.105426+0000","last_peered":"2024-09-12T18:14:06.105426+0000","last_clean":"2024-09-12T18:14:06.105426+0000","last_became_active":"2024-09-12T17:00:14.329394+0000","last_became_peered":"2024-09-12T17:00:14.329394+0000","last_unstale":"2024-09-12T18:14:06.105426+0000","last_undegraded":"2024-09-12T18:14:06.105426+0000","last_fullsized":"2024-09-12T18:14:06.105426+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'121","last_scrub_stamp":"2024-09-12T18:14:06.105271+0000","last_deep_scrub":"264'121","last_deep_scrub_stamp":"2024-09-12T18:14:06.105271+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.105271+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:06.164775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":562,"num_read_kb":483,"num_write":177,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'420","reported_seq":1118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.979078+0000","last_change":"2024-09-12T18:13:59.979078+0000","last_active":"2024-09-12T18:13:59.979078+0000","last_peered":"2024-09-12T18:13:59.979078+0000","last_clean":"2024-09-12T18:13:59.979078+0000","last_became_active":"2024-09-12T17:00:12.314142+0000","last_became_peered":"2024-09-12T17:00:12.314142+0000","last_unstale":"2024-09-12T18:13:59.979078+0000","last_undegraded":"2024-09-12T18:13:59.979078+0000","last_fullsized":"2024-09-12T18:13:59.979078+0000","mapping_epoch":24,"log_start":"264'400","ondisk_log_start":"264'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'420","last_scrub_stamp":"2024-09-12T18:13:59.978965+0000","last_deep_scrub":"264'420","last_deep_scrub_stamp":"2024-09-12T18:13:59.978965+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.978965+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:13.441168+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306453,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":807,"num_read_kb":14993,"num_write":1145,"num_write_kb":29270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:18.797551+0000","last_change":"2024-09-12T18:14:18.797485+0000","last_active":"2024-09-12T18:14:18.797551+0000","last_peered":"2024-09-12T18:14:18.797551+0000","last_clean":"2024-09-12T18:14:18.797551+0000","last_became_active":"2024-09-12T17:00:16.328306+0000","last_became_peered":"2024-09-12T17:00:16.328306+0000","last_unstale":"2024-09-12T18:14:18.797551+0000","last_undegraded":"2024-09-12T18:14:18.797551+0000","last_fullsized":"2024-09-12T18:14:18.797551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:18.797397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:18.797397+0000","last_clean_scrub_stamp":"2024-09-12T18:14:18.797397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:18.136486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'396","reported_seq":1038,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:25.475237+0000","last_change":"2024-09-12T18:14:25.475175+0000","last_active":"2024-09-12T18:14:25.475237+0000","last_peered":"2024-09-12T18:14:25.475237+0000","last_clean":"2024-09-12T18:14:25.475237+0000","last_became_active":"2024-09-12T17:00:18.328500+0000","last_became_peered":"2024-09-12T17:00:18.328500+0000","last_unstale":"2024-09-12T18:14:25.475237+0000","last_undegraded":"2024-09-12T18:14:25.475237+0000","last_fullsized":"2024-09-12T18:14:25.475237+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'396","last_scrub_stamp":"2024-09-12T18:14:25.475080+0000","last_deep_scrub":"264'396","last_deep_scrub_stamp":"2024-09-12T18:14:25.475080+0000","last_clean_scrub_stamp":"2024-09-12T18:14:25.475080+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:49.731826+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46864,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":620,"num_read_kb":1249,"num_write":480,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:15.221543+0000","last_change":"2024-09-12T18:14:15.221487+0000","last_active":"2024-09-12T18:14:15.221543+0000","last_peered":"2024-09-12T18:14:15.221543+0000","last_clean":"2024-09-12T18:14:15.221543+0000","last_became_active":"2024-09-12T17:00:20.350003+0000","last_became_peered":"2024-09-12T17:00:20.350003+0000","last_unstale":"2024-09-12T18:14:15.221543+0000","last_undegraded":"2024-09-12T18:14:15.221543+0000","last_fullsized":"2024-09-12T18:14:15.221543+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:15.221371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:15.221371+0000","last_clean_scrub_stamp":"2024-09-12T18:14:15.221371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:14.433881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'132","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:21.202488+0000","last_change":"2024-09-12T18:14:21.202488+0000","last_active":"2024-09-12T18:14:21.202488+0000","last_peered":"2024-09-12T18:14:21.202488+0000","last_clean":"2024-09-12T18:14:21.202488+0000","last_became_active":"2024-09-12T17:00:22.354601+0000","last_became_peered":"2024-09-12T17:00:22.354601+0000","last_unstale":"2024-09-12T18:14:21.202488+0000","last_undegraded":"2024-09-12T18:14:21.202488+0000","last_fullsized":"2024-09-12T18:14:21.202488+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'132","last_scrub_stamp":"2024-09-12T18:14:21.202400+0000","last_deep_scrub":"264'132","last_deep_scrub_stamp":"2024-09-12T18:14:21.202400+0000","last_clean_scrub_stamp":"2024-09-12T18:14:21.202400+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:03.285432+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":184,"num_read_kb":175,"num_write":297,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'263","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.038272+0000","last_change":"2024-09-12T18:14:06.038272+0000","last_active":"2024-09-12T18:14:06.038272+0000","last_peered":"2024-09-12T18:14:06.038272+0000","last_clean":"2024-09-12T18:14:06.038272+0000","last_became_active":"2024-09-12T17:00:14.329297+0000","last_became_peered":"2024-09-12T17:00:14.329297+0000","last_unstale":"2024-09-12T18:14:06.038272+0000","last_undegraded":"2024-09-12T18:14:06.038272+0000","last_fullsized":"2024-09-12T18:14:06.038272+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'263","last_scrub_stamp":"2024-09-12T18:14:06.038186+0000","last_deep_scrub":"264'263","last_deep_scrub_stamp":"2024-09-12T18:14:06.038186+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.038186+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:05.593867+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1103,"num_read_kb":898,"num_write":417,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.163457+0000","last_change":"2024-09-12T18:13:58.163398+0000","last_active":"2024-09-12T18:13:58.163457+0000","last_peered":"2024-09-12T18:13:58.163457+0000","last_clean":"2024-09-12T18:13:58.163457+0000","last_became_active":"2024-09-12T16:59:54.636487+0000","last_became_peered":"2024-09-12T16:59:54.636487+0000","last_unstale":"2024-09-12T18:13:58.163457+0000","last_undegraded":"2024-09-12T18:13:58.163457+0000","last_fullsized":"2024-09-12T18:13:58.163457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-12T18:13:58.163290+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-12T18:13:58.163290+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.163290+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:28.159963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":539,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.475103+0000","last_change":"2024-09-12T18:13:58.475103+0000","last_active":"2024-09-12T18:13:58.475103+0000","last_peered":"2024-09-12T18:13:58.475103+0000","last_clean":"2024-09-12T18:13:58.475103+0000","last_became_active":"2024-09-12T17:00:00.669728+0000","last_became_peered":"2024-09-12T17:00:00.669728+0000","last_unstale":"2024-09-12T18:13:58.475103+0000","last_undegraded":"2024-09-12T18:13:58.475103+0000","last_fullsized":"2024-09-12T18:13:58.475103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:13:58.475005+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:13:58.475005+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.475005+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:02.835560+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00058116500000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'384","reported_seq":1079,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.120325+0000","last_change":"2024-09-12T18:13:58.120325+0000","last_active":"2024-09-12T18:13:58.120325+0000","last_peered":"2024-09-12T18:13:58.120325+0000","last_clean":"2024-09-12T18:13:58.120325+0000","last_became_active":"2024-09-12T17:00:46.404905+0000","last_became_peered":"2024-09-12T17:00:46.404905+0000","last_unstale":"2024-09-12T18:13:58.120325+0000","last_undegraded":"2024-09-12T18:13:58.120325+0000","last_fullsized":"2024-09-12T18:13:58.120325+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'384","last_scrub_stamp":"2024-09-12T18:13:58.120248+0000","last_deep_scrub":"264'384","last_deep_scrub_stamp":"2024-09-12T18:13:58.120248+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.120248+0000","objects_scrubbed":7,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:48.874148+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524314,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":662,"num_read_kb":82700,"num_write":1255,"num_write_kb":21344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:16.314317+0000","last_change":"2024-09-12T18:14:16.314317+0000","last_active":"2024-09-12T18:14:16.314317+0000","last_peered":"2024-09-12T18:14:16.314317+0000","last_clean":"2024-09-12T18:14:16.314317+0000","last_became_active":"2024-09-12T17:00:16.321151+0000","last_became_peered":"2024-09-12T17:00:16.321151+0000","last_unstale":"2024-09-12T18:14:16.314317+0000","last_undegraded":"2024-09-12T18:14:16.314317+0000","last_fullsized":"2024-09-12T18:14:16.314317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:16.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:16.314230+0000","last_clean_scrub_stamp":"2024-09-12T18:14:16.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:30.567163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'761","reported_seq":1488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:23.500341+0000","last_change":"2024-09-12T18:14:23.500341+0000","last_active":"2024-09-12T18:14:23.500341+0000","last_peered":"2024-09-12T18:14:23.500341+0000","last_clean":"2024-09-12T18:14:23.500341+0000","last_became_active":"2024-09-12T17:00:18.330037+0000","last_became_peered":"2024-09-12T17:00:18.330037+0000","last_unstale":"2024-09-12T18:14:23.500341+0000","last_undegraded":"2024-09-12T18:14:23.500341+0000","last_fullsized":"2024-09-12T18:14:23.500341+0000","mapping_epoch":30,"log_start":"264'700","ondisk_log_start":"264'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'761","last_scrub_stamp":"2024-09-12T18:14:23.500228+0000","last_deep_scrub":"264'761","last_deep_scrub_stamp":"2024-09-12T18:14:23.500228+0000","last_clean_scrub_stamp":"2024-09-12T18:14:23.500228+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:19.444656+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153681,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1487,"num_read_kb":3466,"num_write":1434,"num_write_kb":1274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106952,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:23.229062+0000","last_change":"2024-09-12T18:14:23.229062+0000","last_active":"2024-09-12T18:14:23.229062+0000","last_peered":"2024-09-12T18:14:23.229062+0000","last_clean":"2024-09-12T18:14:23.229062+0000","last_became_active":"2024-09-12T17:00:20.349363+0000","last_became_peered":"2024-09-12T17:00:20.349363+0000","last_unstale":"2024-09-12T18:14:23.229062+0000","last_undegraded":"2024-09-12T18:14:23.229062+0000","last_fullsized":"2024-09-12T18:14:23.229062+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:23.228974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:23.228974+0000","last_clean_scrub_stamp":"2024-09-12T18:14:23.228974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:43.524040+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'190","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:21.241770+0000","last_change":"2024-09-12T18:14:21.241770+0000","last_active":"2024-09-12T18:14:21.241770+0000","last_peered":"2024-09-12T18:14:21.241770+0000","last_clean":"2024-09-12T18:14:21.241770+0000","last_became_active":"2024-09-12T17:00:22.354654+0000","last_became_peered":"2024-09-12T17:00:22.354654+0000","last_unstale":"2024-09-12T18:14:21.241770+0000","last_undegraded":"2024-09-12T18:14:21.241770+0000","last_fullsized":"2024-09-12T18:14:21.241770+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-09-12T18:14:21.241675+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-09-12T18:14:21.241675+0000","last_clean_scrub_stamp":"2024-09-12T18:14:21.241675+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:19.848903+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":450,"num_read_kb":449,"num_write":373,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'132","reported_seq":751,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.085111+0000","last_change":"2024-09-12T18:14:05.085111+0000","last_active":"2024-09-12T18:14:05.085111+0000","last_peered":"2024-09-12T18:14:05.085111+0000","last_clean":"2024-09-12T18:14:05.085111+0000","last_became_active":"2024-09-12T17:00:14.319539+0000","last_became_peered":"2024-09-12T17:00:14.319539+0000","last_unstale":"2024-09-12T18:14:05.085111+0000","last_undegraded":"2024-09-12T18:14:05.085111+0000","last_fullsized":"2024-09-12T18:14:05.085111+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'132","last_scrub_stamp":"2024-09-12T18:14:05.085020+0000","last_deep_scrub":"264'132","last_deep_scrub_stamp":"2024-09-12T18:14:05.085020+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.085020+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:53.322244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":596,"num_read_kb":500,"num_write":197,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":534,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.182307+0000","last_change":"2024-09-12T18:13:59.182258+0000","last_active":"2024-09-12T18:13:59.182307+0000","last_peered":"2024-09-12T18:13:59.182307+0000","last_clean":"2024-09-12T18:13:59.182307+0000","last_became_active":"2024-09-12T17:00:00.671211+0000","last_became_peered":"2024-09-12T17:00:00.671211+0000","last_unstale":"2024-09-12T18:13:59.182307+0000","last_undegraded":"2024-09-12T18:13:59.182307+0000","last_fullsized":"2024-09-12T18:13:59.182307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:59.182180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:59.182180+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.182180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:05.491469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000441562,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'332","reported_seq":1024,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.150556+0000","last_change":"2024-09-12T18:13:58.150556+0000","last_active":"2024-09-12T18:13:58.150556+0000","last_peered":"2024-09-12T18:13:58.150556+0000","last_clean":"2024-09-12T18:13:58.150556+0000","last_became_active":"2024-09-12T17:00:12.306408+0000","last_became_peered":"2024-09-12T17:00:12.306408+0000","last_unstale":"2024-09-12T18:13:58.150556+0000","last_undegraded":"2024-09-12T18:13:58.150556+0000","last_fullsized":"2024-09-12T18:13:58.150556+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-12T18:13:58.150468+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-12T18:13:58.150468+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.150468+0000","objects_scrubbed":9,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:01.376992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1499227,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":518,"num_read_kb":8959,"num_write":977,"num_write_kb":13821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:18.418807+0000","last_change":"2024-09-12T18:14:18.418807+0000","last_active":"2024-09-12T18:14:18.418807+0000","last_peered":"2024-09-12T18:14:18.418807+0000","last_clean":"2024-09-12T18:14:18.418807+0000","last_became_active":"2024-09-12T17:00:16.325914+0000","last_became_peered":"2024-09-12T17:00:16.325914+0000","last_unstale":"2024-09-12T18:14:18.418807+0000","last_undegraded":"2024-09-12T18:14:18.418807+0000","last_fullsized":"2024-09-12T18:14:18.418807+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:18.418708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:18.418708+0000","last_clean_scrub_stamp":"2024-09-12T18:14:18.418708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:50.212483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1365","reported_seq":3212,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.182612+0000","last_change":"2024-09-12T18:14:13.182612+0000","last_active":"2024-09-12T18:14:13.182612+0000","last_peered":"2024-09-12T18:14:13.182612+0000","last_clean":"2024-09-12T18:14:13.182612+0000","last_became_active":"2024-09-12T17:00:18.330715+0000","last_became_peered":"2024-09-12T17:00:18.330715+0000","last_unstale":"2024-09-12T18:14:13.182612+0000","last_undegraded":"2024-09-12T18:14:13.182612+0000","last_fullsized":"2024-09-12T18:14:13.182612+0000","mapping_epoch":30,"log_start":"264'1300","ondisk_log_start":"264'1300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1365","last_scrub_stamp":"2024-09-12T18:14:13.182494+0000","last_deep_scrub":"264'1365","last_deep_scrub_stamp":"2024-09-12T18:14:13.182494+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.182494+0000","objects_scrubbed":11,"log_size":65,"log_dups_size":1300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:53.314146+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154155,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2179,"num_read_kb":4259,"num_write":1270,"num_write_kb":1078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:25.510127+0000","last_change":"2024-09-12T18:14:25.510127+0000","last_active":"2024-09-12T18:14:25.510127+0000","last_peered":"2024-09-12T18:14:25.510127+0000","last_clean":"2024-09-12T18:14:25.510127+0000","last_became_active":"2024-09-12T17:00:20.352287+0000","last_became_peered":"2024-09-12T17:00:20.352287+0000","last_unstale":"2024-09-12T18:14:25.510127+0000","last_undegraded":"2024-09-12T18:14:25.510127+0000","last_fullsized":"2024-09-12T18:14:25.510127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:25.510040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:25.510040+0000","last_clean_scrub_stamp":"2024-09-12T18:14:25.510040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:10.632047+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'97","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:23.206434+0000","last_change":"2024-09-12T18:14:23.206434+0000","last_active":"2024-09-12T18:14:23.206434+0000","last_peered":"2024-09-12T18:14:23.206434+0000","last_clean":"2024-09-12T18:14:23.206434+0000","last_became_active":"2024-09-12T17:00:22.587206+0000","last_became_peered":"2024-09-12T17:00:22.587206+0000","last_unstale":"2024-09-12T18:14:23.206434+0000","last_undegraded":"2024-09-12T18:14:23.206434+0000","last_fullsized":"2024-09-12T18:14:23.206434+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'97","last_scrub_stamp":"2024-09-12T18:14:23.206343+0000","last_deep_scrub":"264'97","last_deep_scrub_stamp":"2024-09-12T18:14:23.206343+0000","last_clean_scrub_stamp":"2024-09-12T18:14:23.206343+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:31.456728+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":151,"num_write":236,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'4068","reported_seq":4661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.108609+0000","last_change":"2024-09-12T18:14:05.108609+0000","last_active":"2024-09-12T18:14:05.108609+0000","last_peered":"2024-09-12T18:14:05.108609+0000","last_clean":"2024-09-12T18:14:05.108609+0000","last_became_active":"2024-09-12T17:00:14.331560+0000","last_became_peered":"2024-09-12T17:00:14.331560+0000","last_unstale":"2024-09-12T18:14:05.108609+0000","last_undegraded":"2024-09-12T18:14:05.108609+0000","last_fullsized":"2024-09-12T18:14:05.108609+0000","mapping_epoch":26,"log_start":"264'4000","ondisk_log_start":"264'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4068","last_scrub_stamp":"2024-09-12T18:14:05.108524+0000","last_deep_scrub":"264'4068","last_deep_scrub_stamp":"2024-09-12T18:14:05.108524+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.108524+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":3000,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:03.977064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16331,"num_read_kb":13702,"num_write":6093,"num_write_kb":3038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":537,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:56.176811+0000","last_change":"2024-09-12T18:13:56.176811+0000","last_active":"2024-09-12T18:13:56.176811+0000","last_peered":"2024-09-12T18:13:56.176811+0000","last_clean":"2024-09-12T18:13:56.176811+0000","last_became_active":"2024-09-12T17:00:01.173083+0000","last_became_peered":"2024-09-12T17:00:01.173083+0000","last_unstale":"2024-09-12T18:13:56.176811+0000","last_undegraded":"2024-09-12T18:13:56.176811+0000","last_fullsized":"2024-09-12T18:13:56.176811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:56.176741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:56.176741+0000","last_clean_scrub_stamp":"2024-09-12T18:13:56.176741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:36.851800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056135799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'326","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:57.001242+0000","last_change":"2024-09-12T18:13:57.001192+0000","last_active":"2024-09-12T18:13:57.001242+0000","last_peered":"2024-09-12T18:13:57.001242+0000","last_clean":"2024-09-12T18:13:57.001242+0000","last_became_active":"2024-09-12T17:00:12.309100+0000","last_became_peered":"2024-09-12T17:00:12.309100+0000","last_unstale":"2024-09-12T18:13:57.001242+0000","last_undegraded":"2024-09-12T18:13:57.001242+0000","last_fullsized":"2024-09-12T18:13:57.001242+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-12T18:13:57.001116+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-12T18:13:57.001116+0000","last_clean_scrub_stamp":"2024-09-12T18:13:57.001116+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:44.466787+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655862,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":481,"num_read_kb":31712,"num_write":1051,"num_write_kb":22323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.116004+0000","last_change":"2024-09-12T18:14:04.116004+0000","last_active":"2024-09-12T18:14:04.116004+0000","last_peered":"2024-09-12T18:14:04.116004+0000","last_clean":"2024-09-12T18:14:04.116004+0000","last_became_active":"2024-09-12T17:00:16.324792+0000","last_became_peered":"2024-09-12T17:00:16.324792+0000","last_unstale":"2024-09-12T18:14:04.116004+0000","last_undegraded":"2024-09-12T18:14:04.116004+0000","last_fullsized":"2024-09-12T18:14:04.116004+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:04.115917+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:04.115917+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.115917+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:04.636526+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'299","reported_seq":1740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:19.441642+0000","last_change":"2024-09-12T18:14:19.441642+0000","last_active":"2024-09-12T18:14:19.441642+0000","last_peered":"2024-09-12T18:14:19.441642+0000","last_clean":"2024-09-12T18:14:19.441642+0000","last_became_active":"2024-09-12T17:00:18.429997+0000","last_became_peered":"2024-09-12T17:00:18.429997+0000","last_unstale":"2024-09-12T18:14:19.441642+0000","last_undegraded":"2024-09-12T18:14:19.441642+0000","last_fullsized":"2024-09-12T18:14:19.441642+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'299","last_scrub_stamp":"2024-09-12T18:14:19.441455+0000","last_deep_scrub":"264'299","last_deep_scrub_stamp":"2024-09-12T18:14:19.441455+0000","last_clean_scrub_stamp":"2024-09-12T18:14:19.441455+0000","objects_scrubbed":9,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:24.826400+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":262,"num_read_kb":252,"num_write":239,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:22.266431+0000","last_change":"2024-09-12T18:14:22.266431+0000","last_active":"2024-09-12T18:14:22.266431+0000","last_peered":"2024-09-12T18:14:22.266431+0000","last_clean":"2024-09-12T18:14:22.266431+0000","last_became_active":"2024-09-12T17:00:20.350197+0000","last_became_peered":"2024-09-12T17:00:20.350197+0000","last_unstale":"2024-09-12T18:14:22.266431+0000","last_undegraded":"2024-09-12T18:14:22.266431+0000","last_fullsized":"2024-09-12T18:14:22.266431+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:22.266345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:22.266345+0000","last_clean_scrub_stamp":"2024-09-12T18:14:22.266345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:16.231319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'277","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:32.850418+0000","last_change":"2024-09-12T18:14:32.850348+0000","last_active":"2024-09-12T18:14:32.850418+0000","last_peered":"2024-09-12T18:14:32.850418+0000","last_clean":"2024-09-12T18:14:32.850418+0000","last_became_active":"2024-09-12T17:00:22.357583+0000","last_became_peered":"2024-09-12T17:00:22.357583+0000","last_unstale":"2024-09-12T18:14:32.850418+0000","last_undegraded":"2024-09-12T18:14:32.850418+0000","last_fullsized":"2024-09-12T18:14:32.850418+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'277","last_scrub_stamp":"2024-09-12T18:14:32.850262+0000","last_deep_scrub":"264'277","last_deep_scrub_stamp":"2024-09-12T18:14:32.850262+0000","last_clean_scrub_stamp":"2024-09-12T18:14:32.850262+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:29.426297+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":565,"num_read_kb":582,"num_write":607,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'184","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.051253+0000","last_change":"2024-09-12T18:14:03.051253+0000","last_active":"2024-09-12T18:14:03.051253+0000","last_peered":"2024-09-12T18:14:03.051253+0000","last_clean":"2024-09-12T18:14:03.051253+0000","last_became_active":"2024-09-12T17:00:14.324830+0000","last_became_peered":"2024-09-12T17:00:14.324830+0000","last_unstale":"2024-09-12T18:14:03.051253+0000","last_undegraded":"2024-09-12T18:14:03.051253+0000","last_fullsized":"2024-09-12T18:14:03.051253+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'184","last_scrub_stamp":"2024-09-12T18:14:03.051167+0000","last_deep_scrub":"264'184","last_deep_scrub_stamp":"2024-09-12T18:14:03.051167+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.051167+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:33.058051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":771,"num_read_kb":626,"num_write":320,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":540,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:57.445513+0000","last_change":"2024-09-12T18:13:57.445513+0000","last_active":"2024-09-12T18:13:57.445513+0000","last_peered":"2024-09-12T18:13:57.445513+0000","last_clean":"2024-09-12T18:13:57.445513+0000","last_became_active":"2024-09-12T17:00:00.668696+0000","last_became_peered":"2024-09-12T17:00:00.668696+0000","last_unstale":"2024-09-12T18:13:57.445513+0000","last_undegraded":"2024-09-12T18:13:57.445513+0000","last_fullsized":"2024-09-12T18:13:57.445513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:13:57.445431+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:13:57.445431+0000","last_clean_scrub_stamp":"2024-09-12T18:13:57.445431+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:24.702957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0012259720000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'362","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:56.795679+0000","last_change":"2024-09-12T18:13:56.795679+0000","last_active":"2024-09-12T18:13:56.795679+0000","last_peered":"2024-09-12T18:13:56.795679+0000","last_clean":"2024-09-12T18:13:56.795679+0000","last_became_active":"2024-09-12T17:00:12.315813+0000","last_became_peered":"2024-09-12T17:00:12.315813+0000","last_unstale":"2024-09-12T18:13:56.795679+0000","last_undegraded":"2024-09-12T18:13:56.795679+0000","last_fullsized":"2024-09-12T18:13:56.795679+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'362","last_scrub_stamp":"2024-09-12T18:13:56.795572+0000","last_deep_scrub":"264'362","last_deep_scrub_stamp":"2024-09-12T18:13:56.795572+0000","last_clean_scrub_stamp":"2024-09-12T18:13:56.795572+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:52:27.168227+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":472,"num_read_kb":35449,"num_write":1073,"num_write_kb":30387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:15.228724+0000","last_change":"2024-09-12T18:14:15.228724+0000","last_active":"2024-09-12T18:14:15.228724+0000","last_peered":"2024-09-12T18:14:15.228724+0000","last_clean":"2024-09-12T18:14:15.228724+0000","last_became_active":"2024-09-12T17:00:16.324683+0000","last_became_peered":"2024-09-12T17:00:16.324683+0000","last_unstale":"2024-09-12T18:14:15.228724+0000","last_undegraded":"2024-09-12T18:14:15.228724+0000","last_fullsized":"2024-09-12T18:14:15.228724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:15.228628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:15.228628+0000","last_clean_scrub_stamp":"2024-09-12T18:14:15.228628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:17.787871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'164","reported_seq":733,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:20.962483+0000","last_change":"2024-09-12T18:14:20.962483+0000","last_active":"2024-09-12T18:14:20.962483+0000","last_peered":"2024-09-12T18:14:20.962483+0000","last_clean":"2024-09-12T18:14:20.962483+0000","last_became_active":"2024-09-12T17:00:18.327205+0000","last_became_peered":"2024-09-12T17:00:18.327205+0000","last_unstale":"2024-09-12T18:14:20.962483+0000","last_undegraded":"2024-09-12T18:14:20.962483+0000","last_fullsized":"2024-09-12T18:14:20.962483+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'164","last_scrub_stamp":"2024-09-12T18:14:20.962389+0000","last_deep_scrub":"264'164","last_deep_scrub_stamp":"2024-09-12T18:14:20.962389+0000","last_clean_scrub_stamp":"2024-09-12T18:14:20.962389+0000","objects_scrubbed":7,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:39.507861+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":197,"num_read_kb":191,"num_write":142,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:14.202546+0000","last_change":"2024-09-12T18:14:14.202546+0000","last_active":"2024-09-12T18:14:14.202546+0000","last_peered":"2024-09-12T18:14:14.202546+0000","last_clean":"2024-09-12T18:14:14.202546+0000","last_became_active":"2024-09-12T17:00:20.356122+0000","last_became_peered":"2024-09-12T17:00:20.356122+0000","last_unstale":"2024-09-12T18:14:14.202546+0000","last_undegraded":"2024-09-12T18:14:14.202546+0000","last_fullsized":"2024-09-12T18:14:14.202546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:14.202464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:14.202464+0000","last_clean_scrub_stamp":"2024-09-12T18:14:14.202464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:50.205142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'120","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:29.475382+0000","last_change":"2024-09-12T18:14:29.475382+0000","last_active":"2024-09-12T18:14:29.475382+0000","last_peered":"2024-09-12T18:14:29.475382+0000","last_clean":"2024-09-12T18:14:29.475382+0000","last_became_active":"2024-09-12T17:00:22.358888+0000","last_became_peered":"2024-09-12T17:00:22.358888+0000","last_unstale":"2024-09-12T18:14:29.475382+0000","last_undegraded":"2024-09-12T18:14:29.475382+0000","last_fullsized":"2024-09-12T18:14:29.475382+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-09-12T18:14:29.475292+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-09-12T18:14:29.475292+0000","last_clean_scrub_stamp":"2024-09-12T18:14:29.475292+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:54.381227+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":246,"num_write":283,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'172","reported_seq":812,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.091204+0000","last_change":"2024-09-12T18:14:04.091204+0000","last_active":"2024-09-12T18:14:04.091204+0000","last_peered":"2024-09-12T18:14:04.091204+0000","last_clean":"2024-09-12T18:14:04.091204+0000","last_became_active":"2024-09-12T17:00:14.330844+0000","last_became_peered":"2024-09-12T17:00:14.330844+0000","last_unstale":"2024-09-12T18:14:04.091204+0000","last_undegraded":"2024-09-12T18:14:04.091204+0000","last_fullsized":"2024-09-12T18:14:04.091204+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'172","last_scrub_stamp":"2024-09-12T18:14:04.091118+0000","last_deep_scrub":"264'172","last_deep_scrub_stamp":"2024-09-12T18:14:04.091118+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.091118+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:28.552302+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":795,"num_read_kb":654,"num_write":268,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'407","reported_seq":1095,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.459613+0000","last_change":"2024-09-12T18:13:59.459613+0000","last_active":"2024-09-12T18:13:59.459613+0000","last_peered":"2024-09-12T18:13:59.459613+0000","last_clean":"2024-09-12T18:13:59.459613+0000","last_became_active":"2024-09-12T17:00:12.318621+0000","last_became_peered":"2024-09-12T17:00:12.318621+0000","last_unstale":"2024-09-12T18:13:59.459613+0000","last_undegraded":"2024-09-12T18:13:59.459613+0000","last_fullsized":"2024-09-12T18:13:59.459613+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'407","last_scrub_stamp":"2024-09-12T18:13:59.459505+0000","last_deep_scrub":"264'407","last_deep_scrub_stamp":"2024-09-12T18:13:59.459505+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.459505+0000","objects_scrubbed":9,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:47.655177+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":592,"num_read_kb":4542,"num_write":1332,"num_write_kb":25874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:55.019040+0000","last_change":"2024-09-12T18:13:55.019040+0000","last_active":"2024-09-12T18:13:55.019040+0000","last_peered":"2024-09-12T18:13:55.019040+0000","last_clean":"2024-09-12T18:13:55.019040+0000","last_became_active":"2024-09-12T17:00:00.667379+0000","last_became_peered":"2024-09-12T17:00:00.667379+0000","last_unstale":"2024-09-12T18:13:55.019040+0000","last_undegraded":"2024-09-12T18:13:55.019040+0000","last_fullsized":"2024-09-12T18:13:55.019040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:55.018974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:55.018974+0000","last_clean_scrub_stamp":"2024-09-12T18:13:55.018974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:11.110303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056755300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:14.189720+0000","last_change":"2024-09-12T18:14:14.189720+0000","last_active":"2024-09-12T18:14:14.189720+0000","last_peered":"2024-09-12T18:14:14.189720+0000","last_clean":"2024-09-12T18:14:14.189720+0000","last_became_active":"2024-09-12T17:00:16.322854+0000","last_became_peered":"2024-09-12T17:00:16.322854+0000","last_unstale":"2024-09-12T18:14:14.189720+0000","last_undegraded":"2024-09-12T18:14:14.189720+0000","last_fullsized":"2024-09-12T18:14:14.189720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:14.189619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:14.189619+0000","last_clean_scrub_stamp":"2024-09-12T18:14:14.189619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:20.726776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'672","reported_seq":1382,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.229545+0000","last_change":"2024-09-12T18:14:17.229453+0000","last_active":"2024-09-12T18:14:17.229545+0000","last_peered":"2024-09-12T18:14:17.229545+0000","last_clean":"2024-09-12T18:14:17.229545+0000","last_became_active":"2024-09-12T17:00:18.333147+0000","last_became_peered":"2024-09-12T17:00:18.333147+0000","last_unstale":"2024-09-12T18:14:17.229545+0000","last_undegraded":"2024-09-12T18:14:17.229545+0000","last_fullsized":"2024-09-12T18:14:17.229545+0000","mapping_epoch":30,"log_start":"264'600","ondisk_log_start":"264'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'672","last_scrub_stamp":"2024-09-12T18:14:17.229332+0000","last_deep_scrub":"264'672","last_deep_scrub_stamp":"2024-09-12T18:14:17.229332+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.229332+0000","objects_scrubbed":10,"log_size":72,"log_dups_size":600,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:36.017250+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95805,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1770,"num_read_kb":3099,"num_write":2318,"num_write_kb":2109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":508234,"num_omap_keys":1154,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:26.825540+0000","last_change":"2024-09-12T18:14:26.825540+0000","last_active":"2024-09-12T18:14:26.825540+0000","last_peered":"2024-09-12T18:14:26.825540+0000","last_clean":"2024-09-12T18:14:26.825540+0000","last_became_active":"2024-09-12T17:00:20.354771+0000","last_became_peered":"2024-09-12T17:00:20.354771+0000","last_unstale":"2024-09-12T18:14:26.825540+0000","last_undegraded":"2024-09-12T18:14:26.825540+0000","last_fullsized":"2024-09-12T18:14:26.825540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:26.825453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:26.825453+0000","last_clean_scrub_stamp":"2024-09-12T18:14:26.825453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:49.316587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'223","reported_seq":755,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:30.227091+0000","last_change":"2024-09-12T18:14:30.227029+0000","last_active":"2024-09-12T18:14:30.227091+0000","last_peered":"2024-09-12T18:14:30.227091+0000","last_clean":"2024-09-12T18:14:30.227091+0000","last_became_active":"2024-09-12T17:00:22.588561+0000","last_became_peered":"2024-09-12T17:00:22.588561+0000","last_unstale":"2024-09-12T18:14:30.227091+0000","last_undegraded":"2024-09-12T18:14:30.227091+0000","last_fullsized":"2024-09-12T18:14:30.227091+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'223","last_scrub_stamp":"2024-09-12T18:14:30.226917+0000","last_deep_scrub":"264'223","last_deep_scrub_stamp":"2024-09-12T18:14:30.226917+0000","last_clean_scrub_stamp":"2024-09-12T18:14:30.226917+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:05.358685+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":223,"num_read_kb":213,"num_write":499,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'180","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.112249+0000","last_change":"2024-09-12T18:14:06.112249+0000","last_active":"2024-09-12T18:14:06.112249+0000","last_peered":"2024-09-12T18:14:06.112249+0000","last_clean":"2024-09-12T18:14:06.112249+0000","last_became_active":"2024-09-12T17:00:14.327268+0000","last_became_peered":"2024-09-12T17:00:14.327268+0000","last_unstale":"2024-09-12T18:14:06.112249+0000","last_undegraded":"2024-09-12T18:14:06.112249+0000","last_fullsized":"2024-09-12T18:14:06.112249+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'180","last_scrub_stamp":"2024-09-12T18:14:06.112165+0000","last_deep_scrub":"264'180","last_deep_scrub_stamp":"2024-09-12T18:14:06.112165+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.112165+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:05.334938+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":852,"num_read_kb":727,"num_write":266,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'349","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.024128+0000","last_change":"2024-09-12T18:13:58.024128+0000","last_active":"2024-09-12T18:13:58.024128+0000","last_peered":"2024-09-12T18:13:58.024128+0000","last_clean":"2024-09-12T18:13:58.024128+0000","last_became_active":"2024-09-12T17:00:12.309896+0000","last_became_peered":"2024-09-12T17:00:12.309896+0000","last_unstale":"2024-09-12T18:13:58.024128+0000","last_undegraded":"2024-09-12T18:13:58.024128+0000","last_fullsized":"2024-09-12T18:13:58.024128+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'349","last_scrub_stamp":"2024-09-12T18:13:58.024056+0000","last_deep_scrub":"264'349","last_deep_scrub_stamp":"2024-09-12T18:13:58.024056+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.024056+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:20.085472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":595,"num_read_kb":32728,"num_write":1244,"num_write_kb":26986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":532,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.217713+0000","last_change":"2024-09-12T18:14:03.217713+0000","last_active":"2024-09-12T18:14:03.217713+0000","last_peered":"2024-09-12T18:14:03.217713+0000","last_clean":"2024-09-12T18:14:03.217713+0000","last_became_active":"2024-09-12T17:00:00.670355+0000","last_became_peered":"2024-09-12T17:00:00.670355+0000","last_unstale":"2024-09-12T18:14:03.217713+0000","last_undegraded":"2024-09-12T18:14:03.217713+0000","last_fullsized":"2024-09-12T18:14:03.217713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:03.217597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:03.217597+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.217597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:02.459061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042464500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.141505+0000","last_change":"2024-09-12T18:14:11.141505+0000","last_active":"2024-09-12T18:14:11.141505+0000","last_peered":"2024-09-12T18:14:11.141505+0000","last_clean":"2024-09-12T18:14:11.141505+0000","last_became_active":"2024-09-12T17:00:16.323157+0000","last_became_peered":"2024-09-12T17:00:16.323157+0000","last_unstale":"2024-09-12T18:14:11.141505+0000","last_undegraded":"2024-09-12T18:14:11.141505+0000","last_fullsized":"2024-09-12T18:14:11.141505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:11.141420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:11.141420+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.141420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:34.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'221","reported_seq":824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:18.286377+0000","last_change":"2024-09-12T18:14:18.286377+0000","last_active":"2024-09-12T18:14:18.286377+0000","last_peered":"2024-09-12T18:14:18.286377+0000","last_clean":"2024-09-12T18:14:18.286377+0000","last_became_active":"2024-09-12T17:00:18.428978+0000","last_became_peered":"2024-09-12T17:00:18.428978+0000","last_unstale":"2024-09-12T18:14:18.286377+0000","last_undegraded":"2024-09-12T18:14:18.286377+0000","last_fullsized":"2024-09-12T18:14:18.286377+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'221","last_scrub_stamp":"2024-09-12T18:14:18.286284+0000","last_deep_scrub":"264'221","last_deep_scrub_stamp":"2024-09-12T18:14:18.286284+0000","last_clean_scrub_stamp":"2024-09-12T18:14:18.286284+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:23.180371+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":266,"num_read_kb":257,"num_write":182,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'774","reported_seq":2999,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:27.420218+0000","last_change":"2024-09-12T18:14:27.420147+0000","last_active":"2024-09-12T18:14:27.420218+0000","last_peered":"2024-09-12T18:14:27.420218+0000","last_clean":"2024-09-12T18:14:27.420218+0000","last_became_active":"2024-09-12T17:00:20.345236+0000","last_became_peered":"2024-09-12T17:00:20.345236+0000","last_unstale":"2024-09-12T18:14:27.420218+0000","last_undegraded":"2024-09-12T18:14:27.420218+0000","last_fullsized":"2024-09-12T18:14:27.420218+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'774","last_scrub_stamp":"2024-09-12T18:14:27.420059+0000","last_deep_scrub":"264'774","last_deep_scrub_stamp":"2024-09-12T18:14:27.420059+0000","last_clean_scrub_stamp":"2024-09-12T18:14:27.420059+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:29.706528+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'116","reported_seq":648,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:33.848747+0000","last_change":"2024-09-12T18:14:33.848671+0000","last_active":"2024-09-12T18:14:33.848747+0000","last_peered":"2024-09-12T18:14:33.848747+0000","last_clean":"2024-09-12T18:14:33.848747+0000","last_became_active":"2024-09-12T17:00:22.587443+0000","last_became_peered":"2024-09-12T17:00:22.587443+0000","last_unstale":"2024-09-12T18:14:33.848747+0000","last_undegraded":"2024-09-12T18:14:33.848747+0000","last_fullsized":"2024-09-12T18:14:33.848747+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'116","last_scrub_stamp":"2024-09-12T18:14:33.848579+0000","last_deep_scrub":"264'116","last_deep_scrub_stamp":"2024-09-12T18:14:33.848579+0000","last_clean_scrub_stamp":"2024-09-12T18:14:33.848579+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:41.972139+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":705,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":239,"num_read_kb":213,"num_write":277,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'317","reported_seq":980,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.992329+0000","last_change":"2024-09-12T18:14:13.992204+0000","last_active":"2024-09-12T18:14:13.992329+0000","last_peered":"2024-09-12T18:14:13.992329+0000","last_clean":"2024-09-12T18:14:13.992329+0000","last_became_active":"2024-09-12T17:00:14.333128+0000","last_became_peered":"2024-09-12T17:00:14.333128+0000","last_unstale":"2024-09-12T18:14:13.992329+0000","last_undegraded":"2024-09-12T18:14:13.992329+0000","last_fullsized":"2024-09-12T18:14:13.992329+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'317","last_scrub_stamp":"2024-09-12T18:14:13.992099+0000","last_deep_scrub":"264'317","last_deep_scrub_stamp":"2024-09-12T18:14:13.992099+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.992099+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:18.628811+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1338,"num_read_kb":1083,"num_write":472,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'372","reported_seq":1036,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:55.895288+0000","last_change":"2024-09-12T18:13:55.895288+0000","last_active":"2024-09-12T18:13:55.895288+0000","last_peered":"2024-09-12T18:13:55.895288+0000","last_clean":"2024-09-12T18:13:55.895288+0000","last_became_active":"2024-09-12T17:00:12.315812+0000","last_became_peered":"2024-09-12T17:00:12.315812+0000","last_unstale":"2024-09-12T18:13:55.895288+0000","last_undegraded":"2024-09-12T18:13:55.895288+0000","last_fullsized":"2024-09-12T18:13:55.895288+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-12T18:13:55.895167+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-12T18:13:55.895167+0000","last_clean_scrub_stamp":"2024-09-12T18:13:55.895167+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:05.686531+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1826072,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":562,"num_read_kb":23161,"num_write":1132,"num_write_kb":14173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":541,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:56.006554+0000","last_change":"2024-09-12T18:13:56.006554+0000","last_active":"2024-09-12T18:13:56.006554+0000","last_peered":"2024-09-12T18:13:56.006554+0000","last_clean":"2024-09-12T18:13:56.006554+0000","last_became_active":"2024-09-12T17:00:00.669898+0000","last_became_peered":"2024-09-12T17:00:00.669898+0000","last_unstale":"2024-09-12T18:13:56.006554+0000","last_undegraded":"2024-09-12T18:13:56.006554+0000","last_fullsized":"2024-09-12T18:13:56.006554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:56.006481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:56.006481+0000","last_clean_scrub_stamp":"2024-09-12T18:13:56.006481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:45.117992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060387199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:16.803917+0000","last_change":"2024-09-12T18:14:16.803917+0000","last_active":"2024-09-12T18:14:16.803917+0000","last_peered":"2024-09-12T18:14:16.803917+0000","last_clean":"2024-09-12T18:14:16.803917+0000","last_became_active":"2024-09-12T17:00:16.327270+0000","last_became_peered":"2024-09-12T17:00:16.327270+0000","last_unstale":"2024-09-12T18:14:16.803917+0000","last_undegraded":"2024-09-12T18:14:16.803917+0000","last_fullsized":"2024-09-12T18:14:16.803917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:16.803829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:16.803829+0000","last_clean_scrub_stamp":"2024-09-12T18:14:16.803829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:52.947001+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'134","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:22.888626+0000","last_change":"2024-09-12T18:14:22.888626+0000","last_active":"2024-09-12T18:14:22.888626+0000","last_peered":"2024-09-12T18:14:22.888626+0000","last_clean":"2024-09-12T18:14:22.888626+0000","last_became_active":"2024-09-12T17:00:18.327994+0000","last_became_peered":"2024-09-12T17:00:18.327994+0000","last_unstale":"2024-09-12T18:14:22.888626+0000","last_undegraded":"2024-09-12T18:14:22.888626+0000","last_fullsized":"2024-09-12T18:14:22.888626+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'134","last_scrub_stamp":"2024-09-12T18:14:22.888539+0000","last_deep_scrub":"264'134","last_deep_scrub_stamp":"2024-09-12T18:14:22.888539+0000","last_clean_scrub_stamp":"2024-09-12T18:14:22.888539+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:47.733685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":161,"num_write":110,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'776","reported_seq":2846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:27.816004+0000","last_change":"2024-09-12T18:14:27.816004+0000","last_active":"2024-09-12T18:14:27.816004+0000","last_peered":"2024-09-12T18:14:27.816004+0000","last_clean":"2024-09-12T18:14:27.816004+0000","last_became_active":"2024-09-12T17:00:20.354519+0000","last_became_peered":"2024-09-12T17:00:20.354519+0000","last_unstale":"2024-09-12T18:14:27.816004+0000","last_undegraded":"2024-09-12T18:14:27.816004+0000","last_fullsized":"2024-09-12T18:14:27.816004+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'776","last_scrub_stamp":"2024-09-12T18:14:27.815915+0000","last_deep_scrub":"264'776","last_deep_scrub_stamp":"2024-09-12T18:14:27.815915+0000","last_clean_scrub_stamp":"2024-09-12T18:14:27.815915+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:28.199095+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'288","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:29.268163+0000","last_change":"2024-09-12T18:14:29.268109+0000","last_active":"2024-09-12T18:14:29.268163+0000","last_peered":"2024-09-12T18:14:29.268163+0000","last_clean":"2024-09-12T18:14:29.268163+0000","last_became_active":"2024-09-12T17:00:22.356132+0000","last_became_peered":"2024-09-12T17:00:22.356132+0000","last_unstale":"2024-09-12T18:14:29.268163+0000","last_undegraded":"2024-09-12T18:14:29.268163+0000","last_fullsized":"2024-09-12T18:14:29.268163+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'288","last_scrub_stamp":"2024-09-12T18:14:29.268013+0000","last_deep_scrub":"264'288","last_deep_scrub_stamp":"2024-09-12T18:14:29.268013+0000","last_clean_scrub_stamp":"2024-09-12T18:14:29.268013+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:42.537942+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":378,"num_read_kb":377,"num_write":631,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'145","reported_seq":770,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.854434+0000","last_change":"2024-09-12T18:14:01.854434+0000","last_active":"2024-09-12T18:14:01.854434+0000","last_peered":"2024-09-12T18:14:01.854434+0000","last_clean":"2024-09-12T18:14:01.854434+0000","last_became_active":"2024-09-12T17:00:14.330433+0000","last_became_peered":"2024-09-12T17:00:14.330433+0000","last_unstale":"2024-09-12T18:14:01.854434+0000","last_undegraded":"2024-09-12T18:14:01.854434+0000","last_fullsized":"2024-09-12T18:14:01.854434+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'145","last_scrub_stamp":"2024-09-12T18:14:01.854354+0000","last_deep_scrub":"264'145","last_deep_scrub_stamp":"2024-09-12T18:14:01.854354+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.854354+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:27.445208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":651,"num_read_kb":539,"num_write":208,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'378","reported_seq":1154,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:57.123146+0000","last_change":"2024-09-12T18:13:57.123146+0000","last_active":"2024-09-12T18:13:57.123146+0000","last_peered":"2024-09-12T18:13:57.123146+0000","last_clean":"2024-09-12T18:13:57.123146+0000","last_became_active":"2024-09-12T17:00:12.307371+0000","last_became_peered":"2024-09-12T17:00:12.307371+0000","last_unstale":"2024-09-12T18:13:57.123146+0000","last_undegraded":"2024-09-12T18:13:57.123146+0000","last_fullsized":"2024-09-12T18:13:57.123146+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'378","last_scrub_stamp":"2024-09-12T18:13:57.123003+0000","last_deep_scrub":"264'378","last_deep_scrub_stamp":"2024-09-12T18:13:57.123003+0000","last_clean_scrub_stamp":"2024-09-12T18:13:57.123003+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:45.220960+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262175,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":835,"num_read_kb":7035,"num_write":1193,"num_write_kb":32501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.077086+0000","last_change":"2024-09-12T18:13:59.077086+0000","last_active":"2024-09-12T18:13:59.077086+0000","last_peered":"2024-09-12T18:13:59.077086+0000","last_clean":"2024-09-12T18:13:59.077086+0000","last_became_active":"2024-09-12T17:00:00.670451+0000","last_became_peered":"2024-09-12T17:00:00.670451+0000","last_unstale":"2024-09-12T18:13:59.077086+0000","last_undegraded":"2024-09-12T18:13:59.077086+0000","last_fullsized":"2024-09-12T18:13:59.077086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:59.077001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:59.077001+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.077001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:10.341382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046867000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:15.985804+0000","last_change":"2024-09-12T18:14:15.985731+0000","last_active":"2024-09-12T18:14:15.985804+0000","last_peered":"2024-09-12T18:14:15.985804+0000","last_clean":"2024-09-12T18:14:15.985804+0000","last_became_active":"2024-09-12T17:00:16.326163+0000","last_became_peered":"2024-09-12T17:00:16.326163+0000","last_unstale":"2024-09-12T18:14:15.985804+0000","last_undegraded":"2024-09-12T18:14:15.985804+0000","last_fullsized":"2024-09-12T18:14:15.985804+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:15.985631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:15.985631+0000","last_clean_scrub_stamp":"2024-09-12T18:14:15.985631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:27.774285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'797","reported_seq":1544,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:20.448119+0000","last_change":"2024-09-12T18:14:20.448119+0000","last_active":"2024-09-12T18:14:20.448119+0000","last_peered":"2024-09-12T18:14:20.448119+0000","last_clean":"2024-09-12T18:14:20.448119+0000","last_became_active":"2024-09-12T17:00:18.429131+0000","last_became_peered":"2024-09-12T17:00:18.429131+0000","last_unstale":"2024-09-12T18:14:20.448119+0000","last_undegraded":"2024-09-12T18:14:20.448119+0000","last_fullsized":"2024-09-12T18:14:20.448119+0000","mapping_epoch":30,"log_start":"264'700","ondisk_log_start":"264'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'797","last_scrub_stamp":"2024-09-12T18:14:20.448016+0000","last_deep_scrub":"264'797","last_deep_scrub_stamp":"2024-09-12T18:14:20.448016+0000","last_clean_scrub_stamp":"2024-09-12T18:14:20.448016+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:50.131210+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164213,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1409,"num_read_kb":3444,"num_write":1148,"num_write_kb":951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:26.808799+0000","last_change":"2024-09-12T18:14:26.808799+0000","last_active":"2024-09-12T18:14:26.808799+0000","last_peered":"2024-09-12T18:14:26.808799+0000","last_clean":"2024-09-12T18:14:26.808799+0000","last_became_active":"2024-09-12T17:00:20.349800+0000","last_became_peered":"2024-09-12T17:00:20.349800+0000","last_unstale":"2024-09-12T18:14:26.808799+0000","last_undegraded":"2024-09-12T18:14:26.808799+0000","last_fullsized":"2024-09-12T18:14:26.808799+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:26.808709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:26.808709+0000","last_clean_scrub_stamp":"2024-09-12T18:14:26.808709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:43.261138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'141","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:31.473663+0000","last_change":"2024-09-12T18:14:31.473606+0000","last_active":"2024-09-12T18:14:31.473663+0000","last_peered":"2024-09-12T18:14:31.473663+0000","last_clean":"2024-09-12T18:14:31.473663+0000","last_became_active":"2024-09-12T17:00:22.360730+0000","last_became_peered":"2024-09-12T17:00:22.360730+0000","last_unstale":"2024-09-12T18:14:31.473663+0000","last_undegraded":"2024-09-12T18:14:31.473663+0000","last_fullsized":"2024-09-12T18:14:31.473663+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'141","last_scrub_stamp":"2024-09-12T18:14:31.473523+0000","last_deep_scrub":"264'141","last_deep_scrub_stamp":"2024-09-12T18:14:31.473523+0000","last_clean_scrub_stamp":"2024-09-12T18:14:31.473523+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:48.973215+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":172,"num_read_kb":170,"num_write":343,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'182","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:32.224139+0000","last_change":"2024-09-12T18:14:32.224139+0000","last_active":"2024-09-12T18:14:32.224139+0000","last_peered":"2024-09-12T18:14:32.224139+0000","last_clean":"2024-09-12T18:14:32.224139+0000","last_became_active":"2024-09-12T17:00:22.354464+0000","last_became_peered":"2024-09-12T17:00:22.354464+0000","last_unstale":"2024-09-12T18:14:32.224139+0000","last_undegraded":"2024-09-12T18:14:32.224139+0000","last_fullsized":"2024-09-12T18:14:32.224139+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'182","last_scrub_stamp":"2024-09-12T18:14:32.224051+0000","last_deep_scrub":"264'182","last_deep_scrub_stamp":"2024-09-12T18:14:32.224051+0000","last_clean_scrub_stamp":"2024-09-12T18:14:32.224051+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:37.381218+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":465,"num_read_kb":419,"num_write":437,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'369","reported_seq":1054,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.917370+0000","last_change":"2024-09-12T18:14:06.917244+0000","last_active":"2024-09-12T18:14:06.917370+0000","last_peered":"2024-09-12T18:14:06.917370+0000","last_clean":"2024-09-12T18:14:06.917370+0000","last_became_active":"2024-09-12T17:00:14.329093+0000","last_became_peered":"2024-09-12T17:00:14.329093+0000","last_unstale":"2024-09-12T18:14:06.917370+0000","last_undegraded":"2024-09-12T18:14:06.917370+0000","last_fullsized":"2024-09-12T18:14:06.917370+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'369","last_scrub_stamp":"2024-09-12T18:14:06.917142+0000","last_deep_scrub":"264'369","last_deep_scrub_stamp":"2024-09-12T18:14:06.917142+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.917142+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:31.654357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1637,"num_read_kb":1326,"num_write":585,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'363","reported_seq":1112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.822164+0000","last_change":"2024-09-12T18:13:58.822164+0000","last_active":"2024-09-12T18:13:58.822164+0000","last_peered":"2024-09-12T18:13:58.822164+0000","last_clean":"2024-09-12T18:13:58.822164+0000","last_became_active":"2024-09-12T17:00:12.307309+0000","last_became_peered":"2024-09-12T17:00:12.307309+0000","last_unstale":"2024-09-12T18:13:58.822164+0000","last_undegraded":"2024-09-12T18:13:58.822164+0000","last_fullsized":"2024-09-12T18:13:58.822164+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'363","last_scrub_stamp":"2024-09-12T18:13:58.822062+0000","last_deep_scrub":"264'363","last_deep_scrub_stamp":"2024-09-12T18:13:58.822062+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.822062+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:04.753595+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":717,"num_read_kb":21828,"num_write":1272,"num_write_kb":15847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.138218+0000","last_change":"2024-09-12T18:14:11.138218+0000","last_active":"2024-09-12T18:14:11.138218+0000","last_peered":"2024-09-12T18:14:11.138218+0000","last_clean":"2024-09-12T18:14:11.138218+0000","last_became_active":"2024-09-12T17:00:16.325555+0000","last_became_peered":"2024-09-12T17:00:16.325555+0000","last_unstale":"2024-09-12T18:14:11.138218+0000","last_undegraded":"2024-09-12T18:14:11.138218+0000","last_fullsized":"2024-09-12T18:14:11.138218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:11.138123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:11.138123+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.138123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:08.175044+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'305","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:22.926768+0000","last_change":"2024-09-12T18:14:22.926768+0000","last_active":"2024-09-12T18:14:22.926768+0000","last_peered":"2024-09-12T18:14:22.926768+0000","last_clean":"2024-09-12T18:14:22.926768+0000","last_became_active":"2024-09-12T17:00:18.327374+0000","last_became_peered":"2024-09-12T17:00:18.327374+0000","last_unstale":"2024-09-12T18:14:22.926768+0000","last_undegraded":"2024-09-12T18:14:22.926768+0000","last_fullsized":"2024-09-12T18:14:22.926768+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'305","last_scrub_stamp":"2024-09-12T18:14:22.926675+0000","last_deep_scrub":"264'305","last_deep_scrub_stamp":"2024-09-12T18:14:22.926675+0000","last_clean_scrub_stamp":"2024-09-12T18:14:22.926675+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:42.780150+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49267,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":497,"num_read_kb":1124,"num_write":398,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:28.842618+0000","last_change":"2024-09-12T18:14:28.842618+0000","last_active":"2024-09-12T18:14:28.842618+0000","last_peered":"2024-09-12T18:14:28.842618+0000","last_clean":"2024-09-12T18:14:28.842618+0000","last_became_active":"2024-09-12T17:00:20.352801+0000","last_became_peered":"2024-09-12T17:00:20.352801+0000","last_unstale":"2024-09-12T18:14:28.842618+0000","last_undegraded":"2024-09-12T18:14:28.842618+0000","last_fullsized":"2024-09-12T18:14:28.842618+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:28.842514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:28.842514+0000","last_clean_scrub_stamp":"2024-09-12T18:14:28.842514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:29.305914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'193","reported_seq":728,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:36.889951+0000","last_change":"2024-09-12T18:14:36.889951+0000","last_active":"2024-09-12T18:14:36.889951+0000","last_peered":"2024-09-12T18:14:36.889951+0000","last_clean":"2024-09-12T18:14:36.889951+0000","last_became_active":"2024-09-12T17:00:22.354651+0000","last_became_peered":"2024-09-12T17:00:22.354651+0000","last_unstale":"2024-09-12T18:14:36.889951+0000","last_undegraded":"2024-09-12T18:14:36.889951+0000","last_fullsized":"2024-09-12T18:14:36.889951+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'193","last_scrub_stamp":"2024-09-12T18:14:36.889868+0000","last_deep_scrub":"264'193","last_deep_scrub_stamp":"2024-09-12T18:14:36.889868+0000","last_clean_scrub_stamp":"2024-09-12T18:14:36.889868+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:27.202596+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":300,"num_read_kb":268,"num_write":394,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'230","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.134128+0000","last_change":"2024-09-12T18:14:07.134035+0000","last_active":"2024-09-12T18:14:07.134128+0000","last_peered":"2024-09-12T18:14:07.134128+0000","last_clean":"2024-09-12T18:14:07.134128+0000","last_became_active":"2024-09-12T17:00:14.320955+0000","last_became_peered":"2024-09-12T17:00:14.320955+0000","last_unstale":"2024-09-12T18:14:07.134128+0000","last_undegraded":"2024-09-12T18:14:07.134128+0000","last_fullsized":"2024-09-12T18:14:07.134128+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'230","last_scrub_stamp":"2024-09-12T18:14:07.133902+0000","last_deep_scrub":"264'230","last_deep_scrub_stamp":"2024-09-12T18:14:07.133902+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.133902+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:28.413454+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1027,"num_read_kb":855,"num_write":338,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'407","reported_seq":1058,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.175316+0000","last_change":"2024-09-12T18:14:05.175316+0000","last_active":"2024-09-12T18:14:05.175316+0000","last_peered":"2024-09-12T18:14:05.175316+0000","last_clean":"2024-09-12T18:14:05.175316+0000","last_became_active":"2024-09-12T17:00:12.315834+0000","last_became_peered":"2024-09-12T17:00:12.315834+0000","last_unstale":"2024-09-12T18:14:05.175316+0000","last_undegraded":"2024-09-12T18:14:05.175316+0000","last_fullsized":"2024-09-12T18:14:05.175316+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'407","last_scrub_stamp":"2024-09-12T18:14:05.175171+0000","last_deep_scrub":"264'407","last_deep_scrub_stamp":"2024-09-12T18:14:05.175171+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.175171+0000","objects_scrubbed":7,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:55.926091+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3436700,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":549,"num_read_kb":44669,"num_write":1257,"num_write_kb":42862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.016125+0000","last_change":"2024-09-12T18:14:17.016058+0000","last_active":"2024-09-12T18:14:17.016125+0000","last_peered":"2024-09-12T18:14:17.016125+0000","last_clean":"2024-09-12T18:14:17.016125+0000","last_became_active":"2024-09-12T17:00:16.327292+0000","last_became_peered":"2024-09-12T17:00:16.327292+0000","last_unstale":"2024-09-12T18:14:17.016125+0000","last_undegraded":"2024-09-12T18:14:17.016125+0000","last_fullsized":"2024-09-12T18:14:17.016125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:17.015961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:17.015961+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.015961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:59.576782+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'53","reported_seq":585,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:18.251671+0000","last_change":"2024-09-12T18:14:18.251671+0000","last_active":"2024-09-12T18:14:18.251671+0000","last_peered":"2024-09-12T18:14:18.251671+0000","last_clean":"2024-09-12T18:14:18.251671+0000","last_became_active":"2024-09-12T17:00:18.331495+0000","last_became_peered":"2024-09-12T17:00:18.331495+0000","last_unstale":"2024-09-12T18:14:18.251671+0000","last_undegraded":"2024-09-12T18:14:18.251671+0000","last_fullsized":"2024-09-12T18:14:18.251671+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'53","last_scrub_stamp":"2024-09-12T18:14:18.251554+0000","last_deep_scrub":"264'53","last_deep_scrub_stamp":"2024-09-12T18:14:18.251554+0000","last_clean_scrub_stamp":"2024-09-12T18:14:18.251554+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:07.081303+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:26.504133+0000","last_change":"2024-09-12T18:14:26.504133+0000","last_active":"2024-09-12T18:14:26.504133+0000","last_peered":"2024-09-12T18:14:26.504133+0000","last_clean":"2024-09-12T18:14:26.504133+0000","last_became_active":"2024-09-12T17:00:20.348274+0000","last_became_peered":"2024-09-12T17:00:20.348274+0000","last_unstale":"2024-09-12T18:14:26.504133+0000","last_undegraded":"2024-09-12T18:14:26.504133+0000","last_fullsized":"2024-09-12T18:14:26.504133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:26.504052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:26.504052+0000","last_clean_scrub_stamp":"2024-09-12T18:14:26.504052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:11.642165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'245","reported_seq":850,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:31.207196+0000","last_change":"2024-09-12T18:14:31.207196+0000","last_active":"2024-09-12T18:14:31.207196+0000","last_peered":"2024-09-12T18:14:31.207196+0000","last_clean":"2024-09-12T18:14:31.207196+0000","last_became_active":"2024-09-12T17:00:22.350195+0000","last_became_peered":"2024-09-12T17:00:22.350195+0000","last_unstale":"2024-09-12T18:14:31.207196+0000","last_undegraded":"2024-09-12T18:14:31.207196+0000","last_fullsized":"2024-09-12T18:14:31.207196+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'245","last_scrub_stamp":"2024-09-12T18:14:31.207106+0000","last_deep_scrub":"264'245","last_deep_scrub_stamp":"2024-09-12T18:14:31.207106+0000","last_clean_scrub_stamp":"2024-09-12T18:14:31.207106+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:42.226323+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":636,"num_read_kb":568,"num_write":560,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'163","reported_seq":766,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.985941+0000","last_change":"2024-09-12T18:14:04.985868+0000","last_active":"2024-09-12T18:14:04.985941+0000","last_peered":"2024-09-12T18:14:04.985941+0000","last_clean":"2024-09-12T18:14:04.985941+0000","last_became_active":"2024-09-12T17:00:14.334652+0000","last_became_peered":"2024-09-12T17:00:14.334652+0000","last_unstale":"2024-09-12T18:14:04.985941+0000","last_undegraded":"2024-09-12T18:14:04.985941+0000","last_fullsized":"2024-09-12T18:14:04.985941+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'163","last_scrub_stamp":"2024-09-12T18:14:04.985772+0000","last_deep_scrub":"264'163","last_deep_scrub_stamp":"2024-09-12T18:14:04.985772+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.985772+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:29.223174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":705,"num_read_kb":585,"num_write":252,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'373","reported_seq":1059,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.509915+0000","last_change":"2024-09-12T18:14:01.509915+0000","last_active":"2024-09-12T18:14:01.509915+0000","last_peered":"2024-09-12T18:14:01.509915+0000","last_clean":"2024-09-12T18:14:01.509915+0000","last_became_active":"2024-09-12T17:00:12.312629+0000","last_became_peered":"2024-09-12T17:00:12.312629+0000","last_unstale":"2024-09-12T18:14:01.509915+0000","last_undegraded":"2024-09-12T18:14:01.509915+0000","last_fullsized":"2024-09-12T18:14:01.509915+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-09-12T18:14:01.509785+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-09-12T18:14:01.509785+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.509785+0000","objects_scrubbed":8,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:46.142118+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524362,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":634,"num_read_kb":31722,"num_write":1487,"num_write_kb":32347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.348553+0000","last_change":"2024-09-12T18:14:17.348472+0000","last_active":"2024-09-12T18:14:17.348553+0000","last_peered":"2024-09-12T18:14:17.348553+0000","last_clean":"2024-09-12T18:14:17.348553+0000","last_became_active":"2024-09-12T17:00:16.326905+0000","last_became_peered":"2024-09-12T17:00:16.326905+0000","last_unstale":"2024-09-12T18:14:17.348553+0000","last_undegraded":"2024-09-12T18:14:17.348553+0000","last_fullsized":"2024-09-12T18:14:17.348553+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:17.348362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:17.348362+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.348362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:36.617419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'351","reported_seq":963,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:23.897991+0000","last_change":"2024-09-12T18:14:23.897991+0000","last_active":"2024-09-12T18:14:23.897991+0000","last_peered":"2024-09-12T18:14:23.897991+0000","last_clean":"2024-09-12T18:14:23.897991+0000","last_became_active":"2024-09-12T17:00:18.329759+0000","last_became_peered":"2024-09-12T17:00:18.329759+0000","last_unstale":"2024-09-12T18:14:23.897991+0000","last_undegraded":"2024-09-12T18:14:23.897991+0000","last_fullsized":"2024-09-12T18:14:23.897991+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'351","last_scrub_stamp":"2024-09-12T18:14:23.897880+0000","last_deep_scrub":"264'351","last_deep_scrub_stamp":"2024-09-12T18:14:23.897880+0000","last_clean_scrub_stamp":"2024-09-12T18:14:23.897880+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:36.146294+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50102,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":567,"num_read_kb":1243,"num_write":450,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.200766+0000","last_change":"2024-09-12T18:14:17.200766+0000","last_active":"2024-09-12T18:14:17.200766+0000","last_peered":"2024-09-12T18:14:17.200766+0000","last_clean":"2024-09-12T18:14:17.200766+0000","last_became_active":"2024-09-12T17:00:20.355629+0000","last_became_peered":"2024-09-12T17:00:20.355629+0000","last_unstale":"2024-09-12T18:14:17.200766+0000","last_undegraded":"2024-09-12T18:14:17.200766+0000","last_fullsized":"2024-09-12T18:14:17.200766+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:17.200666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:17.200666+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.200666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:30.930203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'128","reported_seq":664,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:34.428185+0000","last_change":"2024-09-12T18:14:34.428185+0000","last_active":"2024-09-12T18:14:34.428185+0000","last_peered":"2024-09-12T18:14:34.428185+0000","last_clean":"2024-09-12T18:14:34.428185+0000","last_became_active":"2024-09-12T17:00:22.360051+0000","last_became_peered":"2024-09-12T17:00:22.360051+0000","last_unstale":"2024-09-12T18:14:34.428185+0000","last_undegraded":"2024-09-12T18:14:34.428185+0000","last_fullsized":"2024-09-12T18:14:34.428185+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'128","last_scrub_stamp":"2024-09-12T18:14:34.428091+0000","last_deep_scrub":"264'128","last_deep_scrub_stamp":"2024-09-12T18:14:34.428091+0000","last_clean_scrub_stamp":"2024-09-12T18:14:34.428091+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:03.389025+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":246,"num_read_kb":229,"num_write":325,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'696","reported_seq":1451,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:14.942442+0000","last_change":"2024-09-12T18:14:14.942370+0000","last_active":"2024-09-12T18:14:14.942442+0000","last_peered":"2024-09-12T18:14:14.942442+0000","last_clean":"2024-09-12T18:14:14.942442+0000","last_became_active":"2024-09-12T17:00:14.338453+0000","last_became_peered":"2024-09-12T17:00:14.338453+0000","last_unstale":"2024-09-12T18:14:14.942442+0000","last_undegraded":"2024-09-12T18:14:14.942442+0000","last_fullsized":"2024-09-12T18:14:14.942442+0000","mapping_epoch":26,"log_start":"264'600","ondisk_log_start":"264'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'696","last_scrub_stamp":"2024-09-12T18:14:14.942287+0000","last_deep_scrub":"264'696","last_deep_scrub_stamp":"2024-09-12T18:14:14.942287+0000","last_clean_scrub_stamp":"2024-09-12T18:14:14.942287+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:43.385941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3211,"num_read_kb":2592,"num_write":1218,"num_write_kb":764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'376","reported_seq":1025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:56.083789+0000","last_change":"2024-09-12T18:13:56.083789+0000","last_active":"2024-09-12T18:13:56.083789+0000","last_peered":"2024-09-12T18:13:56.083789+0000","last_clean":"2024-09-12T18:13:56.083789+0000","last_became_active":"2024-09-12T17:00:46.406811+0000","last_became_peered":"2024-09-12T17:00:46.406811+0000","last_unstale":"2024-09-12T18:13:56.083789+0000","last_undegraded":"2024-09-12T18:13:56.083789+0000","last_fullsized":"2024-09-12T18:13:56.083789+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'376","last_scrub_stamp":"2024-09-12T18:13:56.083721+0000","last_deep_scrub":"264'376","last_deep_scrub_stamp":"2024-09-12T18:13:56.083721+0000","last_clean_scrub_stamp":"2024-09-12T18:13:56.083721+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:20.371898+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170356,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":466,"num_read_kb":7187,"num_write":1054,"num_write_kb":23441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.157379+0000","last_change":"2024-09-12T18:14:12.157320+0000","last_active":"2024-09-12T18:14:12.157379+0000","last_peered":"2024-09-12T18:14:12.157379+0000","last_clean":"2024-09-12T18:14:12.157379+0000","last_became_active":"2024-09-12T17:00:16.328571+0000","last_became_peered":"2024-09-12T17:00:16.328571+0000","last_unstale":"2024-09-12T18:14:12.157379+0000","last_undegraded":"2024-09-12T18:14:12.157379+0000","last_fullsized":"2024-09-12T18:14:12.157379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:12.157228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:12.157228+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.157228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:38.775538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'312","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:22.468410+0000","last_change":"2024-09-12T18:14:22.468352+0000","last_active":"2024-09-12T18:14:22.468410+0000","last_peered":"2024-09-12T18:14:22.468410+0000","last_clean":"2024-09-12T18:14:22.468410+0000","last_became_active":"2024-09-12T17:00:18.331634+0000","last_became_peered":"2024-09-12T17:00:18.331634+0000","last_unstale":"2024-09-12T18:14:22.468410+0000","last_undegraded":"2024-09-12T18:14:22.468410+0000","last_fullsized":"2024-09-12T18:14:22.468410+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'312","last_scrub_stamp":"2024-09-12T18:14:22.468254+0000","last_deep_scrub":"264'312","last_deep_scrub_stamp":"2024-09-12T18:14:22.468254+0000","last_clean_scrub_stamp":"2024-09-12T18:14:22.468254+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:28.071156+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":499,"num_read_kb":1194,"num_write":408,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:25.207484+0000","last_change":"2024-09-12T18:14:25.207484+0000","last_active":"2024-09-12T18:14:25.207484+0000","last_peered":"2024-09-12T18:14:25.207484+0000","last_clean":"2024-09-12T18:14:25.207484+0000","last_became_active":"2024-09-12T17:00:20.346778+0000","last_became_peered":"2024-09-12T17:00:20.346778+0000","last_unstale":"2024-09-12T18:14:25.207484+0000","last_undegraded":"2024-09-12T18:14:25.207484+0000","last_fullsized":"2024-09-12T18:14:25.207484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:25.207363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:25.207363+0000","last_clean_scrub_stamp":"2024-09-12T18:14:25.207363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:04.441076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'4226","reported_seq":4840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.048608+0000","last_change":"2024-09-12T18:14:08.048608+0000","last_active":"2024-09-12T18:14:08.048608+0000","last_peered":"2024-09-12T18:14:08.048608+0000","last_clean":"2024-09-12T18:14:08.048608+0000","last_became_active":"2024-09-12T17:00:14.327366+0000","last_became_peered":"2024-09-12T17:00:14.327366+0000","last_unstale":"2024-09-12T18:14:08.048608+0000","last_undegraded":"2024-09-12T18:14:08.048608+0000","last_fullsized":"2024-09-12T18:14:08.048608+0000","mapping_epoch":26,"log_start":"264'4200","ondisk_log_start":"264'4200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4226","last_scrub_stamp":"2024-09-12T18:14:08.048490+0000","last_deep_scrub":"264'4226","last_deep_scrub_stamp":"2024-09-12T18:14:08.048490+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.048490+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":3000,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:16.172312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16999,"num_read_kb":14230,"num_write":6368,"num_write_kb":3177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'348","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.036725+0000","last_change":"2024-09-12T18:14:03.036725+0000","last_active":"2024-09-12T18:14:03.036725+0000","last_peered":"2024-09-12T18:14:03.036725+0000","last_clean":"2024-09-12T18:14:03.036725+0000","last_became_active":"2024-09-12T17:00:12.316401+0000","last_became_peered":"2024-09-12T17:00:12.316401+0000","last_unstale":"2024-09-12T18:14:03.036725+0000","last_undegraded":"2024-09-12T18:14:03.036725+0000","last_fullsized":"2024-09-12T18:14:03.036725+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'348","last_scrub_stamp":"2024-09-12T18:14:03.036602+0000","last_deep_scrub":"264'348","last_deep_scrub_stamp":"2024-09-12T18:14:03.036602+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.036602+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:12.222915+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2180110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":457,"num_read_kb":29254,"num_write":1102,"num_write_kb":37912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:16.256651+0000","last_change":"2024-09-12T18:14:16.256577+0000","last_active":"2024-09-12T18:14:16.256651+0000","last_peered":"2024-09-12T18:14:16.256651+0000","last_clean":"2024-09-12T18:14:16.256651+0000","last_became_active":"2024-09-12T17:00:16.317972+0000","last_became_peered":"2024-09-12T17:00:16.317972+0000","last_unstale":"2024-09-12T18:14:16.256651+0000","last_undegraded":"2024-09-12T18:14:16.256651+0000","last_fullsized":"2024-09-12T18:14:16.256651+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:16.256492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:16.256492+0000","last_clean_scrub_stamp":"2024-09-12T18:14:16.256492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:46.624196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'533","reported_seq":1190,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:14.184880+0000","last_change":"2024-09-12T18:14:14.184880+0000","last_active":"2024-09-12T18:14:14.184880+0000","last_peered":"2024-09-12T18:14:14.184880+0000","last_clean":"2024-09-12T18:14:14.184880+0000","last_became_active":"2024-09-12T17:00:18.327593+0000","last_became_peered":"2024-09-12T17:00:18.327593+0000","last_unstale":"2024-09-12T18:14:14.184880+0000","last_undegraded":"2024-09-12T18:14:14.184880+0000","last_fullsized":"2024-09-12T18:14:14.184880+0000","mapping_epoch":30,"log_start":"264'500","ondisk_log_start":"264'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'533","last_scrub_stamp":"2024-09-12T18:14:14.184757+0000","last_deep_scrub":"264'533","last_deep_scrub_stamp":"2024-09-12T18:14:14.184757+0000","last_clean_scrub_stamp":"2024-09-12T18:14:14.184757+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:06.682388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111195,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":962,"num_read_kb":2364,"num_write":832,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:28.465976+0000","last_change":"2024-09-12T18:14:28.465976+0000","last_active":"2024-09-12T18:14:28.465976+0000","last_peered":"2024-09-12T18:14:28.465976+0000","last_clean":"2024-09-12T18:14:28.465976+0000","last_became_active":"2024-09-12T17:00:20.350413+0000","last_became_peered":"2024-09-12T17:00:20.350413+0000","last_unstale":"2024-09-12T18:14:28.465976+0000","last_undegraded":"2024-09-12T18:14:28.465976+0000","last_fullsized":"2024-09-12T18:14:28.465976+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:28.465868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:28.465868+0000","last_clean_scrub_stamp":"2024-09-12T18:14:28.465868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:07.999497+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'146","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:34.840206+0000","last_change":"2024-09-12T18:14:34.840206+0000","last_active":"2024-09-12T18:14:34.840206+0000","last_peered":"2024-09-12T18:14:34.840206+0000","last_clean":"2024-09-12T18:14:34.840206+0000","last_became_active":"2024-09-12T17:00:22.588456+0000","last_became_peered":"2024-09-12T17:00:22.588456+0000","last_unstale":"2024-09-12T18:14:34.840206+0000","last_undegraded":"2024-09-12T18:14:34.840206+0000","last_fullsized":"2024-09-12T18:14:34.840206+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'146","last_scrub_stamp":"2024-09-12T18:14:34.840097+0000","last_deep_scrub":"264'146","last_deep_scrub_stamp":"2024-09-12T18:14:34.840097+0000","last_clean_scrub_stamp":"2024-09-12T18:14:34.840097+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:53.081305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":212,"num_write":324,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'223","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.188777+0000","last_change":"2024-09-12T18:14:11.188720+0000","last_active":"2024-09-12T18:14:11.188777+0000","last_peered":"2024-09-12T18:14:11.188777+0000","last_clean":"2024-09-12T18:14:11.188777+0000","last_became_active":"2024-09-12T17:00:14.328921+0000","last_became_peered":"2024-09-12T17:00:14.328921+0000","last_unstale":"2024-09-12T18:14:11.188777+0000","last_undegraded":"2024-09-12T18:14:11.188777+0000","last_fullsized":"2024-09-12T18:14:11.188777+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'223","last_scrub_stamp":"2024-09-12T18:14:11.188633+0000","last_deep_scrub":"264'223","last_deep_scrub_stamp":"2024-09-12T18:14:11.188633+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.188633+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:41.061991+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":992,"num_read_kb":851,"num_write":318,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2873,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'356","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.076062+0000","last_change":"2024-09-12T18:13:59.076062+0000","last_active":"2024-09-12T18:13:59.076062+0000","last_peered":"2024-09-12T18:13:59.076062+0000","last_clean":"2024-09-12T18:13:59.076062+0000","last_became_active":"2024-09-12T17:00:12.311606+0000","last_became_peered":"2024-09-12T17:00:12.311606+0000","last_unstale":"2024-09-12T18:13:59.076062+0000","last_undegraded":"2024-09-12T18:13:59.076062+0000","last_fullsized":"2024-09-12T18:13:59.076062+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-12T18:13:59.075963+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-12T18:13:59.075963+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.075963+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:20.684366+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":470,"num_read_kb":10885,"num_write":1123,"num_write_kb":34953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.163200+0000","last_change":"2024-09-12T18:14:13.163200+0000","last_active":"2024-09-12T18:14:13.163200+0000","last_peered":"2024-09-12T18:14:13.163200+0000","last_clean":"2024-09-12T18:14:13.163200+0000","last_became_active":"2024-09-12T17:00:16.327527+0000","last_became_peered":"2024-09-12T17:00:16.327527+0000","last_unstale":"2024-09-12T18:14:13.163200+0000","last_undegraded":"2024-09-12T18:14:13.163200+0000","last_fullsized":"2024-09-12T18:14:13.163200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:13.163092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:13.163092+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.163092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:37.590475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'346","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:23.499116+0000","last_change":"2024-09-12T18:14:23.499116+0000","last_active":"2024-09-12T18:14:23.499116+0000","last_peered":"2024-09-12T18:14:23.499116+0000","last_clean":"2024-09-12T18:14:23.499116+0000","last_became_active":"2024-09-12T17:00:18.326984+0000","last_became_peered":"2024-09-12T17:00:18.326984+0000","last_unstale":"2024-09-12T18:14:23.499116+0000","last_undegraded":"2024-09-12T18:14:23.499116+0000","last_fullsized":"2024-09-12T18:14:23.499116+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'346","last_scrub_stamp":"2024-09-12T18:14:23.498991+0000","last_deep_scrub":"264'346","last_deep_scrub_stamp":"2024-09-12T18:14:23.498991+0000","last_clean_scrub_stamp":"2024-09-12T18:14:23.498991+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:17.424447+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46916,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":562,"num_read_kb":1193,"num_write":464,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:15.220117+0000","last_change":"2024-09-12T18:14:15.220117+0000","last_active":"2024-09-12T18:14:15.220117+0000","last_peered":"2024-09-12T18:14:15.220117+0000","last_clean":"2024-09-12T18:14:15.220117+0000","last_became_active":"2024-09-12T17:00:20.347873+0000","last_became_peered":"2024-09-12T17:00:20.347873+0000","last_unstale":"2024-09-12T18:14:15.220117+0000","last_undegraded":"2024-09-12T18:14:15.220117+0000","last_fullsized":"2024-09-12T18:14:15.220117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:15.220030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:15.220030+0000","last_clean_scrub_stamp":"2024-09-12T18:14:15.220030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:54.298378+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'174","reported_seq":697,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:20.229981+0000","last_change":"2024-09-12T18:14:20.229981+0000","last_active":"2024-09-12T18:14:20.229981+0000","last_peered":"2024-09-12T18:14:20.229981+0000","last_clean":"2024-09-12T18:14:20.229981+0000","last_became_active":"2024-09-12T17:00:22.350856+0000","last_became_peered":"2024-09-12T17:00:22.350856+0000","last_unstale":"2024-09-12T18:14:20.229981+0000","last_undegraded":"2024-09-12T18:14:20.229981+0000","last_fullsized":"2024-09-12T18:14:20.229981+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'174","last_scrub_stamp":"2024-09-12T18:14:20.229862+0000","last_deep_scrub":"264'174","last_deep_scrub_stamp":"2024-09-12T18:14:20.229862+0000","last_clean_scrub_stamp":"2024-09-12T18:14:20.229862+0000","objects_scrubbed":7,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:22.189198+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1852,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":274,"num_read_kb":259,"num_write":495,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'116","reported_seq":710,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.895593+0000","last_change":"2024-09-12T18:14:08.895593+0000","last_active":"2024-09-12T18:14:08.895593+0000","last_peered":"2024-09-12T18:14:08.895593+0000","last_clean":"2024-09-12T18:14:08.895593+0000","last_became_active":"2024-09-12T17:00:14.336495+0000","last_became_peered":"2024-09-12T17:00:14.336495+0000","last_unstale":"2024-09-12T18:14:08.895593+0000","last_undegraded":"2024-09-12T18:14:08.895593+0000","last_fullsized":"2024-09-12T18:14:08.895593+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'116","last_scrub_stamp":"2024-09-12T18:14:08.895502+0000","last_deep_scrub":"264'116","last_deep_scrub_stamp":"2024-09-12T18:14:08.895502+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.895502+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:41.615371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":523,"num_read_kb":437,"num_write":169,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'380","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:57.835221+0000","last_change":"2024-09-12T18:13:57.835221+0000","last_active":"2024-09-12T18:13:57.835221+0000","last_peered":"2024-09-12T18:13:57.835221+0000","last_clean":"2024-09-12T18:13:57.835221+0000","last_became_active":"2024-09-12T17:00:12.318234+0000","last_became_peered":"2024-09-12T17:00:12.318234+0000","last_unstale":"2024-09-12T18:13:57.835221+0000","last_undegraded":"2024-09-12T18:13:57.835221+0000","last_fullsized":"2024-09-12T18:13:57.835221+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'380","last_scrub_stamp":"2024-09-12T18:13:57.835115+0000","last_deep_scrub":"264'380","last_deep_scrub_stamp":"2024-09-12T18:13:57.835115+0000","last_clean_scrub_stamp":"2024-09-12T18:13:57.835115+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:01.043683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":38331,"num_write":1137,"num_write_kb":59769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"264'4","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:20.851412+0000","last_change":"2024-09-12T18:14:20.851412+0000","last_active":"2024-09-12T18:14:20.851412+0000","last_peered":"2024-09-12T18:14:20.851412+0000","last_clean":"2024-09-12T18:14:20.851412+0000","last_became_active":"2024-09-12T17:00:16.327396+0000","last_became_peered":"2024-09-12T17:00:16.327396+0000","last_unstale":"2024-09-12T18:14:20.851412+0000","last_undegraded":"2024-09-12T18:14:20.851412+0000","last_fullsized":"2024-09-12T18:14:20.851412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:14:20.851324+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:14:20.851324+0000","last_clean_scrub_stamp":"2024-09-12T18:14:20.851324+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:03.722330+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'299","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:25.839746+0000","last_change":"2024-09-12T18:14:25.839746+0000","last_active":"2024-09-12T18:14:25.839746+0000","last_peered":"2024-09-12T18:14:25.839746+0000","last_clean":"2024-09-12T18:14:25.839746+0000","last_became_active":"2024-09-12T17:00:18.429149+0000","last_became_peered":"2024-09-12T17:00:18.429149+0000","last_unstale":"2024-09-12T18:14:25.839746+0000","last_undegraded":"2024-09-12T18:14:25.839746+0000","last_fullsized":"2024-09-12T18:14:25.839746+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'299","last_scrub_stamp":"2024-09-12T18:14:25.839646+0000","last_deep_scrub":"264'299","last_deep_scrub_stamp":"2024-09-12T18:14:25.839646+0000","last_clean_scrub_stamp":"2024-09-12T18:14:25.839646+0000","objects_scrubbed":5,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:52.286245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47739,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":501,"num_read_kb":1160,"num_write":400,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:19.244995+0000","last_change":"2024-09-12T18:14:19.244905+0000","last_active":"2024-09-12T18:14:19.244995+0000","last_peered":"2024-09-12T18:14:19.244995+0000","last_clean":"2024-09-12T18:14:19.244995+0000","last_became_active":"2024-09-12T17:00:20.349769+0000","last_became_peered":"2024-09-12T17:00:20.349769+0000","last_unstale":"2024-09-12T18:14:19.244995+0000","last_undegraded":"2024-09-12T18:14:19.244995+0000","last_fullsized":"2024-09-12T18:14:19.244995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:19.244803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:19.244803+0000","last_clean_scrub_stamp":"2024-09-12T18:14:19.244803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:26.784678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'105","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:32.485174+0000","last_change":"2024-09-12T18:14:32.485174+0000","last_active":"2024-09-12T18:14:32.485174+0000","last_peered":"2024-09-12T18:14:32.485174+0000","last_clean":"2024-09-12T18:14:32.485174+0000","last_became_active":"2024-09-12T17:00:22.358484+0000","last_became_peered":"2024-09-12T17:00:22.358484+0000","last_unstale":"2024-09-12T18:14:32.485174+0000","last_undegraded":"2024-09-12T18:14:32.485174+0000","last_fullsized":"2024-09-12T18:14:32.485174+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-12T18:14:32.485068+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-12T18:14:32.485068+0000","last_clean_scrub_stamp":"2024-09-12T18:14:32.485068+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:18.435476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":123,"num_write":242,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'161","reported_seq":804,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.049101+0000","last_change":"2024-09-12T18:14:01.049101+0000","last_active":"2024-09-12T18:14:01.049101+0000","last_peered":"2024-09-12T18:14:01.049101+0000","last_clean":"2024-09-12T18:14:01.049101+0000","last_became_active":"2024-09-12T17:00:14.330238+0000","last_became_peered":"2024-09-12T17:00:14.330238+0000","last_unstale":"2024-09-12T18:14:01.049101+0000","last_undegraded":"2024-09-12T18:14:01.049101+0000","last_fullsized":"2024-09-12T18:14:01.049101+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'161","last_scrub_stamp":"2024-09-12T18:14:01.049004+0000","last_deep_scrub":"264'161","last_deep_scrub_stamp":"2024-09-12T18:14:01.049004+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.049004+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:26.718335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":737,"num_read_kb":617,"num_write":248,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'339","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.091004+0000","last_change":"2024-09-12T18:14:00.091004+0000","last_active":"2024-09-12T18:14:00.091004+0000","last_peered":"2024-09-12T18:14:00.091004+0000","last_clean":"2024-09-12T18:14:00.091004+0000","last_became_active":"2024-09-12T17:00:12.305259+0000","last_became_peered":"2024-09-12T17:00:12.305259+0000","last_unstale":"2024-09-12T18:14:00.091004+0000","last_undegraded":"2024-09-12T18:14:00.091004+0000","last_fullsized":"2024-09-12T18:14:00.091004+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'339","last_scrub_stamp":"2024-09-12T18:14:00.090882+0000","last_deep_scrub":"264'339","last_deep_scrub_stamp":"2024-09-12T18:14:00.090882+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.090882+0000","objects_scrubbed":10,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:32.121245+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048621,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":464,"num_read_kb":5194,"num_write":1027,"num_write_kb":36405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.132722+0000","last_change":"2024-09-12T18:14:12.132722+0000","last_active":"2024-09-12T18:14:12.132722+0000","last_peered":"2024-09-12T18:14:12.132722+0000","last_clean":"2024-09-12T18:14:12.132722+0000","last_became_active":"2024-09-12T17:00:16.327626+0000","last_became_peered":"2024-09-12T17:00:16.327626+0000","last_unstale":"2024-09-12T18:14:12.132722+0000","last_undegraded":"2024-09-12T18:14:12.132722+0000","last_fullsized":"2024-09-12T18:14:12.132722+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:12.132627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:12.132627+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.132627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:23.273859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'115","reported_seq":670,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:25.861617+0000","last_change":"2024-09-12T18:14:25.861482+0000","last_active":"2024-09-12T18:14:25.861617+0000","last_peered":"2024-09-12T18:14:25.861617+0000","last_clean":"2024-09-12T18:14:25.861617+0000","last_became_active":"2024-09-12T17:00:18.429481+0000","last_became_peered":"2024-09-12T17:00:18.429481+0000","last_unstale":"2024-09-12T18:14:25.861617+0000","last_undegraded":"2024-09-12T18:14:25.861617+0000","last_fullsized":"2024-09-12T18:14:25.861617+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'115","last_scrub_stamp":"2024-09-12T18:14:25.861371+0000","last_deep_scrub":"264'115","last_deep_scrub_stamp":"2024-09-12T18:14:25.861371+0000","last_clean_scrub_stamp":"2024-09-12T18:14:25.861371+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:38.446625+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":118,"num_write":86,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'785","reported_seq":4468,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:22.270060+0000","last_change":"2024-09-12T18:14:22.270060+0000","last_active":"2024-09-12T18:14:22.270060+0000","last_peered":"2024-09-12T18:14:22.270060+0000","last_clean":"2024-09-12T18:14:22.270060+0000","last_became_active":"2024-09-12T17:00:20.350976+0000","last_became_peered":"2024-09-12T17:00:20.350976+0000","last_unstale":"2024-09-12T18:14:22.270060+0000","last_undegraded":"2024-09-12T18:14:22.270060+0000","last_fullsized":"2024-09-12T18:14:22.270060+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'785","last_scrub_stamp":"2024-09-12T18:14:22.269972+0000","last_deep_scrub":"264'785","last_deep_scrub_stamp":"2024-09-12T18:14:22.269972+0000","last_clean_scrub_stamp":"2024-09-12T18:14:22.269972+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:14.983222+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'114","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:28.470100+0000","last_change":"2024-09-12T18:14:28.470100+0000","last_active":"2024-09-12T18:14:28.470100+0000","last_peered":"2024-09-12T18:14:28.470100+0000","last_clean":"2024-09-12T18:14:28.470100+0000","last_became_active":"2024-09-12T17:00:22.357215+0000","last_became_peered":"2024-09-12T17:00:22.357215+0000","last_unstale":"2024-09-12T18:14:28.470100+0000","last_undegraded":"2024-09-12T18:14:28.470100+0000","last_fullsized":"2024-09-12T18:14:28.470100+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'114","last_scrub_stamp":"2024-09-12T18:14:28.470019+0000","last_deep_scrub":"264'114","last_deep_scrub_stamp":"2024-09-12T18:14:28.470019+0000","last_clean_scrub_stamp":"2024-09-12T18:14:28.470019+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:46.805507+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":135,"num_write":263,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'292","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.869491+0000","last_change":"2024-09-12T18:14:08.869491+0000","last_active":"2024-09-12T18:14:08.869491+0000","last_peered":"2024-09-12T18:14:08.869491+0000","last_clean":"2024-09-12T18:14:08.869491+0000","last_became_active":"2024-09-12T17:00:14.340459+0000","last_became_peered":"2024-09-12T17:00:14.340459+0000","last_unstale":"2024-09-12T18:14:08.869491+0000","last_undegraded":"2024-09-12T18:14:08.869491+0000","last_fullsized":"2024-09-12T18:14:08.869491+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'292","last_scrub_stamp":"2024-09-12T18:14:08.869378+0000","last_deep_scrub":"264'292","last_deep_scrub_stamp":"2024-09-12T18:14:08.869378+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.869378+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:58.673982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1297,"num_read_kb":1099,"num_write":462,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'344","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.153522+0000","last_change":"2024-09-12T18:14:06.153522+0000","last_active":"2024-09-12T18:14:06.153522+0000","last_peered":"2024-09-12T18:14:06.153522+0000","last_clean":"2024-09-12T18:14:06.153522+0000","last_became_active":"2024-09-12T17:00:46.721297+0000","last_became_peered":"2024-09-12T17:00:46.721297+0000","last_unstale":"2024-09-12T18:14:06.153522+0000","last_undegraded":"2024-09-12T18:14:06.153522+0000","last_fullsized":"2024-09-12T18:14:06.153522+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'344","last_scrub_stamp":"2024-09-12T18:14:06.153427+0000","last_deep_scrub":"264'344","last_deep_scrub_stamp":"2024-09-12T18:14:06.153427+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.153427+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:53.191230+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6112458,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":37702,"num_write":1052,"num_write_kb":18010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:18.393474+0000","last_change":"2024-09-12T18:14:18.393474+0000","last_active":"2024-09-12T18:14:18.393474+0000","last_peered":"2024-09-12T18:14:18.393474+0000","last_clean":"2024-09-12T18:14:18.393474+0000","last_became_active":"2024-09-12T17:00:16.327461+0000","last_became_peered":"2024-09-12T17:00:16.327461+0000","last_unstale":"2024-09-12T18:14:18.393474+0000","last_undegraded":"2024-09-12T18:14:18.393474+0000","last_fullsized":"2024-09-12T18:14:18.393474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:18.393385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:18.393385+0000","last_clean_scrub_stamp":"2024-09-12T18:14:18.393385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:26.549592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'332","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:26.464308+0000","last_change":"2024-09-12T18:14:26.464308+0000","last_active":"2024-09-12T18:14:26.464308+0000","last_peered":"2024-09-12T18:14:26.464308+0000","last_clean":"2024-09-12T18:14:26.464308+0000","last_became_active":"2024-09-12T17:00:18.328990+0000","last_became_peered":"2024-09-12T17:00:18.328990+0000","last_unstale":"2024-09-12T18:14:26.464308+0000","last_undegraded":"2024-09-12T18:14:26.464308+0000","last_fullsized":"2024-09-12T18:14:26.464308+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-12T18:14:26.464180+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-12T18:14:26.464180+0000","last_clean_scrub_stamp":"2024-09-12T18:14:26.464180+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:25.731195+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43471,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":524,"num_read_kb":1084,"num_write":408,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:26.256946+0000","last_change":"2024-09-12T18:14:26.256946+0000","last_active":"2024-09-12T18:14:26.256946+0000","last_peered":"2024-09-12T18:14:26.256946+0000","last_clean":"2024-09-12T18:14:26.256946+0000","last_became_active":"2024-09-12T17:00:20.349643+0000","last_became_peered":"2024-09-12T17:00:20.349643+0000","last_unstale":"2024-09-12T18:14:26.256946+0000","last_undegraded":"2024-09-12T18:14:26.256946+0000","last_fullsized":"2024-09-12T18:14:26.256946+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:26.256855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:26.256855+0000","last_clean_scrub_stamp":"2024-09-12T18:14:26.256855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:17.447555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'123","reported_seq":628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:29.425115+0000","last_change":"2024-09-12T18:14:29.425115+0000","last_active":"2024-09-12T18:14:29.425115+0000","last_peered":"2024-09-12T18:14:29.425115+0000","last_clean":"2024-09-12T18:14:29.425115+0000","last_became_active":"2024-09-12T17:00:22.355658+0000","last_became_peered":"2024-09-12T17:00:22.355658+0000","last_unstale":"2024-09-12T18:14:29.425115+0000","last_undegraded":"2024-09-12T18:14:29.425115+0000","last_fullsized":"2024-09-12T18:14:29.425115+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'123","last_scrub_stamp":"2024-09-12T18:14:29.424986+0000","last_deep_scrub":"264'123","last_deep_scrub_stamp":"2024-09-12T18:14:29.424986+0000","last_clean_scrub_stamp":"2024-09-12T18:14:29.424986+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:12.603589+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":157,"num_read_kb":152,"num_write":284,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'216","reported_seq":835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.847049+0000","last_change":"2024-09-12T18:14:09.847049+0000","last_active":"2024-09-12T18:14:09.847049+0000","last_peered":"2024-09-12T18:14:09.847049+0000","last_clean":"2024-09-12T18:14:09.847049+0000","last_became_active":"2024-09-12T17:00:14.334620+0000","last_became_peered":"2024-09-12T17:00:14.334620+0000","last_unstale":"2024-09-12T18:14:09.847049+0000","last_undegraded":"2024-09-12T18:14:09.847049+0000","last_fullsized":"2024-09-12T18:14:09.847049+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'216","last_scrub_stamp":"2024-09-12T18:14:09.846963+0000","last_deep_scrub":"264'216","last_deep_scrub_stamp":"2024-09-12T18:14:09.846963+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.846963+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:54.849970+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":978,"num_read_kb":833,"num_write":353,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'413","reported_seq":1100,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.537609+0000","last_change":"2024-09-12T18:14:02.537609+0000","last_active":"2024-09-12T18:14:02.537609+0000","last_peered":"2024-09-12T18:14:02.537609+0000","last_clean":"2024-09-12T18:14:02.537609+0000","last_became_active":"2024-09-12T17:00:12.317850+0000","last_became_peered":"2024-09-12T17:00:12.317850+0000","last_unstale":"2024-09-12T18:14:02.537609+0000","last_undegraded":"2024-09-12T18:14:02.537609+0000","last_fullsized":"2024-09-12T18:14:02.537609+0000","mapping_epoch":24,"log_start":"264'398","ondisk_log_start":"264'398","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'413","last_scrub_stamp":"2024-09-12T18:14:02.537459+0000","last_deep_scrub":"264'413","last_deep_scrub_stamp":"2024-09-12T18:14:02.537459+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.537459+0000","objects_scrubbed":15,"log_size":15,"log_dups_size":398,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:34.535056+0000","scrub_duration":65,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2375003,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":614,"num_read_kb":19368,"num_write":1121,"num_write_kb":17051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:22.495978+0000","last_change":"2024-09-12T18:14:22.495978+0000","last_active":"2024-09-12T18:14:22.495978+0000","last_peered":"2024-09-12T18:14:22.495978+0000","last_clean":"2024-09-12T18:14:22.495978+0000","last_became_active":"2024-09-12T17:00:16.329505+0000","last_became_peered":"2024-09-12T17:00:16.329505+0000","last_unstale":"2024-09-12T18:14:22.495978+0000","last_undegraded":"2024-09-12T18:14:22.495978+0000","last_fullsized":"2024-09-12T18:14:22.495978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:22.495890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:22.495890+0000","last_clean_scrub_stamp":"2024-09-12T18:14:22.495890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:14.555384+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'270","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:21.218975+0000","last_change":"2024-09-12T18:14:21.218975+0000","last_active":"2024-09-12T18:14:21.218975+0000","last_peered":"2024-09-12T18:14:21.218975+0000","last_clean":"2024-09-12T18:14:21.218975+0000","last_became_active":"2024-09-12T17:00:18.330548+0000","last_became_peered":"2024-09-12T17:00:18.330548+0000","last_unstale":"2024-09-12T18:14:21.218975+0000","last_undegraded":"2024-09-12T18:14:21.218975+0000","last_fullsized":"2024-09-12T18:14:21.218975+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'270","last_scrub_stamp":"2024-09-12T18:14:21.218862+0000","last_deep_scrub":"264'270","last_deep_scrub_stamp":"2024-09-12T18:14:21.218862+0000","last_clean_scrub_stamp":"2024-09-12T18:14:21.218862+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:44.952083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":1014,"num_write":352,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:18.240467+0000","last_change":"2024-09-12T18:14:18.240467+0000","last_active":"2024-09-12T18:14:18.240467+0000","last_peered":"2024-09-12T18:14:18.240467+0000","last_clean":"2024-09-12T18:14:18.240467+0000","last_became_active":"2024-09-12T17:00:20.347122+0000","last_became_peered":"2024-09-12T17:00:20.347122+0000","last_unstale":"2024-09-12T18:14:18.240467+0000","last_undegraded":"2024-09-12T18:14:18.240467+0000","last_fullsized":"2024-09-12T18:14:18.240467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:18.240377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:18.240377+0000","last_clean_scrub_stamp":"2024-09-12T18:14:18.240377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:46.226638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'145","reported_seq":690,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:35.870927+0000","last_change":"2024-09-12T18:14:35.870927+0000","last_active":"2024-09-12T18:14:35.870927+0000","last_peered":"2024-09-12T18:14:35.870927+0000","last_clean":"2024-09-12T18:14:35.870927+0000","last_became_active":"2024-09-12T17:00:22.588367+0000","last_became_peered":"2024-09-12T17:00:22.588367+0000","last_unstale":"2024-09-12T18:14:35.870927+0000","last_undegraded":"2024-09-12T18:14:35.870927+0000","last_fullsized":"2024-09-12T18:14:35.870927+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'145","last_scrub_stamp":"2024-09-12T18:14:35.870811+0000","last_deep_scrub":"264'145","last_deep_scrub_stamp":"2024-09-12T18:14:35.870811+0000","last_clean_scrub_stamp":"2024-09-12T18:14:35.870811+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:53.068368+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":299,"num_read_kb":277,"num_write":353,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'86","reported_seq":675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.888792+0000","last_change":"2024-09-12T18:14:07.888792+0000","last_active":"2024-09-12T18:14:07.888792+0000","last_peered":"2024-09-12T18:14:07.888792+0000","last_clean":"2024-09-12T18:14:07.888792+0000","last_became_active":"2024-09-12T17:00:14.338251+0000","last_became_peered":"2024-09-12T17:00:14.338251+0000","last_unstale":"2024-09-12T18:14:07.888792+0000","last_undegraded":"2024-09-12T18:14:07.888792+0000","last_fullsized":"2024-09-12T18:14:07.888792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'86","last_scrub_stamp":"2024-09-12T18:14:07.888692+0000","last_deep_scrub":"264'86","last_deep_scrub_stamp":"2024-09-12T18:14:07.888692+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.888692+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:33.432525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":335,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'391","reported_seq":1096,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:57.942934+0000","last_change":"2024-09-12T18:13:57.942881+0000","last_active":"2024-09-12T18:13:57.942934+0000","last_peered":"2024-09-12T18:13:57.942934+0000","last_clean":"2024-09-12T18:13:57.942934+0000","last_became_active":"2024-09-12T17:00:12.318883+0000","last_became_peered":"2024-09-12T17:00:12.318883+0000","last_unstale":"2024-09-12T18:13:57.942934+0000","last_undegraded":"2024-09-12T18:13:57.942934+0000","last_fullsized":"2024-09-12T18:13:57.942934+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'391","last_scrub_stamp":"2024-09-12T18:13:57.942799+0000","last_deep_scrub":"264'391","last_deep_scrub_stamp":"2024-09-12T18:13:57.942799+0000","last_clean_scrub_stamp":"2024-09-12T18:13:57.942799+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:44.840115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":699,"num_read_kb":40775,"num_write":1189,"num_write_kb":14251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"264'6","reported_seq":999,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:19.820125+0000","last_change":"2024-09-12T18:14:19.820125+0000","last_active":"2024-09-12T18:14:19.820125+0000","last_peered":"2024-09-12T18:14:19.820125+0000","last_clean":"2024-09-12T18:14:19.820125+0000","last_became_active":"2024-09-12T17:00:16.326067+0000","last_became_peered":"2024-09-12T17:00:16.326067+0000","last_unstale":"2024-09-12T18:14:19.820125+0000","last_undegraded":"2024-09-12T18:14:19.820125+0000","last_fullsized":"2024-09-12T18:14:19.820125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T18:14:19.820043+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T18:14:19.820043+0000","last_clean_scrub_stamp":"2024-09-12T18:14:19.820043+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:04.795534+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'272","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:24.873557+0000","last_change":"2024-09-12T18:14:24.873557+0000","last_active":"2024-09-12T18:14:24.873557+0000","last_peered":"2024-09-12T18:14:24.873557+0000","last_clean":"2024-09-12T18:14:24.873557+0000","last_became_active":"2024-09-12T17:00:18.326438+0000","last_became_peered":"2024-09-12T17:00:18.326438+0000","last_unstale":"2024-09-12T18:14:24.873557+0000","last_undegraded":"2024-09-12T18:14:24.873557+0000","last_fullsized":"2024-09-12T18:14:24.873557+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'272","last_scrub_stamp":"2024-09-12T18:14:24.873468+0000","last_deep_scrub":"264'272","last_deep_scrub_stamp":"2024-09-12T18:14:24.873468+0000","last_clean_scrub_stamp":"2024-09-12T18:14:24.873468+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:00.691806+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47056,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":445,"num_read_kb":1107,"num_write":372,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:28.835263+0000","last_change":"2024-09-12T18:14:28.835263+0000","last_active":"2024-09-12T18:14:28.835263+0000","last_peered":"2024-09-12T18:14:28.835263+0000","last_clean":"2024-09-12T18:14:28.835263+0000","last_became_active":"2024-09-12T17:00:20.349324+0000","last_became_peered":"2024-09-12T17:00:20.349324+0000","last_unstale":"2024-09-12T18:14:28.835263+0000","last_undegraded":"2024-09-12T18:14:28.835263+0000","last_fullsized":"2024-09-12T18:14:28.835263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:28.835178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:28.835178+0000","last_clean_scrub_stamp":"2024-09-12T18:14:28.835178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:52.122317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'177","reported_seq":1653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:31.440897+0000","last_change":"2024-09-12T18:14:31.440897+0000","last_active":"2024-09-12T18:14:31.440897+0000","last_peered":"2024-09-12T18:14:31.440897+0000","last_clean":"2024-09-12T18:14:31.440897+0000","last_became_active":"2024-09-12T17:00:22.353287+0000","last_became_peered":"2024-09-12T17:00:22.353287+0000","last_unstale":"2024-09-12T18:14:31.440897+0000","last_undegraded":"2024-09-12T18:14:31.440897+0000","last_fullsized":"2024-09-12T18:14:31.440897+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-12T18:14:31.440775+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-12T18:14:31.440775+0000","last_clean_scrub_stamp":"2024-09-12T18:14:31.440775+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:20.637002+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1233,"num_read_kb":1225,"num_write":392,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'366","reported_seq":1057,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.880426+0000","last_change":"2024-09-12T18:14:07.880426+0000","last_active":"2024-09-12T18:14:07.880426+0000","last_peered":"2024-09-12T18:14:07.880426+0000","last_clean":"2024-09-12T18:14:07.880426+0000","last_became_active":"2024-09-12T17:00:14.323113+0000","last_became_peered":"2024-09-12T17:00:14.323113+0000","last_unstale":"2024-09-12T18:14:07.880426+0000","last_undegraded":"2024-09-12T18:14:07.880426+0000","last_fullsized":"2024-09-12T18:14:07.880426+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'366","last_scrub_stamp":"2024-09-12T18:14:07.880341+0000","last_deep_scrub":"264'366","last_deep_scrub_stamp":"2024-09-12T18:14:07.880341+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.880341+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:43.555460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1619,"num_read_kb":1299,"num_write":554,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'327","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.130977+0000","last_change":"2024-09-12T18:13:59.130977+0000","last_active":"2024-09-12T18:13:59.130977+0000","last_peered":"2024-09-12T18:13:59.130977+0000","last_clean":"2024-09-12T18:13:59.130977+0000","last_became_active":"2024-09-12T17:00:12.312456+0000","last_became_peered":"2024-09-12T17:00:12.312456+0000","last_unstale":"2024-09-12T18:13:59.130977+0000","last_undegraded":"2024-09-12T18:13:59.130977+0000","last_fullsized":"2024-09-12T18:13:59.130977+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'327","last_scrub_stamp":"2024-09-12T18:13:59.130866+0000","last_deep_scrub":"264'327","last_deep_scrub_stamp":"2024-09-12T18:13:59.130866+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.130866+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:10.045907+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":504,"num_read_kb":30861,"num_write":1000,"num_write_kb":23841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.250108+0000","last_change":"2024-09-12T18:14:17.250108+0000","last_active":"2024-09-12T18:14:17.250108+0000","last_peered":"2024-09-12T18:14:17.250108+0000","last_clean":"2024-09-12T18:14:17.250108+0000","last_became_active":"2024-09-12T17:00:16.325535+0000","last_became_peered":"2024-09-12T17:00:16.325535+0000","last_unstale":"2024-09-12T18:14:17.250108+0000","last_undegraded":"2024-09-12T18:14:17.250108+0000","last_fullsized":"2024-09-12T18:14:17.250108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:17.250027+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:17.250027+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.250027+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:25.737427+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'310","reported_seq":919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:24.895228+0000","last_change":"2024-09-12T18:14:24.895228+0000","last_active":"2024-09-12T18:14:24.895228+0000","last_peered":"2024-09-12T18:14:24.895228+0000","last_clean":"2024-09-12T18:14:24.895228+0000","last_became_active":"2024-09-12T17:00:18.326140+0000","last_became_peered":"2024-09-12T17:00:18.326140+0000","last_unstale":"2024-09-12T18:14:24.895228+0000","last_undegraded":"2024-09-12T18:14:24.895228+0000","last_fullsized":"2024-09-12T18:14:24.895228+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'310","last_scrub_stamp":"2024-09-12T18:14:24.895132+0000","last_deep_scrub":"264'310","last_deep_scrub_stamp":"2024-09-12T18:14:24.895132+0000","last_clean_scrub_stamp":"2024-09-12T18:14:24.895132+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:02.426451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49596,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":515,"num_read_kb":1146,"num_write":406,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:35.239181+0000","last_change":"2024-09-12T18:14:35.239181+0000","last_active":"2024-09-12T18:14:35.239181+0000","last_peered":"2024-09-12T18:14:35.239181+0000","last_clean":"2024-09-12T18:14:35.239181+0000","last_became_active":"2024-09-12T17:00:20.353962+0000","last_became_peered":"2024-09-12T17:00:20.353962+0000","last_unstale":"2024-09-12T18:14:35.239181+0000","last_undegraded":"2024-09-12T18:14:35.239181+0000","last_fullsized":"2024-09-12T18:14:35.239181+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:35.239094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:35.239094+0000","last_clean_scrub_stamp":"2024-09-12T18:14:35.239094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:53.542493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'124","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:30.865230+0000","last_change":"2024-09-12T18:14:30.865230+0000","last_active":"2024-09-12T18:14:30.865230+0000","last_peered":"2024-09-12T18:14:30.865230+0000","last_clean":"2024-09-12T18:14:30.865230+0000","last_became_active":"2024-09-12T17:00:22.352779+0000","last_became_peered":"2024-09-12T17:00:22.352779+0000","last_unstale":"2024-09-12T18:14:30.865230+0000","last_undegraded":"2024-09-12T18:14:30.865230+0000","last_fullsized":"2024-09-12T18:14:30.865230+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-09-12T18:14:30.865135+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-09-12T18:14:30.865135+0000","last_clean_scrub_stamp":"2024-09-12T18:14:30.865135+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:45.511909+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":133,"num_write":289,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'171","reported_seq":781,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.089074+0000","last_change":"2024-09-12T18:14:09.089074+0000","last_active":"2024-09-12T18:14:09.089074+0000","last_peered":"2024-09-12T18:14:09.089074+0000","last_clean":"2024-09-12T18:14:09.089074+0000","last_became_active":"2024-09-12T17:00:14.315424+0000","last_became_peered":"2024-09-12T17:00:14.315424+0000","last_unstale":"2024-09-12T18:14:09.089074+0000","last_undegraded":"2024-09-12T18:14:09.089074+0000","last_fullsized":"2024-09-12T18:14:09.089074+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-09-12T18:14:09.088983+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-09-12T18:14:09.088983+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.088983+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:18.442009+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":753,"num_read_kb":612,"num_write":278,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'338","reported_seq":1085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.042155+0000","last_change":"2024-09-12T18:14:03.042155+0000","last_active":"2024-09-12T18:14:03.042155+0000","last_peered":"2024-09-12T18:14:03.042155+0000","last_clean":"2024-09-12T18:14:03.042155+0000","last_became_active":"2024-09-12T17:00:12.310322+0000","last_became_peered":"2024-09-12T17:00:12.310322+0000","last_unstale":"2024-09-12T18:14:03.042155+0000","last_undegraded":"2024-09-12T18:14:03.042155+0000","last_fullsized":"2024-09-12T18:14:03.042155+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'338","last_scrub_stamp":"2024-09-12T18:14:03.041984+0000","last_deep_scrub":"264'338","last_deep_scrub_stamp":"2024-09-12T18:14:03.041984+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.041984+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:17.456643+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262194,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":571,"num_read_kb":27239,"num_write":1052,"num_write_kb":25993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'259","reported_seq":893,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.476961+0000","last_change":"2024-09-12T18:14:13.476902+0000","last_active":"2024-09-12T18:14:13.476961+0000","last_peered":"2024-09-12T18:14:13.476961+0000","last_clean":"2024-09-12T18:14:13.476961+0000","last_became_active":"2024-09-12T17:00:46.406809+0000","last_became_peered":"2024-09-12T17:00:46.406809+0000","last_unstale":"2024-09-12T18:14:13.476961+0000","last_undegraded":"2024-09-12T18:14:13.476961+0000","last_fullsized":"2024-09-12T18:14:13.476961+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'259","last_scrub_stamp":"2024-09-12T18:14:13.476817+0000","last_deep_scrub":"264'259","last_deep_scrub_stamp":"2024-09-12T18:14:13.476817+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.476817+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:26.137002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1147,"num_read_kb":935,"num_write":403,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"264'313","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.087595+0000","last_change":"2024-09-12T18:13:59.087595+0000","last_active":"2024-09-12T18:13:59.087595+0000","last_peered":"2024-09-12T18:13:59.087595+0000","last_clean":"2024-09-12T18:13:59.087595+0000","last_became_active":"2024-09-12T17:00:12.312579+0000","last_became_peered":"2024-09-12T17:00:12.312579+0000","last_unstale":"2024-09-12T18:13:59.087595+0000","last_undegraded":"2024-09-12T18:13:59.087595+0000","last_fullsized":"2024-09-12T18:13:59.087595+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'313","last_scrub_stamp":"2024-09-12T18:13:59.087493+0000","last_deep_scrub":"264'313","last_deep_scrub_stamp":"2024-09-12T18:13:59.087493+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.087493+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:39.390471+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262157,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":699,"num_read_kb":738,"num_write":941,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'458","reported_seq":1244,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.496883+0000","last_change":"2024-09-12T18:14:12.496883+0000","last_active":"2024-09-12T18:14:12.496883+0000","last_peered":"2024-09-12T18:14:12.496883+0000","last_clean":"2024-09-12T18:14:12.496883+0000","last_became_active":"2024-09-12T17:00:14.327158+0000","last_became_peered":"2024-09-12T17:00:14.327158+0000","last_unstale":"2024-09-12T18:14:12.496883+0000","last_undegraded":"2024-09-12T18:14:12.496883+0000","last_fullsized":"2024-09-12T18:14:12.496883+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'458","last_scrub_stamp":"2024-09-12T18:14:12.496744+0000","last_deep_scrub":"264'458","last_deep_scrub_stamp":"2024-09-12T18:14:12.496744+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.496744+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:27.723536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2228,"num_read_kb":1913,"num_write":817,"num_write_kb":525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'343","reported_seq":989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.509257+0000","last_change":"2024-09-12T18:14:03.509257+0000","last_active":"2024-09-12T18:14:03.509257+0000","last_peered":"2024-09-12T18:14:03.509257+0000","last_clean":"2024-09-12T18:14:03.509257+0000","last_became_active":"2024-09-12T17:00:12.317893+0000","last_became_peered":"2024-09-12T17:00:12.317893+0000","last_unstale":"2024-09-12T18:14:03.509257+0000","last_undegraded":"2024-09-12T18:14:03.509257+0000","last_fullsized":"2024-09-12T18:14:03.509257+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'343","last_scrub_stamp":"2024-09-12T18:14:03.509147+0000","last_deep_scrub":"264'343","last_deep_scrub_stamp":"2024-09-12T18:14:03.509147+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.509147+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:19.174816+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524314,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":498,"num_read_kb":13770,"num_write":1022,"num_write_kb":25077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'105","reported_seq":716,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.096105+0000","last_change":"2024-09-12T18:14:08.096105+0000","last_active":"2024-09-12T18:14:08.096105+0000","last_peered":"2024-09-12T18:14:08.096105+0000","last_clean":"2024-09-12T18:14:08.096105+0000","last_became_active":"2024-09-12T17:00:14.323394+0000","last_became_peered":"2024-09-12T17:00:14.323394+0000","last_unstale":"2024-09-12T18:14:08.096105+0000","last_undegraded":"2024-09-12T18:14:08.096105+0000","last_fullsized":"2024-09-12T18:14:08.096105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-12T18:14:08.096018+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-12T18:14:08.096018+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.096018+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:14.501315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":480,"num_read_kb":401,"num_write":159,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'469","reported_seq":1235,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.048486+0000","last_change":"2024-09-12T18:14:04.048486+0000","last_active":"2024-09-12T18:14:04.048486+0000","last_peered":"2024-09-12T18:14:04.048486+0000","last_clean":"2024-09-12T18:14:04.048486+0000","last_became_active":"2024-09-12T17:00:12.314938+0000","last_became_peered":"2024-09-12T17:00:12.314938+0000","last_unstale":"2024-09-12T18:14:04.048486+0000","last_undegraded":"2024-09-12T18:14:04.048486+0000","last_fullsized":"2024-09-12T18:14:04.048486+0000","mapping_epoch":24,"log_start":"264'400","ondisk_log_start":"264'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'469","last_scrub_stamp":"2024-09-12T18:14:04.048381+0000","last_deep_scrub":"264'469","last_deep_scrub_stamp":"2024-09-12T18:14:04.048381+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.048381+0000","objects_scrubbed":8,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:13.231997+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550360,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":846,"num_read_kb":44498,"num_write":1407,"num_write_kb":38820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'334","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.931359+0000","last_change":"2024-09-12T18:14:11.931359+0000","last_active":"2024-09-12T18:14:11.931359+0000","last_peered":"2024-09-12T18:14:11.931359+0000","last_clean":"2024-09-12T18:14:11.931359+0000","last_became_active":"2024-09-12T17:00:14.333821+0000","last_became_peered":"2024-09-12T17:00:14.333821+0000","last_unstale":"2024-09-12T18:14:11.931359+0000","last_undegraded":"2024-09-12T18:14:11.931359+0000","last_fullsized":"2024-09-12T18:14:11.931359+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'334","last_scrub_stamp":"2024-09-12T18:14:11.931271+0000","last_deep_scrub":"264'334","last_deep_scrub_stamp":"2024-09-12T18:14:11.931271+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.931271+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:34.893438+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1469,"num_read_kb":1192,"num_write":564,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4003,"num_omap_keys":18,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'335","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.946774+0000","last_change":"2024-09-12T18:13:58.946774+0000","last_active":"2024-09-12T18:13:58.946774+0000","last_peered":"2024-09-12T18:13:58.946774+0000","last_clean":"2024-09-12T18:13:58.946774+0000","last_became_active":"2024-09-12T17:00:12.316672+0000","last_became_peered":"2024-09-12T17:00:12.316672+0000","last_unstale":"2024-09-12T18:13:58.946774+0000","last_undegraded":"2024-09-12T18:13:58.946774+0000","last_fullsized":"2024-09-12T18:13:58.946774+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-12T18:13:58.946616+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-12T18:13:58.946616+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.946616+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:36.236852+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655849,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":486,"num_read_kb":22933,"num_write":961,"num_write_kb":33827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'55","reported_seq":632,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.802515+0000","last_change":"2024-09-12T18:14:10.802515+0000","last_active":"2024-09-12T18:14:10.802515+0000","last_peered":"2024-09-12T18:14:10.802515+0000","last_clean":"2024-09-12T18:14:10.802515+0000","last_became_active":"2024-09-12T17:00:14.324051+0000","last_became_peered":"2024-09-12T17:00:14.324051+0000","last_unstale":"2024-09-12T18:14:10.802515+0000","last_undegraded":"2024-09-12T18:14:10.802515+0000","last_fullsized":"2024-09-12T18:14:10.802515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'55","last_scrub_stamp":"2024-09-12T18:14:10.802432+0000","last_deep_scrub":"264'55","last_deep_scrub_stamp":"2024-09-12T18:14:10.802432+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.802432+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:33.726378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":201,"num_write":77,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'343","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.030703+0000","last_change":"2024-09-12T18:14:00.030703+0000","last_active":"2024-09-12T18:14:00.030703+0000","last_peered":"2024-09-12T18:14:00.030703+0000","last_clean":"2024-09-12T18:14:00.030703+0000","last_became_active":"2024-09-12T17:00:12.314059+0000","last_became_peered":"2024-09-12T17:00:12.314059+0000","last_unstale":"2024-09-12T18:14:00.030703+0000","last_undegraded":"2024-09-12T18:14:00.030703+0000","last_fullsized":"2024-09-12T18:14:00.030703+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'343","last_scrub_stamp":"2024-09-12T18:14:00.030596+0000","last_deep_scrub":"264'343","last_deep_scrub_stamp":"2024-09-12T18:14:00.030596+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.030596+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:28.562910+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288647,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":67840,"num_write":1028,"num_write_kb":38572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'162","reported_seq":756,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.921850+0000","last_change":"2024-09-12T18:14:09.921850+0000","last_active":"2024-09-12T18:14:09.921850+0000","last_peered":"2024-09-12T18:14:09.921850+0000","last_clean":"2024-09-12T18:14:09.921850+0000","last_became_active":"2024-09-12T17:00:14.338503+0000","last_became_peered":"2024-09-12T17:00:14.338503+0000","last_unstale":"2024-09-12T18:14:09.921850+0000","last_undegraded":"2024-09-12T18:14:09.921850+0000","last_fullsized":"2024-09-12T18:14:09.921850+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'162","last_scrub_stamp":"2024-09-12T18:14:09.921753+0000","last_deep_scrub":"264'162","last_deep_scrub_stamp":"2024-09-12T18:14:09.921753+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.921753+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:14.082713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":567,"num_write":272,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'324","reported_seq":941,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.091077+0000","last_change":"2024-09-12T18:14:04.091077+0000","last_active":"2024-09-12T18:14:04.091077+0000","last_peered":"2024-09-12T18:14:04.091077+0000","last_clean":"2024-09-12T18:14:04.091077+0000","last_became_active":"2024-09-12T17:00:12.311933+0000","last_became_peered":"2024-09-12T17:00:12.311933+0000","last_unstale":"2024-09-12T18:14:04.091077+0000","last_undegraded":"2024-09-12T18:14:04.091077+0000","last_fullsized":"2024-09-12T18:14:04.091077+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-12T18:14:04.090966+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-12T18:14:04.090966+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.090966+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:50.074590+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262214,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":415,"num_read_kb":17784,"num_write":989,"num_write_kb":43947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'289","reported_seq":1010,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.097397+0000","last_change":"2024-09-12T18:14:09.097397+0000","last_active":"2024-09-12T18:14:09.097397+0000","last_peered":"2024-09-12T18:14:09.097397+0000","last_clean":"2024-09-12T18:14:09.097397+0000","last_became_active":"2024-09-12T17:00:14.319152+0000","last_became_peered":"2024-09-12T17:00:14.319152+0000","last_unstale":"2024-09-12T18:14:09.097397+0000","last_undegraded":"2024-09-12T18:14:09.097397+0000","last_fullsized":"2024-09-12T18:14:09.097397+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'289","last_scrub_stamp":"2024-09-12T18:14:09.097302+0000","last_deep_scrub":"264'289","last_deep_scrub_stamp":"2024-09-12T18:14:09.097302+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.097302+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:34.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1506,"num_read_kb":1343,"num_write":479,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'453","reported_seq":1124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.986981+0000","last_change":"2024-09-12T18:14:00.986981+0000","last_active":"2024-09-12T18:14:00.986981+0000","last_peered":"2024-09-12T18:14:00.986981+0000","last_clean":"2024-09-12T18:14:00.986981+0000","last_became_active":"2024-09-12T17:00:12.320948+0000","last_became_peered":"2024-09-12T17:00:12.320948+0000","last_unstale":"2024-09-12T18:14:00.986981+0000","last_undegraded":"2024-09-12T18:14:00.986981+0000","last_fullsized":"2024-09-12T18:14:00.986981+0000","mapping_epoch":24,"log_start":"264'400","ondisk_log_start":"264'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'453","last_scrub_stamp":"2024-09-12T18:14:00.986868+0000","last_deep_scrub":"264'453","last_deep_scrub_stamp":"2024-09-12T18:14:00.986868+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.986868+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:58.110493+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":626,"num_read_kb":23095,"num_write":1402,"num_write_kb":45480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'357","reported_seq":1099,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.184916+0000","last_change":"2024-09-12T18:14:10.184780+0000","last_active":"2024-09-12T18:14:10.184916+0000","last_peered":"2024-09-12T18:14:10.184916+0000","last_clean":"2024-09-12T18:14:10.184916+0000","last_became_active":"2024-09-12T17:00:14.331839+0000","last_became_peered":"2024-09-12T17:00:14.331839+0000","last_unstale":"2024-09-12T18:14:10.184916+0000","last_undegraded":"2024-09-12T18:14:10.184916+0000","last_fullsized":"2024-09-12T18:14:10.184916+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'357","last_scrub_stamp":"2024-09-12T18:14:10.184647+0000","last_deep_scrub":"264'357","last_deep_scrub_stamp":"2024-09-12T18:14:10.184647+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.184647+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:43.341571+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1691,"num_read_kb":1457,"num_write":527,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25753,"num_omap_keys":101,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'425","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.546147+0000","last_change":"2024-09-12T18:14:04.546047+0000","last_active":"2024-09-12T18:14:04.546147+0000","last_peered":"2024-09-12T18:14:04.546147+0000","last_clean":"2024-09-12T18:14:04.546147+0000","last_became_active":"2024-09-12T17:00:12.320094+0000","last_became_peered":"2024-09-12T17:00:12.320094+0000","last_unstale":"2024-09-12T18:14:04.546147+0000","last_undegraded":"2024-09-12T18:14:04.546147+0000","last_fullsized":"2024-09-12T18:14:04.546147+0000","mapping_epoch":24,"log_start":"264'400","ondisk_log_start":"264'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'425","last_scrub_stamp":"2024-09-12T18:14:04.545897+0000","last_deep_scrub":"264'425","last_deep_scrub_stamp":"2024-09-12T18:14:04.545897+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.545897+0000","objects_scrubbed":9,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:36.134235+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194332,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":632,"num_read_kb":22255,"num_write":1216,"num_write_kb":35121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'77","reported_seq":661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.799014+0000","last_change":"2024-09-12T18:14:12.798944+0000","last_active":"2024-09-12T18:14:12.799014+0000","last_peered":"2024-09-12T18:14:12.799014+0000","last_clean":"2024-09-12T18:14:12.799014+0000","last_became_active":"2024-09-12T17:00:14.334965+0000","last_became_peered":"2024-09-12T17:00:14.334965+0000","last_unstale":"2024-09-12T18:14:12.799014+0000","last_undegraded":"2024-09-12T18:14:12.799014+0000","last_fullsized":"2024-09-12T18:14:12.799014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'77","last_scrub_stamp":"2024-09-12T18:14:12.798856+0000","last_deep_scrub":"264'77","last_deep_scrub_stamp":"2024-09-12T18:14:12.798856+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.798856+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:20.717929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":336,"num_read_kb":283,"num_write":118,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'338","reported_seq":983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.017968+0000","last_change":"2024-09-12T18:14:02.017906+0000","last_active":"2024-09-12T18:14:02.017968+0000","last_peered":"2024-09-12T18:14:02.017968+0000","last_clean":"2024-09-12T18:14:02.017968+0000","last_became_active":"2024-09-12T17:00:12.321156+0000","last_became_peered":"2024-09-12T17:00:12.321156+0000","last_unstale":"2024-09-12T18:14:02.017968+0000","last_undegraded":"2024-09-12T18:14:02.017968+0000","last_fullsized":"2024-09-12T18:14:02.017968+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'338","last_scrub_stamp":"2024-09-12T18:14:02.017773+0000","last_deep_scrub":"264'338","last_deep_scrub_stamp":"2024-09-12T18:14:02.017773+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.017773+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:36.638383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170120,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":18612,"num_write":1036,"num_write_kb":25817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'177","reported_seq":804,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:25.089900+0000","last_change":"2024-09-12T18:14:25.089835+0000","last_active":"2024-09-12T18:14:25.089900+0000","last_peered":"2024-09-12T18:14:25.089900+0000","last_clean":"2024-09-12T18:14:25.089900+0000","last_became_active":"2024-09-12T17:00:14.322880+0000","last_became_peered":"2024-09-12T17:00:14.322880+0000","last_unstale":"2024-09-12T18:14:25.089900+0000","last_undegraded":"2024-09-12T18:14:25.089900+0000","last_fullsized":"2024-09-12T18:14:25.089900+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-12T18:14:25.089729+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-12T18:14:25.089729+0000","last_clean_scrub_stamp":"2024-09-12T18:14:25.089729+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:52.513915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":741,"num_read_kb":611,"num_write":268,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'393","reported_seq":1057,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.556524+0000","last_change":"2024-09-12T18:14:05.556462+0000","last_active":"2024-09-12T18:14:05.556524+0000","last_peered":"2024-09-12T18:14:05.556524+0000","last_clean":"2024-09-12T18:14:05.556524+0000","last_became_active":"2024-09-12T17:00:12.314707+0000","last_became_peered":"2024-09-12T17:00:12.314707+0000","last_unstale":"2024-09-12T18:14:05.556524+0000","last_undegraded":"2024-09-12T18:14:05.556524+0000","last_fullsized":"2024-09-12T18:14:05.556524+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'393","last_scrub_stamp":"2024-09-12T18:14:05.556338+0000","last_deep_scrub":"264'393","last_deep_scrub_stamp":"2024-09-12T18:14:05.556338+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.556338+0000","objects_scrubbed":7,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:07.321823+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590083,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":560,"num_read_kb":37012,"num_write":1300,"num_write_kb":41769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'170","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.829676+0000","last_change":"2024-09-12T18:14:11.829591+0000","last_active":"2024-09-12T18:14:11.829676+0000","last_peered":"2024-09-12T18:14:11.829676+0000","last_clean":"2024-09-12T18:14:11.829676+0000","last_became_active":"2024-09-12T17:00:14.324709+0000","last_became_peered":"2024-09-12T17:00:14.324709+0000","last_unstale":"2024-09-12T18:14:11.829676+0000","last_undegraded":"2024-09-12T18:14:11.829676+0000","last_fullsized":"2024-09-12T18:14:11.829676+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'170","last_scrub_stamp":"2024-09-12T18:14:11.829476+0000","last_deep_scrub":"264'170","last_deep_scrub_stamp":"2024-09-12T18:14:11.829476+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.829476+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:36.346842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":785,"num_read_kb":657,"num_write":242,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'303","reported_seq":950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.020131+0000","last_change":"2024-09-12T18:14:03.020070+0000","last_active":"2024-09-12T18:14:03.020131+0000","last_peered":"2024-09-12T18:14:03.020131+0000","last_clean":"2024-09-12T18:14:03.020131+0000","last_became_active":"2024-09-12T17:00:12.307159+0000","last_became_peered":"2024-09-12T17:00:12.307159+0000","last_unstale":"2024-09-12T18:14:03.020131+0000","last_undegraded":"2024-09-12T18:14:03.020131+0000","last_fullsized":"2024-09-12T18:14:03.020131+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'303","last_scrub_stamp":"2024-09-12T18:14:03.019965+0000","last_deep_scrub":"264'303","last_deep_scrub_stamp":"2024-09-12T18:14:03.019965+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.019965+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:43.348169+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":429,"num_read_kb":7363,"num_write":949,"num_write_kb":31388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'4088","reported_seq":4677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.194674+0000","last_change":"2024-09-12T18:14:12.194617+0000","last_active":"2024-09-12T18:14:12.194674+0000","last_peered":"2024-09-12T18:14:12.194674+0000","last_clean":"2024-09-12T18:14:12.194674+0000","last_became_active":"2024-09-12T17:00:14.327792+0000","last_became_peered":"2024-09-12T17:00:14.327792+0000","last_unstale":"2024-09-12T18:14:12.194674+0000","last_undegraded":"2024-09-12T18:14:12.194674+0000","last_fullsized":"2024-09-12T18:14:12.194674+0000","mapping_epoch":26,"log_start":"264'4000","ondisk_log_start":"264'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4088","last_scrub_stamp":"2024-09-12T18:14:12.194534+0000","last_deep_scrub":"264'4088","last_deep_scrub_stamp":"2024-09-12T18:14:12.194534+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.194534+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:07.058121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16430,"num_read_kb":13786,"num_write":6128,"num_write_kb":3057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'357","reported_seq":1019,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.049409+0000","last_change":"2024-09-12T18:14:01.049352+0000","last_active":"2024-09-12T18:14:01.049409+0000","last_peered":"2024-09-12T18:14:01.049409+0000","last_clean":"2024-09-12T18:14:01.049409+0000","last_became_active":"2024-09-12T17:00:12.311273+0000","last_became_peered":"2024-09-12T17:00:12.311273+0000","last_unstale":"2024-09-12T18:14:01.049409+0000","last_undegraded":"2024-09-12T18:14:01.049409+0000","last_fullsized":"2024-09-12T18:14:01.049409+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'357","last_scrub_stamp":"2024-09-12T18:14:01.049257+0000","last_deep_scrub":"264'357","last_deep_scrub_stamp":"2024-09-12T18:14:01.049257+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.049257+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:56.629359+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":481304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":502,"num_read_kb":37128,"num_write":1093,"num_write_kb":49312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'266","reported_seq":928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.145064+0000","last_change":"2024-09-12T18:14:09.144997+0000","last_active":"2024-09-12T18:14:09.145064+0000","last_peered":"2024-09-12T18:14:09.145064+0000","last_clean":"2024-09-12T18:14:09.145064+0000","last_became_active":"2024-09-12T17:00:14.318470+0000","last_became_peered":"2024-09-12T17:00:14.318470+0000","last_unstale":"2024-09-12T18:14:09.145064+0000","last_undegraded":"2024-09-12T18:14:09.145064+0000","last_fullsized":"2024-09-12T18:14:09.145064+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'266","last_scrub_stamp":"2024-09-12T18:14:09.144908+0000","last_deep_scrub":"264'266","last_deep_scrub_stamp":"2024-09-12T18:14:09.144908+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.144908+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:18.716492+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1277,"num_read_kb":1058,"num_write":468,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'351","reported_seq":1075,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.181591+0000","last_change":"2024-09-12T18:14:06.181495+0000","last_active":"2024-09-12T18:14:06.181591+0000","last_peered":"2024-09-12T18:14:06.181591+0000","last_clean":"2024-09-12T18:14:06.181591+0000","last_became_active":"2024-09-12T17:00:12.314371+0000","last_became_peered":"2024-09-12T17:00:12.314371+0000","last_unstale":"2024-09-12T18:14:06.181591+0000","last_undegraded":"2024-09-12T18:14:06.181591+0000","last_fullsized":"2024-09-12T18:14:06.181591+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'351","last_scrub_stamp":"2024-09-12T18:14:06.181390+0000","last_deep_scrub":"264'351","last_deep_scrub_stamp":"2024-09-12T18:14:06.181390+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.181390+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:08.888322+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655829,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":559,"num_read_kb":6257,"num_write":1103,"num_write_kb":25577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'129","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.963386+0000","last_change":"2024-09-12T18:14:12.963272+0000","last_active":"2024-09-12T18:14:12.963386+0000","last_peered":"2024-09-12T18:14:12.963386+0000","last_clean":"2024-09-12T18:14:12.963386+0000","last_became_active":"2024-09-12T17:00:14.339316+0000","last_became_peered":"2024-09-12T17:00:14.339316+0000","last_unstale":"2024-09-12T18:14:12.963386+0000","last_undegraded":"2024-09-12T18:14:12.963386+0000","last_fullsized":"2024-09-12T18:14:12.963386+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'129","last_scrub_stamp":"2024-09-12T18:14:12.963173+0000","last_deep_scrub":"264'129","last_deep_scrub_stamp":"2024-09-12T18:14:12.963173+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.963173+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:55.742662+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":538,"num_read_kb":439,"num_write":190,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'325","reported_seq":965,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.097079+0000","last_change":"2024-09-12T18:14:00.097022+0000","last_active":"2024-09-12T18:14:00.097079+0000","last_peered":"2024-09-12T18:14:00.097079+0000","last_clean":"2024-09-12T18:14:00.097079+0000","last_became_active":"2024-09-12T17:00:12.310157+0000","last_became_peered":"2024-09-12T17:00:12.310157+0000","last_unstale":"2024-09-12T18:14:00.097079+0000","last_undegraded":"2024-09-12T18:14:00.097079+0000","last_fullsized":"2024-09-12T18:14:00.097079+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'325","last_scrub_stamp":"2024-09-12T18:14:00.096895+0000","last_deep_scrub":"264'325","last_deep_scrub_stamp":"2024-09-12T18:14:00.096895+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.096895+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:51.639756+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1093042,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":459,"num_read_kb":8306,"num_write":1094,"num_write_kb":29458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'209","reported_seq":818,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.203502+0000","last_change":"2024-09-12T18:14:10.203419+0000","last_active":"2024-09-12T18:14:10.203502+0000","last_peered":"2024-09-12T18:14:10.203502+0000","last_clean":"2024-09-12T18:14:10.203502+0000","last_became_active":"2024-09-12T17:00:46.406426+0000","last_became_peered":"2024-09-12T17:00:46.406426+0000","last_unstale":"2024-09-12T18:14:10.203502+0000","last_undegraded":"2024-09-12T18:14:10.203502+0000","last_fullsized":"2024-09-12T18:14:10.203502+0000","mapping_epoch":37,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'209","last_scrub_stamp":"2024-09-12T18:14:10.203299+0000","last_deep_scrub":"264'209","last_deep_scrub_stamp":"2024-09-12T18:14:10.203299+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.203299+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:01.928198+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":857,"num_read_kb":696,"num_write":294,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":272,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'306","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.595452+0000","last_change":"2024-09-12T18:14:07.595386+0000","last_active":"2024-09-12T18:14:07.595452+0000","last_peered":"2024-09-12T18:14:07.595452+0000","last_clean":"2024-09-12T18:14:07.595452+0000","last_became_active":"2024-09-12T17:00:12.314251+0000","last_became_peered":"2024-09-12T17:00:12.314251+0000","last_unstale":"2024-09-12T18:14:07.595452+0000","last_undegraded":"2024-09-12T18:14:07.595452+0000","last_fullsized":"2024-09-12T18:14:07.595452+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'306","last_scrub_stamp":"2024-09-12T18:14:07.595274+0000","last_deep_scrub":"264'306","last_deep_scrub_stamp":"2024-09-12T18:14:07.595274+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.595274+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:45.280471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":403,"num_read_kb":8717,"num_write":971,"num_write_kb":22240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'314","reported_seq":1127,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.571820+0000","last_change":"2024-09-12T18:14:08.571713+0000","last_active":"2024-09-12T18:14:08.571820+0000","last_peered":"2024-09-12T18:14:08.571820+0000","last_clean":"2024-09-12T18:14:08.571820+0000","last_became_active":"2024-09-12T17:00:12.318408+0000","last_became_peered":"2024-09-12T17:00:12.318408+0000","last_unstale":"2024-09-12T18:14:08.571820+0000","last_undegraded":"2024-09-12T18:14:08.571820+0000","last_fullsized":"2024-09-12T18:14:08.571820+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'314","last_scrub_stamp":"2024-09-12T18:14:08.571615+0000","last_deep_scrub":"264'314","last_deep_scrub_stamp":"2024-09-12T18:14:08.571615+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.571615+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:11.147120+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":853,"num_read_kb":6455,"num_write":1039,"num_write_kb":20037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'90","reported_seq":673,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.213953+0000","last_change":"2024-09-12T18:14:12.213953+0000","last_active":"2024-09-12T18:14:12.213953+0000","last_peered":"2024-09-12T18:14:12.213953+0000","last_clean":"2024-09-12T18:14:12.213953+0000","last_became_active":"2024-09-12T17:00:14.334494+0000","last_became_peered":"2024-09-12T17:00:14.334494+0000","last_unstale":"2024-09-12T18:14:12.213953+0000","last_undegraded":"2024-09-12T18:14:12.213953+0000","last_fullsized":"2024-09-12T18:14:12.213953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'90","last_scrub_stamp":"2024-09-12T18:14:12.213853+0000","last_deep_scrub":"264'90","last_deep_scrub_stamp":"2024-09-12T18:14:12.213853+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.213853+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:27.439976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":377,"num_read_kb":312,"num_write":145,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'354","reported_seq":1000,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.047592+0000","last_change":"2024-09-12T18:14:01.047528+0000","last_active":"2024-09-12T18:14:01.047592+0000","last_peered":"2024-09-12T18:14:01.047592+0000","last_clean":"2024-09-12T18:14:01.047592+0000","last_became_active":"2024-09-12T17:00:12.314988+0000","last_became_peered":"2024-09-12T17:00:12.314988+0000","last_unstale":"2024-09-12T18:14:01.047592+0000","last_undegraded":"2024-09-12T18:14:01.047592+0000","last_fullsized":"2024-09-12T18:14:01.047592+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'354","last_scrub_stamp":"2024-09-12T18:14:01.047428+0000","last_deep_scrub":"264'354","last_deep_scrub_stamp":"2024-09-12T18:14:01.047428+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.047428+0000","objects_scrubbed":6,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:54.071159+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":45801,"num_write":1031,"num_write_kb":31559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'222","reported_seq":885,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:15.436011+0000","last_change":"2024-09-12T18:14:15.436011+0000","last_active":"2024-09-12T18:14:15.436011+0000","last_peered":"2024-09-12T18:14:15.436011+0000","last_clean":"2024-09-12T18:14:15.436011+0000","last_became_active":"2024-09-12T17:00:14.333107+0000","last_became_peered":"2024-09-12T17:00:14.333107+0000","last_unstale":"2024-09-12T18:14:15.436011+0000","last_undegraded":"2024-09-12T18:14:15.436011+0000","last_fullsized":"2024-09-12T18:14:15.436011+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'222","last_scrub_stamp":"2024-09-12T18:14:15.435914+0000","last_deep_scrub":"264'222","last_deep_scrub_stamp":"2024-09-12T18:14:15.435914+0000","last_clean_scrub_stamp":"2024-09-12T18:14:15.435914+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:16.388139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":970,"num_read_kb":803,"num_write":364,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5638,"num_read_kb":3956,"num_write":1906,"num_write_kb":804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8872,"num_omap_keys":19,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1079,"ondisk_log_size":1079,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":16256,"num_read_kb":15929,"num_write":16738,"num_write_kb":4889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2934,"num_omap_keys":19,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1759,"ondisk_log_size":1759,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":565,"ondisk_log_size":565,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1559950,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":19041,"num_read_kb":39761,"num_write":15891,"num_write_kb":11979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685112,"num_omap_keys":1570,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2081,"ondisk_log_size":2081,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2432,"num_read_kb":2899,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102836,"num_read_kb":85763,"num_write":37242,"num_write_kb":18813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43842,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3669,"ondisk_log_size":3669,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":76932281,"num_objects":387,"num_object_clones":0,"num_object_copies":774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":387,"num_whiteouts":0,"num_read":36237,"num_read_kb":1844237,"num_write":71508,"num_write_kb":1970689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":155025408,"data_stored":153864562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3422,"ondisk_log_size":3422,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":154912,"num_write":182,"num_write_kb":116389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":158387,"num_write":182,"num_write_kb":116389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424510347,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76020,"kb_used_data":22628,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94295820,"statfs":{"total":96636764160,"available":96558919680,"internally_reserved":0,"allocated":23171072,"data_stored":21619631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510349,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119664,"kb_used_data":8032,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94252176,"statfs":{"total":96636764160,"available":96514228224,"internally_reserved":0,"allocated":8224768,"data_stored":6647389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543049,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257492,"kb_used_data":27780,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94114348,"statfs":{"total":96636764160,"available":96373092352,"internally_reserved":0,"allocated":28446720,"data_stored":26727116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235207114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543051,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":241664,"kb_used_data":16112,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94130176,"statfs":{"total":96636764160,"available":96389300224,"internally_reserved":0,"allocated":16498688,"data_stored":14904367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":230947270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543051,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150784,"kb_used_data":25264,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94221056,"statfs":{"total":96636764160,"available":96482361344,"internally_reserved":0,"allocated":25870336,"data_stored":24131043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128514501},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543051,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275728,"kb_used_data":32128,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94096112,"statfs":{"total":96636764160,"available":96354418688,"internally_reserved":0,"allocated":32899072,"data_stored":31197660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":249428423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543049,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229924,"kb_used_data":18260,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94141916,"statfs":{"total":96636764160,"available":96401321984,"internally_reserved":0,"allocated":18698240,"data_stored":17001849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":216725957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575752,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98204,"kb_used_data":30924,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94273636,"statfs":{"total":96636764160,"available":96536203264,"internally_reserved":0,"allocated":31666176,"data_stored":30017021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14422016,"data_stored":14261258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4595712,"data_stored":4499422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19558400,"data_stored":19471135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29220864,"data_stored":29046128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28045312,"data_stored":27867248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22167552,"data_stored":21980545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12857344,"data_stored":12753756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24158208,"data_stored":23985070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":4704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:14:59.346 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:20:33.535111+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=20, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:59.346 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T17:39:04.900972+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=39, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:14:59.350 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:15:19.351 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:15:19.715 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T18:15:19.733 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-12T18:15:19.735 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":2521,"stamp":"2024-09-12T18:15:18.671933+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":79100730,"num_objects":719,"num_object_clones":0,"num_object_copies":1438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":719,"num_whiteouts":0,"num_read":182830,"num_read_kb":2305911,"num_write":143792,"num_write_kb":2241608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":741888,"num_omap_keys":1796,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12928,"ondisk_log_size":12928,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1449480,"kb_used_data":181128,"kb_used_omap":12,"kb_used_meta":1268211,"kb_avail":753525240,"statfs":{"total":773094113280,"available":771609845760,"internally_reserved":0,"allocated":185475072,"data_stored":172246076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1298648624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005510"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:45.404401+0000","last_change":"2024-09-12T18:14:45.404401+0000","last_active":"2024-09-12T18:14:45.404401+0000","last_peered":"2024-09-12T18:14:45.404401+0000","last_clean":"2024-09-12T18:14:45.404401+0000","last_became_active":"2024-09-12T17:39:05.922265+0000","last_became_peered":"2024-09-12T17:39:05.922265+0000","last_unstale":"2024-09-12T18:14:45.404401+0000","last_undegraded":"2024-09-12T18:14:45.404401+0000","last_fullsized":"2024-09-12T18:14:45.404401+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:45.404313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:45.404313+0000","last_clean_scrub_stamp":"2024-09-12T18:14:45.404313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:50.489912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'9","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:42.413873+0000","last_change":"2024-09-12T18:14:42.413873+0000","last_active":"2024-09-12T18:14:42.413873+0000","last_peered":"2024-09-12T18:14:42.413873+0000","last_clean":"2024-09-12T18:14:42.413873+0000","last_became_active":"2024-09-12T17:20:34.559027+0000","last_became_peered":"2024-09-12T17:20:34.559027+0000","last_unstale":"2024-09-12T18:14:42.413873+0000","last_undegraded":"2024-09-12T18:14:42.413873+0000","last_fullsized":"2024-09-12T18:14:42.413873+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-12T18:14:42.413793+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-12T18:14:42.413793+0000","last_clean_scrub_stamp":"2024-09-12T18:14:42.413793+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:08.699266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10240,"num_write":14,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"261'5","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:45.823876+0000","last_change":"2024-09-12T18:14:45.823876+0000","last_active":"2024-09-12T18:14:45.823876+0000","last_peered":"2024-09-12T18:14:45.823876+0000","last_clean":"2024-09-12T18:14:45.823876+0000","last_became_active":"2024-09-12T17:20:30.533235+0000","last_became_peered":"2024-09-12T17:20:30.533235+0000","last_unstale":"2024-09-12T18:14:45.823876+0000","last_undegraded":"2024-09-12T18:14:45.823876+0000","last_fullsized":"2024-09-12T18:14:45.823876+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T18:14:45.823766+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T18:14:45.823766+0000","last_clean_scrub_stamp":"2024-09-12T18:14:45.823766+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:56.080267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4098,"num_write":10,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'40","reported_seq":184,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:40.299788+0000","last_change":"2024-09-12T18:14:40.299788+0000","last_active":"2024-09-12T18:14:40.299788+0000","last_peered":"2024-09-12T18:14:40.299788+0000","last_clean":"2024-09-12T18:14:40.299788+0000","last_became_active":"2024-09-12T17:16:11.491724+0000","last_became_peered":"2024-09-12T17:16:11.491724+0000","last_unstale":"2024-09-12T18:14:40.299788+0000","last_undegraded":"2024-09-12T18:14:40.299788+0000","last_fullsized":"2024-09-12T18:14:40.299788+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-09-12T18:14:40.299689+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-09-12T18:14:40.299689+0000","last_clean_scrub_stamp":"2024-09-12T18:14:40.299689+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:48.075858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":153,"num_write":69,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:26.082849+0000","last_change":"2024-09-12T18:14:26.082849+0000","last_active":"2024-09-12T18:14:26.082849+0000","last_peered":"2024-09-12T18:14:26.082849+0000","last_clean":"2024-09-12T18:14:26.082849+0000","last_became_active":"2024-09-12T17:39:05.929533+0000","last_became_peered":"2024-09-12T17:39:05.929533+0000","last_unstale":"2024-09-12T18:14:26.082849+0000","last_undegraded":"2024-09-12T18:14:26.082849+0000","last_fullsized":"2024-09-12T18:14:26.082849+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:26.082750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:26.082750+0000","last_clean_scrub_stamp":"2024-09-12T18:14:26.082750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:34.051588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"261'8","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:43.871636+0000","last_change":"2024-09-12T18:14:43.871636+0000","last_active":"2024-09-12T18:14:43.871636+0000","last_peered":"2024-09-12T18:14:43.871636+0000","last_clean":"2024-09-12T18:14:43.871636+0000","last_became_active":"2024-09-12T17:20:34.558970+0000","last_became_peered":"2024-09-12T17:20:34.558970+0000","last_unstale":"2024-09-12T18:14:43.871636+0000","last_undegraded":"2024-09-12T18:14:43.871636+0000","last_fullsized":"2024-09-12T18:14:43.871636+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-12T18:14:43.871539+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-12T18:14:43.871539+0000","last_clean_scrub_stamp":"2024-09-12T18:14:43.871539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:47.381399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8194,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:28.199935+0000","last_change":"2024-09-12T18:14:28.199935+0000","last_active":"2024-09-12T18:14:28.199935+0000","last_peered":"2024-09-12T18:14:28.199935+0000","last_clean":"2024-09-12T18:14:28.199935+0000","last_became_active":"2024-09-12T17:20:30.539358+0000","last_became_peered":"2024-09-12T17:20:30.539358+0000","last_unstale":"2024-09-12T18:14:28.199935+0000","last_undegraded":"2024-09-12T18:14:28.199935+0000","last_fullsized":"2024-09-12T18:14:28.199935+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T18:14:28.199850+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T18:14:28.199850+0000","last_clean_scrub_stamp":"2024-09-12T18:14:28.199850+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:29.477097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8242,"num_write":10,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'68","reported_seq":259,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.118963+0000","last_change":"2024-09-12T18:14:17.118895+0000","last_active":"2024-09-12T18:14:17.118963+0000","last_peered":"2024-09-12T18:14:17.118963+0000","last_clean":"2024-09-12T18:14:17.118963+0000","last_became_active":"2024-09-12T17:16:11.491610+0000","last_became_peered":"2024-09-12T17:16:11.491610+0000","last_unstale":"2024-09-12T18:14:17.118963+0000","last_undegraded":"2024-09-12T18:14:17.118963+0000","last_fullsized":"2024-09-12T18:14:17.118963+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'68","last_scrub_stamp":"2024-09-12T18:14:17.118797+0000","last_deep_scrub":"264'68","last_deep_scrub_stamp":"2024-09-12T18:14:17.118797+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.118797+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:50.247233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":357,"num_read_kb":265,"num_write":116,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:35.263486+0000","last_change":"2024-09-12T18:14:35.263486+0000","last_active":"2024-09-12T18:14:35.263486+0000","last_peered":"2024-09-12T18:14:35.263486+0000","last_clean":"2024-09-12T18:14:35.263486+0000","last_became_active":"2024-09-12T17:39:05.921846+0000","last_became_peered":"2024-09-12T17:39:05.921846+0000","last_unstale":"2024-09-12T18:14:35.263486+0000","last_undegraded":"2024-09-12T18:14:35.263486+0000","last_fullsized":"2024-09-12T18:14:35.263486+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:35.263401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:35.263401+0000","last_clean_scrub_stamp":"2024-09-12T18:14:35.263401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:24.277742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"261'8","reported_seq":75,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:50.228939+0000","last_change":"2024-09-12T18:14:50.228939+0000","last_active":"2024-09-12T18:14:50.228939+0000","last_peered":"2024-09-12T18:14:50.228939+0000","last_clean":"2024-09-12T18:14:50.228939+0000","last_became_active":"2024-09-12T17:20:34.615550+0000","last_became_peered":"2024-09-12T17:20:34.615550+0000","last_unstale":"2024-09-12T18:14:50.228939+0000","last_undegraded":"2024-09-12T18:14:50.228939+0000","last_fullsized":"2024-09-12T18:14:50.228939+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-12T18:14:50.228839+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-12T18:14:50.228839+0000","last_clean_scrub_stamp":"2024-09-12T18:14:50.228839+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:15.108359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":6148,"num_write":8,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'9","reported_seq":81,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:20.060061+0000","last_change":"2024-09-12T18:14:20.059934+0000","last_active":"2024-09-12T18:14:20.060061+0000","last_peered":"2024-09-12T18:14:20.060061+0000","last_clean":"2024-09-12T18:14:20.060061+0000","last_became_active":"2024-09-12T17:20:30.535182+0000","last_became_peered":"2024-09-12T17:20:30.535182+0000","last_unstale":"2024-09-12T18:14:20.060061+0000","last_undegraded":"2024-09-12T18:14:20.060061+0000","last_fullsized":"2024-09-12T18:14:20.060061+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-12T18:14:20.059838+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-12T18:14:20.059838+0000","last_clean_scrub_stamp":"2024-09-12T18:14:20.059838+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:29.555332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":17410,"num_write":14,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'51","reported_seq":210,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:41.286980+0000","last_change":"2024-09-12T18:14:41.286980+0000","last_active":"2024-09-12T18:14:41.286980+0000","last_peered":"2024-09-12T18:14:41.286980+0000","last_clean":"2024-09-12T18:14:41.286980+0000","last_became_active":"2024-09-12T17:16:11.493043+0000","last_became_peered":"2024-09-12T17:16:11.493043+0000","last_unstale":"2024-09-12T18:14:41.286980+0000","last_undegraded":"2024-09-12T18:14:41.286980+0000","last_fullsized":"2024-09-12T18:14:41.286980+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'51","last_scrub_stamp":"2024-09-12T18:14:41.286882+0000","last_deep_scrub":"264'51","last_deep_scrub_stamp":"2024-09-12T18:14:41.286882+0000","last_clean_scrub_stamp":"2024-09-12T18:14:41.286882+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:14.044443+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":193,"num_write":93,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:54.846974+0000","last_change":"2024-09-12T18:14:54.846974+0000","last_active":"2024-09-12T18:14:54.846974+0000","last_peered":"2024-09-12T18:14:54.846974+0000","last_clean":"2024-09-12T18:14:54.846974+0000","last_became_active":"2024-09-12T17:39:05.931122+0000","last_became_peered":"2024-09-12T17:39:05.931122+0000","last_unstale":"2024-09-12T18:14:54.846974+0000","last_undegraded":"2024-09-12T18:14:54.846974+0000","last_fullsized":"2024-09-12T18:14:54.846974+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:54.846873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:54.846873+0000","last_clean_scrub_stamp":"2024-09-12T18:14:54.846873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:28.937600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'9","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:53.880734+0000","last_change":"2024-09-12T18:14:53.880734+0000","last_active":"2024-09-12T18:14:53.880734+0000","last_peered":"2024-09-12T18:14:53.880734+0000","last_clean":"2024-09-12T18:14:53.880734+0000","last_became_active":"2024-09-12T17:20:34.612720+0000","last_became_peered":"2024-09-12T17:20:34.612720+0000","last_unstale":"2024-09-12T18:14:53.880734+0000","last_undegraded":"2024-09-12T18:14:53.880734+0000","last_fullsized":"2024-09-12T18:14:53.880734+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-12T18:14:53.880619+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-12T18:14:53.880619+0000","last_clean_scrub_stamp":"2024-09-12T18:14:53.880619+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:52.674845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":14336,"num_write":14,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'8","reported_seq":78,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:38.893965+0000","last_change":"2024-09-12T18:14:38.893899+0000","last_active":"2024-09-12T18:14:38.893965+0000","last_peered":"2024-09-12T18:14:38.893965+0000","last_clean":"2024-09-12T18:14:38.893965+0000","last_became_active":"2024-09-12T17:20:30.534068+0000","last_became_peered":"2024-09-12T17:20:30.534068+0000","last_unstale":"2024-09-12T18:14:38.893965+0000","last_undegraded":"2024-09-12T18:14:38.893965+0000","last_fullsized":"2024-09-12T18:14:38.893965+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T18:14:38.893812+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T18:14:38.893812+0000","last_clean_scrub_stamp":"2024-09-12T18:14:38.893812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:22.228878+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'25","reported_seq":132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:41.857869+0000","last_change":"2024-09-12T18:14:41.857869+0000","last_active":"2024-09-12T18:14:41.857869+0000","last_peered":"2024-09-12T18:14:41.857869+0000","last_clean":"2024-09-12T18:14:41.857869+0000","last_became_active":"2024-09-12T17:16:11.489860+0000","last_became_peered":"2024-09-12T17:16:11.489860+0000","last_unstale":"2024-09-12T18:14:41.857869+0000","last_undegraded":"2024-09-12T18:14:41.857869+0000","last_fullsized":"2024-09-12T18:14:41.857869+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'25","last_scrub_stamp":"2024-09-12T18:14:41.857750+0000","last_deep_scrub":"264'25","last_deep_scrub_stamp":"2024-09-12T18:14:41.857750+0000","last_clean_scrub_stamp":"2024-09-12T18:14:41.857750+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:36.971513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:56.843115+0000","last_change":"2024-09-12T18:14:56.843036+0000","last_active":"2024-09-12T18:14:56.843115+0000","last_peered":"2024-09-12T18:14:56.843115+0000","last_clean":"2024-09-12T18:14:56.843115+0000","last_became_active":"2024-09-12T17:39:05.931089+0000","last_became_peered":"2024-09-12T17:39:05.931089+0000","last_unstale":"2024-09-12T18:14:56.843115+0000","last_undegraded":"2024-09-12T18:14:56.843115+0000","last_fullsized":"2024-09-12T18:14:56.843115+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:56.842944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:56.842944+0000","last_clean_scrub_stamp":"2024-09-12T18:14:56.842944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:03.812081+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"264'2","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:38.357246+0000","last_change":"2024-09-12T18:14:38.357246+0000","last_active":"2024-09-12T18:14:38.357246+0000","last_peered":"2024-09-12T18:14:38.357246+0000","last_clean":"2024-09-12T18:14:38.357246+0000","last_became_active":"2024-09-12T17:20:34.557008+0000","last_became_peered":"2024-09-12T17:20:34.557008+0000","last_unstale":"2024-09-12T18:14:38.357246+0000","last_undegraded":"2024-09-12T18:14:38.357246+0000","last_fullsized":"2024-09-12T18:14:38.357246+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:38.357161+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:38.357161+0000","last_clean_scrub_stamp":"2024-09-12T18:14:38.357161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:21.973922+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'7","reported_seq":73,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:47.217738+0000","last_change":"2024-09-12T18:14:47.217738+0000","last_active":"2024-09-12T18:14:47.217738+0000","last_peered":"2024-09-12T18:14:47.217738+0000","last_clean":"2024-09-12T18:14:47.217738+0000","last_became_active":"2024-09-12T17:20:30.538361+0000","last_became_peered":"2024-09-12T17:20:30.538361+0000","last_unstale":"2024-09-12T18:14:47.217738+0000","last_undegraded":"2024-09-12T18:14:47.217738+0000","last_fullsized":"2024-09-12T18:14:47.217738+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'7","last_scrub_stamp":"2024-09-12T18:14:47.217649+0000","last_deep_scrub":"261'7","last_deep_scrub_stamp":"2024-09-12T18:14:47.217649+0000","last_clean_scrub_stamp":"2024-09-12T18:14:47.217649+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:54.284299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4098,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'48","reported_seq":190,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:40.877415+0000","last_change":"2024-09-12T18:14:40.877415+0000","last_active":"2024-09-12T18:14:40.877415+0000","last_peered":"2024-09-12T18:14:40.877415+0000","last_clean":"2024-09-12T18:14:40.877415+0000","last_became_active":"2024-09-12T17:16:11.487771+0000","last_became_peered":"2024-09-12T17:16:11.487771+0000","last_unstale":"2024-09-12T18:14:40.877415+0000","last_undegraded":"2024-09-12T18:14:40.877415+0000","last_fullsized":"2024-09-12T18:14:40.877415+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'48","last_scrub_stamp":"2024-09-12T18:14:40.877325+0000","last_deep_scrub":"264'48","last_deep_scrub_stamp":"2024-09-12T18:14:40.877325+0000","last_clean_scrub_stamp":"2024-09-12T18:14:40.877325+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:39.342368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":161,"num_write":84,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:35.286275+0000","last_change":"2024-09-12T18:14:35.286275+0000","last_active":"2024-09-12T18:14:35.286275+0000","last_peered":"2024-09-12T18:14:35.286275+0000","last_clean":"2024-09-12T18:14:35.286275+0000","last_became_active":"2024-09-12T17:39:05.921661+0000","last_became_peered":"2024-09-12T17:39:05.921661+0000","last_unstale":"2024-09-12T18:14:35.286275+0000","last_undegraded":"2024-09-12T18:14:35.286275+0000","last_fullsized":"2024-09-12T18:14:35.286275+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:35.286189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:35.286189+0000","last_clean_scrub_stamp":"2024-09-12T18:14:35.286189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:53.675989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'3","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:33.284489+0000","last_change":"2024-09-12T18:14:33.284489+0000","last_active":"2024-09-12T18:14:33.284489+0000","last_peered":"2024-09-12T18:14:33.284489+0000","last_clean":"2024-09-12T18:14:33.284489+0000","last_became_active":"2024-09-12T17:20:34.555047+0000","last_became_peered":"2024-09-12T17:20:34.555047+0000","last_unstale":"2024-09-12T18:14:33.284489+0000","last_undegraded":"2024-09-12T18:14:33.284489+0000","last_fullsized":"2024-09-12T18:14:33.284489+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:14:33.284407+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:14:33.284407+0000","last_clean_scrub_stamp":"2024-09-12T18:14:33.284407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:39.812819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'4","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:36.890680+0000","last_change":"2024-09-12T18:14:36.890680+0000","last_active":"2024-09-12T18:14:36.890680+0000","last_peered":"2024-09-12T18:14:36.890680+0000","last_clean":"2024-09-12T18:14:36.890680+0000","last_became_active":"2024-09-12T17:20:30.528029+0000","last_became_peered":"2024-09-12T17:20:30.528029+0000","last_unstale":"2024-09-12T18:14:36.890680+0000","last_undegraded":"2024-09-12T18:14:36.890680+0000","last_fullsized":"2024-09-12T18:14:36.890680+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:14:36.890596+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:14:36.890596+0000","last_clean_scrub_stamp":"2024-09-12T18:14:36.890596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:47.450753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'34","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:25.251913+0000","last_change":"2024-09-12T18:14:25.251913+0000","last_active":"2024-09-12T18:14:25.251913+0000","last_peered":"2024-09-12T18:14:25.251913+0000","last_clean":"2024-09-12T18:14:25.251913+0000","last_became_active":"2024-09-12T17:16:11.490952+0000","last_became_peered":"2024-09-12T17:16:11.490952+0000","last_unstale":"2024-09-12T18:14:25.251913+0000","last_undegraded":"2024-09-12T18:14:25.251913+0000","last_fullsized":"2024-09-12T18:14:25.251913+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-09-12T18:14:25.251827+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-09-12T18:14:25.251827+0000","last_clean_scrub_stamp":"2024-09-12T18:14:25.251827+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:49.122335+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":115,"num_write":60,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'2","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:53.380859+0000","last_change":"2024-09-12T18:14:53.380859+0000","last_active":"2024-09-12T18:14:53.380859+0000","last_peered":"2024-09-12T18:14:53.380859+0000","last_clean":"2024-09-12T18:14:53.380859+0000","last_became_active":"2024-09-12T17:39:05.928959+0000","last_became_peered":"2024-09-12T17:39:05.928959+0000","last_unstale":"2024-09-12T18:14:53.380859+0000","last_undegraded":"2024-09-12T18:14:53.380859+0000","last_fullsized":"2024-09-12T18:14:53.380859+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:53.380765+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:53.380765+0000","last_clean_scrub_stamp":"2024-09-12T18:14:53.380765+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:34.272875+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:32.263068+0000","last_change":"2024-09-12T18:14:32.263068+0000","last_active":"2024-09-12T18:14:32.263068+0000","last_peered":"2024-09-12T18:14:32.263068+0000","last_clean":"2024-09-12T18:14:32.263068+0000","last_became_active":"2024-09-12T17:20:34.552180+0000","last_became_peered":"2024-09-12T17:20:34.552180+0000","last_unstale":"2024-09-12T18:14:32.263068+0000","last_undegraded":"2024-09-12T18:14:32.263068+0000","last_fullsized":"2024-09-12T18:14:32.263068+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:32.262977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:32.262977+0000","last_clean_scrub_stamp":"2024-09-12T18:14:32.262977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:29.463521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:44.825732+0000","last_change":"2024-09-12T18:14:44.825732+0000","last_active":"2024-09-12T18:14:44.825732+0000","last_peered":"2024-09-12T18:14:44.825732+0000","last_clean":"2024-09-12T18:14:44.825732+0000","last_became_active":"2024-09-12T17:20:30.535001+0000","last_became_peered":"2024-09-12T17:20:30.535001+0000","last_unstale":"2024-09-12T18:14:44.825732+0000","last_undegraded":"2024-09-12T18:14:44.825732+0000","last_fullsized":"2024-09-12T18:14:44.825732+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:44.825629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:44.825629+0000","last_clean_scrub_stamp":"2024-09-12T18:14:44.825629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:16.612630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'14","reported_seq":99,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:39.320748+0000","last_change":"2024-09-12T18:14:39.320748+0000","last_active":"2024-09-12T18:14:39.320748+0000","last_peered":"2024-09-12T18:14:39.320748+0000","last_clean":"2024-09-12T18:14:39.320748+0000","last_became_active":"2024-09-12T17:16:11.477940+0000","last_became_peered":"2024-09-12T17:16:11.477940+0000","last_unstale":"2024-09-12T18:14:39.320748+0000","last_undegraded":"2024-09-12T18:14:39.320748+0000","last_fullsized":"2024-09-12T18:14:39.320748+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'14","last_scrub_stamp":"2024-09-12T18:14:39.320655+0000","last_deep_scrub":"264'14","last_deep_scrub_stamp":"2024-09-12T18:14:39.320655+0000","last_clean_scrub_stamp":"2024-09-12T18:14:39.320655+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:44.563002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":35,"num_write":34,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:54.360880+0000","last_change":"2024-09-12T18:14:54.360880+0000","last_active":"2024-09-12T18:14:54.360880+0000","last_peered":"2024-09-12T18:14:54.360880+0000","last_clean":"2024-09-12T18:14:54.360880+0000","last_became_active":"2024-09-12T17:39:05.930694+0000","last_became_peered":"2024-09-12T17:39:05.930694+0000","last_unstale":"2024-09-12T18:14:54.360880+0000","last_undegraded":"2024-09-12T18:14:54.360880+0000","last_fullsized":"2024-09-12T18:14:54.360880+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:54.360785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:54.360785+0000","last_clean_scrub_stamp":"2024-09-12T18:14:54.360785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:26.422302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"261'4","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:51.860116+0000","last_change":"2024-09-12T18:14:51.860116+0000","last_active":"2024-09-12T18:14:51.860116+0000","last_peered":"2024-09-12T18:14:51.860116+0000","last_clean":"2024-09-12T18:14:51.860116+0000","last_became_active":"2024-09-12T17:20:34.552726+0000","last_became_peered":"2024-09-12T17:20:34.552726+0000","last_unstale":"2024-09-12T18:14:51.860116+0000","last_undegraded":"2024-09-12T18:14:51.860116+0000","last_fullsized":"2024-09-12T18:14:51.860116+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-12T18:14:51.860023+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-12T18:14:51.860023+0000","last_clean_scrub_stamp":"2024-09-12T18:14:51.860023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:22.961646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'3","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:45.297314+0000","last_change":"2024-09-12T18:14:45.297314+0000","last_active":"2024-09-12T18:14:45.297314+0000","last_peered":"2024-09-12T18:14:45.297314+0000","last_clean":"2024-09-12T18:14:45.297314+0000","last_became_active":"2024-09-12T17:20:30.538942+0000","last_became_peered":"2024-09-12T17:20:30.538942+0000","last_unstale":"2024-09-12T18:14:45.297314+0000","last_undegraded":"2024-09-12T18:14:45.297314+0000","last_fullsized":"2024-09-12T18:14:45.297314+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:14:45.297210+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:14:45.297210+0000","last_clean_scrub_stamp":"2024-09-12T18:14:45.297210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:07.187278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'32","reported_seq":153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:25.248962+0000","last_change":"2024-09-12T18:14:25.248962+0000","last_active":"2024-09-12T18:14:25.248962+0000","last_peered":"2024-09-12T18:14:25.248962+0000","last_clean":"2024-09-12T18:14:25.248962+0000","last_became_active":"2024-09-12T17:16:11.487242+0000","last_became_peered":"2024-09-12T17:16:11.487242+0000","last_unstale":"2024-09-12T18:14:25.248962+0000","last_undegraded":"2024-09-12T18:14:25.248962+0000","last_fullsized":"2024-09-12T18:14:25.248962+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'32","last_scrub_stamp":"2024-09-12T18:14:25.248876+0000","last_deep_scrub":"264'32","last_deep_scrub_stamp":"2024-09-12T18:14:25.248876+0000","last_clean_scrub_stamp":"2024-09-12T18:14:25.248876+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:35.934364+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":114,"num_write":62,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:34.302331+0000","last_change":"2024-09-12T18:14:34.302331+0000","last_active":"2024-09-12T18:14:34.302331+0000","last_peered":"2024-09-12T18:14:34.302331+0000","last_clean":"2024-09-12T18:14:34.302331+0000","last_became_active":"2024-09-12T17:39:05.924899+0000","last_became_peered":"2024-09-12T17:39:05.924899+0000","last_unstale":"2024-09-12T18:14:34.302331+0000","last_undegraded":"2024-09-12T18:14:34.302331+0000","last_fullsized":"2024-09-12T18:14:34.302331+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:34.302228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:34.302228+0000","last_clean_scrub_stamp":"2024-09-12T18:14:34.302228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:52.230167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'5","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:50.882572+0000","last_change":"2024-09-12T18:14:50.882572+0000","last_active":"2024-09-12T18:14:50.882572+0000","last_peered":"2024-09-12T18:14:50.882572+0000","last_clean":"2024-09-12T18:14:50.882572+0000","last_became_active":"2024-09-12T17:20:34.610374+0000","last_became_peered":"2024-09-12T17:20:34.610374+0000","last_unstale":"2024-09-12T18:14:50.882572+0000","last_undegraded":"2024-09-12T18:14:50.882572+0000","last_fullsized":"2024-09-12T18:14:50.882572+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T18:14:50.882462+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T18:14:50.882462+0000","last_clean_scrub_stamp":"2024-09-12T18:14:50.882462+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:07.231078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1142,"num_write":10,"num_write_kb":1595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"264'3","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:40.354820+0000","last_change":"2024-09-12T18:14:40.354820+0000","last_active":"2024-09-12T18:14:40.354820+0000","last_peered":"2024-09-12T18:14:40.354820+0000","last_clean":"2024-09-12T18:14:40.354820+0000","last_became_active":"2024-09-12T17:20:30.526672+0000","last_became_peered":"2024-09-12T17:20:30.526672+0000","last_unstale":"2024-09-12T18:14:40.354820+0000","last_undegraded":"2024-09-12T18:14:40.354820+0000","last_fullsized":"2024-09-12T18:14:40.354820+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:14:40.354725+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:14:40.354725+0000","last_clean_scrub_stamp":"2024-09-12T18:14:40.354725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:13.858857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'19","reported_seq":118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:38.329697+0000","last_change":"2024-09-12T18:14:38.329697+0000","last_active":"2024-09-12T18:14:38.329697+0000","last_peered":"2024-09-12T18:14:38.329697+0000","last_clean":"2024-09-12T18:14:38.329697+0000","last_became_active":"2024-09-12T17:16:11.481351+0000","last_became_peered":"2024-09-12T17:16:11.481351+0000","last_unstale":"2024-09-12T18:14:38.329697+0000","last_undegraded":"2024-09-12T18:14:38.329697+0000","last_fullsized":"2024-09-12T18:14:38.329697+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'19","last_scrub_stamp":"2024-09-12T18:14:38.329609+0000","last_deep_scrub":"264'19","last_deep_scrub_stamp":"2024-09-12T18:14:38.329609+0000","last_clean_scrub_stamp":"2024-09-12T18:14:38.329609+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:02.772844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":68,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:24.093216+0000","last_change":"2024-09-12T18:14:24.093216+0000","last_active":"2024-09-12T18:14:24.093216+0000","last_peered":"2024-09-12T18:14:24.093216+0000","last_clean":"2024-09-12T18:14:24.093216+0000","last_became_active":"2024-09-12T17:39:05.928497+0000","last_became_peered":"2024-09-12T17:39:05.928497+0000","last_unstale":"2024-09-12T18:14:24.093216+0000","last_undegraded":"2024-09-12T18:14:24.093216+0000","last_fullsized":"2024-09-12T18:14:24.093216+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:24.093130+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:24.093130+0000","last_clean_scrub_stamp":"2024-09-12T18:14:24.093130+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:34.010186+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'2","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:49.923740+0000","last_change":"2024-09-12T18:14:49.923740+0000","last_active":"2024-09-12T18:14:49.923740+0000","last_peered":"2024-09-12T18:14:49.923740+0000","last_clean":"2024-09-12T18:14:49.923740+0000","last_became_active":"2024-09-12T17:20:34.610260+0000","last_became_peered":"2024-09-12T17:20:34.610260+0000","last_unstale":"2024-09-12T18:14:49.923740+0000","last_undegraded":"2024-09-12T18:14:49.923740+0000","last_fullsized":"2024-09-12T18:14:49.923740+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:49.923643+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:49.923643+0000","last_clean_scrub_stamp":"2024-09-12T18:14:49.923643+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:49.938332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'14","reported_seq":84,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:42.400411+0000","last_change":"2024-09-12T18:14:42.400411+0000","last_active":"2024-09-12T18:14:42.400411+0000","last_peered":"2024-09-12T18:14:42.400411+0000","last_clean":"2024-09-12T18:14:42.400411+0000","last_became_active":"2024-09-12T17:20:30.527032+0000","last_became_peered":"2024-09-12T17:20:30.527032+0000","last_unstale":"2024-09-12T18:14:42.400411+0000","last_undegraded":"2024-09-12T18:14:42.400411+0000","last_fullsized":"2024-09-12T18:14:42.400411+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'14","last_scrub_stamp":"2024-09-12T18:14:42.400318+0000","last_deep_scrub":"264'14","last_deep_scrub_stamp":"2024-09-12T18:14:42.400318+0000","last_clean_scrub_stamp":"2024-09-12T18:14:42.400318+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:59.512457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":13314,"num_write":24,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"0'0","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:39.875082+0000","last_change":"2024-09-12T18:14:39.875082+0000","last_active":"2024-09-12T18:14:39.875082+0000","last_peered":"2024-09-12T18:14:39.875082+0000","last_clean":"2024-09-12T18:14:39.875082+0000","last_became_active":"2024-09-12T17:16:11.494493+0000","last_became_peered":"2024-09-12T17:16:11.494493+0000","last_unstale":"2024-09-12T18:14:39.875082+0000","last_undegraded":"2024-09-12T18:14:39.875082+0000","last_fullsized":"2024-09-12T18:14:39.875082+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:39.874988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:39.874988+0000","last_clean_scrub_stamp":"2024-09-12T18:14:39.874988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:32.983646+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:52.393869+0000","last_change":"2024-09-12T18:14:52.393869+0000","last_active":"2024-09-12T18:14:52.393869+0000","last_peered":"2024-09-12T18:14:52.393869+0000","last_clean":"2024-09-12T18:14:52.393869+0000","last_became_active":"2024-09-12T17:39:05.926388+0000","last_became_peered":"2024-09-12T17:39:05.926388+0000","last_unstale":"2024-09-12T18:14:52.393869+0000","last_undegraded":"2024-09-12T18:14:52.393869+0000","last_fullsized":"2024-09-12T18:14:52.393869+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:52.393776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:52.393776+0000","last_clean_scrub_stamp":"2024-09-12T18:14:52.393776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:46.750583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"261'2","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:58.792532+0000","last_change":"2024-09-12T18:14:58.792532+0000","last_active":"2024-09-12T18:14:58.792532+0000","last_peered":"2024-09-12T18:14:58.792532+0000","last_clean":"2024-09-12T18:14:58.792532+0000","last_became_active":"2024-09-12T17:20:34.615468+0000","last_became_peered":"2024-09-12T17:20:34.615468+0000","last_unstale":"2024-09-12T18:14:58.792532+0000","last_undegraded":"2024-09-12T18:14:58.792532+0000","last_fullsized":"2024-09-12T18:14:58.792532+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:14:58.792434+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:14:58.792434+0000","last_clean_scrub_stamp":"2024-09-12T18:14:58.792434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:31.194062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:19.104971+0000","last_change":"2024-09-12T18:14:19.104971+0000","last_active":"2024-09-12T18:14:19.104971+0000","last_peered":"2024-09-12T18:14:19.104971+0000","last_clean":"2024-09-12T18:14:19.104971+0000","last_became_active":"2024-09-12T17:20:30.533436+0000","last_became_peered":"2024-09-12T17:20:30.533436+0000","last_unstale":"2024-09-12T18:14:19.104971+0000","last_undegraded":"2024-09-12T18:14:19.104971+0000","last_fullsized":"2024-09-12T18:14:19.104971+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:19.104877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:19.104877+0000","last_clean_scrub_stamp":"2024-09-12T18:14:19.104877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:57.618987+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'18","reported_seq":115,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:16.123968+0000","last_change":"2024-09-12T18:14:16.123968+0000","last_active":"2024-09-12T18:14:16.123968+0000","last_peered":"2024-09-12T18:14:16.123968+0000","last_clean":"2024-09-12T18:14:16.123968+0000","last_became_active":"2024-09-12T17:16:11.488588+0000","last_became_peered":"2024-09-12T17:16:11.488588+0000","last_unstale":"2024-09-12T18:14:16.123968+0000","last_undegraded":"2024-09-12T18:14:16.123968+0000","last_fullsized":"2024-09-12T18:14:16.123968+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'18","last_scrub_stamp":"2024-09-12T18:14:16.123879+0000","last_deep_scrub":"264'18","last_deep_scrub_stamp":"2024-09-12T18:14:16.123879+0000","last_clean_scrub_stamp":"2024-09-12T18:14:16.123879+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:29.796727+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:43.458781+0000","last_change":"2024-09-12T18:14:43.458781+0000","last_active":"2024-09-12T18:14:43.458781+0000","last_peered":"2024-09-12T18:14:43.458781+0000","last_clean":"2024-09-12T18:14:43.458781+0000","last_became_active":"2024-09-12T17:39:05.922973+0000","last_became_peered":"2024-09-12T17:39:05.922973+0000","last_unstale":"2024-09-12T18:14:43.458781+0000","last_undegraded":"2024-09-12T18:14:43.458781+0000","last_fullsized":"2024-09-12T18:14:43.458781+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:43.458685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:43.458685+0000","last_clean_scrub_stamp":"2024-09-12T18:14:43.458685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:09.244788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:42.864282+0000","last_change":"2024-09-12T18:14:42.864282+0000","last_active":"2024-09-12T18:14:42.864282+0000","last_peered":"2024-09-12T18:14:42.864282+0000","last_clean":"2024-09-12T18:14:42.864282+0000","last_became_active":"2024-09-12T17:20:34.554893+0000","last_became_peered":"2024-09-12T17:20:34.554893+0000","last_unstale":"2024-09-12T18:14:42.864282+0000","last_undegraded":"2024-09-12T18:14:42.864282+0000","last_fullsized":"2024-09-12T18:14:42.864282+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:42.864188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:42.864188+0000","last_clean_scrub_stamp":"2024-09-12T18:14:42.864188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:32.276778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'6","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:44.329140+0000","last_change":"2024-09-12T18:14:44.329140+0000","last_active":"2024-09-12T18:14:44.329140+0000","last_peered":"2024-09-12T18:14:44.329140+0000","last_clean":"2024-09-12T18:14:44.329140+0000","last_became_active":"2024-09-12T17:20:30.535226+0000","last_became_peered":"2024-09-12T17:20:30.535226+0000","last_unstale":"2024-09-12T18:14:44.329140+0000","last_undegraded":"2024-09-12T18:14:44.329140+0000","last_fullsized":"2024-09-12T18:14:44.329140+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T18:14:44.329026+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T18:14:44.329026+0000","last_clean_scrub_stamp":"2024-09-12T18:14:44.329026+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:49.983790+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":6,"num_write_kb":3074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'26","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:37.368433+0000","last_change":"2024-09-12T18:14:37.368381+0000","last_active":"2024-09-12T18:14:37.368433+0000","last_peered":"2024-09-12T18:14:37.368433+0000","last_clean":"2024-09-12T18:14:37.368433+0000","last_became_active":"2024-09-12T17:16:11.491240+0000","last_became_peered":"2024-09-12T17:16:11.491240+0000","last_unstale":"2024-09-12T18:14:37.368433+0000","last_undegraded":"2024-09-12T18:14:37.368433+0000","last_fullsized":"2024-09-12T18:14:37.368433+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'26","last_scrub_stamp":"2024-09-12T18:14:37.368275+0000","last_deep_scrub":"264'26","last_deep_scrub_stamp":"2024-09-12T18:14:37.368275+0000","last_clean_scrub_stamp":"2024-09-12T18:14:37.368275+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:28.300827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":97,"num_write":43,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:57.836752+0000","last_change":"2024-09-12T18:14:57.836752+0000","last_active":"2024-09-12T18:14:57.836752+0000","last_peered":"2024-09-12T18:14:57.836752+0000","last_clean":"2024-09-12T18:14:57.836752+0000","last_became_active":"2024-09-12T17:39:05.931841+0000","last_became_peered":"2024-09-12T17:39:05.931841+0000","last_unstale":"2024-09-12T18:14:57.836752+0000","last_undegraded":"2024-09-12T18:14:57.836752+0000","last_fullsized":"2024-09-12T18:14:57.836752+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:57.836643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:57.836643+0000","last_clean_scrub_stamp":"2024-09-12T18:14:57.836643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:07.199004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:37.351090+0000","last_change":"2024-09-12T18:14:37.351090+0000","last_active":"2024-09-12T18:14:37.351090+0000","last_peered":"2024-09-12T18:14:37.351090+0000","last_clean":"2024-09-12T18:14:37.351090+0000","last_became_active":"2024-09-12T17:20:34.560497+0000","last_became_peered":"2024-09-12T17:20:34.560497+0000","last_unstale":"2024-09-12T18:14:37.351090+0000","last_undegraded":"2024-09-12T18:14:37.351090+0000","last_fullsized":"2024-09-12T18:14:37.351090+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:37.350984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:37.350984+0000","last_clean_scrub_stamp":"2024-09-12T18:14:37.350984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:49.013668+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"261'7","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:35.900552+0000","last_change":"2024-09-12T18:14:35.900552+0000","last_active":"2024-09-12T18:14:35.900552+0000","last_peered":"2024-09-12T18:14:35.900552+0000","last_clean":"2024-09-12T18:14:35.900552+0000","last_became_active":"2024-09-12T17:20:30.535358+0000","last_became_peered":"2024-09-12T17:20:30.535358+0000","last_unstale":"2024-09-12T18:14:35.900552+0000","last_undegraded":"2024-09-12T18:14:35.900552+0000","last_fullsized":"2024-09-12T18:14:35.900552+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'7","last_scrub_stamp":"2024-09-12T18:14:35.900447+0000","last_deep_scrub":"261'7","last_deep_scrub_stamp":"2024-09-12T18:14:35.900447+0000","last_clean_scrub_stamp":"2024-09-12T18:14:35.900447+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:42.300227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":15362,"num_write":12,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'12","reported_seq":99,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:35.440402+0000","last_change":"2024-09-12T18:14:35.440402+0000","last_active":"2024-09-12T18:14:35.440402+0000","last_peered":"2024-09-12T18:14:35.440402+0000","last_clean":"2024-09-12T18:14:35.440402+0000","last_became_active":"2024-09-12T17:16:11.489897+0000","last_became_peered":"2024-09-12T17:16:11.489897+0000","last_unstale":"2024-09-12T18:14:35.440402+0000","last_undegraded":"2024-09-12T18:14:35.440402+0000","last_fullsized":"2024-09-12T18:14:35.440402+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-09-12T18:14:35.440323+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-09-12T18:14:35.440323+0000","last_clean_scrub_stamp":"2024-09-12T18:14:35.440323+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:01.721656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:55.338067+0000","last_change":"2024-09-12T18:14:55.338067+0000","last_active":"2024-09-12T18:14:55.338067+0000","last_peered":"2024-09-12T18:14:55.338067+0000","last_clean":"2024-09-12T18:14:55.338067+0000","last_became_active":"2024-09-12T17:39:05.926766+0000","last_became_peered":"2024-09-12T17:39:05.926766+0000","last_unstale":"2024-09-12T18:14:55.338067+0000","last_undegraded":"2024-09-12T18:14:55.338067+0000","last_fullsized":"2024-09-12T18:14:55.338067+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:55.337964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:55.337964+0000","last_clean_scrub_stamp":"2024-09-12T18:14:55.337964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:56.775425+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"264'2","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:33.279759+0000","last_change":"2024-09-12T18:14:33.279759+0000","last_active":"2024-09-12T18:14:33.279759+0000","last_peered":"2024-09-12T18:14:33.279759+0000","last_clean":"2024-09-12T18:14:33.279759+0000","last_became_active":"2024-09-12T17:20:34.558970+0000","last_became_peered":"2024-09-12T17:20:34.558970+0000","last_unstale":"2024-09-12T18:14:33.279759+0000","last_undegraded":"2024-09-12T18:14:33.279759+0000","last_fullsized":"2024-09-12T18:14:33.279759+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:33.279662+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:33.279662+0000","last_clean_scrub_stamp":"2024-09-12T18:14:33.279662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:33.229244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'4","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:42.893159+0000","last_change":"2024-09-12T18:14:42.893159+0000","last_active":"2024-09-12T18:14:42.893159+0000","last_peered":"2024-09-12T18:14:42.893159+0000","last_clean":"2024-09-12T18:14:42.893159+0000","last_became_active":"2024-09-12T17:20:30.535761+0000","last_became_peered":"2024-09-12T17:20:30.535761+0000","last_unstale":"2024-09-12T18:14:42.893159+0000","last_undegraded":"2024-09-12T18:14:42.893159+0000","last_fullsized":"2024-09-12T18:14:42.893159+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:14:42.893065+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:14:42.893065+0000","last_clean_scrub_stamp":"2024-09-12T18:14:42.893065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:04.991142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8196,"num_write":4,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'42","reported_seq":184,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:37.282667+0000","last_change":"2024-09-12T18:14:37.282667+0000","last_active":"2024-09-12T18:14:37.282667+0000","last_peered":"2024-09-12T18:14:37.282667+0000","last_clean":"2024-09-12T18:14:37.282667+0000","last_became_active":"2024-09-12T17:16:11.487923+0000","last_became_peered":"2024-09-12T17:16:11.487923+0000","last_unstale":"2024-09-12T18:14:37.282667+0000","last_undegraded":"2024-09-12T18:14:37.282667+0000","last_fullsized":"2024-09-12T18:14:37.282667+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'42","last_scrub_stamp":"2024-09-12T18:14:37.282577+0000","last_deep_scrub":"264'42","last_deep_scrub_stamp":"2024-09-12T18:14:37.282577+0000","last_clean_scrub_stamp":"2024-09-12T18:14:37.282577+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:37.971018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":152,"num_write":79,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:54.339140+0000","last_change":"2024-09-12T18:14:54.339140+0000","last_active":"2024-09-12T18:14:54.339140+0000","last_peered":"2024-09-12T18:14:54.339140+0000","last_clean":"2024-09-12T18:14:54.339140+0000","last_became_active":"2024-09-12T17:39:05.921257+0000","last_became_peered":"2024-09-12T17:39:05.921257+0000","last_unstale":"2024-09-12T18:14:54.339140+0000","last_undegraded":"2024-09-12T18:14:54.339140+0000","last_fullsized":"2024-09-12T18:14:54.339140+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:54.339048+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:54.339048+0000","last_clean_scrub_stamp":"2024-09-12T18:14:54.339048+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:25.869485+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'4","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:48.912380+0000","last_change":"2024-09-12T18:14:48.912380+0000","last_active":"2024-09-12T18:14:48.912380+0000","last_peered":"2024-09-12T18:14:48.912380+0000","last_clean":"2024-09-12T18:14:48.912380+0000","last_became_active":"2024-09-12T17:20:34.553659+0000","last_became_peered":"2024-09-12T17:20:34.553659+0000","last_unstale":"2024-09-12T18:14:48.912380+0000","last_undegraded":"2024-09-12T18:14:48.912380+0000","last_fullsized":"2024-09-12T18:14:48.912380+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:14:48.912283+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:14:48.912283+0000","last_clean_scrub_stamp":"2024-09-12T18:14:48.912283+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:36.145195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":52,"num_write":4,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:29.308211+0000","last_change":"2024-09-12T18:14:29.308211+0000","last_active":"2024-09-12T18:14:29.308211+0000","last_peered":"2024-09-12T18:14:29.308211+0000","last_clean":"2024-09-12T18:14:29.308211+0000","last_became_active":"2024-09-12T17:20:30.534878+0000","last_became_peered":"2024-09-12T17:20:30.534878+0000","last_unstale":"2024-09-12T18:14:29.308211+0000","last_undegraded":"2024-09-12T18:14:29.308211+0000","last_fullsized":"2024-09-12T18:14:29.308211+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:29.308129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:29.308129+0000","last_clean_scrub_stamp":"2024-09-12T18:14:29.308129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:55.168954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'93","reported_seq":353,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:37.847533+0000","last_change":"2024-09-12T18:14:37.847533+0000","last_active":"2024-09-12T18:14:37.847533+0000","last_peered":"2024-09-12T18:14:37.847533+0000","last_clean":"2024-09-12T18:14:37.847533+0000","last_became_active":"2024-09-12T17:16:11.489044+0000","last_became_peered":"2024-09-12T17:16:11.489044+0000","last_unstale":"2024-09-12T18:14:37.847533+0000","last_undegraded":"2024-09-12T18:14:37.847533+0000","last_fullsized":"2024-09-12T18:14:37.847533+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'93","last_scrub_stamp":"2024-09-12T18:14:37.847447+0000","last_deep_scrub":"264'93","last_deep_scrub_stamp":"2024-09-12T18:14:37.847447+0000","last_clean_scrub_stamp":"2024-09-12T18:14:37.847447+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:13.908555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":552,"num_read_kb":376,"num_write":139,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4212,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'2","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:52.872374+0000","last_change":"2024-09-12T18:14:52.872374+0000","last_active":"2024-09-12T18:14:52.872374+0000","last_peered":"2024-09-12T18:14:52.872374+0000","last_clean":"2024-09-12T18:14:52.872374+0000","last_became_active":"2024-09-12T17:39:05.932617+0000","last_became_peered":"2024-09-12T17:39:05.932617+0000","last_unstale":"2024-09-12T18:14:52.872374+0000","last_undegraded":"2024-09-12T18:14:52.872374+0000","last_fullsized":"2024-09-12T18:14:52.872374+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:52.872274+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:52.872274+0000","last_clean_scrub_stamp":"2024-09-12T18:14:52.872274+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:59.039413+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"261'5","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:31.300183+0000","last_change":"2024-09-12T18:14:31.300183+0000","last_active":"2024-09-12T18:14:31.300183+0000","last_peered":"2024-09-12T18:14:31.300183+0000","last_clean":"2024-09-12T18:14:31.300183+0000","last_became_active":"2024-09-12T17:20:34.559024+0000","last_became_peered":"2024-09-12T17:20:34.559024+0000","last_unstale":"2024-09-12T18:14:31.300183+0000","last_undegraded":"2024-09-12T18:14:31.300183+0000","last_fullsized":"2024-09-12T18:14:31.300183+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T18:14:31.300097+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T18:14:31.300097+0000","last_clean_scrub_stamp":"2024-09-12T18:14:31.300097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:19.729710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'6","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:39.334151+0000","last_change":"2024-09-12T18:14:39.334151+0000","last_active":"2024-09-12T18:14:39.334151+0000","last_peered":"2024-09-12T18:14:39.334151+0000","last_clean":"2024-09-12T18:14:39.334151+0000","last_became_active":"2024-09-12T17:20:30.534298+0000","last_became_peered":"2024-09-12T17:20:30.534298+0000","last_unstale":"2024-09-12T18:14:39.334151+0000","last_undegraded":"2024-09-12T18:14:39.334151+0000","last_fullsized":"2024-09-12T18:14:39.334151+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T18:14:39.334067+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T18:14:39.334067+0000","last_clean_scrub_stamp":"2024-09-12T18:14:39.334067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:24.059173+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'39","reported_seq":171,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:43.849572+0000","last_change":"2024-09-12T18:14:43.849572+0000","last_active":"2024-09-12T18:14:43.849572+0000","last_peered":"2024-09-12T18:14:43.849572+0000","last_clean":"2024-09-12T18:14:43.849572+0000","last_became_active":"2024-09-12T17:16:11.489085+0000","last_became_peered":"2024-09-12T17:16:11.489085+0000","last_unstale":"2024-09-12T18:14:43.849572+0000","last_undegraded":"2024-09-12T18:14:43.849572+0000","last_fullsized":"2024-09-12T18:14:43.849572+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'39","last_scrub_stamp":"2024-09-12T18:14:43.849477+0000","last_deep_scrub":"264'39","last_deep_scrub_stamp":"2024-09-12T18:14:43.849477+0000","last_clean_scrub_stamp":"2024-09-12T18:14:43.849477+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:18.464822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":137,"num_write":73,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:21.066230+0000","last_change":"2024-09-12T18:14:21.066230+0000","last_active":"2024-09-12T18:14:21.066230+0000","last_peered":"2024-09-12T18:14:21.066230+0000","last_clean":"2024-09-12T18:14:21.066230+0000","last_became_active":"2024-09-12T17:39:05.928320+0000","last_became_peered":"2024-09-12T17:39:05.928320+0000","last_unstale":"2024-09-12T18:14:21.066230+0000","last_undegraded":"2024-09-12T18:14:21.066230+0000","last_fullsized":"2024-09-12T18:14:21.066230+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:21.066130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:21.066130+0000","last_clean_scrub_stamp":"2024-09-12T18:14:21.066130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:24.159619+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"261'5","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:44.862931+0000","last_change":"2024-09-12T18:14:44.862931+0000","last_active":"2024-09-12T18:14:44.862931+0000","last_peered":"2024-09-12T18:14:44.862931+0000","last_clean":"2024-09-12T18:14:44.862931+0000","last_became_active":"2024-09-12T17:20:34.553407+0000","last_became_peered":"2024-09-12T17:20:34.553407+0000","last_unstale":"2024-09-12T18:14:44.862931+0000","last_undegraded":"2024-09-12T18:14:44.862931+0000","last_fullsized":"2024-09-12T18:14:44.862931+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T18:14:44.862835+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T18:14:44.862835+0000","last_clean_scrub_stamp":"2024-09-12T18:14:44.862835+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:25.637914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'7","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:41.404873+0000","last_change":"2024-09-12T18:14:41.404873+0000","last_active":"2024-09-12T18:14:41.404873+0000","last_peered":"2024-09-12T18:14:41.404873+0000","last_clean":"2024-09-12T18:14:41.404873+0000","last_became_active":"2024-09-12T17:20:30.524670+0000","last_became_peered":"2024-09-12T17:20:30.524670+0000","last_unstale":"2024-09-12T18:14:41.404873+0000","last_undegraded":"2024-09-12T18:14:41.404873+0000","last_fullsized":"2024-09-12T18:14:41.404873+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-12T18:14:41.404779+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-12T18:14:41.404779+0000","last_clean_scrub_stamp":"2024-09-12T18:14:41.404779+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:13.064906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4667,"num_write":12,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'33","reported_seq":154,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:38.862439+0000","last_change":"2024-09-12T18:14:38.862388+0000","last_active":"2024-09-12T18:14:38.862439+0000","last_peered":"2024-09-12T18:14:38.862439+0000","last_clean":"2024-09-12T18:14:38.862439+0000","last_became_active":"2024-09-12T17:16:11.486986+0000","last_became_peered":"2024-09-12T17:16:11.486986+0000","last_unstale":"2024-09-12T18:14:38.862439+0000","last_undegraded":"2024-09-12T18:14:38.862439+0000","last_fullsized":"2024-09-12T18:14:38.862439+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-09-12T18:14:38.862316+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-09-12T18:14:38.862316+0000","last_clean_scrub_stamp":"2024-09-12T18:14:38.862316+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:42.639458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":108,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:49.375262+0000","last_change":"2024-09-12T18:14:49.375189+0000","last_active":"2024-09-12T18:14:49.375262+0000","last_peered":"2024-09-12T18:14:49.375262+0000","last_clean":"2024-09-12T18:14:49.375262+0000","last_became_active":"2024-09-12T17:39:05.927578+0000","last_became_peered":"2024-09-12T17:39:05.927578+0000","last_unstale":"2024-09-12T18:14:49.375262+0000","last_undegraded":"2024-09-12T18:14:49.375262+0000","last_fullsized":"2024-09-12T18:14:49.375262+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:49.375098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:49.375098+0000","last_clean_scrub_stamp":"2024-09-12T18:14:49.375098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:07.026617+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:47.904643+0000","last_change":"2024-09-12T18:14:47.904643+0000","last_active":"2024-09-12T18:14:47.904643+0000","last_peered":"2024-09-12T18:14:47.904643+0000","last_clean":"2024-09-12T18:14:47.904643+0000","last_became_active":"2024-09-12T17:20:34.552569+0000","last_became_peered":"2024-09-12T17:20:34.552569+0000","last_unstale":"2024-09-12T18:14:47.904643+0000","last_undegraded":"2024-09-12T18:14:47.904643+0000","last_fullsized":"2024-09-12T18:14:47.904643+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:47.904542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:47.904542+0000","last_clean_scrub_stamp":"2024-09-12T18:14:47.904542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:43.342578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:22.115770+0000","last_change":"2024-09-12T18:14:22.115718+0000","last_active":"2024-09-12T18:14:22.115770+0000","last_peered":"2024-09-12T18:14:22.115770+0000","last_clean":"2024-09-12T18:14:22.115770+0000","last_became_active":"2024-09-12T17:20:30.538157+0000","last_became_peered":"2024-09-12T17:20:30.538157+0000","last_unstale":"2024-09-12T18:14:22.115770+0000","last_undegraded":"2024-09-12T18:14:22.115770+0000","last_fullsized":"2024-09-12T18:14:22.115770+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:22.115629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:22.115629+0000","last_clean_scrub_stamp":"2024-09-12T18:14:22.115629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:25.621456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'29","reported_seq":147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:36.380873+0000","last_change":"2024-09-12T18:14:36.380810+0000","last_active":"2024-09-12T18:14:36.380873+0000","last_peered":"2024-09-12T18:14:36.380873+0000","last_clean":"2024-09-12T18:14:36.380873+0000","last_became_active":"2024-09-12T17:16:11.487998+0000","last_became_peered":"2024-09-12T17:16:11.487998+0000","last_unstale":"2024-09-12T18:14:36.380873+0000","last_undegraded":"2024-09-12T18:14:36.380873+0000","last_fullsized":"2024-09-12T18:14:36.380873+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-12T18:14:36.380714+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-12T18:14:36.380714+0000","last_clean_scrub_stamp":"2024-09-12T18:14:36.380714+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:45.043463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:34.241251+0000","last_change":"2024-09-12T18:14:34.241251+0000","last_active":"2024-09-12T18:14:34.241251+0000","last_peered":"2024-09-12T18:14:34.241251+0000","last_clean":"2024-09-12T18:14:34.241251+0000","last_became_active":"2024-09-12T17:39:05.921008+0000","last_became_peered":"2024-09-12T17:39:05.921008+0000","last_unstale":"2024-09-12T18:14:34.241251+0000","last_undegraded":"2024-09-12T18:14:34.241251+0000","last_fullsized":"2024-09-12T18:14:34.241251+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:34.241154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:34.241154+0000","last_clean_scrub_stamp":"2024-09-12T18:14:34.241154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:44.562900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'2","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:32.305309+0000","last_change":"2024-09-12T18:14:32.305227+0000","last_active":"2024-09-12T18:14:32.305309+0000","last_peered":"2024-09-12T18:14:32.305309+0000","last_clean":"2024-09-12T18:14:32.305309+0000","last_became_active":"2024-09-12T17:20:34.615689+0000","last_became_peered":"2024-09-12T17:20:34.615689+0000","last_unstale":"2024-09-12T18:14:32.305309+0000","last_undegraded":"2024-09-12T18:14:32.305309+0000","last_fullsized":"2024-09-12T18:14:32.305309+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:32.305124+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:32.305124+0000","last_clean_scrub_stamp":"2024-09-12T18:14:32.305124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:47.888594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'4","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:46.254076+0000","last_change":"2024-09-12T18:14:46.254076+0000","last_active":"2024-09-12T18:14:46.254076+0000","last_peered":"2024-09-12T18:14:46.254076+0000","last_clean":"2024-09-12T18:14:46.254076+0000","last_became_active":"2024-09-12T17:20:30.536917+0000","last_became_peered":"2024-09-12T17:20:30.536917+0000","last_unstale":"2024-09-12T18:14:46.254076+0000","last_undegraded":"2024-09-12T18:14:46.254076+0000","last_fullsized":"2024-09-12T18:14:46.254076+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:14:46.253987+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:14:46.253987+0000","last_clean_scrub_stamp":"2024-09-12T18:14:46.253987+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:46.239759+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'41","reported_seq":177,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:24.202227+0000","last_change":"2024-09-12T18:14:24.202169+0000","last_active":"2024-09-12T18:14:24.202227+0000","last_peered":"2024-09-12T18:14:24.202227+0000","last_clean":"2024-09-12T18:14:24.202227+0000","last_became_active":"2024-09-12T17:16:11.488252+0000","last_became_peered":"2024-09-12T17:16:11.488252+0000","last_unstale":"2024-09-12T18:14:24.202227+0000","last_undegraded":"2024-09-12T18:14:24.202227+0000","last_fullsized":"2024-09-12T18:14:24.202227+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-09-12T18:14:24.202082+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-09-12T18:14:24.202082+0000","last_clean_scrub_stamp":"2024-09-12T18:14:24.202082+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:26.021742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":141,"num_write":74,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:48.413887+0000","last_change":"2024-09-12T18:14:48.413887+0000","last_active":"2024-09-12T18:14:48.413887+0000","last_peered":"2024-09-12T18:14:48.413887+0000","last_clean":"2024-09-12T18:14:48.413887+0000","last_became_active":"2024-09-12T17:39:05.925589+0000","last_became_peered":"2024-09-12T17:39:05.925589+0000","last_unstale":"2024-09-12T18:14:48.413887+0000","last_undegraded":"2024-09-12T18:14:48.413887+0000","last_fullsized":"2024-09-12T18:14:48.413887+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:48.413803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:48.413803+0000","last_clean_scrub_stamp":"2024-09-12T18:14:48.413803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:09.395540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'11","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:46.871913+0000","last_change":"2024-09-12T18:14:46.871913+0000","last_active":"2024-09-12T18:14:46.871913+0000","last_peered":"2024-09-12T18:14:46.871913+0000","last_clean":"2024-09-12T18:14:46.871913+0000","last_became_active":"2024-09-12T17:20:34.560319+0000","last_became_peered":"2024-09-12T17:20:34.560319+0000","last_unstale":"2024-09-12T18:14:46.871913+0000","last_undegraded":"2024-09-12T18:14:46.871913+0000","last_fullsized":"2024-09-12T18:14:46.871913+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-09-12T18:14:46.871809+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-09-12T18:14:46.871809+0000","last_clean_scrub_stamp":"2024-09-12T18:14:46.871809+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:09.420084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15462,"num_write":16,"num_write_kb":7218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'2","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:27.217351+0000","last_change":"2024-09-12T18:14:27.217277+0000","last_active":"2024-09-12T18:14:27.217351+0000","last_peered":"2024-09-12T18:14:27.217351+0000","last_clean":"2024-09-12T18:14:27.217351+0000","last_became_active":"2024-09-12T17:20:30.531384+0000","last_became_peered":"2024-09-12T17:20:30.531384+0000","last_unstale":"2024-09-12T18:14:27.217351+0000","last_undegraded":"2024-09-12T18:14:27.217351+0000","last_fullsized":"2024-09-12T18:14:27.217351+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:27.217186+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:27.217186+0000","last_clean_scrub_stamp":"2024-09-12T18:14:27.217186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:29.758742+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'7","reported_seq":85,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:14.091723+0000","last_change":"2024-09-12T18:14:14.091620+0000","last_active":"2024-09-12T18:14:14.091723+0000","last_peered":"2024-09-12T18:14:14.091723+0000","last_clean":"2024-09-12T18:14:14.091723+0000","last_became_active":"2024-09-12T17:16:11.486098+0000","last_became_peered":"2024-09-12T17:16:11.486098+0000","last_unstale":"2024-09-12T18:14:14.091723+0000","last_undegraded":"2024-09-12T18:14:14.091723+0000","last_fullsized":"2024-09-12T18:14:14.091723+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-12T18:14:14.091515+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-12T18:14:14.091515+0000","last_clean_scrub_stamp":"2024-09-12T18:14:14.091515+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:08.093165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:55.803527+0000","last_change":"2024-09-12T18:14:55.803446+0000","last_active":"2024-09-12T18:14:55.803527+0000","last_peered":"2024-09-12T18:14:55.803527+0000","last_clean":"2024-09-12T18:14:55.803527+0000","last_became_active":"2024-09-12T17:39:05.925637+0000","last_became_peered":"2024-09-12T17:39:05.925637+0000","last_unstale":"2024-09-12T18:14:55.803527+0000","last_undegraded":"2024-09-12T18:14:55.803527+0000","last_fullsized":"2024-09-12T18:14:55.803527+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:55.803351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:55.803351+0000","last_clean_scrub_stamp":"2024-09-12T18:14:55.803351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:11.955698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:39.851322+0000","last_change":"2024-09-12T18:14:39.851260+0000","last_active":"2024-09-12T18:14:39.851322+0000","last_peered":"2024-09-12T18:14:39.851322+0000","last_clean":"2024-09-12T18:14:39.851322+0000","last_became_active":"2024-09-12T17:20:47.581310+0000","last_became_peered":"2024-09-12T17:20:47.581310+0000","last_unstale":"2024-09-12T18:14:39.851322+0000","last_undegraded":"2024-09-12T18:14:39.851322+0000","last_fullsized":"2024-09-12T18:14:39.851322+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:14:39.851164+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:14:39.851164+0000","last_clean_scrub_stamp":"2024-09-12T18:14:39.851164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:09.889327+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:42.287196+0000","last_change":"2024-09-12T18:14:42.287196+0000","last_active":"2024-09-12T18:14:42.287196+0000","last_peered":"2024-09-12T18:14:42.287196+0000","last_clean":"2024-09-12T18:14:42.287196+0000","last_became_active":"2024-09-12T17:20:30.535668+0000","last_became_peered":"2024-09-12T17:20:30.535668+0000","last_unstale":"2024-09-12T18:14:42.287196+0000","last_undegraded":"2024-09-12T18:14:42.287196+0000","last_fullsized":"2024-09-12T18:14:42.287196+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:42.287102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:42.287102+0000","last_clean_scrub_stamp":"2024-09-12T18:14:42.287102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:02.558237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'13","reported_seq":101,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:36.270432+0000","last_change":"2024-09-12T18:14:36.270373+0000","last_active":"2024-09-12T18:14:36.270432+0000","last_peered":"2024-09-12T18:14:36.270432+0000","last_clean":"2024-09-12T18:14:36.270432+0000","last_became_active":"2024-09-12T17:16:11.484154+0000","last_became_peered":"2024-09-12T17:16:11.484154+0000","last_unstale":"2024-09-12T18:14:36.270432+0000","last_undegraded":"2024-09-12T18:14:36.270432+0000","last_fullsized":"2024-09-12T18:14:36.270432+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-09-12T18:14:36.270284+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-09-12T18:14:36.270284+0000","last_clean_scrub_stamp":"2024-09-12T18:14:36.270284+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:17.752999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":37,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:51.367267+0000","last_change":"2024-09-12T18:14:51.367200+0000","last_active":"2024-09-12T18:14:51.367267+0000","last_peered":"2024-09-12T18:14:51.367267+0000","last_clean":"2024-09-12T18:14:51.367267+0000","last_became_active":"2024-09-12T17:39:05.927841+0000","last_became_peered":"2024-09-12T17:39:05.927841+0000","last_unstale":"2024-09-12T18:14:51.367267+0000","last_undegraded":"2024-09-12T18:14:51.367267+0000","last_fullsized":"2024-09-12T18:14:51.367267+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:51.367107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:51.367107+0000","last_clean_scrub_stamp":"2024-09-12T18:14:51.367107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:44.506543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:45.434694+0000","last_change":"2024-09-12T18:14:45.434614+0000","last_active":"2024-09-12T18:14:45.434694+0000","last_peered":"2024-09-12T18:14:45.434694+0000","last_clean":"2024-09-12T18:14:45.434694+0000","last_became_active":"2024-09-12T17:20:34.610737+0000","last_became_peered":"2024-09-12T17:20:34.610737+0000","last_unstale":"2024-09-12T18:14:45.434694+0000","last_undegraded":"2024-09-12T18:14:45.434694+0000","last_fullsized":"2024-09-12T18:14:45.434694+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:45.434497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:45.434497+0000","last_clean_scrub_stamp":"2024-09-12T18:14:45.434497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:02.452977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:29.239711+0000","last_change":"2024-09-12T18:14:29.239633+0000","last_active":"2024-09-12T18:14:29.239711+0000","last_peered":"2024-09-12T18:14:29.239711+0000","last_clean":"2024-09-12T18:14:29.239711+0000","last_became_active":"2024-09-12T17:20:30.528902+0000","last_became_peered":"2024-09-12T17:20:30.528902+0000","last_unstale":"2024-09-12T18:14:29.239711+0000","last_undegraded":"2024-09-12T18:14:29.239711+0000","last_fullsized":"2024-09-12T18:14:29.239711+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:29.239538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:29.239538+0000","last_clean_scrub_stamp":"2024-09-12T18:14:29.239538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:02.578918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'31","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:34.425839+0000","last_change":"2024-09-12T18:14:34.425711+0000","last_active":"2024-09-12T18:14:34.425839+0000","last_peered":"2024-09-12T18:14:34.425839+0000","last_clean":"2024-09-12T18:14:34.425839+0000","last_became_active":"2024-09-12T17:16:11.488722+0000","last_became_peered":"2024-09-12T17:16:11.488722+0000","last_unstale":"2024-09-12T18:14:34.425839+0000","last_undegraded":"2024-09-12T18:14:34.425839+0000","last_fullsized":"2024-09-12T18:14:34.425839+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-09-12T18:14:34.425586+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-09-12T18:14:34.425586+0000","last_clean_scrub_stamp":"2024-09-12T18:14:34.425586+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:50.212908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":116,"num_write":54,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:50.369097+0000","last_change":"2024-09-12T18:14:50.369027+0000","last_active":"2024-09-12T18:14:50.369097+0000","last_peered":"2024-09-12T18:14:50.369097+0000","last_clean":"2024-09-12T18:14:50.369097+0000","last_became_active":"2024-09-12T17:39:05.929156+0000","last_became_peered":"2024-09-12T17:39:05.929156+0000","last_unstale":"2024-09-12T18:14:50.369097+0000","last_undegraded":"2024-09-12T18:14:50.369097+0000","last_fullsized":"2024-09-12T18:14:50.369097+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:50.368946+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:50.368946+0000","last_clean_scrub_stamp":"2024-09-12T18:14:50.368946+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:51.105409+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:31.278454+0000","last_change":"2024-09-12T18:14:31.278387+0000","last_active":"2024-09-12T18:14:31.278454+0000","last_peered":"2024-09-12T18:14:31.278454+0000","last_clean":"2024-09-12T18:14:31.278454+0000","last_became_active":"2024-09-12T17:20:34.558826+0000","last_became_peered":"2024-09-12T17:20:34.558826+0000","last_unstale":"2024-09-12T18:14:31.278454+0000","last_undegraded":"2024-09-12T18:14:31.278454+0000","last_fullsized":"2024-09-12T18:14:31.278454+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:31.278298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:31.278298+0000","last_clean_scrub_stamp":"2024-09-12T18:14:31.278298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:47.464949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:43.323471+0000","last_change":"2024-09-12T18:14:43.323393+0000","last_active":"2024-09-12T18:14:43.323471+0000","last_peered":"2024-09-12T18:14:43.323471+0000","last_clean":"2024-09-12T18:14:43.323471+0000","last_became_active":"2024-09-12T17:20:30.537204+0000","last_became_peered":"2024-09-12T17:20:30.537204+0000","last_unstale":"2024-09-12T18:14:43.323471+0000","last_undegraded":"2024-09-12T18:14:43.323471+0000","last_fullsized":"2024-09-12T18:14:43.323471+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:43.323302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:43.323302+0000","last_clean_scrub_stamp":"2024-09-12T18:14:43.323302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:26.631887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'43","reported_seq":185,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:37.891111+0000","last_change":"2024-09-12T18:14:37.891004+0000","last_active":"2024-09-12T18:14:37.891111+0000","last_peered":"2024-09-12T18:14:37.891111+0000","last_clean":"2024-09-12T18:14:37.891111+0000","last_became_active":"2024-09-12T17:16:11.487129+0000","last_became_peered":"2024-09-12T17:16:11.487129+0000","last_unstale":"2024-09-12T18:14:37.891111+0000","last_undegraded":"2024-09-12T18:14:37.891111+0000","last_fullsized":"2024-09-12T18:14:37.891111+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'43","last_scrub_stamp":"2024-09-12T18:14:37.890908+0000","last_deep_scrub":"264'43","last_deep_scrub_stamp":"2024-09-12T18:14:37.890908+0000","last_clean_scrub_stamp":"2024-09-12T18:14:37.890908+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:40.642284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":153,"num_write":79,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:53.327996+0000","last_change":"2024-09-12T18:14:53.327891+0000","last_active":"2024-09-12T18:14:53.327996+0000","last_peered":"2024-09-12T18:14:53.327996+0000","last_clean":"2024-09-12T18:14:53.327996+0000","last_became_active":"2024-09-12T17:39:05.925950+0000","last_became_peered":"2024-09-12T17:39:05.925950+0000","last_unstale":"2024-09-12T18:14:53.327996+0000","last_undegraded":"2024-09-12T18:14:53.327996+0000","last_fullsized":"2024-09-12T18:14:53.327996+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:53.327775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:53.327775+0000","last_clean_scrub_stamp":"2024-09-12T18:14:53.327775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:58.117697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'3","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:44.440305+0000","last_change":"2024-09-12T18:14:44.440225+0000","last_active":"2024-09-12T18:14:44.440305+0000","last_peered":"2024-09-12T18:14:44.440305+0000","last_clean":"2024-09-12T18:14:44.440305+0000","last_became_active":"2024-09-12T17:20:34.555493+0000","last_became_peered":"2024-09-12T17:20:34.555493+0000","last_unstale":"2024-09-12T18:14:44.440305+0000","last_undegraded":"2024-09-12T18:14:44.440305+0000","last_fullsized":"2024-09-12T18:14:44.440305+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:14:44.440141+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:14:44.440141+0000","last_clean_scrub_stamp":"2024-09-12T18:14:44.440141+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:12.342437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'4","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:34.850257+0000","last_change":"2024-09-12T18:14:34.850257+0000","last_active":"2024-09-12T18:14:34.850257+0000","last_peered":"2024-09-12T18:14:34.850257+0000","last_clean":"2024-09-12T18:14:34.850257+0000","last_became_active":"2024-09-12T17:20:30.534448+0000","last_became_peered":"2024-09-12T17:20:30.534448+0000","last_unstale":"2024-09-12T18:14:34.850257+0000","last_undegraded":"2024-09-12T18:14:34.850257+0000","last_fullsized":"2024-09-12T18:14:34.850257+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:14:34.850163+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:14:34.850163+0000","last_clean_scrub_stamp":"2024-09-12T18:14:34.850163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:53.203155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":4,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'9","reported_seq":96,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:26.284636+0000","last_change":"2024-09-12T18:14:26.284565+0000","last_active":"2024-09-12T18:14:26.284636+0000","last_peered":"2024-09-12T18:14:26.284636+0000","last_clean":"2024-09-12T18:14:26.284636+0000","last_became_active":"2024-09-12T17:16:11.488433+0000","last_became_peered":"2024-09-12T17:16:11.488433+0000","last_unstale":"2024-09-12T18:14:26.284636+0000","last_undegraded":"2024-09-12T18:14:26.284636+0000","last_fullsized":"2024-09-12T18:14:26.284636+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-12T18:14:26.284480+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-12T18:14:26.284480+0000","last_clean_scrub_stamp":"2024-09-12T18:14:26.284480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:22.408672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":34,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:46.388775+0000","last_change":"2024-09-12T18:14:46.388775+0000","last_active":"2024-09-12T18:14:46.388775+0000","last_peered":"2024-09-12T18:14:46.388775+0000","last_clean":"2024-09-12T18:14:46.388775+0000","last_became_active":"2024-09-12T17:39:05.925525+0000","last_became_peered":"2024-09-12T17:39:05.925525+0000","last_unstale":"2024-09-12T18:14:46.388775+0000","last_undegraded":"2024-09-12T18:14:46.388775+0000","last_fullsized":"2024-09-12T18:14:46.388775+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:46.388678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:46.388678+0000","last_clean_scrub_stamp":"2024-09-12T18:14:46.388678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:01.994329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'3","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:49.214767+0000","last_change":"2024-09-12T18:14:49.214653+0000","last_active":"2024-09-12T18:14:49.214767+0000","last_peered":"2024-09-12T18:14:49.214767+0000","last_clean":"2024-09-12T18:14:49.214767+0000","last_became_active":"2024-09-12T17:20:34.558946+0000","last_became_peered":"2024-09-12T17:20:34.558946+0000","last_unstale":"2024-09-12T18:14:49.214767+0000","last_undegraded":"2024-09-12T18:14:49.214767+0000","last_fullsized":"2024-09-12T18:14:49.214767+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:14:49.214545+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:14:49.214545+0000","last_clean_scrub_stamp":"2024-09-12T18:14:49.214545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:23.070738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'4","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:40.412399+0000","last_change":"2024-09-12T18:14:40.412289+0000","last_active":"2024-09-12T18:14:40.412399+0000","last_peered":"2024-09-12T18:14:40.412399+0000","last_clean":"2024-09-12T18:14:40.412399+0000","last_became_active":"2024-09-12T17:20:30.528078+0000","last_became_peered":"2024-09-12T17:20:30.528078+0000","last_unstale":"2024-09-12T18:14:40.412399+0000","last_undegraded":"2024-09-12T18:14:40.412399+0000","last_fullsized":"2024-09-12T18:14:40.412399+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-12T18:14:40.412190+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-12T18:14:40.412190+0000","last_clean_scrub_stamp":"2024-09-12T18:14:40.412190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:02.399699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'44","reported_seq":191,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:34.229927+0000","last_change":"2024-09-12T18:14:34.229864+0000","last_active":"2024-09-12T18:14:34.229927+0000","last_peered":"2024-09-12T18:14:34.229927+0000","last_clean":"2024-09-12T18:14:34.229927+0000","last_became_active":"2024-09-12T17:16:11.481431+0000","last_became_peered":"2024-09-12T17:16:11.481431+0000","last_unstale":"2024-09-12T18:14:34.229927+0000","last_undegraded":"2024-09-12T18:14:34.229927+0000","last_fullsized":"2024-09-12T18:14:34.229927+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'44","last_scrub_stamp":"2024-09-12T18:14:34.229758+0000","last_deep_scrub":"264'44","last_deep_scrub_stamp":"2024-09-12T18:14:34.229758+0000","last_clean_scrub_stamp":"2024-09-12T18:14:34.229758+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:49.892480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":166,"num_write":69,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:44.454092+0000","last_change":"2024-09-12T18:14:44.454092+0000","last_active":"2024-09-12T18:14:44.454092+0000","last_peered":"2024-09-12T18:14:44.454092+0000","last_clean":"2024-09-12T18:14:44.454092+0000","last_became_active":"2024-09-12T17:39:05.919207+0000","last_became_peered":"2024-09-12T17:39:05.919207+0000","last_unstale":"2024-09-12T18:14:44.454092+0000","last_undegraded":"2024-09-12T18:14:44.454092+0000","last_fullsized":"2024-09-12T18:14:44.454092+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:44.453999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:44.453999+0000","last_clean_scrub_stamp":"2024-09-12T18:14:44.453999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:48.797179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'10","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:48.229715+0000","last_change":"2024-09-12T18:14:48.229715+0000","last_active":"2024-09-12T18:14:48.229715+0000","last_peered":"2024-09-12T18:14:48.229715+0000","last_clean":"2024-09-12T18:14:48.229715+0000","last_became_active":"2024-09-12T17:20:34.612840+0000","last_became_peered":"2024-09-12T17:20:34.612840+0000","last_unstale":"2024-09-12T18:14:48.229715+0000","last_undegraded":"2024-09-12T18:14:48.229715+0000","last_fullsized":"2024-09-12T18:14:48.229715+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'10","last_scrub_stamp":"2024-09-12T18:14:48.229631+0000","last_deep_scrub":"264'10","last_deep_scrub_stamp":"2024-09-12T18:14:48.229631+0000","last_clean_scrub_stamp":"2024-09-12T18:14:48.229631+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:08.632463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":10,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:18.083168+0000","last_change":"2024-09-12T18:14:18.083073+0000","last_active":"2024-09-12T18:14:18.083168+0000","last_peered":"2024-09-12T18:14:18.083168+0000","last_clean":"2024-09-12T18:14:18.083168+0000","last_became_active":"2024-09-12T17:20:30.538913+0000","last_became_peered":"2024-09-12T17:20:30.538913+0000","last_unstale":"2024-09-12T18:14:18.083168+0000","last_undegraded":"2024-09-12T18:14:18.083168+0000","last_fullsized":"2024-09-12T18:14:18.083168+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:14:18.082969+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:14:18.082969+0000","last_clean_scrub_stamp":"2024-09-12T18:14:18.082969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:58.687456+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'104","reported_seq":395,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:23.231659+0000","last_change":"2024-09-12T18:14:23.231584+0000","last_active":"2024-09-12T18:14:23.231659+0000","last_peered":"2024-09-12T18:14:23.231659+0000","last_clean":"2024-09-12T18:14:23.231659+0000","last_became_active":"2024-09-12T17:16:11.489087+0000","last_became_peered":"2024-09-12T17:16:11.489087+0000","last_unstale":"2024-09-12T18:14:23.231659+0000","last_undegraded":"2024-09-12T18:14:23.231659+0000","last_fullsized":"2024-09-12T18:14:23.231659+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'104","last_scrub_stamp":"2024-09-12T18:14:23.231495+0000","last_deep_scrub":"264'104","last_deep_scrub_stamp":"2024-09-12T18:14:23.231495+0000","last_clean_scrub_stamp":"2024-09-12T18:14:23.231495+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:36.283901+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":629,"num_read_kb":433,"num_write":144,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4660,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:36.333955+0000","last_change":"2024-09-12T18:14:36.333854+0000","last_active":"2024-09-12T18:14:36.333955+0000","last_peered":"2024-09-12T18:14:36.333955+0000","last_clean":"2024-09-12T18:14:36.333955+0000","last_became_active":"2024-09-12T17:39:05.921608+0000","last_became_peered":"2024-09-12T17:39:05.921608+0000","last_unstale":"2024-09-12T18:14:36.333955+0000","last_undegraded":"2024-09-12T18:14:36.333955+0000","last_fullsized":"2024-09-12T18:14:36.333955+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:36.333723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:36.333723+0000","last_clean_scrub_stamp":"2024-09-12T18:14:36.333723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:01.154535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:43.436473+0000","last_change":"2024-09-12T18:14:43.436400+0000","last_active":"2024-09-12T18:14:43.436473+0000","last_peered":"2024-09-12T18:14:43.436473+0000","last_clean":"2024-09-12T18:14:43.436473+0000","last_became_active":"2024-09-12T17:20:34.610719+0000","last_became_peered":"2024-09-12T17:20:34.610719+0000","last_unstale":"2024-09-12T18:14:43.436473+0000","last_undegraded":"2024-09-12T18:14:43.436473+0000","last_fullsized":"2024-09-12T18:14:43.436473+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:43.436302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:43.436302+0000","last_clean_scrub_stamp":"2024-09-12T18:14:43.436302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:16.519635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:37.367785+0000","last_change":"2024-09-12T18:14:37.367714+0000","last_active":"2024-09-12T18:14:37.367785+0000","last_peered":"2024-09-12T18:14:37.367785+0000","last_clean":"2024-09-12T18:14:37.367785+0000","last_became_active":"2024-09-12T17:20:30.535382+0000","last_became_peered":"2024-09-12T17:20:30.535382+0000","last_unstale":"2024-09-12T18:14:37.367785+0000","last_undegraded":"2024-09-12T18:14:37.367785+0000","last_fullsized":"2024-09-12T18:14:37.367785+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:37.367623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:37.367623+0000","last_clean_scrub_stamp":"2024-09-12T18:14:37.367623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:26.522841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'27","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:32.432734+0000","last_change":"2024-09-12T18:14:32.432673+0000","last_active":"2024-09-12T18:14:32.432734+0000","last_peered":"2024-09-12T18:14:32.432734+0000","last_clean":"2024-09-12T18:14:32.432734+0000","last_became_active":"2024-09-12T17:16:11.486799+0000","last_became_peered":"2024-09-12T17:16:11.486799+0000","last_unstale":"2024-09-12T18:14:32.432734+0000","last_undegraded":"2024-09-12T18:14:32.432734+0000","last_fullsized":"2024-09-12T18:14:32.432734+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'27","last_scrub_stamp":"2024-09-12T18:14:32.432578+0000","last_deep_scrub":"264'27","last_deep_scrub_stamp":"2024-09-12T18:14:32.432578+0000","last_clean_scrub_stamp":"2024-09-12T18:14:32.432578+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:59.284922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":89,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:45.863517+0000","last_change":"2024-09-12T18:14:45.863517+0000","last_active":"2024-09-12T18:14:45.863517+0000","last_peered":"2024-09-12T18:14:45.863517+0000","last_clean":"2024-09-12T18:14:45.863517+0000","last_became_active":"2024-09-12T17:39:05.923192+0000","last_became_peered":"2024-09-12T17:39:05.923192+0000","last_unstale":"2024-09-12T18:14:45.863517+0000","last_undegraded":"2024-09-12T18:14:45.863517+0000","last_fullsized":"2024-09-12T18:14:45.863517+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:45.863435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:45.863435+0000","last_clean_scrub_stamp":"2024-09-12T18:14:45.863435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:04.742866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'4","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:40.816615+0000","last_change":"2024-09-12T18:14:40.816539+0000","last_active":"2024-09-12T18:14:40.816615+0000","last_peered":"2024-09-12T18:14:40.816615+0000","last_clean":"2024-09-12T18:14:40.816615+0000","last_became_active":"2024-09-12T17:20:34.555267+0000","last_became_peered":"2024-09-12T17:20:34.555267+0000","last_unstale":"2024-09-12T18:14:40.816615+0000","last_undegraded":"2024-09-12T18:14:40.816615+0000","last_fullsized":"2024-09-12T18:14:40.816615+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:14:40.816449+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:14:40.816449+0000","last_clean_scrub_stamp":"2024-09-12T18:14:40.816449+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:54.013182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'4","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:39.425729+0000","last_change":"2024-09-12T18:14:39.425671+0000","last_active":"2024-09-12T18:14:39.425729+0000","last_peered":"2024-09-12T18:14:39.425729+0000","last_clean":"2024-09-12T18:14:39.425729+0000","last_became_active":"2024-09-12T17:20:30.530998+0000","last_became_peered":"2024-09-12T17:20:30.530998+0000","last_unstale":"2024-09-12T18:14:39.425729+0000","last_undegraded":"2024-09-12T18:14:39.425729+0000","last_fullsized":"2024-09-12T18:14:39.425729+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:14:39.425587+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:14:39.425587+0000","last_clean_scrub_stamp":"2024-09-12T18:14:39.425587+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:28.412390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'20","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:24.246054+0000","last_change":"2024-09-12T18:14:24.245978+0000","last_active":"2024-09-12T18:14:24.246054+0000","last_peered":"2024-09-12T18:14:24.246054+0000","last_clean":"2024-09-12T18:14:24.246054+0000","last_became_active":"2024-09-12T17:16:11.487439+0000","last_became_peered":"2024-09-12T17:16:11.487439+0000","last_unstale":"2024-09-12T18:14:24.246054+0000","last_undegraded":"2024-09-12T18:14:24.246054+0000","last_fullsized":"2024-09-12T18:14:24.246054+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'20","last_scrub_stamp":"2024-09-12T18:14:24.245894+0000","last_deep_scrub":"264'20","last_deep_scrub_stamp":"2024-09-12T18:14:24.245894+0000","last_clean_scrub_stamp":"2024-09-12T18:14:24.245894+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:04.547184+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":36,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:23.090856+0000","last_change":"2024-09-12T18:14:23.090856+0000","last_active":"2024-09-12T18:14:23.090856+0000","last_peered":"2024-09-12T18:14:23.090856+0000","last_clean":"2024-09-12T18:14:23.090856+0000","last_became_active":"2024-09-12T17:39:05.923420+0000","last_became_peered":"2024-09-12T17:39:05.923420+0000","last_unstale":"2024-09-12T18:14:23.090856+0000","last_undegraded":"2024-09-12T18:14:23.090856+0000","last_fullsized":"2024-09-12T18:14:23.090856+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:23.090758+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:23.090758+0000","last_clean_scrub_stamp":"2024-09-12T18:14:23.090758+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:00.038610+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'5","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:30.280509+0000","last_change":"2024-09-12T18:14:30.280444+0000","last_active":"2024-09-12T18:14:30.280509+0000","last_peered":"2024-09-12T18:14:30.280509+0000","last_clean":"2024-09-12T18:14:30.280509+0000","last_became_active":"2024-09-12T17:20:34.557794+0000","last_became_peered":"2024-09-12T17:20:34.557794+0000","last_unstale":"2024-09-12T18:14:30.280509+0000","last_undegraded":"2024-09-12T18:14:30.280509+0000","last_fullsized":"2024-09-12T18:14:30.280509+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T18:14:30.280351+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T18:14:30.280351+0000","last_clean_scrub_stamp":"2024-09-12T18:14:30.280351+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:41.102626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'8","reported_seq":79,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:36.402228+0000","last_change":"2024-09-12T18:14:36.402174+0000","last_active":"2024-09-12T18:14:36.402228+0000","last_peered":"2024-09-12T18:14:36.402228+0000","last_clean":"2024-09-12T18:14:36.402228+0000","last_became_active":"2024-09-12T17:20:30.537970+0000","last_became_peered":"2024-09-12T17:20:30.537970+0000","last_unstale":"2024-09-12T18:14:36.402228+0000","last_undegraded":"2024-09-12T18:14:36.402228+0000","last_fullsized":"2024-09-12T18:14:36.402228+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T18:14:36.402087+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T18:14:36.402087+0000","last_clean_scrub_stamp":"2024-09-12T18:14:36.402087+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:23.401779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":19458,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'24","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:35.418107+0000","last_change":"2024-09-12T18:14:35.418107+0000","last_active":"2024-09-12T18:14:35.418107+0000","last_peered":"2024-09-12T18:14:35.418107+0000","last_clean":"2024-09-12T18:14:35.418107+0000","last_became_active":"2024-09-12T17:16:11.486298+0000","last_became_peered":"2024-09-12T17:16:11.486298+0000","last_unstale":"2024-09-12T18:14:35.418107+0000","last_undegraded":"2024-09-12T18:14:35.418107+0000","last_fullsized":"2024-09-12T18:14:35.418107+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-09-12T18:14:35.418021+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-09-12T18:14:35.418021+0000","last_clean_scrub_stamp":"2024-09-12T18:14:35.418021+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:02.258321+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:52.297659+0000","last_change":"2024-09-12T18:14:52.297659+0000","last_active":"2024-09-12T18:14:52.297659+0000","last_peered":"2024-09-12T18:14:52.297659+0000","last_clean":"2024-09-12T18:14:52.297659+0000","last_became_active":"2024-09-12T17:39:05.921085+0000","last_became_peered":"2024-09-12T17:39:05.921085+0000","last_unstale":"2024-09-12T18:14:52.297659+0000","last_undegraded":"2024-09-12T18:14:52.297659+0000","last_fullsized":"2024-09-12T18:14:52.297659+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:52.297565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:52.297565+0000","last_clean_scrub_stamp":"2024-09-12T18:14:52.297565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:34.374496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'6","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:41.369438+0000","last_change":"2024-09-12T18:14:41.369339+0000","last_active":"2024-09-12T18:14:41.369438+0000","last_peered":"2024-09-12T18:14:41.369438+0000","last_clean":"2024-09-12T18:14:41.369438+0000","last_became_active":"2024-09-12T17:20:34.558963+0000","last_became_peered":"2024-09-12T17:20:34.558963+0000","last_unstale":"2024-09-12T18:14:41.369438+0000","last_undegraded":"2024-09-12T18:14:41.369438+0000","last_fullsized":"2024-09-12T18:14:41.369438+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T18:14:41.369249+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T18:14:41.369249+0000","last_clean_scrub_stamp":"2024-09-12T18:14:41.369249+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:01.621732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:38.410566+0000","last_change":"2024-09-12T18:14:38.410500+0000","last_active":"2024-09-12T18:14:38.410566+0000","last_peered":"2024-09-12T18:14:38.410566+0000","last_clean":"2024-09-12T18:14:38.410566+0000","last_became_active":"2024-09-12T17:20:30.524377+0000","last_became_peered":"2024-09-12T17:20:30.524377+0000","last_unstale":"2024-09-12T18:14:38.410566+0000","last_undegraded":"2024-09-12T18:14:38.410566+0000","last_fullsized":"2024-09-12T18:14:38.410566+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:38.410409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:38.410409+0000","last_clean_scrub_stamp":"2024-09-12T18:14:38.410409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:47.654204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'59","reported_seq":234,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:33.881013+0000","last_change":"2024-09-12T18:14:33.881013+0000","last_active":"2024-09-12T18:14:33.881013+0000","last_peered":"2024-09-12T18:14:33.881013+0000","last_clean":"2024-09-12T18:14:33.881013+0000","last_became_active":"2024-09-12T17:16:11.491512+0000","last_became_peered":"2024-09-12T17:16:11.491512+0000","last_unstale":"2024-09-12T18:14:33.881013+0000","last_undegraded":"2024-09-12T18:14:33.881013+0000","last_fullsized":"2024-09-12T18:14:33.881013+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'59","last_scrub_stamp":"2024-09-12T18:14:33.880931+0000","last_deep_scrub":"264'59","last_deep_scrub_stamp":"2024-09-12T18:14:33.880931+0000","last_clean_scrub_stamp":"2024-09-12T18:14:33.880931+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:13.951597+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":313,"num_read_kb":225,"num_write":101,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:51.277220+0000","last_change":"2024-09-12T18:14:51.277220+0000","last_active":"2024-09-12T18:14:51.277220+0000","last_peered":"2024-09-12T18:14:51.277220+0000","last_clean":"2024-09-12T18:14:51.277220+0000","last_became_active":"2024-09-12T17:39:05.926029+0000","last_became_peered":"2024-09-12T17:39:05.926029+0000","last_unstale":"2024-09-12T18:14:51.277220+0000","last_undegraded":"2024-09-12T18:14:51.277220+0000","last_fullsized":"2024-09-12T18:14:51.277220+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:51.277124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:51.277124+0000","last_clean_scrub_stamp":"2024-09-12T18:14:51.277124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:13.190113+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"261'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:30.313285+0000","last_change":"2024-09-12T18:14:30.313225+0000","last_active":"2024-09-12T18:14:30.313285+0000","last_peered":"2024-09-12T18:14:30.313285+0000","last_clean":"2024-09-12T18:14:30.313285+0000","last_became_active":"2024-09-12T17:20:34.555137+0000","last_became_peered":"2024-09-12T17:20:34.555137+0000","last_unstale":"2024-09-12T18:14:30.313285+0000","last_undegraded":"2024-09-12T18:14:30.313285+0000","last_fullsized":"2024-09-12T18:14:30.313285+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:14:30.313134+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:14:30.313134+0000","last_clean_scrub_stamp":"2024-09-12T18:14:30.313134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:54.305578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'2","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:26.209969+0000","last_change":"2024-09-12T18:14:26.209890+0000","last_active":"2024-09-12T18:14:26.209969+0000","last_peered":"2024-09-12T18:14:26.209969+0000","last_clean":"2024-09-12T18:14:26.209969+0000","last_became_active":"2024-09-12T17:20:30.531232+0000","last_became_peered":"2024-09-12T17:20:30.531232+0000","last_unstale":"2024-09-12T18:14:26.209969+0000","last_undegraded":"2024-09-12T18:14:26.209969+0000","last_fullsized":"2024-09-12T18:14:26.209969+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:26.209790+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:26.209790+0000","last_clean_scrub_stamp":"2024-09-12T18:14:26.209790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:26.231944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'13","reported_seq":107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:27.238728+0000","last_change":"2024-09-12T18:14:27.238658+0000","last_active":"2024-09-12T18:14:27.238728+0000","last_peered":"2024-09-12T18:14:27.238728+0000","last_clean":"2024-09-12T18:14:27.238728+0000","last_became_active":"2024-09-12T17:16:11.491334+0000","last_became_peered":"2024-09-12T17:16:11.491334+0000","last_unstale":"2024-09-12T18:14:27.238728+0000","last_undegraded":"2024-09-12T18:14:27.238728+0000","last_fullsized":"2024-09-12T18:14:27.238728+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-09-12T18:14:27.238574+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-09-12T18:14:27.238574+0000","last_clean_scrub_stamp":"2024-09-12T18:14:27.238574+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:25.141678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":49,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:47.409991+0000","last_change":"2024-09-12T18:14:47.409991+0000","last_active":"2024-09-12T18:14:47.409991+0000","last_peered":"2024-09-12T18:14:47.409991+0000","last_clean":"2024-09-12T18:14:47.409991+0000","last_became_active":"2024-09-12T17:39:05.930326+0000","last_became_peered":"2024-09-12T17:39:05.930326+0000","last_unstale":"2024-09-12T18:14:47.409991+0000","last_undegraded":"2024-09-12T18:14:47.409991+0000","last_fullsized":"2024-09-12T18:14:47.409991+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:47.409905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:47.409905+0000","last_clean_scrub_stamp":"2024-09-12T18:14:47.409905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:54.986456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'6","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:41.859371+0000","last_change":"2024-09-12T18:14:41.859276+0000","last_active":"2024-09-12T18:14:41.859371+0000","last_peered":"2024-09-12T18:14:41.859371+0000","last_clean":"2024-09-12T18:14:41.859371+0000","last_became_active":"2024-09-12T17:20:34.554832+0000","last_became_peered":"2024-09-12T17:20:34.554832+0000","last_unstale":"2024-09-12T18:14:41.859371+0000","last_undegraded":"2024-09-12T18:14:41.859371+0000","last_fullsized":"2024-09-12T18:14:41.859371+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T18:14:41.859166+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T18:14:41.859166+0000","last_clean_scrub_stamp":"2024-09-12T18:14:41.859166+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:02.620814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'4","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:28.273212+0000","last_change":"2024-09-12T18:14:28.273120+0000","last_active":"2024-09-12T18:14:28.273212+0000","last_peered":"2024-09-12T18:14:28.273212+0000","last_clean":"2024-09-12T18:14:28.273212+0000","last_became_active":"2024-09-12T17:20:30.528541+0000","last_became_peered":"2024-09-12T17:20:30.528541+0000","last_unstale":"2024-09-12T18:14:28.273212+0000","last_undegraded":"2024-09-12T18:14:28.273212+0000","last_fullsized":"2024-09-12T18:14:28.273212+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:14:28.273000+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:14:28.273000+0000","last_clean_scrub_stamp":"2024-09-12T18:14:28.273000+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:19.677685+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'21","reported_seq":126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:33.429668+0000","last_change":"2024-09-12T18:14:33.429668+0000","last_active":"2024-09-12T18:14:33.429668+0000","last_peered":"2024-09-12T18:14:33.429668+0000","last_clean":"2024-09-12T18:14:33.429668+0000","last_became_active":"2024-09-12T17:16:11.487238+0000","last_became_peered":"2024-09-12T17:16:11.487238+0000","last_unstale":"2024-09-12T18:14:33.429668+0000","last_undegraded":"2024-09-12T18:14:33.429668+0000","last_fullsized":"2024-09-12T18:14:33.429668+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'21","last_scrub_stamp":"2024-09-12T18:14:33.429572+0000","last_deep_scrub":"264'21","last_deep_scrub_stamp":"2024-09-12T18:14:33.429572+0000","last_clean_scrub_stamp":"2024-09-12T18:14:33.429572+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:19.091582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":71,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'378","reported_seq":1024,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.165454+0000","last_change":"2024-09-12T18:14:11.165354+0000","last_active":"2024-09-12T18:14:11.165454+0000","last_peered":"2024-09-12T18:14:11.165454+0000","last_clean":"2024-09-12T18:14:11.165454+0000","last_became_active":"2024-09-12T17:00:12.304074+0000","last_became_peered":"2024-09-12T17:00:12.304074+0000","last_unstale":"2024-09-12T18:14:11.165454+0000","last_undegraded":"2024-09-12T18:14:11.165454+0000","last_fullsized":"2024-09-12T18:14:11.165454+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'378","last_scrub_stamp":"2024-09-12T18:14:11.165222+0000","last_deep_scrub":"264'378","last_deep_scrub_stamp":"2024-09-12T18:14:11.165222+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.165222+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:54.479677+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":637523,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":542,"num_read_kb":3821,"num_write":1162,"num_write_kb":12701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'137","reported_seq":756,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.416935+0000","last_change":"2024-09-12T18:14:17.416875+0000","last_active":"2024-09-12T18:14:17.416935+0000","last_peered":"2024-09-12T18:14:17.416935+0000","last_clean":"2024-09-12T18:14:17.416935+0000","last_became_active":"2024-09-12T17:00:14.328464+0000","last_became_peered":"2024-09-12T17:00:14.328464+0000","last_unstale":"2024-09-12T18:14:17.416935+0000","last_undegraded":"2024-09-12T18:14:17.416935+0000","last_fullsized":"2024-09-12T18:14:17.416935+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'137","last_scrub_stamp":"2024-09-12T18:14:17.416794+0000","last_deep_scrub":"264'137","last_deep_scrub_stamp":"2024-09-12T18:14:17.416794+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.416794+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:19.839739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":594,"num_read_kb":496,"num_write":221,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'326","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.050966+0000","last_change":"2024-09-12T18:14:02.050905+0000","last_active":"2024-09-12T18:14:02.050966+0000","last_peered":"2024-09-12T18:14:02.050966+0000","last_clean":"2024-09-12T18:14:02.050966+0000","last_became_active":"2024-09-12T17:00:12.302750+0000","last_became_peered":"2024-09-12T17:00:12.302750+0000","last_unstale":"2024-09-12T18:14:02.050966+0000","last_undegraded":"2024-09-12T18:14:02.050966+0000","last_fullsized":"2024-09-12T18:14:02.050966+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-12T18:14:02.050783+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-12T18:14:02.050783+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.050783+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:42.750663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":423,"num_read_kb":57739,"num_write":1027,"num_write_kb":55497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'223","reported_seq":858,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:14.259616+0000","last_change":"2024-09-12T18:14:14.259553+0000","last_active":"2024-09-12T18:14:14.259616+0000","last_peered":"2024-09-12T18:14:14.259616+0000","last_clean":"2024-09-12T18:14:14.259616+0000","last_became_active":"2024-09-12T17:00:14.336238+0000","last_became_peered":"2024-09-12T17:00:14.336238+0000","last_unstale":"2024-09-12T18:14:14.259616+0000","last_undegraded":"2024-09-12T18:14:14.259616+0000","last_fullsized":"2024-09-12T18:14:14.259616+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'223","last_scrub_stamp":"2024-09-12T18:14:14.259469+0000","last_deep_scrub":"264'223","last_deep_scrub_stamp":"2024-09-12T18:14:14.259469+0000","last_clean_scrub_stamp":"2024-09-12T18:14:14.259469+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:43.717710+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":973,"num_read_kb":793,"num_write":333,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8081,"num_omap_keys":32,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'344","reported_seq":1018,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.017398+0000","last_change":"2024-09-12T18:14:02.017303+0000","last_active":"2024-09-12T18:14:02.017398+0000","last_peered":"2024-09-12T18:14:02.017398+0000","last_clean":"2024-09-12T18:14:02.017398+0000","last_became_active":"2024-09-12T17:00:12.309132+0000","last_became_peered":"2024-09-12T17:00:12.309132+0000","last_unstale":"2024-09-12T18:14:02.017398+0000","last_undegraded":"2024-09-12T18:14:02.017398+0000","last_fullsized":"2024-09-12T18:14:02.017398+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'344","last_scrub_stamp":"2024-09-12T18:14:02.017215+0000","last_deep_scrub":"264'344","last_deep_scrub_stamp":"2024-09-12T18:14:02.017215+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.017215+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:38.479748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":529,"num_read_kb":32498,"num_write":1132,"num_write_kb":31975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'256","reported_seq":888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:14.837902+0000","last_change":"2024-09-12T18:14:14.837837+0000","last_active":"2024-09-12T18:14:14.837902+0000","last_peered":"2024-09-12T18:14:14.837902+0000","last_clean":"2024-09-12T18:14:14.837902+0000","last_became_active":"2024-09-12T17:00:14.323358+0000","last_became_peered":"2024-09-12T17:00:14.323358+0000","last_unstale":"2024-09-12T18:14:14.837902+0000","last_undegraded":"2024-09-12T18:14:14.837902+0000","last_fullsized":"2024-09-12T18:14:14.837902+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'256","last_scrub_stamp":"2024-09-12T18:14:14.837731+0000","last_deep_scrub":"264'256","last_deep_scrub_stamp":"2024-09-12T18:14:14.837731+0000","last_clean_scrub_stamp":"2024-09-12T18:14:14.837731+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:31.651864+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1058,"num_read_kb":862,"num_write":363,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":938,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'313","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.579212+0000","last_change":"2024-09-12T18:14:09.579151+0000","last_active":"2024-09-12T18:14:09.579212+0000","last_peered":"2024-09-12T18:14:09.579212+0000","last_clean":"2024-09-12T18:14:09.579212+0000","last_became_active":"2024-09-12T17:00:12.320515+0000","last_became_peered":"2024-09-12T17:00:12.320515+0000","last_unstale":"2024-09-12T18:14:09.579212+0000","last_undegraded":"2024-09-12T18:14:09.579212+0000","last_fullsized":"2024-09-12T18:14:09.579212+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'313","last_scrub_stamp":"2024-09-12T18:14:09.579047+0000","last_deep_scrub":"264'313","last_deep_scrub_stamp":"2024-09-12T18:14:09.579047+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.579047+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:04.911796+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1784539,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":432,"num_read_kb":6790,"num_write":998,"num_write_kb":19852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'120","reported_seq":710,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.170388+0000","last_change":"2024-09-12T18:14:13.170289+0000","last_active":"2024-09-12T18:14:13.170388+0000","last_peered":"2024-09-12T18:14:13.170388+0000","last_clean":"2024-09-12T18:14:13.170388+0000","last_became_active":"2024-09-12T17:00:14.335297+0000","last_became_peered":"2024-09-12T17:00:14.335297+0000","last_unstale":"2024-09-12T18:14:13.170388+0000","last_undegraded":"2024-09-12T18:14:13.170388+0000","last_fullsized":"2024-09-12T18:14:13.170388+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-09-12T18:14:13.170184+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-09-12T18:14:13.170184+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.170184+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:20.955398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":395,"num_write":174,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'333","reported_seq":978,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.237303+0000","last_change":"2024-09-12T18:14:09.237214+0000","last_active":"2024-09-12T18:14:09.237303+0000","last_peered":"2024-09-12T18:14:09.237303+0000","last_clean":"2024-09-12T18:14:09.237303+0000","last_became_active":"2024-09-12T17:00:12.312762+0000","last_became_peered":"2024-09-12T17:00:12.312762+0000","last_unstale":"2024-09-12T18:14:09.237303+0000","last_undegraded":"2024-09-12T18:14:09.237303+0000","last_fullsized":"2024-09-12T18:14:09.237303+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'333","last_scrub_stamp":"2024-09-12T18:14:09.237040+0000","last_deep_scrub":"264'333","last_deep_scrub_stamp":"2024-09-12T18:14:09.237040+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.237040+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:39.532704+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4593537,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":487,"num_read_kb":9220,"num_write":1043,"num_write_kb":31558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'219","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.103243+0000","last_change":"2024-09-12T18:14:10.103167+0000","last_active":"2024-09-12T18:14:10.103243+0000","last_peered":"2024-09-12T18:14:10.103243+0000","last_clean":"2024-09-12T18:14:10.103243+0000","last_became_active":"2024-09-12T17:00:14.321640+0000","last_became_peered":"2024-09-12T17:00:14.321640+0000","last_unstale":"2024-09-12T18:14:10.103243+0000","last_undegraded":"2024-09-12T18:14:10.103243+0000","last_fullsized":"2024-09-12T18:14:10.103243+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'219","last_scrub_stamp":"2024-09-12T18:14:10.103080+0000","last_deep_scrub":"264'219","last_deep_scrub_stamp":"2024-09-12T18:14:10.103080+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.103080+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:24.808735+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1016,"num_read_kb":865,"num_write":355,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'370","reported_seq":1029,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.554846+0000","last_change":"2024-09-12T18:14:06.554790+0000","last_active":"2024-09-12T18:14:06.554846+0000","last_peered":"2024-09-12T18:14:06.554846+0000","last_clean":"2024-09-12T18:14:06.554846+0000","last_became_active":"2024-09-12T17:00:12.319917+0000","last_became_peered":"2024-09-12T17:00:12.319917+0000","last_unstale":"2024-09-12T18:14:06.554846+0000","last_undegraded":"2024-09-12T18:14:06.554846+0000","last_fullsized":"2024-09-12T18:14:06.554846+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'370","last_scrub_stamp":"2024-09-12T18:14:06.554684+0000","last_deep_scrub":"264'370","last_deep_scrub_stamp":"2024-09-12T18:14:06.554684+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.554684+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:37.956148+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432807,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":38218,"num_write":1060,"num_write_kb":26572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'175","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.835788+0000","last_change":"2024-09-12T18:14:17.835721+0000","last_active":"2024-09-12T18:14:17.835788+0000","last_peered":"2024-09-12T18:14:17.835788+0000","last_clean":"2024-09-12T18:14:17.835788+0000","last_became_active":"2024-09-12T17:00:14.332940+0000","last_became_peered":"2024-09-12T17:00:14.332940+0000","last_unstale":"2024-09-12T18:14:17.835788+0000","last_undegraded":"2024-09-12T18:14:17.835788+0000","last_fullsized":"2024-09-12T18:14:17.835788+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'175","last_scrub_stamp":"2024-09-12T18:14:17.835625+0000","last_deep_scrub":"264'175","last_deep_scrub_stamp":"2024-09-12T18:14:17.835625+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.835625+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:25.113287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":715,"num_read_kb":606,"num_write":241,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'326","reported_seq":985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.241894+0000","last_change":"2024-09-12T18:14:08.241830+0000","last_active":"2024-09-12T18:14:08.241894+0000","last_peered":"2024-09-12T18:14:08.241894+0000","last_clean":"2024-09-12T18:14:08.241894+0000","last_became_active":"2024-09-12T17:00:12.304504+0000","last_became_peered":"2024-09-12T17:00:12.304504+0000","last_unstale":"2024-09-12T18:14:08.241894+0000","last_undegraded":"2024-09-12T18:14:08.241894+0000","last_fullsized":"2024-09-12T18:14:08.241894+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-12T18:14:08.241703+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-12T18:14:08.241703+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.241703+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:13.525047+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1691575,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":533,"num_read_kb":24452,"num_write":1091,"num_write_kb":21520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'176","reported_seq":781,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:16.416899+0000","last_change":"2024-09-12T18:14:16.416775+0000","last_active":"2024-09-12T18:14:16.416899+0000","last_peered":"2024-09-12T18:14:16.416899+0000","last_clean":"2024-09-12T18:14:16.416899+0000","last_became_active":"2024-09-12T17:00:14.332360+0000","last_became_peered":"2024-09-12T17:00:14.332360+0000","last_unstale":"2024-09-12T18:14:16.416899+0000","last_undegraded":"2024-09-12T18:14:16.416899+0000","last_fullsized":"2024-09-12T18:14:16.416899+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'176","last_scrub_stamp":"2024-09-12T18:14:16.416668+0000","last_deep_scrub":"264'176","last_deep_scrub_stamp":"2024-09-12T18:14:16.416668+0000","last_clean_scrub_stamp":"2024-09-12T18:14:16.416668+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:39.911259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":738,"num_read_kb":599,"num_write":278,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'372","reported_seq":1086,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.002729+0000","last_change":"2024-09-12T18:14:04.002649+0000","last_active":"2024-09-12T18:14:04.002729+0000","last_peered":"2024-09-12T18:14:04.002729+0000","last_clean":"2024-09-12T18:14:04.002729+0000","last_became_active":"2024-09-12T17:00:12.322419+0000","last_became_peered":"2024-09-12T17:00:12.322419+0000","last_unstale":"2024-09-12T18:14:04.002729+0000","last_undegraded":"2024-09-12T18:14:04.002729+0000","last_fullsized":"2024-09-12T18:14:04.002729+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-12T18:14:04.002546+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-12T18:14:04.002546+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.002546+0000","objects_scrubbed":9,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:39.056847+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786486,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":661,"num_read_kb":7776,"num_write":1130,"num_write_kb":24985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'60","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.168398+0000","last_change":"2024-09-12T18:14:09.168328+0000","last_active":"2024-09-12T18:14:09.168398+0000","last_peered":"2024-09-12T18:14:09.168398+0000","last_clean":"2024-09-12T18:14:09.168398+0000","last_became_active":"2024-09-12T17:00:14.334586+0000","last_became_peered":"2024-09-12T17:00:14.334586+0000","last_unstale":"2024-09-12T18:14:09.168398+0000","last_undegraded":"2024-09-12T18:14:09.168398+0000","last_fullsized":"2024-09-12T18:14:09.168398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'60","last_scrub_stamp":"2024-09-12T18:14:09.168221+0000","last_deep_scrub":"264'60","last_deep_scrub_stamp":"2024-09-12T18:14:09.168221+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.168221+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:35.472486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":225,"num_write":86,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'142","reported_seq":774,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.786046+0000","last_change":"2024-09-12T18:14:13.785983+0000","last_active":"2024-09-12T18:14:13.786046+0000","last_peered":"2024-09-12T18:14:13.786046+0000","last_clean":"2024-09-12T18:14:13.786046+0000","last_became_active":"2024-09-12T17:00:14.322771+0000","last_became_peered":"2024-09-12T17:00:14.322771+0000","last_unstale":"2024-09-12T18:14:13.786046+0000","last_undegraded":"2024-09-12T18:14:13.786046+0000","last_fullsized":"2024-09-12T18:14:13.786046+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-12T18:14:13.785902+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-12T18:14:13.785902+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.785902+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:49.161921+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":650,"num_read_kb":543,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'382","reported_seq":1148,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.206812+0000","last_change":"2024-09-12T18:14:07.206812+0000","last_active":"2024-09-12T18:14:07.206812+0000","last_peered":"2024-09-12T18:14:07.206812+0000","last_clean":"2024-09-12T18:14:07.206812+0000","last_became_active":"2024-09-12T17:00:46.406911+0000","last_became_peered":"2024-09-12T17:00:46.406911+0000","last_unstale":"2024-09-12T18:14:07.206812+0000","last_undegraded":"2024-09-12T18:14:07.206812+0000","last_fullsized":"2024-09-12T18:14:07.206812+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'382","last_scrub_stamp":"2024-09-12T18:14:07.206704+0000","last_deep_scrub":"264'382","last_deep_scrub_stamp":"2024-09-12T18:14:07.206704+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.206704+0000","objects_scrubbed":8,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:11.551940+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029268,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":749,"num_read_kb":51923,"num_write":1318,"num_write_kb":31895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'117","reported_seq":733,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.222238+0000","last_change":"2024-09-12T18:14:13.222152+0000","last_active":"2024-09-12T18:14:13.222238+0000","last_peered":"2024-09-12T18:14:13.222238+0000","last_clean":"2024-09-12T18:14:13.222238+0000","last_became_active":"2024-09-12T17:00:14.336161+0000","last_became_peered":"2024-09-12T17:00:14.336161+0000","last_unstale":"2024-09-12T18:14:13.222238+0000","last_undegraded":"2024-09-12T18:14:13.222238+0000","last_fullsized":"2024-09-12T18:14:13.222238+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'117","last_scrub_stamp":"2024-09-12T18:14:13.222053+0000","last_deep_scrub":"264'117","last_deep_scrub_stamp":"2024-09-12T18:14:13.222053+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.222053+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:25.097396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":545,"num_read_kb":462,"num_write":195,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'338","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.047530+0000","last_change":"2024-09-12T18:14:05.047468+0000","last_active":"2024-09-12T18:14:05.047530+0000","last_peered":"2024-09-12T18:14:05.047530+0000","last_clean":"2024-09-12T18:14:05.047530+0000","last_became_active":"2024-09-12T17:00:12.310589+0000","last_became_peered":"2024-09-12T17:00:12.310589+0000","last_unstale":"2024-09-12T18:14:05.047530+0000","last_undegraded":"2024-09-12T18:14:05.047530+0000","last_fullsized":"2024-09-12T18:14:05.047530+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'338","last_scrub_stamp":"2024-09-12T18:14:05.047367+0000","last_deep_scrub":"264'338","last_deep_scrub_stamp":"2024-09-12T18:14:05.047367+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.047367+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:13.046999+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":594,"num_read_kb":8321,"num_write":1002,"num_write_kb":31830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'144","reported_seq":734,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:14.480076+0000","last_change":"2024-09-12T18:14:14.480010+0000","last_active":"2024-09-12T18:14:14.480076+0000","last_peered":"2024-09-12T18:14:14.480076+0000","last_clean":"2024-09-12T18:14:14.480076+0000","last_became_active":"2024-09-12T17:00:14.324889+0000","last_became_peered":"2024-09-12T17:00:14.324889+0000","last_unstale":"2024-09-12T18:14:14.480076+0000","last_undegraded":"2024-09-12T18:14:14.480076+0000","last_fullsized":"2024-09-12T18:14:14.480076+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'144","last_scrub_stamp":"2024-09-12T18:14:14.479922+0000","last_deep_scrub":"264'144","last_deep_scrub_stamp":"2024-09-12T18:14:14.479922+0000","last_clean_scrub_stamp":"2024-09-12T18:14:14.479922+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:54.095428+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":586,"num_read_kb":478,"num_write":211,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'340","reported_seq":978,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.055701+0000","last_change":"2024-09-12T18:14:02.055592+0000","last_active":"2024-09-12T18:14:02.055701+0000","last_peered":"2024-09-12T18:14:02.055701+0000","last_clean":"2024-09-12T18:14:02.055701+0000","last_became_active":"2024-09-12T17:00:12.315652+0000","last_became_peered":"2024-09-12T17:00:12.315652+0000","last_unstale":"2024-09-12T18:14:02.055701+0000","last_undegraded":"2024-09-12T18:14:02.055701+0000","last_fullsized":"2024-09-12T18:14:02.055701+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'340","last_scrub_stamp":"2024-09-12T18:14:02.055446+0000","last_deep_scrub":"264'340","last_deep_scrub_stamp":"2024-09-12T18:14:02.055446+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.055446+0000","objects_scrubbed":8,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:28.138157+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":305880,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":503,"num_read_kb":21524,"num_write":1088,"num_write_kb":35144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'78","reported_seq":638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.064773+0000","last_change":"2024-09-12T18:14:02.064701+0000","last_active":"2024-09-12T18:14:02.064773+0000","last_peered":"2024-09-12T18:14:02.064773+0000","last_clean":"2024-09-12T18:14:02.064773+0000","last_became_active":"2024-09-12T17:00:14.335009+0000","last_became_peered":"2024-09-12T17:00:14.335009+0000","last_unstale":"2024-09-12T18:14:02.064773+0000","last_undegraded":"2024-09-12T18:14:02.064773+0000","last_fullsized":"2024-09-12T18:14:02.064773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'78","last_scrub_stamp":"2024-09-12T18:14:02.064622+0000","last_deep_scrub":"264'78","last_deep_scrub_stamp":"2024-09-12T18:14:02.064622+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.064622+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:00.192294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":353,"num_read_kb":297,"num_write":121,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'359","reported_seq":1029,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.824698+0000","last_change":"2024-09-12T18:14:00.824638+0000","last_active":"2024-09-12T18:14:00.824698+0000","last_peered":"2024-09-12T18:14:00.824698+0000","last_clean":"2024-09-12T18:14:00.824698+0000","last_became_active":"2024-09-12T17:00:12.312828+0000","last_became_peered":"2024-09-12T17:00:12.312828+0000","last_unstale":"2024-09-12T18:14:00.824698+0000","last_undegraded":"2024-09-12T18:14:00.824698+0000","last_fullsized":"2024-09-12T18:14:00.824698+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'359","last_scrub_stamp":"2024-09-12T18:14:00.824537+0000","last_deep_scrub":"264'359","last_deep_scrub_stamp":"2024-09-12T18:14:00.824537+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.824537+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:37.459215+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850167,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":541,"num_read_kb":47220,"num_write":1168,"num_write_kb":32154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'190","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.125903+0000","last_change":"2024-09-12T18:14:05.125836+0000","last_active":"2024-09-12T18:14:05.125903+0000","last_peered":"2024-09-12T18:14:05.125903+0000","last_clean":"2024-09-12T18:14:05.125903+0000","last_became_active":"2024-09-12T17:00:14.327744+0000","last_became_peered":"2024-09-12T17:00:14.327744+0000","last_unstale":"2024-09-12T18:14:05.125903+0000","last_undegraded":"2024-09-12T18:14:05.125903+0000","last_fullsized":"2024-09-12T18:14:05.125903+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-09-12T18:14:05.125736+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-09-12T18:14:05.125736+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.125736+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:47.673107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":833,"num_read_kb":695,"num_write":274,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'317","reported_seq":1109,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.929717+0000","last_change":"2024-09-12T18:14:06.929610+0000","last_active":"2024-09-12T18:14:06.929717+0000","last_peered":"2024-09-12T18:14:06.929717+0000","last_clean":"2024-09-12T18:14:06.929717+0000","last_became_active":"2024-09-12T17:00:12.319649+0000","last_became_peered":"2024-09-12T17:00:12.319649+0000","last_unstale":"2024-09-12T18:14:06.929717+0000","last_undegraded":"2024-09-12T18:14:06.929717+0000","last_fullsized":"2024-09-12T18:14:06.929717+0000","mapping_epoch":24,"log_start":"264'301","ondisk_log_start":"264'301","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'317","last_scrub_stamp":"2024-09-12T18:14:06.929469+0000","last_deep_scrub":"264'317","last_deep_scrub_stamp":"2024-09-12T18:14:06.929469+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.929469+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":301,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:28.114201+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655853,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":737,"num_read_kb":130250,"num_write":941,"num_write_kb":66985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'137","reported_seq":770,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:15.817768+0000","last_change":"2024-09-12T18:14:15.817698+0000","last_active":"2024-09-12T18:14:15.817768+0000","last_peered":"2024-09-12T18:14:15.817768+0000","last_clean":"2024-09-12T18:14:15.817768+0000","last_became_active":"2024-09-12T17:00:14.329107+0000","last_became_peered":"2024-09-12T17:00:14.329107+0000","last_unstale":"2024-09-12T18:14:15.817768+0000","last_undegraded":"2024-09-12T18:14:15.817768+0000","last_fullsized":"2024-09-12T18:14:15.817768+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'137","last_scrub_stamp":"2024-09-12T18:14:15.817595+0000","last_deep_scrub":"264'137","last_deep_scrub_stamp":"2024-09-12T18:14:15.817595+0000","last_clean_scrub_stamp":"2024-09-12T18:14:15.817595+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:52.489558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":644,"num_read_kb":539,"num_write":215,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'373","reported_seq":1119,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.058013+0000","last_change":"2024-09-12T18:14:01.057944+0000","last_active":"2024-09-12T18:14:01.058013+0000","last_peered":"2024-09-12T18:14:01.058013+0000","last_clean":"2024-09-12T18:14:01.058013+0000","last_became_active":"2024-09-12T17:00:12.307906+0000","last_became_peered":"2024-09-12T17:00:12.307906+0000","last_unstale":"2024-09-12T18:14:01.058013+0000","last_undegraded":"2024-09-12T18:14:01.058013+0000","last_fullsized":"2024-09-12T18:14:01.058013+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-09-12T18:14:01.057824+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-09-12T18:14:01.057824+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.057824+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:19.783672+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524322,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":712,"num_read_kb":3845,"num_write":1087,"num_write_kb":30178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'136","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:31.865736+0000","last_change":"2024-09-12T18:14:31.865736+0000","last_active":"2024-09-12T18:14:31.865736+0000","last_peered":"2024-09-12T18:14:31.865736+0000","last_clean":"2024-09-12T18:14:31.865736+0000","last_became_active":"2024-09-12T17:00:22.355591+0000","last_became_peered":"2024-09-12T17:00:22.355591+0000","last_unstale":"2024-09-12T18:14:31.865736+0000","last_undegraded":"2024-09-12T18:14:31.865736+0000","last_fullsized":"2024-09-12T18:14:31.865736+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'136","last_scrub_stamp":"2024-09-12T18:14:31.865640+0000","last_deep_scrub":"264'136","last_deep_scrub_stamp":"2024-09-12T18:14:31.865640+0000","last_clean_scrub_stamp":"2024-09-12T18:14:31.865640+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:08.827157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1447,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":175,"num_read_kb":172,"num_write":326,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'85","reported_seq":692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.936731+0000","last_change":"2024-09-12T18:14:05.936607+0000","last_active":"2024-09-12T18:14:05.936731+0000","last_peered":"2024-09-12T18:14:05.936731+0000","last_clean":"2024-09-12T18:14:05.936731+0000","last_became_active":"2024-09-12T17:00:14.336144+0000","last_became_peered":"2024-09-12T17:00:14.336144+0000","last_unstale":"2024-09-12T18:14:05.936731+0000","last_undegraded":"2024-09-12T18:14:05.936731+0000","last_fullsized":"2024-09-12T18:14:05.936731+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'85","last_scrub_stamp":"2024-09-12T18:14:05.936499+0000","last_deep_scrub":"264'85","last_deep_scrub_stamp":"2024-09-12T18:14:05.936499+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.936499+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:14.421673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":388,"num_read_kb":332,"num_write":123,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'341","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:57.152269+0000","last_change":"2024-09-12T18:13:57.152269+0000","last_active":"2024-09-12T18:13:57.152269+0000","last_peered":"2024-09-12T18:13:57.152269+0000","last_clean":"2024-09-12T18:13:57.152269+0000","last_became_active":"2024-09-12T17:00:46.720989+0000","last_became_peered":"2024-09-12T17:00:46.720989+0000","last_unstale":"2024-09-12T18:13:57.152269+0000","last_undegraded":"2024-09-12T18:13:57.152269+0000","last_fullsized":"2024-09-12T18:13:57.152269+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'341","last_scrub_stamp":"2024-09-12T18:13:57.152177+0000","last_deep_scrub":"264'341","last_deep_scrub_stamp":"2024-09-12T18:13:57.152177+0000","last_clean_scrub_stamp":"2024-09-12T18:13:57.152177+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:22.890906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":487,"num_read_kb":63990,"num_write":1055,"num_write_kb":41211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:20.415232+0000","last_change":"2024-09-12T18:14:20.415162+0000","last_active":"2024-09-12T18:14:20.415232+0000","last_peered":"2024-09-12T18:14:20.415232+0000","last_clean":"2024-09-12T18:14:20.415232+0000","last_became_active":"2024-09-12T17:00:16.325868+0000","last_became_peered":"2024-09-12T17:00:16.325868+0000","last_unstale":"2024-09-12T18:14:20.415232+0000","last_undegraded":"2024-09-12T18:14:20.415232+0000","last_fullsized":"2024-09-12T18:14:20.415232+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:20.415070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:20.415070+0000","last_clean_scrub_stamp":"2024-09-12T18:14:20.415070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:45.386194+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'344","reported_seq":980,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:20.260785+0000","last_change":"2024-09-12T18:14:20.260679+0000","last_active":"2024-09-12T18:14:20.260785+0000","last_peered":"2024-09-12T18:14:20.260785+0000","last_clean":"2024-09-12T18:14:20.260785+0000","last_became_active":"2024-09-12T17:00:18.329515+0000","last_became_peered":"2024-09-12T17:00:18.329515+0000","last_unstale":"2024-09-12T18:14:20.260785+0000","last_undegraded":"2024-09-12T18:14:20.260785+0000","last_fullsized":"2024-09-12T18:14:20.260785+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'344","last_scrub_stamp":"2024-09-12T18:14:20.260565+0000","last_deep_scrub":"264'344","last_deep_scrub_stamp":"2024-09-12T18:14:20.260565+0000","last_clean_scrub_stamp":"2024-09-12T18:14:20.260565+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:58.070253+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49756,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":1157,"num_write":430,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:30.405500+0000","last_change":"2024-09-12T18:14:30.405393+0000","last_active":"2024-09-12T18:14:30.405500+0000","last_peered":"2024-09-12T18:14:30.405500+0000","last_clean":"2024-09-12T18:14:30.405500+0000","last_became_active":"2024-09-12T17:00:20.348524+0000","last_became_peered":"2024-09-12T17:00:20.348524+0000","last_unstale":"2024-09-12T18:14:30.405500+0000","last_undegraded":"2024-09-12T18:14:30.405500+0000","last_fullsized":"2024-09-12T18:14:30.405500+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:30.405300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:30.405300+0000","last_clean_scrub_stamp":"2024-09-12T18:14:30.405300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:52.715411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'169","reported_seq":737,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:33.450318+0000","last_change":"2024-09-12T18:14:33.450318+0000","last_active":"2024-09-12T18:14:33.450318+0000","last_peered":"2024-09-12T18:14:33.450318+0000","last_clean":"2024-09-12T18:14:33.450318+0000","last_became_active":"2024-09-12T17:00:22.357688+0000","last_became_peered":"2024-09-12T17:00:22.357688+0000","last_unstale":"2024-09-12T18:14:33.450318+0000","last_undegraded":"2024-09-12T18:14:33.450318+0000","last_fullsized":"2024-09-12T18:14:33.450318+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'169","last_scrub_stamp":"2024-09-12T18:14:33.450214+0000","last_deep_scrub":"264'169","last_deep_scrub_stamp":"2024-09-12T18:14:33.450214+0000","last_clean_scrub_stamp":"2024-09-12T18:14:33.450214+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:13.393504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":624,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":254,"num_read_kb":249,"num_write":335,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'315","reported_seq":950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.537532+0000","last_change":"2024-09-12T18:14:10.537417+0000","last_active":"2024-09-12T18:14:10.537532+0000","last_peered":"2024-09-12T18:14:10.537532+0000","last_clean":"2024-09-12T18:14:10.537532+0000","last_became_active":"2024-09-12T17:00:14.327170+0000","last_became_peered":"2024-09-12T17:00:14.327170+0000","last_unstale":"2024-09-12T18:14:10.537532+0000","last_undegraded":"2024-09-12T18:14:10.537532+0000","last_fullsized":"2024-09-12T18:14:10.537532+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'315","last_scrub_stamp":"2024-09-12T18:14:10.537320+0000","last_deep_scrub":"264'315","last_deep_scrub_stamp":"2024-09-12T18:14:10.537320+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.537320+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:19.286520+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1382,"num_read_kb":1112,"num_write":506,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'400","reported_seq":1102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:55.046428+0000","last_change":"2024-09-12T18:13:55.046377+0000","last_active":"2024-09-12T18:13:55.046428+0000","last_peered":"2024-09-12T18:13:55.046428+0000","last_clean":"2024-09-12T18:13:55.046428+0000","last_became_active":"2024-09-12T17:00:12.304357+0000","last_became_peered":"2024-09-12T17:00:12.304357+0000","last_unstale":"2024-09-12T18:13:55.046428+0000","last_undegraded":"2024-09-12T18:13:55.046428+0000","last_fullsized":"2024-09-12T18:13:55.046428+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'400","last_scrub_stamp":"2024-09-12T18:13:55.046290+0000","last_deep_scrub":"264'400","last_deep_scrub_stamp":"2024-09-12T18:13:55.046290+0000","last_clean_scrub_stamp":"2024-09-12T18:13:55.046290+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:33.859962+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2934950,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":656,"num_read_kb":22996,"num_write":1171,"num_write_kb":36092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:18.940024+0000","last_change":"2024-09-12T18:14:18.939964+0000","last_active":"2024-09-12T18:14:18.940024+0000","last_peered":"2024-09-12T18:14:18.940024+0000","last_clean":"2024-09-12T18:14:18.940024+0000","last_became_active":"2024-09-12T17:00:16.323601+0000","last_became_peered":"2024-09-12T17:00:16.323601+0000","last_unstale":"2024-09-12T18:14:18.940024+0000","last_undegraded":"2024-09-12T18:14:18.940024+0000","last_fullsized":"2024-09-12T18:14:18.940024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:18.939871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:18.939871+0000","last_clean_scrub_stamp":"2024-09-12T18:14:18.939871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:47.955364+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'109","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:23.910667+0000","last_change":"2024-09-12T18:14:23.910609+0000","last_active":"2024-09-12T18:14:23.910667+0000","last_peered":"2024-09-12T18:14:23.910667+0000","last_clean":"2024-09-12T18:14:23.910667+0000","last_became_active":"2024-09-12T17:00:18.327744+0000","last_became_peered":"2024-09-12T17:00:18.327744+0000","last_unstale":"2024-09-12T18:14:23.910667+0000","last_undegraded":"2024-09-12T18:14:23.910667+0000","last_fullsized":"2024-09-12T18:14:23.910667+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'109","last_scrub_stamp":"2024-09-12T18:14:23.910502+0000","last_deep_scrub":"264'109","last_deep_scrub_stamp":"2024-09-12T18:14:23.910502+0000","last_clean_scrub_stamp":"2024-09-12T18:14:23.910502+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:25.648635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":113,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:27.792593+0000","last_change":"2024-09-12T18:14:27.792528+0000","last_active":"2024-09-12T18:14:27.792593+0000","last_peered":"2024-09-12T18:14:27.792593+0000","last_clean":"2024-09-12T18:14:27.792593+0000","last_became_active":"2024-09-12T17:00:20.347865+0000","last_became_peered":"2024-09-12T17:00:20.347865+0000","last_unstale":"2024-09-12T18:14:27.792593+0000","last_undegraded":"2024-09-12T18:14:27.792593+0000","last_fullsized":"2024-09-12T18:14:27.792593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:27.792437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:27.792437+0000","last_clean_scrub_stamp":"2024-09-12T18:14:27.792437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:34.829366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'117","reported_seq":641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:33.264633+0000","last_change":"2024-09-12T18:14:33.264633+0000","last_active":"2024-09-12T18:14:33.264633+0000","last_peered":"2024-09-12T18:14:33.264633+0000","last_clean":"2024-09-12T18:14:33.264633+0000","last_became_active":"2024-09-12T17:00:22.352912+0000","last_became_peered":"2024-09-12T17:00:22.352912+0000","last_unstale":"2024-09-12T18:14:33.264633+0000","last_undegraded":"2024-09-12T18:14:33.264633+0000","last_fullsized":"2024-09-12T18:14:33.264633+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'117","last_scrub_stamp":"2024-09-12T18:14:33.264533+0000","last_deep_scrub":"264'117","last_deep_scrub_stamp":"2024-09-12T18:14:33.264533+0000","last_clean_scrub_stamp":"2024-09-12T18:14:33.264533+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:21.531030+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":708,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":149,"num_read_kb":144,"num_write":248,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'179","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.134479+0000","last_change":"2024-09-12T18:14:07.134414+0000","last_active":"2024-09-12T18:14:07.134479+0000","last_peered":"2024-09-12T18:14:07.134479+0000","last_clean":"2024-09-12T18:14:07.134479+0000","last_became_active":"2024-09-12T17:00:14.337515+0000","last_became_peered":"2024-09-12T17:00:14.337515+0000","last_unstale":"2024-09-12T18:14:07.134479+0000","last_undegraded":"2024-09-12T18:14:07.134479+0000","last_fullsized":"2024-09-12T18:14:07.134479+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-09-12T18:14:07.134319+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-09-12T18:14:07.134319+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.134319+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:44.674793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":863,"num_read_kb":715,"num_write":299,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'372","reported_seq":1042,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.233212+0000","last_change":"2024-09-12T18:14:02.233108+0000","last_active":"2024-09-12T18:14:02.233212+0000","last_peered":"2024-09-12T18:14:02.233212+0000","last_clean":"2024-09-12T18:14:02.233212+0000","last_became_active":"2024-09-12T17:00:12.308065+0000","last_became_peered":"2024-09-12T17:00:12.308065+0000","last_unstale":"2024-09-12T18:14:02.233212+0000","last_undegraded":"2024-09-12T18:14:02.233212+0000","last_fullsized":"2024-09-12T18:14:02.233212+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-12T18:14:02.232968+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-12T18:14:02.232968+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.232968+0000","objects_scrubbed":7,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:48.335339+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":976913,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":502,"num_read_kb":43207,"num_write":1166,"num_write_kb":32106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.974689+0000","last_change":"2024-09-12T18:14:17.974613+0000","last_active":"2024-09-12T18:14:17.974689+0000","last_peered":"2024-09-12T18:14:17.974689+0000","last_clean":"2024-09-12T18:14:17.974689+0000","last_became_active":"2024-09-12T17:00:16.326073+0000","last_became_peered":"2024-09-12T17:00:16.326073+0000","last_unstale":"2024-09-12T18:14:17.974689+0000","last_undegraded":"2024-09-12T18:14:17.974689+0000","last_fullsized":"2024-09-12T18:14:17.974689+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:17.974523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:17.974523+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.974523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:10.061813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'145","reported_seq":708,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.127915+0000","last_change":"2024-09-12T18:14:12.127850+0000","last_active":"2024-09-12T18:14:12.127915+0000","last_peered":"2024-09-12T18:14:12.127915+0000","last_clean":"2024-09-12T18:14:12.127915+0000","last_became_active":"2024-09-12T17:00:18.327448+0000","last_became_peered":"2024-09-12T17:00:18.327448+0000","last_unstale":"2024-09-12T18:14:12.127915+0000","last_undegraded":"2024-09-12T18:14:12.127915+0000","last_fullsized":"2024-09-12T18:14:12.127915+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'145","last_scrub_stamp":"2024-09-12T18:14:12.127741+0000","last_deep_scrub":"264'145","last_deep_scrub_stamp":"2024-09-12T18:14:12.127741+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.127741+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:09.199604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":172,"num_read_kb":164,"num_write":118,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'768","reported_seq":2576,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:27.465971+0000","last_change":"2024-09-12T18:14:27.465904+0000","last_active":"2024-09-12T18:14:27.465971+0000","last_peered":"2024-09-12T18:14:27.465971+0000","last_clean":"2024-09-12T18:14:27.465971+0000","last_became_active":"2024-09-12T17:00:20.351202+0000","last_became_peered":"2024-09-12T17:00:20.351202+0000","last_unstale":"2024-09-12T18:14:27.465971+0000","last_undegraded":"2024-09-12T18:14:27.465971+0000","last_fullsized":"2024-09-12T18:14:27.465971+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'768","last_scrub_stamp":"2024-09-12T18:14:27.465814+0000","last_deep_scrub":"264'768","last_deep_scrub_stamp":"2024-09-12T18:14:27.465814+0000","last_clean_scrub_stamp":"2024-09-12T18:14:27.465814+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:30.913051+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'208","reported_seq":1042,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:32.886927+0000","last_change":"2024-09-12T18:14:32.886927+0000","last_active":"2024-09-12T18:14:32.886927+0000","last_peered":"2024-09-12T18:14:32.886927+0000","last_clean":"2024-09-12T18:14:32.886927+0000","last_became_active":"2024-09-12T17:00:22.588111+0000","last_became_peered":"2024-09-12T17:00:22.588111+0000","last_unstale":"2024-09-12T18:14:32.886927+0000","last_undegraded":"2024-09-12T18:14:32.886927+0000","last_fullsized":"2024-09-12T18:14:32.886927+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'208","last_scrub_stamp":"2024-09-12T18:14:32.886828+0000","last_deep_scrub":"264'208","last_deep_scrub_stamp":"2024-09-12T18:14:32.886828+0000","last_clean_scrub_stamp":"2024-09-12T18:14:32.886828+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:45.836812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":621,"num_read_kb":619,"num_write":443,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'162","reported_seq":806,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.947979+0000","last_change":"2024-09-12T18:14:10.947891+0000","last_active":"2024-09-12T18:14:10.947979+0000","last_peered":"2024-09-12T18:14:10.947979+0000","last_clean":"2024-09-12T18:14:10.947979+0000","last_became_active":"2024-09-12T17:00:14.332424+0000","last_became_peered":"2024-09-12T17:00:14.332424+0000","last_unstale":"2024-09-12T18:14:10.947979+0000","last_undegraded":"2024-09-12T18:14:10.947979+0000","last_fullsized":"2024-09-12T18:14:10.947979+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'162","last_scrub_stamp":"2024-09-12T18:14:10.947786+0000","last_deep_scrub":"264'162","last_deep_scrub_stamp":"2024-09-12T18:14:10.947786+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.947786+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:36.780975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":720,"num_read_kb":605,"num_write":258,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'356","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.062180+0000","last_change":"2024-09-12T18:13:58.062122+0000","last_active":"2024-09-12T18:13:58.062180+0000","last_peered":"2024-09-12T18:13:58.062180+0000","last_clean":"2024-09-12T18:13:58.062180+0000","last_became_active":"2024-09-12T17:00:12.310337+0000","last_became_peered":"2024-09-12T17:00:12.310337+0000","last_unstale":"2024-09-12T18:13:58.062180+0000","last_undegraded":"2024-09-12T18:13:58.062180+0000","last_fullsized":"2024-09-12T18:13:58.062180+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-12T18:13:58.062029+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-12T18:13:58.062029+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.062029+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:33.366460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":552,"num_read_kb":13230,"num_write":1122,"num_write_kb":37058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:21.453431+0000","last_change":"2024-09-12T18:14:21.453349+0000","last_active":"2024-09-12T18:14:21.453431+0000","last_peered":"2024-09-12T18:14:21.453431+0000","last_clean":"2024-09-12T18:14:21.453431+0000","last_became_active":"2024-09-12T17:00:16.325141+0000","last_became_peered":"2024-09-12T17:00:16.325141+0000","last_unstale":"2024-09-12T18:14:21.453431+0000","last_undegraded":"2024-09-12T18:14:21.453431+0000","last_fullsized":"2024-09-12T18:14:21.453431+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:21.453254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:21.453254+0000","last_clean_scrub_stamp":"2024-09-12T18:14:21.453254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:29.853021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'313","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:24.501609+0000","last_change":"2024-09-12T18:14:24.501551+0000","last_active":"2024-09-12T18:14:24.501609+0000","last_peered":"2024-09-12T18:14:24.501609+0000","last_clean":"2024-09-12T18:14:24.501609+0000","last_became_active":"2024-09-12T17:00:18.430046+0000","last_became_peered":"2024-09-12T17:00:18.430046+0000","last_unstale":"2024-09-12T18:14:24.501609+0000","last_undegraded":"2024-09-12T18:14:24.501609+0000","last_fullsized":"2024-09-12T18:14:24.501609+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'313","last_scrub_stamp":"2024-09-12T18:14:24.501448+0000","last_deep_scrub":"264'313","last_deep_scrub_stamp":"2024-09-12T18:14:24.501448+0000","last_clean_scrub_stamp":"2024-09-12T18:14:24.501448+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:24.952495+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53213,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":492,"num_read_kb":1165,"num_write":400,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'773","reported_seq":2871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:30.796279+0000","last_change":"2024-09-12T18:14:30.796203+0000","last_active":"2024-09-12T18:14:30.796279+0000","last_peered":"2024-09-12T18:14:30.796279+0000","last_clean":"2024-09-12T18:14:30.796279+0000","last_became_active":"2024-09-12T17:00:20.353914+0000","last_became_peered":"2024-09-12T17:00:20.353914+0000","last_unstale":"2024-09-12T18:14:30.796279+0000","last_undegraded":"2024-09-12T18:14:30.796279+0000","last_fullsized":"2024-09-12T18:14:30.796279+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'773","last_scrub_stamp":"2024-09-12T18:14:30.796110+0000","last_deep_scrub":"264'773","last_deep_scrub_stamp":"2024-09-12T18:14:30.796110+0000","last_clean_scrub_stamp":"2024-09-12T18:14:30.796110+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:10.267813+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'89","reported_seq":685,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.529816+0000","last_change":"2024-09-12T18:14:11.529816+0000","last_active":"2024-09-12T18:14:11.529816+0000","last_peered":"2024-09-12T18:14:11.529816+0000","last_clean":"2024-09-12T18:14:11.529816+0000","last_became_active":"2024-09-12T17:00:14.325669+0000","last_became_peered":"2024-09-12T17:00:14.325669+0000","last_unstale":"2024-09-12T18:14:11.529816+0000","last_undegraded":"2024-09-12T18:14:11.529816+0000","last_fullsized":"2024-09-12T18:14:11.529816+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'89","last_scrub_stamp":"2024-09-12T18:14:11.529715+0000","last_deep_scrub":"264'89","last_deep_scrub_stamp":"2024-09-12T18:14:11.529715+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.529715+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:01.485599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":392,"num_read_kb":330,"num_write":131,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'362","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.169003+0000","last_change":"2024-09-12T18:14:00.168944+0000","last_active":"2024-09-12T18:14:00.169003+0000","last_peered":"2024-09-12T18:14:00.169003+0000","last_clean":"2024-09-12T18:14:00.169003+0000","last_became_active":"2024-09-12T17:00:12.315015+0000","last_became_peered":"2024-09-12T17:00:12.315015+0000","last_unstale":"2024-09-12T18:14:00.169003+0000","last_undegraded":"2024-09-12T18:14:00.169003+0000","last_fullsized":"2024-09-12T18:14:00.169003+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'362","last_scrub_stamp":"2024-09-12T18:14:00.168837+0000","last_deep_scrub":"264'362","last_deep_scrub_stamp":"2024-09-12T18:14:00.168837+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.168837+0000","objects_scrubbed":8,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:13.982975+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311686,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":465,"num_read_kb":13974,"num_write":1122,"num_write_kb":21819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:15.291075+0000","last_change":"2024-09-12T18:14:15.291075+0000","last_active":"2024-09-12T18:14:15.291075+0000","last_peered":"2024-09-12T18:14:15.291075+0000","last_clean":"2024-09-12T18:14:15.291075+0000","last_became_active":"2024-09-12T17:00:16.322693+0000","last_became_peered":"2024-09-12T17:00:16.322693+0000","last_unstale":"2024-09-12T18:14:15.291075+0000","last_undegraded":"2024-09-12T18:14:15.291075+0000","last_fullsized":"2024-09-12T18:14:15.291075+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:15.290984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:15.290984+0000","last_clean_scrub_stamp":"2024-09-12T18:14:15.290984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:22.877472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'404","reported_seq":1055,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:24.461519+0000","last_change":"2024-09-12T18:14:24.461519+0000","last_active":"2024-09-12T18:14:24.461519+0000","last_peered":"2024-09-12T18:14:24.461519+0000","last_clean":"2024-09-12T18:14:24.461519+0000","last_became_active":"2024-09-12T17:00:18.429137+0000","last_became_peered":"2024-09-12T17:00:18.429137+0000","last_unstale":"2024-09-12T18:14:24.461519+0000","last_undegraded":"2024-09-12T18:14:24.461519+0000","last_fullsized":"2024-09-12T18:14:24.461519+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'404","last_scrub_stamp":"2024-09-12T18:14:24.461416+0000","last_deep_scrub":"264'404","last_deep_scrub_stamp":"2024-09-12T18:14:24.461416+0000","last_clean_scrub_stamp":"2024-09-12T18:14:24.461416+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:11.439801+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47718,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":656,"num_read_kb":1335,"num_write":508,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:16.245909+0000","last_change":"2024-09-12T18:14:16.245833+0000","last_active":"2024-09-12T18:14:16.245909+0000","last_peered":"2024-09-12T18:14:16.245909+0000","last_clean":"2024-09-12T18:14:16.245909+0000","last_became_active":"2024-09-12T17:00:20.348507+0000","last_became_peered":"2024-09-12T17:00:20.348507+0000","last_unstale":"2024-09-12T18:14:16.245909+0000","last_undegraded":"2024-09-12T18:14:16.245909+0000","last_fullsized":"2024-09-12T18:14:16.245909+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:16.245739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:16.245739+0000","last_clean_scrub_stamp":"2024-09-12T18:14:16.245739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:46.217319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'563","reported_seq":1396,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:30.435968+0000","last_change":"2024-09-12T18:14:30.435968+0000","last_active":"2024-09-12T18:14:30.435968+0000","last_peered":"2024-09-12T18:14:30.435968+0000","last_clean":"2024-09-12T18:14:30.435968+0000","last_became_active":"2024-09-12T17:00:22.358335+0000","last_became_peered":"2024-09-12T17:00:22.358335+0000","last_unstale":"2024-09-12T18:14:30.435968+0000","last_undegraded":"2024-09-12T18:14:30.435968+0000","last_fullsized":"2024-09-12T18:14:30.435968+0000","mapping_epoch":34,"log_start":"264'500","ondisk_log_start":"264'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'563","last_scrub_stamp":"2024-09-12T18:14:30.435874+0000","last_deep_scrub":"264'563","last_deep_scrub_stamp":"2024-09-12T18:14:30.435874+0000","last_clean_scrub_stamp":"2024-09-12T18:14:30.435874+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:20.170885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1357,"num_read_kb":1346,"num_write":1162,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'63","reported_seq":638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.872058+0000","last_change":"2024-09-12T18:14:02.872058+0000","last_active":"2024-09-12T18:14:02.872058+0000","last_peered":"2024-09-12T18:14:02.872058+0000","last_clean":"2024-09-12T18:14:02.872058+0000","last_became_active":"2024-09-12T17:00:14.335783+0000","last_became_peered":"2024-09-12T17:00:14.335783+0000","last_unstale":"2024-09-12T18:14:02.872058+0000","last_undegraded":"2024-09-12T18:14:02.872058+0000","last_fullsized":"2024-09-12T18:14:02.872058+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'63","last_scrub_stamp":"2024-09-12T18:14:02.871975+0000","last_deep_scrub":"264'63","last_deep_scrub_stamp":"2024-09-12T18:14:02.871975+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.871975+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:08.824516+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":238,"num_write":99,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'411","reported_seq":1151,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.203673+0000","last_change":"2024-09-12T18:14:01.203613+0000","last_active":"2024-09-12T18:14:01.203673+0000","last_peered":"2024-09-12T18:14:01.203673+0000","last_clean":"2024-09-12T18:14:01.203673+0000","last_became_active":"2024-09-12T17:00:12.307222+0000","last_became_peered":"2024-09-12T17:00:12.307222+0000","last_unstale":"2024-09-12T18:14:01.203673+0000","last_undegraded":"2024-09-12T18:14:01.203673+0000","last_fullsized":"2024-09-12T18:14:01.203673+0000","mapping_epoch":24,"log_start":"264'400","ondisk_log_start":"264'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'411","last_scrub_stamp":"2024-09-12T18:14:01.203510+0000","last_deep_scrub":"264'411","last_deep_scrub_stamp":"2024-09-12T18:14:01.203510+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.203510+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:03.740833+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":853,"num_read_kb":14510,"num_write":1377,"num_write_kb":34813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.081210+0000","last_change":"2024-09-12T18:14:03.081210+0000","last_active":"2024-09-12T18:14:03.081210+0000","last_peered":"2024-09-12T18:14:03.081210+0000","last_clean":"2024-09-12T18:14:03.081210+0000","last_became_active":"2024-09-12T17:00:16.322917+0000","last_became_peered":"2024-09-12T17:00:16.322917+0000","last_unstale":"2024-09-12T18:14:03.081210+0000","last_undegraded":"2024-09-12T18:14:03.081210+0000","last_fullsized":"2024-09-12T18:14:03.081210+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:03.081128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:03.081128+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.081128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:19.186349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'273","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:19.963269+0000","last_change":"2024-09-12T18:14:19.963185+0000","last_active":"2024-09-12T18:14:19.963269+0000","last_peered":"2024-09-12T18:14:19.963269+0000","last_clean":"2024-09-12T18:14:19.963269+0000","last_became_active":"2024-09-12T17:00:18.326791+0000","last_became_peered":"2024-09-12T17:00:18.326791+0000","last_unstale":"2024-09-12T18:14:19.963269+0000","last_undegraded":"2024-09-12T18:14:19.963269+0000","last_fullsized":"2024-09-12T18:14:19.963269+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'273","last_scrub_stamp":"2024-09-12T18:14:19.963085+0000","last_deep_scrub":"264'273","last_deep_scrub_stamp":"2024-09-12T18:14:19.963085+0000","last_clean_scrub_stamp":"2024-09-12T18:14:19.963085+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:52.889955+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43451,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":428,"num_read_kb":949,"num_write":338,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:29.805723+0000","last_change":"2024-09-12T18:14:29.805723+0000","last_active":"2024-09-12T18:14:29.805723+0000","last_peered":"2024-09-12T18:14:29.805723+0000","last_clean":"2024-09-12T18:14:29.805723+0000","last_became_active":"2024-09-12T17:00:20.353959+0000","last_became_peered":"2024-09-12T17:00:20.353959+0000","last_unstale":"2024-09-12T18:14:29.805723+0000","last_undegraded":"2024-09-12T18:14:29.805723+0000","last_fullsized":"2024-09-12T18:14:29.805723+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:29.805634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:29.805634+0000","last_clean_scrub_stamp":"2024-09-12T18:14:29.805634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:49.384223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'2409","reported_seq":4240,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:19.233622+0000","last_change":"2024-09-12T18:14:19.233622+0000","last_active":"2024-09-12T18:14:19.233622+0000","last_peered":"2024-09-12T18:14:19.233622+0000","last_clean":"2024-09-12T18:14:19.233622+0000","last_became_active":"2024-09-12T17:00:22.355651+0000","last_became_peered":"2024-09-12T17:00:22.355651+0000","last_unstale":"2024-09-12T18:14:19.233622+0000","last_undegraded":"2024-09-12T18:14:19.233622+0000","last_fullsized":"2024-09-12T18:14:19.233622+0000","mapping_epoch":34,"log_start":"264'2300","ondisk_log_start":"264'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2409","last_scrub_stamp":"2024-09-12T18:14:19.233517+0000","last_deep_scrub":"264'2409","last_deep_scrub_stamp":"2024-09-12T18:14:19.233517+0000","last_clean_scrub_stamp":"2024-09-12T18:14:19.233517+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":2300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:52:18.529817+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6022,"num_read_kb":6027,"num_write":4838,"num_write_kb":1790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'196","reported_seq":784,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.998772+0000","last_change":"2024-09-12T18:14:06.998699+0000","last_active":"2024-09-12T18:14:06.998772+0000","last_peered":"2024-09-12T18:14:06.998772+0000","last_clean":"2024-09-12T18:14:06.998772+0000","last_became_active":"2024-09-12T17:00:14.321270+0000","last_became_peered":"2024-09-12T17:00:14.321270+0000","last_unstale":"2024-09-12T18:14:06.998772+0000","last_undegraded":"2024-09-12T18:14:06.998772+0000","last_fullsized":"2024-09-12T18:14:06.998772+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'196","last_scrub_stamp":"2024-09-12T18:14:06.998613+0000","last_deep_scrub":"264'196","last_deep_scrub_stamp":"2024-09-12T18:14:06.998613+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.998613+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:01.248687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":834,"num_read_kb":668,"num_write":296,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'325","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.185437+0000","last_change":"2024-09-12T18:14:04.185362+0000","last_active":"2024-09-12T18:14:04.185437+0000","last_peered":"2024-09-12T18:14:04.185437+0000","last_clean":"2024-09-12T18:14:04.185437+0000","last_became_active":"2024-09-12T17:00:12.313262+0000","last_became_peered":"2024-09-12T17:00:12.313262+0000","last_unstale":"2024-09-12T18:14:04.185437+0000","last_undegraded":"2024-09-12T18:14:04.185437+0000","last_fullsized":"2024-09-12T18:14:04.185437+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'325","last_scrub_stamp":"2024-09-12T18:14:04.185253+0000","last_deep_scrub":"264'325","last_deep_scrub_stamp":"2024-09-12T18:14:04.185253+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.185253+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:59.905385+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":514296,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":454,"num_read_kb":16364,"num_write":986,"num_write_kb":27335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.184742+0000","last_change":"2024-09-12T18:14:07.184651+0000","last_active":"2024-09-12T18:14:07.184742+0000","last_peered":"2024-09-12T18:14:07.184742+0000","last_clean":"2024-09-12T18:14:07.184742+0000","last_became_active":"2024-09-12T17:00:16.321641+0000","last_became_peered":"2024-09-12T17:00:16.321641+0000","last_unstale":"2024-09-12T18:14:07.184742+0000","last_undegraded":"2024-09-12T18:14:07.184742+0000","last_fullsized":"2024-09-12T18:14:07.184742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:07.184519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:07.184519+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.184519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:04.109723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'345","reported_seq":959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:21.432871+0000","last_change":"2024-09-12T18:14:21.432871+0000","last_active":"2024-09-12T18:14:21.432871+0000","last_peered":"2024-09-12T18:14:21.432871+0000","last_clean":"2024-09-12T18:14:21.432871+0000","last_became_active":"2024-09-12T17:00:18.331707+0000","last_became_peered":"2024-09-12T17:00:18.331707+0000","last_unstale":"2024-09-12T18:14:21.432871+0000","last_undegraded":"2024-09-12T18:14:21.432871+0000","last_fullsized":"2024-09-12T18:14:21.432871+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'345","last_scrub_stamp":"2024-09-12T18:14:21.432771+0000","last_deep_scrub":"264'345","last_deep_scrub_stamp":"2024-09-12T18:14:21.432771+0000","last_clean_scrub_stamp":"2024-09-12T18:14:21.432771+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:36.257707+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47689,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":552,"num_read_kb":1215,"num_write":436,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'766","reported_seq":2737,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:27.262444+0000","last_change":"2024-09-12T18:14:27.262444+0000","last_active":"2024-09-12T18:14:27.262444+0000","last_peered":"2024-09-12T18:14:27.262444+0000","last_clean":"2024-09-12T18:14:27.262444+0000","last_became_active":"2024-09-12T17:00:20.348227+0000","last_became_peered":"2024-09-12T17:00:20.348227+0000","last_unstale":"2024-09-12T18:14:27.262444+0000","last_undegraded":"2024-09-12T18:14:27.262444+0000","last_fullsized":"2024-09-12T18:14:27.262444+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'766","last_scrub_stamp":"2024-09-12T18:14:27.262358+0000","last_deep_scrub":"264'766","last_deep_scrub_stamp":"2024-09-12T18:14:27.262358+0000","last_clean_scrub_stamp":"2024-09-12T18:14:27.262358+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:48.519225+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'116","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:28.274619+0000","last_change":"2024-09-12T18:14:28.274619+0000","last_active":"2024-09-12T18:14:28.274619+0000","last_peered":"2024-09-12T18:14:28.274619+0000","last_clean":"2024-09-12T18:14:28.274619+0000","last_became_active":"2024-09-12T17:00:22.353172+0000","last_became_peered":"2024-09-12T17:00:22.353172+0000","last_unstale":"2024-09-12T18:14:28.274619+0000","last_undegraded":"2024-09-12T18:14:28.274619+0000","last_fullsized":"2024-09-12T18:14:28.274619+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'116","last_scrub_stamp":"2024-09-12T18:14:28.274507+0000","last_deep_scrub":"264'116","last_deep_scrub_stamp":"2024-09-12T18:14:28.274507+0000","last_clean_scrub_stamp":"2024-09-12T18:14:28.274507+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:11.779233+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":136,"num_write":299,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'231","reported_seq":894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.156956+0000","last_change":"2024-09-12T18:14:08.156892+0000","last_active":"2024-09-12T18:14:08.156956+0000","last_peered":"2024-09-12T18:14:08.156956+0000","last_clean":"2024-09-12T18:14:08.156956+0000","last_became_active":"2024-09-12T17:00:14.324823+0000","last_became_peered":"2024-09-12T17:00:14.324823+0000","last_unstale":"2024-09-12T18:14:08.156956+0000","last_undegraded":"2024-09-12T18:14:08.156956+0000","last_fullsized":"2024-09-12T18:14:08.156956+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'231","last_scrub_stamp":"2024-09-12T18:14:08.156786+0000","last_deep_scrub":"264'231","last_deep_scrub_stamp":"2024-09-12T18:14:08.156786+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.156786+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:05.486389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1013,"num_read_kb":830,"num_write":393,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'409","reported_seq":1106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.506501+0000","last_change":"2024-09-12T18:14:00.506441+0000","last_active":"2024-09-12T18:14:00.506501+0000","last_peered":"2024-09-12T18:14:00.506501+0000","last_clean":"2024-09-12T18:14:00.506501+0000","last_became_active":"2024-09-12T17:00:12.318599+0000","last_became_peered":"2024-09-12T17:00:12.318599+0000","last_unstale":"2024-09-12T18:14:00.506501+0000","last_undegraded":"2024-09-12T18:14:00.506501+0000","last_fullsized":"2024-09-12T18:14:00.506501+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'409","last_scrub_stamp":"2024-09-12T18:14:00.506341+0000","last_deep_scrub":"264'409","last_deep_scrub_stamp":"2024-09-12T18:14:00.506341+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.506341+0000","objects_scrubbed":10,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:44.930843+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850207,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":687,"num_read_kb":44825,"num_write":1169,"num_write_kb":32428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.143934+0000","last_change":"2024-09-12T18:14:08.143874+0000","last_active":"2024-09-12T18:14:08.143934+0000","last_peered":"2024-09-12T18:14:08.143934+0000","last_clean":"2024-09-12T18:14:08.143934+0000","last_became_active":"2024-09-12T17:00:16.328352+0000","last_became_peered":"2024-09-12T17:00:16.328352+0000","last_unstale":"2024-09-12T18:14:08.143934+0000","last_undegraded":"2024-09-12T18:14:08.143934+0000","last_fullsized":"2024-09-12T18:14:08.143934+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:08.143773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:08.143773+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.143773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:58.048888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'482","reported_seq":1148,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:19.289062+0000","last_change":"2024-09-12T18:14:19.289062+0000","last_active":"2024-09-12T18:14:19.289062+0000","last_peered":"2024-09-12T18:14:19.289062+0000","last_clean":"2024-09-12T18:14:19.289062+0000","last_became_active":"2024-09-12T17:00:18.329414+0000","last_became_peered":"2024-09-12T17:00:18.329414+0000","last_unstale":"2024-09-12T18:14:19.289062+0000","last_undegraded":"2024-09-12T18:14:19.289062+0000","last_fullsized":"2024-09-12T18:14:19.289062+0000","mapping_epoch":30,"log_start":"264'400","ondisk_log_start":"264'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'482","last_scrub_stamp":"2024-09-12T18:14:19.288972+0000","last_deep_scrub":"264'482","last_deep_scrub_stamp":"2024-09-12T18:14:19.288972+0000","last_clean_scrub_stamp":"2024-09-12T18:14:19.288972+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:03.670071+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60099,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":839,"num_read_kb":2047,"num_write":682,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.106469+0000","last_change":"2024-09-12T18:14:13.106469+0000","last_active":"2024-09-12T18:14:13.106469+0000","last_peered":"2024-09-12T18:14:13.106469+0000","last_clean":"2024-09-12T18:14:13.106469+0000","last_became_active":"2024-09-12T17:00:20.352249+0000","last_became_peered":"2024-09-12T17:00:20.352249+0000","last_unstale":"2024-09-12T18:14:13.106469+0000","last_undegraded":"2024-09-12T18:14:13.106469+0000","last_fullsized":"2024-09-12T18:14:13.106469+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:13.106375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:13.106375+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.106375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:50.311270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'179","reported_seq":721,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:22.241611+0000","last_change":"2024-09-12T18:14:22.241611+0000","last_active":"2024-09-12T18:14:22.241611+0000","last_peered":"2024-09-12T18:14:22.241611+0000","last_clean":"2024-09-12T18:14:22.241611+0000","last_became_active":"2024-09-12T17:00:22.355850+0000","last_became_peered":"2024-09-12T17:00:22.355850+0000","last_unstale":"2024-09-12T18:14:22.241611+0000","last_undegraded":"2024-09-12T18:14:22.241611+0000","last_fullsized":"2024-09-12T18:14:22.241611+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-09-12T18:14:22.241519+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-09-12T18:14:22.241519+0000","last_clean_scrub_stamp":"2024-09-12T18:14:22.241519+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:24.072903+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":278,"num_read_kb":264,"num_write":436,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'144","reported_seq":760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.917152+0000","last_change":"2024-09-12T18:14:03.917096+0000","last_active":"2024-09-12T18:14:03.917152+0000","last_peered":"2024-09-12T18:14:03.917152+0000","last_clean":"2024-09-12T18:14:03.917152+0000","last_became_active":"2024-09-12T17:00:14.334594+0000","last_became_peered":"2024-09-12T17:00:14.334594+0000","last_unstale":"2024-09-12T18:14:03.917152+0000","last_undegraded":"2024-09-12T18:14:03.917152+0000","last_fullsized":"2024-09-12T18:14:03.917152+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'144","last_scrub_stamp":"2024-09-12T18:14:03.917002+0000","last_deep_scrub":"264'144","last_deep_scrub_stamp":"2024-09-12T18:14:03.917002+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.917002+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:28.774783+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":624,"num_read_kb":516,"num_write":207,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'348","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:56.926940+0000","last_change":"2024-09-12T18:13:56.926852+0000","last_active":"2024-09-12T18:13:56.926940+0000","last_peered":"2024-09-12T18:13:56.926940+0000","last_clean":"2024-09-12T18:13:56.926940+0000","last_became_active":"2024-09-12T17:00:12.314509+0000","last_became_peered":"2024-09-12T17:00:12.314509+0000","last_unstale":"2024-09-12T18:13:56.926940+0000","last_undegraded":"2024-09-12T18:13:56.926940+0000","last_fullsized":"2024-09-12T18:13:56.926940+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'348","last_scrub_stamp":"2024-09-12T18:13:56.926498+0000","last_deep_scrub":"264'348","last_deep_scrub_stamp":"2024-09-12T18:13:56.926498+0000","last_clean_scrub_stamp":"2024-09-12T18:13:56.926498+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:36.730340+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2180125,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":439,"num_read_kb":51555,"num_write":1035,"num_write_kb":32245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.184733+0000","last_change":"2024-09-12T18:14:10.184661+0000","last_active":"2024-09-12T18:14:10.184733+0000","last_peered":"2024-09-12T18:14:10.184733+0000","last_clean":"2024-09-12T18:14:10.184733+0000","last_became_active":"2024-09-12T17:00:16.319269+0000","last_became_peered":"2024-09-12T17:00:16.319269+0000","last_unstale":"2024-09-12T18:14:10.184733+0000","last_undegraded":"2024-09-12T18:14:10.184733+0000","last_fullsized":"2024-09-12T18:14:10.184733+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:10.184575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:10.184575+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.184575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:10.584698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'302","reported_seq":908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:21.891284+0000","last_change":"2024-09-12T18:14:21.891215+0000","last_active":"2024-09-12T18:14:21.891284+0000","last_peered":"2024-09-12T18:14:21.891284+0000","last_clean":"2024-09-12T18:14:21.891284+0000","last_became_active":"2024-09-12T17:00:18.330634+0000","last_became_peered":"2024-09-12T17:00:18.330634+0000","last_unstale":"2024-09-12T18:14:21.891284+0000","last_undegraded":"2024-09-12T18:14:21.891284+0000","last_fullsized":"2024-09-12T18:14:21.891284+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'302","last_scrub_stamp":"2024-09-12T18:14:21.891090+0000","last_deep_scrub":"264'302","last_deep_scrub_stamp":"2024-09-12T18:14:21.891090+0000","last_clean_scrub_stamp":"2024-09-12T18:14:21.891090+0000","objects_scrubbed":7,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:21.260428+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48221,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":495,"num_read_kb":1035,"num_write":432,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:24.194293+0000","last_change":"2024-09-12T18:14:24.194175+0000","last_active":"2024-09-12T18:14:24.194293+0000","last_peered":"2024-09-12T18:14:24.194293+0000","last_clean":"2024-09-12T18:14:24.194293+0000","last_became_active":"2024-09-12T17:00:20.351001+0000","last_became_peered":"2024-09-12T17:00:20.351001+0000","last_unstale":"2024-09-12T18:14:24.194293+0000","last_undegraded":"2024-09-12T18:14:24.194293+0000","last_fullsized":"2024-09-12T18:14:24.194293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:24.194064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:24.194064+0000","last_clean_scrub_stamp":"2024-09-12T18:14:24.194064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:58.960227+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'125","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:31.843679+0000","last_change":"2024-09-12T18:14:31.843577+0000","last_active":"2024-09-12T18:14:31.843679+0000","last_peered":"2024-09-12T18:14:31.843679+0000","last_clean":"2024-09-12T18:14:31.843679+0000","last_became_active":"2024-09-12T17:00:22.357001+0000","last_became_peered":"2024-09-12T17:00:22.357001+0000","last_unstale":"2024-09-12T18:14:31.843679+0000","last_undegraded":"2024-09-12T18:14:31.843679+0000","last_fullsized":"2024-09-12T18:14:31.843679+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'125","last_scrub_stamp":"2024-09-12T18:14:31.843463+0000","last_deep_scrub":"264'125","last_deep_scrub_stamp":"2024-09-12T18:14:31.843463+0000","last_clean_scrub_stamp":"2024-09-12T18:14:31.843463+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:17.402238+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":156,"num_write":307,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'263","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.957494+0000","last_change":"2024-09-12T18:14:04.957402+0000","last_active":"2024-09-12T18:14:04.957494+0000","last_peered":"2024-09-12T18:14:04.957494+0000","last_clean":"2024-09-12T18:14:04.957494+0000","last_became_active":"2024-09-12T17:00:14.320928+0000","last_became_peered":"2024-09-12T17:00:14.320928+0000","last_unstale":"2024-09-12T18:14:04.957494+0000","last_undegraded":"2024-09-12T18:14:04.957494+0000","last_fullsized":"2024-09-12T18:14:04.957494+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'263","last_scrub_stamp":"2024-09-12T18:14:04.957288+0000","last_deep_scrub":"264'263","last_deep_scrub_stamp":"2024-09-12T18:14:04.957288+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.957288+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:04.198862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1139,"num_read_kb":929,"num_write":426,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'361","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.038411+0000","last_change":"2024-09-12T18:14:00.038340+0000","last_active":"2024-09-12T18:14:00.038411+0000","last_peered":"2024-09-12T18:14:00.038411+0000","last_clean":"2024-09-12T18:14:00.038411+0000","last_became_active":"2024-09-12T17:00:12.308967+0000","last_became_peered":"2024-09-12T17:00:12.308967+0000","last_unstale":"2024-09-12T18:14:00.038411+0000","last_undegraded":"2024-09-12T18:14:00.038411+0000","last_fullsized":"2024-09-12T18:14:00.038411+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'361","last_scrub_stamp":"2024-09-12T18:14:00.038240+0000","last_deep_scrub":"264'361","last_deep_scrub_stamp":"2024-09-12T18:14:00.038240+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.038240+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:42.694292+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549696,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":120658,"num_write":1095,"num_write_kb":55796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.118915+0000","last_change":"2024-09-12T18:14:10.118839+0000","last_active":"2024-09-12T18:14:10.118915+0000","last_peered":"2024-09-12T18:14:10.118915+0000","last_clean":"2024-09-12T18:14:10.118915+0000","last_became_active":"2024-09-12T17:00:16.329596+0000","last_became_peered":"2024-09-12T17:00:16.329596+0000","last_unstale":"2024-09-12T18:14:10.118915+0000","last_undegraded":"2024-09-12T18:14:10.118915+0000","last_fullsized":"2024-09-12T18:14:10.118915+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:10.118740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:10.118740+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.118740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:07.683997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'350","reported_seq":968,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.163547+0000","last_change":"2024-09-12T18:14:11.163418+0000","last_active":"2024-09-12T18:14:11.163547+0000","last_peered":"2024-09-12T18:14:11.163547+0000","last_clean":"2024-09-12T18:14:11.163547+0000","last_became_active":"2024-09-12T17:00:18.331483+0000","last_became_peered":"2024-09-12T17:00:18.331483+0000","last_unstale":"2024-09-12T18:14:11.163547+0000","last_undegraded":"2024-09-12T18:14:11.163547+0000","last_fullsized":"2024-09-12T18:14:11.163547+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-12T18:14:11.163297+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-12T18:14:11.163297+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.163297+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:56.385197+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48847,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":573,"num_read_kb":1293,"num_write":456,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'739","reported_seq":4713,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:15.120851+0000","last_change":"2024-09-12T18:14:15.120778+0000","last_active":"2024-09-12T18:14:15.120851+0000","last_peered":"2024-09-12T18:14:15.120851+0000","last_clean":"2024-09-12T18:14:15.120851+0000","last_became_active":"2024-09-12T17:00:20.352022+0000","last_became_peered":"2024-09-12T17:00:20.352022+0000","last_unstale":"2024-09-12T18:14:15.120851+0000","last_undegraded":"2024-09-12T18:14:15.120851+0000","last_fullsized":"2024-09-12T18:14:15.120851+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'739","last_scrub_stamp":"2024-09-12T18:14:15.120687+0000","last_deep_scrub":"264'739","last_deep_scrub_stamp":"2024-09-12T18:14:15.120687+0000","last_clean_scrub_stamp":"2024-09-12T18:14:15.120687+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:39.722836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'85","reported_seq":605,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:20.223190+0000","last_change":"2024-09-12T18:14:20.223190+0000","last_active":"2024-09-12T18:14:20.223190+0000","last_peered":"2024-09-12T18:14:20.223190+0000","last_clean":"2024-09-12T18:14:20.223190+0000","last_became_active":"2024-09-12T17:00:22.350283+0000","last_became_peered":"2024-09-12T17:00:22.350283+0000","last_unstale":"2024-09-12T18:14:20.223190+0000","last_undegraded":"2024-09-12T18:14:20.223190+0000","last_fullsized":"2024-09-12T18:14:20.223190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'85","last_scrub_stamp":"2024-09-12T18:14:20.223082+0000","last_deep_scrub":"264'85","last_deep_scrub_stamp":"2024-09-12T18:14:20.223082+0000","last_clean_scrub_stamp":"2024-09-12T18:14:20.223082+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:54.745956+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":129,"num_read_kb":121,"num_write":196,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'24","reported_seq":578,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.926271+0000","last_change":"2024-09-12T18:14:05.926204+0000","last_active":"2024-09-12T18:14:05.926271+0000","last_peered":"2024-09-12T18:14:05.926271+0000","last_clean":"2024-09-12T18:14:05.926271+0000","last_became_active":"2024-09-12T17:00:14.325788+0000","last_became_peered":"2024-09-12T17:00:14.325788+0000","last_unstale":"2024-09-12T18:14:05.926271+0000","last_undegraded":"2024-09-12T18:14:05.926271+0000","last_fullsized":"2024-09-12T18:14:05.926271+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-09-12T18:14:05.926108+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-09-12T18:14:05.926108+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.926108+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:59.672862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":96,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'334","reported_seq":1039,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.798217+0000","last_change":"2024-09-12T18:13:59.798217+0000","last_active":"2024-09-12T18:13:59.798217+0000","last_peered":"2024-09-12T18:13:59.798217+0000","last_clean":"2024-09-12T18:13:59.798217+0000","last_became_active":"2024-09-12T17:00:12.309388+0000","last_became_peered":"2024-09-12T17:00:12.309388+0000","last_unstale":"2024-09-12T18:13:59.798217+0000","last_undegraded":"2024-09-12T18:13:59.798217+0000","last_fullsized":"2024-09-12T18:13:59.798217+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'334","last_scrub_stamp":"2024-09-12T18:13:59.798123+0000","last_deep_scrub":"264'334","last_deep_scrub_stamp":"2024-09-12T18:13:59.798123+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.798123+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:12.466059+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3573814,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":548,"num_read_kb":20473,"num_write":1106,"num_write_kb":21258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:19.375377+0000","last_change":"2024-09-12T18:14:19.375270+0000","last_active":"2024-09-12T18:14:19.375377+0000","last_peered":"2024-09-12T18:14:19.375377+0000","last_clean":"2024-09-12T18:14:19.375377+0000","last_became_active":"2024-09-12T17:00:16.330035+0000","last_became_peered":"2024-09-12T17:00:16.330035+0000","last_unstale":"2024-09-12T18:14:19.375377+0000","last_undegraded":"2024-09-12T18:14:19.375377+0000","last_fullsized":"2024-09-12T18:14:19.375377+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:14:19.375155+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:14:19.375155+0000","last_clean_scrub_stamp":"2024-09-12T18:14:19.375155+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:02.164761+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'107","reported_seq":651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:21.964109+0000","last_change":"2024-09-12T18:14:21.964031+0000","last_active":"2024-09-12T18:14:21.964109+0000","last_peered":"2024-09-12T18:14:21.964109+0000","last_clean":"2024-09-12T18:14:21.964109+0000","last_became_active":"2024-09-12T17:00:18.429253+0000","last_became_peered":"2024-09-12T17:00:18.429253+0000","last_unstale":"2024-09-12T18:14:21.964109+0000","last_undegraded":"2024-09-12T18:14:21.964109+0000","last_fullsized":"2024-09-12T18:14:21.964109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-09-12T18:14:21.963939+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-09-12T18:14:21.963939+0000","last_clean_scrub_stamp":"2024-09-12T18:14:21.963939+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:34.121435+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'784","reported_seq":2542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:16.232299+0000","last_change":"2024-09-12T18:14:16.232241+0000","last_active":"2024-09-12T18:14:16.232299+0000","last_peered":"2024-09-12T18:14:16.232299+0000","last_clean":"2024-09-12T18:14:16.232299+0000","last_became_active":"2024-09-12T17:00:20.352792+0000","last_became_peered":"2024-09-12T17:00:20.352792+0000","last_unstale":"2024-09-12T18:14:16.232299+0000","last_undegraded":"2024-09-12T18:14:16.232299+0000","last_fullsized":"2024-09-12T18:14:16.232299+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'784","last_scrub_stamp":"2024-09-12T18:14:16.232145+0000","last_deep_scrub":"264'784","last_deep_scrub_stamp":"2024-09-12T18:14:16.232145+0000","last_clean_scrub_stamp":"2024-09-12T18:14:16.232145+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:01.862114+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'112","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:29.870180+0000","last_change":"2024-09-12T18:14:29.870180+0000","last_active":"2024-09-12T18:14:29.870180+0000","last_peered":"2024-09-12T18:14:29.870180+0000","last_clean":"2024-09-12T18:14:29.870180+0000","last_became_active":"2024-09-12T17:00:22.352182+0000","last_became_peered":"2024-09-12T17:00:22.352182+0000","last_unstale":"2024-09-12T18:14:29.870180+0000","last_undegraded":"2024-09-12T18:14:29.870180+0000","last_fullsized":"2024-09-12T18:14:29.870180+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-09-12T18:14:29.870096+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-09-12T18:14:29.870096+0000","last_clean_scrub_stamp":"2024-09-12T18:14:29.870096+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:28.046772+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":119,"num_write":244,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'121","reported_seq":775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.105426+0000","last_change":"2024-09-12T18:14:06.105357+0000","last_active":"2024-09-12T18:14:06.105426+0000","last_peered":"2024-09-12T18:14:06.105426+0000","last_clean":"2024-09-12T18:14:06.105426+0000","last_became_active":"2024-09-12T17:00:14.329394+0000","last_became_peered":"2024-09-12T17:00:14.329394+0000","last_unstale":"2024-09-12T18:14:06.105426+0000","last_undegraded":"2024-09-12T18:14:06.105426+0000","last_fullsized":"2024-09-12T18:14:06.105426+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'121","last_scrub_stamp":"2024-09-12T18:14:06.105271+0000","last_deep_scrub":"264'121","last_deep_scrub_stamp":"2024-09-12T18:14:06.105271+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.105271+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:06.164775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":562,"num_read_kb":483,"num_write":177,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'420","reported_seq":1118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.979078+0000","last_change":"2024-09-12T18:13:59.979078+0000","last_active":"2024-09-12T18:13:59.979078+0000","last_peered":"2024-09-12T18:13:59.979078+0000","last_clean":"2024-09-12T18:13:59.979078+0000","last_became_active":"2024-09-12T17:00:12.314142+0000","last_became_peered":"2024-09-12T17:00:12.314142+0000","last_unstale":"2024-09-12T18:13:59.979078+0000","last_undegraded":"2024-09-12T18:13:59.979078+0000","last_fullsized":"2024-09-12T18:13:59.979078+0000","mapping_epoch":24,"log_start":"264'400","ondisk_log_start":"264'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'420","last_scrub_stamp":"2024-09-12T18:13:59.978965+0000","last_deep_scrub":"264'420","last_deep_scrub_stamp":"2024-09-12T18:13:59.978965+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.978965+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:13.441168+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306453,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":807,"num_read_kb":14993,"num_write":1145,"num_write_kb":29270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:18.797551+0000","last_change":"2024-09-12T18:14:18.797485+0000","last_active":"2024-09-12T18:14:18.797551+0000","last_peered":"2024-09-12T18:14:18.797551+0000","last_clean":"2024-09-12T18:14:18.797551+0000","last_became_active":"2024-09-12T17:00:16.328306+0000","last_became_peered":"2024-09-12T17:00:16.328306+0000","last_unstale":"2024-09-12T18:14:18.797551+0000","last_undegraded":"2024-09-12T18:14:18.797551+0000","last_fullsized":"2024-09-12T18:14:18.797551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:18.797397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:18.797397+0000","last_clean_scrub_stamp":"2024-09-12T18:14:18.797397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:18.136486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'396","reported_seq":1038,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:25.475237+0000","last_change":"2024-09-12T18:14:25.475175+0000","last_active":"2024-09-12T18:14:25.475237+0000","last_peered":"2024-09-12T18:14:25.475237+0000","last_clean":"2024-09-12T18:14:25.475237+0000","last_became_active":"2024-09-12T17:00:18.328500+0000","last_became_peered":"2024-09-12T17:00:18.328500+0000","last_unstale":"2024-09-12T18:14:25.475237+0000","last_undegraded":"2024-09-12T18:14:25.475237+0000","last_fullsized":"2024-09-12T18:14:25.475237+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'396","last_scrub_stamp":"2024-09-12T18:14:25.475080+0000","last_deep_scrub":"264'396","last_deep_scrub_stamp":"2024-09-12T18:14:25.475080+0000","last_clean_scrub_stamp":"2024-09-12T18:14:25.475080+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:49.731826+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46864,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":620,"num_read_kb":1249,"num_write":480,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:15.221543+0000","last_change":"2024-09-12T18:14:15.221487+0000","last_active":"2024-09-12T18:14:15.221543+0000","last_peered":"2024-09-12T18:14:15.221543+0000","last_clean":"2024-09-12T18:14:15.221543+0000","last_became_active":"2024-09-12T17:00:20.350003+0000","last_became_peered":"2024-09-12T17:00:20.350003+0000","last_unstale":"2024-09-12T18:14:15.221543+0000","last_undegraded":"2024-09-12T18:14:15.221543+0000","last_fullsized":"2024-09-12T18:14:15.221543+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:15.221371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:15.221371+0000","last_clean_scrub_stamp":"2024-09-12T18:14:15.221371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:14.433881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'132","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:21.202488+0000","last_change":"2024-09-12T18:14:21.202488+0000","last_active":"2024-09-12T18:14:21.202488+0000","last_peered":"2024-09-12T18:14:21.202488+0000","last_clean":"2024-09-12T18:14:21.202488+0000","last_became_active":"2024-09-12T17:00:22.354601+0000","last_became_peered":"2024-09-12T17:00:22.354601+0000","last_unstale":"2024-09-12T18:14:21.202488+0000","last_undegraded":"2024-09-12T18:14:21.202488+0000","last_fullsized":"2024-09-12T18:14:21.202488+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'132","last_scrub_stamp":"2024-09-12T18:14:21.202400+0000","last_deep_scrub":"264'132","last_deep_scrub_stamp":"2024-09-12T18:14:21.202400+0000","last_clean_scrub_stamp":"2024-09-12T18:14:21.202400+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:03.285432+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":184,"num_read_kb":175,"num_write":297,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'263","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.038272+0000","last_change":"2024-09-12T18:14:06.038272+0000","last_active":"2024-09-12T18:14:06.038272+0000","last_peered":"2024-09-12T18:14:06.038272+0000","last_clean":"2024-09-12T18:14:06.038272+0000","last_became_active":"2024-09-12T17:00:14.329297+0000","last_became_peered":"2024-09-12T17:00:14.329297+0000","last_unstale":"2024-09-12T18:14:06.038272+0000","last_undegraded":"2024-09-12T18:14:06.038272+0000","last_fullsized":"2024-09-12T18:14:06.038272+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'263","last_scrub_stamp":"2024-09-12T18:14:06.038186+0000","last_deep_scrub":"264'263","last_deep_scrub_stamp":"2024-09-12T18:14:06.038186+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.038186+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:05.593867+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1103,"num_read_kb":898,"num_write":417,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.163457+0000","last_change":"2024-09-12T18:13:58.163398+0000","last_active":"2024-09-12T18:13:58.163457+0000","last_peered":"2024-09-12T18:13:58.163457+0000","last_clean":"2024-09-12T18:13:58.163457+0000","last_became_active":"2024-09-12T16:59:54.636487+0000","last_became_peered":"2024-09-12T16:59:54.636487+0000","last_unstale":"2024-09-12T18:13:58.163457+0000","last_undegraded":"2024-09-12T18:13:58.163457+0000","last_fullsized":"2024-09-12T18:13:58.163457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-12T18:13:58.163290+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-12T18:13:58.163290+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.163290+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:28.159963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":540,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.475215+0000","last_change":"2024-09-12T18:13:58.475103+0000","last_active":"2024-09-12T18:13:58.475215+0000","last_peered":"2024-09-12T18:13:58.475215+0000","last_clean":"2024-09-12T18:13:58.475215+0000","last_became_active":"2024-09-12T17:00:00.669728+0000","last_became_peered":"2024-09-12T17:00:00.669728+0000","last_unstale":"2024-09-12T18:13:58.475215+0000","last_undegraded":"2024-09-12T18:13:58.475215+0000","last_fullsized":"2024-09-12T18:13:58.475215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:13:58.475005+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:13:58.475005+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.475005+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:02.835560+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00058116500000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'384","reported_seq":1079,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.120325+0000","last_change":"2024-09-12T18:13:58.120325+0000","last_active":"2024-09-12T18:13:58.120325+0000","last_peered":"2024-09-12T18:13:58.120325+0000","last_clean":"2024-09-12T18:13:58.120325+0000","last_became_active":"2024-09-12T17:00:46.404905+0000","last_became_peered":"2024-09-12T17:00:46.404905+0000","last_unstale":"2024-09-12T18:13:58.120325+0000","last_undegraded":"2024-09-12T18:13:58.120325+0000","last_fullsized":"2024-09-12T18:13:58.120325+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'384","last_scrub_stamp":"2024-09-12T18:13:58.120248+0000","last_deep_scrub":"264'384","last_deep_scrub_stamp":"2024-09-12T18:13:58.120248+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.120248+0000","objects_scrubbed":7,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:48.874148+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524314,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":662,"num_read_kb":82700,"num_write":1255,"num_write_kb":21344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:16.314385+0000","last_change":"2024-09-12T18:14:16.314317+0000","last_active":"2024-09-12T18:14:16.314385+0000","last_peered":"2024-09-12T18:14:16.314385+0000","last_clean":"2024-09-12T18:14:16.314385+0000","last_became_active":"2024-09-12T17:00:16.321151+0000","last_became_peered":"2024-09-12T17:00:16.321151+0000","last_unstale":"2024-09-12T18:14:16.314385+0000","last_undegraded":"2024-09-12T18:14:16.314385+0000","last_fullsized":"2024-09-12T18:14:16.314385+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:16.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:16.314230+0000","last_clean_scrub_stamp":"2024-09-12T18:14:16.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:30.567163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'761","reported_seq":1488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:23.500341+0000","last_change":"2024-09-12T18:14:23.500341+0000","last_active":"2024-09-12T18:14:23.500341+0000","last_peered":"2024-09-12T18:14:23.500341+0000","last_clean":"2024-09-12T18:14:23.500341+0000","last_became_active":"2024-09-12T17:00:18.330037+0000","last_became_peered":"2024-09-12T17:00:18.330037+0000","last_unstale":"2024-09-12T18:14:23.500341+0000","last_undegraded":"2024-09-12T18:14:23.500341+0000","last_fullsized":"2024-09-12T18:14:23.500341+0000","mapping_epoch":30,"log_start":"264'700","ondisk_log_start":"264'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'761","last_scrub_stamp":"2024-09-12T18:14:23.500228+0000","last_deep_scrub":"264'761","last_deep_scrub_stamp":"2024-09-12T18:14:23.500228+0000","last_clean_scrub_stamp":"2024-09-12T18:14:23.500228+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:19.444656+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153681,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1487,"num_read_kb":3466,"num_write":1434,"num_write_kb":1274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106952,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:23.229062+0000","last_change":"2024-09-12T18:14:23.229062+0000","last_active":"2024-09-12T18:14:23.229062+0000","last_peered":"2024-09-12T18:14:23.229062+0000","last_clean":"2024-09-12T18:14:23.229062+0000","last_became_active":"2024-09-12T17:00:20.349363+0000","last_became_peered":"2024-09-12T17:00:20.349363+0000","last_unstale":"2024-09-12T18:14:23.229062+0000","last_undegraded":"2024-09-12T18:14:23.229062+0000","last_fullsized":"2024-09-12T18:14:23.229062+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:23.228974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:23.228974+0000","last_clean_scrub_stamp":"2024-09-12T18:14:23.228974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:43.524040+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'190","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:21.241770+0000","last_change":"2024-09-12T18:14:21.241770+0000","last_active":"2024-09-12T18:14:21.241770+0000","last_peered":"2024-09-12T18:14:21.241770+0000","last_clean":"2024-09-12T18:14:21.241770+0000","last_became_active":"2024-09-12T17:00:22.354654+0000","last_became_peered":"2024-09-12T17:00:22.354654+0000","last_unstale":"2024-09-12T18:14:21.241770+0000","last_undegraded":"2024-09-12T18:14:21.241770+0000","last_fullsized":"2024-09-12T18:14:21.241770+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-09-12T18:14:21.241675+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-09-12T18:14:21.241675+0000","last_clean_scrub_stamp":"2024-09-12T18:14:21.241675+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:19.848903+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":450,"num_read_kb":449,"num_write":373,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'132","reported_seq":751,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.085111+0000","last_change":"2024-09-12T18:14:05.085111+0000","last_active":"2024-09-12T18:14:05.085111+0000","last_peered":"2024-09-12T18:14:05.085111+0000","last_clean":"2024-09-12T18:14:05.085111+0000","last_became_active":"2024-09-12T17:00:14.319539+0000","last_became_peered":"2024-09-12T17:00:14.319539+0000","last_unstale":"2024-09-12T18:14:05.085111+0000","last_undegraded":"2024-09-12T18:14:05.085111+0000","last_fullsized":"2024-09-12T18:14:05.085111+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'132","last_scrub_stamp":"2024-09-12T18:14:05.085020+0000","last_deep_scrub":"264'132","last_deep_scrub_stamp":"2024-09-12T18:14:05.085020+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.085020+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:53.322244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":596,"num_read_kb":500,"num_write":197,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":534,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.182307+0000","last_change":"2024-09-12T18:13:59.182258+0000","last_active":"2024-09-12T18:13:59.182307+0000","last_peered":"2024-09-12T18:13:59.182307+0000","last_clean":"2024-09-12T18:13:59.182307+0000","last_became_active":"2024-09-12T17:00:00.671211+0000","last_became_peered":"2024-09-12T17:00:00.671211+0000","last_unstale":"2024-09-12T18:13:59.182307+0000","last_undegraded":"2024-09-12T18:13:59.182307+0000","last_fullsized":"2024-09-12T18:13:59.182307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:59.182180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:59.182180+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.182180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:05.491469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000441562,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'332","reported_seq":1025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.150649+0000","last_change":"2024-09-12T18:13:58.150556+0000","last_active":"2024-09-12T18:13:58.150649+0000","last_peered":"2024-09-12T18:13:58.150649+0000","last_clean":"2024-09-12T18:13:58.150649+0000","last_became_active":"2024-09-12T17:00:12.306408+0000","last_became_peered":"2024-09-12T17:00:12.306408+0000","last_unstale":"2024-09-12T18:13:58.150649+0000","last_undegraded":"2024-09-12T18:13:58.150649+0000","last_fullsized":"2024-09-12T18:13:58.150649+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-12T18:13:58.150468+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-12T18:13:58.150468+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.150468+0000","objects_scrubbed":9,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:01.376992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1499227,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":518,"num_read_kb":8959,"num_write":977,"num_write_kb":13821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:18.418807+0000","last_change":"2024-09-12T18:14:18.418807+0000","last_active":"2024-09-12T18:14:18.418807+0000","last_peered":"2024-09-12T18:14:18.418807+0000","last_clean":"2024-09-12T18:14:18.418807+0000","last_became_active":"2024-09-12T17:00:16.325914+0000","last_became_peered":"2024-09-12T17:00:16.325914+0000","last_unstale":"2024-09-12T18:14:18.418807+0000","last_undegraded":"2024-09-12T18:14:18.418807+0000","last_fullsized":"2024-09-12T18:14:18.418807+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:18.418708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:18.418708+0000","last_clean_scrub_stamp":"2024-09-12T18:14:18.418708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:50.212483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1365","reported_seq":3212,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.182612+0000","last_change":"2024-09-12T18:14:13.182612+0000","last_active":"2024-09-12T18:14:13.182612+0000","last_peered":"2024-09-12T18:14:13.182612+0000","last_clean":"2024-09-12T18:14:13.182612+0000","last_became_active":"2024-09-12T17:00:18.330715+0000","last_became_peered":"2024-09-12T17:00:18.330715+0000","last_unstale":"2024-09-12T18:14:13.182612+0000","last_undegraded":"2024-09-12T18:14:13.182612+0000","last_fullsized":"2024-09-12T18:14:13.182612+0000","mapping_epoch":30,"log_start":"264'1300","ondisk_log_start":"264'1300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1365","last_scrub_stamp":"2024-09-12T18:14:13.182494+0000","last_deep_scrub":"264'1365","last_deep_scrub_stamp":"2024-09-12T18:14:13.182494+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.182494+0000","objects_scrubbed":11,"log_size":65,"log_dups_size":1300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:53.314146+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154155,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2179,"num_read_kb":4259,"num_write":1270,"num_write_kb":1078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:25.510127+0000","last_change":"2024-09-12T18:14:25.510127+0000","last_active":"2024-09-12T18:14:25.510127+0000","last_peered":"2024-09-12T18:14:25.510127+0000","last_clean":"2024-09-12T18:14:25.510127+0000","last_became_active":"2024-09-12T17:00:20.352287+0000","last_became_peered":"2024-09-12T17:00:20.352287+0000","last_unstale":"2024-09-12T18:14:25.510127+0000","last_undegraded":"2024-09-12T18:14:25.510127+0000","last_fullsized":"2024-09-12T18:14:25.510127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:25.510040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:25.510040+0000","last_clean_scrub_stamp":"2024-09-12T18:14:25.510040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:10.632047+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'97","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:23.206434+0000","last_change":"2024-09-12T18:14:23.206434+0000","last_active":"2024-09-12T18:14:23.206434+0000","last_peered":"2024-09-12T18:14:23.206434+0000","last_clean":"2024-09-12T18:14:23.206434+0000","last_became_active":"2024-09-12T17:00:22.587206+0000","last_became_peered":"2024-09-12T17:00:22.587206+0000","last_unstale":"2024-09-12T18:14:23.206434+0000","last_undegraded":"2024-09-12T18:14:23.206434+0000","last_fullsized":"2024-09-12T18:14:23.206434+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'97","last_scrub_stamp":"2024-09-12T18:14:23.206343+0000","last_deep_scrub":"264'97","last_deep_scrub_stamp":"2024-09-12T18:14:23.206343+0000","last_clean_scrub_stamp":"2024-09-12T18:14:23.206343+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:31.456728+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":151,"num_write":236,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'4068","reported_seq":4661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.108609+0000","last_change":"2024-09-12T18:14:05.108609+0000","last_active":"2024-09-12T18:14:05.108609+0000","last_peered":"2024-09-12T18:14:05.108609+0000","last_clean":"2024-09-12T18:14:05.108609+0000","last_became_active":"2024-09-12T17:00:14.331560+0000","last_became_peered":"2024-09-12T17:00:14.331560+0000","last_unstale":"2024-09-12T18:14:05.108609+0000","last_undegraded":"2024-09-12T18:14:05.108609+0000","last_fullsized":"2024-09-12T18:14:05.108609+0000","mapping_epoch":26,"log_start":"264'4000","ondisk_log_start":"264'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4068","last_scrub_stamp":"2024-09-12T18:14:05.108524+0000","last_deep_scrub":"264'4068","last_deep_scrub_stamp":"2024-09-12T18:14:05.108524+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.108524+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":3000,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:03.977064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16331,"num_read_kb":13702,"num_write":6093,"num_write_kb":3038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:56.176861+0000","last_change":"2024-09-12T18:13:56.176811+0000","last_active":"2024-09-12T18:13:56.176861+0000","last_peered":"2024-09-12T18:13:56.176861+0000","last_clean":"2024-09-12T18:13:56.176861+0000","last_became_active":"2024-09-12T17:00:01.173083+0000","last_became_peered":"2024-09-12T17:00:01.173083+0000","last_unstale":"2024-09-12T18:13:56.176861+0000","last_undegraded":"2024-09-12T18:13:56.176861+0000","last_fullsized":"2024-09-12T18:13:56.176861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:56.176741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:56.176741+0000","last_clean_scrub_stamp":"2024-09-12T18:13:56.176741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:36.851800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056135799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'326","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:57.001242+0000","last_change":"2024-09-12T18:13:57.001192+0000","last_active":"2024-09-12T18:13:57.001242+0000","last_peered":"2024-09-12T18:13:57.001242+0000","last_clean":"2024-09-12T18:13:57.001242+0000","last_became_active":"2024-09-12T17:00:12.309100+0000","last_became_peered":"2024-09-12T17:00:12.309100+0000","last_unstale":"2024-09-12T18:13:57.001242+0000","last_undegraded":"2024-09-12T18:13:57.001242+0000","last_fullsized":"2024-09-12T18:13:57.001242+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-12T18:13:57.001116+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-12T18:13:57.001116+0000","last_clean_scrub_stamp":"2024-09-12T18:13:57.001116+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:44.466787+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655862,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":481,"num_read_kb":31712,"num_write":1051,"num_write_kb":22323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.116004+0000","last_change":"2024-09-12T18:14:04.116004+0000","last_active":"2024-09-12T18:14:04.116004+0000","last_peered":"2024-09-12T18:14:04.116004+0000","last_clean":"2024-09-12T18:14:04.116004+0000","last_became_active":"2024-09-12T17:00:16.324792+0000","last_became_peered":"2024-09-12T17:00:16.324792+0000","last_unstale":"2024-09-12T18:14:04.116004+0000","last_undegraded":"2024-09-12T18:14:04.116004+0000","last_fullsized":"2024-09-12T18:14:04.116004+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:04.115917+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:04.115917+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.115917+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:04.636526+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'299","reported_seq":1740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:19.441642+0000","last_change":"2024-09-12T18:14:19.441642+0000","last_active":"2024-09-12T18:14:19.441642+0000","last_peered":"2024-09-12T18:14:19.441642+0000","last_clean":"2024-09-12T18:14:19.441642+0000","last_became_active":"2024-09-12T17:00:18.429997+0000","last_became_peered":"2024-09-12T17:00:18.429997+0000","last_unstale":"2024-09-12T18:14:19.441642+0000","last_undegraded":"2024-09-12T18:14:19.441642+0000","last_fullsized":"2024-09-12T18:14:19.441642+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'299","last_scrub_stamp":"2024-09-12T18:14:19.441455+0000","last_deep_scrub":"264'299","last_deep_scrub_stamp":"2024-09-12T18:14:19.441455+0000","last_clean_scrub_stamp":"2024-09-12T18:14:19.441455+0000","objects_scrubbed":9,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:24.826400+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":262,"num_read_kb":252,"num_write":239,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:22.266431+0000","last_change":"2024-09-12T18:14:22.266431+0000","last_active":"2024-09-12T18:14:22.266431+0000","last_peered":"2024-09-12T18:14:22.266431+0000","last_clean":"2024-09-12T18:14:22.266431+0000","last_became_active":"2024-09-12T17:00:20.350197+0000","last_became_peered":"2024-09-12T17:00:20.350197+0000","last_unstale":"2024-09-12T18:14:22.266431+0000","last_undegraded":"2024-09-12T18:14:22.266431+0000","last_fullsized":"2024-09-12T18:14:22.266431+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:22.266345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:22.266345+0000","last_clean_scrub_stamp":"2024-09-12T18:14:22.266345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:16.231319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'277","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:32.850418+0000","last_change":"2024-09-12T18:14:32.850348+0000","last_active":"2024-09-12T18:14:32.850418+0000","last_peered":"2024-09-12T18:14:32.850418+0000","last_clean":"2024-09-12T18:14:32.850418+0000","last_became_active":"2024-09-12T17:00:22.357583+0000","last_became_peered":"2024-09-12T17:00:22.357583+0000","last_unstale":"2024-09-12T18:14:32.850418+0000","last_undegraded":"2024-09-12T18:14:32.850418+0000","last_fullsized":"2024-09-12T18:14:32.850418+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'277","last_scrub_stamp":"2024-09-12T18:14:32.850262+0000","last_deep_scrub":"264'277","last_deep_scrub_stamp":"2024-09-12T18:14:32.850262+0000","last_clean_scrub_stamp":"2024-09-12T18:14:32.850262+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:29.426297+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":565,"num_read_kb":582,"num_write":607,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'184","reported_seq":779,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.051311+0000","last_change":"2024-09-12T18:14:03.051253+0000","last_active":"2024-09-12T18:14:03.051311+0000","last_peered":"2024-09-12T18:14:03.051311+0000","last_clean":"2024-09-12T18:14:03.051311+0000","last_became_active":"2024-09-12T17:00:14.324830+0000","last_became_peered":"2024-09-12T17:00:14.324830+0000","last_unstale":"2024-09-12T18:14:03.051311+0000","last_undegraded":"2024-09-12T18:14:03.051311+0000","last_fullsized":"2024-09-12T18:14:03.051311+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'184","last_scrub_stamp":"2024-09-12T18:14:03.051167+0000","last_deep_scrub":"264'184","last_deep_scrub_stamp":"2024-09-12T18:14:03.051167+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.051167+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:33.058051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":771,"num_read_kb":626,"num_write":320,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":541,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:57.445577+0000","last_change":"2024-09-12T18:13:57.445513+0000","last_active":"2024-09-12T18:13:57.445577+0000","last_peered":"2024-09-12T18:13:57.445577+0000","last_clean":"2024-09-12T18:13:57.445577+0000","last_became_active":"2024-09-12T17:00:00.668696+0000","last_became_peered":"2024-09-12T17:00:00.668696+0000","last_unstale":"2024-09-12T18:13:57.445577+0000","last_undegraded":"2024-09-12T18:13:57.445577+0000","last_fullsized":"2024-09-12T18:13:57.445577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:13:57.445431+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:13:57.445431+0000","last_clean_scrub_stamp":"2024-09-12T18:13:57.445431+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:24.702957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0012259720000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'362","reported_seq":1015,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:56.795809+0000","last_change":"2024-09-12T18:13:56.795679+0000","last_active":"2024-09-12T18:13:56.795809+0000","last_peered":"2024-09-12T18:13:56.795809+0000","last_clean":"2024-09-12T18:13:56.795809+0000","last_became_active":"2024-09-12T17:00:12.315813+0000","last_became_peered":"2024-09-12T17:00:12.315813+0000","last_unstale":"2024-09-12T18:13:56.795809+0000","last_undegraded":"2024-09-12T18:13:56.795809+0000","last_fullsized":"2024-09-12T18:13:56.795809+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'362","last_scrub_stamp":"2024-09-12T18:13:56.795572+0000","last_deep_scrub":"264'362","last_deep_scrub_stamp":"2024-09-12T18:13:56.795572+0000","last_clean_scrub_stamp":"2024-09-12T18:13:56.795572+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:52:27.168227+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":472,"num_read_kb":35449,"num_write":1073,"num_write_kb":30387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:15.228724+0000","last_change":"2024-09-12T18:14:15.228724+0000","last_active":"2024-09-12T18:14:15.228724+0000","last_peered":"2024-09-12T18:14:15.228724+0000","last_clean":"2024-09-12T18:14:15.228724+0000","last_became_active":"2024-09-12T17:00:16.324683+0000","last_became_peered":"2024-09-12T17:00:16.324683+0000","last_unstale":"2024-09-12T18:14:15.228724+0000","last_undegraded":"2024-09-12T18:14:15.228724+0000","last_fullsized":"2024-09-12T18:14:15.228724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:15.228628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:15.228628+0000","last_clean_scrub_stamp":"2024-09-12T18:14:15.228628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:17.787871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'164","reported_seq":733,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:20.962483+0000","last_change":"2024-09-12T18:14:20.962483+0000","last_active":"2024-09-12T18:14:20.962483+0000","last_peered":"2024-09-12T18:14:20.962483+0000","last_clean":"2024-09-12T18:14:20.962483+0000","last_became_active":"2024-09-12T17:00:18.327205+0000","last_became_peered":"2024-09-12T17:00:18.327205+0000","last_unstale":"2024-09-12T18:14:20.962483+0000","last_undegraded":"2024-09-12T18:14:20.962483+0000","last_fullsized":"2024-09-12T18:14:20.962483+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'164","last_scrub_stamp":"2024-09-12T18:14:20.962389+0000","last_deep_scrub":"264'164","last_deep_scrub_stamp":"2024-09-12T18:14:20.962389+0000","last_clean_scrub_stamp":"2024-09-12T18:14:20.962389+0000","objects_scrubbed":7,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:39.507861+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":197,"num_read_kb":191,"num_write":142,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:14.202546+0000","last_change":"2024-09-12T18:14:14.202546+0000","last_active":"2024-09-12T18:14:14.202546+0000","last_peered":"2024-09-12T18:14:14.202546+0000","last_clean":"2024-09-12T18:14:14.202546+0000","last_became_active":"2024-09-12T17:00:20.356122+0000","last_became_peered":"2024-09-12T17:00:20.356122+0000","last_unstale":"2024-09-12T18:14:14.202546+0000","last_undegraded":"2024-09-12T18:14:14.202546+0000","last_fullsized":"2024-09-12T18:14:14.202546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:14.202464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:14.202464+0000","last_clean_scrub_stamp":"2024-09-12T18:14:14.202464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:50.205142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'120","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:29.475382+0000","last_change":"2024-09-12T18:14:29.475382+0000","last_active":"2024-09-12T18:14:29.475382+0000","last_peered":"2024-09-12T18:14:29.475382+0000","last_clean":"2024-09-12T18:14:29.475382+0000","last_became_active":"2024-09-12T17:00:22.358888+0000","last_became_peered":"2024-09-12T17:00:22.358888+0000","last_unstale":"2024-09-12T18:14:29.475382+0000","last_undegraded":"2024-09-12T18:14:29.475382+0000","last_fullsized":"2024-09-12T18:14:29.475382+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-09-12T18:14:29.475292+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-09-12T18:14:29.475292+0000","last_clean_scrub_stamp":"2024-09-12T18:14:29.475292+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:54.381227+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":246,"num_write":283,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'172","reported_seq":813,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.091266+0000","last_change":"2024-09-12T18:14:04.091204+0000","last_active":"2024-09-12T18:14:04.091266+0000","last_peered":"2024-09-12T18:14:04.091266+0000","last_clean":"2024-09-12T18:14:04.091266+0000","last_became_active":"2024-09-12T17:00:14.330844+0000","last_became_peered":"2024-09-12T17:00:14.330844+0000","last_unstale":"2024-09-12T18:14:04.091266+0000","last_undegraded":"2024-09-12T18:14:04.091266+0000","last_fullsized":"2024-09-12T18:14:04.091266+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'172","last_scrub_stamp":"2024-09-12T18:14:04.091118+0000","last_deep_scrub":"264'172","last_deep_scrub_stamp":"2024-09-12T18:14:04.091118+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.091118+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:28.552302+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":795,"num_read_kb":654,"num_write":268,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'407","reported_seq":1095,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.459613+0000","last_change":"2024-09-12T18:13:59.459613+0000","last_active":"2024-09-12T18:13:59.459613+0000","last_peered":"2024-09-12T18:13:59.459613+0000","last_clean":"2024-09-12T18:13:59.459613+0000","last_became_active":"2024-09-12T17:00:12.318621+0000","last_became_peered":"2024-09-12T17:00:12.318621+0000","last_unstale":"2024-09-12T18:13:59.459613+0000","last_undegraded":"2024-09-12T18:13:59.459613+0000","last_fullsized":"2024-09-12T18:13:59.459613+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'407","last_scrub_stamp":"2024-09-12T18:13:59.459505+0000","last_deep_scrub":"264'407","last_deep_scrub_stamp":"2024-09-12T18:13:59.459505+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.459505+0000","objects_scrubbed":9,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:47.655177+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":592,"num_read_kb":4542,"num_write":1332,"num_write_kb":25874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":543,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:55.019088+0000","last_change":"2024-09-12T18:13:55.019040+0000","last_active":"2024-09-12T18:13:55.019088+0000","last_peered":"2024-09-12T18:13:55.019088+0000","last_clean":"2024-09-12T18:13:55.019088+0000","last_became_active":"2024-09-12T17:00:00.667379+0000","last_became_peered":"2024-09-12T17:00:00.667379+0000","last_unstale":"2024-09-12T18:13:55.019088+0000","last_undegraded":"2024-09-12T18:13:55.019088+0000","last_fullsized":"2024-09-12T18:13:55.019088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:55.018974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:55.018974+0000","last_clean_scrub_stamp":"2024-09-12T18:13:55.018974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:11.110303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056755300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:14.189827+0000","last_change":"2024-09-12T18:14:14.189720+0000","last_active":"2024-09-12T18:14:14.189827+0000","last_peered":"2024-09-12T18:14:14.189827+0000","last_clean":"2024-09-12T18:14:14.189827+0000","last_became_active":"2024-09-12T17:00:16.322854+0000","last_became_peered":"2024-09-12T17:00:16.322854+0000","last_unstale":"2024-09-12T18:14:14.189827+0000","last_undegraded":"2024-09-12T18:14:14.189827+0000","last_fullsized":"2024-09-12T18:14:14.189827+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:14.189619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:14.189619+0000","last_clean_scrub_stamp":"2024-09-12T18:14:14.189619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:20.726776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'672","reported_seq":1382,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.229545+0000","last_change":"2024-09-12T18:14:17.229453+0000","last_active":"2024-09-12T18:14:17.229545+0000","last_peered":"2024-09-12T18:14:17.229545+0000","last_clean":"2024-09-12T18:14:17.229545+0000","last_became_active":"2024-09-12T17:00:18.333147+0000","last_became_peered":"2024-09-12T17:00:18.333147+0000","last_unstale":"2024-09-12T18:14:17.229545+0000","last_undegraded":"2024-09-12T18:14:17.229545+0000","last_fullsized":"2024-09-12T18:14:17.229545+0000","mapping_epoch":30,"log_start":"264'600","ondisk_log_start":"264'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'672","last_scrub_stamp":"2024-09-12T18:14:17.229332+0000","last_deep_scrub":"264'672","last_deep_scrub_stamp":"2024-09-12T18:14:17.229332+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.229332+0000","objects_scrubbed":10,"log_size":72,"log_dups_size":600,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:36.017250+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95805,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1770,"num_read_kb":3099,"num_write":2318,"num_write_kb":2109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":508234,"num_omap_keys":1154,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:26.825540+0000","last_change":"2024-09-12T18:14:26.825540+0000","last_active":"2024-09-12T18:14:26.825540+0000","last_peered":"2024-09-12T18:14:26.825540+0000","last_clean":"2024-09-12T18:14:26.825540+0000","last_became_active":"2024-09-12T17:00:20.354771+0000","last_became_peered":"2024-09-12T17:00:20.354771+0000","last_unstale":"2024-09-12T18:14:26.825540+0000","last_undegraded":"2024-09-12T18:14:26.825540+0000","last_fullsized":"2024-09-12T18:14:26.825540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:26.825453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:26.825453+0000","last_clean_scrub_stamp":"2024-09-12T18:14:26.825453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:49.316587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'223","reported_seq":755,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:30.227091+0000","last_change":"2024-09-12T18:14:30.227029+0000","last_active":"2024-09-12T18:14:30.227091+0000","last_peered":"2024-09-12T18:14:30.227091+0000","last_clean":"2024-09-12T18:14:30.227091+0000","last_became_active":"2024-09-12T17:00:22.588561+0000","last_became_peered":"2024-09-12T17:00:22.588561+0000","last_unstale":"2024-09-12T18:14:30.227091+0000","last_undegraded":"2024-09-12T18:14:30.227091+0000","last_fullsized":"2024-09-12T18:14:30.227091+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'223","last_scrub_stamp":"2024-09-12T18:14:30.226917+0000","last_deep_scrub":"264'223","last_deep_scrub_stamp":"2024-09-12T18:14:30.226917+0000","last_clean_scrub_stamp":"2024-09-12T18:14:30.226917+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:05.358685+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":223,"num_read_kb":213,"num_write":499,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'180","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.112329+0000","last_change":"2024-09-12T18:14:06.112249+0000","last_active":"2024-09-12T18:14:06.112329+0000","last_peered":"2024-09-12T18:14:06.112329+0000","last_clean":"2024-09-12T18:14:06.112329+0000","last_became_active":"2024-09-12T17:00:14.327268+0000","last_became_peered":"2024-09-12T17:00:14.327268+0000","last_unstale":"2024-09-12T18:14:06.112329+0000","last_undegraded":"2024-09-12T18:14:06.112329+0000","last_fullsized":"2024-09-12T18:14:06.112329+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'180","last_scrub_stamp":"2024-09-12T18:14:06.112165+0000","last_deep_scrub":"264'180","last_deep_scrub_stamp":"2024-09-12T18:14:06.112165+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.112165+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:05.334938+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":852,"num_read_kb":727,"num_write":266,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'349","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.024180+0000","last_change":"2024-09-12T18:13:58.024128+0000","last_active":"2024-09-12T18:13:58.024180+0000","last_peered":"2024-09-12T18:13:58.024180+0000","last_clean":"2024-09-12T18:13:58.024180+0000","last_became_active":"2024-09-12T17:00:12.309896+0000","last_became_peered":"2024-09-12T17:00:12.309896+0000","last_unstale":"2024-09-12T18:13:58.024180+0000","last_undegraded":"2024-09-12T18:13:58.024180+0000","last_fullsized":"2024-09-12T18:13:58.024180+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'349","last_scrub_stamp":"2024-09-12T18:13:58.024056+0000","last_deep_scrub":"264'349","last_deep_scrub_stamp":"2024-09-12T18:13:58.024056+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.024056+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:20.085472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":595,"num_read_kb":32728,"num_write":1244,"num_write_kb":26986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.217800+0000","last_change":"2024-09-12T18:14:03.217713+0000","last_active":"2024-09-12T18:14:03.217800+0000","last_peered":"2024-09-12T18:14:03.217800+0000","last_clean":"2024-09-12T18:14:03.217800+0000","last_became_active":"2024-09-12T17:00:00.670355+0000","last_became_peered":"2024-09-12T17:00:00.670355+0000","last_unstale":"2024-09-12T18:14:03.217800+0000","last_undegraded":"2024-09-12T18:14:03.217800+0000","last_fullsized":"2024-09-12T18:14:03.217800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:03.217597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:03.217597+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.217597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:02.459061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042464500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.141561+0000","last_change":"2024-09-12T18:14:11.141505+0000","last_active":"2024-09-12T18:14:11.141561+0000","last_peered":"2024-09-12T18:14:11.141561+0000","last_clean":"2024-09-12T18:14:11.141561+0000","last_became_active":"2024-09-12T17:00:16.323157+0000","last_became_peered":"2024-09-12T17:00:16.323157+0000","last_unstale":"2024-09-12T18:14:11.141561+0000","last_undegraded":"2024-09-12T18:14:11.141561+0000","last_fullsized":"2024-09-12T18:14:11.141561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:11.141420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:11.141420+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.141420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:34.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'221","reported_seq":824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:18.286377+0000","last_change":"2024-09-12T18:14:18.286377+0000","last_active":"2024-09-12T18:14:18.286377+0000","last_peered":"2024-09-12T18:14:18.286377+0000","last_clean":"2024-09-12T18:14:18.286377+0000","last_became_active":"2024-09-12T17:00:18.428978+0000","last_became_peered":"2024-09-12T17:00:18.428978+0000","last_unstale":"2024-09-12T18:14:18.286377+0000","last_undegraded":"2024-09-12T18:14:18.286377+0000","last_fullsized":"2024-09-12T18:14:18.286377+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'221","last_scrub_stamp":"2024-09-12T18:14:18.286284+0000","last_deep_scrub":"264'221","last_deep_scrub_stamp":"2024-09-12T18:14:18.286284+0000","last_clean_scrub_stamp":"2024-09-12T18:14:18.286284+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:23.180371+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":266,"num_read_kb":257,"num_write":182,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'774","reported_seq":2999,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:27.420218+0000","last_change":"2024-09-12T18:14:27.420147+0000","last_active":"2024-09-12T18:14:27.420218+0000","last_peered":"2024-09-12T18:14:27.420218+0000","last_clean":"2024-09-12T18:14:27.420218+0000","last_became_active":"2024-09-12T17:00:20.345236+0000","last_became_peered":"2024-09-12T17:00:20.345236+0000","last_unstale":"2024-09-12T18:14:27.420218+0000","last_undegraded":"2024-09-12T18:14:27.420218+0000","last_fullsized":"2024-09-12T18:14:27.420218+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'774","last_scrub_stamp":"2024-09-12T18:14:27.420059+0000","last_deep_scrub":"264'774","last_deep_scrub_stamp":"2024-09-12T18:14:27.420059+0000","last_clean_scrub_stamp":"2024-09-12T18:14:27.420059+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:29.706528+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'116","reported_seq":648,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:33.848747+0000","last_change":"2024-09-12T18:14:33.848671+0000","last_active":"2024-09-12T18:14:33.848747+0000","last_peered":"2024-09-12T18:14:33.848747+0000","last_clean":"2024-09-12T18:14:33.848747+0000","last_became_active":"2024-09-12T17:00:22.587443+0000","last_became_peered":"2024-09-12T17:00:22.587443+0000","last_unstale":"2024-09-12T18:14:33.848747+0000","last_undegraded":"2024-09-12T18:14:33.848747+0000","last_fullsized":"2024-09-12T18:14:33.848747+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'116","last_scrub_stamp":"2024-09-12T18:14:33.848579+0000","last_deep_scrub":"264'116","last_deep_scrub_stamp":"2024-09-12T18:14:33.848579+0000","last_clean_scrub_stamp":"2024-09-12T18:14:33.848579+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:41.972139+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":705,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":239,"num_read_kb":213,"num_write":277,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'317","reported_seq":980,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.992329+0000","last_change":"2024-09-12T18:14:13.992204+0000","last_active":"2024-09-12T18:14:13.992329+0000","last_peered":"2024-09-12T18:14:13.992329+0000","last_clean":"2024-09-12T18:14:13.992329+0000","last_became_active":"2024-09-12T17:00:14.333128+0000","last_became_peered":"2024-09-12T17:00:14.333128+0000","last_unstale":"2024-09-12T18:14:13.992329+0000","last_undegraded":"2024-09-12T18:14:13.992329+0000","last_fullsized":"2024-09-12T18:14:13.992329+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'317","last_scrub_stamp":"2024-09-12T18:14:13.992099+0000","last_deep_scrub":"264'317","last_deep_scrub_stamp":"2024-09-12T18:14:13.992099+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.992099+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:18.628811+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1338,"num_read_kb":1083,"num_write":472,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'372","reported_seq":1036,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:55.895288+0000","last_change":"2024-09-12T18:13:55.895288+0000","last_active":"2024-09-12T18:13:55.895288+0000","last_peered":"2024-09-12T18:13:55.895288+0000","last_clean":"2024-09-12T18:13:55.895288+0000","last_became_active":"2024-09-12T17:00:12.315812+0000","last_became_peered":"2024-09-12T17:00:12.315812+0000","last_unstale":"2024-09-12T18:13:55.895288+0000","last_undegraded":"2024-09-12T18:13:55.895288+0000","last_fullsized":"2024-09-12T18:13:55.895288+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-12T18:13:55.895167+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-12T18:13:55.895167+0000","last_clean_scrub_stamp":"2024-09-12T18:13:55.895167+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:05.686531+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1826072,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":562,"num_read_kb":23161,"num_write":1132,"num_write_kb":14173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":541,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:56.006554+0000","last_change":"2024-09-12T18:13:56.006554+0000","last_active":"2024-09-12T18:13:56.006554+0000","last_peered":"2024-09-12T18:13:56.006554+0000","last_clean":"2024-09-12T18:13:56.006554+0000","last_became_active":"2024-09-12T17:00:00.669898+0000","last_became_peered":"2024-09-12T17:00:00.669898+0000","last_unstale":"2024-09-12T18:13:56.006554+0000","last_undegraded":"2024-09-12T18:13:56.006554+0000","last_fullsized":"2024-09-12T18:13:56.006554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:56.006481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:56.006481+0000","last_clean_scrub_stamp":"2024-09-12T18:13:56.006481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:45.117992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060387199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:16.803981+0000","last_change":"2024-09-12T18:14:16.803917+0000","last_active":"2024-09-12T18:14:16.803981+0000","last_peered":"2024-09-12T18:14:16.803981+0000","last_clean":"2024-09-12T18:14:16.803981+0000","last_became_active":"2024-09-12T17:00:16.327270+0000","last_became_peered":"2024-09-12T17:00:16.327270+0000","last_unstale":"2024-09-12T18:14:16.803981+0000","last_undegraded":"2024-09-12T18:14:16.803981+0000","last_fullsized":"2024-09-12T18:14:16.803981+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:16.803829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:16.803829+0000","last_clean_scrub_stamp":"2024-09-12T18:14:16.803829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:52.947001+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'134","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:22.888626+0000","last_change":"2024-09-12T18:14:22.888626+0000","last_active":"2024-09-12T18:14:22.888626+0000","last_peered":"2024-09-12T18:14:22.888626+0000","last_clean":"2024-09-12T18:14:22.888626+0000","last_became_active":"2024-09-12T17:00:18.327994+0000","last_became_peered":"2024-09-12T17:00:18.327994+0000","last_unstale":"2024-09-12T18:14:22.888626+0000","last_undegraded":"2024-09-12T18:14:22.888626+0000","last_fullsized":"2024-09-12T18:14:22.888626+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'134","last_scrub_stamp":"2024-09-12T18:14:22.888539+0000","last_deep_scrub":"264'134","last_deep_scrub_stamp":"2024-09-12T18:14:22.888539+0000","last_clean_scrub_stamp":"2024-09-12T18:14:22.888539+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:47.733685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":161,"num_write":110,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'776","reported_seq":2846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:27.816004+0000","last_change":"2024-09-12T18:14:27.816004+0000","last_active":"2024-09-12T18:14:27.816004+0000","last_peered":"2024-09-12T18:14:27.816004+0000","last_clean":"2024-09-12T18:14:27.816004+0000","last_became_active":"2024-09-12T17:00:20.354519+0000","last_became_peered":"2024-09-12T17:00:20.354519+0000","last_unstale":"2024-09-12T18:14:27.816004+0000","last_undegraded":"2024-09-12T18:14:27.816004+0000","last_fullsized":"2024-09-12T18:14:27.816004+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'776","last_scrub_stamp":"2024-09-12T18:14:27.815915+0000","last_deep_scrub":"264'776","last_deep_scrub_stamp":"2024-09-12T18:14:27.815915+0000","last_clean_scrub_stamp":"2024-09-12T18:14:27.815915+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:28.199095+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'288","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:29.268163+0000","last_change":"2024-09-12T18:14:29.268109+0000","last_active":"2024-09-12T18:14:29.268163+0000","last_peered":"2024-09-12T18:14:29.268163+0000","last_clean":"2024-09-12T18:14:29.268163+0000","last_became_active":"2024-09-12T17:00:22.356132+0000","last_became_peered":"2024-09-12T17:00:22.356132+0000","last_unstale":"2024-09-12T18:14:29.268163+0000","last_undegraded":"2024-09-12T18:14:29.268163+0000","last_fullsized":"2024-09-12T18:14:29.268163+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'288","last_scrub_stamp":"2024-09-12T18:14:29.268013+0000","last_deep_scrub":"264'288","last_deep_scrub_stamp":"2024-09-12T18:14:29.268013+0000","last_clean_scrub_stamp":"2024-09-12T18:14:29.268013+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:42.537942+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":378,"num_read_kb":377,"num_write":631,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'145","reported_seq":771,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.854501+0000","last_change":"2024-09-12T18:14:01.854434+0000","last_active":"2024-09-12T18:14:01.854501+0000","last_peered":"2024-09-12T18:14:01.854501+0000","last_clean":"2024-09-12T18:14:01.854501+0000","last_became_active":"2024-09-12T17:00:14.330433+0000","last_became_peered":"2024-09-12T17:00:14.330433+0000","last_unstale":"2024-09-12T18:14:01.854501+0000","last_undegraded":"2024-09-12T18:14:01.854501+0000","last_fullsized":"2024-09-12T18:14:01.854501+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'145","last_scrub_stamp":"2024-09-12T18:14:01.854354+0000","last_deep_scrub":"264'145","last_deep_scrub_stamp":"2024-09-12T18:14:01.854354+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.854354+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:27.445208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":651,"num_read_kb":539,"num_write":208,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'378","reported_seq":1154,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:57.123146+0000","last_change":"2024-09-12T18:13:57.123146+0000","last_active":"2024-09-12T18:13:57.123146+0000","last_peered":"2024-09-12T18:13:57.123146+0000","last_clean":"2024-09-12T18:13:57.123146+0000","last_became_active":"2024-09-12T17:00:12.307371+0000","last_became_peered":"2024-09-12T17:00:12.307371+0000","last_unstale":"2024-09-12T18:13:57.123146+0000","last_undegraded":"2024-09-12T18:13:57.123146+0000","last_fullsized":"2024-09-12T18:13:57.123146+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'378","last_scrub_stamp":"2024-09-12T18:13:57.123003+0000","last_deep_scrub":"264'378","last_deep_scrub_stamp":"2024-09-12T18:13:57.123003+0000","last_clean_scrub_stamp":"2024-09-12T18:13:57.123003+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:45.220960+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262175,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":835,"num_read_kb":7035,"num_write":1193,"num_write_kb":32501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.077086+0000","last_change":"2024-09-12T18:13:59.077086+0000","last_active":"2024-09-12T18:13:59.077086+0000","last_peered":"2024-09-12T18:13:59.077086+0000","last_clean":"2024-09-12T18:13:59.077086+0000","last_became_active":"2024-09-12T17:00:00.670451+0000","last_became_peered":"2024-09-12T17:00:00.670451+0000","last_unstale":"2024-09-12T18:13:59.077086+0000","last_undegraded":"2024-09-12T18:13:59.077086+0000","last_fullsized":"2024-09-12T18:13:59.077086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:59.077001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:59.077001+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.077001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:10.341382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046867000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:15.985804+0000","last_change":"2024-09-12T18:14:15.985731+0000","last_active":"2024-09-12T18:14:15.985804+0000","last_peered":"2024-09-12T18:14:15.985804+0000","last_clean":"2024-09-12T18:14:15.985804+0000","last_became_active":"2024-09-12T17:00:16.326163+0000","last_became_peered":"2024-09-12T17:00:16.326163+0000","last_unstale":"2024-09-12T18:14:15.985804+0000","last_undegraded":"2024-09-12T18:14:15.985804+0000","last_fullsized":"2024-09-12T18:14:15.985804+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:15.985631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:15.985631+0000","last_clean_scrub_stamp":"2024-09-12T18:14:15.985631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:27.774285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'797","reported_seq":1545,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:20.448179+0000","last_change":"2024-09-12T18:14:20.448119+0000","last_active":"2024-09-12T18:14:20.448179+0000","last_peered":"2024-09-12T18:14:20.448179+0000","last_clean":"2024-09-12T18:14:20.448179+0000","last_became_active":"2024-09-12T17:00:18.429131+0000","last_became_peered":"2024-09-12T17:00:18.429131+0000","last_unstale":"2024-09-12T18:14:20.448179+0000","last_undegraded":"2024-09-12T18:14:20.448179+0000","last_fullsized":"2024-09-12T18:14:20.448179+0000","mapping_epoch":30,"log_start":"264'700","ondisk_log_start":"264'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'797","last_scrub_stamp":"2024-09-12T18:14:20.448016+0000","last_deep_scrub":"264'797","last_deep_scrub_stamp":"2024-09-12T18:14:20.448016+0000","last_clean_scrub_stamp":"2024-09-12T18:14:20.448016+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:50.131210+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164213,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1409,"num_read_kb":3444,"num_write":1148,"num_write_kb":951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:26.808799+0000","last_change":"2024-09-12T18:14:26.808799+0000","last_active":"2024-09-12T18:14:26.808799+0000","last_peered":"2024-09-12T18:14:26.808799+0000","last_clean":"2024-09-12T18:14:26.808799+0000","last_became_active":"2024-09-12T17:00:20.349800+0000","last_became_peered":"2024-09-12T17:00:20.349800+0000","last_unstale":"2024-09-12T18:14:26.808799+0000","last_undegraded":"2024-09-12T18:14:26.808799+0000","last_fullsized":"2024-09-12T18:14:26.808799+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:26.808709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:26.808709+0000","last_clean_scrub_stamp":"2024-09-12T18:14:26.808709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:43.261138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'141","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:31.473663+0000","last_change":"2024-09-12T18:14:31.473606+0000","last_active":"2024-09-12T18:14:31.473663+0000","last_peered":"2024-09-12T18:14:31.473663+0000","last_clean":"2024-09-12T18:14:31.473663+0000","last_became_active":"2024-09-12T17:00:22.360730+0000","last_became_peered":"2024-09-12T17:00:22.360730+0000","last_unstale":"2024-09-12T18:14:31.473663+0000","last_undegraded":"2024-09-12T18:14:31.473663+0000","last_fullsized":"2024-09-12T18:14:31.473663+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'141","last_scrub_stamp":"2024-09-12T18:14:31.473523+0000","last_deep_scrub":"264'141","last_deep_scrub_stamp":"2024-09-12T18:14:31.473523+0000","last_clean_scrub_stamp":"2024-09-12T18:14:31.473523+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:48.973215+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":172,"num_read_kb":170,"num_write":343,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'182","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:32.224139+0000","last_change":"2024-09-12T18:14:32.224139+0000","last_active":"2024-09-12T18:14:32.224139+0000","last_peered":"2024-09-12T18:14:32.224139+0000","last_clean":"2024-09-12T18:14:32.224139+0000","last_became_active":"2024-09-12T17:00:22.354464+0000","last_became_peered":"2024-09-12T17:00:22.354464+0000","last_unstale":"2024-09-12T18:14:32.224139+0000","last_undegraded":"2024-09-12T18:14:32.224139+0000","last_fullsized":"2024-09-12T18:14:32.224139+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'182","last_scrub_stamp":"2024-09-12T18:14:32.224051+0000","last_deep_scrub":"264'182","last_deep_scrub_stamp":"2024-09-12T18:14:32.224051+0000","last_clean_scrub_stamp":"2024-09-12T18:14:32.224051+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:37.381218+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":465,"num_read_kb":419,"num_write":437,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'369","reported_seq":1054,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.917370+0000","last_change":"2024-09-12T18:14:06.917244+0000","last_active":"2024-09-12T18:14:06.917370+0000","last_peered":"2024-09-12T18:14:06.917370+0000","last_clean":"2024-09-12T18:14:06.917370+0000","last_became_active":"2024-09-12T17:00:14.329093+0000","last_became_peered":"2024-09-12T17:00:14.329093+0000","last_unstale":"2024-09-12T18:14:06.917370+0000","last_undegraded":"2024-09-12T18:14:06.917370+0000","last_fullsized":"2024-09-12T18:14:06.917370+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'369","last_scrub_stamp":"2024-09-12T18:14:06.917142+0000","last_deep_scrub":"264'369","last_deep_scrub_stamp":"2024-09-12T18:14:06.917142+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.917142+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:31.654357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1637,"num_read_kb":1326,"num_write":585,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'363","reported_seq":1113,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.822222+0000","last_change":"2024-09-12T18:13:58.822164+0000","last_active":"2024-09-12T18:13:58.822222+0000","last_peered":"2024-09-12T18:13:58.822222+0000","last_clean":"2024-09-12T18:13:58.822222+0000","last_became_active":"2024-09-12T17:00:12.307309+0000","last_became_peered":"2024-09-12T17:00:12.307309+0000","last_unstale":"2024-09-12T18:13:58.822222+0000","last_undegraded":"2024-09-12T18:13:58.822222+0000","last_fullsized":"2024-09-12T18:13:58.822222+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'363","last_scrub_stamp":"2024-09-12T18:13:58.822062+0000","last_deep_scrub":"264'363","last_deep_scrub_stamp":"2024-09-12T18:13:58.822062+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.822062+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:04.753595+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":717,"num_read_kb":21828,"num_write":1272,"num_write_kb":15847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.138339+0000","last_change":"2024-09-12T18:14:11.138218+0000","last_active":"2024-09-12T18:14:11.138339+0000","last_peered":"2024-09-12T18:14:11.138339+0000","last_clean":"2024-09-12T18:14:11.138339+0000","last_became_active":"2024-09-12T17:00:16.325555+0000","last_became_peered":"2024-09-12T17:00:16.325555+0000","last_unstale":"2024-09-12T18:14:11.138339+0000","last_undegraded":"2024-09-12T18:14:11.138339+0000","last_fullsized":"2024-09-12T18:14:11.138339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:11.138123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:11.138123+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.138123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:08.175044+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'305","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:22.926844+0000","last_change":"2024-09-12T18:14:22.926768+0000","last_active":"2024-09-12T18:14:22.926844+0000","last_peered":"2024-09-12T18:14:22.926844+0000","last_clean":"2024-09-12T18:14:22.926844+0000","last_became_active":"2024-09-12T17:00:18.327374+0000","last_became_peered":"2024-09-12T17:00:18.327374+0000","last_unstale":"2024-09-12T18:14:22.926844+0000","last_undegraded":"2024-09-12T18:14:22.926844+0000","last_fullsized":"2024-09-12T18:14:22.926844+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'305","last_scrub_stamp":"2024-09-12T18:14:22.926675+0000","last_deep_scrub":"264'305","last_deep_scrub_stamp":"2024-09-12T18:14:22.926675+0000","last_clean_scrub_stamp":"2024-09-12T18:14:22.926675+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:42.780150+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49267,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":497,"num_read_kb":1124,"num_write":398,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:28.842689+0000","last_change":"2024-09-12T18:14:28.842618+0000","last_active":"2024-09-12T18:14:28.842689+0000","last_peered":"2024-09-12T18:14:28.842689+0000","last_clean":"2024-09-12T18:14:28.842689+0000","last_became_active":"2024-09-12T17:00:20.352801+0000","last_became_peered":"2024-09-12T17:00:20.352801+0000","last_unstale":"2024-09-12T18:14:28.842689+0000","last_undegraded":"2024-09-12T18:14:28.842689+0000","last_fullsized":"2024-09-12T18:14:28.842689+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:28.842514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:28.842514+0000","last_clean_scrub_stamp":"2024-09-12T18:14:28.842514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:29.305914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'193","reported_seq":728,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:36.889951+0000","last_change":"2024-09-12T18:14:36.889951+0000","last_active":"2024-09-12T18:14:36.889951+0000","last_peered":"2024-09-12T18:14:36.889951+0000","last_clean":"2024-09-12T18:14:36.889951+0000","last_became_active":"2024-09-12T17:00:22.354651+0000","last_became_peered":"2024-09-12T17:00:22.354651+0000","last_unstale":"2024-09-12T18:14:36.889951+0000","last_undegraded":"2024-09-12T18:14:36.889951+0000","last_fullsized":"2024-09-12T18:14:36.889951+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'193","last_scrub_stamp":"2024-09-12T18:14:36.889868+0000","last_deep_scrub":"264'193","last_deep_scrub_stamp":"2024-09-12T18:14:36.889868+0000","last_clean_scrub_stamp":"2024-09-12T18:14:36.889868+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:27.202596+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":300,"num_read_kb":268,"num_write":394,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'230","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.134128+0000","last_change":"2024-09-12T18:14:07.134035+0000","last_active":"2024-09-12T18:14:07.134128+0000","last_peered":"2024-09-12T18:14:07.134128+0000","last_clean":"2024-09-12T18:14:07.134128+0000","last_became_active":"2024-09-12T17:00:14.320955+0000","last_became_peered":"2024-09-12T17:00:14.320955+0000","last_unstale":"2024-09-12T18:14:07.134128+0000","last_undegraded":"2024-09-12T18:14:07.134128+0000","last_fullsized":"2024-09-12T18:14:07.134128+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'230","last_scrub_stamp":"2024-09-12T18:14:07.133902+0000","last_deep_scrub":"264'230","last_deep_scrub_stamp":"2024-09-12T18:14:07.133902+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.133902+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:28.413454+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1027,"num_read_kb":855,"num_write":338,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'407","reported_seq":1059,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.175414+0000","last_change":"2024-09-12T18:14:05.175316+0000","last_active":"2024-09-12T18:14:05.175414+0000","last_peered":"2024-09-12T18:14:05.175414+0000","last_clean":"2024-09-12T18:14:05.175414+0000","last_became_active":"2024-09-12T17:00:12.315834+0000","last_became_peered":"2024-09-12T17:00:12.315834+0000","last_unstale":"2024-09-12T18:14:05.175414+0000","last_undegraded":"2024-09-12T18:14:05.175414+0000","last_fullsized":"2024-09-12T18:14:05.175414+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'407","last_scrub_stamp":"2024-09-12T18:14:05.175171+0000","last_deep_scrub":"264'407","last_deep_scrub_stamp":"2024-09-12T18:14:05.175171+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.175171+0000","objects_scrubbed":7,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:55.926091+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3436700,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":549,"num_read_kb":44669,"num_write":1257,"num_write_kb":42862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.016125+0000","last_change":"2024-09-12T18:14:17.016058+0000","last_active":"2024-09-12T18:14:17.016125+0000","last_peered":"2024-09-12T18:14:17.016125+0000","last_clean":"2024-09-12T18:14:17.016125+0000","last_became_active":"2024-09-12T17:00:16.327292+0000","last_became_peered":"2024-09-12T17:00:16.327292+0000","last_unstale":"2024-09-12T18:14:17.016125+0000","last_undegraded":"2024-09-12T18:14:17.016125+0000","last_fullsized":"2024-09-12T18:14:17.016125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:17.015961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:17.015961+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.015961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:59.576782+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'53","reported_seq":586,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:18.251781+0000","last_change":"2024-09-12T18:14:18.251671+0000","last_active":"2024-09-12T18:14:18.251781+0000","last_peered":"2024-09-12T18:14:18.251781+0000","last_clean":"2024-09-12T18:14:18.251781+0000","last_became_active":"2024-09-12T17:00:18.331495+0000","last_became_peered":"2024-09-12T17:00:18.331495+0000","last_unstale":"2024-09-12T18:14:18.251781+0000","last_undegraded":"2024-09-12T18:14:18.251781+0000","last_fullsized":"2024-09-12T18:14:18.251781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'53","last_scrub_stamp":"2024-09-12T18:14:18.251554+0000","last_deep_scrub":"264'53","last_deep_scrub_stamp":"2024-09-12T18:14:18.251554+0000","last_clean_scrub_stamp":"2024-09-12T18:14:18.251554+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:07.081303+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:26.504201+0000","last_change":"2024-09-12T18:14:26.504133+0000","last_active":"2024-09-12T18:14:26.504201+0000","last_peered":"2024-09-12T18:14:26.504201+0000","last_clean":"2024-09-12T18:14:26.504201+0000","last_became_active":"2024-09-12T17:00:20.348274+0000","last_became_peered":"2024-09-12T17:00:20.348274+0000","last_unstale":"2024-09-12T18:14:26.504201+0000","last_undegraded":"2024-09-12T18:14:26.504201+0000","last_fullsized":"2024-09-12T18:14:26.504201+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:26.504052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:26.504052+0000","last_clean_scrub_stamp":"2024-09-12T18:14:26.504052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:11.642165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'245","reported_seq":850,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:31.207196+0000","last_change":"2024-09-12T18:14:31.207196+0000","last_active":"2024-09-12T18:14:31.207196+0000","last_peered":"2024-09-12T18:14:31.207196+0000","last_clean":"2024-09-12T18:14:31.207196+0000","last_became_active":"2024-09-12T17:00:22.350195+0000","last_became_peered":"2024-09-12T17:00:22.350195+0000","last_unstale":"2024-09-12T18:14:31.207196+0000","last_undegraded":"2024-09-12T18:14:31.207196+0000","last_fullsized":"2024-09-12T18:14:31.207196+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'245","last_scrub_stamp":"2024-09-12T18:14:31.207106+0000","last_deep_scrub":"264'245","last_deep_scrub_stamp":"2024-09-12T18:14:31.207106+0000","last_clean_scrub_stamp":"2024-09-12T18:14:31.207106+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:42.226323+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":636,"num_read_kb":568,"num_write":560,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'163","reported_seq":766,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.985941+0000","last_change":"2024-09-12T18:14:04.985868+0000","last_active":"2024-09-12T18:14:04.985941+0000","last_peered":"2024-09-12T18:14:04.985941+0000","last_clean":"2024-09-12T18:14:04.985941+0000","last_became_active":"2024-09-12T17:00:14.334652+0000","last_became_peered":"2024-09-12T17:00:14.334652+0000","last_unstale":"2024-09-12T18:14:04.985941+0000","last_undegraded":"2024-09-12T18:14:04.985941+0000","last_fullsized":"2024-09-12T18:14:04.985941+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'163","last_scrub_stamp":"2024-09-12T18:14:04.985772+0000","last_deep_scrub":"264'163","last_deep_scrub_stamp":"2024-09-12T18:14:04.985772+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.985772+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:29.223174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":705,"num_read_kb":585,"num_write":252,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'373","reported_seq":1060,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.509977+0000","last_change":"2024-09-12T18:14:01.509915+0000","last_active":"2024-09-12T18:14:01.509977+0000","last_peered":"2024-09-12T18:14:01.509977+0000","last_clean":"2024-09-12T18:14:01.509977+0000","last_became_active":"2024-09-12T17:00:12.312629+0000","last_became_peered":"2024-09-12T17:00:12.312629+0000","last_unstale":"2024-09-12T18:14:01.509977+0000","last_undegraded":"2024-09-12T18:14:01.509977+0000","last_fullsized":"2024-09-12T18:14:01.509977+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-09-12T18:14:01.509785+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-09-12T18:14:01.509785+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.509785+0000","objects_scrubbed":8,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:46.142118+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524362,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":634,"num_read_kb":31722,"num_write":1487,"num_write_kb":32347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.348553+0000","last_change":"2024-09-12T18:14:17.348472+0000","last_active":"2024-09-12T18:14:17.348553+0000","last_peered":"2024-09-12T18:14:17.348553+0000","last_clean":"2024-09-12T18:14:17.348553+0000","last_became_active":"2024-09-12T17:00:16.326905+0000","last_became_peered":"2024-09-12T17:00:16.326905+0000","last_unstale":"2024-09-12T18:14:17.348553+0000","last_undegraded":"2024-09-12T18:14:17.348553+0000","last_fullsized":"2024-09-12T18:14:17.348553+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:17.348362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:17.348362+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.348362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:36.617419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'351","reported_seq":964,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:23.898099+0000","last_change":"2024-09-12T18:14:23.897991+0000","last_active":"2024-09-12T18:14:23.898099+0000","last_peered":"2024-09-12T18:14:23.898099+0000","last_clean":"2024-09-12T18:14:23.898099+0000","last_became_active":"2024-09-12T17:00:18.329759+0000","last_became_peered":"2024-09-12T17:00:18.329759+0000","last_unstale":"2024-09-12T18:14:23.898099+0000","last_undegraded":"2024-09-12T18:14:23.898099+0000","last_fullsized":"2024-09-12T18:14:23.898099+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'351","last_scrub_stamp":"2024-09-12T18:14:23.897880+0000","last_deep_scrub":"264'351","last_deep_scrub_stamp":"2024-09-12T18:14:23.897880+0000","last_clean_scrub_stamp":"2024-09-12T18:14:23.897880+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:36.146294+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50102,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":567,"num_read_kb":1243,"num_write":450,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.200827+0000","last_change":"2024-09-12T18:14:17.200766+0000","last_active":"2024-09-12T18:14:17.200827+0000","last_peered":"2024-09-12T18:14:17.200827+0000","last_clean":"2024-09-12T18:14:17.200827+0000","last_became_active":"2024-09-12T17:00:20.355629+0000","last_became_peered":"2024-09-12T17:00:20.355629+0000","last_unstale":"2024-09-12T18:14:17.200827+0000","last_undegraded":"2024-09-12T18:14:17.200827+0000","last_fullsized":"2024-09-12T18:14:17.200827+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:17.200666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:17.200666+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.200666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:30.930203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'128","reported_seq":664,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:34.428185+0000","last_change":"2024-09-12T18:14:34.428185+0000","last_active":"2024-09-12T18:14:34.428185+0000","last_peered":"2024-09-12T18:14:34.428185+0000","last_clean":"2024-09-12T18:14:34.428185+0000","last_became_active":"2024-09-12T17:00:22.360051+0000","last_became_peered":"2024-09-12T17:00:22.360051+0000","last_unstale":"2024-09-12T18:14:34.428185+0000","last_undegraded":"2024-09-12T18:14:34.428185+0000","last_fullsized":"2024-09-12T18:14:34.428185+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'128","last_scrub_stamp":"2024-09-12T18:14:34.428091+0000","last_deep_scrub":"264'128","last_deep_scrub_stamp":"2024-09-12T18:14:34.428091+0000","last_clean_scrub_stamp":"2024-09-12T18:14:34.428091+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:03.389025+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":246,"num_read_kb":229,"num_write":325,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'696","reported_seq":1451,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:14.942442+0000","last_change":"2024-09-12T18:14:14.942370+0000","last_active":"2024-09-12T18:14:14.942442+0000","last_peered":"2024-09-12T18:14:14.942442+0000","last_clean":"2024-09-12T18:14:14.942442+0000","last_became_active":"2024-09-12T17:00:14.338453+0000","last_became_peered":"2024-09-12T17:00:14.338453+0000","last_unstale":"2024-09-12T18:14:14.942442+0000","last_undegraded":"2024-09-12T18:14:14.942442+0000","last_fullsized":"2024-09-12T18:14:14.942442+0000","mapping_epoch":26,"log_start":"264'600","ondisk_log_start":"264'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'696","last_scrub_stamp":"2024-09-12T18:14:14.942287+0000","last_deep_scrub":"264'696","last_deep_scrub_stamp":"2024-09-12T18:14:14.942287+0000","last_clean_scrub_stamp":"2024-09-12T18:14:14.942287+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:43.385941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3211,"num_read_kb":2592,"num_write":1218,"num_write_kb":764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'376","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:56.083847+0000","last_change":"2024-09-12T18:13:56.083789+0000","last_active":"2024-09-12T18:13:56.083847+0000","last_peered":"2024-09-12T18:13:56.083847+0000","last_clean":"2024-09-12T18:13:56.083847+0000","last_became_active":"2024-09-12T17:00:46.406811+0000","last_became_peered":"2024-09-12T17:00:46.406811+0000","last_unstale":"2024-09-12T18:13:56.083847+0000","last_undegraded":"2024-09-12T18:13:56.083847+0000","last_fullsized":"2024-09-12T18:13:56.083847+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'376","last_scrub_stamp":"2024-09-12T18:13:56.083721+0000","last_deep_scrub":"264'376","last_deep_scrub_stamp":"2024-09-12T18:13:56.083721+0000","last_clean_scrub_stamp":"2024-09-12T18:13:56.083721+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:20.371898+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170356,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":466,"num_read_kb":7187,"num_write":1054,"num_write_kb":23441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.157379+0000","last_change":"2024-09-12T18:14:12.157320+0000","last_active":"2024-09-12T18:14:12.157379+0000","last_peered":"2024-09-12T18:14:12.157379+0000","last_clean":"2024-09-12T18:14:12.157379+0000","last_became_active":"2024-09-12T17:00:16.328571+0000","last_became_peered":"2024-09-12T17:00:16.328571+0000","last_unstale":"2024-09-12T18:14:12.157379+0000","last_undegraded":"2024-09-12T18:14:12.157379+0000","last_fullsized":"2024-09-12T18:14:12.157379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:12.157228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:12.157228+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.157228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:38.775538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'312","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:22.468410+0000","last_change":"2024-09-12T18:14:22.468352+0000","last_active":"2024-09-12T18:14:22.468410+0000","last_peered":"2024-09-12T18:14:22.468410+0000","last_clean":"2024-09-12T18:14:22.468410+0000","last_became_active":"2024-09-12T17:00:18.331634+0000","last_became_peered":"2024-09-12T17:00:18.331634+0000","last_unstale":"2024-09-12T18:14:22.468410+0000","last_undegraded":"2024-09-12T18:14:22.468410+0000","last_fullsized":"2024-09-12T18:14:22.468410+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'312","last_scrub_stamp":"2024-09-12T18:14:22.468254+0000","last_deep_scrub":"264'312","last_deep_scrub_stamp":"2024-09-12T18:14:22.468254+0000","last_clean_scrub_stamp":"2024-09-12T18:14:22.468254+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:28.071156+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":499,"num_read_kb":1194,"num_write":408,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:25.207591+0000","last_change":"2024-09-12T18:14:25.207484+0000","last_active":"2024-09-12T18:14:25.207591+0000","last_peered":"2024-09-12T18:14:25.207591+0000","last_clean":"2024-09-12T18:14:25.207591+0000","last_became_active":"2024-09-12T17:00:20.346778+0000","last_became_peered":"2024-09-12T17:00:20.346778+0000","last_unstale":"2024-09-12T18:14:25.207591+0000","last_undegraded":"2024-09-12T18:14:25.207591+0000","last_fullsized":"2024-09-12T18:14:25.207591+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:25.207363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:25.207363+0000","last_clean_scrub_stamp":"2024-09-12T18:14:25.207363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:04.441076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'4226","reported_seq":4841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.048700+0000","last_change":"2024-09-12T18:14:08.048608+0000","last_active":"2024-09-12T18:14:08.048700+0000","last_peered":"2024-09-12T18:14:08.048700+0000","last_clean":"2024-09-12T18:14:08.048700+0000","last_became_active":"2024-09-12T17:00:14.327366+0000","last_became_peered":"2024-09-12T17:00:14.327366+0000","last_unstale":"2024-09-12T18:14:08.048700+0000","last_undegraded":"2024-09-12T18:14:08.048700+0000","last_fullsized":"2024-09-12T18:14:08.048700+0000","mapping_epoch":26,"log_start":"264'4200","ondisk_log_start":"264'4200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4226","last_scrub_stamp":"2024-09-12T18:14:08.048490+0000","last_deep_scrub":"264'4226","last_deep_scrub_stamp":"2024-09-12T18:14:08.048490+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.048490+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":3000,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:16.172312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16999,"num_read_kb":14230,"num_write":6368,"num_write_kb":3177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'348","reported_seq":980,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.036797+0000","last_change":"2024-09-12T18:14:03.036725+0000","last_active":"2024-09-12T18:14:03.036797+0000","last_peered":"2024-09-12T18:14:03.036797+0000","last_clean":"2024-09-12T18:14:03.036797+0000","last_became_active":"2024-09-12T17:00:12.316401+0000","last_became_peered":"2024-09-12T17:00:12.316401+0000","last_unstale":"2024-09-12T18:14:03.036797+0000","last_undegraded":"2024-09-12T18:14:03.036797+0000","last_fullsized":"2024-09-12T18:14:03.036797+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'348","last_scrub_stamp":"2024-09-12T18:14:03.036602+0000","last_deep_scrub":"264'348","last_deep_scrub_stamp":"2024-09-12T18:14:03.036602+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.036602+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:12.222915+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2180110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":457,"num_read_kb":29254,"num_write":1102,"num_write_kb":37912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:16.256651+0000","last_change":"2024-09-12T18:14:16.256577+0000","last_active":"2024-09-12T18:14:16.256651+0000","last_peered":"2024-09-12T18:14:16.256651+0000","last_clean":"2024-09-12T18:14:16.256651+0000","last_became_active":"2024-09-12T17:00:16.317972+0000","last_became_peered":"2024-09-12T17:00:16.317972+0000","last_unstale":"2024-09-12T18:14:16.256651+0000","last_undegraded":"2024-09-12T18:14:16.256651+0000","last_fullsized":"2024-09-12T18:14:16.256651+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:16.256492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:16.256492+0000","last_clean_scrub_stamp":"2024-09-12T18:14:16.256492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:46.624196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'533","reported_seq":1190,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:14.184880+0000","last_change":"2024-09-12T18:14:14.184880+0000","last_active":"2024-09-12T18:14:14.184880+0000","last_peered":"2024-09-12T18:14:14.184880+0000","last_clean":"2024-09-12T18:14:14.184880+0000","last_became_active":"2024-09-12T17:00:18.327593+0000","last_became_peered":"2024-09-12T17:00:18.327593+0000","last_unstale":"2024-09-12T18:14:14.184880+0000","last_undegraded":"2024-09-12T18:14:14.184880+0000","last_fullsized":"2024-09-12T18:14:14.184880+0000","mapping_epoch":30,"log_start":"264'500","ondisk_log_start":"264'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'533","last_scrub_stamp":"2024-09-12T18:14:14.184757+0000","last_deep_scrub":"264'533","last_deep_scrub_stamp":"2024-09-12T18:14:14.184757+0000","last_clean_scrub_stamp":"2024-09-12T18:14:14.184757+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:06.682388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111195,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":962,"num_read_kb":2364,"num_write":832,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:28.465976+0000","last_change":"2024-09-12T18:14:28.465976+0000","last_active":"2024-09-12T18:14:28.465976+0000","last_peered":"2024-09-12T18:14:28.465976+0000","last_clean":"2024-09-12T18:14:28.465976+0000","last_became_active":"2024-09-12T17:00:20.350413+0000","last_became_peered":"2024-09-12T17:00:20.350413+0000","last_unstale":"2024-09-12T18:14:28.465976+0000","last_undegraded":"2024-09-12T18:14:28.465976+0000","last_fullsized":"2024-09-12T18:14:28.465976+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:28.465868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:28.465868+0000","last_clean_scrub_stamp":"2024-09-12T18:14:28.465868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:07.999497+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'146","reported_seq":655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:34.840324+0000","last_change":"2024-09-12T18:14:34.840206+0000","last_active":"2024-09-12T18:14:34.840324+0000","last_peered":"2024-09-12T18:14:34.840324+0000","last_clean":"2024-09-12T18:14:34.840324+0000","last_became_active":"2024-09-12T17:00:22.588456+0000","last_became_peered":"2024-09-12T17:00:22.588456+0000","last_unstale":"2024-09-12T18:14:34.840324+0000","last_undegraded":"2024-09-12T18:14:34.840324+0000","last_fullsized":"2024-09-12T18:14:34.840324+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'146","last_scrub_stamp":"2024-09-12T18:14:34.840097+0000","last_deep_scrub":"264'146","last_deep_scrub_stamp":"2024-09-12T18:14:34.840097+0000","last_clean_scrub_stamp":"2024-09-12T18:14:34.840097+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:53.081305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":212,"num_write":324,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'223","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.188777+0000","last_change":"2024-09-12T18:14:11.188720+0000","last_active":"2024-09-12T18:14:11.188777+0000","last_peered":"2024-09-12T18:14:11.188777+0000","last_clean":"2024-09-12T18:14:11.188777+0000","last_became_active":"2024-09-12T17:00:14.328921+0000","last_became_peered":"2024-09-12T17:00:14.328921+0000","last_unstale":"2024-09-12T18:14:11.188777+0000","last_undegraded":"2024-09-12T18:14:11.188777+0000","last_fullsized":"2024-09-12T18:14:11.188777+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'223","last_scrub_stamp":"2024-09-12T18:14:11.188633+0000","last_deep_scrub":"264'223","last_deep_scrub_stamp":"2024-09-12T18:14:11.188633+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.188633+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:41.061991+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":992,"num_read_kb":851,"num_write":318,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2873,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'356","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.076062+0000","last_change":"2024-09-12T18:13:59.076062+0000","last_active":"2024-09-12T18:13:59.076062+0000","last_peered":"2024-09-12T18:13:59.076062+0000","last_clean":"2024-09-12T18:13:59.076062+0000","last_became_active":"2024-09-12T17:00:12.311606+0000","last_became_peered":"2024-09-12T17:00:12.311606+0000","last_unstale":"2024-09-12T18:13:59.076062+0000","last_undegraded":"2024-09-12T18:13:59.076062+0000","last_fullsized":"2024-09-12T18:13:59.076062+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-12T18:13:59.075963+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-12T18:13:59.075963+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.075963+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:20.684366+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":470,"num_read_kb":10885,"num_write":1123,"num_write_kb":34953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.163289+0000","last_change":"2024-09-12T18:14:13.163200+0000","last_active":"2024-09-12T18:14:13.163289+0000","last_peered":"2024-09-12T18:14:13.163289+0000","last_clean":"2024-09-12T18:14:13.163289+0000","last_became_active":"2024-09-12T17:00:16.327527+0000","last_became_peered":"2024-09-12T17:00:16.327527+0000","last_unstale":"2024-09-12T18:14:13.163289+0000","last_undegraded":"2024-09-12T18:14:13.163289+0000","last_fullsized":"2024-09-12T18:14:13.163289+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:13.163092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:13.163092+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.163092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:37.590475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'346","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:23.499229+0000","last_change":"2024-09-12T18:14:23.499116+0000","last_active":"2024-09-12T18:14:23.499229+0000","last_peered":"2024-09-12T18:14:23.499229+0000","last_clean":"2024-09-12T18:14:23.499229+0000","last_became_active":"2024-09-12T17:00:18.326984+0000","last_became_peered":"2024-09-12T17:00:18.326984+0000","last_unstale":"2024-09-12T18:14:23.499229+0000","last_undegraded":"2024-09-12T18:14:23.499229+0000","last_fullsized":"2024-09-12T18:14:23.499229+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'346","last_scrub_stamp":"2024-09-12T18:14:23.498991+0000","last_deep_scrub":"264'346","last_deep_scrub_stamp":"2024-09-12T18:14:23.498991+0000","last_clean_scrub_stamp":"2024-09-12T18:14:23.498991+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:17.424447+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46916,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":562,"num_read_kb":1193,"num_write":464,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:15.220117+0000","last_change":"2024-09-12T18:14:15.220117+0000","last_active":"2024-09-12T18:14:15.220117+0000","last_peered":"2024-09-12T18:14:15.220117+0000","last_clean":"2024-09-12T18:14:15.220117+0000","last_became_active":"2024-09-12T17:00:20.347873+0000","last_became_peered":"2024-09-12T17:00:20.347873+0000","last_unstale":"2024-09-12T18:14:15.220117+0000","last_undegraded":"2024-09-12T18:14:15.220117+0000","last_fullsized":"2024-09-12T18:14:15.220117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:15.220030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:15.220030+0000","last_clean_scrub_stamp":"2024-09-12T18:14:15.220030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:54.298378+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'174","reported_seq":698,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:20.230097+0000","last_change":"2024-09-12T18:14:20.229981+0000","last_active":"2024-09-12T18:14:20.230097+0000","last_peered":"2024-09-12T18:14:20.230097+0000","last_clean":"2024-09-12T18:14:20.230097+0000","last_became_active":"2024-09-12T17:00:22.350856+0000","last_became_peered":"2024-09-12T17:00:22.350856+0000","last_unstale":"2024-09-12T18:14:20.230097+0000","last_undegraded":"2024-09-12T18:14:20.230097+0000","last_fullsized":"2024-09-12T18:14:20.230097+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'174","last_scrub_stamp":"2024-09-12T18:14:20.229862+0000","last_deep_scrub":"264'174","last_deep_scrub_stamp":"2024-09-12T18:14:20.229862+0000","last_clean_scrub_stamp":"2024-09-12T18:14:20.229862+0000","objects_scrubbed":7,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:22.189198+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1852,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":274,"num_read_kb":259,"num_write":495,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'116","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.895652+0000","last_change":"2024-09-12T18:14:08.895593+0000","last_active":"2024-09-12T18:14:08.895652+0000","last_peered":"2024-09-12T18:14:08.895652+0000","last_clean":"2024-09-12T18:14:08.895652+0000","last_became_active":"2024-09-12T17:00:14.336495+0000","last_became_peered":"2024-09-12T17:00:14.336495+0000","last_unstale":"2024-09-12T18:14:08.895652+0000","last_undegraded":"2024-09-12T18:14:08.895652+0000","last_fullsized":"2024-09-12T18:14:08.895652+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'116","last_scrub_stamp":"2024-09-12T18:14:08.895502+0000","last_deep_scrub":"264'116","last_deep_scrub_stamp":"2024-09-12T18:14:08.895502+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.895502+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:41.615371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":523,"num_read_kb":437,"num_write":169,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'380","reported_seq":1015,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:57.835277+0000","last_change":"2024-09-12T18:13:57.835221+0000","last_active":"2024-09-12T18:13:57.835277+0000","last_peered":"2024-09-12T18:13:57.835277+0000","last_clean":"2024-09-12T18:13:57.835277+0000","last_became_active":"2024-09-12T17:00:12.318234+0000","last_became_peered":"2024-09-12T17:00:12.318234+0000","last_unstale":"2024-09-12T18:13:57.835277+0000","last_undegraded":"2024-09-12T18:13:57.835277+0000","last_fullsized":"2024-09-12T18:13:57.835277+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'380","last_scrub_stamp":"2024-09-12T18:13:57.835115+0000","last_deep_scrub":"264'380","last_deep_scrub_stamp":"2024-09-12T18:13:57.835115+0000","last_clean_scrub_stamp":"2024-09-12T18:13:57.835115+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:01.043683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":38331,"num_write":1137,"num_write_kb":59769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"264'4","reported_seq":999,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:20.851479+0000","last_change":"2024-09-12T18:14:20.851412+0000","last_active":"2024-09-12T18:14:20.851479+0000","last_peered":"2024-09-12T18:14:20.851479+0000","last_clean":"2024-09-12T18:14:20.851479+0000","last_became_active":"2024-09-12T17:00:16.327396+0000","last_became_peered":"2024-09-12T17:00:16.327396+0000","last_unstale":"2024-09-12T18:14:20.851479+0000","last_undegraded":"2024-09-12T18:14:20.851479+0000","last_fullsized":"2024-09-12T18:14:20.851479+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:14:20.851324+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:14:20.851324+0000","last_clean_scrub_stamp":"2024-09-12T18:14:20.851324+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:03.722330+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'299","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:25.839746+0000","last_change":"2024-09-12T18:14:25.839746+0000","last_active":"2024-09-12T18:14:25.839746+0000","last_peered":"2024-09-12T18:14:25.839746+0000","last_clean":"2024-09-12T18:14:25.839746+0000","last_became_active":"2024-09-12T17:00:18.429149+0000","last_became_peered":"2024-09-12T17:00:18.429149+0000","last_unstale":"2024-09-12T18:14:25.839746+0000","last_undegraded":"2024-09-12T18:14:25.839746+0000","last_fullsized":"2024-09-12T18:14:25.839746+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'299","last_scrub_stamp":"2024-09-12T18:14:25.839646+0000","last_deep_scrub":"264'299","last_deep_scrub_stamp":"2024-09-12T18:14:25.839646+0000","last_clean_scrub_stamp":"2024-09-12T18:14:25.839646+0000","objects_scrubbed":5,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:52.286245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47739,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":501,"num_read_kb":1160,"num_write":400,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:19.244995+0000","last_change":"2024-09-12T18:14:19.244905+0000","last_active":"2024-09-12T18:14:19.244995+0000","last_peered":"2024-09-12T18:14:19.244995+0000","last_clean":"2024-09-12T18:14:19.244995+0000","last_became_active":"2024-09-12T17:00:20.349769+0000","last_became_peered":"2024-09-12T17:00:20.349769+0000","last_unstale":"2024-09-12T18:14:19.244995+0000","last_undegraded":"2024-09-12T18:14:19.244995+0000","last_fullsized":"2024-09-12T18:14:19.244995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:19.244803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:19.244803+0000","last_clean_scrub_stamp":"2024-09-12T18:14:19.244803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:26.784678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'105","reported_seq":609,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:32.485268+0000","last_change":"2024-09-12T18:14:32.485174+0000","last_active":"2024-09-12T18:14:32.485268+0000","last_peered":"2024-09-12T18:14:32.485268+0000","last_clean":"2024-09-12T18:14:32.485268+0000","last_became_active":"2024-09-12T17:00:22.358484+0000","last_became_peered":"2024-09-12T17:00:22.358484+0000","last_unstale":"2024-09-12T18:14:32.485268+0000","last_undegraded":"2024-09-12T18:14:32.485268+0000","last_fullsized":"2024-09-12T18:14:32.485268+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-12T18:14:32.485068+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-12T18:14:32.485068+0000","last_clean_scrub_stamp":"2024-09-12T18:14:32.485068+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:18.435476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":123,"num_write":242,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'161","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.049155+0000","last_change":"2024-09-12T18:14:01.049101+0000","last_active":"2024-09-12T18:14:01.049155+0000","last_peered":"2024-09-12T18:14:01.049155+0000","last_clean":"2024-09-12T18:14:01.049155+0000","last_became_active":"2024-09-12T17:00:14.330238+0000","last_became_peered":"2024-09-12T17:00:14.330238+0000","last_unstale":"2024-09-12T18:14:01.049155+0000","last_undegraded":"2024-09-12T18:14:01.049155+0000","last_fullsized":"2024-09-12T18:14:01.049155+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'161","last_scrub_stamp":"2024-09-12T18:14:01.049004+0000","last_deep_scrub":"264'161","last_deep_scrub_stamp":"2024-09-12T18:14:01.049004+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.049004+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:26.718335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":737,"num_read_kb":617,"num_write":248,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'339","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.091063+0000","last_change":"2024-09-12T18:14:00.091004+0000","last_active":"2024-09-12T18:14:00.091063+0000","last_peered":"2024-09-12T18:14:00.091063+0000","last_clean":"2024-09-12T18:14:00.091063+0000","last_became_active":"2024-09-12T17:00:12.305259+0000","last_became_peered":"2024-09-12T17:00:12.305259+0000","last_unstale":"2024-09-12T18:14:00.091063+0000","last_undegraded":"2024-09-12T18:14:00.091063+0000","last_fullsized":"2024-09-12T18:14:00.091063+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'339","last_scrub_stamp":"2024-09-12T18:14:00.090882+0000","last_deep_scrub":"264'339","last_deep_scrub_stamp":"2024-09-12T18:14:00.090882+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.090882+0000","objects_scrubbed":10,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:32.121245+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048621,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":464,"num_read_kb":5194,"num_write":1027,"num_write_kb":36405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.132722+0000","last_change":"2024-09-12T18:14:12.132722+0000","last_active":"2024-09-12T18:14:12.132722+0000","last_peered":"2024-09-12T18:14:12.132722+0000","last_clean":"2024-09-12T18:14:12.132722+0000","last_became_active":"2024-09-12T17:00:16.327626+0000","last_became_peered":"2024-09-12T17:00:16.327626+0000","last_unstale":"2024-09-12T18:14:12.132722+0000","last_undegraded":"2024-09-12T18:14:12.132722+0000","last_fullsized":"2024-09-12T18:14:12.132722+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:12.132627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:12.132627+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.132627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:23.273859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'115","reported_seq":670,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:25.861617+0000","last_change":"2024-09-12T18:14:25.861482+0000","last_active":"2024-09-12T18:14:25.861617+0000","last_peered":"2024-09-12T18:14:25.861617+0000","last_clean":"2024-09-12T18:14:25.861617+0000","last_became_active":"2024-09-12T17:00:18.429481+0000","last_became_peered":"2024-09-12T17:00:18.429481+0000","last_unstale":"2024-09-12T18:14:25.861617+0000","last_undegraded":"2024-09-12T18:14:25.861617+0000","last_fullsized":"2024-09-12T18:14:25.861617+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'115","last_scrub_stamp":"2024-09-12T18:14:25.861371+0000","last_deep_scrub":"264'115","last_deep_scrub_stamp":"2024-09-12T18:14:25.861371+0000","last_clean_scrub_stamp":"2024-09-12T18:14:25.861371+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:38.446625+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":118,"num_write":86,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'785","reported_seq":4468,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:22.270060+0000","last_change":"2024-09-12T18:14:22.270060+0000","last_active":"2024-09-12T18:14:22.270060+0000","last_peered":"2024-09-12T18:14:22.270060+0000","last_clean":"2024-09-12T18:14:22.270060+0000","last_became_active":"2024-09-12T17:00:20.350976+0000","last_became_peered":"2024-09-12T17:00:20.350976+0000","last_unstale":"2024-09-12T18:14:22.270060+0000","last_undegraded":"2024-09-12T18:14:22.270060+0000","last_fullsized":"2024-09-12T18:14:22.270060+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'785","last_scrub_stamp":"2024-09-12T18:14:22.269972+0000","last_deep_scrub":"264'785","last_deep_scrub_stamp":"2024-09-12T18:14:22.269972+0000","last_clean_scrub_stamp":"2024-09-12T18:14:22.269972+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:14.983222+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'114","reported_seq":619,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:28.470160+0000","last_change":"2024-09-12T18:14:28.470100+0000","last_active":"2024-09-12T18:14:28.470160+0000","last_peered":"2024-09-12T18:14:28.470160+0000","last_clean":"2024-09-12T18:14:28.470160+0000","last_became_active":"2024-09-12T17:00:22.357215+0000","last_became_peered":"2024-09-12T17:00:22.357215+0000","last_unstale":"2024-09-12T18:14:28.470160+0000","last_undegraded":"2024-09-12T18:14:28.470160+0000","last_fullsized":"2024-09-12T18:14:28.470160+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'114","last_scrub_stamp":"2024-09-12T18:14:28.470019+0000","last_deep_scrub":"264'114","last_deep_scrub_stamp":"2024-09-12T18:14:28.470019+0000","last_clean_scrub_stamp":"2024-09-12T18:14:28.470019+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:46.805507+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":135,"num_write":263,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'292","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.869599+0000","last_change":"2024-09-12T18:14:08.869491+0000","last_active":"2024-09-12T18:14:08.869599+0000","last_peered":"2024-09-12T18:14:08.869599+0000","last_clean":"2024-09-12T18:14:08.869599+0000","last_became_active":"2024-09-12T17:00:14.340459+0000","last_became_peered":"2024-09-12T17:00:14.340459+0000","last_unstale":"2024-09-12T18:14:08.869599+0000","last_undegraded":"2024-09-12T18:14:08.869599+0000","last_fullsized":"2024-09-12T18:14:08.869599+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'292","last_scrub_stamp":"2024-09-12T18:14:08.869378+0000","last_deep_scrub":"264'292","last_deep_scrub_stamp":"2024-09-12T18:14:08.869378+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.869378+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:58.673982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1297,"num_read_kb":1099,"num_write":462,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'344","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.153522+0000","last_change":"2024-09-12T18:14:06.153522+0000","last_active":"2024-09-12T18:14:06.153522+0000","last_peered":"2024-09-12T18:14:06.153522+0000","last_clean":"2024-09-12T18:14:06.153522+0000","last_became_active":"2024-09-12T17:00:46.721297+0000","last_became_peered":"2024-09-12T17:00:46.721297+0000","last_unstale":"2024-09-12T18:14:06.153522+0000","last_undegraded":"2024-09-12T18:14:06.153522+0000","last_fullsized":"2024-09-12T18:14:06.153522+0000","mapping_epoch":37,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'344","last_scrub_stamp":"2024-09-12T18:14:06.153427+0000","last_deep_scrub":"264'344","last_deep_scrub_stamp":"2024-09-12T18:14:06.153427+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.153427+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:53.191230+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6112458,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":37702,"num_write":1052,"num_write_kb":18010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:18.393566+0000","last_change":"2024-09-12T18:14:18.393474+0000","last_active":"2024-09-12T18:14:18.393566+0000","last_peered":"2024-09-12T18:14:18.393566+0000","last_clean":"2024-09-12T18:14:18.393566+0000","last_became_active":"2024-09-12T17:00:16.327461+0000","last_became_peered":"2024-09-12T17:00:16.327461+0000","last_unstale":"2024-09-12T18:14:18.393566+0000","last_undegraded":"2024-09-12T18:14:18.393566+0000","last_fullsized":"2024-09-12T18:14:18.393566+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:18.393385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:18.393385+0000","last_clean_scrub_stamp":"2024-09-12T18:14:18.393385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:26.549592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'332","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:26.464308+0000","last_change":"2024-09-12T18:14:26.464308+0000","last_active":"2024-09-12T18:14:26.464308+0000","last_peered":"2024-09-12T18:14:26.464308+0000","last_clean":"2024-09-12T18:14:26.464308+0000","last_became_active":"2024-09-12T17:00:18.328990+0000","last_became_peered":"2024-09-12T17:00:18.328990+0000","last_unstale":"2024-09-12T18:14:26.464308+0000","last_undegraded":"2024-09-12T18:14:26.464308+0000","last_fullsized":"2024-09-12T18:14:26.464308+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-12T18:14:26.464180+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-12T18:14:26.464180+0000","last_clean_scrub_stamp":"2024-09-12T18:14:26.464180+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:25.731195+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43471,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":524,"num_read_kb":1084,"num_write":408,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:26.257000+0000","last_change":"2024-09-12T18:14:26.256946+0000","last_active":"2024-09-12T18:14:26.257000+0000","last_peered":"2024-09-12T18:14:26.257000+0000","last_clean":"2024-09-12T18:14:26.257000+0000","last_became_active":"2024-09-12T17:00:20.349643+0000","last_became_peered":"2024-09-12T17:00:20.349643+0000","last_unstale":"2024-09-12T18:14:26.257000+0000","last_undegraded":"2024-09-12T18:14:26.257000+0000","last_fullsized":"2024-09-12T18:14:26.257000+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:26.256855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:26.256855+0000","last_clean_scrub_stamp":"2024-09-12T18:14:26.256855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:17.447555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'123","reported_seq":629,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:29.425232+0000","last_change":"2024-09-12T18:14:29.425115+0000","last_active":"2024-09-12T18:14:29.425232+0000","last_peered":"2024-09-12T18:14:29.425232+0000","last_clean":"2024-09-12T18:14:29.425232+0000","last_became_active":"2024-09-12T17:00:22.355658+0000","last_became_peered":"2024-09-12T17:00:22.355658+0000","last_unstale":"2024-09-12T18:14:29.425232+0000","last_undegraded":"2024-09-12T18:14:29.425232+0000","last_fullsized":"2024-09-12T18:14:29.425232+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'123","last_scrub_stamp":"2024-09-12T18:14:29.424986+0000","last_deep_scrub":"264'123","last_deep_scrub_stamp":"2024-09-12T18:14:29.424986+0000","last_clean_scrub_stamp":"2024-09-12T18:14:29.424986+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:12.603589+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":157,"num_read_kb":152,"num_write":284,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'216","reported_seq":836,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.847118+0000","last_change":"2024-09-12T18:14:09.847049+0000","last_active":"2024-09-12T18:14:09.847118+0000","last_peered":"2024-09-12T18:14:09.847118+0000","last_clean":"2024-09-12T18:14:09.847118+0000","last_became_active":"2024-09-12T17:00:14.334620+0000","last_became_peered":"2024-09-12T17:00:14.334620+0000","last_unstale":"2024-09-12T18:14:09.847118+0000","last_undegraded":"2024-09-12T18:14:09.847118+0000","last_fullsized":"2024-09-12T18:14:09.847118+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'216","last_scrub_stamp":"2024-09-12T18:14:09.846963+0000","last_deep_scrub":"264'216","last_deep_scrub_stamp":"2024-09-12T18:14:09.846963+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.846963+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:54.849970+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":978,"num_read_kb":833,"num_write":353,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'413","reported_seq":1101,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.537692+0000","last_change":"2024-09-12T18:14:02.537609+0000","last_active":"2024-09-12T18:14:02.537692+0000","last_peered":"2024-09-12T18:14:02.537692+0000","last_clean":"2024-09-12T18:14:02.537692+0000","last_became_active":"2024-09-12T17:00:12.317850+0000","last_became_peered":"2024-09-12T17:00:12.317850+0000","last_unstale":"2024-09-12T18:14:02.537692+0000","last_undegraded":"2024-09-12T18:14:02.537692+0000","last_fullsized":"2024-09-12T18:14:02.537692+0000","mapping_epoch":24,"log_start":"264'398","ondisk_log_start":"264'398","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'413","last_scrub_stamp":"2024-09-12T18:14:02.537459+0000","last_deep_scrub":"264'413","last_deep_scrub_stamp":"2024-09-12T18:14:02.537459+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.537459+0000","objects_scrubbed":15,"log_size":15,"log_dups_size":398,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:34.535056+0000","scrub_duration":65,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2375003,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":614,"num_read_kb":19368,"num_write":1121,"num_write_kb":17051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:22.496042+0000","last_change":"2024-09-12T18:14:22.495978+0000","last_active":"2024-09-12T18:14:22.496042+0000","last_peered":"2024-09-12T18:14:22.496042+0000","last_clean":"2024-09-12T18:14:22.496042+0000","last_became_active":"2024-09-12T17:00:16.329505+0000","last_became_peered":"2024-09-12T17:00:16.329505+0000","last_unstale":"2024-09-12T18:14:22.496042+0000","last_undegraded":"2024-09-12T18:14:22.496042+0000","last_fullsized":"2024-09-12T18:14:22.496042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:22.495890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:22.495890+0000","last_clean_scrub_stamp":"2024-09-12T18:14:22.495890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:14.555384+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'270","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:21.219031+0000","last_change":"2024-09-12T18:14:21.218975+0000","last_active":"2024-09-12T18:14:21.219031+0000","last_peered":"2024-09-12T18:14:21.219031+0000","last_clean":"2024-09-12T18:14:21.219031+0000","last_became_active":"2024-09-12T17:00:18.330548+0000","last_became_peered":"2024-09-12T17:00:18.330548+0000","last_unstale":"2024-09-12T18:14:21.219031+0000","last_undegraded":"2024-09-12T18:14:21.219031+0000","last_fullsized":"2024-09-12T18:14:21.219031+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'270","last_scrub_stamp":"2024-09-12T18:14:21.218862+0000","last_deep_scrub":"264'270","last_deep_scrub_stamp":"2024-09-12T18:14:21.218862+0000","last_clean_scrub_stamp":"2024-09-12T18:14:21.218862+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:44.952083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":1014,"num_write":352,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:18.240467+0000","last_change":"2024-09-12T18:14:18.240467+0000","last_active":"2024-09-12T18:14:18.240467+0000","last_peered":"2024-09-12T18:14:18.240467+0000","last_clean":"2024-09-12T18:14:18.240467+0000","last_became_active":"2024-09-12T17:00:20.347122+0000","last_became_peered":"2024-09-12T17:00:20.347122+0000","last_unstale":"2024-09-12T18:14:18.240467+0000","last_undegraded":"2024-09-12T18:14:18.240467+0000","last_fullsized":"2024-09-12T18:14:18.240467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:18.240377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:18.240377+0000","last_clean_scrub_stamp":"2024-09-12T18:14:18.240377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:46.226638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'145","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:35.871028+0000","last_change":"2024-09-12T18:14:35.870927+0000","last_active":"2024-09-12T18:14:35.871028+0000","last_peered":"2024-09-12T18:14:35.871028+0000","last_clean":"2024-09-12T18:14:35.871028+0000","last_became_active":"2024-09-12T17:00:22.588367+0000","last_became_peered":"2024-09-12T17:00:22.588367+0000","last_unstale":"2024-09-12T18:14:35.871028+0000","last_undegraded":"2024-09-12T18:14:35.871028+0000","last_fullsized":"2024-09-12T18:14:35.871028+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'145","last_scrub_stamp":"2024-09-12T18:14:35.870811+0000","last_deep_scrub":"264'145","last_deep_scrub_stamp":"2024-09-12T18:14:35.870811+0000","last_clean_scrub_stamp":"2024-09-12T18:14:35.870811+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:53.068368+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":299,"num_read_kb":277,"num_write":353,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'86","reported_seq":675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.888792+0000","last_change":"2024-09-12T18:14:07.888792+0000","last_active":"2024-09-12T18:14:07.888792+0000","last_peered":"2024-09-12T18:14:07.888792+0000","last_clean":"2024-09-12T18:14:07.888792+0000","last_became_active":"2024-09-12T17:00:14.338251+0000","last_became_peered":"2024-09-12T17:00:14.338251+0000","last_unstale":"2024-09-12T18:14:07.888792+0000","last_undegraded":"2024-09-12T18:14:07.888792+0000","last_fullsized":"2024-09-12T18:14:07.888792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'86","last_scrub_stamp":"2024-09-12T18:14:07.888692+0000","last_deep_scrub":"264'86","last_deep_scrub_stamp":"2024-09-12T18:14:07.888692+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.888692+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:33.432525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":335,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'391","reported_seq":1096,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:57.942934+0000","last_change":"2024-09-12T18:13:57.942881+0000","last_active":"2024-09-12T18:13:57.942934+0000","last_peered":"2024-09-12T18:13:57.942934+0000","last_clean":"2024-09-12T18:13:57.942934+0000","last_became_active":"2024-09-12T17:00:12.318883+0000","last_became_peered":"2024-09-12T17:00:12.318883+0000","last_unstale":"2024-09-12T18:13:57.942934+0000","last_undegraded":"2024-09-12T18:13:57.942934+0000","last_fullsized":"2024-09-12T18:13:57.942934+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'391","last_scrub_stamp":"2024-09-12T18:13:57.942799+0000","last_deep_scrub":"264'391","last_deep_scrub_stamp":"2024-09-12T18:13:57.942799+0000","last_clean_scrub_stamp":"2024-09-12T18:13:57.942799+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:44.840115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":699,"num_read_kb":40775,"num_write":1189,"num_write_kb":14251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"264'6","reported_seq":1000,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:19.820186+0000","last_change":"2024-09-12T18:14:19.820125+0000","last_active":"2024-09-12T18:14:19.820186+0000","last_peered":"2024-09-12T18:14:19.820186+0000","last_clean":"2024-09-12T18:14:19.820186+0000","last_became_active":"2024-09-12T17:00:16.326067+0000","last_became_peered":"2024-09-12T17:00:16.326067+0000","last_unstale":"2024-09-12T18:14:19.820186+0000","last_undegraded":"2024-09-12T18:14:19.820186+0000","last_fullsized":"2024-09-12T18:14:19.820186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T18:14:19.820043+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T18:14:19.820043+0000","last_clean_scrub_stamp":"2024-09-12T18:14:19.820043+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:04.795534+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'272","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:24.873557+0000","last_change":"2024-09-12T18:14:24.873557+0000","last_active":"2024-09-12T18:14:24.873557+0000","last_peered":"2024-09-12T18:14:24.873557+0000","last_clean":"2024-09-12T18:14:24.873557+0000","last_became_active":"2024-09-12T17:00:18.326438+0000","last_became_peered":"2024-09-12T17:00:18.326438+0000","last_unstale":"2024-09-12T18:14:24.873557+0000","last_undegraded":"2024-09-12T18:14:24.873557+0000","last_fullsized":"2024-09-12T18:14:24.873557+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'272","last_scrub_stamp":"2024-09-12T18:14:24.873468+0000","last_deep_scrub":"264'272","last_deep_scrub_stamp":"2024-09-12T18:14:24.873468+0000","last_clean_scrub_stamp":"2024-09-12T18:14:24.873468+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:00.691806+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47056,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":445,"num_read_kb":1107,"num_write":372,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:28.835263+0000","last_change":"2024-09-12T18:14:28.835263+0000","last_active":"2024-09-12T18:14:28.835263+0000","last_peered":"2024-09-12T18:14:28.835263+0000","last_clean":"2024-09-12T18:14:28.835263+0000","last_became_active":"2024-09-12T17:00:20.349324+0000","last_became_peered":"2024-09-12T17:00:20.349324+0000","last_unstale":"2024-09-12T18:14:28.835263+0000","last_undegraded":"2024-09-12T18:14:28.835263+0000","last_fullsized":"2024-09-12T18:14:28.835263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:28.835178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:28.835178+0000","last_clean_scrub_stamp":"2024-09-12T18:14:28.835178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:52.122317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'177","reported_seq":1654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:31.441008+0000","last_change":"2024-09-12T18:14:31.440897+0000","last_active":"2024-09-12T18:14:31.441008+0000","last_peered":"2024-09-12T18:14:31.441008+0000","last_clean":"2024-09-12T18:14:31.441008+0000","last_became_active":"2024-09-12T17:00:22.353287+0000","last_became_peered":"2024-09-12T17:00:22.353287+0000","last_unstale":"2024-09-12T18:14:31.441008+0000","last_undegraded":"2024-09-12T18:14:31.441008+0000","last_fullsized":"2024-09-12T18:14:31.441008+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-12T18:14:31.440775+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-12T18:14:31.440775+0000","last_clean_scrub_stamp":"2024-09-12T18:14:31.440775+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:20.637002+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1233,"num_read_kb":1225,"num_write":392,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'366","reported_seq":1058,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.880494+0000","last_change":"2024-09-12T18:14:07.880426+0000","last_active":"2024-09-12T18:14:07.880494+0000","last_peered":"2024-09-12T18:14:07.880494+0000","last_clean":"2024-09-12T18:14:07.880494+0000","last_became_active":"2024-09-12T17:00:14.323113+0000","last_became_peered":"2024-09-12T17:00:14.323113+0000","last_unstale":"2024-09-12T18:14:07.880494+0000","last_undegraded":"2024-09-12T18:14:07.880494+0000","last_fullsized":"2024-09-12T18:14:07.880494+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'366","last_scrub_stamp":"2024-09-12T18:14:07.880341+0000","last_deep_scrub":"264'366","last_deep_scrub_stamp":"2024-09-12T18:14:07.880341+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.880341+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:43.555460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1619,"num_read_kb":1299,"num_write":554,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'327","reported_seq":999,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.131042+0000","last_change":"2024-09-12T18:13:59.130977+0000","last_active":"2024-09-12T18:13:59.131042+0000","last_peered":"2024-09-12T18:13:59.131042+0000","last_clean":"2024-09-12T18:13:59.131042+0000","last_became_active":"2024-09-12T17:00:12.312456+0000","last_became_peered":"2024-09-12T17:00:12.312456+0000","last_unstale":"2024-09-12T18:13:59.131042+0000","last_undegraded":"2024-09-12T18:13:59.131042+0000","last_fullsized":"2024-09-12T18:13:59.131042+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'327","last_scrub_stamp":"2024-09-12T18:13:59.130866+0000","last_deep_scrub":"264'327","last_deep_scrub_stamp":"2024-09-12T18:13:59.130866+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.130866+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:10.045907+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":504,"num_read_kb":30861,"num_write":1000,"num_write_kb":23841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:17.250108+0000","last_change":"2024-09-12T18:14:17.250108+0000","last_active":"2024-09-12T18:14:17.250108+0000","last_peered":"2024-09-12T18:14:17.250108+0000","last_clean":"2024-09-12T18:14:17.250108+0000","last_became_active":"2024-09-12T17:00:16.325535+0000","last_became_peered":"2024-09-12T17:00:16.325535+0000","last_unstale":"2024-09-12T18:14:17.250108+0000","last_undegraded":"2024-09-12T18:14:17.250108+0000","last_fullsized":"2024-09-12T18:14:17.250108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:14:17.250027+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:14:17.250027+0000","last_clean_scrub_stamp":"2024-09-12T18:14:17.250027+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:25.737427+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'310","reported_seq":919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:24.895228+0000","last_change":"2024-09-12T18:14:24.895228+0000","last_active":"2024-09-12T18:14:24.895228+0000","last_peered":"2024-09-12T18:14:24.895228+0000","last_clean":"2024-09-12T18:14:24.895228+0000","last_became_active":"2024-09-12T17:00:18.326140+0000","last_became_peered":"2024-09-12T17:00:18.326140+0000","last_unstale":"2024-09-12T18:14:24.895228+0000","last_undegraded":"2024-09-12T18:14:24.895228+0000","last_fullsized":"2024-09-12T18:14:24.895228+0000","mapping_epoch":30,"log_start":"264'200","ondisk_log_start":"264'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'310","last_scrub_stamp":"2024-09-12T18:14:24.895132+0000","last_deep_scrub":"264'310","last_deep_scrub_stamp":"2024-09-12T18:14:24.895132+0000","last_clean_scrub_stamp":"2024-09-12T18:14:24.895132+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:02.426451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49596,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":515,"num_read_kb":1146,"num_write":406,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:35.239181+0000","last_change":"2024-09-12T18:14:35.239181+0000","last_active":"2024-09-12T18:14:35.239181+0000","last_peered":"2024-09-12T18:14:35.239181+0000","last_clean":"2024-09-12T18:14:35.239181+0000","last_became_active":"2024-09-12T17:00:20.353962+0000","last_became_peered":"2024-09-12T17:00:20.353962+0000","last_unstale":"2024-09-12T18:14:35.239181+0000","last_undegraded":"2024-09-12T18:14:35.239181+0000","last_fullsized":"2024-09-12T18:14:35.239181+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:14:35.239094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:14:35.239094+0000","last_clean_scrub_stamp":"2024-09-12T18:14:35.239094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:53.542493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'124","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:30.865230+0000","last_change":"2024-09-12T18:14:30.865230+0000","last_active":"2024-09-12T18:14:30.865230+0000","last_peered":"2024-09-12T18:14:30.865230+0000","last_clean":"2024-09-12T18:14:30.865230+0000","last_became_active":"2024-09-12T17:00:22.352779+0000","last_became_peered":"2024-09-12T17:00:22.352779+0000","last_unstale":"2024-09-12T18:14:30.865230+0000","last_undegraded":"2024-09-12T18:14:30.865230+0000","last_fullsized":"2024-09-12T18:14:30.865230+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-09-12T18:14:30.865135+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-09-12T18:14:30.865135+0000","last_clean_scrub_stamp":"2024-09-12T18:14:30.865135+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:45.511909+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":133,"num_write":289,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'171","reported_seq":781,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.089074+0000","last_change":"2024-09-12T18:14:09.089074+0000","last_active":"2024-09-12T18:14:09.089074+0000","last_peered":"2024-09-12T18:14:09.089074+0000","last_clean":"2024-09-12T18:14:09.089074+0000","last_became_active":"2024-09-12T17:00:14.315424+0000","last_became_peered":"2024-09-12T17:00:14.315424+0000","last_unstale":"2024-09-12T18:14:09.089074+0000","last_undegraded":"2024-09-12T18:14:09.089074+0000","last_fullsized":"2024-09-12T18:14:09.089074+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-09-12T18:14:09.088983+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-09-12T18:14:09.088983+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.088983+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:18.442009+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":753,"num_read_kb":612,"num_write":278,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'338","reported_seq":1086,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.042262+0000","last_change":"2024-09-12T18:14:03.042155+0000","last_active":"2024-09-12T18:14:03.042262+0000","last_peered":"2024-09-12T18:14:03.042262+0000","last_clean":"2024-09-12T18:14:03.042262+0000","last_became_active":"2024-09-12T17:00:12.310322+0000","last_became_peered":"2024-09-12T17:00:12.310322+0000","last_unstale":"2024-09-12T18:14:03.042262+0000","last_undegraded":"2024-09-12T18:14:03.042262+0000","last_fullsized":"2024-09-12T18:14:03.042262+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'338","last_scrub_stamp":"2024-09-12T18:14:03.041984+0000","last_deep_scrub":"264'338","last_deep_scrub_stamp":"2024-09-12T18:14:03.041984+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.041984+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:17.456643+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262194,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":571,"num_read_kb":27239,"num_write":1052,"num_write_kb":25993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'259","reported_seq":893,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:13.476961+0000","last_change":"2024-09-12T18:14:13.476902+0000","last_active":"2024-09-12T18:14:13.476961+0000","last_peered":"2024-09-12T18:14:13.476961+0000","last_clean":"2024-09-12T18:14:13.476961+0000","last_became_active":"2024-09-12T17:00:46.406809+0000","last_became_peered":"2024-09-12T17:00:46.406809+0000","last_unstale":"2024-09-12T18:14:13.476961+0000","last_undegraded":"2024-09-12T18:14:13.476961+0000","last_fullsized":"2024-09-12T18:14:13.476961+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'259","last_scrub_stamp":"2024-09-12T18:14:13.476817+0000","last_deep_scrub":"264'259","last_deep_scrub_stamp":"2024-09-12T18:14:13.476817+0000","last_clean_scrub_stamp":"2024-09-12T18:14:13.476817+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:26.137002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1147,"num_read_kb":935,"num_write":403,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"264'313","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:59.087652+0000","last_change":"2024-09-12T18:13:59.087595+0000","last_active":"2024-09-12T18:13:59.087652+0000","last_peered":"2024-09-12T18:13:59.087652+0000","last_clean":"2024-09-12T18:13:59.087652+0000","last_became_active":"2024-09-12T17:00:12.312579+0000","last_became_peered":"2024-09-12T17:00:12.312579+0000","last_unstale":"2024-09-12T18:13:59.087652+0000","last_undegraded":"2024-09-12T18:13:59.087652+0000","last_fullsized":"2024-09-12T18:13:59.087652+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'313","last_scrub_stamp":"2024-09-12T18:13:59.087493+0000","last_deep_scrub":"264'313","last_deep_scrub_stamp":"2024-09-12T18:13:59.087493+0000","last_clean_scrub_stamp":"2024-09-12T18:13:59.087493+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:39.390471+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262157,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":699,"num_read_kb":738,"num_write":941,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'458","reported_seq":1244,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.496883+0000","last_change":"2024-09-12T18:14:12.496883+0000","last_active":"2024-09-12T18:14:12.496883+0000","last_peered":"2024-09-12T18:14:12.496883+0000","last_clean":"2024-09-12T18:14:12.496883+0000","last_became_active":"2024-09-12T17:00:14.327158+0000","last_became_peered":"2024-09-12T17:00:14.327158+0000","last_unstale":"2024-09-12T18:14:12.496883+0000","last_undegraded":"2024-09-12T18:14:12.496883+0000","last_fullsized":"2024-09-12T18:14:12.496883+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'458","last_scrub_stamp":"2024-09-12T18:14:12.496744+0000","last_deep_scrub":"264'458","last_deep_scrub_stamp":"2024-09-12T18:14:12.496744+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.496744+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:27.723536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2228,"num_read_kb":1913,"num_write":817,"num_write_kb":525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'343","reported_seq":990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.509367+0000","last_change":"2024-09-12T18:14:03.509257+0000","last_active":"2024-09-12T18:14:03.509367+0000","last_peered":"2024-09-12T18:14:03.509367+0000","last_clean":"2024-09-12T18:14:03.509367+0000","last_became_active":"2024-09-12T17:00:12.317893+0000","last_became_peered":"2024-09-12T17:00:12.317893+0000","last_unstale":"2024-09-12T18:14:03.509367+0000","last_undegraded":"2024-09-12T18:14:03.509367+0000","last_fullsized":"2024-09-12T18:14:03.509367+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'343","last_scrub_stamp":"2024-09-12T18:14:03.509147+0000","last_deep_scrub":"264'343","last_deep_scrub_stamp":"2024-09-12T18:14:03.509147+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.509147+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:19.174816+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524314,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":498,"num_read_kb":13770,"num_write":1022,"num_write_kb":25077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'105","reported_seq":716,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.096105+0000","last_change":"2024-09-12T18:14:08.096105+0000","last_active":"2024-09-12T18:14:08.096105+0000","last_peered":"2024-09-12T18:14:08.096105+0000","last_clean":"2024-09-12T18:14:08.096105+0000","last_became_active":"2024-09-12T17:00:14.323394+0000","last_became_peered":"2024-09-12T17:00:14.323394+0000","last_unstale":"2024-09-12T18:14:08.096105+0000","last_undegraded":"2024-09-12T18:14:08.096105+0000","last_fullsized":"2024-09-12T18:14:08.096105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-12T18:14:08.096018+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-12T18:14:08.096018+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.096018+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:14.501315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":480,"num_read_kb":401,"num_write":159,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'469","reported_seq":1235,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.048486+0000","last_change":"2024-09-12T18:14:04.048486+0000","last_active":"2024-09-12T18:14:04.048486+0000","last_peered":"2024-09-12T18:14:04.048486+0000","last_clean":"2024-09-12T18:14:04.048486+0000","last_became_active":"2024-09-12T17:00:12.314938+0000","last_became_peered":"2024-09-12T17:00:12.314938+0000","last_unstale":"2024-09-12T18:14:04.048486+0000","last_undegraded":"2024-09-12T18:14:04.048486+0000","last_fullsized":"2024-09-12T18:14:04.048486+0000","mapping_epoch":24,"log_start":"264'400","ondisk_log_start":"264'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'469","last_scrub_stamp":"2024-09-12T18:14:04.048381+0000","last_deep_scrub":"264'469","last_deep_scrub_stamp":"2024-09-12T18:14:04.048381+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.048381+0000","objects_scrubbed":8,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:13.231997+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550360,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":846,"num_read_kb":44498,"num_write":1407,"num_write_kb":38820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'334","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.931359+0000","last_change":"2024-09-12T18:14:11.931359+0000","last_active":"2024-09-12T18:14:11.931359+0000","last_peered":"2024-09-12T18:14:11.931359+0000","last_clean":"2024-09-12T18:14:11.931359+0000","last_became_active":"2024-09-12T17:00:14.333821+0000","last_became_peered":"2024-09-12T17:00:14.333821+0000","last_unstale":"2024-09-12T18:14:11.931359+0000","last_undegraded":"2024-09-12T18:14:11.931359+0000","last_fullsized":"2024-09-12T18:14:11.931359+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'334","last_scrub_stamp":"2024-09-12T18:14:11.931271+0000","last_deep_scrub":"264'334","last_deep_scrub_stamp":"2024-09-12T18:14:11.931271+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.931271+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:34.893438+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1469,"num_read_kb":1192,"num_write":564,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4003,"num_omap_keys":18,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'335","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:13:58.946774+0000","last_change":"2024-09-12T18:13:58.946774+0000","last_active":"2024-09-12T18:13:58.946774+0000","last_peered":"2024-09-12T18:13:58.946774+0000","last_clean":"2024-09-12T18:13:58.946774+0000","last_became_active":"2024-09-12T17:00:12.316672+0000","last_became_peered":"2024-09-12T17:00:12.316672+0000","last_unstale":"2024-09-12T18:13:58.946774+0000","last_undegraded":"2024-09-12T18:13:58.946774+0000","last_fullsized":"2024-09-12T18:13:58.946774+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-12T18:13:58.946616+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-12T18:13:58.946616+0000","last_clean_scrub_stamp":"2024-09-12T18:13:58.946616+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:36.236852+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655849,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":486,"num_read_kb":22933,"num_write":961,"num_write_kb":33827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'55","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.802601+0000","last_change":"2024-09-12T18:14:10.802515+0000","last_active":"2024-09-12T18:14:10.802601+0000","last_peered":"2024-09-12T18:14:10.802601+0000","last_clean":"2024-09-12T18:14:10.802601+0000","last_became_active":"2024-09-12T17:00:14.324051+0000","last_became_peered":"2024-09-12T17:00:14.324051+0000","last_unstale":"2024-09-12T18:14:10.802601+0000","last_undegraded":"2024-09-12T18:14:10.802601+0000","last_fullsized":"2024-09-12T18:14:10.802601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'55","last_scrub_stamp":"2024-09-12T18:14:10.802432+0000","last_deep_scrub":"264'55","last_deep_scrub_stamp":"2024-09-12T18:14:10.802432+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.802432+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:33.726378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":201,"num_write":77,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'343","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.030703+0000","last_change":"2024-09-12T18:14:00.030703+0000","last_active":"2024-09-12T18:14:00.030703+0000","last_peered":"2024-09-12T18:14:00.030703+0000","last_clean":"2024-09-12T18:14:00.030703+0000","last_became_active":"2024-09-12T17:00:12.314059+0000","last_became_peered":"2024-09-12T17:00:12.314059+0000","last_unstale":"2024-09-12T18:14:00.030703+0000","last_undegraded":"2024-09-12T18:14:00.030703+0000","last_fullsized":"2024-09-12T18:14:00.030703+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'343","last_scrub_stamp":"2024-09-12T18:14:00.030596+0000","last_deep_scrub":"264'343","last_deep_scrub_stamp":"2024-09-12T18:14:00.030596+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.030596+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:28.562910+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288647,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":67840,"num_write":1028,"num_write_kb":38572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'162","reported_seq":757,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.921925+0000","last_change":"2024-09-12T18:14:09.921850+0000","last_active":"2024-09-12T18:14:09.921925+0000","last_peered":"2024-09-12T18:14:09.921925+0000","last_clean":"2024-09-12T18:14:09.921925+0000","last_became_active":"2024-09-12T17:00:14.338503+0000","last_became_peered":"2024-09-12T17:00:14.338503+0000","last_unstale":"2024-09-12T18:14:09.921925+0000","last_undegraded":"2024-09-12T18:14:09.921925+0000","last_fullsized":"2024-09-12T18:14:09.921925+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'162","last_scrub_stamp":"2024-09-12T18:14:09.921753+0000","last_deep_scrub":"264'162","last_deep_scrub_stamp":"2024-09-12T18:14:09.921753+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.921753+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:14.082713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":567,"num_write":272,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'324","reported_seq":941,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.091077+0000","last_change":"2024-09-12T18:14:04.091077+0000","last_active":"2024-09-12T18:14:04.091077+0000","last_peered":"2024-09-12T18:14:04.091077+0000","last_clean":"2024-09-12T18:14:04.091077+0000","last_became_active":"2024-09-12T17:00:12.311933+0000","last_became_peered":"2024-09-12T17:00:12.311933+0000","last_unstale":"2024-09-12T18:14:04.091077+0000","last_undegraded":"2024-09-12T18:14:04.091077+0000","last_fullsized":"2024-09-12T18:14:04.091077+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-12T18:14:04.090966+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-12T18:14:04.090966+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.090966+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:50.074590+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262214,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":415,"num_read_kb":17784,"num_write":989,"num_write_kb":43947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'289","reported_seq":1011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.097507+0000","last_change":"2024-09-12T18:14:09.097397+0000","last_active":"2024-09-12T18:14:09.097507+0000","last_peered":"2024-09-12T18:14:09.097507+0000","last_clean":"2024-09-12T18:14:09.097507+0000","last_became_active":"2024-09-12T17:00:14.319152+0000","last_became_peered":"2024-09-12T17:00:14.319152+0000","last_unstale":"2024-09-12T18:14:09.097507+0000","last_undegraded":"2024-09-12T18:14:09.097507+0000","last_fullsized":"2024-09-12T18:14:09.097507+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'289","last_scrub_stamp":"2024-09-12T18:14:09.097302+0000","last_deep_scrub":"264'289","last_deep_scrub_stamp":"2024-09-12T18:14:09.097302+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.097302+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:34.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1506,"num_read_kb":1343,"num_write":479,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'453","reported_seq":1124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.986981+0000","last_change":"2024-09-12T18:14:00.986981+0000","last_active":"2024-09-12T18:14:00.986981+0000","last_peered":"2024-09-12T18:14:00.986981+0000","last_clean":"2024-09-12T18:14:00.986981+0000","last_became_active":"2024-09-12T17:00:12.320948+0000","last_became_peered":"2024-09-12T17:00:12.320948+0000","last_unstale":"2024-09-12T18:14:00.986981+0000","last_undegraded":"2024-09-12T18:14:00.986981+0000","last_fullsized":"2024-09-12T18:14:00.986981+0000","mapping_epoch":24,"log_start":"264'400","ondisk_log_start":"264'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'453","last_scrub_stamp":"2024-09-12T18:14:00.986868+0000","last_deep_scrub":"264'453","last_deep_scrub_stamp":"2024-09-12T18:14:00.986868+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.986868+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:58.110493+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":626,"num_read_kb":23095,"num_write":1402,"num_write_kb":45480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'357","reported_seq":1099,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.184916+0000","last_change":"2024-09-12T18:14:10.184780+0000","last_active":"2024-09-12T18:14:10.184916+0000","last_peered":"2024-09-12T18:14:10.184916+0000","last_clean":"2024-09-12T18:14:10.184916+0000","last_became_active":"2024-09-12T17:00:14.331839+0000","last_became_peered":"2024-09-12T17:00:14.331839+0000","last_unstale":"2024-09-12T18:14:10.184916+0000","last_undegraded":"2024-09-12T18:14:10.184916+0000","last_fullsized":"2024-09-12T18:14:10.184916+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'357","last_scrub_stamp":"2024-09-12T18:14:10.184647+0000","last_deep_scrub":"264'357","last_deep_scrub_stamp":"2024-09-12T18:14:10.184647+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.184647+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:43.341571+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1691,"num_read_kb":1457,"num_write":527,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25753,"num_omap_keys":101,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'425","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:04.546147+0000","last_change":"2024-09-12T18:14:04.546047+0000","last_active":"2024-09-12T18:14:04.546147+0000","last_peered":"2024-09-12T18:14:04.546147+0000","last_clean":"2024-09-12T18:14:04.546147+0000","last_became_active":"2024-09-12T17:00:12.320094+0000","last_became_peered":"2024-09-12T17:00:12.320094+0000","last_unstale":"2024-09-12T18:14:04.546147+0000","last_undegraded":"2024-09-12T18:14:04.546147+0000","last_fullsized":"2024-09-12T18:14:04.546147+0000","mapping_epoch":24,"log_start":"264'400","ondisk_log_start":"264'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'425","last_scrub_stamp":"2024-09-12T18:14:04.545897+0000","last_deep_scrub":"264'425","last_deep_scrub_stamp":"2024-09-12T18:14:04.545897+0000","last_clean_scrub_stamp":"2024-09-12T18:14:04.545897+0000","objects_scrubbed":9,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:36.134235+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194332,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":632,"num_read_kb":22255,"num_write":1216,"num_write_kb":35121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'77","reported_seq":661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.799014+0000","last_change":"2024-09-12T18:14:12.798944+0000","last_active":"2024-09-12T18:14:12.799014+0000","last_peered":"2024-09-12T18:14:12.799014+0000","last_clean":"2024-09-12T18:14:12.799014+0000","last_became_active":"2024-09-12T17:00:14.334965+0000","last_became_peered":"2024-09-12T17:00:14.334965+0000","last_unstale":"2024-09-12T18:14:12.799014+0000","last_undegraded":"2024-09-12T18:14:12.799014+0000","last_fullsized":"2024-09-12T18:14:12.799014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'77","last_scrub_stamp":"2024-09-12T18:14:12.798856+0000","last_deep_scrub":"264'77","last_deep_scrub_stamp":"2024-09-12T18:14:12.798856+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.798856+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:20.717929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":336,"num_read_kb":283,"num_write":118,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'338","reported_seq":983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:02.017968+0000","last_change":"2024-09-12T18:14:02.017906+0000","last_active":"2024-09-12T18:14:02.017968+0000","last_peered":"2024-09-12T18:14:02.017968+0000","last_clean":"2024-09-12T18:14:02.017968+0000","last_became_active":"2024-09-12T17:00:12.321156+0000","last_became_peered":"2024-09-12T17:00:12.321156+0000","last_unstale":"2024-09-12T18:14:02.017968+0000","last_undegraded":"2024-09-12T18:14:02.017968+0000","last_fullsized":"2024-09-12T18:14:02.017968+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'338","last_scrub_stamp":"2024-09-12T18:14:02.017773+0000","last_deep_scrub":"264'338","last_deep_scrub_stamp":"2024-09-12T18:14:02.017773+0000","last_clean_scrub_stamp":"2024-09-12T18:14:02.017773+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:36.638383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170120,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":18612,"num_write":1036,"num_write_kb":25817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'177","reported_seq":804,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:25.089900+0000","last_change":"2024-09-12T18:14:25.089835+0000","last_active":"2024-09-12T18:14:25.089900+0000","last_peered":"2024-09-12T18:14:25.089900+0000","last_clean":"2024-09-12T18:14:25.089900+0000","last_became_active":"2024-09-12T17:00:14.322880+0000","last_became_peered":"2024-09-12T17:00:14.322880+0000","last_unstale":"2024-09-12T18:14:25.089900+0000","last_undegraded":"2024-09-12T18:14:25.089900+0000","last_fullsized":"2024-09-12T18:14:25.089900+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-12T18:14:25.089729+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-12T18:14:25.089729+0000","last_clean_scrub_stamp":"2024-09-12T18:14:25.089729+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:52.513915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":741,"num_read_kb":611,"num_write":268,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'393","reported_seq":1057,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:05.556524+0000","last_change":"2024-09-12T18:14:05.556462+0000","last_active":"2024-09-12T18:14:05.556524+0000","last_peered":"2024-09-12T18:14:05.556524+0000","last_clean":"2024-09-12T18:14:05.556524+0000","last_became_active":"2024-09-12T17:00:12.314707+0000","last_became_peered":"2024-09-12T17:00:12.314707+0000","last_unstale":"2024-09-12T18:14:05.556524+0000","last_undegraded":"2024-09-12T18:14:05.556524+0000","last_fullsized":"2024-09-12T18:14:05.556524+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'393","last_scrub_stamp":"2024-09-12T18:14:05.556338+0000","last_deep_scrub":"264'393","last_deep_scrub_stamp":"2024-09-12T18:14:05.556338+0000","last_clean_scrub_stamp":"2024-09-12T18:14:05.556338+0000","objects_scrubbed":7,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:07.321823+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590083,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":560,"num_read_kb":37012,"num_write":1300,"num_write_kb":41769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'170","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:11.829676+0000","last_change":"2024-09-12T18:14:11.829591+0000","last_active":"2024-09-12T18:14:11.829676+0000","last_peered":"2024-09-12T18:14:11.829676+0000","last_clean":"2024-09-12T18:14:11.829676+0000","last_became_active":"2024-09-12T17:00:14.324709+0000","last_became_peered":"2024-09-12T17:00:14.324709+0000","last_unstale":"2024-09-12T18:14:11.829676+0000","last_undegraded":"2024-09-12T18:14:11.829676+0000","last_fullsized":"2024-09-12T18:14:11.829676+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'170","last_scrub_stamp":"2024-09-12T18:14:11.829476+0000","last_deep_scrub":"264'170","last_deep_scrub_stamp":"2024-09-12T18:14:11.829476+0000","last_clean_scrub_stamp":"2024-09-12T18:14:11.829476+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:36.346842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":785,"num_read_kb":657,"num_write":242,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'303","reported_seq":950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:03.020131+0000","last_change":"2024-09-12T18:14:03.020070+0000","last_active":"2024-09-12T18:14:03.020131+0000","last_peered":"2024-09-12T18:14:03.020131+0000","last_clean":"2024-09-12T18:14:03.020131+0000","last_became_active":"2024-09-12T17:00:12.307159+0000","last_became_peered":"2024-09-12T17:00:12.307159+0000","last_unstale":"2024-09-12T18:14:03.020131+0000","last_undegraded":"2024-09-12T18:14:03.020131+0000","last_fullsized":"2024-09-12T18:14:03.020131+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'303","last_scrub_stamp":"2024-09-12T18:14:03.019965+0000","last_deep_scrub":"264'303","last_deep_scrub_stamp":"2024-09-12T18:14:03.019965+0000","last_clean_scrub_stamp":"2024-09-12T18:14:03.019965+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:43.348169+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":429,"num_read_kb":7363,"num_write":949,"num_write_kb":31388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'4088","reported_seq":4677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.194674+0000","last_change":"2024-09-12T18:14:12.194617+0000","last_active":"2024-09-12T18:14:12.194674+0000","last_peered":"2024-09-12T18:14:12.194674+0000","last_clean":"2024-09-12T18:14:12.194674+0000","last_became_active":"2024-09-12T17:00:14.327792+0000","last_became_peered":"2024-09-12T17:00:14.327792+0000","last_unstale":"2024-09-12T18:14:12.194674+0000","last_undegraded":"2024-09-12T18:14:12.194674+0000","last_fullsized":"2024-09-12T18:14:12.194674+0000","mapping_epoch":26,"log_start":"264'4000","ondisk_log_start":"264'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4088","last_scrub_stamp":"2024-09-12T18:14:12.194534+0000","last_deep_scrub":"264'4088","last_deep_scrub_stamp":"2024-09-12T18:14:12.194534+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.194534+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:07.058121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16430,"num_read_kb":13786,"num_write":6128,"num_write_kb":3057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'357","reported_seq":1019,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.049409+0000","last_change":"2024-09-12T18:14:01.049352+0000","last_active":"2024-09-12T18:14:01.049409+0000","last_peered":"2024-09-12T18:14:01.049409+0000","last_clean":"2024-09-12T18:14:01.049409+0000","last_became_active":"2024-09-12T17:00:12.311273+0000","last_became_peered":"2024-09-12T17:00:12.311273+0000","last_unstale":"2024-09-12T18:14:01.049409+0000","last_undegraded":"2024-09-12T18:14:01.049409+0000","last_fullsized":"2024-09-12T18:14:01.049409+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'357","last_scrub_stamp":"2024-09-12T18:14:01.049257+0000","last_deep_scrub":"264'357","last_deep_scrub_stamp":"2024-09-12T18:14:01.049257+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.049257+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:56.629359+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":481304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":502,"num_read_kb":37128,"num_write":1093,"num_write_kb":49312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'266","reported_seq":928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:09.145064+0000","last_change":"2024-09-12T18:14:09.144997+0000","last_active":"2024-09-12T18:14:09.145064+0000","last_peered":"2024-09-12T18:14:09.145064+0000","last_clean":"2024-09-12T18:14:09.145064+0000","last_became_active":"2024-09-12T17:00:14.318470+0000","last_became_peered":"2024-09-12T17:00:14.318470+0000","last_unstale":"2024-09-12T18:14:09.145064+0000","last_undegraded":"2024-09-12T18:14:09.145064+0000","last_fullsized":"2024-09-12T18:14:09.145064+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'266","last_scrub_stamp":"2024-09-12T18:14:09.144908+0000","last_deep_scrub":"264'266","last_deep_scrub_stamp":"2024-09-12T18:14:09.144908+0000","last_clean_scrub_stamp":"2024-09-12T18:14:09.144908+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:18.716492+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1277,"num_read_kb":1058,"num_write":468,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'351","reported_seq":1075,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:06.181591+0000","last_change":"2024-09-12T18:14:06.181495+0000","last_active":"2024-09-12T18:14:06.181591+0000","last_peered":"2024-09-12T18:14:06.181591+0000","last_clean":"2024-09-12T18:14:06.181591+0000","last_became_active":"2024-09-12T17:00:12.314371+0000","last_became_peered":"2024-09-12T17:00:12.314371+0000","last_unstale":"2024-09-12T18:14:06.181591+0000","last_undegraded":"2024-09-12T18:14:06.181591+0000","last_fullsized":"2024-09-12T18:14:06.181591+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'351","last_scrub_stamp":"2024-09-12T18:14:06.181390+0000","last_deep_scrub":"264'351","last_deep_scrub_stamp":"2024-09-12T18:14:06.181390+0000","last_clean_scrub_stamp":"2024-09-12T18:14:06.181390+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:08.888322+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655829,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":559,"num_read_kb":6257,"num_write":1103,"num_write_kb":25577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'129","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.963386+0000","last_change":"2024-09-12T18:14:12.963272+0000","last_active":"2024-09-12T18:14:12.963386+0000","last_peered":"2024-09-12T18:14:12.963386+0000","last_clean":"2024-09-12T18:14:12.963386+0000","last_became_active":"2024-09-12T17:00:14.339316+0000","last_became_peered":"2024-09-12T17:00:14.339316+0000","last_unstale":"2024-09-12T18:14:12.963386+0000","last_undegraded":"2024-09-12T18:14:12.963386+0000","last_fullsized":"2024-09-12T18:14:12.963386+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'129","last_scrub_stamp":"2024-09-12T18:14:12.963173+0000","last_deep_scrub":"264'129","last_deep_scrub_stamp":"2024-09-12T18:14:12.963173+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.963173+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:55.742662+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":538,"num_read_kb":439,"num_write":190,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'325","reported_seq":965,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:00.097079+0000","last_change":"2024-09-12T18:14:00.097022+0000","last_active":"2024-09-12T18:14:00.097079+0000","last_peered":"2024-09-12T18:14:00.097079+0000","last_clean":"2024-09-12T18:14:00.097079+0000","last_became_active":"2024-09-12T17:00:12.310157+0000","last_became_peered":"2024-09-12T17:00:12.310157+0000","last_unstale":"2024-09-12T18:14:00.097079+0000","last_undegraded":"2024-09-12T18:14:00.097079+0000","last_fullsized":"2024-09-12T18:14:00.097079+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'325","last_scrub_stamp":"2024-09-12T18:14:00.096895+0000","last_deep_scrub":"264'325","last_deep_scrub_stamp":"2024-09-12T18:14:00.096895+0000","last_clean_scrub_stamp":"2024-09-12T18:14:00.096895+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:51.639756+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1093042,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":459,"num_read_kb":8306,"num_write":1094,"num_write_kb":29458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'209","reported_seq":818,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.203502+0000","last_change":"2024-09-12T18:14:10.203419+0000","last_active":"2024-09-12T18:14:10.203502+0000","last_peered":"2024-09-12T18:14:10.203502+0000","last_clean":"2024-09-12T18:14:10.203502+0000","last_became_active":"2024-09-12T17:00:46.406426+0000","last_became_peered":"2024-09-12T17:00:46.406426+0000","last_unstale":"2024-09-12T18:14:10.203502+0000","last_undegraded":"2024-09-12T18:14:10.203502+0000","last_fullsized":"2024-09-12T18:14:10.203502+0000","mapping_epoch":37,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'209","last_scrub_stamp":"2024-09-12T18:14:10.203299+0000","last_deep_scrub":"264'209","last_deep_scrub_stamp":"2024-09-12T18:14:10.203299+0000","last_clean_scrub_stamp":"2024-09-12T18:14:10.203299+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:01.928198+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":857,"num_read_kb":696,"num_write":294,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":272,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'306","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:07.595452+0000","last_change":"2024-09-12T18:14:07.595386+0000","last_active":"2024-09-12T18:14:07.595452+0000","last_peered":"2024-09-12T18:14:07.595452+0000","last_clean":"2024-09-12T18:14:07.595452+0000","last_became_active":"2024-09-12T17:00:12.314251+0000","last_became_peered":"2024-09-12T17:00:12.314251+0000","last_unstale":"2024-09-12T18:14:07.595452+0000","last_undegraded":"2024-09-12T18:14:07.595452+0000","last_fullsized":"2024-09-12T18:14:07.595452+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'306","last_scrub_stamp":"2024-09-12T18:14:07.595274+0000","last_deep_scrub":"264'306","last_deep_scrub_stamp":"2024-09-12T18:14:07.595274+0000","last_clean_scrub_stamp":"2024-09-12T18:14:07.595274+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:45.280471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":403,"num_read_kb":8717,"num_write":971,"num_write_kb":22240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'314","reported_seq":1127,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.571820+0000","last_change":"2024-09-12T18:14:08.571713+0000","last_active":"2024-09-12T18:14:08.571820+0000","last_peered":"2024-09-12T18:14:08.571820+0000","last_clean":"2024-09-12T18:14:08.571820+0000","last_became_active":"2024-09-12T17:00:12.318408+0000","last_became_peered":"2024-09-12T17:00:12.318408+0000","last_unstale":"2024-09-12T18:14:08.571820+0000","last_undegraded":"2024-09-12T18:14:08.571820+0000","last_fullsized":"2024-09-12T18:14:08.571820+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'314","last_scrub_stamp":"2024-09-12T18:14:08.571615+0000","last_deep_scrub":"264'314","last_deep_scrub_stamp":"2024-09-12T18:14:08.571615+0000","last_clean_scrub_stamp":"2024-09-12T18:14:08.571615+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:11.147120+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":853,"num_read_kb":6455,"num_write":1039,"num_write_kb":20037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'90","reported_seq":673,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:12.213953+0000","last_change":"2024-09-12T18:14:12.213953+0000","last_active":"2024-09-12T18:14:12.213953+0000","last_peered":"2024-09-12T18:14:12.213953+0000","last_clean":"2024-09-12T18:14:12.213953+0000","last_became_active":"2024-09-12T17:00:14.334494+0000","last_became_peered":"2024-09-12T17:00:14.334494+0000","last_unstale":"2024-09-12T18:14:12.213953+0000","last_undegraded":"2024-09-12T18:14:12.213953+0000","last_fullsized":"2024-09-12T18:14:12.213953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'90","last_scrub_stamp":"2024-09-12T18:14:12.213853+0000","last_deep_scrub":"264'90","last_deep_scrub_stamp":"2024-09-12T18:14:12.213853+0000","last_clean_scrub_stamp":"2024-09-12T18:14:12.213853+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:27.439976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":377,"num_read_kb":312,"num_write":145,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'354","reported_seq":1000,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:01.047592+0000","last_change":"2024-09-12T18:14:01.047528+0000","last_active":"2024-09-12T18:14:01.047592+0000","last_peered":"2024-09-12T18:14:01.047592+0000","last_clean":"2024-09-12T18:14:01.047592+0000","last_became_active":"2024-09-12T17:00:12.314988+0000","last_became_peered":"2024-09-12T17:00:12.314988+0000","last_unstale":"2024-09-12T18:14:01.047592+0000","last_undegraded":"2024-09-12T18:14:01.047592+0000","last_fullsized":"2024-09-12T18:14:01.047592+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'354","last_scrub_stamp":"2024-09-12T18:14:01.047428+0000","last_deep_scrub":"264'354","last_deep_scrub_stamp":"2024-09-12T18:14:01.047428+0000","last_clean_scrub_stamp":"2024-09-12T18:14:01.047428+0000","objects_scrubbed":6,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:54.071159+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":45801,"num_write":1031,"num_write_kb":31559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'222","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:14:15.436076+0000","last_change":"2024-09-12T18:14:15.436011+0000","last_active":"2024-09-12T18:14:15.436076+0000","last_peered":"2024-09-12T18:14:15.436076+0000","last_clean":"2024-09-12T18:14:15.436076+0000","last_became_active":"2024-09-12T17:00:14.333107+0000","last_became_peered":"2024-09-12T17:00:14.333107+0000","last_unstale":"2024-09-12T18:14:15.436076+0000","last_undegraded":"2024-09-12T18:14:15.436076+0000","last_fullsized":"2024-09-12T18:14:15.436076+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'222","last_scrub_stamp":"2024-09-12T18:14:15.435914+0000","last_deep_scrub":"264'222","last_deep_scrub_stamp":"2024-09-12T18:14:15.435914+0000","last_clean_scrub_stamp":"2024-09-12T18:14:15.435914+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:16.388139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":970,"num_read_kb":803,"num_write":364,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5638,"num_read_kb":3956,"num_write":1906,"num_write_kb":804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8872,"num_omap_keys":19,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1079,"ondisk_log_size":1079,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":16256,"num_read_kb":15929,"num_write":16738,"num_write_kb":4889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2934,"num_omap_keys":19,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1759,"ondisk_log_size":1759,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":565,"ondisk_log_size":565,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1559950,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":19041,"num_read_kb":39761,"num_write":15891,"num_write_kb":11979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685112,"num_omap_keys":1570,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2081,"ondisk_log_size":2081,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2432,"num_read_kb":2899,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102836,"num_read_kb":85763,"num_write":37242,"num_write_kb":18813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43842,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3669,"ondisk_log_size":3669,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":76932281,"num_objects":387,"num_object_clones":0,"num_object_copies":774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":387,"num_whiteouts":0,"num_read":36237,"num_read_kb":1844237,"num_write":71508,"num_write_kb":1970689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":155025408,"data_stored":153864562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3422,"ondisk_log_size":3422,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":154912,"num_write":182,"num_write_kb":116389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":158387,"num_write":182,"num_write_kb":116389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424510351,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76020,"kb_used_data":22628,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94295820,"statfs":{"total":96636764160,"available":96558919680,"internally_reserved":0,"allocated":23171072,"data_stored":21619631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510353,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119664,"kb_used_data":8032,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94252176,"statfs":{"total":96636764160,"available":96514228224,"internally_reserved":0,"allocated":8224768,"data_stored":6647389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543053,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257492,"kb_used_data":27780,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94114348,"statfs":{"total":96636764160,"available":96373092352,"internally_reserved":0,"allocated":28446720,"data_stored":26727116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235207114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543055,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":241664,"kb_used_data":16112,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94130176,"statfs":{"total":96636764160,"available":96389300224,"internally_reserved":0,"allocated":16498688,"data_stored":14904367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":230947270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543055,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150784,"kb_used_data":25264,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94221056,"statfs":{"total":96636764160,"available":96482361344,"internally_reserved":0,"allocated":25870336,"data_stored":24131043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128514501},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543055,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275728,"kb_used_data":32128,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94096112,"statfs":{"total":96636764160,"available":96354418688,"internally_reserved":0,"allocated":32899072,"data_stored":31197660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":249428423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543053,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229924,"kb_used_data":18260,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94141916,"statfs":{"total":96636764160,"available":96401321984,"internally_reserved":0,"allocated":18698240,"data_stored":17001849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":216725957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575756,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98204,"kb_used_data":30924,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94273636,"statfs":{"total":96636764160,"available":96536203264,"internally_reserved":0,"allocated":31666176,"data_stored":30017021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14422016,"data_stored":14261258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4595712,"data_stored":4499422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19558400,"data_stored":19471135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29220864,"data_stored":29046128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28045312,"data_stored":27867248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22167552,"data_stored":21980545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12857344,"data_stored":12753756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24158208,"data_stored":23985070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":4704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:15:19.759 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T18:15:20.091 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T18:15:20.092 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T18:15:20.092 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T18:15:20.092 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:15:20.139 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T18:15:20.139 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T18:15:20.139 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:15:20.179 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T18:15:20.180 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T18:15:20.180 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:15:20.254 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T18:15:20.254 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T18:15:20.254 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:15:20.340 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T18:15:20.340 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T18:15:20.340 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:15:20.390 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T18:15:20.391 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T18:15:20.391 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:15:20.435 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T18:15:20.435 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T18:15:20.436 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:15:20.490 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T18:15:20.490 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T18:15:20.491 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:15:20.535 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T18:15:20.536 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T18:15:20.536 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T18:15:20.536 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:15:20.562 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T18:15:20.562 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T18:15:20.562 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:15:20.591 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T18:15:20.592 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T18:15:20.592 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T18:15:20.592 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:15:20.619 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T18:15:20.620 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T18:15:20.620 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:15:20.673 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T18:15:20.673 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T18:15:20.673 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:15:20.686 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T18:15:20.686 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T18:15:20.686 DEBUG:teuthology.orchestra.run.smithi067:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T18:15:20.757 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi067.front.sepia.ceph.com 2024-09-12T18:15:20.757 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T18:15:20.991 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi067.front.sepia.ceph.com 2024-09-12T18:15:20.991 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T18:15:21.093 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi067.front.sepia.ceph.com 2024-09-12T18:15:21.093 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T18:15:21.165 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi067.front.sepia.ceph.com 2024-09-12T18:15:21.166 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T18:15:21.248 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi118.front.sepia.ceph.com 2024-09-12T18:15:21.249 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T18:15:21.458 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi118.front.sepia.ceph.com 2024-09-12T18:15:21.458 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T18:15:21.562 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi118.front.sepia.ceph.com 2024-09-12T18:15:21.563 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T18:15:21.641 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi118.front.sepia.ceph.com 2024-09-12T18:15:21.641 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T18:15:21.717 INFO:tasks.ceph:Archiving mon data... 2024-09-12T18:15:21.718 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902701/data/mon.a.tgz 2024-09-12T18:15:21.719 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2024-09-12T18:15:21.751 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.B4TbD5lfsQ 2024-09-12T18:15:21.752 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.B4TbD5lfsQ 2024-09-12T18:15:21.958 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.B4TbD5lfsQ 2024-09-12T18:15:22.071 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.B4TbD5lfsQ is 501KB 2024-09-12T18:15:22.169 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.B4TbD5lfsQ 2024-09-12T18:15:22.199 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902701/data/mon.c.tgz 2024-09-12T18:15:22.199 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2024-09-12T18:15:22.268 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.sCwGLPraBv 2024-09-12T18:15:22.268 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.sCwGLPraBv 2024-09-12T18:15:22.453 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.sCwGLPraBv 2024-09-12T18:15:22.566 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.sCwGLPraBv is 501KB 2024-09-12T18:15:22.670 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.sCwGLPraBv 2024-09-12T18:15:22.699 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902701/data/mon.b.tgz 2024-09-12T18:15:22.700 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2024-09-12T18:15:22.734 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.XUNGVQiXIo 2024-09-12T18:15:22.734 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.XUNGVQiXIo 2024-09-12T18:15:23.184 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.XUNGVQiXIo 2024-09-12T18:15:23.318 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.XUNGVQiXIo is 501KB 2024-09-12T18:15:23.779 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.XUNGVQiXIo 2024-09-12T18:15:23.810 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T18:15:23.811 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T18:15:23.814 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T18:15:24.005 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T18:15:24.035 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T18:15:24.035 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T18:15:24.038 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902701/remote/smithi067/crash 2024-09-12T18:15:24.038 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T18:15:24.080 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902701/remote/smithi118/crash 2024-09-12T18:15:24.081 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T18:15:24.119 INFO:tasks.ceph:Compressing logs... 2024-09-12T18:15:24.119 DEBUG:teuthology.orchestra.run.smithi067:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T18:15:24.125 DEBUG:teuthology.orchestra.run.smithi118:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T18:15:24.207 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32851.log 2024-09-12T18:15:24.207 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T18:15:24.207 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32708.log 2024-09-12T18:15:24.207 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32851.log.gz 2024-09-12T18:15:24.208 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T18:15:24.208 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32708.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T18:15:24.208 INFO:teuthology.orchestra.run.smithi118.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32708.log.gz 2024-09-12T18:15:24.208 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32895.log 2024-09-12T18:15:24.208 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32763.log 2024-09-12T18:15:24.208 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32895.log.gz 2024-09-12T18:15:24.208 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32576.log 2024-09-12T18:15:24.208 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32807.log 2024-09-12T18:15:24.208 INFO:teuthology.orchestra.run.smithi118.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32763.log.gz 2024-09-12T18:15:24.208 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32576.log.gz 2024-09-12T18:15:24.208 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T18:15:24.209 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32807.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T18:15:24.209 INFO:teuthology.orchestra.run.smithi118.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32807.log.gz 2024-09-12T18:15:24.209 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.6.log: 90.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T18:15:24.209 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T18:15:24.209 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T18:15:24.209 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T18:15:24.209 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32664.log 2024-09-12T18:15:24.209 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.32664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32664.log.gz 2024-09-12T18:15:24.209 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32620.log 2024-09-12T18:15:24.209 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32620.log.gz 2024-09-12T18:15:24.215 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T18:15:24.267 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T18:15:24.267 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82706.log 2024-09-12T18:15:24.267 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110389.log 2024-09-12T18:15:24.267 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.82706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112156.log 2024-09-12T18:15:24.267 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155746.log 2024-09-12T18:15:24.267 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163425.log 2024-09-12T18:15:24.268 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38715.log 2024-09-12T18:15:24.268 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.110389.log: /var/log/ceph/ceph-client.admin.112156.log: /var/log/ceph/ceph-client.admin.155746.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.82706.log.gz 2024-09-12T18:15:24.268 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.163425.log: gzip 87.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.110389.log.gz --verbose 2024-09-12T18:15:24.268 INFO:teuthology.orchestra.run.smithi067.stderr: -- /var/log/ceph/ceph-client.admin.74297.log 2024-09-12T18:15:24.268 INFO:teuthology.orchestra.run.smithi067.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.112156.log.gz 2024-09-12T18:15:24.268 INFO:teuthology.orchestra.run.smithi067.stderr:gzip 81.8% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.163425.log.gz -- 2024-09-12T18:15:24.268 INFO:teuthology.orchestra.run.smithi067.stderr: /var/log/ceph/ceph-client.0.187405.log 2024-09-12T18:15:24.268 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.38715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38715.log.gz 2024-09-12T18:15:24.268 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194173.log 2024-09-12T18:15:24.268 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.74297.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.74297.log.gz 2024-09-12T18:15:24.269 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.187405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141608.log 2024-09-12T18:15:24.269 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.194173.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.187405.log.gz 2024-09-12T18:15:24.269 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60874.log 2024-09-12T18:15:24.269 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194173.log.gz 2024-09-12T18:15:24.269 INFO:teuthology.orchestra.run.smithi067.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.155746.log.gz 2024-09-12T18:15:24.269 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50765.log 2024-09-12T18:15:24.269 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.141608.log: /var/log/ceph/ceph-client.admin.60874.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.141608.log.gzgzip 2024-09-12T18:15:24.269 INFO:teuthology.orchestra.run.smithi067.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.38502.log 2024-09-12T18:15:24.269 INFO:teuthology.orchestra.run.smithi067.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.60874.log.gz 2024-09-12T18:15:24.269 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66967.log 2024-09-12T18:15:24.269 INFO:teuthology.orchestra.run.smithi067.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.50765.log.gz 2024-09-12T18:15:24.270 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.38502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39284.log 2024-09-12T18:15:24.270 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38502.log.gz 2024-09-12T18:15:24.270 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.66967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63587.log 2024-09-12T18:15:24.270 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135128.log 2024-09-12T18:15:24.270 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39284.log.gz 2024-09-12T18:15:24.270 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.63587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175310.log 2024-09-12T18:15:24.270 INFO:teuthology.orchestra.run.smithi067.stderr: 58.8% -- replaced with /var/log/ceph/ceph-client.admin.63587.log.gz 2024-09-12T18:15:24.270 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.135128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67588.log 2024-09-12T18:15:24.270 INFO:teuthology.orchestra.run.smithi067.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.135128.log.gz 2024-09-12T18:15:24.270 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.175310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40066.log 2024-09-12T18:15:24.271 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71921.log 2024-09-12T18:15:24.271 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.67588.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.175310.log.gz 2024-09-12T18:15:24.271 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.40066.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40066.log.gz -5 2024-09-12T18:15:24.271 INFO:teuthology.orchestra.run.smithi067.stderr: --verbose -- /var/log/ceph/ceph-client.admin.135717.log 2024-09-12T18:15:24.271 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.71921.log: /var/log/ceph/ceph-client.admin.64159.log 2024-09-12T18:15:24.271 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.135717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162247.log 2024-09-12T18:15:24.271 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.64159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173338.log 2024-09-12T18:15:24.271 INFO:teuthology.orchestra.run.smithi067.stderr: 87.7%/var/log/ceph/ceph-client.admin.162247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45061.log 2024-09-12T18:15:24.271 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64159.log.gz 2024-09-12T18:15:24.271 INFO:teuthology.orchestra.run.smithi067.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.162247.log.gz 2024-09-12T18:15:24.271 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71921.log.gz 2024-09-12T18:15:24.271 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.173338.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.135717.log.gz 2024-09-12T18:15:24.272 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164603.log 2024-09-12T18:15:24.272 INFO:teuthology.orchestra.run.smithi067.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.173338.log.gz 2024-09-12T18:15:24.272 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38103.log 2024-09-12T18:15:24.272 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.45061.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.45061.log.gz 2024-09-12T18:15:24.272 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.164603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42643.log 2024-09-12T18:15:24.272 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164603.log.gz 2024-09-12T18:15:24.272 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.38103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64960.log 2024-09-12T18:15:24.272 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38103.log.gz 2024-09-12T18:15:24.272 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.42643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53169.log 2024-09-12T18:15:24.272 INFO:teuthology.orchestra.run.smithi067.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.0.42643.log.gz 2024-09-12T18:15:24.272 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.64960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194127.log 2024-09-12T18:15:24.273 INFO:teuthology.orchestra.run.smithi067.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.67588.log.gz 2024-09-12T18:15:24.273 INFO:teuthology.orchestra.run.smithi067.stderr: 20.8% -- replaced with /var/log/ceph/ceph-client.admin.64960.log.gz 2024-09-12T18:15:24.273 INFO:teuthology.orchestra.run.smithi067.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.66967.log.gz 2024-09-12T18:15:24.273 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113334.log 2024-09-12T18:15:24.273 INFO:teuthology.orchestra.run.smithi067.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.53169.log.gz 2024-09-12T18:15:24.273 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.194127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102732.log 2024-09-12T18:15:24.273 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194127.log.gz 2024-09-12T18:15:24.273 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.113334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143375.log 2024-09-12T18:15:24.273 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.102732.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.113334.log.gz 2024-09-12T18:15:24.273 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179488.log 2024-09-12T18:15:24.274 INFO:teuthology.orchestra.run.smithi067.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.102732.log.gz 2024-09-12T18:15:24.274 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.143375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104499.log 2024-09-12T18:15:24.274 INFO:teuthology.orchestra.run.smithi067.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.143375.log.gz 2024-09-12T18:15:24.274 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.179488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156924.log 2024-09-12T18:15:24.274 INFO:teuthology.orchestra.run.smithi067.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.179488.log.gz 2024-09-12T18:15:24.274 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.104499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41389.log 2024-09-12T18:15:24.274 INFO:teuthology.orchestra.run.smithi067.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.104499.log.gz 2024-09-12T18:15:24.274 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.156924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182533.log 2024-09-12T18:15:24.274 INFO:teuthology.orchestra.run.smithi067.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.156924.log.gz 2024-09-12T18:15:24.274 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.41389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84473.log 2024-09-12T18:15:24.274 INFO:teuthology.orchestra.run.smithi067.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.0.41389.log.gz 2024-09-12T18:15:24.274 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.182533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142197.log 2024-09-12T18:15:24.275 INFO:teuthology.orchestra.run.smithi067.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.0.182533.log.gz 2024-09-12T18:15:24.275 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166418.log 2024-09-12T18:15:24.275 INFO:teuthology.orchestra.run.smithi067.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.84473.log.gz 2024-09-12T18:15:24.275 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.142197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126293.log 2024-09-12T18:15:24.275 INFO:teuthology.orchestra.run.smithi067.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.142197.log.gz 2024-09-12T18:15:24.275 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.166418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178270.log 2024-09-12T18:15:24.275 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166418.log.gz 2024-09-12T18:15:24.275 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.126293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119813.log 2024-09-12T18:15:24.275 INFO:teuthology.orchestra.run.smithi067.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.126293.log.gz 2024-09-12T18:15:24.275 INFO:teuthology.orchestra.run.smithi067.stderr:gzip/var/log/ceph/ceph-client.0.178270.log: -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T18:15:24.275 INFO:teuthology.orchestra.run.smithi067.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.0.178270.log.gz 2024-09-12T18:15:24.276 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.119813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160458.log 2024-09-12T18:15:24.276 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.1.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.119813.log.gz 2024-09-12T18:15:24.276 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145142.log 2024-09-12T18:15:24.276 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.160458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139841.log 2024-09-12T18:15:24.276 INFO:teuthology.orchestra.run.smithi067.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.160458.log.gz 2024-09-12T18:15:24.276 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.145142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68207.log 2024-09-12T18:15:24.276 INFO:teuthology.orchestra.run.smithi067.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.145142.log.gz 2024-09-12T18:15:24.276 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40786.log 2024-09-12T18:15:24.276 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.139841.log: /var/log/ceph/ceph-client.admin.68207.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T18:15:24.276 INFO:teuthology.orchestra.run.smithi067.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.139841.log.gz 2024-09-12T18:15:24.277 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.40786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46851.log 2024-09-12T18:15:24.277 INFO:teuthology.orchestra.run.smithi067.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.40786.log.gz 2024-09-12T18:15:24.277 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194541.log 2024-09-12T18:15:24.277 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ops-log-ceph-client.0.log: /var/log/ceph/ceph-client.admin.46851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177023.log 2024-09-12T18:15:24.277 INFO:teuthology.orchestra.run.smithi067.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.46851.log.gz 2024-09-12T18:15:24.277 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.194541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96842.log 2024-09-12T18:15:24.277 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194541.log.gz 2024-09-12T18:15:24.277 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.177023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53121.log 2024-09-12T18:15:24.277 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.96842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117457.log 2024-09-12T18:15:24.277 INFO:teuthology.orchestra.run.smithi067.stderr:gzip/var/log/ceph/ceph-client.admin.53121.log: -5 87.2% -- replaced with /var/log/ceph/ceph-client.admin.96842.log.gz 2024-09-12T18:15:24.277 INFO:teuthology.orchestra.run.smithi067.stderr: --verbose 0.0% -- /var/log/ceph/ceph-client.admin.38304.log 2024-09-12T18:15:24.278 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53121.log.gz 2024-09-12T18:15:24.278 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5/var/log/ceph/ceph-client.admin.117457.log: --verbose -- /var/log/ceph/ceph-client.admin.170347.log 2024-09-12T18:15:24.278 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.38304.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.117457.log.gz 2024-09-12T18:15:24.278 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38304.log.gz 2024-09-12T18:15:24.278 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83884.log 2024-09-12T18:15:24.278 INFO:teuthology.orchestra.run.smithi067.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.177023.log.gz 2024-09-12T18:15:24.278 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39084.log 2024-09-12T18:15:24.278 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.170347.log: /var/log/ceph/ceph-client.admin.83884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65024.log 92.3% 2024-09-12T18:15:24.278 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.170347.log.gz 82.0% -- replaced with /var/log/ceph/ceph-client.admin.83884.log.gz 2024-09-12T18:15:24.278 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T18:15:24.278 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39084.log.gz 2024-09-12T18:15:24.278 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190687.log 2024-09-12T18:15:24.279 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.65024.log: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.68207.log.gz 2024-09-12T18:15:24.279 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102143.log 2024-09-12T18:15:24.279 INFO:teuthology.orchestra.run.smithi067.stderr: 21.6% -- replaced with /var/log/ceph/ceph-client.admin.65024.log.gz 2024-09-12T18:15:24.279 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194495.log 2024-09-12T18:15:24.279 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.190687.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190687.log.gz 2024-09-12T18:15:24.279 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88596.log 2024-09-12T18:15:24.279 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.102143.log: /var/log/ceph/ceph-client.admin.194495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105088.log 2024-09-12T18:15:24.279 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194495.log.gz 87.2% 2024-09-12T18:15:24.279 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102143.log.gz 2024-09-12T18:15:24.279 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80350.log 2024-09-12T18:15:24.279 INFO:teuthology.orchestra.run.smithi067.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.88596.log.gz 2024-09-12T18:15:24.279 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153389.log 2024-09-12T18:15:24.280 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.105088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54936.log 2024-09-12T18:15:24.280 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.80350.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.105088.log.gz 2024-09-12T18:15:24.280 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.153389.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.80350.log.gz 2024-09-12T18:15:24.280 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32801.log 2024-09-12T18:15:24.280 INFO:teuthology.orchestra.run.smithi067.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.153389.log.gz 2024-09-12T18:15:24.280 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116868.log 2024-09-12T18:15:24.280 INFO:teuthology.orchestra.run.smithi067.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.54936.log.gz 2024-09-12T18:15:24.280 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.32801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139252.log 2024-09-12T18:15:24.280 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32801.log.gz 2024-09-12T18:15:24.281 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33232.log 2024-09-12T18:15:24.281 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.116868.log: /var/log/ceph/ceph-client.admin.139252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133361.log 2024-09-12T18:15:24.281 INFO:teuthology.orchestra.run.smithi067.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.116868.log.gz 2024-09-12T18:15:24.281 INFO:teuthology.orchestra.run.smithi067.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.139252.log.gz 2024-09-12T18:15:24.281 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.33232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193943.log 2024-09-12T18:15:24.281 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33232.log.gz 2024-09-12T18:15:24.281 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.133361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39698.log 2024-09-12T18:15:24.281 INFO:teuthology.orchestra.run.smithi067.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.133361.log.gz 2024-09-12T18:15:24.281 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.193943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180706.log 2024-09-12T18:15:24.281 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193943.log.gz 2024-09-12T18:15:24.281 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122169.log 2024-09-12T18:15:24.282 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39698.log.gz 2024-09-12T18:15:24.282 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.180706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125704.log 2024-09-12T18:15:24.282 INFO:teuthology.orchestra.run.smithi067.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.180706.log.gz 2024-09-12T18:15:24.282 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.122169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148676.log 2024-09-12T18:15:24.282 INFO:teuthology.orchestra.run.smithi067.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.122169.log.gz 2024-09-12T18:15:24.282 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119224.log 2024-09-12T18:15:24.282 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.125704.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.125704.log.gz 2024-09-12T18:15:24.282 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.148676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63840.log 2024-09-12T18:15:24.282 INFO:teuthology.orchestra.run.smithi067.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.148676.log.gz 2024-09-12T18:15:24.282 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191347.log 2024-09-12T18:15:24.283 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.119224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57881.log 2024-09-12T18:15:24.283 INFO:teuthology.orchestra.run.smithi067.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.119224.log.gz 2024-09-12T18:15:24.283 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.63840.log: 57.7% -- replaced with /var/log/ceph/ceph-client.admin.63840.log.gz 2024-09-12T18:15:24.283 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.191347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159280.log 2024-09-12T18:15:24.283 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191347.log.gz 2024-09-12T18:15:24.283 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166466.log 2024-09-12T18:15:24.283 INFO:teuthology.orchestra.run.smithi067.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.57881.log.gz 2024-09-12T18:15:24.283 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.159280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158691.log 2024-09-12T18:15:24.283 INFO:teuthology.orchestra.run.smithi067.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.159280.log.gz 2024-09-12T18:15:24.283 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.166466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61511.log 2024-09-12T18:15:24.283 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193667.log 2024-09-12T18:15:24.283 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.158691.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.166466.log.gz 2024-09-12T18:15:24.284 INFO:teuthology.orchestra.run.smithi067.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.158691.log.gz 2024-09-12T18:15:24.284 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.61511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120402.log 2024-09-12T18:15:24.284 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59059.log 2024-09-12T18:15:24.284 INFO:teuthology.orchestra.run.smithi067.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.61511.log.gz 2024-09-12T18:15:24.284 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.193667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193667.log.gz 2024-09-12T18:15:24.284 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.120402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51354.log 2024-09-12T18:15:24.284 INFO:teuthology.orchestra.run.smithi067.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.120402.log.gz 2024-09-12T18:15:24.284 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128060.log 2024-09-12T18:15:24.284 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59059.log.gz 2024-09-12T18:15:24.284 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184360.log 2024-09-12T18:15:24.285 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51354.log: gzip/var/log/ceph/ceph-client.admin.128060.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.147498.log 2024-09-12T18:15:24.285 INFO:teuthology.orchestra.run.smithi067.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.51354.log.gz 2024-09-12T18:15:24.285 INFO:teuthology.orchestra.run.smithi067.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.128060.log.gz 2024-09-12T18:15:24.285 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.184360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39475.log 2024-09-12T18:15:24.285 INFO:teuthology.orchestra.run.smithi067.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.184360.log.gz 2024-09-12T18:15:24.285 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.147498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154567.log 2024-09-12T18:15:24.285 INFO:teuthology.orchestra.run.smithi067.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.147498.log.gz 2024-09-12T18:15:24.285 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44458.log 2024-09-12T18:15:24.285 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39475.log.gz 2024-09-12T18:15:24.285 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95664.log 2024-09-12T18:15:24.285 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.154567.log: /var/log/ceph/ceph-client.0.44458.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.154567.log.gz 2024-09-12T18:15:24.286 INFO:teuthology.orchestra.run.smithi067.stderr: 44.2%gzip -- replaced with /var/log/ceph/ceph-client.0.44458.log.gz -5 2024-09-12T18:15:24.286 INFO:teuthology.orchestra.run.smithi067.stderr: --verbose -- /var/log/ceph/ceph-client.0.77420.log 2024-09-12T18:15:24.286 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.192117.log 2024-09-12T18:15:24.286 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.95664.log: /var/log/ceph/ceph-client.0.77420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169090.log 2024-09-12T18:15:24.286 INFO:teuthology.orchestra.run.smithi067.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.95664.log.gz 2024-09-12T18:15:24.286 INFO:teuthology.orchestra.run.smithi067.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.77420.log.gz 2024-09-12T18:15:24.286 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.192117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137485.log 2024-09-12T18:15:24.286 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43855.log 2024-09-12T18:15:24.286 INFO:teuthology.orchestra.run.smithi067.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.192117.log.gz 2024-09-12T18:15:24.286 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.169090.log: 83.1% -- replaced with /var/log/ceph/ceph-client.0.169090.log.gz 2024-09-12T18:15:24.286 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.137485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165829.log 2024-09-12T18:15:24.287 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193759.log 2024-09-12T18:15:24.287 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.43855.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.137485.log.gz 2024-09-12T18:15:24.287 INFO:teuthology.orchestra.run.smithi067.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.43855.log.gz 2024-09-12T18:15:24.287 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.165829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183751.log 2024-09-12T18:15:24.287 INFO:teuthology.orchestra.run.smithi067.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.165829.log.gz 2024-09-12T18:15:24.287 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70683.log 2024-09-12T18:15:24.287 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.193759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193759.log.gz 2024-09-12T18:15:24.287 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.183751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161047.log 2024-09-12T18:15:24.287 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.70683.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.183751.log.gz 2024-09-12T18:15:24.287 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194035.log 2024-09-12T18:15:24.288 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.161047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75479.log 2024-09-12T18:15:24.288 INFO:teuthology.orchestra.run.smithi067.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.161047.log.gz 2024-09-12T18:15:24.288 INFO:teuthology.orchestra.run.smithi067.stderr:gzip/var/log/ceph/ceph-client.admin.194035.log: -5 --verbose -- 0.0% /var/log/ceph/ceph.audit.log 2024-09-12T18:15:24.288 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.194035.log.gz 2024-09-12T18:15:24.288 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39083.log 2024-09-12T18:15:24.288 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53145.log 89.6% -- replaced with /var/log/ceph/ceph-client.admin.75479.log.gz 2024-09-12T18:15:24.288 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T18:15:24.288 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39083.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.70683.log.gz 2024-09-12T18:15:24.288 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39083.log.gz 2024-09-12T18:15:24.288 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161658.log 2024-09-12T18:15:24.289 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38707.log 2024-09-12T18:15:24.289 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53145.log.gz 2024-09-12T18:15:24.289 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.161658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89774.log 2024-09-12T18:15:24.289 INFO:teuthology.orchestra.run.smithi067.stderr: 82.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.192810.log 2024-09-12T18:15:24.289 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.161658.log.gz/var/log/ceph/ceph-client.admin.38707.log: 2024-09-12T18:15:24.289 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38707.log.gz 2024-09-12T18:15:24.289 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38713.log 2024-09-12T18:15:24.289 INFO:teuthology.orchestra.run.smithi067.stderr: 81.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193851.log 2024-09-12T18:15:24.289 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.89774.log.gz/var/log/ceph/ceph-client.0.192810.log: 2024-09-12T18:15:24.289 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.38713.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38713.log.gz 2024-09-12T18:15:24.290 INFO:teuthology.orchestra.run.smithi067.stderr: --verbose -- /var/log/ceph/ceph-client.admin.83295.log 2024-09-12T18:15:24.290 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.193851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193851.log.gz 2024-09-12T18:15:24.290 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T18:15:24.290 INFO:teuthology.orchestra.run.smithi067.stderr: -- /var/log/ceph/ceph-client.admin.39071.log 2024-09-12T18:15:24.290 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.83295.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.83295.log.gz 2024-09-12T18:15:24.290 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155157.log 2024-09-12T18:15:24.290 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39071.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39071.log.gz -5 2024-09-12T18:15:24.290 INFO:teuthology.orchestra.run.smithi067.stderr: --verbose -- /var/log/ceph/ceph-client.admin.194588.log 2024-09-12T18:15:24.290 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39082.log 2024-09-12T18:15:24.290 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.155157.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.155157.log.gz 2024-09-12T18:15:24.291 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.194588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38706.log 2024-09-12T18:15:24.291 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194588.log.gz 2024-09-12T18:15:24.291 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39082.log.gz 2024-09-12T18:15:24.291 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.186187.log 2024-09-12T18:15:24.291 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78739.log 2024-09-12T18:15:24.291 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.38706.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38706.log.gz 2024-09-12T18:15:24.291 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.186187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95075.log 2024-09-12T18:15:24.291 INFO:teuthology.orchestra.run.smithi067.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.0.186187.log.gz 2024-09-12T18:15:24.291 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59696.log 2024-09-12T18:15:24.291 INFO:teuthology.orchestra.run.smithi067.stderr: 49.7% -- replaced with /var/log/ceph/ceph-client.admin.78739.log.gz 2024-09-12T18:15:24.291 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.95075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108622.log 2024-09-12T18:15:24.292 INFO:teuthology.orchestra.run.smithi067.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.95075.log.gz 2024-09-12T18:15:24.292 INFO:teuthology.orchestra.run.smithi067.stderr:gzip/var/log/ceph/ceph-client.admin.59696.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.56703.log 2024-09-12T18:15:24.292 INFO:teuthology.orchestra.run.smithi067.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.59696.log.gz 2024-09-12T18:15:24.292 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.108622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39744.log 2024-09-12T18:15:24.292 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177631.log 2024-09-12T18:15:24.292 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39744.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.56703.log.gz 2024-09-12T18:15:24.292 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190051.log 2024-09-12T18:15:24.292 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39744.log.gz 2024-09-12T18:15:24.292 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39652.log 2024-09-12T18:15:24.292 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.177631.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.108622.log.gz 2024-09-12T18:15:24.292 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.190051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194311.log 2024-09-12T18:15:24.293 INFO:teuthology.orchestra.run.smithi067.stderr: 80.4%/var/log/ceph/ceph-client.admin.39652.log: -- replaced with /var/log/ceph/ceph-client.admin.190051.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191422.log 2024-09-12T18:15:24.293 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T18:15:24.293 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39652.log.gz 2024-09-12T18:15:24.293 INFO:teuthology.orchestra.run.smithi067.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.177631.log.gz 2024-09-12T18:15:24.293 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.194311.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194311.log.gz 2024-09-12T18:15:24.293 INFO:teuthology.orchestra.run.smithi067.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.126882.log 2024-09-12T18:15:24.293 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.191422.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.191422.log.gz 2024-09-12T18:15:24.293 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144553.log 2024-09-12T18:15:24.293 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77251.log 2024-09-12T18:15:24.293 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.126882.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.126882.log.gz 2024-09-12T18:15:24.293 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.144553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134539.log 2024-09-12T18:15:24.294 INFO:teuthology.orchestra.run.smithi067.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.144553.log.gz 2024-09-12T18:15:24.294 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.77251.log: 26.2% -- replaced with /var/log/ceph/ceph-client.admin.77251.log.gz 2024-09-12T18:15:24.294 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87418.log 2024-09-12T18:15:24.294 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193989.log 2024-09-12T18:15:24.294 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.134539.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.134539.log.gz 2024-09-12T18:15:24.294 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123936.log 2024-09-12T18:15:24.294 INFO:teuthology.orchestra.run.smithi067.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.87418.log.gz 2024-09-12T18:15:24.294 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.193989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193989.log.gz 2024-09-12T18:15:24.294 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64239.log 2024-09-12T18:15:24.294 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92130.log 2024-09-12T18:15:24.294 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.123936.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.123936.log.gz 2024-09-12T18:15:24.295 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.64239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76660.log 2024-09-12T18:15:24.295 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64239.log.gz 2024-09-12T18:15:24.295 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.92130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52532.log 2024-09-12T18:15:24.295 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.76660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62689.log 2024-09-12T18:15:24.295 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52532.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-12T18:15:24.295 INFO:teuthology.orchestra.run.smithi067.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.76660.log.gz 2024-09-12T18:15:24.295 INFO:teuthology.orchestra.run.smithi067.stderr: 80.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48361.log 2024-09-12T18:15:24.295 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52532.log.gz 2024-09-12T18:15:24.295 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.62689.log: /var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43252.log 2024-09-12T18:15:24.295 INFO:teuthology.orchestra.run.smithi067.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.92130.log.gz 2024-09-12T18:15:24.296 INFO:teuthology.orchestra.run.smithi067.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.62689.log.gz 2024-09-12T18:15:24.296 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48361.log: gzip -5 82.7% -- replaced with /var/log/ceph/ceph-client.admin.48361.log.gz 2024-09-12T18:15:24.296 INFO:teuthology.orchestra.run.smithi067.stderr: --verbose -- /var/log/ceph/ceph-client.admin.156335.log 2024-09-12T18:15:24.296 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.43252.log: 43.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118046.log 2024-09-12T18:15:24.296 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.0.43252.log.gz 2024-09-12T18:15:24.296 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.156335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118635.log 2024-09-12T18:15:24.296 INFO:teuthology.orchestra.run.smithi067.stderr: 81.8%/var/log/ceph/ceph-client.admin.118046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82117.log 2024-09-12T18:15:24.296 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.156335.log.gz 2024-09-12T18:15:24.296 INFO:teuthology.orchestra.run.smithi067.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.118046.log.gz 2024-09-12T18:15:24.296 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151622.log 2024-09-12T18:15:24.296 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.118635.log: /var/log/ceph/ceph-client.admin.82117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151033.log 2024-09-12T18:15:24.297 INFO:teuthology.orchestra.run.smithi067.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.118635.log.gz 2024-09-12T18:15:24.297 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.151622.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.82117.log.gz 2024-09-12T18:15:24.297 INFO:teuthology.orchestra.run.smithi067.stderr: 81.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132772.log 2024-09-12T18:15:24.297 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.151622.log.gz 2024-09-12T18:15:24.297 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.151033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143964.log 2024-09-12T18:15:24.297 INFO:teuthology.orchestra.run.smithi067.stderr: 81.9%/var/log/ceph/ceph-client.admin.132772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180097.log 2024-09-12T18:15:24.297 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.151033.log.gz 2024-09-12T18:15:24.297 INFO:teuthology.orchestra.run.smithi067.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.132772.log.gz 2024-09-12T18:15:24.297 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.143964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50741.log 2024-09-12T18:15:24.297 INFO:teuthology.orchestra.run.smithi067.stderr: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-12T18:15:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.180097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89185.log 84.2% -- replaced with /var/log/ceph/ceph-client.0.180097.log.gz 2024-09-12T18:15:24.298 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T18:15:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50741.log.gz 2024-09-12T18:15:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38916.log 2024-09-12T18:15:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89185.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.143964.log.gz 2024-09-12T18:15:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:gzip 82.0% -- replaced with /var/log/ceph/ceph-client.admin.89185.log.gz 2024-09-12T18:15:24.298 INFO:teuthology.orchestra.run.smithi067.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39072.log 2024-09-12T18:15:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.38916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191323.log 2024-09-12T18:15:24.298 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38916.log.gz 2024-09-12T18:15:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39072.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.39072.log.gz -- 2024-09-12T18:15:24.299 INFO:teuthology.orchestra.run.smithi067.stderr: /var/log/ceph/ceph-client.admin.149265.log 2024-09-12T18:15:24.299 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.191323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121580.log 2024-09-12T18:15:24.299 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191323.log.gz 2024-09-12T18:15:24.299 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.149265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66347.log 2024-09-12T18:15:24.299 INFO:teuthology.orchestra.run.smithi067.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.149265.log.gz 2024-09-12T18:15:24.299 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.121580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40154.log 2024-09-12T18:15:24.299 INFO:teuthology.orchestra.run.smithi067.stderr:gzip/var/log/ceph/ceph-client.admin.66347.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.121580.log.gz 2024-09-12T18:15:24.299 INFO:teuthology.orchestra.run.smithi067.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.68826.log 2024-09-12T18:15:24.299 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.40154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40154.log.gz 2024-09-12T18:15:24.299 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T18:15:24.299 INFO:teuthology.orchestra.run.smithi067.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.66347.log.gz 2024-09-12T18:15:24.300 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191301.log 2024-09-12T18:15:24.300 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.68826.log: /var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194219.log 2024-09-12T18:15:24.300 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.191301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150444.log 2024-09-12T18:15:24.300 INFO:teuthology.orchestra.run.smithi067.stderr: 25.4% -- replaced with /var/log/ceph/ceph-client.admin.191301.log.gz 2024-09-12T18:15:24.300 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.194219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194219.log.gz 2024-09-12T18:15:24.300 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131594.log 2024-09-12T18:15:24.300 INFO:teuthology.orchestra.run.smithi067.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.68826.log.gz 2024-09-12T18:15:24.300 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.150444.log: gzip -5 --verbose 82.5% -- replaced with /var/log/ceph/ceph-client.admin.150444.log.gz 2024-09-12T18:15:24.300 INFO:teuthology.orchestra.run.smithi067.stderr: -- /var/log/ceph/ceph-client.admin.136895.log 2024-09-12T18:15:24.300 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.131594.log: gzip -5 --verbose 81.9% -- replaced with /var/log/ceph/ceph-client.admin.131594.log.gz 2024-09-12T18:15:24.300 INFO:teuthology.orchestra.run.smithi067.stderr: -- /var/log/ceph/ceph-client.admin.81528.log 2024-09-12T18:15:24.301 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.136895.log: gzip -5 --verbose 81.2% -- replaced with /var/log/ceph/ceph-client.admin.136895.log.gz 2024-09-12T18:15:24.301 INFO:teuthology.orchestra.run.smithi067.stderr: -- /var/log/ceph/ceph-client.0.181924.log 2024-09-12T18:15:24.301 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81528.log: gzip -5 --verbose 81.6% -- replaced with /var/log/ceph/ceph-client.admin.81528.log.gz 2024-09-12T18:15:24.301 INFO:teuthology.orchestra.run.smithi067.stderr: -- /var/log/ceph/ceph-client.admin.62100.log 2024-09-12T18:15:24.301 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.181924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100965.log 84.1% -- replaced with /var/log/ceph/ceph-client.0.181924.log.gz 2024-09-12T18:15:24.301 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T18:15:24.301 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.62100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65725.log 2024-09-12T18:15:24.301 INFO:teuthology.orchestra.run.smithi067.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.62100.log.gz 2024-09-12T18:15:24.301 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.100965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90952.log 2024-09-12T18:15:24.301 INFO:teuthology.orchestra.run.smithi067.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.100965.log.gz 2024-09-12T18:15:24.302 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40177.log 2024-09-12T18:15:24.302 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.65725.log: /var/log/ceph/ceph-client.admin.90952.log: 81.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39474.log 2024-09-12T18:15:24.302 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.90952.log.gz 2024-09-12T18:15:24.302 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.40177.log: 86.9% -- replaced with /var/log/ceph/ceph-client.0.192810.log.gz 2024-09-12T18:15:24.302 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136306.log 2024-09-12T18:15:24.302 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39474.log.gz 2024-09-12T18:15:24.302 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99198.log 2024-09-12T18:15:24.302 INFO:teuthology.orchestra.run.smithi067.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.0.40177.log.gz 2024-09-12T18:15:24.302 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5/var/log/ceph/ceph-client.admin.136306.log: --verbose -- /var/log/ceph/ceph-client.admin.194449.log 2024-09-12T18:15:24.302 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.99198.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.136306.log.gz 2024-09-12T18:15:24.303 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose 81.6% -- replaced with /var/log/ceph/ceph-client.admin.99198.log.gz 2024-09-12T18:15:24.303 INFO:teuthology.orchestra.run.smithi067.stderr: -- /var/log/ceph/ceph-client.admin.140430.log 2024-09-12T18:15:24.303 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.194449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194449.log.gz 2024-09-12T18:15:24.303 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39476.log 2024-09-12T18:15:24.303 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.140430.log: gzip -5 --verbose -- 87.4% -- replaced with /var/log/ceph/ceph-client.admin.140430.log.gz 2024-09-12T18:15:24.303 INFO:teuthology.orchestra.run.smithi067.stderr: /var/log/ceph/ceph-client.admin.167644.log 2024-09-12T18:15:24.303 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39476.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189462.log 2024-09-12T18:15:24.303 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39476.log.gz 2024-09-12T18:15:24.303 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.167644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93308.log 2024-09-12T18:15:24.303 INFO:teuthology.orchestra.run.smithi067.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.167644.log.gz 2024-09-12T18:15:24.303 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103910.log 2024-09-12T18:15:24.304 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.189462.log: /var/log/ceph/ceph-client.admin.93308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70064.log 2024-09-12T18:15:24.304 INFO:teuthology.orchestra.run.smithi067.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.93308.log.gz/var/log/ceph/ceph-client.admin.103910.log: 2024-09-12T18:15:24.304 INFO:teuthology.orchestra.run.smithi067.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.189462.log.gz 2024-09-12T18:15:24.304 INFO:teuthology.orchestra.run.smithi067.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.103910.log.gz 2024-09-12T18:15:24.304 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39070.log 2024-09-12T18:15:24.304 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.70064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57292.log 2024-09-12T18:15:24.304 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39070.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171514.log 2024-09-12T18:15:24.304 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39070.log.gz 2024-09-12T18:15:24.304 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57292.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.57292.log.gz 2024-09-12T18:15:24.304 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138663.log 2024-09-12T18:15:24.305 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.186796.log 2024-09-12T18:15:24.305 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.171514.log: /var/log/ceph/ceph-client.admin.138663.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.138663.log.gz 2024-09-12T18:15:24.305 INFO:teuthology.orchestra.run.smithi067.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.171514.log.gz 2024-09-12T18:15:24.305 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41998.log 2024-09-12T18:15:24.305 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114512.log 2024-09-12T18:15:24.305 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.186796.log: /var/log/ceph/ceph-client.0.41998.log: 83.8% -- replaced with /var/log/ceph/ceph-client.0.186796.log.gz 2024-09-12T18:15:24.305 INFO:teuthology.orchestra.run.smithi067.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.41998.log.gz 2024-09-12T18:15:24.305 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174094.log 2024-09-12T18:15:24.305 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127471.log 2024-09-12T18:15:24.306 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.114512.log: /var/log/ceph/ceph-client.admin.174094.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.114512.log.gz 2024-09-12T18:15:24.306 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88007.log 2024-09-12T18:15:24.306 INFO:teuthology.orchestra.run.smithi067.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.174094.log.gz 2024-09-12T18:15:24.306 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.127471.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.127471.log.gz 2024-09-12T18:15:24.306 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55525.log 2024-09-12T18:15:24.306 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T18:15:24.306 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88007.log: /var/log/ceph/ceph-client.admin.55525.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.88007.log.gz 2024-09-12T18:15:24.306 INFO:teuthology.orchestra.run.smithi067.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.55525.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159869.log 2024-09-12T18:15:24.306 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T18:15:24.306 INFO:teuthology.orchestra.run.smithi067.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.65725.log.gz 2024-09-12T18:15:24.306 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132183.log 2024-09-12T18:15:24.307 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.159869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128649.log 2024-09-12T18:15:24.307 INFO:teuthology.orchestra.run.smithi067.stderr: 82.0%/var/log/ceph/ceph-client.admin.132183.log: -- replaced with /var/log/ceph/ceph-client.admin.159869.log.gz 2024-09-12T18:15:24.307 INFO:teuthology.orchestra.run.smithi067.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.132183.log.gz 2024-09-12T18:15:24.307 INFO:teuthology.orchestra.run.smithi067.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.70064.log.gz 2024-09-12T18:15:24.307 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193805.log 2024-09-12T18:15:24.307 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.128649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175918.log 2024-09-12T18:15:24.307 INFO:teuthology.orchestra.run.smithi067.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.128649.log.gz/var/log/ceph/ceph-client.admin.193805.log: 2024-09-12T18:15:24.307 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38716.log 2024-09-12T18:15:24.307 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193805.log.gz 2024-09-12T18:15:24.307 INFO:teuthology.orchestra.run.smithi067.stderr:gzip/var/log/ceph/ceph-client.admin.175918.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.91541.log 2024-09-12T18:15:24.307 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71302.log 2024-09-12T18:15:24.308 INFO:teuthology.orchestra.run.smithi067.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.175918.log.gz 2024-09-12T18:15:24.308 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.38716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38716.log.gz 2024-09-12T18:15:24.308 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.91541.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.91541.log.gz 2024-09-12T18:15:24.308 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63950.log 2024-09-12T18:15:24.308 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146320.log 2024-09-12T18:15:24.308 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.71302.log: /var/log/ceph/ceph-client.admin.63950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152211.log 2024-09-12T18:15:24.308 INFO:teuthology.orchestra.run.smithi067.stderr: 48.1% -- replaced with /var/log/ceph/ceph-client.admin.63950.log.gz 2024-09-12T18:15:24.308 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.146320.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.146320.log.gz 2024-09-12T18:15:24.332 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71302.log.gz 2024-09-12T18:15:24.332 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69445.log 2024-09-12T18:15:24.332 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64365.log 2024-09-12T18:15:24.332 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.152211.log: /var/log/ceph/ceph-client.admin.69445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56114.log 2024-09-12T18:15:24.332 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.64365.log: 55.6% -- replaced with /var/log/ceph/ceph-client.admin.64365.log.gz 2024-09-12T18:15:24.332 INFO:teuthology.orchestra.run.smithi067.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.152211.log.gz 2024-09-12T18:15:24.333 INFO:teuthology.orchestra.run.smithi067.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.69445.log.gz 2024-09-12T18:15:24.333 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194357.log 2024-09-12T18:15:24.333 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50717.log 2024-09-12T18:15:24.333 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56114.log: /var/log/ceph/ceph-client.admin.194357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39081.log 2024-09-12T18:15:24.333 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194357.log.gz 2024-09-12T18:15:24.333 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50717.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.56114.log.gz 2024-09-12T18:15:24.333 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50717.log.gz 2024-09-12T18:15:24.333 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106855.log 2024-09-12T18:15:24.333 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64301.log 2024-09-12T18:15:24.333 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39081.log: /var/log/ceph/ceph-client.admin.106855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194680.log 2024-09-12T18:15:24.333 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39081.log.gz 2024-09-12T18:15:24.334 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.64301.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.106855.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172730.log 2024-09-12T18:15:24.334 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T18:15:24.334 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.194680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194680.log.gz 2024-09-12T18:15:24.334 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166442.log 2024-09-12T18:15:24.334 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47446.log 2024-09-12T18:15:24.334 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.172730.log: /var/log/ceph/ceph-client.admin.166442.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166442.log.gz 2024-09-12T18:15:24.334 INFO:teuthology.orchestra.run.smithi067.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.172730.log.gz 2024-09-12T18:15:24.334 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130416.log 2024-09-12T18:15:24.334 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115101.log 2024-09-12T18:15:24.334 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47446.log: /var/log/ceph/ceph-client.admin.130416.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.47446.log.gz 2024-09-12T18:15:24.334 INFO:teuthology.orchestra.run.smithi067.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.130416.log.gz 2024-09-12T18:15:24.335 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174702.log 2024-09-12T18:15:24.335 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.115101.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.115101.log.gz 2024-09-12T18:15:24.335 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194081.log 2024-09-12T18:15:24.335 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T18:15:24.335 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.174702.log: /var/log/ceph/ceph-client.admin.194081.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194081.log.gz 2024-09-12T18:15:24.335 INFO:teuthology.orchestra.run.smithi067.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.174702.log.gz 2024-09-12T18:15:24.335 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74886.log 2024-09-12T18:15:24.335 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165240.log 2024-09-12T18:15:24.335 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.74886.log: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.74886.log.gz 2024-09-12T18:15:24.335 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64301.log.gz 2024-09-12T18:15:24.335 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39472.log 2024-09-12T18:15:24.336 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.165240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131005.log 2024-09-12T18:15:24.336 INFO:teuthology.orchestra.run.smithi067.stderr: 81.1%/var/log/ceph/ceph-client.admin.39472.log: -- replaced with /var/log/ceph/ceph-client.admin.165240.log.gz 2024-09-12T18:15:24.336 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39472.log.gz 2024-09-12T18:15:24.336 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26720.log 2024-09-12T18:15:24.336 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.131005.log: gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-09-12T18:15:24.336 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph.tmp-client.admin.26720.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.131005.log.gz 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26720.log.gz 2024-09-12T18:15:24.336 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T18:15:24.336 INFO:teuthology.orchestra.run.smithi067.stderr: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T18:15:24.336 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90363.log 2024-09-12T18:15:24.336 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/valgrind/ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191398.log 2024-09-12T18:15:24.337 INFO:teuthology.orchestra.run.smithi067.stderr: 62.7% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-09-12T18:15:24.337 INFO:teuthology.orchestra.run.smithi067.stderr:gzip/var/log/ceph/ceph-client.admin.90363.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.64427.log 2024-09-12T18:15:24.337 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.191398.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.90363.log.gz 2024-09-12T18:15:24.337 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38708.log 2024-09-12T18:15:24.337 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191398.log.gz 2024-09-12T18:15:24.337 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.64427.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T18:15:24.337 INFO:teuthology.orchestra.run.smithi067.stderr: 91.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109800.log 2024-09-12T18:15:24.337 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64427.log.gz 2024-09-12T18:15:24.337 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.38708.log: /var/log/ceph/ceph-mgr.y.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38708.log.gz 2024-09-12T18:15:24.337 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80939.log 2024-09-12T18:15:24.338 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.109800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85651.log 2024-09-12T18:15:24.338 INFO:teuthology.orchestra.run.smithi067.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.109800.log.gz 2024-09-12T18:15:24.338 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.80939.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.80939.log.gz 2024-09-12T18:15:24.338 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108033.log 2024-09-12T18:15:24.338 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85062.log 2024-09-12T18:15:24.338 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.108033.log: /var/log/ceph/ceph-client.admin.85651.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.108033.log.gz 2024-09-12T18:15:24.338 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.85651.log.gz 2024-09-12T18:15:24.338 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94486.log 2024-09-12T18:15:24.338 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.85062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86829.log 2024-09-12T18:15:24.338 INFO:teuthology.orchestra.run.smithi067.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.85062.log.gz 2024-09-12T18:15:24.338 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.94486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193621.log 2024-09-12T18:15:24.339 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.86829.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.94486.log.gz 2024-09-12T18:15:24.339 INFO:teuthology.orchestra.run.smithi067.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.86829.log.gz 2024-09-12T18:15:24.339 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107444.log 2024-09-12T18:15:24.339 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141019.log 2024-09-12T18:15:24.339 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.107444.log: /var/log/ceph/ceph-client.admin.193621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193621.log.gz 2024-09-12T18:15:24.339 INFO:teuthology.orchestra.run.smithi067.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.107444.log.gz 2024-09-12T18:15:24.339 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T18:15:24.339 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48950.log 2024-09-12T18:15:24.339 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.141019.log: /var/log/ceph/ceph.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.141019.log.gz 2024-09-12T18:15:24.339 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38364.log 2024-09-12T18:15:24.339 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48950.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.48950.log.gz 2024-09-12T18:15:24.340 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193713.log 2024-09-12T18:15:24.340 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.38364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38364.log.gz 2024-09-12T18:15:24.340 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39377.log 2024-09-12T18:15:24.340 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.193713.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193713.log.gz 2024-09-12T18:15:24.340 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79484.log 2024-09-12T18:15:24.340 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39377.log.gz 2024-09-12T18:15:24.340 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72540.log 2024-09-12T18:15:24.340 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.79484.log: 80.2% -- replaced with /var/log/ceph/ceph-client.0.79484.log.gz 2024-09-12T18:15:24.340 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146909.log 2024-09-12T18:15:24.340 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.72540.log: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.72540.log.gz 2024-09-12T18:15:24.340 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38456.log 2024-09-12T18:15:24.341 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.146909.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.146909.log.gz 2024-09-12T18:15:24.341 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123347.log 2024-09-12T18:15:24.341 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.38456.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38456.log.gz 2024-09-12T18:15:24.341 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60285.log 2024-09-12T18:15:24.341 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.123347.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.123347.log.gz 2024-09-12T18:15:24.397 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113923.log 2024-09-12T18:15:24.397 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.60285.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.60285.log.gz 2024-09-12T18:15:24.397 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125115.log 2024-09-12T18:15:24.397 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.113923.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.113923.log.gz 2024-09-12T18:15:24.397 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38281.log 2024-09-12T18:15:24.397 INFO:teuthology.orchestra.run.smithi067.stderr: 93.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T18:15:24.397 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.125115.log: 81.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39308.log 2024-09-12T18:15:24.397 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.125115.log.gz 2024-09-12T18:15:24.398 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.38281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38281.log.gz 2024-09-12T18:15:24.398 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58470.log 2024-09-12T18:15:24.398 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38217.log 2024-09-12T18:15:24.398 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39308.log.gz 2024-09-12T18:15:24.398 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.58470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145731.log 2024-09-12T18:15:24.398 INFO:teuthology.orchestra.run.smithi067.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.58470.log.gz 2024-09-12T18:15:24.398 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.38217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65136.log 2024-09-12T18:15:24.398 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0%/var/log/ceph/ceph-client.admin.145731.log: -- replaced with /var/log/ceph/ceph-client.admin.38217.log.gz 2024-09-12T18:15:24.398 INFO:teuthology.orchestra.run.smithi067.stderr: 87.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98609.log 2024-09-12T18:15:24.398 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.145731.log.gz 2024-09-12T18:15:24.398 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153978.log 2024-09-12T18:15:24.399 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.65136.log: /var/log/ceph/ceph-client.admin.98609.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.65136.log.gz 2024-09-12T18:15:24.399 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106266.log 2024-09-12T18:15:24.399 INFO:teuthology.orchestra.run.smithi067.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.98609.log.gz 2024-09-12T18:15:24.399 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.153978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164627.log 2024-09-12T18:15:24.399 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.106266.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.106266.log.gz 2024-09-12T18:15:24.399 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115690.log 2024-09-12T18:15:24.399 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.164627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164627.log.gz 2024-09-12T18:15:24.399 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51943.log 2024-09-12T18:15:24.399 INFO:teuthology.orchestra.run.smithi067.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.153978.log.gz 2024-09-12T18:15:24.399 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.115690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103321.log 2024-09-12T18:15:24.399 INFO:teuthology.orchestra.run.smithi067.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.115690.log.gz 2024-09-12T18:15:24.400 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96253.log 2024-09-12T18:15:24.400 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.103321.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.51943.log.gz 2024-09-12T18:15:24.400 INFO:teuthology.orchestra.run.smithi067.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.103321.log.gz 2024-09-12T18:15:24.400 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110978.log 2024-09-12T18:15:24.400 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61487.log 2024-09-12T18:15:24.400 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.110978.log: /var/log/ceph/ceph-client.admin.96253.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.96253.log.gz 2024-09-12T18:15:24.400 INFO:teuthology.orchestra.run.smithi067.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.110978.log.gz 2024-09-12T18:15:24.400 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190641.log 2024-09-12T18:15:24.400 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.61487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61487.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38410.log 2024-09-12T18:15:24.400 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T18:15:24.400 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59083.log 2024-09-12T18:15:24.400 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.38410.log: /var/log/ceph/ceph-client.admin.190641.log: 24.6% -- replaced with /var/log/ceph/ceph-client.admin.190641.log.gz 2024-09-12T18:15:24.401 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38410.log.gz 2024-09-12T18:15:24.401 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149855.log 2024-09-12T18:15:24.401 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40022.log 2024-09-12T18:15:24.401 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59083.log.gz 2024-09-12T18:15:24.401 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.149855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53758.log 2024-09-12T18:15:24.401 INFO:teuthology.orchestra.run.smithi067.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.149855.log.gz 2024-09-12T18:15:24.401 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.40022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78029.log 2024-09-12T18:15:24.401 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53758.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40022.log.gz 2024-09-12T18:15:24.401 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194634.log 2024-09-12T18:15:24.401 INFO:teuthology.orchestra.run.smithi067.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.53758.log.gz 2024-09-12T18:15:24.401 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.78029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73204.log 2024-09-12T18:15:24.402 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.194634.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.78029.log.gz 2024-09-12T18:15:24.402 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194634.log.gz 2024-09-12T18:15:24.402 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183142.log 2024-09-12T18:15:24.402 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.73204.log: /var/log/ceph/ceph-client.admin.122758.log 2024-09-12T18:15:24.402 INFO:teuthology.orchestra.run.smithi067.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.73204.log.gz 2024-09-12T18:15:24.402 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.183142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133950.log 2024-09-12T18:15:24.402 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.122758.log: 83.8% 81.8% -- replaced with /var/log/ceph/ceph-client.admin.122758.log.gz 2024-09-12T18:15:24.402 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.0.183142.log.gz 2024-09-12T18:15:24.402 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40110.log 2024-09-12T18:15:24.402 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.133950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.188014.log 2024-09-12T18:15:24.402 INFO:teuthology.orchestra.run.smithi067.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.133950.log.gz 2024-09-12T18:15:24.402 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.40110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40110.log.gz 2024-09-12T18:15:24.403 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142786.log 2024-09-12T18:15:24.403 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.188014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129827.log 2024-09-12T18:15:24.403 INFO:teuthology.orchestra.run.smithi067.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.188014.log.gz 2024-09-12T18:15:24.403 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.142786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181315.log 2024-09-12T18:15:24.403 INFO:teuthology.orchestra.run.smithi067.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.142786.log.gz 2024-09-12T18:15:24.403 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.129827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124526.log 2024-09-12T18:15:24.403 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.181315.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.129827.log.gz 2024-09-12T18:15:24.403 INFO:teuthology.orchestra.run.smithi067.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.181315.log.gzgzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T18:15:24.403 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T18:15:24.403 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193575.log 2024-09-12T18:15:24.403 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/rgw.ceph.client.0.log: /var/log/ceph/ceph-client.admin.124526.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.124526.log.gz 2024-09-12T18:15:24.403 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100376.log 2024-09-12T18:15:24.404 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.193575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193575.log.gz 2024-09-12T18:15:24.404 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99787.log 2024-09-12T18:15:24.404 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.100376.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.100376.log.gz 2024-09-12T18:15:24.404 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169739.log 2024-09-12T18:15:24.404 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.99787.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.99787.log.gz 2024-09-12T18:15:24.404 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152800.log 2024-09-12T18:15:24.404 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.169739.log: 95.1% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T18:15:24.404 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184969.log 2024-09-12T18:15:24.404 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.152800.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.152800.log.gz 2024-09-12T18:15:24.404 INFO:teuthology.orchestra.run.smithi067.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.169739.log.gz 2024-09-12T18:15:24.404 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162836.log 2024-09-12T18:15:24.404 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.184969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112745.log 2024-09-12T18:15:24.405 INFO:teuthology.orchestra.run.smithi067.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.184969.log.gz 2024-09-12T18:15:24.405 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.162836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105677.log 2024-09-12T18:15:24.405 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.112745.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.162836.log.gz 2024-09-12T18:15:24.405 INFO:teuthology.orchestra.run.smithi067.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.112745.log.gz 2024-09-12T18:15:24.405 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120991.log 2024-09-12T18:15:24.405 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78875.log 2024-09-12T18:15:24.405 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.105677.log: /var/log/ceph/ceph-client.admin.120991.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.105677.log.gz 2024-09-12T18:15:24.405 INFO:teuthology.orchestra.run.smithi067.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.120991.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49539.log 2024-09-12T18:15:24.405 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T18:15:24.405 INFO:teuthology.orchestra.run.smithi067.stderr:gzip/var/log/ceph/ceph-client.0.78875.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.157513.log 2024-09-12T18:15:24.406 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49539.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.49539.log.gz 2024-09-12T18:15:24.406 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59107.log 2024-09-12T18:15:24.406 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.157513.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.157513.log.gz 2024-09-12T18:15:24.406 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97431.log 2024-09-12T18:15:24.406 INFO:teuthology.orchestra.run.smithi067.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.78875.log.gz 2024-09-12T18:15:24.406 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59107.log: 80.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129238.log 2024-09-12T18:15:24.406 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59107.log.gz 2024-09-12T18:15:24.406 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190711.log 2024-09-12T18:15:24.406 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.97431.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.97431.log.gz 2024-09-12T18:15:24.406 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.129238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98020.log 2024-09-12T18:15:24.406 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.190711.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.190711.log.gz 2024-09-12T18:15:24.407 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158102.log 2024-09-12T18:15:24.407 INFO:teuthology.orchestra.run.smithi067.stderr: 86.1%/var/log/ceph/ceph-client.admin.98020.log: -- replaced with /var/log/ceph/ceph-client.admin.129238.log.gz 2024-09-12T18:15:24.407 INFO:teuthology.orchestra.run.smithi067.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.98020.log.gz 2024-09-12T18:15:24.407 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39375.log 2024-09-12T18:15:24.407 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.158102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54347.log 2024-09-12T18:15:24.407 INFO:teuthology.orchestra.run.smithi067.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.158102.log.gz 2024-09-12T18:15:24.407 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191373.log 2024-09-12T18:15:24.407 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54347.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39375.log.gz 2024-09-12T18:15:24.407 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50128.log 2024-09-12T18:15:24.407 INFO:teuthology.orchestra.run.smithi067.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.54347.log.gz 2024-09-12T18:15:24.407 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.191373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190663.log 2024-09-12T18:15:24.408 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191373.log.gz 2024-09-12T18:15:24.408 INFO:teuthology.orchestra.run.smithi067.stderr: 81.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194265.log 2024-09-12T18:15:24.408 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50128.log.gz 2024-09-12T18:15:24.408 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38710.log 2024-09-12T18:15:24.408 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.190663.log: /var/log/ceph/ceph-client.admin.194265.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190663.log.gz 2024-09-12T18:15:24.408 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.194265.log.gz 2024-09-12T18:15:24.408 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194724.log 2024-09-12T18:15:24.408 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.38710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38710.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.185578.log 2024-09-12T18:15:24.408 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T18:15:24.408 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148087.log 2024-09-12T18:15:24.408 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.185578.log: /var/log/ceph/ceph-client.admin.194724.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194724.log.gz 2024-09-12T18:15:24.409 INFO:teuthology.orchestra.run.smithi067.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.185578.log.gz 2024-09-12T18:15:24.409 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116279.log 2024-09-12T18:15:24.409 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.148087.log: /var/log/ceph/ceph-client.admin.167055.log 2024-09-12T18:15:24.409 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.116279.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.116279.log.gz 2024-09-12T18:15:24.409 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T18:15:24.409 INFO:teuthology.orchestra.run.smithi067.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.148087.log.gz 2024-09-12T18:15:24.409 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.167055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164651.log 2024-09-12T18:15:24.409 INFO:teuthology.orchestra.run.smithi067.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.167055.log.gz 2024-09-12T18:15:24.409 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178879.log 2024-09-12T18:15:24.409 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.164651.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.164651.log.gz 2024-09-12T18:15:24.410 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38705.log 2024-09-12T18:15:24.410 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.178879.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.178879.log.gz 2024-09-12T18:15:24.410 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194403.log 2024-09-12T18:15:24.410 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.38705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38705.log.gz 2024-09-12T18:15:24.410 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111567.log 2024-09-12T18:15:24.410 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.194403.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194403.log.gz 2024-09-12T18:15:24.410 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93897.log 2024-09-12T18:15:24.410 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.111567.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.111567.log.gz 2024-09-12T18:15:24.410 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109211.log 2024-09-12T18:15:24.410 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.93897.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.93897.log.gz 2024-09-12T18:15:24.410 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61463.log 2024-09-12T18:15:24.411 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.109211.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.109211.log.gz 2024-09-12T18:15:24.411 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76069.log 2024-09-12T18:15:24.411 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.61463.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61463.log.gz 2024-09-12T18:15:24.411 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101554.log 2024-09-12T18:15:24.411 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.76069.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.76069.log.gz 2024-09-12T18:15:24.411 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193897.log 2024-09-12T18:15:24.419 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.101554.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.101554.log.gz 2024-09-12T18:15:24.419 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92719.log 2024-09-12T18:15:24.419 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.193897.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193897.log.gz 2024-09-12T18:15:24.419 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172122.log 2024-09-12T18:15:24.419 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.92719.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.92719.log.gz 2024-09-12T18:15:24.420 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86240.log 2024-09-12T18:15:24.420 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.172122.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.172122.log.gz 2024-09-12T18:15:24.420 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164014.log 2024-09-12T18:15:24.420 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.86240.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.86240.log.gz 2024-09-12T18:15:24.420 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33139.log 2024-09-12T18:15:24.420 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.164014.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.164014.log.gz 2024-09-12T18:15:24.420 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138074.log 2024-09-12T18:15:24.420 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.33139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33139.log.gz 2024-09-12T18:15:24.421 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161637.log 2024-09-12T18:15:24.421 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.138074.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.138074.log.gz 2024-09-12T18:15:24.421 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.161637.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161637.log.gz 2024-09-12T18:15:24.913 INFO:teuthology.orchestra.run.smithi118.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T18:15:25.104 INFO:teuthology.orchestra.run.smithi067.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T18:15:25.262 INFO:teuthology.orchestra.run.smithi118.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T18:15:27.870 INFO:teuthology.orchestra.run.smithi067.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T18:15:28.622 INFO:teuthology.orchestra.run.smithi067.stderr: 92.3% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T18:15:30.406 INFO:teuthology.orchestra.run.smithi067.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T18:15:30.623 INFO:teuthology.orchestra.run.smithi118.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T18:15:32.300 INFO:teuthology.orchestra.run.smithi067.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T18:15:32.420 INFO:teuthology.orchestra.run.smithi118.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T18:15:33.998 INFO:teuthology.orchestra.run.smithi118.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T18:15:36.392 INFO:teuthology.orchestra.run.smithi067.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T18:15:41.276 INFO:teuthology.orchestra.run.smithi118.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T18:15:41.278 INFO:teuthology.orchestra.run.smithi118.stderr: 2024-09-12T18:15:41.279 INFO:teuthology.orchestra.run.smithi118.stderr:real 0m17.091s 2024-09-12T18:15:41.279 INFO:teuthology.orchestra.run.smithi118.stderr:user 0m41.810s 2024-09-12T18:15:41.279 INFO:teuthology.orchestra.run.smithi118.stderr:sys 0m1.445s 2024-09-12T18:15:45.038 INFO:teuthology.orchestra.run.smithi067.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T18:15:45.040 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T18:15:45.040 INFO:teuthology.orchestra.run.smithi067.stderr:real 0m20.886s 2024-09-12T18:15:45.040 INFO:teuthology.orchestra.run.smithi067.stderr:user 0m54.569s 2024-09-12T18:15:45.040 INFO:teuthology.orchestra.run.smithi067.stderr:sys 0m1.913s 2024-09-12T18:15:45.040 INFO:tasks.ceph:Archiving logs... 2024-09-12T18:15:45.041 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902701/remote/smithi067/log 2024-09-12T18:15:45.042 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T18:15:52.513 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902701/remote/smithi118/log 2024-09-12T18:15:52.513 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T18:15:58.535 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T18:15:58.547 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T18:15:58.547 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T18:15:58.550 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T18:15:58.658 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T18:15:58.668 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T18:15:58.669 DEBUG:teuthology.orchestra.run.smithi067:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:15:58.674 DEBUG:teuthology.orchestra.run.smithi118:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:15:58.706 INFO:teuthology.orchestra.run.smithi067.stderr:bash: line 1: ntpq: command not found 2024-09-12T18:15:58.708 INFO:teuthology.orchestra.run.smithi118.stderr:bash: line 1: ntpq: command not found 2024-09-12T18:15:58.711 INFO:teuthology.orchestra.run.smithi067.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T18:15:58.711 INFO:teuthology.orchestra.run.smithi067.stdout:=============================================================================== 2024-09-12T18:15:58.711 INFO:teuthology.orchestra.run.smithi067.stdout:^* hv01.front.sepia.ceph.com 3 6 377 53 +869us[ +864us] +/- 55ms 2024-09-12T18:15:58.711 INFO:teuthology.orchestra.run.smithi067.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 119 +200us[ +176us] +/- 66ms 2024-09-12T18:15:58.711 INFO:teuthology.orchestra.run.smithi067.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 55 -1264us[-1269us] +/- 67ms 2024-09-12T18:15:58.711 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T18:15:58.713 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T18:15:58.713 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2024-09-12T18:15:58.713 INFO:teuthology.orchestra.run.smithi118.stdout:^* hv01.front.sepia.ceph.com 3 6 377 59 +851us[ +844us] +/- 55ms 2024-09-12T18:15:58.713 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 116 +196us[ +187us] +/- 66ms 2024-09-12T18:15:58.713 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 -1284us[-1284us] +/- 67ms 2024-09-12T18:15:58.713 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T18:15:58.714 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T18:15:58.759 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T18:15:58.760 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T18:15:58.846 DEBUG:teuthology.orchestra.run.smithi067:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T18:15:58.933 DEBUG:teuthology.orchestra.run.smithi118:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T18:15:59.014 DEBUG:teuthology.orchestra.run.smithi067:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T18:15:59.060 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:15:59.061 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T18:15:59.105 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:15:59.105 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T18:15:59.118 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T18:15:59.147 INFO:teuthology.task.internal:Duration was 5013.790617 seconds 2024-09-12T18:15:59.147 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T18:15:59.281 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T18:15:59.281 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T18:15:59.284 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T18:15:59.339 INFO:teuthology.orchestra.run.smithi067.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T18:15:59.341 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T18:15:59.848 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T18:15:59.849 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi067.front.sepia.ceph.com 2024-09-12T18:15:59.849 DEBUG:teuthology.orchestra.run.smithi067:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T18:15:59.887 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi118.front.sepia.ceph.com 2024-09-12T18:15:59.887 DEBUG:teuthology.orchestra.run.smithi118:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T18:15:59.930 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T18:15:59.930 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T18:15:59.933 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T18:16:00.015 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T18:16:00.015 DEBUG:teuthology.orchestra.run.smithi067:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T18:16:00.017 DEBUG:teuthology.orchestra.run.smithi118:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T18:16:00.139 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T18:16:00.151 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T18:16:00.151 DEBUG:teuthology.orchestra.run.smithi067:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T18:16:00.191 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T18:16:00.230 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T18:16:00.248 DEBUG:teuthology.orchestra.run.smithi067:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:16:00.251 DEBUG:teuthology.orchestra.run.smithi118:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:16:00.286 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = core 2024-09-12T18:16:00.306 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = core 2024-09-12T18:16:00.351 DEBUG:teuthology.orchestra.run.smithi067:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:16:00.379 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:16:00.380 DEBUG:teuthology.orchestra.run.smithi118:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:16:00.419 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:16:00.420 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T18:16:00.432 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T18:16:00.433 DEBUG:teuthology.misc:Transferring archived files from smithi067:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902701/remote/smithi067 2024-09-12T18:16:00.433 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T18:16:00.485 DEBUG:teuthology.misc:Transferring archived files from smithi118:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902701/remote/smithi118 2024-09-12T18:16:00.486 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T18:16:00.532 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T18:16:00.532 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T18:16:00.535 DEBUG:teuthology.orchestra.run.smithi118:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T18:16:00.595 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T18:16:00.609 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T18:16:00.609 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T18:16:00.638 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T18:16:00.639 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T18:16:00.642 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T18:16:00.669 INFO:teuthology.orchestra.run.smithi067.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 18:16 /home/ubuntu/cephtest 2024-09-12T18:16:00.670 INFO:teuthology.orchestra.run.smithi118.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 18:16 /home/ubuntu/cephtest 2024-09-12T18:16:00.671 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T18:16:00.683 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T18:16:00.777 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 5013.790616750717 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T18:16:00.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T18:16:00.862 INFO:teuthology.run:pass